Monday, April 18, 2011

New Reading: Real-Time Text Technology...

Real-Time Text is a feature that allows users to see text as it is typed into a text interface. It differs from Internet instant messaging (IM) and mobile texting (SMS) in that the characters appear in near real-time as they are typed, not as a block of text after it is written. Real-Time Text is communicating using text that is the closest to voice communication.

Real-time means that something occurs within a fraction of a second. For example, a voice conversation between two or more people happens in real-time. The audio is sent and received immediately by the people. Another example of real-time is a computer game, where the actions of the player are immediately shown on the computer screen.

Real-Time Text is conversational text that is sent and received on a character by character basis. The characters are sent immediately (in a fraction of a second) once typed and also displayed immediately to the receiving person(s). This allows text to be used in the same conversational mode as voice. 

Real-Time Text can be used on its own to enable conversations using text. It can also be used where voice is impractical (such as in noisy environments or meetings), or as an adjunct to voice and video conversations to transfer text information with the audio or video feed. Real-time transcription of a video or audio conference is an example.

Real-Time Text is part of a concept called “Total Conversation” which provides bi-directional real-time exchange of video, text and voice between users in two or more locations.

Real-Time Text is of particular importance for people who are Deaf or Hard of Hearing as a replacement for voice telephony (not a complementary technology).

However, it is expected that Real-Time Text will be adopted by mainstream users as well. In particular, it is a natural extension for other real-time, conversational services such as voice telephony e.g. for use in noisy environments, when you want to communicate during a meeting when voice is not appropriate. It is also very useful for conveying information where exact spelling is important during a voice call, e.g. booking numbers, street addresses, words that are hard to perceive because of different dialects etc.

Technology behind RTT:
At the core of the framework for Real-Time Text over Internet Protocol (IP) networks is the Session Initiation Protocol (SIP) and the Real-Time Text transport standard as currently described in IETF RFC 4103.
 
This framework is designed to be compatible with voice over IP (VoIP) and Video over IP environments. It also builds upon, and is compatible with, the high-level user requirements of deaf, hard of hearing, and speech-impaired users, as described in RFC 3351.

Use of Real-Time Text:
Real-Time Text provides a quite different user experience from Instant Messaging (IM). Real-Time Text and IM (and email) are complementary text services with different capabilities. Real-Time Text allows new services to be created or improve existing services.

Real time Text can be used:
  • In conjunction with voice and/or video in a multimedia communication or on its own, on fixed or mobile accesses
  • By people who want a fast and really interactive means of conversing,
  • In noisy environments where it may be hard to hear,
  • In environments where other people are nearby but where communications privacy is required,
  • To transfer information e.g. numbers, addresses etc, where exactness is necessary,
  • By people who are Deaf or Hard of Hearing or with a speech impairment to communicate with other people , including people who can hear and speak.
  • For relay services to offer real-time conversion between different modes of communication as a service to people who are Deaf or Hard of Hearing or with a speech impairment. E.g. to provide real time captioning of a voice conversation for people who are Hard of Hearing.
  • To provide all voice callers with a convenient means to accurately pass numbers, addresses and other detailed information in text.
  • To allow people who are Deaf or Hard of Hearing or have a speech impairment to use the emergency services without limitations.
  • To offer remote interpreter and transcribing (note taking) services for every user who needs it.

While Real-time Text (RTT) is often used stand-alone, it is also a key component of Total Conversation. Total Conversation is a standardized concept allowing an audiovisual conversation with bidirectional full-duplex real-time transfer of Real-Time Text, video and voice between two or more users. This means that you have RTT with video and voice (audio) simultaneously in the call.

Total Conversation allows people with one or multiple disabilities (for example people who are deaf, hard of hearing, blind or deaf-blind) and people who find them in a situation where the addition of RTT and video to the audio fulfill the conversation needs much better than only audio. For example there is background noise making the voice hard or impossible to understand or the call takes place in a location where voice is inappropriate to use like a library. Or for example where a speaker is heavily accented and only understandable via RTT.

The bottom-line is that Total Conversation enriches the communication for all.

Overview of the current and future projects with RTT and Total Conversation:

This page lists an overview of the current and future (possible) projects where RTT plays a significant part of it.

REACH112 - REsponding to All Citizens needing Help - is an EU project running from 2009-2012 involving 7 European countries. It will implement an accessible alternative to traditional voice telephony that will be suitable for all. While people with disabilities find it hard to communicate with the existing solutions, REACH112 will provide modes of communication so that they will find a way to communicate in each situation, may it be with a live real-time text conversation, with sign language, with lip reading, with voice or with any simultaneous combination of these modes described by the concept of Total Conversation. The service will be of benefit for all. The REACH112 project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Programme by the European Community. The R3TF is in the Advisory Board. Several of our partners are project members.

Transclick - Real time language translation
Transclick provides real-time translation capabilities for cellphones, messaging and collaboration systems. The award winning product offer business-quality translation, on user desktop or in user hand. Initially developed for the US Army, Transclick's patent-protected technology is now available to both consumers, enterprises, government agencies and NGOs. The newest products, the Transclick Instant Messenger (TIM) and Transclick Instant Messenger Mobile (TIMM) allow to type in user's own language and be read in the language of the communication partner.

Also offered are products like the Transclick Handset Client, (THAC) for Blackberry and J2ME smart phones. Specific features include:
·        - Support for 16 languages and translation over email or on-screen
·        - Ability to cache the last 10 messages
·        - Swapping of to/from languages and other ease-of-use features
·        - Ability to retrieve email addresses from your contact list
·        - THAC is the ideal tool to make foreign communication easier for any tourist or business traveler, or any professional who needs to communicate outside their native language in a business setting.

Real Time Text to Speech Project, College of Staten Island Disability Services and Office of Information Technology

The Real Time Speech to Text project is cutting edge technology that has been attempted to utilize in a classroom setting. A hard copy of a professor’s lecture is backed-up onto a secondary storage disc. The project’s main goal is to provide equal access to Deaf and Hard-of-Hearing students who do not use American Sign Language (ASL). The project can also be beneficial to other students because they are able to obtain a hard copy of the lecture.

References:


No comments:

Post a Comment