ComputerMediated HumanHuman Communication Every pocket every briefcase every
Computer-Mediated Human-Human Communication Every pocket, every briefcase, every office, and every carries a family of radio-linked talking computers. What do we do with them? Ø Free the user from her geographic location… Ø Low-bit rate audio and video coding, e. g. , speech-driven video synthesis Ø Dereverberation & denoising of audio (local and remote) Ø Virtual libraries – user interface, user trust, semantic search, audiovisual browsing Ø… or from her body… Ø Emotive avatar for social computing and asynchronous meetings Ø User interface for users with disability, e. g. , students with cerebral palsy Ø…or help to feel more at home in her own body, wherever it may be. Ø Automatic schedule, travel, and exercise management Ø Automatic assessment of second-language fluency Ø Avatar-based training in the conversational culture of a second language
Emotive avatar: Purpose Social Computing “Actors are liberated from their bodies: The title character, a 6 -foot-6 blond warrior, is played by middle-aged and self-described ‘plump’ actor Ray Winstone. ” Beowulf aims to change the look of movies, USA Today, 11/9/2007 Tasks that Involve Human Beings “A lack of face-to-face interaction may in some cultures be interpreted as a sign of disrespect or lack of sincerity, particularly in those cultures that value protocol…” The Cultural Vacuum in Online Dispute Resolution, Sharanya Rao, 2004
Other Research § AVICAR audiovisual speech recognition corpus (Motorola-funded): Ø Research users in seven countries Ø Testbed, at Illinois, of the LDG speechreading algorithm and the phoneme restoration HMM § Talkers with cerebral palsy (NSF and NIH funding): Ø ASR outperforms human listeners (low-intelligibility speakers, small vocabulary ASR) § Non-speech audio event detection: Ø University of Illinois team achieved lowest error rate in CHIL (computers in the human loop) competition
- Slides: 3