TAUCHI Tampere Unit for ComputerHuman Interaction Tampere Unit

TAUCHI – Tampere Unit for Computer-Human Interaction Tampere Unit for Human-Computer Interaction University of Tampere Markku Turunen MUMIN workshop, Helsinki, 15 -16. 11. 2002

TAUCHI – Tampere Unit for Computer-Human Interaction Outline Topics • Research themes, context and methods • Applications • Future challenges and topics for discussion

TAUCHI – Tampere Unit for Computer-Human Interaction Research themes Interaction techniques for speech applications • adaptive multilingual speech inputs and output • error handling strategies • interaction (dialogue) management strategies • fusion and fission of multimodal information • information representation in distributed applications • context-awareness, privacy and trust

TAUCHI – Tampere Unit for Computer-Human Interaction Research context Pervasive and mobile settings • multiple simultaneous multiparty dialogues • human-to-computer, human-to-human • implicit modalities: sensor information, position etc. • speaker recognition and verification • telephony applications, mobile settings • special user groups (e. g. visually impaired users)

TAUCHI – Tampere Unit for Computer-Human Interaction Research approach Constructive HCI research • architectures for adaptive applications • prototype applications • support for iterative development • support for evaluation: Wizard of Oz, usability evaluation • support for data (corpus) collection

TAUCHI – Tampere Unit for Computer-Human Interaction Architecture research speech application development framework • a framework for adaptive speech applications • designed especially for multilingual and distributed applications • overall focus on system level adaptivity • current focus on ubiquitous and multimodal applications • Java and XML, freely available • used in several projects and applications

TAUCHI – Tampere Unit for Computer-Human Interaction Application prototypes Jaspis-based speech applications traditional, unimodal applications • speech-based timetable services • multilingual e-mail applications • mobile speech applications • ubiquitous computing applications innovative, multimodal applications

TAUCHI – Tampere Unit for Computer-Human Interaction Applications: Busman (Bussimies) / Interact Speech-enabled timetable services • speech interface for (bus) timetables • “natural” spoken queries • “mass-market” application • two independent versions: – Busman (Bussimies): Tampere version – USIX-Interact: Helsinki version, collaboration with other universities (e. g. UIAH)

TAUCHI – Tampere Unit for Computer-Human Interaction Applications: Mailman (Postimies) / Athos. Mail Multilingual speech-based e-mail systems • Basic e-mail features for telephone users (IMAP/POP 3) • Finnish and English & English / Swedish • ASR + DTMF inputs • Main focus on intelligible and pleasant speech outputs • in collaboration with visually impaired users • Athos. Mail: EU-funded IST project (DUMAS)

TAUCHI – Tampere Unit for Computer-Human Interaction Applications: Mobile applications Mobile speech applications • integration of services • support for group communication (awareness, shared knowledge) • visually impaired users (short message services etc. ) • office environments • mobile usage

TAUCHI – Tampere Unit for Computer-Human Interaction Applications: Doorman (Ovimies) Speech-based ubicomp systems • identifies the target of the visitor’s visit or the identity of the staff member • opens the door and guide the visitors in our premises • conveys personal and organizational messages to staff members

TAUCHI – Tampere Unit for Computer-Human Interaction Applications: Doorman (Ovimies) Technology • speech synthesis, speech recognition, speaker recognition, anthropomorphic guidance, physical switches, sensors • EMFi-technology: wall and ceiling mounted loudspeakers and floorsensors • telephone and PDA interfaces for mobile users

TAUCHI – Tampere Unit for Computer-Human Interaction Current vs. new application areas Traditional speech applications Future speech applications single user multiple users desktop and telephony office and home environments, mobile settings Single deterministic dialogue open-ended, dynamically constructed concurrent dialogues active user active computer centralized dialogue management distributed interaction management

TAUCHI – Tampere Unit for Computer-Human Interaction Current vs. new application areas Traditional speech applications Future speech applications mostly unimodal mostly multimodal alternative / exclusive (sequential) modalities concurrent / synergistic (parallel) modalities speech, text, graphics speech, sensors, … monolingual multilingual ”natural” interaction methods based on human-human interaction ”innovative” interaction methods based on human-computer interaction

TAUCHI – Tampere Unit for Computer-Human Interaction Discussion topics • English vs. Nordic languages • Freely available and open-source components • Demonstrations vs. working applications

TAUCHI – Tampere Unit for Computer-Human Interaction Department of Computer and Information Sciences Tampere Unit for Computer Human Interaction http: //www. cs. uta. fi/hci/spi/ spi@cs. uta. fi mturunen@cs. uta. fi