Visual Communication and Interaction Technologies Centre Amalia Ortiz

Visual Communication and Interaction Technologies Centre Amalia Ortiz aortiz@vicomtech. es Asociación VICOMTech Mikeletegi Pasealekua 57 20. 009 Donostia - San Sebastián (Gipuzkoa) Darmstadt, October 02, 2007

Index Institute profile Aim of Interaction for Education, Leisure and e-inclusion department Related technologies • • • Avatars Agents Speech Natural language processing Virtual environments Applications

Institute Profile (1) Applied Research Technology Centre in Computer Graphics, Multimedia and Telecommunications (non for profit Association) Located in the San Sebastian Technology Park Founded by:

Institute Profile (2) Alliances / Membership Member of INI-Graphics. Net Member of IK 4 Research Alliance Basque R&D and Innovation Network International R&D Centre Spanish Federation of Innovation and Technology Organisations (known by its Spanish initials, FEDIT) Innovation and Technology Centre (CIT-88) ISO 9001: 2000 certified UNE 166002: 2006 certified in I+D+i System Managment 50 researchers (8 Ph. D. , Engineers, Computer Scientists, . . . )

Application Areas Digital TV & Multimedia Services (DVB-MHP standard, new interfaces, TV & Internet, …) Biomedical Applications (Telemedicine, simulation, Mixed Reality, 3 D representation …) Tourism, Cultural Heritage & Creativity (Heritage value, Tourism Applications, virtual enviroments…) Interaction for Education, Leisure and e-inclusion (Multimodal – multilingual interfaces, Avatars, e-Learning …) Industrial Applications (e-Commerce, 3 D Product Configuration, CSCW, Geometry Compression, Digital Security)

Index Institute profile Aim of Interaction for Education, Leisure and e-inclusion department Related technologies • • • Avatars Agents Speech Natural language processing Virtual environments Applications

Interaction for Education, Leisure and e. Inclusion Aim: Technologies related to multimodal interaction

Index Institute profile Aim of Interaction for Education, Leisure and e-inclusion department Related technologies • • • Avatars Agents Speech Natural language processing Virtual environments Applications

Avatar Characteristics Avatars Virtual characters Designed for • Looking and moving as real people § Lip-Synch: Synchronization of lips and audio § High level of facial expression and emotional capacity • Using on multimedia applications Multimodal interaction for • User motivation • Catch the user attention • Create the illusion of being communicating with a person

Related technologies Avatars Body: Real time Animation • Defined: § Facial expressions Emotions Gestures § Lipsynch Synchronization § Corporal animation Non predefined animation (Pointing) Prerecording animations (walk) • Animation techniques: § Morphing § Inverse kinematics

Technologies Authoring tools • Appearance and behavior Authoring tools

Index Institute profile Aim of Interaction for Education, Leisure and e-inclusion department Related technologies • • • Avatars Agents Speech Natural language processing Virtual environments Applications

Technologies Intelligent agents Able to having decisions • Expert Systems • E-Learning • E-Commerce • Emotional interaction •

Index Institute profile Aim of Interaction for Education, Leisure and e-inclusion department Related technologies • • • Avatars Agents Speech Natural language processing Virtual environments Applications

Technologies Speech technologies • • Multiplatform TTS and ASR integration Voice transformation Facial animation through audio analysis Automatic subtitling

Index Institute profile Aim of Interaction for Education, Leisure and e-inclusion department Related technologies • • • Avatars Agents Speech Natural language processing Virtual environments Applications

Technologies Natural Language Processing • • Natural language lexicon Morphology Semantics Syntax

Index Institute profile Aim of Interaction for Education, Leisure and e-inclusion department Related technologies • • • Avatars Agents Speech Natural language processing Virtual environments Applications

Technologies Interaction in virtual environments • • • Acting as virtual guides Advanced interaction devices. Dynamic and static collisions. Interaction between several objects and avatars. Shadows

Technologies Multiplatform interfaces • • • PC PDA Cellular Digital TV Web Browser

Index Institute profile Aim of Interaction for Education, Leisure and e-inclusion department Related technologies Applications Future lines

Applications Web • e-Learning: Intelligent tutors • e-Commerce: Virtual Assistants

Applications Leisure • High level of interactivity: Multimedia technologies + 3 D Animation Virtual Communities, 3 D Chat Museums Virtual presenters

Companies

Thank you!!!