Multimedia What next Nicolas D Georganas University of

Multimedia: What next? Nicolas D. Georganas University of Ottawa- Canada

MULTIMEDIA COMMUNICATIONS THE FIELD REFFERING TO THE: • REPRESENTATION , • STORAGE / RETRIEVAL • DISSEMINATION OF MACHINE-PROCESSABLE INFORMATION EXPRESSED IN MULTIPLE MEDIA, SUCH AS: • • TEXT VOICE GRAPHICS / 3 D IMAGES ANIMATIONS AUDIO VIDEO

MM Research Issues • • • User Interface Design and AI Signal Processing and Coding Database issues Operating Systems Networking Protocols Synchronization Security and authentication Collaborative applications

Problem now well understood: Media Synchronization Voice Server Text & Graphics Server Image Server Audio/Video Server Time Image Communication Controller video Text Transfer Media Buffers Audio Display Scenario Synchronizer Mic Camera …. let us forget about more research on this!

New Media • • Virtual Reality Holography Haptics (Touch) e. Smell e. Taste e. Thought ……. .

Media and sensors MEDIA SENSORS ACTUATORS Audio Microphone Speaker Visual 3 D scanner 3 D video camera Head-Mounted Display LCD, CRT Holography Touch Motion sensor Thermal sensor Pressure sensor Human body robotics Haptic device Smell Electronic nose Smell actuator Taste Electronic tongue Taste actuator

Environment Synthesis from Sensor Data Fusion

Future Multimedia Telecommunication System: “Sensorium” (Ray Kurtzweil) audio visual touch smell taste Telephone Videophone VRT phone Super VRT phone (From a thesis at the MM Univ. , Malaysia (Prof. Riyoshi Komiya))

Hapto-Audio-Visual Communications (From a thesis at the Multimedia Univ. , Malaysia (Prof. Riyoshi Komiya))

Stringent Qo. S Constraints: Network End-to-End-Delay • Tele-haptics – 50 -100 msec (dependent on refresh rates) • Collaborative Virtual Environments – 100 -200 msec. • Good Predictors are needed here (“Dead Reckoning” not good enough) …. We still have a lot of problems still to solve here.

MM Sensor Networks Research • Exciting field for MM research • Wireless, small OS footprint, limited power, bring new constraints • Ad Hoc Networking • Source-to-sensor sink data download but with possible sensor-to-sensor messaging • Redundant coverage and reliability essential • New Protocols needed.

The future looks exciting but …scary!