Virtual Characters and Environments New Modalities for Human

Virtual Characters and Environments: New Modalities for Human Computer Interaction December 12 th, 2003 Benjamin Lok

Overview n Computer generated characters and environments n n Amazing visuals and audio Interacting is limited! n Reduce applicability? n Goals: n n Aki from Final Fantasy: The Spirits Within Create new methods to interact Evaluate the effectiveness of these interaction methods Walking Experiment PIT - UNC

Life-Sized Virtual Characters n Virtual Characters as a way to interact with information n If virtual characters are presented with an adequate level of realism, would people respond to them as they would to other people? n Effective Interaction n Natural (> than keyboard and mouse) 3 D, Dynamic (augmentable) Effective Collaboration n n Non-verbal communication (60%) High impact?

Interaction n n Each participant in a communication has three stages: perception, cognition, and response Investigate: Display, perception, efficacy Thinking Virtual Character Responding Perceiving Interaction Perceiving Participant Responding Thinking

Projects underway n Interpersonal communication n Teaching n n Distributed acting rehearsal Distributed engineering design Medical First Responder Training Future work: Universal Access n n n Disabled Minorities Rural communities

Virtual Environments n n n Been around for almost 30 years # of systems in research labs > day to day use Why? n n Interaction with the virtual environment is too poor Everything is virtual isn’t necessarily good n n Example, change a light bulb Approach: n n n Real objects as interfaces to the virtual world Merge the real and virtual spaces Evaluate what VR is good for!

Merging real and virtual spaces

Videos of Task Having a hybrid environment provides substantial benefits in prototype design.

Avatars in VE n n n Most virtual environments do not provide an avatar (user self-representation) Why? Because tracking the human body is difficult. Solution: Use simple computer vision to track colored markers to generate an avatar

Locomotion in VR n Most common locomotion: n n n Use a ‘virtual walking’ metaphor. Does this reduce effectiveness? We can test this because of new wide-area tracking technologies.

VR Interaction n n Getting real objects into virtual environments How do you naturally interact with virtual objects?

Equipment n n n 3 Graduate students 15’x 10’ wide area tracker Virtual Research V 8 HMD 42” Plasma TV 8 data projectors Cyberware 3 D scanner Collaboration with expertise in: • Virtual Reality • Digital Arts • Image Processing • Computational Geometry • Human Computer Interaction • Image Based Rendering