Wii Punch Tracking and Gesture Recognition for 3

Wii Punch: Tracking and Gesture Recognition for 3 D Game Environments By Owen Heneghan Advisor: Prof Cass 1

Nintendo Wii ¡ ¡ Nintendo's fifth home console December 8, 2006 2

Wiimote and Sensor Bar 3

Wii Straight Tracking 4

Wii Games with Gestures 5

Research Question ¡ Straight Tracking vs. Gestures l l User Preference Performance Reaction ¡ Ability to complete tasks ¡ 6

Game Design ¡ Implemented in boxing game l l ¡ ¡ ¡ Capture forearm movement Wiimote stationary as LEDs move Two game environments to compare straight tracking and gestures Multiple scenes to allow evaluation of movements User study 7

Straight Tracking Using position of the infrared diodes calculate place in three dimensions ¡ One to one user to character movement ¡ 8

Gesture Recognition Set of predefined movements (points) ¡ Goal is to classify movement as a preset gesture ¡ Moves the ‘fist’ along preset points ¡ Three different movements ¡ 9

A Game in Three Scenes 1 1. 2. 3. 2 Rag doll Boxer Brick Wall Falling Ball 3 10

User Session Calibrate user to tracking device ¡ Explain how Wiimote tracking is done and show them how it fails ¡ Load up game with first control scheme ¡ Record scene data as subject plays game and scenes ¡ Switch control scheme and repeat ¡ 11

Evaluation ¡ Recorded Data l ¡ Score Questionnaire: l l l Accuracy at determining gestures Responsiveness Reasonable Behavior Intuitive Potential Lasting Appeal 12

Preliminary Results 20 Users ¡ More users preferred straight tracking over gestures ¡ Performance and surveys both coincided ¡ User feedback indicated that predetermined movements needed most work ¡ 13

Problems ¡ Under straight tracking users sometimes would ‘push’ rather than punch objects l ¡ Resulted in faster times for knocking down the wall scenes The faster the punch moves the less forces it has on bricks or falling ball 14

Average Scores for Participants 15

Future Work… Develop more complex gesture recognition system ¡ Incorporate more complex gestures ¡ Test movement of objects ¡ Develop practical applications for gaming ¡ 16

Questions? 17