Human Body Movement Analysis Decoding the Movement and

Human Body Movement Analysis Decoding the Movement and Emotion A three years research and application development project Yunyu Wang, Professor C. C. Lin, Associate Professor W. C. Chen, Professor

Origin--2003 u. The Exchange/Discussion u People from Animation, Dance, Laban Movement Analysis, Computer Science and Sports Science. u Topics about Movement Quality, Emotion, Expression, Skill Analysis, Dance Innovation and LMA Application. 2

Project Description u Period: u Three-year: 2006 to 2009 u First year: April 1, 2006 u Participants u Professors: 5 u Graduate students: 18 u Full time staffs and technicians: 5 3

TNUA u. The College of Dance u. Graduate School of Technology and Arts u. Center for Art and Technology u. The E Motion Lab 4

The E Motion Lab 5

Partner Organizations and Institutions u. NCPES (National College of Physical Education and Sports) u. ITRI (Industrial Technology Research Institute) u. Academia Sinica (http: //www. sinica. edu. tw/as/intro/hist_e. html) 6

WHY ？ u. In Dance u. In Animation u. In Exercise and Sports u. In health industry 7

8

Sub-Project I Motion Database and Metadata

Motion Database and Metadata u Project Leadership and Project integration u Theory development, movement knowledge analysis u Movement Data Collection u Motion Database Schema and Structure u Metadata 10

11

Sub-project II Motion Synthesis and Detection

Motion Synthesis and Detection n n A kernel Engine for Laban motion and emotion analysis Laban motion q q q n Effort Shape Body Emotion q q Cyclic Non-Cyclic 13

Motion Synthesis Laban mocap Mocap(LM) emotional Emotional mocap Mocap(EM) Construction of Basis Functions (LM and EM separately) Dynamic PCA FT Dd Systems Learning Algorithm Construction of Basis Functions EM Motives LM Movement Primitive Lib. (LM and EM) Motion compiler Task Objective Output Motion 14

Motion Detection/Classification Laban mocap Mocap emotional Emotional mocap Mocap Construction of Basis Functions (LM and EMCAP) PCA FT Dd Neural Net Movement Primitive Lib. (LM and EM) Motion Classifier Construction Motion Classifier Lib. Unclassified Motion Detection Learning Algorithm 15

Example Result: PCA elbow up 16

Demo(Man’s arm up movement) Mocap original motion PCA motion synthesis 17

Sub-project III Industry Applications

Application… uin Dance u. Dance engine for Choreography u. Dance analysis u. Dance creation u. Interactive Dance Sub-3 19

Application… u in movie and animation u. Motion/Emotion Quantity Model and Synthesis techniques u. Common Motion Language u. Animation Plug-in u. Game engine Sub-3 20

Application… u. In Exercise and Sports u Efficient and safe (Basketball shooting and Discus throwing) u Online instruction and learning u Skill Analysis and diagnosis Sub-3 21

Application… u. In Health industry u. Better Rehab. --Motivating Moves Janet Hamburg (University of Kansas) u. Fitness Instructor ---My Best Friend u Online Stretching, exercise monitoring, … Sub-3 22

The End In describing movement, we must make a mental note of the most important intermediary positions.