Analysis of Pathological and Nonpathological Human Motion with

Analysis of Pathological and Non-pathological Human Motion with 3 D Motion Capture Methods

The 138/2001 ICT R&D Project General goals – Buildup of a new MOCAP laboratory – Evaluation of human motion in 3 D space: whole body, facial expressions, gestures – Support of diagnostics, physical therapy and clinical rehabilitation, emotional computing and telepresence. Participants – TU Budapest Department of Control Engineering and Information Technology – Foundation of the „Bone and Joint Decade” – The Collegiate Department of the Semmelweis University Detailed information about the project: lovanyi@iit. bme. hu

In Hungary • Low back pain is first amongst diseases causing the highest number of days taken off from work • Low back pain is the third biggest cause disabling workers • In 1999, there were 55000 cases of treatment in hospitals because of low back pain. The total cost is estimated at more than 3, 6 billion HUF (about 16. 1 million USD)

Goals - from a medical perspective § Registration of the basic motion of healthy individuals from different groups § 2 D and 3 D registration and analysis of the basic motion of patients suffering from acute low back pain § 2 D and 3 D registration and analysis of the basic motion of patients suffering from chronic low back pain § Development of a standard motion therapy for acute and chronic low back pain, and the effective evaluation of it § Consultation of patients suffering in acute low back pain and in sciatic neuralgia

Conventional diagnostics on spinal lumbago • • • Anamnesis Inspection Palpation Functional examinations: active/passive motion detection etc. Conventional diagnostics is a rather complex task! It is hard to interpret these steps from an engineering point of view aiming to substitute them by computer – aided solutions

3 D Mo. Cap devices • Ultrasound devices are generally very robust, realtime - but they have limited functionality • Optical solutions are expensive, they use several cameras generating complex illumination / background / calibration problems - but there is no need for cables. We are trying Sensor fusion (ultrasound / optical) • Markers: where? how many? • Inverse kinematic modelling: the number of markers can be reduced

Hierarchy of algorithms for video-rate image processing Even accurate real-time interpreting of a single image feature is difficult… A hierarchical set of features is needed for a sequence of images! Example: From simple but less robust features Intensity /histogram Color Edges Series of convolution Geometrical properties FFT / shape coefficients Textures Contours Topological properties To complex but more robust features

Goals - from an ICT perspective • 2 D-2, 5 D-3 D-4 D data acquisition • Measurement and modeling of human behavior in daily life • Creation of human movement standards and reference database for healthy and pathological cases • Projection of clinical models into adequate information system representation • Development and implementation of numerically stable mathematically founded image processing algorithms • Application-specific, content-based indexing

Goals - from an ICT perspective • Real-time 2 D / 3 D image processing and visualization • Improving efficiency of diagnosis and therapy by means of statistics and reference database • Tele-consulting / tele-diagnostics methods for therapy and prevention • Theraphy: teaching of optimal motion using real-time electromechanical, visual, acoustical feedback • Web-based educational material for learning and assessment • Buildup of a new medical Mo. Cap system • Equipping of the MOCAP laboratory

Taxonomy of the „Looking at people” problem – Full body motion detection – Facial expression evaluation – Gesture analysis Our field of interest: medical applications of human movement analysis using 3 D image processing tools

Registration of typical symptoms Telemedicine Non-pathological human motion: Sport Physical therapy Non-pathological human motion: Training Clinical rehabilitation 3 D Mo. Cap Applications Non-pathological human motion: National Cultural Heritage (eg. Folk dancing) 3 D Analysis Disease standards The continuous objective following up of the patients The early recognition of the disease More effective treatment Cost-reduction

Conclusion Due to experiences acquired by testing available medical purpose Mo. Cap systems (e. g. Zebris) we decided to start our system development by carefully choosing an appropriate Mo. Cap device as a „starting point”. Then our hardware-software modifications will be added (e. g. sensor fusion). Such way development cost and time may considerably be reduced.