Kinect RealTime Taiwan Sign Language Translation Using Kinect

Kinect台灣手語即時翻譯系統 Real-Time Taiwan Sign Language Translation Using Kinect 謝高丰洪孟漢郭宇宏指導教授 : 劉興民

Development Tools Tool name use Visual Studio 2013 Environment Kinect Studio v 2. 0

Database Kinect Studio Record 3 D Views Visual Gesture Builder Feature Points Machine Learning

Visual Gesture Builder • Example – Stand – Raise hand right – Raise hand

Methodology • K-Curvature Algorithm – Each point in the set describes the contours –

Webcam • Kinect can’t distinguish the following two images ? Today Fat Webcam solve

Reference • [1]台灣手語線上辭典 http: //140. 123. 46. 77/TSL/ • [2]Open. CV Learninghttp: //monkeycoding. com/?

Reference • Microsoft Speech API 5. 3 https: //msdn. microsoft. com/enus/library/ms 720163(v=vs. 85). aspx

Slides: 17

Download presentation

Kinect台灣手語即時翻譯系統 Real-Time Taiwan Sign Language Translation Using Kinect 謝高丰洪孟漢郭宇宏指導教授 : 劉興民副教授

Development Tools Tool name use Visual Studio 2013 Environment Kinect Studio v 2. 0 Record, 3 D Views Logitech Webcam C 170 Record Visual Gesture Builder Feature Points, Machine Learning Open. CV Library for Image process QT 5. 7 UI environment

Database Kinect Studio Record 3 D Views Visual Gesture Builder Feature Points Machine Learning

Visual Gesture Builder • Example – Stand – Raise hand right – Raise hand left

Visual Gesture Builder

Methodology • K-Curvature Algorithm – Each point in the set describes the contours – Find two vectors that start at the point and end k points away in either direction. – Calculate the angle between the two vectors – Determine the angle and find the space between fingers and the fingertips

Webcam • Kinect can’t distinguish the following two images ? Today Fat Webcam solve this challenge by recording from different views

Text To Speech Microsoft Speech SDK 5

Reference • [1]台灣手語線上辭典 http: //140. 123. 46. 77/TSL/ • [2]Open. CV Learninghttp: //monkeycoding. com/? page_id=12 • [3]張財榮, 陳定宏, 蘇彥彰, 使用K曲率法則於手語手勢辨識, 台南科技大學資訊程學系, 2014 • [4]呂緯昱, A Gesture Recognition Method based on the Finger Tips and Angles with Local Skin Color Detection, 台北科技大學資訊程系碩士班, 碩士學位論文, 2010. 6 • [5] Kinect For Windows v 2 c++ https: //kheresy. wordpress. com/kinect-for-windows-v 2 -cppindex/ • [6]QT Learning http: //monkeycoding. com/? page_id=5 • [7]Hand Tracking and Recognition With Open. CV http: //simena 86. github. io/blog/2013/08/12/hand-tracking-andrecognition-with-opencv/

Reference • Microsoft Speech API 5. 3 https: //msdn. microsoft. com/enus/library/ms 720163(v=vs. 85). aspx • A High Level Description of Two Fingertip Tracking Techniques: k -curvature and convexity defects http: //www. tmroyal. com/ahigh-level-description-of-two-fingertip-tracking-techniques-kcurvature-and-convexity-defects. html