The User Interface Design for the Sign Language

① The User Interface Design for the Sign Language Interpreter in a Remote Sign Language Interpretation System Hiroki Minagawa, Ichiro Naito, Nobuko Kato, Hiroshi Murakami, and Yasushi Ishihara Tsukuba College of Technology, Japan E-mail: minagawa@a. tsukuba-tech. ac. jp

② Concept n The Necessity of Remote Sign Language Interpretation n n The number of interpreters is not enough. Special knowledge is required of interpreters. (Ex. Lecture of University) The Spread of Broadband Networks The Necessity of Considering a System Design

③ Experiment System Interpreter n Internet Hearing Person Audio Video Deaf Person Assumed System Experiment System n No Time Delay No Quality Loss

④ Deaf Person - Hearing Person Audio Interpreter Voice Hearing Person Interpretation Room Video Sign Language Deaf Person Usual Interpretation Remote Interpretation

⑤ Interpretation Room Realized System Interpreter Scene Hearing Person Deaf Person Usual Interpretation Remote Interpretation

⑥ Results ○ Remote interpretation was successful. ○ The feeling of refusal to the system was lost as it was used. (Interpreter, Deaf Person, Hearing Person) ○A scenery monitor was necessary for the interpreter. ○ The interpreter found the hearing person’s appearance well. × Interpretation could not be obtained while the deaf person was not looking at the monitor. × Eye contact was difficult for the interpreter.

⑦ Hearing Lecturer - Deaf Students Interpretation Room Interpreter Voice Hearing Lecturer Sign Language Deaf Students Usual Interpretation Remote Interpretation

⑧ Interpretation Supporters Realized System Interpreter Interpretation Room Hearing Lecturer Scene Deaf Students Lecture Room Lecture Note

⑨ Results Remote interpretation was successful. 2. A scenery monitor of the lecture room was necessary for the interpreter as a main monitor. 1. The interpreter found the lecturer’s appearance well. 2. The character on a white board could not be read. 3. The interpreter sometimes mistook right and left. 3. Merit of Remote Sign Language Interpretation 1. The interpretation supporters could read two or more students' sign language. 2. The lecture note could be placed near the interpreter.

⑩ Interpretation Room Deaf Lecturer - Hearing Students Deaf Lecturer Sign Language Interpreter Voice Hearing Students Usual Interpretation Remote Interpretation

⑪ Realized System Interpretation Supporters Interpretation Room Interpreter Deaf Lecturer Scene Hearing Students Lecture Room Lecture Note

⑫ Results ○ Remote interpretation was successful. ○ A scenery monitor of the students was necessary for the interpreter. ○ The interpreter was able to see students' expression. × Interpretation failed when the lecturer disappeared from the monitor. × Interpretation could not be obtained while the lecturer had turned to the white board.

⑬ Other Applications n Multi-point Meeting With Sign Language n Possibility of a Low Cost Remote Sign Language Interpretation System

⑭ n Personal Sign Language Interpreter n n Pocket Interpreter Secret Interpreter

⑮ Future Subjects n The Method of the Information Support for the Interpreter n n n How to Show the Interpreter’s Video to the Deaf Person Actual System Design n Hearing Person’s Expression Relation Between the Deaf Person and the Hearing Person Detailed Information on the Scene As a Lecture Note Sign Language Interpretation Server System Mobile Client System Estimation of Total Cost