Jerry Free Chat Sasa Junuzovic Jerry Free Chat

Jerry. Free. Chat Sasa Junuzovic

Jerry. Free. Chat Agenda • • What is Jerry. Free. Chat? System Architecture User Interface – Multiple Conversations User Interface – Awareness Sounds User Interface – Browsing History Controls Demo Sasa Junuzovic

Jerry. Free. Chat What is Jerry. Free. Chat? What is it? • A chat client for blind people What was the motivation for it? • Investigate different kinds of user interfaces that focus on sound instead of graphics for display and feedback – Improve the user interfaces of all applications for blind people – Improve all user interfaces Sasa Junuzovic

Jerry. Free. Chat System Architecture Sound UI Method Calls Events Received Login Response Start a conversation Base UI Conversation Status Change Send Message Received a Message Query Status User Status Changed Chat Client ……………… Chat Client Chat Server Sasa Junuzovic

Jerry. Free. Chat User Interface – Multiple Conversations • Main idea: Arrange conversations in a semi-circle and let spatial sound take care of the rest Current conversation Remote User Center Channel Right off-center Channel Left Channel Center Channel Local User Remote User Right Channel Right Most Channel A conversation is assigned a random voice! Sasa Junuzovic

Jerry. Free. Chat User Interface – Awareness Sounds Application Awareness • You are chatting – You hear crowd murmurs when not in main menu • You are in the main menu – You hear some sort of beat Conversation Awareness • Unanswered message • Conversation status change • User status change KEY: These are also spatial sounds! Preventing notifications from clobbering each other • Random back-off period Sasa Junuzovic

Jerry. Free. Chat User Interface – Browsing Chat History • Skipping through history Jean C: Hello Paul • Snapback Scrolling Paul M: How are you? Jean C: I’m fine, merci. Jean C: You wanted to know about golf courses? Paul M: Yes Unanswered Messages Read Messages out for the user Jean C: Are you there? Jean C: Hallo? Sasa Junuzovic

Jerry. Free. Chat User Interface – Main Menu Commands / * Starting a chat 7 8 9 Canceling current command 4 5 6 1 2 3 Ending a chat 0 Get the contact list status Main Menu and Centre Conversation Toggle Sasa Junuzovic

Jerry. Free. Chat User Interface – Conversation Commands Stop reading text not related to center conversation Go Back in Conversation History Main Menu and Centre Conversation Toggle / * 7 8 9 4 5 6 1 2 3 0 Stop reading all text Go to last unheard message Go Forward in Conversation History Sasa Junuzovic

Jerry. Free. Chat Problems Encountered • Technology related – Getting all the right development tools and kits • Text-to-speech: need both speech libraries and Direct. X audio playback – Solution: samples and documentation (and many frustrating coding hours while trying multiple solutions for solving a problem) – Getting better at C# • Design related – Creating an audio UI that can be reused with other chat clients • Solution: my UI and chat programs communicate only through events – Trying to get away from the visual feedback paradigm • Solution: Working on it … – The biggest one: what are multiple conversation supposed to sound like? • Solution: let the user decide Sasa Junuzovic

Jerry. Free. Chat Improving All User Interfaces • Co-Editor – Adding user awareness tools and capabilities • Radar views • Multi user scrollbars – After Jerry. Free. Chat use sounds as well • If a user is editing a section far away from you, you barely hear them typing or you don’t hear them at all • If a user edits areas of the document closer to the area you are working on, the typing of the remote user becomes louder Sasa Junuzovic

Jerry. Free. Chat Q&A Sasa Junuzovic

Jerry. Free. Chat Design Principles • Visibility Principle (DOET) – The user should always know the possible actions and be given accurate and prompt feedback when executing these actions – Corollary: Actions which are done infrequently should not be immediately available • Mapping Principle (DOET) – Natural mappings make it easier to remember and understand the possible actions and their outcomes • Power to the user – User should always be in control • Can override system • Avoid monotony – Introductory and ending phrases are taking from a pool of phrases Sasa Junuzovic

Jerry. Free. Chat MSN Wrapper Sound UI Forward Method Calls Base UI Forward Events Received Login Response Start a conversation Conversation Status Change Send Message MSN Wrapper Query Status Received a Message User Status Changed MSN Sasa Junuzovic

Jerry. Free. Chat Basic vs. Audio UI Users Input Method Calls Start a conversation Send Message Query Status Play Sound UI Base UI Events Received Login Response Conversation Status Change Received a Message User Status Changed Sasa Junuzovic

Jerry. Free. Chat User Interface – Multiple Conversations Remote User Left Channel Remote User Current conversation Center Channel Remote User Local User Right Channel Sasa Junuzovic

Jerry. Free. Chat User Interface – Multiple Conversations Remote User Current conversation Remote User Right off-center Channel Center Channel Local User Remote User Right Most Channel A conversation is assigned a random voice! Sasa Junuzovic