Jerry Free Chat Sasa Junuzovic Jerry Free Chat

  • Slides: 17
Download presentation
Jerry. Free. Chat Sasa Junuzovic

Jerry. Free. Chat Sasa Junuzovic

Jerry. Free. Chat Agenda • • What is Jerry. Free. Chat? System Architecture User

Jerry. Free. Chat Agenda • • What is Jerry. Free. Chat? System Architecture User Interface – Multiple Conversations User Interface – Awareness Sounds User Interface – Browsing History Controls Demo Sasa Junuzovic

Jerry. Free. Chat What is Jerry. Free. Chat? What is it? • A chat

Jerry. Free. Chat What is Jerry. Free. Chat? What is it? • A chat client for blind people What was the motivation for it? • Investigate different kinds of user interfaces that focus on sound instead of graphics for display and feedback – Improve the user interfaces of all applications for blind people – Improve all user interfaces Sasa Junuzovic

Jerry. Free. Chat System Architecture Sound UI Method Calls Events Received Login Response Start

Jerry. Free. Chat System Architecture Sound UI Method Calls Events Received Login Response Start a conversation Base UI Conversation Status Change Send Message Received a Message Query Status User Status Changed Chat Client ……………… Chat Client Chat Server Sasa Junuzovic

Jerry. Free. Chat User Interface – Multiple Conversations • Main idea: Arrange conversations in

Jerry. Free. Chat User Interface – Multiple Conversations • Main idea: Arrange conversations in a semi-circle and let spatial sound take care of the rest Current conversation Remote User Center Channel Right off-center Channel Left Channel Center Channel Local User Remote User Right Channel Right Most Channel A conversation is assigned a random voice! Sasa Junuzovic

Jerry. Free. Chat User Interface – Awareness Sounds Application Awareness • You are chatting

Jerry. Free. Chat User Interface – Awareness Sounds Application Awareness • You are chatting – You hear crowd murmurs when not in main menu • You are in the main menu – You hear some sort of beat Conversation Awareness • Unanswered message • Conversation status change • User status change KEY: These are also spatial sounds! Preventing notifications from clobbering each other • Random back-off period Sasa Junuzovic

Jerry. Free. Chat User Interface – Browsing Chat History • Skipping through history Jean

Jerry. Free. Chat User Interface – Browsing Chat History • Skipping through history Jean C: Hello Paul • Snapback Scrolling Paul M: How are you? Jean C: I’m fine, merci. Jean C: You wanted to know about golf courses? Paul M: Yes Unanswered Messages Read Messages out for the user Jean C: Are you there? Jean C: Hallo? Sasa Junuzovic

Jerry. Free. Chat User Interface – Main Menu Commands / * Starting a chat

Jerry. Free. Chat User Interface – Main Menu Commands / * Starting a chat 7 8 9 Canceling current command 4 5 6 1 2 3 Ending a chat 0 Get the contact list status Main Menu and Centre Conversation Toggle Sasa Junuzovic

Jerry. Free. Chat User Interface – Conversation Commands Stop reading text not related to

Jerry. Free. Chat User Interface – Conversation Commands Stop reading text not related to center conversation Go Back in Conversation History Main Menu and Centre Conversation Toggle / * 7 8 9 4 5 6 1 2 3 0 Stop reading all text Go to last unheard message Go Forward in Conversation History Sasa Junuzovic

Jerry. Free. Chat Problems Encountered • Technology related – Getting all the right development

Jerry. Free. Chat Problems Encountered • Technology related – Getting all the right development tools and kits • Text-to-speech: need both speech libraries and Direct. X audio playback – Solution: samples and documentation (and many frustrating coding hours while trying multiple solutions for solving a problem) – Getting better at C# • Design related – Creating an audio UI that can be reused with other chat clients • Solution: my UI and chat programs communicate only through events – Trying to get away from the visual feedback paradigm • Solution: Working on it … – The biggest one: what are multiple conversation supposed to sound like? • Solution: let the user decide Sasa Junuzovic

Jerry. Free. Chat Improving All User Interfaces • Co-Editor – Adding user awareness tools

Jerry. Free. Chat Improving All User Interfaces • Co-Editor – Adding user awareness tools and capabilities • Radar views • Multi user scrollbars – After Jerry. Free. Chat use sounds as well • If a user is editing a section far away from you, you barely hear them typing or you don’t hear them at all • If a user edits areas of the document closer to the area you are working on, the typing of the remote user becomes louder Sasa Junuzovic

Jerry. Free. Chat Q&A Sasa Junuzovic

Jerry. Free. Chat Q&A Sasa Junuzovic

Jerry. Free. Chat Design Principles • Visibility Principle (DOET) – The user should always

Jerry. Free. Chat Design Principles • Visibility Principle (DOET) – The user should always know the possible actions and be given accurate and prompt feedback when executing these actions – Corollary: Actions which are done infrequently should not be immediately available • Mapping Principle (DOET) – Natural mappings make it easier to remember and understand the possible actions and their outcomes • Power to the user – User should always be in control • Can override system • Avoid monotony – Introductory and ending phrases are taking from a pool of phrases Sasa Junuzovic

Jerry. Free. Chat MSN Wrapper Sound UI Forward Method Calls Base UI Forward Events

Jerry. Free. Chat MSN Wrapper Sound UI Forward Method Calls Base UI Forward Events Received Login Response Start a conversation Conversation Status Change Send Message MSN Wrapper Query Status Received a Message User Status Changed MSN Sasa Junuzovic

Jerry. Free. Chat Basic vs. Audio UI Users Input Method Calls Start a conversation

Jerry. Free. Chat Basic vs. Audio UI Users Input Method Calls Start a conversation Send Message Query Status Play Sound UI Base UI Events Received Login Response Conversation Status Change Received a Message User Status Changed Sasa Junuzovic

Jerry. Free. Chat User Interface – Multiple Conversations Remote User Left Channel Remote User

Jerry. Free. Chat User Interface – Multiple Conversations Remote User Left Channel Remote User Current conversation Center Channel Remote User Local User Right Channel Sasa Junuzovic

Jerry. Free. Chat User Interface – Multiple Conversations Remote User Current conversation Remote User

Jerry. Free. Chat User Interface – Multiple Conversations Remote User Current conversation Remote User Right off-center Channel Center Channel Local User Remote User Right Most Channel A conversation is assigned a random voice! Sasa Junuzovic