Chapter 3 Interaction Frameworks Paradigms and Styles May

Chapter 3 Interaction Frameworks Paradigms, and Styles May 11, 2007 Mohamad Eid

Outline Interaction Frameworks Interaction Paradigms 1. 2. l l l l Interaction Styles 3. l l l l l 4. May 11, 2007 Large Scale Computing Personal Computing Networked Computing Mobile Computing Collaborative Environments Virtual Reality Augmented Reality Command Line Menu-Based Interface Form Fill-In Question and Answer Direct Manipulation Metaphors Web Navigation Three-Dimensional Environments Natural Language Key points to review Mohamad Eid

Interaction Frameworks l A framework is basically a structure that provides a context for conceptualizing something l We can use these frameworks to: l l l Structure the design process Help us to identify problematic areas within the design Help us to conceptualize the problem space as a whole May 11, 2007 Mohamad Eid

Interaction Framework l System (S)—Uses its core language (computational attributes related to system state) l User (U)—Uses its task language (psychological attributes related to user state) l Input (I)—Uses its input language l Output (O)—Uses its output language May 11, 2007 Mohamad Eid

Interaction Framework l Based on Execution/Evaluation Action Cycle (EEC) l Execution Phase l l Articulation—The user formulates a goal, which is then articulated using the input language. Performance—The input language is translated into the core language (operations that the system will carry out). Presentation—The system manifests the result of the corelanguage operations using the output language. Evaluation Phase l May 11, 2007 Observation—The user interprets the results on the screen and reconciles them with the original goal. Mohamad Eid

Interaction Paradigms l l l l Large Scale Computing Personal Computing Networked Computing Mobile Computing Collaborative Environments Virtual Reality Augmented Reality May 11, 2007 Mohamad Eid

Interaction Paradigms Large circles represent principal paradigms. Oblong shapes represent convergent paradigms. Words without surrounding shapes represent specific system architectures (sometimes used for a paradigm reference, as in desktop computing for personal computing). May 11, 2007 Mohamad Eid

Large Scale Computing l l l The original mainframe computers were large-scale computing machines, referred to as hosts They resided in a central location They were accessed by remote alphanumeric terminals equipped with keyboards l l The terminals were referred to as “dumb terminals” These systems are also referred to as host/terminal systems May 11, 2007 Mohamad Eid

Large Scale Computing l Super Computers l l These highly specialized machines crunch large amounts of data at high speed, as in computing fluid dynamics, weather patterns, seismic activity predictions, and nuclear explosion dynamics. Supercomputers are used for the very high speed backbone (v. BNS) connections that constitute the core of the Internet. National Center for Super Computing Applications (NCSA) May 11, 2007 Mohamad Eid

Personal Computing l Desktop Computing The Alto, developed at the Xerox Palo Alto Research Center in 1973, was the first computer to use a GUI that involved the desktop metaphor: pop-up menus, windows, and icons The Xerox Alto computer (1973) Courtesy Palo Alto Research Center. May 11, 2007 Mohamad Eid

Personal Computing The Xerox Alto mail program (1973) The Xerox Alto computer (1973) May 11, 2007 Courtesy Palo Alto Research Center . Mohamad Eid

Personal Computing l Personal-Public Computing l l Public Access Computing – The information divide Public Information Appliances Automated teller machine with touchscreen. May 11, 2007 Courtesy Big. Stock. Photo. com Mohamad Eid

Networked Computing l Scope l l l WAN – Wide Area Network MAN – Metropolitan Area Network LAN – Local Area Network PAN – Personal Area Network Wired - Wireless l l l Wi-Fi (IEEE 802. 11 x) Bluetooth 3 G May 11, 2007 Mohamad Eid

Mobile Computing l Mobile computing technologies comprise a very diverse family of devices: l l l Laptop computers Tablet computers Game players MP 3 players PDAs Cell phones May 11, 2007 Mohamad Eid

Mobile Computing Desktop metaphors do not translate well to mobile devices. MP 3 player Laptop computer Courtesy Big. Stock. Photo. com Tablet computer Cell phone Hybrid desktop/mobile environments can afford optimal interaction efficiency. May 11, 2007 Mohamad Eid

Mobile Computing l Mobile devices can be connected to global positioning systems (GPS) l These have touchscreens and voice interaction to alleviate potential visual attention problems during driving On-board navigation system. Courtesy Big. Stock. Photo. com May 11, 2007 Mohamad Eid

Mobile Computing l Mobile devices can offer situational computing that can take advantage of location-specific information through location-based mobile services (LMS). l LMS can be beneficial for location-sensitive advertisements, public service announcements, social interactions, and location-specific educational information. May 11, 2007 Mohamad Eid

Collaborative Environments l Networks allow members of a group to interact with other members on shared files and documents. l l This creates a virtual space where people can collaborate and work collectively. Groupware Networks facilitate collaborative activities. May 11, 2007 Mohamad Eid

Collaborative Environments l Collaborative work l l Communication Coordination Organization Presentation l Computer-mediated communication (CMC) Computer-supported cooperative work (CSCW) l What are some of the different types of groupware? l May 11, 2007 Mohamad Eid

Collaborative Environments l Remote interaction l Synchronous l l l Video conferencing Instant messaging Chat rooms Remote access white boards Asynchronous l l l May 11, 2007 Recommender systems Bulletin boards Email Mohamad Eid

Embodied Virtuality Some of us use the term “embodied virtuality” to refer to the process of drawing computers out of their electronic shells. The “virtuality” of computer-readable data—all the different ways in which it can be altered, processed analyzed—is brought into the physical world. (Weiser, 1991, 95) May 11, 2007 Mohamad Eid

Embodied Virtuality l How do we disperse computing functionality throughout the environment? l What form should EV computing take? l What kind of interface does it require? l How much control should we retain, and how much should be automated? May 11, 2007 Mohamad Eid

Embodied Virtuality l Emerging fields l l l May 11, 2007 Ubiquitous/pervasive computing Invisible/transparent computing Wearable computing Mohamad Eid

Embodied Virtuality - Ubiquitous/pervasive l Third Paradigm (Alan Key) l Devices like cameras, video recorders, musical instruments, and picture frames are becoming “smart” through the introduction of embedded chips. l The essence of Ubi. Comp is that, to fulfill their potential, computing technologies must be considered a part of the fabric of our lives and not something that resides in a gray box. May 11, 2007 Mohamad Eid

Embodied Virtuality - Ubiquitous/pervasive l Ambient computing l The concept of a computational grid that is seamlessly integrated into our physical environment l l Smart environments that sense and recognize people l May 11, 2007 Lighting systems Heating systems Electrical systems l Face recognition ID tags Mohamad Eid

Embodied Virtuality Invisible/transparent l The most profound technologies are those that disappear. They weave themselves into the fabric of everyday life until they are indistinguishable from it. (Weiser, 1991, 94) l Two approaches l Make the interface simple and intuitive § l Remove the interface entirely § May 11, 2007 Driving a car Automotive breaking systems Mohamad Eid

Embodied Virtuality Invisible/transparent l Information Appliances An appliance specializing in information: knowledge, facts, graphics, images, video, or sound. An information appliance is designed to perform a specific activity, such as music, photography, or writing. A distinguishing feature of information appliances is the ability to share information among themselves. (Norman, 1998, 53) l May 11, 2007 A Black. Berry type of device. PDAs, Black. Berry® devices, digital cameras, MP 3 players, and portable game players. Mohamad Eid Courtesy of Big. Stock. Photo. com.

Embodied Virtuality - Wearable l The underlying principle of wearable computing is the merging of information space with work space - humionics. l The goal of humionics is to create an interface that is unobtrusive and easily operated under work-related conditions. l Traditional I/O technologies are generally inadequate l Wearable systems must take advantage of auditory and haptic as well as visual interaction. Wearable computing systems require multimodal interfaces. May 11, 2007 Mohamad Eid

Embodied Virtuality - Wearable l Personal Area Network (PAN) l Two types l Wireless network of wearable and proximal devices § § l Wearable devices that use the body to transmit signals § § May 11, 2007 (IEEE) 802. 15 Working Group for WPAN Microsoft – Connect to a Bluetooth personal area network (PAN) MIT Media Lab – Intrabody Signaling IBM Personal Area Network (PAN) Mohamad Eid

Embodied Virtuality l Embodied Virtuality Environments and Their Characteristics Manual Automated Fixed Portable Ubi. Comp Some systems are manual Some systems are automated Some components are embedded Some devices are portable Invisible User does not interact with computer System takes care of all computer functionality Some system components are embedded Some devices are portable Wearable Many of the wearable components allow manual control Some of the wearable components interact automatically with embedded sensors Some systems use situated sensors that interact with wearable components Most system components are portable (wearable) Embodied virtuality environments location/operation. May 11, 2007 Mohamad Eid

Virtual Reality l The goals of the virtual reality (VR) community are the direct opposite of the goals of the EV community. l l May 11, 2007 EV strives to integrate computer functionality with the real world VR strives to immerse humans in a virtual world Mohamad Eid

Virtual Reality Vs. Embodied Virtuality Virtual Reality May 11, 2007 Embodied Virtuality Mohamad Eid

Virtual Reality l Nonimmersive - screen-based, pointer-driven, threedimensional (3 D) graphical presentations that may involve haptic feedback l l l VRML Quick. Time VR Immersive VR environments are designed to create a sense of “being” in a world populated by virtual objects. l May 11, 2007 To create a convincing illusion, they must use as many human perceptual channels as possible. Mohamad Eid

Virtual Reality - Immersive CAVE automated virtual environment at the National Center for Supercomputing Applications (NCSA). http: //brighton. ncsa. uiuc. edu/~prajlich/cave. html Sketching a virtual world in the VR design tool Shadow. Light. Photographs and Shadow. Light application courtesy of Kalev Leetaru. Sensics pi. Sight Virtual Reality (VR) system. http: //www. sensics. com/ May 11, 2007 Mohamad Eid

Augmented Reality l The goal of AR is to create a seamless integration between real and virtual objects in a way that augments the user’s perception and experience. l Criteria for AR environments l May 11, 2007 The virtual information must be: l Relevant to and l in sync with the real-world environment. Mohamad Eid

Augmented Reality l AR I/O devices l Heads Up Displays (HUD) l l Optical see through Video see through Micro. Optical MD-6 Critical Data Viewer. http: //microoptical. net/ Sportvue MC 1 motorcycle helmet heads-up display. http: //www. sportvue. com/ May 11, 2007 Mohamad Eid

Virtuality Continuum May 11, 2007 Mohamad Eid

Interaction Styles l l l l l Command Line Menu-Based Interface Form Fill-In Question and Answer Direct Manipulation Metaphors Web Navigation Three-Dimensional Environments Zoomable Interface Natural Language May 11, 2007 Mohamad Eid

Interaction Styles - Command Line l Command-line interfaces are fast and powerful. l l l Many commands are abbreviated l quick and efficient Commands can be applied to many objects simultaneously l fast input Some commands have multiple parameters that can be set and altered l precise and flexible May 11, 2007 Mohamad Eid

Interaction Styles - Command Line l Advantages of command-line interfaces: l l l Suitable for repetitive tasks Advantageous for expert users Offer direct access to system functionality Efficient and powerful Not encumbered with graphic controls Low visual load l Not taxing on system resources l May 11, 2007 Mohamad Eid

Interaction Styles - Command Line l Disadvantages of command-line interfaces: l l l Low command retention Steep learning curve High error rates Heavy reliance on memory Frustrating for novice users May 11, 2007 Mohamad Eid

Interaction Styles - Menu-Based Interface l Menu-driven interfaces present users with sequential hierarchal menus that offer lists of functions. l l Textual: key-in number of option Graphical: use arrow keys or pointing device May 11, 2007 Mohamad Eid

Interaction Styles - Menu-Based Interface Menus are based on recognition as opposed to recall l l No need to remember commands Users search from a list of possible choices List provides constraints Appropriate for small screens (i. Pod) May 11, 2007 Mohamad Eid

Interaction Styles - Menu-Based Interface l Most menus are a variation on a few basic categories: Single Sequential Star network May 11, 2007 Hierarchal Web network Mohamad Eid

Interaction Styles - Menu-Based Interface l Advantages of menu-based interfaces: l l l Low memory requirements Self-explanatory Easy to undo errors Appropriate for beginners Disadvantages of menu-based interfaces: l l Rigid and inflexible navigation Inefficient for large menu navigation Inefficient use of screen real estate Slow for expert users May 11, 2007 Mohamad Eid

Interaction Styles - Form Fill-In l Similar to menu interfaces – present screens of information l Different than menu interfaces - used to capture information and proceed linearly not to navigate a hierarchical structure May 11, 2007 Mohamad Eid

Interaction Styles - Form Fill-In l Advantages l l of form fill-in interfaces: Low memory requirements Self-explanatory Can gather a great deal of information in little space Present a context for input information l Disadvantages l l l of form fill-in interfaces: Require valid input in valid format Require familiarity with interface controls Can be tedious to correct mistakes May 11, 2007 Mohamad Eid

Interaction Styles - Question and Answer l l l Question and answer interfaces are also called wizards. They are restricting for expert users They are easy for novice users l However, they may not know the required information Users must be able to cancel a menu without affecting the state of the computer May 11, 2007 Mohamad Eid

Interaction Styles - Question and Answer l Microsoft Add Network Place Wizard (a) Add Network Place wizard. (b) Select a service provider. (c) Address of the network place. May 11, 2007 Mohamad Eid

Interaction Styles - Question and Answer l Advantages of question and answer interfaces: l l l Low memory requirements Self-explanatory Simple linear presentation Easy for beginners Disadvantages of question and answer interfaces: l l l Require valid input supplied by user Require familiarity with interface controls Can be tedious to correct mistakes May 11, 2007 Mohamad Eid

Interaction Styles - Direct Manipulation l Ben Shneiderman (1982) l l l Continuous representations of the objects and actions of interest with meaningful visual metaphors. Physical actions or presses of labeled buttons instead of complex syntax. Rapid, incremental, reversible actions whose effects on the objects of interest are visible immediately. May 11, 2007 Mohamad Eid

Interaction Styles - Direct Manipulation l Three phases in Direct Manipulation - Cooper, Reimann (2003) l l l Free Phase—How the screen looks before any user actions Captive Phase—How the screen looks during a user action (click, click-drag, etc. ) Termination Phase—How the screen looks after a user action May 11, 2007 Mohamad Eid

Interaction Styles - Direct Manipulation l Advantages of direct manipulation interfaces: l l l l Easy to learn Low memory requirements Easy to undo Immediate feedback to user actions Enables user to use spatial cues Easy for beginners Disadvantages of direct manipulation interfaces: l l l Not self-explanatory Inefficient use of screen real estate High graphical system requirements May 11, 2007 Mohamad Eid

Interaction Styles - Metaphors l l GUIs use visual relationships to real-world objects (metaphors) Metaphors can help people relate to complex concepts and procedures by drawing on realworld knowledge Real-world affordances can be reflected What metaphors are used by contemporary GUIs? May 11, 2007 Mohamad Eid

Interaction Styles - Metaphors Microsoft Windows XP May 11, 2007 Apple OS X Mohamad Eid

Interaction Styles - Metaphors A metaphor’s function must be consistent with real-world expectations l l Metaphors that do not behave the way people expect will cause confusion and frustration Macintosh trashcan May 11, 2007 Mohamad Eid

Interaction Styles - Metaphors Don’t force a metaphor l Potential problems with metaphors l Run out of metaphors l l l Some virtual processes and objects have no real-world counter parts Mixed metaphors Carry connotations and association May 11, 2007 Mohamad Eid

Interaction Styles - Web Navigation l Two basic interaction styles l Link-based navigation Sensitive to articulatory distance l Ambiguous link labels increase the gulf of evaluation l l Search Sensitive to semantic distance l Inadequate search engine algorithms increase the gulf of execution l Slight advantage in development of mental models l May 11, 2007 Mohamad Eid

Interaction Styles - Natural Language l l Natural Language Interaction (NLI) - Interacting with computers using everyday language Obstacles l l Language is ambiguous Meaning depends on context “Search results” l “She said she did not know” l l Dependant on visual cues May 11, 2007 Mohamad Eid

Interaction Styles - Natural Language l Two areas of development l l Speech recognition Semantics Grammar issues l Vague meanings l Contradictory statements l NLIs may require constant clarification of linguistic ambiguities May 11, 2007 Mohamad Eid

Interaction Styles - Natural Language l Advantages of NLI: l l l Ease of learning Low memory requirements Flexible interaction Low screen requirements Appropriate for beginners Disadvantages of NLI: l l l Requires knowledge of the task domain May require tedious clarification dialogues Complex system development May 11, 2007 Mohamad Eid

Summary l Goals of HCI: Improve l l l Visibility and feedback Affordance and perceived affordance Goal = state; task = action Human/computer as system running on 2 processors Types, classes and abilities of users Productivity = functionality * usability Usability factors l l safety functionality efficiency usability e. g. learnability, fit, acceptability Contributing disciplines l May 11, 2007 e. g. linguistics, Artificial Intelligence Mohamad Eid

Summary (Cont’d) l Human cognitive system - Limitations on: l l l Task analysis vs. functional analysis Star model with evaluation at centre UI levels l l l l perception attention memory task conceptual model interaction style interaction element physical element Usability engineering Layered approach = Model View Controller Software Design Pattern Malfunction as a kind of defect (of usability) May 11, 2007 Mohamad Eid