Human Computer Interaction Institute School of Computer Science

Human Computer Interaction Institute School of Computer Science Carnegie Mellon University Handhelds in the Automobile: The Denali Navigation System Brad A. Myers bam@cs. cmu. edu http: //www. cs. cmu. edu/~pebbles

General Idea l l l How can a handheld augment the operation of an automobile? Not just using a PDA while in a car PDA augments and interoperates with car l Not for driving l Examples: l Setting functions, controls l Specifying destination for navigation systems Brad Myers Talk for General Motors – 4/02/04 2

Pebbles Project l l This research is part of the Pebbles project Overall goal: investigate use of handhelds at the same time as PCs and other computerized devices l l “Multi-Machine User Interfaces” Assumption: handhelds will frequently be in close interactive communication with each other and other computers l Brad Myers Wireless and wired technologies Talk for General Motors – 4/02/04 3

Other Domains for Pebbles l Also created applications to study use of PDAs in: l l l Brad Myers Classrooms Offices Meeting rooms Command Post of the Future Homes For the Handicapped Talk for General Motors – 4/02/04 4

Personal Universal Controller l Two-way communication l l Appliance describes its functions Personal Universal Controller then: l Automatically creates user interface l Controls the appliance l Displays feedback about appliance status Specifications Control Feedback Brad Myers Talk for General Motors – 4/02/04 5

Current PUC Specification Language l l l XML Full documentation for the specification language and protocol Has been used to specify many appliances l Brad Myers Stereo, MP 3 player, camera, VCR, room lights, elevator, etc. Talk for General Motors – 4/02/04 6

Previously Reported l Modeling the GMC Yukon Denali SUV l l l Brad Myers Has a sophisticated Driver Information Console system Three-zone HVAC system LCD screen-based navigation system Talk for General Motors – 4/02/04 7

Simulator l Navigation System l 50+ screens covering most navigation features l l Brad Myers Limited direct interaction with the map (e. g. scrolling) Based on interacting with real device Talk for General Motors – 4/02/04 8

Navigation Simulator, cont. Brad Myers Talk for General Motors – 4/02/04 9

New Work l More parts of the Navigation Simulator l l l Specification of the Navigation System’s functions in XML l l Audio functions Various settings Exercises advanced features of PUC specification language Automatic generation of (parts of) Navigation System on Pocket. PCs Brad Myers Talk for General Motors – 4/02/04 10

Future Work l Future Work on Simulator l Simulate XM radio l Conduct a comparison user study Similar to our previous comparison study l Measure time/errors for users using both the physical unit and handheld remote control l l Automatic generation with user consistency Brad Myers Talk for General Motors – 4/02/04 11

Human Computer Interaction Institute School of Computer Science Carnegie Mellon University Text Input Using Edge. Write Brad A. Myers bam@cs. cmu. edu http: //www. cs. cmu. edu/~pebbles

Input while physically unstable l l GM has sponsored research and patent on a new text entry technique called Edge. Write™ First aimed at people with motor impairments l l l Unable to make Graffiti or Jot gestures Physical edges provide physical stability Instability might be a property of the environment, not just the person l Brad Myers e. g. , on a bus, while walking, or in a car Talk for General Motors – 4/02/04 13

Stylus Edge. Write™ l l Move along plastic edges inside square hole Recognition based on order corners are hit l l OK if the path is jittery No need for: l l Brad Myers Shift or caps lock Separate areas for numbers and letters Talk for General Motors – 4/02/04 14

Character Chart l Three subsets: l l Brad Myers Alphanumerics (e. g. , abc, 123) Punctuation (e. g. , !? #$*) Extended characters (e. g. , ®¶Øç) 144 characters with 306 forms Talk for General Motors – 4/02/04 15

Stylus Edge. Write™ Results l After 15 minutes of practice, able-bodied novices: l l 18% more accurate than Graffiti About the same in speed (~7 WPM with each) l l Note: Tasks included numbers and punctuation Motor-impaired users were vastly more accurate l Brad Myers 22/72 in Graffiti, 68/72 in Edge. Write (Parkinson’s) Talk for General Motors – 4/02/04 16

Joystick Edge. Write™ l l l Could be useful for game consoles, mobile phones, or on power wheelchairs Compared Edge. Write to Date Stamp and Selection Keyboard Tested with unmodified COTS joystick Brad Myers Talk for General Motors – 4/02/04 17

Touchpad Edge. Write™ l Use elevated edges around a Synaptics touchpad l l Brad Myers May be easier for people with motor impairments Maybe mount on the steering wheel or arm-rest? Talk for General Motors – 4/02/04 18

Touchpad Pilot Study l Two factors l l Output visible Touchpad visibility a complete nonfactor! Not seeing output doesn’t degrade performance very much One subject: 22. 61 WPM (maximum) Brad Myers Talk for General Motors – 4/02/04 19

New! l l Using Joystick on Wheelchair Custom hardware and software to interface to commercial joystick Informally evaluated with 7 disabled power-wheelchair users l l Brad Myers 6 with Cerebral Palsy, 1 with Multiple Sclerosis Compared to on-screen keyboard and using Edge. Write on a touchpad Talk for General Motors – 4/02/04 20

Results l Touchpad worked better than wheelchair joystick Brad Myers Talk for General Motors – 4/02/04 21

Edge. Write. com l l l Download Edge. Write software Find abridged and full character charts Find publications Order plastic templates See http: //www. edgewrite. com/ or http: //www. cs. cmu. edu/~edgewrite/ l Same web site Brad Myers Talk for General Motors – 4/02/04 22

Future Edge. Write™ work l Mouse/text disambiguation on touchpad l l Keyboard/mouse replacement for people with disabilities Custom (non-commercial) joystick implementation Cell phone implementation More user tests! Brad Myers Talk for General Motors – 4/02/04 23

Human Computer Interaction Institute School of Computer Science Carnegie Mellon University Brad A. Myers bam@cs. cmu. edu http: //www. cs. cmu. edu/~pebbles