Ubiquitous and Pervasive Computing HCI in the real

Ubiquitous and Pervasive Computing HCI in the real world

Ubiquitous Computing “The most profound technologies are those that disappear. They weave themselves into the fabric of everyday life until they are indistinguishable from it. ” - Mark Weiser, “The Computer for the 21 Century”, Scientific American st CS / Psych 6750 2

Agenda n Area overview n Four themes n Challenges/issues CS / Psych 6750 3

Pervasive/Ubiquitous Computing n Move beyond desktop machine n Computing is embedded everywhere in the environment l CS / Psych 6750 Nike + i. Pod interface for running shoes 4

Internet Kitchen n Internet refrigerator and cooking appliance n Download recipes from web directly to device http: //www. dreamlg. com/en/ref/internet/introduction_tv. shtm CS / Psych 6750 5

Ubicomp Notions n Computing capabilities, any time, any place n “Invisible” resources n Machines sense users’ presence and act accordingly CS / Psych 6750 Automatic hand soap dispenser 6

Video Examples • Ambient Room - H. Ishii • Beyond the Desktop – J. Rekimoto CS / Psych 6750 7

Four Themes 1. Automated capture of experiences with easy access 2. Context-aware/sensitive interactions and applications 3. Ubiquitous services independent of devices/platforms 4. Natural/Implicit interfaces CS / Psych 6750 8

1. Automated Capture n Motivation n Record-taking is hard n Multiple streams of information need to be captured n Machines are better at some of these things than we are CS / Psych 6750 9

Examples • Meeting capture (scribe at Xerox PARC), Mark Weiser CS / Psych 6750 10

Live. Board CS / Psych 6750 11

Classroom 2000/e. Class CS / Psych 6750 12

Issues n Stream integration -- At what level? n Very finest level of actions or more coarse? n Modifying a record after the fact n Can student notes be added later? n Networked interaction n Why can’t your notes be put up on the Liveboard? CS / Psych 6750 13

2. Context-Aware Computing n Computing services sense aspects of environment (location, user emotion, …) and tailor provided services n Walk into conference room, my email is projected on a big screen there CS / Psych 6750 14

Examples n Active Badge & PARCTab n Shopping assistant n Cyberguide n Perception system for recognizing user moods from their facial expressions n House where position is sensed and temperature adjusted automatically CS / Psych 6750 15

Augmented Reality CS / Psych 6750 16

Issues n Registration, registration n How to integrate all the different aspects of context? n What about the loss of privacy? CS / Psych 6750 17

3. Ubiquitous Services n Care about service, not application n Want to receive a message using whatever device is handy nearby n Message is tailored to work according to device CS / Psych 6750 18

Issues n What is software infrastructure for integration? n Do we get it by just adopting some standard? CS / Psych 6750 19

4. Natural/Implicit Interfaces n Computer interfaces and devices are more natural interaction tools n Pen input n Speech n Gesture n Tangible interfaces CS / Psych 6750 20

Examples • • Pen applications Speech applications Gesture pendant H. Ishii’s tangible UI work at MIT CS / Psych 6750 21

Gesture Pendant CS / Psych 6750 22

Personal Ambient Displays are small, physical devices worn to display information to a person in a subtle, persistent, and private manner. They can be small enough to be carried in a pocket, worn as a watch, or even adorned like jewelry. In our implementations, information is displayed solely through tactile modalities such as heating and cooling, movement and vibration, and change of shape. CS / Psych 6750 23

Pins and Super Cilia Skin is a multi-modal interactive interface, conceived as a computationally enhanced membrane coupling tactile-kinesthetic input with tactile and visual output. An array of individual actuators (cilia) use changes in orientation to display images or physical gestures as physical or tactile information. CS / Psych 6750 24

Workbenches CS / Psych 6750 25

Sand. Scape is a tangible interface for designing and understanding landscapes through a variety of computational simulations using sand. Users view these simulations as they are projected on the surface of a sand model that represents the terrain. The users can choose from a variety of different simulations that highlight either the height, slope, contours, shadows, drainage or aspect of the landscape model. The users can alter the form of the landscape model by manipulating sand while seeing the resultant effects of computational analysis generated and projected on the surface of sand in real-time. CS / Psych 6750 26

Issues n Errors are more likely (handwriting recognition, speech, …) How to discover and correct them? n Is there truly value added? CS / Psych 6750 27

Wearable Computing n Computation devices accompany you, rather than you seeking them out n T. Starner CS / Psych 6750 28

Evaluation n How do we evaluate these technologies? n Challenge in Classroom 2000 CS / Psych 6750 29

Interested in More… • CS 7470, Mobile and Ubiquitous computing, usually in Spring term • Gregory Abowd • Readings, discussion, research-oriented CS / Psych 6750 30