CS 160 Lecture 2 Professor John Canny Spring

CS 160: Lecture 2 Professor John Canny Spring 2004 Jan 23 3/7/2021 1

History of HCI 4 Personalities: * Vannevar Bush - Universal information access * J. C. R. Licklider - Networking, Agents * Ivan Sutherland - Sketchpad * Doug Engelbart - Mouse, GUI, Word proc. . . * Ted Nelson - Hypertext * Alan Kay - OO programming, Laptops * Don Norman - Cognitive principles * Jacob Nielsen - Usability 3/7/2021 2

History of HCI 4 Systems: * Memex - 1945 (concept) * Sketchpad - 1963 * NLS (o. NLine System) - 1963 -68 + (mouse ‘ 64) * Xerox Alto ‘ 72, Star ‘ 81 * Grid Compass 1983 * Apple Lisa ‘ 83, Mac ‘ 84, Ne. XT ‘ 88 * Powerbook 1991 * HTML, HTTP 1994 3/7/2021 1968 Dynabook 1983 3

History of HCI 4 Politics * Military Funding + NDRC - OSRD - ARPA – DARPA * Elite universities (MIT, Stanford, CMU, Berkeley) * NSF 1950 present * Xerox PARC - 1970 present * Apple - Ne. XT * Hypertext 1967. . . + Prototypes: HES 1969, ZOG 1975. . . + Xanadu 1981, not funded ‘til 87 (Hypercard 1987) + 1989 Xanadu -> Autodesk, WWW proposal 3/7/2021 4

People 4 Vannevar Bush (1890 -1974) * Engineer by training (MIT) * Differential analyzer - 1930 * Led computing research in ‘ 30 s * Created military research + NDRC ‘ 40, OSRD ‘ 41 -47 * Managed nuclear weapons research throughout the 40’s * Wrote “science - the endless frontier” 1945 * Military consultant through 50’s 3/7/2021 5

People 4 Bush’s “as we may think” 1945 * Proposed the “Memex” a very modern computer 3/7/2021 6

Bush’s Memex 4 Individuals store all personal books, records, 4 4 communications Items retrieved rapidly through indexing, keywords, cross references, . . . Can annotate text with margin notes, comments. . . Can construct a trail through the material and save it Acts as an external memory 3/7/2021 7

Post-Memex 4 After WWII, Bush continued to push for analogue computers (and against digital). 4 You can’t win ‘em all! 3/7/2021 8

J. C. R. Licklider 1915 -1990 4 Ph. D. 1942 Rochester, Psychologist 4 Started “Human Engineering group” at MIT’s Lincoln labs in 1951 4 Tried to evolve psych. into a department within Electrical Engineering 4 ARPA created in 1958 in response to Sputnik, “Lick” became director in 1962. 4 With ARPA sponsorship, the first CS programs were created: * MIT, CMU, Berkeley, Stanford 3/7/2021 9

J. C. R. Licklider 1915 -1990 4 At ARPA, Licklider promoted computing research and sponsored: * Time-sharing * Networking * Engelbart’s and Sutherland’s online computing work 3/7/2021 10

J. C. R. Licklider publications 4 Man-computer symbiosis – 1960 4 Libraries of the future – 1965 4 The computer as communication device - 1968 3/7/2021 11

Man-Computer Symbiosis - 1960 4 Did self-observation of his daily work. * Observed that much work was mundane and related to accessing and organizing information 4 Proposed: * Digital libraries * Display screens with pen input and character recognition * Wall displays for collaborative work * Speech recognition and production for HCI 3/7/2021 12

The Computer as a Communication Device - 1968 4 Cooperative work with shared and individual screens 4 Pen chat 4 Online communities 4 Agents – OLIVERs On-Line Vicarious Expediter and Responder 3/7/2021 13

Networks, Time-sharing 4 Much of Licklider’s sponsored research was unpopular in the engineering community: 4 “Time-sharing is a waste of valuable computer time” 4 “Why are we doing this? ” * BBN engineer about the first computer network 3/7/2021 14

Ivan Sutherland 1938 4 MIT Ph. D. in 1963 4 Ph. D. work was “Sketchpad” 4 Pioneered computer graphics and CAD 4 Started Evans and Sutherland in 1968 3/7/2021 15

Doug Engelbart 1925 - 4 Ph. D. UC Berkeley (EE) in 1955 4 Thesis on “plasma digital devices” 4 4 - a way into computing Strongly influenced by Bush’s article Moved to SRI, started formulating human augmentation ideas in 1959 Funding from ARPA in 1963 NLS (o. NLine System) demo 1968 3/7/2021 16

Engelbart’s innovations 4 NLS (1968) featured: * * * * Video screen and keyboard Mouse and chordal keyboard Videoconferencing Hypertext linking Word processing E-mail A window system User testing! 3/7/2021 17

Engelbart’s work 4 Continued at SRI, worked on network extensions 4 Funding dwindles through the 70’s…, AI HCI 4 NLS project sold in 1977 to Tymshare * Half of the (~40) NLS engineers moved to Xerox PARC, others to Tymshare * Engelbart fired from SRI in ’ 77, moves to Tymshare 4 Migrated to Mc. Donnell-Douglas in 1984, until 1989 pushed for open hypertext systems 4 Started Bootstrap institute in 1989 3/7/2021 18

Engelbart’s work 4 80 s and 90 s: Personal computing and the web happen 4 Engelbart Receives the ACMTuring award in 1997 “For an inspiring vision of the future of interactive computing and the invention of key technologies to help realize this vision” 3/7/2021 19

Ted Nelson 1937 - 4 M. A. Sociology, Harvard ’ 63 4 Coined “hypertext” in 1960 4 Worked with Van Dam at Brown on HES – 1967 4 Designed Xanadu in 1981 * Global hypertext * Pay-per-view * Not funded until 1987 4 Hypertext as a more natural medium than linear text for creative writing 4 “I build paradigms. I work on complex ideas and make up words for them. It is the only way. ” 3/7/2021 20

Alan Kay 1940 - 4 Ph. D. 1969 (Utah) Computer Graphics 4 In 1968, met Seymour Papert 4 4 (LOGO) in the MIT AI Lab. - kids can program! Moved to Xerox PARC in 1972 Started developing “Smalltalk”, in the Learning Research Group First general OO programming language Influenced by Simula * Engineers can program! 3/7/2021 21

Alan Kay @ PARC 4 Dynabook (laptop computer) conceived in 1968, well ahead of its time. 4 As interim steps, Kay develops the Xerox Alto (1972) and Star, the first real personal computers. Xerox Alto 3/7/2021 22

Alan Kay @ PARC 4 The Star (1981 and begun in 1975) in particular was a very advanced machine. It had most of the “WIMP” elements we know today. 4 The Star was the result of extensive user testing, and its design has stood the test of time (Liddle article). 4 Many design features were better than its successors (e. g. object-oriented editing features) 3/7/2021 23

The Star group 4 The Star design team developed a new 4 4 methodology for system design: Task analysis Wide range of users Usage scenarios Decomposition of design: * display and control interface * User’s conceptual model 4 Many prototyping cycles 4 Desktop metaphor, direct manipulation, WYSIWYG 3/7/2021 24

Star -> Mac 4 But the Star was expensive and slow ($25 k). 4 Steve Jobs and Apple engineers visited PARC in 1979, and that set the path for Apple 4 15 PARC engineers migrated to Apple 4 Apple Lisa ships in 1983 at $10, 000, and fails in the marketplace 4 The Apple Macintosh ships in 1984 at $2500, and the personal computing market changes for good 3/7/2021 25

Alan Kay after PARC 4 Kay worked briefly at Atari, then became an Apple fellow in 1984. Often visited the MIT Media Lab in the 80’s and 90’s. 4 In 1996 he left for Disney to become a Disney fellow. 4 Left Disney because of cutbacks, joined HP labs in 2002. 3/7/2021 26

Alan Kay quote 4 "Don't worry about what anybody else is going to do… The best way to predict the future is to invent it. Really smart people with reasonable funding can do just about anything that doesn't violate too many of Newton's Laws!" 3/7/2021 27

Small Devices 4 The Apple Newton was the first “PDA” (1993) but didn’t succeed commercially. 4 Still popular, though out of production. 4 Has achieved a kind of cult status. 3/7/2021 28

Palm Pilot 4 Jeff Hawkins was an EE with an interest in 4 4 cognitive science and the brain. Worked at GRi. D. Wrote Ph. D. proposal at Berkeley in Biophysics in 1987 - rejected. Back to GRi. DPad - first pen computer? Developed a handwriting recognizer based on his interests in the Brain. 3/7/2021 29

Palm Pilot 4 Next try “Zoomer” 1993 - a failure commercially 4 Intensive studies of Zoomer users began in 1994. 4 Decided the PDA should be a paper replacement, not a PC replacement. 4 Switched to graffiti. 4 Shrunk to pocket size. 4 Unveiled the Palm Pilot in 1994. 3/7/2021 30

Tablet PC 4 Excellent writing surface, pen, digital ink. 4 Compromise on: * Keyboard * Weight * Battery life 4 Still trying to be a PC. 4 Many formats, will natural selection choose a winner? - or is it headed the way of the Newton? 3/7/2021 31

Smart phones 4 Qualcomm’s PDQ 1999 (Jacobs) - phone 4 4 with a complete Palm Pilot inside. Other models followed. Latest generation of phones support “applets”. Motorola J 2 ME phones. Qualcomm’s BREW (binary) environment. GPS will enable locationbased services. 3/7/2021 32

Break 3/7/2021 33

Admin issues 4 First assignment is due Monday at 529 Soda (in mailbox or slide under door). 4 If you’re ready you can hand it in at end of class. 4 Ombudsperson – volunteer? 4 http: //www. cs. berkeley. edu/~jfc click on CS 160 4 Farhad farhadm@berkeley. edu 3/7/2021 34

HCI principles 4 Wilfred Hansen (1971) introduced principles for 4 4 UI design: “Know the user” “Minimize Memorization” “Optimize Operations” “Engineer for Errors” 3/7/2021 35

HCI principles 4 “The Psychology of Human-Computer Interaction” by Card, Moran and Newell, 1983 4 Included mechanistic models of human behavior, the MHP or “Model Human Processor”. 3/7/2021 36

HCI principles 4 Don Norman introduced many principles from 4 4 cognitive science: (1980 s – 90 s) Mental representation. Gibson’s affordances. Direct Manipulation (WYSIWYG). Human-centered design. 3/7/2021 37

HCI principles 4 John Gould (1988) in “How to Design Usable 4 4 Systems” outlined many modern principles of UI design: Early, continuous, focus on users Early and continuous user testing Iterative Design Integrated Design 4 Suggested observation of users in their workplace, “thinking aloud”, videotaping, task analysis, discovery of work context, … 3/7/2021 38

HCI principles 4 Jacob Nielsen fostered a science of “Usability” in the 1990 s. 4 Structured processes for evaluation and development of UIs and web sites. 4 Pioneered “heuristic evaluation” and other low-cost usability methods. 4 Emphasized the economic benefit of usability improvement to companies. 3/7/2021 39

Contextual Inquiry 4 Main advocates: Hugh Beyer and Karen Holtzblatt 4 Contextual Design book published in 1997 4 Structured interview process and thinking aloud. 4 Almost universal now in user interface design. 3/7/2021 40

What hasn’t happened (yet) 4 Virtual Reality: create a world in the computer that’s like the “real world”: Microsoft “BOB”. 3/7/2021 41

What hasn’t happened (yet) 4 VR still has potential, but it must be applied carefully. Keep in mind that: 4 People adapt their real-world skills quite well to non-physical environments: navigation on the web. 4 Much of the detail in the physical world is irrelevant to the task. 4 In the real world, we rely a great deal on text and documents. 3/7/2021 42

What hasn’t happened (yet) 4 Speech interfaces haven’t “taken over” UI design. 4 There are growing applications of speech 4 4 interfaces (especially telephone systems). But speech is only part of natural human-human interaction. Speech requires shared understanding and “everyday” knowledge that is hard for computers. In real life, we still rely on text and graphics to communicate complex ideas. Visual representations of information have many advantages: scanning, recognizing, summarizing 3/7/2021 43

What hasn’t happened (yet) 4 Today, most HCI researchers believe speech will be used in combination with other I/O modes whenever possible. 4 This is the area of “Multimodal” UIs. 3/7/2021 44

What hasn’t happened (yet) 4 Intelligent “agents” that you interact with like a person. 4 There are some examples and this is still a research area, but it has been found that: 4 Some benefits of agent interaction apply in much simpler cases: people are “influenced by” and make human-like attributions to text interfaces. 4 Successful agents are complex and expensive to build – realism takes work that doesn’t translate into profit for a company. 3/7/2021 45

What hasn’t happened (yet) 4 On the other hand, agents have great potential for entertainment. 4 Many successful games use agents, e. g. The Sims 4 Toys are appearing with agent-like behavior (Sony’s Aibo). 4 This creates powerful infrastructure for agent design, which may yield results for HCI. 3/7/2021 46

The future? 4 Smart rooms, cars & homes 4 Wearable computers 4 Multimodal and tangible UIs 4 Context-aware and “anywhere” interfaces 3/7/2021 47

Summary 4 Many seminal ideas came from the very early years of computing 4 Considering the user (even if its yourself) leads to new ideas 4 Innovation happened in bursts, depending on funding and the right environment 4 A modern design process led to a very modern design (the Xerox Star) 3/7/2021 48

Summary 4 The theoretical influences in HCI have not been obvious (a little cognitive science and AI, quite a lot of anthropology and social psychology). 4 User-centered design and iteration evolved by trail-and-error. 4 Some appealing kinds of interaction haven’t taken over (VR, speech, agents) – beware naïve models of human behavior. 3/7/2021 49