Sketch Recognizers from the EndUsers the Designers and

Sketch Recognizers from the End-User’s, the Designer’s, and the Programmer’s Perspective Jason Hong James Landay A. Chris Long Jennifer Mankoff Mar 26 2002

Overview • Lots of existing work on recognizers – Focus on accuracy and robustness • Not as much out there on using recognizers in practice – End-users, designers, programmers • Outline our group's experiences – Building and evaluating sketching apps – Tools for designers and programmers Mar 26 2002 2

Roles in Developing Sketching Apps Role End-User Goals Accomplish some task with the technology Designer Create and iteratively evaluate and improve an interface Concerns Useful Usable Desirable Interaction Feedback Look and Feel Prototyping Programmer Write good code and Recognizers debug it Reusability APIs Debugging Mar 26 2002 3

Overview of Apps and Tools Role End-User Applications and Tools SILK, Burlap, DENIM Designer Quill Programmer SATIN and OOPS Mar 26 2002 4

Overview of Apps and Tools Role End-User Applications and Tools SILK, Burlap, DENIM Designer Quill Programmer SATIN and OOPS Mar 26 2002 5

SILK Mar 26 2002 Landay (1996)6

Burlap Mar 26 2002 Mankoff, Hudson, Abowd (CHI 2000) 7

DENIM Mar 26 2002 Lin, Newman, Hong, Landay (CHI 2000) 8

Overview of Apps and Tools Role End-User Applications and Tools SILK, Burlap, DENIM Designer Quill Programmer SATIN and OOPS Mar 26 2002 9

Quill Mar 26 2002 Long, Landay, Rowe, Michiels (CHI 2000) 10

Quill Mar 26 2002 11

Overview of Apps and Tools Role End-User Applications and Tools SILK, Burlap, DENIM Designer Quill Programmer SATIN and OOPS Mar 26 2002 12

SATIN and OOPS • Clear need for APIs and algorithms for strokes and recognizers • Two different toolkits – Focus on pluggability and reusability Mar 26 2002 13

SATIN Mar 26 2002 14

SATIN Libraries Straighten Merge Mar 26 2002 15

SATIN Libraries Split Mar 26 2002 Pen Widgets 16

OOPS • Toolkit-level support for handling ambiguity and recognition errors – Library of mediators – Architectural support • hierarchical events, mediation, and event dispatching Mar 26 2002 17

OOPS down • • • drag • • • up stroke s Mar 26 2002 c 18

Takeaway Ideas • Still need many tools for creating useful and usable sketching apps – Designers need more prototyping and evaluation tools – Programmers need more toolkits and libraries for making robust applications • Informal user interfaces – Creative or communication tasks • Ambiguity and errors will always occur – Minimize, hide, or defer (and mediate) Mar 26 2002 19

Sketch Recognizers from the End-User’s, the Designer’s, and the Programmer’s Perspective Jason Hong James Landay A. Chris Long Jennifer Mankoff Mar 26 2002

Backup Slides Mar 26 2002 21

Backup Slides Mar 26 2002 22

Backup Slides Mar 26 2002 23

Backup Slides Mar 26 2002 24

Backup Slides Mar 26 2002 25

Backup Slides Mar 26 2002 26

Defining Multistrokes (and (contains-p container containee) (rectangle-p container) (rectangle-p containee) (skinny-p container : vertical) versus Mar 26 2002 27