Too Much Information And Too Little Time Raj

  • Slides: 16
Download presentation
Too Much Information And Too Little Time Raj Reddy Carnegie Mellon University Sep 22,

Too Much Information And Too Little Time Raj Reddy Carnegie Mellon University Sep 22, 2016 Talk Presented at Heidelberg Laureate Forum 1

Bill of Rights for Surviving in an Information Rich Society l Getting the right

Bill of Rights for Surviving in an Information Rich Society l Getting the right information l l To the right people l l e. g. machine translation In the right medium l l e. g. just-in-time (task modeling, planning) In the right language l l e. g. categorizing, routing At the right time l l e. g. search engines e. g. using speech for language divide and literacy divide With the right level of detail (granularity) l e. g. summarization Carbonell, Language Technology Institute Manifesto 2

Human Limitations and Human Strengths Lessons from Cognitive Science l Understand Human Limitations ·

Human Limitations and Human Strengths Lessons from Cognitive Science l Understand Human Limitations · People Make Errors · Tend To Forget · Become Impatient · Tend To Favor Least Effort · · Understand Human Strengths · People Learn From Experience · Tolerate Errorful, Ambiguous And Imprecise Input · Exploit Vast Amounts Of Knowledge · Communicate Using Speech And Natural Language · · Too Much Information And Too Little Time

Human Limitations and Options l To Err is Human l Lead to Catastrophic loss

Human Limitations and Options l To Err is Human l Lead to Catastrophic loss of data (“I didn’t mean to do that”) and Unanticipated side-effects “What happened? ” l Caused by Sensory, Cognitive and Motor overload l “Like being in a traffic jam” l Current solutions: Partial Undo and ^C l Future Options: Unlimited Undo and Anytime Abort l To Forget is Human l A non-expert occasional user can’t be expected to remember the details l Forgetting is caused by the loss of indexing structure l Current solutions: Recognition vs. recall: Menus and On -line manuals l Future Options: Intelligent Help “How do I” and “What if” Multi-media documentation (Why not You. Tube Model? )

Human Limitations and Options (cont. ) l To Be Impatient is Human l Waiting

Human Limitations and Options (cont. ) l To Be Impatient is Human l Waiting time to get the answer in interactive problem solving Long Start-up and Shutdown Times l Network operations: Unpredictable retrieval and browsing times l l Current solutions: Hour glasses, Wheels and Progress Bars l l l No idea how long it will take Future Options: Updates in the background, Learn from experience, Look ahead retrieval and computation To Favor Least Effort is Human Most people use a minimal subset of functionality in Word, Power. Point, etc. l Most people avoid tasks requiring too much cognitive effort e. g. PGP (too much work) and FTP (too complex) l Causes: Principle of Least Effort l Future opportunities: Autocomplete and Cognition Amplifiers l

Human Limitations and Human Strengths Lessons from Cognitive Science · Understand Human Limitations ·

Human Limitations and Human Strengths Lessons from Cognitive Science · Understand Human Limitations · People · · · Understand Human Strengths · People · · · Make Errors Tend To Forget Become Impatient Tend To Favor Least Effort Learn From Experience Tolerate Errorful, Ambiguous And Imprecise Input Exploit Vast Amounts Of Knowledge Communicate Using Speech And Natural Language Too Much Information And Too Little Time

Video Illustrating Human Capabilities That Computers Can’t Match, Yet Link to Video: www. rr.

Video Illustrating Human Capabilities That Computers Can’t Match, Yet Link to Video: www. rr. cs. cmu. edu/ff. wmv

Missing Science of Human Capabilities Lessons from Flash Forward Video l SILKy Interfaces l

Missing Science of Human Capabilities Lessons from Flash Forward Video l SILKy Interfaces l Speech, Image, Language and Knowledge l Forgiving Interfaces: Tolerate error and ambiguity l “You Bet” --- “Did That Mean Yes? ” l Learning from Experience: Incremental nonintrusive knowledge acquisition l “Darn” --- “Would you Care to Define It? ” l Intelligent Help, Advice and Tutoring l “ Enthusiasm Detected --- Care to View Large Screen? ” l Intelligent Agents: Task Execution l “Get me Sam Gallagher, Try Every Number”

Human Limitations and Human Strengths Lessons from Cognitive Science · Human Limitations · People

Human Limitations and Human Strengths Lessons from Cognitive Science · Human Limitations · People · · · Human Strengths · People · · · Make Errors Tend To Forget Become Impatient Tend To Favor Least Effort Learn From Experience Tolerate Errorful, Ambiguous And Imprecise Input Exploit Vast Amounts Of Knowledge Communicate Using Speech And Natural Language Too Much Information And Too Little Time

Too Much Information and Too Little Time l Drowning In Too Much Information and

Too Much Information and Too Little Time l Drowning In Too Much Information and Too Little Time Severely lacking tools to cope with the problem l Not a new problem, but the scale of the data and data rate has changed dramatically l l As early as 1969, Simon discussed the problem of “Wealth of Information and Scarcity of Attention” l l in Computers, Communications and Public Interest, Martin Greenberger 1971 Spawned the Field of “Attention Economics” White House Analogy l Need-to-Know Principle l l l Re-structure information: Organize, Summarize and Hyperlink Overview, Zoom, Filter and Details on Demand Simon on Reading Newspapers: “It is a complete waste of time” Social Networks like Facebook viewed primarily as entertainment

Key Principles of Information Overload l Bounded Rationality and Satisficing When Faced with Information

Key Principles of Information Overload l Bounded Rationality and Satisficing When Faced with Information Overload, People Settle for Good Enough Solutions in Preference to Optimal Solutions l When human thinking capabilities are overloaded, People use strategies and tactics of “optimal-least-computation” l l l “Optimal-least-computation” is the study of approximate algorithms to find the best possible solution given limited memory capacity, limited time, or limited bandwidth Wealth of Information and Scarcity of Attention l When faced with too much information and too little time, Embrace the Need-to-Know-Principle, by creating Summarization Tools l Information Structuring Tools l Use Techniques of Journalism and Cinematography l Overview, Zoom, Filter and Details on Demand (Hyperlink the Details) l Autocomplete Actions l Non Intrusive Notifications l

Cognition Amplifiers and Guardian Angels are two families of intelligent Agents that help with

Cognition Amplifiers and Guardian Angels are two families of intelligent Agents that help with scarcity of attention problem l A Cognition Amplifier is a Personal Enduring Autonomic Intelligent Agent that anticipates what you want to do and helps you to do it with less effort l l l l Buying and selling: Transact with multiple providers Email: Filter spam, understand respond to actionable email News: Based on topic preferences, novelty, collaborative filtering Banking: Monitor bank account, Credit Cards, Pay Bills Travel: Flights, hotel, schedule disruptions, cancellations A Guardian Angel is a Personal Enduring Autonomic Intelligent Agent that Discovers And Warns You About Unanticipated Events That Could Impact Your Safety, Security, and Happiness Just-in-Time Warnings: Hurricanes, Tornados, Tsunami, Earthquakes, Flooding, Extreme Weather l Accident Alerts and Rerouting; Transport Strikes l Scarcity of Essential Resources: Food, Energy, Water etc. 12 l l Thousands of Cogs and Gats as Personal Assistants?

Architecture of Cogs and Gats l Cogs and Gats are Mobile Apps (like a

Architecture of Cogs and Gats l Cogs and Gats are Mobile Apps (like a shadow) for Each Person on the Planet l l Unlike APPs of today, Cogs are Mass-customized to Each Individual Designed to be Non-intrusive, Autonomic, and Device Independent Always On, Always Present and Always Working Always Learning l l Cogs and Gats Monitor, Analyze and Learn From Experience; l Learn From Own Experience And Experience of Others l l l Enduring (life-long) And share knowledge with a community of Cogs and Gats Automated Discovery of Data and Information Sources Data, suitably anonymized, can be used to learn appropriate responses for every possible situation by l l Learning preferences by observing user choices, Learning by task similarity and user similarity, Learning by error correction and Simply learning thru clarification dialog ( does that mean yes? Would 13 you care to define it? ).

Conclusion l Pay Attention to Human Strengths, Limitations and Needs l NEVER Intrusive Ads

Conclusion l Pay Attention to Human Strengths, Limitations and Needs l NEVER Intrusive Ads on the right or bottom, no animation l Abolish Dialog Boxes - Replace with Notifications! l Replace “Live Tiles” with WIWTBDIWC l Glasses and Watches To Invisible Wearables l l Scarcity of Attention Implies Creation of Tools for Minimization of Human Effort Use Cogs Autocomplete Tasks, not Just Text l Use Gats to Help with Unpredictable Events l Avoid Redesigns that Require Re-Learning l l Ribbons in Word l Win 7 to Win 8 l $10 Rule: Are You Willing to Pay Every Customer $10 Every Time You Radically Change Look And Feel Of Your Software Product? l One Size Fits All Software Personalized Modular Software l Personalize and Mass-customize everything

Backup Slides

Backup Slides

Vision: Cognition Amplifiers Maxim is “Activity Monitoring” enables “Intention Awareness” enables “Cognition Amplifiers” enables

Vision: Cognition Amplifiers Maxim is “Activity Monitoring” enables “Intention Awareness” enables “Cognition Amplifiers” enables “ 80%+ Automation” l Intention Awareness can be Inferred from Prior Activity Patterns of the User (and Others with Similar Profile) l Intention Awareness enables Creation of Personal Autonomic Cognition Amplifiers (Cogs) l Cogs are created by continuously monitoring multimodal sensors on modern smart phones, and discovering and interpreting user activities and intentions thru non-intrusive learning technologies. l The Activity Monitoring System non-intrusively adapts and creates personalized Cogs using Cog Templates from the Platform providers and Cog developers l Cogs enable Automation of Much of the Human Work and Daily Personal Activities Than One-size-fits-all Apps l No matter what the user is trying to do (not just search) intention aware computing and Cogs will enable the user to do the tasks faster, with fewer errors, and less cognitive load. l