chapter 18 modelling rich interaction Modelling Rich Interaction
![chapter 18 modelling rich interaction chapter 18 modelling rich interaction](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-1.jpg)
![Modelling Rich Interaction • status–event analysis • rich environments in task analysis • sensor-based Modelling Rich Interaction • status–event analysis • rich environments in task analysis • sensor-based](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-2.jpg)
![status–event analysis • events – things that happen • e. g. alarm bell, beeps, status–event analysis • events – things that happen • e. g. alarm bell, beeps,](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-3.jpg)
![rich set of phenomena events status input keypress mouse position output beep display internal rich set of phenomena events status input keypress mouse position output beep display internal](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-4.jpg)
![rich set of behaviour actions: – state change at (user initiated) event status change rich set of behaviour actions: – state change at (user initiated) event status change](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-5.jpg)
![Properties of events • status change event – the passing of a time • Properties of events • status change event – the passing of a time •](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-6.jpg)
![Design implications • actual/perceived lag… matches application timescale? • too slow – response to Design implications • actual/perceived lag… matches application timescale? • too slow – response to](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-7.jpg)
![Naïve psychology • Predict where the user is looking – mouse – when positioning Naïve psychology • Predict where the user is looking – mouse – when positioning](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-8.jpg)
![email delivery email delivery](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-9.jpg)
![email delivery (ctd) • mail has arrived! • timeline at each level • Perceived email delivery (ctd) • mail has arrived! • timeline at each level • Perceived](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-10.jpg)
![screen button widget Delete screen button often missed, … but, error noticed the quick screen button widget Delete screen button often missed, … but, error noticed the quick](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-11.jpg)
![Screen-button – HIT Delete brown fox quick the quick brown Screen-button – HIT Delete brown fox quick the quick brown](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-12.jpg)
![Screen button – MISS Delete the quick brown quick Screen button – MISS Delete the quick brown quick](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-13.jpg)
![HIT or a MISS? HIT CLICK identical screen feedback MISS semantic feedback only closure HIT or a MISS? HIT CLICK identical screen feedback MISS semantic feedback only closure](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-14.jpg)
![rich contexts rich contexts](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-15.jpg)
![the problem • task models – formal description • situatedness – unique contexts • the problem • task models – formal description • situatedness – unique contexts •](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-16.jpg)
![collaboration • already in several notations – e. g. CTT, GTA • add artefacts collaboration • already in several notations – e. g. CTT, GTA • add artefacts](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-17.jpg)
![Concur. Task. Trees (CTT) Paterno et al. CNUCE, Pisa book holiday abstract task user Concur. Task. Trees (CTT) Paterno et al. CNUCE, Pisa book holiday abstract task user](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-18.jpg)
![Groupware Task Analysis GTA – conceptual framework, tools, elicitation techniques Used_by rich model of Groupware Task Analysis GTA – conceptual framework, tools, elicitation techniques Used_by rich model of](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-19.jpg)
![information pre-planned cognitive model goal action situated action environment action information pre-planned cognitive model goal action situated action environment action](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-20.jpg)
![control • open loop control – no feedback – fragile control system actions environment control • open loop control – no feedback – fragile control system actions environment](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-21.jpg)
![control • open loop control – no feedback – fragile • closed loop control control • open loop control – no feedback – fragile • closed loop control](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-22.jpg)
![adding information adding information](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-23.jpg)
![adding information (ctd) information required when – – – subtask involves input (or output) adding information (ctd) information required when – – – subtask involves input (or output)](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-24.jpg)
![triggers process – get post from pigeon hole what happens and order bring post triggers process – get post from pigeon hole what happens and order bring post](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-25.jpg)
![triggers process – what happens and order triggers – when and why first thing triggers process – what happens and order triggers – when and why first thing](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-26.jpg)
![common triggers • immediate – straight after previous task • temporal – at a common triggers • immediate – straight after previous task • temporal – at a](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-27.jpg)
![artefacts • ethnographic studies • as shared representation • as focus of activity • artefacts • ethnographic studies • as shared representation • as focus of activity •](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-28.jpg)
![placeholders • knowing where you are in a process – like a program counter placeholders • knowing where you are in a process – like a program counter](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-29.jpg)
![where are you? where are you?](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-30.jpg)
![step 1. choose new flight level step 1. choose new flight level](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-31.jpg)
![step 3. flight level confirmed step 3. flight level confirmed](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-32.jpg)
![step 5. new flight level acheived step 5. new flight level acheived](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-33.jpg)
![tracing placeholders a form of information, may be … – in people’s heads • tracing placeholders a form of information, may be … – in people’s heads •](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-34.jpg)
![low intention and sensor-based interaction low intention and sensor-based interaction](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-35.jpg)
![car courtesy lights • turn on – when doors unlocked/open • turned off – car courtesy lights • turn on – when doors unlocked/open • turned off –](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-36.jpg)
![Pepys • Xerox Cambridge (RIP) • active badges • automatic diaries Allan's purpose to Pepys • Xerox Cambridge (RIP) • active badges • automatic diaries Allan's purpose to](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-37.jpg)
![Media. Cup • cup has sensors – heat, movement, pressure • broadcasts state (IR) Media. Cup • cup has sensors – heat, movement, pressure • broadcasts state (IR)](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-38.jpg)
![shopping cart • goods in shopping cart analysed – e. g. Amazon books • shopping cart • goods in shopping cart analysed – e. g. Amazon books •](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-39.jpg)
![on. Cue • ‘intelligent’ toolbar – appropriate intelligence • make it good when it on. Cue • ‘intelligent’ toolbar – appropriate intelligence • make it good when it](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-40.jpg)
![the intentional spectrum intentional expected incidental press light switch walk into room expecting lights the intentional spectrum intentional expected incidental press light switch walk into room expecting lights](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-41.jpg)
![fluidity intentional co-option expected users explicitly use behaviour e. g. open door for lights fluidity intentional co-option expected users explicitly use behaviour e. g. open door for lights](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-42.jpg)
![interaction models • intentional cycle – Norman execution/evaluation loop • some exceptions – multiple interaction models • intentional cycle – Norman execution/evaluation loop • some exceptions – multiple](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-43.jpg)
![cognition • physical things (inanimate) – directness of effect – locality of effect – cognition • physical things (inanimate) – directness of effect – locality of effect –](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-44.jpg)
![cognition • understanding – innate intelligences • physical, natural/animal, social, physiological – rational thought cognition • understanding – innate intelligences • physical, natural/animal, social, physiological – rational thought](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-45.jpg)
![designing incidental interaction • need richer representations – of the world, of devices, of designing incidental interaction • need richer representations – of the world, of devices, of](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-46.jpg)
![issues and process • no accepted methods but … general pattern • uncertainty – issues and process • no accepted methods but … general pattern • uncertainty –](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-47.jpg)
![designing a car courtesy light • available input –door open, car engine • desired designing a car courtesy light • available input –door open, car engine • desired](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-48.jpg)
![implementation • sensors not used for original purpose • open architectures, self-discovering, self-configuring • implementation • sensors not used for original purpose • open architectures, self-discovering, self-configuring •](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-49.jpg)
![architectures for sensor-based systems? inference data fusion raw sensors data reduction control context model architectures for sensor-based systems? inference data fusion raw sensors data reduction control context model](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-50.jpg)
- Slides: 50
![chapter 18 modelling rich interaction chapter 18 modelling rich interaction](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-1.jpg)
chapter 18 modelling rich interaction
![Modelling Rich Interaction statusevent analysis rich environments in task analysis sensorbased Modelling Rich Interaction • status–event analysis • rich environments in task analysis • sensor-based](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-2.jpg)
Modelling Rich Interaction • status–event analysis • rich environments in task analysis • sensor-based systems
![statusevent analysis events things that happen e g alarm bell beeps status–event analysis • events – things that happen • e. g. alarm bell, beeps,](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-3.jpg)
status–event analysis • events – things that happen • e. g. alarm bell, beeps, keystrokes • status – things that are • e. g. screen display, watch face, mouse position • unifying framework – system (formal analysis) – user (psychology & heuristics) • time behaviour – detect delays, select feedback • transferable phenomena e. g. polling – active agent discovers status change
![rich set of phenomena events status input keypress mouse position output beep display internal rich set of phenomena events status input keypress mouse position output beep display internal](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-4.jpg)
rich set of phenomena events status input keypress mouse position output beep display internal interrupt document state external time temperature Most notations only deal with subset of these e. g. • STNs: event-in/event-out may need awkward work-arounds
![rich set of behaviour actions state change at user initiated event status change rich set of behaviour actions: – state change at (user initiated) event status change](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-5.jpg)
rich set of behaviour actions: – state change at (user initiated) event status change events: – e. g. stock drops below re-order level interstitial behaviour: – between actions – e. g. dragging an icon standard notations: usually, sometimes, never!
![Properties of events status change event the passing of a time Properties of events • status change event – the passing of a time •](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-6.jpg)
Properties of events • status change event – the passing of a time • actual and perceived events – usually some gap • polling – glance at watch face – status change becomes perceived event • granularity – birthday – days – appointment – minutes
![Design implications actualperceived lag matches application timescale too slow response to Design implications • actual/perceived lag… matches application timescale? • too slow – response to](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-7.jpg)
Design implications • actual/perceived lag… matches application timescale? • too slow – response to event too late e. g. , power plant emergency • too fast – interrupt more immediate task e. g. , stock level low
![Naïve psychology Predict where the user is looking mouse when positioning Naïve psychology • Predict where the user is looking – mouse – when positioning](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-8.jpg)
Naïve psychology • Predict where the user is looking – mouse – when positioning – insertion point – intermittently when typing – screen – if you're lucky • Immediate events – audible bell – when in room (and hearing) – peripheral vision – movement or large change • Closure – lose attention (inc. mouse) – concurrent activity
![email delivery email delivery](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-9.jpg)
email delivery
![email delivery ctd mail has arrived timeline at each level Perceived email delivery (ctd) • mail has arrived! • timeline at each level • Perceived](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-10.jpg)
email delivery (ctd) • mail has arrived! • timeline at each level • Perceived event in minutes – not guaranteed alternative explicit examination audible bell – timescale – hours/days seconds but want minutes – guaranteed
![screen button widget Delete screen button often missed but error noticed the quick screen button widget Delete screen button often missed, … but, error noticed the quick](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-11.jpg)
screen button widget Delete screen button often missed, … but, error noticed the quick brown quick a common widget, a common error: Why? Closure mistake likely – concurrent action noticed – semantic feedback missed Solution widget feedback for application event a perceived event for the user N. B. an expert slip – testing doesn't help
![Screenbutton HIT Delete brown fox quick the quick brown Screen-button – HIT Delete brown fox quick the quick brown](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-12.jpg)
Screen-button – HIT Delete brown fox quick the quick brown
![Screen button MISS Delete the quick brown quick Screen button – MISS Delete the quick brown quick](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-13.jpg)
Screen button – MISS Delete the quick brown quick
![HIT or a MISS HIT CLICK identical screen feedback MISS semantic feedback only closure HIT or a MISS? HIT CLICK identical screen feedback MISS semantic feedback only closure](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-14.jpg)
HIT or a MISS? HIT CLICK identical screen feedback MISS semantic feedback only closure eye moves elsewhere one solution add simulated click
![rich contexts rich contexts](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-15.jpg)
rich contexts
![the problem task models formal description situatedness unique contexts the problem • task models – formal description • situatedness – unique contexts •](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-16.jpg)
the problem • task models – formal description • situatedness – unique contexts • ethnography – rich ecologies bringing them together?
![collaboration already in several notations e g CTT GTA add artefacts collaboration • already in several notations – e. g. CTT, GTA • add artefacts](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-17.jpg)
collaboration • already in several notations – e. g. CTT, GTA • add artefacts too ?
![Concur Task Trees CTT Paterno et al CNUCE Pisa book holiday abstract task user Concur. Task. Trees (CTT) Paterno et al. CNUCE, Pisa book holiday abstract task user](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-18.jpg)
Concur. Task. Trees (CTT) Paterno et al. CNUCE, Pisa book holiday abstract task user task >> holiday idea computer task make booking user and computer >> email advert decide destination ( customer : ) || book flights ( travel agent: ) >> choose hotel ( customer : ) book hotel ( travel agent: ) cooperative task
![Groupware Task Analysis GTA conceptual framework tools elicitation techniques Usedby rich model of Groupware Task Analysis GTA – conceptual framework, tools, elicitation techniques Used_by rich model of](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-19.jpg)
Groupware Task Analysis GTA – conceptual framework, tools, elicitation techniques Used_by rich model of task world Object rich ontology – human roles for collaboration – physical and electronic objects Event Triggers Uses Task Performed_by Subtask Triggers Subgoal Role Subrole Is Responsible Has Goal Contains Plays Agent
![information preplanned cognitive model goal action situated action environment action information pre-planned cognitive model goal action situated action environment action](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-20.jpg)
information pre-planned cognitive model goal action situated action environment action
![control open loop control no feedback fragile control system actions environment control • open loop control – no feedback – fragile control system actions environment](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-21.jpg)
control • open loop control – no feedback – fragile control system actions environment
![control open loop control no feedback fragile closed loop control control • open loop control – no feedback – fragile • closed loop control](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-22.jpg)
control • open loop control – no feedback – fragile • closed loop control – uses feedback – robust feedback control system actions environment
![adding information adding information](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-23.jpg)
adding information
![adding information ctd information required when subtask involves input or output adding information (ctd) information required when – – – subtask involves input (or output)](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-24.jpg)
adding information (ctd) information required when – – – subtask involves input (or output) some kind of choice (how to know what to do) subtask repeated (but iterations unspecified) sources of information i. iii. iv. part of existing task (e. g. phone number entered) user remembers it (e. g. recall number after directory enquiry) on device display (e. g. PDA address book, then dial) in the environment • pre-existing (e. g. phone directory) • created in task (e. g. write number down on paper) GUI easy (lots of space) mobile/PDA need to think
![triggers process get post from pigeon hole what happens and order bring post triggers process – get post from pigeon hole what happens and order bring post](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-25.jpg)
triggers process – get post from pigeon hole what happens and order bring post to desk open post
![triggers process what happens and order triggers when and why first thing triggers process – what happens and order triggers – when and why first thing](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-26.jpg)
triggers process – what happens and order triggers – when and why first thing in the morning get post from pigeon hole holding post bring post to desk at coffee time open post
![common triggers immediate straight after previous task temporal at a common triggers • immediate – straight after previous task • temporal – at a](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-27.jpg)
common triggers • immediate – straight after previous task • temporal – at a particular time • sporadic – when someone thinks of it! • external event – when something happens, e. g. phone call • environmental cue – something prompts action … artefacts
![artefacts ethnographic studies as shared representation as focus of activity artefacts • ethnographic studies • as shared representation • as focus of activity •](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-28.jpg)
artefacts • ethnographic studies • as shared representation • as focus of activity • act as triggers, information sources, etc.
![placeholders knowing where you are in a process like a program counter placeholders • knowing where you are in a process – like a program counter](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-29.jpg)
placeholders • knowing where you are in a process – like a program counter • coding: – memory – explicit (e. g. to do list) – in artefacts
![where are you where are you?](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-30.jpg)
where are you?
![step 1 choose new flight level step 1. choose new flight level](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-31.jpg)
step 1. choose new flight level
![step 3 flight level confirmed step 3. flight level confirmed](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-32.jpg)
step 3. flight level confirmed
![step 5 new flight level acheived step 5. new flight level acheived](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-33.jpg)
step 5. new flight level acheived
![tracing placeholders a form of information may be in peoples heads tracing placeholders a form of information, may be … – in people’s heads •](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-34.jpg)
tracing placeholders a form of information, may be … – in people’s heads • remembering what to do next – explicitly in the environment • to-do lists, planning charts, flight strips, workflow – implicitly in the environment • location and disposition of artefacts electronic environments … – fewer affordances for artefacts – danger for careless design! papers tidy or skewed letter open or closed
![low intention and sensorbased interaction low intention and sensor-based interaction](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-35.jpg)
low intention and sensor-based interaction
![car courtesy lights turn on when doors unlockedopen turned off car courtesy lights • turn on – when doors unlocked/open • turned off –](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-36.jpg)
car courtesy lights • turn on – when doors unlocked/open • turned off – after time period – when engine turned on driver's purpose is to get into the car incidentally the lights come on
![Pepys Xerox Cambridge RIP active badges automatic diaries Allans purpose to Pepys • Xerox Cambridge (RIP) • active badges • automatic diaries Allan's purpose to](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-37.jpg)
Pepys • Xerox Cambridge (RIP) • active badges • automatic diaries Allan's purpose to visit Paul’s office incidentally diary entry created
![Media Cup cup has sensors heat movement pressure broadcasts state IR Media. Cup • cup has sensors – heat, movement, pressure • broadcasts state (IR)](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-38.jpg)
Media. Cup • cup has sensors – heat, movement, pressure • broadcasts state (IR) • used for awareness – user is moving, drinking, … Han's purpose to drink coffee incidentally colleagues are aware
![shopping cart goods in shopping cart analysed e g Amazon books shopping cart • goods in shopping cart analysed – e. g. Amazon books •](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-39.jpg)
shopping cart • goods in shopping cart analysed – e. g. Amazon books • used to build knowledge about books – people who like X also like Y • used to give you suggestions – “you might like to look at …”, “special offer …” my purpose to buy a book incidentally shown related titles
![on Cue intelligent toolbar appropriate intelligence make it good when it on. Cue • ‘intelligent’ toolbar – appropriate intelligence • make it good when it](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-40.jpg)
on. Cue • ‘intelligent’ toolbar – appropriate intelligence • make it good when it works • don’t make it hard of it doesn’t • analyses clipboard contents • suggests things to do with it user's purpose to copy text elsewhere incidentally alternative things to do
![the intentional spectrum intentional expected incidental press light switch walk into room expecting lights the intentional spectrum intentional expected incidental press light switch walk into room expecting lights](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-41.jpg)
the intentional spectrum intentional expected incidental press light switch walk into room expecting lights to switch on walk into room … unbeknown to you … air conditioning increases
![fluidity intentional cooption expected users explicitly use behaviour e g open door for lights fluidity intentional co-option expected users explicitly use behaviour e. g. open door for lights](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-42.jpg)
fluidity intentional co-option expected users explicitly use behaviour e. g. open door for lights comprehension incidental users notice, form model then rely on behaviour
![interaction models intentional cycle Norman executionevaluation loop some exceptions multiple interaction models • intentional cycle – Norman execution/evaluation loop • some exceptions – multiple](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-43.jpg)
interaction models • intentional cycle – Norman execution/evaluation loop • some exceptions – multiple goals, displays, opportunistic • guidelines – feedback, transparency intention goal execution evaluation system
![cognition physical things inanimate directness of effect locality of effect cognition • physical things (inanimate) – directness of effect – locality of effect –](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-44.jpg)
cognition • physical things (inanimate) – directness of effect – locality of effect – visibility of state • computational things (also animate) – complex effects – non locality of effect distance – networks; – large hidden state time – delays, memory
![cognition understanding innate intelligences physical naturalanimal social physiological rational thought cognition • understanding – innate intelligences • physical, natural/animal, social, physiological – rational thought](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-45.jpg)
cognition • understanding – innate intelligences • physical, natural/animal, social, physiological – rational thought – imagination • interfaces – GUI, VR, AR, tangible • recruit physical/tangible intelligence – ubicomp, ambient, incidental • ? ? ? homunculi, haunted houses
![designing incidental interaction need richer representations of the world of devices of designing incidental interaction • need richer representations – of the world, of devices, of](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-46.jpg)
designing incidental interaction • need richer representations – of the world, of devices, of artefacts – wider ecological concerns • two tasks – purposeful task – supported task – – for interpretation for actions
![issues and process no accepted methods but general pattern uncertainty issues and process • no accepted methods but … general pattern • uncertainty –](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-47.jpg)
issues and process • no accepted methods but … general pattern • uncertainty – traditional system due to errors – sensor-based intrinsic to design • uncertain readings, uncertain inference • usually control non-critical aspects of environment • process … identify – input – what is going to be sensed – output – what is going to be controlled – scenarios – desired output and available input
![designing a car courtesy light available input door open car engine desired designing a car courtesy light • available input –door open, car engine • desired](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-48.jpg)
designing a car courtesy light • available input –door open, car engine • desired output –light! • identify scenario • label steps 0 don’t care +, ++, … want light –, ––, … don’t want it • legal requirements light off whilst driving • safety approaching car? ? 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. 13. 14. 15. safe? light advertises presence deactivate alarm walk up to car key in door – open door & take key get in ++ close door 0 adjust seat + find road map ++ look up route +++ find right key + key in ignition – start car 0 seat belt light flashes fasten seat belt drive off ––––– 0 + illegal to drive with interior light on
![implementation sensors not used for original purpose open architectures selfdiscovering selfconfiguring implementation • sensors not used for original purpose • open architectures, self-discovering, self-configuring •](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-49.jpg)
implementation • sensors not used for original purpose • open architectures, self-discovering, self-configuring • privacy • internet–enables kettle broadcasts to the world! • context • inferring activity from sensor readings – status not event • data filtering and fusion • using several sensors to build context • inference • hand-coded or machine-learning • must be used • control something (lights) or modify user actions (TV on)
![architectures for sensorbased systems inference data fusion raw sensors data reduction control context model architectures for sensor-based systems? inference data fusion raw sensors data reduction control context model](https://slidetodoc.com/presentation_image/1d32a80373b4fca479c810ed2fd43988/image-50.jpg)
architectures for sensor-based systems? inference data fusion raw sensors data reduction control context model user actions
Richer interaction in hci
Modeling rich interaction in hci
Think and grow rich chapter 10
What is technological modelling
Homology modelling steps
Modeling tools in java
Molecular modelling laboratory
Modelling madness what's new
Revolver formula min max
Constructive solid geometry (csg)
Homology modelling steps
Hair modelling
Embedded system development life cycle
Homology modelling steps
Advanced process modeling
Mathematical modeling of electrical systems
Unit 5 data modelling assignment 2
Is graphical modelling tool for structured analysis
Algorithmic cost modelling
Class responsibility collaborator modelling
State modelling
Object oriented modelling
Multi jet modeling
An introduction to model-based cognitive neuroscience
Cognitive modelling
Types of financial modelling techniques
Menurut anda apa tujuan dari dimensional modelling....?
Data modelling techniques in business intelligence
Malatesta's modelling e.g. by mother
Cognitive modelling
Trendlines and regression analysis
Bim presentation ppt
Threat modelling web application
150000/175
Modelling
Define the relationship chapter 16
Unified modelling language
Disease modelling
Modelling software
Crc model
Marco arpagaus
Or modelling
Solid
Consequence modelling software
Unit 42 spreadsheet modelling
Sim biology
Modelling
Mom modelling
Modelling task
Modelling
Modelling