Visual Thinking and Visual Thinking Tools Space Time

  • Slides: 43
Download presentation
Visual Thinking and Visual Thinking Tools: Space, Time and Simple Cognitive Models to Support

Visual Thinking and Visual Thinking Tools: Space, Time and Simple Cognitive Models to Support Design Colin Ware Data Visualization Research Lab, CCOM, University of New Hampshire

Architecture for visual thinking

Architecture for visual thinking

Change Blindness Simons and Levin

Change Blindness Simons and Levin

Central Problem: How do we perceive the world in all its rich detail?

Central Problem: How do we perceive the world in all its rich detail?

The Nature of Visual Space

The Nature of Visual Space

Capacity of visual working memory (Vogal, Woodman, Luck, 2001) n n n Task –

Capacity of visual working memory (Vogal, Woodman, Luck, 2001) n n n Task – change detection Can see 3. 3 objects Each object can be complex 1 second

Sequential comparison task

Sequential comparison task

We can remember about 3 -8 locations Gist Semantic content

We can remember about 3 -8 locations Gist Semantic content

Solution n “The world is its own memory” O’Regan Task-related active vision “What you

Solution n “The world is its own memory” O’Regan Task-related active vision “What you see is what you need” Treish et al. (2003) n Seeing is a process that helps us solve problems

Task-related eye movements Hayhoe and Ballard, 2005

Task-related eye movements Hayhoe and Ballard, 2005

Example 1: How to get focus and context? n n n Zooming (Bedersen) Linked

Example 1: How to get focus and context? n n n Zooming (Bedersen) Linked windows (Fowler & Ware) Fisheye (Furnas, Carpendale)

Zooming Vs Multiple Windows (Matt Plumlee) n Problem: When do we need extra windows?

Zooming Vs Multiple Windows (Matt Plumlee) n Problem: When do we need extra windows? Comparing parts of a visual scene. n 2 solutions: Zooming, multiple windows n

Task: searching for target patterns that match Conditons: Zooming vs Windows + eye movements

Task: searching for target patterns that match Conditons: Zooming vs Windows + eye movements 1, 3, 5, 7 items per cluster

Cognitive Model (grossly simplified) n Time = setup cost + number of “visits” x

Cognitive Model (grossly simplified) n Time = setup cost + number of “visits” x time per visit Number of visits is a function of number of objects to be compared and visual working memory capacity. Visits = n/M n

Prediction As targets (and visual working memory load) increases, multiple Windows become more attractive.

Prediction As targets (and visual working memory load) increases, multiple Windows become more attractive. Results

Design heuristic n When we need to compare more two or three simple pattern

Design heuristic n When we need to compare more two or three simple pattern components add windows.

Example 2 n Tools for finding new underwater behaviors from humpback whale tag data

Example 2 n Tools for finding new underwater behaviors from humpback whale tag data (Why turning time into space is a good idea)

The gear Antenna Big Eyes DTAG Mark Johnson Dave Wiley

The gear Antenna Big Eyes DTAG Mark Johnson Dave Wiley

Task: find new behaviors = stereotyped patterns Cognitive Algorithm n repeat n n Review

Task: find new behaviors = stereotyped patterns Cognitive Algorithm n repeat n n Review behavior sequence looking for patterns. Remember patterns. Look for more instances. until no new patterns

The old way

The old way

Solution 1. Geo. Zui 4 D

Solution 1. Geo. Zui 4 D

Cognitive process for finding new behaviors stereotyped patterns Cognitive Algorithm n repeat n n

Cognitive process for finding new behaviors stereotyped patterns Cognitive Algorithm n repeat n n n Review behavior sequence looking for patterns by playback. Remember patterns using space-time notes. Look for more instances. May involve reviewing all other whale tracks. Until no new patterns Cost k*playback time.

Solution 2: trackplot

Solution 2: trackplot

Foraging patterns

Foraging patterns

Traversing

Traversing

2006 Mostly 04 06 07 06

2006 Mostly 04 06 07 06

Process for finding new behaviors stereotyped patterns Cognitive algorithm n Get to a good

Process for finding new behaviors stereotyped patterns Cognitive algorithm n Get to a good viewpoint n repeat n n n Review behavior sequence looking for patterns eye movements. Remember patterns using visual working memory. Look for more instances. May involve reviewing all other whale tracks. Can be posted on the wall until no new patterns Cost Nav + Eye Movement time *pattern matching.

Gain in efficiency – from playback tool to pattern finding tool n Many hours

Gain in efficiency – from playback tool to pattern finding tool n Many hours (with playback) A few minutes (with patterns) n Approximately a factor of 100 n

Design heuristic n Whenever possible: Turn time into a spatial pattern – one that

Design heuristic n Whenever possible: Turn time into a spatial pattern – one that converts critical events into shapes or patterns n Try to make natural mappings – proper use of texture color, etc.

Example 3: Network diagram

Example 3: Network diagram

Degree of relevance highlighting n n n User clicks on something Computer shows related

Degree of relevance highlighting n n n User clicks on something Computer shows related items User conducts a visual search for task relevant information

ME Graph Constellation

ME Graph Constellation

Order of magnitude gain in size n n n Layout problem simplified Applicable to

Order of magnitude gain in size n n n Layout problem simplified Applicable to many problems Depends on information scent

Review OBJECT FILES “Nexus”

Review OBJECT FILES “Nexus”

Where are we going? n Simple cognitive process models involving n n Perceptual and

Where are we going? n Simple cognitive process models involving n n Perceptual and cognitive operations Interaction methods For Design