Feature Level Processing n n Lessons from lowlevel

  • Slides: 61
Download presentation
Feature Level Processing n n Lessons from low-level vision Applications in Highlighting Icon (symbol)

Feature Level Processing n n Lessons from low-level vision Applications in Highlighting Icon (symbol) design Glyph design

Spotfire product

Spotfire product

Visual symbols

Visual symbols

Architecture for visual thinking

Architecture for visual thinking

Primitives of Perception (the phonemes). n n The whole visual field is processed in

Primitives of Perception (the phonemes). n n The whole visual field is processed in parallel This machinery tells us what kinds of information are easily distinguished Popout effects (general attention) Segmentation effects (dividing up the visual field)

Segmentation by Primitive Features

Segmentation by Primitive Features

Livingston and Hubel Neural Architecture

Livingston and Hubel Neural Architecture

Orientation and Size (Gabor primitives)

Orientation and Size (Gabor primitives)

Image segmentation based on texture

Image segmentation based on texture

Vector fields like using gabors

Vector fields like using gabors

Pre-Attentive Processing

Pre-Attentive Processing

Color is Pre-Attentive (Pops out)

Color is Pre-Attentive (Pops out)

Generic Pre-Attentive Experiment n n Number of irrelevant items varies Pre-attentive 10 msec per

Generic Pre-Attentive Experiment n n Number of irrelevant items varies Pre-attentive 10 msec per item or better.

Color

Color

Orientation

Orientation

Motion

Motion

Size

Size

Simple shading

Simple shading

Conjunction (does not pop out)

Conjunction (does not pop out)

Semantic Depth of Field

Semantic Depth of Field

Compound features (do not pop out)

Compound features (do not pop out)

Surrounded colors do not pop out

Surrounded colors do not pop out

Laws of pre attentive display n Must stand out on some simple dimension n

Laws of pre attentive display n Must stand out on some simple dimension n n color, simple shape = orientation, size motion, depth Lessons for highlighting – one of each

Lessons: Highlighting how to make information available to attention Using color Using underlining A

Lessons: Highlighting how to make information available to attention Using color Using underlining A flying box leads attention Blinking momentarily attracts attention Motion elicits an orienting response

More Pre-Attentive

More Pre-Attentive

Conjunction (does not pop out)

Conjunction (does not pop out)

Pre-attentive conjunction

Pre-attentive conjunction

Conjunctions of motion and shape do pop out. (color also? ) n Mc. Leod,

Conjunctions of motion and shape do pop out. (color also? ) n Mc. Leod, P. , Driver, J. and Crisp, J. (1988) Visual search for a conjunction of movement and form is parallel. Nature 332, 154 -155. n Driver, J. , Mac. Leod, P. and Dienes, Z. (1992) Motion coherence and conjunction search: Implications for guided search theory. Perception and Psychophysics. 51, 1, 79 -85.

MEGraph: Experimental system n Allows for various topological range highlighting methods MEGraph Goal from

MEGraph: Experimental system n Allows for various topological range highlighting methods MEGraph Goal from 30 to 2000 nodes

Pre-Attentive Channels n n n Form (orientation/size) Color Simple motion/blinking Addition/numerosity (up to 3)

Pre-Attentive Channels n n n Form (orientation/size) Color Simple motion/blinking Addition/numerosity (up to 3) Spatial, stereo depth, shading, position

Pre-Attentive Conjunctions n n n Stereo and color Color and motion Color and position

Pre-Attentive Conjunctions n n n Stereo and color Color and motion Color and position Shape and position In general: spatial location and some aspect of form

Pre-Attentive Lessons n n n Rapid visual search (10 msec/item) Easy to attend to

Pre-Attentive Lessons n n n Rapid visual search (10 msec/item) Easy to attend to Makes symbols distinct Based on simple visual attributes Faces, etc are not pre-attentive

Designing symbols

Designing symbols

Perceptual Channels n n n Color (3) Shape (size, orient) Motion (2? ) Texture

Perceptual Channels n n n Color (3) Shape (size, orient) Motion (2? ) Texture (2++) Position (x, y)

Spatial Channels Like interferes with like

Spatial Channels Like interferes with like

Size contrast effect

Size contrast effect

Orient contrast

Orient contrast

Size contrast effects can cause errors in information display

Size contrast effects can cause errors in information display

Chris Weigle: orientation channels for info display

Chris Weigle: orientation channels for info display

Mapping data to display variables Data glyphs n n n n Position (2) Orientation

Mapping data to display variables Data glyphs n n n n Position (2) Orientation (1) Size (spatial frequency) Motion (2)++ Blinking? Star glyph Color (3) Method Note we have the problem of heterogeneity – There is no good solution

Starplot glyph

Starplot glyph

Spotfire product

Spotfire product

Integral and Separable dimension (Garner) n Can we read display attributes n n n

Integral and Separable dimension (Garner) n Can we read display attributes n n n Independently Holistically Speeded classification task. Sort into two piles on one dimension or another

Integral red-green yellow-blue black-white red-green x-size y-size Color orientation Motion Color Separable

Integral red-green yellow-blue black-white red-green x-size y-size Color orientation Motion Color Separable

Lessons for Information Display n n n Orthogonality - use a different channel for

Lessons for Information Display n n n Orthogonality - use a different channel for a different type of information If you need this use separable challenge If you need to highlight by two properties use separable dimensions.

The programmable filter n n n We can only look for patterns of simple

The programmable filter n n n We can only look for patterns of simple features Conjunctions of shape, color cannot be programmed for parallel search of field Conjunctions of depth/motion and color/shape can be Integral dimensions tend to be seen holistically cannot be separated Separable dimensions tend to be seen separately

Searchlight Model of Attention

Searchlight Model of Attention

Searchlight Properties n n n Size varies with data density Size varies with stress

Searchlight Properties n n n Size varies with data density Size varies with stress level Attention operators work within the searchlight beam Attention is a tunable filter Eye movements 3/sec – A series of saccades