Vision is hard Humans vision is easy chess

  • Slides: 29
Download presentation
Vision is hard • Humans - vision is easy - chess is hard •

Vision is hard • Humans - vision is easy - chess is hard • Computers - vision is hard - chess is easy

Origins of image variability • • • Illumination Scale Translation Rotation Deformation

Origins of image variability • • • Illumination Scale Translation Rotation Deformation

Illumination invariance • Light from an object depends on illumination, as well as absorption.

Illumination invariance • Light from an object depends on illumination, as well as absorption. • Even black and white depend on context. • Center-surround antagonism is helpful for ignoring illumination.

Checker-shadow illusion Courtesy of Professor Edward H. Adelson. Used with permission.

Checker-shadow illusion Courtesy of Professor Edward H. Adelson. Used with permission.

Checker-shadow illusion Courtesy of Professor Edward H. Adelson. Used with permission.

Checker-shadow illusion Courtesy of Professor Edward H. Adelson. Used with permission.

Selectivity and invariance • The sensory world is in eternal flux. • Yet we

Selectivity and invariance • The sensory world is in eternal flux. • Yet we perceive an underlying constancy.

Cortical area 17 Human Macaque Monk y 1 cm Area 17 • Occipital lobe

Cortical area 17 Human Macaque Monk y 1 cm Area 17 • Occipital lobe • Brodmann area • Synonyms - area 17 - primary visual cortex - V 1 - striate cortes Calcarine Fissure Figure by MIT OCW. After figure 10. 11 in: Bear, Mark F. , Barry W. Connors, and Michael A. Paradiso. Neuroscience: Exploring the Brain. 2 nd ed. Baltimore, Md. : Lippincott Williams & Wilkins, 2001. ISBN: 0683305964.

Simple cell receptive field • Elongated ON and OFF subregions • Antagonistic organization Images

Simple cell receptive field • Elongated ON and OFF subregions • Antagonistic organization Images removed due to copyright reasons. Please see figures 10. 21 a, b, and c in: Bear, Mark F. , Barry W. Connors, and Michael A. Paradiso. Neuroscience: Exploring the Brain. 2 nd ed. Baltimore, Md. : Lippincott Williams & Wilkins, 2001. ISBN: 0683305964.

Orientation selectivity Receptive field Visual stimulus Cell discharge Figure by MIT OCW. After figure

Orientation selectivity Receptive field Visual stimulus Cell discharge Figure by MIT OCW. After figure 10. 22 in: Bear, Mark F. , Barry W. Connors, and Michael A. Paradiso. Neuroscience: Exploring the Brain. 2 nd ed. Baltimore, Md. : Lippincott Williams & Wilkins, 2001. ISBN: 0683305964.

Direction selectivity Visual stimulus Receptive field Direction of movement Layer IVB cell discharge In

Direction selectivity Visual stimulus Receptive field Direction of movement Layer IVB cell discharge In response to left-right Stimulus movement Direction of movement Receptive field Layer IVB cell discharge In response to left-right Stimulus movement Figure by MIT OCW. After figure 10. 23 in: Bear, Mark F. , Barry W. Connors, and Michael A. Paradiso. Neuroscience: Exploring the Brain. 2 nd ed. Baltimore, Md. : Lippincott Williams & Wilkins, 2001. ISBN: 0683305964.

Complex cell receptive field Visual stimulus Receptive field Light: ON OFF Record of Action

Complex cell receptive field Visual stimulus Receptive field Light: ON OFF Record of Action potentials Time Figure by MIT OCW. After figure 10. 24 in: Bear, Mark F. , Barry W. Connors, and Michael A. Paradiso. Neuroscience: Exploring the Brain. 2 nd ed. Baltimore, Md. : Lippincott Williams & Wilkins, 2001. ISBN: 0683305964.

Selectivity and invariance • Simple cells - selective to stimulus orientation • Complex cells

Selectivity and invariance • Simple cells - selective to stimulus orientation • Complex cells - invariant to stimulus location

Laminar organization • Basic six-layer design • Striate cortex has nine layers Images removed

Laminar organization • Basic six-layer design • Striate cortex has nine layers Images removed due to copyright reasons. Please see figure 10. 12 in: Bear, Mark F. , Barry W. Connors, and Michael A. Paradiso. Neuroscience: Exploring the Brain. 2 nd ed. Baltimore, Md. : Lippincott Williams & Wilkins, 2001. ISBN: 0683305964.

Columnar organization • Column: group of cells encountered in radial direction • Cells in

Columnar organization • Column: group of cells encountered in radial direction • Cells in a column have similar receptive field properties

Cortical maps Images removed due to copyright reasons.

Cortical maps Images removed due to copyright reasons.

Transneuronal autoradiography Images removed due to copyright reasons. Please see figure 10. 17 in:

Transneuronal autoradiography Images removed due to copyright reasons. Please see figure 10. 17 in: Bear, Mark F. , Barry W. Connors, and Michael A. Paradiso. Neuroscience: Exploring the Brain. 2 nd ed. Baltimore, Md. : Lippincott Williams & Wilkins, 2001. ISBN: 0683305964.

Ocular dominance columns Images removed due to copyright reasons. Please see figures 10. 18

Ocular dominance columns Images removed due to copyright reasons. Please see figures 10. 18 a and b in: Bear, Mark F. , Barry W. Connors, and Michael A. Paradiso. Neuroscience: Exploring the Brain. 2 nd ed. Baltimore, Md. : Lippincott Williams & Wilkins, 2001. ISBN: 0683305964.

Cytochrome oxidase blobs Images removed due to copyright reasons. Please see figures 10. 19

Cytochrome oxidase blobs Images removed due to copyright reasons. Please see figures 10. 19 a and b: Bear, Mark F. , Barry W. Connors, and Michael A. Paradiso. Neuroscience: Exploring the Brain. 2 nd ed. Baltimore, Md. : Lippincott Williams & Wilkins, 2001. ISBN: 0683305964.

Parallel pathways Striate Cortex Interblob Mlagoncellular LGN Layer 1 Contralateral Retina: M-type Ganglion Cell

Parallel pathways Striate Cortex Interblob Mlagoncellular LGN Layer 1 Contralateral Retina: M-type Ganglion Cell Blobs II and III IVB IVB IVC IVC Magnocellular LGN Layer 2 Ipsilateral Retina: M-type Ganglion Cell Parvocellular LGN Layers 4 and 6 Contralateral Retina: P-type Ganglion Cell Parvocellular LGN Layers 3 and 5 Ipsilateral Retina: P-type Ganglion Cell Koniocellular Layers Ventral To LGN layers 1 and 4 Contralateral Retina: non. P-non. M Ganglion Cell Koniocellular Layers Ventral To LGN Layers 2 and 3 Ipsilateral Retina: non. P-non. M Ganglion Cell Figure by MIT OCW. After figure 10. 20 in: Bear, Mark F. , Barry W. Connors, and Michael A. Paradiso. Neuroscience: Exploring the Brain. 2 nd ed. Baltimore, Md. : Lippincott Williams & Wilkins, 2001. ISBN: 0683305964.

Parallel processing • M channel: motion • P-IB channel: Shape • Blob channel: color

Parallel processing • M channel: motion • P-IB channel: Shape • Blob channel: color

Ocular dominance columns Image removed due to copyright reasons. Orientation map Images removed due

Ocular dominance columns Image removed due to copyright reasons. Orientation map Images removed due to copyright reasons. Please see figures B and C in Box 10. 2 in: Bear, Mark F. , Barry W. Connors, and Michael A. Paradiso. Neuroscience: Exploring the Brain. 2 nd ed. Baltimore, Md. : Lippincott Williams & Wilkins, 2001. ISBN: 0683305964.

Variation of preferred orientation Image removed due to copyright reasons. Cortical module Images removed

Variation of preferred orientation Image removed due to copyright reasons. Cortical module Images removed due to copyright reasons. Please see figures 10. 25 and 10. 26 in: Bear, Mark F. , Barry W. Connors, and Michael A. Paradiso. Neuroscience: Exploring the Brain. 2 nd ed. Baltimore, Md. : Lippincott Williams & Wilkins, 2001. ISBN: 0683305964.

Extrastriate cortex Dorsal Stream Other Dorsal Areas Other Ventral Areas Ventral Stream Figure by

Extrastriate cortex Dorsal Stream Other Dorsal Areas Other Ventral Areas Ventral Stream Figure by MIT OCW. After figure 10. 28 in: Bear, Mark F. , Barry W. Connors, and Michael A. Paradiso. Neuroscience: Exploring the Brain. 2 nd ed. Baltimore, Md. : Lippincott Williams & Wilkins, 2001. ISBN: 0683305964.

Visual areas in the human brain Images removed due to copyright reasons. Please see

Visual areas in the human brain Images removed due to copyright reasons. Please see figure 10. 28 in: Bear, Mark F. , Barry W. Connors, and Michael A. Paradiso. Neuroscience: Exploring the Brain. 2 nd ed. Baltimore, Md. : Lippincott Williams & Wilkins, 2001. ISBN: 0683305964.

Visual motion area in humans Images removed due to copyright reasons. Please see figure

Visual motion area in humans Images removed due to copyright reasons. Please see figure 10. 30 in: Bear, Mark F. , Barry W. Connors, and Michael A. Paradiso. Neuroscience: Exploring the Brain. 2 nd ed. Baltimore, Md. : Lippincott Williams & Wilkins, 2001. ISBN: 0683305964.

Face-evoked brain activity Images removed due to copyright reasons. Please see figure 10. 31

Face-evoked brain activity Images removed due to copyright reasons. Please see figure 10. 31 in: Bear, Mark F. , Barry W. Connors, and Michael A. Paradiso. Neuroscience: Exploring the Brain. 2 nd ed. Baltimore, Md. : Lippincott Williams & Wilkins, 2001. ISBN: 0683305964.

Ice cube model of cortex Images removed due to copyright reasons. Please see figure

Ice cube model of cortex Images removed due to copyright reasons. Please see figure 10. 32 in: Bear, Mark F. , Barry W. Connors, and Michael A. Paradiso. Neuroscience: Exploring the Brain. 2 nd ed. Baltimore, Md. : Lippincott Williams & Wilkins, 2001. ISBN: 0683305964.

Random dot stereogram

Random dot stereogram

Different monocular images

Different monocular images