Semantic Knowledge Its Nature its Development and its
- Slides: 59
Semantic Knowledge: Its Nature, its Development, and its Neural Basis James L. Mc. Clelland Department of Psychology and Center for Mind, Brain, and Computation Stanford University In collaboration with: Tim Rogers, Karalyn Patterson, Matt Lambon Ralph, and Katia Dilkina
Parallel Distributed Processing Approach to Semantic Cognition • Representation is a pattern of activation distributed over neurons within and across brain areas. language • Bidirectional propagation of activation underlies the ability to bring these representations to mind from given inputs. • The knowledge underlying propagation of activation is in the connections. • Experience affects our knowledge representations through a gradual connection adjustment process
Distributed Representations: and Overlapping Patterns for Related Concepts dog goat hammer
Responses of Four Neurons to Face and Non-Face Stimuli
Development and Degeneration of Semantic Abilities • Learned distributed representations in an appropriately structured distributed connectionist system underlies the development of conceptual knowledge. • Gradual degradation of the representations constructed through this developmental process underlies the pattern of semantic disintegration seen in semantic dementia.
Differentiation, ‘Illusory Correlations’, and Overextension of Frequent Names in Development
The Rumelhart Model
The Training Data: All propositions true of items at the bottom level of the tree, e. g. : Robin can {grow, move, fly}
Target output for ‘robin can’ input
Forward Propagation of Activation aj wij neti=Sajwij ai wki
Back Propagation of Error (d) aj wij di ~ Sdkwki ai wki Error-correcting learning: At the output layer: At the prior layer: … dk ~ (tk-ak) Dwki = edkai Dwij = edjaj
Early Later Still E x p e r i e n c e
Why Does the Model Show Progressive Differentiation? • Learning is sensitive to patterns of coherent covariation. • Coherent Covariation: – The tendency for properties of objects to co-vary in clusters
What Drives Progressive Differentiation? • Waves of differentiation reflect coherent covariation of properties across items. • Patterns of coherent covariation are reflected in the principal components of the property covariance matrix. • Figure shows attribute loadings on the first three principal components: – 1. Plants vs. animals – 2. Birds vs. fish – 3. Trees vs. flowers • • Same color = features covary in component Diff color = anti-covarying features
Illusory Correlations
A typical property that a particular object lacks e. g. , pine has leaves An infrequent, atypical property
A One-Class and a Two-Class Naïve Bayes Classifier Model Property One-Class Model 1 st class in two-class model 2 nd class in two-class model Can Grow 1. 0 0 Is Living 1. 0 0 Has Roots 0. 5 1. 0 0 Has Leaves 0. 4375 0. 875 0 Has Branches 0. 25 0. 5 0 Has Bark 0. 25 0. 5 0 Has Petals 0. 25 0. 5 0 Has Gills 0. 25 0 0. 5 Has Scales 0. 25 0 0. 5 Can Swim 0. 25 0 0. 5 Can Fly 0. 25 0 0. 5 Has Feathers 0. 25 0 0. 5 Has Legs 0. 25 0 0. 5 Has Skin 0. 5 0 1. 0 Can See 0. 5 0 1. 0
Overgeneralization of Frequent Names to Similar Objects “goat” “tree” “dog”
Development and Degeneration of Semantic Abilities • Sensitivity to coherent covariation in an appropriately structured Parallel Distributed Processing system underlies the development of conceptual knowledge. • Gradual degradation of the representations constructed through this developmental process underlies the pattern of semantic disintegration seen in semantic dementia.
Disintegration of Conceptual Knowledge in Semantic Dementia • Loss of differentiation • Overgeneralization of frequent names • Illusory correlations
Picture naming and drawing in Sem. Demantia
Grounding the Model in What we Know About The Organization of Semantic Knowledge in The Brain • Specialized brain areas subserve many different kinds of semantic information. • Semantic dementia results from progressive bilateral disintegration of the anterior temporal cortex. • Rapid acquisition of new knowledge depends on medial temporal lobes, leaving long-term semantic knowledge intact. language
Proposed Architecture for the Organization of Semantic Memory name action Temporal pole motion color valance form Medial Temporal Lobe
Rogers et al (2005) model of semantic dementia Integrative Layer name appearance motoric encyclopedic visual
Simulation of Delayed Copying Integrative Layer name appearance motoric encyclopedic visual • Visual input is presented, then removed. • After several time steps, pattern is compared to the pattern that was presented initially. • Omissions and intrusions are scored for typicality
IF’s ‘camel’ DC’s ‘swan’ Simulation results Omissions by feature type Intrusions by feature type
Development and Degeneration of Semantic Abilities • Learned distributed representations in an appropriately structured distributed connectionist system underlies the development of conceptual knowledge. • Gradual degradation of the representations constructed through this developmental process underlies the pattern of semantic disintegration seen in semantic dementia.
Thanks!
Development and Degeneration • Sensitivity to coherent covariation in an appropriately structured Parallel Distributed Processing system underlies the development of conceptual knowledge. • Gradual degradation of the representations constructed through this developmental process underlies the pattern of semantic disintegration seen in semantic dementia.
Further Investigations • • • Lexical and Semantic Deficits in SD Individual Differences Laterality Effects Unilateral Resections and Recovery Effects of TMS on Semantic Task Performance Category specific deficits: – Why they may occur in some types of patients but not others.
Further Investigations Ø • • Ø Lexical and Semantic Deficits in SD Individual Differences Laterality Effects Unilateral Resections and Recovery Effects of TMS on Semantic Task Performance Category specific deficits: Ø Why they may occur in some types of patients but not others.
Relation between lexical and semantic deficits (Patterson et al, 2006) • Tested 14 SD patients, each assigned a ‘Semantic Score’ based on 3 standard tests. • Then tested each patient on: – Reading HF&LF Reg. and Exc. Words – Spelling HF&LF Reg. and Exc. Words – Past Tense Inflection, HF&LF R&E Words – Lexical Decision: fruit/frute, flute/fluit – Object Decision (at right) – Delayed Copying Test
Reg. Exc.
The Integrated Connectionist Model
Category Specific Deficits: What is the cause? • SD patients typically do not show a differential deficit for living things; however, Herpes Encephalitis patients often do. • Alternative explanations? – Differential lesion location – Differential nature of the lesion itself • In the Rogers Et Al model, removing links produces the SD pattern, but adding noise to connection weights produces the Herpes pattern (Lambon-Ralph, Lowe, and Rogers, 2007).
Naming of Animals and Artifacts at the Basic Level: Patients and Simulation Results From Lambon-Ralph, Lowe, & Rogers 2007
Predictions from Model • Herpes patients should make relatively more semantic errors, SD patients relatively more omissions. • When tested at the subordinate level of naming, differences between Herpes and SD patients should go away.
Conclusions • PDP models provide a useful framework for developing an integrated understanding of both the development and the neural basis of semantic cognitive abilities. • For neuropsychology, the models capture the graceful degredation of semantic knowledge with brain damage, as well as frequency, typicality, and even some aspects of apparent domain-specificity effects. • There are several promising avenues for further extension of the model.
The Integrated Connectionist Model
Sensitivity to Coherence Requires Convergence A A A
Coherence Training Patterns Items Properties Coherent Incoherent is can has … 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 No labels are provided Each item and each property occurs with equal frequency
Effect of Coherence on Representation
Another key property of the model • Sensitivity to coherent covariation can be domain- and property-type specific, and such sensitivity is acquired as differentiation occurs. • Obviates the need for initial domain-specific biases to account for domain-specific patterns of generalization and inference.
Differential Importance (Marcario, 1991) • 3 -4 yr old children see a puppet and are told he likes to eat, or play with, a certain object (e. g. , top object at right) – Children then must choose another one that will “be the same kind of thing to eat” or that will be “the same kind of thing to play with”. – In the first case they tend to choose the object with the same color. – In the second case they will tend to choose the object with the same shape.
Adjustments to Training Environment • • • Among the plants: – All trees are large – All flowers are small – Either can be bright or dull Among the animals: – All birds are bright – All fish are dull – Either can be small or large In other words: – Size covaries with properties that differentiate different types of plants – Brightness covaries with properties that differentiate different types of animals
Testing Feature Importance • After partial learning, model is shown eight test objects: – Four “Animals”: • All have skin • All combinations of bright/dull and large/small – Four “Plants”: • All have roots • All combinations of bright/dull and large/small • Representations are generated by using back-propagation to representation. • Representations are then compared to see which animals are treated as most similar, and which plants are treated as most similar.
Similarities of Obtained Representations Size is relevant for Plants Brightness is relevant for Animals
- Prototype in semantics
- Study of meanings
- Knowledge creation and knowledge architecture
- Nature of knowledge and knowing
- Nature and nature's law lay hid in night meaning
- Pragmatic development chart
- Shared and personal knowledge
- Knowledge shared is knowledge squared meaning
- Knowledge shared is knowledge multiplied meaning
- Contoh shallow knowledge dan deep knowledge
- What is a priori and a posteriori knowledge
- Book smarts vs street smarts
- Knowledge and knower
- Gertler econ
- Nature of knowledge
- Nature of knowledge tok
- Non-semantic elements
- Nature nature controversy
- Definition of educational psychology
- Short essay on nature
- Chomsky nature vs nurture
- Nature of development economics
- Human development introduction
- The emigree poem
- Its halloween its halloween the moon is full and bright
- Cueing systems definition
- What is semantic translation?
- Conclusion of communication
- Semiotic triangle example
- Reflective meaning in semantics example
- Abowd and beale framework example
- Polysemy examples
- Semantic nets and frames
- Data integration with xml and semantic web technologies
- Ordinal group technique
- Semantic differential scale advantages and disadvantages
- Translation
- Purpose of community development
- Development that ended much development crossword
- What are the three methods of pattern development
- F&b product knowledge
- Difference between data and information and knowledge
- When a train increases its velocity, its momentum
- Sunny cloudy windy rainy
- If its a square it's a sonnet summary
- Its not easy but its worth it
- Semantic understanding
- Semantic vector
- Semantic web
- Examples of sense and reference in semantics
- Sense of scope
- Semantic mismatch example
- Metode penerjemahan adaptasi
- Ebnf tester
- Semantic web rule language
- Stylistic semasiology deals with
- Semantic mismatch example
- Semantics
- Meronymy
- Syntax vs semantic