1 / 10

Emergence of Semantic Structure from Experience

Emergence of Semantic Structure from Experience . Jay McClelland Stanford University. The PDP Approach to Semantic Cognition. Distributed representation Experience-driven learning -> Development, adult performance, and effects of brain damage on semantic cognition. dog goat hammer. dog.

morrison
Download Presentation

Emergence of Semantic Structure from Experience

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Emergence of Semantic Structure from Experience Jay McClelland Stanford University

  2. The PDP Approach to Semantic Cognition • Distributed representation • Experience-driven learning • -> Development, adult performance, and effects of brain damage on semantic cognition

  3. dog goat hammer dog goat hammer Distributed Representations in the Brain:Overlapping Patterns for Related Concepts (Kiani et al, 2007) • Many hundreds of single neurons recorded in monkey IT. • 1000 different photographs were presented twice each to each neuron. • Hierarchical clustering based on the distributed representation of each picture: • The pattern of activation over all the neurons

  4. Kiani et al, J Neurophysiol 97: 4296–4309, 2007.

  5. The Rumelhart Model The QuillianModel

  6. Early Later LaterStill Experie nce Newer versions of this type of model exhibit the same behavior with up 240 concepts with a deeper hierarchyof categories.

  7. Phenomena in Development • Progressive differentiation • Overgeneralization of • Typical properties • Frequent names • Emergent domain-specificity of representation • Basic level advantage • Expertise and frequency effects • Conceptual reorganization

  8. Disintegration in Semantic Dementia • Loss of differentiation • Overgeneralization

  9. Emergent vs. Stipulated Structure Midtown Manhattan Old London

  10. New Directions For these Ideas (all in collaboration with students) • Naturalistic inductive inference • If a gorilla has biotin in its blood, how likely is it that a monkey has biotin? A fox? A whale? • Solving analogies • UNPRECEDENTED : FORERUNNERS :: • unnecessary : prerequisites • nauseating : medicine • bloodthirsty : anemia • holistic : proof • adulterated : purity • Metaphorical grounding • Transfer of structured knowledge from one domain (such as space) to another (such as time) • Development of mathematical and scientific reasoning abilities • In naïve physics (balance scale) • In mathematics (geometry and trigonometry)

More Related