fa buf cse lo Knowledge Representation and Reasoning

fa buf @ cse lo Knowledge Representation and Reasoning Stuart C. Shapiro Professor, CSE Director, SNe. PS Research Group Member, Center for Cognitive Science Faculty Member, Interdisciplinary MS in Computational Linguistics S. C. Shapiro

fa buf @ cse lo Introduction S. C. Shapiro

fa buf @ cse lo Long-Term Goal • Theory and Implementation of Natural-Language-Competent Computerized Cognitive Agent/Robot • and Supporting Research in Artificial Intelligence Cognitive Science Computational Linguistics. S. C. Shapiro

fa buf @ cse • • S. C. Shapiro lo Research Areas Knowledge Representation and Reasoning Cognitive Robotics Natural-Language Understanding Natural-Language Generation.

fa buf @ cse lo Goal • A computational cognitive agent that can: – Understand communicate in English; – Discuss specific, generic, and “rule-like” information; – Reason; – Discuss acts and plans; – Sense; – Act; – Maintain a model of itself; – Remember and report what it has sensed and done. S. C. Shapiro

fa buf @ cse lo Cassie • A computational cognitive agent – Embodied in hardware – or Software-Simulated – Based on SNe. PS and GLAIR. S. C. Shapiro

fa buf @ cse lo GLAIR Architecture Grounded Layered Architecture with Integrated Reasoning Knowledge Level SNe. PS Perceptuo-Motor Level NL Sensory-Actuator Level Vision Sonar Proprioception S. C. Shapiro Motion

fa buf @ cse lo SNe. PS • Knowledge Representation and Reasoning – Propositions as Terms • SNIP: SNe. PS Inference Package – Specialized connectives and quantifiers • SNe. BR: SNe. PS Belief Revision • SNe. RE: SNe. PS Rational Engine • Interface Languages – SNe. PSUL: Lisp-Like – SNe. PSLOG: Logic-Like – GATN for Fragments of English. S. C. Shapiro

fa buf @ cse lo Example Cassies & Worlds S. C. Shapiro

fa buf @ cse S. C. Shapiro lo Blocks. World

fa buf @ cse S. C. Shapiro lo FEVAHR

fa buf @ cse S. C. Shapiro lo FEVAHRWorld Simulation

fa buf @ cse lo UXO Remediation Corner flag Field UXO Drop-off zone Non. UXO object Battery meter Corner flag Recharging Station S. C. Shapiro Corner flag Cassie Safe zone

fa buf @ cse S. C. Shapiro lo Crystal Space Environment

fa buf @ cse lo Princess from “The Trial, The Trail” A VR drama by Josephine Anstey S. C. Shapiro

fa buf @ cse lo Vacuum Cleaner Cassie Using Byron Weber Becker’s Java Karel S. C. Shapiro

fa buf @ cse S. C. Shapiro lo Magellan Pro. TM Mobile Robot from i. Robot

fa buf @ cse lo Sample Research Issues: Indexicals S. C. Shapiro

fa buf @ cse lo Representation and Use of Indexicals • Words whose meanings are determined by occasion of use • E. g. I, you, now, then, here, there • Deictic Center <*I, *YOU, *NOW> • *I: SNe. PS term representing Cassie • *YOU: person Cassie is talking with • *NOW: current time. S. C. Shapiro

fa buf @ cse • • S. C. Shapiro lo Analysis of Indexicals (in input) First person pronouns: *YOU Second person pronouns: *I “here”: location of *YOU Present/Past relative to *NOW.

fa buf @ cse lo Generation of Indexicals • *I: First person pronouns • *YOU: Second person pronouns • *NOW: used to determine tense and aspect. S. C. Shapiro

fa buf @ cse lo Use of Indexicals 1 Come here. S. C. Shapiro

fa buf @ cse lo Use of Indexicals 2 Come here. I came to you, Stu. I am near you. S. C. Shapiro

fa buf @ cse lo Use of Indexicals 3 Who am I? Your name is ‘Stu’ and you are a person. Who have you talked to? I am talking to you. Talk to Bill. I am talking to you, Bill. Come here. S. C. Shapiro

fa buf @ cse lo Use of Indexicals 4 Come here. I found you. I am looking at you. S. C. Shapiro

fa buf @ cse lo Use of Indexicals 5 Come here. I found you. I am looking at you. I came to you. I am near you. S. C. Shapiro

fa buf @ cse lo Use of Indexicals 6 Who am I? Your name is ‘Bill’ and you are a person. Who are you? I am the FEVAHR and my name is ‘Cassie’. Who have you talked to? I talked to Stu and I am talking to you. S. C. Shapiro

fa buf @ cse lo Current Research Issues: Distinguishing Perceptually Indistinguishable Objects Ph. D. Dissertation, John F. Santore S. C. Shapiro

fa buf @ cse lo Some robots in a suite of rooms. S. C. Shapiro

fa buf @ cse lo • Are these the same two robots? • Why do you think so/not? S. C. Shapiro

fa buf @ cse lo Next Steps • How do people do this? – Currently analyzing protocol experiments • Getting Cassie to do it. S. C. Shapiro

fa buf @ cse lo Current Research Issues: Representation & Reasoning with Arbitrary Objects Stuart C. Shapiro in conjunction with Development of SNe. PS 3 S. C. Shapiro

fa buf @ cse lo Classical Representation • Clyde is gray. – Gray(Clyde) • All elephants are gray. – x(Elephant(x) Gray(x)) • Some elephants are albino. – x(Elephant(x) & Albino(x)) • Why the difference? S. C. Shapiro

fa buf @ cse lo Representation Using Arbitrary & Indefinite Objects • Clyde is gray. – Gray(Clyde) • Elephants are gray. – Gray(any x Elephant(x)) • Some elephants are albino. – Albino(some x Elephant(x)) S. C. Shapiro

fa buf @ cse lo Structural Subsumption Among Arbitrary & Indefinite Objects (any x Elephant(x)) (any x Albino(x) & Elephant(x)) (some x Elephant(x)) If x subsumes y, then P(x) P(y) S. C. Shapiro

fa buf @ cse lo Example (Runs in SNe. PS 3) Hungry(any x Elephant(x) & Eats(x, any y Tall(y) & Grass(y) & On(y, Savanna))) Hungry(any u Albino(u) & Elephant(u) & Eats(u, any v Grass(v) & On(v, Savanna))) S. C. Shapiro

fa buf @ cse lo Axiomatic Subsumption (Runs in SNe. PS 3) Animal(any x Mammal(x)) Hairy(any x Mammal(x)) Mammal(any x Dog(x)) Dog(Fido) Hairy(any x Dog(x)) Hairy(Fido) Animal(Fido) S. C. Shapiro

fa buf @ cse lo Next Steps • Finish theory and implementation of arbitrary and indefinite objects. • Extend to other generalized quantifiers – Such as most, many, few, no, both, 3 of, … S. C. Shapiro

fa buf @ cse lo For More Information • Shapiro: http: //www. cse. buffalo. edu/~shapiro/ • SNe. PS Research Group: http: //www. cse. buffalo. edu/sneps/ – Meets Fridays 9 -11, 242 Bell Hall – Join us! S. C. Shapiro