alo f buf cse Research in Knowledge Representation
alo f buf @ cse Research in Knowledge Representation, Reasoning, and Acting Stuart C. Shapiro Professor, CSE Affiliated Professor, Linguistics, Philosophy Director, Center for Cognitive Science Director, SNe. PS Research Group ACM Distinguished Scientist Fellow, AAAI Faculty Member: Interdisciplinary MS in Computational Linguistics Center for Multi. Source Information Fusion National Center for Ontological Research National Center Information and Analysis Research Overview '06 for Geographic S. C. Shapiro
alo @ cse f buf Long-Term Goal • Theory and Implementation of Natural-Language-Competent Computerized Cognitive Agent/Robot • and Supporting Research in Artificial Intelligence Cognitive Science Computational Linguistics. 2 Research Overview '06 S. C. Shapiro
alo @ cse f buf Cassie • A computational cognitive agent – Embodied in hardware – or software-simulated – Based on SNe. PS and (M)GLAIR. 3 Research Overview '06 S. C. Shapiro
alo @ cse f buf MGLAIR Agent Architecture Mind Body KL (SNe. PS) Independent of lower-body implementation PMLa PMLb I/P s o c k e t s Dependent on lower-body implementation PMLc Proprioception Speech Hearing SAL Vision Motion Research Overview '06 S. C. Shapiro 4 W O R L D
alo f buf @ cse SNe. PS is a Logic-Based Frame-Based Network-Based knowledge representation, reasoning, and acting system. 5 Research Overview '06 S. C. Shapiro
alo @ cse f buf Some Important SNe. PS Features • First-person beliefs – Not third-person “truth” about agent or world • Beliefs are current beliefs – Even if about the past • On-line acting • Reified propositions as well as acts & … • Neither states nor times are privileged 6 Research Overview '06 S. C. Shapiro
alo f buf @ cse Some Recent & Current Research Projects • A General Characterization of Answers to Questions • KRR for Information Fusion for Cyber Security • Information Extraction for Soft Target Exploitation and Fusion • Ontological reasoning for Geo. CLEF: multilingual geographic information retrieval • Intermedia Performance Studio – Actor-agents in VR drama 7 Research Overview '06 S. C. Shapiro
alo f buf @ cse A General Characterization of Answers to Questions • Every clause descended from a query clause in resolution theorem proving is an answer to the query. • General form of an answer: [H ] [G ] Q H is Hypothetical component (optional) G is Generic component (optional) Q is Question component (either generic or specific) • Example: {~Cat(Boots), ~Tuna(x), Answer(Likes(Boots, x))} Cat(Boots) x (Tuna(x) Likes (Boots, x)) If Boots is a cat, then Boots likes to eat any tuna. [D. T. Burhans & S. C. Shapiro, Defining Answer Classes Using Resolution Refutation, Journal of Applied Logic 5, 1 (March 2007), in press. ] 8 Research Overview '06 S. C. Shapiro
alo f buf @ cse KRR for Information Fusion for Cyber Security • Use SNe. PS to reason about computer networks, and about potential, and actual attacks. • Provide ontology-oriented SNe. PS GUI • A task of the National Center for Multisource Information Fusion • With Moises Sudit (IE & CMIF) & Michael Kandefer (CSE: RA) • Funded by the Air Force Research Laboratory (AFRL) 9 Research Overview '06 S. C. Shapiro
alo f buf @ cse SNe. PS Ontology GUI • SNe. PS GUI supports the loading and exporting of SNe. PS files in several formats. • Allows the display of binary predicates as a tree hierarchy 10 Research Overview '06 S. C. Shapiro
alo f buf @ cse Selecting a Predicate for the Tree View • The user selects a predicate from the drop down menu, after which the tree is generated 11 Research Overview '06 S. C. Shapiro
alo @ cse f buf Class Hierarchy • This view shows a small class hierarchy for hosts on a network 12 Research Overview '06 S. C. Shapiro
alo @ cse f buf Part Of • This view shows a part of hierarchy. 13 Research Overview '06 S. C. Shapiro
alo f buf @ cse • • Network View Shows the network representation (drawn using the JUNG network visualization tool) of a SNe. PS belief base User can zoom, move nodes, and save images as JIMI supported file types (jpg, bmp, png) Tooltips provide information about the propositions expressed by the nodes in the network Ex. This view shows assertions about the connectivity of various hosts (h 0 -h 4) 14 Research Overview '06 S. C. Shapiro
alo @ cse Information Extraction for Soft Target Exploitation and Fusion f buf • Review relevant NLP tools. • Translate unstructured text messages to structured summaries. • E. g. From 03/17/07 Sabah Dulaimi arrived at 1035. To (m 2 (date (m 1 (day 17) (month 03) (year 07)))) (m 3! (act arrive) (agent Sabah Dulaimi) (time 1035)) • • With Shane Axtell (CL: RA) Funded by the US Army CERDEC (Communications-Electronics Research, Development and Engineering Center) 15 Research Overview '06 S. C. Shapiro
alo @ cse f buf Ontological Reasoning for Geo. CLEF • Provide additional search terms to retrieve articles for queries such as International sports competitions in the Ruhr area and provide means of eliminating irrelevant answers. • With Miguel Ruiz (LIS), June Abbas (LIS), Thomas Bittner (PHI & GEO), & David Mark (GEO). 16 Research Overview '06 S. C. Shapiro
alo @ cse f buf Intermedia Performance Studio • Buffalo-Region resource focusing on the integration of live actors, virtual avatars, intelligent actor-agents, dynamic sets and live, mobile audience members. • With Sarah Bay-Cheng (THD & DMS), Josephine Anstey (DMS), David Pape (DMS), & Jon Bona (CSE: RA) • Funded by UB Provost’s Interdisciplinary Research Development Fund (IRDF) • See http: //vrstudio. buffalo. edu/ips/wiki/ 17 Research Overview '06 S. C. Shapiro
alo @ cse f buf The Trial The Trail • Virtual Reality Drama with SNe. PS/GLAIR agent-actors. • With Josephine Anstey (DMS), David Pape (DMS), and CSE grads: Jon Bona, Albert Goldfain, Mike Kandefer, Vishwac Sena Kannan, Madhumitha Nagarajan 18 Research Overview '06 S. C. Shapiro
alo @ cse f buf The Trial The Trail Bad guy agents hassling a human participant 19 Research Overview '06 S. C. Shapiro
alo f buf @ cse For More Information • Shapiro: http: //www. cse. buffalo. edu/~shapiro/ • SNe. PS Research Group: http: //www. cse. buffalo. edu/sneps/ – Meets Tuesdays 10 -12, 242 Bell Hall – Join us! • Register for CSE 563 in Spring, 2007 20 Research Overview '06 S. C. Shapiro
- Slides: 20