Possible DARPA IPTO Grand Challenge WAIS Robot WAIS
Possible DARPA IPTO Grand Challenge: “WAIS Robot” (WAIS+ Robot? ) Presented by: Dr. Selmer Bringsjord with Bettina Schimanski
The Challenge: WAIS Robot Autonomous artificially intelligent robots will display mastery of the Wechsler Adult Intelligence Scale (WAIS). … + tests of creativity and mechanical ability…?
Intelligence Tests: Narrow vs. Broad Spearman’s view of intelligence Thurstone’s view of intelligence
Narrow Test: RPM ====== start of search ====== given clause #1: (wt=2) 10 [] R 1(a 11). given clause #2: (wt=2) 11 [] R 1(a 12). given clause #3: (wt=2) 12 [] R 1(a 13). . given clause #4: (wt=2) 13 [] R 2(a 21). given clause #278: (wt=16) 287 [para_into, 64. 3. 1, 3. 3. 1] R 2(x)| -R 3(a 23)| -Empty. Bar(y)| -R 3(x)| -Empty. Bar(x)| -T(a 23)| R 3(y)| -T(y). given clause #279: (wt=16) 288 [para_into, 65. 3. 1, 8. 3. 1] R 2(x)| -R 3(a 23)| -Striped. Bar(y)| -R 3(x)| -Striped. Bar(x)| Empty. Bar(a 23)| -R 3(y)| -Empty. Bar(y). Search stopped by max_seconds option. ====== end of search ======
Broad Test: WAIS Wechsler Adult Intelligent Scale WAIS includes many sub-tests
Broad Test: WAIS Wechsler Adult Intelligent Scale
Broad Test: WAIS Wechsler Adult Intelligent Scale
Broad Test: WAIS Wechsler Adult Intelligent Scale Comprehension sub-test The Comprehension sub-test is so difficult it could be a motivator for the original CYC dream -Deals with ordinary conversation Examples: “Why is copper often used in making electrical wires? ” “What is the advantage of keeping money in a bank account? ”
Broad Test: WAIS Wechsler Adult Intelligent Scale Block Design sub-test -Arrange blocks to match a given sample (Blocks courtesy of Binary Arts Corporation)
Broad Test: WAIS Wechsler Adult Intelligent Scale Object Assembly sub-test - Presented with several 2 D puzzle-like pieces
Object Assembly Sample provided by Psychological Corporation (© 2004)
Broad Test: WAIS Wechsler Adult Intelligent Scale Picture Arrangement sub-test - Deals with many mental facets
Picture Arrangement
WAIS Challenge Decidedly Non - Ad Hoc l l Integrated intelligence via Alan Newell’s third paradigm “You Can’t Play 20 Questions with Nature and Win” (1973) l l l “We never seem in the experimental literature to put the results of all the experiments together” First Paradigm: Complete Processing Models Second Paradigm: Analyze a Complex Task Third Paradigm: One Program for Many Tasks The same observation can be made today about systems engineered in AI (Building Block Approach) l The idea is to use different subtests from certain chosen tests of mental and/or physical ability to create a composite artificial agent for a specific application.
The Proposed Rules l l The artificial agent must operate without any prior knowledge of actual test course (must handle any case in the general space) The artificial agent will be administered the test as a human subject would: l l l Must physically manipulate objects (of many different shapes and sizes but weighing less than 4 lbs. each) Must be able to take spoken directions Must be able to respond to questions of varied topics Must have a vision component Must be subject to the same time limitations The artificial agent operates autonomously once the test has started until completion
Training & Test Materials l Some homegrown test samples/examples
Milestones l Year 1: Feasibility demonstration l Complete individual sub-tests at different year cutoffs: l l l Year 2: Digit Symbol, Digit Span, Vocabulary, Arithmetic, Similarities Year 3: Block Design, Object Assembly Year 5: Picture Completion Year 7: Information. Comprehension Year 9: Picture Arrangement Year 10: Complete all sub-tests within time limit given for humans (in terms of physical manipulation, language parsing, visual deciphering, etc. )
Milestones: Permutation 1 l Year 1: Feasibility demonstration l Complete individual sub-tests at different year cutoffs: l l l Year 2: Digit Symbol, Digit Span, Vocabulary, Arithmetic, Similarities Year 3: Block Design, Object Assembly Year 5: Picture Completion Year 7: Picture Arrangement Year 9: Information, Comprehension Year 10: Complete all sub-tests within time limit given for humans (in terms of physical manipulation, language parsing, visual deciphering, etc. )
Limitations l l The WAIS does not test generative ability much l Short Story Game (S 3 G) l S. Bringsjord (1998). "Chess is Too Easy", Technology Review, 101, 2, 23 -28. What about locomotion etc. ?
Background References l S. Bringsjord and B. Schimanski (2003). "What is Artificial Intelligence? Psychometric AI as an Answer", Proceedings of the 18 th International Joint Conference on Artificial Intelligence (IJCAI-03), Morgan Kaufmann, San Francisco, CA, 887 -893. l S. Bringsjord and B. Schimanski (2004). "Pulling It All Together via Psychometric AI", Achieving Human-Level Intelligence Through Integrated Systems and Research: Technical Report FS-04 -01, AAAI Press, Menlo Park, CA, 9 -16.
- Slides: 20