Artificial Intelligence Language Processing Dr M Tanvir Afzal

Artificial Intelligence Language Processing Dr. M. Tanvir Afzal

Language Processing Perception ü The success obtained in translating formal high-level programming languages into machine language led early researchers to believe that the ability to program computers to understand natural language was only a few years away. 2

Language Processing Reality! ü Although formal language differ from natural languages like English, Urdu, German only a few years away. ü Programming languages are constructed from well-designed primitives so that each statement has only one grammatical structure and only one meaning. 3

Language Processing Reality! ü A statement in a natural language can have multiple meanings depending on its context or even the manner in which it is communicated. ü To understand natural language, humans rely heavily on additional knowledge and context. 4

Language Processing Example ü I need an Apple! Fruit or phone? 5

Language Processing Example ü “You are very late. ” Means speaker was waiting for a long time. 6

Language Processing Understanding NLP Requires: ü Syntactic Analysis ü Semantic Analysis ü Contextual Analysis 7

Language Processing Syntactic Analysis Major component is parsing. “Mary gave John a birthday card. ” Subject = Mary John got a birthday card from Mary. Subject = John 8

Language Processing Semantic Analysis ü Identifying the semantic role of each word in the statement. ü “Mary gave John a birthday card” and “John got a birthday card from Mary” would be recognized as saying the same thing. 9

Language Processing Contextual Analysis ü Context of the sentence is brought into the understanding process. ü The bat fell to the ground has different meanings in following two contexts: a) Baseball game b) Cave exploration 10

Summary Language Processing ü Perception to Reality ü Understanding NLP ü Syntactic Analysis ü Semantic Analysis ü Contextual Analysis 11