Artificial Intelligence Computational modelling of Grammar Acquisition Rishabh
Artificial Intelligence Computational modelling of Grammar Acquisition Rishabh Nigam Shubhdeep Kochhar
The Problem ● Computational framework for Grammar Acuisition ● Unsupervised Learning from a real corpus ● Why the problem ● Algorithm is capable of learning complex syntax, generati grammatical novel sentences, and proving useful in other fields that call for structure discovery from raw data, such bioinformatics.
The Algorithm ● ADIOS – Automatic Distillation Of Structure ● What it does :
Codes Used ● MEX criterion ● Training scripts ● Generating Scripts
Work done so far ● ● ● Converted the CHILDES database, HINDI database(WORDNET) into format readable by the ADIOS algorithm. Ran the algorithm on the CHILDES database and HINDI database. Had a brief correspondence with Shushobhan Nayak and w ran the algorithm on his database of small commentary.
Running on the CHILDES database ● E 6478 {we, youse} ● P 6479 (I, think) 0. 0068258047 1 2 201 ● P 6480 (E 6481, you, are) 1 3 18 ● E 6481 {there, here} ● P 6482 (who, E 6466) 1 2 ● P 6483 (P 6439, P 6434, Emily)0 ● P 6484 (he, is, E 6485) ● E 6485 {. , here} ● P 6486 (are, we, P 6402) ● P 6487 (wait, to, E 6488, E 6489) ● E 6488 {we, you} ● E 6489 {hear, see} 0 0. 0039371848 0. 33333334 36 5. 4000001 4 0. 0058915019 1 3 28 0. 0043362379 1 4 10 0. 5 4 6. 1452389 e-05 15
Running on the Commentary ● P 447 (the, E 448, square) 0 3 65 ● E 448 {large, big} ● P 449 (big, square) 7. 212162 e-05 1 2 ● P 450 (the, little, E 451) 0 1 3 49 ● E 451 {circle, square} ● P 452 (the, big, box) 0 1 3 34 ● E 455 {opens, closes, enters} ● P 456 (the, E 457)0. 0055941939 1 2 91 ● E 457 {bottom, corner, door, entrance} ● P 458 (P 449, E 459, the) 1 4 4 ● E 459 {leaves, closes, enters} ● E 461 {--, inside, and, leaves, left, opens, closes, enters} 0 1 38
Precision And Recall Precision - the proportion of Clearner sentences accepted by the Teacher Recall - the proportion of Ctarget sentences accepted by the Learner
References [1] Heider. Waterfall , Ben Sandbank, Luca Onnis and Shimo Edelman , An empirical generativeframework for computational modeling of language acquisition* : Cambridge University Press 2010 [2] Zach Solan PHD thesis under Professor David Horn , Professor Shimon Edelman, and Professor Eytan Ruppin AVIV university
Thank You
- Slides: 11