NLP Introduction to NLP Collocations Collocations phrases Dictionary
![NLP NLP](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-1.jpg)
![Introduction to NLP Collocations Introduction to NLP Collocations](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-2.jpg)
![Collocations (phrases) • Dictionary definitions – Meaning of words in isolation • “Know a Collocations (phrases) • Dictionary definitions – Meaning of words in isolation • “Know a](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-3.jpg)
![Collocations • Properties – Common use – No general syntactic or semantic rules – Collocations • Properties – Common use – No general syntactic or semantic rules –](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-4.jpg)
![Types of Multiword Sequences • Idioms • Free-word combinations • Collocations Types of Multiword Sequences • Idioms • Free-word combinations • Collocations](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-5.jpg)
![Examples Idioms Collocations Free-word combinations To kick the bucket Dead end To catch up Examples Idioms Collocations Free-word combinations To kick the bucket Dead end To catch up](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-6.jpg)
![Properties • Arbitrariness: substitutions are usually not allowed: – Make an effort vs. *make Properties • Arbitrariness: substitutions are usually not allowed: – Make an effort vs. *make](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-7.jpg)
![Uses • Disambiguation (e. g, “bank”/“loan”, “river”) • Translation • Generation Uses • Disambiguation (e. g, “bank”/“loan”, “river”) • Translation • Generation](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-8.jpg)
![Types of Collocations • Grammatical – come to, put on; afraid that, fond of, Types of Collocations • Grammatical – come to, put on; afraid that, fond of,](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-9.jpg)
![Base-Collocator Pairs • Base – bears most of the meaning of the collocation. Writers Base-Collocator Pairs • Base – bears most of the meaning of the collocation. Writers](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-10.jpg)
![Extracting collocations • Most-common bigrams? • Drop function words? • Look at POS sequences? Extracting collocations • Most-common bigrams? • Drop function words? • Look at POS sequences?](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-11.jpg)
![Extracting collocations • Mutual information I (x; y) = log 2 • Larger means Extracting collocations • Mutual information I (x; y) = log 2 • Larger means](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-12.jpg)
![Yule’s coefficient A - frequency of pairs involving both W and X B - Yule’s coefficient A - frequency of pairs involving both W and X B -](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-13.jpg)
![Example X x W A=800 B=160 w C=180 D=80 A B C D AD-BC Example X x W A=800 B=160 w C=180 D=80 A B C D AD-BC](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-14.jpg)
![Example from the Hansard corpus (Brown, Lai, and Mercer) – “prime” Example from the Hansard corpus (Brown, Lai, and Mercer) – “prime”](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-15.jpg)
![Flexible and rigid collocations • Example (from Smadja): “free” and “trade” Flexible and rigid collocations • Example (from Smadja): “free” and “trade”](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-16.jpg)
![Xtract (Smadja) • The Dow Jones Industrial Average • The NYSE’s composite index of Xtract (Smadja) • The Dow Jones Industrial Average • The NYSE’s composite index of](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-17.jpg)
![Translating Collocations • Examples: – Brush up a lesson, repasser une leçon – Bring Translating Collocations • Examples: – Brush up a lesson, repasser une leçon – Bring](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-18.jpg)
![Links • Sample phrasal collocations – http: //en. wiktionary. org/wiki/Appendix: Collocations_of_do, _have, _make, _and_take Links • Sample phrasal collocations – http: //en. wiktionary. org/wiki/Appendix: Collocations_of_do, _have, _make, _and_take](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-19.jpg)
![NLP NLP](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-20.jpg)
- Slides: 20
![NLP NLP](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-1.jpg)
NLP
![Introduction to NLP Collocations Introduction to NLP Collocations](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-2.jpg)
Introduction to NLP Collocations
![Collocations phrases Dictionary definitions Meaning of words in isolation Know a Collocations (phrases) • Dictionary definitions – Meaning of words in isolation • “Know a](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-3.jpg)
Collocations (phrases) • Dictionary definitions – Meaning of words in isolation • “Know a word by the company that it keeps” – Firth 1935 • Examples – – dead end strong tea Benazir Bhutto Fabry disease
![Collocations Properties Common use No general syntactic or semantic rules Collocations • Properties – Common use – No general syntactic or semantic rules –](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-4.jpg)
Collocations • Properties – Common use – No general syntactic or semantic rules – Important for non-native speakers • Collocation acquisition – Important for NLP
![Types of Multiword Sequences Idioms Freeword combinations Collocations Types of Multiword Sequences • Idioms • Free-word combinations • Collocations](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-5.jpg)
Types of Multiword Sequences • Idioms • Free-word combinations • Collocations
![Examples Idioms Collocations Freeword combinations To kick the bucket Dead end To catch up Examples Idioms Collocations Free-word combinations To kick the bucket Dead end To catch up](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-6.jpg)
Examples Idioms Collocations Free-word combinations To kick the bucket Dead end To catch up To trade actively Table of contents Orthogonal projection To take the bus The end of the road To buy a house
![Properties Arbitrariness substitutions are usually not allowed Make an effort vs make Properties • Arbitrariness: substitutions are usually not allowed: – Make an effort vs. *make](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-7.jpg)
Properties • Arbitrariness: substitutions are usually not allowed: – Make an effort vs. *make an exertion – Running commentary vs. *running discussion – Commit treason vs. *commit treachery • Language- and dialect-specific – – – Régler la circulation = direct traffic Russian, German, Serbo-Croatian: direct translation of regulate is used American English: set the table, make a decision British English: lay the table, take a decision “semer le désarroi” - “to sow disarray” - “to wreak havoc” • Common in technical language • Recurrent in context
![Uses Disambiguation e g bankloan river Translation Generation Uses • Disambiguation (e. g, “bank”/“loan”, “river”) • Translation • Generation](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-8.jpg)
Uses • Disambiguation (e. g, “bank”/“loan”, “river”) • Translation • Generation
![Types of Collocations Grammatical come to put on afraid that fond of Types of Collocations • Grammatical – come to, put on; afraid that, fond of,](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-9.jpg)
Types of Collocations • Grammatical – come to, put on; afraid that, fond of, by accident, witness to • Semantic – only certain synonyms • Flexible – find/discover/notice by chance
![BaseCollocator Pairs Base bears most of the meaning of the collocation Writers Base-Collocator Pairs • Base – bears most of the meaning of the collocation. Writers](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-10.jpg)
Base-Collocator Pairs • Base – bears most of the meaning of the collocation. Writers think of the base first. Foreign language speakers search by base. For decoding purposes, it is more appropriate to store the collocation under the collocator. Base Noun Verb Adjective Verb Collocator verb adjective adverb preposition Example Set the table Warm greetings Struggle desperately Sound asleep Put on
![Extracting collocations Mostcommon bigrams Drop function words Look at POS sequences Extracting collocations • Most-common bigrams? • Drop function words? • Look at POS sequences?](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-11.jpg)
Extracting collocations • Most-common bigrams? • Drop function words? • Look at POS sequences?
![Extracting collocations Mutual information I x y log 2 Larger means Extracting collocations • Mutual information I (x; y) = log 2 • Larger means](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-12.jpg)
Extracting collocations • Mutual information I (x; y) = log 2 • Larger means stronger • What if I(x; y) = 0? P(x, y) P(x)P(y) – no relation • What if I(x; y) < 0? – complementary distribution (rare)
![Yules coefficient A frequency of pairs involving both W and X B Yule’s coefficient A - frequency of pairs involving both W and X B -](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-13.jpg)
Yule’s coefficient A - frequency of pairs involving both W and X B - frequency of pairs involving W only C - frequency of pairs involving X only D - frequency of pairs involving neither Y= AD - BC AD + BC -1 Y 1
![Example X x W A800 B160 w C180 D80 A B C D ADBC Example X x W A=800 B=160 w C=180 D=80 A B C D AD-BC](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-14.jpg)
Example X x W A=800 B=160 w C=180 D=80 A B C D AD-BC AD+BC 800 160 180 80 35200 92800 0. 38
![Example from the Hansard corpus Brown Lai and Mercer prime Example from the Hansard corpus (Brown, Lai, and Mercer) – “prime”](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-15.jpg)
Example from the Hansard corpus (Brown, Lai, and Mercer) – “prime”
![Flexible and rigid collocations Example from Smadja free and trade Flexible and rigid collocations • Example (from Smadja): “free” and “trade”](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-16.jpg)
Flexible and rigid collocations • Example (from Smadja): “free” and “trade”
![Xtract Smadja The Dow Jones Industrial Average The NYSEs composite index of Xtract (Smadja) • The Dow Jones Industrial Average • The NYSE’s composite index of](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-17.jpg)
Xtract (Smadja) • The Dow Jones Industrial Average • The NYSE’s composite index of all its listed common stocks fell *NUMBER* to *NUMBER*
![Translating Collocations Examples Brush up a lesson repasser une leçon Bring Translating Collocations • Examples: – Brush up a lesson, repasser une leçon – Bring](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-18.jpg)
Translating Collocations • Examples: – Brush up a lesson, repasser une leçon – Bring about/осуществлять • Hansards examples – – late spring fin du printemps Atlantic Canada Opportunities Agency Agence de promotion économique du Canada atlantique
![Links Sample phrasal collocations http en wiktionary orgwikiAppendix Collocationsofdo have make andtake Links • Sample phrasal collocations – http: //en. wiktionary. org/wiki/Appendix: Collocations_of_do, _have, _make, _and_take](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-19.jpg)
Links • Sample phrasal collocations – http: //en. wiktionary. org/wiki/Appendix: Collocations_of_do, _have, _make, _and_take • List of English language idioms – http: //en. wikipedia. org/wiki/List_of_English-language_idioms • Idiomsite – http: //www. idiomsite. com
![NLP NLP](https://slidetodoc.com/presentation_image_h/2e1a8fff12e7975fa3b121dc8a416e3d/image-20.jpg)
NLP
Collocation meaning
Verbal phrases to mathematical phrases examples
Simlish phrases
Italian collocations
Do have make take
Kolokasi contoh
Collocations with keep
Translation
Correct the mis collocations in these sentences
What are collocations
Idiomatic collocations
Collocations definition
Phraseological fusions examples
Coloocations
Outline collocation
Lecture collocations
Rewrite the sentences using the...the + comparative
Flax collocation
Signal phrases definition
Webster's dictionary
Guide words in dictionary