Lecture 13 Attention and Memory Alireza Akhavan Pour

  • Slides: 13
Download presentation
Lecture 13: Attention and Memory Alireza Akhavan Pour CLASS. VISION SRTTU – A. Akhavan

Lecture 13: Attention and Memory Alireza Akhavan Pour CLASS. VISION SRTTU – A. Akhavan Lecture 13 1 ۱۳۹۷ آﺬﺭ ۱۲ ، ﺩﻭﺷﻨﺒﻪ

The problem of long sequences ! یک ﻣﺘﺮﺟﻢ ﺗﺎ ﺍﻧﺘﻬﺎی کﺘﺎﺏ ﻧﻤیﺨﻮﻧﻪ ﺳپﺲ ﺗﺮﺟﻤﻪ

The problem of long sequences ! یک ﻣﺘﺮﺟﻢ ﺗﺎ ﺍﻧﺘﻬﺎی کﺘﺎﺏ ﻧﻤیﺨﻮﻧﻪ ﺳپﺲ ﺗﺮﺟﻤﻪ کﻨﻪ Jane s'est rendue en Afrique en septembre dernier, a apprécié la culture et a rencontré beaucoup de gens merveilleux; elle est revenue en parlant comment son voyage était merveilleux, et elle me tente d'y aller aussi. Jane went to Africa last September, and enjoyed the culture and met many wonderful people; she came back raving about how wonderful her trip was, and is tempting me to go too. https: //devblogs. nvidia. com/introduction-neural-machine-translation-gpus-part-3/figure 1_bleuscore_vs_sentencelength/ SRTTU – A. Akhavan Lecture 13 2 ۱۳۹۷ آﺬﺭ ۱۲ ، ﺩﻭﺷﻨﺒﻪ

Attention model intuition jane visite l’Afrique en septembre [Bahdanau et. al. , 2014. Neural

Attention model intuition jane visite l’Afrique en septembre [Bahdanau et. al. , 2014. Neural machine translation by jointly learning to align and translate] SRTTU – A. Akhavan Lecture 13 3 ۱۳۹۷ آﺬﺭ ۱۲ ، ﺩﻭﺷﻨﺒﻪ

Attention model intuition jane visite l’Afrique en septembre [Bahdanau et. al. , 2014. Neural

Attention model intuition jane visite l’Afrique en septembre [Bahdanau et. al. , 2014. Neural machine translation by jointly learning to align and translate] SRTTU – A. Akhavan Lecture 13 4 ۱۳۹۷ آﺬﺭ ۱۲ ، ﺩﻭﺷﻨﺒﻪ

Attention model intuition c jane visite l’Afrique en septembre [Bahdanau et. al. , 2014.

Attention model intuition c jane visite l’Afrique en septembre [Bahdanau et. al. , 2014. Neural machine translation by jointly learning to align and translate] SRTTU – A. Akhavan Lecture 13 5 ۱۳۹۷ آﺬﺭ ۱۲ ، ﺩﻭﺷﻨﺒﻪ

Attention model intuition c jane visite l’Afrique en septembre [Bahdanau et. al. , 2014.

Attention model intuition c jane visite l’Afrique en septembre [Bahdanau et. al. , 2014. Neural machine translation by jointly learning to align and translate] SRTTU – A. Akhavan Lecture 13 6 ۱۳۹۷ آﺬﺭ ۱۲ ، ﺩﻭﺷﻨﺒﻪ

Attention model intuition c c jane visite l’Afrique en septembre [Bahdanau et. al. ,

Attention model intuition c c jane visite l’Afrique en septembre [Bahdanau et. al. , 2014. Neural machine translation by jointly learning to align and translate] SRTTU – A. Akhavan Lecture 13 7 ۱۳۹۷ آﺬﺭ ۱۲ ، ﺩﻭﺷﻨﺒﻪ

Attention model ( , ) jane visite l’Afrique en septembre [Bahdanau et. al. ,

Attention model ( , ) jane visite l’Afrique en septembre [Bahdanau et. al. , 2014. Neural machine translation by jointly learning to align and translate] SRTTU – A. Akhavan Lecture 13 8 ۱۳۹۷ آﺬﺭ ۱۲ ، ﺩﻭﺷﻨﺒﻪ

Attention model ( , ) + T ‘ jane visite l’Afrique en septembre [Bahdanau

Attention model ( , ) + T ‘ jane visite l’Afrique en septembre [Bahdanau et. al. , 2014. Neural machine translation by jointly learning to align and translate] SRTTU – A. Akhavan Lecture 13 9 ۱۳۹۷ آﺬﺭ ۱۲ ، ﺩﻭﺷﻨﺒﻪ

Attention model + T ‘ jane ( , ) visite l’Afrique en septembre [Bahdanau

Attention model + T ‘ jane ( , ) visite l’Afrique en septembre [Bahdanau et. al. , 2014. Neural machine translation by jointly learning to align and translate] SRTTU – A. Akhavan Lecture 13 10 ۱۳۹۷ آﺬﺭ ۱۲ ، ﺩﻭﺷﻨﺒﻪ

Attention model + T ‘ jane ( , ) یک ﺷﺒکﻪ ﺑﺎﺯگﺸﺘی ﺳﺎﺩﻩ visite

Attention model + T ‘ jane ( , ) یک ﺷﺒکﻪ ﺑﺎﺯگﺸﺘی ﺳﺎﺩﻩ visite l’Afrique en septembre [Bahdanau et. al. , 2014. Neural machine translation by jointly learning to align and translate] SRTTU – A. Akhavan Lecture 13 11 ۱۳۹۷ آﺬﺭ ۱۲ ، ﺩﻭﺷﻨﺒﻪ

 [Bahdanau et. al. , 2014. Neural machine translation by jointly learning to align

[Bahdanau et. al. , 2014. Neural machine translation by jointly learning to align and translate] [Xu et. al. , 2015. Show, attend and tell: Neural image caption generation with visual attention] SRTTU – A. Akhavan Lecture 13 12 ۱۳۹۷ آﺬﺭ ۱۲ ، ﺩﻭﺷﻨﺒﻪ

 ﻣﻨﺎﺑﻊ • https: //www. coursera. org/specializations/deep -learning SRTTU – A. Akhavan Lecture 13

ﻣﻨﺎﺑﻊ • https: //www. coursera. org/specializations/deep -learning SRTTU – A. Akhavan Lecture 13 13 ۱۳۹۷ آﺬﺭ ۱۲ ، ﺩﻭﺷﻨﺒﻪ