Automated Template Generation for Question Answering over Knowledge

Automated Template Generation for Question Answering over Knowledge Graphs 张玲玲

KBQA 知识库： 问题：Which actress played character Amy Squirrel on Bad Teacher？ 答案：Au = {Lucy. Punch}

Motivation Hand-crafted templates [Unger et al. (WWW’ 12), Yahya et al. (EMNLP’ 12), Fader et al. (KDD’ 14), Yao and Durme, (ACL’ 14), Bast and Haussmann, (CIKM’ 15)] Templates by Fader et al. (2014) 1. Human Expertise 2. Coverage No/Naive answer typing “Who” —> person “Where” —> location

Contributions • Generates role-aligned question-query templates automatically • Handles compositional questions Who has played for Manchester United and Real Madrid? • Improved answer typing

Outline • Template Generation • Question Answering with Templates • Experiments • Conclusion

Template Generation 输入： 问题(utterance)：Which actress played character Amy Squirrel on Bad Teacher？ 答案：Au = {Lucy. Punch} 输出：

Template Generation-Utterance-Query Alignment Integer Linear Programming

Template Generation-Utterance-Query Alignment •

Template Generation-Utterance-Query Alignment 本文利用了Gurobi来解决ILP问题获得预期的对齐方式m，由符号 ent, type, pred进行u和q之间的语义标记来对应。

Template Generation-Generalization to Templates

Outline • Template Generation • Question Answering with Templates • Experiments • Conclusion

Question Answering with Templates Which popular actress played role Phoebe on Friends？

Question Answering with Templates Which popular actress played role Phoebe on Friends？

Question Answering with Templates Which popular actress played role Phoebe on Friends？

Question Answering with Templates-Answering Complex Questions • Relative clauses • “actors starring in The Departed who were born in Cambridge” • Coordinating conjunction • “Who acted in the Green Mile and Forrest Gump? ” • A set of rules to decompose a question into sub-questions • “Who acted in the Green Mile? ” and “Who acted in Forrest Gump? ”

Question Answering with Templates-Answering Complex Questions Who acted in the Green Mile and Forrest Gump? Automated dependency parse rewriting

Question Answering with Templates-Answering Complex Questions Who acted in the Green Mile and Forrest Gump? Sub-question Answering

Question Answering with Templates-Answering Complex Questions Who acted in the Green Mile and Forrest Gump? Stitching

Outline • Template Generation • Question Answering with Templates • Experiments • Conclusion

Experiments-Setup Web. Questions 3775 question/answer training pairs 2032 testing questions Free 917 641 training 276 test Complex. Questions 150 questions “Who has played for Manchester United and Real Madrid? ”

Experiments-Results on Web. Questions and Free 917

Experiments-Anecdotal results from Web. Questions

Experiments-Results on Complex. Questions

Outline • Template Generation • Question Answering with Templates • Experiments • Conclusion

Conclusions QUINT automatically learns role-aligned question-query templates QUINT handles compositional questions QUINT supports answer typing

Q&A Thank you for your listening.