Question Decomposition ywsun Step 2 decompose question question

  • Slides: 6
Download presentation
Question Decomposition ywsun

Question Decomposition ywsun

Step 2 - decompose question • 输入: question • 输出: 问句解析树 • 识别主干成分的修饰 how

Step 2 - decompose question • 输入: question • 输出: 问句解析树 • 识别主干成分的修饰 how many children of eddard stark were born in winterfell ? Seq 1: Seq 2: children of stark eddard how many children were born in winterfell

Step 2 - decompose question • Input: sequence • Output: tree • While True:

Step 2 - decompose question • Input: sequence • Output: tree • While True: • redundant_span = redundant_span_prediction(sequence) • father_token = look_for_father(redundant_span) • tree. add(redundant_span, father_token) • sequence = update(sequence) • If is_simple_sequence(sequence): • tree. add_main_sentence(sequence) • break • Return tree

redundant_span_prediction Model

redundant_span_prediction Model

Training Data • Dataset: • (x, y): x=sequence, y=redundant_span • Example: • what is

Training Data • Dataset: • (x, y): x=sequence, y=redundant_span • Example: • what is the name of the managing director ? managing • what is the name of the director ? of the director • From Treebank (Question Bank, Penn Treebank)

“sequence": "how many children of eddard stark were born in winterfell ? " "1":

“sequence": "how many children of eddard stark were born in winterfell ? " "1": { "sequence": "how many children of eddard stark were born in winterfell ? ", "redundancy": "eddard", "start_index": 4, "end_index": 4 } “ 2": { "sequence": "how many children were born in winterfell ? ", "redundancy": "of stark ", "start_index": 3, "end_index": 5 } “main_sequence": "how many children were born in winterfell ? " Seq 1: Seq 2: children of stark eddard How many children were born in winterfell