Turntaking and Disfluencies Julia Hirschberg CS 6998 212022
Turn-taking and Disfluencies Julia Hirschberg CS 6998 2/1/2022 1
Today z Turn-taking behaviors y. Conversational Analysis y. Importance in real systems z Disfluencies y. How to model? Detect? y. Role in human-human interaction y. Importance in real systems? 2/1/2022 2
Turn-taking z Expected patterns of behavior y. Deviation is significant y. How do we find the patterns? x. Ordinary conversation x. Telephone talk x. Meetings x. Email? y. Who looks for these? (Ilana) 2/1/2022 3
z Terminology y. Adjacency pairs y. Preference y. Pre-sequence y. Repair z Examples: y. Telephone openings, closings y. Broadcasts 2/1/2022 4
Could this be useful when we build SDS? z What do we expect to hear? z What should we produce? 2/1/2022 5
Disfluencies and Self-Repairs z Are these just ‘noise’? y. For people (Heba) y. For parsers y. For speech recognizers 2/1/2022 6
Hindle ’ 83: Finding the Edit Signal z If we have it, can we ‘repair’ the self-repair automatically? y. Builds a correcting parser, Fidditch, for spontaneous speech y. Given a string with an edit signal marked, produces a ‘repaired’ version I was * I am really annoyed y. If X 1 * X 2 are similar linguistic elements separated by an edit signal, replace X 1 w/X 2 2/1/2022 7
What does it mean to be the same z Same surface string Well if they’d * if they’d… z Same category I was just that * the kind of guy… z Same constituent I think that you get * it’s more strict in Catholic schools z Restarts are completely different… I just think * Do you want something to eat? 2/1/2022 8
Bear et al ’ 92: Detecting and Correcting Self-Repairs z Use multiple knowledge sources but not edit signal y. Lexical pattern matching y. Parsing failure + pattern matching + reparsing y. Acoustic information: pause, peak F 0, y. Cue words: well, no y. Fragments 2/1/2022 9
But…is there an edit signal? 2/1/2022 10
Does it identify self-repairs reliably? z. CART prediction: 86% precision, 91% recall y. Duration of interval, presence of fragment, pause filler, p. o. s. , lexical matching across DI z Are there edit signals? 2/1/2022 13
Next Week 2/1/2022 14
- Slides: 12