Tag Helper Track Overview Carolyn Penstein Ros Carnegie

Tag. Helper Track Overview Carolyn Penstein Rosé Carnegie Mellon University Language Technologies Institute & Human-Computer Interaction Institute School of Computer Science

Tag. Helper Tools and SIDE Define Annotations Annotate Data Tag. Helper Tools uses text mining technology to automate annotation of conversational data Visualize Annotated Data SIDE facilitates rapid prototyping of reporting interfaces for group learning facilitators

? t? i h t i u B t a h tw n a c w o d u yo 3

Identifying types of conversational moves Eddie: Well, i don't think it matters what order the numbers are in. You still get the same answer. But three times four and four times three seem like they could be talking about different things. Teacher: Rebecca, do you agree or disagree with what Eddie is saying? Rebecca: Well, I agree that it doesn't matter which number is first, because they both give you twelve. But I don't get what Eddie means about them saying different things. Teacher: Eddie, would you explain what you mean? Eddie: Well, I just think that like three times four can mean three groups of four things, like three bags of four apples. And four times three means four bags of three apples, and those don't seem like the same thing. Tiffany: But you still have the same number of apples, so they are the same! Teacher: OK, so we have two different ideas here to talk about. Eddie says the order does matter, because the two orders can be used to describe different situations. So Tiffany, are you saying that three times four and four times three can't be used to describe two different situations?

? t t n a d l u B t u y h w h t o ? t a d o w u o y o w 5

Why automatically monitor conversations? • Support for collaborative learning is like training wheels • Effective support allows learners to achieve better collaboration • Unnecessary support can be demotivating • Fading support is ideal • But too little support can be detrimental as well • Ideal support is adaptive and context sensitive 6

Triggering Support as Needed • Integrated with several collaborative learning environments • Evaluated in several Learning Studies • Positive effects on learning in comparison with no support control conditions – (Kumar et al. , 2007; Wang et al. , 2007; Chaudhuri et al. , 2008) 7

Projects from Previous Years • Identifying types of helping behavior • Identifying argumentation moves • Identifying correct and incorrect physics explanations • Identifying grammatical errors in non-native English speakers’ essays 8

Tracking Valuable Conversational Behavior • Tag. Helper Tools Project – 445 users from 55 countries • Some success in automating transactivity analysis – Rosé et al. , in press; Joshi & Rosé, 2007 • Limitations – Highly controlled settings – Limited generalizability 9

10

11

12

Tracking Valuable Conversational Behavior • Tag. Helper Tools Project – 445 users from 55 countries • Some success in automating transactivity analysis – Rosé et al. , in press; Joshi & Rosé, 2007 • Limitations – Highly controlled settings – Limited generalizability 13

Any questions? Download tools at: http: //www. cs. cmu. edu/~cprose/Tag. Helper. html http: //www. cs. cmu. edu/~cprose/SIDE. html 14