Visualizing NonVerbal Behavior in Small Group Interactions how

Visualizing Non-Verbal Behavior in Small Group Interactions ‘how to make friends without speaking’ September 21 st, 2001 Darren Gergle

Overview • Address the modeling and sensing aspects of situationally appropriate systems • Focus on small group interactions • Meeting room behavior • Small group public spaces • Provide insight for automating sensing and modeling September 21 st, 2001 Darren Gergle

Project Goals • Develop and produce a high-level description of meeting group interactions • Produce data visualizations that may be used to inform modeling and sensing September 21 st, 2001 Darren Gergle

Project Proposal • Stage 1: literature review and development of coding / notational description system • Stage 2: collect data and create metadata descriptions using coding system • Stage 3: produce visualizations of data to further understand potential utility of captured sensor data September 21 st, 2001 Darren Gergle

Stage 1 • Literature review to uncover list of target behaviors • Develop notational coding system of chosen behaviors September 21 st, 2001 Darren Gergle

What To Look For? • Types of data – Non-verbal behavioral data • Spatial orientation • Spatial activity – Auditory cues (see Foote, Boreczsky & Wilcox, 1999) • Localization • Duration • Level September 21 st, 2001 • Levels of granularity – Event data • Transitional events • Indicator events (e. g. , handshakes) – Sequential event data – Large scale temporal data Darren Gergle

Example Events • Interacting groups form structural arrangements in space (event – group formation) • Handshakes may signify beginning of meeting September 21 st, 2001 Darren Gergle

Example Sequential Events During group discussions, short glances of > 30 degrees occur. However, sustained glances of > 30 degrees usually lead to reorientation of entire body (Kendon, 1990) September 21 st, 2001 Darren Gergle

Group Spatial Arrangements September 21 st, 2001 Darren Gergle

Example Large Scale Temporal Patterns • Traffic Patterns – Gather data on traffic patterns • Rythmic Auditory Patterns – Examine patterns of vocal interaction over time (e. g. , speaker 1 -speaker 2 -speaker 3, vs. speaker 1 -speaker 1…) September 21 st, 2001 Darren Gergle

Sample Concepts for Coding Scheme • Individual • Head Frw, L, R • Body (N, NE, E, S, SW, W, NW) • Group Spatial Formations • F-Form • O-Form September 21 st, 2001 • Auditory • Actori speaking • Global activity • Rhythm (Erickson, 1991) • Traffic Patterns • Activity level • Path frequency Darren Gergle

Stage 2 • Collect data • Review videos and code data September 21 st, 2001 Darren Gergle

Collecting The Data • Outfitted meeting room – Localized ceiling mic’s – Wide angle camera on the ceiling – 2 to 3 wall-mounted or tripod digital video recorders • Alternatively, use pre-recorded meetings as source data September 21 st, 2001 Darren Gergle

Stage 3 • Develop visualization of these data • Allow users to explore visualizations and gather information regarding human perception of patterns • Use this user data to facilitate formation of models September 21 st, 2001 Darren Gergle

The Group Visualizer September 21 st, 2001 Darren Gergle

Questions? September 21 st, 2001 Darren Gergle