Audio Streamer Exploiting simultaneity for listening Chris Schmandt

  • Slides: 10
Download presentation
Audio Streamer Exploiting simultaneity for listening Chris Schmandt and Atty Mullins MIT Media Laboratory

Audio Streamer Exploiting simultaneity for listening Chris Schmandt and Atty Mullins MIT Media Laboratory

More productive listening l time scaling l skipping / skimming (Speech. Skimmer) l simultaneous

More productive listening l time scaling l skipping / skimming (Speech. Skimmer) l simultaneous listening “cocktail party effect”

Simultaneous listening l selective attention l cues for interest on secondary channels l scenarios:

Simultaneous listening l selective attention l cues for interest on secondary channels l scenarios: audio “channel surfing” evening news on multiple channels sorting old voice mail

Streamer overview l 3 simultaneous audio sources l localized sound (Beachtron, headphones) l head

Streamer overview l 3 simultaneous audio sources l localized sound (Beachtron, headphones) l head l user position sensors (Fish) controls gain (attention) l Streamer gives cues for interest (tone, gain)

Layout and attention switching 60’’ 60

Layout and attention switching 60’’ 60

Selective attention l we can select between simultaneous streams l streaming factors: tempo, timbre,

Selective attention l we can select between simultaneous streams l streaming factors: tempo, timbre, pitch, gender, location l Streamer enhances interest by four levels of gain l gain decays, as does attention

Listener attention l More activity = greater interest l Interest decays with time

Listener attention l More activity = greater interest l Interest decays with time

Monitoring auxiliary channels l How much do we hear? l Streamer enhances possible points

Monitoring auxiliary channels l How much do we hear? l Streamer enhances possible points of interest l Story boundaries, speaker changes

Making suggestions l tone plus increased gain l decays with time

Making suggestions l tone plus increased gain l decays with time

Future work l listener evaluation bimodal reactions so far l browsing l more a

Future work l listener evaluation bimodal reactions so far l browsing l more a single recording interaction techniques l auditory “info landscapes”

audio audio srcaudio source src audio autoplay audioaudio audio srcaudio source src audio autoplay audio
Audio Streamer Board Release D Woodcock SDC EMEAAudio Streamer Board Release D Woodcock SDC EMEA
Listening Overview Listening Listening vs Hearing Definition AListening Overview Listening Listening vs Hearing Definition A
Developing Listening strategies Listening strategies Listening strategies areDeveloping Listening strategies Listening strategies Listening strategies are
Chapter 4 Listening Skills Listening Skills Introduction ListeningChapter 4 Listening Skills Listening Skills Introduction Listening
LISTENING OBJECTIVES Understand the listening process Develop listeningLISTENING OBJECTIVES Understand the listening process Develop listening
Skim listening Listening for detailed comprehension Listening forSkim listening Listening for detailed comprehension Listening for
Chapter 4 Listening Importance of Listening Good listeningChapter 4 Listening Importance of Listening Good listening
The Power of Listening What is Listening ListeningThe Power of Listening What is Listening Listening