ListenJava Edward L Gilmore II Bryan P Strait

Listen/Java Edward L. Gilmore II Bryan P. Strait Aditya P. Mathur Purdue University {gilmorel, apm, straitbp}@cs. purdue. edu 10. 25. 2002

Introduction n n What is Listen/Java? Motivation Overall architecture Future experiments Demonstrations 2

What is Listen/Java? n n A tool for mapping program events to sound. Provides automated code instrumentation to investigate use of sound in computing environments. Listen Specification Language (LSL): language for specifying aural events. LSL/Java is an evolution of prior work done with LSL/C. 3

Motivation n n Investigate the usefulness of sound in various software engineering-related tasks. Use program auralization to improve quality of simulations of telephone networks, mechanical systems, and biological systems. Data analysis using aural cues. Development of programming environments for visually handicapped. Research in novel approaches to music composition. 4

LSL/Java Environment: Java source file (J) Compilation Listen Instrumented Java file (J’) javac LSL spec. file Generates table of program events to be auralized LSL parser Java parser decorates parse tree based on table Listen. Event table Java parser 5

Instrumented File Overview Listen. Media. Manager class Instrumented file Listen. Event class includes Listen. Sound. Manager. play (Listen. Event); includes Java. Sound API 6

Future Experiments n Defibrillator ¡ n n Heart events corresponding to embedded program events can be auralized to monitor heart status Network monitoring Software testing & debugging 7

Demos n 1) Program flow ¡ n Learning objective: to identify when a program has entered and exited a while loop. 2) Variable access ¡ Learning objective: to identify when a specific variable has been used. 8