Motion Composer the search for coherence in movement
- Slides: 62
Motion. Composer - the search for coherence in movement and sound Robert Wechsler Workshop/Roundtable Mc. Gill University, Feb. 29 -Mar. 2, 2012 www. motioncomposer. de this power point may be downloaded from: www. palindrome. de/ppt
Überblick Mercredi 1 – 6 workshop Jeudi 1 – 6 workshop Vendredi 2 – 3 presentation 3 – 5 roundtable www. motioncomposer. de this power point may be downloaded from: www. palindrome. de/ppt
Überblick - Workshop (both days) introductions demonstration 3 talks - 40 min ea. discussion after each 20 – 40 min. project design and execution project presentation, de-briefing www. motioncomposer. de this power point may be downloaded from: www. palindrome. de/ppt
Überblick – 3 talks over 2 days. who am i? interactive performance motion tracking mapping and synaesthesia the motioncomposer: an intuitive expression device for persons with disabilities (Bauhaus Universität) www. motioncomposer. de this power point may be downloaded from: www. palindrome. de/ppt
me dancer, choreographer, developer - New York, Nürnberg, Stuttgart, Weimar - Palindrome Dance Company - interactive since 1975 - developed Eye. Con software with Frieder Weiss 1995 -2005 - teach motion tracking - Motion. Composer project director, Bauhaus University www. palindrome. de/ppt Part 1: me
influences New York City in the 1980's www. palindrome. de/ppt Part 1: me
John Cage Merce Cunningham
Interactive what activity /response activity www. palindrome. de/ppt activity /response Part 2: Interactive Performance
interactive performance is nothing new Cave drawings, Spain ca. 4000 BC
mechanical technology was used to empower performers Dionysis Thr. Athens - 300 BC
Louis XIV - sun king and megalomanic
Louis loved mechanical devices, toys, remote acting devices (automation)
He also loved cannons, the ultimate amplifier of gesture.
Interactive devices were used by New York performance artists in the 60's and 70's Robert Rauschenberg - "Pelican" 1963 Laurie Anderson - "Walking Solo for Tape Bow Violin" 1979
Interactive Performance today Interaction Design Gesture Sonification Motion Capture Virtual Environments Immersive Environments Haptic responders Diversified Performance (using internet) and and www. palindrome. de/ppt Part 2: Interactive Performance
Part 3: Motion Tracking
motion tracking vs. motion capture – highly accurate, expensive (ca. 1 m €) – generally not realtime – used for data collection (research), making realistic human or animal animations (films, games, etc. ) motion tracking – less data, less equipment, less cost (ca. 1 k-2 k €) – concerned with motion qualities like dynamic, direction of motion – real time www. palindrome. de/ppt Part 3: Motion Tracking
motion capture – tracks location of fixed positions on body with reflective markers – 12 -24 cameras, each lens is ringed with infrared lights www. palindrome. de/ppt Part 3: Motion Tracking
motion capture • Vicon is a leading company in motion capture
motion capture
motion capture
motion capture
real-time mo-capture – performances with interactive animated characters: "No DNA" (http: //www. nodna. com) – dance pieces on stage – Motione (2003 -5) Arizona State U. (http: //ame. asu. edu/motione) (Trisha Brown, Kaiser, et. al. ) "22" (Bill T. Jones, Kaiser , et. al. ) – Luc Vanier et al. at the interactive performance facility U of Wisconsin at Milwaukee (http: //www. isl. uiuc. edu/Publications/final%20 dance 1. pdf) www. palindrome. de/ppt Part 3: Motion Tracking
motion tracking sensors • body-oriented • environment-oriented www. palindrome. de/ppt Part 3: Motion Tracking
motion tracking sensors • body-oriented – body-worn electrodes • EEG • ECG • EMG • Touching – joint bend-sensors – accelerometers, other body-worn devices • environment-oriented – video camera-based (eg. eyecon) – infrared camera-based – floor sensors, wall sensors, etc www. palindrome. de/ppt Part 3: Motion Tracking
Part 4: Mapping and Synaesthesia
Synaesthesia Dostoyovsky Kandinsky www. palindrome. de/ppt Part 4: Mapping and Synaesthesia
Dance + Music = ? www. palindrome. de/ppt Part 4: Mapping and Synaesthesia
movement sound Where , how do they connect? How can we build up this connection? What is Mapping? www. palindrome. de/ppt Part 4: Mapping and Synaesthesia
movement sound What possibilities does the technology allow? www. palindrome. de/ppt Part 4: Mapping and Synaesthesia
e. g. sound e. g. movement sensor device a-to-d conversion analogue processing Digital d-to-a conversion output device analogue
What is Mapping? movement www. palindrome. de/ppt makes sound Part 4: Mapping and Synaesthesia
What is Mapping? dance www. palindrome. de/ppt makes music Part 4: Mapping and Synaesthesia
What is Mapping? dance www. palindrome. de/ppt music Part 4: Mapping and Synaesthesia
What is Mapping? dance www. palindrome. de/ppt music Part 4: Mapping and Synaesthesia
What is Mapping? dance music correlation?
What is Mapping? correlation dance turns on turns off toggle iterate raise lower complex continuous variables music
What is Mapping? dance correlation turns off toggle iterate raise lower complex continuous variables music
What is Mapping? dance correlation music
What is Mapping? Number of mappings (M) = number of Input parameters (I) x number of Relationships (R) x number of Output parameters (O) M=Ix. Rx. O www. palindrome. de/ppt Part 4: Mapping and Synaesthesia
There are thousands of possibilities. Most are intelligible. few are palpable. www. palindrome. de/ppt Part 4: Mapping and Synaesthesia
Coherent Mapping -- movement parameters
Coherent Mapping -- movement parameters spatial / temporal
Coherent Mapping -- movement parameters / spatial
Coherent Mapping -- movement parameters / spatial
Coherent Mapping -- movement parameters / spatial
Coherent Mapping -- music parameters / time and timing 1 discrete events
Coherent Mapping -- music parameters / time and timing 1 discrete events Accents Starts www. palindrome. de/ppt Stops Other instaneous changes Part 4: Mapping and Synaesthesia
Coherent Mapping -- music parameters / time and timing 2 Tags www. palindrome. de/ppt Part 4: Mapping and Synaesthesia
Coherent Mapping -- music parameters / time and timing 3 Modulation www. palindrome. de/ppt Part 4: Mapping and Synaesthesia
Coherent Mapping -- music parameters / time and timing 4 Repetition, sequences and timing patterns A, B, . . . (bi-modal) A, B, C, D, E, F, . . . (scales and melodies) A, A, A, www. palindrome. de/ppt A, A, . . . (rhythms and randomness) Part 4: Mapping and Synaesthesia
Coherent Mapping – time and space 5 Multi-dimensional „qualitative“ assocations many evocative qualities arise through combinations of aural and kinesthetic experience. www. palindrome. de/ppt Part 4: Mapping and Synaesthesia
Motion Tracking technology - approaches dynamic activity, stillness, flow (direction) sensing background substraction, „ 3 d cams“ position, shape intelligemt systems body part and gesture recognition
Motion Tracking - Software MT: Eye. Con, Eyesweb, Motion. Composer, MAX/Jitter (et al. Cyclops), Isadora, VNS, Icarus. . Vicon (etc. ) Sound: Eye. Con, Kontakt, Ableton (Max live), . . . DSP: Csound, Max/msp, Pure Data, Supercollider
Motion Tracking - Hardware Computers Cameras Framegrabbers
thank you. questions? Join Motion. Composer. . . www. motioncomposer. com robert@motioncomposer. com www. palindrome. de this power point may be downloaded from: www. palindrome. de/ppt
thank you. questions? ideas? robert@palindrome. de www. palindrome. de this power point may be downloaded from: www. palindrome. de/ppt
thank you. questions? ideas? robert@palindrome. de www. palindrome. de this power point may be downloaded from: www. palindrome. de/ppt
thank you. questions? ideas? robert@palindrome. de www. palindrome. de this power point may be downloaded from: www. palindrome. de/ppt
thank you. questions? ideas? robert@palindrome. de www. palindrome. de this power point may be downloaded from: www. palindrome. de/ppt
thank you. questions? ideas? robert@palindrome. de www. palindrome. de this power point may be downloaded from: www. palindrome. de/ppt