Symbolic Representations of Music Ichiro Fujinaga 2005 Computer

Symbolic Representations of Music Ichiro Fujinaga 2005

Computer representation by application category n Score-based n n Gestural n n Music N, Smoke, Nyquist, Open. Music, Elody Audio n n Humdrum / **kern Compositional n n MIDI Analytical n n DARMS, CMN, SMDL, NIFF, GUIDO MP 3, au, wav, sdii, ra, qt, snd Descriptive n MPEG 4, MPEG 7, MPEG 21

Score-based Formats n Binary formats n n n Sibelius (Proprietary) Enigma (Finale - proprietary? ) NIFF (Notation Interchange File Format) Score (Leland Smith) Ascii / Unicode formats n n n DARMS (1963) cmn GUIDO Lily. Pond (GNU project) HTML / XML

Examples n GUIDO [clef<"treble"> meter<"4/4"> d/4 e/8 f# g a b c#2 d/2 _/2] n DARMS !I 1 !G !M 4/4 0 Q 1 E 2# 3 4 5 6# 7 H RH n cmn (staff treble d 4 q e 4 e fs 4 e a 4 e b 4 e cs 5 d 5 h half-rest)

HTML / XML n n n n SMDL (Hytime, SGML) MHTML Music. ML Musi. XML Music. XML Musique. XML Xmusic Etc.

Example of Music. XML <note> <pitch> <step>A</step> <octave>4</octave> </pitch> <duration>4</duration> <type>half</type> <stem>up</stem> <notations> <slur type="start” number="1"/> <tied type="start"/> </notations> </note>

Gesture / Performance n Piano roll n MIDI (SMF) n n Ubiquitous n Keyboard -centric (note and velocity) SKINI (Synthesis tool. Kit Instrument Network Interface)

Analytical (Humdrum /** kern) Represents syntactic rather than orthographic information !! Fux: "Gradus ad Parnassum” **kern *M 4/4 *k[] =12 d/ 4 f/ 4 a/ =2 2 b-/ 2 a/ ==|! *-

Compositional n Music N (Csound) n Smoke (Smalltalk) n Nyquist (Lisp) n Max/MSP (visual object-oriented graphical programming environment) n Elody (java, MIDI, visual functional programming environment) n Open. Music (visual Lisp-based programming environment) n Super. Collider, Kyma, etc.

Csound example n Orchstra file instr 1 asig oscil 1000, cpspch(p 5), 1 out asig endin n Score file f 1 0 256 10 1 ; a sine wave table ; a pentatonic scale ; start dur amp pitch i 1 0. 5 0 8. 01 i 1 0. 5. . 8. 03 i 1 1. 0. . 8. 06 i 1 1. 5. . 8. 08 i 1 2. 0. . 8. 10 e

Smoke example [(Event. List new. Named: #test 1) add: (0 => (Event dur: 1/4 pitch: 'c 3' ampl: 'mf'); add: (1 => ((Event new) dur: 6 ampl: 0. 3 sound: #s 73 bw))] "C-minor fugue theme. ” ((0. 5 beat => ((1/4 beat), ('c 3' pitch), (voice: 'harpsichord'))), ((1/4 beat), ('b 2' pitch)), ((1/2 beat), ('c 3' pitch)), ((1/2 beat), ('g 2' pitch)), ((1/2 beat), ('a-flat 2' pitch)) )

Nyquist example I Sequences (defun note (pitch dur) (osc pitch dur *table*)) (play (seq (note (note c 4 d 4 f 4 g 4 d 4 i) i) q)))

Nyquist example II Transformation ; env-note produces an enveloped note. The duration defaults ; to 1. 0, but stretch can be used to change the duration. ; (defun env-note (p) (mult (note p 1. 0) (env 0. 05 0. 1 0. 5 1. 0 0. 5 0. 4))) ; now use stretch to play different durations ; (play (seq (stretch 0. 25(seq (env-note c 4) (env-note d 4))) (stretch 0. 5 (seq (env-note f 4) (env-note g 4))) (env-note c 4)))

Descriptive / compression n MPEG 4 n n MPEG 7 n n structured audio (SAOL) a standard for describing features of multimedia content MPEG 21 n an open framework for multimedia delivery and consumption

Music Representation by Humans n Symbolic? n Search n Recall

Music Representation by Humans n Symbolic? n Search n Recall n Identification n Example 1 n Example 2 n Example 3