CS 414 Multimedia Systems Design Lecture 1 Introduction

CS 414 – Multimedia Systems Design Lecture 1 - Introduction Instructor: Klara Nahrstedt Lecture Presented by Teaching Assistant: Hoang Nguyen Spring 2009 CS 414 - Spring 2009

Overview Course information (personnel, policy, schedule, misc. ) n What is Multimedia? n What is happening in Multimedia domain? n Summary n CS 414 - Spring 2009

Instructor n Klara Nahrstedt ¨ Ph. D, University of Pennsylvania ¨ Research: n n n Multimedia distributed systems (overlay multicast, peer-topeer systems, service composition), Multimedia operating systems (soft-real-time scheduling, caching), Multimedia networking (routing, Qo. S management, pricing), Multimedia applications (multi-camera tele-immersive systems) Multimedia security CS 414 - Spring 2009

Overview n Office Assistant: ¨ Lynette Lubben (llubben@illinois. edu) for Klara Nahrstedt n Teaching Assistant: (assistance with MPs/HW/Final Exam) ¨ Hoang Nguyen (hnguyen 5@illinois. edu) Graduate Assistant: (assistance with Lectures/Lecturing/Midterm) ¨ Ramses Morales (rvmorale@uiuc. edu) Class Website http: //www. cs. uiuc. edu/class/sp 09/cs 414/ Newsgroup: uiuc. class. cs 414 n n n CS 414 - Spring 2009

Required Readings for cs 414 n Textbook: ¨ Media Coding and Content Processing, Ralf Steinmetz, Klara Nahrstedt, Prentice Hall, 2002 ¨ Multimedia Systems, Ralf Steinmetz, Klara Nahrstedt, Springer Verlag, 2004 n Papers!!! (required reading since many areas are not covered in present textbooks) CS 414 - Spring 2009

Course Prerequisites CS 241 – pre-requisite MUST, otherwise the class will be hard, especially the MPs!!! n You need to know n ¨ ¨ ¨ System/C Programming on top of Linux Socket Programming Thread Programming Locks/Semaphore Synchronization/Programming Basic System Principles – File Systems, Memory Management, Process Management, I/O Management, Network Programming Java and/or C/C++ CS 414 - Spring 2009

Facilities and Office Hours n Laboratory Facilities ¨ CSIL-Linux machines, 216 SC, equipped with cameras and microphones, connected to high-speed Ethernet n Office hours: available in web page ¨ KN: Tues/Wed, 9 -10 am, Office: 3104 SC ¨ HN: Thu/Fr, 3 -4 pm, Office: TA office – will be announced CS 414 - Spring 2009

About this course… Goals Principles n n n Multimedia System concepts Multimedia System design Some theory Rationale Practice n n n Understand Digital Audio/Video Media Understand Multimedia Systems decisions Get hands dirty CS 414 - Spring 2009

Expect Some Pain Fast pace 4 MPs (programming) 2 Homework 1 Midterm and 1 Final Exam Ben S. Bernanke (Image Source: www. federalreserve. gov) CS 414 - Spring 2009

Grading Final exam: 35% n Mid-exam: 15% n 2 Homework: 10% (each 5%) n Peer Evaluation: 5% n 4 MPs: 35% (depending on the difficulty each MP will have different weight n ¨ 1 st MP – 5% ¨ 2 nd MP – 10% ¨ 3 rd MP – 7% ¨ 4 th MP – 13% CS 414 - Spring 2009

Grading policy Gradebook system: http: //compass. uiuc. edu n Late policy for MPs and Homework Assignments n ¨ No n Late Policy It is your responsibility! ¨ Check announcements in lectures, newsgroups, or web pages Homework done individually!!! n MPs will be done in Groups of 3 -4 students n MPs done on Linux machines in 0216 SC n CS 414 - Spring 2009

Group Setup n Setup Groups between 1/21 and 1/24 and latest by 1/26 ¨ Use n newsgroup to find group partners Email to TA Hoang (hnguyen 5@illinois. edu) your group formation latest by 1/26 ¨ If you cannot find a group, email immediately to the TA Hoang – email your request as well as skills you can bring to the table. n n TSG will setup accounts for groups. Between 1/26 and 1/28 the TA will inform each group their login and password to start to work on the Linux machines. CS 414 - Spring 2009

Peer Evaluation By 5/6 each peer submits ‘peer evaluation’ of his/her group n Evaluation will include n ¨ ¨ ¨ His/her own self-evaluation His/her evaluation of each group member for each MP Evaluation should include contribution of each member to each MP Evaluations will be sent to instructor only Evaluations will be known only to the instructor, i. e. , will not be revealed neither to any other group members nor TA. CS 414 - Spring 2009

Peer Evaluation – form submitted to instructor at the end of the semester MP 1 MP 2 Self. Evaluation Group Member X Group Member Y Group Member Z CS 414 - Spring 2009 MP 3 MP 4

Re-grading policy Students have 1 week (after the grade for homework/MPs/exam is released into the gradebook) to request for re-grading n Re-grading requests need to be in writing to the TA n After the re-grading period, no re-grading request will be granted for this Homework/MP/exam. n CS 414 - Spring 2009

Cheating Policy n n Academic integrity Your homework and exams must be your own - we have a zero tolerance policy towards cheating of any kind any student who cheats will get a failing grade in the course. Both the cheater and the student who aided the cheater will be held responsible for the cheating Machine problems will be graded per group, i. e. , each member gets the same number of points. CS 414 - Spring 2009

Lecture Format Help you understand important and hard Media and Multimedia Systems concepts n Lectures do not cover everything n ¨ Not all questions in homework or exams are from lectures n Students responsibility ¨ Attend lectures ¨ Read textbooks ¨ Homework, MP, Exam ¨ Periodically check web page ¨ Read/utilize newsgroup CS 414 - Spring 2009

MPs: Peer-to-Peer-based VOD Server Movie 1 Stream Found Movie Play Request Movie 2 V 1 Server S 1 Dispatcher S 2 V 2 S 3 Video-On-Demand Server (consists of Peer Servers) CS 414 - Spring 2009 VOD Clients/Viewers

MP 1 & MP 2: Local Play & Upload/Search Movie 1 Store Upload/Search Movie 1 Movie 2 V 1 Response Dispatcher S 2 S 3 Video-On-Demand Server (consists of Peer Servers) CS 414 - Spring 2009 VOD Clients/Viewers

MP 3: Streaming Movie 1 Stream S 1 Movie 2 V 1 Dispatcher S 2 S 3 CS 414 - Spring 2009

MP 4: Integration Movie 1 Stream Found Movie Play Request Movie 2 V 1 Server S 1 Dispatcher S 2 V 2 S 3 Video-On-Demand Server (consists of Peer Servers) CS 414 - Spring 2009 VOD Clients/Viewers

P 2 P-Based VOD Server Project n n n 4 MPs will hang together and at the end should yield one new P 2 P Video Server to which you can upload A/V files and also request to stream (play/fast-forward/rewind) A/V (movie) to client(s) Choose group members carefully and be committed to the group since if you leave, you may leave the group with piece of code that they will have to live with through the rest of the MPs Document your MPs/code carefully CS 414 - Spring 2009

P 2 P-based VOD Server Project All groups will build the same server and at the end there will be a competition and we will announce the winning group on 5/1 n The final demonstration on Friday, 5/1 will be seen by and evaluated not only by the instructor and TAs but also by Pavlov Company, and others n The top three winning groups will be featured on the departmental website and receive small gifts n CS 414 - Spring 2009

MPs (Deadlines) MP 1 post 1/28/2009 MP 1 (Monday) due 2/9/2009 Audio/Video Local Playback Services (demo 5 -7 pm in 216 SC) MP 2 post 2/9/2009 MP 2 (Monday) due 3/2/2009 A/V P 2 P-based Server Protocols Design and Implementation to Upload A/V files from Client to P 2 P-based Server (demo 5 -7 in 216 SC) MP 3 post 3/16/2009 MP 3(Monday) due 4/6/2009 A/V Streaming Protocol Design and Implementation from Single Server to Client (demo 5 -7 pm in 216 SC) MP 4 post 4/6/2009 MP 4 (Friday) due 5/1/2009 A/V P 2 P-based Server Protocols to stream A/V streams from P 2 P-based VOD Servers to the Requesting Client (demo 5 -7 pm in 216 SC) • Q&A Session before each MP due date • MP releases and Q&A Session dates will be announced on the course web page/ newsgroup CS 414 - Spring 2009

Homework & Exams Friday post 2/27 Friday due 3/6, 5 pm HW 1 3/9, Monday, 11 -11: 50 am Midterm Exam (In-class), closed book 1 -side cheatsheet allowed 1302 SC Monday post 4/27 Wednesday due 5/6, 5 pm HW 2 5/12, Tuesday 7 -10 pm Final Exam (Comprehensive, Room: TBD closed book) 2 -side cheatsheet allowed CS 414 - Spring 2009 • Announcement in web page • No makeup homework • No makeup exams unless with documented medical emergency

¼ Unit Project: graduate students n n Final grade is decided upon ¾ unit performance ¼ unit project: pass or fail Individual or group of two Choices ¨ Implementation project ¨ Animation project ¨ Survey n n Proposal due: 2/20, Friday, 5 pm, by email to klara@cs. uiuc. edu Details in web page CS 414 - Spring 2009

Digital Media Revolution n Digital camcorders, cameras, MP 3 players ¨ but n also location sensors, speech, gestures, etc. Digital media enables new forms of expression ¨ inform, educate, entertain, provoke, etc. ¨ multi-sensory, emphasizes temporal over spatial n Digital media places the power of mega production studios at the fingertips of the user ¨ record, edit, process, play, and share digital media ¨ profound social, cultural, educational, technological, and communicative impact – its just now beginning CS 414 - Spring 2009

Multimedia Requires n Multiple media ¨ discrete or continuous ¨ at least one continuous n Coordination ¨ temporal n or spatial Interaction ¨ user exercises control CS 414 - Spring 2009

Related Terms n Media ¨ representation of information ¨ text, graphics, images, sound, etc. n Medium ¨ how that representation is communicated ¨ TV, Radio, Print, Web n Multimodal CS 414 - Spring 2009

Aspects of Multimedia Systems Capture n Representation n Storage n Transmission n Processing n Information exchange n Presentation n Perception n CS 414 - Spring 2009

This Class n Perception ¨ auditory n perception, visual system, cognition Multimedia Systems Design ¨ compression, Qo. S, Multimedia Processing (process scheduling, buffer management, device management), multimedia servers, multimedia networking, synchronization n n Multimedia User Interface Design Multimedia Applications (video conferencing, tele -immersion, Vo. D, Skype…) CS 414 - Spring 2009

Where’s the Action in Multimedia? Enable amateurs to take pictures and shoot video like the pros n Interfaces for organizing, retrieving, and accessing large collections of content n Capturing and sharing experiences n Multi-source/multi-party collaborative systems n 3 D media n P 2 P Streaming (IPTV) n CS 414 - Spring 2009

After this lecture… n n n Browse the web site Subscribe to newsgroup Login to csil machines Setup Groups: 1/21 -1/26(email to Hoang about group formation) Think what are the next generation of multimedia systems/applications? Name multimedia applications that you know CS 414 - Spring 2009