CS 414 Multimedia Systems Design Lecture 1 Introduction

CS 414 – Multimedia Systems Design Lecture 1 - Introduction Klara Nahrstedt Spring 2012 CS 414 - Spring 2012

Overview Course information (personnel, policy, schedule, misc. ) n What is Multimedia? n What is happening in Multimedia domain? n Summary n CS 414 - Spring 2012

Instructor n Klara Nahrstedt ¨ Ph. D 1995 University of Pennsylvania ¨ Research: n n n Multimedia distributed systems (overlay multicast, peer-topeer systems, service composition, resource management), Mobile computing – smart phones protocols – P 2 P, video streaming over mobile phones, group management, … Multimedia operating systems (soft-real-time scheduling, caching), Multimedia networking (routing, Qo. S management, pricing), Multimedia applications (multi-view 3 D tele-immersive collaborative environments, mobile multimedia, P 2 P IPTV) CS 414 - Spring 2012

Overview n Office Assistant: ¨ Lynette Lubben (llubben@illinois. edu) for Klara Nahrstedt n Teaching Assistant: ¨ Md Ahsan Arefin Class Website http: //www. cs. uiuc. edu/class/sp 12/cs 414/ Newsgroup: class. sp 12. cs 414 (access through cs 414 website) n n CS 414 - Spring 2012

Required Readings for cs 414 n Required Textbooks: ¨ Media Coding and Content Processing, Ralf Steinmetz, Klara Nahrstedt, Prentice Hall, 2002 ¨ Multimedia Systems, Ralf Steinmetz, Klara Nahrstedt, Springer Verlag, 2004 n Papers!!! (required reading since many areas are not covered in present textbooks) CS 414 - Spring 2012

Course Prerequisites CS 241 – pre-requisite MUST, otherwise the class will be hard, especially the MPs!!! n You need to know n ¨ ¨ ¨ System/C/Java Programming on top of Linux Socket Programming Thread Programming Locks/Semaphore Synchronization/Programming Basic System Principles – File Systems, Memory Management, Process Management, I/O Management, Network Programming CS 414 - Spring 2012

Facilities and Equipment (1) n Leasing Process from Barb Leisner ¨ ¨ ¨ Lease one Logitech camera for each student or at least two cameras within one group to start MP 1, and then for MP 2/MP 3. Leasing process starts on January 24 (hopefully groups will be setup) Pick up the camera from Barb Leisner office 2312 SC Bring your student ID to sign for the camera Each cs 414 student is responsible for his/her own camera n if you loose it (or badly damage) and you don’t have police report, you pay for it (charged to your student account at the end of the semester) Hours are Monday –Friday 9 am-5 pm ¨ No camera pickup on Saturday and Sunday ¨ n Returning Process to Barb Leisner If you drop the class, return immediately camera to Barb Leisner ¨ If your camera does not work, return immediately and get a new one ¨ CS 414 - Spring 2012

Facilities and Equipment (2) n Engineering workstations-linux machines n 216 SC/SC 220 (SC basement where you can run the camera) CS 414 - Spring 2012

Office Hours n Office hours: available in web page ¨ KN: n Wed/Fri, 9 -10 am, n Office: 3104 SC n Phone: 244 -6624 ¨ Arefin: n Th: 3 -4 pm; Fr: 3 -4 pm n Office: 0207 SC n Phone: 244 -0526 CS 414 - Spring 2012

About this course… Goals Principles n n n Multimedia System concepts Multimedia System design Some theory Rationale Practice n n n Understand Digital Audio/Video Media Understand Multimedia Systems decisions Get hands dirty CS 414 - Spring 2012

Expect (Some) Pain Fast pace Hard material 3 MPs (programming) 2 Homework 1 Midterm and 1 Final Exam But…. Students had fun in past cs 414! Ben S. Bernanke (Image Source: www. federalreserve. gov) CS 414 - Spring 2012

Grading Final exam: 35% n Mid-exam: 15% n 2 Homework: 10% n Peer Evaluation: 5% n 3 MPs: 35% n ¨ 1 st MP – 8% ¨ 2 nd MP – 12% ¨ 3 rd MP – 15% CS 414 - Spring 2012

Grading policy Gradebook system: http: //compass. uiuc. edu n Late policy for MPs and Homework Assignments n ¨ No n Late Policy, but 3 Bonus Days for MPs!!! It is your responsibility! ¨ Check announcements in lectures, newsgroups, or web pages n MPs will be done in Groups of 3 -4 students ¨ Start forming groups as soon as possible!! ¨ Recommend 3 in a group CS 414 - Spring 2012

Group Setup Process n Organize Groups among yourself between 1/18 and 1/23 ¨ Use n Email to TA Arefin (marefin 2@illinois. edu) your group formation by 1/23 ¨ n n newsgroup to find group partners If you cannot find a group, email immediately to the TA – email your request as well as skills you can bring to the table. TSG will setup accounts and directories for groups. Between 1/26 and 1/30 the TA (Shu) will inform each group their login and password to start to work on the Linux machines. CS 414 - Spring 2012

Peer Evaluation n Each group will submit at the end self-evaluation and evaluation of other group members By Friday 5/4 each peer submits ‘peer evaluation’ of his/her group n Evaluation will include n ¨ ¨ ¨ His/her own self-evaluation His/her evaluation of each group member for each MP Evaluation should include contribution of each member to each MP Evaluations will be sent to instructor only (klara@illinois. edu) Evaluations will be known only to the instructor, i. e. , will not be revealed neither to any other group members nor TA. CS 414 - Spring 2012

Peer Evaluation – form submitted to instructor at the end of the semester MP 1 MP 2 Self. Evaluation Group Member X Group Member Y Group Member Z CS 414 - Spring 2012 MP 3 MP 4

Re-grading policy Students have 1 week (after the grade for homework/MPs/exam is released into the gradebook) to request for re-grading n Re-grading requests need to be in writing to the TA n After the re-grading period, no re-grading request will be granted for this Homework/MP/exam. n CS 414 - Spring 2012

Cheating Policy n n n Academic integrity Exams must be your own – if cheating, then students will get a failing grade in the course. Homework must be your own - first offense 0 point, second offense F grade in the course Both the cheater and the student who aided the cheater will be held responsible for the cheating Machine problems will be graded per group, i. e. , each member gets the same number of points. CS 414 - Spring 2012

Lecture Format Help you understand important and hard Media and Multimedia Systems concepts n Lectures do not cover everything n ¨ Not all questions in homework or exams are from lectures n Students responsibility ¨ Attend lectures ¨ Read textbooks, papers!! ¨ Homework, MP, Exam ¨ Periodically check web page ¨ Read/utilize newsgroup CS 414 - Spring 2012

MPs (Deadlines) MP 1, post 1/29, deadline 2/18 (Saturday), Demonstration on 2/20 Audio/Video Recording and Playback MP 2, post 3/11, deadline 4/7 (Saturday), Demonstration on 4/9 Audio/Video Streaming Protocols MP 3, post 4/9, deadline 4/28 (Saturday), Demonstration on 4/30 Multi-camera Surveillance System • Q&A Session before each MP due date • MP releases and Q&A Session dates will be announced on the course web page/ newsgroup CS 414 - Spring 2012

Multi-camera Surveillance System (Camera 1/View 1) (Camera 2/View 2) (Camera 3/View 3) Display of Multiple Cameras Network Audio-Video Devices

Multi-camera Surveillance System (Camera 1/View 1) MP 1 Recording and Playback (Camera 2/View 2) (Camera 3/View 3) Display of Multiple Cameras Network Audio-Video Devices

Multi-camera Surveillance System (Camera 1/View 1) MP 2 Synchronized Audio-Video Transport Protocol (Camera 2/View 2) (Camera 3/View 3) Display of Multiple Cameras Network Audio-Video Devices

Multi-camera Surveillance System MP 3 Integration of Multiple Active/Passive Cameras into the Networked Surveillance System (Camera 1/View 1) (Camera 2/View 2) (Camera 3/View 3) Display of Multiple Cameras Network Audio-Video Devices

Multi-Camera Surveillance System 3 MPs will hang together and at the end should yield one large multi-view (multicamera) distributed surveillance system n Choose group members carefully and be committed to the group since if you leave, you may leave the group with piece of code that they will have to live with through the rest of the MPs n Document your MPs/code carefully n CS 414 - Spring 2012

Multi-camera surveillance system All groups will be in competition and we will announce the winning group n The final demonstration on 4/30 will be seen by and evaluated not only by the instructor/TA but also by companies (e. g. , Google or Byte. Mobile representative will be invited) n Winning group will be featured on the departmental website. n CS 414 - Spring 2012

Homework & Exams Post 2/22, deadline 3/1 HW 1 March 5, Monday 11 -11: 50 am Midterm Exam (Inclass) 1105 SC Post 4/20, deadline 5/2 May 11, Friday 1: 30 -4: 30 pm Room: TBD HW 2 Final Exam CS 414 - Spring 2012 • Announcement in web page • No makeup homework • No makeup exams unless with documented medical emergency

¼ Unit Project: graduate students n n Final grade is decided upon ¾ unit performance ¼ unit project: pass or fail Individual or group of two Choices: Animation project, Survey, Implementations of some multimedia services n n n Proposal due: 2/24, Friday, 5 pm, by email to klara@illinois. edu Deadline of ¼ unit project delivery: 5/4, Friday. Details in web page CS 414 - Spring 2012

Digital Media Revolution n n New digital media: camcorders, 3 D cameras, MP 3 players, location sensors, speech, gestures, etc. Digital media enables new forms of expression ¨ inform, educate, entertain, provoke, etc. ¨ multi-sensory, emphasizes temporal over spatial n Digital media places the power of mega production studios at the fingertips of the user ¨ record, edit, process, play, and share digital media ¨ profound social, cultural, educational, technological, and communicative impact – its just now beginning CS 414 - Spring 2012

Multimedia Requires n Multiple media ¨ discrete or continuous ¨ at least one continuous n Coordination ¨ temporal n and/or spatial Interaction ¨ user exercises control CS 414 - Spring 2012

Related Terms n Media ¨ representation of information ¨ text, graphics, images, video, sound, etc. n Medium ¨ how that representation is communicated ¨ TV, Radio, Print, Web n Multimodal CS 414 - Spring 2012

Integrating Aspects of Multimedia Image/Video Capture Audio/Video Perception/ Playback Audio/Video Presentation Playback Image/Video Information Representation Transmission Audio Capture Transmission Compression Processing Audio Information Representation Media Server Storage CS 414 - Spring 2012 A/V Playback

This Class n Perception ¨ auditory n perception, visual system Multimedia Systems Design ¨ compression, Qo. S, Multimedia Processing (process scheduling, buffer management, device management), multimedia servers, multimedia networking, synchronization n Multimedia Applications (video conferencing, 3 D tele-immersion, Vo. D, Skype, You. Tube, …) CS 414 - Spring 2012

Where’s the Action in Multimedia? n n n n n Enable amateurs to take pictures and shoot video like the pros New interfaces for organizing, retrieving, and accessing large collections of content (Apple - IPhone, Microsoft – Kinect) Capturing and sharing experiences (Facebook, Twitter) Multi-party collaborative systems (Cisco Tele-presence System) Multi-camera, multi-view systems 3 D media – 3 D compression, 3 D movies (Avatar, …) Internet P 2 P Streaming (IPTV – PPVlive) Mobile multimedia (Games on phones, phone-TV) CS 414 -Amazon Spring 2012 Media servers – You. Tube,

After this lecture… n n n Browse the web site Subscribe to newsgroup Login to Linux machines in 216/220 SC Setup Groups: 1/18 -1/23(email to Arefin about group formation) Think what are the next generation of multimedia systems/applications? Name multimedia applications that you know CS 414 - Spring 2012