Online Streaming video Martin Otalike 2 nd October

Online Streaming [video] Martin Otalike 2 nd October, 2019

Brief History of Online Video Streaming 2

Brief History of Online Video Streaming 3

Brief History of Online Video Streaming 4

Brief History of Online Video Streaming 5

Brief History of Online Video Streaming 6

Brief History of Online Video Streaming 7

Streaming Multi. Media n n Streaming technology offers a significant improvement over the download-and-play approach to multimedia file distribution, because it allows the data to be delivered to the client as a continuous flow with minimal delay before playback can begin. The multimedia data arrives, is briefly buffered before being played, and is then discarded. It is never actually stored on the users' computer. Users benefit by experiencing instant playback without the frustration of having to wait for the entire data to be downloaded before they can determine whether it meets their needs or interests 8

Streaming Multi. Media n Opening up the network for traditional multimedia applications such as news, education, training, entertainment, advertising, and a host of other uses. 9

Server/client n n Streaming is a server/client technology Allows live or pre-recorded data to be broadcast in "real time” 10

Streaming technology n n Typically, when accessing multimedia data across a network, a user had to wait for the entire file to be transferred before they could use the information. Streaming, however, allows a user to see or hear the information as it arrives without having to wait. Users benefit by experiencing instant playback without the frustration of having to wait for the entire data to be downloaded before they can determine whether it meets their needs or interests. In most cases, this download process took a long time, and was impractical for widespread acceptance. 11

Video source n n n The Video Source is typically one or more streams of analogue video. It can come from cameras, DVD players or VCRs. These video sources will have an analogue video connection to the Encoding Station. It is common for live broadcasts to connect the cameras to video production and editing equipment, before being passed on to the Encoding Station. 12

Encoding Station n n The Encoding Station is a computer that captures and typically, encodes both the audio and video live, directly into the required streaming format. The most commonly used systems for encoding purposes are Windows 7 - 10 as well as MAC PC’s workstations equipped with audio and video capture cards. These systems must have the computational power to encode one or more audio and video streams either in software or via a hardware codec. The use of a good capture card is critical in achieving these high rates with good picture quality. The card needs to be capable of capturing 640 x 480 @ 30 fps without dropping any pixels/frames, or having a high CPU consumption. 13

Encoding Station n n The Encoding Station, which needs to be near the Video Source, sends the compressed audio/video streams on to the Video Streaming Server (typically via a LAN using UDP/TCP protocol). Individual compressed streams can vary from 20 Kbps (Kilobits/second) to 5 Mbps (HD video) or more. 14

Encoding Station n The connection between the Encoding Station and the Video Streaming Server must be able to accommodate the total of the bandwidths of the individual streams and must be a clear and reliable connection. This is to ensure that problems commonly aasociated with streaming videos e. g Blocky, Blury and Jerky artifacts and completely eliminated or greatly minimised. 15

Video Streaming Stream n The Video Streaming Server is responsible for delivering compressed video to each individual request for a particular video stream. This is usually handled by one of the commercial streaming media software packages such as Real. Networks® Real. System™ or Microsoft® Windows Media™ Technologies. 16

Video Streaming Server n n The bandwidth connection to the Video Streaming Server must accommodate the total bandwidth of all the requests for a video stream As a result, the Video Streaming Server usually has a direct connection to a very high bandwidth line. – For example, if there were 100 requests for a video stream compressed at 28. 8 Kbps, the server would require at least a 3 Mbps connection. – Although, this is no longer the case with the invention if Adaptive Bitrate Streaming 17

Web access n The Web. Server for video streaming is in no way different from other Web Servers. The web site merely contains a URL link to the Video Streaming Server - one for every available video stream. Typically this is an icon on the web page to be selected. 18

Video player n n A Video Player application is required to decode the specific video stream received by the system requesting the stream over the Internet (or corporate Intranet). The most popular current video streaming applications are – Real. Networks® Real. System™ – Microsoft® Windows Media™ Technologies. 19

Video player n n Both of these require downloading a corresponding Video Player application such as Real. One™ Player or Windows Media™ Player; but both of these are free. There are other video streaming applications that are implemented in such a way as to include the player in the stream and no download is required. 20

Unicast v IP Multicast. n There are two key streaming delivery techniques: unicast and multicast. Unicast refers to networking in which computers establish two-way, point-to-point connections. Most networks operate in this fashion. . users request a file, and a server sends the file to those clients only. 21

Unicast n n When streaming multimedia over a network, the advantage of unicast is that the client computer can communicate with the computer supplying the multimedia stream. The disadvantage of unicast is that each client that connects to the server receives a separate stream, which rapidly uses up network bandwidth 22

Multicast n n IP Multicast refers to the networking technique in which one computer sends a single copy of the data over the network and many computers receive that data. Unlike a broadcast, routers can control where a multicast travels on the network. When streaming multimedia over the network, the advantage to multicasting is that only a single copy of the data is sent across the network, which preserves network bandwidth. The disadvantage to multicasting is that it is connectionless; clients have no control over the streams they receive. 23

Multicast n To use IP multicast on a network, the network routers must support the IP Multicast protocol. Most routers now handle multicast. 24

Capturing Moving Sequences n n Capturing video as a moving sequence is much more demanding as the amount of data generated can be high. There are three popular formats used when capturing video; – AVI, – MPEG – Motion-JPEG. 25

Capturing Moving Sequences n n Which format is used will depend upon several factors, such as – required quality; – image size; – length of sequence; – available storage capacity; – distribution media and cost. This can be very intensive, not only must the capture card be capable of capturing video at the required size, depth and frame rate, but the rest of the system must have sufficient CPU power and hard discs performance capable of storing this data. 26

AVI n n n In general, AVI files are good for very short sequences. They are cheap to produce and can be played by freely available software packages such as Microsoft's Windows Media™ Player or Real. Networks Real. One™ Player. However, if not checked, AVI sequences can very quickly swamp the available disk space as they usually contain uncompressed raw video and grow rapidly at several MBps. 27

Compression n n You can reduce the AVI file size by applying software compression; however, applying any compression requires that the Player must be able to de-compress the file. AVI files can be incorporated into slide presentations, used as video messages and sent as attachments in email, or used to create promotional and training videos for distribution on disc. 28

MPEG-2 n n MPEG-2 is the format to use for high quality videos that can be several hours long. It is the same format as used on DVD-Video and Digital TV. MPEG-2 requires hardware encoding to attain the high compression rates needed for instantaneous storage. Also, hardware decoding is required when playing the files. 29

VIDEO COMPRESSION Methodology and Applications

AGENDA 22/08/2017 ü OVERVIEW ü VIDEO SCHEME ü VIDEO COMPRESSION ü MPEG 31

1. OVERVIEW 22/08/2017 o A video comprises of a sequence of frames. Frame 1 Frame 2 Frame 3 Frame 4 o A video, of the duration of 1 second, generated by a TV camera usually contains 24 frames or 30 frames. o Each pixel in a frame is represented by three attributes (each 8 bits long) – One luminance attribute and two chrominance attributes. (i. e. YCb. Cr) {Y, Cb, Cr} Luminance (Y) : Describes the brightness of the pixel. Chrominance (Cb. Cr) : Describes the color of the pixel. Frame 32

22/08/2017 o An uncompressed video data is big in size. 720 Pixels For example. A single frame having the resolution of 720 X 480 (no. of pixels in each horizontal line is 720 and total no. of horizontal lines per frame is 480) will be described by 480 Lines {Y, Cb, Cr}, {Y, Cb, Cr}…. {Y, Cb, Cr} …………………………………………………………………………………. . . …………………………………………………………………………………. {Y, Cb, Cr}, {Y, Cb, Cr}…. {Y, Cb, Cr} Frame (720 X 480) 720 X 480 X 8 + 720 X 480 X 8 bits = 8294400 bits. ~ 8. 29 Mb. Or A complete video of 1 second will be described by (720 X 480 X 8 + 720 X 480 X 8) X 24 bits = 199065600 bits ~ 199 Mb. Thus, for the entire movie, the data would be too big to fit on DVDs or to transmit it using the bandwidth of available TV channels. 33

22/08/2017 2. VIDEO SCHEME Types of video schemes used for transmission - q Interlaced Video Scanning o In this, a frame is divided into two separate fields – Top Fields and Bottom fields. Frame Bottom Fields Top Fields Even numbered rows in a frame. Odd numbered rows in a frame. Field 1 Field 2 o The two successive fields (field 1 & field 2) are called a frame. o Both the fields are sent one after another and display puts them back together before displaying the full frame. o Quality degraded as sometimes the frames come out of sync. o It conserve the bandwidth. o Maximum frame rate is 60 frames/ second. 34

22/08/2017 q Progressive Video Scanning o In this, complete frame is sent to display. Frame o Bandwidth requirement is twice as compared to Interlaced video scanning. o Quality is good as frames come in sync and image is much sharper. o Maximum frame rate is 30 frames/ second. 35

22/08/2017 3. VIDEO COMPRESSION The concept of video compression lies on two main factors- o The data in frames is often redundant in space and time. For example. Spatial redundancy Time based redundancy In a frame, adjacent pixels are usually correlated. e. g. - The grass is green in the background of a frame. In a video, adjacent frames are usually correlated. e. g. - The green background is persisting frame after frame. Frame 1 Frame 2 Frame 3 Frame 4 o The human eye better resolve the brightness details than color details. So the way human eye works, it is also possible to delete some data from the frame with almost no noticeable degradation in image quality. 36

Spatial Redundancy n Take advantage of similarity among most neighboring pixels 37

Spatial Redundancy Reduction n n RGB to YUV – less information required for YUV (humans less sensitive to chrominance) Macro Blocks – Take groups of pixels (16 x 16) Discrete Cosine Transformation (DCT) – Based on Fourier analysis where you represent a signal as sum of sine's and cosine’s – Concentrates on higher-frequency values – Represent pixels in blocks with fewer numbers Quantization – Reduce data required for co-efficients Entropy coding – Compress 38

Spatial Redundancy Reduction “Intra-Frame Encoded” Quantization • major reduction • controls ‘quality’ Zig-Zag Scan, Run-length coding 39

Loss of Resolution Original (63 kb) Low (7 kb) Very Low (4 kb) 40

Temporal (Time-Based) Redundancy n Take advantage of similarity between successive frames 950 951 952 41

22/08/2017 4. MPEG stands for Motion Picture Experts Group established in 1988 as a working group within ISO/IEC that has defined standards for digital compression of audio & video signals. Such as- o MPEG-1 : It was the very first project of this group and published in 1993 as ISO/IEC 11172 standard. v MPEG-1 defines coding methods to compress the progressively scanned video. v Commonly used in CD-i and Video CD systems. v It supports coding bit rate of 1. 5 Mbit/s. o MPEG-2 : is an extension of MPEG-1, published in 1995 as ISO/IEC 13818 standard. v MPEG-2 defines coding methods to compress progressively scanned video as well as interlaced scanned video. v Commonly used in broadcast format, such as – Standard Definition TV (SDT) and High Definition TV (HDT). v It supports coding bit rate of 3 - 15 Mbit/s for SDT and 15 – 20 Mbit/s for HDT. o MPEG-4 : introduced in 1998 and still in development as ISO/IEC 14496 standard. v MPEG-2 defines object based coding methods for mixed media data and provides new features, such as – 3 D rendering, animation graphics, DRM, various types of interactivity etc. v Commonly used in web based streaming media, CD, videophone, DVB, etc. v It supports coding bit rate of few Kbit/s – tens of Mbit/s. 42

Traditional Video Streaming (Challenges)

Problems with Internet Video not accessible – Video Behind firewall – Plugins not available – Bandwidth not sufficient – Wrong and non-trust device – Wrong format n Low Quality of Experience – – n Long start-up latency Frequent rebuffering Low playback quality No lip-sync … 44

Mobile Video Streaming Challenges n n n Mobile Internet use is expanding dramatically Video traffic is growing exponentially Challenges: – Mobile users expect high quality video experience – Network operators need to offer quality experience affordably 45

Growth of Mobile Internet/Video Thomas Stockhammer, Qualcomm, “DASH – Design Principles and Standards , MMSys 2011 46

Adaptive Streaming An approach to tackling problems/challenges posed by bandwidth unpredictability

Adaptive Streaming Concept… n Adaptive Streaming technologies enable – Optimal streaming video viewing experience for diverse range of devices over broad set of connection speeds n Adaptive streaming technologies share – Production of multiple files from the same source file to distribute to viewers watching on different powered devices via different connection speeds – Distribution of files adaptively, changing stream that is delivered to adapt to changes in effective throughput and available CPU cycles on playback stations – Transparent operation to the user so that the viewer clicks one button and all streams switch/adapt behind the scenes. 48

Adaptive Streaming One Approach of Adaptive Streaming - Server sends first the high important video information (e. g. , I frames) And after the high importance video information is sent, lower importance video information follows (e. g. , P and B frames) if bandwidth and time allows Second Approach of Adaptive Streaming - Server sends with high quality part of the frame and only progressively , if bandwidth and time allow, it sends the rest of the frame information Source: http: //www. dicomdistribution. com/Adaptive%20 Streaming. html

Adaptive Streaming Cont… n n Third Approach of Adaptive Streaming - At server video is encoded in multiple bitrates and depending on the device bandwidth it adjusts at that rate Other approaches exist 50

Standardization History Thomas Stockhammer, Qualcomm, “DASH – Design Principles and Standards , Presentation at MMSys 2011

Adaptive HTTP Streaming System (Protocol) n Server – Can be standard web server – Media segment can be prepared in-line or off-line n Client – Sends series of HTTP GET segment requests and receives segments – Performs rate adaptation before sending a new GET segment request 52

Client-Centric Approach n n Client has best view of network conditions No session state in network – Redundancy – Scalability Faster innovation and experimentation But, relies on client for operational metrics – Only client knows what really happens 53

Adaptive Streaming in Practice Source: Watson, MMSys’ 11 54

Adaptive Streaming in Practice 55

Adaptive Live Streaming Workflow

Adaptive Live Streaming Workflow

Compressing Your Stream…

Transcoding your Stream

How Adaptive Works… n Adaptive Bitrate Streaming over HTTP which detects (in real-time) the bandwidth of the user and calibrates the video stream accordingly to always deliver the best possible picture quality as illustrated in the diagram below; 60

How Adaptive Works… 61

How Adaptive Works…

How Adaptive Works… 63

How Adaptive Works… 64

How Adaptive Works… 65

How Adaptive Works… Figure: Example Bitrate Adaptation in Pull-Based Adaptive Streaming 66

TRUE BENEFITS OF LIVE STREAMING

TRUE BENEFITS OF LIVE STREAMING 1. Live Streaming Internet Generate A Bigger Audience Video Could Any event has geographical and physical restrictions no matter where it is. Streaming events and content live on the web makes it accessible to a worldwide audience. This means attendance to your content can surpass any capacity limitations a physical event would have. 68

TRUE BENEFITS OF LIVE STREAMING 2. A Live Streamed Internet Video Gives Your Content Urgency If you are streaming content live for a one time only event, your stream becomes a rare and urgent entity. Online users take passive action towards content they can access on a regular basis, but if your stream is only available at one moment in time, its urgency can create quite a stir on the web. 69

TRUE BENEFITS OF LIVE STREAMING 3. Live Streaming Internet Video can Whip Up Online Interaction Live streams are a great way of boosting interaction between you and your potential clients. If your content is interesting to individuals in your niche or just a curious topic to outsiders, you will be given the opportunity to engage with prospective clients who previously may not have thought about contacting you. 70

TRUE BENEFITS OF LIVE STREAMING 4. A Live Streamed Internet Video Could Open Opportunities For New Revenue A Free live stream could allow you to interact with new (and current) clients and create new business opportunities, while you could also charge for access to your stream, which could bring in extra revenue. Don't forget that if your stream is of a physical event (NTA TV College training or conferences organised by the NTA), you would be able to charge both an admission fee for the physical attendees and another for online attendees. 71

TRUE BENEFITS OF LIVE STREAMING 5. Live Streaming Internet Video Could Make You Stand Out From The Crowd. Streaming live events and content could give your brand or business a fantastic point of differentiation. Live streamed events whether it's a Webinar, conference or just an informal tutorial chat are not something that is being used by many organizations. If you could take this innovative use of Internet video and steer it towards your organizations marketing aims, then you could really start to set yourself apart from the rest of the competition. 72

MONETIZING YOUR STREAM

MONETIZING YOUR STREAM v Do you know that you can get paid for streaming your videos on You. Tube? v Do you know that the publishers of many of the videos you watch on You. Tube (some are linked to Facebook accounts etc) earn money each time their videos are watched? v Do you know what impressions mean with regards to earning $$$$$ via You. Tube? n How much do You. Tubers make when each of their videos get 50 k, 100 k, 500 k, 1 m, and 1. 5 m views? 74

MONETIZING YOUR STREAM n n Cost per mille (CPM), also called cost % and cost per thousand (CPT) (in Latin mille means thousand) stands for cost per 1, 000 Impressions. CPM networks pays for every 1, 000 You. Tube ad impressions you get. Source: Cost per mille n n n If a CPM is $1 then it means that they’re paying you $1 for every 1, 000 advertisement impressions you generate. CPM could be $0. 1 or $10, it all depends on the niche you're using (video games, music, videos, educational, comedy, etc. . . ). You. Tube's CPM is reported to be on average 7. 6$, that means you get paid 7. 6$ for each 1, 000 views. 75

MONETIZING YOUR STREAM Let's do the math and calculate the average scenario of $1 CPM: n n n n 1, 000 views $1. 0 10, 000 views $10. 0 100, 000 views $100. 0 1, 000 views $1000. 0 10, 000 views $10, 000. 0 100, 000 views $100, 000. 0 1, 000, 000 views $1, 000. 0 76

MONETIZING YOUR STREAM Let's do the math in case you're lucky and you got a $7. 0 CPM: n n n n 1, 000 views $7. 0 10, 000 views $70. 0 100, 000 views $700. 0 1, 000 views $7000. 0 10, 000 views $70, 000. 0 100, 000 views $700, 000. 0 1, 000, 000 views $7, 000. 0 77

MONETIZING YOUR STREAM However, there are important points to consider: 1. Not all videos will show advertisements. Views does not equal ad impressions. Adsense selectively shows moderate advertisements to each user. sometimes there are no advertisers at all. 2. A huge number of users have ad-blocking extensions installed, that would disable the advertisement and the impression won't be count (but that's only on web browsers). 3. Half of You. Tube views come from mobile devices (Statistics - You. Tube). My guess is that most of them use the You. Tube app where you can't block advertisements. 78

MONETIZING YOUR STREAM Now, still skeptical? Here are different real life examples: 1. Psy - Gangnam Style. n Probably the TOP player on You. Tube, Back in 2013 when PSY had reached 1, 000, 000 views he made $7, 900, 000. 00, his CPM was $7. 9 which is great! Source: Google: Psy’s ‘Gangnam Style’ Has Earned $8 Million On You. Tube Alone 2. Disclaimer: Earned extra 1 B views when this picture was produced. That makes it 9 billion views. His net worth is being reported at being $20, 000 (as of January, 2017). That makes his CPM not bad too. 79

MONETIZING YOUR STREAM 80

MONETIZING YOUR STREAM The list is endless, You. Tube graduated a lot of millionaires mostly making junk videos. You can verify this online. Source: Pew. Die. Pie Net Worth 81

MONETIZING YOUR STREAM 82

MONETIZING YOUR STREAM PSY – Gangnam Style Best of Emmanuella Comedy 2, 936, 234, 091 views (as of 8 am today)/2012 10, 997, 116 views/2016 83

QUESTIONS 84

REFERENCES 1. http: //en. wikipedia. org/wiki/MPEG-2 2. http: //www. john-wiseman. com/technical/MPEG_tutorial. htm 3. http: //www. bretl. com/mpeghtml/MPEGindex. htm 4. Audio & Video Streaming-Supporting Student Skills Development: Wayne Britcliffe E-Learning Development Team, University of York. 5. Media Compression Techniques: Michael Moewe et Kaminow, 2004 6. Youtube 85

THE END… 86