DECE Common Format Overview Jim Taylor CTO DECE

  • Slides: 18
Download presentation
DECE Common Format Overview Jim Taylor CTO, DECE 12‐Jun‐ 2016

DECE Common Format Overview Jim Taylor CTO, DECE 12‐Jun‐ 2016

Goals and Benefits of Common Format (CF) • Serve the entire industry (not just

Goals and Benefits of Common Format (CF) • Serve the entire industry (not just Ultra. Violet) • Build on existing standards – Define constraints (profiles) to simplify playback and device design • Establish industry interoperability targets and reduce supply chain fragmentation and cost – Issues • • Studio: multiple different mezzanine deliveries for different retailers Retailer: multiple different encodes and apps for different platforms Device: different encodes and apps from different retailers Consumer: different quality levels and apps from different retailers

Without CF – pretty colors, ugly reality Studio Mezz Mezz Studio Studio Mezz Mezz

Without CF – pretty colors, ugly reality Studio Mezz Mezz Studio Studio Mezz Mezz Mezz Dozens Mezz Retailer Retailer Retailer Retailer Retailer Player File App Player Mezz A few hundreds Up to hundreds 3

With CF – Nirvana Studio IMF SD CF Studio HD CF UHD CF Retailer

With CF – Nirvana Studio IMF SD CF Studio HD CF UHD CF Retailer Retailer Retailer Retailer Retailer Studio Dozens One/profile (plus one mezz) A few hundreds App App App App. App App Up to hundreds SD CF SD Player HD CF HD Player HD CF UHD Player One/profile 4

CF as Part of a Broad Ecosystem Retailers Library n o i t mp

CF as Part of a Broad Ecosystem Retailers Library n o i t mp ita g i D c to de e r de o c l, Common Streaming Dis Digital Bri Download (Late Binding) dge R SCSA DM CMP/CFF R NSM DM Physical Media Players Happy Users

CF in the Digital Supply Chain Specifications and best practices for delivering media and

CF in the Digital Supply Chain Specifications and best practices for delivering media and metadata from studios/service providers to retailers • • • EMA Avails for content offerings and terms Media Manifest and File Manifest for delivery IMF for mezzanine files CFF/CMP for standard download and streaming format Media Entertainment Core for standard metadata 6

Common Format Overview • Designed for adoption independent of Ultra. Violet – Structured as

Common Format Overview • Designed for adoption independent of Ultra. Violet – Structured as core specs with annexes defining profiles, delivery targets, etc. – Easy to add new profiles, codecs, etc. Glues together many standards and fills in gaps • Built to support end‐to‐end supply chain and consumer experience – – – – MPEG ISO BMFF, SMPTE Media Package Download, adaptive bit rate streaming (DASH), and packaged media delivery SD, HD, and UHD resolution AVC and HEVC video encoding High dynamic range (HDR), high frame rate (HFR), wide color gamut Multichannel audio (AAC, Dolby Digital, Dolby True. HD, DTS‐HD Master) Object‐oriented audio (Dolby Atmos, DTS: X, MPEG‐H 3 D Audio) SMPTE/W 3 C Timed Text subtitles (text and graphics) Localizable metadata (≈ EMA/DEG Media Entertainment Core; see http: //www. movielabs. com/md) Late binding (separate download of audio, and subtitle track files) Seamless clip sequence playback Simple interactivity MPEG Common Encryption (DRM interoperability) 7

DECE CF Specifications www. uvcentral. com/specs • Media Format [DMedia] – Video, audio, and

DECE CF Specifications www. uvcentral. com/specs • Media Format [DMedia] – Video, audio, and subtitle tracks – formats and constraints – Media profiles (video resolution, bit depth, color gamut, bitrate, etc. ) – Delivery targets for streaming, download and physical media • Media Package [DDMP] – Common Media Package (CMP) – CMP Fulfillment [DFulfill] • Common Streaming [DStream] – Additions and constraints for MPEG DASH or DASH‐IF • Common Player [DPlayer] – Common Download Player – Common Streaming Player – Experience Media Application Playback (simple interactivity) Related Movie. Labs Specifications Common Metadata Ratings Common Media Manifest Metadata • DECE Device [DDevice] – Ultra. Violet‐specific player • Keyset Delivery Format [DKey. Delivery] – Common encryption keyset delivery 8

CF Anatomy • Container – Holds movie and metadata – Based on ISO base

CF Anatomy • Container – Holds movie and metadata – Based on ISO base media file format standard – Collection of data structures called ‘boxes’ – (e. g. , ‘moof’ box holds a movie fragment, ‘meta’ box holds metadata) – Constrained to ease implementation and compliance testing – Defines trick play support • Codecs – Uses industry standard codecs, but constrains options to ease implementation and compliance testing • Profiles – Constraints on codecs to deliver a specific consumer experience (e. g. , HD download) – HD, SD, UHD • Package – Collects Containers into a single file – Allows Late Binding – Improves supply chain efficiency – Designed to support Interactivity

CFF Media Profiles SD HD 8 HD 10 x. HD m. UHD 8 m.

CFF Media Profiles SD HD 8 HD 10 x. HD m. UHD 8 m. UHD 10 h. UHD 10 m. HDR 10 h. HDR 10 DV HDR 12 854 x 800 resolution; 60 FPS; 8‐bit color with BT. 709 2 k resolution; 25 Mbps; 30‐ 60 FPS; 8‐bit color with BT. 709 2 k; 25 Mbps; ; 30‐ 60 FPS; 10‐bit color with BT. 709 2 k; 25 Mbps; 30‐ 60 FPS; 8‐bit color with BT. 709 4 k; 60 FPS; 40 Mbps; 10‐bit color with BT. 709 or BT. 2020 m. UHD 10 at 100 Mbps 4 K; 60 FPS; 40 Mbps; 10‐bit color with BT. 2020 and SMPTE‐ 2084 m. HDR 10 at 100 Mbps Dolby Vision 12‐bit dynamic range extension to 8‐bit and 10‐bit base layers [HD, x. HD, m. UHD, h. UHD, m. HDR 10 or h. HDR 10] with SMPTE‐ 2084 4 k; 12‐bit color with BT. 2020; 150 Mbps; MPEG Main 12 Profile; SMPTE‐ 2084 10

CF Metadata • Basic Metadata – Information about the work independent of encoding •

CF Metadata • Basic Metadata – Information about the work independent of encoding • Digital Asset Metadata – Information about individual encoded audio, video and subtitle streams, and other media • Uses Movie. Labs Common Metadata Spec – Same base as EMA/DEG Media Entertainment Core – Fully localizable using UTF‐ 8 – See http: //www. movielabs. com/md 11

Metadata Details • Basic Metadata – – – – Title. Display 60 Title. Sort

Metadata Details • Basic Metadata – – – – Title. Display 60 Title. Sort Summary 190/4000 Art. Reference (cover art) Genre Run. Length Release. Year Work. Type (movie, episode, supplement, music video, etc. ) Parent (episodes, seasons, supplements, etc. ) Aspect. Ratio Rating. Set (Common Ratings) People (cast & crew) Copyright. Line and more… • Digital Asset Metadata – – – – Description Codec, Format. Type Channels Bitrate. Average VBR Sample. Rate Sample. Bit. Depth MPEGProfile, MPEGLevel Aspect. Ratio, Pixel. Aspect Width. Pixels, Height. Pixels Frame. Rate Progressive Color. Encoding HDRPlayback. Info and more… 12

Subtitles • CF defined a formal subset of TTML V 1 Second Edition /

Subtitles • CF defined a formal subset of TTML V 1 Second Edition / SMPTE‐TT • A significant amount of work was done to improve interoperability: – Simplify requirements for decoders by removing non‐essential features – Clarify TTML requirements and adapt TTML into ISOBMFF media presentation scenarios – Define a guaranteed performance model – so subtitle presentation can be authored to a fixed performance target which players must support … fed into W 3 C TTML Profiles for Internet Media Subtitles and Captions 1. 0 (IMSC 1) • CFF Timed Text was designed to meet the FCC 708 minimum decoder requirements as defined in 79. 102 – SMPTE‐TT is designated FCC safe harbor technology for Internet delivered captions (see http: //uvcentral. com/page/cff‐tt‐and‐us‐fcc‐closed‐caption‐requirements)

Common Encryption • CF uses ISO/IEC 23001‐ 7: 2013 for Common Encryption (CENC) •

Common Encryption • CF uses ISO/IEC 23001‐ 7: 2013 for Common Encryption (CENC) • Provides a way to encrypt samples in ISOBMFF agnostic of content protection systems, enabling a single file to work across multiple DRMs • AES‐ 128 in Counter Mode (CTR) • NAL structured video is encrypted with subsample (partial sample) encryption – significant flexibility in decoder design and asset reuse – All other tracks use full sample encryption

CF Industry Adoption and Interoperability • MPEG – Standardized several technologies first specified by

CF Industry Adoption and Interoperability • MPEG – Standardized several technologies first specified by DECE in MPEG standards such as Common Encryption and additions to the ISO Base Media File Format and MPEG‐ 4 Part 30 Subtitle Tracks • W 3 C – Adopted DECE subtitle specifications in Internet Media Subtitle and Captions (IMSC 1) • BDA ‐ Adopted CFF and Common Media Package (CMP) for Blu‐ray Digital Bridge • SCSA (Vidity) ‐ Adopted CFF and CMP, and references the Common Player spec – All Samsung UHD TVs support CFF playback (through SCSA functionality) • Div. X/Neulion ‐ The Div. X Software Development Kit (SDK) and Certification Test Kit (CTK) version 8. 0 supports CF • APEX ‐ Adopting CFF for inflight‐entertainment, possibly defining new profiles • DASH Industry Forum – Specified interoperability points consistent with Common Format streaming http: //dashif. org/wp‐content/uploads/2015/04/DASH‐ IF‐IOP‐v 3. 0. pdf • DLNA, DVB, ETSI, EBU, Hbb. TV, DTG, ATSC, ARIB, 3 GPP, BDA, Cable RDK – Specified CFF compatible media formats for streaming, storage, or broadcast • IE, Edge, Safari, Opera, Firefox, and Chrome browsers – All decode the streaming and file format across platforms, with the ability to access different native DRMs for strong content protection • Supported by native players in Android, Windows 10, consoles, sticks such as Chromecast, players such as Flash, JW, VLC, cast. Labs, Azure Media Player, Akamai, DASH. js, etc. 15

Maturity • CFF content, CFF Verifier, and CFF players have been in testing for

Maturity • CFF content, CFF Verifier, and CFF players have been in testing for several years with multiple different companies and implementations involved • ~100 sample files exist for verification • 1000 s of files for commercial titles were created by Hollywood studios • The CFF Verifier has ~750 different conformance tests, with >30 versions released (and >200 total bug fixes) • Many specification clarifications were made based on the above

Summary • CF is a mature, well‐tested format that brings many standards together into

Summary • CF is a mature, well‐tested format that brings many standards together into a practical, end‐to‐ end solution • The public specifications may be referenced or adopted by anyone – New profiles can be added directly to the CF specs or can reference CF

Q&A

Q&A