INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION

INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO N 18975 ISO/IEC JTC 1/SC 29/WG 11 Brussels, BE – January 2020 Source: Title: Status: Requirements Presentation of MPEG Standardisation Roadmap Approved, Public

MPEG Standardisation Roadmap January 2020

Why a Standardisation Roadmap? • MPEG has created, and is still producing, media standards that enable huge markets to flourish • MPEG works on requirements from industry • Many industries represented in MPEG, but not all of MPEG’s customers can or need to participate in the process • MPEG wants to inform its customers about its long-term plans (~ 5 years out) • … and collect feedback and requirements from these customers • Comments on the roadmap are always welcome

What is in the Roadmap • Our roadmap is a short document. • It briefly outlines MPEG’s most important standards

Major MPEG Standards 1990 1995 Digital Television Internet Audio MP 3 2000 2005 MPEG-2 Video & Systems MPEG-4 Video UHD & Immersive Services HD Distribution AAC 2020 2015 Custom Fonts on Web & Digi. Pub Music Distribution Mobile Video 2010 AVC MP 4 FF Media Storage and Streaming OFF HEVC DASH 3 D Audio MMT New Forms of Digital Television Unified Media Streaming CMAF

What is in the Roadmap • Our roadmap is a short document. • It briefly outlines MPEG’s most important standards • … it then gives an overview of MPEG’s activities

MPEG’s Areas of Activity Compression of media, genomes and neural networks Technologies for content e-commerce MPEG-A Multimedia Platform Technologies MPEGB, DASH Io. MT MPEGE, M Device & application interfaces MPEG-21 MPEG 1, 2, 4, C, D G, H, I MPEGU, V MPEG-7 Description of video, audio and multimedia for content search ication l p p A edia m i t l ations u n i M b m ts (co a m r o mats) r F o f t n e of cont s& m e t Sys sport tran

What is in the Roadmap • Our roadmap is a short document. • It briefly outlines MPEG’s most important standards • … it then gives an overview of MPEG’s activities • … and then an overview of all MPEG’s standards

More Detailed Overview of MPEG Standards 1990 Audio Video MP 1 L 2 2000 1995 MP 3 2005 AAC 2010 Surround 2015 USAC 3 D Audio SAOC Video SP AVC 2020 DRC HEVC Video MIAF BIFS Graphics OFF AFX ARAF IVC MORE Systems CENC MDS Mediarelated MPEG-V DID PS/TS MP 4 FF CEL/MCO MPEG DASH UD TT MMT Colour coding CDVS MPEG-1 MPEG-2 MPEG-4 MPEG-7 MPEG-21 MPEG-A MPEG-B MPEG-V MPEG-D MPEG-H OMAF CMAF MPEG-I All acronyms are explained in the companion document to this presentation

Significant Developments Shape MPEG’s Roadmap • The relentless increase of IP-distributed and Mobile media • Higher quality media • More immersion (UHD, VR, AR) • The Internet of Media Things & Wearables • Cloud-based media processing, storage and delivery • New, high-speed networks including fibre and 5 G mobile

5 -Year Planning

Jan 2020 Genome Compression 2021 2022 2023 Jan 2025 Beyond Media Genome Compression v. 2 Genome Annotation Compression Neural Network Compression for Multimedia Colour Support in Open Font Format Essential Video Coding (MPEG-5) 2024 Video Coding for Machines VCM v. 2 Low Complexity Enhancement Video Versatile Video Coding 6 Do. F Video Extensions 3 Do. F+ Video (MPEG Immersive Video) Video Point Cloud Compression (V-PCC) Dynamic Mesh Compression Geometry PCC v. 2 Geometry Point Cloud Compression (G-PCC) 6 Do. F Audio Scene Description Media Coding Scene Description v. 2 Video Decoding Interface PCC Systems Support OMAF v. 2 Network-Based Media Processing CMAF v. 2 Partial File Format v. 2 OMAF v. 3 NBMP v. 2 Systems and Tools

MPEG-I (ISO/IEC 23090) Coded Representation of Immersive Media Parts: 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. 13. 14. Architectures for Immersive Media (Technical Report) Omnidirectional Medi. A Format (OMAF) Versatile Video Coding Immersive Audio Video-based Point Cloud Compression (V-PCC) Metrics for Immersive Services and Applications Metadata for Immersive Services and Applications Network-Based Media Processing Geometry-based Point Cloud Compression (G-PCC) Carriage of Video Point Cloud Data Implementation Guidelines for Network-based Media Processing MPEG Immersive Video (working title) Video Decoding Interface for Immersive Media MPEG-I Scene Descriptions

Versatile Video Codec – Timeline (MPEG-I part 3) Collection of test material Final Call for Evidence Assessment of Cf. E responses Final Call for Proposals Subjective tests Working Draft Committee Draft Delivery of standard (Final Draft International Standard) Jan 2017 Apr 2017 Jul 2017 Oct 2017 Apr 2018 Jul 2019 Jul 2020

Jan 2020 2021 2022 2023 2024 Jan 2025 MPEG-I Phase 2 a MPEG Media for 6 Do. F Versatile Video Coding 3 Do. F+ Video (MPEG Immersive Video) Media Coding Video Point Cloud Compression (V-PCC) Geometry Point Cloud Compression (G-PCC) Scene Description Video Decoding Interface PCC Systems Support OMAF v. 2 Network-Based Media Processing OMAF v. 3 NBMP v. 2 Systems and Tools

Jan 2020 2021 2022 2023 2024 Jan 2025 MPEG-I Phase 2 b (tentative) Versatile Video Coding 6 Do. F Video Extensions 3 Do. F+ Video (MPEG Immersive Video) Video Point Cloud Compression (V-PCC) Dynamic Mesh Compression Geometry PCC v. 2 Geometry Point Cloud Compression (G-PCC) 6 Do. F Audio Scene Description Media Coding Scene Description v. 2 Video Decoding Interface PCC Systems Support OMAF v. 2 Network-Based Media Processing OMAF v. 3 NBMP v. 2 Systems and Tools

• Viewport-Adaptive Streaming • Benefits greatly from fast edge response times • OMAF v. 2 • Immersive Media Access and Delivery • Finer granularity access for huge media data volumes • Partial retrieval of partially visible and audible scenes • Fast network responses for immersive and interactive media • Partial (“split”) or Complete Edge Rendering • Do heavy lifting in network, save on processing in mobile devices • Allowing very sophistated media to be consumed with reasonable device power use • Mixing immersive feeds for real-time communication • Network-Based Media Processing • Using the network and the edge to support media processing • Network-based, last-second media personalization • IOT • Internet of Media Things

Jan 2020 2021 2022 2023 2024 Jan 2025 Media Coding & Systems for 5 G Video Coding for Machines VCM v. 2 Versatile Video Coding 6 Do. F Video Extensions 3 Do. F+ Video (MPEG Immersive Video) Dynamic Mesh Compression Video Point Cloud Compression (V-PCC) Geometry PCC v. 2 Geometry Point Cloud Compression (G-PCC) 6 Do. F Audio Scene Description Media Coding Scene Description v. 2 Video Decoding Interface PCC Systems Support OMAF v. 2 Network-Based Media Processing Internet of Media Things OMAF v. 3 NBMP v. 2 Systems and Tools