MPEG 4 MPEG 4 2004227 http www chiariglione

MPEG 4概論 MPEG 4的原理與規格內容概述主講人：姜文揚 2004/2/27 “http: //www. chiariglione. org/mpeg/standards/mpeg-4/mpeg 4. htm”, MPEG 4

Outline ¡ ¡ ¡ MPEG 4的目標 MPEG 4重要定義 –「Media Object」實例說明MPEG 4物件概念、場景(scene)的運作方式和傳輸無關的MPEG 4重要功能(functions)

¡ ¡ ¡ MPEG 4的目標 MPEG 4重要定義 –「Media Object」實例說明MPEG 4物件概念、場景(scene)的運作方式和傳輸無關的MPEG 4重要功能(functions) 深入介紹MPEG

MPEG 4的目標為： ¡ 同時MPEG 4訂立了標準來達到上述目標： ¡ ¡ represent units of aural, visual or

MPEG 4重要定義 – 「Media Object」 ¡ 包含了下面這三大纇： Still images (e. g. as a fixed

深入介紹MPEG 4的function – Binary Format for Scene description （BIFS） ¡ Logical structure of a

Binary Format for Scene description （BIFS）做了哪些事？ ¡ How objects are grouped together ¡ How

比較：MPEG 2編碼流程圖 - DCT Q Entropy Encoding Invr. Q Motion Estimation Invr. DCT +

MPEG 4的Profiles ¡ Visual Profiles ¡ Audio Profiles ¡ Graphics Profiles ¡ Scene Graph

MPEG-4 File Format（目標） ¡ flexible, extensible format which facilitates interchange, management, editing, and presentation

MPEG-4 File Format（範例） ¡ The MP 4 file format is composed of object-oriented structures

MPEG 4的其他重要能力 1. 能對非矩形影像物 2. 3. 4. 5. 件進行編碼 Scalability Zerotree wavelet algorithm Wavelet

MPEG 4的其他重要能力 1. 能對非矩形影像物 ¡ Complexity scalability 件進行編碼 Scalability Zerotree wavelet algorithm Wavelet tiling

Slides: 44

Download presentation

MPEG 4概論 MPEG 4的原理與規格內容概述主講人：姜文揚 2004/2/27 “http: //www. chiariglione. org/mpeg/standards/mpeg-4/mpeg 4. htm”, MPEG 4 Forum

Outline ¡ ¡ ¡ MPEG 4的目標 MPEG 4重要定義 –「Media Object」實例說明MPEG 4物件概念、場景(scene)的運作方式和傳輸無關的MPEG 4重要功能(functions) 深入介紹MPEG 4的function – Binary Format for Scene description （BIFS） MPEG 4編碼流程圖 MPEG 4的Profiles MPEG-4 的File Format MPEG 4 System的傳輸 MPEG 4的其他重要能力 MPEG 4的版本關係 Summary - 重要觀念整理

¡ ¡ ¡ MPEG 4的目標 MPEG 4重要定義 –「Media Object」實例說明MPEG 4物件概念、場景(scene)的運作方式和傳輸無關的MPEG 4重要功能(functions) 深入介紹MPEG 4的function – Binary Format for Scene description （BIFS） MPEG 4編碼流程圖 MPEG 4的Profiles MPEG-4 的File Format MPEG 4 System的傳輸 MPEG 4的其他重要能力 MPEG 4的版本關係 Summary - 重要觀念整理

MPEG 4的目標為： ¡ 同時MPEG 4訂立了標準來達到上述目標： ¡ ¡ represent units of aural, visual or audiovisual content(稱作media objects) ¡ describe the composition of these objects to create compound media objects that form audiovisual scenes ¡ multiplex and synchronize the data associated with media objects ¡ interact with the audiovisual scene generated at the receiver’s end

MPEG 4重要定義 – 「Media Object」 ¡ 包含了下面這三大纇： Still images (e. g. as a fixed background) 2. Video objects (e. g. a talking person without the background) 3. Audio objects (e. g. the voice associated with that person, background music) 1.

深入介紹MPEG 4的function – Binary Format for Scene description （BIFS） ¡ Logical structure of a scene：

Binary Format for Scene description （BIFS）做了哪些事？ ¡ How objects are grouped together ¡ How objects are positioned in space and time ¡ Attribute Value Selection：Examples include the pitch of a sound, the color for a synthetic object, activation or deactivation of enhancement information for scaleable coding, etc. ¡ Other transforms on media objects：例如互動性

比較：MPEG 2編碼流程圖 - DCT Q Entropy Encoding Invr. Q Motion Estimation Invr. DCT + Motion Compensation Frame Mem. ¡ “Design of an MPEG-2 Codec”, Konstantinos Konstantinides, Cheng- Tie Chen, Ting-Chung Chen, Hown Cheng, and Fure-Ching Jeng

MPEG 4的Profiles ¡ Visual Profiles ¡ Audio Profiles ¡ Graphics Profiles ¡ Scene Graph Profiles ¡ MPEG-J Profiles ¡ Object Descriptor Profile

¡ Visual Profiles ¡ The Simple Visual Profile ¡ The Simple Scalable ¡ ¡ ¡ ¡ ¡ Visual Profile The Core Visual Profile The Main Visual Profile The N-Bit Visual Profile (其他的是用在合成影像上的Profiles) Audio Profiles Graphics Profiles Scene Graph Profiles MPEG-J Profiles Object Descriptor Profile

MPEG 4的Profiles ¡ Visual Profiles ¡ The Simple Visual Profile ¡ The Simple Scalable ¡ ¡ ¡ ¡ ¡ Visual Profile The Core Visual Profile The Main Visual Profile The N-Bit Visual Profile (其他的是用在合成影像上的Profiles) Audio Profiles Graphics Profiles Scene Graph Profiles MPEG-J Profiles Object Descriptor Profile ¡ provides efficient, error resilient coding of rectangular video objects, suitable for applications on mobile networks, such as PCS and IMT 2000.

MPEG 4的Profiles ¡ Visual Profiles ¡ The Simple Visual Profile ¡ The Simple Scalable ¡ ¡ ¡ ¡ ¡ Visual Profile The Core Visual Profile The Main Visual Profile The N-Bit Visual Profile (其他的是用在合成影像上的Profiles) Audio Profiles Graphics Profiles Scene Graph Profiles MPEG-J Profiles Object Descriptor Profile ¡ adds support for coding of temporal and spatial scalable objects to the Simple Visual Profile, It is useful for applications which provide services at more than one level of quality due to bit-rate or decoder resource limitations, such as Internet use and software decoding.

MPEG 4的Profiles ¡ Visual Profiles ¡ The Simple Visual Profile ¡ The Simple Scalable ¡ ¡ ¡ ¡ ¡ Visual Profile The Core Visual Profile The Main Visual Profile The N-Bit Visual Profile (其他的是用在合成影像上的Profiles) Audio Profiles Graphics Profiles Scene Graph Profiles MPEG-J Profiles Object Descriptor Profile ¡ adds support for coding of arbitraryshaped and temporally scalable objects to the Simple Visual Profile. It is useful for applications such as those providing relatively simple content-interactivity (Internet multimedia applications).

MPEG 4的Profiles ¡ Visual Profiles ¡ The Simple Visual Profile ¡ The Simple Scalable ¡ ¡ ¡ ¡ ¡ Visual Profile The Core Visual Profile The Main Visual Profile The N-Bit Visual Profile (其他的是用在合成影像上的Profiles) Audio Profiles Graphics Profiles Scene Graph Profiles MPEG-J Profiles Object Descriptor Profile ¡ adds support for coding of interlaced, semi-transparent, and sprite objects to the Core Visual Profile. It is useful for interactive and entertainmentquality broadcast and DVD applications.

MPEG 4的Profiles ¡ Visual Profiles ¡ The Simple Visual Profile ¡ The Simple Scalable ¡ ¡ ¡ ¡ ¡ Visual Profile The Core Visual Profile The Main Visual Profile The N-Bit Visual Profile (其他的是用在合成影像上的Profiles) Audio Profiles Graphics Profiles Scene Graph Profiles MPEG-J Profiles Object Descriptor Profile ¡ adds support for coding video objects having pixel-depths ranging from 4 to 12 bits to the Core Visual Profile. It is suitable for use in surveillance applications.

MPEG-4 File Format（目標） ¡ flexible, extensible format which facilitates interchange, management, editing, and presentation of the media

MPEG-4 File Format（範例） ¡ The MP 4 file format is composed of object-oriented structures called ‘atoms’ ¡ Most atoms describe a hierarchy of metadata giving information such as index points, durations, and pointers to the media data. The media data itself is located elsewhere; it can be in the MP 4 file, contained in one or more “mdat” or media data atoms, or located outside the MP 4 file and referenced via URLs.

MPEG 4的其他重要能力 1. 能對非矩形影像物 2. 3. 4. 5. 件進行編碼 Scalability Zerotree wavelet algorithm Wavelet tiling Error Robustness ¡ 8 bit transparency component ¡ Binary mask

MPEG 4的其他重要能力 1. 能對非矩形影像物 ¡ Complexity scalability 件進行編碼 Scalability Zerotree wavelet algorithm Wavelet tiling Error Robustness in the encoder ¡ Complexity scalability in the decoder ¡ Spatial scalability ¡ Temporal scalability ¡ Quality scalability ¡ Fine Grain Scalability (all of the above) 2. 3. 4. 5.

MPEG 4的其他重要能力 1. 能對非矩形影像物 2. 3. 4. 5. 件進行編碼 Scalability Zerotree wavelet algorithm Wavelet tiling Error Robustness ¡ 提供有效率的靜態圖像、材質壓縮 ¡ 11階層的quality scalability

MPEG 4的其他重要能力 1. 能對非矩形影像物 2. 3. 4. 5. 件進行編碼 Scalability Zerotree wavelet algorithm Wavelet tiling Error Robustness ¡ Performance test中的重要一環，測試時會在 MPEG 4測試檔案中加入使用千分之一的資料錯誤和10 ms的average length of burst errors