CS 414 Multimedia Systems Design Lecture 9 JPEG

CS 414 – Multimedia Systems Design Lecture 9 – JPEG 2000 Compression (Part 4) Klara Nahrstedt Spring 2012 CS 414 - Spring 2012

Administrative MP 1 posted n SVNs for each group installed!!! n CS 414 - Spring 2012

Today’s Discussed Topic n JPEG-2000 Compression n Reading: Section 7. 5 in Media Coding book, Steinmetz&Nahrstedt, and http: //en. wikipedia. org/wiki/JPEG_2000 and links in slides CS 414 - Spring 2012

JPEG Steps Review n Image Preparation Components Separation ¨ Block Division (8 x 8 Blocks) of each Component ¨ n Image Processing Pixel Value Shifting ¨ 2 D DCT Transformation ¨ Creation of DC and AC Coefficients ¨ n Quantization Tables Entropy Coding Zig-Zag Ordering ¨ DC Coefficients – Differential Coding ¨ AC Coding - RLE & Huffman Coding ¨ CS 414 - Spring 2012

JPEG-2000 Original (uncompressed TIF 116 KB) JPEG (8: 1, 14 KB) JPEG-2000 (8: 1, 14 KB) http: //www. photographical. net/jpeg 2000. html CS 414 - Spring 2012

JPEG-2000 Created in 2000 by JPEG committee n File extension: n ¨ jp 2 for ISO/IEC 15444 -1 conforming files ¨ image/jp 2 for MIME type CS 414 - Spring 2012

JPEG-2000 Features n Low bit rate compression performance ¨ Current standards offer excellent ratedistortion performance in mid and high bit rates ¨ Low bit rate distortions become unacceptable n Lossless and lossy compression ¨ Current standard does not provide superior lossless and lossy compression in a single code-stream CS 414 - Spring 2012

JPEG-2000 Features n Large Images ¨ Current standard does not allow for images larger than 64 Kx 64 K pixels without quality degradation n Single decompression architecture ¨ Current standard has 44 modes (application specific, and not used by majority JPEG coders) ¨ Single common decompression architecture can provide greater interchange between applications CS 414 - Spring 2012

JPEG-2000 Features n Transmission in noisy environment ¨ Current standard has provision for restart intervals, but image degrades badly when bit errors occur. n Computer generated imagery (Graphics) ¨ Current n standard is optimized only for natural imagery Compound documents ¨ Current standard is not applied to compound documents because of its poor performance when applied to text imagery CS 414 - Spring 2012

JPEG-2000 Features n Superior low bit rate performance ¨ Below 0. 25 bits per pixel for highly detailed grey-scale images CS 414 - Spring 2012

JPEG-2000 Features n Lossless and lossy compression ¨ Lossless compression uses progressive decoding (i. e. , difference image encoding) for medical imaging n Progressive transmission by pixel accuracy and resolution ¨ Reconstruction of images is possible with different resolutions and pixel accuracy for different target devices CS 414 - Spring 2012

JPEG-2000 Features n Random code-stream access and processing ¨ Needed in case images have parts that are more important than others ¨ User defines “regions-of-interest” in the image to be randomly accessed and/or decompressed with less distortion than the rest of images ¨ random code-stream processing allows operations: rotation, translation, filtering, feature extraction, scaling, … CS 414 - Spring 2012

Methods of Compression n DCT-based coder ¨ New baseline JPEG algorithm required for backward compatibility with existing JPEG n Wavelet-based coder ¨ This method permits coding of still images with high coding efficiency as well as spatial and SNR (signal-to-noise ratio) scalability at fine granularity (see also tutorial – part 1/part 2/part 3 http: //users. rowan. edu/~polikar/WAVELETS/WTpart 1. html) CS 414 - Spring 2012

Color Component Transformation n JPEG-2000: transformation from RGB to YCBCR or YUV ¨ Irreversible n uses the well known YCBCR color space. It is called "irreversible" because it has to be implemented in floating or fix-point and causes round-off errors. ¨ Reversible n Color Transform: uses a modified YUV color space that does not introduce quantization errors, so it is fully reversible. CS 414 - Spring 2012

Wavelet Transform n n DWT (Discrete Wavelet Transform) extracts information from the source image at different scales, locations and orientations JPEG-2000 uses two techniques in wavelet-based coder 2 D wavelets ¨ multi-scale transforms ¨ n n Wavelet is defined as a set of basic functions, derived from the same prototype function Prototype function is known as “mother wavelet” ¨ Examples: “Mexican Hat” wavelet, Haar wavelet CS 414 - Spring 2012

Continuous Wavelet Transform In one dimension, (time domain) (frequency domain) s – scale parameter, b – location parameter, ψ (x) – analyzing wavelet, cwt – wavelet coefficient In two dimension, (time domain) (frequency domain) We want to calculate 2 D CWT in frequency domain When scale s is fixed, CS 414 - Spring 2012

1 D/2 D Mexican Hat ‘analyzing wavelet’ Time domain 1 0 -0. 5 -3 CS 414 - Spring 2012 0 3

2 D Mexican Hat ‘analyzing wavelet’ Time domain Frequency domain CS 414 - Spring 2012

Example of artifacts produced by wavelet transform (for different scale parameters) CS 414 - Spring 2012

Wavelet Transform Properties n Wavelet transform coders process high and low frequency parts of image independently ¨ DCT methods have difficulties with highfrequency information n Wavelet method transforms image as a whole (not subdivided into pixel blocks) ¨ No blocking artifacts occur ¨ Wavelet coders degrade gracefully CS 414 - Spring 2012

Forward Wavelet Transform - Image is first filtered along the x dimension, resulting in lowpass and high-pass image - Since bandwidth of both low pass and high pass image is now half that of the original image, both filtered images can be down-sampled by factor 2 without loss of information - Then both filtered images are again filtered and downsampled along the y dimension resulting in four sub-images CS 414 - Spring 2012

Wavelet Transform CS 414 - Spring 2012

Wavelet Transform (1) CS 414 - Spring 2012

Wavelet Transform (2) CS 414 - Spring 2012

JPEG-2000 Resolution Scalability Source: http: //www. ee. unsw. edu. au/~taubman/seminars_files/IEEE_IEA_J 2 K. pdf CS 414 - Spring 2012

JPEG-2000 Scalability n Scalable in both SNR and resolution More bits CS 414 - Spring 2012

JPEG-2000 Scalability CS 414 - Spring 2012

JPEG-2000 Scalability CS 414 - Spring 2012

JPEG-2000 Performance Gain up to about 20% compression performance to the first JPEG standard n Applications of JPEG-2000 n ¨ Large images ¨ Images with low-contrast edges (e. g. , medical images ¨ In printers, scanners, facsimile ¨ HD satellite images CS 414 - Spring 2012

Applications of Motion JPEG 2000 Leading digital film standard n Supported by Digital Cinema Initiatives for storage, distribution and exhibition of motion pictures n Considered by Library of Congress to be the digital archival format n CS 414 - Spring 2012

Conclusion - Artifacts of JPEG-2000 Compression • Compression 1/20 size is without incurring visible artifacts • If artifacts occur they can be seen as Smoothing rather than squares or mosquito noise CS 414 - Spring 2012

Available Software Implementation CS 414 - Spring 2012

Available Hardware Implementation CS 414 - Spring 2012

Lytro Camera Lytro start-up company n Technology allows a picture’s focus to be adjusted after it is taken. n Lytro’s founder – Ren Ng n Lytro camera captures far more light data, from many angles than it is possible with conventional camera n ¨ It accomplishes it with a special sensor called a microlens array, which puts the equivalent of many lenses into a small space CS 414 - Spring 2012