Lecture 2 Intensity Transformation and Spatial Filtering Spatial

  • Slides: 97
Download presentation
Lecture 2. Intensity Transformation and Spatial Filtering

Lecture 2. Intensity Transformation and Spatial Filtering

Spatial Domain vs. Transform Domain ► Spatial domain image plane itself, directly process the

Spatial Domain vs. Transform Domain ► Spatial domain image plane itself, directly process the intensity values of the image plane ► Transform domain process the transform coefficients, not directly process the intensity values of the image plane 2/23/2021 2

Spatial Domain Process 2/23/2021 3

Spatial Domain Process 2/23/2021 3

Spatial Domain Process 2/23/2021 4

Spatial Domain Process 2/23/2021 4

Spatial Domain Process 2/23/2021 5

Spatial Domain Process 2/23/2021 5

Some Basic Intensity Transformation Functions 2/23/2021 6

Some Basic Intensity Transformation Functions 2/23/2021 6

Image Negatives 2/23/2021 7

Image Negatives 2/23/2021 7

Example: Image Negatives Small lesion 2/23/2021 8

Example: Image Negatives Small lesion 2/23/2021 8

Log Transformations 2/23/2021 9

Log Transformations 2/23/2021 9

Example: Log Transformations 2/23/2021 10

Example: Log Transformations 2/23/2021 10

Power-Law (Gamma) Transformations 2/23/2021 11

Power-Law (Gamma) Transformations 2/23/2021 11

Example: Gamma Transformations 2/23/2021 12

Example: Gamma Transformations 2/23/2021 12

Example: Gamma Transformations Cathode ray tube (CRT) devices have an intensity-to-voltage response that is

Example: Gamma Transformations Cathode ray tube (CRT) devices have an intensity-to-voltage response that is a power function, with exponents varying from approximately 1. 8 to 2. 5 2/23/2021 13

Example: Gamma Transformations 2/23/2021 14

Example: Gamma Transformations 2/23/2021 14

Example: Gamma Transformations 2/23/2021 15

Example: Gamma Transformations 2/23/2021 15

Piecewise-Linear Transformations ► Contrast Stretching — Expands the range of intensity levels in an

Piecewise-Linear Transformations ► Contrast Stretching — Expands the range of intensity levels in an image so that it spans the full intensity range of the recording medium or display device. ► Intensity-level Slicing — Highlighting a specific range of intensities in an image often is of interest. 2/23/2021 16

2/23/2021 17

2/23/2021 17

Highlight the major blood vessels and study the shape of the flow of the

Highlight the major blood vessels and study the shape of the flow of the contrast medium (to detect blockages, etc. ) 2/23/2021 Measuring the actual flow of the contrast medium as a function of time in a series of images 18

Bit-plane Slicing 2/23/2021 19

Bit-plane Slicing 2/23/2021 19

Bit-plane Slicing 2/23/2021 20

Bit-plane Slicing 2/23/2021 20

Bit-plane Slicing 2/23/2021 21

Bit-plane Slicing 2/23/2021 21

Histogram Processing ► Histogram Equalization ► Histogram Matching ► Local Histogram Processing ► Using

Histogram Processing ► Histogram Equalization ► Histogram Matching ► Local Histogram Processing ► Using Histogram Statistics for Image Enhancement 2/23/2021 22

Histogram Processing 2/23/2021 23

Histogram Processing 2/23/2021 23

2/23/2021 24

2/23/2021 24

Histogram Equalization 2/23/2021 25

Histogram Equalization 2/23/2021 25

Histogram Equalization 2/23/2021 26

Histogram Equalization 2/23/2021 26

Histogram Equalization 2/23/2021 27

Histogram Equalization 2/23/2021 27

Histogram Equalization 2/23/2021 28

Histogram Equalization 2/23/2021 28

Example 2/23/2021 29

Example 2/23/2021 29

Example 2/23/2021 30

Example 2/23/2021 30

Histogram Equalization 2/23/2021 31

Histogram Equalization 2/23/2021 31

Example: Histogram Equalization Suppose that a 3 -bit image (L=8) of size 64 ×

Example: Histogram Equalization Suppose that a 3 -bit image (L=8) of size 64 × 64 pixels (MN = 4096) has the intensity distribution shown in following table. Get the histogram equalization transformation function and give the ps(sk) for each sk. 2/23/2021 32

Example: Histogram Equalization 2/23/2021 33

Example: Histogram Equalization 2/23/2021 33

Example: Histogram Equalization 2/23/2021 34

Example: Histogram Equalization 2/23/2021 34

2/23/2021 35

2/23/2021 35

2/23/2021 36

2/23/2021 36

Figure 3. 22 (a) Image from Phoenix Lander. (b) Result of histogram equalization. (c)

Figure 3. 22 (a) Image from Phoenix Lander. (b) Result of histogram equalization. (c) Histogram of image (a). (d) Histogram of image (b). (Original image courtesy of NASA. )

Question Is histogram equalization always good? No 2/23/2021 38

Question Is histogram equalization always good? No 2/23/2021 38

Histogram Matching Histogram matching (histogram specification) — generate a processed image that has a

Histogram Matching Histogram matching (histogram specification) — generate a processed image that has a specified histogram 2/23/2021 39

Histogram Matching 2/23/2021 40

Histogram Matching 2/23/2021 40

Histogram Matching: Procedure ► Obtain pr(r) from the input image and then obtain the

Histogram Matching: Procedure ► Obtain pr(r) from the input image and then obtain the values of s ► Use the specified PDF and obtain the transformation function G(z) ► Mapping from s to z 2/23/2021 41

Histogram Matching: Example Assuming continuous intensity values, suppose that an image has the intensity

Histogram Matching: Example Assuming continuous intensity values, suppose that an image has the intensity PDF Find the transformation function that will produce an image whose intensity PDF is 2/23/2021 42

Histogram Matching: Example Find the histogram equalization transformation for the input image Find the

Histogram Matching: Example Find the histogram equalization transformation for the input image Find the histogram equalization transformation for the specified histogram The transformation function 2/23/2021 43

Histogram Matching: Discrete Cases ► Obtain pr(rj) from the input image and then obtain

Histogram Matching: Discrete Cases ► Obtain pr(rj) from the input image and then obtain the values of sk, round the value to the integer range [0, L-1]. ► Use the specified PDF and obtain the transformation function G(zq), round the value to the integer range [0, L-1]. ► Mapping from sk to zq 2/23/2021 44

Example: Histogram Matching Suppose that a 3 -bit image (L=8) of size 64 ×

Example: Histogram Matching Suppose that a 3 -bit image (L=8) of size 64 × 64 pixels (MN = 4096) has the intensity distribution shown in the following table (on the left). Get the histogram transformation function and make the output image with the specified histogram, listed in the table on the right. 2/23/2021 45

Example: Histogram Matching Obtain the scaled histogram-equalized values, Compute all the values of the

Example: Histogram Matching Obtain the scaled histogram-equalized values, Compute all the values of the transformation function G, 2/23/2021 46

Example: Histogram Matching 2/23/2021 47

Example: Histogram Matching 2/23/2021 47

Example: Histogram Matching Obtain the scaled histogram-equalized values, Compute all the values of the

Example: Histogram Matching Obtain the scaled histogram-equalized values, Compute all the values of the transformation function G, s 0 s 2 s 1 s 3 s 4 s 5 s 6 s 7 2/23/2021 48

Example: Histogram Matching 2/23/2021 49

Example: Histogram Matching 2/23/2021 49

Example: Histogram Matching 2/23/2021 50

Example: Histogram Matching 2/23/2021 50

Example: Histogram Matching 2/23/2021 51

Example: Histogram Matching 2/23/2021 51

Example: Histogram Matching 2/23/2021 52

Example: Histogram Matching 2/23/2021 52

Example: Histogram Matching 2/23/2021 53

Example: Histogram Matching 2/23/2021 53

Example: Histogram Matching 2/23/2021 54

Example: Histogram Matching 2/23/2021 54

Figure 3. 24 (a) An image, and (b) its histogram.

Figure 3. 24 (a) An image, and (b) its histogram.

Figure 3. 25 (a) Histogram equalization transformation obtained using the histogram in Fig. 3.

Figure 3. 25 (a) Histogram equalization transformation obtained using the histogram in Fig. 3. 24(b). (b) Histogram equalized image. (c) Histogram of equalized image.

Figure 3. 26 Histogram specification. (a) Specified histogram. (b) Transformation labeled (1), labeled (2).

Figure 3. 26 Histogram specification. (a) Specified histogram. (b) Transformation labeled (1), labeled (2). (c) Result of histogram specification. (d) and Histogram of image (c).

Local Histogram Processing Define a neighborhood and move its center from pixel to pixel

Local Histogram Processing Define a neighborhood and move its center from pixel to pixel At each location, the histogram of the points in the neighborhood is computed. Either histogram equalization or histogram specification transformation function is obtained Map the intensity of the pixel centered in the neighborhood Move to the next location and repeat the procedure 2/23/2021 58

Local Histogram Processing: Example 2/23/2021 59

Local Histogram Processing: Example 2/23/2021 59

Figure 3. 33 (a) Original image. (b) Result of local enhancement based on local

Figure 3. 33 (a) Original image. (b) Result of local enhancement based on local histogram statistics. Compare (b) with Fig. 3. 32(c).

Using Histogram Statistics for Image Enhancement Average Intensity Variance 2/23/2021 61

Using Histogram Statistics for Image Enhancement Average Intensity Variance 2/23/2021 61

Using Histogram Statistics for Image Enhancement 2/23/2021 62

Using Histogram Statistics for Image Enhancement 2/23/2021 62

Using Histogram Statistics for Image Enhancement: Example 2/23/2021 63

Using Histogram Statistics for Image Enhancement: Example 2/23/2021 63

Spatial Filtering A spatial filter consists of (a) a neighborhood, and (b) a predefined

Spatial Filtering A spatial filter consists of (a) a neighborhood, and (b) a predefined operation Linear spatial filtering of an image of size Mx. N with a filter of size mxn is given by the expression 2/23/2021 64

Spatial Filtering 2/23/2021 65

Spatial Filtering 2/23/2021 65

Spatial Correlation 2/23/2021 66

Spatial Correlation 2/23/2021 66

Spatial Convolution 2/23/2021 67

Spatial Convolution 2/23/2021 67

Figure 3. 35 Illustration of 1 -D correlation and convolution of a kernel, w,

Figure 3. 35 Illustration of 1 -D correlation and convolution of a kernel, w, with a function f consisting of a discrete unit impulse. Note that correlation and convolution are functions of the variable x, which acts to displace one function with respect to the other. For the extended correlation and convolution results, the starting configuration places the rightmost element of the kernel to be coincident with the origin of f. Additional padding must be used.

2/23/2021 69

2/23/2021 69

Figure 3. 58 Transfer functions of ideal 1 -D filters in the frequency domain

Figure 3. 58 Transfer functions of ideal 1 -D filters in the frequency domain (u denotes frequency). (a) Lowpass filter. (b) Highpass filter. (c) Bandreject filter. (d) Bandpass filter. (As before, we show only positive frequencies for simplicity. )

Table 3. 7 Summary of the four principal spatial filter types expressed in terms

Table 3. 7 Summary of the four principal spatial filter types expressed in terms of lowpass filters. The centers of the unit impulse and the filter kernels coincide.

Smoothing Spatial Filters Smoothing filters are used for blurring and for noise reduction Blurring

Smoothing Spatial Filters Smoothing filters are used for blurring and for noise reduction Blurring is used in removal of small details and bridging of small gaps in lines or curves Smoothing spatial filters include linear filters and nonlinear filters. 2/23/2021 72

Spatial Smoothing Linear Filters 2/23/2021 73

Spatial Smoothing Linear Filters 2/23/2021 73

Two Smoothing Averaging Filter Masks 2/23/2021 74

Two Smoothing Averaging Filter Masks 2/23/2021 74

2/23/2021 75

2/23/2021 75

Example: Gross Representation of Objects 2/23/2021 76

Example: Gross Representation of Objects 2/23/2021 76

Order-statistic (Nonlinear) Filters — Nonlinear — Based on ordering (ranking) the pixels contained in

Order-statistic (Nonlinear) Filters — Nonlinear — Based on ordering (ranking) the pixels contained in the filter mask — Replacing the value of the center pixel with the value determined by the ranking result E. g. , median filter, max filter, min filter 2/23/2021 77

Example: Use of Median Filtering for Noise Reduction 2/23/2021 78

Example: Use of Median Filtering for Noise Reduction 2/23/2021 78

Sharpening Spatial Filters ► Foundation ► Laplacian Operator ► Unsharp Masking and Highboost Filtering

Sharpening Spatial Filters ► Foundation ► Laplacian Operator ► Unsharp Masking and Highboost Filtering ► 2/23/2021 Using First-Order Derivatives for Nonlinear Image Sharpening — The Gradient 79

Sharpening Spatial Filters: Foundation ► The first-order derivative of a one-dimensional function f(x) is

Sharpening Spatial Filters: Foundation ► The first-order derivative of a one-dimensional function f(x) is the difference ► The second-order derivative of f(x) as the difference 2/23/2021 80

2/23/2021 81

2/23/2021 81

Sharpening Spatial Filters: Laplace Operator The second-order isotropic derivative operator is the Laplacian for

Sharpening Spatial Filters: Laplace Operator The second-order isotropic derivative operator is the Laplacian for a function (image) f(x, y) 2/23/2021 82

Sharpening Spatial Filters: Laplace Operator 2/23/2021 83

Sharpening Spatial Filters: Laplace Operator 2/23/2021 83

Sharpening Spatial Filters: Laplace Operator Image sharpening in the way of using the Laplacian:

Sharpening Spatial Filters: Laplace Operator Image sharpening in the way of using the Laplacian: 2/23/2021 84

2/23/2021 85

2/23/2021 85

Unsharp Masking and Highboost Filtering ► Unsharp masking Sharpen images consists of subtracting an

Unsharp Masking and Highboost Filtering ► Unsharp masking Sharpen images consists of subtracting an unsharp (smoothed) version of an image from the original image e. g. , printing and publishing industry ► Steps 1. Blur the original image 2. Subtract the blurred image from the original 3. Add the mask to the original 2/23/2021 86

Unsharp Masking and Highboost Filtering 2/23/2021 87

Unsharp Masking and Highboost Filtering 2/23/2021 87

Unsharp Masking: Demo 2/23/2021 88

Unsharp Masking: Demo 2/23/2021 88

Figure 3. 55 (a) Unretouched “soft-tone” digital image of size (b) Image blurred using

Figure 3. 55 (a) Unretouched “soft-tone” digital image of size (b) Image blurred using a Gaussian lowpass filter with σ = 5. (c) Mask. (d) Result of unsharp masking using Eq. (3 -65) with k = 1. (e) and (f) Results of highboost filtering with k = 2 and k = 3, respectively.

Unsharp Masking and Highboost Filtering: Example 2/23/2021 90

Unsharp Masking and Highboost Filtering: Example 2/23/2021 90

Image Sharpening based on First-Order Derivatives Gradient Image 2/23/2021 91

Image Sharpening based on First-Order Derivatives Gradient Image 2/23/2021 91

Image Sharpening based on First-Order Derivatives z 1 z 2 z 3 z 4

Image Sharpening based on First-Order Derivatives z 1 z 2 z 3 z 4 z 5 z 6 z 7 z 8 z 9 2/23/2021 92

Image Sharpening based on First-Order Derivatives z 1 z 2 z 3 z 4

Image Sharpening based on First-Order Derivatives z 1 z 2 z 3 z 4 z 5 z 6 z 7 z 8 z 9 2/23/2021 93

Image Sharpening based on First-Order Derivatives 2/23/2021 94

Image Sharpening based on First-Order Derivatives 2/23/2021 94

Example 2/23/2021 95

Example 2/23/2021 95

Example: Combining Spatial Enhancement Methods Goal: Enhance the image by sharpening it and by

Example: Combining Spatial Enhancement Methods Goal: Enhance the image by sharpening it and by bringing out more of the skeletal detail 2/23/2021 96

Example: Combining Spatial Enhancement Methods Goal: Enhance the image by sharpening it and by

Example: Combining Spatial Enhancement Methods Goal: Enhance the image by sharpening it and by bringing out more of the skeletal detail 2/23/2021 97