Fundamentals of Multimedia Signal Processing

Lecture 1
Digital Signal Processing: Basics
Hoang Van Xiem, Ph.D.
xiemhoang@gmail.com

Hanoi, 2018
 Outline

1. DSP: Introduction
2. Fourier Transform
3. Discrete Cosine Transform (DCT)
4. DCT in Image and Video Coding: A case study

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing

2
 DSP: Introduction

 Digital Signal: a sequence of numbers that

represent samples of a continuous variable in a domain
such as time, space, or frequency.

Audio signal Image signal Digital Image signal

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing

3
 DSP: Introduction

 Signal Sampling: To convert a continuous signal form

into a discrete signal form and assign an appropriate
digital value for the obtained form.
 Discretization
 Quantization

 Nyquist–Shannon sampling theorem states that a signal can be

exactly reconstructed from its samples if the sampling frequency is
greater than twice the highest frequency component in the signal

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing

4
 Fourier Transform

 Target: To decompose a signal (time domain) into the

frequencies (frequency domain)

 Formulation:

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing

5
 Discrete Fourier Transform

 Target: To convert a finite sequence of equally-

spaced samples of a function into a same-length
sequence of equally-spaced samples of the discrete-
time Fourier transform (DTFT), which is a complex-
valued function of frequency

 Formulation:

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing

6
 Exercises

1
 Let N = 4; 𝑥 = 2−𝑖
−𝑖
−1 + 2𝑖
Compute the Fourier transform (X) of x ?

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing

7
 Solution

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing

8
 Discrete Cosine Transform (DCT)

 DCT: expresses a finite sequence of data points in

terms of a sum of cosine functions oscillating at
different frequencies

 DCTs are important to numerous applications in

science and engineering, from lossy
compression of audio (e.g. MP3)
and images (e.g. JPEG) (where small high-frequency
components can be discarded).

 DCT is a Fourier-related transform similar to

the discrete Fourier transform (DFT), but using only real
numbers
Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing
9
 Discrete Cosine Transform (DCT)

 DCT: expresses a finite sequence of data points in

terms of a sum of cosine functions oscillating at
different frequencies

 DCTs are important to numerous applications in

science and engineering, from lossy
compression of audio (e.g. MP3)
and images (e.g. JPEG) (where small high-frequency
components can be discarded).

 DCT is a Fourier-related transform similar to

the discrete Fourier transform (DFT), but using only real
numbers
Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing
10
 DCT in video coding: Transform coding

 Block – wise transform coding

 Orthonormal transform
 DCT – Type II
 Thresholding Coding
 DCT coding artifact

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing

11
 Block – wise transform coding

@B. Girod, EE398A Image and Video Compression

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing

12
 Orthonormal transform

 Forward transform

 Inverse transform

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing

13
 DCT – Type II

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing

14
 Thresholding coding

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing

15
 DCT coding artifact

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing

16
 Homework

 Xây dựng chương trình mô phỏng phép biến đổi DCT

ứng dụng trên xử lý ảnh
 Biểu diễn giá trị hệ số DCT sau biến đổi cho một vài
khối hình 8x8

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing

17
 Lecture References

1. Wikipedia.com

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing

18
 Recap

 Homework assignment: 15%

 Project: 30%
 Mid. Exam: 20%
 Fin. Exam: 35%

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing

19