COMPRESSIVE SENSING BASED

IMAGE RECONSTRUCTION
Internal Guide External Guide
Prof. Jigna Patel Prof. Ketki Pathak
E.C .Department E. C. Department,
Dr. S. & S. S. Ghandhy GEC, Surat SCET, Surat.

Submitted By:-
SHERIN C ABRAHAM (150230727015)
M.E. (ELECTRONICS AND COMMUNICATION)
Wireless Communication Systems and Networks
Semester-4, Year 2017,
Dr. S. & S. S. Ghandhy Govt. Engineering College, Surat.
CONTENTS
• Introduction
• Motivation
• Objective
• CS based CSPM system
• Proposed Block Diagram
• Results
• Inferences
• Future works
• Conclusion
• References

Compressive sensing based image reconstruction

2
150230727015
INTRODUCTION – COMPRESSIVE SENSING
• By Nyquist criteria, signal will be sampled at 2* fmax rate and then compress
by discarding small coefficients
• If the signal is “sparse” or compressible, then the acquired significant
Measurement matrix Incoherence
information is sufficient to reconstruct. is non adaptive & RIP
• The Compressive Sensing (CS) theory asserts that one can recover certain
signals and images from far fewer samples or measurements.
• CS
Fig. directly
1: Sparsity in measure the part that will not end up being thrown away
wavelet domain. [13] Nonlinear
• Compressive Sensing relies on three principle – Sparsity, Incoherence, Non-
Reconstruction
Linear Reconstruction. M<<N
M N
X Compressed sensing Reconstruction 𝑋෠
Compressive Sensing based Image Reconstruction
3
150230727015
MOTIVATION

• The increasing demand for visual communication over Internet and wireless
networks.

• The amount of visual data is huge, while the bandwidth of transmission

channels is limited.

• MRI data collection is inherently slow. Decrease scan time is a challenge.

• The reconstructed image should be of good quality.

Compressive sensing based image reconstruction

4
150230727015
OBJECTIVE

• Achieve good compression ratio.

• Achieve high PSNR.

• Reduce bandwidth used for transmission

• Add enough sparsity.

• Use good measurement matrix.

• Use proper reconstruction algorithm.

Compressive sensing based image reconstruction

5
150230727015
 WHY CS IN MRI?
• Magnetic Resonance Imaging (MRI) is an essential medical
imaging tool with an inherently slow data acquisition
process.
• Due to large number of data need to be collected while
scanning a patient.
• Applying CS to MRI offers
– significant scan time reductions
– Less radiation exposure Fig. 2: An MRI Image [24]

– benefits for patients and health care economics.

• Medical imagery is naturally compressible by sparse coding in

an appropriate transform domain (e.g., by wavelet transform).
Compressive sensing based image reconstruction
6
150230727015
PROPOSED IN MSR

• Compare with different levels of wavelet transform and different wavelets.

• Compare with more measurement matrices.

Compressive sensing based image reconstruction

7
150230727015
 CS- BASIC BLOCK DIAGRAM
Incoherence

f
x Sparsity Inducing
matrix Ψ
Measurement
matrix φ

y
ሚf
Reconstruction
𝑥෤ Ψ* Inverse of Ψ
algorithm

Fig. 3: Sparsity of a rich signal in another domain. [16]

Compressive sensing based image reconstruction
8
150230727015
RESTRICTED ISOMETRY PROPERTY (RIP)
• For any vector V sharing the same K nonzero entries as x and for some ε > 0
𝐴𝑐𝑠 𝑉 2
1–ε≤ ≤1+ε.
𝑉 2

– This is RIP condition

• Acs = φ ψ

• If ψ = I, φ is incoherent with ψ .

• MxN i.i.d Gaussian matrix have RIP with high probability if

𝑁
M ≥ 𝑐𝐾𝑙𝑜𝑔 ≪𝑁
𝐾

- c is a small coefficient

Compressive sensing based image reconstruction

9
150230727015
MEASUREMENT MATRIX

• Hadamard Matrix
• Matrix whose entries are either +1 or −1 and whose rows are mutually orthogonal
which satisfies below condition.
• HHT = n In,
– where In is identity matrix of size n when H is of size n x n.
– HT is the transpose of H.
• Gaussian Matrix
• The random projection or a matrix of i.i.d. random variables from a sub-Gaussian
distribution is Gaussian Matrix. An M-by-N matrix containing pseudorandom
values drawn from the standard normal distribution and the values are normalized.

Compressive sensing based image reconstruction

10
150230727015
MEASUREMENT MATRICES CONT..
Bernoulli matrix
• The Bernoulli distribution is the probability distribution of a random variable which
takes the value 1 with probability p and the value 0 with probability q = 1-p.

• If X is a random variable with this distribution, we have:

• Pr(X=0) = 1 – Pr(X=1) = 1-p =q

Toeplitz matrix
• A matrix in which each descending diagonal from left to
right is constant. If the i, j element of A is denoted A i, j.
A i , j = A i+1, j+1
Fig. 4: Toeplitz matrix [18]
• Diagonal-constant matrix
Compressive sensing based image reconstruction
11
150230727015
PREDICTION METHODS
• Linear Prediction
𝑎 𝑏
The pixel arrangement is as follows, 4 x 4 matrix
𝑐 𝑑
Then the prediction error for above pixel orientation can be calculated as
 e (2,2) = d - (c+b)
 d(2,2) = e(2,2) + d (1,2) + d (2,1)
• Differential Adaptive Run Coding (DARC)
Parameters dh and dv represent the gradient orientation in vertical and horizontal, :
dv = 𝑐 − 𝑎
dh = b − a
Then final predictor predicts the unknown pixel by the following equation:
𝑑𝑣 𝑑ℎ
e(2,2) = c+ 𝑏
𝑑𝑣+𝑑ℎ 𝑑𝑣+𝑑ℎ

Compressive sensing based image reconstruction

12
150230727015
HUFFMAN ENCODER
• Huffman coding is a lossless data compression algorithm.
• It’s variable length coding with less number of bits assigned to
frequent symbols and large number of bits to less frequent symbols.
• Huffman codes are Prefix Codes, means the code assigned to one
symbol is not prefix of code assigned to any other symbol.
• This helps to remove ambiguity when decoding the generated bit
stream.
• This algorithm is used for symbol-by-symbol coding with a known
input probability distribution.

Compressive sensing based image reconstruction

13
150230727015
CS BASED CSPM SYSTEM

Fig. 5: Overall block diagram of CSPM based compressive sensing. [1]

Compressive sensing based image reconstruction
150230727015 14
PROPOSED BLOCK DIAGRAM
Original Image Reconstructed Image

2-D2-D
DWTDWT
/ DCT Inverse DWT

Low frequency High frequency CS Recovery using L1 CS Recovery using

CS Recovery
minimization CS Recovery
components components OMP

Received Received
Measurements using Measurements using Measurements of Measurements of
Hadamard matrix
Measurement matrix Measurement matrix
Gaussian matrix low band high bands

Prediction error calculation

Prediction using DARC
error calculation Prediction
Prediction using DARC

Encoder
Huffman Encoder Huffman Decoder
Decoder

Channel

Fig. 6: Proposed algorithm block diagram

Compressive sensing based image reconstruction
15
150230727015
MATLAB ALGORITHM
• Perform the wavelet transform of the N*N image, and get the four wavelet sub-
band coefficients {LH1, HL1, HH1, LL1}.
• Use the measurement matrix to measure the three high-frequency sub-band
coefficients LH1, HL1, HH1, to get the matrices of the measured high band
coefficients while use another measurement matrix for the low-frequency sub-band
coefficients LL1.
• Find out prediction error for all components.
• Undergoes entropy coding and transmit encoded values.

Compressive sensing based image reconstruction

16
150230727015
MATLAB ALGORITHM CONT..
• At receiver side, do decoding of received signal values.
• Do prediction on decoded values.
• Use the reconstruction algorithm to reconstruct the three high-frequency
coefficients matrices 𝐿𝐻 1, 𝐻𝐿1, 𝐻𝐻 1.Then LL1 band coefficient matrices are
reconstructed by using another reconstruction algorithm.
• All coefficient recovered will undergo inverse wavelet transform to reconstruct
the image.
• The image reconstructed will be verified by its PSNR value and MSE value.

Compressive sensing based image reconstruction

17
150230727015
 RESULTS

Compressive sensing based image reconstruction

18
150230727015
MEDICAL IMAGES

More..

Fig. 7: Different medical images [24,25,26]

Compressive sensing based image reconstruction
19
150230727015
WAVELET TRANSFORM

Fig. 8: Haar Wavelet Transform Output of 256x256 image.

Compressive sensing based image reconstruction
20
150230727015
IMAGE SPARSITY BY WAVELET TRANSFORM

Fig. 9: Sparsity due to wavelet transform

Compressive sensing based image reconstruction
21
150230727015
MEASUREMENTS TAKEN BY APPLYING CS

Fig. 10: Less samples or measurements taken after applying CS

Compressive sensing based image reconstruction
22
150230727015
IMAGE SPARSITY BY DCT TRANSFORM

Fig. 11: Sparsity using DCT

Compressive sensing based image reconstruction
23
150230727015
COMPARISON BETWEEN DIFFERENT
MEASUREMENT MATRIX USING DCT IMAGE
More..

Hadamard matrix will give better results

Fig. 12: Results in PSNR (dB) between different measurement matrix used for DCT
transformed image
Compressive sensing based image reconstruction
24
150230727015
DB2 DAUBECHIES WAVELET TRANSFORM

Fig. 13: db2 Wavelet Transform Output of 256x256 image.

Compressive sensing based image reconstruction
25
150230727015
2 ND LEVEL WAVELET DECOMPOSITION

Fig. 14: Level 2 Wavelet Decomposition Output of 256x256 image.

Compressive sensing based image reconstruction
26
150230727015
COMPARISON WITH DIFFERENT SIZE OF
DWT IMAGES USING GAUSSIAN MATRIX
More..

As size increases,
PSNR is
decreasing. But as
size decreases,
the detailing of
image is less

Fig. 15: Comparison of PSNR with different size of images

Compressive sensing based image reconstruction
27
150230727015
COMPARISON BETWEEN HADAMARD USED
FOR MEASURING LL BAND WITH GAUSSIAN
MATRIX USED FOR ALL SUB BANDS
More..

Hadamard used for LL band is

giving better results than all sub
bands used with Gaussian matrix
Fig 16: Comparison of PSNR (dB) between
Hadamard matrix used for measuring LL band and
Gaussian matrix used for all frequency bands
Compressive sensing based image reconstruction 28
150230727015
 COMPARISON OF DWT WITH ALL BAND GAUSSIAN
MATRIX AND LL BAND USING HADAMARD MATRIX
Original Image Gaussian used for all bands Hadamard used for LL band

Hadamard applied to LL
band will give better results

Fig. 17: Visual quality comparison with all Gaussian and with LL band measured with Hadamard
Compressive sensing based image reconstruction
29
150230727015
OUTPUT FROM
DIFFERENT
TECHNIQUES

Compressive sensing based image reconstruction

150230727015 30
Fig. 18: Output of 256 x 256 image using various techniques
COMPARISON BETWEEN DCT AND DWT

DWT give better

results than DCT

Fig. 19: Comparison of

PSNR between DCT
and DWT image
Compressive sensing based image reconstruction
31
150230727015
 COMPARISON OF DWT AND DCT
Original Image DCT reconstructed images DWT reconstructed images

DWT is better than DCT

Fig. 20: Visual quality comparison for different medical images for DCT and DWT method is compared
Compressive sensing based image reconstruction
32
150230727015
GRAPH REPRESENTING DWT WITH DIFFERENT
PREDICTION METHODS AND WITHOUT PREDICTION

More..

DARC prediction
gives better results

Fig. 21: Comparison of PSNR (dB) of different medical images for DWT with
different prediction methods
Compressive sensing based image reconstruction
33
150230727015
 COMPARISON WITH LINEAR PREDICTION AND
WITH DARC PREDICTION
Original Image Linear Prediction DARC Prediction

DARC prediction will give

better results than Linear
Prediction

Fig. 22: Visual quality comparison for different medical images for DWT method with 34
Compressive sensing based image reconstruction
linear prediction and DWT with DARC prediction is compared 150230727015
COMPARISON FOR DWT WITH DIFFERENT
LEVELS OF DECOMPOSITION
More..

Level 4 decomposition
level gives better
results

Fig. 23: Comparison of PSNR (dB) for different medical images for DWT with
different levels of decomposition
Compressive sensing based image reconstruction
35
150230727015
COMPARISON FOR DIFFERENT MEDICAL
IMAGES FOR DWT WITH DIFFERENT
DAUBECHIES WAVELET
More..

db2, db1 gives better results

Fig 24: Comparison of PSNR (dB) for different medical images than other daubechies
for DWT with different Daubechies wavelet wavelets
Compressive sensing based image reconstruction
36
150230727015
COMPARISON FOR DIFFERENT MEDICAL IMAGES
FOR DWT WITH DIFFERENT MEASUREMENT
MATRICES
More..

Hadamard matrix will give

better results

Fig 25: Comparison of PSNR (dB) for different medical images for DWT with
different measurement matrices
Compressive sensing based image reconstruction
37
150230727015
COMPARISON FOR DIFFERENT MEDICAL
IMAGES FOR DWT WITHOUT ENCODER
AND WITH ENCODER
More..

PSNR slightly
decreases after using
Huffman encoder

Fig 26: Comparison of PSNR (dB) for different medical images for DWT without encoder
and with encoder Compressive sensing based image reconstruction
38
150230727015
COMPRESSION RATIO COMPARISON :
WITH HUFFMAN ENCODER AND WITHOUT
ENCODING
More..

Compression Ratio is
higher after using
Huffman encoder

Fig 27: Comparison of compression ratio for different medical images for DWT without
encoder and with encoder Compressive sensing based image reconstruction
39
150230727015
BIT RATE COMPARISON: WITH HUFFMAN
ENCODER AND WITHOUT ENCODING

Bit Rate is less after

using Huffman encoder

Fig 28: Comparison of bit rates for different medical images for DWT without encoder and
with encoder Compressive sensing based image reconstruction
40
150230727015
PSNR VS ITERATIONS

Fig. 29: PSNR for different number of iterations in OMP reconstruction algorithm.
Compressive sensing based image reconstruction
41
150230727015
INFERENCES
• When size of image increases, the PSNR value decreases for OMP reconstruction
algorithm.
• MSE value will increases when size of image increases.
• PSNR will increase when number of iterations are increased.
• Hadamard matrix for low frequency band will give better results than Gaussian matrix
for LL band.
• With applying L1 minimisation for LL band, the PSNR is getting better when
Hadamard matrix used for LL band measurement.
• With applying OMP for high sub bands, the PSNR is getting better when Gaussian
matrix used for high sub bands.
• DARC is better prediction than Linear Prediction.
• Huffman encoder helps to get increased compression ratio and less bit rate

Compressive sensing based image reconstruction

42
150230727015
RESULTS

LL band High Bands

Measurement matrix Hadamard Gaussian

Prediction method DARC DARC

Encoder Huffman Huffman

Recovery Algorithm L1 minimisation OMP

Compressive sensing based image reconstruction
43
150230727015
RESULTS
Base Paper New Algorithm

Gaussian
31.3 15.5

Hadamard 35 37.17

PSNR is
Bernoulli 31.5 35.35 improved

Toeplitz 31.8 35.15

Compressive sensing based image reconstruction
44
150230727015
RESULTS
Base Paper New Algorithm

Huffman
34.83 35.43

Maximum PSNR 37.61 40.98 New

Algorithm
has more
Percentage of PSNR and
66.55% 80.7%
reduction of bits less bit rate

Bit Rate 1.8 1.66

Compressive sensing based image reconstruction
45
150230727015
FUTURE WORKS

• Add ROI extraction

Compressive sensing based image reconstruction

46
150230727015
 PUBLICATIONS
• ICMTES
– “COMPRESSIVE SENSING BASED IMAGE RECONSTRUCTION using WAVELET TRANSFORM”,
publication by the Virtual International Conference on Modern Technologies in Engineering and Science
conference and in International Journal of Engineering and Technology journal, ISSN : 0975-4024, UGC approved
during June 2, 2017 to June 3, 2017 (Paper) (Review_form)
• AD PUBLICATION
– “COMPRESSIVE SENSING BASED IMAGE RECONSTRUCTION – REVIEW”, publication by the
International Journal of Engineering Science and Futuristic Technology ISSN : 2454-1338, ISTE approved,
Impact Factor 3.885. (Paper) (Certificate)
• WJERT
– “COMPRESSIVE SENSING BASED IMAGE RECONSTRUCTION”, publication by the World Journal of
Engineering Research and Technology, ISSN No: 2454-695X, SJIF Impact Factor 4.326, ICV 44.56 on 16-05-
2017.(Paper) (Certificate)
• ICFITT
– “COMPRESSIVE SENSING BASED IMAGE RECONSTRUCTION” under review, publication by the
International Conference on Future Internet Technologies and Trends published by Springer at SVNIT, Surat
during August 31, 2017 to September 2, 2017
Compressive sensing based image reconstruction 47
150230727015
 REFERENCES
1. V. Angayarkanni, S. Radha ”Design of Bandwidth Efficient Compressed Sensing Based Prediction
Measurement Encoder for Video Transmission in Wireless Sensor Networks”, Springer Wireless
Personnel Communication Journal, 13 January 2016
2. Xiumeni Li and Guoan Bi, “Image reconstruction based on the improved compressive sensing algorithm”,
IEEE International Conference on Digital Signal Processing (DSP), 2015
3. Muhammad Ali Qureshi and M. Deriche, “A new wavelet based efficient image compression algorithm
using compressive sensing”, Springer Science Multimedia tools and applications, March 2015
4. Weisheng Dong, Xiaolin Wu, and Guangming Shi, "Sparsity Fine Tuning in Wavelet Domain With
Application to Compressive Image Reconstruction”, IEEE Transactions on Image Processing , vol. 23,
no.12, December 2014.
5. Chenwei Deng, Weisi Lin, Bu-sung Lee, and Chiew Tong Lau, "Robust Image Coding Based Upon
Compressive Sensing”, IEEE Transactions on Multimedia, vol. 14, no.2, April 2014.
6. Yun Song, Wei Cao, Yanfei Shen and Gaobo Yang, “Compressed sensing image reconstruction using intra
prediction”, Science direct, Neurocomputing, 2015
7. Sabbisetti Ravindranath and et. al, “Compressive Sensing based Image acquisition and Reconstruction
analysis” Green Computing Communication and Electrical Engineering (ICGCCEE), 2014 International
Conference Compressive sensing based image reconstruction
48
150230727015
 REFERENCES CONT..
8. Chen Chen and Junzhou Huang, “Exploiting the wavelet structure in compressed sensing MRI”, Science
Direct Magnetic Resonance Imaging, July 2014.
9. S. Spurthi and Parnasree Chakraborty, “Block based compressed sensing algorithm for medical image
compression”, International Journal of Engineering and Computer Science, 2016.
10. SumitBudhiraja and DiptiBhatnagar, “Wavelet based compressive sensing techniques for image
compression”, International journal of Engineering Research and Applications, 2011.
11. Saad Qaisar ande et.al, “Compressive sensing: From theory to applications, a survey”, IEEE Journal of
communications and networks, vol.15, no.5, October 2013
12. Michael Lustig and et.al, “ Compressed sensing MRI”, IEEE signal processing magazine, March, 2008
13. Emmanuel J. Candès and Michael B. Wakin, “An introduction to compressive sensing”, IEEE Signal
Processing Magazine, March 2008
14. R.G. Baraniuk, “Compressive Sensing [Lecture notes]”, Lecture Notes in IEEE signal processing
Magazine, Volume 24, issue 4, July 2007.
15. Sherin C Abraham, Ketki Pathak, “Compressive Sensing Based Image Reconstruction – Review”,
International Journal of Engineering Science and Futuristic Technology, April 2017.
Compressive sensing based image reconstruction
49
150230727015
 REFERENCES CONT..
Websites:
16. http://dsp.rice.edu/cs
17. https://en.wikipedia.org/wiki/Compressed_sensing
18. https://en.wikipedia.org/wiki/Toeplitz_matrix
19. https://pdfs.semanticscholar.org/228a/594fcc53c6166c18e6ff4a03d3471a45537f.pdf
20. http://www.slideshare.net/thomasstefani169/compressive-sensing-basics-medical-imaging-mri
Image Database:
24. Civil Hospital, Surat
25. https://www.ncm-c.org/services/diagnostic-imaging/magnetic-resonance-imaging-mri/
26. http://jimalgie.club/when-health-insurance-means-life-death-bankruptcy/skull-fracture-x-ray/

Compressive sensing based image reconstruction

50
150230727015
THE END

Compressive sensing based image reconstruction

51
150230727015