Blind Image Restoration Based On Wiener Filtering and Defocus Point Spread Function Estimation

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 5

Blind Image Restoration Based on Wiener Filtering

and Defocus Point Spread Function Estimation

Fengqing Qin
School of Computer and Information Engineering
Yibin University, 644007,
Yibin, China

Abstract—In order to improve the quality of the defocus blurred cross iteration under the noise of Poisson [5-6],depends on the
image, the defocus point spread function (PSF) of the imaging initial value of PSF. It is effective only when the initial value
system needs to be estimated. A blind image restoration of PSF approaches the true PSF, otherwise the restoration
algorithm was proposed, in which the defocus PSF of the blurred effect is poor .The accurate estimation of initial value of PSF,
image was estimated through error-parameter estimation method.
Firstly, the error-parameter curve was generated through
however, is very difficult in the practical application, so the
Wiener filtering algorithm. Then, by analyzing the error- method is inapplicable for the blind restoration of motion blur
parameter curve, the defocus radius of the blurred image was images. Xue-lin Wang et al represent image restoration
estimated. Finally, utilizing the estimated PSF, image restoration method based on wavelet-domain local Gaussian model [7],
was performed through Wiener filtering algorithm. assuming wavelet coefficients satisfy the local Gaussian
Experimental results showed that the defocus PSF was estimated model. The model exists in some rationality for some images,
with high accuracy, and justified the fact that the defocus PSF but usually the wavelet coefficients of astronomical images
estimation plays a great important part in blind image and medical images do not satisfy the assumption, therefore
restoration. there are some limitations to the application scope. With a
Keywords- blind; image restoration; point spread function;
view to the spectrum characteristic of motion-blur images, Ze-
defocus; Wiener filtering. feng Deng and You-lun Xiong have proposed a kind of
identification method of motion-blur direction based on
frequency-domain algorithm [8], but it is not robust to noise
I. INTRODUCTION
disturbance and may result in a great error in identification of
Image blur may be caused by relative motion between the PSF if the motion-blur images are noised. Qin et al proposed a
camera and the scene, or by an optical system that is out of blind sing-image super resolution reconstruction method based
focus, atmospheric turbulence, aberrations in the optical system, on motion blur [9], the motion PSF is estimated with high
etc. [1]. In recent years, image restoration has been applied to accuracy when the signal-to-noise ratio is higher than 40dB.
many areas such as astronomy, remote sensing imaging and The foremost difficulty of blind image restoration is rooted
medical image restoration etc. The blurred image is expressed in the fact that the observed image is an incomplete
as the convolution of the original high resolution image with convolution [10]. The convolution relationship around the
the point spread function (PSF) of the imaging system. boundary is destroyed by the cut-off frequency, which makes it
In most of the current image restoration algorithms, the PSF much more difficult to identify the PSF of the imaging system.
of the imaging system is assumed to be a given type and In general, the Gaussian PSF and motion PSF are mainly
parameters. It does not meet the real imaging model of optical considered in many papers, but the defocus PSF is less
devices and the performance of the restoration algorithm will discussed.
decrease. But in many applications, the PSF of the imaging In this paper, a blind image restoration method based on
model is most likely unknown or is known only within a set of Wiener filtering and defocus PSF estimation was proposed. For
parameters, and such image restoration is called blind a given defocused image, the defocus PSF was estimated
restoration. Thus, blind image restoration problem arises through error-parameter analysis method. Image restoration
naturally and is expressed as estimating a high-resolution was performed through Wiener filtering algorithm. The
image and the PSF simultaneously, which has always been one importance of defocus PSF estimation in blind image
advanced issue and challenge in image processing [2-4]. restoration was tested through experiments.
According to the mechanisms of image blurred,
researchers have proposed a series of blind image restoration II. WIENER FILTERING IMAGE RESTORATION
method. For example, the blind restoration based on Lucy- METHOD
Richardson method, employing the theory of the maximum
likelihood function to estimate the true image and PSF by Wiener filtering is broadly applied in signal and image
processing. Practical experience shows that it is a classical
deconvolution technique with good restoration effect and small H *Y
amount of calculation. In this paper, Wiener filtering method is X= (5)
H +Γ
2
used to restore the high resolution image, and to generate the
error-parameter curve of the observed low resolution image. If Where, Γ is a positive constant, which is often taken as a
the image and the noise are assumed to be generalized
stationary process, image may be restored through Wiener experience value. The best value of Γ is the reciprocal of the
filter. SNR of the observed image.

In Wiener filtering image restoration algorithm, both the


blur function and the statistical character of system noise are III. DEFOCUS BLUR ESTIMATION
considered. The noise is assumed to be a random process. The
aim is to make the mean square error between the original A. Defocus Blur
image and the estimated image to be the least. According to Defocus blur refers to the image degradation caused by the
this idea, the sketch map of Wiener filtering may be expressed incorrect focus of the optical system during the imaging
in Fig.1. process. Geometrical optic analysis shows that the point spread
function (PSF) of defocus blur is a uniformly distributed
circular facula. The defocus PSF may be expressed as
following:

⎧1/ (π R 2 ) m 2 + n 2 ≤ R 2
h(m, n) = ⎨ (6)
⎩ 0 others
Figure 1. The sketch map of Wiener filtering. Where, R is the defocus radius, which needs to be estimated.

The observed low resolution image may be expressed as B. Parameter-Error Estimation Method
follows:
Error-parameter analysis method is utilized to estimate the

parameter of defocus PSF. Wiener filtering method is used to
y ( n) = ∑ x(n − k )h(k ) + ξ (n) = x(n)* h(n) +ξ (n)
k =−∞
(1)
generate the error-parameter curve. Given a range of the
motion distance [Rmin, Rmax], the parameter (R) increases with a
Where, * is the convolution operation; x(n) is the original given increment. For each parameter, utilizing Wiener filtering
high resolution image; ξ(n) is Gaussian white noise with zero image restoration method, a restored image may be gained, and
means; h(n) is the blur function, which can be presented by the corresponding restoration error may be calculated. In this
point spread function. way, an error-parameter curve is generated at different defocus
It’s expected to find a filter with input y(n), and the output radius (R). By analyzing the relationship this curve, the real
is the estimated image expressed as follows: defocus radius can be estimated approximately. The defocus
∞ blur estimation criterion is as follows: when the parameter (R)
xˆ (n) = ∑ y(n − k ) g (k ) = y(n)* g (n)
k =−∞
(2) changes from big to small, the slope of the error-parameter
curve decreases evidently around the real parameter. Given a
The mean square error between the original image and the threshold of curve slope, the real defocus radius can be
estimated image is expressed as follows: estimated automatically. In this way, the parameter (R) and its
corresponding defocus PSF may be estimated approximately.
e 2 = E{| x(n) − xˆ ( n) |2 } (3)
The description of this algorithm may be expressed as
If the image and the noise are irrelevant, the minimum of follows:
the error function may be calculated in frequency domain.
When the discrete Fourier transform (DFT) method is used to Step 1: Select a range of motion distance [Rmin, Rmax], a
estimate the restored image, the Wiener filter may be expressed researching number S. So, ΔR=( Rmax - Rmin)/S;
as follows: Step 2: for i=1:S
*
HY Calculate the current parameter: Ri= Rmin +(i-1) ΔR;
X= (4)
H + Snn / S xx
2
Calculate the current PSF: h=1/Ri;
where, X, Y and H are the DFT of the real image (x), the Using Wiener filter, calculate the estimated image ( xˆi );
*
blurred image (y) and the blur function (h) respectively; Calculate the estimation error: Ei = y − xˆi * hi
denotes the conjugate operation; Snn and Sxx denote the power
spectrum of the noise and the real image. As it is usually very end
difficult to estimate Snn and Sxx, the Wiener filter is usually Step 3: Under different parameter (R), plot the error-
approximated by the following formula: parameter curve (E).
IV. EXPERIMENTAL RESULT B. The defocus PSF Estimation
When Rmin=0.5, Rmax=3, S=40, and the threshold of curve
A. Simulated Images slope is taken as 0.01 , using Wiener filtering image
In order to test the effectiveness of our algorithm restoration algorithm, the restoration error (E) at different
objectively and subjectively, experiments are performed on motion distance (L) is calculated. The error-parameter curve of
simulated low resolution image. The original high resolution the blurred image is shown in Fig.4.
image is taken as a standard image ‘lena.bmp’ of size 256×
256, which is shown in Fig.2.

Figure 4. The error-parameter curve.

Figure 2. The original high resolution image.

The original image is passed through an imaging model


to simulate a low resolution image. Here, the original image is
convolved with a defocus PSF to simulate the blurring process.
The original defocus radius (R0) is taken as 1.5. The simulated
low resolution is shown in Fig.3.

Figure 5. The estimated defocus PSF.

From the error-parameter curve, we can see that when the


defocus radius changes from big to small, the curve slope
around the real defocus radius decreases obviously. Using the
algorithm proposed in this paper, the estimated defocus radius
is 1.4375, and the relative estimation error is: (1.5-
1.4377)/1.5=0.0625.
From the experimental result, we can see that the defocus
PSF estimation algorithm achieves high accuracy. The
Figure 3. The simulated low resolution image. estimated PSF is shown in Fig.5.
C. Image restoration ACKNOWLEDGMENT
Utilizing the estimated defocus PSF, image restoration is This paper was supported by the National Nature Science
performed through Wiener filtering method. The restored Foundation of China (61202195), the Scientific and
image is shown in Fig.6. The peak signal to noise ratio (PSNR) Technology key Project of Sichuan Provincial Education
of the restored image relative to the high resolution image is Department (11ZA174), the Application Fundamental
33.2411dB. Research Project of Sichuan Provincial Scientific and
Technology Department (2011JY0139), the key project of
Yibin Science and Technology Bureau (2011SF016 ), as well
as the Doctor Scientific Research Starting project of Yibin
University (2009B02).

Figure 6. The restored image at the estimated defocus PSF.

D. The effect of defocus PSF estimate in image restoration


In order to show the importance of defocus PSF estimate,
image restoration is performed at different estimated defocus (a) When the estimated standard deviation is 0.5,PSNR=34.9729dB.
PSF. When the estimated standard deviation are 0.5, 1, 1.5 2,
and 3 respectively, the restored images are shown in Fig.7 (a)-
(d).
From the experimental results, we can see that the restored
image has better quality around the real defocus PSF, as shown
in Fig.6 and Fig.7 (b). If the estimated defocus radius is smaller
than the real value, the restored image as shown in Fig.7 (a) is
illegible, though the PSNR is a bit higher. If the estimated
defocus radius is larger than the real value, ringing effect
appears in the restored image.

V. CONCLUSION
In this paper, a blind image restoration method was
proposed. The defocus PSF of the blurred image was estimated
through the parameter-error analysis method. Utilizing the
estimated defocus PSF, the image was restored through Wiener
filtering algorithm. The experimental results showed that the
parameter of defocus PSF was estimated with high accuracy.
The effect of defocus PSF estimation in image restoration was
also tested. The quality of the restored images was better
around the real defocus PSF. When the estimated defocus
radius was far away from the real value, the restored image (b) When the estimated standard deviation is 1.5, PSNR=35.2159dB.
would be illegible or appear obvious ringing effect.
REFERENCES
[1] K. Gao, Y. Zhang, X.-G. Shao, Y.-H. Liu, and G. Q. Ni, “PSF
estimation for defocus blurred image based on quanturm back-
propagation neural network,” Proc. Of SPIE on Optoelectronic Imaging
and Multimedia Technology, Vol.7850, 785018, pp.1-8,2010.
[2] A.-K. Seghouane, “A Kullback-Leibler Divergence Approach to Blind
Image Restoration,” IEEE Transactions on Image Processing, vol.20,
no.7, pp.2078-2083, 2011.
[3] Y. H. Luo, and C. Y. Fu, “Midfrequency-based real-time blind image
restoration via independent component analysis and genetic algorithms,”
Optical Engineering, vol.50, no.4, 3567072, 2011.
[4] G. Alexia, “Classification-based adaptive filtering for multiframe blind
image restoration,” IEEE Transactions on Image Processing, vol.20, pp.
382-390, 2011.
[5] W. H Richardson, "Bayesian-based iterative method of image
restoration," Journal of Optical Society of America, vol.62, pp.55-59,
1972,.
[6] B.Lucy, "An iterative technique for rectification of observed
distributions," the Astronomical Journal, vol.79, pp.745-754, 1974.
[7] X.L. Wang, et al, "Image restoration based on wavelet-domain local
Gaussian model," China:Journal of Software, vol.15, no.3,443-450, 2004.
[8] Z.-F. Deng,Y.-L. Xiong, "Identification of motion-blur direction based
(c) When the estimated standard deviation is 2, PSNR=32.2817dB. on frequency-domain algorithm," Opto-Electronic Engineering, vol.34,
pp.98-101, 2007.
[9] F. Q. Qin, Z. Li, L. H. Zhu,Y.D. You, and L.L. Cao, “Blind Single-
Image Super-Resolution Reconstruction Based on Motion Blur,”
Advanced Materials Research, Vol.225-226, pp.895-899, 2011.
[10] M.Y. Zou, “Deconvolution and Signal Recovery”, Defence Industry
Publishing of China, 2004.

(d) When the estimated standard deviation is 2.5, PSNR=31.8648dB.

Figure 7. The restored images at different estimated defocus PSF.

You might also like