Noise Reduction and dehazing of Visual Data

MOHIT BHOJ KUMAR AMAN SEHRAWAT

Student, Bachelor of Technology Student, Bachelor of Technology Student, Bachelor of Technology
Computer Science and Engineering, Computer Science and Engineering, Computer Science and Engineering,
Lovely Professional University Lovely Professional University Lovely Professional University
Phagwara, India Phagwara, India Phagwara, India

UPINDER KAUR
Assistant Professor
Computer Science and Engineering,
Lovely Professional University
Phagwara, India

Abstract- The problem of haziness is a poorly
presented problem that has been broadly
contemplated in recent years. Images of dim
scenes normally experience low contrast which
corrupts the perceivability of the scene. Because
of light scattering and absorption by climatic
particles, pictures/recordings acquired from video
surveillance, traffic checking, galactic imaging,
clinical imaging, and remote detecting have poor
perceivability. Noise and haze both degraded the
overall quality of animage. So, the objective of this
paper is to give a review with respect to these
issues by reviewing over eleven techniques of
image dehazing on different datasets. Through
this paper, a thorough study and analysis of
unsupervised as well as supervised techniques
have been presented.
Keywords: Dehazing, supervised, unsupervised,
Convolutional Neural Network, Colour
attenuation, Image enhancement, Noise
reduction
Introduction
Pictures taken outdoors in adverse weather
conditions generally lose contrast and
distinctiveness, because of the way that light is
ingested and dispersed by the thick medium like
particles and water drops. Furthermore, most
programmed frameworks that solely rely on the
meaning of the data images fail to function, which
is frequently caused by damaged images. As a
result, developing an approach for removing
image haziness will help a wide range of picture
comprehension and computer vision applications.
The goal of Haze Removal calculations is to
recover and upgradethe scene from a hazy image.
Nowadays, computer vision and illustration have
several applications in a variety of fields.As a result,
when haze and fog are visible in photos and
videos, their clarity suffers. Climate circumstances
cause dimness patterns to remain slack for a
period. For example- In terms of the sun, it could
appear tannish or light blue depending on the
angle ofobservation. The notion of sampling and
capturing the scene is destroyed by fog and
immersion. As a result, it weakens the light
perceived from the scenes and correspondingly
combines it with some additional light substance
within the atmosphere. This is where the dehazing
approach comes in, which is essential in computer
vision applications since it can remove haze from
pictures and improve sceneperception.
When atmospheric dampness impacts the scenes,
it permanently corrupts the perceivability of open-
air scenes, and this is referred to as haze. Haze
becomes inconvenient to many PC visions and
frequently influences design applications since it
reduces the clarity of the scene. Attenuation
(reduces the discrepancy) and air light (expands
the whiteness) are the two
 principal peculiarities that cause a haze,
w.r.t. Figure 1.
Haze= Attenuation + Air light
Figure 1. Attenuation and air light phenomena
[16]
The haziness affects the pixel powers, which may
result in the loss of vital data in smart frameworks
that utilize image data. These particles include
fog, dust, cloudiness, precipitation, and smoke.
When light contacts these particles, a scattering
effectoccurs, and a white coating is formed on the
image, which alters the shading and contrast
value., w.r.t. Figure 2.
Figure 2. Mechanism of atmospheric
scattering. [16]
Furthermore, submerged underwater images are
a good source of data for research into ocean
organisms, with a focus on ocean bottom
hydrothermal vents. A buried image must deal
with important challenges such as low difference,
shading mutilation, and poor visual appearance.
Such problems were caused by light dispersion
and refraction as it infiltrates from less common to
denser material. Light dispersion reduces shade
contrast. The presence of submerged life
creatures adds to the impact of water in
submerged images.
Figure 3. Underwater imaging visual demonstration.
Literature Survey
Huzaifa Rashid et al [1] proposed a strategy for
single picture dehazing utilizing a Convolutional
neural organization. An end-to-end encoder and
decoder training model which is used to accomplish
a top notch de- hazed image. Upon approving on
datasetswhich comprises of around 1500 open air
pictures. The strategy likewise gives atransmission
guide of the dim picture which can be further be
utilized to improve theperceivability of the scene. In
future, their work might be reached out to dehaze
those pictures having no shadow cast and to run on
all cases.
Bin Luo et al [7] They presented a strategy for
Repeated Averaging Filters for assessing the
environmental light from a solitary dim picture,
which will additionally add to betterscene brilliance
recovery. An averaged channel is acquired from a
solitary picture by more than once averaging the
filters by means of essential pictures which gives a
quicker and proficient way for eliminating halo
antiquities.
Sebastián Salazar-Colores et al [8] presents a dark
channel that has been altered that works on the
nature of the depth assessments of the picture
components and decreases altogether the antiques
produced when the customary dark channel is
utilized. They gave the calculationhandling time by
involving the algorithm andmaking applications in
high- resolution pictures and real-time video
achievable.
Akshay Dudhane et al [2] proposed a for a single
image, a cycle-steady generative adversarial network
is used. CDNet is a de-hazing algorithm that is
prepared in an unpaired manner on a real foggy
image dataset, involving encoder-decoder
architecture and an optical model to recover the
haze-free scene. They dealt with the issue of matched
regular dim photographs being unavailable, as well as
the issue of colour distortion in regular dim pictures.
An optical model-based methodology was used to
settle existing end-to-end dehazing systems.
Xiaoqin Zhang et al [3] proposed two effective
modules. A combination module with multiple
levels, low-level elements help to recuperate better
subtleties, and the undeniable level elements find
conceptual semantics. In addition to significant
aspects, a residual mixed-convolution attention
module effectively drives our organization to zero.
They had an edge connection but didn't measure
the atmospheric light force or transmission map
specifically.
Chongyi Li et al[5] After Combining the upsides of
existing indoor and outside picture dehazing
preparing information, They suggested Delay, a
deep convolutional neural network (CNN) for
single-picture dehazing that included a perception-
motivated haze removal subnetwork that
reproduces the idle dehazed picture and a
refinement subnetwork that further improves the
difference and shading properties of the dehazed
result through joint multi-term shortfall
improvement.
Wenqi Ren et al [4] They use a coarse-scale network
to develop expertise with a complete assessment of
the scene transmission map, and then a fine-scale
network to refine it using local data and the results
from the coarse-scale network in their suggested
model. Similarly, an all-encompassing edge directed
network ensures that items of comparable depth
have identical transmission values. To put it another
way, they improve the multi-scale network by
removing the pooling and up-inspecting layers
while maintaining performance. Second, for edge
refinement, they promote an intelligent holistic
edge directed network. Third, they provided
additional specialized information, such as
execution evaluation and quantitative analysis of
the suggested algorithm.
Lerenhan Li et al [9] They proposed an algorithm
that applies a deep, both a supervised and an
unsupervised learning branch can be found in a
CNN. The deep neural network is obligated by
supervised loss functions with ground-truth labels
in the supervised branch. In the absence of
supervision, they constrain the network by using
the qualities of clean pictures, such as the sparsity
of dark channels and inclination priors.
Zhihui Li et al [10] Here a technique based on
quadtree decomposition is proposed, which
maintains a strategic distance from the impact of
dazzling white region on air light assessment and
precisely appraises environmental light in the sky
region. Utilising this quadtree disintegration. After
using a multi-scale convolutional neural organization
to create a rough transmission map through learning,
the method is used to precisely gauge the
surrounding light. The suggested technique is
capable of obtaining precise values of ambient light
and transmission maps for fog images with radiant
white patches and sky regions, as well as maintaining
high robustness.
Ziling Huang et al [6] A Haze-Aware Representation
Distillation Generative Adversarial Network
(HardGAN) for single-picture dehazing, using a multi-
scale structure neural organization made out of their
proposed haze-aware portrayal refining layers and
to use the standardization layer capably rather than
many picture quality enhancement assessments
claim that stacking with the convolutional layers
directly as before can prevent valuable data
washout. Other than pictures with homogeneous
haze, their strategy can likewise work effectively in
eliminating thick non-homogeneous murkiness in a
picture.
Boyun Li et al [11] They proposed a clever layer
disentanglement strategy based on surveying a hazy
picture as the entanglement of a few "less difficult"
layers - a hazy-free picture layer, transmission map
layer, and atmospheric light layer - which differs
from the usual worldview of preparing a profound
model for a dataset of enormous scope.
Furthermore, the proposed model outperforms
most unaided procedures and achieves nearly equal
execution as the provided strategies.
B S N V Chaitanya et al [12] They've presented an end-
to-end cycleGAN network for single-picture dehazing
that creates dimness-free images from foggy inputs
without having to examine atmospheric dissipation
model assumptions. Furthermore, their network
provides unpaired image preprocessing for dim and
ground-based images. The conventional CycleGAN
network had been improved by them. integrating a
haze explicit transformer network into the GAN
generator to keep up with the visual nature of the
delivered transparent pictures, as well as a loss work
explicit to the issue of single picture dehazing, by
adding weighted SSIM misfortune to the
conventional loss functions for the haze removal
issue
Problem Statement

Abnormalities in visual data are the main field of exploration in handling and investigation of data. It
has been observed that the researchers are only focusing on the solitary image. Additionally, no effort
has been put into working on noise reduction in underwater imaging. To eliminate this research gap,
inthe current work we have focused on noise reduction of both images and videos with prime concern
onvideos and underwater imaging by utilizing deep learning.

Comparison of various techniques

Author Dataset used Technique Name Outcomes Results

Akshay A. CDnet: Unpaired • Addressed the issue of

Dudhane D-HAZY, a Adversarial paired pairs being PSNR/
(2019) [2] database of Training unavailable. Using an SSIM
synthetic unpaired training strategy,
outdoor hazy natural hazy images were 2.9207/
images (derived used to train convolutional 0.8919
from the neural networks (CycleGAN).
ImageNet • It outperforms existing
database), the single picture haze removal
Indoor SOTS algorithms when trained in an
database, and a unpaired fashion on a real-
set of real-world world hazy image dataset.
outdoor hazy
photographs
were all used.

Xiaoqin Multi-level• • A multi-level fusion module

Zhang DCPDN- Fusion and that takes advantage of both PSNR/
(2019) TestA, Attention- low- and high-level features. SSIM
[3] RESIDE, and guidedCNN• • Low-level features aid in the
the real- recovery of finer details, while 32.07
world high-level features aid in the /
dataset discovery of abstract 0.9841
semantics.
Wenqi Ren photos with haze •
Multi-scale CNN • Using local data and the PSNR/
(2020) [4] outcome of the coarse-scale SSIM
and transmission with Holistic
network, refine it using a fine-
maps based on Edges 21.56
scale network.
them /0.86
 Author Dataset used Technique Name Outcomes Results

the NYU Depth

dataset.

Chongyi Li real and PDR-Net • reconstructs the latent PSNR/

(2019) [5] syntheti dehazed image as well SSIM
cimages as a refinement
subnetwork that 21.70
improves the image /
further 0.8847
Synthetic HardGAN • They were able to combine PSNR/
Ziling Huang benchmark local spatial information and SSIM
dataset and global atmospheric
(2020) [6] Real-world brightness, guided by the 34.34 /
photos from trained haze-aware maps for 0.9871
NTIRE 2020 specific channels, in an
adaptive manner.

Bin Luo real images and Repeated • Solved the problem of MSE /
(2019) synthetic Averaging Filters operational complexity & halo SSIM
[7] datasets artifacts in the final
outputimage after 1940.08 /
dehazing. 0.802
real images and modifying the • They gave the PSNR/
Sebastiá synthetic dark channel calculation handling time by SSIM
nSalazar- datasets prior involving the algorithm and 18.50/
Colores making applications in high- 0.810
(2019) resolution pictures and real
[8] time video achievable.
Lerenhan Li Real-world Semi-Supervised • Used both supervisedand PSNR/
(2020) [9] photos and Image Dehazing unsupervised learning SSIM
benchmark method
datasets • They train the supervised 23.15
branch on synthetic data /0.91
with ground-truth labels
using labelled loss
functions.
• But at the other hand, they
used real data and
unlabeled loss functions
based on commonly used
picture priors like dark
channel and total variation
to train the unsupervised
branch.
 Author Dataset used Technique Name Outcomes Results

real images and Quadtree • It can accurately PSNR/

Zhihui Li synthetic decompositio calculate atmospheric light SSIM
(2020) [10] datasets nand CNN and transmission maps for
hazy photos with dazzling 15.9492 /
white patches and sky 0.5569
areas while maintaining
high resilience.
• There is no halo or
pseudo-shadow effect, and
the detail information is
evident.
Dehazing of • layer disentanglement,
Boyun Li REalistic Single Zero-Shot which considers a picture to PSNR/
(2020) Image Images be made up of a few SSIM
[11] DEhazing "simpler" layers/factors.
(RESIDE)i.e., • To disentangle the input 22.65
SOTS andHSTS. foggy picture into these three /
layers, ZID employs three 0.9011
combined subnetworks,
recovering the immaculate
image and analyzing the
haze. ZID works in an
unsupervised instead of
supervised way.
• Every unsupervised
strategy is quantitatively
outflanked by ZID, which
achieves comparable results
with supervised strategies.

NTIRE 2019 Improved • The suggested generator PSNR/

BSNV challenge Cycle GAN model's feature transformer SSIM
Chaitanya dataset, NYU- translates encoded features
Depth and into desirable feature space, 20.05
(2021) reside beta which would then be sent into / 0.83070
datasets. the CycleGAN decoder to
[12] create a clear image.

• They did not assess the

atmospheric dissipating model
parameters
Conclusion
This paper gives a comprehensive study of
supervised and unsupervised picture
dehazing algorithms. We introduced the
relationship between the design of the
dehazing models and explicit data types. Our
research indicates that the suggested learning
technique is not limited to synthetic training
datasets and can be applied to real-world
images with ease. Furthermore, it has the
potential to increase its performance further,
bringing it closer to the state of the art when
compared to supervised deep image dehazing
approaches. Conclusively, we pointed out
the issues worthy of attention in the future
of dehazing research have been restricted over
single images and no efforts have been put into
working on noise reduction in underwater
imaging or videos in general.
References
1. Rashid, Huzaifa, Nauman Zafar, M. Javed
Iqbal, Hassan Dawood, and Hussain Dawood. "Single
image dehazing using CNN." Procedia Computer
Science 147 (2019): 124130.
2. Dudhane, Akshay, and Subrahmanyam
Murala. "Cdnet: Single image de-hazing using
unpaired adversarial training." In 2019 IEEE Winter
Conference on Applications of Computer Vision
(WACV),pp. 1147-1155. IEEE, 2019.
3. Zhang, Xiaoqin, Tao Wang, Wenhan Luo,
and Pengcheng Huang. "Multi-level fusion and
attention-guided CNN for image dehazing." IEEE
Transactions on Circuits and Systems for Video
Technology 31, no. 11(2020): 4162-4173.
4. Ren, Wenqi, Jinshan Pan, Hua Zhang,
Xiaochun Cao, and Ming-Hsuan Yang."Single image
dehazing via multi-scale convolutional neural
networks with holistic edges." International Journal
of Computer Vision 128, no. 1 (2020): 240-259.
5. Li, Chongyi, Chunle Guo, Jichang Guo, Ping
Han, Huazhu Cong. "PDR-Net: Perception- inspired
single image dehazing network withrefinement." IEEE
Transactions on Multimedia 22, no. 3 (2019): 704-
716.
6. Deng, Qili, Ziling Huang, Chung-Chi Tsai,
and Chia-Wen Lin. "Hardgan: A haze- aware
representation distillation gan for single image
dehazing." In European Conference on
Computer Vision, pp 722- 738. Springer, Cham,
2020.
7. Hassan, Haseeb, Bin Luo, Qin Xin, Rashid
Abbasi, and Waqas Ahmad. "Single Image Dehazing
from Repeated Averaging Filters." In 2019 IEEE 8th
Joint International Information Technology and
Artificial Intelligence Conference (ITAIC), pp. 1053-
1056. IEEE, 2019.
8. Salazar-Colores, Sebastián, Juan-Manuel
RamosArreguín, Jesus-Carlos Pedraza- Ortega, and
Juvenal Rodríguez-Reséndiz. “Efficient single image
dehazing by modifying the dark channel prior.”
EURASIP Journal on Image and Video Processing
2019, no. 1 (2019): 1-8.
9. Li, Lerenhan, Yunlong Dong, Wenqi Ren, Jinshan
Pan, Changxin Gao, Nong Sang, and Ming-Hsuan
Yang. "Semisupervised image dehazing." IEEE
Transactions on Image Processing 29 (2019): 2766-
2779.
10. Li, Zhihui, Bian Gui, Tong Zhen, and Yuhua Zhu.
"Grain depot image dehazing via quadtree
decomposition and convolutional neural networks."
Alexandria Engineering Journal 59, no. 3 (2020):
1463-1472.
11. Li, Boyun, Yuanbiao Gou, Jerry Zitao Liu,
Hongyuan Zhu, Joey Tianyi Zhou, and Xi Peng. "Zero-
shot image dehazing." IEEE Transactions on Image
Processing 29 (2020): 8457-8466.
12. Chaitanya, B. S. N. V., and Snehasis Mukherjee.
"Single image dehazing using improved cycleGAN."
Journal of Visual Communication and Image
Representation 74 (2021): 103014.
13. Sharma, Ruchika and Dr. Vinay Chopra. “A
Review on Different Image Dehazing Methods.”
(2014).
14. Patel, Shruti and Manish Nakrani. “A Review on
Methods of Image Dehazing.” International Journal
of Computer Applications 133 (2016): 44-49.
15. McCartney EJ. Optics of the atmosphere:
scattering bymolecules and particles. N Y John Wiley
Sons Inc 1976 421P. 1976.
16. Current Issues on Single Image Dehazing
Method”, International Journal of Computer
Engineering In Research Trends, 5(2): pp:
37-49, February-2018.