Infrared Image Quality Assessment using

Convolutional Neural Network

Engr. Bilal Ahmed

21-MS-EE-63

Supervisor
Dr. Gulistan Raja

Department of Electrical Engineering

Problem Statement
 Assessing image quality is of fundamental importance due in
part to massive expansion of large infrared image volume.
 The demand of better image quality for infrared images has
increased, however due to lack of proper focus of devices,
results in poor quality images that affects the analysis and
decision making.
 Therefore, need of an image quality assessment model arises
that accurately evaluate the quality of infrared images for
better performance and decision making.

Department of Electrical Engineering

Aims & Objectives

 Aim
Our aim is to identify the quality of infrared images using an
image quality assessment model and classification of these
images according to its quality using Deep learning.
 Objectives
 To Preprocess infrared image dataset for quality assessment.
 To train image quality assessment model using Convolutional
Neural Network.
 To classify real time infrared images into classes according to
image quality.

Department of Electrical Engineering

Literature Review
References Authors Title year Method Dataset
Type
[1] Y. Li, X. Ye, and Image quality assessment 2017 Deep Convolutional Neural LIVE IQA &
Y. Li using deep convolutional Network TID2008
networks
[4] S. Bianco, L. On the use of deep learning 2017 Deep Convolutional Neural LIVE, CSIQ,
Celona, P. for blind image quality Network TID2008, &
Napoletano, and assessment TID2013
R. Schettini

[9] S. Bosse, D. Deep Neural Networks for 2018 Deep Convolutional Neural LIVE, CSIQ,
Maniry, K. -R. No-Reference and Full- Network & TID2013
Müller, T. Reference Image Quality
Wiegand and W. Assessment
Samek
[10] H. Talebi and P. NIMA: Neural Image 2018 Deep Convolutional Neural AVA
Milanfar Assessment Network &TID2013
[12] W. Zhang, K. Blind Image Quality 2020 Deep Convolutional Neural Waterloo
Ma, J. Yan, D. Assessment Using a Deep Network Exploration,
Deng, and Z. Bilinear Convolutional & PASCAL
Wang Neural Network VOC

Department of Electrical Engineering

 Literature Review
Cutting edge papers for research:
 M. Rajchel and M. Oszust introduced in 2020 [13], a new large benchmark
database, containing naturally distorted images captured with a digital camera,
along with a new NR-IQA metric.
 The experimental comparison of the method with the NR techniques on the
introduced dataset reveals its superior performance, in terms of typically used
evaluation criteria.

 C. Yan et al. presented a novel scheme for precise NR IQA (no reference
image quality Assessment) in 2021 [14]. (Base Paper)
 The scheme has two steps i.e., distortion identification and quality evaluation.
 Inception-ResNet-v2 is used for image distortion identification and quality evaluation.
 LIVE, TID2013, CSIQ, and Waterloo Exploration databases used to demonstrate the
model.

 A. Rubel et al. described three approaches for the development and

optimization of no reference combined metric and dataset of images containing
distortions typical for remote sensing in 2022 [15].
 The design combines NR metrics using NN and weighted sum/product-based
approaches with application to distortions typical for three-channel RS images.

Department of Electrical Engineering

Challenges
 Classifier for image quality assessment.
 Classifying images according to their quality for applications in
remote sensing technologies etc.

Selected Avenue
The purpose of this research is to train image quality
assessment model using large infrared image dataset using
deep learning. Different deep learning algorithms and classifiers
from literature to classify images according to their quality will be
reviewed [13].

Department of Electrical Engineering

Methodology of Research
 Theoretical Studies:
 Literature review related to reference less image quality
assessment and its implementation will be accomplished to
make clear sense of the model to classify the infrared image
into classes according to their quality using deep learning
algorithm.
 In-depth knowledge is made of the different methods and
variants to identify the quality of image using deep learning.

Department of Electrical Engineering

Methodology of Research
 Experimental Setup:
 Datasets which will be used for infrared image quality
Assessment is BIRDSAI (Benchmarking IR Dataset for
Surveillance with Aerial Intelligence).
 The dataset with the ground truth is freely available online
 Analysis and modeling of the system will be implemented on
GPU.
 Tools required for modeling the setup will be Google Colab,
PyCharm and Jupyter-Notebook programming software.
 Python will be used for programming analysis.

Department of Electrical Engineering

Methodology of Research

Method of Analysis
The dataset will be split into training, validating and testing data.
To find the quality of infrared image, Sobel filter will be used that
determines the sharpness of image.

Where:
G is the gradient magnitude for determining the sharpness in the image.
Gx and Gy are the horizontal and vertical gradient approximation.
Convolutional neural network will be used for training the image
quality assessment model.

Department of Electrical Engineering

Method of Analysis

Department of Electrical Engineering

Method of Analysis
The classification model will be able to classify the images into following
classes according to their quality.
 Excellent
 Good
 Poor
One way to evaluate how frequently a deep learning classification algorithm
classifies a data correctly is to look at the algorithm’s accuracy.

Where:
 TP is True Positive
 TN is True Negative
 FP is False Positive
 FN is False Negative
These are the parameters used in evaluation of accuracy of the model.

Department of Electrical Engineering

Expected Results
 We expect an accurate image quality assessment model that
 Will classify infrared images into different classes according to their
image quality
 Performance of the model by finding its accuracy.

Department of Electrical Engineering

Utilization of Research Results
 The results of this research can be utilized to monitor the
image quality in control quality system.
 It can be utilized in field of remote sensing applications for
studying climate changes and for the CCTV camera for object
detection.
 It can also be utilized to benchmark the infrared images in
field of image processing system.

Department of Electrical Engineering

 References
[1] Y. Li, X. Ye, and Y. Li, “Image quality assessment using deep convolutional networks,” AIP
Advances, vol. 7, no. 12, p. 125324, Dec. 2017.
[2] X. Liu, J. van de Weijer, and A. D. Bagdanov, “RankIQA: Learning From Rankings for No-
Reference Image Quality Assessment,” in Proceedings of the IEEE International Conference on
Computer Vision (ICCV), Jul. 2017, pp. 1040-1049
[3] K. Gu, J. Zhou, J.-F. Qiao, G. Zhai, W. Lin, and A. C. Bovik, “No-Reference Quality Assessment
of Screen Content Pictures,” IEEE Transactions on Image Processing, vol. 26, no. 8, pp. 4005–4018,
Aug. 2017.
[4] S. Bianco, L. Celona, P. Napoletano, and R. Schettini, “On the use of deep learning for blind
image quality assessment,” Signal, Image and Video Processing, vol. 12, no. 2, pp. 355–362, Aug.
2017.
[5] X. Min, K. Ma, K. Gu, G. Zhai, Z. Wang, and W. Lin, “Unified Blind Quality Assessment of
Compressed Natural, Graphic, and Screen Content Images,” IEEE Transactions on Image
Processing, vol. 26, no. 11, pp. 5462–5474, Nov. 2017.
[6] P. Garcia Freitas, W. Y. L. Akamine, and M. C. Q. Farias, “Referenceless image quality
assessment by saliency, color-texture energy, and gradient boosting machines,” Journal of the
Brazilian Computer Society, vol. 24, no. 1, Aug. 2018.
Department of Electrical Engineering
References
[7] X. Min, G. Zhai, K. Gu, Y. Liu, and X. Yang, “Blind Image Quality Estimation via Distortion
Aggravation,” IEEE Transactions on Broadcasting, vol. 64, no. 2, pp. 508–517, Jun. 2018.
[8] K. Gu, D. Tao, J.-F. Qiao, and W. Lin, “Learning a No-Reference Quality Assessment Model of
Enhanced Images With Big Data,” IEEE Transactions on Neural Networks and Learning Systems, vol.
29, no. 4, pp. 1301–1313, Apr. 2018.
[9] S. Bosse, D. Maniry, K. -R. Müller, T. Wiegand and W. Samek, "Deep Neural Networks for No-
Reference and Full-Reference Image Quality Assessment," in IEEE Transactions on Image
Processing, vol. 27, no. 1, pp. 206-219, Jan. 2018
[10] H. Talebi and P. Milanfar, “NIMA: Neural Image Assessment,” IEEE Transactions on Image
Processing, vol. 27, no. 8, pp. 3998–4011, Aug. 2018.
[11] K. Ma, W. Liu, K. Zhang, Z. Duanmu, Z. Wang, and W. Zuo, “End-to-End Blind Image Quality
Assessment Using Deep Neural Networks,” IEEE Transactions on Image Processing, vol. 27, no. 3,
pp. 1202–1213, Mar. 2018.
[12] W. Zhang, K. Ma, J. Yan, D. Deng, and Z. Wang, “Blind Image Quality Assessment Using a
Deep Bilinear Convolutional Neural Network,” IEEE Transactions on Circuits and Systems for Video
Technology, vol. 30, no. 1, pp. 36–47, Jan. 2020.

Department of Electrical Engineering

References

[13] M. Rajchel and M. Oszust, “No-reference image quality assessment of authentically distorted
images with global and local statistics,” Signal, Image and Video Processing, Jun. 2020.
[14] Chenggang Yan, Tong Teng, Yutao Liu, Yongbing Zhang, Haoqian Wang, and Xiangyang Ji,
“Precise No-Reference Image Quality Evaluation Based on Distortion Identification,” in ACM
Transactions Multimedia Computing, Communications, and Applications, vol. 17, no. 3, pp.1-21, Oct.
2021.
[15] A. Rubel, O. Ieremeiev, V. Lukin, J. Fastowicz, and K. Okarma, “Combined No-Reference Image
Quality Metrics for Visual Quality Assessment Optimized for Remote Sensing Images,” Applied
Sciences, vol. 12, no. 4, p. 1986, Jan. 2022.

Department of Electrical Engineering

Q&A

Thank you

Department of Electrical Engineering