Professional Documents
Culture Documents
Research Paper 3
Research Paper 3
Research Paper 3
a r t i c l e i n f o a b s t r a c t
Keywords: This article is mainly focused to accurately detecting any abnormality of heart if present using echocardiographic
Artificial neural network image of the patient. Heart abnormalities are now a days very common not only in India but all over the globe
Classification irrespective of age and gender. The detection of abnormality is achieved by using Artificial neural network (ANN)
Discrete Wavelet transform filters
Classifier. However, processing of the image is achieved through preprocessing, segmentation, feature extraction
Feature extraction
and then achieving classification. Processing of image for removal of noise and enhancement is carried out as
Level set segmentation
Preprocessing Preprocessing of image followed by segmentation. The most significant processing task is segmentation which is
Segmentation discussed in detail and preferable algorithm which overcomes the drawbacks and limitations of previous algo-
rithms is proposed. This algorithm is a solution to all problems faced in previous algorithms. carried out using
different techniques, three different segmentation techniques are discussed where algorithm proposed Reaction
Diffusion Level Set Segmentation (RDLSS) is better than other three methods also overcome the problems faced in
previous algorithms, then feature extraction is done to extract energy features where the novelty of the research
is use of symlet, Debauches and Bio orthogonal filters for feature extraction and these features are used to classify
the images as normal or abnormal using ANN classifier. The ANN classifier is effective and efficient resulting in
accuracies of greater than 98%. The results are also clinically validated by doctors.
1. Introduction choice of features for biomedical applications. The three filters used in
proposed methodology are Symlet filters, Debauches filter and Bio or-
Processing of Echocardiographic images is very essential for disease thogonal filters. The use of this combination of three different filters is
detection and diagnosis. Various processing techniques have been dis- novel approach in the research. Lastly ANN classifier is used for classi-
cussed in the previously published papers like Preprocessing [1], seg- fication of given input images into normal or abnormal.
mentation [2], feature extraction and classification [3]. Each processing The remaining paper is organized in the following sections: Section
approach used in research for optimization is discussed in methodology 2 specifies the related work. Preprocessing, segmentation, feature ex-
section. traction and classification are discussed in Section 3 in Methodology
The main aim of the paper is as follows: Preprocessing: The in- section. Section 4 discusses results and Section 5 is conclusion.
put echocardiographic image is preprocessed [4–6] so as to remove
inherent noise using appropriate filters the filters used for preprocess- 2. Related work
ing in the research are fractional order filters. Segmentation of the de-
noised/enhanced image is carried out using level set segmentation (LSS) In [1] authors discussed denoising algorithm for noise removal in
[7] techniques which is considered as preferable and popular method of echocardiographic images again the filter used for denoising is a frac-
segmentation. Four different LSS techniques discussed in methodology tional order integral filter. In [2] authors have discussed 10 different
section i.e. (Conventional Level set segmentation (LSS), Re- Initializa- segmentation techniques used in last one decade in Comparative Anal-
tion LSS [8], Distance Regularized level set evolution (DRLSE), DRLSE1, ysis of various image segmentation techniques. Earlier many researches
DRLSE2, and DRLSE3 [9] respectively for three different rates and lastly have proposed classification techniques for heart abnormalities [3, 11].
proposed method of segmentation Reaction diffusion LSS) [10]. Feature Medical image resolution enhancement is done in [4] where authors fo-
extraction is done so as to extract energy features which are the best cus on wavelet transform which is dual tree complex wavelet transform
and singular value decomposition (SVD) is used as basis algorithm. In
∗
Corresponding author. Tel.: +0-805-040-1459
E-mail address: ayeshaheena31@gmail.com (A. Heena).
https://doi.org/10.1016/j.gltp.2022.04.003
3.2. Preprocessing
3.3. Segmentation
14
A. Heena, N. Biradar, N.M. Maroof et al. Global Transitions Proceedings 3 (2022) 13–19
of the partial derivative is considered for update. This should be con- i.e., Eq. (5) gives the familiar level set equation:
sidered in the context of Rprop which has great utility in practice and 𝜕𝜙
constitutes the stoutness of its parameters. Rprop is applied in many ap- = −𝑔(𝑥, 𝑦)|∇𝜙| (5)
𝜕𝑡
plications wherein only standard values of its parameters are used. A
In Level Set Segmentation (LSS) process, altogether three LSS meth-
brief description of Rprop is now attempted for which a search value is
ods are discussed and analysed. Finally, a novel reaction-diffusion level
chosen, represented by Eq. (2)
set segmentation is proposed which can estimate the problems of the
𝑠𝑙 = −𝑠𝑖𝑔𝑛(∇𝑓𝑙 ) ∗ ∇𝑙 (2) conventional level set segmentation methods.
where ∇l is a vector containing the current update values and sign (•) 3.3.1. Conventional LSS
is the element wise sign function. Approach to segmentation problem In the conventional LSS, consider a closed parameterized planar
is possible through application of calculation of the variations wherein curve or surface which is denoted by C (y, t): [0,1]x R+ to Rn , where
the energy functions is defined using the Euler language equation. This n=2 for planar curve and n=3 for surface and t is the artificial time gen-
finds use in the derivation of motion equation and the corresponding erated by the movement of the initial curve or surface, C0 (y) and its
energy gradients for the contour. Use of these gradients in segmentation inward normal direction is 𝑁̄ . The curve or surface evolution equation
applications are performed in contour space for gradient descent search. is as follows as given in Eq. (6).
The following function in Eq. (3) describes derivation of the weighted {
𝐶(𝑦, 𝑡 = 0) = 𝐶0 (𝑦)
region. (6)
𝐶𝑡 = 𝐹 𝑁
𝑓 (𝑝) = 𝑔(𝑥, 𝑦)𝑑 𝑥𝑑 𝑦 (3) where F is the force function
∫ ∫
Ω𝑝 In the above equation, the intrinsic drawback of interactively solving
Eq. (6) consists difficulty in handling splitting and merging because of
Where p represents 1D curve embedded in a 2D space, Ωp is the region
the topological changes of the moving front. This problem is resolved in
inside of p, and g (x, y) is a scalar function. These function finds use in
level set method (LSM) by modification of above equation and Eq. (7) is
maximizing quantity given by g (x, y) inside p. The area is maximum
obtained by taking the derivative of above equation w.r.t time t on the
when g (x, y) = 1. Calculating the first variation of above equation i.e.,
both sides, yielding the following equation.
Eq. (4) yields the evolution equation: {
𝜑𝑡 + ∇𝜑 .𝐶𝑡 = 𝜑𝑡 + Δ𝜑 .𝐹 𝑁 = 0
𝜕𝑝 (7)
= −𝑔(𝑥, 𝑦)𝜂 (4) 𝜑(𝑥, 𝑡 = 0) = 𝜑0 (𝑥)
𝜕𝑡
𝜕(.) 𝜕(.)
where 𝜂 is the curve normal using g (x, y) = 1 and it is the constant where gradient operator ∇(.) = ,
𝜕 𝑥1 𝜕 𝑥2
, ..... 𝜕𝜕(𝑥.) and 𝜑0 (𝑥)𝑖𝑠the initial
𝑛
flow in the negative normal direction. Implicit representation of the con- LSF𝐶0 (𝑦) = {𝑥|𝜑0 (𝑥) = 0}, but problem with Eq. (7) is it doesn’t work
tour is often done by level set function which is in turn defined as the for very flat or very steep near the zero-level set. The Re initialization
zero level of a time dependent signed distance function. A contour p is is so introduced to address this issue.
formally described by p = {x: 𝜑 (x, t) = 0}. The contour p is evolved
in time using a set of partial differential equations (PDEs). Generally 3.3.2. Re-initialization LSS
speaking, translation of a motion equation for a parameterized curve In the above-mentioned process of evolution serious numerical errors
𝜕𝑝
𝜕𝑡
= 𝛾𝜂 is done into the level set equation 𝜕𝜙
𝜕𝑡
= 𝛾|∇𝜙| below equation occur. As a solution to the problem, a procedure called re-initialization
15
A. Heena, N. Biradar, N.M. Maroof et al. Global Transitions Proceedings 3 (2022) 13–19
16
A. Heena, N. Biradar, N.M. Maroof et al. Global Transitions Proceedings 3 (2022) 13–19
Table 2
Sub band type and energy values for dataset of 43 images.
Database Images Db3:cH1 Db3:cV1 Sym3:cH2 Sym3:cV2 Rbio3.3: cH3 Rbio3.3: cD3
reaction function must produce a binary valued function with values Table 2 as Rbio values these values in addition to horizontal and verti-
0 and 1. The diffusion function then becomes pragmatic to the binary cal direction also has diagonal values for all three vanishing moments
function for producing a curvature dependent motion, which is not the as shown in Table 2.
same as used for curvature reliant motion. The Level set evolution (LSE)
is drawn by the reaction function using the LSE equation.
3.5. Classification
3.4. Feature Extraction
The energy feature values extracted from above step are given as in-
put to ANN. Classification requires reference data for training. The train-
Discrete wavelet transform (DWT) filters are used in the proposed
ing of ANN is achieved by two set of values called reference data/values
methodology for feature extraction. Three DWT filters are applied for
in terms of energy. One set of values are for normal classification and
feature extraction. The novelty is all these are applied to extract fea-
other set for abnormal classification of images. This reference values
tures corresponding to four different directions at 0-degree, 90-degree,
are compared with input values to detect whether given values match
180 degree and 360 degrees. The filters are 1. Symlet filter, 2. Debauches
the trained reference for normal or abnormal and accordingly output
filter and 3. Bio orthogonal filter. All these three filters are applied on
of ANN is either normal or abnormal. Table 1 gives the classification
each image in the dataset in four different directions one by one so that,
output for all 43 images in the dataset.
maximum image area is covered and there is no loss of information
content in the image. All these filters extract energy features. The clas-
sification results are shown in Table 1. Tables 2 and 3 gives overview 4. Results
of filtering and its application. The energy values extracted using Sym-
let filter is Esym, sym values are obtained for both horizontal and ver- The experimental setup used for implanting the proposed work was
tical directions SymcH and SymcV as shown in Table 3. Similarly, Db successfully analysed using a dataset of 43 echocardiographic images
denotes values corresponding to Debauches filter Db values are also ob- out of 43 many images were abnormal and few were normal as given
tained in both horizontal and vertical direction as DbcH and DbcV then in Table 1. The accuracy of classification was almost 99%. Accuracy be-
Bio orthogonal filter further has three sub functions corresponding to ing most significant performance metric frequently used for analysing
three vanishing moments at 3.3, 3.5 and 3.7 accordingly given in the classification task which is measured as ratio of accurate predictions
17
A. Heena, N. Biradar, N.M. Maroof et al. Global Transitions Proceedings 3 (2022) 13–19
Table 3
Sub band type with energy values.
Database Images Rbio3.3: cV3 Rbio3.5: cH4 Rbio3.5: cD4 Rbio3.5: cV4 Rbio3.7: cH5 Rbio3.7: cV5 Rbio3.7: cD5 Rbio3.7: cV5
Table 4 5. Conclusion
Comparative table of state-of-the-art-methods.
Method Accuracy Sensitivity Specificity Precision The proposed method of processing implemented for detection and
classification of echocardiographic images into normal and abnormal
K. Zhang et al (2013) 0.84 0.89 0.91 0.48
involves four processes: Pre-processing, Segmentation, feature extrac-
T. Chiara et al (2008) 0.87 0.85 0.89 0.82
J.P. Zhang et al (2014) 0.63 0.91 0.92 0.85 tion and Classification. It is concluded that all processing is carried out
Proposed method 0.93 0.91 0.95 0.90 efficiently and resulted in very good accuracy of detection and classifi-
cation. The ANN classifier was trained with set of two references cor-
responding to normal and abnormal energy values, tested successfully.
Detection of heart abnormality is very important if this is possible, can
to total observations. Other performance parameters include sensitiv- save lives by initiating early and proper treatment. This could also be
ity, specificity and precision. All other performance parameters are also an aid to doctors for early and accurate diagnosis which is need of the
giving good results. The results of detection and classification are val- hour. As it is known fact precaution is better than cure if diagnosis and
idated by doctor, are able to accurately detect abnormality if present prognosis is done accurately it leads to correct treatment and hence con-
from the echo images and classify them as abnormal images and oth- sequently reducing risk of death due to critical conditions.
ers as normal images. The practical implications of the proposed paper
are it can assess doctors in diagnosis and early detection of abnormality Declaration of Competing Interest
can result in early treatment. Moreover, it can reduce the time taken
by doctors for diagnosis as result of detection and classification is quite The Authors declare that they have no Conflicts of Interest.
fast. Also, since echocardiography is non-invasive there are no side ef-
fects. Thus, it helps reduce mortality rate due to heart abnormalities in Acknowledgments
patients.
Table 4 give comparative table in terms of performance metric which The authors would like to Acknowledge BKIT Bhalki, KBNCE,
includes accuracy, sensitivity, specificity and precision and it reveals Visveswaraya Technological University, Belagavi, Karnataka INDIA. The
proposed method exhibits better performance than others. Authors declare that they have no Conflicts of Interest.
18
A. Heena, N. Biradar, N.M. Maroof et al. Global Transitions Proceedings 3 (2022) 13–19
References [16] J.P. Nayak, B.D. Parameshachari, K.S. Soyjaudah, R. Banu, A.C. Nuthan, Identi-
fication of PCB faults using image processing, in: 2017 International Conference
[1] A. Heena, N. Biradar, N.M. Maroof, Design and implementation of Fractional Order on Electrical, Electronics, Communication, Computer, and Optimization Techniques
Integral Filter for denoising of Echocardiographic images, in: Published in Elsevier (ICEECCOT), IEEE, 2017, pp. 1–4.
SSRN, ISMAC CVB 2020 as Conference Proceedings, 2020 Elsevier SSRN. [17] J.P. Zhang, K. Chen, B. Yu, D.A. Gould, A local information based variational model
[2] B.D. Parameshachari, H.T. Panduranga, Medical image encryption using SCAN tech- for selective image segmentation, Inver. Probl. Imag. 1 (1) (2014) 293–320.
nique and chaotic tent map system, in: Recent Advances in Artificial Intelligence and [18] E.A. Ashton, K. Parker, Multiple resolution Bayesian segmentation of ultrasound
Data Engineering, Springer, Singapore, 2022, pp. 181–193. images, Ultrason. Imag. 17 (4) (Oct. 1995) 291–304.
[3] A. Heena, N. Biradar, N.M. Maroof, “Comparative Analysis of various image segmen- [19] S. Madhu, B.D. Parameshachari, N. Joe, H.S. DivakaraMurthy, Color retinal image
tation techniques, published in Book titled “A collection of contemporary research analysis for automated detection and severity of exudates, Int. J. Adv. Res. Comput.
articles in Electronics, Communication and Computation” under Image and Signal Sci. 4 (10) (2013).
processing Track. NCECC 2020 NIT Jamshedpur ISBN: 978-81-948050-7-6. [20] N. Paragios, M.P. Jolly, M. Taron, R. Ramaraj, Active shape models & segmenta-
[4] A. Heena, N. Biradar, N.M. Maroof, Neural Network based classification of echocar- tion of the left ventricle in echocardiography, in: in Int. Conf. Scale Space Theories
diographic images, LINO J. 11 (2022) Issue-1-2020-S.NO.27. and PDEs methods in Computer Vision, ser. Lect. Note Comput. Sci, 3459, 2005,
[5] T.N. Nguyen, N.P. Nguyen, C. Savaglio, Y. Zhang, B. Dumba, The role of artificial pp. 131–142.
intelligence (AI) in healthcare data analytics, Int. J. Artifi. Intell. Tool. 30 (06 N 08) [21] N. Lin, W.C. Yu, J.S. Duncan, Combinative multi-scale level set framework for echo
(2021). cardiographic image segmentation, in: in MICCAI, ser. Lect. Note Comput. Sci, 2488,
[6] M.Z. Iqbal, A. Ghafoor, A.M. Siddiqui, M.M. Riaz, U. Khalid, Dual-tree complex Tokyo, Japan, 2002, pp. 682–689.
wavelet transform and SVD based medical image resolution enhancement, Signal [22] M.K. Chowdary, T.N. Nguyen, D.J. Hemanth, Deep learning-based facial emotion
Process. 105 (2014) 430–437. recognition for human–computer interaction applications, Neur. Comput. Applica.
[7] A. Pizurica, W. Philips, I. Lemahieu, M. Acheroy, A versatile wavelet domain noise (2021) 1–18.
filtering technique for medical imaging, IEEE Transact. Med. Imag. 22 (3) (2003) [23] C. Haas, H. Ermert, S. Holt, P. Grewe, A. Machraoui, J. Barmeyer, Segmentation of
323–331. 3D intravascular ultrasonic images based on a random field model, Ultrasound Med.
[8] K. Yu, L. Tan, L. Lin, X. Cheng, Z. Yi, T. Sato, Deep-learning-empowered breast cancer Biol 26 (2) (Feb. 2000) 297–306.
auxiliary diagnosis for 5GB remote E-health, IEEE Wirel. Commun. 28 (3) (2021) [24] F. Gaudreault, P. Delachartre, G. Finet, I.E. Magnin, Modelization and segmentation
54–61. of intravascular ultrasound images, Traitement du Signal 17 (5-6) (2000) 517–533.
[9] B. Jayachandran, J. Jaganath, G.F. Sudha, Adaptive speckle reduction in ultrasound [25] A. Sarti, E. Mazzini, C. Corsi, C. Lamberti, Maximum likelihood segmentation of
images using fuzzy logic on coefficient of variation, Biomed. Signal Process Control ultrasound images with Rayleigh distribution, IEEE Trans. Ultra. Fer. Freq. Control
23 (2016) 93–103. 52 (6) (June 2005) 974 –960.
[10] T.D. Ngo, T.T. Bui, T.M. Pham, H.T. Thai, G.L. Nguyen, T.N. Nguyen, Image deconvo- [26] H.A. Li, J. Fan, K. Yu, X. Qi, Z. Wen, Q. Hua, . . . Q. Zheng, Medical image color-
lution for optical small satellite with deep learning and real-time GPU acceleration, ing based on gabor filtering for internet of medical things, IEEE Access 8 (2020)
J. Real-Time Image Process. 18 (5) (2021) 1697–1710. 104016–104025.
[11] C. Baillard, C. Barillot, Robust 3D segmentation of anatomical structures with level [27] D. Boukerroui, A. Baskurt, J.A. Noble, O. Basset, Segmentation of ultrasound images
sets, in: MICCAI, ser. Lect. Note Comput. Sci, 1935, Pittsburgh, Pennsylvania, USA, - multiresolution 2D and 3D algorithm based on global and local statistics, Pattern
2000, pp. 236–245. Recognition. Lett. 24 (4-5) (Feb. 2003) 779–790.
[12] K. Zhang, K. Zhang, H. Song, D. Zhanf, Re-Initialization free level set evolution via [28] T. Chiara, A. Ray, A New Measure using intuitionistic fuzzy set theory and its appli-
reaction diffusion, IEEE Transact. Image Process. 22 (2013) 258–271. cation to edge detection, Appl. Soft Comput. 8 (2008) 919–927.
[13] F. Shao, K.V. Ling, W.S. Ng, Automatic 3D prostate surface detection from TRUS [29] I. Larrabidi, R. Feijoo, A. Novotny, An Image segmentation method based on discrete
with level sets, Int. J. Image Graphics 4 (3) (July 2004) 385–403. version of topological derivative, in: world congress structural and multidisciplinary
[14] F. Ding, K. Yu, Z. Gu, X. Li, Y. Shi, Perceptual enhancement for autonomous vehicles: optimization, 2005, pp. 01–11.
restoring visually degraded images for context prediction via adversarial training, [30] A. Heena, A. Heena, N. Biradar, NM Maroof, A novel approach to review various im-
IEEE Transact. Intell. Transport. Syst. (2021). age segmentation techniques, IJIRCCE 5 (Special Issue 4) (June 2017) ISSN(Online):
[15] A. Heena, N. Biradar, NM Maroof, “Chapter 2 machine learning based detection and 2320-9801, ISSN (Print): 2320-9798.
classification of heart abnormalities”, International Conference on Image Processing [31] A. Heena, N. Biradar, N.M. Maroof, Comparative analysis of fractional order calculus
and Capsule Networks (ICIPCN) –2021 Springer Science and Business Media LLC, in image processing, In proceedings of ICAIT in IEEE digital explore, 2020.
2nd International Conference on Image Processing and Capsule Networks (ICIPCN),
2022.
19