Professional Documents
Culture Documents
3D Brain Slice Classification and Feature Extraction 2022 Computers in Biol
3D Brain Slice Classification and Feature Extraction 2022 Computers in Biol
A R T I C L E I N F O A B S T R A C T
Keywords: Brain tumors are the most frequently occurring and severe type of cancer, with a life expectancy of only a few
Brain tumors months in most advanced stages. As a result, planning the best course of therapy is critical to improve a patient’s
MRI ability to fight cancer and their quality of life. Various imaging modalities, such as computed tomography (CT),
3D tumor
magnetic resonance imaging (MRI) and ultrasound imaging, are commonly employed to assess a brain tumor.
VOI
This research proposes a novel technique for extracting and classifying tumor features in 3D brain slice images.
DHHM-DDRN
After input images are processed for noise removal, resizing, and smoothening, features of brain tumor are
extracted using Volume of Interest (VOI). The extracted features are then classified using the Deformable Hi
erarchical Heuristic Model-Deep Deconvolutional Residual Network (DHHM-DDRN) based on surfaces, curves,
and geometric patterns. Experimental results show that proposed approach obtained an accuracy of 95%, DSC of
83%, precision of 80%, recall of 85%, and F1 score of 55% for classifying brain cancer features.
1. Introduction invasively examine the brain. Specifically, MRI images yield a huge
volume of spatial brain structure information and the anatomy of soft
Brain tumors are produced by uncontrolled accumulation of tissue that are pertinent for medical diagnosis. The picture intensity of
cancerous tissue that can be implanted in various parts of the brain, an MRI image affects four specifications: the density of protons (PD),
which can drastically affect the body’s responsive functioning. These which is governed by relative water molecule concentration; and T1, T2,
tumors are considered one of the most dangerous and complicated types and T2* relaxation, which indicate different local properties of indi
to diagnose and treat [2]. There are 2 sorts of tumors: benign as well as vidual protons [4].
malignant tumors. While benign tumors are typically harmless, they can In cancer detection, treatment planning, and treatment outcome
harm the brain’s healthy tissue if they continue to grow then it turns into estimation, early detection via proper grading as well as classification of
cancer cells. Brain cancer is defined by malignant tumors that grow brain tumors is critical. Despite contemporary medical technological
within the brain [1]. A glioma refers to a tumor that develops in glial improvements, histological examination of biopsy specimens is still
cells, which are the most abundant cells in the central nervous system performed to diagnose, classify, and grade brain cancers [5]. To attain a
that surround and insulate the neurons [3]. While meningiomas are final diagnosis, clinical examination as well as interpretation of imaging
usually benign, a small percentage of them are malignant and are more modalities like MRI or CT, followed by pathological tests, are routinely
common in those aged 45–55 years. Over the past two decades, performed. However, this process is invasive, time-consuming, and
groundbreaking approaches and computer-aided methods for the seg prone to sampling errors. Using computer-aided and entirely automated
mentation of brain tumors have gradually emerged to better classify detection as well as diagnosis systems to obtain rapid and accurate
brain tumors. classification, it is possible for physicians and radiologists to make more
Imaging technology is crucial in diagnosis and treatment of brain accurate diagnoses in a shorter time. Precision labelling of MRI image
tumors. Doctors and researchers often utilize CT scans and MRIs to non- pixels is needed for accurate MRI segmentation, which is used to detect
* Corresponding author.
E-mail address: gandomi@uts.edu.au (A.H. Gandomi).
https://doi.org/10.1016/j.compbiomed.2022.105990
Received 26 May 2022; Received in revised form 7 August 2022; Accepted 14 August 2022
Available online 20 August 2022
0010-4825/© 2022 Elsevier Ltd. All rights reserved.
R. Sekaran et al. Computers in Biology and Medicine 149 (2022) 105990
contaminated tumor tissues and subsequently determine the optimal classifier. In Ref. [24], the classification of brain MR images is based on
treatment and radiation therapy [6]. FFNN classifiers and rough set theory. The authors of [25] proposed an
The process of this research is described as follows: SVM-based hybrid method for detecting brain tumors in MR images,
which applies features of texture and intensity.
• To accurately predict brain tumors in 3D images, the proposed sys
tem performance was improved by adding additional class identifi 3. Proposed model
cations to gain more data about type of brain tumor, enhance the
quantity of training and test data, and thereby obtain more accurate This section discusses proposed design of brain tumor feature
results so that a better cancer prognosis can be made. extraction and classification method using deformable models inte
• The features in the region of the tumor processed brain image were grated with DL methods. Overall proposed architecture is given in Fig. 1.
extracted using Volume of Interest (VOI). After input images are processed for noise removal, resizing, and
• The extracted image was classified using the Deformable Hierarchi smoothening, features of brain tumor are extracted using Volume of
cal Heuristic Model-based Deep Deconvolutional Residual Network Interest (VOI). The extracted features are then classified using the
(DHHM-DDRN) Deformable Hierarchical Heuristic Model-Deep Deconvolutional Resid
• A parametric analysis was conducted to evaluate and compare the ual Network (DHHM-DDRN) based on surfaces, curves, and geometric
proposed technique with existing methods in terms of DSC, accuracy, patterns.
precision, recall, and F1 score.
2
R. Sekaran et al. Computers in Biology and Medicine 149 (2022) 105990
2) Using the mean shift approach, calculate an image segmentation. For 3.2. Deformable Hierarchical Heuristic Model-based deconvolutional
a given x, where xi, i = 1, n is a random set of n points inside a residual network (DHHM-DDRN)
dataset. Mean shift process can be obtained by evaluating the mean ⃒
Consider data {yj } with labels {zj } asχ = {(yj , xj )⃒yj ∈ Rm , zj ∈ Rn , j =
⃒
shift vector m(x) via Eq. (7):
(y′ − s 2 ) (y′ − F(s )2 ) 1,…M], and DNN regulates a function fDNN : Rm →Rn . Neurons xj ∈ R, 1
∑∞
layer of l neurons x = (x1 ,…xl ), and ρ is the activation function. If a DNN
i,j k k
k=1 x k g g i,j hr
( ) hk
m yj + yj = ( ) (7) has layers i = 0,… k, each of them has mi neurons given by Eq. (12):
∑∞ (y′ij − sk 2 ) y′i,j − F(sk )2
i=1 g ‖ g ( )
hs hr
x(i) = ρ Θ(i− 1) ⋅ x(i− 1) + a(i− 1) (12)
Assuming y1 is the original value, the new concentrated x movement Objective function Min(F) is determined by Eq. (13):
is evaluated using Eq. (8): [ ( ) ]
∑X
3) Grey images are created from photos that pass the mean shift process. ( )
I∗X
4) Initial function φ0 is therefore described as follows: f2 = Max ∑l ∑X ∑Y ∑z ( )( )
⎧ i=1 x=1 y=1 z=1 tixyz llxyx
⎨ − ρ (x, y) ∈ Ω0 − αΩ0
φ0 (x, y) = 0 (x, y) ∈ Ω0 (9) (
l ∑
∑ Y ∑
z
( )( ) l ∑
∑ Y ∑
z
( )( )
)
⎩
ρ Ω − Ω0 f3 = m llxyz tixyz − li(x+1)yz ti(x+1)yz
i=1 y=1 z=1 i=1 y=1 z=1
5) Equation (9) computes early level set functions from an arbitrary Decision variables and constraints are determined using Eq. (15):
region Ω0 in picture domain Ω. ∑
Y ∑
x ∑
z
( ) ∑Y
lixyz =
For every patient Ptcga in TCGA data, the total cell number (TCNtcga ) y=1 x=1 z=1 y=1
3
R. Sekaran et al. Computers in Biology and Medicine 149 (2022) 105990
1
(16)
2 ( ( ))1/β
Xℓ+1 = argminf (Xℓ ) + Tr(X − Xℓ )⊤ ∇f (Xℓ ) + X − Xℓ F + λG (X) πβ
X 2η σ = Γ(1 + β) × sin (26)
2
2
where X − Xℓ F is the proximal term; and X-Xl is the distal term. Using
where d is dimension of position vectors. In [0,1], r1 and r2 are random
the definitions of proximal operators, the update for separable G (X) is
numbers, β is constant, and Γ(x) = (x − 1). Fitness function is evaluated
written equivalently as Eq. (17):
using Eqns. (27) and (28):
Xℓ+1 = P ν (Xℓ − η∇f (Xℓ )) (17) 1
fiti = (27)
1 + fi
where P ν is the proximal operator for G ; and ν = λη is the equal sign by
Eq. (18): 1 ∑nj ( )
fi = d Xj , C i (28)
M ∑
∑ N ⃒ ⃒ nj i=1
where
( ) ( )
(k − 1)u2
φk u = uexp − (23)
2τ 2
1∑ N
( )
J(c) = XL Yq , c − Xq 22 (24)
2 q=1 q
δ∗c = argmiñ
J(ci + δc ) + γδc 22
δc
r1 × σ
Xt+1 = Xt + Lévy (d) × Xt Lévy(x) = 0.01 × 1
|r2 |β
4
R. Sekaran et al. Computers in Biology and Medicine 149 (2022) 105990
pictures:
RIDER dataset includes MRI-multi-sequence pictures from 19 glio
blastoma patients (Grade IV) and 70,220 photos in total.
REMBRANDT (Repository of Molecular Brain Neoplasia Data) data
set includes MRI multi-sequence pictures of 130 patients with Grade II,
III, and IV gliomas and 110,020 photos in total.
TCGA-LGG (Cancer Genome Atlas Low-Grade Glioma) dataset con
tains 199 patients with low-grade (I and II) gliomas are represented by
241,183 MRI scans.
5. Results
Table 1 shows the input brain cancer images achieved using the
proposed volume-based region of cancer extraction and DHHM-DDRN-
based classification.
Table 2 presents a comparative analysis of the proposed and existing
(ACM and GAC) techniques based on DSC, accuracy, precision, recall,
and F1 score. Results are illustrated in graph form in Figs. 3–7,
respectively.
Fig. 7 presents the graphical representation of statistical metrics from
Table 2 for a parametric comparison between proposed and existing Fig. 3. DSC comparison.
method. It is apparent that proposed approach obtained optimal results
with an accuracy of 95%, DSC of 83%, precision of 80%, recall of 85%,
and F1 score of 55%.
6. Discussion
Table 1
Proposed feature extraction and classification of 3D brain slices.
INPUT DATASET PROCESSED 3D EXTRACTED CLASSIFIED
3D BRAIN BRAIN IMAGE FEATURE OF CANCER REGION Fig. 4. Accuracy comparison.
IMAGE CANCER IN 3D OF 3D BRAIN
BRAIN IMAGE IMAGE
7. Conclusion
RIDER DATASET
This research proposes a novel technique to extract the features and
classify cancerous regions in 3D brain images. Specifically, the input
images are initially processed for noise removal, resized, and smooth
REMBRANDT ened. Then, features are extracted based on Volume of Interest (VOI) to
accurately classify the tumor using the Deformable Hierarchical Heu
ristic Model-based Deep Deconvolutional Residual Network (DHHM-
DDRN). In this study, we propose a four-stage classification scheme
TCGA-LGG based on the extraction of brain tumor features utilizing the machine
learning paradigm to support medical professionals. Due to the
complexity of images and dearth of anatomical methods that adequately
represent various deformations in each component, medical image
5
R. Sekaran et al. Computers in Biology and Medicine 149 (2022) 105990
Ethics approval
Not Applicable.
Acknowledgements
Not Applicable.
References
[1] Milica M. Badža, Marko Č. Barjaktarović, Classification of brain tumors from MRI
images using a convolutional neural network, Appl. Sci. 10 (6) (2020) 1999.
[2] Neelum Noreen, A deep learning model based on concatenation approach for the
diagnosis of brain tumor, IEEE Access 8 (2020) 55135–55144.
[3] Sumit Tripathi, Ashish Verma, Neeraj Sharma, Automatic segmentation of brain
Fig. 6. Recall comparison. tumour in MR images using an enhanced deep learning approach, Comput.
Methods Biomech. Biomed. Eng.: Imaging & Visualization 9 (2) (2021) 121–130.
[4] Díaz Pernas, Francisco Javier, A deep learning approach for brain tumor
classification and segmentation using a multiscale convolutional neural network,
Healthcare 9 (2021) 2.
[5] Zahra Sobhaninia, Brain tumor segmentation by cascaded deep neural networks
using multiple image scales, in: 28th Iranian Conference on Electrical Engineering
(ICEE), 2020, 2020.
[6] J. Richard Landis, Gary G. Koch, The Measurement of Observer Agreement for
Categorical Data, biometrics, 1977, pp. 159–174.
[7] Kai Roman Laukamp, Automated meningioma segmentation in multiparametric
MRI, Clin. Neuroradiol. 31 (2) (2021) 357–366.
[8] Hassan A. Khalil, 3D-MRI brain tumor detection model using modified version of
level set segmentation based on dragonfly algorithm, Symmetry 12 (8) (2020)
1256.
[9] Anucha Tungkasthan, WichianPremchaiswadi, Automatic region of interest
detection in natural images, in: 15th WSEAS International Conference on
Computers. hal., 2011.
[10] Yoichi Watanabe, A mathematical model of tumor growth and its response to single
irradiation, Theor. Biol. Med. Model. 13 (1) (2016) 1–20.
[11] Mohammad Mirzaei, Navid, A mathematical model of breast tumor progression
based on immune infiltration, J. Personalized Med. 11 (10) (2021) 1031.
[12] Bhowmik, A., Bayesian deep deconvolutional neural networks, Second Workshop
on Bayesian Deep Learning (NIPS 2017), (Long Beach, CA, USA).
[13] Heng Yu, Zhiqing Zhou, Qiming Wang, Deep learning assisted predict of lung
cancer on computed tomography images using the adaptive hierarchical heuristic
mathematical model, IEEE Access 8 (2020) 86400–86410.
[14] Ranbir Singh, B. Khan, Meta-hierarchical-heuristic-mathematical-model of loading
problems in flexible manufacturing system for development of an intelligent
Fig. 7. F1 score comparison.
approach, Int. J. Ind. Eng. Comput. 7 (2) (2016) 177–190.
[15] Ahmed Fakhry, Tao Zeng, Shuiwang Ji, Residual deconvolutional networks for
brain electron microscopy image segmentation, IEEE Trans. Med. Imag. 36 (2)
(2016) 447–456.
6
R. Sekaran et al. Computers in Biology and Medicine 149 (2022) 105990
[16] Ujjwal Baid, A novel approach for fully automatic intra-tumor segmentation with [22] Gökay Karayegen, Mehmet FeyziAksahin, Brain tumor prediction on MR images
3D U-Net architecture for gliomas, Front. Comput. Neurosci. 14 (2020) 10. with semantic segmentation by using deep learning network and 3D imaging of
[17] Muhammad Adeel Azam, A review on multimodal medical image fusion: tumor region, Biomed. Signal Process Control 66 (2021), 102458.
compendious analysis of medical modalities, multimodal databases, fusion [23] T. Sadad, A. Rehman, A. Munir, T. Saba, U. Tariq, N. Ayesha, R. Abbasi, Brain
techniques and quality metrics, Comput. Biol. Med. 144 (2022), 105253. tumor detection and multi-classification using advanced deep learning techniques,
[18] Sunil Maharjan, A novel enhanced softmax loss function for brain tumour detection Microsc. Res. Tech. 84 (6) (2021) 1296–1308.
using deep learning, J. Neurosci. Methods 330 (2020), 108520. [24] M. Ahmadi, F. DashtiAhangar, N. Astaraki, M. Abbasi, B. Babaei, FWNNet:
[19] Dimitrios Ataloglou, Fast and precise hippocampus segmentation through deep Presentation of a New Classifier of Brain Tumor Diagnosis Based on Fuzzy Logic
convolutional neural network ensembles and transfer learning, Neuroinformatics and the Wavelet-Based Neural Network Using Machine-Learning Methods,
17 (4) (2019) 563–582. Computational Intelligence and Neuroscience, 2021, 2021.
[20] Mohammad Shehab, Machine learning in medical applications: a review of state- [25] M. Arif, F. Ajesh, S. Shamsudheen, O. Geman, D. Izdrui, D. Vicoveanu, Brain tumor
of-the-art methods, Comput. Biol. Med. 145 (2022), 105458. detection and classification by MRI using biologically inspired orthogonal wavelet
[21] Gökay Karayegen, Mehmet FeyziAksahin, Brain tumor prediction on MR images transform and deep learning techniques, J. Healthcare Eng. 2022 (2022).
with semantic segmentation by using deep learning network and 3D imaging of
tumor region, Biomed. Signal Process Control 66 (2021), 102458.