Professional Documents
Culture Documents
Breast Cancer
Breast Cancer
Abstract— Deep learning has recently attracted a lot of images obtained with breast cancer is extremely important
attention with the aim to develop a quick, automatic and for diagnosis. Many methods have been used to classify
accurate system for image identification and breast cancer. One of the most important methods among
classification. In this work, the focus was on fine-tuning these methods is deep learning-based methods. The most
and evaluation of state-of-the-art deep convolutional important reason for choosing the deep learning model for
neural network for image-based plant disease breast cancer diagnosis is that it can give faster and more
classification. An empirical comparison of the deep accurate results than the existing methods. The
learning architecture is done. The architectures histopathologic images of the breast cancer features were
evaluated include ResNet with 50 and 18 layers and extracted using the method which is one of the deep learning
DenseNets with 121 layers. The data used for the approaches.[6]
experiment is 38 different classes including diseased and
The data collected at baseline include breast ultrasound
healthy images of leafs of 14 plants from plantVillage.
images among women in ages between 25 and 75 years old.
Fast and accurate models for plant disease identification
This data was collected in 2018. The number of patients is
are desired so that accurate measures can be applied
600 female patients. The dataset consists of 1560 images
early. Thus, alleviating the problem of food security. In
with an average image size of 500*500 pixels. The images
our experiment, DenseNets has tendency’s to
are in PNG format. The ground truth images are presented
consistently improve in accuracy with growing number
with original images. The images are categorized into three
of epochs, with no signs of overfitting and performance
classes, which are normal, benign, and malignant.
deterioration. Moreover, DenseNets requires a
considerably less number of parameters and reasonable
computing time to achieve state-of-the-art performances. II. LITERATURE REVIEW
It achieves a testing accuracy score of 90% to beat the Deep Learning (DL) is a rising field of researches in the last
rest of the architectures. Keras with Theano backend decade by exposing a hybrid analysis procedure including
was used to perform the training of the architectures. advanced level image processing and many efficient
supervised classifiers. Robustness of the DL algorithms to
Keywords— convolutional, resnet50, densenet121, seresnet18, the big data enhances the analysis capabilities of machine
seresnext50, mobilenet. learning models by feature learning on heterogeneous image
database. In this paper, Convolutional Neural Network
I. INTRODUCTION (CNN) architecture was proposed on simplified feature
learning and fine-tuned classifier model to separate cancer-
The use of deep learning (DL) for the analysis and diagnosis
normal cases on mammograms. In this paper, we propose a
of biomedical and health care problems has received
fully automatic breast cancer detection system. [14]
unprecedented attention in the last decade. The technique
has recorded a number of achievements for unearthing Breast cancer happens when cells in your breast grow and
meaningful features and accomplishing tasks that were divide in an uncontrolled way, creating a mass of tissue
hitherto difficult to solve by other methods and human called a tumor. Signs of breast cancer can include feeling a
experts. Currently, biological and medical devices, lump in your breast, experiencing a change in the size of
treatment, and applications are capable of generating large your breast and seeing changes to the skin on your breasts.
volumes of data in the form of images, sounds, text, graphs, Mammograms can help with early detection. Breast cancer
and signals creating the concept of big data. is one of the most commonly found and dangerous cancer
among women which leads to a major research topic in
Breast cancer is one of the most common cancer types
medical science. Most of the times, it is identified by using a
diagnosed in the ladies worldwide. Statistics indicate that
biopsy method where tissue is removed and studied under a
breast cancer rate is about 12 \%in all cancer cases in the
microscope.[13] The objective of this paper is to compare
world. Also, approximately 25\% of women have breast
the breast cancer detection with two model networks of deep
cancer. Therefore, rapid and accurate analysis of medical
learning technique. The overall process involves image
preprocessing, classification and performance evaluation. chances of survival. Invasive detection techniques cause
[16] This paper proposes a comprehensive method to locate rupture of the tumor, accelerating the spread of cancer to
the cancerous region in the mammogram image. This adjoining areas. Hence, there arises the need for a more
method employs image noise reduction, optimal image robust, fast, accurate, and efficient noninvasive cancer
segmentation based on the convolutional neural network, a detection system. In this work, an automated system is
grasshopper optimization algorithm, and optimized feature proposed for achieving error-free detection of breast cancer
extraction and feature selection based on the grasshopper using mammogram. In this system, the deep learning
optimization algorithm, thereby improving precision and techniques such as convolutional neural network, sparse
decreasing the computational cost.[17] autoencoder, and stacked sparse autoencoder are used. The
performance of these techniques is analyzed and compared
We proposed a novel deep learning framework for the
with the existing methods. From the analysis, it is observed
detection and classification of breast cancer in breast
that the stacked sparse autoencoder performs better
cytology images using the concept of transfer learning. In
compared to other methods.[9]
general, deep learning architectures are modeled to be
problem specific and is performed in isolation. Contrary to Deep convolutional neural networks (CNNs) are
classical learning paradigms, which develop and yield in investigated in the context of computer-aided diagnosis
isolation, transfer learning is aimed to utilize the gained (CADx) of breast cancer. State-of-the-art CNNs are trained
knowledge during the solution of one problem into another and evaluated on two mammographic datasets, consisting of
related problem. In the proposed framework, features from ROIs depicting benign or malignant mass lesions. The
images are extracted using pre-trained CNN architectures, performance evaluation of each examined network is
namely, GoogLeNet, Visual Geometry Group Network addressed in two training scenarios: the first involves
Residual Networks (ResNet), which are fed into a fully initializing the network with pre-trained weights, while for
connected layer for classification of malignant and benign the second the networks are initialized in a random fashion.
cells using average pooling classification. To evaluate the Extensive experimental results show the superior
performance of the proposed framework, experiments are performance achieved in the case of fine-tuning a pretrained
performed on standard benchmark data sets. It has been network compared to training from scratch.[10]
observed that the proposed framework outclasses all the
Deep Learning (DL) is a rising field of researches in the last
other deep learning architectures in terms of accuracy in
decade by exposing a hybrid analysis procedure including
detection and classification of breast tumor in cytology
advanced level image processing and many efficient
images.[3] Deep comparison of functioning of each network
supervised classifiers. Robustness of the DL algorithms to
and its designing is performed and then analysis is done
the big data enhances the analysis capabilities of machine
based on the accuracy of diagnosis and classification of
learning models by feature learning on heterogeneous image
breast malignancy by the network to decide which network
database. In this paper, Convolutional Neural Network
outperforms the other. CNN is found to give slightly higher
(CNN) architecture was proposed on simplified feature
accuracy than MLP for diagnosis and detection of breast
learning and fine-tuned classifier model to separate cancer-
cancer. There still is the need to carefully analyses and
normal cases on mammograms. Breast Cancer is a prevalent
perform a thorough research that uses both these methods on
and mortal disease that appeared resultant mutating of
the same data set under same conditions in order identify the
normal tissue into tumor pathology. Mammograms are
architecture that gives better accuracy.[4]
common and effective tools for the diagnosis of breast
The lack of publicly available ground-truth data has been cancer. DL-based computer-assisted systems have the
identified as the major challenge for transferring recent capability of detailed analysis for even small pathology that
developments in deep learning to the biomedical imaging may lead the curing progress for a complete assessment. The
domain. Though crowdsourcing has enabled annotation of proposed DL-based model aimed at assessing the
large-scale databases for real world images, its application applicability of various feature-learning models and
for biomedical purposes requires a deeper understanding enhancing the learning capacity of the DL models for an
and hence, more precise definition of the actual annotation operative breast cancer diagnosis using CNN.[11]
task. The fact that expert tasks are being outsourced to non-
In this paper, we firstly tested three training methods on the
expert users may lead to noisy annotations introducing
MIAS database: 1) trained a CNN from scratch, 2) applied
disagreement between users. Despite being a valuable
the pre-trained model to extract features from input
resource for learning annotation models from
mammograms and used these features to train a Neural
crowdsourcing, conventional machine-learning methods
Network (NN)-classifier, 3) updated the weights in several
may have difficulties dealing with noisy annotations during
final layers of the pre-trained model by back-propagation
training. In this manuscript, we present a new concept for
(fine-tuning) to detect abnormal regions. We found that
learning from crowds that handle data aggregation directly
method 2) is ideal for study because the classification
as part of the learning process of the convolutional neural
accuracy of fine-tuning model was just 0.008 higher than
network (CNN) via additional crowdsourcing layer.[5]
that of feature extraction model but time cost of feature
Breast cancer has the second highest mortality rate in extraction model was only about 5% of that of the fine-
women next to lung cancer. As per clinical statistics, 1 in tuning model. Then, we used method 2) to classify regions:
every 8 women is diagnosed with breast cancer in their benign vs. normal, malignant vs. normal and abnormal vs.
lifetime. However, periodic clinical checkups and self-tests normal from the DDSM database with 10-fold cross
help in early detection and thereby significantly increase the validation. The average validation accuracy converged at
about 0.905 for abnormal vs. normal cases, and there was no sets of information are merged. In contrast to Artificial
obvious overfitting. This study shows that applying transfer Neural Network (ANN) which has a single layer, CNN has a
learning in CNN can detect breast cancer from number of layers placed in sequence. In the context of
mammograms, and training a NN-classifier by feature CNNs, a convolutional layer (called filter or kernel) is
extraction is a faster method in transfer learning.[12] applied to the input data to then produce a feature map
(Acharya et al. 2020). In detail, it consists of an input layer,
Breast Cancer is the abnormal growth of cells in the breast.
many convolutional layers, pooling layers, fully connected
According to the World Health Organization, Breast Cancer
layer and finally an output layer. Apart from the input and
is the most common type of cancer that women are
the output layer, the rest of the layers are termed as hidden
diagnosed with worldwide. Breast cancer tests vary from
layers.
Mammograms to CTs and Ultrasounds; however, the only
way to tell for sure if the suspicious lesions found in the CNN also processes image data to detect or classify an
breast are cancerous or not is by performing a biopsy test. object. CNN layers are arranged in such a way that they
The main contribution of this paper is proposing a deep detect simpler patterns first (lines, curves, etc.) and more
learning approach to diagnose breast cancer from biopsy complex patterns (faces, objects, etc.) further along.
microscopy images. Several types of Deep Convolution nets However, CNN received significant attention in data science
such as Resnet50, Resnet18, and Densenet121 are used.[15] since it has proven its capabilities in detecting, localizing,
and segmenting objects in the image.
This review focuses on breast cancer classification by using
medical imaging multimodalities through state-of-the-art An original CNN architecture in this research refers to a
artificial deep neural network approaches. It is anticipated to CNN network and algorithm that is available in Keras or
maximize the procedural decision analysis in five aspects, Github. In this research, a CNN algorithm is kept original as
such as types of imaging modalities, datasets and their firstly proposed by its authors and programmers, with no
categories, pre-processing techniques, types of deep neural change of processing units, parameterizations and hyper-
network, and performance metrics used for breast cancer parameter optimization strategies, design patterns, and
classification. Forty-nine journal and conference connectivity of layers. Often a well-known CNN network
publications from eight academic repositories were was developed and evolved by different researchers and
methodically selected and carefully reviewed from the programmers through various challenges. For example,
perspective of the five aforementioned aspects. In addition, AlexNet architecture was the winner of ILSVRC 2012 and
this study provided quantitative, qualitative, and critical was proposed by Krizhevsky et al. (Ruba et al. 2022)
analyses of the five aspects. This review showed that ResNet was proposed by He et al. (Ruba et al. 2022) from
mammograms and histopathologic images were mostly used Microsoft and won 2015 ILSVRC, DenseNet as an
to classify breast cancer. [18] extension of ResNet was first proposed in 2016 by Huang et
al. from Facebook (Ruba et al. 2022), (Mehta and Arbel
The automatic and precision classification for breast cancer
2018). The CNN architectures those are utilised in this study
histopathological image has a great significance in clinical
are discussed in the next sections.
application. However, the existing analysis approaches are
difficult to addressing the breast cancer classification
problem because the feature subtle differences of inter-class
histopathological image and the classification accuracy still
hard to meet the clinical application. Recent advancements
in data-driven sharing processing and multi-level
hierarchical feature learning have made available
considerable chance to dope out a solution to this problem.
To address the challenging problem, we propose a novel
breast cancer histopathological image classification method
based on deep convolutional neural networks, named as
BiCNN model, to address the two-class breast cancer
classification on the pathological image. This deep learning
Figure 1: The basic CNN architecture. (source-
model considers class and sub-class labels of breast cancer google)
as prior knowledge, which can restrain the distance of
features of different breast cancer pathological images. In ResNet: ResNet was proposed by (Simonyan and Zisserman
addition, an advanced data augmented method is proposed 2014). from Microsoft and won 2015 ImageNet Large Scale
to fit tolerance whole slide image recognition, which can Visual Recognition Challenge (ILSVRC). The main
full reserve image edge feature of cancerization region. The innovation in ResNet architectures is the use of residual
transfer learning and fine-tuning method are adopted as an layers and skip connections to solve the problem of
optimal training strategy to improve breast cancer vanishing gradients that may result in stopping the weights
histopathological image classification accuracy. [19] in the network to further update/change. This is particularly
CNN networks a problem in deep networks because the value of gradient
can vanish, i.e. shrink to zero, when several chain rules
The term ‘convolution’ in a convolutional neural network applied consecutively. Skipping connections will help
(CNN) refers to the mathematical combination of two gradients flow backwards directly from end layers to initial
functions to form a third function. When that happens, two layer filters, enabling CNN models to deepen with 18 layers
(Majeed et al. 2020). In the field of image recognition and
localization tasks, ResNet has a strong performance that
demonstrates the importance of many visual recognition
task (Elshennawy and Ibrahim (2020)
The ResNet50 architecture (Kaldera et al. 2019) which won
the ILSVRC-2015 competition in 2015, is an architecture
proposed to solve the problem of multiple nonlinear layers
learning identity maps and the degradation problem.
ResNet50 is a network in network architecture based on
many stacked residual units. Residual units are used as
building blocks to build the network. Below the block
diagram of ResNet50 is provided-
Figure 4: Schematic representation of SE ResNet
MobileNet: It is a CNN architecture that seeks to perform
well on mobile devices. It is based on an inverted residual
structure where the residual connections are between the
bottleneck layers. The intermediate expansion layer uses
lightweight depth-wise (Dwise) convolutions to filter
features as a source of non-linearity. As a whole, its
architecture contains the initial fully convolutional layer
with 32 filters, followed by 19 residual bottleneck layers
(Bonte 2018). The architecture of MobileNetV2 is given in
Figure 5.
Cancer No Cancer
No Cancer 104 89
Mobilenet:
Mobilenet:
Cancer No Cancer
Cancer 735 59
Densenet121:
No Cancer 75 251
Cancer No Cancer
Resnet50: Resnet50:
Cancer No Cancer
No Cancer 39 67
seresnet18:
seresnet18:
Cancer No Cancer
Cancer No Cancer
Cancer 724 59
No Cancer 79 258
Densenet121:
V. RESULT OF EXPERIMENT 3:
Cancer No Cancer
No Cancer 57 219
Training Model
Architecture
Accuracy Accuracy
resnext50 73% 73%
Resnet50: densenet121 88% 87%
seresnet18 72% 70%
Cancer No Cancer seresnet50 90% 85%
mobilenet 87% 87%
Cancer 823 288
No Cancer 6 3
seresnet18:
Cancer No Cancer
Cancer No Cancer
No Cancer 39 67
seresnet50: No Cancer 0 0
Cancer No Cancer
Cancer 736 78
No Cancer 81 225
VI. DISCUSSIONS Not surprisingly, from our investigation, we found that the
ensemble of deep learning models improved its accuracy
over a single CNN architecture. Our findings also support
the study by (Ju et al. 2022).
[3] Khan, S., Islam, N., Jan, Z., Din, I. U., & Rodrigues, [14] Mohamed, E. A., Rashed, E. A., Gaber, T., &
J. J. C. (2019). A novel deep learning based Karam, O. (2022). Deep learning model for fully
framework for the detection and classification of automated breast cancer detection system from
thermograms. PloS one, 17(1), e0262349. Mujtaba, G., Nweke, H. F., Al-garadi, M. A., ... &
Azmi, N. A. (2020). Deep learning-based breast
[15] Eldin, S. N., Hamdy, J. K., Adnan, G. T., Hossam, cancer classification through medical imaging
M., Elmasry, N., & Mohammed, A. (2021, May). modalities: state of the art and research
Deep learning approach for breast cancer diagnosis challenges. Artificial Intelligence Review, 53(3),
from microscopy biopsy images. In 2021 1655-1720.
International Mobile, Intelligent, and Ubiquitous
Computing Conference (MIUCC) (pp. 216-222). [19] Wei, B., Han, Z., He, X., & Yin, Y. (2017, April).
IEEE. Deep learning model-based breast cancer
histopathological image classification. In 2017 IEEE
[16] Ismail, N. S., & Sovuthy, C. (2019, August). Breast 2nd international conference on cloud computing
cancer detection based on deep learning technique. and big data analysis (ICCCBDA) (pp. 348-353).
In 2019 International UNIMAS STEM 12th IEEE.
engineering conference (EnCon) (pp. 89-92). IEEE. [20] Zou, L., Yu, S., Meng, T., Zhang, Z., Liang, X., &
Xie, Y. (2019). A technical review of convolutional
[17] Sha, Z., Hu, L., & Rouyendegh, B. D. (2020). Deep neural network-based mammographic breast cancer
learning and optimization algorithms for automatic diagnosis. Computational and mathematical methods
breast cancer detection. International Journal of in medicine, 2019.
Imaging Systems and Technology, 30(2), 495-506.