Download as pdf or txt
Download as pdf or txt
You are on page 1of 6

Classification of therapeutic wastes using the

CNN algorithm with a 5 DOF robotic arm.


Renisha B Ronald J Josephin Jaffrin Gomez P
Electronics and Communications Electronics and Communications Electronics and Communications
Engineering. Engineering. Engineering.
Loyola-ICAM College of Loyola-ICAM College of Loyola-ICAM College of
Engineering Engineering Engineering
and Technology and Technology and Technology
Chennai, India Chennai, India Chennai, India
renisha.20ec@licet.ac.in ronald.20ec@licet.ac.in josephinjaffringomez.20ec@lice
t.ac.in

Abstract​— ​The healthcare industry plays a vital role the healthcare sector are enormous and they are also
in the financial state of a country. The activities of the contagious to human life as they risk the lives of
healthcare industry protect, restore, and save the lives healthcare workers. The medical wastes can also
of people. But the waste and by-products it produces cause impacts on the environment. Many of the
contain potentially harmful microorganisms that can fields dispose of medical wastes. Some of them are
infect the hospital patients, healthcare workers, and hospitals, veterinary clinics, dental clinics, funeral
also the public. An optimal solution that will reduce the homes, pharmacies, etc. Many treacherous diseases
risk of harmful microorganisms is by not employing are the effects of improper medical waste disposal.
human beings in the field of disposal of medical wastes. Respiratory contamination such as tuberculosis,
The proposed solution combines the field of robotics
Streptococcus pneumonia, and viruses like measles,
and machine learning to automate the process of
medical waste segregation and disposal. A machine all of these can be transmitted through improper
learning model that can automate the classification of disposal of infectious waste. HIV and AIDS are both
waste is being built. The CNN algorithm is employed to transmitted through items contaminated with blood
classify the medical wastes into four categories. After or body fluids.
the wastes are classified, they are picked using a 5 DOF
robotic arm which has a web camera mounted on it.
The robotic arm is built using AutoCAD software. The To make the disposal methods conventional, the
web camera in the robotic arm will be able to recognize sector disposing of the waste has to be careful with
the image and a signal will be initiated to the PIC handling the waste and also segregate them properly
controller which will initiate the pick and place robotic according to the mandates. For this to be done
arm to pick the waste and drop it into the respective flawlessly, a sector would have to employ people
bin. A conveyor belt is used to collect the wastes from who will separate the wastes according to the
each unit in the hospital and is disposed of, which
mandates and dispose of them properly. But
totally reduces human involvement in this and thereby
reduces the risk of infections. employing human beings in the field of medical
waste disposal will risk their lives with lots of
diseases. They are more likely to acquire infectious
Keywords​— Machine learning, CNN algorithm, DOF, diseases which sometimes might also lead to death.
Robotic arm, AutoCAD, PIC controller. To avoid such problems the machine learning
domain is used which can do the waste disposal
automatically. The machine learning domain is being
I. INTRODUCTION
combined with the robotics which will be
The healthcare industry or the medical industry is a automating the entire procedure that a human being
zone that provides goods and services to treat would do.
patients with restorative and rehabilitative care. The
healthcare industries are composed of establishments
devoted to prevention, diagnosis, treatment, and The proposed solution uses the CNN algorithm to
rehabilitation of medical conditions. The healthcare classify the images. The dataset is split into
industry plays a vital role in the financial state of a validation and train images and the model after
country. The activities of the healthcare industry being built was tested with the validation set. The
protect, restore, and save the lives of people. But the dataset was first labeled and then used for image
wastes and the by-products that are produced from classification. The software model comprised three
convolutional layers, three pooling layers, and three Shoji Kido​; ​Yasushi Hirano​; ​Noriaki
fully-connected layers to build the model. CNN Hashimoto​,(2018) [2] image-based Cadx is
algorithm was used instead of ANN because CNN is
considered as the powerful one compared to
best suitable for spatial data such as images. The
main superiority of CNN compared to its feature-based Cadx that requires an image feature
predecessors is that it detects all the important extractor for diagnosis of lung abnormalities. Also
features of a class without human governance. Thus development of image-based Cade (Computer-aided
CNN algorithm is used to build the model. The detection) algorithm by use of CNN features for
images would be trained with the CNN algorithm
detection of lung abnormalities.
and then the model can classify the images based on
their classes.
Seong-Hyeon Han​; ​Kwang-Yeob Lee​,(2017) [4]
revolves around the implementation of image
The robotic arm is designed as a 5 DOF model classification CNN using a multithreaded GPU which
using AutoCAD. It was designed using acrylic has 256 threads used for limiting each layer
material. The binary signal obtained from the CNN
classification results is being sent to the PIC allocation as well as for parallel processing.
controller. Five servo motors were used for building
the robotic arm. The PIC controller has only two Pradipta Sasmal​; ​Yuji Iwahori​; ​M. K. Bhuyan​; ​Kunio
PWN pins but the control must be over five servo Kasugai​,(2018) [8] shows the purpose to detect any
motors of the robotic arm. So the GPIO pins of the abnormality in the gastrointestinal tract using an
PIC controller are utilized and generate PWM
signals on PIC GPIO pins using the timer interrupts. automated framework that efficiently classifies
The mechanical structure of the robotic arm was polyps which are diagnosed and the images have
completely 3D printed. been devised. A deep CNN has been employed to
train a network and also for the classification of
polyp types and data augmentation for increasing the
This robotic arm will pick the waste and drop it
number of images for classification.
into the respective dustbin. Medical wastes can be
classified into four types. They are infectious,
hazardous, radioactive, and general. The four-color Ana Riza F. Quiros​; ​Alexander C. Abad​; ​Elmer P.
bins that are used to classify the medical wastes are Dadios​,(2015) [11] revolves about an artificial neural
yellow, red, blue, and white. The yellow color network approach to an object locator and picker
dustbin is filled with human and animal anatomical
which uses a pick and place robotic arm that is in a
waste, soiled waste, discarded or expired medicine,
chemical waste, and microbiology or biotechnology fixed position in a limited area at which it can pick
or clinical laboratory wastes. The red dustbin is and place the object and also can place in limited
filled with contaminated wastes that are recyclable. angles only.
The blue dustbin is filled with glassware and the
metallic body imparts. The white dustbin is filled
with waste sharps including metals. The waste that is Roland Szabó​; ​Ioan Lie​, (2012) [20] represents the
picked with the arm will now be dropped into the application of color sorting using a robotic arm that
respective color dustbin. recognizes color using image recognition with a
webcam. It also revolves around replacing humans
II. RELATED WORK with robots that make decisions.

Guoming Chen; Yongchang Chen; Zeduo Yuan;


Onur Koçak; Hüseyin Kurtuldu; Ali Akpek; Arif
Xuming Lu; Xiongyong Zhu; Wanyi Li,(2019) [1]
aims to improve the recognition accuracy when Koçoğlu; Osman Eroğul,(2016) [25] implements
image bit-sliced classification is applied on breast medical waste collection, separation, and
cancer image. Resulting in the simulation on breast classification process that were surveyed in new city
cancer image datasets that can improve the hospitals constructed with public-private
recognition rate and promote classification partnerships. Through studying the medical waste
performance.
disposal methods, few suggestions regarding the most
appropriate methods and models of offset technology remarkable architecture of the neural networks,
investments for the city hospitals were proposed. which uses some features of the visual cortex. The
principal task of image classification is acquiring the
Selvaraj Geetha​; ​Samayan Narayanamoorthy​; input image and the following definition of its class.
Daekook Kang​; ​Joseph Varghese Kureethara​,(2019) The computer cannot see the image as human beings
[28] extends the MULTIMOORA decision-making can see. The computer can see an array of pixels and
method with an intuitionistic hesitant fuzzy set to not the image as humans can see them. The input
evaluate the healthcare waste treatment methods. image will pass through a series of convolutional,
pooling, fully connected layers, ReLU layer i.e.
III. DATASET activation function, and normalization layers.
Different convolutional neural networks are built to
The dataset was obtained from Vecteezy. The
train the data for classification. The number of
images have five classes. They are cotton, syringe,
gloves, face mask, and surgical head cap. For each convolutional layers is increased to check if it gives
class, a total of 500 images were collected. They an improvement in the performance. CNN’s with
were labeled and split into train data and validation convolutional and max-pooling layers are created to
data. The train data contained 80% of the total data compare their performance for the given dataset. The
while the validation data was 20% of the total data. number of convolution layers and the max-pooling
For images that have to contain all the classes
together, images were captured and some were taken layers can be increased to verify and improve the
from google chrome and then all those images were performance. The input is subjected to an activation
cleaned and reduced to the same size for easy function called a rectified linear unit to reject any
processing of the model. negative value. The layers are pooled to reduce the
dimensions. The final output layer uses a sigmoid
IV. METHODOLOGY activation function which is needed to perform
classification.
A. Machine learning model
Machine learning has been procuring momentum
over the last decades in various sectors. One among
them is image classification. The machine learning
model was developed using the CNN image
classification algorithm. The image classification
technique takes an input image, learns by itself, and
then the classification result would be obtained. As
machine learning would have self-learning capability
without being explicitly programmed, the machine Fig. 4.1. Classification of Waste Using CNN Algorithm
learning domain is used. CNN image classification
algorithm was chosen over the other algorithms
because they can be more effective over spatial data B. Pick and place robotic arm
than any other machine learning algorithm. ​Robotics finds applications in many industries and
sectors and one among them is the medical and
1) CNN image classification: ​Python was used
healthcare sector. Robotics is used for automation
as the syntax to build the CNN image classification
purposes and the proposed solution consists of a pick
model. Keras, a high-level neural network API
and place robotic arm that automates the procedure of
written in Python was used as the framework. But
collecting the waste and segregating them. The
keras needs a backend to work on low-level
Robotic Arm uses 5 DOF to segregate the waste. It
operations and thus TensorFlow is also used. For
receives pulse width modulated signals from the PIC
visualizing the data Matplotlib is used and the
microcontroller and the servo motors in a robotic arm
development environment is google colab. The
dataset was obtained from Vecteezy. CNN is a
receive pulses initiating the pick and place Robotic V. RESULTS AND PERFORMANCE
Arm that is used to segregate the waste. EVALUATION

The model's efficiency was validated and the


1) Design of robotic arm: The arm was designed
accuracy was almost 70%. The model was trained
using the software, AutoCAD. The attributes that are
using a dataset obtained from Vecteezy which
needed to be considered before designing the arm are contained five classes and each class had a thousand
finding an appropriate servo motor and designing an images. The model was tested using a dataset from
artificial servo motor to make it easy to develop the Vecteezy which also had five classes and each class
arm. The design of the arm is decided based on the had 400 images and the model was validated from the
torque values executed by the servo motor. The Vecteezy dataset which had five classes and each
torque must be maintained within 50% to 70% to class contained around 300 images. The accuracy of
have proper functioning and also thus enabling the the validation set turned out to be 70%. The error was
arm to lift objects. 0.8 which makes the machine learning model a
reliable one.
2) Functioning of robotic arm: ​The segregation of
the medical wastes would be done using the robotic
arm integrated with the machine learning backend.
When an object is being identified by the machine
learning model, it would pass a signal to the PIC
controller’s input terminal which would use serial
communication to pass the pulse width modulated
signals as output from the PIC controller to the
robotic arm. These pulse width modulated signals
would reach the servo motors in the robotic arm. The
proposed solution has five servo motors(MG996R)
which would be used to initiate the robotic arm. The
arm after being initiated scans for the dustbin color
and with the trained machine learning model it would Fig. 5.1 Actual accuracy vs Validated Accuracy
drop the picked waste in the bin it has to drop. For
instance, if the robotic arm detects cotton, it would From the plot, it is observed that the validated
pick it and then have a wait time to scan to search the accuracy matches the actual accuracy at some points
yellow bin. Once it finds a yellow bin, the arm will and this confirms the accuracy of the model.
drop the waste into it. This is how the backend is
connected to the front end. REFERENCES

[1] Guoming Chen; Yongchang Chen; Zeduo Yuan;


Xuming Lu; Xiongyong Zhu; Wanyi Li, “​Breast
Cancer Image Classification based on CNN and
Bit-Plane slicing​”, 2019 International Conference on
Medical Imaging Physics and Engineering (ICMP).

[2] ​Shoji Kido​; ​Yasushi Hirano​; ​Noriaki Hashimoto​,


“​Detection and classification of lung abnormalities by
use of the convolutional neural network (CNN) and
Fig.4. 2. The functioning of the Arm regions with CNN features (R-CNN)​”, ​2018
International Workshop on Advanced Image
Technology (IWAIT)​.
[3] ​Hoo-Chang Shin​; ​Holger R. Roth​; ​Mingchen International Conference on Image, Vision, and
Gao​; ​Le Lu​; ​Ziyue Xu​; ​Isabella Nogues​; ​Jianhua Computing (ICIVC)​.
Yao​; ​Daniel Mollura​; ​Ronald M. Summers​, “ ​Deep
Convolutional Neural Networks for Computer-Aided [11] ​Ana Riza F. Quiros​; ​Alexander C. Abad​; ​Elmer
Detection: CNN Architectures, Dataset P. Dadios​, “​Object locator and collector robotic arm
Characteristics, and Transfer Learning​”, ​IEEE using artificial neural networks​”, ​2015 International
Transactions on Medical Imaging​. Conference on Humanoid, Nanotechnology,
Information Technology, Communication and
[4] ​Seong-Hyeon Han​; ​Kwang-Yeob Lee​, “ Control, Environment and Management (HNICEM)​.
Implementation of image classification CNN using
multi-thread GPU​”, ​2017 International SoC Design [12] ​Rosidah Sam​; ​Kamarul Ariffin​; ​Norlida
Conference (ISOCC)​. Buniyamin​, “​Simulation of pick and place robotics
system using Solidworks Softmotion​”, ​2012
[5] ​An Tien Vo​; ​Hai Son Tran​; ​Thai Hoang Le​,” International Conference on System Engineering and
Advertisement image classification using Technology (ICSET)​.
convolutional neural network​”, ​2017 9th International
Conference on Knowledge and Systems Engineering [13] ​Sara Fatima Noshahi​; ​Adil Farooq​; ​Muhammad
(KSE)​. Irfan​; ​Tayyaba Ansar​; ​Narumol Chumuang​, “​Design
and Fabrication of an Affordable SCARA 4-DOF
[6] ​Jie Feng​; ​Jiantong Chen​; ​Liguo Liu​; ​Xianghai Robotic Manipulator for Pick and Place Objects​”,
Cao​; ​Xiangrong Zhang​; ​Licheng Jiao​; ​Tao Yu​,” 2019 14th International Joint Symposium on
CNN-Based Multilayer Spatial–Spectral Feature Artificial Intelligence and Natural Language
Fusion and Sample Augmentation With Local and Processing (Isai-NLP)​.
Nonlocal Constraints for Hyperspectral Image
Classification​”, ​IEEE Journal of Selected Topics in [14] ​Rasika Yenorkar​; ​U. M. Chaskar​,” ​GUI Based
Applied Earth Observations Pick and Place Robotic Arm for Multipurpose
and Remote Sensing​. Industrial Applications​”, ​2018 Second International
Conference on Intelligent Computing and Control
[7] ​Kavitha D.​; ​Ramachandra Hebbar​; ​Vinod P.V.​; Systems (ICICCS)​.
Harsheetha M.P.​; ​Jyothi L.​; ​Madhu S.H.​, “​CNN
Based Technique for Systematic Classification of [15] ​K. Dhayalini​; ​R. Mukesh​, “​Deterioration &
Field Photographs​”, ​2018 International Conference non-deterioration wastes separation using pick &
on Design Innovations for 3Cs Compute place robot​”, ​2018 2nd International Conference on
Communicate Control (ICDI3C)​. Inventive Systems and Control (ICISC)​.

[8] ​Pradipta Sasmal​; ​Yuji Iwahori​; ​M. K. Bhuyan​; [16] ​Pratiksha Andhare​; ​Sayali Rawat​, “​Pick and
Kunio Kasugai​, “​Classification of Polyps in Capsule place industrial robot controller with computer
Endoscopic Images using CNN​”, ​2018 IEEE Applied vision​”, ​2016 International Conference on Computing
Signal Processing Conference (ASPCON)​. Communication Control and Automation
(ICCUBEA)​.
[9] ​Hideaki Yanagisawa​; ​Takuro Yamashita​; ​Hiroshi [17] ​Shivam Sharma​; ​Shashwat Sahai​; ​Jaisal Joshi​; ​N
Watanabe​, “ ​A study on object detection method Hema​, “​Stage-wise Development of a Remote
from manga images using CNN​”, ​2018 International Controlled Robotic Arm​”, ​2018 Fifth International
Workshop on Advanced Image Technology (IWAIT)​. Conference on Parallel, Distributed and Grid
Computing (PDGC)​.
[10] ​Xu Zhang​; ​Wei Pan​; ​Perry Xiao​, “​In-Vivo Skin
Capacitive Image Classification Using AlexNet [18] ​Prachi P. Sonawanc​; ​Gayatri M. Phade​, “
Convolution Neural Network​”, ​2018 IEEE 3rd Motion Control of Robotic Arm for
Micro-Positioning in Industrial Application​”, ​2018 Innovative Sustainable Computational Technologies
International Conference On Advances in (CISCT)​.
Communication and Computing Technology​.
[27] ​S. B. Abitha​; ​R. Dhanapal​, “​Depreciation of
[19] ​Faisal Ahmed​; ​Mohammad Adom Safiullah​; biomedical waste hazards: A solar-based approach​”,
Saddam Hossain Khan​; ​Abdullah Moinuddin​; ​Abu 2015 International Conference on Circuits, Power
Mohammed Farhan​, “​Assembly of Robotic Arm and Computing Technologies [ICCPCT-2015]​.
Based on Inverse Kinematics Using Stepper Motor​”,
2012 Sixth UKSim/AMSS European Symposium on [28] ​Selvaraj Geetha​; ​Samayan Narayanamoorthy​;
Computer Modeling and Simulation​. Daekook Kang​; ​Joseph Varghese Kureethara​, “​A
Novel Assessment of Healthcare Waste Disposal
[20] ​Roland Szabó​; ​Ioan Lie​, “​Automated colored Methods: Intuitionistic Hesitant Fuzzy
object sorting application for robotic arms​”, ​2012 MULTIMOORA Decision Making Approach​”, ​IEEE
10th International Symposium on Electronics and Access​.
Telecommunications​.
[29] ​Arunima Sharma​; ​Ramesh Babu Battula​,
[21] ​Pooja Raundale​; ​Sachin Gadagi​; ​Chinmay “​Architecture for Waste Management in Indian Smart
Acharya​, “​IoT based biomedical waste classification, Cities (AWMINS)​”, ​2019 International Conference
quantification, and management​”, ​2017 International on Information and Communication Technology
Conference on Computing Methodologies and Convergence (ICTC)​.
Communication (ICCMC)​.
[30] ​Patrick Ndayizigamiye​; ​Lydia Hangulu​; ​Olagoke
[22] ​Lakshmi​; ​J. Refonaa​; ​J. Vivek​, “​Tracking of Akintola​, “​A design of a mobile health intervention
biomedical waste using global positioning system​”, to enhance home-carers' disposal of medical waste in
2015 International Conference on Circuits, Power South Africa​”, ​2017 IEEE Global Humanitarian
and Computing Technologies [ICCPCT-2015]​. Technology Conference (GHTC)​.

[23] ​Jagruthi D. Atada​; ​S. Atheeth​; ​Samrat Sankhya​;


O. Kishore Kumar Sharma​, “​Creating smartness in
people towards waste management: Behavioral
approach to solving the issue​”, ​2017 IEEE Region 10
Symposium (TENSYMP)

[24] ​Chunping Huang​; ​Zhenxiang Zeng​; ​Dawei Yue​,


“​The Design and Its Achieving Method on
Multi-Dimension Data Warehouse of Medical Waste
Management​”, ​2006 IEEE International Conference
on Service Operations and Logistics, and Informatics​.

[25] Onur Koçak ; Hüseyin Kurtuldu ; Ali Akpek ;


Arif Koçoğlu ; Osman Eroğul, “​A medical waste
management model for public private partnership
hospitals​”, ​2016 Medical Technologies National
Congress (TIPTEKNO)​.

[26] ​Kuldeep​; ​Shivani Saini​; ​Pushpa Singh​; ​Rajnesh


Singh​, “​Integrated Online Framework for Waste
Management​”,​2019 International Conference on

You might also like