Waste Management Detection
Using Deep Learning
1 4
Dr. Pokkuluri Kiran Sree
Head & Professor, Dept of C.S.E,
Shri Vishnu Engineering College for Women(A),
Bhimavaram,
hodcse@svecw.edu.in
2
Smt SSSN Usha Devi N
Assistant Professor , University College of
Engineering, JNTUK, Kakinada,
ushaucek@gmail.com
3
Mr. G. Ramesh Babu
Dept of C.S.E, Shri Vishnu Engineering College for
Women(A), Bhimavaram,
Abstract— In the modern world waste pollution is the
challenging environmental issues. To reduce
pollution, we need to recycle the waste. In order to
recycle waste, one must know which category the
waste belongs to. Waste classification is a social issue
related to people’s livelihood, so letting smart systems
perform intelligent waste classification has important
significance. So, we are here with a waste detection
system that uses deep learning and categorizes the
waste plastic or non-recyclable or glass or bio or
others. The proposed system is trained and tested to
detect the classify the waste using the
CNN(Convolution Neural Network) i.e. a deep
learning algorithm. The image of the waste material is
fed into a neural network which determines the class
of object. We have considered precision, recall and F1
Score as performance metrics to evaluate our model.
The proposed model is compared with existing
baseline models like machine learning, basic neural
networks and datamining approach. The developed
deep learning model has outperformed the existing
literature with chosen parameters.
Keywords: Deep Learning, Object Detection, yolov5,
Faster R -CNN, Waste Classification, etc.
I. INTRODUCTION
A major concern of the present world is
waste management. Here, the amount of waste in
the world generates at least 5 million tons of waste
per day and this number is still increasing day by
day. Recycling waste is particularly important to
reduce pollution[2]. To recycle waste, one must
know which category tells that waste belongs to.
Waste Management in the present time is
known to everyone but unfortunately, it is
neglected by numerous people that are utilized to
portray exercises for waste segregation to take care
of issues brought about by wrong garbage disposal
. Illegal dumping has been a constant issue in
numerous urban communities on the planet[1]. The
smells and pollutants brought about by deserted
household things and unloaded trash, and
construction leftovers ruin the city as well as
threaten the well being of the citizens. To diminish
Mr. Ch. Phaneendra Varma
Dept of C.S.E,
Shri Vishnu Engineering College for Women(A),
Bhimavaram,
5
Dr. M. Prasad
Dept of C.S.E,
Shri Vishnu Engineering College for Women(A),
Bhimavaram,
6
Dr. P.B.V.Raja Rao
Dept of C.S.E,
Shri Vishnu Engineering College for Women(A),
Bhimavaram,
illegal dumping, a couple of urban areas have
planned network-based voluntary reporting
frameworks and observation camera-based
monitoring frameworks.
But these methodologies require manual
observing and recognition, which are vulnerable
and expensive against false alarms. The techniques
of deep learning are being effectively applied to
different areas, for example, medical imaging,
autonomous driving, and numerous industrial
environments with amazing outcomes on object
identification issues. Applying these techniques to
waste sorting can build the amount of recycled
material and thus, give a simpler everyday life for
the common people as well as more efficiency for
the industry.
Thus, the aim is to plan and develop a
framework with a deep learning approach that can
be effectively used for waste segregation. The
image will be recognized by utilizing the concept
of a CNN and with the help of an image processing
method that identifies wastes from their shape,
color, dimension, and size . This technique
automatically will help the system to learn the
pertinent features from the sample images of the
trash and consequently recognize those features in
new images. By using the strategy of CNN garbage
will be classified into different classes. The strategy
utilized for this characterization[3] is with the
assistance of Tensorflow Object Detection API and
Faster R- CNN technique. Through this technique,
bounding boxes are made on the recyclable waste
demonstrating which class (cardboard, paper,
metal, glass, plastic, and trash) the waste falls into.
The main objective of this study is to develop
software to detect types of recyclable materials in
trash bins and check for possible contamination
which would ultimately reduce human effort in
waste segregation[5].
So, we are here with a waste detection
system that uses deep learning and categorizes the
different waste materials into bio, glass, metal,
plastic, non-recyclable, paper..
II. RELATED WORKS
Environmental pollution is related to waste
management and it is a global problem. So, the
huge production of biodegradable goods in the past
few years has resulted in significant increase to
build garbage, which according to the household
waste collection reports 5.2 tons of waste were
generated in 2018[4]. By the time it reaches 2050,
it is predicted to have three billion tons waste every
year. World Bank States that 14% of waste is
recycled globally and without any classification
initially 30% of the garbage is separated from the
original waste. So, this leads to the fact that
different types of wastes are freely separate in a
wide variety of environments.
We have identified the most spreading and
environmental harm is due to plastic waste. This
spreading is increasing day by day, we need to
prevent this pollution of this environment and them
protect the wild animals and human life.
Since then, the number has been increasing day by
day. According to the most recent WHO report,
466 million individuals, or 5% of the world's
population, had hearing loss in 2019. Of these, 432
million (or 83%) were adults and 34 million (or
17%) were children. The WHO predicted that by
2050, the number will double. There is a need to
remove the communication barrier that impacts
deaf-mute people's lives and social interactions in
this rapidly expanding population[7].
III. SYSTEM DESIGN
A. Convolutional Neural Networks (CNN)
The convolutional neural networks (CNN)
main function is to classify or the images/pictures
or group the images or cluster the pictures by the
similar features and it performs the detection of the
object by artificial neural networks. CNN takes the
input as information pertaining to the pictures and
then process the image as a tensor. It can be viewed
as the matrix of numbers with the dimensions also
as an input and then sort the search. Then CNN
identifies 3D objects are the portion of instances
which recognize the images in large scale. Many
applications, such as item identification and facial
recognition, are uploading it. One of the top non-
trivial assignments is this one. Convolutional
layers, subsampling layers, and fully linked layers
are the three distinct layer types that are seen as
components of CNN in neural networks. Since
CNN offers more benefits than other techniques, it
is primarily utilized for image recognition.
B. Object Detection
Object Detection is a part of the computer
vision technique where a software framework can
detect, trace, and locate the object from any given
video or image. One of the special traits of object
detection is that it recognizes the object's class and
the coordinates of the location of the object in the
given picture. By drawing a bounding box around
the object, it states that the region is being pointed
out.The bounding box might or might not precisely
find the location of the object. The capability of
locating the object inside a picture describes the
accuracy of the performance of the algorithm
which is being used for detection. Face
identification is one of the instances of object
detection [6][15].
For the most part, the object detection task
is completed in three stages:
The little rectangular portions are being produced
upon the input image.
1. Feature extraction is completed for each
portion of the rectangular region to predict
whether the rectangular shape contains a
valid object.
2. Finally, the rectangular boxes which are
overlapped get combined into a single
bounding box showing the detection result
of the object.
C. Image Processing
Image processing is one of the main parts
of a structure of signal processing, where the input
is in the form of an image; for instance, a
photograph or video clip. The performance of an
image processing can likewise be an image or
plenty of characteristics or parameters related to the
image. The main objective of image preprocessing
is to upgrade the image information where
superfluous images were taken out, and the
significant images are added for additional
processing[8].
D. Proposed System
Input Convolution Layer Fully Connected Layer Output
Fig. 1 CNN Architecture
In our paper we primarily focus on
producing a CNN model which can detect the
images of waste and show the accuracy of that
particular image. We made a system which can
detect many types of waste into categories such as:
bio, glass, metal, plastic, non-recyclable, paper and
other. Preprocessing techniques aim to enhance the
image's details in order to remove unwanted
distortions and improve a few aspects of the input
image. Image processing can remove extraneous
characteristics, convert RGB images to grayscale,
and pair them. A sophisticated digital instrument,
such as a camera, takes a photograph of the image
and converts it into grayscale. Calculating the
average estimate of the three components of the
two colours results in the grayscale transformation
(0 and 255 separately). The colour intensity is
determined by a set limit, in this case 127, which is
adjusted to 0 and then to 255[9].
The proposed design is presented in
Figure 1. We have used the basic AlexNet and used
the normalization function. Then we have
deactivated the two convolutional layers consisting
of 238 filters. In the first model we have used the
Softmax for the last fully connected layer as a
activation function and cross entropy categorical
loss function. In the later model ie second we have
used a linear function for the last fully connected
layer with hige categorical loss function. CNN is
turned to be better classifier for handling the multi
class classification [10].
Both the images of waste and capturing of the
waste by using a camera will be shown in our
Application. So it will detect the particular images
of waste and then it will give the accuracy [12].
IV. IMPLEMENTATION
A. Model Building
We take the dataset and these divisions
were made depending on the pictures contained in
the separate respective folder. But the annotations
of these images were specifically needed for
training the data in a Faster R- CNN model. To get
the annotations that are for the labeling of the
images, a tool has been used which is known as the
LabelIMG tool.In LabelIng tool, we needed to label
the relevant area of the image to the class it is
associated with such as cardboard, metal, trash, etc.
This type of labeling of the image includes the
strategy of creating boundaries to the waste object
in the picture.The whole purpose of this particular
system is to make the framework figure out how to
detect objects. The data of the annotations of the
images made by the LabelIMG tool are saved in the
XML extension format. The annotations of the
picture include the size of images, location
coordinates, and also the names of marked objects
that could be inspected in the file[11].
B. Model Training
After model construction it is time for
model training In this phase, the training data is
generated by generating TFrecords and converting
the XML files(annotations of the images labeled by
LabelIMG tool) to CSV files which contain all the
data for the train and test images. After the training
data is generated, a label map is created which
notifies the system about what each object is by
characterizing a mapping of class ID numbers to
class names. After the label map is created, finally,
the object detection pipeline is configured which
helps in defining what type of parameters and
models is used for training.
C. Model Testing
During this phase a second set of data is loaded.
Testing the trained model is the last part of the
process. After the training gets completed, the
frozen inference graph is exported. This is used for
identifying and classifying the objects in a real-
time feed utilizing webcam, images, and
videos[14].
D. Live Detection
In this module, the user can directly turn on their
camera and start showing the images, the images
will start predicting the accuracy of that particular
image[13].
V. RESULTS AND DISCUSSION
In this segment, the outcomes of the
created model will be examined. The created model
works reasonably on the test data. Out of 500
images, 420 images were accurately predicted by
the model which concludes that the accuracy rate of
the model is near about 90%.The model precisely
classifies the type of waste materials by detecting
the type of objects. The images of the testing data
were utilized for testing the result of the created
model. For the detection of the waste materials, the
images of the test data have been specifically
included in the testing code. The total detection
time taken by the model to predict a single object
from an image is about some seconds.
To find the actual accuracy of the model,
the names of the images were physically given to
observe how exact the functions of the model have
performed in those images. At first, during testing,
multiple boundaries have been observed getting
created in the region of the detection of the objects
and by changing the threshold for the prediction of
the images this error was eliminated. This aided in
invalidating the boundaries of the object with
minimal threshold values.
The model is also being tested on multiple
waste objects. Though in some images it could
detect and predict the multiple objects accurately as
the training dataset does not contain any multiple
waste objects that's why the prediction of the model
was not consistent and sometimes it failed to detect
the waste objects accurately in an image with
multiple objects. The total detection time taken by
the model to predict multiple objects from an image
is near about 8.09 seconds. The multiple object
images were taken in a white background for
testing as the images of the training dataset were
also taken in a white background. These images do
not belong to testing data and were taken by a
mobile camera.
This analysis can be done by applying the
various classification algorithms of each model on
this framework separately and lastly conclude the
best-suited model which will be utilized to get
more accurate object detection and prediction in a
short time. We can also choose the hardware part
by using Robotic to pick the garbage and then put it
into the garbage bin.
Fig. 2 Summary of Precision, Recall, F1 Score using Deep
Learning (CNN)
In the above graph, we can see the
accuracy of the images after training and validation
of the dataset. We can see that the results of
training and validation on the above graph So, this
graph is for detecting the percentage of the given
dataset images.
The output of the CNN (Deep Learning)
classifier is five classes i.e. dividing the material
into waste plastic, non-recycle content, glass, bio
and others. We have evaluated our classifier using
precision, recall and F1 score. The proposed
classifier has identified the waste plastic with 0.94
precision, non-recycle waste with 0.79 F1 score,
glass class with 0.89 F1 score, bio class with 0.82
F1 score and others class with 0.78 as shown in the
Figure 2.
Fig. 3 Comparison with Base Line Classifiers
The proposed classifier ie CNN (Deep
Learning) has reported a precision for identifying
waste plastic as 0.94, non-recycle content as 0.75,
glass content as 0.87, bio class as 0.78 and others
class as 0.78. DM(Data Mining) has reported a
precision for identifying waste plastic as 0.85, non-
recycle content as 0.74, glass content as 0.80, bio
class as 0.72 and others class as 0.73. The NN(
Neural Network) approach has reported a precision
for identifying waste plastic as 0.84, non-recycle
content as 0.69, glass content as 0.81, bio class as
0.74 and others class as 0.61. The ML( Machine
Learning) approach has reported a precision for
identifying waste plastic as 0.85, non-recycle
content as 0.68, glass content as 0.76, bio class as
0.81 and others class as 0.64 as shown in Figure 3.
The results show the robustness and versatility
of the developed classifier.
VI. CONCLUSION
With the help of Waste Management detection,
we can recycle a lot of wastage which helps in
reducing pollution. This leads to minimizing cost
and to maintain the surroundings clean. This is one
of the unique methods to detect waste and classify
the waste using the standard benchmarked datasets.
We have ensured that the quality of the detection of
waster in different environments is tested. The
framework has received the best remarkable
performance in the detection of waste. The future
work also aims to implement this technology in a
mobile platform so that it becomes very easy for
the user to classify waste materials and dump the
waste materials in the correct disposal bin to
protect the environment and reduce pollution.
REFERENCES
[1] He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep
residual learning for image recognition. In Proceedings of
the IEEE conference on computer vision and pattern
recognition (pp. 770-778).
[2] A. Lanorte, F. De Santis, G. Nolè, I. Blanco, R.V. Loisi, E.
Schettini, G. Vox Agricultural plastic waste spatial
estimation by Landsat 8 satellite images Comput. Electron.
Agric., 1 (2017), pp. 35-45,
10.1016/j.compag.2017.07.003
[3] Y. Liu, Z. Ge, G. Lv, S. WangResearch on automatic
garbage detection system based on deep learning and
narrowband internet of things J. Phys.: Conf. Ser.,
1069(2018), p. 012032, 10.1088/1742-
6596/1069/1/012032
[4] Zhao, Z.Q.; Zheng, P.; Xu, S.t.; Wu, X. Object detection
with deep learning: A review.
IEEE transactions on neural networks and learning systems
2019, 30, 3212–3232.
[5] Çevik, E.; Zengin, K. Classification of Skin Lesions in
Dermatoscopic Images with Deep Convolutional Network.
[6] Simonyan, K.; Zisserman, A. Very deep convolutional
networks for large-scale image recognition. arXiv preprint
arXiv:1409.1556 2014.
[7] Donovan, J. Auto-trash sorts garbage automatically at the
techcrunch disrupt hackathon. Techcrunch Disrupt
Hackathon, San Francisco, CA, USA, Tech. Rep. Disrupt
SF 2016, 2016.
[8] Awe, O.; Mengistu, R.; Sreedhar, V. Smart trash net:
Waste localization and classification.
arXiv preprint 2017.
[9] Pokkuluri, Kiran Sree, SSSN Usha Devi Nedunuri, and
Usha Devi. "Crop Disease Prediction with Convolution
Neural Network (CNN) Augmented With Cellular
Automata." INTERNATIONAL ARAB JOURNAL OF
INFORMATION TECHNOLOGY 19.5 (2022): 765-773.
[10] Pokkuluri, Kiran Sree, and Devi Nedunuri Usha. "A secure
cellular automata integrated deep learning mechanism for
health informatics." Int. Arab J. Inf. Technol. 18.6 (2021):
782-788.
[11] Pokkuluri, Kiran Sree, and SSSN Usha Devi Nedunuri. "A
Novel Cellular Automata Classifier for COVID-19
Prediction." Journal of Health Sciences 10.1 (2020): 34-38.
[12] Sree, P. K. Deep Learning Mechanism Augmented with
16-Hybrid Cellular Automata For Secondary Structure
Prediction. PP: 490-493 , Volume-9 Issue-2, December
2019, International Journal of Innovative Technology and
Exploring Engineering (IJITEE).
[13] Anh Khoa, Tran, et al. "Waste management system using
IoT-based machine learning in university." Wireless
Communications and Mobile Computing 2020 (2020): 1-
13.
[14] Xu, A., Chang, H., Xu, Y., Li, R., Li, X., & Zhao, Y.
(2021). Applying artificial neural networks (ANNs) to
solve solid waste-related issues: A critical review. Waste
Management, 124, 385-402.
[15] Dias, J. L., Sott, M. K., Ferrão, C. C., Furtado, J. C., &
Moraes, J. A. R. (2021). Data mining and knowledge
discovery in databases for urban solid waste management:
A scientific literature review. Waste Management &
Research, 39(11), 1331-1340.