Professional Documents
Culture Documents
Share Mid Term Report
Share Mid Term Report
Changunarayan,Bhaktapur
Report On:
Web Based Pigeon Pea Diseases Classification and
Recommendation System Using ML
SUBMITTED BY:
Ram kishor Yadav(019-409)
Rohit Bahadur Chand(019-410)
SUBMITTED TO:
Department Of Electronics and Communication Engineering
Nepal Engineering College
Bhaktapur, Nepal
April, 2024
Nepal Engineering College
Department of Electronics and Communication Engineering
CERTIFICATE
The undersigned certify that hethey have read and recommended to the Department of
Electronics and Communication Engineering for acceptance, a project report entitled"Web
Based Pigeon Pea Diseases Classification and Recommendation System Using
ML" .submitted by Rohit Bahadur Chand and Ram Kishor Yadav in partial fulfillment of the
requirement for the Bachelor’s degree in Electronics and Communication Engineering.
Supervisor:
...................................
Assoc.Prof.Bijaya Shrestha
Asst.Prof.Deepesh Prakash Guragain
Nepal Engineering College
Changunarayan , Bhaktapur
External Examiner:
...................................
Name of External Examiner
Position in the College/Company
Name of College/Company
ii
DEPARTMENTAL ACCEPTANCE
The project report entitled “Web Based Pigeon Pea Diseases Classification and
Recommendation System Using ML”, submitted by Rohit Bahadur Chand and Ram Kishor
Yadav in partial fulfillment of the requirement for the Bachelor’s degree in Electronics and
Communication Engineering has been accepted as a bonafide record of work independently
carried out by the group in the department.
……………………………..
Asst.Prof.Deepesh Prakash Guragain
Project Coordinator
Department of Electronics and Communication Engineering,
Nepal Engineering College,
Bhaktapur, Nepal.
iii
ACKNOWLEDGEMENT
It is great to pleasure for us to acknowledge the assistance and contributions of various
individual for providing necessary ideas and views for our project. Firstly; we would like to
thank the Department of Electronics and Communication Engineering for providing this
opportunity.
We would like to express our sincere gratitude to Asst. Prof. Deepesh Prakash Guragain and
Assoc.prof. Bijaya Shrestha for his invaluable guidance and support throughout the
preparation of this project . His expertise and encouragement have been instrumental in
shaping our ideas and refining our approach. We are truly thankful for his time, insights, and
dedication to helping us navigate this early stage of our project.
iv
ABSTRACT
Plant disease classificationsand early disease treatment are essential for sustainable crop
production. Computer vision for crop science is overgrowing with the advancement in deep
learning. Real time plant disease classificationsposes a challenge due to the unpredictable
spread of diseases within the plant, environmental factors, and the scarcity of real field
datasets. The proposed work systematically addresses these issues through three key
components: (a) Collaboratively generating the novel pigeon pea image dataset from
agricultural fields. (b) The design of lightweight and high-performance models for real-time
plant disease classificationsin resource-constrained devices. (c) The extraction of multiscale
feature of plant diseases using Multi-kernel Depthwise separable Convolutions. The proposed
lightweight Lite-MDC architecture uses the Multi-kernel Depthwise separable Convolutions
(MDsConv). The MDsConv module captures spatial features across various scales while
maintaining alightweight design. It effectively extracts multi-scale information to
characterize plant diseases, accommodating their diverse scale.. The proposed method
outperforms the state-of-the-art networks such as VGG16, ResNet50, on the proposed pigeon
pea dataset with 94.14% accuracy. Notably, the method achieves a 34 Frames Per Second
(FPS) inference on an NVIDIA P100 GPU. Furthermore, its performance is validated across
publicly available datasets, including the plant village dataset, yielding 99.78%, accuracy.
v
Table of Contents
1 INTRODUCTION..............................................................................................................1
1.1.1 Background:.........................................................................................................1
1.1.5 Bracteomania........................................................................................................5
1.4 Scope.........................................................................................................................10
1.5 Applications...............................................................................................................11
2 LITERATURE REVIEW.................................................................................................12
3 METHODOLOGY...........................................................................................................16
vi
3.2.6 Annotation and Labeling:...................................................................................18
3.2.11 Documentation:..................................................................................................18
3.5 Algorithm:.................................................................................................................22
3.6 Assumptions:.............................................................................................................22
3.7.1 Hardware:...........................................................................................................22
3.8 Software:....................................................................................................................23
3.8.1 Python:...............................................................................................................23
3.8.2 HTML................................................................................................................23
vii
5 CONCLUSION................................................................................................................35
6 References........................................................................................................................36
viii
List of Figures:
Figure 1-1: some examples diseases present in Pigeon Pea............................................................................1
Figure 1-2: Alternaria blight (Alternaria alternata)......................................................................................... 2
Figure 1-3: Sterility Mosaic............................................................................................................................ 3
Figure 1-4 : Fusarium Leaf Blight................................................................................................................... 4
Figure 1-5: Bracteomania.............................................................................................................................. 5
Figure 1-7 Resnet-50 Model architecture....................................................................................................... 8
Figure 1-6: VGG16......................................................................................................................................... 8
Figure 1-8:Efficient Net- B0 model architecture............................................................................................. 9
Figure 1-9: Custom CNN model architecture.................................................................................................. 9
Figure 1-10: inception model architecture................................................................................................... 10
Figure 3-1: Working Block Diagram.............................................................................................................. 16
Figure 3-2: Prposed DL model...................................................................................................................... 20
Figure 3-3: Some Sample Images................................................................................................................. 20
Figure 3-4:Flowchart Prediction of disease and Recommendation...............................................................22
Figure 3-5: Android phone........................................................................................................................... 22
Figure 3-6:Camera....................................................................................................................................... 23
Figure 4-1: Training and validation loss graph VGG16 model........................................................................24
Figure 4-2:Training and validation accuracy graph of VGG16 model.............................................................24
Figure 4-3: Confusion Matrix of VGG16 Model............................................................................................. 25
Figure 4-4: Training and validation accuracy graph of ResNet50 model......................................................26
Figure 4-5:Training and validation loss graph of ResNet50 model................................................................26
Figure 4-6: Confusion Matrix of ResNet50 Model.........................................................................................27
Figure 4-7:Training and validation accuracy graph of Efficient Net -B0 model...............................................28
Figure 4-8: Training and validation loss graph of Efficient Net- B0 model.....................................................28
Figure 4-9:Confusion Matrix of Efficient Net -B0 Model...............................................................................29
Figure 4-10:Training and validation accuracy graph of Cuatom CNN model..................................................30
Figure 4-11: Training and validation loss graph of Custom CNN model........................................................30
Figure 4-12: Confusion Matrix of Custom CNN Model.................................................................................31
Figure 4-13:Training and validation accuracy graph of Inceptionv3 Model...................................................32
Figure 4-14: Training and validation loss graph of Inceptionv3 Model.........................................................32
Figure 4-15: Confusion Matrix of Inceptionv3 Model...................................................................................33
ix
1 INTRODUCTION
1.1 Background and statement of problem
1.1.1 Background:
Globally, pigeon pea is the sixth most significant legume in Asian countries .Pigeon pea is a
rich source of protein, high in fiber, and contains essential amino acids. However, the
numerous occurrences of plant diseases may significantly restrict the plants’ health and affect
the yield. Annually, plant diseases cause production loss between 12 23 million
dollars.Presently, the detection of numerous plant diseases predominantly relies on human
visual assessment. Farmers and experts depend on visually inspecting plants to spot diseases.
This method has limitations. Subjective interpretations and visual fatigue can result in
inaccurate assessments. When diseases are misdiagnosed, it can disrupt the monitoring and
control procedures, resulting in the improper application of pesticides, diminished plant
quality, and reduced yields .Considering the potential repercussions of misidentifying plant
diseases, it becomes evident that precise disease identification is indispensable for preserving
plant health and attaining optimal yields.
1.1.2
1.1.2.2 Symptoms:
Symptoms develop as small, circular, necrotic spots on leaves that develop quickly forming
typically concentric rings. The lesions appear on all aerial plant parts including pods. They
cause blighting of leaves ,and severe defoliation and drying of infected branches. The fungus
sporulates well under warm, humid conditions.
2
Some pigeonpea varieties, e.g., ICP 2376 exhibit ring spot leaf symptoms (green
islands surrounded by chlorotic areas), these indicate localized sites of
infection of the pathogen , and such plants produce normal flowers and pods.
1.1.3.2 Preventions
1.1.3.2.1 Biological Control
Introduce predatory mites like Amblyseius swirskii to prey on eriophyid mites,
vectors of Sterility Mosaic.
Apply beneficial nematodes like Steinernema feltiae to soil to target eriophyid mite
larvae.
3
yellow and dry prematurely. When the weather is humid, white mycelia with abundant
conidia appear on the blighted leaves. Lesions may expand rapidly, causing necrosis of entire
leaves.
Chemical Control
1.1.5 Bracteomania
1.1.5.1 Symptoms
Affected plants are stunted with few branches, they produce solitary simple leaves with
obtuse tips and long petioles attached to their stems, twigs, and floral shoots. Axillary flower
buds proliferate into abnormal, clustered inflorescences .The flowers of affected plants are
sessile, small, bunchy, and tightly packed, giving the inflorescences a knotted appearance.
Such flowers do not produce normal pods.
5
1.1.6.3 Data-Driven Decision Support:
Traditional approaches to disease Presentations in pigeon pea may lack the data-driven
precision required for optimal decision-making. CNNs can analyze large datasets of images
depicting healthy and diseased pigeon pea plants, learning patterns and features that are
imperceptible to the human eye. This allows for more accurate and data-driven decision
support in recommending appropriate Presentations strategies.
Deep learning techniques, such as CNNs, excel in image recognition tasks. Integrating deep
learning into disease classifications systems for pigeon pea allows for the automatic
extraction of intricate features from images, enabling more nuanced and accurate
identification of diseases at various stages of development.
By addressing these challenges through the integration of machine learning and CNNs, Nepal
can significantly enhance its pigeon pea disease classifications and recommendation systems.
The application of these advanced technologies holds the potential to revolutionize
agricultural practices, ensuring sustainable pigeon pea cultivation and improved livelihoods
for farmers in the region.
6
here is not labeled. So the first task is to clean and label the database. There is a huge
database so basically the images with better resolution and angle are selected. After selection
of images we should Have deep knowledge about the different Pigeon Pea. Different types of
plant images are studied and corresponding. After detail study, labeling in done by
segregating the images and with different diseases.
Source:https://medium.com/geekculture/boost-your-image-classification-model-with-pretrained-vgg-16-ec185f763104
1.2.2.2 ResNet50
ResNet-50 is a 50-layer convolutional neural network (48 convolutional layers, one MaxPool
layer, and one average pool layer). Residual neural networks are a type of artificial
neuralnetwork (ANN) that forms networks by stacking residual blocks.
7
1.2.2.3 Efficient Net- B0
EfficientNet is a convolutional neural network built upon a concept called "compound
scaling.” This concept addresses the longstanding trade-off between model size, accuracy,
and computational efficiency. The idea behind compound scaling is to scale three essential
dimensions of a neural network: width, depth, and resolution
Source:https://www.researchgate.net/figure/The-detailed-structure-of-each-stream-in-MAT-EffNet-The-input-is-RGB-video-frames-
or_fig5_361521546
8
1.2.2.5 Inceptionv3
Inception v3 is a convolutional neural networkfor assisting in image analysis and object
detection and got its start as a module for GoogLeNet. It is the third edition of Google's
Inception Convolutional Neural Network, originally introduced during the ImageNet
Recognition Challenge. The design of Inceptionv3 was intended to allow deeper networks
while also keeping the number of parameters from growing too large: it has "under 25 million
parameters", compared against 60 million for AlexNet. Just as ImageNetcan be thought of as
a database of classified visual objects, Inception helps classification of objects in the world
of computer vision .The Inceptionv3 architecture has been reused in many different
applications, often used "pre-trained" from ImageNet
1.4 Scope
It can be used by farmer to diagnose the different kinds of diseases in Pigeon Pea.
Technology can be transferred to other domain of agriculture.
It can be useful for facial recognition.
It can also be applied for human and animals disease detection.
9
1.5 Applications
Early diseases identification in Pigeon Pea.
Recommendation for Pigeon Pea diseases
It can be also applied for other species disease classificationsandrecommendation.
10
2 LITERATURE REVIEW
2.1 Related work and Research gap
Title and Authors Year of Work Done TechniquesUsed
Publication
1) machine learning 2015 Databasecontaining 330 images metric for evaluating the
and of paddy leaves showed that the KNN classifier, and not
Sachin D. Khirade & et 2017 It requires tremendous amount image acquisition, image
al. [3] Identification of of work, pre-processing, image
the plant diseases is the expertise in the plant diseases, segmentation, feature
key to preventing the and also require the excessive extraction and
losses processing time classification
in the yield and
quantity of the
agricultural product.
11
Kulkarni, in the paper 2019 Itgives better results with a artificial neural network
methodology for early recognition rate of up to 91%. (ANN) and diverse
and accurately plant image
diseases detection, processingtechniques
usingartificial neural ANN classifier for
network (ANN) and classification and Gabor
diverse image filter for feature
processing techniques extraction
Sibiya & 2021 . One hundred images per class . CNN architecture used
Sumbwanyambe they will beused with a ratio of 70% was not explained in
using 3 classes of for training and 30% for testing. detail, but it
disease classification: The testing results showed an onlymentioned using 50
northern leaf blight, accuracy hidden layers consisting
common rust, and of 92.85%. of convolution layers
cercospora with filter kernels that
have amedian of 24,
rectified linear units
(ReLU) and pooling
layers
12
Sukhvir Kaur et al. 2021 A rule-based semi-automatic color features,
provide a technique for system using concepts of k- texture features, and
the detection of disease means is designed and their combinations to
from Soybean leaf implemented to train three models based
images distinguish healthy leaves from on support vector
diseased leaves. The proposed machine
system gives maximum classifier. Using SVM
average classification accuracy classify the proposed
reported is ~90% using a big system classify the leaf
dataset of 4775 images. disease in 3 classes like
i.e.downy mildew, frog
eye, and sectorial leaf
blight
Efficient crop yield 2022 The Supervised learning Backing Vector machine
recommendation Algorithm is used to predict Calculation to perform
system using machine harvest with higher precision and AI, Supervised machine
learning for digital productivity forranchers to settle learning algorithm
farming on the yield to be planted
13
Most of the Author has done research on the leaf detection of plants like potato, tomato,
rice,paddy, wheat and so on. Comparison among the entire author for better result is done by
fewauthors was the number of image feature considered was few and overall accuracy was
low. Also,we did not find any research related to pigeon pea diseases detection. This research
will havemultiple features like contract, inverse difference moment, entropy and color for
training and prediction purpose of pigeon pea to get higher accuracy. More than one thousand
images will beconsidered in this research. The Artificial Intelligence model like deep
learning, machine learning,CNN will be used for training and testing purpose and the
accuracy result will be compared. CNNhas different layers that are Dense, Dropout,
Activation, Flatten, Convolution2D, and MaxPooling2D. After the model is trained
successfully, the software can identify the disease if theplant species is contained in the
database. After successful training and preprocessing, comparisonof the test image and
trained model takes place to predict the disease.
14
3 METHODOLOGY
3.1 Basic Block Diagram
The block diagram of Pigeon Pea diseases detection based on convolution neural network is
shown in figure 3.1. Firstly, raw images are captured and then images are applied for resizing
and sampling. The CNN based disease classifications is divided into two phase such as
training and testing phases. Image database system organizes digital pictures into a central
location of fast sharing and regain especially with effort. In testing phase, the input image is
inserted for preprocessing. After preprocessing in training and testing phase, images are
passing on for feature extraction. In feature extraction, the extracted feature signals are
utilized by the neural network for classification. The extracted images are different group of
similar types. Future, classified image are compared in order to find healthy and unhealthy
Pigeon Peas. Thus, this system will determine or identify diseases.
where X is the input data, Y is the output data, and G is the function that maps the input data
to the output data. The function G is learned by the CNN during training, and it can be a
complex non-linear function that involves multiple layers of convolution, pooling, and fully
connected layers .
15
3.2 Dataset Description
Table showing total number of data taken for training and validation as well as testing
16
3.2.6 Annotation and Labeling:
Annotate each image with labels indicating the presence of diseases and their types. Use a
standardized labeling system for consistency and clarity.
The database is divided into 80% for testing and 20% for learning. First the augmentation
data are applied for the training data settings applied include flipping (random), padding
mode (reflection) and zoom with crop (Zoom with crop‟ was later omitted after discovering
that .
3.2.11 Documentation:
Document details of each image, including location, date, and specific disease if present.
Create a metadata file containing information about the dataset for future reference.
17
3.2.13 Data augmentation and process:
Data augmentation is crucial in deep learning, especially for image classification tasks where
datasets may be limited in variety. Techniques like flipping, rotating, and scaling images
increase dataset diversity, aiding in building accurate models. By applying these
transformations, the model encounters variations in the data, enhancing its ability to
generalize to unseen examples. This augmentation process enriches the dataset, leading to
improved model performance and robustness.
18
3.3 Proposed DL Model
3.4
Sampling data
19
20
3.5 Algorithm:
Start
3.6 Assumptions:
We are dealing with pigeon pea only.
3.7.1 Hardware:
3.7.1.1 Mobile device
In our project, this device is use to take images
21
3.7.1.2 Camera
This is also used to capture the image for the collection of data.
Figure 3-16:Camera
3.8 Software:
3.8.1 Python:
Python is an interpreted high-level general-purpose programming language. Its design
philosophy emphasizes code readability with its use of significant indentation. Its language
constructs as well as its object-oriented approach aim to help programmers write clear,
logical code for small and large-scale projects.
3.8.2 HTML
A webpage is a hypertext document on the world wide web. Web pages are delivered by a
web server to the user and displayed in a web browser
Upon the completion of this proposed project, we expect the following output:
22
4 RESULTS AND DISCUSSION
The results are compared with state-of-the-art methods from both qualitative and quantitative
perspectives to provide a comprehensive analysis. A lightweight CNN architecture with multi
kernel depth wise separable convolution called MDC (multi-dimensional convolution) is
proposed for plant disease Classifications. Depthwise convolution is employed to reduce the
computations, and the mixed convolution kernels are used to match the receptive fields in the
multiscale variation of plant diseases.
23
24
4.1.2 ResNet50-Training and Validation Accuracy
25
Figure 4-22: Confusion Matrix of ResNet50 Model
26
4.1.3 Efficient Net- B0 -Training and Validation Accuracy
Figure 4-23:Training and validation accuracy graph of Efficient Net -B0 model
Figure 4-24: Training and validation loss graph of Efficient Net- B0 model
27
Figure 4-25:Confusion Matrix of Efficient Net -B0 Model
28
4.1.4 Custom CNN Model-Training and Validation Accuracy
Figure 4-27: Training and validation loss graph of Custom CNN model
29
Figure 4-28: Confusion Matrix of Custom CNN Model
30
4.1.5 Inceptionv3-Training and Validation Accuracy
31
Figure 4-31: Confusion Matrix of Inceptionv3 Model
32
Precision 0.986 0.986 0.97 0.834 0.054
Recall 0.984 0.982 0.97 0.796 0.2
F1-score O.986 0.986 0.97 0.804 0.086
Accuracy 0.984 0.982 0.97 0.812 0.27
5 CONCLUSION
The evaluation of five different modules used for pigeon pea plant disease classification
reveals varying levels of performance. ResNet50 and VGG16 demonstrate robust results,
showcasing high precision, recall, F1-score, and accuracy. These models appear to be the
33
most reliable for this classification task. Inceptionv3 also performs well, although slightly
below ResNet50 and VGG16 in precision and recall metrics. However, it maintains a high
level of accuracy, indicating its effectiveness for this task.
On the other hand, the Custom CNN model shows lower performance compared to the
pretrained models, with notably reduced precision, recall, F1-score, and accuracy. This
suggests potential areas for improvement in its architecture or training approach. Lastly,
EfficientNet-B0 performs the poorest among the evaluated models, exhibiting extremely low
precision, recall, F1-score, and accuracy. This indicates that either the model architecture
might not be suitable for this task, or it requires significant optimization and fine-tuning.
Overall, pretrained models like ResNet50 and VGG16 emerge as the top performers,
followed by Inceptionv3, while Custom CNN and EfficientNet-B0 require further refinement
for improved performance in pigeon pea plant disease classification.
34
6 References
[1] O.P Sharma. (Jun,2010). Diseases Types. In O. S. Gopali, PESTS OF PIGEONPEA (pp.
23-24). Dr O. M. Bambawale Director, NCIPM, New Delhi.
[2] Suhas Yelshetty, O.M.Bambwale. (july,2010). About insects their effects in pigeon pea.
delhi: Dr O. M. Bambawale.
[3] Amresh sing. (2012, 05 26). chrome. new dehli: sanu. Retrieved from
https://constrofacilitator.com/:
https://constrofacilitator.com/wp-content/uploads/2020/07/Gravel-3276918.jpg
[4] M.V. Reddy, T.N. Raju. (1993). Handbook of Pigeon Pea Diseases. Andhra Pradesh:
ICRISAT.
[6] rana raj Pandit. (2016). Pigeon Pea Farming In Nepal. calkata: renuka ram.
[7] Y.L. Nene, and D. McDonald. (2009). pigeon pea crisess in world wide. springer, 19-30.
[9] Sandesh Bhagwat ,Dr.Patil. (jan,2024). Advancing real-time plant disease detection: A
lightweight deep learning approach and novel dataset for pigeon pea crop. Data
Science, 25-50.
35