Go, change the

RV College of world
Engineering

IV Semester Design
Thinking Lab
(18CS47)
Department of Computer Science and Engineering
R V College of Engineering, Bengaluru.

1
RV College of
Engineering
Go, change the world

INTRUSION CONTROL AND REAL TIME

MONITORING FOR
YIELD MAXIMIZATION
Name USN
ADARSH RAMKRISHNA HEGDE 1RV19CS004

K N PRASANNA 1RV19CS068

NITEESH HEGDE 1RV19CS105

PRAJWAL VIJAY KAMBLE 1RV19CS115

Theme: 5 – Conservation of agriculture, healthcare and quality education

Mentor Name & Designation:

Prapulla SB - Assistant Professor
Soumya A - Assistant
Professor 2
 RV College of
Engineering END USER/CUSTOMER Go, change the
world
• Farmers / agriculturists
• Agriculture researchers

3
 RV College of
Engineering
Beneficiary Go, change the
Details world

Brief Background of customer

• End users of our solution are farmers and researchers who are involved themselves in the field
of agriculture.
• As India is a agricultural country, farmers are backbone of our country.
• Nowadays farmers are not getting the expected yield in their farm.
• Many times they are not able to get back the money that they have invested in the farm.
• Farmers need a solution to increase the yield in their farm by using optimal quantity of fertilizers
and protecting their farms from invading animals.
• Agriculture researchers need a solution so that, they can get real time data about soil conditions
and environment of farms.
• These data will be help for them to analysis of different effect caused on crops and yield due to
varying conditions. This will be need for them to come with the different solution to increase yield.

4
 Go, change the
RV College of world
Engineering

Empathy Phase

5
 RV College of
Engineering
Empathy Go, change the
phase world

Questionnaire
1. Do wild animals attack your farm?
2. Are you able to detect the intrusion of animals?
3. Are you able to take measures in preventing animals destroying your farm?
4. What percentage of crops are getting destroyed due to the animals?
5. What is the upper margin that you are willing to spend for this system?
6. Which crops are you growing?
7. Which fertilizer are you generally using?
8. Are you getting good productivity from your farm?
9. On what basis are you using different types of fertilizers in your farm?
10. Are you using the fertilizers on the basis of soil testing reports?
11. Are you receiving any suggestions from the department of agriculture?

6
 RV College of
Engineering
Empathy Go, change the
phase world

Customer Interview

• They said they are growing Areca nut ,Banana, coconut etc.
Some farmers also said they grow Fruit plants, maize, sugarcane
etc.
• Almost all of them said every year they are getting less yield. They
are not getting the expected yield.
• One of the major problems told by them was that their crops are
destroyed by animals like monkeys, elephants, wild boars, cows,
squirrels, etc.
• Due to the attack of monkeys, elephants, wild boars, cows they are
losing a major percent of their crops. They need to visit their farm
frequently to protect crops.
• They are not able to get notified about the intrusion of animals. Before
they get to know about animal attack ,animals are destroying a major
quantity of crops.

7
 RV College of
Engineering
Empathy Go, change the
phase world

Customer Interview
• They also said every year on average 15 to 30 percent of crops are lost
due to this animal attack. Some animals attack at night, so we weren't
able to get notified about this.
• To prevent attacks at night they have to stay in the farm during harvest
days . But This not a good solution for them. They are losing most of
the time visiting their farm and checking for animal intrusion.
• We also asked them if they get notified about animal intrusion as soon
as animals enter the farm ,will it be helpful for them. They said this
will help them a lot. They can visit the farm and drive the animals out
of the farm .
• They said they are using some crackers to drive the animals out of the
farm. Some of them said that they are making loud sounds to scare
the animals and drive them out.
• At night time they are using torches to flash the light so by seeing this
light animals are going out of the farm as they are scared by this
sharp light.

8
 RV College of
Engineering
Empathy Go, change the
phase world

Customer Interview
• Farmers said that if they get rid of the attack of animals they can
grow some other kind of crops also which gives them better yield and
good price. Currently they have stopped growing some kinds of crops
because they are attacked by animals and they are not able to recover
the money they have invested.
• Many of the farmers said that they are not visiting and getting
suggestions from the agriculture department. Now also they are
following conventional farming methods.
• They are not doing soil testing and not growing crops based on the
nature of the soil and environment of the farm. They are using
fertilizers without proper knowledge about what is needed for the soil
and crops. They are using the fertilizers based on what their
neighbors are using.
• We explained to them the importance of knowing what all nutrients
are there in the farm and growing crops based on that. They said
it's cumbersome for them to visit laboratories and get soil tested.
They agreed that if they easily get suggestions about their soil
nature and suitable crops for their farm environment they can get
more yield.
9
 RV College of
Engineering
Empathy Go, change the
phase world

Questionnaire
1. Are farmers coming to your department seeking a solution?
2. On which factors of the soil do you decide the crop to be grown?
3. Can you decide the amount of productivity of the farm or the crop to be grown on the based on the
soil NPK, humidity, and temperature values?
4. Which sensors do you use to measure the NPK, humidity, and temperature values?
5. How do weather conditions affect the productivity of the crop?
6. Do you think climate change is affecting the growth patterns of the crop?
7. Can you predict the seeding period of the year based on the weather conditions of the previous years?
8. Can you give the good period for the harvesting and seeding for different types of crops?
9. Can you give the information about the good factors for the soil for optimal growth of different crops?
10. Are you able to utilize the data from the farms over the period of time about humidity, temperature
and NPK values for optimizing the growth of the crops in the future?

10
 RV College of
Engineering
Empathy Go, change the
phase world

Customer Interview
• The interview started with the info about how the nutrients in the soil affect the growth of the crop.
• How different types of nutrients are essential for different crops. He explained about the benefits of using organic fertilizers instead of chemical
fertilizers.
• Even though chemical fertilizers provide nutrients to the soil quickly, they have adverse effects on the soil itself. By the usage of these
fertilizers the soil loses its fertility in a longer run rather than gaining it
• Also the usage of chemical fertilizers is like a chain reaction, since the nutrients of the soil are degraded away, farmers tend to use more
chemical fertilizers that worsens the effect of degrading the soil
• He also emphasized on the micro nutrients that are required by the soil, which also has essential effects on the growth of the crop and hence
yield of the farm
• He also explained the difference between weather and climate in an area and how it affects the situation of the farm. The climate is the trends of
changes in temperature, humidity, and rainfall over a long period of time. While the weather is the immediate changes in the following
conditions. Both of these conditions have severe effects on the growth pattern and the amount of productivity in the farm
• He also explained the recent phenomenon of intrusion of animals into the farms due to destruction of habitat.
• This is due to humans encroaching the forest land. This causes damage to the food and shelter sources in the forest.
• Hence they come to the farmland in the search of food and shelter. The routes that animals like elephants and wild buffalos take were now used
to grow ginger and other crops. This forces them to enter the farmland and cause destruction to the crops

11
RV College of
Engineering Empathy Maps Go, change the
world

12
RV College of
Engineering Empathy Maps Go, change the
world

13
RV College of
Engineering Empathy Maps Go, change the
world

14
RV College of
Engineering Interview Videos Go, change the
world

15
RV College of
Engineering Interview Videos Go, change the
world

16
RV College of
Engineering Interview Go, change the
world
Audio

17
 RV College of
Engineering
Empathy Go, change the
phase world

Proofs for Empathy

1. https://drive.google.com/file/d/1R2kKEgvvLoGm-P5PTqcR2nsi6dxVuh93/view?usp=sharing
2. https://drive.google.com/file/d/135qAbAnLqeYrD7qUVpsBMpIwk33Z0PT1/view?usp=sharing
3. https://drive.google.com/file/d/14ZdZbnhvVA_nKRK5I8DuhfF3LX7AA3/view?usp=sharing
4. https://drive.google.com/file/d/1wTBjX9KthMdFYC6Q9HKNEL36WbAfu_0P/view?usp=sharing
5. https://drive.google.com/file/d/1uLScqM9PHtGaXzIltSQiNXbgW6w4hf82/view?usp=sharing
6. https://drive.google.com/file/d/1YwOSUBaB9guvmA0wDbihAaXT14n3HUtd/view?usp=sharing
7. https://drive.google.com/file/d/1jc4F_l0hzi6uSOq88Tnix_Bi6a8FPGRA/view?usp=sharing
8. https://drive.google.com/file/d/1q9A9_twLqivt8l9vVpUfSjxWCv1G-4cw/view?usp=sharing
9. https://drive.google.com/file/d/1-trzSmPhsEc7gF-iZJRL3137ECgM2oS7/view?usp=sharing
10. https://drive.google.com/file/d/1gKKbv0npZd4uxsS69VhPRek7YbDFbl_A/view?usp=sharing
11. https://drive.google.com/file/d/14smN59v9cUciayAg12yK6psE5ftgfmIr/view?usp=sharing
12. https://drive.google.com/file/d/1GndJhLs1AFezEYQDLtwJ4pNrBbGxK3L4/view?usp=sharing

18
 Go, change the
RV College of world
Engineering

Problem definition

19
 RV College of
Engineering
Problem definition Go, change the
world

Design thinking challenge formulated for

ideation
1. Nowadays farmers are facing many problems. They are
not getting expected yield from there farm.
2. One of the reasons for this is the lack of knowledge. Farmers
are growing crops without knowing which crop is suitable
for that soil and that environment.
3. They are not contacting department of agriculture to get
suggestion from them. They are not knowing how the
condition in farm such as temperature, humidity and soil
nutrients values are varying.
4. They are using fertilizer without understanding which
nutrients are required for their soil and crop.
5. Another problem they are facing is due to the animals.
Sometimes their crop is destroyed by the invading animals or
sometimes due to fire accident.
6. They're not notified immediately about this situation which is 20

reason for increase in crop loss. Because of all these reasons

RV College of
Engineering
Point Of View Go, change the
world

Farmers needa way to increase the yield and to protectthe crops

due to varyingenvironment of farms and invading animals

21
RV College of
Engineering Customer Journey Map Go, change the
world

22
 RV College of
Engineering How might we? Go, change the
world
Detection
● How might we help farmers to increase the yield?
● How might we protect farm from animals?
● How might we detect animal intrusion and fire in the
farm?
● How might we detect intrusion of animals during night
time?
Action
● How might we take action after detection of animal
intrusion?
● How might we alert farmers about animal
intrusion?
● How might we do anything to send animal out of
farm?

23
 RV College of
Engineering How might we? Go, change the
world
Soil conditions
● How might we help farmers to
understand what is needed for their farm?
● How might we help farmers the find the
optimal quantity of fertilizers be used
in their farm?
● How might we monitor the nutrients
in the soil?
● How might we monitor the conditions
such as temperature, humidity etc in
the farm?
● How might we help farmers to find
which crop is good for that farm?
24
 RV College of
Engineering How might we? Go, change the
world
Irrigation
● How might we help farmers to irrigate their farm
intelligently based on need?
● How might we decide the optimal time duration
based on weather conditions for timely irrigation
in the farms?
Weather Conditions
● How might we minimize the damages caused to
the farm due to changing climatic conditions?
● How might we help farmers to get information
about varying weather and environment of farm?
● How might we use the data from the past to
decide the proper method to adapt to the changing
climate?
25
 Go, change the
RV College of world
Engineering

Ideation Phase

26
 RV College of
Engineering Ideation Go, change the
world

Brainstorming
•This is a popular method to generate ideas while havinga good
interaction with all the participants.
•In this method all the participants got together in a
google meet and started brainstorming by coming up
with an idea or building uponsome ideas.
•This involved a healthy discussion for a set duration of time and walking along
the path and improvising on the ideas that were brought up during the duration of
time that the meet was organized.
•The help ofproblem statements and the previously generated how might we
questions were used as a guide to help participants to stay on track of the topic
assigned and notstray too much away from original problems and ideas.

27
 RV College of
Engineering Ideation Go, change the
world

Brainstorming

https://drive.google.com/file/d/1nYCquNWUGpC1aJMfhnqMl2nvt0wBKXIj/view?usp=sharing
28
 RV College of
Engineering Ideation Go, change the
world

Mind Mapping
•Mind mapping is a unique process in a way that used
visual tools like graphical and
pictorial representation of all the ideas generated and using them to generate a
tree of all the related ideas
•But unlike affinity mapping this involved branching out of all the
ideas and pushing our minds to the limits to come up with all the out ofthe
box ideas that we could come up with and visualizing them to getan overall
picture of the situation we are in and geta deeper understanding ofthe
problem faced by the stakeholders.
29
RV College of
Engineering Mind Map Go, change the
world

30
RV College of
Engineering Story Board Go, change the
world

31
RV College of
Engineering Story Board Go, change the
world

32
RV College of
Engineering Affinity Map Go, change the
world

33
 RV College of
Engineering Ideation Go, change the
world

Intrusion detection
● Animal detection using Arduino with
camera and image processing vb.
Net
● Intrusion detection using PIR motion
sensor
● Intrusion detection using sonar
● Detection of fire using camera and
temperature sensor
● Detection of animals and fire using
python image processing tool and
raspberry pi
● Using night vision cameras to detect
intruding animals
34
 RV College of
Engineering Ideation Go, change the
world

Taking action
● Alerting the farmers using buzzer systems
● Driving animals out of the farm using loud sounds and mimicking the sounds
of animals or generate light patterns
● Alerting farmers using push notifications using GSM modules or via internet
to send alert messages to farmers

35
 RV College of
Engineering Ideation Go, change the
world
Prediction system
Fertilizer and crop
● Using NPK sensor to detect the appropriate values and predict
required nutrient for the soil and use it to determine the crop
to be grown in the soil
● Using pH sensor to detect the deficient nutrients in the soil
● Store the data locally in SD card for analysis and prediction
● Store the data in cloud for analysis and for future use
● On the basis of humidity, soil moisture, and water level to give
the areas in need of more irrigation
● Monitor changes in the soil and suggest the appropriate time for
re-fertilization
● Monitor changes in the soil and find the relationship
between fertility and amount of irrigation in the farm

36
 RV College of
Engineering Ideation Go, change the
world
Climate and weather

● Using temperature, humidity, light to predict

which crop is suitable for that farm
● Using temperature, humidity, pressure , wind
speed to detect abrupt weather changes.
● Using the collected data to give the time
during which the seeding should be done
● Using the weather and climatic data from
weather stations to predict the variations in the
weather and alert the farmers

37
RV College of
Engineering How Now Wow Matrix Go, change the
world

38
RV College of
Engineering How Now Wow Matrix Go, change the
world

39
 RV College of
Engineering Finalized Idea Go, change the
world
● Detecting the intrusion of animals and fire using
image processing and raspberry pi and alerting the
farmers using push notifications via GSM modules
or using internet or by driving the animals away
from the farm by mimicking the sounds of the
animals or by using certain light patterns

● Using NPK, temperature, humidity, light sensors

to detect the appropriate values of nutrients in the
soil and providing the suggestion for the suitable
fertilizer and crop to be grown on the soil and
monitor the changes in the soil and provide the
time for re-fertilization of the farm

40
RV College of
Engineering Customer Feedback Go, change the
world
● First, we wanted to gain opinion about our
ideas that were generated during the ideation
phase, in the perspective of the farmer.
● We wanted to gain more insights about the
problem at hand that were faced by the farmer
and what they personally thought about the idea
itself
● We went to them and interviewed then about
the idea, and collected their thoughts and
insights about the solution and how effectively
it would solve their problem.
● Based on their opinion and their requirements
we try to develop a product that was best suited
for their needs.

41
RV College of
Engineering Customer Feedback Go, change the
world
● They said the product will be helpful for them
● We explained both of the ideas that were generated
during the ideation process.
● We asked for their opinion on which would be the
better choice
● Many of them preferred the idea of animal
intrusion
● They said that, the problem of intrusion of animals
is causing more harm and it is something that is
not in their hands, but something must be done to
prevent it.
● For the other idea they said that, they have figured
out the logistics of the fertilizers used and how
the quantity of the fertilizers affect the growth of
the crops

42
RV College of
Engineering Customer Feedback Go, change the
world
● We asked them about how effective the notification system
would be in different scenarios
● We asked them if a buzzer system would be helpful
● They felt that any improvement towards the goal of keeping
animals out of the farm will help
● We also asked them about the cost range of the product and
asked them about the hypothetical case where multiple
microcontrollers were fixed throughout the farm
● They said that they could not afford highly expensive
products also they warned us about the weather. The
product should be weather proof that is given, but one thing
to keep in mind is that the humidity is higher than other
regions
● We also asked them about the power and network facilities.
● They said that it was not possible to supply AC power to
the microcontroller itself and the availability of network
was limited to calling.

43
 Go, change the
RV College of world
Engineering

Prototyping Phase

44
 RV College of
Engineering
Prototype/Pretotype Go, change the
phase world

What is prototyping?

• This method involves producing an early, inexpensive, and scaled down version of the product in order to
reveal any problems with the current design.
• Prototyping offers designers the opportunity to bring their ideas to life, test the practicability of the
current design, and to potentially investigate how a sample of users think and feel about a product.
• Prototypes are often used in the final testing section in a Design Thinking method in an effort to determine
how users behave with the prototype, to reveal new solutions to problems, or to find out whether or no
longer the implemented answers had been a success.
• The consequences generated from these exams are then used to redefine one or more of the problems
mounted in the earlier levels of the task, and to build a much better information of the issues customers might
also face while interacting with the product within the supposed surroundings.

45
 RV College of
Engineering
Prototype/Pretotype Go, change the
phase world

Different approaches of prototyping

Low-fidelity prototyping:-
• Low-fidelity prototyping involves the use of basic models or examples of the product being tested.
• For example, the model might be incomplete and utilize just a few of the features that will be available in the final design, or
it might be constructed using materials not intended for the finished article, such as wood, paper, or metal for a plastic
product.
• Low-fidelity prototypes can either be models that are cheaply and easily made, or simply recounts or visualizations of them.

High-fidelity prototyping:-
• High-fidelity prototypes are prototypes that look and operate closer to the finished product.
• For example, a 3D plastic model with movable parts (allowing users to manipulate and interact with a device in the same
manner as the final design) is high-fi in comparison to, say, a wooden block.
• Likewise, an early version of a software system developed using a design program such as Sketch or Adobe Illustrator is
high-fi in comparison to a paper prototype.
46
 RV College of
Engineering
Prototype/Pretotype Go, change the
phase world

Prototype Specifications
(Hardware)

For training:
•A laptop with GPU (i5 processor with 1650Ti GPU)
Prototype specifications
•Raspberry pi 4 B
•Cost 3000 Rs
•64 bit quad core cortex- A72 ARM v8,
Broadcom BCM2711 and runs at a speed of
1.5GHz
•2 lane MIPI CSI camera port and 4-pole stereo audio and
composite video port
•RAM 2 GigaBytes
•Video Core IV 3D graphics core
•The v2 Camera Module has a Sony IMX219 8-megapixel 47
sensor
 RV College of
Engineering
Prototype/Pretotype Go, change the
phase world

Prototype Specifications
(Software)

For training:
•Google Collab
•TensorFlow/Keras
•OpenCV
•MobileNetV2

In Prototype:
•OpenCV
•TensorFlow Lite version of the model
•Twilio
•Thingspeak
•StreamLit
•Flask 48
 Go, change the
RV College of world
Engineering

Demonstration

49
RV College of
Engineering
Prototype/Pretotype Go, change the
phase world

50
RV College of
Engineering
Prototype/Pretotype Go, change the
phase world

51
RV College of
Engineering
Prototype/Pretotype Go, change the
phase world

52
RV College of
Engineering
Prototype/Pretotype Go, change the
phase world

53
RV College of
Engineering
Prototype/Pretotype Go, change the
phase world

54
RV College of
Engineering
Prototype/Pretotype Go, change the
phase world

55
RV College of
Engineering
Prototype/Pretotype Go, change the
phase world

hosting webapp on local

default browser

Web App

56
 RV College of
Engineering
Prototype/Pretotype Go, change the
phase world

Image_to_tes
t Is selected

57
 RV College of
Engineering
Prototype/Pretotype Go, change the
phase world

Processing is
Successful and
Message is sent
To the farmer

58
 RV College of
Engineering
Prototype/Pretotype Go, change the
phase world

Message in farmer’s
mobile

59
 RV College of
Engineering
Prototype/Pretotype Go, change the
phase world

Project information

60
 RV College of
Engineering
Prototype/Pretotype Go, change the
phase world

Starting up and running of flask web

app

Post request is sent using an elephants image from another process in laptop to mimic the working
of Raspberry pi and result is obtained
Animal: elephant is the result sent back in json format

61
 RV College of
Engineering
Prototype/Pretotype Go, change the
phase world

Message sent
Using twilio
service

62
 RV College of
Engineering
Prototype/Pretotype Go, change the
phase world

Message sent from

the twilio service by the
request of web app, in
farmer’s mobile

63
 RV College of
Engineering
Learning outcome Go, change the
(Knowledge, Skills, and Research world
Base)

1. We learnt how design thinking approach can be used to develop the product and solve the real - world
problem
2. We learnt how to implement the design thinking approach to identify the problems faced by the
stakeholders
3. We learnt different ways and techniques to come up with different ideas that might contribute to the solution
of the problem
4. We learnt how different phases in the design thinking process enhances the creativity and helps us come up
with a solution for the problem
5. We learnt how different approaches of prototyping and implementation of corresponding prototype in real
world applications
6. We learnt how our model can help the farmers
7. How our product is helping the farmers to increase the yield
8. We also learnt what and all the difficulties while building an product to farmers
9. We also learnt about different constraints to be consider while building a product
10. We learnt the importance of testing phase in design thinking
64
11. We also learnt about the image processing and deep learning can be used to solve real world problems
RV College of
Engineering
References Go, change the
world

1.Santhiya, S., et al. "A smart farmland using Raspberry Pi crop prevention and animal intrusion detection
system." Int. Res. J. Eng. Technol (2018).
2. https://www.interaction-design.org/literature/article/what-is-design-thinking-and-why-is-it so-popular
3.Xue, Wenling, Ting Jiang, and Jiong Shi. "Animal intrusion detection based on convolutional neural
networks." 2017 17th International Symposium on Communications and Information Technologies
(ISCIT). IEEE, 2017.
4.Jeevitha, S., and Venkatesh Kumar. "A Review of Animal Intrusion Detection System.“ International
Journal of Engineering and Technical Research 9.5 (2020): 1219-1221. 5. Jeevitha, S., and S. Vengatesh
Kumar. "A Study on Sensor Based Animal Intrusion Alert System Using Image Processing Techniques."
2019 Third International conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud)(I-SMAC).
IEEE, 2019. 6. Hussin, R., et al. "Digital image processing techniques for object detection from
complex background images." Procedia Engineering 41 (2012): 340-344.
7. https://www.twilio.com/docs/sms/quickstart/python

65
 Go, change the
RV College of world
Engineering

Thank You

66