Professional Documents
Culture Documents
ARTICOL6
ARTICOL6
Abstract Rise in demand for food worldwide has led the agriculture industry to
shift towards Corporate Agriculture; major conglomerates operate huge lands with
Precision Farming; maximizing outputs and utilization of resources while reduce
waste and costs. This efficiency required the introduction of Automation and
Robotics in Agriculture, which led to great technological challenges. This in turn
sparked interest in research in the area of Agriculture Mobile Robots (AMRs). This
paper reviews research in this area for the last 5 years; it highlights examples of
robots already in action in fields around the world, identifies trends and important
sub-topics, and finally outlines the direction of where research in Mobile
Agriculture Robots is heading.
Keywords Agriculture mobile robots Mobile robot navigation in agriculture
Image processing for agriculture Tractor-trailer stability Agribots
H. A. Mat Sakim and M. T. Mustaffa (eds.), The 8th International Conference 107
on Robotic, Vision, Signal Processing & Power Applications,
Lecture Notes in Electrical Engineering 291, DOI: 10.1007/978-981-4585-42-2_13,
Springer Science+Business Media Singapore 2014
108 S. S. H. Hajjaj and K. S. M. Sahari
robotics into the agriculture industry. This has led to many technological and
engineering challenges, which in turn led to increase in interest in research in the
area of Agriculture Mobile Robots and Precision Autonomous Farming.
This research area has produced many successful stories; over the last
five years, robots have been introduced—successfully—into the agriculture
industry worldwide; robots tap rubber and work the land in India, pick citrus fruits
in the United States, harvest tomatoes and pick strawberries in China [2–6].
Others include solar powered robots picking dates from palm trees in Saudi
Arabia, robots transplanting rice and transporting other plants in Japan, and robot
inspecting irrigation water in Thailand [7–11]. Mobile robots also harvested white
asparagus and other crops in Greece [12].
Mingjun et al. [13] tested their algorithm; the Conditional Random Fields based
Near-to-Far Perception framework (CRFNFP), on agriculture robots and found
13 Review of Research in the Area of Agriculture Mobile Robots 109
Cheng, F. et al. applied the traditional artificial potential field method due to its
simplicity; simulation was used to model an apple growing and picking environ-
ment. Their results showed that productivity of apple picking robot was improved
[19].
Yan-hong, D. et al. solved the problem of optimizing the drive servo PID
controller of wheeled robots by first identifying the drive system by BP neural
network, then optimizing the controller by the genetic algorithm based on the afore
results [20].
Pazderski and Kozlowski applied the Transverse Function to control a multi-
body vehicle which consists of a unicycle-like tractor with three trailers. Their
algorithm was based on input transformation of an open-loop error dynamics [21].
Cariou et al. separated the navigation algorithm into three parts, steering, speed
control, and reversing, and combined them to control the vehicle. Their robots
were able to reverse automatically to connect the next reference track [22].
de Sousa et al. combined simple fuzzy and non-fuzzy behaviors. Their strategy
was to coordinate behaviors that operate in different stages on the robotic archi-
tecture to perform navigation actions. The outcome reflected on the feasibility of
the approach [23].
Borrero et al. developed a fuzzy controller using a multivariable plant which
incorporated simplified linear model of the lateral dynamics of a vehicle whose
input were the linear combination of the rear and front steering angles [24].
Prema et al. developed fuzzy based micro-controller for their agriculture robot
that was able to plug the land, plant seeds, and sense the soil moisture. Their robot
was controlled remotely over the internet using LABVIEW [25].
Hamid et al. utilized a combination of GPS for navigation and Sonar for locali-
zation to develop a low cost agriculture mobile robot that could navigate through the
desired waypoint and at the same time apply the obstacle avoidance rules [28].
Agriculture robots need to know that the crops they working on are ripe enough for
collection. They also need to identify obstacles and vegetation in the field. For all
that to work, they need a robust sensor and image processing system.
Between 2009 and 2012, Lulio et al. worked on several projects related to
computer vision for agriculture robots. They developed a platform for image
processing and segmentation through an omnidirectional vision system to agri-
cultural mobile robots.
They first combined JSEG-based computational methods with BP-ANN for
image classification, characterization, and recognition. Then they combined it with
a customized BP multilayer perception (BP-MLP) algorithm in Matlab/Octave
environments, as well as structured heuristics methods in Simulink environment
[29–32].
Palipana et al. developed a semi-autonomous robot able to localize itself, based
on wireless sensor network combined with the use of Zigbee protocol. Also, an
extended Kalman filter and a fuzzy inference system were applied to filter the
initial training data. Results showed the robot to be accurate within the range of
2–10 m [33].
Zhao C. J. and Jiang G. Q. developed a simple and a robust vision based mobile
robot algorithm. Firstly, images captured were processed to obtain quasi naviga-
tion baseline, from which the navigation line was extracted to control the motion
of the robot. They reported that the system was simple to develop and implement
[34, 35].
Rajendra et al. studied the impact of illumination intensity on area detection for
a strawberries picking robot. They concluded that because of its shape and distance
from the light source, illumination variation was almost negligible [37].
Morshidi et al. used BP neural Networks algorithms to segment color images
from RGB (red, green, blue) color space and projected them into HSV (hue,
saturation, value), to provide data points insensitive to illumination changes.
Results showed the effectiveness of the algorithm as images were segmented
reliably with less blobs [38].
Xiang et al. tackled the same problem, and they tested three algorithms of image
segmentation; R-G segmentation, normalized R-G segmentation, and band ratio
segmentation. Results showed that R-G segmentation was not adequate to counter
the effects of illumination variance, while the other two were effective [39].
Joycy and Prabavathy developed an algorithm for image segmentation that helps
agriculture robot identify the three items; green plants, soil, and sky, the main
items found in the field. Their algorithm depended on thresholding approaches
combined with adjusting the supervised fuzzy clustering [40].
Suzukiy et al. focused on the issue of human face detection and tracking, which
is very helpful for agriculture robots as it would make them more human friendly.
Their algorithm detected faces by focusing on skin color and eyes features [41].
In order to make agriculture mobile robots reliable in the field, the Robots must be
able to handle rough terrain. In most cases, robots would have to work on surfaces
that are uneven, covered with vegetation, contain animals and insects. The wheels
of the robots could slip, or even get tangled in the soil. Finally, robots have to be
sturdy enough to handle the unforgiving weather conditions.
Matveev et al. [42] tackled the problem path tracking when the robot is subjected
to wheel slips by dividing the guidance into two specific laws, one for pure sliding
controller, and other for a combined slip and motion controller.
Wang Y, et al. studied the same problem, but instead decided to incorporate
nonlinear friction, center-of-gravity shifts, and load changes, which are prevalent
under slip motion. To do so they proposed a digital acceleration control algorithm
to compensate for nonlinear friction [43].
13 Review of Research in the Area of Agriculture Mobile Robots 113
In agriculture applications, mobile robots would have to toe trailers, and control
the stability of the trailers, by controlling the motion of the robot, is very
important. Morales et al. [44] analyzed the effect of towing a single-axle trailer on
static tip-over stability for field mobile robots on slopes.
They proposed an algorithm, the Altered Supporting Polygons (ASP), for both
tractor and trailer. These ASPs were based on a force-torque static equilibrium
analysis that reshaped the corresponding ground contact supporting polygons. That
allowed them to tip-over stability for each unit by projecting its center of gravity
onto its ASP, even when both bodies have different inclinations [44].
Zhe Leng and Minor proposed a two-tier controller that directly controls the
curvature of the trailer’s trajectory. It allowed the control input to be more directly
related to path specification and handles path curvature discontinuity better.
Results demonstrated good performance on modest side-slope [45].
This problem is further complicated if the motion is in reverse. Due to the
instability of the reverse motion of the tractor-trailer mobile robot, Cheng J.
constructed and utilized a fuzzy controller via line-of-sight. Simulation showed
that the backward curve path tracking can be carried out successfully [46].
Not all crops are within man’s reach, so Guan, Y. et al. tackled this problem by
developing biped climbing robot, or Climbot. Inspired by Inchworms, their robot
consisted of five 1-DoF joint modules connected in series and two special grippers
mounted at the ends. Results showed that not only Climbot was able to climb a
variety of media, but also to grasp and manipulate objects [47].
Lun and Xu developed another tree climbing robot; Treebot. Their climbing
algorithm is based on the use of minimal sensing resources. Once again inspired by
inchworms, the algorithm reconstructed the shape of a tree by the use of tactile
sensors. Then, with an efficient non-holonomic motion planning strategy, Treebot
identified the optimal climbing path before climbing it [48].
13.6 Discussion
One can notice that when it comes to research in agriculture mobile robots, the
main focus of research was on agriculture-specific navigation and control. Sec-
ondly, research focused on agriculture-specific image processing. These are
summarized in Table 13.1.
The total number of literature reported is 50. From the table, one can also see
that there were other sub-topics that are worth noting; the problem of tractor-trailer
stability consisted of 10 % of the overall research. Similarly, the problem of
variance in illumination, or the effect of shades on the quality of image processing
of plants and crops also consisted of 10 % of overall research.
Finally, it is also worth noting that nearly 15 % of the research was on stand-
alone frameworks, such as the Conditional Random Fields based Near-to-Far
Perception framework (CRFNFP), and similar frameworks.
13.7 Conclusions
Table 13.1 can also give us an insight into where research in agriculture mobile
robots is heading; agriculture specific navigation and image processing is primary
focus and interest of researchers. Getting the robot to know its way around the
field, and identifying its surroundings and the ripeness of the crops seems to be the
main focus.
It is also worth noting that some other issues do interest researchers as well; the
problem of tractor-trailer stability, the problem of variance of illumination
(shades), seems to be of interest.
13 Review of Research in the Area of Agriculture Mobile Robots 115
Table 13.1 Summary of research in the area of agriculure mobile robots (AMRs)
Category and sub-categories Percentage of overall research (%)
Agriculture-specific navigation and control 42
Stand-alone frameworks 15
Artificial neural network related 10
Fuzzy controllers related 8
GPS localization related 8
Agriculture-specific sensor technology and image processing 33
Image based algorithms for agriculture robots 18
Effects of variance in illumination 10
Others 5
Robot stability and handling rough terrain 21
Effect of slip on navigation in a rough terrain 5
Stability of tractor-trailer motion 10
Tree climbing robots 5
Support/logistics systems needed for agriculture robots 5
References
1. Eaton R et al (2008) Precision guidance of agricultural tractors for autonomous farming. In:
2nd annual IEEE systems conference, pp 1–8
2. Simon S (2010) Autonomous navigation in rubber plantations. In: 2nd international
conference on machine learning and computing, pp 309–312
3. Gollakota A, Srinivas M (2011) Agribot—a multipurpose agricultural robot. In: IEEE India
conference (INDICON), pp 1–4
4. Aloisio C et al (2012) Next generation image guided citrus fruit picker. In: IEEE international
conference on technologies for practical robot applications (TePRA), pp 37–41
5. Jun W et al (2012) Design and co-simulation for tomato harvesting robots. In: 31st Chinese
control conference (CCC), pp 5105–5108
6. Qingchun F et al (2012) Study on strawberry robotic harvesting system. In: IEEE
international conference on computer science and automation engineering (CSAE), vol 1.
pp 320–324
7. Shukla A, Jibhakate S (2011) Design and implementation of real time pollution free
autonomous vehicle for harvesting on VI platform. In: International conference on electronics
computer technology (ICECT), vol 1. pp 335–339
8. Aljanoobi A et al (2010) A setup of mobile robotic unit for fruit harvesting. In: 19th
international workshop on robotics in Alpe-Adria-Danube region (RAAD), pp 105–108
9. Tamaki K et al (2009) A rice transplanting robot contributing to credible food safety system.
In: IEEE workshop on advanced robotics and its social impacts, pp 78–79
10. Sakai S et al (2007) Robust control systems of a heavy material handling agricultural robot: a
case study for initial cost problem. IEEE Trans Control Syst Technol 15(6):1038–1048
116 S. S. H. Hajjaj and K. S. M. Sahari
11. Ruangwiset A, Higashino S (2012) Development of an UAV for water surface survey using
video images. In: IEEE/SICE international symposium on system ntegration (SII),
pp 144–147
12. Chatzimichali AP et al (2009) Design of an advanced prototype robot for white asparagus
harvesting. In: IEEE international conference on advanced intelligent mechatronics,
pp 887–892
13. Mingjun W et al (2012) Study on long-range navigation behavior of agricultural robots. In:
International conference on computing, measurement, control and sensor network,
pp 409–412
14. Patino HD et al (2009) Adaptive critic designs-based autonomous unmanned vehicles
navigation: application to robotic farm vehicles. In: IEEE symposium on adaptive dynamic
programming and reinforcement learning, pp 233–237
15. Cheng J et al (2012) Motion planning algorithm for tractor-trailer mobile robot in unknown
environment. In: 8th international conference on natural computation (ICNC), pp 1050–1055
16. Long Y et al (2011) A system for fruit tree canopy characters measuring based on CAN-bus.
In: International conference on intelligent computation technology and automation, vol 2.
pp 15–21
17. Hansen S et al (2011) Orchard navigation using derivative free Kalman filtering. In:
American control conference (ACC), pp 4679–4684
18. Piyathilaka L, Munasinghe R (2011) Vision-only outdoor localization of two-wheel tractor
for autonomous operation in agricultural fields. In: 6th IEEE international conference on
industrial and information systems (ICIIS), pp 358–363
19. Cheng F (2012) Apple picking robot obstacle avoidance based on the improved artificial
potential field method. In: 5th IEEE international conference on advanced computational
intelligence, pp 18–20
20. Yan-hong D (2011) PID controller optimization of mobile robot servo system. In: IEEE 2nd
international conference on computing, control and industrial engineering (CCIE), vol 1.
pp 235–237
21. Pazderski D, Kozlowski K (2012) Control of a unicycle-like robot with three on-axle trailers
using transverse function approach. In: IEEE/RSJ international conference on intelligent
robots and systems (IROS), pp 395–401
22. Cariou C et al (2009) Motion planner and lateral-longitudinal controllers for autonomous
maneuvers of a farm vehicle in headland. In: IEEE/RSJ international conference on
intelligent robots and systems, pp 5782–5787
23. de Sousa RV et al (2011) A methodology for coordinating primitive fuzzy behaviors to guide
mobile agricultural robots. In: 9th international conference on control and automation,
pp 280–285
24. Borrero G et al (2012) Fuzzy control strategy for the adjustment of front steering angle of a
4WSD agricultural mobile robot. In: 7th Colombian computing congress (CCC), pp 1–6
25. Prema K et al (2012) Online control of remote operated agricultural robot using fuzzy
controller and virtual instrumentation. In: International conference on advances in
engineering, science and management (ICAESM), pp 196–201
26. Jun C (2011) On-tracking control of agricultural mobile robot based on inner information. In:
International conference on computer distributed control and intelligent environmental
monitoring (CDCIEM), pp 103–106
27. Jun Zhou W (2008) Coordinating control for an agricultural vehicle with individual wheel
speeds and steering angles. Control Syst IEEE 28(5):21–24
28. Hamid MHA et al (2009) Navigation of mobile robot using global positioning system (GPS)
and obstacle avoidance system with commanded loop daisy chaining application method. In:
5th international colloquium on signal processing & its applications, pp 176–181
29. Lulio LC et al (2009) JSEG-based image segmentation in computer vision for agricultural
mobile robot navigation. In: IEEE international symposium on computational intelligence in
robotics and automation, pp 240–245
13 Review of Research in the Area of Agriculture Mobile Robots 117
30. Lulio LC et al (2010) ANN statistical image recognition method for computer vision in
agricultural mobile robot navigation. In: International conference on mechatronics and
automation, pp 279–283
31. Lulio LC et al (2010) Pattern recognition structured heuristics methods for image processing
in mobile robot navigation. In: IEEE/RSJ international conference on intelligent robots and
systems (IROS), pp 4970–4975
32. Lulio LC et al (2012) Cognitive-merged statistical pattern recognition method for image
processing in mobile robot navigation. In: Robotics symposium and latin American robotics
symposium (SBR-LARS), pp 279–283
33. Palipana S et al (2012) Localization of a mobile robot using ZigBee based optimization
techniques. In: 6th IEEE international conference on information and automation for
sustainability, pp 215–220
34. Zhao C, Jiang G (2010) Baseline detection and matching to vision-based navigation of
agricultural robot. In: International conference on wavelet analysis and pattern recognition,
pp 44–48
35. Jiang G, Zhao C (2010) A vision system based crop rows for agricultural mobile robot. In:
International conference on computer application and system modeling, vol 11. pp 142–145
36. Zhao B et al (2010) Path recognition method of agricultural wheeled-mobile robot in shadow
environment. In: International conference on digital ecosystems and technologies, vol 1.
pp 284–287
37. Rajendra P et al (2011) Shading compensation methods for robots to harvest strawberries in
tabletop culture. In: IEEE/SICE international symposium on system integration, pp 172–177
38. Morshidi MA et al (2008) Color segmentation using multi layer neural network and the HSV
color space. In: International conference on computer and communication engineering,
pp 1335–1339
39. Xiang R et al (2011) Research on image segmentation methods of tomato in natural
conditions. In: 4th international congress on image and signal processing (CISP), vol 3.
pp 1268–1272
40. Joycy JS, Prabavathy K (2012) Survey on automatic segmentation of relevant textures in
agricultural images. In: International conference on advances in engineering, science and
management (ICAESM), pp 26–32
41. Suzukiy S et al (2009) A human tracking mobile-robot with face detection. In: 35th IEEE
annual conferecne on industrial electronics, pp 4217–4222
42. Matveev AS et al (2010) Mixed nonlinear-sliding mode control of an unmanned farm tractor
in the presence of sliding. In: 11th international conference on control automation robotics &
vision, pp 927–932
43. Wang Y et al (2011) Car-like mobile robot oriented digital acceleration control method. In:
International conference on mechatronics and automation, pp 1491–1497
44. Morales J et al (2013) Static tip-over stability analysis for a robotic vehicle with a single-axle
trailer on slopes based on altered supporting polygons. IEEE/ASME Trans Mechatron
18(2):697–705
45. Zhe L, Minor M (2011) A tractor-trailer backing control for path following with side-slope
compensation. In: IEEE international conference on robotics and automation (ICRA),
pp 2386–2391
46. Cheng J (2011) Curve path tracking control for tractor-trailer mobile robot. In: 8th international
conference on fuzzy systems and knowledge discovery (FSKD), vol 1. pp 502–506
47. Guan Y et al (2011) Climbot: a modular bio-inspired biped climbing robot. In: IEEE
international conference on intelligent robots and systems, pp 1473–1478
48. Lun T, Xu Y (2011) Climbing strategy for a flexible tree climbing robot—treebot. IEEE
Trans Robot 27(6):1107–1117
49. Koshi K et al (2010) Greenhouse partner system. In: 41st international symposium on
robotics, pp 1–8
50. Ali O, Van Oudheusden D (2009) Logistics planning for agriculture vehicles. In: IEEE
international conference on industrial engineering and engineering management, pp 311–314