Download as pdf or txt
Download as pdf or txt
You are on page 1of 29

Level-up and

Accelerate your
Road to
Autonomy

Emily Plahn (Emily.Plahn@Danfoss.com)


Senior Technical Sales Engineer, Autonomy – Danfoss
The Problem

Lack of Labor Equipment


Experience Shortage Accidents

• Fewer qualified operators with • Over $3bn of crops not • According to the IATA the
increasingly more complex harvested in 2019 in USA and average cost of a ground support
machines Canada accident with a plane is about
$250K
• New workers with less • Food supply shortages across
experience causing companies large portions of world • ~90% of the cost is indirect and
millions USD in rework ~10% is directly associated to
• Many crops still require highly
vehicle damage.
• Projects delayed and costs grow labor-intensive processes

2 | Level-up and Accelerate your Road to Autonomy


The solution

Precision Safety
Perform precision
Increase safety for
tasks faster and
the operator
more reliably

Productivity
Improve the productivity of
the machine and operator

3 | Level-up and Accelerate your Road to Autonomy


The result

Precision Safety
Perform precision Reduced rework Increase safety for
tasks faster and & increased first the operator
more reliably time quality

Higher situational
awareness and
fewer accidents

Productivity Over 30% improvement


Improve the productivity of for real world operator
the machine and operator assist applications

4 | Level-up and Accelerate your Road to Autonomy


Danfoss Autonomy portfolio

ACL Software

Utility
Perception Positioning Navigation
software

Software Engineering Services

Data

Perception sensors Ruggedized hardware

5 | Level-up and Accelerate your Road to Autonomy


The 5 levels of autonomy

All manned vehicles

Level 0
No automation

6 | Level-up and Accelerate your Road to Autonomy


The 5 levels of autonomy

Manned vehicle

Level 1
Operator Assistance
Driver still controls most functions. Specific functions, such as
steering can be undertaken by the machine at direction of operator.

7 | Level-up and Accelerate your Road to Autonomy


The 5 levels of autonomy

Manned vehicle

Level 2
Partial Automation
In certain circumstances, the machine can steer, accelerate and brake.
The operator’s is still directing and monitoring the action of the vehicle.

8 | Level-up and Accelerate your Road to Autonomy


The 5 levels of autonomy

Advanced sensors
& software

Manned back-up

Level 3
Conditional Automation
More complex actions are controlled and executed by the machine. In the right conditions,
a machine can manage most driving aspects, including monitoring the environment.

9 | Level-up and Accelerate your Road to Autonomy


The 5 levels of autonomy

In-field supervision of unmanned vehicles

Level 4
Supervised Automation
Machine can operate without human input or oversight, multiple autonomous
machines work together on one job site, supervision required for edge cases

10 | Level-up and Accelerate your Road to Autonomy


The 5 levels of autonomy

No local supervision

Level 5
Unsupervised Automation
Machine can operate without human input or oversight
controlled by site management systems

11 | Level-up and Accelerate your Road to Autonomy


Level 4 operator supervised vineyard sprayer

12 | Level-up and Accelerate your Road to Autonomy


System overview Ouster LiDAR

GNSS antenna

Smart camera

Danfoss XM100
controller

RCT IK3

13 | Level-up and Accelerate your Road to Autonomy


System Block Diagram Legend

XM100
Relative
Corrections GPS Path
Position HW Component
Recorder
PLUS+1 ACL Software Block

Custom PLUS+1 Software


IMU Path
Position
Filter Loader
Wheel
Speed
Odometry Path
Steer Follower Display
Angle Advanced

LiDAR Obstacle Detection

Smart
Custom Logic
Camera

RCT/eStop Propel Spray Steer


14 | Level-up and Accelerate your Road to Autonomy
Determining GNSS Position

Cell tower
Without corrections
With corrections

15 | Level-up and Accelerate your Road to Autonomy


GNSS to Relative Position

16 | Level-up and Accelerate your Road to Autonomy


Position Filter

▪ Position filter fuses multiple sensors into a better estimation of position

17 | Level-up and Accelerate your Road to Autonomy


Position Filter

18 | Level-up and Accelerate your Road to Autonomy


Path Recorder

▪ Path Recorder Block captures a series of waypoints that include the machine’s position,
bearing, velocity, and ancillary data. These waypoints are then each fit with a Bezier curve.

Y: North
Backwards Radius

Bearing
Waypoint 0:
Position: X,Y X: East
Velocity: mmps Waypoint 1: Forward Radius
Position: X,Y
Velocity: mmps

Waypoint 2:
Position: X,Y
Velocity: mmps
Waypoint 3:
Position: X,Y
Velocity: mmps
Ancillary: Turn Sprayer On

19 | Level-up and Accelerate your Road to Autonomy


Path Recorder

20 | Level-up and Accelerate your Road to Autonomy


Path Follower Advanced

▪ Is used to follow a path made of a series of Bezier curves.


▪ Path Follower Advanced can either follow a path from start to finish or navigate to the path in
the most direct way.
▪ Can be used to control machines velocity along path

21 | Level-up and Accelerate your Road to Autonomy


Path Follower Advanced

22 | Level-up and Accelerate your Road to Autonomy


Slow for Detected Obstacle

Zones
LiDAR Points

LiDAR Frame
LiDAR

• LiDAR provides point cloud with coordinates of each point in the sensor’s frame
• Obstacle Detect counts number of LiDAR points within developer defined zones
23 | Level-up and Accelerate your Road to Autonomy
Slow for Detected Obstacle

24 | Level-up and Accelerate your Road to Autonomy


Docking with Smart Camera and ArUco markers
Top view Camera view

Pose estimation

x y
z
z
x

Smart camera

• 1 ArUco marker can provide position and rotation information with a monocular camera
• Pose estimate can then be used to navigate to the marker
25 | Level-up and Accelerate your Road to Autonomy
System Block Diagram Legend

XM100
Relative
Corrections GPS Path
Position HW Component
Recorder
PLUS+1 ACL Software Block

Custom PLUS+1 Software


IMU Path
Position
Filter Loader
Wheel
Speed
Odometry Path
Steer Follower Display
Angle Advanced

LiDAR Obstacle Detection

Smart
Custom Logic
Camera

RCT/eStop Propel Spray Steer


26 | Level-up and Accelerate your Road to Autonomy
List of Software Blocks

Perception Positioning Navigation Utility

These blocks are used to perceive These blocks are used together to These blocks are used to plan These blocks provide functionality
the environment around the machine. locate/position the feed mixer at a and navigate a path that the that make integration easier
Reflector and Post Detection are precise location on the globe. machine will follow.
compared with a known map to
get a precise global position. Wall
Detection is for local positioning
(i.e. Follow wall with a 0.5m offset)

▪ Obstacle Detect ▪ Ackermann Yaw Rate ▪ Path Follower ▪ Angle to Curvature


▪ Reflector Detect ▪ Origin ▪ Path Follower Advanced ▪ Curvature to Angle
▪ Post Detect ▪ Relative Position ▪ Obstacle Avoidance ▪ Transform 3D
▪ Wall Detect ▪ UTM Conversion ▪ Two Point Planner ▪ Data Lockers
▪ Edge Detect ▪ UTM Conversion Zone ▪ Path Loader ▪ Lidar Mask
▪ Projected Path ▪ Yaw Estimate ▪ Path Recorder ▪ Path Extract
▪ Extract Ring ▪ Position Filter ▪ Line Follower ▪ Path Convert
▪ Planar Surface Segmentation (ML)

27 | Level-up and Accelerate your Road to Autonomy


Additional Resources

• PLUS+1® User Forum:


• plus1forum.danfoss.com
• PLUS+1® HelpDesk:
• plus1helpdesk.danfoss.com

28 | Level-up and Accelerate your Road to Autonomy


Questions?

29 | Level-up and Accelerate your Road to Autonomy

You might also like