Professional Documents
Culture Documents
Long Range Object Tracking Using Infrared and Ultrasound Optical Sensors
Long Range Object Tracking Using Infrared and Ultrasound Optical Sensors
Long Range Object Tracking Using Infrared and Ultrasound Optical Sensors
Michael Fader, Supervised by Dr. Brian Surgenor
Department of Mechanical and Materials Engineering, Queen’s University, Kingston, Ontario, Canada
April 13, 2018
The recent use of drone technology for recreational and commercial applications has been increasing these days due to its reduction
in cost. Although prices are decreasing, the replacement of this technology is still expensive. To limit replacement due to damages
when hitting the ground, companies have developed drone mounted parachutes to deploy in the case of power or lift failure.
Unfortunately, these parachute systems may not always guarantee a safe touchdown to the ground should the drone fall on to a
hard surface or into water. A potential solution to solve this problem would be to employ a tracking system on the ground to follow
the falling drone in the sky and safely catch it with a mobile mechanism at its landing location. With respect to the tracking
component of this solution, there is interest to see if low-cost range sensors could be used as they have been decreasing in price
while being developed to track longer distances. This research sets out to test the hypothesis that low-cost long-range sensors could
be used to track an object approximately 0.4m in size within a range of 5m. Three different sensors were tested in this research, the
infrared Sharp (5m range), ultrasound UMR37 (5m range) and ultrasound PING (3m range), which all cost less than $30.00. All
sensors were tested to understand their signal response behaviour, field of vision size, target identification capabilities and signal
response time. These tests were done to aid in the selection of what sensor would be most appropriate to test this hypothesis. Of
the three sensors, the PING sensor was chosen to be the most suitable for this application. The PING’s consistent and fast signal
response made it the best of the three sensors tested in this research. To test the hypothesis, PING sensors were installed on a servo
to function as a dynamic object tracking system. This tracking system was able to track a target moving at 0.7m/s within a 3m
range, on the condition that the moving target was not turned away such that the sensor signal would not be returned to the PING.
The tracking system implemented with the PING failed to prove this hypothesis as it could only detect objects within a 3m range
rather than the desired 5m range. However, this testing provided an understanding of performance metrics that are expected of
these low-cost long-range sensors to be used in this application. Future work should involve looking into testing the capabilities of
other sensor technology such as longer-range ultrasound or laser/Lidar technology. Once an appropriate sensor is selected, further
tests should be done to understand the speed limitations of the system when tracking fast moving objects to replicate a realistic
descent speed for a drone with a parachute.
1.0 Introduction net on a boat, to reuse them for future launches [1]. This idea
The use of drones in commercial and recreational of catching rocket nose cones is very similar to the solution
applications has been increasing as this technology becomes of catching drones.
more versatile and affordable. Despite decreasing prices, the
replacement of these drones is still costly. Parachute and This MECH 461 project set out test the hypothesis that low
drone companies have now started to produce drone cost long-range optical sensors would track a falling object
mounted parachutes to be deployed in the case of power loss with a parachute the size of a small 0.4 m drone at a 5m
or lift failure to reduce or eliminate the cost of replacement. range. Detecting a falling object with low-cost sensors may
Although drones can now be equipped with one of these be difficult due to the limited capabilities of the sensors
parachute systems, their rate of descent could still be fast available on the market. Short range optical sensors such as
enough to cause damage upon contact with the ground. the infrared 1m-Sharp are widely available and used for
These parachutes also do not address the issue of saving the small autonomous mobile robots, but they do not have a
drone should it fall into water. These existing issues, suggest useful detection range for this sort of application. Recently,
that an additional method of recovery could be used to a long-range version of the Sharp infrared (IR) sensor has
improve the remote landing of drones. A solution is to been produced that has a detection range of 5m, which can
employ a ground mounted tracking sensor that could track be seen in Figure 1. Infrared sensors have proved to be
the falling object and deploy a mobile mechanism to catch effective for dynamic object detection as seen in the Leap
the drone at its landing location. This system could be used Motion IR sensor. The Leap Motion sensor can track static
to recover and save drones from falling into hard terrain or and dynamic movements of an individual’s hands for user
even water to prevent damage. interface or virtual reality applications but costs
approximately $100.00 [2]. There is interest in seeing if the
This catching system is being attempted on a large scale as more economic 5m Sharp sensor could be effective for
the private space company SpaceX. In 2018 they tried to tracking falling objects at long range.
catch their Falcon 9 rocket nose cones after launch via a large
1
MECH461 Technical Report Fader 2018
2
MECH461 Technical Report Fader 2018
3
MECH461 Technical Report Fader 2018
2500 2000
Voltage (mV)
2000
1500
1500
1000 1000
-60 -40 -20 0 20 40 60
500 Target Offset Distance (cm)
0.5m Test
0 1m Test
2m Test
0 200 400 600 800 3m Test
Target Distance (cm) 0.5m Expected Voltage
1m Expected Voltage
2m Expected Voltage
Small Target Large Target 3m Expected Voltage
4
MECH461 Technical Report Fader 2018
100.0
Figure 8: Sharp signal response for the oblique and normal
target test 0.0
0 100 200 300 400 500 600
3.1.4 Test #4 Results Distance from UT Sensor (cm)
This test was never performed with the Sharp sensor as its
signal response was identified as 16ms on the Sharps data Small Target Large Target
sheet [5]. Additionally, since the signal from the Sharp is
infrared light traveling at the speed of light, the difference in
signal time of flight for targets of different ranges is Figure 9: URM37 analog signal response at range
essentially negligible. For these reasons, the signal response
time of 16ms was treated as a constant. 3.2.2 Test #2 Results
The consistency of the URM37 sensor during this test was
3.1.5 Sharp Discussion much more accurate than what was seen with the Sharp. The
Although the Sharp has a specified 5m range and a quick signal peaks when the target was identified were much more
signal response time of 16ms, it has many associated consistent, as seen in Figure 10. This width of the field of
drawbacks. The largest drawback to this sensor is the non- vision was very similar to the Sharp as it is also
linear signal response as a function of target distance. This approximately 50cm wide. The URM37 also has a field of
non-linearity was the reason the Sharp cannot provide a vision centered around the right side of the sensor (+0.2m
offset from 0m), rather than directly in the center of the
consistent signal response at ranges larger than 3m.
sensor. Again, this is due to one side of the sensor emitting
Furthermore, since the Sharp cannot consistently detect
the ultrasound and the other side receiving.
objects closer than 1m, the useful range of this sensor is
much smaller than what is specified on the data sheet [5].
Although being able to detect some of the targets in Test #3, 400
the Sharp’s inconsistent signal response and small useful
Measured Distance (cm)
350
detection range made it unfit for this object tracking
application. 300
250
3.2 URM37 Results 200
Since the Sharp was not selected to be used for this tracking 150
system application, a new sensor with similar technical
100
specifications was selected to be tested. This second sensor
to test was the URM37 ultrasound sensor. 50
0
3.2.1 Test #1 Results -0.6 -0.4 -0.2 0 0.2 0.4 0.6
One difference with the signal response for the URM37 is Target Offset Distance (m)
that it would output the actual measured distance rather than
voltage like the Sharp. Due to this, the data plots for the 0.5m Test 1m Test
URM37 would show the measured distance plotted against 2m Test 3m Test
the target distance. This is technically not the direct signal
output as the sensor must do a calculation to return range,
but considering this is a scaled form of output from the Figure 10: URM37 field of vision test signal response
analog signal, it will be considered as the sensor’s calibration
curve/signal response. It can be seen in Figure 9 that the
5
MECH461 Technical Report Fader 2018
300
Panning Angle (degrees) 250
200
Normal Targets Oblique Targets 150
100
Figure 11: URM37 signal response for the oblique and 50
normal target test 0
0 20 40 60 80 100
Another thing to note is the URM37 has an associated 100ms Panning Angle (degrees)
signal response time as mentioned in its datasheet [4]. This
became very apparent in this test as the programmed delay
was increased above and below 100ms to see the effects of Figure 13: Portion of URM37 servo sweeping in test #3
the servo moving faster than the URM37 can technically with a programmed delay of 0ms
measure. The result of this is that the angles in which the
signal would peak up or down would be rather inconsistent 3.2.4 Test #4 Results
at servo speeds where there is a delay less than 100ms. Performing the timing test was particularly important for the
Figure 11 shows the data from when there was no delay UMR37 as it was the deciding factor for this sensors
which can be compared to Figure 12, which shows a portion feasibility for this tracking application. The sensor data sheet
of the normal target plot with the URM37 but with a did make it clear that there was a 100ms delay time with data
programmed delay of 100ms. acquisition, but it was worth investigating exactly what this
time would be. During Test #3, timing statements were
It can be seen in Figure 12 that the points where the signal programming in the code and the length of the time was
increases and decreases (circled in red) there is always two taken to measure the distance to the target at 1m away from
vertical lines separated by approximately 5 degrees. This is the URM37. Table 1 shows some data from the testing when
due to the one side of the sensor doing the object detection, the servo was sweeping towards a normal facing target at
the URM37 will detect the same target at two different 1m. When the distance recorded reports “Invalid”, this
angles depending on its direction of rotation (CCW or CW). means that the URM37 was measuring distance beyond its
The data in Figure 12 is three measurement cycles (-90 to 90 maximum range, so it would not just identify this as an
and back to -90), and something to note is the consistency of invalid measurement. But what should be noticed is that the
the location of these vertical lines. Since they are always in measurement time for a distance that is approximately 5m
the same angle even despite having three rotations of range away from the sensor is ~250ms, not 100ms as specified in
data overlaid on the plot, it could be justified that the 100ms the datasheet [4]. Additionally, the data points measuring
delay is allowing the sensor to detect range properly before close to 100cm had measurement times of ~60ms.
moving to the following angle.
6
MECH461 Technical Report Fader 2018
225 250
200
175 200
150
125 150
100
75 100
50
25 50
0
0 100 200 300 400 500 600 0
Target Distance (cm) 0 100 200 300 400
Target Distance (cm)
Figure 14: URM37 measurement time as a function of
target distance
Expected Distance (cm)
3.2.5 URM37 Discussion Small Target
Even before performing all the tests with the URM37, it was
Large Target
made clear that it had an associated 100ms signal delay time.
The hope was that this sensor would outperform the Sharp in
these tests, but the signal delay proved to be the biggest Figure 15: PING signal response at range
drawback for the URM37. Although having a consistent
calibration curve and field of vision response, its inability to
identify targets at an oblique angle and its slow signal
response made it not ideal for this time-sensitive drone
tracking application.
7
MECH461 Technical Report Fader 2018
3.3.2 – Test #2 Results The justification for the sensor not identifying the oblique
It was found that the test results for the PING were slightly targets placed at ±60 degrees from information found in the
less accurate than the signal response seen with the URM37 PING data sheet. The data sheet provides a graphic showing
but still more consistent than the Sharp. This signal response that if an angle between the line of sight of the sensor and a
can be seen in Figure 16, shows consistency around the flat object is less than 45 degrees, the signal will not be
measured distance but with slight range fluctuation. This returned to the PING [6]. This angle is shown as theta (θ) in
small fluctuation was discovered in the test results from Test Figure 18. Since the functionality of the URM37 and the
#1 as the PING signal response is less accurate with a smaller PING are essentially identical and performed in a similar
target, which was the same target used in this test. Some of way for test #1, #2 and #3, this is most likely the cause of
the fluctuations could be due to the inconsistent testing why the URM37 also didn’t detect the target at ±60 degrees.
protocol as the target could have been turned or slightly Unfortunately, this information from the PING data sheet
closer to the sensor in this test when it was positioned does not provide justification on why the URM37 and PING
manually. did not identify the targets at ±30 degrees. To understand
this, further testing should be done by collecting data for
targets turned above and below this criteria angle of 45
400.00 degrees indicated by the PING data sheet.
Measured Distance (cm)
300.00
200.00
100.00
0.00
-0.6 -0.4 -0.2 0 0.2 0.4 0.6
Target Offset Distance (m)
0.5m Test 1m Test
θ
2m Test 3m Test
Figure 16: PING field of vision test signal response Figure 18: Screenshot from PING data sheet showing
oblique identification limitations [6]
3.3.3 – Test #3 Results
Similarly to the URM37, the PING did not perform as With respect to the signal peak consistency, the PING
expected for the oblique target test. It can be seen in Figure proved to have quite consistent signal peaks while doing
17 that the signal response for the oblique target (blue curve) several 180-degree sweeps. This consistency is most likely
does not stay at the same measured distance value as the due to the very quick signal response rate of less than 19ms
normal target signal response (green curve). Since the mentioned in the datasheet [6]. These consistent signal
normal target response has locations of consistently responses can be seen circled in red in Figure 19.
measured distances at the appropriate angles, it is treated as
the ideal response for this test. This can also be justified by 250
making the comparison between Figure 17 and Figure 11 of
the URM37 as they are a similar shape. When comparing to
Distance Measured (cm)
the oblique target data curve, the PING failed to identify 200
targets at ±30 and ±60 degrees (circled in red).
350 150
300
Distance Measured (cm)
250
100
200
150
100 50
50
0 0
-90 -60 -30 0 30 60 90 0 30 60 90
Servo Angle (Deg) Servo Angle (Deg)
Normal Targets Oblique Targets Figure 19: Portion of PING servo sweeping in test #3 with
a programmed delay of 0ms
8
MECH461 Technical Report Fader 2018
9
MECH461 Technical Report Fader 2018
PING Sensors
Figure 23: Schematic of 2D tracking system area and robot
trajectory
10
MECH461 Technical Report Fader 2018
Tracking Sensors
Figure 27: Graphic showing where sensor system will lose
the position of the target due to large oblique angle in
demonstration #2
11
MECH461 Technical Report Fader 2018
the Sharp or a LIDAR unit. Since the signal is traveling at 6.0 Acknowledgements
the speed of light, the signal response will be essentially I would like to thank my supervisor Dr. Brian Surgenor for
instantaneous before signal processing time. Perhaps an IR overseeing my work throughout this project. Despite my
sensor that uses a geometry relationship like the Sharp semester of research being rather short, my introduction to
should not be used, due to the inaccuracies that were found research was a positive and valuable experience. Thank you
throughout this research. A Lidar or Radar sensor where the for challenging my ideas and thought processes, as well as
time of flight is measured by a light signal would most likely giving me the opportunity to learn from my mistakes. I
provide a more accurate and fast signal response. This Lidar learned that quite often things will go wrong in research and
technology is essentially a combination of the Sharp and tests will need to be modified, redone or eliminated. I
PING technology by using light as the signal and time of appreciate and value your guidance provided to improve my
flight as the measurement of range. MECH 461 experience and my newly developed research
skills.
5.0 Conclusions and Recommendations
The tests performed on all three sensors were intended to
distinguish characteristics of the sensors to indicate which
would be most applicable for a scenario when tracking a 7.0 References
falling object at a range of up to 5m. Despite the PING have [1] L. Grush and T. Verge, "SpaceX tried to catch its
a smaller detection range compared to the Sharp and rocket’s nose cone with a giant net — and just missed," 28
URM37, its linear distance response, fast signal response February 2018. [Online]. Available:
and consistent object detection make it an ideal low-cost https://www.theverge.com/2018/2/22/17039860/spacex-
sensor for a smaller scale proof of concept of this projectile falcon-9-payload-fairing-mr-steven-net-catch. [Accessed 5
tracking application. Unfortunately, due to the PING’s March 2018].
reduced detection range of 3m, it does not prove the
hypothesis that low-cost long-range sensors could be used to [2] J. Guna, G. Jakus, M. Pogačnik, S. Tomažič and
track targets of 0.4m within a 5m range. However, this J. Sodnik, "An Analysis of the Precision and Reliability of
research does provide support that this hypothesis could be the Leap Motion Sensor and Its Suitability for Static and
true with the use of longer-range sensors similar to the PING.
Dynamic Tracking," Sensors, Vol. 14, 3702-3720, 2014.
To improve this tracking system in the future, changes [3] C. Mellon, "What is different about the Sharp IR
should be made to both hardware and software in the system. Sensor?," Carnegie Mellon Robotics Academy, 2018.
With respect to hardware, a faster and stronger servo could
[Online]. Available:
be used to improve the speed of the tracking. Another
hardware solution could be using different sensors using http://education.rec.ri.cmu.edu/content/electronics/boe/ir_s
different range detection methods and extended range. Using ensor/4.html . [Accessed 10 03 2018].
longer range ultrasound sensors or even small LIDAR units
[4] D. Robot, "URM37 V4.0 Ultrasonic Sensor
that are decreasing in price could be worth testing similar to
the other sensors to see if they are more suited for this (SKU:SEN0001)," DFRobot, 15 05 2017. [Online].
application than the PING. Even longer-range sensors could Available:
be used to track objects at further distances than 5m moving https://www.dfrobot.com/wiki/index.php/URM37_V4.0_Ul
at faster speeds. Some software upgrades could involve trasonic_Sensor_(SKU:SEN0001). [Accessed 15 02 2018].
using programming logic to store information about previous
sensor readings. This previously stored information could be [5] Sharp, GP2Y0A710K0F - Distance Measuring
analyzed continuously to better understand data trends Sensor Unit, Sharp Corporation, 2006.
(peaks or drops in sensor signal) to better track a moving
target. [6] Parallax, PING))) Ultrasonic Distance Sensor
(#28015), Parallax Inc., 2008.
As costs of long-range sensors are decreasing now that the
technology is becoming more accessible, the scale of this
proof of concept could eventually grow to a useable distance
for drones of all sizes and performance. This would be
another example of technology that started in the space
industry and has been adapted to a commercial and
recreational scale. It is simply a matter of time.
12