Professional Documents
Culture Documents
Completely Done It
Completely Done It
Completely Done It
SNOW SPECIFIED:PROTOTYPE
Prepared for: Year 10 IT Assignment
Prepared by: Annabel and Bri
3 June 2016
Items called Drone:(titile) are corresponding with a footage clip in the accompanying
powerpoint.
Page 1
!
EXECUTIVE SUMMARY
OBJECTIVE
TECHNOLOGY
FUTURE
5
5
5
1.1.1.1.THERMAL IMAGING
1.1.1.2.ARTIFICIAL INTELLIGENCE
8
8
1.2.1.1.THERMAL IMAGING
1.2.1.2.UAV PROGRAMMING
9
9
9
10
2.2. PRODUCTION
13
2.2.1. DRONE
13
2.2.2. NODE.JS
14
25
3. Conclusion
25
4. References
27
Page 2
!
Page 3
!
EXECUTIVE SUMMARY
Objective
Over the past years, we have seen an extensive amount of people become lost or buried in snow because of
avalanches, snow storms and the like. Using drones, thermal imaging and artificial intelligence, alongside
Global Positioning Systems (GPS) signalling and node.js, we aim to develop a program with the capacity to fly
a drone remotely in a pre-programmed grid-like route across snow at the first sign of an avalanche.
Technology
By attaching thermal cameras to the base side of the drone, we will be able to detect changes in temperature
and therefore body temperature above the average temperature of snow and beneath snow. Artificial
intelligence allows the drone to move around objects in its path without direct and manual control. This means
it will be able to follow the specified route in majority of situations.
Future
We hope that after these programs and UAVs have been implemented in rural areas and snowy areas that
they are able to be altered to form smaller portable drones for skiers and hikers to carry themselves incase of
emergencies.
Page 4
!
1.1.1.2.Artificial Intelligence
Artificial intelligence is the field within computer science that seeks to explain and emulate, exhibited by
machines or software, some or all aspects of human intelligence. It is the ability for computers to interact with
the environment through sensory means and to make decisions in unforeseen circumstances without human
interaction. Artificial Intelligence is used in a variety of occupations to assist with needs. The beginnings of
artificial intelligence are traced back to philosophy, fiction and imagination. Early inventions such as electronics
and engineering has influenced artificial intelligence. However, some believe the end result of the technology
will eradicate poverty and disease, while others warn it could endanger human survival.
Currently, artificial intelligence is being used for medical diagnosis, robot control, law, remote sensing, scientific
discoveries and toys. For this project, artificial intelligence is intended to be installed into the programming so
that it can dodge past objects in the way of its routed path and realise when a hotspot is detected by the
Page 5
!
imager. This will allow for the drone to remain on its route without having to be manually controlled around
objects such as trees. This will decrease the need for work personnel because all that needs to be done is
keep an eye on the drone and its path as well as knowing when a GPS Signal has been sent back to the base
identifying a buried body.
Page 6
!
slow so that they are hard to detect at all. Only one or two breaths per minute may be taken. The skin is very
pale and icy cold to the touch. The limbs are stiff, the pupils of the eyes dilate and are unreactive to light.
At a core temperature of around 28C heartbeat irregularities may occur, cardiac arrhythmias, this can lead to
an uncoordinated twitching of the heart muscle preventing it from pumping blood properly and so resulting in
death. Even if this does not happen, the heart will stop beating completely at around 20C causing death,
approximately an hour after hypothermia begins and 30 minutes after the first signs of frostbite.
After Death
A body looses heat through four methods; conduction, convection, radiation and evaporation.
Conduction: direct transfer from the body to an object that is cooler than the body (contact with snow)
Convection: air or liquid flow across the skin drawing off heat (wind will increase heat loss)
Radiation: electromagnetic waves distribute heat into the ambient environment (exposed skin will allow
heat to be drawn off if the air temperature is less than the body)
Evaporation: fluid on the skin turns to vapour, drawing off heat (moist skin will lose heat more rapidly)
On average, after death a body looses temperature at a rate of 1.5C per hour until the body is at the
temperature surrounding it, in the case of the snow, approximately 2C. A body's temperature will drop much
more slowly if the body has been exposed to extreme cold; such as being left outdoors, submerged in water
or icy conditions like snow. With all factors considered, there is approximately 6 hours to find the body after the
heart has stopped beating, a total of about 7 hours after the avalanche occurs.
Page 7
!
Read - Reads user's input, parse the input into JavaScript data-structure and stores in memory.
Loop - Loops the above command until user press ctrl-c twice.
With these materials you are able to hack into he drones wifi connection and control its movements.
1.2.1.2.UAV Programming
The drone will be programmed to fly in a grid. This grid will be approximately 500mx500m in size.
The drone is programmed from a system called Node.js. This system allows for you to manually code the
actions that you want the drone to do.
Page 8
!
There is not a particular amount of drones needed to cover the grid.It all depends on the charge of the battery.
The aim is to have one drone that lasts numerous hours. In the drone there will be an interchangeable system
that allows for the drone to change batteries when the first one has run out. This allows for more time to detect
bodies. If all the batteries run out of charge and the search has not been accomplished, the drone will fly back
to the base and another drone will be sent out in its place. That way, the batteries can be charged. Artificial
intelligence will assist in alerting the drone when it must return the the base so that it has just enough battery
to return.
Node.js will give the directions of the grid. The grid will already be programmed so that when an avalanche has
been detected, the drone will set out on its routed path. The thermal cameras attached to the drone can
identify heat as deep as 1000ft (300m). To allow for faster and clear identifications, the drone will fly at
approximately 1m above the surface of the ground.
Currently these are ideas for the future of the project. Our aim is to incorporate these features into the drone to
make it more assistive and enhanced for prospective users.
Page 9
!
reason, the design below have been deemed appropriate for the body shape:
3D Modelling - Drone:3D_model
Thermal Cameras
The thermal cameras we have chosen to use in our design are the new Seek Thermal XR. The new Seek XR
has a focus lens for viewing objects at close range, or at distances of up to 2,000 feet or around 610 meters. It
can recognise temperatures between -5 and 330 degrees celsius. At present, this camera is used as an
accessory for iPhones and androids but in the future we hope to be able to attach multiple of the lenses to
drones. For accurate detection, we predict a minimum of nine lenses to be appropriate.
Page !10
Page !11
Grid:
Prototype grid:
Page !12
2.2. Production
2.2.1. DRONE
2.2.1.1.Week one
7th May - 13th May
After submitting our proposal we found many points of consideration we needed to assess in our design and
general technicalities. Our original drone design was deemed unsuitable as it was the shape of a plane and
there was a concern about the stability of the vehicle and its ability to hover above snow. Due to this we have
altered our beginning ideas to create the drone type seen in the previous section, Design.
Following the return of our proposal, we had many question that needed to be answered. These included
concerns to the drone shape, stability in the air, thermal sensor positioning, power and how it will be
programmed.
The drone was altered to be a flatter object in the shape of a rectangle and made out of carbon fibres to
provide a stable and durable UAV. The thermal sensors will be required on the underside of the drone so they
are closes to the snow. Because camera lenses can range in various sizes, most inconvenient for drone, we
have taken the shape of the DroneThermal v3 Micro UAV Thermal Camera as an influence for design.
Figure 0: DroneThermal v3 Micro UAV Thermal Camera
Page !13
2.2.2. NODE.JS
2.2.2.1. Week two: About
14th May - 20th May
Node javascript is a highly demanding software which is still in its early stages. Although it is not extremely
complicated there were a lot of pieces of information to learn and skills to develop. We have now spent an
entire week learning about javascript and researching node. This is extremely important because it gives us the
starting platform for recognising and writing node scripts. Node.js is currently being used for many different
things including Netflix, PayPal and Uber as it allows people to program mobile and web sites. Node.js for
drones is in much earlier stages of development and being explored by Nodecopter and toured around the
world at different events.
There were many different sections to this style of programming which we had no previous experience with. In
order to use the terminal and node.js, we were required to understand the program and develop enough skills
to hack the drone. This took an extremely long time but hopefully paid off in the end of the project.
Page !14
The next step in the installation caused many problems as we were unable to download the npm package
through the school network. The following image was one of the errors we encountered:
Figure 2: Unsuccessful installation due to network
When the device was connected through an android or iPhone hotspot, the installation was successful in its
completion.
Figure 3: Successful installation of node-ar-drone package
Page !15
The REPL file is where we planned to write the pre-programmed code. At this stage, the file had once job: to
define the variables to be used within node in the terminal. To activate the REPL file, we needed to find the file
within the terminal. This caused multiple complications as the terminal was trying to locate the REPL file inside
the user system shown in figure 5. This location is not a commonly used place within the laptop so we
struggled to find it. Once the repl.js file was moved into the correct place, there were no problems connecting
the terminal and activating the repl.
Figure 5: User system - annabelhughes home
With node-ar-drone installed we then attempted to fly a drone using commands from the computer. The ReadEval-Print loop (REPL) allows us to execute a single line of code at a time. We type a command into the
terminal, that command is read, it is then evaluated (run), and the result is printed. When everything was ready
to manually control the drone, the terminal had the following command lines.
Page !16
Page !17
node java code. After we connected the drone to the laptop through the wifi, we were prompted with drone
>, as seen in the last command line of figure 6.
After completing the standard pre-flight checklists, we typed the following commands and this produced
Drone:first_flight.
Figure 7: First Flight
The most important thing discovered was the need to wait until one command was completed before entering
the new command. With our plans for a grid like program, we began to experiment with clockwise and
anticlockwise rotation after the drone had taken off.
Figure 8: node.js used in terminal alongside basic repl.js file
This code made the drone takeoff the ground and hover before it was commanded to turn clockwise at a
speed of 0.5. When controlling a drone through node.js, most speeds range from 0 to 10 and rarely go above
1. The drone continued to spin until the client.stop command was entered into the terminal. We faced many
problems while typing commands as we needed to type them quickly as the previous step would continue
until the new one was entered. We also found errors that meant commands could not be followed due to
Page !18
syntax errors and client does not exist alerts. These alerts were common when they were typed incorrectly or
the wrong measurements were used within the brackets ();.
Figure 9: Command error
We then began incorporating horizontal movement of the drone as well as the rotation.
Page !19
After completing the basics, we were still unable to control the distances the drone travelled. We developed
the skills to manually program the speed and directions but no exact measurements. Figures 11 and 12 depict
the script used to change the altitude and horizontal directions of the drone but due to the outdoor
environment, we were unable to determine the exact height/distance it flew in the air. We then began to
explore other options we could use as part of the drone for alerts and animations like flashing LED lights and
abnormal actions (eg ariel flips).
Figure 11: Commands to change altitude (verticals)
Drone:flip
Page !20
Page !21
We attempted to write javascript commands into the terminal in order to use timed actions however this failed.
The next strategy attempted was to use client.createRepl(); in the terminal itself instead of the javascript
document (repl.js). This also failed with the following notifications given.
Page !22
Errors continued but for the purpose of the example they have been cropped.
After trying multiple more ways of possibly pre-programming the drone, we were about to conclude the
inability to pre-program however the solution was the REPL.js file. The REPL file allowed us to script multiple
commands to be followed after the previous finished. As soon as the terminal was connected to the REPL, the
script written in repl.js were activated.
Page !23
Page !24
Figure 20: repl.js and node.js in terminal to produce horizontal and vertical movements
Due to weather conditions the final script we have written has not been recorded.
3. CONCLUSION
The aim of this project was to demonstrate how thermal imagining, unmanned ariel vehicles and artificial
intelligence can be applied in search a rescue in a complex terrain where target was lost in the snow. By
having a cold environment as a backdrop, the heat of the target can be detected using thermal imaging.
Page !25
Thermal imaging relies of a temperature differential between the background and the target. In order to search
a large area, the drone was programmed to follow a predetermined search path carrying a thermal imager.
With the assistance of the artificial intelligence in the control system and programming would allow the drone
to avoid obstacles and identify thermal hotspots. This project focuses on the development of a node.js control
system to allow the vehicle to search for a heat signature on the assumption that it had a thermal imager.
What we achieved was a basic pre-programmed flight path to demonstrate the concept of the ability to follow
a predetermined search plan. This was done by using a node-ar-drone npm package within node.js. We
found using this code provided more flexibility and capability than when controlled using the AR-Drone app. In
that we had more direct control over the drones commands and flight movement which allowed us to adapt
the drones behaviour to suit its search and rescue mission. The potential of this software and application in
controlling a drone for search and rescue means more complex and remote terrains can be accessed,
providing greater certainty in potentially locating a survivor of an avalanche or the like.
Page !26
4. REFERENCES
Better Health Channel 2013, Hypothermia, viewed 3 May 2016, https://www.betterhealth.vic.gov.au/health/
healthyliving/hypothermia
"Bodies Of American Mountain Climber And Cameraman Are Found In Glacier".Mail Online. N.p., 2016. Web.
3 May 2016.
http://www.dailymail.co.uk/news/article-3568403/Bodies-elite-climber-cameraman-melting-glacier.html
Cool Antarctica 2013, Hypothermia: Cold weather cool risks, viewed 3 May 2016, http://
www.coolantarctica.com/Antarctica%20fact%20file/science/cold_hypothermia.php
Explore Forensics 2016, Estimating The Time of Death, viewed 4 May 2016, http://
www.exploreforensics.co.uk/estimating-the-time-of-death.html
How To NZ 2014, Cold Shock and Hypothermia What Happens to the Body in Very Cold Water, viewed 4
May 2016, http://howto.yellow.co.nz/health-nutrition/medical-concerns/cold-shock-and-hypothermia%E2%80%93-what-happens-to-the-body-in-very-cold-water/
Map Toaster Topo 2014, How GPS Works, viewed 5 May 2016, https://www.maptoaster.com/maptoastertopo-nz/articles/how-gps-works/how-gps-works.html
WebMD 2014, First Aid and Emergencies - Body Temperature, viewed 3 May 2016, http://www.webmd.com/
first-aid/body-temperature?page=8
Thermal 2016, Compact".Seek Thermal. N.p., 2016. Web. 1 June 2016. http://www.thermal.com/products/
compact
FLIR Systems, Inc 2016. "FLIR Systems | Thermal Imaging, Night Vision And Infrared Camera
Systems".Flir.com.au. N.p.,. Web. 27 May 2016.
http://www.flir.com.au/home/
Forrest, Conner. 2015, "10 Things You Need To Know About Artificial Intelligence Techrepublic".TechRepublic. N.p.,. Web. 1 June 2016.
http://www.techrepublic.com/article/10-things-you-need-to-know-about-artificial-intelligence/
"Hover Camera Self-Flying Camera That Follows You 2016.Gethover.com. N.p.,. Web. 31 May 2016.
http://gethover.com/
"Hover Camera Is A Safe And Foldable Drone That Follows You".Engadget. N.p., 2016. Web. 14 May 2016.
Page !27
http://www.engadget.com/2016/04/26/hover-camera-drone-zero-zero-robotics/
"Infrared Camera And Thermal Imaging Camera Reviews - By Experience Infrared Thermographers".Infrared
Camera and Thermal Imaging Camera Reviews. N.p., 2013. Web. 29 May 2016.
http://infraredcameras.net.au/
"Overview".Seek Thermal. N.p., 2016. Web. 31 May 2016.
http://www.thermal.com/products/
"Seek Thermal XR, A Thermal Camera Accessory With Extra Range - Thermal Imaging Blog".Thermalimagingblog.com. N.p., 2016. Web. 31 May 2016.
http://thermalimaging-blog.com/133-seek-thermal-xr-a-thermal-camera-accessory-with-extra-range/
"Thermal Imaging Cameras Australia - Thermal Imaging Cameras
Australia".Thermalimagingcamerasaustralia.com.au. N.p., 2016. Web. 30 May 2016.
http://www.thermalimagingcamerasaustralia.com.au/
"Artificial Intelligence Facts, Information, Pictures | Encyclopedia.Com Articles About Artificial
Intelligence".Encyclopedia.com. N.p., 2016. Web. 3 May 2016.
http://www.encyclopedia.com/topic/artificial_intelligence.aspx
Drones?, What. "What Are Drones? - For Dummies".Dummies.com. N.p., 2016. Web. 4 May 2016.
http://www.dummies.com/how-to/content/what-are-drones.html
Page !28
Science, Live. "History Of A.I.: Artificial Intelligence (Infographic)".Live Science. N.p., 2014. Web. 2 May 2016.
http://www.livescience.com/47544-history-of-a-i-artificial-intelligence-infographic.html
"What Are Drones?".Drone Wars UK. N.p., 2010. Web. 3 May 2016.
https://dronewars.net/aboutdrone/
Page !29