Download as pdf or txt
Download as pdf or txt
You are on page 1of 9

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/331723697

The Impact of Adverse Weather Conditions on Autonomous Vehicles:


Examining how rain, snow, fog, and hail affect the performance of a self-
driving car

Article in IEEE Vehicular Technology Magazine · March 2019


DOI: 10.1109/MVT.2019.2892497

CITATIONS READS

230 10,126

6 authors, including:

Shizhe Zang Ming Ding


The University of Sydney The Commonwealth Scientific and Industrial Research Organisation
7 PUBLICATIONS 314 CITATIONS 365 PUBLICATIONS 10,579 CITATIONS

SEE PROFILE SEE PROFILE

Dali Kaafar
Macquarie University
224 PUBLICATIONS 4,454 CITATIONS

SEE PROFILE

All content following this page was uploaded by Ming Ding on 08 March 2020.

The user has requested enhancement of the downloaded file.


The Impact of Adversary Weather
Conditions on Autonomous Vehicles
Shizhe Zang∗ (The University of Sydney), Ming Ding‡ , David Smith‡ , Paul Tyler‡ , Thierry
Rakotoarivelo‡ , Mohamed Ali Kaafar‡ (Data 61, CSIRO).

Recently, the development of autonomous vehicles and o Notification of traffic lights, signs, and so on.
intelligent driver assistance systems has drawn significant Since the on-road driving environment is very complex and
amount of attention from the general public. One of the most dynamic, especially for the navigation and control systems, most
of the current autonomous vehicles are equipped with different
critical issues in the development of autonomous vehicles and types of sensors. This enables systems to take advantage of their
driver assistance systems is their poor performance under ad- respective strengths and obtain more accurate awareness of the
verse weather conditions such as rain, snow and fog. environment by means of fusion techniques. These sensors
However, up to now there has been no study, which provides include camera, light radar (LIDAR), radar, GPS and sonar.
readers with a systematic and unified review about Currently, one of the most critical issues in the development
the weather effect on various types of sensors, used in of autonomous vehicles and driver assistance systems is their
poor performance under adverse weather conditions, such as
autonomous vehicles. In this paper, we first present a literature
rain, snow and fog. In the case of bad weather, human vision is
review about the impact of adverse weather conditions on degraded and proper functioning of driver assistance systems
state-of-the-art sensors, such as light radar (LIDAR), global becomes even more essential to drivers. Unfortunately, like
positioning system (GPS), camera and radar. Then we propose the human vision, these sensors are also negatively impacted
a new model to characterize the rain effect on millimeter-wave by adverse weather conditions. For example, rainy and foggy
(MMW) radar, which considers both the rain attenuation and conditions cause a significant degradation on the camera and
LIDAR [1]. Consequently, inaccurate information from sensors
the backscatter effects. Our simulation results show that the
can lead to wrong decisions and in turn car crashes. Therefore,
detection range of the MMW radar can be reduced by up to 55% research on the sensor performance under adverse weather
under severe rainfall conditions. Moreover, the rain backscatter conditions is particularly urgent for the development of
effect is significantly different for targets with different radar autonomous vehicles.
cross- se c t i on areas. Research on the sensor degradation due to bad weather
conditions has emerged in recent decades. For example, the
authors of [2] focused on the performance of LIDAR under
I. INTRODUCTION
various weather phenomena. The authors of [3] studied the
Recently, the development of autonomous vehicles and rain effect on cameras. The authors of [4] and [5] described
intelligent driver assistance systems has drawn significant propagation effect on millimeter-wave (MMW) radar under
amount of attention from the public. In August 2013, a Mercedes- various weather conditions. However, up to now there has been
Benz S-class vehicle called “Bertha” drove autonomously no study which provides readers with a systematic and unified
without human intervention for about 100 km from Mannheim review about the weather effect on various types of sensors,
to Pforzheim, Germany. Later in June 2016, Google tested their used in autonomous vehicles.
fleet in autonomous mode over a total of 2,777,585 km. The Since radar can measure radial distance and velocity of
fleet included Audi TT, Toyota Prius, Lexus RX450h and remote object very precisely, the market for driver assistance
Google’s own cars. This advanced technology is not only able systems based on millimeter-wave radar sensor technology is
to improve road safety, but also relieve the burden of many tasks gaining momentum. According to [4], the most serious source
performed by a driver. This includes the following: for radar signal attenuation is rain. In [5], it is stated that
o Self-steering with lane recognition; backscatter also contributes significantly to the impact of
o Distance maintenance in platooning vehicles; rain on millimeter-wave radar because the droplet sizes are
o Self-parking; comparable to the radar wavelength. The attenuation effect
o Automatic braking systems with pedestrian recognition; reduces the received power of useful signals and the backscatter


Wikipedia, “Google self-driving car — wikipedia, the free
encyclopedia,” Available:
https://en.wikipedia.org/w/index.php?oldid=736369985
effect increases the interference at the receiver. Therefore, the 10m [6]. Due to its short detection range and limited usage in
combined effect of these two factors should be carefully autonomous cars, it has not been considered in the following
studied. discussion.
In this paper, we first present a literature review about the
influence of adverse weather conditions on state-of-the- art LIDAR
sensors such as LIDAR, GPS, camera and radar. Then, we
Since light radar (LIDAR) sensors are able to provide
propose a new model to characterize the rain effect on the
outstanding angular resolution and highly accurate range
MMW radar, which considers both the rain attenuation and
measurements, in recent years they have been proposed as the
the backscatter effects. Our simulation results show that the
essential part of a high performance perception system for
detection range of the MMW radar can be reduced by up
advanced driver assistant functions.
to 55% under severe heavy rainfall conditions. Moreover, for
targets with different radar cross-section areas, the rain The working principal for LIDAR is to first transmit a pulse
backscatter effect is significantly different. and then measure the time until it receives the bounced or
reflected pulse signal from a target object. The distance
between the LIDAR device and the target is thus equal to half
the round trip time multiplied by the speed of light.
Clemens et al. [1] proposed that the criterion for object
detection at the receiver should be that the voltage of the
reflected pulse is greater than a noise voltage threshold. The
authors of [7] gave formulas about receiving power and signal-
to-noise-ratio (SNR) of LIDAR with an avalanche photodiode
(APD) receiver. They also studied the relationship among peak
return detection, false alarm rate and SNR. From the
formulation of LIDAR in [1], the receiving power is affected
by an extinction coefficient α and a backscattering coefficient
β from different weather conditions. In [2], Rasshofer et al.
presented the mathematical formulas to calculate these
coefficients under rainy, foggy and snowy conditions,
respectively. According to [2] and [7], these coefficients are
determined by the distributions of particle diameters and size,
which are related to rainfall and snowfall rates.
In [7], it was mentioned that fogs produce high extinction
and backscattering coefficients (5 × 10−3 to 1.5 × 10−2 ),
which are higher than those of snowfall (10−3 to 5 × 10−3 )
and rainfall (less than 10−3 ). For rain and snow, their
extinction coefficients show no frequency selectivity. As a
result, for a LIDAR with wavelength of 900nm, fog has the
largest impact on its detection ability. Under rainy conditions,
if the raindrop is very close in distance to the laser emitter,
Figure 1 Diagram of various sensors on an autonomous vehicle there will be a high chance for false detection. In other words,
if the laser beam intersects a particle and it generates a “burst
The rest of the article is organized as follows. Section II of light” like a small surface, there will be a return of peak,
reviews the weather effects on LIDAR, camera and radar. which is similar to the one from object on road.
Sections III presents our mathematical modeling of rain effect Some of the commercial products already have automatic
on the MMW radar. Section IV presents simulation results fog correction. Therefore, raindrops and snowflakes can be
and provides implementation considerations of MMW radar filtered out by the use of pixel oriented evaluation [3]. Pixel
according to the simulation results. Finally, Section V oriented evaluation involves saving sequential measurement
concludes the paper. values from each individual spot in each scan, and a separate
counter being started for each spot. Erroneous measurements
II. WEATHER EFFECTS ON SENSORS FOR can be filtered out by repeatedly examining the reported spot.
AUTONOMOUS VEHICLES However, there is no study on how much accuracy these
techniques could guarantee in adverse weather conditions.
This section reviews different sensing technologies for
autonomous vehicles and their respective issues under a
variety of adverse weather conditions (e.g. rain, fog, snow, or Camera
space weather). These considered sensing technologies Vehicle on-board cameras provide drivers with crucial visual
include LIDAR, video camera, GPS, and radar. signals and information for safe driving. The information can
Note that besides the mentioned sensors, sonar is also help detect pavement markings, road signs or hazards such
a popular equipment for navigation and ranging on autonomous as obstacles. These systems provide a good service in more
vehicles. Sonar is able to operate in adverse weather with little typical weather conditions, especially in clear daylight.
interference due to its short measurement range of less than However, such systems should not degrade in severe weather
and the camera system should continue to provide helpful conditions. Furthermore, fog negatively influences perception
information under these conditions, especially as the driver is and creates potentially dangerous situations as it can reduce the
under an increased workload. Bad weather reduces the scene contrast of the image and increase the difficulty of pattern edge
contrast and visibility, and hence this subsection will analyze recognition [1]. In the case of an observed fog scene, the
the performance of camera based systems in the three most frequency components are concentrated at zero frequency
frequent adverse weather conditions: snow, rain and fog. whereas in the scene without fog one finds a broadly spread
spectrum. Sharp edges are modeled by different low and high
Rainy and Snowy Conditions frequencies, whereas smooth edges are characterized only by low
Most algorithms used in outdoor vision systems assume that frequencies.
intensities of image pixels are proportional to scene brightness. From [9], the current technologies to remove fog effects are
However, dynamic weather (rain and snow) introduces sharp of two types: fog correction and fog removal. Fog correction is
intensity fluctuations in images and videos, which degrade the based on the correction of contrast level, for example, color
qualities of images and videos, and thus violate this basic correction. In a fog removal process, the fog level over an image
assumption [8]. For example, raindrops in the air can create is estimated and removed. The authors of [9] reviewed state-of-
raindrop pattern on the image, which will decrease the image art image enhancement and restoration methods for improving the
intensity and blur the edge of other patterns behind it [3]. Heavy quality and visibility level of an image through several aspects:
snow in the air can increase the image intensity and obscure the image acquisition, estimation, enhancement, restoration and
edge of the pattern of object in the image or video so that the compression. They also compared these approaches through
object cannot be recognized. Technologies to deal with this implementation of the methods while using the same parameter
issue can be classified into two main categories: real-time values for critical analysis.
processing and post-time processing.
In terms of real-time processing, Garg and Nayar [8] showed Global Positioning System (GPS)
that by appropriately selecting camera parameters, one could
reduce (and sometimes remove) the effect of rain, without The GPS can provide real time location of a vehicle, which
appreciably altering the appearance of the scene. This is done is the core functionality for any navigation system combined
during image acquisition and does not require any post- with a digital map. In theory, local weather condition does not
processing. The work first did the analysis of visibility of rain affect the accuracy of GPS positioning as it is designed for all-
and then presented a method that automatically sets the camera weather conditions. The GPS signal frequency around
parameters (exposure time, F-number and focus setting) to 1575MHZ is chosen because it is a frequency "window" for
remove/reduce the effect of rain based on the analysis. signal propagation that is mostly unaffected by the weather [10].
Apart from their influence on the image, raindrops and However, vehicle GPS does suffer from some performance
snowflakes can affect the camera directly. In snowy condition, degradation in rainy or snowy days. For example, if a GPS
cool temperature affects a camera system due to optical and module is installed inside a car attached on the windscreen, the
mechanical disruptions. An un-shielded camera can be easily wipers running across the windshield will intermittently block
damaged by ice. If the on-board camera is a powered rotation reception and make it difficult for a GPS device to detect a
camera such as an auto tracker, the ice formed residual moisture complete navigation data string. Since GPS receives location
from rain or sleet can cause the camera to be locked in place and
signal from different satellites, it is important for the receiver to
prevent rotation. If there is moisture around a camera below
have a clear line of sight of sky. When the wipers are in the
freezing point, the frost can cover the camera’s lens and deny the
middle between the GPS receiver and sky, the receiver is
viewer seeing any activities besides the crystalline patterns of
the snow. These issues can be solved by a self-heating camera, blocked and has trouble receiving those bits of string arriving at
which can generate heat during its operation to avoid frozen the passing of the wiper. Therefore, the GPS may not decode the
moisture inside or on its lens. Rainy condition affects the system received string properly and is likely to give inaccurate
due to electrical and optical disruptions. If the system is not information. On the other hand, if the GPS is mounted outside a
waterproof, it can be damaged by short circuit from raindrops. car, the raindrop will affect the receiving frequency of the GPS
Optically, raindrops on the lens can change the focus of camera. antenna and also attenuate the signal.
As a result, part of the image affected by raindrops will be out of Although GPS is not affected much by local weather, it can
focus and blurred. These effects can lead to the failure of image be influenced by space weather. Irregularities in the ionospheric
processing such as pattern recognition. layer of the Earth’s atmosphere can at times lead to rapid fading
in received signal power levels due to destructive interference in
Foggy Condition multi-path signals. This phenomenon, referred as ionospheric
Under foggy condition, moisture such as condensation on a scintillation, can lead to a receiver being unable to track one or
lens has the similar impact on the image processing as snowy more visible satellites for short periods of time. Other factors

 
“Weather affects surveillance cameras,” Available: “Rain, snow, clouds and gps reception,” Available:
http://www.securitycameraking.com/securityinfo/weatheraffectssurvei http://www.gpsinformation.net/gpsclouds.htm
llance- cameras/
affecting GPS accuracy include radio interference from other explained in Table 1. Parameters 𝑉 (multipath coefficient) and 𝛾
research satellites and multi-path fading from nearby (rain attenuation coefficient) need to be calculated by other
environment [10]. One way to improve the GPS accuracy is to formulas in [4] and 𝜎𝑖 (rain backscatter coefficient) needs to be
enhance the receiver tracking threshold, especially by means of calculated by using the formula for Marshall-Palmer distribution
external velocity aiding from an inertial measurement unit in [13].
(IMU). This has already been used in some luxury cars. Other
techniques include redesigning the receiver antenna and signal The Backscatter Effect
processing procedures. According to formula 4.1 in [14], the detection process also
depends on the signal-to-interference-plus-noise-ratio (SINR).
Radar Maintaining the SINR above a certain threshold is vital for
Over the last decade, radar based driver assistance and active reliable detection. From formula 4.20 in [14], the relationship
safety systems have found wide applications in nearly all vehicle between the power intensity of the target signal and that of the
manufacturers the world. The basic principal for this kind of backscatter signal is characterized by
radar is range and velocity detection of moving objects.
According to the American and European standards, the 𝑆𝑡 8𝜎𝑡
( )= (2)
frequency band of the radar for automobiles is around 24 and 𝑆𝐵 𝜏𝑐𝜃𝐵𝑊 𝜋𝑅𝑡2 𝜎𝑖
2

77GHz [11] and the radar operating in this band is called


millimeter-wave radar (MMW). Compared to traditional where 𝑆𝑡 and 𝑆𝑏 are power intensities of target and backscatter
microwave radar systems, millimeter-wave radar is able to signals; c is the speed of light and other parameters are explained
provide higher resolution. In microwave systems, transmission in Table 1.
loss is mainly caused by the free-space loss. However, in the
millimeter-wave spectrum, additional loss factors come into Variable Value
play, such as rain, snow and mist in the transmission medium 𝑃𝑡 , Transmission Power 10mW
[4]. 𝐺, Antenna Gain 30dB
According to [4], the most serious source for radar signal 𝑓, Radar Frequency 77GHz
attenuation is rain. In [5], it is stated that backscatter also 𝜏, Pulse Duration 5 × 10−8 s
contributes significantly to the impact by rain on millimeter- 𝜃𝐵𝑊 , Antenna Beamwidth 2 - 4°
wave radar. This is because the droplet sizes are comparable to 𝜎𝑡 , Radar Cross-Section of Sedan: 15.85𝑚2 , Pedestrian: 1𝑚2
the radar wavelength. The attenuation effect reduces the Target
received power of useful signals and the backscatter effect 𝐹𝑁 , Receiver Noise Figure 11dB
increases the interference at the receiver. In the events of snow 𝐵, Receiver Filter Bandwidth 20MHz – 4GHz
and mist, MMW radars are also affected in the form of 𝑇0 , Thermal Temperature 293 Kelvin
attenuation and backscatter. From [12], the mathematical models
Table 1 Simulation parameter values
for attenuation and backscatter of snow and mist conditions are
the same as those of the rain model though mist and snow have
different attenuation and backscatter coefficients and the Receiver Noise
calculation methods are also studied there. In the next section, From [15], the receiver noise for a MMW radar is given by
we will investigate the rain attenuation effect, the backscatter
effect and their combined effect in more detail. 𝑁 = (𝐹𝑁 − 1)𝑘𝑇0 𝐵 (3)

III. RAIN EFFECTS ON MILLIMETER-WAVE where 𝑁 is the receiver thermal noise in watts and other variables
RADAR are explained in Table 1.
As mentioned above, rain effects on MMW radar can be
classified as two types: attenuation and backscatter. The Combined Effect on MMW Radar
Mathematical models of both effects, receiver noise and the If we treat the rain backscatter effect as interference at the
combined effect will be described in the following subsections. receiver, the SINR can be calculated as 𝑆𝐼𝑁𝑅 = 𝑃𝑟 /(𝑃𝑏 + 𝑁),
where 𝑃𝑟 is the signal power at the receiver, 𝑃𝑏 and 𝑁 are the
The Attenuation Effect backscatter signal power and receiver thermal noise,
respectively. Without loss of generality, we assume the areas of
𝑃𝑡 𝐺 2 𝜆2 𝜎𝑡 4
𝑃𝑟 = ∙ 𝑉 ∙ 𝑒𝑥𝑝(−0.2𝛾𝑟) (1) radar receiver and transmitter are the same. Therefore, 𝑃𝑟 /𝑃𝑏
(4𝜋)3 𝑟 4
becomes the same as 𝑆𝑡 /𝑆𝑏 in Equation (2) and 𝑃𝑏 can be
where 𝑟 is the distance between radar and target; 𝑃𝑟 is the signal calculated by using Equation (1) and Equation (2). Obviously,
power at receiver; 𝜆 is the radar wavelength. Other variables are
the signal-to-noise ratio (SNR) at the receiver can be written as condition (50mm/hr) and 20% for the extreme condition
𝑆𝑁𝑅 = 𝑃𝑟 /𝑁. (400mm/hr), respectively. For normal detection requirement
(SINR = 13dB), the drop is around 11% for the severe condition
IV. SIMULATION AND RESULTS (50mm/hr) and 22% for the extreme condition (400mm/hr),
respectively. Therefore, we can conclude that severe and
In this section, four general scenarios and implementation extreme rainfall conditions have a significant impact on the radar
aspects are considered, which are described as follows. detection range.
Scenario 1: The radar detection range of a sedan is
calculated versus different rainfall rates (0 - 400mm/hr) with Scenario 2: Radar Detection Range of a Pedestrian
fixed SINRs (10dB, 13dB and 20dB). Effect of multi-path is also versus Rainfall Rate
considered and the target of radar is a sedan. The difference between this scenario and the above scenario
Scenario 2: The target of radar is changed to a pedestrian and is the different radar-cross section (RCS) due to the change of
the rest are the same as Scenario 1. target from a sedan to a pedestrian. The RCS of the target may
Scenario 3: Comparison between the rain attenuation and be characterized by the following factors: material of target
backscatter effects is performed under different rainfall rates (0 surface, the size of the target, incident and reflected angles of
- 400mm/hr) with fixed distance (100m) for detection of a sedan. radar wave, the polarization of transmitted and received
Both SNR and SINR versus rainfall rate are plotted. radiation, etc. From Subsection III-A, it can be seen that the
Scenario 4: The target of the radar is changed to a pedestrian receiving power of radar is proportional to the target radar cross
and the fixed distance is changed to 50m. The rest of the scenario section area. Since the radar cross section area of a pedestrian is
are the same as Scenario 3. less than a sedan (see Table 1), the detection range is expected
The parameter values used in our simulations are to be shorter. This is demonstrated in the simulation results in
summarized in Table 1. this subsection. We plot the simulation results in Figure 3a with
multi-path and Figure 3b without multi-path. From Figure 3a,
Scenario 1: Radar Detection Range of a Sedan the multi-path effect of this pedestrian scenario diminishes faster
versus Rainfall Rate than Scenario 1 due to the difference in the RCS. From Figure
As mentioned above, for reliable target detection, there is a 3b, it can be seen that the detection range is reduced by 26% at
requirement for the receiver SINR. The SINR for radar detection severe rainy condition (50mm/hr) and 55% at extreme rainy
is related to the probability of detection and false alarming rate. condition (400mm/hr) when SINR is at 13dB. Compared to
A typical radar system will operate with a detection probability Scenario 1, a target with lower RCS value experiences a faster
of 0.9 and a probability of false alarm of 10−6 . The required decrease in detection range at the same SINR requirement.
SINR for millimeter-wave radar was suggested to be 13.2dB in Furthermore, from the comparison, rainfall has a more severe
[16]. Therefore, in our simulation, the minimum required SINR impact on the detection range of target with a small RCS.
for the combined effect is set to13 dB with multi-path effect and
10, 13 and 20dB without multi-path effect. Scenario 3: Radar Receiver SNR and SINR of a
Different detection ranges can be solved by using the SINR Sedan versus Rainfall Rate
equation with different rainfall rates. Since the maximum In this scenario, the distance between the target and the radar
rainfall rate in the world is 401mm/hr according to the record, is fixed and we consider the effect of rainfall rate on the
the range of rainfall rate is set to 0 – 400mm/hr. attenuation and backscatter effects. As mentioned before, the
The simulation results are shown in Figure 2a with multi- SNR formulates the case where only rain attenuation effect is
path effect and Figure 2b without multi-path effect. From Figure considered. SINR formulates the case where the combined
2a, it can be seen that the multi-path effect (causing the variance effects of rain attenuation and backscatter are concerned. The
of the detection distance) is less observable with the increase of receiver SNR and SINR are plotted in the same graph versus the
the rainfall rate. This is because the high rainfall rate tends to rainfall rate. The distances are set to 50, 100 and 150 m. The
attenuate the detection distance severely and lead to the results are shown in Figure 4a without multi-path effect.
reduction of the variance caused by multi-path. From Figure 2b, From this figure, we can see that the gap between SNR and
we can observe that the detection range decreases faster with SINR increases with rainfall rate. In other words, the rain
rainfall rate at a higher SINR requirement. For example, when backscatter effect becomes severe in heavy rain conditions. For
SINR = 20dB, the detection range decreases 17% at severe rain example, when the rainfall rate is 50mm/hr, the degradation of
condition (50mm/hr) and 33% at extreme condition (400mm/hr).
However, when SINR = 10dB, the reduction is 9% for the severe


“World’s record rainfall,” Available:

http://www.bom.gov.au/water/designRainfalls/rainfallEvents/worldRec “Radar cross-section — wikipedia, the free encyclopedia,” Available:
Rainfall.shtm https://en.wikipedia.org/wiki/Radar-cross-section
(a) Radar Detection Range of Sedan versus Rainfall Rate with Multi-path (b) Radar Detection Range of Sedan versus Rainfall Rate without Multi-
Effect path Effect

Figure 2 Radar Detection Range of Sedan versus Rainfall Rate

(a) Radar Detection Range of Pedestrian versus Rainfall Rate with Multi- (b) Radar Detection Range of Pedestrian versus Rainfall Rate with Multi-
path Effect path Effect

Figure 3 Radar Detection Range of Pedestrian versus Rainfall Rate

(a) Radar Receiver SNR and SINR of Sedan versus Rainfall Rate (b) Radar Receiver SNR and SINR of Pedestrian versus Rainfall Rate

Figure 4 Radar Receiver SNR and SINR of Sedan and Pedestrian versus Rainfall Rate

SINR due to attenuation is 1.11dB and 0.78dB due to Scenario 4 Radar Receiver SNR and SINR of
backscatter. At a rainfall rate of 100mm/hr, the reduction due to Pedestrian versus Rainfall Rate
attenuation increases to 1.55dB and 1.06dB due to backscatter. This scenario is similar to Scenario 3 except that the target
At a rainfall rate of 400mm/hr, the backscatter effect will is changed from a sedan to a pedestrian. As a result, the radar
degrade 2.98dB because of attenuation and 1.64dB due to cross-section area of the target is also changed. The distance is
backscatter. Therefore, the attenuation effect is always greater set to 50m since the radar cross section area of pedestrian is
than backscatter effect on a sedan. Also, for different smaller than vehicle’s. The results are shown in Figure 4b. The
measurement distances at the same rainfall rate, the gap between results are similar to those of Scenario 3 except that the rain
SNR and SINR increases with the decrease of distance. This is backscatter effect is much larger than the rain attenuation effect.
due to the fact that backscatter from shorter distance experiences For example, when the rainfall rate is 100 mm/hr, the SINR
less attenuation and produces stronger interference when the degradation due to the rainfall attenuation is 0.56dB and 2.82dB
target distance is also shorter. Overall, from Figure 4a, we can due to backscatter. Therefore, the backscatter effect dominates
conclude that rainfall can influence radar detection significantly the decrease of SINR. This is because the radar cross-section
especially at heavy and extreme conditions. area of a pedestrian is much smaller than a sedan.
Implementation Aspects of Millimeter-wave Radar REFERENCES
From the literature review and simulation results, we [1] C. Dannheim, C. Icking, M. Mader, and P. Sallis, “Weather detection
conclude that there are three implementation considerations for in vehicles by means of camera and lidar systems,” in Computational
millimeter-wave radar of autonomous vehicle. Intelligence, Communication Systems and Networks (CICSyN), 2014
The first aspect is the transmission power of the radar, which Sixth International Conference on, May 2014, pp. 186–191.
is dependent on the function and detection range of radar. For [2] R. H. Rasshofer, M. Spies, and H. Spies, “Influences of weather
example, for a forward looking long range radar, its transmission phenomena on automotive laser radar systems,” Advances in Radio
power is higher than the short range rear parking aid radar. High Science, vol. 9, pp. 49–60, 2011. [Online]. Available: http://www.adv-
transmission power not only provides long detection range in radio-sci.net/9/49/2011/
good weather, but also provides high SINR, especially in [3] H. Kurihata, T. Takahashi, I. Ide, Y. Mekada, H. Murase, Y.
adverse weather conditions. However, using a radar constantly Tamatsu, and T. Miyahara, “Rainy weather recognition from in-vehicle
on high power transmission mode is not energy efficient and camera images for driver assistance,” in IEEE Proceedings. Intelligent
adaptive transmission power should be indicated based on the Vehicles Symposium, 2005., June 2005, pp. 205–210.
function range and weather conditions. For instance, if the rainy [4] G. P.Kulemin, “Influence of propagation effects on millimeter wave
condition is detected by the car (this technology is already radar operation,” in SPIE Conference of Radar Sensor Technology, vol.
mature for the automatic windscreen swift), the system should 3704, SPIE. SPIE, apr 1999, pp. 170–178.
also increase the transmission power for the radar to reach the [5] H. B. Wallace, “Millimeter-wave propagation measurements at the
required SINR. ballistic research laboratory,” IEEE Transactions on Geoscience and
The second aspect is the bandwidth for the radar. As high Remote Sensing, vol. 26, no. 3, pp. 253–258, May 1988.
bandwidth provides high resolution for a radar, the radar has the [6] B. Yamauchi, “All-weather perception for man-portable robots using
ability to distinguish objects like human and vehicle and also ultra-wideband radar,” in Robotics and Automation (ICRA), 2010 IEEE
give more accurate estimations for the target distance and speed. International Conference on, May 2010, pp. 3610–3615.
Nonetheless, from Equation (3), high bandwidth also causes [7] L. Hespel, N. Riviere, T. Huet, B. Tanguy, and R. Ceolato,
noise issues for the radar receiver. Therefore, there is a trade-off “Performance evaluation of laser scanners through the atmosphere with
in radar bandwidth and it is important to find the optimal adverse condition,” pp. 818 606–818 606–15, 2011. [Online]. Available:
bandwidth for the radar receiver based on the function http://dx.doi.org/10.1117/12.898010
requirements. If the vehicle is also equipped with LIDAR which [8] K. Garg and S. K. Nayar, “When does a camera see rain?” in Tenth
provides high resolution speed and distance measurement, then IEEE International Conference on Computer Vision (ICCV’05) Volume
a low bandwidth radar will be a better choice to reduce the noise 1, vol. 2, Oct 2005, pp. 1067–1074 Vol. 2.
at the receiver. [9] G. Yadav, S. Maheshwari, and A. Agarwal, “Fog removal techniques
The third aspect is the radar beamwidth. Obviously, a wider from images: A comparative review and future directions,” in Signal
beamwidth and a larger number of beams could help a radar Propagation and Computer Technology (ICSPCT), 2014 International
detect more objects around vehicle. But it will also consume Conference on, July 2014, pp. 44–52.
more power and lead to greater rain backscatter interference [10] C. H. Elliott Kaplan, Understanding GPS: Principles and
from Equation (2). As a result, it is also crucial to find the Applications, C. H. Elliott Kaplan, Ed. Artech House, 2005.
optimal beamwidth for the radar based on the function [11] D. Johnson, “Experimental comparison of two automotive radars
requirements. for use on an autonomous vehicle,” in The 2nd International Conference
on Wireless Broadband and Ultra Wideband Communications
V. CONCLUSION (AusWireless2007), Aug 2007, pp. 28–28.
In conclusion, this paper provides a literature review about [12] V. N. Pozhidaev, “Estimation of attenuation and backscattering
the influence of adverse weather conditions on state-of-the-art of millimeter radio waves in meteorological formations,” Journal of
sensors such as LIDAR, GPS, camera, and radar. Furthermore, Communication Technology and Electronics, vol. 55, no. 11, pp. 1223–
we proposed a new model to characterize the rain effect on the 1230, 2010. [Online]. Available:
millimeter-wave radar, which considers both the attenuation and http://dx.doi.org/10.1134/S1064226910110033
backscatter effect. The simulation results show that the detection [13] J. Huang, S. Jiang, and X. Lu, “Rain backscattering properties and
range of a millimeter-wave radar can be reduced by up to 55% effects on the radar performance at mm wave band,” International
under severe rainfall conditions. Moreover, for a bigger target Journal of Infrared and Millimeter Waves, vol. 22, no. 6, pp. 917–922,
with a larger radar cross section areas, the backscatter effect 2001. [Online]. Available: http://dx.doi.org/10.1023/A:1014922632540
plays a more significant role causing additional performance [14] S. Hovanessian., Introduction to Sensor Systems. Artech House,
degradation. 1988.
[15] J. C. Toomay and P. J. Hannen, Radar Principles for the Non-
Specialist, ser. Radar, Sonar, Navigation and Avionics. Institution of
Engineering and Technology, 2004. [Online]. Available: http://digital-
library.theiet.org/content/books/ra/sbra032e
[16] ACFR, University of Sydney, “Chapter 10. detection of signal has been providing project management and technical
in noise,” [Online; accessed 28-August-2016]. [Online]. Available: knowledge to Transport for NSW to deploy the Cooperative
http://www.acfr.usyd.edu.au/pdfs/training/sensorSystems/ Intelligent Transport Initiative (CITI), a connected vehicles trial
in the Illawarra region. Previous to this he has worked on
Shizhe Zang received the B.S. (University Medal, first class projects such as traffic state estimations from loop detectors at
Hons.) in electrical engineering (telecommunication) from signalised roundabouts, investigations into adaptive traffic
University of Sydney, Australia. He received summer control systems and video tracking of vehicles. Previous to
scholarship from School of Medicine, University of Sydney in Data61, Paul worked at the Australian Nuclear Science and
2014 and published a literature review about telehealth Technology Organisation (ANSTO) fullfilling a scientific
reimbursement in Australia in Internal Medicine Journal. He computing and research engineering role with a particle
was a summer scholar at NICTA in 2015 and in data 61, CSIRO accelerator. Paul has considerable experience in systems
in 2016. He is currently a PhD candidate at University of engineering, computer systems administration and software
Sydney. His current research focuses on millimeter wave development as well as performing project management roles.
communication in heterogeneous network. Paul has a PhD in Computer Science and a Bachelor of Science
both from the University of Sydney.
Ming Ding (M’12) received the B.S. and M.S. degrees (with first
class Hons.) in electronics engineering from Shanghai Jiao Thierry Rakotoarivelo completed his PhD in cotutelle with
Tong University (SJTU), Shanghai, China, and the Doctor of University of New South Wales (UNSW, Australia) and the
Philosophy (Ph.D.) degree in signal and information processing Institut National Polytechnique of Toulouse (INPT, France). He
from SJTU, in 2004, 2007, and 2011, respectively. He has worked on peer-to-peer mechanisms to discover and utilise
authored more than 30 papers in IEEE journals and Quality-of-Service enhanced alternate paths on the Internet. His
conferences, all in recognized venues, and about 20 3GPP thesis received the “Prix Léopold Escande” award from INPT.
standardization contributions, as well as a Springer book He was a Senior Researcher with NICTA (National ICT
Multipoint Cooperative Communication Systems: Theory and Australia). I worked on protocols and frameworks for large
Applications. Also, as the first inventor, he holds 15 CN, 7 JP, 3 scale distributed testbeds (i.e. design, provisioning,
US, 2 KR patents and co-authored another 100+ patent control/orchestration, and instrumentation/measurement). He
applications on 4G/5G technologies. He is currently a senior also worked on tools to enable reproducible experiments on
research scientist in network measurements and modelling team these testbeds. Currently, he is a Senior Research Scientist with
in data61, CSIRO. His research interests include B3G, 4G, and the Networks Group at Data61, CSIRO.
5G wireless communication networks, synchronization, MIMO
technology, cooperative communications, heterogeneous Mohamed Ali Kaafar is the Group Leader of the Networks
networks, device-to-device communications, and modelling of Group and a Senior Principal Researcher at Data61. His main
wireless communication systems. research interests are in the area of data Privacy, Networks
Security and Performance modelling. He holds the position of
David Smith received the B.E. degree in electrical engineering visiting professor of the Chinese Academy of Science (CAS). He
from the University of New South Wales, Australia, in 1997, and was previously a research leader and a principal researcher at
the M.E. (research) and Ph.D. degrees in telecommunications the Mobile Networks Systems group at NICTA and a researcher
engineering from the University of Technology Sydney, in 2001 at the Privatics team at INRIA in France. Prof. Kaafar obtained
and 2004, respectively. He is a Senior Researcher Scientist with a Ph.D. in Computer Science from University of Nice Sophia
Data61, CSIRO (previously in NICTA) and an Adjunct Fellow Antipolice at Inria France. He published over 200 scientific
with Australian National University (ANU). He was with NICTA peer-reviewed papers with several repetitive publications in the
since 2004, and in Data61 since 2016. He has been with ANU prestigious ACM SIGCOMM and IEEE INFOCOM. Prof.
since 2004. He He has published over 100 technical refereed Kaafar is also a member of the editorial board of the Privacy
papers and made various contributions to IEEE standardization Enhancing Technologies Symposium and Journal (PETS and
activity. His research interests are in wireless body area PoPETS). In 2015, he has been appointed as the editor of the
networks, game theory for distributed networks, mesh networks, IEEE Internet Computing on Small Wearables and currently
5G networks, disaster tolerant networks, radio propagation, serves as the associate editor of the ACM Transactions on
MIMO wireless systems, space-time coding, antenna design, and Modeling and Performance Evaluation of Computing Systems.
also in distributed optimization for smart grid. He is also member of several technical committees including the
ACM International Conference on emerging Networking
Paul Tyler is currently a Senior Research Engineer with Experiments and Technologies (CoNEXT), ACM Internet
Data61’s Netowrk Research Group. Paul has been with Data61 Measurement Conference (IMC) and WWW. He is the general
(and formally NICTA) since 2004 bringing ICT research to the Chair of Passive Active Measurement 2017.
transport and infrastructure domain. For the past 4 years, Paul

View publication stats

You might also like