Professional Documents
Culture Documents
Sensor and Actuator Fault Detection in Small Autonomous Helicopters
Sensor and Actuator Fault Detection in Small Autonomous Helicopters
com
a
Robotics, Vision and Control Group,1 Engineering School, University of Seville, Camino de los Descubrimientos s/n, 41092 Seville, Spain
b
Robotics, Vision and Control Group, Pablo de Olavide University, Spain
Abstract
The use of autonomous helicopters in civilian applications requires the improvement of safety conditions to avoid potential accidents.
Fault detection and isolation (FDI) plays an important role in this context. This paper presents an actuator and sensor FDI system for
small autonomous helicopters. Fault detection is accomplished by evaluating any significant change in the behaviour of the vehicle with
respect to the fault-free behaviour, which is estimated by using observers. Several types of faults have been considered. The effectiveness
of the proposed approach is demonstrated by means of experimental results and simulations.
2007 Elsevier Ltd. All rights reserved.
Keywords: Fault detection and identification; Autonomous helicopters; UAV; Actuators; Sensors
0957-4158/$ - see front matter 2007 Elsevier Ltd. All rights reserved.
doi:10.1016/j.mechatronics.2007.09.007
G. Heredia et al. / Mechatronics 18 (2008) 90–99 91
The presence of faults is detected by means of the so-called TAR helicopter [18]). The payload is usually around 4–
residuals, i.e., quantities that are over-sensitive to the mal- 8 kg, and therefore the equipment that can be mounted
functions. Residual generation can be performed in differ- onboard is limited. In some cases, the Yamaha RMAX
ent ways: parity equations [2], observer-based generation spraying helicopter is used as airframe (see for example
[3], and the methods based on parameter estimation [4]. the GTMax [12,13]). The RMAX is larger than the other
Neural networks and fuzzy systems have also been applied airframes (the payload is around 30 kg) and it does not
in model-based FDI [5]. have these weight limitations.
Observer-based and parameter estimation methods are Small helicopters typically have five control inputs: col-
the most frequently applied methods for fault detection lective pitch pc, cyclic pitch py for pitching, cyclic pitch px
[6]. Most published work in recent years on FDI systems for rolling, tail rotor pitch ptr and engine throttle pt. It is
for autonomous vehicles also use observer-based methods. usual that an engine governor or a separate throttle control
The basic idea behind the observer or filter-based approach loop maintain the speed of the main rotor at a constant
is to estimate the outputs of the system from the measure- value manipulating the throttle pt, and therefore the flight
ments by using either Luenberger observer(s) in a deter- controller control only the four first inputs.
ministic setting or Kalman filter(s) in a stochastic setting. Helicopters have linkages in the main rotor system that
Particularly in the field of autonomous vehicles FDI, mechanically relates the helicopter’s blade angles to the
Luenberger observers, Kalman filters, banks of observers main rotor actuators, via an intermediary swashplate.
and Kalman filters and neural networks have been used Most small helicopters usually have three swashplate actu-
for observer generation. Neural networks have been used ators, but in some cases four actuators are used [17].
to detect sensor and actuator faults applied to a B-747 If one of the main rotor actuators fails, severe degrada-
mathematical model [7]. A bank of Kalman filters and neu- tion or even complete loss of helicopter controllability may
ral networks have also been used for sensor fault detection happen. In these situations, fast and reliable detection and
on a NASA high altitude UAV simulation model [8], and on identification of the fault is very important. Once the infor-
B-373 actual flight data [9]. A bank of Kalman filters have mation of the presence and location of the failure is avail-
been also used for fault detection in aircrafts [10]. Actuator able, the flight system can take actions to counteract its
fault detection in unmanned underwater vehicles has been effects via controller reconfiguration. Enns and Li [19] pro-
done using a bank of Kalman filter estimators [11]. pose an actuator geometry for three-actuator swashplates
However, very few results on fault detection for auton- that provides control axis coupling and a reconfiguration
omous helicopters can be found in the literature. Drozeski strategy that retain control of any two of the three control
et al. [12,13] present a FDI system based on neural net- axes at a time. Drozeski et al. [13] present a reconfigurable
works in the context of a reconfigurable flight control flight control architecture that recovers vertical control
architecture for UAVs. The FDI system has been imple- after a collective actuator fault in a helicopter, controlling
mented and tested in a modified Yamaha RMAX autono- the speed of the main rotor with the throttle pt.
mous helicopter (the RMAX airframe weighs 58 kg, and Helicopter autonomous flight needs precise position and
has a 30 kg payload). attitude information for control and stabilization. Small
In this paper, the diagnosis of actuator and sensor faults autonomous helicopters carry a pack of sensors that in a typ-
in autonomous helicopters is investigated and the design of ical case includes an inertial measurement unit (IMU) with
a fault detection system is considered, using a model-based three gyros, three accelerometers and three-axis magneto-
approach, with observer-based residual generation. The meter for attitude determination, a centimeter-precision
system is tested with real flight data. This paper is based kinematic DGPS, a sensor for measuring the main rotor
on conference papers [14,15]. rpm, and an ultrasonic altitude sensor for take-off and
The paper is organized as follows. Small autonomous landing.
helicopters are described in Section 2. Section 3 introduces A fault in one of the sensors, although not as crucial as
the fault detection and isolation approach. The results on actuator faults, may induce position and attitude estima-
the application of these techniques to actuator and sensor tion errors if undetected. Reconfiguration in these cases
fault detection are presented in Sections 4 and 5, respec- usually consists in isolating the faulty sensor and using
tively. Section 6 is devoted to the conclusions. the other sensors to get the best possible estimation of posi-
tion and attitude.
2. Small autonomous helicopters Some of the experimental data presented in this paper
has been recorded using the MARVIN helicopter [17],
Several small autonomous helicopter prototypes have which is based on a conventional model airframe (see
been developed in recent years at different research centres Fig. 1). Sensors for position and attitude determination
throughout the world [16]. In most cases, the prototype is include an IMU, an ultrasonic rangefinder looking down
built upon a commercial airframe, to which sensors, com- and a Novatel RT-2 carrier phase differential GPS receiver.
puters and communication equipment are added. In many MARVIN’s actuators are six servos that operate the
cases the airframe is a conventional model helicopter (see, engine throttle, the tail rotor pitch, and the main rotor
for example, the MARVIN helicopter [17], or the AVA- pitch settings. The swashplate is moved by four servos,
92 G. Heredia et al. / Mechatronics 18 (2008) 90–99
FDI
Reference
Actuator Sensors
Controller UAV Supervision
ables are inside the specified range. y i ðtÞ ¼ ai;j y i ðt jÞ þ bi;j;k uj ðt kÞ þ ei ðtÞ ð1Þ
j¼1 j¼1 k¼1
The variables used to specify the flight envelope covered
by the identification data and the limit values are the The number of identified MISO ARX models is equal to
helicopter velocity in the XY plane in world coordinates the number m of the output variables. The model order n
(VelXY < 10 m/s), the vertical helicopter velocity in world and the parameters ai,j and bi,j,k with i = 1, . . ., m, of the
coordinates (VelZ < 2 m/s), the helicopter pitch angle model have to be determined by the identification ap-
(Pitch < 20) and the helicopter roll angle (Roll > 10). proach. The term ei(t) takes into account the modelling er-
Fig. 4 shows helicopter velocities in a typical experiment ror, which is due to process noise, parameter variations,
used for identification. etc.
From a practical perspective, a FDI system based on lin- The ARX model is chosen with the structure that
ear observers is easier to implement on board small auton- achieve the smallest Akaike’s Information Theoretic Crite-
omous helicopters, which usually have limited computing rion (AIC) [21], according to a simple search algorithm, in
resources. Linear observers have been used in this paper which the first half of data is used for estimation and the
for fault detection. second for cross-validation.
For FDI purposes, the estimation of the state vector is High quality flight data are essential to a successful iden-
unnecessary and only output estimation is required [3]. tification. The main concerns are the accuracy of the
Vel XY (m/s)
15
10
0
0 100 200 300 400 500 600
Vel Z (m/s)
3
2
1
0
-1
-2
-3
0 100 200 300 400 500 600
0.35
3 *T T 1.1
0.3
1.05
0.25
1
A
0.2 0.95
0.15 0.9
A
0.85
0.1
0.8
0.05 2 *T T 0.75
0
0 0.5 1 1.5 2 2.5 3 3.5 4 30 32 34 36 38 40 42
a) 3211 input signal definition. b) 3211 real input signal in a sample experiment.
Fig. 5. (a) 3211 input signal definition and (b) 3211 real input signal in a sample experiment.
estimated vehicle states and the information content of the 4.1. Fault detection using simulated helicopter data
flight data (i.e., whether the measurements contain evi-
dence of the relevant vehicle dynamics). Flight data obtained by simulation of the full non-linear
The system identification has been performed using model have been used to detect faults in all four helicopter
input–output data taken by flying the helicopter in a way actuators: main rotor collective, tail rotor collective and
to obtain evidences of the relevant vehicle dynamics. The both rolling and pitching cyclic inputs.
only realistic way to obtain these data is to perform special In Fig. 6, the results of a collective actuator fault detec-
purpose experiments with the helicopter. In these experi- tion is shown. The upper graph shows the real helicopter
ments, that were done open-loop by a human pilot, an vertical linear velocity Vz. The middle graph shows the
input sequence was used in one of the inputs of the helicop- Vz estimated by the observer. The lower graph shows the
ter, while maintaining almost constant the other inputs evolution of the calculated residual. At t = 5 s, the collec-
(these inputs were modified slightly by the pilot to maintain tive actuator gets stuck near the trim hovering value. It can
stability if needed). be seen that as a result of the collective failure, the helicop-
Input sequences that are normally used in aircraft and ter Vz remains almost constant while the Vz estimated by
helicopter identification include the doublet signal and the observer varies. This is captured by the residual evolu-
the 3211 input signal. The 3211 input sequence (shown in tion, which is below the threshold level for fault-free oper-
Fig. 5a) has been used in the identification experiments ation but exceeds the threshold value (dashed line) after the
because it has higher frequency content while still being
easily reproduced by the pilot. Fig. 5b shows the corre-
sponding real input signal generated by the human pilot
in a sample experiment. Helicopter real Vz
1
0.5
4. Actuator fault detection
0
actuator gets stuck, and therefore the collective fault can be 4.2. Fault detection using real flight helicopter data
detected.
Fault detection of the rolling cyclic actuator is presented A failure in an actuator can be potentially dangerous for
in Fig. 7. The three plots show the real helicopter linear the helicopter, because it can take the helicopter out of con-
velocity Vx, the Vx estimated by the observer and the evo- trol and it may crash. Even for experienced pilots, it could
lution of the rolling cyclic residual, respectively. At t = 5 s, be dangerous to make flight experiments with a faulty actu-
the rolling cyclic actuator gets stuck near the trim hover- ator. In order to test the FDI system of the autonomous
ing value. In this case, the detection time is larger, but helicopter in real flight conditions, some experiments were
this is due to that the cyclic input is not excited. In planned to simulate a faulty condition in an actuator while
fact, it is impossible to detect an actuator failure if the actu- maintaining security of people and the helicopter.
ator is not excited. In this experiment, the rolling cyclic In these experiments, the pilot was commanded to make
actuator is not immediately excited, but after a few tenths a flight with different movements, but at a given time, he
of a second. Once the cyclic input is excited, the residual should maintain one of the actuators almost fixed in a
goes above the threshold value, and the fault can be given position, and thus simulating a stuck actuator. These
detected. experiments were repeated in different flight conditions
(near hover, forward flight at different velocities, etc.).
Fig. 8 shows a photograph of the experiments. The video
sequences can be seen in the COMETS web site (http://
Real helicopter Vx www.comets-uavs.org).
1 After the experiments, the input data was modified. The
0.5 input signal corresponding to the ‘‘stuck’’ actuator was
0 changed, and a different input command was introduced
for that actuator. The effect of this modification is that a
-0.5
varying input signal is commanded to the helicopter, but,
-1
1 2 3 4 5 because of the stuck actuator, the actuator remains in a
fixed position, and all the sensor data correspond to this
Estimated stuck situation. This is an effective and safe way of repro-
1
ducing faulty conditions in helicopter actuators.
0.5 In Fig. 9, an example actuator fault experiment is pre-
0 sented. A stuck type fault has been reproduced in the main
-0.5 rotor collective of the MARVIN helicopter, using real
-1
flight experiment data. At t = 18 s (dashed line) the collec-
1 2 3 4 5 tive actuator gets stuck. Then the collective input com-
-5
manded by the controller cannot be followed by the
x 10 Rolling cyclic fault detection residual
actuator, which remains stuck (effective input line in
15 Fig. 9).
10 The collective residual generated by the FDI system can
5 be seen in Fig. 10. It can be seen that the residual is below
0 the threshold level (horizontal dashed line) for normal
fault-free operation. But, when the actuator gets stuck (ver-
1 2 3 4 5
Time tical dashed line), the residual goes above the threshold
level, and therefore, a collective actuator fault has been
Fig. 7. Rolling cyclic fault detection (non-linear mathematical model). detected.
2.5 y y1
2
Commanded input u y2
1.5 UAV ..
ym
1
0.5
0
Observer 1 r1
-0.5
-1
-1.5 FAULT
Effective input r2
Observer 2 DIAGNOSIS
-2
0 5 10 15 20
..
Fig. 9. MARVIN main rotor collective actuator failure.
Observer m
rm
0.1
Fig. 11. Bank of estimators for output residual generation.
0.08
tification is straightforward: each residual is only sensitive
to a single helicopter sensor. If the residual k goes above
0.06
the threshold level, a fault has been detected in sensor k.
The sensor FDI system has been implemented with the
0.04 above structure using ARX input–output models. The
results are presented in the following subsections.
0.02
5.2. Sensor failure types
0
0 5 10 15 20
In this section, the results of helicopter sensor FDI sys-
Fig. 10. Time evolution of the collective residual. tem using linear ARX output estimators are presented. All
the experiments have been done using real helicopter flight
data. Flight data were recorded from several experiments
5. Sensor fault detection carried out at the Lousá (Portugal) airfield during the gen-
eral experiments of the COMETS project. These experi-
5.1. Sensor fault detection structure ments were performed in spring with temperatures
around 20 C and low wind conditions.
The helicopter sensor FDI subsystem performs the tasks Sensors used in autonomous helicopters can fail in sev-
of failure detection and identification by continuously eral ways. Some failure types are general for various sen-
monitoring the outputs of the sensors. Under nominal con- sors, while others are specific of a single sensor. The
ditions, these measurements follow predictable patterns, failure types that have been considered in this work are
within a tolerance determined by the amount of uncertain- the following:
ties introduced by random system disturbances and mea-
surement noise in the sensors. Usually, sensor FDI tasks • Total sensor failure. This is a catastrophic failure, at a
are accomplished by observing when the output of a failed given time the sensor stops working and gives a constant
sensor deviates from its predicted pattern. zero output after that. This failure can be due to electri-
For detection of faults in the helicopter sensors, a bank cal or communication problems.
of output estimators has been implemented as showed in • Stuck with constant bias sensor failure. In this failure
Fig. 11. This type of diagnosis system is usually called type, at a given time the sensor gets stuck with a con-
the dedicated observer scheme [23]. The number of these stant bias, and the output remains constant.
observers is equal to the number of system outputs. Thus, • Drift or additive-type sensor failure. This is a very com-
each device is driven by a single output and all the inputs of mon failure in analog sensors. Due to internal tempera-
the system. In this case a fault on the ith output sensor ture changes or calibration problems, the sensor output
affects only the residual function of the output observer has an added constant term (the drift).
or filter driven by the ith output. Therefore sensor faults • Multiplicative-type sensor failure. In this failure type, a
can be isolated by analyzing the pattern of zero and non- multiplicative factor is applied to the sensor nominal
zero residuals. value.
A residual is generated for each sensor, comparing the • Outlier data sensor failure. This is a failure that appears
estimator output with the sensor output. Each residual is sometimes in GPS sensors. It is a temporal failure: a sin-
not affected by the other sensors, and therefore fault iden- gle point with a large error is given by the GPS sensor,
G. Heredia et al. / Mechatronics 18 (2008) 90–99 97
but after that, the following measurements are correct. 5.4. Additive-type sensor failure detection
This is supposed to be caused by failures in the GPS
internal signal processing algorithms. Figs. 13 and 14 show the results of the fault detection of
additive faults in gyro-z sensor output. In Fig. 13, a 3.5/s
The MARVIN helicopter has 12 individual sensors: drift has been added, and the residual detects the fault very
three gyroscopes, three accelerometers, three components fast. In Fig. 14, a 1.75/s drift has been added to the sensor
of the magnetic sensor and the three GPS coordinates. output at t = 18 s.
Since there are too many possible combinations of sensors A detectability study has also been done with the addi-
and failure types, only a few representative cases will be tive type sensor failure. Two cases have been considered:
described in detail in this section. a drift of 50% of the maximum sensor value, which results
The z component of the gyroscope angular velocity sen- are presented in Table 1, and a drift of 10% of the maxi-
sor will be used as representative case of sensor failure mum sensor value, which results are presented in Table 2.
detection for the first four failure types presented (total sen- The results presented in Table 1 show that a drift 50% of
sor failure, stuck with constant bias, additive type and mul- maximum sensor value can be detected reliably in all the
tiplicative type). The z component of the GPS sensor will experiments. It can be noticed that the detection time is
be used for the fifth failure type (outlier data), since it is very short. The detection time means the time between
a specific failure of GPS sensors. the first erroneous measurement and the failure detection,
For some failure types, a sensor failure detectability excluding the processing time.
study for all 12 MARVIN sensors has been conducted.
Sensor failures have been studied in nine different helicop-
ter experiments, using real MARVIN flight data. The 20
Gyro-z (deg/sec)
results have been summarized in tables, including the detec- 10
tion time.
0
-20
The sensor fault has been reproduced using real flight 0 5 10 15 20 25 30 35
data. In this case, the gyro-z sensor output gets stuck with
the last output value before the fault was produced. In 2000
Gyro-z residual
20
20
Gyro-z (deg/sec)
Gyro-z (deg/sec)
10 10
0 0
-10 -10
-20 -20
0 5 10 15 20 25 30 35 0 5 10 15 20 25 30 35
2000 2000
Gyro-z residual
Gyro-z residual
1500 1500
1000 1000
500 500
0 0
0 5 10 15 20 25 30 35 0 5 10 15 20 25 30 35
t (sec) t (sec)
Fig. 12. Stuck with constant bias gyro-z failure detection. Fig. 14. Additive gyro-z sensor failure detection (drift of +1.75/s).
98 G. Heredia et al. / Mechatronics 18 (2008) 90–99
Table 1
Sensor fault detection with drift of 50% of maximum sensor value
GPS ACCEL MAG GYRO
X Y Z X Y Z X Y Z X Y Z
Mean detection time 0.00 0.00 0.00 0.00 0.00 0.09 0.09 0.00 0.00 0.12 0.00 0.00
Undetected faults 0 0 0 0 0 0 0 0 0 0 0 0
False alarms 0 0 0 0 0 0 0 0 0 0 0 0
Table 2
Sensor fault detection with drift of 10% of maximum sensor value
GPS ACCEL MAG GYRO
X Y Z X Y Z X Y Z X Y Z
Mean detection time 0.15 3.67 0.00 0.75 2.42 0.75 0.14 0.00 0.00 0.75 3.25 0.90
Undetected faults 0 0 0 0 0 1 0 0 0 2 2 1
False alarms 0 0 0 2 0 3 3 0 0 0 1 0
0.1 Acknowledgements
GPS-z residual
0.08
0.06 This work has been carried out in the framework of the
AWARE (European Commission, IST-2006-33579) and
0.04
COMETS (European Commission, IST-2001-34304) Euro-
0.02
pean Projects, and the AEROSENS (DPI2005-02293)
0 Spanish National Research Project. The authors give
0 5 10 15 20 25 special thanks to V. Remuss, C. Deeg and G. Hommel
t (sec)
from Technical University of Berlin (TUB-Germany) for
Fig. 15. Outlier data GPS-z sensor failure detection using ARX output help in collecting experimental data, as well the other mem-
estimator (1 m). bers of COMETS partners.
G. Heredia et al. / Mechatronics 18 (2008) 90–99 99