Professional Documents
Culture Documents
Chen2013 PDF
Chen2013 PDF
INTRODUCTION
Path planning for multiple unmanned air vehicles
(UAVs) to cooperatively track ground targets is an
UAV Path Planning with important research topic with approaches varying from
Tangent-plus-Lyapunov Vector classical optimal trajectory planning to bio-inspired
swarm behavior [1—4]. There are many complex
Field Guidance and Obstacle factors involved in creating a realistic path, such as
obstacles, threats, the presence of multiple UAVs,
Avoidance uncertainty in the environment, and multiple tasks
per UAV. The path-planning problem for a UAV
tracking a ground target was typically formulated
as an optimal control problem [5—9], consisting of a
HONGDA CHEN system dynamic, a set of boundary conditions, control
KUOCHU CHANG
George Mason University constraints, and an object function. Traditionally,
the objective function can be expressed as the cost
CRAIG S. AGATE
Toyon Research Corporation associated with the UAV state trajectory along
the path from a UAV’s initial state to a desired
state. The objective function is to be minimized
A dynamic path-planning algorithm is proposed for routing in order to produce an optimal control solution.
unmanned air vehicles (UAVs) in order to track ground targets However, the overall costs will be UAV dependent
under path constraints, wind effects, and obstacle avoidance and could include factors such as power (battery, gas)
requirements. We first present the tangent vector field guidance consumption, communication, mission scheduling with
(TVFG) and the Lyapunov vector field guidance (LVFG)
multiple UAVs, and so on. Past approaches include
algorithms. We demonstrate that the TVFG outperforms the
nonlinear programming [10—12], optimization and
LVFG as long as a tangent line is available between the UAV’s
stochastic sampling [13—14], search methods [15—19],
turning circle and an objective circle, which is a desired orbit
pattern over a target. Based on a hybrid version of the TVFG
and evolution based approaches [20—21].
and LVFG, we then derive a theoretically shortest path algorithm
Assuming that each UAV has the resources to
with UAV operational constraints given a target position and the complete its tracking assignment, the cost function
current UAV dynamic state. This algorithm has the efficiency of could be dramatically simplified. In this paper the
the TVFG when UAV is outside the standoff circle and the ability only physical limitations we consider are a UAV’s
to follow the path via the LVFG when inside the standoff circle. maximum turn rate and a nominal cruising speed.
In addition we adopt point-mass approximation of the target state Consequently, the simplified objective considered
probability density function (pdf) for target motion prediction here is to minimize the UAV’s flight path length, such
by exploiting road network information and target dynamics that given a UAV’s initial state and a desired final
as well as obstacle avoidance strategies. Overall, the proposed state, the objective is to find the shortest trajectory
technical approach is practical and competitive, supported by between them with possible constraints. The focus
solid theoretical analysis on several aspects of the algorithm of the paper is to develop a dynamic path-planning
performance. With extensive simulations we show that the
algorithm for routing UAVs to track ground targets
tangent-plus-Lyapunov vector field guidance (T+LVFG) algorithm
under path constraints, wind effects, and obstacle
provides effective and robust tracking performance in various
avoidance requirements.
scenarios, including a target moving according to waypoints or
a random kinematics model in an environment that may include
In the case of obstacle-free environments, the
obstacles and/or winds. control solution of the objective generally is a set
of UAV waypoints and speeds passed to a UAV
Manuscript received March 18, 2011; revised October 7, 2011, and autopilot system (AP) for low-level control [22—23].
January 27 and March 29, 2012; released for publication June 14, Past approaches for trajectory planning include the
2012. map-based approach [24—25], target-based approach
IEEE Log No. T-AES/49/2/944504. with possible coordination between multiple UAVs
Refereeing of this contribution was handled by W. Koch.
[26—29], and coordinated planning under potential
uncertain environments [30—32]. Considering UAV’s
Authors’ current addresses: H. Chen, Sigma Space Corporation, limitations of turning rate and speed constraints, an
4600 Forbes Blvd., Lanham, MD 20706; K. Chang, Department
of Systems Engineering and Operations Research, George Mason accurate UAV motion model is required to insure that
University, MS 4A6, 4400 University Dr., Fairfax, VA 22030, its AP can reach the waypoints. The shortest path
E-mail: (kchang@gmu.edu); C. S. Agate, Algorithms R&D, Toyon involves flying a constant turning rate path. If we
Research Corporation, Goleta, CA 93117. consider varying the UAV speed, a shorter distance
solution is available such that UAV initially slows to
0018-9251/13/$26.00 °
c 2013 IEEE achieve maximum turning rate, then accelerates along
840 IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS VOL. 49, NO. 2 APRIL 2013
tangent line. Finally, UAV decelerates on final circle The rest of this paper is organized as follows. In
to achieve desired velocity. Section II the model and solution methodology of
In reality often there are obstacles or constraints UAV flight guidance used to create the path plans
such as a no-flight zone to restrict UAV flight path in the search of an uncertain, dynamic, and windy
[33—37]. Vision-based navigation and guidance environment [42] is reviewed. T+LVFG is described
strategy for collision avoidance are traditionally in detail. Section III introduces the particle approach
used in the literature [44—48]. In this paper we for target motion prediction to maximize target
develop a novel UAV routing algorithm with an detection probability. Target-location particles and
obstacle avoidance strategy. The algorithm combines how they are utilized in the stochastic simulations
the tangent vector field guidance (TVFG) [38] are discussed. The calculation of UAV coverage
path-planning approach with the Lyapunov vector probabilities is derived analytically. In Section IV
field guidance (LVFG) algorithm [39—41] to obtain obstacle avoidance strategies are presented and
a theoretically shortest path with UAV operational analyzed. Section V gives a set of demonstrations
constraints given a target position and the current to validate the techniques in multiple different
UAV dynamic state. This hybrid algorithm, called environments. Finally, Section VI concludes the
tangent-plus-Lyapunov vector field guidance paper.
(T+LVFG), has the advantage of the TVFG when
UAV is outside the standoff circle and presents the II. UAV FLIGHT GUIDANCE
ability to follow the path via the LVFG when inside The UAV autopilot system is developed
the standoff circle. to accomplish more complex tasks, operate in
Given the assumption that the UAV has been given uncertain and dynamic environments, and eventually
the initial state (position/velocity) information about allow integration with other UAVs to accomplish
the target of interest and that the UAV could observe coordinated missions. Its command signal is produced
the latest target state information with its own sensor by the guidance system with respect to UAV state
in a tracking stage, we first determine the approximate
variables. The algorithms presented here assume that
location of target at intercept time. Then, a desired
the UAV is equipped with a low-level control system
UAV state (at the planning horizon time) is chosen
so that vector field guidance indications can present a
based on three factors: 1) UAV position is located on
kinematic model to the guidance layer.
the circle of a predefined radius about target; 2) UAV
In an obstacle-free environment the dynamic
speed is selected based on the target speed (matched
path-planning algorithm requires the following
if possible); and 3) UAV heading is the same to the
information about the system state: 1) the predicted
target. Usually, the estimated intercept location is
target state, 2) the current UAV state, and 3) the
less accurate when UAV is farther away. However,
desired UAV state. Specifically, a two-dimensional
the replanning interval is normally shorter than the
(2D) position and velocity target state is defined by
planning horizon so that accuracy of prediction
[xt , x_ t , yt , y_ t ]; the UAV inertial state is [xu , x_ u , yu , y_ u ]; the
improves as UAV approaches target. Moreover,
considering target location uncertainty or probability relative state of the UAV to the target is [xr , x_ r , yr , y_ r ];
of detecting target at a desired location, we propose and the desired UAV state is [xd , x_ d , yd , y_ d ]. It is
to use a particle filter to predict target location necessary to mention that all state vectors are time
probability density function (pdf). A point-mass dependent, however, the time variable (t) is not
approximation of the target state pdf is stochastically presented for simplicity. In practice the UAV inertial
simulated using a ground vehicle motion model that state at any time step is known, and the target state
exploits road network and other information. Once we is estimated from collected sensor data. The desired
generate a predicted target state pdf, we determine UAV state is given by the following conditions: 1) the
an “optimal” UAV location that maximizes the UAV is positioned on a circle of fixed radius around
probability of detecting the target. When obstacles or the estimated target location; 2) the UAV’s heading is
constraints are present to restrict the UAV flight path, equal to the target’s heading; and 3) the UAV’s speed
we model the obstacles as a circular region similar to is equal to the target’s speed unless the target speed
the standoff circles. The obstacle avoidance strategy is is less than the UAV’s minimal speed; in which case,
then developed by considering the path with obstacles the UAV’s speed is set to its minimum. The UAV’s
and determining the best path to go around them with desired state is, therefore, dependent on the target state
the similar TVFG concept mentioned earlier. Overall, and can be determined through different approaches.
the main contribution of this research is the newly For example, in the left diagram of Fig. 1,
proposed path-planning method, which is able to UAV starts at point “A” with initial velocity v1 =
provide a shortest path for a UAV tracking a target, to [x_ u (t1 ), y_ u (t1 )] and ends at desired endpoint “G” with
utilize particle filters for target motion predictions and velocity v2 = [x_ d (t2 ), y_ d (t2 )]. It is obvious that the size
to avoid identified obstacles in generating the optimal of a UAV’s turning circle depends on its speed. The
paths. optimal path (minimal traveling distance) follows A !
CHEN, ET AL.: UAV PATH PLANNING WITH TANGENT-PLUS-LYAPUNOV VECTOR FIELD GUIDANCE 841
Fig. 1. UAV path planning (L) and selected path (R).
842 IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS VOL. 49, NO. 2 APRIL 2013
target [xt , yt ]T with velocity [x_ t , y_ t ]T , the UAV model
may be simply modified as
x_ r = V ¢ cos μ + Wx ¡ x_ t (7)
y_ r = V ¢ sin μ + Wy ¡ y_ t (8)
where Wx and Wy are the components of the
background (horizontal and vertical) wind velocity.
To compare the performance of the two guidance
laws in a more rigorous manner, we introduce distance
and time efficiency measures to evaluate the UAV
path-planning efficiency. The distance between
UAV and target is denoted as “d.” The relative UAV
heading direction to the target is denoted ½, and ®
is the relative direction of Wind. The distance and
time efficiency are then defined as Dx =d and Tx V̄=d,
respectively. Here, Dx denotes the UAV total flight
Fig. 3. Clockwise TVFG with Rt = 30 m.
distance to the objective circle, and Tx is the total time
used to travel to the objective circle. V̄ is the average
speed of UAV. Notice that, in the case of a UAV
such that with constant speed, the time efficiency and distance
q efficiency are equivalent.
Rc2 Rc
x1,2 = (x ¡ x ) ¨ (y ¡ y ) ru2 ¡ Rc2 + xc Figure 4 plots two example trajectories when ½ = 0
ru2 u c
ru2 u c
CHEN, ET AL.: UAV PATH PLANNING WITH TANGENT-PLUS-LYAPUNOV VECTOR FIELD GUIDANCE 843
Fig. 5. Efficiency performances of LVFG and TVFG.
844 IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS VOL. 49, NO. 2 APRIL 2013
Fig. 7. Geometry illustration for two angle calculations.
Fig. 6. (a) Objective bias using T+LVFG with UAV speed 1) In case of Rc ¸ Rt we have
14 m/s. (b) Objective bias using LVFG with UAV speed 14 m/s. 8 s1 p
>
< ¼R 2 , if d0 ¸ Rc2 ¡ Rt2
t
Pr = : (13)
assumed to be ® and ¯, respectively. Then, at the : 1 ¡ s2 ,
> otherwise
next time step, the UAV and target positions can be ¼Rt2
expressed as 2) In case of Rc < Rt we have
xu = x̄u + ¢Vu cos ® 8 s p
> 1
(9) > , if d0 ¸ Rt2 ¡ Rc2
< ¼Rt2
yu = ȳu + ¢Vu sin ®
Pr = (14)
>
> R2 s
xt = x̄t + ¢Vt cos ¯ : c2 + 2 2 , otherwise
: (10) Rt ¼Rt
yt = ȳt + ¢Vt sin ¯
where s1 ´ 12 [μ2 ¡ sin(μ2 )]Rt2 + 12 [μ1 ¡ sin(μ1 )]Rc2 and
The radius of the UAV’s coverage is denoted to be Rc , s2 ´ 12 [μ2 ¡ sin(μ2 )]Rt2 ¡ 12 [μ1 ¡ sin(μ1 )]Rc2 .
and target uncertainty radius (say, 3-sigma boundary)
is Rt . The intersection points of the two circles may be B. General Coverage Probabilities
found from the solutions of the following equations,
In practice, due to the road and/or turning angle
(x ¡ xu ) + (y ¡ yu ) = Rc2
2 2 limitations, a UAV or a target cannot move freely to
(11) anywhere in their reachable circles and, therefore,
(x ¡ xt )2 + (y ¡ yt )2 = Rt2 :
the circular representation of the target’s location
Obviously, in the case of no real solution from (11), uncertainty is insufficient. Our objective for choosing
the coverage probability is either one or zero, which a desired UAV location is to maximize the probability
CHEN, ET AL.: UAV PATH PLANNING WITH TANGENT-PLUS-LYAPUNOV VECTOR FIELD GUIDANCE 845
of detection. Since the target’s state is not known Based on the UAV’s FOV radius, the coverage
with certainty, we can only calculate the expected probabilities can then be estimated as a ratio of the
probability of detection number of particles inside the UAV’s FOV over the
Z total number of particles
EfPd g = D(x)p(x)dx (15)
−s 1X
Pr(j) = ±[dP!C (i, j) · RC ]: (17)
where −s presents the sensor FOV, p(x) is the pdf of N
i
the target state, and D(x) represents a function that
To determine the most desirable UAV destination
maps the target state into a probability of detection.
objective based on (16) and (17), we must sample
Note that p(x) is obtained by extrapolating the
the set of reachable UAV states in order to render
target’s kinematic state based on road network
information. The idea is to use a digital road map to the number of potential locations to consider into a
constrain the possible target locations. Monte Carlo finite number. To select the destination candidates, one
samples (particles) can be generated to describe simple idea is to define them uniformly in the UAV
possible target states, and the integration part of (15) reachable region based on maximum and minimum
can be approximated by counting the number of UAV speeds.
particles in the respective areas.
IV. OBSTACLE AVOIDANCE
C. Coverage Rate with Particles In an operational environment often there are
As mentioned in the previous section, we apply obstacles or constraints, such as no-flight zone or
particles to simulate possible target locations at the tall buildings, to restrict the UAV flight path. The
next time step in order to obtain a UAV’s desired information about the existence of the obstacles is
location. As described in the Introduction, it is either known in advance (e.g., buildings) or acquired
assumed that the UAV has been given the initial during flight (e.g., collision avoidance with other
state (position/velocity) information about the target aircraft). In most real scenarios more than one
of interest; and in a tracking stage, the UAV could obstacle might appear, so multiple obstacles are
observe the latest target state information with its considered.
own sensor. We further assume that digital road We assume that the UAV is capable of receiving
map information is available and that initial target obstacle information at any path-planning cycle
information is available from at least one of the by either its own sensors or road map indications.
resources (ground moving target indicator (GMTI) or Without loss of generality obstacles are modeled
otherwise). After initialization the UAV must track the as circles determined by their center position and
target using only sensor data collected by the UAV’s radius. Other shapes may be treated in a conservative
onboard sensor. If the UAV cannot acquire the target manner by inscribing them in a larger circle, which
on its own after the initial assignment, then it is highly thereby permits the obstacle avoidance problem to
likely that it will never track the target. In that case a be formulated in terms of a simplified model of
separate initialization/reassignment process is needed. turning circles similar to the shortest path algorithm
The initial pdf of a target state is generally given described earlier. The obstacle avoidance problem is,
based on the assumption that the target is following then, interpreted as the shortest path selection among
the roads in a given map, and its velocities are all possible paths. Specifically, we first determine
uniformly distributed between maximal and minimal the closest obstacle for the UAV to move around
speed limits. Thus, particles will be randomly drawn by using a straight line to link the UAV and the
from this pdf. These particles are used to predict destination circle about the target. Then, we start from
the target state forward in time based on the road
this obstacle to locate the next possible obstacle, if
network.
any, between the target and current obstacle circle.
The desired UAV destination objective is a
By this recursive process all the possible paths and
reachable position for the UAV within a given
corresponding distances can be calculated to obtain a
planning cycle that maximizes the probability of
practical solution with the shortest distance.
detecting the target, which amounts to the UAV
More specifically, during a path-planning cycle,
location such that the maximum number of particles
assume L obstacle circles (no flight zones) appear
is within the UAV’s FOV. Euclidean distances
unexpectedly. These obstacle circle parameters are
can be used to compare the destination objectives.
Specifically, by assuming that there are N particles assumed to be available, i.e., center coordinates
fPi (x, y)g and M candidate objectives fCj (x, y)g, we (xo[i] , yo[i] ) and radius Ro[i] . For simplicity the obstacle
have the distance between particle i and candidate circles are assumed to be nonoverlapping in this
objective j, namely paper. The intersection points of the obstacle circles
and the path-line between the UAV and the target
dP!C (i, j) = jPi (x, y) ¡ Cj (x, y)j: (16) may be found from the solutions of the following
846 IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS VOL. 49, NO. 2 APRIL 2013
equations
CHEN, ET AL.: UAV PATH PLANNING WITH TANGENT-PLUS-LYAPUNOV VECTOR FIELD GUIDANCE 847
Fig. 9. T+LVFG tracking performance in four different scenarios. (a) T+LVFG tracking: Target with random-moving model.
(b) T+LVFG tracking with winds: Target with random-moving model. (c) T+LVFG tracking: Target with speed-waypoint model.
(d) T+LVFG tracking with winds: Target with time-waypoint model.
200, y0t = 100] m with an initial speed of 5 m/s and T+LVFG algorithm provides an efficient and effective
a heading angle of ¡45 deg. The target maximal solution in each of the scenarios.
speed is 12 m/s, and the state process noise standard To demonstrate the robustness of the T+LVFG
deviation is 0.1 m/s. In addition a constant wind of algorithm under wind conditions, we now consider
strength 5.0 m/s and an angle of 45 deg is present a case in which the UAV tracks a stationary target.
in scenarios (b) and (d). In the speed-based model Suppose that a UAV’s relative-angle to the target
the target has a constant speed in each line space is ¼, turn-limit is 30 deg/s with a speed of 14 m/s.
(road section). Specifically, the moving segments Figure 10 plots the UAV and target trajectories
are defined as pt (t0 ) ) pt (t1 ) ) pt (t2 ) ) pt (t3 ) ) in different wind environments. In Fig. 10(a) the
pt (t4 ) ) pt (t5 ), where the target positions are located trajectories using LVFG and T+LVFG under a wind
at [¡100, ¡120] m, [¡50, ¡20] m, [10, 0] m, condition of ½w = 1:0 m/s and μw = ¡¼=4 are given.
[¡50, 102] m, [¡110, 150] m, and [¡300, 200] m, While in this case the T+LVFG yields similar paths
and the target speeds are 10 m/s, 8 m/s, 7 m/s, 2 m/s, with or without the presence of wind, the LVFG
15 m/s, 12 m/s, and 14 m/s, respectively. In the alone does not perform very well. In Fig. 10(b)
time-based model the target arrives to these denoted the wind strength is increased to ½w = 2:0 m/s and
points at times of 0 s, 8 s, 18 s, 37 s, 52 s, and 68 s the heading angle is ¡¼=4. Notice that, while the
then stops at the final position. Results show that the T+LVFG algorithm has a slightly distorted path along
848 IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS VOL. 49, NO. 2 APRIL 2013
Fig. 10. Performance comparison with different wind scenarios. The relative-angle of UAV and target is ¼, UAV with v = 14 m/s and
turn-limit W = ¼=6. (a) Constant winds: strength ½ = 1:0 m/s and angle μw = ¡¼=4. (b) Constant winds: strength ½ = 2:0 m/s and angle
μw = ¡¼=4. (c) Constant winds: strength ½ = 13:0 m/s and angle μw = ¡¼=4. (d) Constant winds: strength ½ = 14:0 m/s and angle
μw = ¡¼=4.
the objective circle, the LVFG could not keep up as in the case of tracking a stationary target. Figure 11
with the target in these mild wind cases. As shown shows the tracking results for a moving target with
in Fig. 10(c), at a high wind speed of 13.0 m/s, and without winds. In Fig. 11(a) the moving target
the T+LVFG algorithm struggles but manages to has a constant velocity of 5 m/s, starts from (0, 0), and
eventually locate the target within the FOV, though moves along a direction angle of μt = ¼=10. Since the
the trajectory fails to accurately follow the objective UAV is much faster than the target, both algorithms
circle. Unfortunately, when the wind speed is the
demonstrate that the UAVs are circling along the
same or higher than the UAV’s speed, the UAV
target trajectory. However, the T+LVFG algorithm
cannot compensate for the wind and, therefore, cannot
provides closer and more efficient tracks than the
reach the objective circle as expected. A simulation
example with the wind speed equal to the UAV speed LVFG. In Fig. 11(b) we consider a faster target with
limit of 14 m/s is shown in Fig. 10(d) in which both a constant velocity of 12 m/s. The target starts from
algorithms diverge. (0, 0) and heads east. Again, the path corresponding
Next, we apply the newly proposed T+LVFG to the T+LVFG algorithm is generally closer to
algorithm for a UAV that tracks a moving target under the target. In Figs. 11(c) and (d), winds are added
windy conditions. The UAV has the same parameters with a speed of 2 m/s and 13 m/s, respectively. The
CHEN, ET AL.: UAV PATH PLANNING WITH TANGENT-PLUS-LYAPUNOV VECTOR FIELD GUIDANCE 849
Fig. 11. Performance comparison for a moving target in different wind conditions. (a) Without winds, Target speed is 5 m/s, and UAV
speed is 14 m/s. (b) Without winds, Target speed is 12 m/s, and UAV speed is 14 m/s. (c) Constant winds (½ = 2 m/s, μw = ¡¼=4),
Target speed is 5 m/s, and UAV speed is 14 m/s. (d) Constant winds (½ = 13 m/s, μw = ¡¼=4), Target speed is 5 m/s, and the UAV
speed is 14 m/s.
T+LVFG algorithm works well, but the LVFG alone are defined as Obstacle-1 centered at [10, 40] m with a
fails in both cases. radius of 45 m, Obstacle-2 centered at [110, 30] m and
Figure 12 illustrates simulation results using a radius 50 m, and Obstacle-3 centered at [68, 140] m
point-mass approximation of the target predicted and radius 50 m. On the left of Fig. 13, the initial
pdf and choosing a desired UAV location based on position of UAV is fixed at [¡160, ¡140] m, and
maximizing the probability of detecting the target. a heading of 50 deg. A target is following a road
The two plots show the corresponding tracking results map. The optimal paths are plotted for different
via the particle simulation strategy. In each planning hypothetical target positions, where obstacles are
step we generate 100 particles for the predicted successfully avoided in each planned path. On the
target location and select 50 destination candidates right of Fig. 13, the same obstacles are presented with
uniformly in the UAV’s reachable region. At each a specific target trajectory. A target is moving with
planning cycle we select the UAV destination based a kinematic model in 2D free space [8]. The initial
on maximizing the probability of detecting the target. target position is assumed to be [x0t = ¡200, y0t =
Finally, we evaluate the obstacle-avoidance 100] m with an initial speed of 5 m/s and a heading
strategies in the dynamic path-planning algorithm. of ¡45 deg. The target’s maximal speed is 12 m/s,
Suppose that there are three obstacles in a and the state process noise standard deviation is
path-planning environment. The simulated obstacles 0.1 m/s. The UAV is initially located at [500, 200] m
850 IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS VOL. 49, NO. 2 APRIL 2013
with velocity [14, 0] m/s and heading of 90 deg. The
results show that the UAV is able to track the target
successfully while avoiding the obstacles.
VI. CONCLUSIONS
In this paper we have proposed a dynamic UAV
path-planning algorithm for tracking a ground target.
The algorithm is characterized by a combination of
TVFG and LVFG, a point-mass approximation of the
target state pdf, and obstacle avoidance strategies. The
key advantages of the proposed method are the ability
to find the shortest path for a UAV tracking target,
to utilize particle filters for target motion predictions
for the case in which road network information is
available, and to avoid identified obstacles in the
path generations. Theoretical analysis shows that the
T+LVFG algorithm outperforms the LVFG alone
whenever the tangent lines are available between the
UAV’s turning limit circle and an objective circle. The
steady-state objective biases of both the T+LVFG and
LVFG algorithms are formally derived, as well as the
coverage probability calculations. The fact that tangent
lines and particle filters are combined to generate path
candidates for UAV tracking makes this approach very
effective. The proposed solution methodology can
be easily embedded in a mission-planning strategy.
This dynamic path planning uses fixed-increment
time advance, which fits well with any heuristic
solution algorithms. Simulation results demonstrate
the efficiency and robustness of the new algorithm
as a UAV tracks a target in a variety of different
experimental scenarios, including different target
moving models, wind environments, preknown road
maps, and multiple obstacles along the way. Future
Fig. 12. (a) Map-1: Tracking results with road constraints. work will focus on a collaboration of multiple UAVs
(b) Map-2: Tracking results with road constraints. in a multiple target environment.
Fig. 13. Path planning and tracking results with the obstacle avoidance strategy.
CHEN, ET AL.: UAV PATH PLANNING WITH TANGENT-PLUS-LYAPUNOV VECTOR FIELD GUIDANCE 851
APPENDIX I
PROOF OF PROPOSITION 1
Without loss of generality, we assume that a target
is located at [0, 0], the radius of an objective circle
is Rt , and a UAV position is given by [xr , yr ]. As
long as the tangent lines are available between the
UAV’s turning limit circle and the objective circle,
TVFG follows tangent lines to the standoff circle.
Thus, the minimal distance between the target and
the TVFG guidance line is always a constant of Rt . Fig. 14. Illustration diagram for TVFG objective bias.
Next we show that the minimal distance between
the target and the LVFG guidance line is larger Figure 14 illustrates a UAV that passes through
than Rt and that it depends on the location of the an objective circle via TVFG. A target is located at
UAV. “O,” and the radius of the objective circle is R = Rt .
Based onpthe LVFG (2, 3), at the UAV position Assume that the UAV’s current position is “A” and
[xr , yr ], r = xr2 + yr2 , two possible directional lines are that it will be moving along the tangent line “A ! B”
either clockwise as with the tangent point “C.” If a planning cycle time
is ¢ seconds and if the points “A, B” are associated
¡2rRt xr + (r2 ¡ Rt2 )yr with two consequent planning cycles, then we have
y ¡ yr = (x ¡ xr ) (19)
(r2 ¡ Rt2 )xr + 2rRt yr
jABj = jACj + jCBj
or counterclockwise as
= a1 + a2
2rR x + (r2 ¡ Rt2 )yr
y ¡ yr = 2 t r 2 (x ¡ xr ): (20) = V̄¢ (22)
(r ¡ Rt )xr ¡ 2rRt yr
Since the minimal distance between any 2D where V̄ denotes UAV’s speed. Therefore, the distance
from the two planning cycles (A,B) to the target is
coordinates [x0 , y0 ] to a line Ax + By + C = 0
q
is given by jAx0 + By0 + Cj ¢ (A2 + B 2 )¡1=2 , the x1 = Rt2 + a21 ¡ Rt (23)
minimal distance of the target to LVFG lines can be
q
expressed as
x2 = Rt2 + a22 ¡ Rt : (24)
¨2rR x + (r2 ¡ Rt2 )yr
yr ¡ 2 t r2 x For the linear tangent line, the averaged difference is
(r ¡ Rt )xr § 2rRt yr r
dmin = s· ¸2 given by
¨2rRt xr + (r2 ¡ Rt2 )yr ±TVFG = 12 x1 + 12 x2 : (25)
+1
(r2 ¡ Rt2 )xr § 2rRt yr Therefore, the maximal objective bias will be obtained
2r(xr2 + yr2 )Rt when x1 = x2 , such that
=p q
(xr2 + yr2 )(r2 + Rt2 )2 ¤
±TVFG = 12 4Rt2 + V̄2 ¢2 ¡ Rt : (26)
2r2
= R: (21) Now, we consider the case of LVFG alone. Since
r2 + Rt2 t clockwise LVFG and counterclockwise LVFG are
Since tangent lines are available, it implies r > Rt . symmetric, we only show the clockwise LVFG
without loss of generality. Assume that a target is
Therefore, from (21), we have dmin > Rt , and the
located at (0, 0), andq
that the LVFG trajectory is given
minimal distance depends on the UAV position [xr , yr ].
If the UAV is far away from the target (i.e., r À Rt ), by fxi , yi g with ri = xi2 + yi2 ; i = 1, 2, : : :. Based on the
this distance could be twice the radius of the objective clockwise LVFG (2), the (k + 1)th trajectory point can
circle. be derived from the kth one, such that
· ¸ · ¸ · ¸
xk+1 xk x_ k
APPENDIX II = + ¢¢
yk+1 yk y_ k
PROOF OF PROPOSITION 2 · ¸ · ¸
xk xk
First, we show the result for T+LVFG. Since the = ¡ ¸¢Hk
guidance law when a UAV is within an objective yk yk
circle is the same for T+LVFG and LVFG alone, we · ¸· ¸
1 ¡ ¸¢(rk ¡ Rt2 )
2
2¸¢rk Rt xk
compare T+LVFG and LVFG only when the UAV = 2 2
¡2¸¢rk Rt 1 ¡ ¸¢(rk ¡ Rt ) yk
starts outside the objective circle and attempts to
approach and fly along it. (27)
852 IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS VOL. 49, NO. 2 APRIL 2013
where · ¸ [3] Ferng, C., et al.
ri2 ¡ Rt2 2ri Rt Distributed simulation of forward reachable set-based
Hi = : (28) control for multiple pursuer UAVs.
¡2ri Rt ri2 ¡ Rt2 Proceedings of the SimTecT 2006 Simulation Conference
and Exhibition, Melbourne, Australia, May 29—June 1,
The squared distance from UAV to the target can be 2006.
recursively expressed as
[4] Ma, G., Duan, H., and Liu, S.
· ¸T · ¸ Improved ant colony algorithm for global optimal
2
xk+1 xk+1 trajectory planning of UAV under complex environment.
rk+1 =
yk+1 yk+1 International Journal of Computer Science and
Applications, 4, 3 (2007), 57—68.
= [1 ¡ ¸k ¢(rk2 ¡ Rt2 )]2 rk2 + 4¸2k ¢2 Rt2 rk4 : (29) [5] Winstrand, M.
Mission planning and control of multiple UAVs.
The nominal speed of the UAV can be computed from Swedish Defence Research Agency, Scientific Report,
2D vectors, namely 1650—1942, Oct. 2004.
s· ¸ · ¸ [6] Rathinam, S., et al.
x_ i T x_ i An architecture for UAV team control.
V̄ = Proceedings of the 5th IFAC Conference on Intelligent
y_ i y_ i Autonomous Vehicles, Lisbon, Portugal, July 5—7, 2004.
s· ¸ · ¸ [7] Wise, R.
xi T T xi
= ¸i Hi Hi UAV control and guidance for autonomous cooperative
yi yi tracking of a moving target.
Ph.D. research proposal, Dept. of Aeronautics and
= ¸i (ri2 + Rt2 )ri : (30) Astronautics, University of Washington, Seattle, WA,
June 2006.
The normalization factor can then be determined by [8] Cowling, I., Whidborne, J., and Cooke, A.
Optimal trajectory planning and LQR control for a
V̄ quadrotor UAV.
¸i = : (31)
ri (ri2 + Rt2 ) Proceedings of the International Conference on Control
2006, Glasgow, Scotland, Aug. 30—Sept. 11, 2006.
With (29) and (31) the squared distance can be further [9] Collins, G., et al.
deduced into Cooperative control of UAVs for tracking moving targets
through information gain.
2 2V̄¢rk (rk2 ¡ Rt2 ) Toyon Research Corporation, Phase II STTR Final
rk+1 = rk2 + V̄2 ¢2 ¡ : (32) Report, Dec. 28, 2007.
rk2 + Rt2
[10] Tang, S. and Conway, B.
As LVFG converges, k ! 1, the steady-state distance Optimization of low-thrust interplanetary trajectories
from UAV to the target may be solved as below. using collocation and nonlinear programming.
AIAA Journal of Guidance, Control, and Dynamics, 18, 3
2r3 ¡ V̄¢r2 ¡ 2Rt2 r ¡ V̄¢Rt2 = 0: (33) (1995), 599—604.
[11] Geiger, B., et al.
The real solution in the third-order polynomial Optimal path planning of UAVs using direct collocation
equation is given by with nonlinear programming.
AIAA Guidance, Navigation, and Control Conference,
q p q p Keystone, CO, Aug. 2006, AIAA Paper 2006-6199.
3 3
r¤ = ¡q + q2 + p3 + ¡q ¡ q2 + p3 + 16 V̄¢ [12] Karatas, T. and Bullo, F.
Randomized searches and nonlinear programming in
(34)
trajectory planning.
1 2 2 1 2 1
where p = ¡ 36 V̄ ¢¡ 3 Rt
and q = ¡ ¡ 216 V̄3 ¢3 Proceedings of the 40th IEEE Conference on Decision
1 2 and Control, vol. 5, Orlando, FL, Dec. 4—7, 2001, pp.
3 V̄¢Rt . Therefore, the ASB of the LVFG can be 5032—5037.
¤
obtained as ±LVFG = r¤ ¡ Rt .
[13] Betts, J. T.
Survey of numerical methods for trajectory optimization.
REFERENCES Journal of Guidance, Control, and Dynamics, 21, 2 (1998),
193—207.
[1] Eberhart, R. and Shi, Y.
Particle swarm optimization: Developments, applications [14] Faiz, N., Agrawal, S. K., and Murray, R. M.
and resources. Trajectory planning of differential systems with dynamics
Proceedings of the 2001 IEEE Congress on Evolutionary and inequalities.
Computation (CEC 2001), vol. 1, Seoul, Korea, May AIAA Journal of Guidance, Control, and Dynamics, 24
27—30, 2001, pp. 81—86. (Apr. 2001), 219—227.
[2] Rasmussen, S. J., et al. [15] Ablavsky, V., Stouch, D., and Snorrason, M.
Introduction to the MultiUAV2 simulation and its Search path optimization for UAVs using stochastic
application to cooperative control research. sampling with abstract pattern descriptors.
Proceedings of the 2005 American Control Conference, Proceedings of the AIAA Guidance Navigation and Control
Portland, OR, June 8—10, 2005, pp. 4495—4496. Conference, Austin, TX, Aug. 2003.
CHEN, ET AL.: UAV PATH PLANNING WITH TANGENT-PLUS-LYAPUNOV VECTOR FIELD GUIDANCE 853
[16] Ferguson, D. and Stentz, A. [28] Misovec, K., et al.
The delayed D* algorithm for efficient path replanning. Low observable nonlinear trajectory generation for
Proceedings of the 2005 IEEE International Conference on unmanned air vehicles.
Robotics and Automation (ICRA 2005), Barcelona, Spain, Proceedings of the 42nd IEEE Conference on Decision and
Apr. 18—22, 2005, pp. 2045—2050. Control, Piscataway, NJ, 2003, pp. 3103—3110.
[17] O’Rourke, K., et al. [29] Lee, J., et al.
Dynamic routing of unmanned aerial vehicles using Strategies of path-planning for a UAV to track a ground
reactive tabu search. vehicle.
Military Operations Research Journal, 6 1 (2001), 5—30. Proceedings of the 2nd Annual Symposium on Autonomous
Intelligent Networks and Systems (AINS 2003), Menlo
[18] Flint, M., Fernandez-Gaucherand, E., and Polycarpou, M.
Park, CA, June 30—July 1, 2003.
A probabilistic frame-work for passive cooperation
among UAVs performing a search. [30] Pongpunwattana, A. and Rysdyk, R.
Proceedings of the Sixteenth International Symposium on Real-time planning for multiple autonomous vehicles in
Mathematical Theory of Networks and Systems, Leuven, dynamic uncertain environments.
Belgium, 2004. Journal of Aerospace Computing, Information, and
Communication, 1, 12 (Dec. 2004), 580—604.
[19] Yang, Y., Polycarpou, M., and Minai, A.
[31] Frew, E. and Lawrence, D.
Decentralized cooperative search by networked UAVs in
Cooperative stand-off tracking of moving targets by a
an uncertain environment.
team of autonomous aircraft.
Proceedings of the 2004 American Control Conference, vol.
Proceedings of the AIAA Guidance, Navigation, and
6, Boston, MA, June 30—July 2, 2004, pp. 5558—5563.
Control Conference and Exhibit, San Francisco, CA, Aug.
[20] Rathbun, D., et al. 15—18, 2005, AIAA Paper 2005-6363.
An evolution based path planning algorithm for [32] Rysdyk, R., Lum, C., and Vagners, J.
autonomous motion of a UAV through uncertain Autonomous orbit coordination for two unmanned aerial
environments. vehicles.
Proceedings of the AIAA 21st Digital Avionics Systems Proceedings of the AIAA Guidance, Navigation, and
Conference, vol. 2, Irvine, CA, Oct. 2003, pp. Control Conference and Exhibit, San Francisco, CA, Aug.
8D21—8D212. 15—18, 2005, pp. 4876—4884.
[21] Barlow, G. J., Oh, C. K., and Grant, E. [33] Milam, M. and Mushambi, R.
Incremental evolution of autonomous controllers for A new computational approach to real-time trajectory
unmanned aerial vehicles using multi-objective genetic generation for constrained mechanical systems.
programming. Proceedings of the IEEE Conference on Decision and
Proceedings of the 2004 IEEE Conference on Cybernetics Control, Sydney, Australia, Dec. 2000, pp. 845—851.
and Intelligent Systems (CIS), vol. 2, Singapore, Dec. [34] Singh, L. and Fuller, J.
2004, pp. 689—694. Trajectory generation for a UAV in urban terrain, using
[22] Fradkov, A. and Andrievsky, B. nonlinear MPC.
UAV guidance system with combined adaptive autopilot. Proceedings of the 2001 American Control Conference, vol.
Proceedings of the IASTED International Conference on 3, Arlington, VA, June 25—27, 2001, pp. 2301—2308.
Intelligent Systems and Control, Salzburg, Austria, 2003, [35] Becker, M., Dantas, C., and Macedo, W.
pp. 91—93. Obstacle avoidance procedure for mobile robots.
[23] Roskam, J. In ABCM Symposium Series in Mechatronics (1st ed.),
Airplane Flight Dynamics and Automatic Flight Controls, vol. 2, Brazilian Society of Mechanical Sciences and
Parts I & II. Engineering, Rio de Janeiro, 2006, pp. 250—257.
Lawrence, KS: DAR Corporation, 1998. [36] Keerkov, S. M., Kabamba, P. T., and Zeitz, III, F. H.
Optimal path planning for unmanned combat aerial
[24] Stentz, A.
vehicles to defeat radar tracking.
Map-based strategies for robot navigation in unknown
Journal of Guidance, Control, and Dynamics, 29, 2 (Apr.
environments.
2006), 279—288.
Planning with Incomplete Information for Robot Problems:
[37] Richards, A. and How, J.
Papers from the 1996 AAAI Spring Symposium, Palo Alto,
Aircraft trajectory planning with collision avoidance using
CA: AAAI Press, 1996, pp. 10—116.
mixed integer linear programming.
[25] Burns, B. and Brock, O. Proceedings of the 2002 American Control Conference, vol.
Information theoretic construction of probabilistic 3, Anchorage, AK, May 8—10, 2002, pp. 1936—1941.
roadmaps. [38] Chen, H., Chang, K. C., and Agate, C.
Proceedings of the 2003 IEEE/RSJ International A dynamic path planning algorithm for UAV tracking.
Conference on Intelligent Robots and Systems, vol. 1, Las Proceedings of SPIE, Signal Processing, Sensor Fusion,
Vegas, NV, Oct. 27—31, 2003, pp. 650—655. and Target Recognition XVIII, vol. 7336, Orlando, FL,
[26] Mclain, T. and Beard, R. Apr. 2009.
Trajectory planning for coordinated rendezvous of [39] Chen, H., Chang, K. C., and Agate, C.
unmanned air vehicles. Tracking with UAV using tangent-plus-Lyapunov vector
Proceedings of the AIAA Guidance, Navigation, and field guidance.
Control Conference, Denver, CO, Aug. 14—17, 2000, pp. Proceedings of the 12th International Conference on
1247—1254. Information Fusion, Seattle, WA, July 6—9, 2009, pp.
[27] Campbell, M. and Ousingsawat, J. 363—372.
On-line estimation and path planning for multiple [40] Lawrence, D.
vehicles in an uncertain environment. Lyapunov fields for UAV track coordination.
Proceedings of the AIAA Guidance, Navigation, and Proceedings of the 2nd AIAA Un-manned Unlimited
Control Conference and Exhibit, Monterey, CA, Aug. 5—8, Systems, Technologies and Operations Conference, San
2002, AIAA Paper 2002-4466. Diego, CA, Sept. 2003.
854 IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS VOL. 49, NO. 2 APRIL 2013
[41] Frew, E., Lawrence, D., and Morris, S. [45] Lorusso, A. and Micheli, E. D.
Coordinated standoff tracking of moving targets using An approach to obstacle detection and steering control
Lyapunov guidance vector fields. from optical flow.
Journal of Guidance, Control, and Dynamics, 31, 2 Proceedings of the 1996 IEEE Intelligent Vehicle
(Mar.—Apr. 2008). Symposium, Tokyo, Sept. 19—20, 1996, pp. 357—362.
[42] McGee, T., Spry, S., and Hedrick, J. [46] Gandhi, T., et al.
Optimal path planning for an aircraft with a bounded turn Detection of obstacles in the flight path of an aircraft.
rate in the presence of a constant wind. IEEE Transactions on Aerospace and Electronic Systems,
Proceedings of the AIAA Conference on Guidance, 39, 1 (Jan. 2003), 179—191.
Navigation, and Control, Aug. 2005. [47] Kavraki, L., et al.
[43] Nikolos, I. K., et al. Probabilistic roadmaps for path planning in
Evolutionary algorithm based offline/online path planner high-dimensional configuration spaces.
for UAV navigation. IEEE Transactions on Robotics and Automation, 12, 4
IEEE Transactions on Systems, Man, and Cybernetics, Part (1996), 556—580.
B: Cybernetics, 33, 6 (Dec. 2003), 898—912. [48] Larson, J., et al.
[44] Petillot, Y., Ruiz, I. T., and Lane, D. M. Advances in autonomous obstacle avoidance for
Underwater vehicle obstacle avoidance and path planning unmanned surface vehicles.
using a multi-beam forward looking sonar. AUVSI Unmanned Systems North America 2007,
IEEE Journal of Oceanic Engineering, 26, 2 (Apr. 2001), Washington, D.C., Aug. 7—9, 2007.
240—251.
CHEN, ET AL.: UAV PATH PLANNING WITH TANGENT-PLUS-LYAPUNOV VECTOR FIELD GUIDANCE 855
Hongda Chen received his B.S. and M.S. degrees in electrical engineering
from the Beijing Institute of Technology, Beijing, China in 1987 and 1990,
respectively, and his Ph.D. degree in information technology from George Mason
University, Fairfax, VA in 1999.
From 1998 to 2002 he was a senior member of technical staff in Mobile
Satellite Communication, Hughes Network Systems. In 2003 he joined Intelligent
Automation as a senior research engineer. He performed state-of-the-art research
and development in Riorey, Inc. for advanced network security products in
2006. Since 2003 he has served as a senior research consultant on projects of
multisensor data fusion and multitarget tracking in the Department of SEOR,
George Mason University, VA, and currently, he is a senior research scientist
with Sigma Space Corporation, Lanham, MD, where he works on NASA
EOS projects. His research interests include signal processing, data analysis,
communications, and fault diagnosis/prognosis in industry applications.
Dr. Chen has published more than 30 papers in the areas of signal processing,
data fusion, and communications.
Craig Agate received his B.S. and M.S. degrees in electrical engineering
from California State University, Northridge and his Ph.D. degree in electrical
engineering from the University of California, Santa Barbara in 2000.
Upon graduating he joined Toyon Research Corporation in Goleta, CA.
With a general background in detection and Bayesian estimation theory, he has
developed a particle filtering algorithm to address the unique aspects of ground
target tracking (incorporating road constraints, evidence such as nondetection
events, and measured signatures for feature-aided tracking and identification).
Other research includes developing feature-aided tracking algorithms and object
identification algorithms based on Bayesian evidence accrual. Addressing
the need for long-term continuous tracking of particular targets, he has also
developed an approach to feature-aided tracking that exploits features collected
“on-the-fly” to characterize targets of interest, which has provided a fingerprint
that allows for disambiguation of the target of interest from background targets.
856 IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS VOL. 49, NO. 2 APRIL 2013