Professional Documents
Culture Documents
Equilibrium-Independent Dissipativity With Quadratic Supply Rates
Equilibrium-Independent Dissipativity With Quadratic Supply Rates
Equilibrium-Independent Dissipativity With Quadratic Supply Rates
fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TAC.2018.2838664, IEEE
Transactions on Automatic Control
SUBMITTED TO IEEE TRANSACTIONS ON AUTOMATIC CONTROL. THIS VERSION: MAY 14, 2018 1
Abstract—Equilibrium-independent dissipativity (EID) is a re- When many uncertain systems are interconnected, explicitly
cently introduced system property which requires a system to be calculating this equilibrium set may prove infeasible. It then
dissipative with respect to any forced equilibrium configuration. becomes challenging to construct classical storage functions for
This paper is a detailed examination of EID with quadratic
supply rates for a common class of nonlinear control-affine the subsystems in order to verify internal stability and/or I/O
systems. We provide an algebraic characterization of EID for properties of the interconnection; classical dissipativity falls
such systems in the spirit of the Hill-Moylan lemma, where short as an effective tool.
the usual stability condition is replaced by an incremental One remedy to these issues is termed incremental dissipa-
stability condition. Based on this characterization, we state results
concerning internal stability, feedback stability, and absolute
tivity, which requires that a dissipation inequality hold along
stability of EID systems. Finally, we study EID for discrete-time any two arbitrary trajectories of a forced system [8]. A closely
systems, providing the relevant definitions and an analogous Hill- related property termed differential dissipativity is discussed in
Moylan-type characterization. Results for both continuous-time [9], [10]. Under appropriate technical assumptions, incremental
and discrete-time systems are illustrated through examples on dissipativity implies the existence of a unique equilibrium
physical systems and convex optimization algorithms.
trajectory towards which all other trajectories converge. As
Index Terms—Nonlinear systems, dissipative systems, passivity, such, incremental dissipativity has proven useful for studying
stability analysis, absolute stability, Lyapunov methods output regulation [8], [11] and synchronization of intercon-
nected systems [12]–[14], where all subsystem trajectories con-
I. INTRODUCTION verge to a common global steady-state trajectory. Incremental
Dissipation inequalities provide a general framework for dissipativity however is quite demanding as a system property,
the analysis and design of interconnected nonlinear dynamical since often we wish only to establish stability/dissipativity of
systems. Introduced by Willems in [1], dissipativity is an input- trajectories with respect to the set of equilibrium configurations,
output system property which unifies classical properties such and not with respect to all other possible trajectories.
as finite-gain, passivity, and conicity [2]. Further advances As an intermediate property between classical and incremen-
in [3], [4] by Hill and Moylan characterized dissipativeness tal dissipativity, equilibrium-independent dissipativity (EID)
for control-affine systems in terms of a system of nonlinear has recently been introduced [15]–[17], requiring a dissipation
equations. Dissipative systems theory and associated control inequality to hold between any system trajectory and any forced
design techniques are now fairly mature, with several reference equilibrium point. The utility of this property is that as the
books available [5]–[7]. operating point of the system moves — either intentionally due
When applied to state-space systems for the purposes of to set-point changes, or unintentionally due to disturbances —
stability analysis, dissipation inequalities are referenced to a one is guaranteed that the dissipation inequality under consid-
chosen equilibrium input-state-output configuration (ū, x̄, ȳ), eration will continue to hold with respect to the new operating
which is typically taken to be the origin. If several such point. This property has been used for the control of port-
dissipative systems are interconnected with one another, the Hamiltonian systems [18], [19], for performance certification
origin is an equilibrium point for the closed-loop system, and of interconnected systems [20], [21], for network congestion
dissipativity theory provides tools for assessing its stability [7]. control [22], for stability analysis of various power system
This framework however assumes considerable knowledge of models [23]–[25], and for analysis of optimization algorithms
the equilibrium sets of the individual subsystems, and this may [26]. Particularly relevant to this paper is [18], where a
not be justified in applications. When considering uncertain, Lyapunov construction based on the Bregman divergence was
large-scale, nonlinear systems, equilibrium sets of subsystems used to establish equilibrium-independent passivity.1
may be uncertain or otherwise difficult to characterize. Further The theory of EID systems presented in [15]–[17] has not
complicating the situation, the very act of interconnection however been developed to the level of the classical dissi-
between subsystems will induce a closed-loop equilibrium pativity literature [5]–[7], and no consistent, comprehensive
set, determined by the simultaneous solution of all subsys- reference is available. In addition, two particularly important
tem equilibrium equations and all interconnection constraints. items absent from the literature are an algebraic Hill-Moylan-
type characterization of EID, and analogous definitions and
J. W. Simpson-Porco is with the Department of Electrical and Computer results for the discrete-time case. The former is theoretical
Engineering, University of Waterloo, Waterloo ON, N2L 3G1 Canada. Corre-
spondence: jwsimpson@uwaterloo.ca.
This work was supported in part by the NSERC Discovery Grant RGPIN- 1 The use of the Bregman divergence in the control literature apparently
2017-04008 and by University of Waterloo start-up funding. traces to [27]; we thank N. Monshizadeh for this observation.
0018-9286 (c) 2018 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TAC.2018.2838664, IEEE
Transactions on Automatic Control
SUBMITTED TO IEEE TRANSACTIONS ON AUTOMATIC CONTROL. THIS VERSION: MAY 14, 2018 2
bedrock and a key step towards EID control design [7], while spaces are denoted by `m m
2 [0, ∞) and `2e [0, ∞). For a twice-
the author sees the latter as important for analyzing and de- differentiable function V : R → R, ∇V : Rn → Rn is
n
signing interconnections of physical systems with optimization its gradient while ∇2 V : Rn → Rn×n is its Hessian. A
algorithms. Putting these future directions/applications to the differentiable function V : Rn → R is convex if
side, here we focus instead on developing and illustrating the
[∇V (x) − ∇V (z)]T (x − z) ≥ k(x, z)kx − zk22
basic theory of equilibrium-independent dissipativity.
for all x, z ∈ Rn and some function k : Rn × Rn → R≥0 . If
k(x, z) > 0 for all x 6= z, then V is strictly convex, and if
A. Contributions k(x, z) ≥ µ > 0 for all (x, z), then V is µ-strongly convex; in
The overarching goal of this paper is to provide a de- the twice differentiable case, these statements are equivalent to
tailed treatment of EID systems with quadratic supply rates, ∇2 V (x) 0 and ∇2 V (x) µIn for all x ∈ Rn , respectively.
developing basic characterizations and stability results, and
illustrating the results with examples. We restrict our discussion I I . N O N L I N E A R D I S S I PAT I V E S Y S T E M S
to nonlinear control-affine systems with constant input and A. Control-Affine Systems and Forced Equilibria
throughput matrices, in both continuous and discrete-time.2 Consider the continuous-time nonlinear control-affine system
There are three main contributions.3 First, we show in with constant input and throughput matrices
Section III that EID can be characterized in terms of an (
ẋ(t) = f (x(t)) + Gu(t)
appropriately modified Hill-Moylan lemma [4]. The key mod- Σ: (1)
ification is that the usual stability-like condition is replaced y(t) = h(x(t)) + Ju(t)
by an incremental stability-like condition. Roughly speaking, with state x(t) ∈ X := Rn , input u(t) ∈ U := Rm and output
the results can be interpreted as saying that dissipativity plus y(t) ∈ Y := Rp where m, p ≤ n. The maps f : X → Rn
an appropriate incremental stability-like condition yields EID; and h : X → Y are assumed to be sufficiently smooth such
we present various examples illustrating the results. Second, in that trajectories are forward complete for all initial conditions
Section IV, we study stability of EID systems, stating results x(0) ∈ X and all input functions u(·) ∈ L m [0, ∞), with
2e
for internal and feedback stability, and study an equilibrium- corresponding output trajectories y(·) ∈ L p [0, ∞). The input
2e
independent variant of the absolute stability problem. Third matrix G ∈ Rn×m is constant and has rank m (full column
and finally, in Section V we consider the discrete-time case, rank). The throughput matrix J ∈ Rp×m is constant. An
providing the relevant definitions, corresponding Hill-Moylan- equilibrium configuration of (1) is a triple (ū, x̄, ȳ) ∈ U ×X ×Y
type conditions, and illustrating how the results can be applied satisfying
to analyze the gradient method for convex optimization. 0n = f (x̄) + Gū
Two major implications of our results are that (i) EID can (2)
ȳ = h(x̄) + J ū .
be established and applied to problems in much the same way
as standard dissipativity, and (ii) for square EID systems in When m = n, the system is fully actuated and for any desired
−1
feedback, the existence/uniqueness of closed-loop equilibria equilibrium point x̄ ∈ X , ū = −G f (x̄) is the associated
⊥ (n−m)×n
can be inferred by studying the monotonicity of the subsystem equilibrium input. When m < n, let G ∈ R be a
I/O relations. full-rank left annihilator of G; that is, G satisfies G⊥ G = 0
⊥
0018-9286 (c) 2018 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TAC.2018.2838664, IEEE
Transactions on Automatic Control
SUBMITTED TO IEEE TRANSACTIONS ON AUTOMATIC CONTROL. THIS VERSION: MAY 14, 2018 3
which relates compatible steady-state inputs and outputs. supply rate (5) is equivalent to the existence of an integer k > 0
Remark 2.1: (Assignable Equilibria): If 0n−m is a regular and matrices L ∈ Rk×n , W ∈ Rk×m solving the linear matrix
value for E(x) := G⊥ f (x), then the associated fiber EΣ = equality
E −1 (0n−m ) is a m-dimension embedded submanifold of Rn T T
F P + PF PG H J Q S H J
[30, Corollary 5.24]. In the case of LTI systems where f (x) = −
GT P 0 0 Im S T R 0 Im
F x with F ∈ Rn×n , the set of assignable equilibria becomes T (7)
EΣ = ker(G⊥ F ). If in addition F is invertible, this simplifies L
+ L W = 0 .
further to EΣ = F −1 Im(G). WT
I I I . E Q U I L I B R I U M - I N D E P E N D E N T D I S S I PAT I V I T Y
B. Classical Dissipativity of Control-Affine Systems FOR CONTINUOUS-TIME CONTROL-AFFINE
We provide a brief review of dissipativity theory for control- SYSTEMS
affine nonlinear systems; see [5]–[7] for various overviews
The presented state-space definitions of dissipativity implic-
of dissipativity and related concepts. In this subsection, we
itly reference a specific equilibrium configuration (the origin).
make the additional assumptions for (1) that f (0n ) = 0n and
Often however, we are interested in operating a control system
h(0n ) = 0p , so that (ū, x̄, ȳ) = (0m , 0n , 0p ) is an equilibrium
around an equilibrium configuration (ū, x̄, ȳ), and we wish
configuration. Let w : U × Y → R be a continuous function
to establish input/output properties with respect to this forced
called the supply rate. The system Σ in (1) is dissipative with
equilibrium configuration. In general, verifying dissipativeness
respect to the supply rate w(u, y) if there exists a continuously
with respect to the forced equilibrium must be done with a new
differentiable storage function V : X → R≥0 with V (0n ) = 0
storage candidate Vx̄ (x), which depends on the equilibrium x̄.
such that
Simply shifting a storage function V (x) as used in Lemma
d
V (x(t)) := ∇V (x)T (f (x) + Gu) ≤ w(u(t), y(t)) (4) 2.2 need not suffice, as the following simple example shows.
dt Example 3.1: (Second-Order System): Consider the second-
for all t ≥ 0 and all measurable inputs u(·) ∈ L2e m
[0, ∞). order system
The inequality (4) is called a dissipation inequality; the
ẋ1 = x2 , ẋ2 = −∇U (x1 ) − x2 + u
interpretation is that the rate of change of energy V (x) stored
by the system is less than the supplied power w(u, y). In this y = x2
paper we focus exclusively on quadratic supply rates where U : R → R is differentiable and strictly convex,
T
y Q S y
with ∇U (0) = 0. Clearly (ū, x̄1 , x̄2 , ȳ) = (0, 0, 0, 0) is an
w(u, y) = T , (5) equilibrium configuration, and the storage function V (x) =
u S R u 1 T
2 x2 x2 + U (x1 ) − U (0) satisfies V (0, 0) = 0 and certifies
T T
where Q = Q , S, and R = R are matrices of appro- output-strict passivity:
priate dimensions. To ensure that the inequality (4) is not
trivially satisfied, we make the standard assumption that the V̇ = ∇U (x1 ) · x2 − x2 · ∇U (x1 ) − x22 + x2 u = −y 2 + yu
block matrix in (5) is sign-indefinite [4]. The supply rate := w(u, y) .
(5) contains some common I/O system properties as special
Consider now a forced equilibrium configuration (ū, x̄1 , 0, 0),
cases, including passivity (Q, S, R) = (0, 21 Im , 0) and finite
where ū = ku (x̄) := ∇U (x̄1 ). A natural choice for a storage
L2 -gain (Q, S, R) = (−Ip , 0, γ 2 Im ) for γ ≥ 0. The key
candidate is Vx̄ (x) = V (x) − U (x̄1 ), satisfying Vx̄ (x̄1 , 0) = 0.
characterization of quadratically dissipative continuous-time
However, a similar calculation shows that
control-affine systems is due to Hill and Moylan.
Lemma 2.2: (Hill-Moylan Conditions [4]): The control- V̇x̄ = −(y − ȳ)2 + (y − ȳ)u
affine system Σ in (1) is dissipative with respect to the supply 6= w(u − ū, y − ȳ) ,
rate (5) with continuously-differentiable storage function V :
X → R≥0 if and only if there exists an integer k > 0, a matrix and therefore Vx̄ (x) does not establish the desired equilibrium-
W ∈ Rk×m and a function l : X → Rk such that independent passivity property.
The concept of equilibrium-independent dissipativity (EID)
∇V (x)T f (x) = h(x)T Qh(x) − l(x)T l(x) (6a) requires dissipativity of a system with respect to any equi-
1
∇V (x)T G = h(x)T (QJ + S) − l(x)T W (6b) librium configuration [15], [17], [21]. Our definition roughly
2 follows [17], [21].
W T W = R + J T S + S T J + J T QJ . (6c)
Definition 3.2: (Equilibrium-Independent Dissipativity):
In most applications, the first equation in (6) enforces some The control-affine system (1) is equilibrium-independent dis-
type of stability; the remaining equations ensure a proper sipative (EID) with supply rate w : U × Y → R if, for every
matching of inputs and outputs to generate the supply rate (5). equilibrium x̄ ∈ EΣ , there exists a continuously-differentiable
When specialized to LTI systems ẋ = F x+Gu , y = Hx+Ju, storage function Vx̄ : X → R≥0 such that Vx̄ (x̄) = 0 and
with quadratic storage functions V (x) = xT P x, P = P T 0, d
Lemma 2.2 states that dissipativity with respect to the quadratic Vx̄ (x(t)) := ∇Vx̄ (x)T (f (x)+Gu) ≤ w(u− ū, y − ȳ) , (8)
dt
0018-9286 (c) 2018 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TAC.2018.2838664, IEEE
Transactions on Automatic Control
SUBMITTED TO IEEE TRANSACTIONS ON AUTOMATIC CONTROL. THIS VERSION: MAY 14, 2018 4
0018-9286 (c) 2018 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TAC.2018.2838664, IEEE
Transactions on Automatic Control
SUBMITTED TO IEEE TRANSACTIONS ON AUTOMATIC CONTROL. THIS VERSION: MAY 14, 2018 5
where we have used that f (x̄) + Gū = 0n and, for notational D(x, x̄) that
simplicity, suppressed the time-dependence. Adding the non-
negative quantity k`(x, x̄) + W (u − ū)k22 to the right-hand side ˜ x̄)T `(x,
`(x, ˜ x̄) = a(x, x̄) (17a)
of the dissipation rate, we obtain T˜
W (x, x̄) `(x, x̄) = b(x) − b(x̄) (17b)
V̇x̄ ≤ [∇V (x) − ∇V (x̄)]T [f (x) − f (x̄)] W (x, x̄)T W (x, x̄) = R
b (17c)
+ k`(x, x̄)k22 + [∇V (x) − ∇V (x̄)] G(u − ū) T
for all pairs (x, x̄). We now show that without loss of generality,
+ 2`(x, x̄) W (u − ū) + (u − ū)T W T W (u − ū) .
T
one may select W (x, x̄) = W as constant. From Lemma
Inserting (12a) and (12c), we obtain A.5, (17c) holds if and only if W (x, x̄) = O(x, x̄)W for
an orthogonal matrix O(x, x̄) ∈ Rk×k and a constant ma-
V̇x̄ ≤ [h(x) − h(x̄)]T Q[h(x) − h(x̄)] ˜ x̄) and
trix W ∈ Rk×m . Defining `(x, x̄) := O(x, x̄)T `(x,
+ [∇V (x) − ∇V (x̄)]T G(u − ū) inserting these expressions into (17), the orthogonal matrices
+ 2`(x, x̄)T W (u − ū) + (u − ū)T R(u
b − ū) , vanish and we find that
where Rb = R + J T S + S T J + J T QJ. Inserting (12b) into the `(x, x̄)T `(x, x̄) = a(x, x̄) (18a)
dissipation inequality, we find T
W `(x, x̄) = b(x) − b(x̄) (18b)
V̇x̄ ≤ [h(x) − h(x̄)]T Q[h(x) − h(x̄)] W TW = R b (18c)
+ (u − ū)T J T QJ(u − ū)
which shows that we may indeed select W (x, x̄) = W
+ 2[h(x) − h(x̄)]T (QJ + S)(u − ū)
independent of (x, x̄). Substitution of the expressions for
+ 2(u − ū)T S T J(u − ū) + (u − ū)T R(u − ū) . a(x, x̄), b(x) and Rb into (18a)–(18c) immediately leads to
Inserting h(x) = y − Ju and h(x̄) = ȳ − J ū, collecting terms, the three equations (12a)–(12c). To show the final statement,
and simplifying, one arrives at V̇x̄ ≤ w(u − ū, y − ȳ) which note from (15) that a(x, x) = 0, and hence it follows from
shows the system is EID. (18b) that `(x, x) = 0k . Using Lemma A.6, the equation (18b)
holds if and only if
Necessity: Assume Σ is EID with supply rate w(u, y) and
storage function (11), i.e., for each x̄ ∈ EΣ it holds that V̇x̄ ≤
W T (`(x1 , x2 ) + `(x2 , x3 ) + `(x3 , x1 )) = 0m (19)
w(u − ū, y − ȳ). Defining dx̄ (x, u) := −V̇x̄ + w(u − ū, y − ȳ),
we find that for any triple (x1 , x2 , x3 ). With z ∈ Rk as an auxiliary
T
0 ≤ dx̄ (x, u) = −[∇V (x) − ∇V (x̄)] [f (x) + Gu] variable for brevity, observe that a particular solution of the
+ (y − ȳ)T Q(y − ȳ) + (u − ū)T R(u − ū) equation W T z = 0m in (19) is zpar = `(x1 , x2 ) + `(x2 , x3 ) +
`(x3 , x1 ) = 0k . Using Lemma A.6 once more, this implies that
+ 2(y − ȳ)T S(u − ū)
`(x, x̄) = l(x) − l(x̄) for an appropriate function l : X → Rk .
Substituting for y and ȳ, after some manipulation one obtains Let r := dim(ker(W T )), let t1 , . . . , tr ∈ Rk be a basis for
T ker(W T ), and set T := t1 · · · tr . Then W T T = 0 and
b(x)T − b(x̄)T
1 a(x, x̄) 1 the homogeneous solution to W T z = 0m can be written as
dx̄ (x, u) =
u − ū b(x) − b(x̄) R
b u − ū
| {z }
:=D(x,x̄) zhom = T [q(x1 , x2 ) + q(x2 , x3 ) + q(x3 , x1 )]
where for some function q : X × X → Rr satisfying q(x, x) = 0r .
a(x, x̄) = −[∇V (x) − ∇V (x̄)]T [f (x) − f (x̄)] , Combining the particular and homogeneous solutions, it follows
+ [h(x) − h(x̄)]T Q[h(x) − h(x̄)] that we may take `(x, x̄) = l(x) − l(x̄) + T q(x, x̄), which
(15)
1 completes the proof.
b(x)T = − ∇V (x)T G + h(x)T (QJ + S) ,
2
The equation (12c) is identical to the third Hill-Moylan
and Rb is as before. Since dx̄ (x, u) ≥ 0 for all u, we in fact
condition (6c). When W T has full column rank, then the final
have that D(x, x̄) 0 for all (x, x̄) [7, Lemma 4.1.3]; in statement of Lemma 3.4 implies that `(x, x̄) may always be
particular then a(x, x̄) ≥ 0 and R b 0. For each pair (x, x̄),
chosen in the form `(x, x̄) = l(x) − l(x̄). In this case, the
the matrix D(x, x̄) may be factorized as second equation (12b) of Lemma 3.4 may be alternatively
˜ x̄)T written as
`(x, ˜ x̄) W (x, x̄)
D(x, x̄) = T `(x, (16)
W (x, x̄) 1
∇V (x)G = h(x)T (QJ + S) − l(x)T W + ξ T
where `˜ : X × X → Rk and W : X × X → Rk×m for 2
some nonnegative integer k.4 It follows by equating blocks of for a constant vector ξ ∈ Rm , which is quite similar to
4 For example, if one uses an SVD decomposition then k can be chosen as
the second Hill-Moylan condition (6b). As a special case of
the maximum rank of D(x, x̄) over (x, x̄), and hence k ≤ m + 1. This is Lemma 3.4, consider the supply rate w(u, y) = −y T y+γ 2 uT u;
just one option though; see [7, Chapter 4.1] for some further discussion. this corresponds to Σ having a finite L2 -gain less than or equal
0018-9286 (c) 2018 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TAC.2018.2838664, IEEE
Transactions on Automatic Control
SUBMITTED TO IEEE TRANSACTIONS ON AUTOMATIC CONTROL. THIS VERSION: MAY 14, 2018 6
to γ. The conditions of Lemma 3.4 for EID reduce to general one would seek to find a differentiable function V (x)
such is convex and establishes the dissipation inequality, i.e.,
[∇V (x) − ∇V (x̄)]T [f (x) − f (x̄)] + kh(x) − h(x̄)k22
= −k`(x, x̄)k22 [∇V (x) − ∇V (x̄)]T (x − x̄) ≥ 0
1 [∇V (x) − ∇V (x̄)]T [f (x) + Gu] ≤ w(u − ū, y − ȳ)
[∇V (x) − ∇V (x̄)]T G = −[h(x) − h(x̄)]T J − `(x, x̄)T W
2 for all (x, x̄, u) with corresponding values for (y, ȳ, ū). For
γ 2 Im − J T J = W T W LTI systems with quadratic storage functions, these constraints
(20) reduce to finding a symmetric matrix P 0 such that the left-
which is an incremental nonlinear-bounded-real type result hand side of (7) is negative semidefinite; this is a linear matrix
(c.f. [4, Example 1]). The assumption for Lemma 3.4 that the inequality. When f (x) and h(x) are polynomial functions, the
input and throughput matrices G and J are state-independent search for a polynomial function V (x) certifying EID can be
allows for (12b)–(12c) to remain similar to the corresponding cast as a sum-of-squares feasibility problem and solved via
equations in the standard Hill-Moylan result of Lemma 2.2. semidefinite programming; see [21] for further discussion.
We do not pursue the extension to state-dependent input and
throughout matrices here here, but see [21, Section 3.1] for
the case of scalar systems. B. Illustrative Examples
In [21, Example 3.1], the single-input single-output scalar Our first example illustrates the usefulness of the Lyapunov
system ẋ = f (x) + u with output y = h(x) was shown to construction (11).
be equilibrium-independent passive if f is continuous and Example 3.8: (Port-Hamiltonian Systems): A port-
decreasing and h is continuous and increasing, with EIP storage Hamiltonian system with state-independent input, dissipation,
function family parameterized as and interconnection matrices G, R, and J takes the form
Z x
ẋ = [J − R]∇H(x) + Gu + d
Vx̄ (x) = [h(z) − h(x̄)] dz . (21) (25)
x̄ y = GT ∇H(x) ,
Since h is increasing, there exists a continuously differentiable where H : X → R≥0 is a convex function, d ∈ Rn is an
convex function V : R → R such that h(x) = ∇V (x), and unknown constant disturbance, and J , R ∈ Rn×n satisfy J =
(21) can be seen as a special case of the construction (11) −J T and R = RT 0. The system from Example 3.1 is
used in Lemma 3.4. Concerning the requirement that f be a special case of the above port-Hamiltonian model. Forced
decreasing, the following corollary of Lemma 3.4 generalizes equilibria are determined by
this idea to higher-dimensional systems.
EΣ = {x̄ ∈ X | ∃ū ∈ U s.t. [J − R]∇H(x̄) + Gū + d = 0n } ,
Corollary 3.6: (Equilibrium-Independent Passive Sys-
tems): Consider the square control-affine nonlinear system and therefore depend on the unknown disturbance d. With
V (x) = H(x), we have the EID storage candidate Vx̄ (x) =
ẋ = f (x) + Gu , y = GT ∇V (x) (22) H(x) − H(x̄) − ∇H(x̄)T (x − x̄), and a direct computation
shows that
where V : Rn → R is continuously differentiable and strongly
convex. If the mapping −f ◦ ∇V −1 is monotone, then (22) is V̇x̄ = −(∇H(x) − ∇H(x̄))T R(∇H(x) − ∇H(x̄))
equilibrium-independent passive with storage function (11). + (y − ȳ)T (u − ū) .
Proof: Since V is continuously differentiable and strongly Note that due to the incremental nature of the dissipation
convex, x 7→ ∇V (x) is both maximally and strongly monotone, inequality, the unknown constant disturbance d does not appear.
and is therefore a bijection on X [31, Example 22.9]. Therefore, The conditions of Lemma 3.4 are satisfied with (Q, S, R) =
f˜ := −f ◦ ∇V −1 is well-defined, and by assumption satisfies (0, 1 Im , 0), k = n, W = 0n×m , and `(x, x̄) = R 12 [∇H(x) −
2
T ˜ ˜ ∇H(x̄)]. Suppose that we now wish to regulate the output of
(x1 − x2 ) (f (x1 ) − f (x2 )) ≥ 0 , x1 , x2 ∈ X . (23)
the system (25) to a desired set point ȳ ∈ Y; we assume there
For the system (22) with supply rate (Q, S, R) = (0, 2 Im , 0) exists an assignable equilibrium x̄ ∈ EΣ such that ȳ = ky (x̄).
1
one may quickly verify that (12b)–(12c) automatically hold Consider the PI controller with input e(t) and output yc (t):
with W = 0, and therefore (12a) holds if and only if ζ̇ = e , y = K e + K ζ , (26) c P I
[∇V (x) − ∇V (x̄)]T [f (x) − f (x̄)] ≤ 0 (24) where KP , KI 0. A quick calculation shows that with EID
storage function Wζ̄ (ζ) = 12 kζ − ζ̄k2KI , the PI controller (26)
for all (x, x̄) ∈ X × EΣ . Setting x1 := ∇V (x), x2 = ∇V (x̄),
satisfies the EID inequality
we see that (23) implies (24), which shows the result.
Ẇζ̄ = (yc − ȳc )T (e − ē) − (e − ē)T KP (e − ē) .
Remark 3.7: (Computational Verification of EID): While
appropriate functions V (x) for the Lyapunov construction (11) With the negative feedback interconnection e = y − ȳ,
can sometimes be chosen for a system based on intuition, a u = −yc , we may add the EID dissipation inequalities to
suitable choice may not always be obvious. To verify the EID obtain V̇x̄ + Ẇζ̄ ≤ −ky − ȳk2KP . From this point, one can
property for a given nonlinear system (1) using Lemma 3.4, in argue in a standard fashion that y(t) → ȳ; under additional
0018-9286 (c) 2018 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TAC.2018.2838664, IEEE
Transactions on Automatic Control
SUBMITTED TO IEEE TRANSACTIONS ON AUTOMATIC CONTROL. THIS VERSION: MAY 14, 2018 7
0018-9286 (c) 2018 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TAC.2018.2838664, IEEE
Transactions on Automatic Control
SUBMITTED TO IEEE TRANSACTIONS ON AUTOMATIC CONTROL. THIS VERSION: MAY 14, 2018 8
The choice α = 2γ 2 λmin (M + AT KA) makes this inequality Lemma 4.3: (Internal Stability of EID Systems): Suppose
the tightest it can be, in which case it becomes that a system Σ satisfies the conditions of Lemma 3.4 with
1 V (x) strictly convex and Q ≺ 0. If Σ is equilibrium-
γ ≥ γ ? := . (36) independent observable, then for every x̄ ∈ EΣ , x = x̄ is
λmin (M + AT KA)
a locally asymptotically stable equilibrium of the associated
We conclude that the system is EID with the given supply forced system ẋ = f (x) + Gū. Moreover, if V (x) in Lemma
rate for any choice of γ ≥ γ ? , and in particular, with γ = 3.4 is strongly convex, then x̄ is globally asymptotically stable.
γ ? . This shows the system has equilibrium-independent L2 -
gain less than or equal to γ ? . As discussed in [26], γ ? can in Proof: Fix an arbitrary x̄ ∈ EΣ with associated ū and ȳ, and
some situations be minimized by a judicious choice of the free let Vx̄ (x) be as in Lemma 3.4. Since Vx̄ (x̄) = 0 and Vx̄ (x) > 0
parameter matrix K. When K = 0, the L2 -gain is limited for x 6= x̄ (Lemma A.2(i)), Vx̄ (x) is a Lyapunov candidate and
only by the convexity parameters M of the cost functions. satisfies the dissipation inequality
V̇x̄ (x(t)) ≤ (y(t) − ȳ)T Q(y(t) − ȳ)
I V. S TA B I L I T Y OF EID SYSTEMS
This section presents internal and feedback stability results along trajectories of the forced system ẋ = f (x) + Gū. Since
for continuous-time EID systems. The results are natural Q ≺ 0, there exists an α > 0 such that V̇x̄ (x(t)) ≤ −αky(t)−
extensions of classical stability results for dissipative systems, ȳk22 . Standard arguments then show that y(t) = h(x(t)) + J ū
but have not been stated in the literature. converges to ȳ which, due to equilibrium-independent ob-
servability, implies that x(t) → x̄ showing local asymptotic
stability. When V (x) is µ-strongly convex, Lemma A.2(ii)
A. Internal Stability of EID Systems shows that Vx̄ (x) ≥ µ2 kx − x̄k22 , and thus Vx̄ (x) is radially
Standard stability results for dissipative systems proceed unbounded; standard results (e.g., [5, Corollary 2.2]) then yield
along the following lines. Consider the system Σ in (1) under global asymptotic stability of x̄.
the assumptions of Section II-B. If the system is dissipative
with respect to the supply rate (5) with storage function V (x) Variations on this result are possible, for example, by weak-
satisfying V (0n ) = 0 and V (x) > 0 for x 6= 0n , then with zero ening the observability requirement to an appropriate notion
input the origin x = 0n is 1) stable if Q 0, 2) asymptotically of equilibrium-independent detectability; we omit the details.
stable if Q ≺ 0 and Σ is zero-state observable5 , and 3) globally
asymptotically stable if Q ≺ 0, Σ is zero-state observable, and B. Interconnection and Feedback Stability
V (x) → ∞ as kxk2 → ∞ (i.e., V is radially unbounded).6
Consider now two control-affine systems
We begin with an observability definition. (
Definition 4.1: (Equilibrium-Independent Observability): ẋi = fi (xi ) + Gi ui
Σi :
The system (1) is equilibrium-independent observable if, for yi = hi (xi ) + Ji ui
every x̄ ∈ EΣ with associated equilibrium input/output vectors
ū = ku (x̄) and ȳ = ky (x̄), no trajectory of ẋ = f (x) + Gū i ∈ {1, 2}, with compatible input/output spaces U1 = Y2 =
can remain within the set {x ∈ X | h(x) + J ū = ȳ} other Rm and Y1 = U2 = Rp , subject to the negative feedback
than the equilibrium trajectory x(t) = x̄. interconnection of Figure 2:
Definition 4.1 is the natural extension of zero-state observ- u1 = v1 − y2 , u2 = v2 + y1 .
ability to EID systems, requiring that every forced system be
“zero-state” observable. Compared to the general discussion of As is standard, we assume that Ip + J1 J2 is nonsingular,
forced equilibria in Section II-A, Definition 4.1 rules out the which ensures that the feedback interconnection is well-posed.
possibility that two distinct equilibria x̄, x̃ ∈ EΣ yield the same Given constant input vectors v̄1 , v̄2 , the conditions for a forced
input/output pairs through (3). equilibrium of the closed-loop system are that
Proposition 4.2: (Observability & Equilibrium Unique- ȳ1 ∈ KΣ1 (v̄1 − ȳ2 )
ness): If the system (1) is equilibrium-independent observable, (37)
ȳ2 ∈ KΣ2 (v̄2 + ȳ1 ) .
then for a given equilibrium I/O pair (ū, ȳ) ∈ KΣ , there is
exactly one x̄ ∈ EΣ satisfying (3). Lemma A.3 in the appendix presents sufficient conditions
for square EID systems which guarantee that for any pair of
Proof: Let (ū, ȳ) ∈ KΣ be an equilibrium I/O pair and sup- constant inputs (v̄ , v̄ ), the simultaneous inclusions (37) are
1 2
pose that x̄ and x̄0 are distinct points both satisfying (3). Then uniquely solvable for corresponding outputs (ȳ , ȳ ). We will
0 1 2
x(t) = x̄ and x(t) = x̄ are both trajectories of ẋ = f (x)+Gū, make explicit use of this lemma in Section IV-C. For now,
and both remain within the set {x ∈ X | h(x) + J ū = ȳ}, we simply assume that (37) yields a well-defined equilibrium
which contradicts equilibrium-independent observability. input-output relation K
Σcl ⊂ (U1 × U2 ) × (Y1 × Y2 ) for the
closed-loop system.
5 The system is said to be zero-state observable if no solution of ẋ = f (x)
Theorem 4.4: (Dissipativity and Stability of EID Feed-
can stay within the set {x | h(x) = 0p } other than x(t) = 0n .
6 We will restrict our attention to cases where the storage function has a back Systems): Consider the feedback interconnection of
strict local minimum at the equilibrium point. Figure 2. Suppose that
0018-9286 (c) 2018 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TAC.2018.2838664, IEEE
Transactions on Automatic Control
SUBMITTED TO IEEE TRANSACTIONS ON AUTOMATIC CONTROL. THIS VERSION: MAY 14, 2018 9
0018-9286 (c) 2018 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TAC.2018.2838664, IEEE
Transactions on Automatic Control
SUBMITTED TO IEEE TRANSACTIONS ON AUTOMATIC CONTROL. THIS VERSION: MAY 14, 2018 10
Proof: Through a standard loop transformation (see, e.g., [38, since Σ0 is EID with supply rate parameters (40), KΣ0 is ε-
Pg. 267]), we may transform the feedback interconnection of cocoercive, and is therefore maximally monotone (Lemma A.1).
Figure 3 to the feedback interconnection in Figure 4. The new Applying Lemma A.3 with KΣ1 = KΣ0 and KΣ2 = Kψ0 , we
nonlinearity ψ 0 : Rm → Rm in the feedback path satisfies conclude that the closed-loop system in Figure 4 possesses a
the incremental dissipation inequality (10) with parameters unique equilibrium I/O pair (ū` , ȳ` ) ∈ KΣ0 with −ū` = ψ 0 (ȳ` ).
1 0
(Qψ0 , Sψ0 , Rψ0 ) = 0, 2 Im , 0 , i.e., ψ is monotone [38, Pg. Therefore, by definition, there exists an associated equilibrium
233]. point x̄ ∈ EΣ0 , and this equilibrium point is unique by
Proposition 4.2. By the previous arguments on equivalence
0m u` y` of equilibria between the systems, x̄ ∈ EΣ as well.
Σ0 Using the EID storage function Vx̄ (x), we compute that
−
V̇x̄ ≤ −εky` − ȳ` k22 + (y` − ȳ` )T (u` − ū` )
= −εky` − ȳ` k22 − (y` − ȳ` )T (ψ 0 (y` ) − ψ 0 (ȳ` ))
−
ψ K −1
+ ≤ −εky` − ȳ` k22 ,
where we have used that ψ 0 is monotone; the rest of the result
K1 follows from Lemma 4.3.
ψ0
Example 4.6: (SMIB Power System): Consider the single-
machine infinite-bus (SMIB) power system model
Fig. 4: Loop-transformed feedback system.
θ̇ = ω ,
We first address the equivalence of equilibria between the M ω̇ = Pm − bV 2 sin(θ) − Dω + u ,
two feedback loops, and the existence of an equilibrium point.
y=ω
Equilibria x̄ of Figure 3 are determined by
where θ ∈ R is the rotor angle, ω ∈ R is the generator fre-
0n = f (x̄) − Gψ(ȳ)
⇔ 0n = f (x̄) − Gψ(h(x̄)) (41) quency, Pm ∈ R is the mechanical power, and M, D, b, V > 0;
ȳ = h(x̄) let y = ω be the output. By inspection, the set of assignable
while equilibria x̃ of Figure 4 are determined by equilibrium points is
EΣ = {(θ̄, ω̄) | θ̄ ∈ R , ω̄ = 0} ,
0n = f (x̃) − GK1 h(x̃) − Gψ 0 (ỹ` ) (42a)
ỹ` = Kh(x̃) − ψ 0 (ỹ` ) with corresponding input ū = ku (θ̄) = bV 2 sin(θ̄) − Pm . For
(42b)
a fixed Γ ∈ [0, π/2), we restrict our attention to equilibria
Since ψ 0 is continuous and monotone, the mapping z 7→ z + in the set Θ(Γ) × {0} ⊂ EΣ where Θ(Γ) = {θ | |θ| ≤ Γ};
ψ 0 (z) is continuous and 1-strongly monotone, and therefore for this ensures that the nonlinearity sin(·) is strongly monotone
every b ∈ Rm the equation b = γ(z) := z +ψ 0 (z) has a unique in a neighbourhood of any equilibrium θ̄ ∈ Θ(Γ). We
solution; we denote this solution by z = γ −1 (b). It follows further assume that |Pm | ≤ bV 2 sin(Γ), which is necessary
that (42b) may be uniquely solved for ỹ` = γ −1 (Kh(x̃)), and and sufficient for the existence of an equilibrium θ̄ ∈ Θ(Γ)
(42) is therefore equivalent to the single equation when u = 0. Consider now the frequency feedback control
0n = f (x̃) − GX(h(x̃)) , (43) u = −ψ(ω), where ψ : R → R is incrementally in the
sector [α, β] with α < β and ψ(0) = 0.9 Following Theo-
where X(h) := K1 h + ψ 0 (γ −1 (Kh)). Comparing (41) and rem 4.5, we examine the loop-transformed system (39). Let
(43), equivalence of equilibria will follow if ψ = X. To show V (θ, ω) = 12 M ω 2 + bV 2 (1 − cos(θ)); this function is strongly
this, note from Figure 4 that ψ 0 is defined by convex in a neighbourhood of (θ̄, 0) ∈ Θ(Γ) × {0}. Using
(11), a simple computation shows that (39) is quadratically
ψ 0 (z 0 ) = ψ(K −1 (z 0 + ψ 0 (z 0 ))) − K1 K −1 (z 0 + ψ 0 (z 0 )) . EID with parameters (40), where ε = (D + α)/(2D + β + α).
Substituting γ(z 0 ) = z 0 + ψ 0 (z 0 ), we find that It follows that the closed-loop equilibrium point (θ̄, 0) is locally
asymptotically stable for α > −D and α < β < +∞.
ψ 0 (z 0 ) = ψ(K −1 γ(z 0 )) − K1 K −1 γ(z 0 ) .
V. E Q U I L I B R I U M - I N D E P E N D E N T D I S S I PAT I V I T Y
Changing variables now to h := γ −1 (Kz 0 ), this further
FOR DISCRETE-TIME CONTROL-AFFINE SYSTEMS
simplifies to
In this section we consider discrete-time control-affine
ψ 0 (γ −1 (Kh)) = ψ(h) − K1 h nonlinear systems with constant input and throughput matrices
(
from which it follows by comparison that ψ(h) = X(h). xt+1 = f (xt ) + Gut
Therefore, the equilibrium sets of the two feedback systems are Σ: (44)
yt = h(xt ) + Jut
equal. To address existence and uniqueness of an equilibrium
point, note that since ψ 0 is a continuous monotone function, 9 In this particular case, the interconnection preserves the open-loop equi-
Kψ0 = ψ 0 is maximally monotone (Lemma A.1). Moreover, librium point (θ̄, ω̄) ∈ Θ(Γ) × {0}.
0018-9286 (c) 2018 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TAC.2018.2838664, IEEE
Transactions on Automatic Control
SUBMITTED TO IEEE TRANSACTIONS ON AUTOMATIC CONTROL. THIS VERSION: MAY 14, 2018 11
where t ∈ Z≥0 is the time index. Similarly to Section II-A, Lemma 3.3 holds for discrete-time systems without changes.
the set of assignable equilibrium points for (44) is To go from dissipativity to equilibrum-independent dissipativity
( for continuous-time systems in Section III, we were obliged to
X if m = n (i) strengthen the requirements on the storage function (in the
EΣ :=
{x̄ ∈ X | G⊥ (x̄ − f (x̄)) = 0n−m } if m < n continuous-time case, convexity was assumed), and (ii) replace
the first two Hill-Moylan conditions (6a)–(6b) with incremental
with equilibrium-to-input map ū = ku (x̄) = (GT G)−1 GT (x̄ − variants. To obtain similar results for discrete-time, we will be
f (x̄)) and equilibrium-to-output map ȳ = ky (x̄) = h(x̄) + J ū. obliged to do the same. Here in discrete-time, we strengthen the
requirement that V (f (x) + Gu) be quadratic in u to requiring
A. Review of Discrete-Time Dissipativity quadratic storage functions V (x) = xT P x.
In this subsection we make the additional assumptions that Lemma 5.3: (Conditions for Discrete-Time EID): Consider
f (0n ) = 0n and h(0n ) = 0p . Mirroring the definitions from the discrete-time control-affine system Σ in (44). Let P =
Section II-B, the system (44) is dissipative with respect to the P T ∈ Rn×n be positive semidefinite, and for x̄ ∈ EΣ , let
supply rate (5) if there exists a storage function V : X → R≥0 Vx̄ (x) := kx − x̄k2P . The system Σ is EID with respect to the
with V (0n ) = 0 such that supply rate w(u, y) in (5) with storage function Vx̄ (x) if and
only if there exists an integer k > 0, a matrix W ∈ Rk×m and
V (xt+1 ) − V (xt ) ≤ w(ut , yt ) ,
a continuous function ` : X × X → Rk such that
for all t ∈ Z≥0 and all inputs u ∈ `m 2e [0, ∞). kf (x)−f (x̄)k2P − kx − x̄k2P = −k`(x, x̄)k22
While the characterization of continuous-time quadratically (47a)
dissipative control-affine systems is well understood, the situa- + [h(x) − h(x̄)]T Q[h(x) − h(x̄)]
tion for discrete-time control-affine systems is less settled. The [f (x) − f (x̄)]T P G = [h(x) − h(x̄)]T (QJ + S)
cases of lossless and passive systems were studied in [39], [40]. (47b)
− `(x, x̄)T W
Dissipativity with general quadratic supply rates was studied
in [41] and further generalized to arbitrary supply rates in [42], W TW = R b − GT P G (47c)
[43], which is the most general result the author is aware of. b = R + J T S + S T J + J T QJ. The function `(x, x̄)
where R
All useful known results however are restricted to the situation
appearing in (12a)–(12b) may always be chosen to have the
where the storage function V (xt+1 ) = V (f (xt ) + Gut )
form
evaluated at the next time step is a quadratic function of ut .
Under this restriction, the following result is known. `(x, x̄) = l(x) − l(x̄) + T q(x, x̄) ,
Lemma 5.1: (Discrete-Time Hill-Moylan Conditions [43]): where l : X → Rk , the columns of T ∈ Rk×r with r =
Consider the control-affine system Σ in (44). Suppose there dim(ker(W T )) form a basis for ker(W T ), and q : X ×X → Rr
exists a twice continuously-differentiable function V : X → satisfies q(x, x) = 0r for all x ∈ X .
R≥0 such that V (f (x) + Gu) is quadratic in u. Then Σ is
Proof: See appendix.
dissipative with respect to the supply rate (5) with storage
function V (x) if and only if there exists an integer k > 0 and
Equation (47c) is the third condition from Lemma 5.1,
continuous functions l : X → Rk , W : X → Rk×m , such that
specialized to a quadratic storage function, while (47a)–(47b)
are incremental variants of the previous conditions (45a)–(45b).
V (f (x)) − V (x) = h(x)T Qh(x) − kl(x)k22 (45a) To interpret the new condition (47a), consider the case where
1 P 0 and Q 0. Then (47a) implies that
∇V (f (x))T G = h(x)T (QJ + S) − W (x)T l(x) (45b)
2 kf (x) − f (x̄)k2P ≤ kx − x̄k2P .
T 1 T 2
W (x) W (x) = R − G [∇ V (f (x))]G ,
b (45c)
2 for all (x, x̄) ∈ X × EΣ . If this holds for all x, x̄ ∈ X ,
T T
where R = R + J S + S J + J QJ.
b T then f is non-expansive on X in the norm k · kP . Thus,
Lemma 5.3 replaces the stability-like condition (45a) with
the new incremental-stability-like condition (47a). Internal and
B. Discrete-Time Equlibrium-Independent Dissipativity feedback stability results for EID systems can be derived in
We begin with the key definition. the discrete-time case just as they were in continuous-time in
Section IV; we omit the details, but illustrate the application
Definition 5.2: (Discrete-Time EID): The control-affine
of these results with an example.
system (44) is equilibrium-independent dissipative (EID) with
supply rate w(u, y) if, for every equilibrium x̄ ∈ EΣ , there Example 5.4: (Input/Output Gradient Method): Consider
exists a storage function Vx̄ : X → R≥0 such that Vx̄ (x̄) = 0 the unconstrained optimization problem
and
Vx̄ (xt+1 ) − Vx̄ (xt ) ≤ w(ut − ū, yt − ȳ) , (46) minimize φ(x) (48)
x∈Rn
0018-9286 (c) 2018 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TAC.2018.2838664, IEEE
Transactions on Automatic Control
SUBMITTED TO IEEE TRANSACTIONS ON AUTOMATIC CONTROL. THIS VERSION: MAY 14, 2018 12
gradient method for (48): Applying Lemma A.4 (see appendix), we conclude that the
I/O mapping v 7→ x has finite equilibrium-independent `2 -
xt+1 = xt − α(∇φ(xt ) − vt ) gain, bounded as
(49) √
yt = xt 1+ 2µα+1
1 µα +
kΣv 7→ x k2`2 2
≤ γ := 2 2 1
4
. (52)
where α > 0 is the step size and v ∈ `n2e [0, ∞) is an auxiliary µ 1 − 1+√2µα+1
input. We interpret v as a disturbance to (or error in) the
Note that the Lipschitz constant L of ϕ does not enter
calculated gradient ∇φ(xt ), with v = 0m recovering the usual
explicitly10 into this bound, which depends only on the strong
gradient method [44, Sec. 1.2]. A standard analysis from the
convexity parameter µ and the step size α. The upper bound
optimization literature when v = 0m shows that, under the
is a monotonically increasing function of α; small step sizes
stated assumptions, the gradient method (49) converges to the
therefore improve the worst-case I/O performance, but will also
unique global minimizer of φ if α < L2 [44, Prop. 1.2.3].
lead to slower convergence. Finally, we note that the bound
We will show that this result can be obtained via EID theory.
satisfies γ → 1/µ as α → 0 (c.f. [26, Theorem 4.1]). Therefore,
To begin, the system (49) can be considered as the negative
input-output performance is ultimately limited by the modulus
feedback interconnection of the LTI system
of strong convexity of φ.
xt+1 = xt + αut
(50)
yt = xt VI. CONCLUSIONS
This paper has presented a systematic treatment of
with the static nonlinearity ỹt = ∇φ(ũt ), i.e., the interconnec- equilibrium-independent dissipativity for a common class of
tion ut = −∇φ(yt ) + vt . Regarding (50), note that ū = 0n is control-affine nonlinear systems. We have provided a Hill-
the only possible equilibrium input. Consider now the function Moylan-type characterization of EID for both continuous and
1
V (x) = 2α kxk22 , leading to the candidate EID storage function discrete-time systems, presented some associated internal and
1
family Vx̄ (x) = 2α kx− x̄k22 . A simple computation shows that feedback stability results, and applied the results to examples
along trajectories of (50), in both continuous and discrete time.
α T Future work will explore applications of these results to
Vx̄ (xt+1 ) − Vx̄ (xt ) = (yt − ȳ)T ut + u ut . (51) the analysis and control of large-scale cyber-physical systems
2 t
[46], in particular to applications in power systems. For
Therefore, (50) is EID with supply parameters (Q, S, R) = such applications, extending the present results to differential-
(0, 12 In , α2 In ). algebraic systems would be desirable. Another key direction
Since φ is µ-strongly convex, ∇φ is µ-strongly mono- is to further apply EID and the associated Hill-Moylan con-
tone and satisfies the EID inequality (10) with (Q, S, R) = ditions developed here to the analysis and design of convex
(0, 21 In , −µIn ). Moreover, since ∇φ is both monotone and optimization algorithms. In this latter context, an EID-based
L-Lipschitz, it is also L1 -cocoercive [31, Corollary 18.16], approach seems particularly well suited due to the presence
and therefore ∇φ satisfies a second EID inequality with of monotone nonlinearities, and similar to [45] may provide
(Q, S, R) = (− L1 In , 12 In , 0). Taking a convex combination an intuitive framework for both certifying and improving algo-
of these two EID inequalities, it follows that for any λ ∈ rithm performance. Treating EID from a purely input/output
[0, 1], ∇φ satisfies the EID inequality (10) with (Q, S, R) = point of view is also of interest, as is developing local versions
(−λ L1 In , 21 In , −(1 − λ)µIn ). Applying (the discrete-time ana- of the results herein.
log of) Theorem 4.4, it follows that for any λ ∈ [0, 1], the
interconnection with input vt and outputs (yt , ỹt ) is EID with AC K N OW L E D G E M E N T S
supply rate (Qcl , Scl , Rcl ) given by The author thanks N. Monshizadeh, C. Nielsen, B. Bamieh,
and J. Marden for helpful discussions related to this work.
(1 − λ)µ 0 1/2 α
Qcl = − λ α , Scl = , Rcl = .
0 − α/2 2
L 2 REFERENCES
The closed-loop system is internally stable if Qcl ≺ 0, which [1] J. C. Willems, “Dissipative dynamical systems–Part I: General theory,”
Archive for Rational Mechanics and Analysis, vol. 45, no. 5, pp. 321–351,
is true if and only if λ ∈ (0, 1) and 0 < α < αcrit (λ) := L2 λ. 1972.
Maximizing the upper bound αcrit (λ) over λ ∈ (0, 1), we see [2] G. Zames, “On the input-output stability of time-varying nonlinear
that α ∈ (0, L2 ) is sufficient for stability, which recovers the feedback systems – Part I: Conditions derived using concepts of loop
gain, conicity, and positivity,” IEEE Transactions on Automatic Control,
known step-size result. vol. 11, no. 2, pp. 228–238, 1966.
Moving beyond stability to input-output performance, we can [3] P. Moylan, “Implications of passivity in a class of nonlinear systems,”
examine the equilibrium-independent `2 -gain for the mapping IEEE Transactions on Automatic Control, vol. 19, no. 4, pp. 373–381,
1974.
vt 7→ yt = xt , as a measure of robustness to disturbances. [4] D. Hill and P. Moylan, “The stability of nonlinear dissipative systems,”
For this mapping, we set λ = 0 and therefore have EID with IEEE Transactions on Automatic Control, vol. 21, pp. 708–711, 1976.
respect to the supply rate [5] R. Sepulchre, M. Janković, and P. V. Kokotović, Constructive Nonlinear
Control. Springer, 1997.
α T
w(v, y) = −µy T y + y T v + v v. 10 In practice of course, α must be selected with some knowledge of L [45].
2
0018-9286 (c) 2018 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TAC.2018.2838664, IEEE
Transactions on Automatic Control
SUBMITTED TO IEEE TRANSACTIONS ON AUTOMATIC CONTROL. THIS VERSION: MAY 14, 2018 13
[6] B. Brogliato, R. Lozano, B. Maschke, and O. Egeland, Dissipative [32] M. Zamani and R. Majumdar, “A Lyapunov approach in incremental
Systems Analysis and Control. Springer, 2007. stability,” in IEEE Conf. on Decision and Control and European Control
[7] A. J. van der Schaft, L2-Gain and Passivity Techniques in Nonlinear Conference, Orlando, FL, USA, Dec. 2011, pp. 302–307.
Control, 3rd ed. Springer, 2016. [33] A. Pavlov, A. Pogromsky, N. Van de Wouw, and H. Nijmeijer, “Con-
[8] A. Pavlov and L. Marconi, “Incremental passivity and output regulation,” vergent dynamics, a tribute to Boris Pavlovich Demidovich,” Systems &
Systems & Control Letters, vol. 57, no. 5, pp. 400 – 409, 2008. Control Letters, vol. 52, no. 3-4, pp. 257–261, 2004.
[9] F. Forni and R. Sepulchre, “On differentially dissipative dynamical [34] J. W. Simpson-Porco and F. Bullo, “Contraction theory on Riemannian
systems,” IFAC Symposium on Nonlinear Control Systems, vol. 46, no. 23, manifolds,” Systems & Control Letters, vol. 65, pp. 74–80, 2014.
pp. 15 – 20, 2013. [35] N. Monshizadeh, P. Monshizadeh, R. Ortega, and A. van der Schaft, “Con-
[10] A. van der Schaft, “On differential passivity,” IFAC Symposium on ditions on shifted passivity of port-Hamiltonian systems,” Automatica,
Nonlinear Control Systems, vol. 46, no. 23, pp. 21 – 25, 2013. 2014, submitted.
[11] M. Bürger and C. D. Persis, “Dynamic coupling design for nonlinear [36] J. Wang and N. Elia, “A control perspective for centralized and distributed
output agreement and time-varying flow control,” Automatica, vol. 51, convex optimization,” in IEEE Conf. on Decision and Control and
pp. 210 – 222, 2015. European Control Conference, Orlando, FL, USA, Dec. 2011, pp. 3800–
3805.
[12] G. B. Stan and R. Sepulchre, “Analysis of interconnected oscillators by
[37] D. Feijer and F. Paganini, “Stability of primal–dual gradient dynamics
dissipativity theory,” IEEE Transactions on Automatic Control, vol. 52,
and applications to network optimization,” Automatica, vol. 46, no. 12,
no. 2, pp. 256–270, 2007.
pp. 1974–1981, 2010.
[13] T. Liu, D. J. Hill, and J. Zhao, “Incremental-dissipativity-based output [38] H. K. Khalil, Nonlinear Systems, 3rd ed. Prentice Hall, 2002.
synchronization of dynamical networks with switching topology,” in [39] C. I. Byrnes and W. Lin, “Losslessness, feedback equivalence, and the
IEEE Conf. on Decision and Control, Los Angeles, CA, USA, Dec. global stabilization of discrete-time nonlinear systems,” IEEE Transac-
2014, pp. 4591–4596. tions on Automatic Control, vol. 39, no. 1, pp. 83–98, 1994.
[14] H. Pang and J. Zhao, “Incremental (Q, S, R)-dissipativity and incremen- [40] W. Lin and C. I. Byrnes, “Passivity and absolute stabilization of a class
tal stability for switched nonlinear systems,” Journal of the Franklin of discrete-time nonlinear systems,” Automatica, vol. 31, no. 2, pp. 263
Institute, vol. 353, no. 17, pp. 4542 – 4564, 2016. – 267, 1995.
[15] G. H. Hines, M. Arcak, and A. K. Packard, “Equilibrium-independent [41] I. C. Goknar and N. S. Sengor, “Discrete-time version of Kalman-
passivity: A new definition and numerical certification,” Automatica, Yacubovitch-Popov lemma for non-linear systems,” in IEEE International
vol. 47, pp. 1949–1956, 2011. Conference on Electronics, Circuits and Systems, vol. 1, Lisboa, Portugal,
[16] M. Bürger, D. Zelazo, and F. Allgöwer, “On the steady-state inverse- Sep. 1998, pp. 79–82.
optimality of passivity-based cooperative control,” IFAC Workshop on [42] E. M. Navarro-López, H. Sira-Ramı́rez, and E. Fossas-Colet, “Dissipativ-
Distributed Estimation and Control in Networked Systems, vol. 46, no. 27, ity and feedback dissipativity properties of general nonlinear discrete-time
pp. 138 – 143, 2013. systems,” European Journal of Control, vol. 8, no. 3, pp. 265 – 274,
[17] ——, “Duality and network theory in passivity-based cooperative control,” 2002.
Automatica, vol. 50, no. 8, pp. 2051 – 2061, 2014. [43] E. M. Navarro-López, “QSS-dissipativity and feedback QS-passivity of
[18] B. Jayawardhana, R. Ortega, E. Garcia-Canseco, and F. Castanos, “Pas- nonlinear discrete-time systems,” Dynamics of Continuous Discrete and
sivity of nonlinear incremental systems: Application to pi stabilization Impulsive Systems, Series B: Applications & Algorithms, vol. 14, no. 1b,
of nonlinear rlc circuits,” Systems & Control Letters, vol. 56, no. 9, pp. pp. 47–64, 2007.
618 – 622, 2007. [44] D. P. Bertsekas, Nonlinear Programming, 1st ed. Athena Scientific,
[19] S. Aranovskiy, R. Ortega, and R. Cisneros, “Robust PI passivity-based 1995.
control of nonlinear systems: Application to port-Hamiltonian systems [45] L. Lessard, B. Recht, and A. Packard, “Analysis and design of opti-
and temperature regulation,” in American Control Conference, Chicago, mization algorithms via integral quadratic constraints,” SIAM Journal on
IL, USA, 2015, pp. 434–439. Optimization, vol. 26, no. 1, pp. 57–95, 2016.
[20] C. Meissen, L. Lessard, M. Arcak, and A. K. Packard, “Compositional [46] P. J. Antsaklis, B. Goodwine, V. Gupta, M. J. McCourt, Y. Wang, P. Wu,
performance certification of interconnected systems using ADMM,” M. Xia, H. Yu, and F. Zhu, “Control of cyberphysical systems using
Automatica, vol. 61, pp. 55 – 63, 2015. passivity and dissipativity based methods,” European Journal of Control,
[21] M. Arcak, C. Meissen, and A. Packard, Networks of Dissipative Sys- vol. 19, no. 5, pp. 379 – 388, 2013.
tems: Compositional Certification of Stability, Performance, and Safety. [47] R. A. Horn and C. R. Johnson, Matrix Analysis, 2nd ed. Cambridge
Springer Briefs in Control, Automation and Robotics, 2016. University Press, 1985.
[22] J. T. Wen and M. Arcak, “A unifying passivity framework for network
flow control,” IEEE Transactions on Automatic Control, vol. 49, no. 2,
pp. 162–174, 2004.
[23] S. Trip, M. Bürger, and C. D. Persis, “An internal model approach to
(optimal) frequency regulation in power grids with time-varying voltages,”
Automatica, vol. 64, pp. 240 – 253, 2016.
[24] S. Trip and C. D. Persis, “Distributed optimal load frequency control
with non-passive dynamics,” IEEE Transactions on Control of Network
Systems, vol. PP, no. 99, pp. 1–1, 2017.
[25] C. D. Persis and N. Monshizadeh, “Bregman storage functions for
microgrid control,” IEEE Transactions on Automatic Control, vol. 63,
no. 1, pp. 53–68, 2018.
[26] J. W. Simpson-Porco, “Input/output analysis of primal-dual gradient algo- John W. Simpson-Porco (S’11–M’16) received the
rithms,” in Allerton Conf. on Communications, Control and Computing, B.Sc. degree in engineering physics from Queen’s
Monticello, IL, USA, Sep. 2016, pp. 219–224. University, Kingston, ON, Canada in 2010, and the
[27] A. A. Alonso and E. B. Ydstie, “Stabilization of distributed systems using Ph.D. degree in mechanical engineering from the
irreversible thermodynamics,” Automatica, vol. 37, no. 11, pp. 1739 – University of California at Santa Barbara, Santa
1755, 2001. Barbara, CA, USA in 2015.
[28] J. W. Simpson-Porco, “A Hill-Moylan lemma for equilibrium- He is currently an Assistant Professor of Electrical
independent dissipativity,” in American Control Conference, Milwaukee, and Computer Engineering at the University of Wa-
WI, USA, Jul. 2018, to Appear. terloo, Waterloo, ON, Canada. He was previously a
[29] R. Ortega, A. van der Schaft, F. Castanos, and A. Astolfi, “Control by visiting scientist with the Automatic Control Labora-
interconnection and standard passivity-based control of port-Hamiltonian tory at ETH Zürich, Zürich, Switzerland. His research
systems,” IEEE Transactions on Automatic Control, vol. 53, no. 11, pp. focuses on the control and optimization of multi-agent systems and networks,
2527–2542, 2008. with applications in modernized power grids.
[30] J. M. Lee, Introduction to Smooth Manifolds. Springer, 2003. Prof. Simpson-Porco is a recipient of the 2012–2014 IFAC Automatica
[31] H. H. Bauschke and P. L. Combettes, Convex Analysis and Monotone Prize and the Center for Control, Dynamical Systems and Computation Best
Operator Theory in Hilbert Spaces, 1st ed. Springer, 2011. Thesis Award and Outstanding Scholar Fellowship.
0018-9286 (c) 2018 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TAC.2018.2838664, IEEE
Transactions on Automatic Control
SUBMITTED TO IEEE TRANSACTIONS ON AUTOMATIC CONTROL. THIS VERSION: MAY 14, 2018 14
0018-9286 (c) 2018 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TAC.2018.2838664, IEEE
Transactions on Automatic Control
SUBMITTED TO IEEE TRANSACTIONS ON AUTOMATIC CONTROL. THIS VERSION: MAY 14, 2018 15
Σ in (1) is dissipative with respect to the supply rate which shows that f (x1 , x2 ) = −f (x2 , x1 ). Finally, set g(x) =
f (x, 0n ) and set x3 = 0n in (i) to find that
w(u, y) = −ay T y + y T u + buT u
f (x1 , x2 ) = −f (x2 , 0n ) − f (0n , x1 ) = −g(x2 ) + g(x1 ) ,
where a > 0 and b ≥ 0, then it is dissipative with respect to
the supply rate which shows the result.
T 2 T
w̃(u, y) = −y y + γ u u
with √
1 ab + 1+ 4ab+1
γ2 = 2 1
4
(58)
a 1 − 1+√4ab+1
1
w(u, y) = −ay T y − (y − δu)T (y − δu)
2δ
| {z }
≥0
δ 1
+ buT u + uT u + y T y
2 2δ
1 T δ
≤− a− y y+ b+ uT u
2δ 2
1
After rescaling by a − 2δ > 0, this is equivalent to dissipativity
with respect to the supply rate
w̄(u, y) = −y T y + Γ(δ)uT u
0018-9286 (c) 2018 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.