Professional Documents
Culture Documents
Robusth2
Robusth2
2
deconvolutionltering
Xavier Bombois
a
Hakan Hjalmarsson
b
Gerard Scorletti
c
a
Delft Center for Systems and Control, Mekelweg 2, 2628 CD Delft, The Netherlands
b
ACCESS Linnaeus Center, Electrical Engineering, KTH Royal Institute of Technology, S-100 44 Stockholm, Sweden
c
Laboratoire Amp`ere, Ecole Centrale de Lyon, 36 avenue Guy de Collongue - 69134 Ecully Cedex, France
Abstract
This paper addresses robust deconvolution ltering when the system and noise dynamics are obtained by parametric system
identication. Consistent with standard identication methods, the uncertainty in the estimated parameters is represented
by an ellipsoidal uncertainty region. Three problems are considered: 1) Computation of the worst case H2 performance of a
given deconvolution lter in this uncertainty set. 2) Design of a lter which minimizes the worst case H2 performance in this
uncertainty set. 3) Input design for the identication experiment, subject to a limited input power budget, such that the lter
in 2) gives the smallest possible worst-case H2 performance. It is shown that there are convex relaxations of the optimization
problems corresponding to 1) and 2) while the third problem can be treated via iterating between two convex optimization
problems.
1 Introduction
In many applications it is of interest to estimate the
input to a dynamical system given measurements of
the output, examples include seismic signal process-
ing [12], telecommunication [8], etc. Compounding
factors are that in general measurements are noise
corrupted and, furthermore, that the system through
which the signal passes is not known exactly but un-
certain. In deconvolution ltering the original signal is
estimated by ltering the measured signal(s) through
a lter. The measured signal is {y} which is given by
y(t) = G
0
(z)u(t) + H
0
(z)e(t) where G
0
is the dynam-
ics of the system through which {u} passes and where
the term H
0
(z)e(t) represents an aggregation of distur-
bances, modelled as zero mean white noise {e} ltered
through some dynamics H
0
. The measured signal y
is ltered through the causal deconvolution lter F,
resulting in the estimate u(t n
k
) = F(z)y(t). The
delay n
k
corresponds to the degree of non-causality (or
smoothing) that will be allowed in the ltering.
In the sequel, we will suppose that all signals are wide-
sense stationary and that the power spectrum
u
()
of the signal u(t) is given by
u
() = |W
u
(e
j
)|
2
with
W
u
(z) being a known stable transfer function. The vari-
ance of e(t) is denoted by
2
e
. We assume that u and e
are independent. We will also assume that G
0
and H
0
are stable linear time invariant systems and H
0
is fur-
ther assumed to be inversely stable and monic.
The lter F(z) should be designed in order to give an
accurate estimate of the input signal. By this we mean
an estimate such that the mean-square error J
0
(F) =
E
_
( u(t) u(t))
2
:= lim
N
1
N
N
t=1
E
_
( u(t) u(t))
2
N
and shaped by the
inverse R of the covariance matrix P
of
N
:
U = { | (
N
)
T
R (
N
) < } (2)
Preprint submitted to Automatica 24 September 2009
where is a constant related to the desired probability
level Pr(
0
U) and R can be estimated from the data
[11]. This ellipsoid U thus characterizes the uncertainty
of both G and H. To the best of the authors knowledge,
the use of parametric ellipsoidal uncertainty in robust
H
2
-deconvolution ltering is new. Consequently, the rst
technical contribution of this paper is to give a solution
for the robust H
2
deconvolution problem with such un-
certainty description. To do so, we adopt the dynamic
multiplier approach of [13] since, as stressed in [13], this
is the least conservative and the most universally appli-
cable of the existing methods. Our contribution is to de-
duce an appropriate factorization of the dynamic multi-
plier for the nonstandard uncertainty (2) and to adapt
the continuous-time results of [13] to the case of discrete-
time systems as considered in prediction error identi-
cation.
G()
H()
F
+
e(t)
y(t)
M(z)
e(t)
(t)
u(t)
z
-nk
+
+
-
(t)
u(t)
q(t) p(t)
Fig. 1. Filter to be analyzed (left) and corresponding LFT
loop (right).
More specically, let us consider Figure 1 (left-
hand side) where the true system has been re-
placed by G(z, ) and H(z, ) for one arbitrary
U and let us dene J(, F) =
E
_
2
(t, )
where
(t, )
= F(z) (G(z, )u(t) +H(z, )e(t))u(tn
k
). We
have thus that J
0
(F) < if J(, F) < U. Given
this set-up, we will study the following two problems:
1. Performance validation. Given a lter F(z) and
an uncertainty region U, verify that J(, F) < U
for some given . We are in fact interested by the small-
est for which the latter holds (i.e. the worst case per-
formance achieved by the lter over the plants described
by a in U). This worst case performance J
WC
is thus
the solution
opt
of the following optimization problem:
min
s.t. J(, F) < , U
(3)
2. Robust H
2
lter design. Given an uncertainty re-
gion U, determine a lter F such that J(, F) <
U for the smallest possible . The to-be-designed lter
F is thus the solution F
opt
of the following optimization
problem:
min
,F
s.t. J(, F) < , U
(4)
In this paper, we will restrict attention to lters with pre-
specied state-space matrices A
F
and B
F
. This covers,
e.g., FIR lters, which are commonly used in Telecom-
munications applications, but also Laguerre and Kautz
lters.
3. Optimal input design for robust ltering. Fi-
nally, we will also analyze a third problem: the optimal
design of the identication experiment leading to U. An
important characteristic of the uncertainty ellipsoid U
is indeed that it is dependent on the experimental con-
ditions of this identication experiment. These exper-
imental conditions are the number N of input-output
data and the spectrum
u
id
() of the excitation signal
u
id
used during the identication. The subscript id in
u
id
() is there to distinguish the input signal during
the identication (i.e. u
id
) and the one that has to be re-
constructed (i.e. u). In this paper, we will suppose that
the number of data is given and U will therefore be only
dependent on
u
id
(). To show this dependence, U will
be also sometimes denoted by U(
u
id
). More details on
the relation between
u
id
and U(
u
id
) will be given in
Section 4.
Suppose that there is a constraint on the maximal power
for the excitation signal u
id
for the identication exper-
iment, which is supposed to be conducted in open loop.
Suppose also, as mentioned above, that the number N
of data is given. The optimal experiment design problem
consists in this case of determining the input spectrum
u
id
of u
id
that delivers an uncertainty region U(
u
id
)
for which the corresponding robust lter F leads to the
smallest worst case performance. The optimal
u
id
is the
solution
opt
u
id
of the following optimization problem:
min
,F,u
id
(5)
s.t. J(, F) < U(
u
id
) (6)
1
2
_
u
id
() d < (7)
where represents the maximum allowed power. The
corresponding robust lter is then given by the optimal
lter F
opt
in the same optimization problem.
It is important to note that the topic of this paper, in
general, and our optimal input design problemfor robust
ltering, in particular, can be related to the problem of
designing optimal training sequences for wireless com-
munication systems [10]. These training sequences are
used to identify a model of the communication channel
that can be subsequently used to design a lter for the
reconstruction of the emitted signal from the received
signal. The problem considered in [10] is nevertheless
restricted to static transfer functions G
0
and the objec-
tive of optimizing the performance of the reconstruction
2
lter (used in the above formulation) is replaced by a
simpler criterion on the matrix R dening U.
The three problems presented above will be covered in
the ensuing three sections. Section 5 contains a numeri-
cal illustration and the paper is concluded in Section 6.
2 Validation problem
2.1 Reformulation in the LFT framework
The validation problem(3) is basically a robustness anal-
ysis problem. Solving such a problem requires to refor-
mulate it in the LFT framework where the uncertain el-
ements (i.e. the parameter vector in our case) are sep-
arated from the other elements [17]. For this purpose,
let us rst take a look at Figure 1. Since e and u are
independent and since
u
() = |W
u
(e
j
)|
2
, we can say
that u(t) = W
u
(z) u(t) and e(t) =
e
e(t) with u(t) and
e(t) independent white noises with unit variance. Conse-
quently, the cost function J(F, ) is equal to the squared
H
2
-gain of the vector of transfer functions:
V(z) =
_
e
F(z)H(z, ) ((F(z)G(z, )) z
n
k
)W
u
(z)
_
which is the transfer function between
_
e(t)
u(t)
and (t).
We have thus:
J(F, ) = V(z)
2
2
:=
1
2
_
Trace(V
(e
j
)V(e
j
)) d
The dierent parametrizations of G(z, ) and H(z, )
which are commonly used in prediction error identica-
tion (ARX, BJ,.. structures) [11] can all be expressed as:
G(z, ) =
Z
1
1 +Z
2
H(z, ) =
1 +Z
3
1 +Z
4
(8)
with Z
i
(z) row vectors of dimension k containing only
delays and zeros and R
k1
. We observe that both
G(z, ) and H(z, ) can be easily transformed into an
LFT in [17]. Consequently, the transfer function be-
tween v(t) :=
_
e(t)
u(t)
N
). It is to
be noted that the uncertainty structure in this prob-
lem is similar to the one we obtain from identication
of MIMO systems (see our previous contribution [1]).
Thus, we have that
_
p
_
=
=M(z)
..
_
M
11
M
12
M
21
M
22
__
q
v
_
, q =
=
..
_
0
0
_
p (9)
(see the right-hand side of Figure 1), which is an
LFT transformation. We will use the notation (t) =
F(M(z), )v(t).
Based on what has been developed above, Problem 1
(see (3)) can be reformulated as follows:
min
s.t. F(M(z), )
2
2
< U
(10)
with as in (9).
To be able to develop some of the coming results, it will
be necessary to make the following two assumptions.
Assumption 1 The transfer functions G(z, ) and
H(z, ) are stable for all U.
Assumption 2 The transfer matrix M
12
(z) in (9) has
no direct term i.e. M
12
(z) contains at least one delay.
Recall that we have assumed that both G
0
(z) and H
0
(z)
are stable. Assumption 1 states thus that the systems
in the uncertainty regions (1) for G
0
and H
0
are also
stable. Given an uncertainty U, Assumption 1 can be
easily veried using the results in [7]. If, for a given U,
we conclude that Assumption 1 does not hold, then we
can also conclude that the worst case performance J
WC
(the solution of (3)) is equal to innity. Assumption 2 is
also not restrictive since, given the parametrization (8)
where the vectors Z
i
(z) have no direct terms, the LFT
relation (9) can always be chosen such that the matrix
M
12
(z) has no direct term.
2.2 Multiplier describing the uncertainty
As mentioned in the introduction, we will solve (10)
using an approach based on dynamic multipliers. For
this purpose, we need to dene a very general ane
parametrization of the set of hermitian matrices sat-
isfying:
U =
_
I
_T
I
_
> 0 (11)
The matrix is a representation of the structure of the
uncertainty and is called multiplier (see e.g. [14]). Ro-
bustness problems can generally be solved by solving an
LMI system where it is required to nd a family of these
multipliers i.e. one multiplier for each frequency (dy-
namic multiplier). This family will be represented by in-
troducing the frequency-dependent notation: (). For
H
2
analysis problems such as in (10), this frequency de-
pendence will have to take the form of the frequency re-
sponse of a matrix of transfer functions. More precisely,
we will need a factorized version of () of the form:
() =
(e
j
) P (e
j
) (12)
where P = P
T
is a frequency-independent matrix and
(z) is a matrix of stable transfer functions.
An appropriate expression for the multiplier () of the
nonstandard uncertainty set has been developed in our
3
recent contribution [1]. However, in that paper, treating
an H
i
(e
j
) (i = 0...b), the multiplier
() satisfying (11) can be factorized into (12) with:
(z) =
_
_
_
_
_
_
_
B(z) I
2k
0
0 B(z) I2
I
2k
0
0 I2
_
_
_
_
_
_
_
and P =
_
_
_
_
LR 0
0
_
_
P
T
21
P21 0
_
_
with =
_
_
_
_
_
0
b
.
.
. 0 0
T
b
0 0
_
_
_
_
_
; LR =
R
P21 =
_
_
_
_
_
_
_
_
K0...K
b
_
+
_
L0...L
b
_
_
_
_
_
0
...
b
_
_
_
_
T
_
_
_
_
0
...
b
_
_
_
_
T
_
0...
b
_
+
_
0...
b
_
0
_
_
_
_
_
_
_
The elements
i
,
i
,
i
, L
i
and K
i
(i = 0..b) of the
parametrization of P can take any values provided that:
i =
_
_
li,1 li,2
li,2 li,3
_
_
; i =
_
_
0
li,2
li,2 0
_
_
Li =
_
_
Li,1 Li,2
Li,2 Li,3
_
_
; Ki =
_
_
0 Ki,2
Ki,2 0
_
_
with l
i,j
and
l
i,j
R
1k
and with K
i,j
= K
T
i,j
R
kk
and L
i,j
= L
T
i,j
R
kk
. Finally, the elements of the
matrix are constrained as follows:
i
R
22
(i =
0...b),
0
=
T
0
and there must exist a matrix X = X
T
such that the following LMI is satised:
_
_
A
T
B
XAB X A
T
B
XBB
B
T
B
XAB B
T
B
XBB
_
_
+
_
_
C
T
B
D
T
B
_
_
_
CB DB
_
> 0
(13)
with (A
B
, B
B
, C
B
, D
B
) a state-space realization of B(z)
I
2
. In the sequel, we will denote by P the class of matrices
P having the structure given above.
Remark 1 Dierent types of basis functions can be con-
sidered. Possible choices are orthonormal basis functions
such as the FIR basis functions B(z) = (1 z
1
... z
b
)
T
or the Laguerre basis functions.
In the sequel, we will show that solving (10) will require
the determination of a matrix P having the structure in
Proposition 1. The ane parametrization of P will make
possible a solution via LMI-based optimization.
2.3 LMI formulation for the validation problem
Knowing that the squared H
2
gain of a transfer func-
tion is equivalent to the energy of the pulse response of
this transfer function, it is of interest to restrict the in-
put of the LFT system (9) to signals v(t) = w(t) (with
w
=
_
w
1
w
2
_
T
R
21
and (t) the discrete-time pulse
signal). Considering now the signal q(t) of the LFT (9)
and v(t) = w(t) as inputs and using the transfer ma-
trices M
ij
(z) and (z) (see (9) and (12)), we dene the
following system (in the frequency domain) :
_
_
z1(e
j
)
z2(e
j
)
_
_
=
_
_
(e
j
)
_
_
I
2k
0
M11(e
j
) M12(e
j
)
_
_
_
M21(e
j
) M22(e
j
)
_
_
_
_
_
q(e
j
)
_
_
w1
w2
_
_
_
_
(14)
The state-space representation of this new system is
denoted:
x(t + 1) =Ax(t) +B1q(t) +B2
_
_
w1(t)
w2(t)
_
_
_
_
z1(t)
z2(t)
_
_
=
_
_
C1
C2
_
_
x(t) +
_
_
D11
D21
_
_
q(t) +
_
_
D12
D22
_
_
_
_
w1(t)
w2(t)
_
_
(15)
We are now in position to present a method to compute
an upper bound for the worst case performance J
WC
.
This is done in the following proposition whose proof is
given in Appendix B.
Proposition 2 Consider the validation problem (3) for
the LFT (9) with an uncertainty such that (11) holds.
Consider the class P of matrices P having the structure
given in Proposition 1. Finally, consider that Assump-
tions 1 and 2 hold. Then, the solution
opt
of the follow-
ing LMI optimization problem is an upper bound for the
solution of (3):
min
, Q=Q
T
, K=K
T
, PP
F
u(t-nk)
z2(t)=(t) +
-
Fig. 2. Schematic of system (14).
on F is represented. The minimal state-space represen-
tation for the system (14) can be easily deduced from a
minimal state-space representation for the transfer ma-
trix L dened in Figure 2. Let us therefore suppose that
we have a minimal realization for the transfer matrix L:
x(t + 1) =
A x(t) +
B1q(t) +
B2v(t)
_
_
_
_
q(t)
p(t)
_
_
y(t)
u(t n
k
)
_
_
=
_
C1
C2
C3
_
_
x(t) +
_
D1q
D2q
0
_
_
q(t) +
_
_
0
D2v
D3v
_
_
v(t)
Note that
D
3v
= 0 only when n
k
= 0. Using now
the formulae on page 34 of [17] and denoting by
(A
, B
, C
, D
A 0 0
B
C1 A 0
BF
C2 0 AF
_
_
, B1 =
_
B1
B
D1q
BF
D2q
_
_
, B2 =
_
B2
0
BF
D2v
_
_
C1 =
_
D
C1 C 0
_
, C2 =
_
DF
C2
C3 0 CF
_
and D
11
= D
D
1q
, D
12
= 0, D
21
= D
F
D
2q
, D
22
=
D
F
D
2v
D
3v
. Consequently, we see that C
2
, D
21
and
D
22
are the only matrices which are functions of C
F
and D
F
and that, furthermore, they are linear func-
tions of C
F
and D
F
. Let us now consider the depen-
dence on C
F
and D
F
of the matrix inequality (17) i.e.
B
T
2
KB
2
+D
T
12
PD
12
+D
T
22
D
22
< Q. Because of the prod-
uct D
T
22
D
22
, such an expression is not an LMI in D
F
.
However, using the Schur complement, we see that this
inequality is equivalent to:
_
QB
T
2
KB
2
D
T
12
PD
12
D
T
22
D
22
1
_
> 0 (21)
The latter expression is an LMI in Q, P, K but now also
in D
F
. Similarly (18) is equivalent to an LMI in Q, P,
K, C
F
and D
F
:
_
_
F1(K)
_
C1 D11
_
T
P
_
C1 D11
_ _
C2 D21
_
T
_
C2 D21
_
1
_
_
> 0
(22)
5
The robust lter design problem (4) now can be written
min
, Q=Q
T
, K=K
T
, PP, CF , DF
init
)
T
R(
u
id
)(
init
) < }
R(u
id
) =
N
2
_
F1(e
j
)F
1
(e
j
)u
id
()+F2(e
j
)F
2
(e
j
) d
where
init
is a known initial estimate of the true
system (e.g. obtained from an earlier identication ex-
periment; note that, in the simulation example of next
section, we will use the true parameter vector as ini-
tial estimate) and F
1
= H
1
(z,
init
)
G(z,)
init
and
F
2
= H
1
(z,
init
)
H(z,)
init
. In this expression, we
do not consider the random relation between
u
id
and
the to-be-identied parameter vector. Indeed, we pose
the center of the ellipsoid equal to the a-priori estimate
init
.Consequently, the only dependence of U on
u
id
is via the matrix R which is equal to the inverse of the
covariance matrix P
where
0
has been replaced by
init
[11].
Note now that the expression for R is ane in
u
id
()
and that this matrix Ronly appears in P in the optimiza-
tion problem ROBFILT. As shown in Proposition 1,
the matrix P is bilinear in R and the matrix . Thus if
we modify ROBFILT by keeping xed and adding
u
id
to the decision variables (and adding (7)), the mod-
ied problem is still an LMI. We denote this modied
optimization problem MODROBFILT for future ref-
erence.
Consequently, in order to determine the optimal input
spectrum
u
id
for the identication, we can use an itera-
tive algorithm. Each iteration of this algorithm is made
of two steps. In a rst step, for a xed spectrum
u
id
and
thus a xed R, we solve ROBFILT. This delivers a value
for the decision variable . In a second step, we solve
MODROBFILT to optimize on
u
id
by xing to the
value found in the rst step. This delivers a new value
for
u
id
that can be subsequently used in Step 1. This
approach is inspired by the DK-approach in -synthesis
[17].
The spectrum
u
id
will be generally parametrized as
follows [9]:
u
id
() =
M
r=M
r
e
jr
> 0 (23)
with M an user choice and
r
=
r
R. This cor-
responds to signals u
id
obtained by ltering a white
noise through a FIR lter of order M + 1. With this
parametrization, R can be rewritten as an ane func-
tion of the coecients
r
(r = 0...M) and the con-
straint (7) as
0
< (see [9]). The coecients
r
(r = 0...M) become so the actual decision variables of
MODROBFILT. This choice for the parametrization
of
u
id
also ensures that R will remain strictly positive-
denite. Note that the positivity of the spectrum
u
id
can be easily ensured via an extra LMI on the coe-
cients
r
(r = 0...M) (see [9]).
Remark 2 Note that
u
id
does not inuence the uncer-
tainty of the parameters that only appear in H(z, ). This
uncertainty can only be inuenced by the number of data
used for the identication and, if this uncertainty is too
large, the number N of data should be increased.
Remark 3 Assumption 1 must be veried for the un-
certainty region U deduced from the designed
u
id
.
This can be veried a-posteriori after each iteration or
directly incorporated as an extra LMI constraint into
MODROBFILT using e.g. the multiplier (with xed
) and the separation of graph theorem (see e.g. [14]).
5 Numerical illustrations
We consider the following Box-Jenkins true system:
y(t) = G
0
(z)u(t) + H
0
(z)e(t) with G
0
(z) =
b0z
1
1+f0z
1
and H
0
(z) = 1 + c
0
z
1
with b
0
= 3.6, c
0
= 0.9 and
f
0
= 0.7. Both G
0
and H
0
are represented in a Bode
plot in Figure 3. The variance
2
e
of the noise e(t) is
here chosen equal to 1. We would like to reconstruct
the signal u(t) of this system based on a measurement
of the output y(t). We will suppose that the to-be-
reconstructed input is a white noise of variance 10000
i.e.
u
() = 10000 and W
u
(z) = 100 and that the delay
n
k
in Figure 1 is equal to one.
6
In order to determine a robust deconvolution lter F to
reconstruct this input, we rst identify a model and an
uncertainty for the system using 1000 input-output data
generated by a white noise of variance 1. To determine
F, we will use ROBFILT. For this purpose, we need
to x some variables such as b, B(z) and n
f
. The scalar
b is the size of the basis function vector B(z) which al-
lows to factorize the multiplier (). It is to be noted
that the larger b, the closer the optimal deduced with
ROBFILT will be from the actual value of the worst
case performance J
WC
( is indeed an upper bound of
J
WC
and will be denoted J
up
WC
in the sequel). On the
other hand, the larger b, the larger the complexity of
the optimization problem (see the expression of (z) in
Proposition 1). As a trade-o choice, the value of b is
here chosen equal to 2. We have also to choose which
types of basis functions we will use in B. Here, we have
chosen Laguerre basis functions and we have chosen the
pole of these Laguerre functions by trial and error as
the one for which ROBFILT delivers the lter F with
the smallest J
WC
. For white noise, this is = e
3
. Fi-
nally, the scalar n
f
is the order of the parametrization
of the lter F(z) that will be here chosen as a FIR. A
similar trade-o as for the value of b must be done for
n
f
: we have here chosen n
f
= 3.
For
u
id
() = 1 , the optimization problem
ROBFILT delivers a lter F achieving an upper bound
of the robust performance J
up
WC
= 2.14. In order to have
an idea of the conservatism, we compute a lower bound
for J
WC
by gridding U. The computed lower bound is
here J
low
WC
= 1.26. The conservatism could seem high,
but these numbers have to be compared with the power
of the to-be-reconstructed signal equal to 10000. This
comparison shows that the conservatism is in fact lim-
ited.
We will nowdetermine the spectrum
u
id
of power = 1
which minimizes the robust performance using the re-
sults of Section 4. For this purpose, we determine the pa-
rameters
r
=
r
in the classical parametrization (23)
where M is chosen equal to 30. The spectrum
u
id
ob-
tained after the rst iteration is represented in black
dashed in Figure 4 where it is compared to
u
id
() = 1
(blue dashdot).
We continue to iterate between ROBFILT and
MODROBFILT. After three iterations, we obtain
the spectrum represented in red solid in Figure 4. This
spectrum
u
id
() delivers an uncertainty U for which
J
up
WC
is equal to 0.756 while J
low
WC
= 0.43. With respect
to the initial white spectrum, this is an improvement of
65% for both J
up
WC
and J
low
WC
. Additional iterations do
not yield further improvement. Consequently, to recon-
struct a white noise signal u(t), an identication with
a white noise excitation u
id
(t) is far from optimal. The
optimal excitation signal is a signal that concentrates
its power
1
around the frequency 0.15 as can be seen
in Figure 4. Using such a signal instead of white noise
indeed reduces the guaranteed performance of the de-
signed lter by 65%. Such an improvement can also be
explained by observing the reduction in volume of the
uncertainty ellipses obtained when you use the optimal
excitation signal instead of a white noise signal (see Fig-
ure 5 where we represent those ellipses centered at 0 for
comparison purposes and where we restrict attention
to the parameters b, f in the G-transfer function). It
is to be noted that the optimal spectrum concentrates
its power in the region of the pole of G
0
(located at
= 0.35) and of the zero of H
0
(located at = 0.1).
The optimal lter F(z) corresponding to this third it-
eration is represented in Figure 3 where we can observe
that |F(e
j
)| |G
0
(e
j
)|
1
. It is to be noted that the
optimal lter does not change signicantly when going
from a white noise excitation signal to the optimal exci-
tation signal.
30
20
10
0
10
20
30
M
a
g
n
itu
d
e
(d
B
)
10
3
10
2
10
1
10
0
10
1
180
90
0
90
P
h
a
s
e
(d
e
g
)
Bode Diagram
Frequency (rad/sec)
Fig. 3. Bode plot of G0 (red dashed), of H0 (blue dashdot)
and of the optimal lter F obtained after three iterations
(black solid)
10
3
10
2
10
1
10
0
0
2
4
6
8
10
12
14
16
18
f
Fig. 5. Uncertainty ellipses when u
id
() = 1 (blue dashdot)
and when u
id
() is the optimal spectrum obtained after
three iterations (red solid)
considering the problem of how to design the input in
an identication experiment such that the resulting ro-
bust lter gives the smallest possible worst-case H
2
per-
formance in the set of uncertain systems. We believe
these methods to have wide applicability. As an example,
these results allow with minor adaptations to compute
the worst case H
2
performance achieved by a controller
over an uncertainty set delivered by system identica-
tion. This is an extension of the results in [7] considering
H
performance.
7 Acknowledgment
The authors gratefully acknowledge fruitful discussions
with H. Koroglu, C. Scherer, M. Barenthin and C. Rojas.
References
[1] M. Barenthin, X. Bombois, H. Hjalmarsson, and
G. Scorletti. Identication for control of multivari-
able systems: controller validation and experiment
design via LMIs. Automatica, 44(12):30703078,
2008.
[2] X. Bombois, G. Scorletti, M. Gevers, P.M.J. Van
den Hof, and R. Hildebrand. Least costly iden-
tication experiment for control. Automatica,
42(10):16511662, 2006.
[3] S. Boyd, L. El Ghaoui, E. Feron, and V. Balakr-
ishnan. Linear Matrix Inequalities in Systems and
Control Theory, volume 15 of Studies in Appl. Math.
SIAM, Philadelphia, June 1994.
[4] Y.L. Chen and B.S. Chen. Minimax robust de-
convolution lters under stochastic parametric and
noise uncertainties. IEEE Transactions on Signal
Processing, 42(1):3245, 1994.
[5] Y.C. Eldar. Robust mean-squared error estimation
in the presence of model uncertainties. IEEE Trans-
actions on Signal Processing, 53(1):168181, 2005.
[6] J.C. Geromel and M.C. de Oliveira. H2 and Hinf
robust ltering for convex bounded uncertain sys-
tems. IEEE Transactions on Automatic Control,
46(1):100107, 2001.
[7] M. Gevers, X. Bombois, B. Codrons, G. Scorletti,
and B.D.O. Anderson. Model validation for control
and controller validation in a prediction error iden-
tication framework- part I : Theory. Automatica,
39(3):403415, 2003.
[8] D.N. Godard. Self-recovering equalization
and carrier tracking in two-dimensional data
communication-systems. IEEE Transactions on
Communications, 28(11):18671875, 1980.
[9] H. Jansson and H. Hjalmarsson. Input design
via LMIs admitting frequency-wise model speci-
cations in condence regions. IEEE Transactions
on Automatic Control, 50(10):15341549, October
2005.
[10] Y. Liu, T.F. Wong, and W.W. Hager. Training sig-
nal design for estimation of correlated MIMO chan-
nels with colored interference. IEEE Transactions
on Signal Processing, 55(4):14861497, 2007.
[11] L. Ljung. System Identication: Theory for the
User. Prentice-Hall, Englewood Clis, NJ, 2nd edi-
tion edition, 1999.
[12] J.M. Mendel. Optimal Seismic Deconvolution. New
York Academic, 1983.
[13] C. Scherer and I.E. Kose. Robustness with dynamic
IQCs: an exact state-space characterization of nom-
inal stability with applications to robust estimation.
Automatica, 44:16661675, 2008.
[14] G. Scorletti. Robustness analysis with time delays.
In Proc. 36th IEEE Conference on Decision and
Control, San Diego, 1997.
[15] K. Sun and A. Packard. Robust H2 and Hinf lters
for uncertain LFT systems. IEEE Transactions on
Automatic Control, 50(5):715720, 2005.
[16] J. Veenman, H. Koroglu, and C.W. Scherer. An
IQC approach to robust estimation against pertur-
bations of smoothly time-varying parameters. In
CD-ROM Proc. 47th Conference on Decision and
Control, pp. 2533-2538, Cancun, Mexico, 2008.
[17] K. Zhou and J. Doyle. Essentials of Robust Con-
trol. Prentice Hall, Upper Saddle River, New Jer-
sey, 1998.
A Proof of Proposition 1
In[1], a very general parametrization of the multiplier
() satisfying (11) is proposed:
() =
_
_
Z0
R
+
_
_
j A11 B12 +jA12
B12 +jA12 jA22
_
_
_
_
j p11 p12 +jp12
p12 +jp12 jp22
_
_
Z0
_
_
where R is the matrix dening U (see (2)). The other el-
ements in this parametrization are frequency-dependent
and can take any values provided that p
ij
(), p
ij
()
R
1k
, Z
0
() a positive denite Hermitian matrix of di-
mension 2 and A
ij
() B
ij
() R
kk
with A
ij
= A
T
ij
and B
ij
= B
T
ij
.
8
Consequently, we must prove that the factorization of
Proposition 1 is a factorization of the above (). It is
indeed the case. The frequency function Z
0
() in ()
is factorized as Z
0
() = (B
I
2
)(B I
2
) which is
Hermitian and which is guaranteed to be positive de-
nite by the existence of X = X
T
such that (13) holds.
The latter is a consequence of the Kalman Yakubovitch
Popov (KYP) Lemma [3]. Similarly, the other frequency
functions are factorized as follows: Z
0
()
R
= (B
I
2k
)L
R
(B I
2k
),
_
_
j p11 jp12
+jp12 jp22
_
_
=
_
0 ...
b
_
(BI
2k
)(B
I2)
_
_
_
_
0
...
b
_
_
_
_
The factorization of
_
j A
11
jA
12
jA
12
jA
22
_
is as above with
i
replaced by L
i
(i = 0...b). We have also:
_
_
0 p12
p12 0
_
_
=
_
0 ...
b
_
(BI
2k
) +(B
I2)
_
_
_
_
0
...
b
_
_
_
_
Finally, the factorization of
_
0 B
12
B
12
0
_
is as above
but with
i
replaced by K
i
(i = 0...b). All these factor-
izations lead to the desired properties for the elements
of ().
B Proof of Proposition 2
The rst part of the proof consists of establishing that
the LMIs (17) and (18) for some Q = Q
T
implies that
the system (15) has the following property:
+
t=0
_
_
z1(t)
z2(t)
_
_
T
_
_
P 0
0 1
_
_
_
_
z1(t)
z2(t)
_
_
< w
T
Qw (B.1)
for any trajectory of the system. To show this, we rst
observe that, due to Assumption 2, the system (9), from
which (15) is deduced, has the property that q(t = 0) = 0
when the input vector v(t) is such that v(t < 0) = 0.
Consequently, since here v(t) = w(t), the state-space
representation (15) for t > 0 can be simplied to
x(t + 1) =Ax(t) +B
1
q(t)
_
z
1
(t)
z
2
(t)
_
=
_
C
1
C
2
_
x(t) +
_
D
11
D
21
_
q(t) (B.2)
if we impose the following initial conditions: x(1) = B
2
w
and
_
z
1
(0)
z
2
(0)
_
=
_
D
12
D
22
_
w
The LMI (18) ensures that, for any trajectory of the
system (B.2),
_
_
x(t)
q(t)
_
_
T
(F1(K) +F2(P))
_
_
x(t)
q(t)
_
_
< 0
x(t + 1)
T
Kx(t + 1) x(t)
T
Kx(t) +...
... +
_
_
z1(t)
z2(t)
_
_
T
_
_
P 0
0 1
_
_
_
_
z1(t)
z2(t)
_
_
< 0
The latter constraint is of the form g(t) < 0 and holds
for each time t > 0. Consequently, it implies that
+
t=1
g(t) < 0 and thus, A being stable, that
+
t=1
_
z
1
(t)
z
2
(t)
_T _
P 0
0 1
_ _
z
1
(t)
z
2
(t)
_
< x(1)
T
Kx(1) (B.3)
The rst LMI (17) ensures that, for any trajectory of the
system (B.2),
w
T
_
_
B
T
2
KB2 +
_
_
D12
D22
_
_
T
_
_
P 0
0 1
_
_
_
_
D12
D22
_
_
_
_
w < w
T
Qw
x(1)
T
Kx(1) < w
T
Qw w
T
_
_
D12
D22
_
_
T
_
_
P 0
0 1
_
_
_
_
D12
D22
_
_
w
Combining (B.3) and the last expression, we ob-
tain (B.1).
For the second part of the proof, we can follow the rea-
soning in e.g. [13, 16]. Indeed, it is very easy to show us-
ing (9), (12), (14) and Parsevals theorem that the prop-
erty (B.1) is equivalent to the property:
1
2
_
_
_
q(e
j
)
p(e
j
)
_
_
()
_
_
q(e
j
)
p(e
j
)
_
_
+
(e
j
)
(e
j
) d < w
T
Qw
(B.4)
for any trajectory of (14) (note that Assumption 1 en-
sures that Parsevals theorem can be used). Introducing
the relation p = q of the LFT (9) which is the original
system with which (14) is dened, we see that the prop-
erty (B.4) for any trajectory of (14) is equivalent to the
property:
1
2
_
(e
j
)
_
_
I2
_
_
T
()
_
_
I2
_
_
p(e
j
)+
(e
j
)
(e
j
) d < w
T
Qw
for any trajectory of the LFT (9) when v(t) = w(t).
Now using (11), we see that the latter implies that, for
all U,
1
2
_
(e
j
)
(e
j
) d < w
T
Qw which, com-
bined to (16) for some Q = Q
T
, yields F(M(z), )
2
2
<
for all U.
9