Professional Documents
Culture Documents
The Recursive Least Squares Identi Fication Algorithm For A Class of Wiener Nonlinear Systems
The Recursive Least Squares Identi Fication Algorithm For A Class of Wiener Nonlinear Systems
The Recursive Least Squares Identi Fication Algorithm For A Class of Wiener Nonlinear Systems
com
Abstract
Many physical systems can be modeled by a Wiener nonlinear model, which consists of a linear dynamic
system followed by a nonlinear static function. This work is concerned with the identification of Wiener
systems whose output nonlinear function is assumed to be continuous and invertible. A recursive least
squares algorithm is presented based on the auxiliary model identification idea. To solve the difficulty of the
information vector including the unmeasurable variables, the unknown terms in the information vector are
replaced with their estimates, which are computed through the preceding parameter estimates. Finally, an
example is given to support the proposed method.
& 2016 The Franklin Institute. Published by Elsevier Ltd. All rights reserved.
1. Introduction
Parameter estimation is basic for model-based control system design [1–3] and system
identification [4,5]. Roughly speaking, existing nonlinear systems of block structures can be
classified into the following basic categories: the input nonlinear system (including the Hammerstein
system: a static nonlinear block followed by a linear dynamic subsystem), the output nonlinear
systems (including the Wiener system: a linear dynamic subsystem followed by a static nonlinear
☆
This work was supported by the National Natural Science Foundation of China (No. 61472195) and the Taishan
Scholar Project Fund of Shandong Province of China.
n
Corresponding author.
E-mail addresses: fding12@126.com (F. Ding), liuximeiqd@163.com (X. Liu),
mmLiu467912432@163.com (M. Liu).
http://dx.doi.org/10.1016/j.jfranklin.2016.02.013
0016-0032/& 2016 The Franklin Institute. Published by Elsevier Ltd. All rights reserved.
F. Ding et al. / Journal of the Franklin Institute 353 (2016) 1518–1526 1519
block) [10], the input–output nonlinear system (including the Hammerstein–Wiener system (a linear
dynamic block sandwiched by two static nonlinear blocks), the Wiener–Hammerstein system (a static
nonlinear block sandwiched by two linear dynamic blocks), and the feedback nonlinear system [6].
Nonlinear systems have received considerable attention in the areas of system control [7–9],
system identification [10,11] and fault detection [12,13] for the past decade. For instance, Li
derived a maximum likelihood estimation algorithm to estimate the parameters of Hammerstein
nonlinear controlled autoregressive moving average systems by using the Newton iteration [15];
Wang et al. discusses several iterative estimation algorithms for a nonlinear IIR filter with
moving average noise by means of the data filtering technique [14].
Wiener systems are widely encountered in engineering and science applications. They can
model the chemical processes [16], electrical control [17], or biological process [18]. For
decades, the parameter estimation issues for Wiener nonlinear systems have attracted great
attention in the field of system identification [19–21]. For instance, Hagenblad et al. presented a
maximum likelihood method to identify Wiener models and testified the implemented efficiency
of the proposed algorithm [22]. Recently, a new identification problem, which the nonlinear part
of Wiener models has an inverse function, has raised increasing concern [23]. For example, Bai
proposed a blind approach to identify a Hammerstein–Wiener model which nonlinear part has
inverse functions [24]; Lacy and Berntein studied the identification method of FIR Wiener
systems with unknown, non-invertible, polynomial non-linearities and presented three methods
for simultaneous direct estimation of the non-linearity and a prediction error optimization method
[25]; Janczak surveyed of various known approaches to the identification of Wiener and
Hammerstein systems which are applicable to both neural network and polynomial models [26].
The recursive least squares algorithm is a popular method in the field of system identification.
On the basis of the work in [24], a recursive least squares algorithm is deduced to estimate
parameters of a Wiener nonlinear system in this paper, and the nonlinear output element is
assumed to be invertible, that is, the inner variable is theoretically justified [27,28].
To close this section, we give an outline of this paper. Section 2 formulates the problem and
describes the identification model of the Wiener nonlinear systems. Section 3 derives a recursive least
squares algorithm for the Wiener nonlinear model. Section 4 provides an illustrative example to
verify the effectiveness of the proposed algorithm. Finally, some concluding remarks are given in
Section 5.
Let us introduce some notation first. The superscript T denotes the vector transpose; the
symbol I ðIn Þ stands for an identity matrix of appropriate sizes (n n); 1n represents an n-
dimensional column vector whose elements are 1. Consider a Wiener nonlinear system in Fig. 1,
which can be expressed as
BðzÞ
r ðt Þ ¼ uðt Þ; ð1Þ
AðzÞ
Notice that the intermediate signals r(t) and x(t) are unmeasurable, it means that the model
parameters in Eq. (6) cannot be uniquely determined without introducing further constraints. A
solution to this problem is to fix a coefficient of the two blocks. Without loss of generality,
assume that the first coefficient of the nonlinear part is unity, i.e., c1 ¼ 1. Eq. (6) can be written as
Xm X
na X
nb
yðtÞ þ ck yk ðtÞ ¼ ai ½vðt iÞ xðt iÞ þ bj uðt jÞ þ vðtÞ;
k¼2 i¼1 j¼1
or
X
na X
nb X
m
yðtÞ ¼ ai ½vðt iÞ xðt iÞ þ bj uðt jÞ ck yk ðtÞ þ vðtÞ: ð7Þ
i¼1 j¼1 k¼2
θ≔½θT1 ; c2 ; c3 ; …; cm T A Rn ; n≔na þ nb þ m 1
In the following, we derive a recursive least squares algorithm for Wiener nonlinear systems to
identify the parameter vector θ.
Define a quadratic cost function,
X
L
JðθÞ≔ ½yðtÞ φT ðtÞθ2 ;
t¼1
Replacing φ1 ðtÞ, φðtÞ, θ1 and θ in Eqs. (8) and (9) with φ^ 1 ðtÞ, φðtÞ,
^ θ^ 1 ðtÞ and θðtÞ,
^ we obtain the
estimates
1
^
LðtÞ ¼ Pðt 1ÞφðtÞ½1 ^
þ φ^ T ðtÞPðt 1ÞφðtÞ ; ð18Þ
^
v^ ðtÞ ¼ yðtÞ φ^ T ðtÞθðtÞ: ð25Þ
^
LðtÞA Rn is the gain vector and PðtÞA Rn is the covariance matrix. The steps of computing θðtÞ
in the W-RLS algorithm in Eqs. (17)–(25) are listed in the following.
1. Let t ¼ 1, give the data length Le and set the initial values θð0Þ ^ ¼ 1n =p0 , Pð0Þ ¼ p0 In ,
uðiÞ ¼ 0, yðiÞ ¼ 0, x^ ðiÞ ¼ 0, v^ ðiÞ ¼ 0 for ir 0, p0 is a large number, e.g., p0 ¼ 106 .
2. Collect the input–output data fuðtÞ; yðtÞg.
3. Form φ^ 1 ðtÞ by Eq. (21) and φðtÞ ^ by Eq. (20).
4. Compute the gain vector LðtÞ by Eq. (18) and the covariance matrix PðtÞ by Eq. (19).
5. Update the parameter estimation vector θðtÞ ^ by Eq. (17).
^ ^
6. Read θ 1 ðtÞ from θðtÞ in Eq. (22). Compute v^ ðtÞ by Eq. (25) and x^ ðtÞ by Eq. (24).
7. If toLe , increase t by 1, go to Step 2, continue the recursive calculation; otherwise,
terminate this process and obtain the parameter estimates.
^
Fig. 2. The flowchart of computing the WNI-RLS parameter estimate θðtÞ.
Table 1
The parameter estimates and errors with different s2.
s2 t a1 a2 b1 b2 c2 c3 δ ð%Þ
0.7
0.6
0.5
0.4
δ
0.3
σ =0.50
0.2
0.1
σ =1.00
0
0 500 1000 1500 2000 2500 3000
t
4. Example
1. The parameter estimation errors given by the proposed approach gradually become smaller
as the data length increases.
2. As the variance of the noise decreases, the parameter estimation errors given by the
proposed approach become smaller. This shows that the proposed algorithm is effective.
5. Conclusions
This paper presents a recursive least squares algorithm for a Wiener nonlinear system by using
the auxiliary model identification idea. The idea is assuming P that thek nonlinear output element is
to be invertible, that is, the inner variable x ¼ f 1 ðyÞ ¼ m
k ¼ 1 ck y ðtÞ is theoretically justified.
The simulation results demonstrate that the proposed algorithm is effective. The proposed
method can be extended to study identification problems of other nonlinear systems with colored
noise [29,30], uncertain chaotic delayed nonlinear systems and hybrid switching-impulsive
F. Ding et al. / Journal of the Franklin Institute 353 (2016) 1518–1526 1525
dynamical networks [31,32], dual-rate and non-uniformly sampled-data systems [33–35]. The
proposed method can combine the multi-innovation theory and the auxiliary model idea for
parameter identification [36–40].
References
[1] Y. Shi, H. Fang, Kalman filter based identification for systems with randomly missing measurements in a network
environment, Int. J. Control 83 (3) (2010) 538–551.
[2] Y. Shi, B. Yu, Output feedback stabilization of networked control systems with random delays modeled by Markov
chains, IEEE Trans. Autom. Control 54 (7) (2009) 1668–1674.
[3] Y. Shi, B. Yu, Robust mixed H-2/H-infinity control of networked control systems with random time delays in both
forward and backward communication links, Automatica 47 (4) (2011) 754–760.
[4] F. Ding, System Identification—New Theory and Methods, Science Press, Beijing, 2013.
[5] F. Ding, System Identification—Performances Analysis for Identification Methods, Science Press, Beijing, 2014.
[6] P.P. Hu, F. Ding, J. Sheng, Auxiliary model based least squares parameter estimation algorithm for feedback
nonlinear systems using the hierarchical identification principle, J. Frankl. Inst.—Eng. Appl. Math. 350 (10) (2013)
3248–3259.
[7] X.L. Luan, P. Shi, F. Liu, Stabilization of networked control systems with random delays, IEEE Trans. Ind.
Electron. 58 (9) (2011) 4323–4330.
[8] X.L. Luan, S.Y. Zhao, F. Liu, H-infinity control for discrete-time Markov jump systems with uncertain transition
probabilities, IEEE Trans. Autom. Control 58 (6) (2013) 1566–1572.
[9] P. Shi, X.L. Luan, F. Liu, H-infinity filtering for discrete-time systems with stochastic incomplete measurement and
mixed delays, IEEE Trans. Ind. Electron. 59 (6) (2012) 2732–2739.
[10] F. Ding, X.H. Wang, Q.J. Chen, Y.S. Xiao, Recursive least squares parameter estimation for a class of output
nonlinear systems based on the model decomposition, Circuits Syst. Signal Process. (2016), 10.1007/s00034-015-
0190-6.
[11] D.Q. Wang, Hierarchical parameter estimation for a class of MIMO Hammerstein systems based on the reframed
models, Appl. Math. Lett. 57 (2016) 13–19.
[12] H. Li, Y. Gao, P. Shi, H.K. Lam, Observer-based fault detection for nonlinear systems with sensor fault and limited
communication capacity, IEEE Trans. Autom. Control (2016), 10.1109/TAC.2015.2503566.
[13] H. Li, P. Shi, D. Yao, L. Wu, Observer-based adaptive sliding mode control of nonlinear Markovian jump systems,
Automatica 64 (2016) 133–142.
[14] Y.J. Wang, F. Ding, Iterative estimation for a nonlinear IIR filter with moving average noise by means of the data
filtering technique, IMA J. Math. Control Inf. (2016), 10.1093/imamci/dnv067.
[15] J.H. Li, Parameter estimation for Hammerstein CARARMA systems based on the Newton iteration, Appl. Math.
Lett. 26 (1) (2013) 91–96.
[16] G. Shafiee, M.M. Arefi, M.R. Jahed-Motlagh, A.A. Jalali, Nonlinear predictive control of a polymerization reactor
based on piecewise linear Wiener model, Chem. Eng. J. 143 (1–3) (2008) 282–292.
[17] X. Jin, B. Huang, D.S. Shook, Multiple model LPV approach to nonlinear process identification with EM algorithm,
J. Process Control 21 (1) (2011) 182–193.
[18] M.M. da Silva, T. Wigren, T. Mendon, Nonlinear identification of a minimal neuromuscular blockade model in
anesthesia, IEEE Trans. Control Syst. Technol. 20 (1) (2012) 181–188.
[19] K. Pelckmans, MINLIP for the identification of monotone Wiener systems, Automatica 47 (10) (2011) 2298–2305.
[20] W.L. Xiong, J.X. Ma, R.F. Ding, An iterative numerical algorithm for modeling a class of Wiener nonlinear
systems, Appl. Math. Lett. 26 (4) (2013) 487–493.
[21] J. Vörös, Parameter identification of Wiener systems with multisegment piecewise-linear nonlinearities, Syst.
Control Lett. 56 (2) (2007) 99–105.
[22] A. Hagenblad, L. Ljung, A. Wills, Maximum likelihood identification of Wiener models, Automatica 44 (11) (2008)
2697–2705.
[23] A. Hasanov, V.G. Romanov, An inverse coefficient problem related to elastic-plastic torsion of a circular cross-
section bar, Appl. Math. Lett. 26 (5) (2013) 533–538.
[24] E.W. Bai, A blind approach to the Hammerstein–Wiener model identification, Automatica 38 (6) (2002) 967–979.
[25] S.L. Lacy, D.S. Berntein, Identification of FIR Wiener systems with unknown, non-invertible, polynomial non-
linearities, Int J. Control 76 (15) (2003) 1500–1507.
1526 F. Ding et al. / Journal of the Franklin Institute 353 (2016) 1518–1526
[26] A. Janczak, Identification of Nonlinear Systems Using Neural Networks and Polynomial Models, Springer, Berlin,
Heidelberg, 2005.
[27] M.S. Revathy, N.N. Singh, An efficient way of solving inverse problem using nonlinear Wiener filter and its
application to pattern recognition, Procedia Eng. 38 (2012) 708–717.
[28] I.A. Krishtal, K.A. Okoudjou, Invertibility of the Gabor frame operator on the Wiener amalgam space, J. Approx.
Theory 153 (2) (2008) 212–224.
[29] Y.B. Hu, B.L. Liu, Q. Zhou, C. Yang, Recursive extended least squares parameter estimation for Wiener nonlinear
systems with moving average noises, Circuits Syst. Signal Process. 33 (2) (2014) 655–664.
[30] Y.B. Hu, B.L. Liu, Q. Zhou, A multi-innovation generalized extended stochastic gradient algorithm for output
nonlinear autoregressive moving average systems, Appl. Math. Comput. 247 (2014) 218–224.
[31] Y. Ji, X.M. Liu, et al., New criteria for the robust impulsive synchronization of uncertain chaotic delayed nonlinear
systems, Nonlinear Dyn. 79 (1) (2015) 1–9.
[32] Y. Ji, X.M. Liu, Unified synchronization criteria for hybrid switching-impulsive dynamical networks, Circuits Syst.
Signal Process. 34 (5) (2015) 1499–1517.
[33] J. Ding, C.X. Fan, J.X. Lin, Auxiliary model based parameter estimation for dual-rate output error systems with
colored noise, Appl. Math. Modell. 37 (6) (2013) 4051–4058.
[34] F. Ding, X.M. Liu, Y. Gu, An auxiliary model based least squares algorithm for a dual-rate state space system with
time-delay using the data filtering, J. Frankl. Inst. 353 (2) (2016) 398–408.
[35] J. Ding, J.X. Lin, Modified subspace identification for periodically non-uniformly sampled systems by using the
lifting technique, Circuits Syst. Signal Process. 33 (5) (2014) 1439–1449.
[36] X.H. Wang, F. Ding, Convergence of the recursive identification algorithms for multivariate pseudo-linear
regressive systems, Int. J. Adapt. Control Signal Process 30 (2016), http://dx.doi.org/10.1002/acs.2642.
[37] F. Ding, Y.J. Wang, J. Ding, Recursive least squares parameter identification for systems with colored noise using
the filtering technique and the auxiliary model, Digital Signal Process 37 (2015) 100–108.
[38] X.H. Wang, F. Ding, Modelling and multi-innovation parameter identification for Hammerstein nonlinear state
space systems using the filtering technique, Math. Comput. Model. Dyn. Syst. (2016), http://dx.doi.org/10.1080/
13873954.2016.1142455.
[39] Y.J. Wang, F. Ding, Recursive least squares algorithm and gradient algorithm for Hammerstein-Wiener systems
using the data filtering, Nonlinear Dyn (2016), http://dx.doi.org/10.1007/s11071-015-2548-5.
[40] Y.J. Wang, F. Ding, Recursive parameter estimation algorithms and convergence for a class of nonlinear systems
with colored noise, Circuits Syst. Signal Process 35 (2016), http://dx.doi.org/10.1007/s00034-015-0210-6.