Download as pdf or txt
Download as pdf or txt
You are on page 1of 7

Artif Life Robotics

DOI 10.1007/s10015-015-0203-3

ORIGINAL ARTICLE

Repetitive control for the periodic walking training in a gait


rehabilitation robot
Ping Wang1 · Lei Li2 · Maode Yan1 · Feng Ru1 · Yongfeng Ju1 

Received: 12 June 2014 / Accepted: 30 December 2014


© ISAROB 2015

Abstract  The number of people with difficulty in walking nervous system by “recall” the lost function and enhance the
has increased with aging issues worldwide. It is possible to descending motor pathways. Those neurological deficien-
regain walking ability after persistent locomotion training. cies often initiate pathological gaits that force patients stay
With the development of robotics, cyclic walking motion in wheelchairs and other walking devices to achieve func-
is implemented to stimulate the correct walking pattern. In tional mobility during daily activities. However, it is obvious
order to better track the planned walking motion, this paper that the current manual assistance is time-consuming and
focuses on the “repetitive” motion input for the lower limb, far from enough in consideration of the limited professional
and the intelligent control algorithm is proposed to diminish doctors and therapists. This is the area where an intelligent
the tracking error. Repetitive control algorithm, based on the robotics can replicate manual assistance of repetitive motor
characteristics of a cyclical input signal and the internal model pattern training. Furthermore, most of the gait exercise easily
control principle, implanted the periodic signal generator has turns out to be inefficient for gait recovery without the pro-
developed into the closed-loop system in order to achieve fessional guidance, such as the trainees do not execute their
steady tracking of cyclic reference signals and rejecting dis- own strength but passively follow external assistant loops,
turbance on the rehabilitation robot. Results are applied on and then these cyclic trainings are actually not effective as
the simulation model of a bedecked overground walking gait expected [1, 2]. Therefore, maximizing the use of remain-
system. It shows the effectiveness of the proposed method ing ability and enlarging the assistant training effort are the
compared with the conventional PD controller. research focus during the development of such clinic-used
robot with enhanced robotics technology in recent decades.
Keywords  Rehabilitation robot · Gait training · As emphasized earlier that a proper repetitive exercise is
Repetitive motion · Intelligent control effective for gait recovery, which saves lots of manpower,
repetitive controller (RC) has advantages for the repeti-
tive task following periodic input signals [3]. The design
1 Introduction of RC is based on the iterative learning law by eliminat-
ing the effects of periodic disturbance and errors cycle by
Depending on the existence of neural plasticity, intensive cycle. The fundamental frequency of RC is obtained by
and repetitive rehabilitative exercises can stimulate the the analysis of the dominant frequency components of the
input signal based on the frequency decomposition. RC
algorithm built on the robotic dynamic equations has been
* Ping Wang implemented into robotic manipulators when a robot per-
wang0372@e.ntu.edu.sg forms a periodic motion. The periodic disturbances built
1 up by gravity torque and inaccuracies in the machining or
School of Electronic and Control Engineering, Chang’an
University, Mailbox 370, Nan Er Huan Road, Xi’an 710064, mounting of shafts can be compensated by the corrective
Shaanxi, China action until the error goes away [4]. Moreover, the effec-
2
School of Mechanical and Aerospace Engineering, Nanyang tiveness of RC has even been successfully tested on nonlin-
Technological University, Singapore 639798, Singapore ear, highly coupled robotic devices with unknown inverse

13
Artif Life Robotics

dynamics or without direct measurement of joint veloci- training is first presented. A lower-limb rehabilitation robot
ties [5, 6]. Robotics applied in rehabilitation area was also was simulated to test the proposed control algorithm and
applied in the RC to provide compliance assistant torque compared with the conventional PD controller. The effec-
for the upper-limb rehabilitation [7]. However, few of the tiveness of RC to automatically diminish the tracking error
studies have reported on the applications of the lower-limb was then demonstrated. The proposed method is applied on
rehabilitation as considered in the complex of gait training. a simulation model of a gait rehabilitation robot to evaluate
In this paper, the initial study was conducted on the RC the effort.
algorithm on the simulation model of a gait robot used in
the lower-limb rehabilitation training.
As walking training is continuous and repeatable [8, 2 Method
9], RC algorithm is suitable for the “repetitive” motion
input for joints on the lower limb. Unlike the upper-limb In order to use RC algorithm on the gait system with the
rehabilitation, gait trajectory is more complex in the con- periodic input, the proposed RC algorithm is first discussed
sideration of the balance of the trainee, walking sequence, with the selection of fundamental frequency by inserting
shifting of the center of gravity (CoG), and posture con- different time delay. The frequency response of RC is also
trol to complete a gait cycle (GC). In order to track the presented to show oscillation wave in high-frequency band.
complex gait trajectory to complete appropriate walking Then, the frequency decomposition of the input signal for
motions, various control algorithms have been developed. the lower-limb walking pattern is analyzed. With the cutoff
The conventional PD controllers are commonly used in the frequency of the controller, the periodic signal trims out the
feedback control of robotic system. The constant control high-frequency band for every cycle. Unlike conventional
parameters may lead to bad tracking effects, which make controller, RC with iterative learning ability could let cer-
the planned walking motion unworkable. Researchers tain high-frequency bands get through with selected fun-
have analyzed the dynamic model of the walking robot [5] damental frequency. Therefore, more information would
to improve the PD control effect. Furthermore, it is also bypass to track the gait parent more accurately cycle by
worth to study the interaction torque between the trainee cycle to handle these periodic signal disturbance rejection
and robot. The assistant force transferred effectively and problems.
properly to push or pull lower limbs. The bad tracking
error not only introduces impracticable gait pattern, but 2.1 Repetitive control
also enlarges the theoretical assistant force to be exces-
sively huge when the error accumulated, which is unreal- It is well known that the dynamics of a rigid robotic manip-
izable. Therefore, many researchers have studied the stiff- ulator is of the following general form:
ness and compliance of interaction torque [8, 10]. Further
studies use fuzzy logic combined with PD control carrying
Γ = M(q)q̈ + C(q, q̇) + g(q) (1)
out the force/position hybrid control to control both force where Ґ is the torque, q is the joint position, M(q) is the
and position at the same time [11]. Other intelligent algo- inertia matrix, C(q, q̇) is the matrix of the Coriolis and cen-
rithms have also been investigated such as neural network trifugal forces, and g(q) is the gravity force. The state equa-
and genetic algorithm in consideration of various changes tions of the robotic manipulator are of following form, des-
of subjects’ conditions [12]. As the assistant force is so ignate H(q, q̇) = C(q, q̇) + g(q) for short.
vital for the rehabilitation robot, modified control algo- 
q̇ = v
rithms combined with computed torque controllers and (2)
v̇ = M −1 (q)(Γ − H(q, q̇))
impedance control theory have also been implemented to
drive the manipulator tracking the desired trajectory and where v is the joint velocity, and v̇ is the joint acceleration,
ensure the sufficient torque to assist the lower limbs [13, assume
14]. Event-trigger algorithms have also been developed
u = q̈ (3)
based on the different discrete state of rehabilitation robot
during training process [15, 16]. All those superior meth- The dynamic equations of the robotic manipulator are
ods have been tested on the specific robot and obtained highly nonlinear and coupled. In order to design a control-
satisfactory results. ler, the following is linearization of the dynamic:
In this paper, the applications of RC are discussed to 
q̇ = v
diminish tracking error cycle by cycle to perform planned (4)
v̇ = M̂ −1 (q)(Γ − Ĥ(q, q̇))
motion for the rehabilitation with the possibility to add
on current algorithms without ability of iterative learn- where M̂ and Ĥ are estimation of the manipulator dynam-
ing methods. RC combined with gait analysis for walking ics. In the case of periodic disturbance and when the

13
Artif Life Robotics

( ) Repetitive controller ( )
( )
+ + + Robot
( )
+ +
( ) − ( , ̇)

Fig. 1  Diagram of the repetitive control system used in the robotic system, M(q) is inertia matrix of the robotic joint. H(q, q̇) is summation of
the matrix of coriolis torques and the gravity torques

Fig. 2  Frequency response of 4

the repetitive control system 2

Magnitude (dB)
-2

-4

-6

4
-8 x 10

2.88

2.304
Phase (deg)

1.728

1.152

0.576

0
-2 -1 0 1 2
10 10 10 10 10
Frequency (rad/sec)

dynamic model is unknown, the tracking systems have to The self-oscillation of the repetitive controller introduces
deal with periodic reference signals. Repetitive control instability for the system. In order to design functional
based on the internal model principle has been proved to repetitive controller, system needs to satisfy the conditions
be a useful control strategy for this class of systems. The for internal stability. According to the internal stability [18],
diagram of the repetitive control used in robotic system is the parameters of the repetitive controller are obtained.
shown in Fig. 1. There are two loops of the controller; the As for the repetitive controller, the fundamental fre-
inner loop is torque control with adjustable current. The quency is
joint torque is linked to joint revolute joint angle with the 
help of friction gravity compensation and robotic dynam-
ωk = 2π L (7)
ics via Eq. (1). The outer loop is the position control to The instability’s condition covers G(s) asymptotic stabil-
track the planned trajectory of the revolute joint angle. ity and T(jω) = 1. That is, |1 + G(jω)| > 1 refers to Eq. (6).
The high loop gain injected by RC at the fundamental and
harmonic frequencies of the network frequency ensures 2.2 Frequency response
good tracking of the reference input and the rejection of
the high-order harmonics of the disturbance [17]. The pro- Compared with the conventional controller such as PD con-
posed structure of RC with time delay decides the founda- troller, there is magnitude oscillation occuring on the high-
tional frequency. frequency domain. More high-harmonic series can pass
The open-loop transfer function of the block of repeti- through the RC. The frequency response of the RC is shown
tive controller is in Fig. 2. When the internal model oscillation is the same
to the input signal, then it enhances the capacity of periodic
Q(s)e−Ls
D(s) = (5) signal tracking and suppresses the periodic disturbance.
1 − Q(s)e−Ls
2.3 Walking pattern analysis
The closed-loop transfer function is
G(s) As defined, heel contact (HC) of the right foot is the starting
T(s) = (6)
1 − Q(s)e−Ls + G(s) point in a gait cycle. Smooth impact between the foot and the

13
Artif Life Robotics

80
60
Knee (xh,yh)

Angle (Degree)
40 Hip L+l2(t)
20
0
(x0,y0) hip
-20 0 50 100 l3
-40 Ankle
-60
% of Gait Cycle

Fig. 3  Comparison between the original signals (solid line) and sig- (xk,yk)
nals that cut off high-harmonic Fourier (dotted line) knee

ground initial contact is required during heel rocker. When l4


the stance phase starts, the standing foot stay on the ground
without lifting up or dragging around as a fixed point to allow
(xm,ym)
ankle rocker. As walking forward, the standing foot lift heel
(xa,ya) ankle
off the ground at the end of stance phase to allow forefoot
rocker. Finally, swing forward under foot clearance require- l5
ment before contacting ground again. Inverse kinematics
study is applied to calculate the hip, knee, and ankle joints. It
Fig. 4  Sub-mechanism of robotic leg parallel attached in NaTUre-
therefore disperses walking motion into cycle by cycle with gaits
periodic joint angles for hip, knee, and ankle joints. An entire
gait cycle is divided 100 percentage from HC to next HC to
complete a whole walking cycle, as shown in Fig. 3.
As the average walking pattern for one cycle is demon-
strated, the entire walking pattern repeats the average pat-
tern cycle by cycle. Then periodic joint angles can be repre-
sented by the Fourier series as


q(t) = ak cos(kωt) + bk sin(kωt), k = 1, 2, . . . (8)
k=1

PD controller are commonly used in robotic tracking


control. The disturbance in the high-frequency domain are
cutoff with loss of high-harmonic Fourier series of the peri-
odic input signals. Therefore, the cutoff signal (dotted line)
is slightly different from the original signal (solid line)
within every cycle as shown in Fig. 3. The tracking perfor-
mance is influenced by this reason.

3 Result

The robotic orthosis mechanism consists of two sets of link-


age resembling human lower limb in NaTUre-gaits (Natu-
ral and TUnable rehabilitation gait system) [19], which
provide assistance for walking during gait rehabilitation. At
each of the joint, a Maxon brushless motor is meshed with
spur gears to drive the movement of the linkage. The con-
trolled joints on each limb of the robotic orthosis are ankle,
knee, and hip joints control as simulated. In order to enable
the periodic synchronization of motors, all the axes can be
Fig. 5  Simulation model on the hip, knee, and ankle joints to com-
slaved to one master axis. The master axis is a fictitious pare the control effort of the PD controller and repetitive controller. a
axis, which allows a table-based relationship to synchro- PD and RC algorithm simulation; b Machine for model link to Solid-
nize all the controller axes. In our research, the DMC-2182 works model with trajectory of hip, knee and ankle joints is illustrated

13
Artif Life Robotics

controller has a fictitious axis as one master and six slaves The proposed RC is used in this simulation platform,
for all the motors. The synchronized six-axis motion for the and the track performance for hip, knee, and ankle joints
lower limbs is generated and tracked as shown in Fig. 4. is shown in Fig. 6. Take Fig. 6a as an example; “AnkleRef”
A robotic manipulator with three revolute joints is used indicates the desired planned motion of ankle joint, while
for simulation study. The conventional PD controller and pro- “AnkleResult” is the resultant tracking output. The maxi-
posed RC are applied on the simulation of a 3 DoF robotic mum tracking error decreased continually from 3° to zero
system for one leg. Those joints are following the cyclic com- for the ankle joint as shown in solid line of “AnkleRef”
mands from hip, knee, and ankle joints, respectively. The con- and dotted line of “AnkleResult.” With increase in time,
trol algorithms are also simulated as shown in Fig. 5a. The more walking cycle is performed and the periodic input
robotic manipulator is taken as a controlled plant represented signals are shown. The actual joint output convergent
by a sub-system. The simulation model is setup to mimic the approaches the desired input cycle by cycle. The track per-
walking machine as shown in Fig. 5b. This model acts as the formance improved with time with the help of the repetitive
controlled plant sub-system to test the control algorithm. controller.

The Gait Cycle in the N*GaitT

10 AnkleRef AnkleResult

5 (a)
0
Angle

-5

-10

-15

-20
0 10 20 30 40 50 60

Time (s)

The Gait Cycle in the N*GaitT


70
KneeRef KneeResult

60
(b)
50

40
Angle

30

20

10

0
0 10 20 30 40 50 60

Time (s)

The Gait Cycle in the N*GaitT

HipRef HipResult
20

(c)
15

10
Angle

-5

-10

0 10 20 30 40 50 60

Time (s)

Fig. 6  Tracking performance of hip, knee, and ankle joint with RC. a ankle joint; b knee joint and c hip joint

13
Artif Life Robotics

Fig. 7  Tracking error of ankle, 3.5


ankleErr
knee, and hip joints compared a 3 (a) kneeErr
PD controller, b RC hipErr
2.5

1.5

Angle
1

0.5

-0.5

-1
0 10 20 30 40 50 60

3.5
ankleErr
3 (b) kneeErr
hipErr
2.5

1.5
Angle

0.5

-0.5

-1
0 10 20 30 40 50 60

Time (s)

Fig. 8  Frequency response total controller and plant compared RC and PD


compared between PD control- 60

ler and repetitive control-


ler working with the controlled 40
Magnitude (dB)

plant
20

-20
180

0
Phase (deg)

-180

PD
-360 Repetitive control

-540
-2 -1 0 1 2
10 10 10 10 10
Frequency (rad/sec)

The tracking error is also highlighted by both the per- help of RC as the controller conducts self-learning algo-
formances under the conventional PD control and RC, as rithm and changes the assistant torque correspondingly in
shown in Fig. 7. There is no obvious change of tracking Fig. 7b. This auto-tuning method of assistant torque could
error under PD control between neighboring cycles. Within benefit the gait rehabilitation as it forces more to track large
every cycle, the tracking error reaches maximum at certain angle changes.
degree to formulate a peak value. This peak value is con- The DMC-2183 is an 8-axis programmable motion con-
stantly repeated cycle by cycle when large ankle changes trol card. It can interface with desktop via Ethernet cable
are required as in Fig. 7a. This value is decreased with the or RS232 cable. Two units of opto-isolator modules are

13
Artif Life Robotics

mounted onto the control card. To program the DMC-2183, 4. Longman RW (2000) Iterative learning control and repetitive
Window Servo Design Kit (WSDK), a program provided control for engineering practice. Int J Control 73:930–954
5. Kaneko K, Horowitz R (1997) Repetitive and adaptive control of
by Galil motion control, allows users to use basic assem- robot manipulators with velocity estimation. IEEE Trans Robot
bly language to control the motion profile of the motors. Autom 13:204–217
Users can program the motors to run simultaneously using 6. Wei R, Balasubramanian S, Xu L, He J (2008) Adaptive Iterative
different modes, such as electronic CAM mode, contour Learning Control design for RUPERT IV. In: 2nd Biennial IEEE/
RAS-EMBS International Conference on Biomedical Robotics
mode, and absolute positioning mode. At current stage, and Biomechatronics, BioRob 2008, 19 Oct 2008–22 Oct 2008,
WSDK was used to program the gait pattern for the robotic Scottsdale, pp 647–652
orthosis. Then the feedback motor torque is calculated by 7. Xiaoke F, Xing L, Jianhui W, Liang D (2010) Repetitive control
WSDK based on tracking error. The tendency of decreased of rehabilitation robot with multi-channel periodic input sig-
nal. In: Intelligent Control and Automation (WCICA), 2010 8th
assistant torque is similar to the change of the tracking World Congress on 2010, pp 6605–6609
error under RC compared with PD control. The overall 8. Wang P, Low KH, McGregor AH (2011) A subject-based motion
frequency response compared between the conventional generation model with adjustable walking pattern for a gait
PD controller and repetitive controller is shown in Fig. 8. robotic trainer: NaTUre-gaits. In: 2011 IEEE/RSJ International
Conference on Intelligent Robots and Systems (IROS), San
Band pass is enlarged for the repetitive controller compared Francisco (2011)
with the PD controller, which allows more accurate desired 9. Okamoto S, Lee JH, Fujieda H (2013) Computational and exper-
motion pass through the system as expected. imental analyses on impact reduction when a humanoid robot
lands on the ground. Artificial Life and Robotics 18:212–218
10. Motonaka K, Watanabe K, Maeyama S (2014) Offline gain opti-
mization in kinodynamic motion planning based on a harmonic
4 Concluding remarks potential field. Artificial Life and Robotics 19:47–54
11. Koceska N, Koceski S, Zobel PB, Durante F (2008) Control
The RC algorithm has been developed to achieve steady architecture for a lower limbs rehabilitation robot system. In:
IEEE International Conference on Robotics and Biomimetics
tracking performance of the cyclic input signals and reject (ROBIO), Bangkok, Thailand, pp 971–976
disturbance on the robotic control for the lower-limb reha- 12. Erol D, Mallapragada V, Sarkar N, Uswatte G, Taub E (2005)
bilitation. The combination between RC and gait analysis A new control approach to robot assisted rehabilitation. In:
develops the method to obtain fundamental frequency of IEEE 9th International Conference on Rehabilitation Robotics
(ICORR), Chicago, pp 323–328
RC by the analysis of the dominant frequency components 13. Buerger SP, Hogan N (2007) Complementary stability and loop
based on the frequency decomposition. RC in the reha- shaping for improved human-robot interaction. IEEE Trans Rob
bilitation robot control suppresses the tracking error and 23:232–244
improves the active level of assistant torque, which is dem- 14. Emken JL, Harkema SJ, Beres-Jones JA, Ferreira CK, Reinkens-
meyer DJ (2008) Feasibility of manual teach-and-replay and
onstrated by comparison with conventional PD controller, continuous impedance shaping for robotic locomotor train-
providing an alternative robotic control method focusing ing following spinal cord injury. IEEE Trans Biomed Eng
on the lower-limb rehabilitation with repetitive walking 55:322–334
training. 15. Zhang JF, Dong YM, Yang CJ, Geng Y, Chen Y, Yang Y (2010)
5-Link model based gait trajectory adaption control strategies
of the gait rehabilitation exoskeleton for post-stroke patients.
Acknowledgment  Thanks to the support of the Special Fund for Mechatronics 20:368–376
Basic Scientific Research of Central Colleges, Chang’an University, 16. Yoon J, Novandy B, Yoon CH, Park KJ (2010) A 6-DOF gait
China (No. 2014G2320006, 2013G3322009, 2014G1321040) and the rehabilitation robot with upper and lower limb connections
Key Science and Technology Program of Shaanxi Province, China that allows walking velocity updates on various terrains. IEEE/
(Grant No. 2013JC2-25) ASME Trans Mechatron 15:201–215
17. Ying-Yu T, Rong-Shyang O, Jung SL, Meng-Yueh C (1997)

High-performance programmable AC power source with low
References harmonic distortion using DSP-based repetitive control tech-
nique. Power Electronics, IEEE Transactions on 12:715–725
18. Wang JH, Li X, Fang XK, Dong L, C. Northeastern Univ (2010)
1. Wang P, Low KH, Tow A (2010) Effects of body-weight support Single-joint Repetitive Control of Upper-limb Rehabilitation
locomotion training (BWSLT) on EMG activation in healthy and Robot. In: Control and Decision Conference (CCDC), China,
spinal cord injury (SCI) subjects. In: IEEE International Confer- 26–28 May 2010, p 1330
ence on Robotics and Biomimetics (ROBIO), 2010, pp 271–276 19. Wang P, McGregor A, Tow A, Lim HB, Khang LS, H. Low K
2. Wang P, Low KH, McGregor AH, Tow A (2013) Detection of (2009) Rehabilitation control strategies for a gait robot via EMG
abnormal muscle activations during walking following spinal evaluation. In: IEEE 11th International Conference on Rehabili-
cord injury (SCI). Res Dev Disabil 34:1226–1235 tation Robotics (ICORR), Kyoto, pp 86–91
3. Liuping W, Shan C, Rogers E (2010) Predictive repetitive control
based on frequency decomposition. American Control Confer-
ence (ACC) 2010:4277–4282

13

You might also like