Robotics and Autonomous Systems: Jafar Kazemi Sadjaad Ozgoli
Robotics and Autonomous Systems: Jafar Kazemi Sadjaad Ozgoli
Robotics and Autonomous Systems: Jafar Kazemi Sadjaad Ozgoli
highlights
article info a b s t r a c t
Article history: Lower extremity exoskeletons have been developed as a motion assistive technology in recent years.
Received 30 September 2018 Walking pattern generation is a fundamental topic in the design of these robots. The usual approach
Received in revised form 10 January 2019 with most exoskeletons is to use a pre-recorded pattern as a look-up table. There are some deficiencies
Accepted 18 February 2019
with this method, including data storage limitation and poor regulation relating to the walking
Available online 2 March 2019
parameters. In addition, the walking parameters can be taken in hand very hard. Therefore modeling
Keywords: the human walking pattern is required. The few existing models provide piece by piece walking
Exoskeleton patterns, only generating at the beginning of each stride. In this paper, a real-time walking pattern
Walking pattern generation method is provided which enables changing the parameters during the stride. For this
Optimal control purpose, two feedback controlled third order systems are proposed as real-time trajectory planners for
Center of mass
generating the trajectories of the x and y components of each joint’s position. The boundary conditions
Exoped
of the trajectories are determined to prevent backward balance loss by appropriate displacement of the
center of mass. In addition, a cost function is intended for each trajectory planner in order to increase
the smoothness of trajectories. Optimization technique is used to design the feedback controller for
tracking the boundary conditions in such a way that the cost function is minimized. Finally, the proper
joint angles are generated using inverse kinematics transformation. The performance of the proposed
pattern generator is verified via real experiments on the Exoped robot.
© 2019 Elsevier B.V. All rights reserved.
https://doi.org/10.1016/j.robot.2019.02.012
0921-8890/© 2019 Elsevier B.V. All rights reserved.
2 J. Kazemi and S. Ozgoli / Robotics and Autonomous Systems 116 (2019) 1–23
Fig. 6. A general trajectory shape for the x component of the position of the joints.
Fig. 7. The proposed trajectory planner for the x component of the position of the joints.
where the symbol * refers to the extremals of Xj (t ), vx (t ), and Therefore, from Lemma 1 and (13), ux (t) is obtained as (12).
P (t ). The necessary conditions for optimality can be written as The trajectory obtained by applying ux (t) to the system Sx is
ẋ∗1 (t) = x∗2 (t) denoted by Tx (t , tf , Xj (tf )), where:
Fig. 8. The general trajectory shape for the y component of the position of the joints.
Fig. 9. The proposed trajectory planner for the y component of the position of the joints.
where that the cost function Jy is minimized. uy (t) is obtained for t < tf as
360(y1 (tf ) − y1 (t0 )) 180(y2 (tf ) + y2 (t0 )) the following:
a= −
(tf − t0 )5 (tf − t0 )4 60(yj (tf ) − y1 (t)) 12(2ẏj (tf ) + 3y2 (t))
uy (t ) = −
30(y3 (tf ) − y3 (t0 )) k(tf − t0 ) (tf − t)3 (tf − t)2
+ −
(tf − t0 )3 8 3(ÿj (tf ) − 3y3 (t)) K (tf − t)3
+ − . (21)
360(y1 (tf ) − y1 (t0 )) 24(7y2 (tf ) + 8y2 (t0 )) (tf − t) 240
b= −
(tf − t0 )4 (tf − t0 )3
Proof. As in proof of Theorem 1:
12(2y3 (tf ) − 3y3 (t0 )) k(tf − t0 )2
+ −
uy (t ) = vy (t)|t0 = t
{ }
(tf − t0 )2 20 (22)
60(y1 (tf ) − y1 (t0 )) 12(2y2 (tf ) + 3y2 (t0 )) From Lemma 2 and (22), uy (t) is obtained as (21).
c= −
(tf − t0 )3 (tf − t0 )2
Calculation of k:
3(y3 (tf ) − 3y3 (t0 )) k(tf − t0 )3 According to the designed feedback control law (21) we have
+ − . (18)
(tf − t0 ) 240 tf tf
(tf − t0 )7
∫ ⏐ ∫ ⏐
yj (t ) dt ⏐⏐ yj (t ) dt ⏐⏐
⏐ ⏐
− = −k∗ × (23)
t0 k=k∗ t0 k=0
5 × 8!
Proof. As in proof of Lemma 1, the Hamiltonian function is
defined as where k∗ denotes the proper value of k for generating a trajectory
p
with a peak of yj .
H Yj (t ) , vy (t ) , P (t ) =vy2 (t ) + ky1 (t ) + p1 (t ) y2 (t )
( )
By describing the trajectories by piecewise fifth-order polyno-
+ p2 (t ) y3 (t ) + p3 (t ) vy (t ) (19) mials, the approximate integral of yj (t) for k = 0 and for k = k∗
can be calculated numerically as
The necessary conditions for optimality can be written as ⎡ ⎤T ⎡ ⎤
∗ ∗ 60yj (t0 ) (tf − t0 )
ẏ1 (t) = y2 (t) ⎢ ⎥ ⎢ ⎥
⎢ 12ẏj (t0 ) ⎥ ⎢(tf − t0 )2 ⎥
ẏ∗2 (t) = y∗3 (t) ∫ tf
⏐ ⎢ ⎥ ⎢ ⎥
1 ⎢ ÿj (t0 ) ⎥ ⎢(tf − t0 )3 ⎥
⎢ ⎥ ⎢ ⎥
ẏ∗3 (t ) = −0.5p∗3 (t) yj (t ) dt ⏐⏐ ∼ ⎥ .⎢
⏐
= ⎢ ⎥ (24)
t0 120 ⎢ 60yj (tf ) ⎥ ⎢ (tf − t0 ) ⎥
ṗ∗1 (t ) = −k k=0 ⎢ ⎥ ⎢ ⎥
⎣−12ẏj (tf )⎦ ⎣(tf − t0 )2 ⎦
⎢ ⎥ ⎢ ⎥
ṗ∗2 (t ) = −p∗1 (t )
ṗ∗3 (t ) = −p∗2 (t ) ÿj (tf ) (tf − t0 )3
The trajectory
( obtained by applying ) uy (t) to the system Sy is
p
denoted by Ty t , t0 , tf , Yj (t0 ), Yj (tf ), yj , where:
p
Ty t , t0 , tf , Yj (t0 ), Yj (tf ), yj = yj (t)|u = uy (t ) , t < tf .
( ) { }
(27)
Table 1
Boundary conditions of the x component of the joints position for the double
support phase (tf = t0 + 0.2Ts ).
Joint Hip Left ankle Right ankle
xRa0 +xLa0 (1+0.2ωTs )
xj (tf ) 2+0.2ωTs
xLa0 xRa0
ω xLa0 − xh (tf )
( )
ẋj (tf ) 0 0
g (x −x (t ))×y (t )
ẍj (tf ) − La0 h f 2 2h f 0 0
(xLa0 −xh (tf )) +yh (tf )
Table 2
Boundary conditions of the y component of each joints position for the double
support phase (tf = t0 + 0.2Ts ).
Joint Hip Left ankle Right ankle
√ ( )2
yj (tf ) l2 − xh (tf ) − xRa0 0 0
xRa0 −xh (tf )
ẏj (tf ) yh (tf )
× ẋh (tf ) 0 0
( )
g xLa0 −xh (tf )
2
ÿj (tf ) − 0 0
(xLa0 −xh (tf ))2 +y2h (tf )
p
√
yj l2 − 0.25 (xLa0 − xRa0 )2 0 0
Table 3
Boundary conditions of the x component of the joints position for the single
support phase (tf = t0 + Ts ).
Joint Hip Left ankle Right ankle
xj (tf ) xLa0 + 0.25Ls xLa0 xLa0 + 0.5Ls
ẋj (tf ) 0 0 0
ẍj (tf ) 0 0 0
constraints (28):
Fig. 12. Trajectory planned by Tx for fixed boundary conditions. Dashed lines indicate the boundary conditions. Solid lines indicate the planned trajectory, the first
and the second derivatives, and the control signal.
Fig. 13. Trajectory planned by Tx for changeable boundary conditions. Dashed lines indicate the boundary conditions. Solid lines indicate the planned trajectory, the
first and the second derivatives, and the control signal.
Fig. 14. Trajectory planned by Ty for fixed boundary conditions. Dashed lines indicate the boundary conditions. Dot-dashed line indicates the peak value. Solid lines
indicate the planned trajectory, the first and the second derivatives, and the control signal.
Fig. 15. Trajectory planned by Ty for changeable boundary conditions. Dashed lines indicate the boundary conditions. Dot-dashed line indicates the peak value. Solid
lines indicate the planned trajectory, the first and the second derivatives, and the control signal.
Xj (tf ) = [2 1 1]T at tf = 5. While in Fig. 13, the boundary the figures, the continuity of the first and the second derivatives
conditions change from Xj (tf ) = [2 1 1]T to Xj (tf ) = [1 − are maintained against the change of the parameters. As well
0.5 − 1]T at t = 2 and the boundary time is brought forward as, the final conditions of the trajectories reach to the required
from tf = 5 to tf = 4 at t = 3. Similarly for Ty , Figs. 14 and 15 boundaries at t = tf . The results illustrate the good performance
represent the trajectories, respectively for fixed and changeable of the trajectory planners.
boundary conditions. Fig. 14 shows the trajectory generated by
p
Ty for Yj (t0 ) = [0 1 0]T , Yj (tf ) = [1 − 1 − 1]T , yj = 2, and tf = 5. 5.2. The real-time walking pattern implementation
While in Fig. 15, the boundary parameters change three times at
t = 1, 2, and 3. In the figures, the dashed lines are the boundary For evaluating the proposed walking pattern generation
conditions, while the solid lines indicate the planned trajectory, method, different experiments with different walking parameters
the first and the second derivatives of the trajectory, and the were carried out on the Exoped robot. In order to evaluate the
control signal of the trajectory planner systems. As shown in robustness of the method across different users, each experiment
J. Kazemi and S. Ozgoli / Robotics and Autonomous Systems 116 (2019) 1–23 11
Fig. 17. The x component of the position of the joints in the first experiment.
Table 5 the walking ends with a half-step taken by the left leg. Fig. 16
The characteristics of the participants.
shows the walking parameters related to the first experiment,
Participant lT lS Weight
which took 20 s. As shown, the half-step and full-step time was
User1 45 cm 51 cm 82 kg
User2 42 cm 47 cm 71 kg
2 and 4 s respectively. Maximum foot clearance and step length
were considered as Hs = 10 cm and Ls = 60 cm. The zero
step length from t = 18 s to t = 20 s corresponds to the final
half-step.
was repeated by two participants described in Table 5. The
Figs. 17 and 18 show the real-time position of the joints
experimental results of user1 are presented in the following. As
well as, the effect of the participant’s dimensions on the backward generated by the proposed method for the first experiment. As
balance of the robot is studied by comparing the stability results shown by the figures, the required walking parameters were
of the users. satisfied. Moreover, all of the trajectories had a continuous second
derivative.
5.2.1. The 1st experiment By applying inverse kinematics transformations, the desired
In the first experiment, walking begins from a standing pose angle trajectories of the joints were obtained in real-time as
and the right leg takes the first half-step. After taking four strides, shown in Fig. 19. A PID controller was used for regulation of
12 J. Kazemi and S. Ozgoli / Robotics and Autonomous Systems 116 (2019) 1–23
Fig. 18. The y component of the position of the joints in the first experiment.
Fig. 19. Experimental result; The reference angles (black lines) and the real angles (red lines) of the joints in the first experiment . (For interpretation of the
references to color in this figure legend, the reader is referred to the web version of this article.)
each motor’s reference input. The obtained reference angles of the 5.2.2. The 2nd experiment
joints compared to the real angles measured by the hall sensors The second experiment was carried out to evaluate the efficacy
of the proposed method in obstacle crossing. As shown in Fig. 22,
are depicted in the plots. Also, the motor current corresponding
maximum foot clearance increased at t = 5 s from Hs = 8 cm to
to each joint is shown in Fig. 20.
Hs = 15 cm.
Fig. 21 Presents snapshots of whole walking cycle during the Figs. 23 and 24 show the generated real-time position of the
first experiment. joints. As shown in Fig. 24, the height of the stride increased from
J. Kazemi and S. Ozgoli / Robotics and Autonomous Systems 116 (2019) 1–23 13
Fig. 20. Experimental result; The motor currents of the joints in the first experiment.
Fig. 21. Snapshots of whole walking cycle during the first experiment.
Fig. 23. The x component of the position of the joints in the 2nd experiment.
Fig. 24. The y component of the position of the joints in the 2nd experiment.
8 cm to 15 cm in the second full-step. In addition, the continuity 5.2.3. The 3rd experiment
of the second derivative of the trajectories are maintained in In the 3rd experiment the step length was shortened at the
respect to the change of the parameters at t = 5 s and t = 10 s. beginning of the second full-step and then reset back to the
Figs. 25 and 26 show the implementation results of the second previous value at the middle of the third step. Fig. 27 shows the
experiment. walking parameters during the experiment.
J. Kazemi and S. Ozgoli / Robotics and Autonomous Systems 116 (2019) 1–23 15
Fig. 25. Experimental result; The reference angles (black lines) and the real angles (red lines) of the joints in the 2nd experiment . (For interpretation of the references
to color in this figure legend, the reader is referred to the web version of this article.)
Fig. 26. Experimental result; The motor currents of the joints in the 2nd experiment.
Fig. 28. The x component of the position of the joints in the 3rd experiment.
Fig. 29. The y component of the position of the joints in the 3rd experiment.
The generated real-time positions of the joints are shown in 5.2.4. The 4th experiment
Figs. 28 and 29. As shown by the figures, the required step length The real-time changing of the walking speed is implemented
was satisfied in addition to maintaining continuity of the second in the 4th experiment. As shown in Fig. 32 the walking speed
derivatives. Figs. 30 and 31 show the implementation results of decreased at t = 6.2 s and then reset back to the previous value
the experiment. at t = 12 s.
J. Kazemi and S. Ozgoli / Robotics and Autonomous Systems 116 (2019) 1–23 17
Fig. 30. Experimental result; The reference angles (black lines) and the real angles (red lines) of the joints in the 3rd experiment . (For interpretation of the references
to color in this figure legend, the reader is referred to the web version of this article.)
Fig. 31. Experimental result; The motor currents of the joints in the 3rd experiment.
Fig. 33. The x component of the position of the joints in the 4th experiment.
Fig. 34. The y component of the position of the joints in the 5th experiment.
Figs. 33 and 34 show the generated real-time position of the 5.2.5. The 5th experiment
joints. As shown by the figures, the required walking parameters The 5th experiment was carried out to evaluate the efficacy
were satisfied in addition to maintaining continuity of the second of the proposed method in response to the changes in all the
derivatives. Figs. 35 and 36 show the implementation results of parameters. Fig. 37 shows the walking parameters during the
the 4th experiment. experiment. As shown, maximum foot clearance and step length
J. Kazemi and S. Ozgoli / Robotics and Autonomous Systems 116 (2019) 1–23 19
Fig. 35. Experimental result; The reference angles (black lines) and the real angles (red lines) of the joints in the 4th experiment . (For interpretation of the references
to color in this figure legend, the reader is referred to the web version of this article.)
Fig. 36. Experimental result; The motor currents of the joints in the 4th experiment.
Table 6 decision to put the left leg down 20 cm ahead of the right leg
Comparing the stability of the gaits for user1 and user2. in 1.2 s. This corresponds to setting Ls = 40 cm and Ts =
SM(t0 + 0.2Ts ) 2.7 s.
∫
Experiment Participant SM(t)dt
User1 5.029 0.0312 Figs. 38 and 39 show the generated real-time position of the
Exp1
User2 5.139 0.0326 joints. As shown by the figures, the required walking parameters
User1 3.981 0.0314 were satisfied in addition to maintaining continuity of the second
Exp2
User2 4.067 0.0330 derivatives. Figs. 40 and 41 show the implementation results of
User1 3.534 0.0290 the 5th experiment.
Exp3
User2 3.609 0.0302
User1 4.254 0.0278 5.2.6. Stability analysis
Exp4
User2 4.338 0.0288 By defining the stability margin SM in the single support phase
User1 3.005 0.0279 as
Exp5
User2 3.066 0.0291
SM (t ) = ẋh (t ) − ω(max(xRa (t), xLa (t)) − xh (t)), (52)
the following constraint should be satisfied to avoid a back-
ward balance loss during the single support phase
increased at t = 1.8 s and t = 6 s respectively. Also, walk-
ing speed decreased at t = 4.5 s. The walking ends with a SM (t ) > 0. (53)
20 J. Kazemi and S. Ozgoli / Robotics and Autonomous Systems 116 (2019) 1–23
Fig. 38. The x component of the position of the joints in the 5th experiment.
The value of SM(t) for each experiment is given in Fig. 42, results for user1 and user2, it can be seen that the ∼7% decrease
in which SM (t ) is positive for all experiments and the stability in l = lT + lS leads to ∼4% improvement in stability of the gaits
of the gaits are preserved. By comparing SM(t) in the first and at the critical time (beginning of the double support phases) and
second experiment, it can be said that in the proposed method ∼2% improvement in stability of the gaits during the walking
the backward balance is not affected by Hs . While, the 4th exper- cycles.
iment (6.2 < t < 12) demonstrates that a significant decrease in
walking speed can lead to backward balance loss. 6. Conclusion
The stability margin obtained for user1 and user2 is compared
in order to investigate the effect of the user dimensions on the A walking pattern generation method is proposed which gen-
stability of the gaits. For this purpose, the integrals of SM (t ) erates the joint angles based on gait parameters. The provided
during the experiments, and the mean values of SM(t0 + 0.2Ts ) pattern generator is designed in such a way that enables changing
at the start time of the double support phases are computed. The the gait parameters during the stride. For this purpose, the real-
obtained values are summarized in Table 6. By comparing the time trajectory planning problem is formulated as an optimal
J. Kazemi and S. Ozgoli / Robotics and Autonomous Systems 116 (2019) 1–23 21
Fig. 39. The y component of the position of the joints in the 5th experiment.
Fig. 40. Experimental result; The reference angles (black lines) and the real angles (red lines) of the joints in the 5th experiment . (For interpretation of the references
to color in this figure legend, the reader is referred to the web version of this article.)
control problem with changeable final states; and a novel method Exoped robot. The results indicate that the robot has a smooth
is proposed to solve this problem. The trajectories generated by and stable motion even by changing the walking parameters.
the proposed method have continuous second derivatives, even The proposed method provides a natural walking pattern for
with the changing parameters of gait. In order to achieve a stable the lower limb exoskeletons, which is adaptable to the change
walking gait, the trajectory of the center of mass is defined in of the walking parameters in different situations and moments.
such a way to prevent the backward balance loss. Two experi- Moreover, the proposed method provides a safe way for walking
ments were carried out to evaluate the proposed method on the with crutches by maintaining the backward balance. Considering
22 J. Kazemi and S. Ozgoli / Robotics and Autonomous Systems 116 (2019) 1–23
Fig. 41. Experimental result; The motor currents of the joints in the 5th experiment.
Fig. 42. The value of SM(t) during the experiments for user1. SM(t) is defined as zero in double support phases.
the stability in the gait can help the user by reducing the force References
applied to the arms, especially in the clinical training between the
[1] R.S. Mosher, Handyman to Hardiman, SAE Trans. 76 (1968) 588–597.
parallel bars. According to Fig. 3 our future work is to design the
[2] A. Formalskii, A. Shneider, Book Reviews : Biped Locomotion (Dynamics
walking parameters generator block. As an example, the sensor Stability Control and Application): by M. Vukobratovich, B. Borovac, D.
based determination of the parameters can be used for automat- Surla, and D. Stokich published by Springer-Verlag, 1990, Int. J. Robot. Res
11 (4) (1992) 396.
ing the movement of the robot in order to overcome obstacles [3] E. Guizzo, H. Goldstein, The rise of the body bots [robotic exoskeletons],
and difficult situations. As well as, the real-time computing of IEEE Spectr. 42 (10) (2005) 50–56.
the walking parameters according to the stability of the robot [4] T. Yan, M. Cempini, C.M. Oddo, N. Vitiello, Review of assistive strategies
in powered lower-limb orthoses and exoskeletons, Robot. Auton. Syst. 64
can make the movement of the robot safer. For this purpose, the (2015) 120–136.
foot force stability margin [19] is a simple and reliable index for [5] M. Vukobratović, B. Borovac, Zero-moment point — thirty five years of its
assessing stability of a exoskeleton robot. In any case, the real- life, Int. J. Humanoid Robot. 01 (01) (2004) 157–173.
[6] H.F.N. Al-Shuka, B. Corves, W.-H. Zhu, B. Vanderborght, Multi-level control
time determination of the walking parameters will be a potential of zero-moment point-based humanoid biped robots: a review, Robotica
application of the proposed walking pattern generator. 34 (11) (2016) 2440–2466.
J. Kazemi and S. Ozgoli / Robotics and Autonomous Systems 116 (2019) 1–23 23
[7] H. Kazerooni, J.L. Racine, L. Huang, R. Steger, On the Control of the [17] D.E. Kirk, Optimal Control Theory: An Introduction, Courier Corporation,
Berkeley Lower Extremity Exoskeleton (BLEEX), in: Proceedings of the 2012.
IEEE 2005 International Conference on Robotics and Automation, 2005, [18] Waijung Blockset. [Online]. Available: http://waijung.aimagin.com/ [Ac-
pp. 4353–4360. cessed: 05-Jul-2018].
[8] C. Lee, J.-Y. Kim, S.-Y. Kim, S. Oh, Human force observation and assistance [19] M. Agheli, S.S. Nestinger, Force-based stability margin for multi-legged
for lower limb rehabilitation using wire-driven series elastic actuator, robots, Robot. Auton. Syst. 83 (2016) 138–149.
Mechatronics 55 (2018) 13–26.
[9] A. Esquenazi, M. Talaty, A. Packel, M. Saulino, The rewalk powered
exoskeleton to restore ambulatory function to individuals with thoracic-
level motor-complete spinal cord injury, Am. J. Phys. Med. Rehabil. 91 (11) Jafar Kazemi received his B.Sc. in electrical engineering
(2012) 911–921. from Tabriz University, Tabriz, Iran, in 2012, and his
[10] K.A. Strausser, H. Kazerooni, The development and testing of a human M.Sc. in electrical engineering from Tarbiat Modares
machine interface for a mobile medical exoskeleton, in: 2011 IEEE/RSJ University, Tehran, Iran, in 2014. He is currently a Ph.D.
International Conference on Intelligent Robots and Systems, 2011, pp. student in the Electrical and Computer Engineering
4911–4916. Department at Tarbiat Modares University, Tehran, Iran.
[11] D. Sanz-Merodio, M. Cestari, J.C. Arevalo, E. Garcia, Control motion ap- His current research interest focuses on the lower limb
proach of a lower limb orthosis to reduce energy consumption, Int. J. Adv. exoskeletons.
Robot. Syst. 9 (6) (2012) 232.
[12] J. Yoon, R.P. Kumar, A. Özer, An adaptive foot device for increased gait and
postural stability in lower limb Orthoses and exoskeletons, Int. J. Control
Autom. Syst. 9 (3) (2011) 515. Sadjaad Ozgoli is an associate professor working with
[13] R. Huang, H. Cheng, Y. Chen, Q. Chen, X. Lin, J. Qiu, Optimisation of the electrical engineering school at Tarbiat Modares
reference gait trajectory of a lower limb exoskeleton, Int. J. Soc. Robot. University. He works on control systems with appli-
8 (2) (2016) 223–235. cation to Mechatronics systems and Biological systems.
[14] F.M. Silva, J.A.T. Machado, Kinematic aspects of robotic biped locomotion He received his B.Sc. and M. Eng degrees in electri-
systems, in: Proceedings of the IEEE/RSJ International Conference on cal engineering from Sharif University of Technology,
Intelligent Robots and Systems, 1997. IROS ’97, 1997, pp. 266–272 vol.1. Tehran, Iran, respectively in 1997 and 1999. He
[15] E.T. Esfahani, M.H. Elahinia, Stable walking pattern for an SMA-actuated received his Ph.D. from K.N. Toosi University of Tech-
biped, IEEE ASME Trans. Mechatron. 12 (5) (2007) 534–541. nology, Tehran, Iran in electrical engineering with
[16] T. Kagawa, H. Ishikawa, T. Kato, C. Sung, Y. Uno, Optimization- based minors in mechanical engineering in 2005. He has pub-
motion planning in joint space for walking assistance with wearable robot, lished more than 40 papers in international Journals
IEEE Trans. Robot. 31 (2) (2015) 415–424. and conference proceedings.