Robotics 12 00083 v4
Robotics 12 00083 v4
Robotics 12 00083 v4
Article
Finger Joint Stiffness Estimation with Joint Modular Soft
Actuators for Hand Telerehabilitation
Fuko Matsunaga 1 , Shota Kokubu 1 , Pablo Enrique Tortos Vinocour 1 , Ming-Ta Ke 2 , Ya-Hsin Hsueh 3 ,
Shao Ying Huang 4 , Jose Gomez-Tames 1,5 and Wenwei Yu 1,5, *
1 Department of Medical Engineering, Graduate School of Engineering, Chiba University, Chiba 263-8522, Japan
2 Graduate School of Intelligent Data Science, National Yunlin University of Science and Technology,
Yunlin 64002, Taiwan
3 Department of Electronic Engineering, National Yunlin University of Science and Technology,
Yunlin 64002, Taiwan
4 Engineering Product Development Department, Singapore University of Technology and Design,
Singapore 487372, Singapore
5 Center for Frontier Medical Engineering, Chiba University, Chiba 263-8522, Japan
* Correspondence: yuwill@faculty.chiba-u.jp; Tel.: +81-43-290-3231
analytical model of SECA for estimating finger joint stiffness is not completely applicable
to this new type of actuator.
The analytical model of the SECA is derived from the air chamber unit energy con-
servation law, so the length of the air chamber is included in the analytical model, but
not the length of the actuator itself. When the lengths of the air chambers are equal, the
analytical model can be interpreted as indicating that the SECA and Modular-SECA have
the same bending performance. Therefore, it is possible to estimate the stiffness of the
Modular-SECA using the original analytical model of the SECA. However, unlike the SECA,
the joint modular soft actuator has rigid connectors at both ends, and the length ratio of the
actuator body to the chamber is different [17,20]. Therefore, the two types of soft actuators
may exhibit different bending performances, and the analytical model of the SECA cannot
be applied directly to that of the Modular-SECA.
Another problem of the stiffness estimation method described in [17] is caused by
using a marker-based joint angle measurement. However, it is difficult for the patient
or his/her family members to attach the markers at precise positions, which limits its
application to telerehabilitation.
Furthermore, using 2D markers limits the acquisition of joint angles on a flat surface,
making it impossible to measure the joint angles of the middle and ring fingers, and thus
making it difficult to estimate the joint stiffness of them. Zhou et al. have developed a
system that simultaneously obtains the joint angles of multiple fingers and estimates their
stiffness by integrating a flex sensor into an actuator [22]. Flex sensors do not interfere with
the bending response of soft actuators too much, but they must be calibrated individually
for each actuator and cannot measure finger or hand orientation [23,24]. Moreover, using
this system, it is not possible to measure joint angles when a soft actuator is not attached. By
designing a system that can measure joint angles without having the soft actuators attached,
it is also possible to measure joint range of motion, increasing the system’s functionality.
In addition, having a high-cost system can limit how many devices can be provided for
telerehabilitation [25].
The leap motion controller (LMC) is an inexpensive and compact marker-less mea-
surement device for tracking and acquiring the position of hand joints. Although the
accuracy of hand joint angle measurement is not sufficient for rehabilitation purposes [26],
it is possible to improve the measurement accuracy by fitting a regression model of joint
angle [27]. However, the combined use of LMC and soft actuators has not yet been inves-
tigated. Especially, joint modular soft actuators may cause the motion of one single joint,
which is different from most natural hand motions. It is also unclear how the attachment
of the soft actuator affects the LMC and whether or not the measurement accuracy can be
improved in the same way as when the soft actuator is not attached.
In this study, we proposed finger joint stiffness estimation for hand–finger joints using
Modular-SECAs and the LMC, and verified the feasibility of this procedure by performing
stiffness estimation on a mannequin hand and a subject’s MCP joint, respectively. We
designed the Modular-SECA, a joint modular soft actuator incorporating the finger joint
stiffness estimation function. In addition, correction terms (or parameters) were added to
the previous analytical model for the bending analysis of a Modular-SECA supporting a
joint for the purpose of hand rehabilitation. The correction parameters were determined
by comparing the values of the bending angles obtained from the analytical model with
measured angles from a free bending experiment with the Modular-SECAs. Moreover, a
regression model accounting for the actuation for and motion of the neighboring joints was
proposed to correct the direct outputs of LMC.
This paper is organized as follows: First, the design and improved analytical model of
the joint modular soft actuator for stiffness estimation are presented. Next, the regression
model method to improve the accuracy of LMC joint angle measurement is presented.
Finally, validation experiments using a mannequin hand and a subject’s hand are presented
in which stiffness estimation is performed using a combination of these methods.
2. Materials and Methods
2.1. Joint Modular Soft Actuators for Joint Stiffness Estimation
Robotics 2023, 12, 83 4 of 25
This subsection gives a concise introduction to the design of the joint modular soft
actuator, for the sake of clarity. A more comprehensive explanation can be found in [20].
The analytical model for the SECA and thereby the improved analytical model for the
2. Materials and Methods
joint modular soft
2.1. Joint actuator
Modular are explained.
Soft Actuators for Joint Stiffness Estimation
This subsection gives a concise introduction to the design of the joint modular soft
2.1.1. Design andfor
actuator, Fabrication
the sake of clarity. A more comprehensive explanation can be found in [20].
TheThe analytical modelconsists
Modular-SECA for the SECA
of anand thereby thebody,
elastomer improved analytical model
a semi-circular forchamber
air the joint with
modular soft actuator are explained.
air pockets, a silicone tube, a fiber reinforcement wrapped around its circumference, 3D-
printed rigid connectors,
2.1.1. Design and a torque compensation layer. When pressurized with air
and Fabrication
pressure, theThe fibers wrapped consists
Modular-SECA aroundofthe surface of
an elastomer theaactuator
body, suppress
semi-circular radial
air chamber elonga-
with
air pockets, a silicone tube, a fiber reinforcement wrapped around
tion. The torque-compensating layer limits axial elongation at the bottom, allowing onlyits circumference, 3D-
printed rigid connectors, and a torque compensation layer. When pressurized with air
the top of the actuator to extend and the finger to bend. During decompression, the
pressure, the fibers wrapped around the surface of the actuator suppress radial elongation.
torque-compensating layer provides
The torque-compensating a supplementary
layer limits axial elongationbending moment
at the bottom, to extend
allowing only thethe fin-
ger to itstop
initial
of theposition.
actuator to extend and the finger to bend. During decompression, the torque-
The compensating
silicon partlayer of the actuator
provides was madebending
a supplementary by pouring
moment silicon (Smooth-On,
to extend Dragon
the finger to its
initial position.
Skin 10 Medium) into a 3D-printed mold. A stainless-steel plate (A2 stainless-steel plate)
The silicon part of the actuator was made by pouring silicon (Smooth-On, Dragon Skin
with a thickness of 0.2 mm was used for the torque compensating layer, which was at-
10 Medium) into a 3D-printed mold. A stainless-steel plate (A2 stainless-steel plate) with a
tached tothickness
the bottom of the
of 0.2 mm wassilicon
used for part of the
the torque actuator. Next,
compensating 0.3556
layer, which wasmm diameter
attached to the rein-
forcing fibers
bottommade of Kevlar
of the silicon (Dupont,
® the
part of actuator. Inc.,
Next, Delaware, USA) reinforcing
0.3556 mm diameter were wound fibersaround
made the
®
actuator,ofandKevlar
silicon(Dupont,
tubingInc.,
for Wilmington,
air flow andDE, USA) were connectors
3D-printed wound around madethe actuator, and acid
of polylactic
silicon tubing for air flow and 3D-printed connectors made of polylactic acid (PLA) resin
(PLA) resin were attached. Finally, a thin coat of silicone (Smooth-On, Dragon Skin 10
were attached. Finally, a thin coat of silicone (Smooth-On, Dragon Skin 10 Medium) was
Medium)applied
was applied
over the over
fibers the fibers them
to prevent to prevent them from
from shifting. Figureshifting.
1a shows theFigure 1a shows the
cross-section
cross-section and dimensions
and dimensions of the actuator.
of the actuator.
(a) (b)
Figure 1. (a) Modular-SECA
Figure cross-section
1. (a) Modular-SECA and dimensions;
cross-section (b) (b)
and dimensions; bending angle
bending anglemeasurement of Mod-
measurement of
ular-SECAModular-SECA
in free space.
in free space.
may cause the change in the ratio of both WA to WL , and their sum to P∆V. Therefore,
the analytical model of the SECA was modified to match the energy distribution of the
Modular-SECA, as shown in Equation (2):
α A WA + α L WL
P= (2)
αV ∆V
wm is the bending strain energy density function, λ is the principal stretch, and
Ci (i = 1, 2, 3) is the material coefficient. The 3rd-order Yeoh model parameters for the
silicon used (Smooth-On, Dragon Skin 10 Medium) were C1 = 0.04773 MPa,
C2 = 3.42 × 10−4 MPa, and C3 = −1.1942 × 10−6 MPa, respectively. These parame-
ters were calculated by using the material data provided in [29]. The material parameters
of the stainless-steel plates used as torque compensation layers with a Young’s modulus
of 193 GPa, a Poisson’s ratio of 0.318, and a density of 8000 kg/m3 [30]. The bending
angle in free space was measured by a camera-based two-dimensional marker detection
system (Figure 1b). The camera (C930eR, Logicool, Lausanne, Switzerland) recorded the
2D position coordinates of the markers and the angle was calculated. The bending angle,
θ, was obtained using Equation (4) when air pressure was applied from 0 kPa to 80 kPa
in 10 kPa increments. The bending angles obtained from the experiment were compared
with those from the analytical model, and correction parameters were identified using
the least-squares method. A more comprehensive description of FEM can be found in
Appendix A.
→ →
a·b
−1
θ = cos
→ → (4)
a b
𝑀𝑃⃗ ∙ 𝑃𝐷⃗
Robotics 2023, 12, 83 6 of 25
𝜃 = cos (6)
𝑀𝑃⃗ ∙ 𝑃𝐷⃗
goniometer (Appendix B), so these values were used as the reference values of joint angles
in this study. Figure 2a shows the setup for the joint𝑃𝐷 ⃗ ∙ 𝐷𝑇measurement.
angle ⃗ For the ease of
𝜃 = cos (7)
2D marker attachment, the index finger of the right𝑃𝐷 ⃗ ∙ was
hand 𝐷𝑇 ⃗ used for the measurement.
The 2D markers were attached to the side of the index finger of the mannequin hand, and
theThe anglebetween
distance obtained
LMC viaand
thethe
method usinghand
mannequin the two-dimensional
was set at 15 cm [33].marker is denoted as
The frictional
2D Angle, and the angle obtained by the method using LMC is denoted as the LMC Angle.
resistance of each joint of the index finger of the mannequin hand was negligible.
(a) (b)
Figure
Figure2.2.(a)
(a)Joint
Joint angle measurement
angle measurement setup;
setup; (b)(b) joints
joints andand
jointjoint angles.
angles.
In this study, a regression model is generated for taking into consideration the influence
of joint modular soft actuators to multiple joints of fingers. Therefore, unlike the previous
study, the regression model in this study needs the following explanatory variables.
• Angles of other joints:
As shown in Appendix C, the LMC Angle of one joint is affected by the interaction
between joints of the same finger. Therefore, to estimate the angle of one joint, it is
necessary to provide its current LMC Angle value, but also the angle values of other
joints in the same finger.
• Dummy variables indicating whether one joint modular soft actuator is pressurized or
not:
When joint modular soft actuators are attached to the joints of one finger, the ten-
dency of angle change of each joint differs depending on whether each soft actuator
is pressurized or not (Appendix C). Therefore, if a regression model is generated
from all the data regarding the angular changes of all joints in (a)–(g) in Figure A2,
corresponding to all combinations of the Boolean pressurization (1 = pressurized,
0 = not pressurized) variables, pDIP, pPIP and pMCP, except the case where pDIP = 0,
pPIP = 0, and pMCP = 0, the goodness of fit is likely low. Therefore, by introducing
the Boolean pressurization variables, a single model can be fitted to reflect the different
angular change tendencies caused by different pressurization combinations.
• Terms reflecting the interaction between variables:
Since it is impossible to guarantee that there is no interaction between all the explana-
tory variables, adding interaction terms may improve the correction performance.
Based on the above points, the regression models were generated to correct the LMC
Angles of the three joints, respectively, using the measurement data in Appendix C. LMC
Angles of the three joints of the same finger (DIP, PIP, and MCP) and the dummy pressur-
ization variables were used as explanatory variables (pDIP, pPIP, and pMCP) and their
interaction terms were also added as explanatory variables (Table 1).
Table 1. Candidate explanatory variables for correction models of LMC Angle with the soft actuator.
Total 23
However, explanatory variables that do not contribute to the correction of joint angles
may be included. The exclusion of variables with low contribution would improve the
correction of joint angles. Therefore, a variable selection was performed to the 23 candidate
explanatory variables shown in Table 1 to obtain the final explanatory variables.
der (less than half) of theTable ROM 2. Modified Ashworth scale for grading spasticity [36].
more marked
0 : no increase increase in muscle tone through most of the ROM, but affected part(s) easily
in muscle tone
slight increase in muscle tone, manifested by a catch and release or by minimal resistance at the end of the range of motion when
considerable
1 : increase in muscle tone, passive movement is difficult
the affected part/s is/are moved in flexion or extension
affected
1+ : part/s is/are rigid in flexion or extension
slight increase in muscle tone, manifested by a catch, followed by minimal resistance throughout the remainder (less than half)
of the ROM
2 : more marked increase in muscle tone through most of the ROM, but affected part(s) easily moved
3 : considerable increase in muscle tone, passive movement is difficult
4 : Table
affected part/s is/are rigid in 3. Spasticity
flexion and spring constant of the torsion
or extension spring used in the two le
Reference Stiffness
Table 3. Spasticity and spring constant of the torsion spring used in the two levels of stiffness values.
fness Level MAS Score Joint Condition
(N mm/deg)
Reference Stiffness Spring Constant
Stiffness Level MAS Score Joint Condition
w Stiffness 0 Healthy (N mm/deg) 0.52
(N mm/deg)
Low Stiffness 0 Healthy 0.52
dle Stiffness
Middle Stiffness 1+ 1+ Slight spasticity
Slight spasticity 1.40 1.400.552
1.686
Figure 3. Joint with middle stiffness made using a torsion spring with a spring constant of
Figure 3.mm/deg.
1.686 N Joint with middle stiffness made using a torsion spring with a spr
mm/deg. Stiffness values were estimated using different combinations of analytical models (the
SECA model and Modular-SECA model) and joint angles (2D Angle, original LMC Angle,
and corrected LMC Angle), comprising six combinations overall.
Estimation of Stiffness of Joints of Multiple Fingers
Estimation of Stiffness of Joints of Multiple Fingers
The feasibility of estimating the stiffness of joints of multiple fi
The feasibility of estimating the stiffness of joints of multiple fingers using the proposed
posed
methodmethod wastwo
was verified; verified; twoofdifferent
different states joint stiffnessstates of joint
were setup for this stiffness
purpose: we
healthy
pose: and simulated-stiff.
healthy and simulated-stiff.
The stiffnesses of MCP in multiple fingers (index, middle, ring, and little fingers)
of The stiffnesses
a healthy subject’s rightofhand
MCP werein multiple
estimated fingers
using the proposed (index, middle,
method (Figure 4a). ring,
Simulated-stiffness
a healthy subject’s jointsright
with a hand
higher apparent
were stiffness
estimatedvalue were
usingprepared
the byproposed
ban-
daging the healthy joints (Figure 4b). Each of the four fingers was bandaged to increase
Simulated-stiffness
stiffness in the extension joints
direction.with
For eacha higher apparent
state of stiffness, stiffness
estimation value wer
was performed
three times. The resting angle, θ0 , was measured using a goniometer. The thumb was fixed
aging the healthy joints (Figure 4b). Each of the four fingers was b
with a fixture because thumb movement could have affected the measurement data, and
stiffness in between
the distance the extension
the hand anddirection.
LMC was set to For each state of stiffness, estima
15 cm.
three times. The resting angle, 𝜃 , was measured using a goniome
fixed with a fixture because thumb movement could have affected th
and the distance between the hand and LMC was set to 15 cm.
Robotics 2023, 12, 83 10
Robotics 2023, 12, 83 variable; thus, the angle correction model for the index finger cannot be used
10 of 25for the
fingers.
(a) (b)
Figure
Figure4. 4.(a)(a)Setup
Setupofof the experiment
the experiment to to estimate
estimate the stiffness
the stiffness of a healthy
of a healthy subject’ssubject’s MCP join
MCP joint;
(b) stiff joint with a higher apparent stiffness value due to
stiff joint with a higher apparent stiffness value due to bandaging. bandaging.
It should be noted that, in the experiment, when estimating the MCP stiffness of the
3. Results
index finger, both the original LMC Angle and corrected LMC Angle were used, though for
3.1.the middle, ring,
Analytical andof
Model little
thefingers, their MCP stiffness values were estimated using only
Modular-SECA
the original LMC Angle. This is because that, the regression model for the corrected LMC
Theofcorrection
Angle parameters
the index finger identified
could be built by using were 𝛼 = angle
the reference 1, 𝛼 values
= 0.5,obtained
and 𝛼 from= 1.15. Su
tuting these parameters into Equation (2), the analytical model for the
the 2D marker measurement system; however, due to the difficulty to attach 2D markers toModular-SEC
as the other fingers, it was difficult to derive an angle correction model for them.
follows:
Certainly, one option might be making use of the angle correction model of the index
finger for the other fingers. Actually, as shown 𝑊 + 0.5𝑊 D, for the middle and ring
in Appendix
𝑃 =
fingers, the PIP and MCP joints had a good fit (>0.7) 1.15∆𝑉
with the corrected LMC Angle from
the index finger, but the DIP joint had a poor fit. Nevertheless, the angle correction model
forCompared
the MCP jointtoof the SECA
the index analytical
finger model,
also includes theangle
the DIP coefficient of the increase
as an explanatory variable; in cha
volume
thus, the angle correction model for the index finger cannot be used for the other fingers.strain en
relative to the air pressure input increased, and that of the bending
stored in the torque compensation layer decreased in the actuator’s energy distribu
3. Results
Figure 5 shows a graph comparing the actuator-only bending angles in free space
3.1. Analytical Model of the Modular-SECA
difference is seen between the results of the analytical model, experiment, and FEM
The correction parameters identified were α A = 1, α L = 0.5, and αV = 1.15. Substi-
ulation
tuting for the
these Modula-SECA.
parameters However,
into Equation there is model
(2), the analytical a difference between the isresults o
for the Modular-SECA
SECA analytical model and those of the Modular-SECA.
as follows:
WA + 0.5WL
P= (9)
1.15∆V
Compared to the SECA analytical model, the coefficient of the increase in chamber
volume relative to the air pressure input increased, and that of the bending strain energy
stored in the torque compensation layer decreased in the actuator’s energy distribution.
Figure 5 shows a graph comparing the actuator-only bending angles in free space. No
difference is seen between the results of the analytical model, experiment, and FEM simula-
tion for the Modula-SECA. However, there is a difference between the results of the SECA
analytical model and those of the Modular-SECA.
Figure 5. Actuator-only finger bending angle in free space obtained from analytical models,
and experiment.
Figure 5. Actuator-only finger bending angle in free space obtained from analytical models, FEM,
Figure 5. Actuator-only finger bending angle in free space obtained from ana
and experiment.
and experiment.
3.2. Joint Angle Correction Model with Actuator
Regression models created for each of the DIP, PIP, and MCP joints to correct the joint
3.2. Joint Angle Correction Model with Actuator
angles with soft actuators were as follows:
Regression models created for each of the DIP, PIP, and MCP jo
DIP = −6.77D + 13.71P − 12.27M + 92.36pD + 65.56pP − 40pM − 0.01P· M
joint angles with
−78.93pD soft
· pP − actuators
53.97pP were· pM
· pM − 69.07pD as+follows:
69.86pD · pP· pM (10)
+6.9D · pM + P·(4.66pD − 0.56pP − 15.74pM) − M·(4.79pD − 16.41pM)
𝐷𝐼𝑃 = −6.77 𝐷 + 13.71 𝑃 − 12.27 𝑀 + 92.36 𝑝𝐷 + 65.56 𝑝𝑃 − 40 𝑝𝑀
PIP = 2.55D + 1.69M − 3.32pP − 0.04D · P − 0.08D · M − 0.001D · P· M
−1.6pD · pP + 4.54pD · pM + 4.49pD · pP· pM (11)
+ D ·(1.49pP − 1.2pM) − M·(0.25pD + 0.29pM)
DIP( D ), PIP( P) and MCP( M ) are LMC Angles, and pDIP( pD ), pPIP( pP) and
pMCP( pM) are dummy Boolean variables indicating whether the soft actuator corre-
sponding to each joint was pressurized or not. The adjusted coefficients of determination
were 0.895 for the DIP joint, 0.992 for the PIP joint, and 0.995 for the MCP joint. The PIP and
MCP joints were above 0.9, and the DIP joint was slightly below 0.9. The model consisted
of around 15 variables, resulting from the variable selection process. As shown, the models
for each joint contain the LMC Angle of other joints.
Figure 6.Relationship
Figure 6. Relationship between
between pressure
pressure and
and joint joint
angle angle in
in stiffness stiffnessexperiments.
estimation estimation experiments
The correction performance of each regression model was evaluated in terms of the
Table 4. Prediction accuracy of LMC Angle correction model with the actuator (RMSE). Tw
root-mean-square error (RMSE) values between the 2D Angle and LMC Angle in Figure 6
ues are 4).
(Table underlined
As shown,where
exceptthe
theRMSE of the corrected
DIP measurement LMC
on the angle
middle from proposed
stiffness method is l
level (double
than the RMSE of the original LMC angle. Among them, the one whose RMSE
underlined in Table 4), the corrected LMC Angle under the proposed model improved is larger than
RMSE of the corrected
the prediction accuracyLMC angletofrom
compared previousLMC
the corrected studyAngle
is double
from underlined.
the previous study.
The model in the previous study did not include soft actuator pressure information as an
Corrected LMC Angle from Corrected LMC Angl
explanatory variable, so the model had
Stiffness Level Joint Original LMC Angle (deg) to be changed when the combination of joints to be
Proposed
pressured changed. On the other hand, compared Model
with (deg)
original LMC Angle, Previous
the proposedStudy (d
DIP model showed improvement,
15.31 except for the two measurements
5.51 underlined in Table 4. 10.22
Low Stiffness PIP 4.98 4.97 10.94
MCP 16.39 5.07 10.93
DIP 11.74 14.67 8.80
Middle Stiffness PIP 8.34 14.80 23.33
MCP 23.55 8.83 19.66
Table 4. Prediction accuracy of LMC Angle correction model with the actuator (RMSE). Two values
are underlined where the RMSE of the corrected LMC angle from proposed method is larger than the
RMSE of the original LMC angle. Among them, the one whose RMSE is larger than the RMSE of the
corrected LMC angle from previous study is double underlined.
Figure
Figure Relationship
7. 7. between
Relationship joint angle
between jointand estimated
angle stiffness value
and estimated in low stiffness
stiffness value in condition.
low stiffness co
Table 5. Results of stiffness estimation experiments using the mannequin hand. The smallest error among the six methods is colored red.
Table 6. The joint angles of the subject’s index finger during rest and with the actuator attached.
The mean and standard deviation of three measurements of the stiffness values esti-
mated for the MCP joints of the fingers are shown in Table 7.
Table 7. Results of an experiment estimating the stiffness of the MCP joint in multiple fingers of a
subject using the analytical model of the Modular-SECA.
For the little finger, the stiffness estimates for stiff joints were higher than those for
healthy joints. Though, for the ring finger, it was difficult to distinguish between healthy
and stiff joints from the estimates. For the MCP joint of the index finger and middle finger,
this was even reversed.
Another issue is that of negative estimates of stiffness. As can be seen in Figure 7, the
accuracy of the joint angles was low because the estimated values were negative depending
on the joint angle. The angle correction model for the index finger was generated using
joint angle data obtained from a mannequin hand. Its applicability to the human hand was
low, and the lack of LMC Angle correction may have resulted in negative values.
Moreover, because the fingers were separately restrained by bandaging (Figure 4b),
the strength of the restraint was different for each finger, causing a large difference in
the apparent stiffness for each finger. These issues revealed that stiffness estimation for a
human finger is not so reliable, though the possibility for simultaneous joints of multiple
fingers was shown.
4. Discussion
The results show that the SECA and Modular-SECA have different bending perfor-
mances, and the interaction of joints affected the output of LMC when the Modular-SECA
was attached. Furthermore, it was confirmed that the accuracy of the stiffness estimation
with the Modular-SECA could be improved by correcting the analytical model of stiffness
estimation and the joint angles.
Robotics 2023, 12, 83 16 of 25
Figure 8. Relationship between pressure and joint angle of MCP in low stiffness estimation (the
Figure 8. Relationship between pressure and joint angle of MCP in low s
2D Angle is the reference value). For the SECA model and Modular-SECA model, the joint angles
Angle
were is the
calculated reference
backward value).
by substituting theFor the
spring SECA
constant model
of the and and
torsion spring Modular-SECA
the input air m
pressure into Equation (8). The upper
calculated backward by substituting the limit angle is 0.7θ 0 , which is the upper limit of the
spring constant of the torsion spstiffness
estimation range θ ∈ [0, 0.7θ0 ).
sure into Equation (8). The upper limit angle is 0.7𝜃 , which is the uppe
mation range 𝜃 ∈ [0, 0.7𝜃 ).
5. Conclusions
In this study, we proposed a method combining the Modular-SECA and LMC for
the stiffness estimation of finger joints in a telerehabilitation environment. The SECA
analytical model for stiffness estimation was modified to be applied to the Modular-SECA,
and the LMC Angle was improved by the regression models to improve the accuracy of the
proposed method. It was also shown that using the angle information of other joints and
the dummy variables indicating whether or not the soft actuator is pressurized is effective
for the correction model of the LMC Angle with the soft actuator. Furthermore, the results
suggest that the proposed method could be used in a telerehabilitation environment to
evaluate the spasticity condition in case a more precise correction of the analytical model
and the LMC Angle becomes available. Since the simultaneous estimation of multiple
fingers’ MCP joints is feasible using the proposed method in this study, it is necessary
to make it possible to estimate DIP and PIP joints and joints with high stiffness values.
Moreover, in the near future, it is necessary to verify the effectiveness of the proposed
method in a telerehabilitation setting.
Author Contributions: Conceptualization, F.M. and W.Y.; methodology, F.M., S.K. and P.E.T.V.;
software, F.M.; validation, F.M. and P.E.T.V.; investigation, F.M.; data curation, F.M.; writing—original
draft preparation, F.M.; writing—review and editing, S.K., P.E.T.V., M.-T.K., Y.-H.H., S.Y.H., J.G.-T. and
W.Y.; supervision, W.Y. All authors have read and agreed to the published version of the manuscript.
Funding: This work was supported by Grant-in-Aid for Scientific Research (B), JSPS KAKENHI
Grant Number 22H03450.
Acknowledgments: The authors would like to thank Zhongchao Zhou, Yuxi Lu and Ema Oba for
their support in the experiments.
Conflicts of Interest: The authors declare no conflict of interest.
Abbreviations
Appendix A
The finite element model (FEM) of the Modular-SECA was built on COMSOL Mul-
tiphysics 5.6® . Dragon skin 10 was modeled as a Yeoh third-order hyperelastic material.
The Kevlar fibers, stainless-steel plate and PLA were all modeled as linear elastic materials.
The material parameters used for Dragon Skin 10 and the stainless-steel plate were the
same as those in Section 2.1.2. The Kevlar fibers were modeled with a Young’s modulus
(E-31670 MPa), Poisson’s ratio (v-0.36) and density (ρ-1440 kg/m3 ) [39]. For the PLA the
material parameters used were E-4.4 GPa, v-0.3 and ρ-1240 kg/m3 [40]. A stationary study
for increasing input air pressure of the actuator from 0 kPa to 100 kPa (steps of 10 kPa) was
conducted. Gravity was included in the model. A symmetry constraint was used to take
advantage of the symmetrical conditions of the model and reduce computational times.
lus (E-31670 MPa), Poisson’s ratio (v-0.36) and density (ρ-1440 kg/m3) [39]. For the PLA
the material parameters used were E-4.4 GPa, v-0.3 and ρ-1240 kg/m3 [40]. A stationary
study for increasing input air pressure of the actuator from 0 kPa to 100 kPa (steps of 10
Robotics 2023, 12, 83
kPa) was conducted. Gravity was included in the model. A symmetry constraint was used
20 of 25
to take advantage of the symmetrical conditions of the model and reduce computational
times. The meshing was carried out using tetrahedral elements. Gravity was incorporated
into
Thethe model.was
meshing Figure A1out
carried shows
usingthe model bending
tetrahedral at Gravity
elements. different input
was air pressures.
incorporated into
the model. Figure A1 shows the model bending at different input air pressures.
Appendix C
The effect of joint interaction in the same finger on the LMC Angle was examined. Soft
actuators were attached to the mannequin hand, and the soft actuators corresponding to the
DIP, PIP, and MCP joints were selected for each of the seven combinations of measurements
(Figure A2). The 2D Angle and LMC Angle were calculated. A joint modular soft actuator
without a torque compensation layer was used to verify the performance of LMC estimation
over a wide range of bending angles. In some cases, the joint angle of the mannequin hand
showed an extension (the opposite direction of flexion) angle instead of a flexion angle.
Therefore, a flexion/extension judgment was made, and the sign of the joint angle was
set to negative in the case of an extension angle. In the 2D marker detection system, the
decision was based on the sign of the value of the outer product of the vectors (θ MCP is
−−→ −−→
W M × WP ). Since LMC is a three-dimensional coordinate system, the x coordinate of the
−−→ −−→
outer product of the two vectors (θ MCP is W M × MP ) in the measurement method shown
in Figure 2b was the extension angle if it was positive.
The trend of angle change differed depending on the combination of joints to be
pressurized. Even when the 2D Angle did not change, the LMC Angle changed by the
angle of the other joints. This suggests that the interaction between joints in the same finger
affects the LMC Angle.
(𝜃 is 𝑊𝑀⃗ × 𝑊𝑃⃗). Since LMC is a three-dimensional coordinate system, the x coordi-
nate of the outer product of the two vectors (𝜃 is 𝑊𝑀⃗ × 𝑀𝑃⃗ ) in the measurement
method shown in Figure 2b was the extension angle if it was positive.
The trend of angle change differed depending on the combination of joints to be pres-
Robotics 2023, 12, 83 surized. Even when the 2D Angle did not change, the LMC Angle changed by the angle 21 of 25
of the other joints. This suggests that the interaction between joints in the same finger
affects the LMC Angle.
(a) Pressure on three joints; DIP + PIP + MCP (𝑝𝐷𝐼𝑃: 1; 𝑝𝑃𝐼𝑃: 1; 𝑝𝑀𝐶 : 1)
Figure A2. LMC Angle change due to interaction between joints in the same finger when
ators were attached. 𝑝𝐷𝐼𝑃, 𝑝𝑃𝐼𝑃 and 𝑝𝑀𝐶𝑃 are dummy Boolean variables indicating 1
pressure is input to the soft actuator corresponding to the joint and 0 when it is not.
Figure A2. LMC Angle change due to interaction between joints in the same finger when soft
actuators were attached. pDIP, pPIP and pMCP are dummy Boolean variables indicating 1 when air
Appendix D
pressure is input to the soft actuator corresponding to the joint and 0 when it is not.
With no soft actuator attached, one subject was asked to bend the right hand
Appendix D
middle, ring, and little fingers’ joints and maintain a constant angle. The angle o
these 12 jointsactuator
With no soft attached, one
was measured subject
using LMC wasand
asked to bend the right
a goniometer, hand’s
and thisindex,
was carried
middle, ring, and little fingers’ joints and maintain a constant angle. The angle of each
times. From the measured angle data of the index, an angle correction model of th
of these 12 joints was measured using LMC and a goniometer, and this was carried out
was
ten created
times. Fromusing a third-order
the measured regression
angle data model
of the index, (Figure
an angle A3). When
correction model that
of theangle co
model
index wasofcreated
the index
usingwas applied to
a third-order the other
regression fingers,
model the
(Figure adjusted
A3). When thatcoefficients
angle of
correction modelobtained
nation were of the index was
and applied
these aretoshown
the other
infingers,
Table the
A2.adjusted
The PIP coefficients
and MCP of for the
determination were obtained and these are shown in Table A2. The PIP and MCP for the
and ring fingers had a good fit of 0.7 or better, while the others resulted in a poor
middle and ring fingers had a good fit of 0.7 or better, while the others resulted in a poor fit.
suggests
This that
suggests thateven
evenwhen softactuators
when soft actuatorsareare applied,
applied, the trend
the trend of angular
of angular change maychange m
fromfrom
differ finger to to
finger finger.
finger.
Figure A3. Degree of angular change tendency conformity between the index finger and other fingers.
Figure A3. Degree of angular change tendency conformity between the index finger and othe
Table A2. The goodness of fit between the index finger’s regression model and the othe
angular change trend.
Adjusted R-Square
Middle Ring Littl
DIP 0.149 0.682 0.472
PIP 0.731 0.764 0.065
MCP 0.749 0.894 0.215
Figure A3. Degree of angular change tendency conformity between the index finger and othe
Robotics 2023, 12, 83 Table A2. The goodness of fit between the index finger’s regression model 23and
of 25the othe
Adjusted
Table A2. The goodness of fit between the index finger’s regression R-Square
model and the other fingers’
angular change trend. Middle Ring Little
DIP 0.149
Adjusted R-Square 0.682 0.472
PIP Middle 0.731 Ring 0.764 Little 0.065
DIP MCP 0.149 0.749 0.682 0.894 0.472 0.215
PIP 0.731 0.764 0.065
MCP 0.749 0.894 0.215
Appendix E
TheEbending
Appendix of the three joints (DIP, PIP, and MCP) of the mannequin hand
finger,
The 2D Angle
bending andthree
of the LMC Angle
joints (DIP,were measured,
PIP, and respectively.
MCP) of the For this
mannequin hand’s measurem
index
index finger of the mannequin hand with frictional resistance was used to hold it
finger, 2D Angle and LMC Angle were measured, respectively. For this measurement, the
index finger of
at a given the mannequin
angle. hand with frictional
This measurement resistance
data and was used
the joint to hold
angles withit inthe
place at actuato
soft
a given angle. This measurement data and the joint angles with the soft actuator measured
ured in Appendix B are shown in Figure A4. The trend of the LMC Angle chan
in Appendix B are shown in Figure A4. The trend of the LMC Angle change with and
and without
without the soft the soft differs.
actuator actuator differs.
Figure
Figure A4.
A4. Angular
Angular trendtrend comparison
comparison with andwith andsoft
without without
actuator.soft actuator.
References
1. Feigin, V.L.; Forouzanfar, M.H.; Krishnamurthi, R.; Mensah, G.A.; Connor, M.; Bennett, D.A.; Moran, A.E.; Sacco, R.L.; Anderson,
L.; Truelsen, T.; et al. Global and Regional Burden of Stroke during 1990-2010: Findings from the Global Burden of Disease Study
2010. Lancet 2014, 383, 245–254. [CrossRef] [PubMed]
2. Kwakkel, G.; Kollen, B.J.; Van der Grond, J.V.; Prevo, A.J.H. Probability of Regaining Dexterity in the Flaccid Upper Limb: Impact
of Severity of Paresis and Time since Onset in Acute Stroke. Stroke 2003, 34, 2181–2186. [CrossRef] [PubMed]
3. Mouri, T.; Kawasaki, H.; Aoki, T.; Nishimoto, Y.; Ito, S.; Ueki, S. Telerehabilitation for Fingers and Wrist Using a Hand
Rehabilitation Support System and Robot Hand. IFAC Proc. Vol. 2009, 42, 603–608. [CrossRef]
4. Nam, C.; Zhang, B.; Chow, T.; Ye, F.; Huang, Y.; Guo, Z.; Li, W.; Rong, W.; Hu, X.; Poon, W. Home-Based Self-Help Telerehabilitation
of the Upper Limb Assisted by an Electromyography-Driven Wrist/Hand Exoneuromusculoskeleton after Stroke. J. Neuroeng.
Rehabil. 2021, 18, 137. [CrossRef] [PubMed]
5. Placidi, G.; Di Matteo, A.; Lozzi, D.; Polsinelli, M.; Theodoridou, E. Patient-Therapist Cooperative Hand Telerehabilitation
through a Novel Framework Involving the Virtual Glove System. Sensors 2023, 23, 3463. [CrossRef]
6. Arya, K.N.; Pandian, S.; Verma, R.; Garg, R.K. Movement Therapy Induced Neural Reorganization and Motor Recovery in Stroke:
A Review. J. Bodyw. Mov. Ther. 2011, 15, 528–537. [CrossRef]
7. Signal, N.; Martin, T.; Leys, A.; Maloney, R.; Bright, F. Implementation of Telerehabilitation in Response to COVID-19: Lessons
Learnt from Neurorehabilitation Clinical Practice and Education. N. Z. J. Physiother. 2020, 48, 117–126. [CrossRef]
8. Soopramanien, A.; Jamwal, S.; Thomas, P.W. Digital Health Rehabilitation Can Improve Access to Care in Spinal Cord Injury in
the UK: A Proposed Solution. Int. J. Telerehabil. 2020, 12, 3–16. [CrossRef]
9. Auger, L.-P.; Moreau, E.; Côté, O.; Guerrera, R.; Rochette, A.; Kairy, D. Implementation of Telerehabilitation in an Early Supported
Discharge Stroke Rehabilitation Program before and during COVID-19: An Exploration of Influencing Factors. Disabilities 2023, 3,
87–104. [CrossRef]
10. Dietz, V.; Sinkjaer, T. Spastic Movement Disorder: Impaired Reflex Function and Altered Muscle Mechanics. Lancet Neurol. 2007,
6, 725–733. [CrossRef]
11. Sadarangani, G.P.; Jiang, X.; Simpson, L.A.; Eng, J.J.; Menon, C. Force Myography for Monitoring Grasping in Individuals with
Stroke with Mild to Moderate Upper-Extremity Impairments: A Preliminary Investigation in a Controlled Environment. Front.
Bioeng. Biotechnol. 2017, 5, 42. [CrossRef] [PubMed]
Robotics 2023, 12, 83 24 of 25
12. Plantin, J.; Pennati, G.V.; Roca, P.; Baron, J.C.; Laurencikas, E.; Weber, K.; Godbolt, A.K.; Borg, J.; Lindberg, P.G. Quantitative
Assessment of Hand Spasticity after Stroke: Imaging Correlates and Impact on Motor Recovery. Front. Neurol. 2019, 10, 836.
[CrossRef] [PubMed]
13. Tsuji, T.; Ota, T.; Kimura, A.; Chino, N.; Ishigami, S. A Study of Inter-Rater Reliability of the Modified Ashworth Scale (MAS) in
Spasticity in Patients with Stroke. Jpn. J. Rehabil. Med. 2002, 39, 409–415. [CrossRef]
14. Milner, T.E.; Franklin, D.W. Characterization of Multijoint Finger Stiffness: Dependence on Finger Posture and Force Direction.
IEEE Trans. Biomed. Eng. 1998, 45, 1363–1375. [CrossRef]
15. Kamper, D.G.; Zev Rymer, W. Quantitative Features of the Stretch Response of Extrinsic Finger Muscles in Hemiparetic Stroke.
Muscle Nerve 2000, 23, 954–961. [CrossRef]
16. Fiorilla, A.E.; Tsagarakis, N.G.; Nori, F.; Sandini, G. Design of a 2-Finger Hand Exoskeleton for Finger Stiffness Measurements.
Appl. Bionics. Biomech. 2009, 6, 217–228. [CrossRef]
17. Heung, H.L.; Tang, Z.Q.; Shi, X.Q.; Tong, K.Y.; Li, Z. Soft Rehabilitation Actuator With Integrated Post-Stroke Finger Spasticity
Evaluation. Front. Bioeng. Biotechnol. 2020, 8, 111. [CrossRef] [PubMed]
18. Shi, X.Q.; Heung, H.L.; Tang, Z.Q.; Tong, K.Y.; Li, Z. Verification of Finger Joint Stiffness Estimation Method With Soft Robotic
Actuator. Front. Bioeng. Biotechnol. 2020, 8, 592637. [CrossRef]
19. Tarvainen, T.V.J.; Yu, W. Preliminary Results on Multi-Pocket Pneumatic Elastomer Actuators for Human-Robot Interface in
Hand Rehabilitation. In Proceedings of the 2015 IEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2015,
Zhuhai, China, 6–9 December 2015; pp. 2635–2639. [CrossRef]
20. Kokubu, S.; Wang, Y.; Tortós Vinocour, P.E.; Lu, Y.; Huang, S.; Nishimura, R.; Hsueh, Y.H.; Yu, W. Evaluation of Fiber-Reinforced
Modular Soft Actuators for Individualized Soft Rehabilitation Gloves. Actuators 2022, 11, 84. [CrossRef]
21. Yun, S.S.; Kang, B.B.; Cho, K.J. Exo-Glove PM: An Easily Customizable Modularized Pneumatic Assistive Glove. IEEE Robot
Autom. Lett. 2017, 2, 1725–1732. [CrossRef]
22. Zhou, C.Q.; Shi, X.Q.; Li, Z.; Tong, K.Y. 3D Printed Soft Robotic Hand Combining Post-Stroke Rehabilitation and Stiffness
Evaluation. In Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in
Bioinformatics); Springer International Publishing: Cham, Switzerland, 2022; Volume 13457 LNAI, pp. 13–23. [CrossRef]
23. Chong, T.W.; Lee, B.G. American Sign Language Recognition Using Leap Motion Controller with Machine Learning Approach.
Sensors 2018, 18, 3554. [CrossRef] [PubMed]
24. Elgeneidy, K.; Lohse, N.; Jackson, M. Bending Angle Prediction and Control of Soft Pneumatic Actuators with Embedded Flex
Sensors—A Data-Driven Approach. Mechatronics 2018, 50, 234–247. [CrossRef]
25. Kavian, M.; Nadian-Ghomsheh, A. Monitoring Wrist and Fingers Range of Motion Using Leap Motion Camera for Physical
Rehabilitation. In Proceedings of the 2020 International Conference on Machine Vision and Image Processing (MVIP), Qom, Iran,
18–20 February 2020; IEEE: Piscataway, NJ, USA. [CrossRef]
26. Ganguly, A.; Rashidi, G.; Mombaur, K. Comparison of the Performance of the Leap Motion Controllertm with a Standard
Marker-Based Motion Capture System. Sensors 2021, 21, 1750. [CrossRef] [PubMed]
27. Li, X.; Wan, K.; Wen, R.; Hu, Y. Development of Finger Motion Reconstruction System Based on Leap Motion Controller.
In Proceedings of the CIVEMSA 2018—2018 IEEE International Conference on Computational Intelligence and Virtual Environ-
ments for Measurement Systems and Applications, Proceedings, Ottawa, ON, Canada, 12–13 June 2018. [CrossRef]
28. Pagoli, A.; Chapelle, F.; Corrales-Ramon, J.A.; Mezouar, Y.; Lapusta, Y. Review of Soft Fluidic Actuators: Classification and
Materials Modeling Analysis. Smart Mater. Struct. 2022, 31, 013001. [CrossRef]
29. Marechal, L.; Balland, P.; Lindenroth, L.; Petrou, F.; Kontovounisios, C.; Bello, F. Toward a Common Framework and Database of
Materials for Soft Robotics. Soft Robot. 2021, 8, 284–297. [CrossRef]
30. Suzuki, T.; Kanno, I.; Loverich, J.J.; Kotera, H.; Wasa, K. Characterization of Pb(Zr,Ti)O3 Thin Films Deposited on Stainless Steel
Substrates by RF-Magnetron Sputtering for MEMS Applications. Sens. Actuators A Phys. 2006, 125, 382–386. [CrossRef]
31. Pititeeraphab, Y.; Choitkunnan, P.; Thongpance, N.; Kullathum, K.; Pintavirooj, C. Robot-Arm Control System Using LEAP
Motion Controller. In Proceedings of the BME-HUST 2016—3rd International Conference on Biomedical Engineering, Hanoi,
Vietnam, 5–6 October 2016; pp. 109–112. [CrossRef]
32. Leap Motion Controller Datasheet. Available online: https://www.ultraleap.com/datasheets/Leap_Motion_Controller_
Datasheet.pdf (accessed on 10 April 2023).
33. Guna, J.; Jakus, G.; Pogačnik, M.; Tomažič, S.; Sodnik, J. An Analysis of the Precision and Reliability of the Leap Motion Sensor
and Its Suitability for Static and Dynamic Tracking. Sensors 2014, 14, 3702–3720. [CrossRef]
34. Okuno, T.; Kume, H.; Haga, T.; Yoshizawa, T. Tahenryô Kaisekihô (Kaiteiban) [Multivatiate Analysis Methods (Revised Edition)], Revised
Edition; JUSE Press, Ltd.: Tokyo, Japan, 2005.
35. Dionysian, E.; Kabo, J.M.; Dorey, F.J.; Meals, R.A. Proximal Interphalangeal Joint Stiffness: Measurement and Analysis. J. Hand
Surg. 2005, 30, 573–579. [CrossRef]
36. Bohannon, R.W.; Smith, M.B. Interrater Reliability of a Modified Ashworth Scale of Muscle Spasticity. Phys. Ther. 1987, 67,
206–207. [CrossRef]
37. Kamper, D.G.; Hornby, T.G.; Rymer, W.Z. Extrinsic Flexor Muscles Generate Concurrent Flexion of All Three Finger Joints.
J. Biomech. 2002, 35, 1581–1589. [CrossRef]
Robotics 2023, 12, 83 25 of 25
38. Kamper, D.G.; Fischer, H.C.; Cruz, E.G.; Rymer, W.Z. Weakness Is the Primary Contributor to Finger Impairment in Chronic
Stroke. Arch. Phys. Med. Rehabil. 2006, 87, 1262–1269. [CrossRef] [PubMed]
39. Connolly, F.; Walsh, C.J.; Bertoldi, K. Automatic Design of Fiber-Reinforced Soft Actuators for Trajectory Matching. Proc. Natl.
Acad. Sci. USA 2017, 114, 51–56. [CrossRef] [PubMed]
40. Mirkhalaf, S.M.; Fagerström, M. The Mechanical Behavior of Polylactic Acid (PLA) Films: Fabrication, Experiments and Modelling.
Mech. Time Depend Mater. 2021, 25, 119–131. [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual
author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to
people or property resulting from any ideas, methods, instructions or products referred to in the content.