Prerpints.org logo
Preprint
Article

Quantitative comparison of hand kinematics measured with a markerless commercial head-mounted display and a marker-based motion capture system in stroke survivors.

Altmetrics

Downloads

119

Views

59

Comments

0

A peer-reviewed article of this preprint also exists.

Submitted:

22 July 2023

Posted:

25 July 2023

You are already at the latest version

Alerts
Abstract
Upper limb paresis is very common after stroke. An important tool to assess motor recovery is to use marker-based motion capture systems to measure the kinematic characteristics of patients’ movements in ecological scenarios. These systems are, however, very expensive and, as such, not readily available for many rehabilitation units. Here, we explored whether the markerless hand motion capabilities of the cost-effective Oculus Quest head-mounted display could be used to provide clinically meaningful measures. 14 stroke patients executed ecologically relevant upper limb tasks in an immersive virtual environment. During task execution, we recorded their hand movements simultaneously by means of the Oculus Quest’s and a marker-based motion capture system. Our results showed that the markerless estimates of the hand position and peak velocity provided by the Oculus Quest were in very close agreement with those provided by a marker-based commercial system with their regression line having a slope close to 1. Furthermore, the Oculus Quest had virtually the same sensitivity as that of a commercial system in distinguishing healthy from pathological kinematic measures. The Oculus Quest was as accurate as a commercial marker-based system in measuring clinically meaningful upper limb kinematic parameters in stroke patients.
Keywords: 
Subject: Medicine and Pharmacology  -   Neuroscience and Neurology

1. Introduction

Stroke is one of the main causes of acquired adult disability worldwide [1,2,3]. Even worse, due to the ongoing ageing of the population, the impact of stroke is expected to dramatically increase in the next years [4]. In addition to obvious human costs, stroke is also associated with very high direct and indirect economic costs [5] that, in 2017, were estimated at €60 billion across 32 European Countries [6]. Upper limb impairment is one of the most frequent and disabling consequences after stroke, persisting at 6 months in approximately 60% of people [7]. Rehabilitation has a key role in maximizing upper limb motor recovery, neuroplasticity can be elicited through motor and cognitive stimulations in order to improve brain re-organization and neuromotor abilities [8]. Physical therapy-based rehabilitation has in fact showed notable effects in improving upper limb function, increasing muscle strength, reducing arm pain and increasing quality of life [9]. Upper limb movements are instrumental to perform daily living routines (e.g. pouring a glass of water or eating) that are critical for the quality of life of stroke survivors [10,11]. Their preservation/re-establishment is thus one of the key goals of motor rehabilitation therapies.
A key step towards providing effective upper-limb rehabilitation interventions for post-stroke patients is to establish sensitive and reliable assessments of motor functions. Kinematic analysis is presently one of the most sophisticated techniques in the clinician’s toolbox to quantitatively investigate motor performance, to assess the quality of arm movements and to detect behavioral changes during functional recovery and rehabilitation [12]. Clinicians have developed several kinematic metrics of upper limb movements to characterize the amount of impairment and monitor patient’s sensorimotor recovery in a reliable way [13]. Among these, hand peak velocity represents a relevant indicator of motor changes in stroke subjects [14] with good reliability properties [13]. Moreover, in kinematic evaluation, hand movement trajectories are frequently recorded for computing movement accuracy metrics[13], useful data for analyzing upper limb function in stroke survivors. Given the high heterogeneity reported in the literature concerning the technology used, motor tasks performed, and kinematic metrics analyzed [15], specific recommendations have been made to standardize the methodologies to assess upper limb kinematics after stroke [16]. For example, a high-speed and high-resolution marker-based systems are recommended for kinematic analysis. These systems have however several limitations in terms of applicability due to high costs, the need of a dedicated area, trained professionals requested, and non-trivial set-up procedures, that are beyond the motor capabilities of patients with neurological diseases [17]. To overcome these limitations, several commercial markerless devices, such as Kinect or Leap Motion Controller, have been adapted to the clinical use [18]. These markerless tracking devices hold the promises to allow clinicians to perform kinematic assessments in their everyday clinical practice at a fraction of the costs of optical systems and under more ecological conditions (e.g. no marker needs to be placed on the patient). Assessment through markerless technologies has been mostly investigated in the context of gait analysis [17,19], with some studies addressing the analysis of upper limb movements [20,21,22], but rarely in post-stroke patients [23].
The interest of clinicians for markerless tracking devices is currently increasing with a specific focus on head-mounted displays (HMDs). An HMD is a device that is worn on the head and binocularly displays a virtual environment (henceforth VR) in an immersive manner. VR is being widely used in the scientific community as a research tool. For example, several studies have used embodiment in virtual avatars as a manner to investigate human cognition or explore new ways to treat psychological conditions [24,25,26,27,28,29,30]. Notably, many presently available HMDs, such as the Oculus Quest (Meta, Menlo Park, USA) or the Vive (HTC, Taiwan), also have motion-tracking capabilities to monitor, in real-time, the movements. They thus represent a promising solution for combining a highly-stimulating intervention in an enriched environment with a portable and flexible motion capture system. Given the characteristics of modern HMDs, there are presently several ongoing studies to use them in the rehabilitation of neurological disorders such as multiple sclerosis [31] and stroke [32]. However, while the clinical outcomes of immersive VR-based rehabilitation interventions have been thoroughly investigated [32,33,34], their potential use as kinematic measurement devices has receive significant less attention. In particular, very few studies have analyzed the kinematic accuracy of HMDs compared to marker-based systems [35,36,37,38] and no study has investigated HMDs’ hand-tacking precision in post-stroke subjects.
We have recently developed an immersive virtual reality tool (henceforth RehabVR) for upper limb rehabilitation based on the Oculus Quest 2 HMD [39]. We performed a preliminary study to test feasibility, safety, and acceptance in stroke patients who completed a single session of upper limb training in our immersive environment. Our findings showed not only very high levels of satisfaction and embodiment in all patients of our cohort but revealed also correlations between behavioral measures of patients’ performance (i.e. median difference in completion time between the paretic and non-paretic arm) and clinical scores (i.e. the Fugl-Meyer Assessment score). This result suggested that behavioral measures, which are easily computed by our immersive VR-based tool, could be potentially used as proxies of clinical assessments that need instead long testing times and specifically trained personnel. This study aims to explore whether, in addition to behavioral measures, also the measures of hand movements provided by the Quest 2 could be potentially used for clinical purposes. To this end, we recorded the hand trajectories of post-stroke patients, while they executed one of the tasks in RehabVR, simultaneously by means of the the Quest 2 and a commercial marker-based motion capture system (Optitrack by Natural Point Inc., Corballis, USA). We then compared the same kinematic assessments computed separately from each of the two data sets.

2. Materials and Methods

2.1. Subjects

14 subacute and chronic post-stroke patients (4 females, mean age 59±15) enrolled from the Rehabilitation Units of the Ferrara University Hospital participated in the experiments. They had a wide range of motor impairments and a diagnosis of first, ischemic or hemorrhagic stroke. No age restrictions were applied but patients affected by severe cognitive impairments or other severe co-existing clinical conditions were excluded. The clinical protocol and all procedures were approved by the local ethical committee (Comitato Etico di Area Vasta Emilia Centro (CE-AVEC) protocol code: 897-2020-Oss-AOUFe approved on March 17th, 2021).

2.2. Experimental procedures

Prior to the experimental procedure, written, informed consent was obtained from all patients. After being consented patients were sitting in front of a table and a total of 13 reflective markers were applied on their arms and shoulders (see markers’ placements in Figure 1A). Following that, the patient was comfortably seated in front of a table and wore an head-mounted display (HMD, Oculus Quest 2, Meta, USA) and she/he was immersed in an in-home developed immersive virtual environment for motor rehabilitation [39].
The system offers different motor rehabilitation tasks and for the purpose of this study, we focused on the “Glasses” task since it represents the recommended reaching movement requested in upper limb kinematics examination in post-stroke patients [16].
In this task, the patient is presented with four pedestals presented on the virtual table. The pedestals are distributed along a circle centered on the patient’s body at equal angular displacements (Figure 1A). A trial start when the patient puts her/his hands on two locations marked on the virtual table. A glass then appears on one randomly selected pedestal and the patients have to push it down (Figure 1A). The patients have to use the hand closer to the pedestal on which the glass appear (two pedestals are closer to the right hand and two are closer to the left hand).
For the purpose of this study, the patients performed three sessions of the “Glasses” task, each consisting of 40 trials: 20 trials for each hand.

2.3. Motion capture

During task execution we recorded the patients’ hand positions by means of the Oculus and of a commercial motion capture system (Optitrack, Natural Point Inc, Corballis, USA) equipped with xx cameras. The Oculus estimates hand positions and postures by a combination of on-board sensors and software. The Optitrack system uses a set of infrared cameras to track, by triangulation, the positions of a set of infrared-reflective markers.
To allow synchronization between the data recorded on the Oculus and Optitrack systems, this latter system broadcasted, in real-time, the number of each acquired frame on the local network. This stream of data was received by our VR system on the Oculus and was used to timestamp the locally recorded hand positions, together with the time instants were each trial of the task started and ended. Optitrack data were off-line processed to interpolate gaps in the markers’ position and then exported for further processing.
In the Optitrack system, we computed the position of the left and right hand by averaging the positions of the two markers placed on each of the two wrists. In the Oculus system, we directly used the hand positions computed by onboard software with no further processing.

2.4. Data Analysis

To remove noise, we first low-pass filtered Optitrack and Oculus hand positions at 3Hz by means of a 2-nd order Butterworth filter. We then segmented both the Optitrack and Oculus data into trials by using the timestamped events recorded by our VR system during task execution. For each trial, we used the Optitrack data to obtain the time tmax at which the hand performing the task was maximally extended with respect to its initial position at the beginning of the trial (time t=0). We then extracted the hand position between 0 and tmax both from the Optitrack and Oculus data and computed the maximum distance travelled by the hand performing the task. We then computed the peak velocity of the hand in the interval [0, tmax] both from Oculus and Optitrack data.
The Oculus system estimates the position of the two hands by means of onboard software and cameras. Such tracking can be sometime faulty (e.g. because of abrupt movements of the head, where the sensors are located, or sudden changes of direction of the hand, etc.). In these cases, the Oculus will incorrectly locate the hand position, that will default to a pre-defined value (e.g. 0,0,0) and a consequent “spike” in the velocity profile. To discard such incorrect data from our analysis we excluded all trials in which the maximum distance and peak velocity computed from Oculus data were above a threshold of 65cm and 2 m/s, respectively. These higher bounds were set based on the ground-truth values provided by the Optitrack system that yielded a maximum distance of 51cm and a maximum peak velocity of 1.35 m/s across all subjects and trials.
All pre-processing steps were performed in Python.

2.5. Linear regression analysis

To investigate the congruency between Optritrack and Oculus measures we performed a linear correlation analysis followed by an ANOVA on the values of the slope. All statistical analyses were performed in R.

3. Results

14 post-stroke subjects were included in the present study, demographic and clinical characteristics of the sample are reported in Table 1. Figure 1B shows examples of hand trajectories recorded by the Optitrack (left column) and Oculus (right column) systems. Although the Oculus Quest trajectories are, as expected, noisier, they are nonetheless very close to their ground-truth values. The similarity of Oculus estimate to their ground-truth values is also true for estimates of hand velocity, although, in this case, higher-frequency noise was present (Figure 1C). This is expected. Indeed, the velocity is the first derivative of position, and the derivative operator magnifies higher frequency noise.

3.1. Oculus estimates of position and velocity are linearly related to their ground-truth values

To quantitatively investigate the hand tracking capabilities of the Oculus system we computed for each trial the maximum reaching distance and peak velocity of the patients’ hands and we compares these estimates with their ground-truth values provided by the Optitrack system. Figure 2A shows scatterplots of measures of maximum hand distance and velocity provided by the Oculus and Optitrack systems, respectively. In these plots, each dot represents a single trial whose x coordinate represents the measure provided by the Optitrack and whose y coordinate represents the measure provided by the Oculus system. As these plots show, Oculus and Optitrack measures exhibit a clear linear relationship, and we thus investigated the slope of this relationship.
In a first step, we studied whether this linear relationship was stable in time (i.e. across the three sessions of the “Glasses” task) and independent from the hand. To this end, we performed linear fits of the Oculus against Optitrack measures of maximum distance and peak velocity separately for each patient, trial, and acting hand. We then submitted the slopes of these linear fits to a repeated-measures ANOVA analysis with factors hand (left or right) and session (first, second or third). Both factors as well as their interaction were not significant for both the maximum distance (factor session: F(2, 26)=0.76, p=0.48; factor hand: F(1, 13)=0.155, p=0.7; interaction: F(2, 26)=0.71, p=0.5) and peak velocity (factor session: F(2, 26)=1.09, p=0.35; factor hand: F(1, 13)=0.183, p=0.68; interaction: F(2, 26)=0.332, p=0.72) ANOVA. A similar pattern of result was obtained when trials were sorted based on whether they were executed by patients with their healthy or impaired hand (ANOVA maximum distance: factor session: F(2, 26)=0.76, p=0.48; factor hand: F(1, 13)=0.58, p=0.46; interaction: F(2, 26)=0.9, p=0.42 – ANOVA peak velocity: factor session: F(2, 26)=1.90, p=0.35; factor hand: F(1, 13)=0.21, p=0.65; interaction: F(2, 26)=1.45, p=0.25). These results show that the linear relationship between estimates provided by the Oculus system and their ground-truth values are robust in time and have similar characteristics for the two hands.
Since both the factor session and hand were not significant, we pooled together the data for each patient and computed the slope of the linear relationship between Oculus and Optitrack kinematic measure. Figure 2B shows the distribution of the slopes across patients. For both maximum distance and peak velocity the average slope was very close to 1 (maximum distance: mean slope = 0.94±0.1; peak velocity: mean slope = 1.06±0.12). We obtained similar results when we pooled together the data from all subjects, sessions, and trials (Figure 2C). In this case, we obtained a mean slope of 0.97 for the measures of maximum distance and of 1.08 for the measures of peak velocity. Bland-Altman plots (Figure 2D) show a systematic bias both for measures of maximum distance (bias=0.01m) and peak velocity (bias=-0.14 m/s). A negative trend is present in both Bland-Altman plots. It is just noticeable in the maximum distance plot (Figure 1D, left panel), and very evident in the peak velocity plot (Figure 1D, right panel).
Together with our ANOVA analysis above, the results in Figure 2 suggest that, provided that some simple data cleaning procedures are enforced (see Methods section), the kinematic measures of distance and velocity provided by the Oculus are relatively accurate and linearly related to their ground-truth values. The slopes of these linear relationships suggest that the Oculus system tends to slightly underestimate distances and to slightly overestimate velocities. Furthermore, the negative trends in the Bland-Altman plots suggest that in both distance and velocity estimates of the Oculus system there is a proportional bias that is more pronounced for velocity measures.

3.2. Oculus kinematic assessments agree with the same assessments based on ground-truth data

We next investigated whether kinematic measures provided by the Oculus are sensitive enough to reveal fine-structured characteristics of the patients’ movements. For example, Figure 2A shows the distributions of peak velocities measured by means of the Optitrack system in one of our patients for the impaired and healthy hand, respectively. For this patient, the medians of the two distributions were significantly different (Mann-Whitney U test=126, p<<0.05) and we found the same significant difference between the impaired and healthy hand also in the Oculus data (Figure 2B, Mann-Whitney U test=107, p<<0.05) (Figure 3).
We thus investigated the congruency between assessments based on ground-truth Optitrack data and Oculus data across our pool of patients. When we used the Optitrack estimates of peak velocities, we found a significant difference between the distributions of the healthy and impaired hand in 11 out of 14 of our patients. Notably, for 10 out of them we found the same significant difference also in the peak velocities assessed by means of the Oculus system (Table 2). These results further suggest that kinematic assessments obtained with the Oculus system can be used as proxy for the same assessments obtained by means of ground-truth values.

4. Discussion

Here, we quantitatively compared the accuracy of the Oculus Quest 2 in tracking the hand movements of a group of stroke patients with that of a commercial marker-based system (Figure 1). Our results showed that the estimates of the hand position and peak velocity provided by the markerless Oculus Quest were in very close agreement with those provided by a marker-based commercial system. Indeed, the two sets of measures were not only very strongly correlated but the regression line between them exhibited a slope close to 1 (Figure 2). Furthermore, the Oculus Quest exhibited a sensitivity very similar to that of the commercial system in distinguishing pathological from healthy upper limb movements (Figure 3 and Table 2).
Marker-based motion capture systems presently used for clinical kinematic assessments have high costs and need lengthy training periods. As such, there is a growing interest by clinicians towards more cost-effective and easy-to-use markerless systems. Especially in patients with neurological disorders, such as stroke, a quantitative analysis of the subject’s motor performance is crucial to plan proper therapeutic interventions. Even if current markerless devices seem to be still immature for replacing reference marker-based systems [16], the COVID-19 outbreak has underlined the clinical need to have systems able to assess and monitor patient’s physical function more flexibly, remotely in an ecological environment or adaptable to different clinical contexts. The research of new clinical tools for the assessment of upper limb function in post-stroke patients at home is thus increasing. Among them, wearable technologies (like Inertial Measurement Units sensors) are under investigation [40,41] and also video-conferencing administration of validated clinical scales, such as Fugl-Meyer Assessment [42], or ad-hoc developed tools (i.e. The Arm Capacity and Movement Test) have been recently proposed [43]. However, the related literature is still lacking and there is a paucity of technologically and clinically validated solutions for remote kinematic analyses in subjects with neurological disorders.
While several studies showed promising results in upper limb kinematic assessment in post-stroke people through markerless devices [44], there is scarce information on validation data and psychometric properties of kinematic metrics recorded with these tools [45]. Among the studies that simultaneously recorded and compared upper limb motor indexes by means of markerless (i.e. Kinect, Leap Motion Controller) and marker-based systems in post-stroke subjects, Bonnechère et al. found good agreement in speed-related parameters among Kinect sensor and PiG (Vicon) system in 10 chronic stroke patients analyzed on shoulder and wrist movements [23]. However, the small sample size influences the strength of the results. Furthermore, Bonnechere et al. focused only on shoulder movements and performed no measures of hand kinematics.
The clinical applications of HMDs are currently increasing due to their affordable costs and ease of use. Concerning the proofs of accuracy in kinematic assessment made so far, HMDs showed encouraging results both in simulated analysis [35] and in human testing. Good estimations have been detected in assessing cervical spine mobility [37], balance stability [36], and shoulder range of motion [38] compared to reference marker-based systems, however, only healthy subjects have been involved. Motor performance in patients after stroke is definitely different compared to what is observed in the general population and no one has still investigated HMDs for motor recording analysis in this patient population, specifically in hand kinematics assessment.
“Reaching a glass” is one of the recommended functional tasks for the evaluation of upper limb functions [16]. Indeed, the characteristic of these movements, such as the peak velocity, can provide relevant information to the clinician on the subject’s level of impairment [46,47]. Our implementation of the “reaching a glass” task in RehabVR contains the reaching phase but lacks the grasping phase because of the present impossibility to physically interact with objects in a virtual environment. However, the reaching phase alone, already offers several informative data on upper limb motor functions [46]. Furthermore, the rapid development of haptic interfaces holds the promise to remove this limitation in the close future.
Our study has also limitations that need to be discussed. First, the generalizability of our results is influenced by the reduced sample size. Second, the motion capture capabilities of the Oculus Quest are presently limited to hand movements. Kinematic analysis of the hands alone does not allow a comprehensive evaluation of the patient’s upper limb functions. For example, it does not allow to evaluate potential compensatory movements with other joints (e.g. the shoulder) or motor synergies. However, the possibility, suggested here, of measuring hand movements by means of an easy-to-use and cost-effective system such as the Oculus Quest 2 paves the way to a new generation of systems that can provide quick and reliable proxy assessments of patients’ improvements. Notably, these assessments could be potentially performed remotely, thus strongly reducing the number of in-person and more cost-demanding in-depth evaluations. Third, our analysis shows that, while the position information provided by the Oculus Quest 2 are fairly accurate, its velocity estimates are affected by a higher level of noise and acceleration estimates are unreliable (data not reported here). While this limits the possibility of using the Oculus Quest 2 to compute kinematic assessments that are based on the acceleration and higher derivatives (e.g. measures based on the smoothness of the movement [13], it might also stimulates research into finding novel measures that are based on position and velocity alone. Such measures would have a wide use in the clinical use, given that they could be easily performed with the new cost-effective devices available today. In addition, RehabVR could be augmented with a set of inertial sensors placed on the patient’s body. Such sensors have a low cost and could provide estimates of acceleration to complement the position and velocity measures provided by the Oculus Quest.

5. Conclusions

In a cohort of 14 stroke patients (FMA-UE range 20-65), the Oculus Quest 2 exhibited an accuracy similar to that of a commercial marker-based system in measuring two clinically relevant kinematic parameters of upper-limb movements: the spatial ranges of hand movements and their peak velocities. These results suggest that the markerless motion capture capabilities of the Oculus Quest can be used to monitor arm motor recovery in stroke patients.

Author Contributions

Conceptualization, G.F., A.C. and S.S.; methodology, A.C., S.S.; formal analysis, A.C.; investigation, G.F., V.B., A.B. and C.P.; data curation, G.F. and N.L.; writing—original draft preparation, G.F., A.C. and S.S.; writing—review and editing, A.C., S.S. and G.F; supervision, S.S..; project administration, G.F.; funding acquisition, F.M. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by #NEXTGENERATIONEU (NGEU) and funded by the Ministry of University and Research (MUR), National Recovery and Resilience Plan (NRRP), project MNESYS (PE0000006) – A Multiscale integrated approach to the study of the nervous system in health and disease (DN. 1553 11.10.2022).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Ethics Committee of Area Vasta Emilia Centro, Regione Emilia Romagna (Italy) (protocol code: 897-2020-Oss-AOUFe approved on March 17th, 2021).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data that support the findings of this study are available from the corresponding author, upon reasonable request.

Acknowledgments

We would like to thank Matilda Boscolo and Nicola Schincaglia for their help during data collection.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bonita, R.; Mendis, S.; Truelsen, T.; Bogousslavsky, J.; Toole, J.; Yatsu, F. The Global Stroke Initiative. Lancet Neurol. 2004, 3, 391–393. [Google Scholar] [CrossRef]
  2. Warlow, C.; Gijn, J.; Dennis, M.; Wardlaw, J.; Bamford, J.; Hankey, G.; Sandercock, P.; Rinkel, G.; Langhorne, P.; Sudlow, C.; et al. Stroke- Practical Management; Wiley-Blackwell: United Kingdom, 2008; ISBN 978-1-4051-2766-0. [Google Scholar]
  3. World Health Organization The World Health Report : 2003 : Shaping the Future; World Health Organization, 2003.
  4. Wafa, H.A.; Wolfe, C.D.A.; Emmett, E.; Roth, G.A.; Johnson, C.O.; Wang, Y. Burden of Stroke in Europe: Thirty-Year Projections of Incidence, Prevalence, Deaths, and Disability-Adjusted Life Years. Stroke 2020, 51, 2418–2427. [Google Scholar] [CrossRef]
  5. Bennett, D.A.; Krishnamurthi, R.V.; Barker-Collo, S.; Forouzanfar, M.H.; Naghavi, M.; Connor, M.; Lawes, C.M.M.; Moran, A.E.; Anderson, L.M.; Roth, G.A.; et al. The Global Burden of Ischemic Stroke: Findings of the GBD 2010 Study. Glob. Heart 2014, 9, 107–112. [Google Scholar] [CrossRef]
  6. Luengo-Fernandez, R.; Violato, M.; Candio, P.; Leal, J. Economic Burden of Stroke across Europe: A Population-Based Cost Analysis. Eur. Stroke J. 2020, 5, 17–25. [Google Scholar] [CrossRef]
  7. Nijland, R.H.M.; van Wegen, E.E.H.; Harmeling-van der Wel, B.C.; Kwakkel, G. ; EPOS Investigators Presence of Finger Extension and Shoulder Abduction within 72 Hours after Stroke Predicts Functional Recovery: Early Prediction of Functional Outcome after Stroke: The EPOS Cohort Study. Stroke 2010, 41, 745–750. [Google Scholar] [CrossRef]
  8. Dimyan, M.A.; Cohen, L.G. Neuroplasticity in the Context of Motor Rehabilitation after Stroke. Nat. Rev. Neurol. 2011, 7, 76–85. [Google Scholar] [CrossRef]
  9. Huang, J.; Ji, J.-R.; Liang, C.; Zhang, Y.-Z.; Sun, H.-C.; Yan, Y.-H.; Xing, X.-B. Effects of Physical Therapy-Based Rehabilitation on Recovery of Upper Limb Motor Function after Stroke in Adults: A Systematic Review and Meta-Analysis of Randomized Controlled Trials. Ann. Palliat. Med. 2022, 11, 521–531. [Google Scholar] [CrossRef]
  10. Lieshout, E.C.C. van; van de Port, I.G.; Dijkhuizen, R.M.; Visser-Meily, J.M.A. Does Upper Limb Strength Play a Prominent Role in Health-Related Quality of Life in Stroke Patients Discharged from Inpatient Rehabilitation? Top. Stroke Rehabil. 2020, 27, 525–533. [Google Scholar]
  11. Morris, J.H.; van Wijck, F.; Joice, S.; Donaghy, M. Predicting Health Related Quality of Life 6 Months after Stroke: The Role of Anxiety and Upper Limb Dysfunction. Disabil. Rehabil. 2013, 35, 291–299. [Google Scholar] [CrossRef]
  12. Kwakkel, G.; Lannin, N.A.; Borschmann, K.; English, C.; Ali, M.; Churilov, L.; Saposnik, G.; Winstein, C.; van Wegen, E.E.; Wolf, S.L.; et al. Standardized Measurement of Sensorimotor Recovery in Stroke Trials: Consensus-Based Core Recommendations from the Stroke Recovery and Rehabilitation Roundtable. Int. J. Stroke Off. J. Int. Stroke Soc. 2017, 12, 451–461. [Google Scholar] [CrossRef]
  13. Maura, R.M.; Rueda Parra, S.; Stevens, R.E.; Weeks, D.L.; Wolbrecht, E.T.; Perry, J.C. Literature Review of Stroke Assessment for Upper-Extremity Physical Function via EEG, EMG, Kinematic, and Kinetic Measurements and Their Reliability. J. Neuroengineering Rehabil. 2023, 20, 21. [Google Scholar] [CrossRef]
  14. Thrane, G.; Sunnerhagen, K.S.; Murphy, M.A. Upper Limb Kinematics during the First Year after Stroke: The Stroke Arm Longitudinal Study at the University of Gothenburg (SALGOT). J. Neuroengineering Rehabil. 2020, 17, 76. [Google Scholar] [CrossRef]
  15. Schwarz, A.; Kanzler, C.M.; Lambercy, O.; Luft, A.R.; Veerbeek, J.M. Systematic Review on Kinematic Assessments of Upper Limb Movements After Stroke. Stroke 2019, 50, 718–727. [Google Scholar] [CrossRef]
  16. Kwakkel, G.; Van Wegen, E.; Burridge, J.H.; Winstein, C.J.; van Dokkum, L.; Alt Murphy, M.; Levin, M.F.; Krakauer, J.W. Standardized Measurement of Quality of Upper Limb Movement after Stroke: Consensus-Based Core Recommendations from the Second Stroke Recovery and Rehabilitation Roundtable. Int. J. Stroke Off. J. Int. Stroke Soc. 2019, 14, 783–791. [Google Scholar] [CrossRef]
  17. Cerfoglio, S.; Ferraris, C.; Vismara, L.; Amprimo, G.; Priano, L.; Pettiti, G.; Galli, M.; Mauro, A.; Cimolin, V. Kinect-Based Assessment of Lower Limbs during Gait in Post-Stroke Hemiplegic Patients: A Narrative Review. Sensors 2022, 22, 4910. [Google Scholar] [CrossRef]
  18. Lam, W.W.T.; Tang, Y.M.; Fong, K.N.K. A Systematic Review of the Applications of Markerless Motion Capture (MMC) Technology for Clinical Measurement in Rehabilitation. J. Neuroengineering Rehabil. 2023, 20, 57. [Google Scholar] [CrossRef]
  19. Wade, L.; Needham, L.; McGuigan, P.; Bilzon, J. Applications and Limitations of Current Markerless Motion Capture Methods for Clinical Gait Biomechanics. PeerJ 2022, 10, e12995. [Google Scholar] [CrossRef]
  20. Ganguly, A.; Rashidi, G.; Mombaur, K. Comparison of the Performance of the Leap Motion ControllerTM with a Standard Marker-Based Motion Capture System. Sensors 2021, 21, 1750. [Google Scholar] [CrossRef]
  21. Lahkar, B.K.; Muller, A.; Dumas, R.; Reveret, L.; Robert, T. Accuracy of a Markerless Motion Capture System in Estimating Upper Extremity Kinematics during Boxing. Front. Sports Act. Living 2022, 4, 939980. [Google Scholar] [CrossRef]
  22. Smeragliuolo, A.H.; Hill, N.J.; Disla, L.; Putrino, D. Validation of the Leap Motion Controller Using Markered Motion Capture Technology. J. Biomech. 2016, 49, 1742–1750. [Google Scholar] [CrossRef]
  23. Bonnechère, B.; Sholukha, V.; Omelina, L.; Van Sint Jan, S.; Jansen, B. 3D Analysis of Upper Limbs Motion during Rehabilitation Exercises Using the KinectTM Sensor: Development, Laboratory Validation and Clinical Application. Sensors 2018, 18, 2216. [Google Scholar] [CrossRef]
  24. Banakou, D.; Groten, R.; Slater, M. Illusory Ownership of a Virtual Child Body Causes Overestimation of Object Sizes and Implicit Attitude Changes. Proc. Natl. Acad. Sci. U. S. A. 2013, 110, 12846–12851. [Google Scholar] [CrossRef]
  25. Fodor, L.A.; Coteț, C.D.; Cuijpers, P.; Szamoskozi, Ștefan; David, D. ; Cristea, I.A. The Effectiveness of Virtual Reality Based Interventions for Symptoms of Anxiety and Depression: A Meta-Analysis. Sci. Rep. 2018, 8, 10323. [Google Scholar] [CrossRef]
  26. Keizer, A.; van Elburg, A.; Helms, R.; Dijkerman, H.C. A Virtual Reality Full Body Illusion Improves Body Image Disturbance in Anorexia Nervosa. PloS One 2016, 11, e0163921. [Google Scholar] [CrossRef]
  27. Marini, M.; Casile, A. I Can See My Virtual Body in a Mirror: The Role of Visual Perspective in Changing Implicit Racial Attitudes Using Virtual Reality. Front. Psychol. 2022, 13, 989582. [Google Scholar] [CrossRef]
  28. Slater, M.; Sanchez-Vives, M.V. Enhancing Our Lives with Immersive Virtual Reality. Front. Robot. AI 2016, 3. [Google Scholar]
  29. Tassinari, M.; Aulbach, M.B.; Jasinskaja-Lahti, I. The Use of Virtual Reality in Studying Prejudice and Its Reduction: A Systematic Review. PloS One 2022, 17, e0270748. [Google Scholar] [CrossRef]
  30. Yee, N.; Bailenson, J. The Proteus Effect: The Effect of Transformed Self-Representation on Behavior. Hum. Commun. Res. 2007, 33, 271–290. [Google Scholar] [CrossRef]
  31. Pau, M.; Porta, M.; Bertoni, R.; Mattos, F.G.M.; Cocco, E.; Cattaneo, D. Effect of Immersive Virtual Reality Training on Hand-to-Mouth Task Performance in People with Multiple Sclerosis: A Quantitative Kinematic Study. Mult. Scler. Relat. Disord. 2023, 69, 104455. [Google Scholar] [CrossRef]
  32. Demeco, A.; Zola, L.; Frizziero, A.; Martini, C.; Palumbo, A.; Foresti, R.; Buccino, G.; Costantino, C. Immersive Virtual Reality in Post-Stroke Rehabilitation: A Systematic Review. Sensors 2023, 23, 1712. [Google Scholar] [CrossRef]
  33. Marek, K.; Zubrycki, I.; Miller, E. Immersion Therapy with Head-Mounted Display for Rehabilitation of the Upper Limb after Stroke-Review. Sensors 2022, 22, 9962. [Google Scholar] [CrossRef]
  34. Patsaki, I.; Dimitriadi, N.; Despoti, A.; Tzoumi, D.; Leventakis, N.; Roussou, G.; Papathanasiou, A.; Nanas, S.; Karatzanos, E. The Effectiveness of Immersive Virtual Reality in Physical Recovery of Stroke Patients: A Systematic Review. Front. Syst. Neurosci. 2022, 16, 880447. [Google Scholar] [CrossRef]
  35. Jost, T.A.; Nelson, B.; Rylander, J. Quantitative Analysis of the Oculus Rift S in Controlled Movement. Disabil. Rehabil. Assist. Technol. 2021, 16, 632–636. [Google Scholar] [CrossRef]
  36. Craig, C.M.; Stafford, J.; Egorova, A.; McCabe, C.; Matthews, M. Can We Use the Oculus Quest VR Headset and Controllers to Reliably Assess Balance Stability? Diagn. Basel Switz. 2022, 12, 1409. [Google Scholar] [CrossRef]
  37. Xu, X.; Chen, K.B.; Lin, J.-H.; Radwin, R.G. The Accuracy of the Oculus Rift Virtual Reality Head-Mounted Display during Cervical Spine Mobility Measurement. J. Biomech. 2015, 48, 721–724. [Google Scholar] [CrossRef]
  38. Carnevale, A.; Mannocchi, I.; Sassi, M.S.H.; Carli, M.; De Luca, G.; Longo, U.G.; Denaro, V.; Schena, E. Virtual Reality for Shoulder Rehabilitation: Accuracy Evaluation of Oculus Quest 2. Sensors 2022, 22, 5511. [Google Scholar] [CrossRef]
  39. Fregna, G.; Schincaglia, N.; Baroni, A.; Straudi, S.; Casile, A. A Novel Immersive Virtual Reality Environment for the Motor Rehabilitation of Stroke Patients: A Feasibility Study. Front. Robot. AI 2022, 9, 1–12. [Google Scholar] [CrossRef]
  40. Kim, G.J.; Parnandi, A.; Eva, S.; Schambra, H. The Use of Wearable Sensors to Assess and Treat the Upper Extremity after Stroke: A Scoping Review. Disabil. Rehabil. 2022, 44, 6119–6138. [Google Scholar] [CrossRef]
  41. Maceira-Elvira, P.; Popa, T.; Schmid, A.-C.; Hummel, F.C. Wearable Technology in Stroke Rehabilitation: Towards Improved Diagnosis and Treatment of Upper-Limb Motor Impairment. J. Neuroengineering Rehabil. 2019, 16, 142. [Google Scholar] [CrossRef]
  42. Liz, L.; da Silva, T.G.; Michaelsen, S.M. Validity, Reliability, and Measurement Error of the Remote Fugl-Meyer Assessment by Videoconferencing: Tele-FMA. Phys. Ther. 2023, pzad054. [Google Scholar] [CrossRef]
  43. Yang, C.-L.; Simpson, L.A.; Eng, J.J. A Pilot Study for Remote Evaluation of Upper Extremity Motor Function After Stroke: The Arm Capacity and Movement Test (ArmCAM). Am. J. Occup. Ther. Off. Publ. Am. Occup. Ther. Assoc. 2023, 77, 7701205020. [Google Scholar] [CrossRef]
  44. Webster, D.; Celik, O. Systematic Review of Kinect Applications in Elderly Care and Stroke Rehabilitation. J. Neuroengineering Rehabil. 2014, 11, 108. [Google Scholar] [CrossRef]
  45. Mesquita, I.A.; Fonseca, P.F.P. da; Pinheiro, A.R.V.; Velhote Correia, M.F.P.; Silva, C.I.C. da Methodological Considerations for Kinematic Analysis of Upper Limbs in Healthy and Poststroke Adults Part II: A Systematic Review of Motion Capture Systems and Kinematic Metrics. Top. Stroke Rehabil. 2019, 26, 464–472. [Google Scholar] [CrossRef]
  46. Alt Murphy, M.; Willén, C.; Sunnerhagen, K.S. Kinematic Variables Quantifying Upper-Extremity Performance after Stroke during Reaching and Drinking from a Glass. Neurorehabil. Neural Repair 2011, 25, 71–80. [Google Scholar] [CrossRef]
  47. Schwarz, A.; Bhagubai, M.M.C.; Nies, S.H.G.; Held, J.P.O.; Veltink, P.H.; Buurke, J.H.; Luft, A.R. Characterization of Stroke-Related Upper Limb Motor Impairments across Various Upper Limb Activities by Use of Kinematic Core Set Measures. J. Neuroengineering Rehabil. 2022, 19, 2. [Google Scholar] [CrossRef]
Preprints 80293 g001
Figure 1. Experimental protocol and examples of hand trajectories and velocity profiles. (A) Perspective (top panel) and top (bottom panel) view of a graphical depiction of the experimental conditions. The patients wore an head-mounted display and were immersed in a virtual environment in which they played a game with motor rehabilitation purposes (i.e. hit virtual glasses and make them fall). During the task, their hand movements were recorded by the Oculus on-board sensors and software and by means of a commercial motion capture system (Optitrack, NaturalPoint, Inc., Corvallis, USA) respectively. The gray circles represent the placements on the patient’s body of the Optitrack markers. The inset in the top panel shows the patient’s view of the virtual environment inside the HMD. (B) Perspective (top panel) and top (bottom panel) view of hand trajectories recorded by the Optitrack and Oculus systems during one experimental session. Left and right hand trajectories are plotted in blue and light brown respectively. (C) Example of velocity profile computed from Oculus and Optitrack data for the left (top panel) and right (bottom panel) hand, respectively.
Figure 1. Experimental protocol and examples of hand trajectories and velocity profiles. (A) Perspective (top panel) and top (bottom panel) view of a graphical depiction of the experimental conditions. The patients wore an head-mounted display and were immersed in a virtual environment in which they played a game with motor rehabilitation purposes (i.e. hit virtual glasses and make them fall). During the task, their hand movements were recorded by the Oculus on-board sensors and software and by means of a commercial motion capture system (Optitrack, NaturalPoint, Inc., Corvallis, USA) respectively. The gray circles represent the placements on the patient’s body of the Optitrack markers. The inset in the top panel shows the patient’s view of the virtual environment inside the HMD. (B) Perspective (top panel) and top (bottom panel) view of hand trajectories recorded by the Optitrack and Oculus systems during one experimental session. Left and right hand trajectories are plotted in blue and light brown respectively. (C) Example of velocity profile computed from Oculus and Optitrack data for the left (top panel) and right (bottom panel) hand, respectively.
Preprints 80293 g001
Preprints 80293 g002
Figure 2. Estimation of distances and velocities by the Optitrack and Oculus systems, respectively. (A) Maximum reaching distances (top) and peak velocities (bottom) measured in an experimental session for one of our patients. In both panels, each dot represents a single trial. (B) Slopes of the linear regression between measures of maximum reaching distance and peal velocity computed from Optitrack and Oculus data. Each dot represents a patient. Mean slope for estimates of maximum reaching distance = 0.94±0.1. Mean slope for estimates of peak velocities=1.06±0.12. (C) Estimates of maximum reaching distances (left figure) and peak velocity (right panel) computed for all patients from Optitrack and Oculus data. Each dot represents a single trial. In both panels, the red line represents a linear fit of the data. The slopes of this fit is shown in the caption. (D) Bland-Altman plots of the data in panel C.
Figure 2. Estimation of distances and velocities by the Optitrack and Oculus systems, respectively. (A) Maximum reaching distances (top) and peak velocities (bottom) measured in an experimental session for one of our patients. In both panels, each dot represents a single trial. (B) Slopes of the linear regression between measures of maximum reaching distance and peal velocity computed from Optitrack and Oculus data. Each dot represents a patient. Mean slope for estimates of maximum reaching distance = 0.94±0.1. Mean slope for estimates of peak velocities=1.06±0.12. (C) Estimates of maximum reaching distances (left figure) and peak velocity (right panel) computed for all patients from Optitrack and Oculus data. Each dot represents a single trial. In both panels, the red line represents a linear fit of the data. The slopes of this fit is shown in the caption. (D) Bland-Altman plots of the data in panel C.
Preprints 80293 g002
Preprints 80293 g003
Figure 3. Comparison of kinematic assessments using data from the Optitrack and Oculus systems. The two boxplots show the distributions of peak velocities of healthy and impaired hand obtained with the Optitrack (left panel) and Oculus (right panel) systems in one patient. In both panels, each dot represents a trial and the asterisk indicates a statistically significant difference (p<0.05).
Figure 3. Comparison of kinematic assessments using data from the Optitrack and Oculus systems. The two boxplots show the distributions of peak velocities of healthy and impaired hand obtained with the Optitrack (left panel) and Oculus (right panel) systems in one patient. In both panels, each dot represents a trial and the asterisk indicates a statistically significant difference (p<0.05).
Preprints 80293 g003
Table 1. Anagraphic and clinical characteristics of the patients enrolled, expressed in relative and absolute frequencies (n, %). Abbreviations: SD: standard deviation, FMA-UE: Fugl-Meyer Assessment-Upper Extremity.
Table 1. Anagraphic and clinical characteristics of the patients enrolled, expressed in relative and absolute frequencies (n, %). Abbreviations: SD: standard deviation, FMA-UE: Fugl-Meyer Assessment-Upper Extremity.
Sample (N=14)
Age (mean, SD) 59±15
Sex
Males
Females
10 (71%)
4 (29%)
Stroke Type
Ischemic
Hemorrhagic
13 (93%)
1 (7%)
Stroke side
Left
Right
5 (36%)
9 (64%)
Stroke timeframe
<1 year
1-3 years
>3 years
6 (42%)
4 (29%)
4 (29%)
FMA-UE score (min-max) 20-65
Table 2. Statistical comparison of the peak-velocity distributions for the healthy and impaired hand. The top row represents p-values obtained using ground-truth Optitrack values and the bottom row p-values obtained using Oculus measures. Each column represents results for a patient. For display purposes significant values at the p<0.05 level are highlighted in red.
Table 2. Statistical comparison of the peak-velocity distributions for the healthy and impaired hand. The top row represents p-values obtained using ground-truth Optitrack values and the bottom row p-values obtained using Oculus measures. Each column represents results for a patient. For display purposes significant values at the p<0.05 level are highlighted in red.
1 2 3 4 5 6 7 8 9 10 11 12 13 14
Optitrack 7.37e-03 8.23e-04 1.80e-04 5.77e-15 6.36e-01 4.44e-03 1.81e-03 2.36e-01 4.32e-08 2.40e-05 3.06e-13 2.15e-10 2.60e-01 1.10e-04
Oculus 5.35e-01 7024e-03 3.69e-02 8.24e-13 2.84e-01 1.27e-03 8.73e-04 1.44e-01 1.16e-06 1.12e-02 1.02e-13 1.02e-05 1.43e-01 4.56e-04
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.
Prerpints.org logo

Preprints.org is a free preprint server supported by MDPI in Basel, Switzerland.

facebook logotwitter logolinkedin logo
MDPI Initiatives
Important Links
Subscribe

Disclaimer

Terms of Use

Privacy Policy

© 2024 MDPI (Basel, Switzerland) unless otherwise stated