This version is not peer-reviewed.
Submitted:
12 December 2024
Posted:
12 December 2024
You are already at the latest version
A peer-reviewed article of this preprint also exists.
ID | Author | Year | Country | Database | Summary |
---|---|---|---|---|---|
1 | Lim et al. | 2024 | Canada | WOS, PubMed | Feasibility of depth cameras & pressure pads as alternatives to force plates. |
2 | Wagner et al. | 2023 | Poland | PubMed | Depth-sensor gait methods compared. |
3 | Raza et al. | 2023 | Pakistan, Saudi Arabia | WOS, Scopus | AI for pose estimation in physiotherapy exercises. |
4 | Maskeliunas et al. | 2023 | Lithuania | WOS, Scopus | BiomacVR for posture & movement analysis in rehabilitation. |
5 | Lim et al. | 2023 | China | Scopus, PubMed | Adaptive Cobot system for assistive rehab training. |
6 | Khan et al. | 2023 | USA | WOS | Quantum neural network for post-stroke exercise assessment. |
7 | Bijalwan et al. | 2023 | India | WOS, Scopus | Automated system for upper limb exercise detection using an RGB-Depth camera. |
8 | Keller et al. | 2022 | USA | PubMed | Unsupervised ML for low back pain exercise strategies. |
9 | Zhao et al. | 2021 | USA, China | WOS, Scopus | Home TKR rehab system development. |
10 | Trinidad-Fernández et al. | 2021 | Spain, Belgium | PubMed | RGB-D camera validates motion capture in spondyloarthritis. |
11 | Hustinawaty et al. | 2021 | Indonesia | Scopus | Kinect SDK for a study of straight leg lift exercise. |
12 | Girase et al. | 2021 | USA | PubMed | Key factors identified for spine, hip, and knee assessment from sit-to-stand. |
13 | Çubukçu et al. | 2021 | Turkey | WOS, Scopus | Kinect-based mentor for shoulder injury telerehab. |
14 | Wei et al. | 2020 | USA | WOS, Scopus | Sensors and DL for automated balance assessment. |
15 | Uccheddu et al. | 2021 | Italy | WOS, Scopus | Hybrid approach for 3D pose estimation proposed. |
16 | Trinidad-Fernández et al. | 2020 | Belgium, Spain, Australia | PubMed | RGB-D camera kinematic assessment results. |
17 | Saratean et al. | 2020 | Romania | WOS, Scopus | Kinect-based physical therapy guidance system. |
18 | Garcia et al. | 2020 | Brazil | WOS, Scopus | RGB-D camera analysis of compensatory trunk movements. |
ID | Data Type | Dataset |
---|---|---|
1 | Joint displacement data series | 10 non-disabled participants: 7 males, 3 females |
2 | RGB-D Images | 5 subjects: 2 males, 3 females |
3 | Skeleton Data | Multi-Class Exercise Poses for Human Skeleton |
4 | RGB-D Videos | 16 healthy subjects, 10 post-stroke patients |
5 | RGB-D Image | 5 healthy subjects |
6 | Joint-Skeletal | UI-PRMD |
7 | RGB-D | UTD-MHAD, mHealth, OU-ISIR, HAPT |
8 | RGB-D | 111 participants: back pain 43, control 26, surgery 4 |
9 | RGB-D & IMU | / |
10 | RGB-D Videos & IMU | 17 subjects: 54.35 (±11.75) years |
11 | RGB-D | 10 human objects |
12 | RGB-D Time Series | 3 patient groups and one control group: 78 control, 130 LBP, 90 hip, and 113 knee |
13 | Skeleton Data | 29 shoulder damaged volunteers: 18 males, 11 females |
14 | RGB-D Image | 41 subjects: 26 males, 15 females; 21 healthy subjects and 20 patients with PD |
15 | RGB-D Videos | / |
16 | RGB-D & IMU | 30 subjects: 18 65 years with non-specific lumbar pain |
17 | Skeleton Data | / |
18 | RGB-D | 14 volunteers: 9 range of movement capture tests, 5 trunk compensation tests |
ID | Algorithm | Processing |
---|---|---|
1 | / | Joint Displacement Data. |
2 | Savitzky-Golay Filter | Transform the coordinate system using the KD, CH, and FV data processing methods. |
3 | RF, LR, GRU, LSTM, LogRF | MediaPipe Pose Marker, Feature Selection, and Hyperparameter Tuning. |
4 | ANN, DNN, CNN, CPM | Human skeletal movement was observed using visible information. |
5 | Imitation Learning for Adaptive Learning | / |
6 | High-Quality Neural Network | Align the length and center, and perform characteristic transformation. |
7 | HDL of CNN, RNN, CNN-GRU, and CNN-LSTM | Apply Min-Max normalization. |
8 | PCA, NLPCA, LR, Kaiser and Scree Plot Rules, Pattern Matching Statistics | Use Kalman filter, sequential second-order, and low pass Butterworth filtering. |
9 | / | Fuse accelerometer and gyroscope measurements. |
10 | Statistical analysis | Synchronize the dataset with the timestamp and visualize it using OpenNI2, NiTE2, and MRPT. |
11 | Detecting and Tracking | Calibration, skeletalization process, and feature extraction. |
12 | SVM, RF, MLPs, CCNN, Semi-Supervised Learning, Unscented Kalman Filter | Estimate joint center positions using the standard Kinect 2 Body Tracking library. |
13 | Statistical Analysis | Use the Kinect SDK 2.0. |
14 | CNN, RF Classifier | Perform data augmentation. |
15 | OpenPose | Process video frames from the RGB sensor with the OpenPose library. |
16 | / | Synchronize and use OpenNI2 and NiTE2 to create a virtual skeleton representation. |
17 | Effort-Based Parameterization Method | / |
18 | PrimeSense | Use the Kinect SDK 2.0. |
ID | Feature |
---|---|
1 | Demonstrates integration of depth cameras and pressure mats as cost-effective, accessible feedback mechanisms for balance training. |
2 | Advances gait assessment techniques using depth sensor data, improving diagnostic and treatment accuracy. |
3 | Uses the LogRF method and random forest algorithms for improved human pose estimation in physiotherapy. |
4 | Employs virtual reality to increase precision and engagement in posture and movement analysis during rehabilitation. |
5 | Features a personalized adaptive learning system for upper-limb rehabilitation, enhancing patient-specific outcomes. |
6 | Introduces a hybrid quantum neural network to enhance speed and accuracy in post-stroke exercise assessments. |
7 | Combines deep learning models to enhance modeling of spatio-temporal features in stroke rehabilitation. |
8 | Utilizes unsupervised machine learning to analyze movement capture data, identifying movement strategies in low back pain patients. |
9 | Proposes a protocol for home-based rehabilitation post-knee replacement using accessible technology. |
10 | Uses an RGB-D camera to accurately assess movement limitations in spondyloarthritis, supporting better clinical decisions. |
11 | Applies Kinect SDK skeletonization to accurately assess the straight leg raise, aiding lumbar condition diagnoses. |
12 | Automates detection and classification of pathologies from sit-to-stand movements using machine learning. |
13 | Develop a system using Kinect to monitor and correct shoulder exercises dynamically. |
14 | Integrates sensors and deep learning to enable real-time balance evaluations, enhancing therapy effectiveness. |
15 | Develop a hybrid method using RGB-D sensors for accurate joint angle estimation in-home rehabilitation. |
16 | Validates the use of RGB-D cameras for reliable and responsive kinematic assessments in clinical settings. |
17 | Implements a Kinect-based system for remote physiotherapy coaching, facilitating continuous care. |
18 | Analyze compensatory trunk movements with RGB-D cameras to refine upper limb rehabilitation strategies. |
ID | Scenario | Objective |
---|---|---|
1 | Local | Evaluate balance training effectiveness with depth cameras and pressure mats. |
2 | Local | Enhance gait analysis accuracy using new spatiotemporal methods and depth sensors. |
3 | Local | Improve exercise correction in physiotherapy with innovative pose estimation. |
4 | Remote, Clinical | Develop a VR system for precise human posture and motion analysis to boost rehabilitation engagement. |
5 | Remote | Build a personalized adaptive learning system with collaborative robots for upper-limb rehab. |
6 | Local | Improve post-stroke exercise assessments with a hybrid quantum neural network. |
7 | Clinical | Enhance upper extremity rehab post-stroke by modeling spatio-temporal features with deep learning. |
8 | Clinical | Discover low back pain strategies using unsupervised learning on motion data. |
9 | Local | Establish a comprehensive home protocol for post-knee replacement recovery. |
10 | Clinical | Validate RGB-D cameras for precise trunk movement analysis in spondyloarthritis. |
11 | Clinical, Local | Analyze straight leg raises accurately using Kinect SDK’s skeletonization. |
12 | Clinical | Automate diagnosis of spinal, hip, and knee pathologies from sit-to-stand movements. |
13 | Remote | Develop a Kinect-based system to monitor and correct shoulder rehab exercises. |
14 | Local | Develop an on-demand balance evaluation tool integrating sensors with deep learning. |
15 | Local | Merge 2D and 3D RGB-D data for precise joint angle estimation in-home rehab. |
16 | Local | Validate the reliability and responsiveness of kinematic assessments with RGB-D cameras. |
17 | Remote | Implement a Kinect-based remote physiotherapy coaching system to ensure exercise adherence. |
18 | Clinical | Analyze compensatory trunk movements in upper limb rehab using RGB-D cameras. |
ID | Target | Sensor |
---|---|---|
1 | body | Kinect V2, Pressure Mat |
2 | foot, knee, ankle | Kinect V2 |
3 | body | Ordinary Camera |
4 | upper limb | Intel RealSense L515/D435i, HTC Vive VR Equipment |
5 | upper limb | Kinect Camera, Cobot, Force/Torque Sensor |
6 | body | Kinect |
7 | upper limb | Kinect V2 |
8 | low-back | Kinect V2 |
9 | knee | Kinect V2, IMU(Shimmer) |
10 | trunk | RGB-D Camera, IMU(MP67B) |
11 | leg | Kinect |
12 | low-back, hip, knee | Kinect V2 |
13 | shoulder | Kinect V2 |
14 | body | Kinect, WBB |
15 | hip, knee, ankle | Intel RealSense D415 |
16 | low-back | RGB-D Camera (Xtion Pro), IMU(MP67B) |
17 | body | Kinect for Xbox 360 |
18 | upper limb | Kinect V2 |
ID | Problem Statement |
---|---|
1 | Current feedback mechanisms in balance training are restricted by their reliance on expensive, bulky equipment. |
2 | Traditional gait analysis needs to harness depth sensor data, impacting diagnostic accuracy effectively. |
3 | Current pose estimation in physiotherapy often lacks precision, leading to ineffective exercise correction. |
4 | Conventional motion analysis tools lack the precision and interactivity required for effective rehabilitation. |
5 | Standard upper-limb rehabilitation devices do not adapt to patient progress, limiting their effectiveness. |
6 | Existing post-stroke assessments lack precision and speed, necessitating advanced computational solutions. |
7 | Spatio-temporal feature modeling in stroke rehabilitation is inadequate, hindering exercise effectiveness. |
8 | Personalized treatment strategies in low back pain are limited by poor analysis of movement data. |
9 | Spatio-temporal feature modeling in stroke rehabilitation is inadequate, hindering exercise effectiveness. |
10 | Tools for assessing movement limitations in spondyloarthritis need to be improved. |
11 | Current methods need to capture the straight leg raise, complicating lumbar assessments accurately. |
12 | Automated diagnostic tools for spine, hip, and knee pathologies need to be improved. |
13 | Existing shoulder rehab systems lack precise, interactive monitoring of exercises. |
14 | Current physical therapy lacks practical on-demand balance evaluation tools. |
15 | Home rehab methods inaccurately estimate joint angular ranges, affecting treatment outcomes. |
16 | Kinematic assessments lack the reliability and responsiveness required for effective clinical decisions. |
17 | Current physical therapy lacks effective on-demand balance evaluation tools. |
18 | Methods to analyze compensatory trunk movements in upper limb rehab are ineffective. |
ID | Ref | Limitation |
---|---|---|
1 | [21] | The study only tested non-disabled participants, not spinal cord injury patients. |
2 | [22] | Gait analyses were conducted under controlled lab conditions, which may not reflect real-world variability. |
3 | [23] | Pose estimation algorithms tested primarily in well-controlled environments, may not perform as well in cluttered spaces. |
4 | [24] | VR systems may cause discomfort or dizziness in some patients, limiting their widespread usability. |
5 | [25] | System’s adaptability is not tested on patients with varying degrees of cognitive impairments. |
6 | [26] | Validation is restricted to small datasets which may not generalize to broader populations. |
7 | [27] | Deep learning models require extensive computational resources, limiting deployment in low-resource settings. |
8 | [28] | Machine learning models derived from a limited demographic, potentially affecting the universality of findings. |
9 | [29] | Study did not account for long-term adherence to home-based programs. |
10 | [30] | Camera’s depth resolution is insufficient to capture fine-grained joint movements accurately. |
11 | [31] | Kinect SDK’s accuracy in capturing leg movements is not verified against gold-standard clinical assessment tools. |
12 | [32] | Diagnostic accuracy is dependent on the precise execution of sit-to-stand movements, which varies widely among patients. |
13 | [33] | Limited to static exercises; dynamic movements’ complexity not fully explored. |
14 | [34] | Balance evaluation algorithms not validated in diverse real-world environments. |
15 | [35] | Estimations may not be accurate for patients with severe joint deformities or those wearing certain types of clothing that interfere with sensor accuracy. |
16 | [36] | Kinematic data’s reliability is compromised by occasional sensor inaccuracies and environmental interferences. |
17 | [37] | Kinect sensor’s limited field of view can restrict the range of exercises that can be monitored. |
18 | [8] | Analysis does not account for simultaneous lower limb movements, which can influence trunk motion. |
KD | Knee Distance |
CH | Centre Height |
FV | Foot Velocity |
RF | Random Forest |
LR | Logistic Regression |
GRU | Gated Recurrent Unit |
LSTM | Long Short-Term Memory |
LogRF | Logistic regression Recursive Feature elimination |
ANN | Artificial Neural Network |
DNN | Deep Neural Network |
CNN | Convolutional Neural Network |
CPM | Convolutional Pose Machines |
HDL | Hybrid Deep Learning |
RNN | Recurrent Neural Network |
PCA | Principal Component Analysis |
NLPCA | Non-Linear Principal Component Analysis |
SVM | Support Vector Machine |
MLPs | Multi-Layer Perceptrons |
CCNN | Causal dilated Convolutional Neural Network |
MRPT | Mobile Robot Programming Toolkit [51,52] |
1 | |
2 | |
3 | |
4 | |
5 |
RQ 1: What types of depth camera sensors are used in physiotherapy movement assessment, and what are their characteristics and applications? |
Motivation 1: Depth camera technologies (e.g., time-of-flight, structured light, and stereo vision) are essential to physiotherapy movement assessment. Each depth camera type has unique advantages, and choosing the right camera for a particular treatment scenario is critical. A comprehensive analysis of the depth cameras used in this study and their actual efficacy in physical therapy can provide an essential reference for practical applications to improve the evaluation system’s stability and performance, optimize the data acquisition quality, and enhance evaluation accuracy. |
RQ 2: How do the dataset type, construction methods, and feature selection impact algorithm performance and the effectiveness of applications in depth camera-based physiotherapy exercise assessments? |
Motivation 2: The quality and applicability of datasets are critical factors in determining the effectiveness of computer vision techniques in physiotherapy movement assessment. To systematically analyze the effects of dataset types, construction methods, and dataset sizes and the effectiveness of their application as used in the current literature to evaluate existing models’ reliability and provide methodological guidance for future research to optimize dataset construction strategies. |
RQ 3: What are the primary data processing methods used in depth-camera-based movement analysis for physical therapy, and how do they affect the assessment? |
Motivation 3: Data processing directly affects the assessment’s quality and accuracy. Systematic study of current data processing techniques (e.g., skeletal data extraction, coordinate system transformation, data normalization) can help optimize the processing flow, improve data quality, and enhance model generalization to improve the accuracy and clinical relevance of the assessment and drive depth camera-based movement analysis in physical therapy toward higher accuracy and a more comprehensive range of applications. |
RQ 4: Which algorithms perform best for depth camera-based physiotherapy movement assessment, and what are the advantages and limitations of different algorithms for various physical therapy tasks? |
Motivation 4: Algorithm selection is crucial for depth camera-based physiotherapy assessment, impacting accuracy, efficiency, and clinical utility. Comparing traditional machine learning, deep learning, and specialized algorithms across various physiotherapy tasks, elucidating their strengths and limitations. Optimizing algorithm choice aims to enhance assessment techniques, improve patient outcomes, and establish a robust foundation for intelligent, personalized physiotherapy interventions. |
RQ 5: What are the main innovative features of current research in physical therapy exercise assessment with depth camera sensors? How do these features improve rehabilitation outcomes and accessibility? |
Motivation 5: Depth camera sensor technology presents multiple innovative features in physiotherapy movement assessment, and systematic analysis of these features is essential to capture advances in the field and guide future research. By exploring how these innovations can work together to promote advances in physical therapy, comprehensive and effective rehabilitation systems could be developed, improving diagnostic accuracy and personalized rehabilitation outcomes while optimizing home rehabilitation and remote monitoring solutions. |
RQ 6: What are the main application scenarios for depth cameras in physical therapy, and how do these scenarios affect the implementation strategies and rehabilitation outcomes? |
Motivation 6: Depth camera technology is used in different scenarios, such as remote, clinical, and home. An in-depth understanding of the specific needs and challenges of these scenarios can help optimize the implementation strategy, improve the efficiency of rehabilitation resource allocation, and promote the development of physical therapy in the direction of more intelligent, personalized, and universal, thus improving the overall rehabilitation effect. |
RQ 7: What are the most common body parts targeted by camera depth sensor-based physiotherapy, and where is this technology most frequently implemented? |
Motivation 7: In physical rehabilitation, movement assessment on different body parts is critical to patient recovery. Clarifying the application of depth camera technology in assessing various body parts can help develop more comprehensive and accurate assessment methods, improve the relevance and effectiveness of rehabilitation treatment, and provide a reliable basis for developing individualized rehabilitation plans. |
RQ 8: What are the main challenges and limitations of computer vision and depth sensor technology in physiotherapy movement assessment? |
Motivation 8: Although depth camera technology has shown great potential in physical therapy, it still faces many challenges. A thorough analysis of these challenges will not only help to understand the limitations of the current technology, but also point to future research that will lead to more accurate and reliable physiotherapy movement assessment systems and improved rehabilitation outcomes. |
Database | Query |
WOS, PubMed | ("Computer Vision" OR "Depth Camera*" OR "Depth Sensor*" OR "Kinect" OR "RGBD" OR "RGB-D") AND ("Physiotherapy" OR "Physiotherapies" OR "Physical Therapy" OR "Physical Therapies") AND ("Habilitation" OR "Rehabilitation" OR "Movement" OR "Exercise*" OR "Action" OR "Recognition") |
Scopus | TITLE-ABS-KEY (("Computer Vision" OR "Depth Camera*" OR "Depth Sensor*" OR "Kinect" OR "RGBD" OR "RGB-D") AND ("Physiotherapy" OR "Physiotherapies" OR "Physical Therapy" OR "Physical Therapies") AND ("Habilitation" OR "Rehabilitation" OR "Movement" OR "Exercise*" OR "Action" OR "Recognition")) |
Astrophysics | (title:"Computer Vision" OR title:"Depth Camera*" OR title:"Depth Sensor*" OR title:"Kinect" OR title:"RGBD" OR title:"RGB-D" OR keyword:"Computer Vision" OR keyword:"Depth Camera*" OR keyword:"Depth Sensor*" OR keyword:"Kinect" OR keyword:"RGBD" OR keyword:"RGB-D" OR abstract:"Computer Vision" OR abstract:"Depth Camera*" OR abstract:"Depth Sensor*" OR abstract:"Kinect" OR abstract:"RGBD" OR abstract:"RGB-D") AND (title:"Physiotherapy" OR title:"Physiotherapies" OR title:"Physical Therapy" OR title:"Physical Therapies" OR keyword:"Physiotherapy" OR keyword:"Physiotherapies" OR keyword:"Physical Therapy" OR keyword:"Physical Therapies" OR abstract:"Physiotherapy" OR abstract:"Physiotherapies" OR abstract:"Physical Therapy" OR abstract:"Physical Therapies") AND (title:"Habilitation" OR title:"Rehabilitation" OR title:"Movement" OR title:"Exercise*" OR title:"Action" OR title:"Recognition" OR keyword:"Habilitation" OR keyword:"Rehabilitation" OR keyword:"Movement" OR keyword:"Exercise*" OR keyword:"Action" OR keyword:"Recognition" OR abstract:"Habilitation" OR abstract:"Rehabilitation" OR abstract:"Movement" OR abstract:"Exercise*" OR abstract:"Action" OR abstract:"Recognition") AND (pubdate:[2020-01-01 TO 2024-12-31]) |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
Downloads
129
Views
75
Comments
0
Subscription
Notify me about updates to this article or when a peer-reviewed version is published.
© 2025 MDPI (Basel, Switzerland) unless otherwise stated