1. Introduction
The most common activities of daily living (ADL) are walking and climbing stairs [
1]. The ability to perform ADLs with ease is essential for the quality of life of patients or elderly persons. This is especially important as disorders of the human gait pattern increase significantly with age. A study by Mahlknecht et al. [
2] revealed that the prevalence of gait and balance disorders ranges around 10% for individuals aged between 60 and 69 years and exceeds 60% for those aged over 80 years. In context of an ageing society, interest in effective and affordable treatment methods for gait disorders is increasing. There are multiple approaches to reduce the impairment of gait disorders. One of them are orthoses and exoskeletons, which can be used to support or even regain lower extremity functions [
3,
4,
5,
6,
7,
8,
9,
10,
11]. To develop and validate such devices and to adapt them to the user, long-term gait observation is necessary. Parameters such as knee joint torque and angle, hip joint angular velocity, and the speed of the subject’s movement can be derived based on biomechanical measurements [
5]. By evaluation of these parameters over the course of a day while performing ADL load collectives can be generated for the lower limb. The collected data is instrumental in refining the design, verification, and control of exoskeletons.
Biomechanical data can be captured with Motion Analysis Systems (MAS). There are several methods for this purpose, which differ primarily in the choice of sensors.
A frequently selected method of recording motion kinetics is the use of optical systems [
12]. An example of such system has been described by Riener et al. [
13].
This methodology with motion-detecting cameras has been proven for decades in biokinematics but is inappropriate for a wearable biomechanical analysis system. Optical systems can record human motion very accurately but are cost intensive and restrict the recording spatially into a stationary environment equipped with an array of cameras [
12,
14]. However, the precise data and the large amount of test results in the literature can be used for the verification of a new measurement system [
13,
15].
Wearable systems based on IMUs (Inertial Measurement Units) have been recently subject of extensive research [
12,
14,
16,
17,
18,
19,
20,
21,
22,
23,
24,
25,
26,
27,
28,
29,
30,
31,
32,
33,
34,
35,
36,
37,
38,
39,
40,
41,
42,
43]. These systems, while not yet delivering the same accuracy as optical systems, can be operated everywhere and not only in a stationary environment equipped with cameras. Commercial solutions for inertial motion capturing have existed since the early 2000s. In 2008, Cloete et al. [
33] benchmarked the commercially available MOVEN motion capture system by XSENS, comparing it to a clinically used optical system. They concluded that the system can measure the inclinations of body parts and joint angles with reasonable accuracy, while being exceptionally fast to set up and flexible in its use [
33]. However, the commercial solutions tested still are expensive, with the latest version of XSENS motion capture suit costing more than 4.000 USD.
Due to their advantages, IMU Sensors are the most commonly used wearable technology for gait analysis [
30]. But this technology is still not used to its full potential. Benson et al. reviewed over 230 MAS for running gait analysis based on IMU sensors. 28% of the studies were conducted outdoors and in 33% of all studies the analysed distance was greater than one step or stride or 200 m [
44]. Which means most of the systems are not designed to run long-term measurements out of the laboratory. Furthermore only 10% of the reviewed devices are used for measuring joint angles or range of motion. Benson et al. suggest, to shift gait analysis research from controlled laboratory settings to more real-world environments [
44].
This leads to the conclusion, that there is a research gap in developing a low-cost solution for measurements of biomechanical data over the course of multiple days in an environment of daily living.
Long-term measurements are required to obtain a complete set of biomechanical data in real-life conditions. Field measurements offer a significantly larger and more realistic variety of load scenarios compared to simulating selected walking activities in a laboratory. Additionally, simulating tasks can lead to systematic errors. These errors can be avoided by measuring under real conditions.
Load collectives of the human leg will be calculated from the data of long-term measurements obtained by the proposed system. The data sets will also help to identify different walking activities (e.g., level walking, stair ascending and descending) performed by the user. This information will be used in future work for the control of an active exoskeleton for the human knee.
For this purpose, SensAA is focused on measuring the kinematics of the lower human limbs. SensAA will be used by elderly people; therefore, the use of the measurement system shall be as intuitive as possible. The wearer does not need technical knowledge to operate the system and can don and doff it on their own. No maintenance like recharging, sensor adjustment and calibration are required during runtime. The system is implemented using off-the-shelf hardware and open source software. This reduces cost and improves accessibility of the system.
SensAA is used in activities of daily living both indoors and outdoors. It is also used all day without taking it off. Therefore, a small, compact, and wireless design is suggested, which is non-obstructive to its wearer and does not cause discomfort.
To take full advantage of this wearable design, cloud-based software for data acquisition and analysis is proposed. While the measurements are running, the data is automatically uploaded to a database on a cloud server. The server allows for central data storage and online data collection for multiple users simultaneously.
In literature there already are reports of approaches which use IMU sensors to measure lower limb kinematics [
32,
45]. However, to our knowledge, no device has yet been described that combines all desired goals. These approaches lack at least one of the following aspects:
Easy setup and low calibration effort [
16,
18,
19]
Compact and wireless design [
14,
25,
46]
Data upload outdoors without WIFI connection [
19,
27]
Energy optimization for long-term measurements [
19,
27,
28,
31]
This paper presents a novel all-in-one solution, that combines solutions for accuracy, usability, and security to close the shown research gap.
2. Materials and Methods
2.1. System Architecture
The system SensAA consists of the following three main components:
The components and their interfaces are illustrated in
Figure 1:
SensAA uses IMU sensors to measure joint angles. This sensor principle enables the measuring system to be used independently in every environment of daily living.
The IMU sensors measure acceleration and angular velocity to observe their inclination relative to the gravity vector on earth. At least two sensors are required to measure the angle at one joint axis. Each sensor is integrated in a housing, a wearable Sensor Box, which also contains a battery and a Bluetooth
® Low Energy (BLE) module (see
Section 2.2).
In order to measure the angle of the human knee joint, one Sensor Box is attached to the thigh and another one to the shank of a leg. The sensors are placed parallel to the sagittal plane of the user’s body.
The data collected are transmitted wirelessly via BLE from the sensors to a smartphone (see
Section 2.3). The smartphone runs an Android application, which receives the data via BLE notifications and forwards them to a Cloud Server System over the cellular network. The Cloud Server provides a read and write interface to a central database for up- and downloading datapoints (see
Section 2.4). The link to this database gives the possibility to create data backups regularly. Since the server is accessible from a public address, appropriate measures must be taken to ensure the authenticity and authority of the users.
Figure 2 shows the system architecture of SensAA. The three main components and their sub-architectures are described in Sections 2.2 to 2.4.
2.2. Sensor Box
2.2.1. Electronic Structure
The Sensor
Boxes with integrated inertial sensor and microcontroller are designed to have a small form factor while maintaining a long battery life.
Figure 3 shows the block diagram of the electronic structure and interfaces of SensAA.
The long duration of recordings requires the use of energy-efficient hardware and an appropriately dimensioned power source. IMU sensors based on MEMS (Micro-Electro-Mechanical Systems) technology have a negligible power consumption and are well suited for the proposed application. Processors and wireless transmitters also have to be carefully selected to keep the power consumption to a minimum. For this reason, Bluetooth
® Low Energy is the preferred protocol for transmitting data wirelessly to a smartphone (see
Section 2.3).
The compact STEVAL-STLCS02V1 (ST-Evaluation) sensor board from STMicrolectronics has been chosen. This board is inexpensive and offers a suitable interface for programming the integrated STM32-L476 microcontroller [
49]. Furthermore, its small size (13.5 mm x13.5 mm) makes the board ideal for the intended application. The board has a built-in IMU sensor, LSM6DSM, which incorporates an accelerometer and a gyroscope. Linear acceleration can be measured up to ±16 g (gravity of the earth) and the angular velocity up to ±2000 dps (degrees per second) [
50]. BLE communication is provided by the modules integrated on the STEVAL-Board.
A 500 mAh LiPo battery (lithium polymer battery) provides the power supply, which can be switched on and off via a slide switch. The nominal battery voltage is 4.2 V. To recharge the battery and provide long operating times, a LiPo-battery-charger from Adafruit
® is used [
51]. This charger can be connected through a micro-USB (Universal Serial Bus).
For the connection to the supply voltage and the interface ports of the STEVAL-Board a breakoutboard is required. Therefore, a custom PCB (Printed Circuit Board) has been designed. The supply voltage of this breakoutboard PCB is 3.3 V, which is constantly provided by an LDO (low dropout voltage regulator).
2.2.2. Mechanical Structure
The electronic components are mounted in a 3D-printed housing, the Sensor Box. The bottom half of the housing provides cut-outs and guides for components and cables. One corner of the custom PCB is cut at an angle, which prevents the PCB from being inserted incorrectly in the housing. The PCB has an overall size of 17.5 mm x20 mm. The housing also provides openings for the slide switch and the USB connector of the LiPo-charger.
The top half top half of the housing includes support structures to ensure that the components do not move during measurements. While the Sensor Box is closed, these support structures are in contact with the components and hold them down securely.
The Sensor Box has the final dimensions of 53.2 mm in length, 52.5 mm in width, and 11.6 mm in height.
Figure 4 shows the 3D printed housing with the fitted components.
2.3. Sensor Firmware and Smartphone Application
The firmware of the sensors is implemented in the C language with the following main functions:
Reading values from the built-in accelerometer and gyroscope
Observing the inclination of the sensors by fusing the accelerometer and gyroscope data
Transmission of measurement data to the Android application
The Android application provides a user interface to interact with the sensors. The application allows to connect, disconnect, and calibrate the sensors. Communication between the application and the sensors is implemented using the BLE GATT (Generic Attribute Profile) protocol. All interactions are mapped to GATT services and characteristics. A Service is a background-process, which may be executed even when the device display is off. The Service is used to silently collect sensor data via BLE without needing any interaction with the user.
The following GATT-Services are provided:
The “Metric” service provides the sensor data. For each type of sensor data (acceleration, angular velocity, inclination), a GATT characteristic is defined, which can be subscribed by the smartphone app. Furthermore, a GATT-descriptor is added to each characteristic, describing the scale and unit of the provided metrics. Using the descriptor, the full scale of the device can be reconfigured, without reprogramming the scaling in the smartphone application.
The “Version” service provides the firmware version running on the sensor. It features two characteristics, one for reading the major and minor version numbers and one for the exact build revision.
The “Control” service is used to imperatively trigger different processes in the sensor firmware. Each characteristic of the service is assigned to an action in the sensor firmware. For now, it is only used to initiate the self-calibration function.
Figure 5 illustrates the main state machine of the sensor firmware. On reset, the system goes into the Init state. In the Init state, the microcontroller and its peripherals are configured. After initialization, the system goes into the Operating state. In the Operating state, the sensors are read, and the notifications are updated. The user can trigger self-calibration of the sensors via the “Control” GATT-service. During self-calibration, the offset in the gyroscope values is calculated while the sensor is in a stationary state. This offset is then stored in flash and applied to all subsequent sensor readings. When calibration is finished, the system goes back into the Operating state, resuming characteristic updates. During operation, the sensors calculate their orientation using an Extended Kalman Filter (EKF) based observer algorithm. The observer estimates the direction of the gravity vector from which the inclination of the sensor is derived. The inclination is published via the ‘Inclination’ GATT characteristic in radians as a 32bit floating point number.
Depending on the number of sensors connected, the sensors reach a sampling rate from at least 20 Hz (with four sensors) up to 50 Hz (with two sensors). The average frequency of walking is between 1.5 Hz and 2.5 Hz [
52] and can go up to 4.5 Hz while climbing stairs [
53]. According to the Nyquist-Shannon Sampling Theorem, a sampling rate of at least 9 Hz is needed to record the gait pattern of a subject correctly. Therefore, the sampling rate of SensAA is sufficient for human motion analysis.
2.4. Cloud Server System
The Cloud Server System has the responsibility of persistent data storage, while keeping the data accessible, integrous, and consistent. The consistency and integrity requirement can be met by using a database management system and a well-defined data model. For this purpose, a MySQL database management system is used. To enable cross-platform access to a database system, an interface application based on web technologies has been chosen. Therefore, the system communicates using the Hypertext Transfer Protocol (HTTP), which is the standard protocol for web applications. To achieve high accessibility, an architecture is developed that allows for fast deployment and updatability. The clients interacting with the Cloud Server System are connected via public, mobile networks. The Cloud Server System is listening on a public IP address. When exposing the application to the internet, data security becomes an immediate concern. To prevent unauthorized access to the system all communications are encrypted and an authentication and authorization system is used.
Figure 6 shows the proposed Cloud Server System architecture. For simple interaction, the system acts as a single HTTP Server towards the client. Internally, the system is implemented as a docker container network. Each container runs specific services, each responsible for enabling distinct functions of the system. All containers can be maintained and updated individually. This allows incremental updates, without the need to shut down the entire system. All services are connected to the clients via HTTP based Application Programming Interfaces (APIs). However, from a client’s point of view, it is easier to communicate with a single server offering all these services. The API-Gateway is a reverse proxy that addresses this issue. Depending on the path of the request, the request is relayed to the service handling it. To ensure data security, API-Gateway uses Transport Layer Security (TLS). The API-Gateway decrypts incoming HTTP messages and relays the unencrypted message to its destination service. In this way, while the services are not handling security themselves, the API-Gateway ensures that no unencrypted data can leave the system.
The API-Server container hosts the Metrics-API, which is responsible for accessing the database. The Metrics-API provides one endpoint for each type of measurement, each reachable on a distinct HTTP path. There is a corresponding database table for each endpoint. The scheme of this table describes the measurement datatype. When inserting a datapoint, the body of the client’s request contains a JSON (Java Script Object Notation) document, which contains an array of JSON objects, each representing a single measurement. When retrieving datapoints, the body of the HTTP response contains the data points in the same format. To support selective retrieval of the datapoints, the endpoints provide filter options for each column of the datatype in question. The supported filter operators depend on the column datatype. A text value can only be compared for equality. For numerical types, the column can be filtered using a comparison value, with either an equality, greater than, or less than operator applied. To filter a range of values, both a greater than and a smaller than operator can be applied to the same column. The filters are passed to the API with the HTTP request query string.
2.5. Verification
To verify the accuracy and the data transmission reliability of the proposed inertial measurement system, several tests are carried out, which ensure that the set requirements are met and that correct measurement results are achieved. Verification includes a Battery Life Test, a Pendulum Test, and a Treadmill Test.
2.5.1. Battery Life Test
The goal of the Battery Life Test is to verify whether the battery-based power supply of the Sensor Boxes is sufficient for long-term recording. Sensor Boxes need to be able to record and transmit data over a complete day, at least 16 hours (cf. Section 1.3). For this purpose, two sensor modules are switched on and connected to a smartphone via the Bluetooth® Low Energy interface. This starts the data acquisition and the test. The smartphone is logged into the Cloud Server System and continuously delivers measurement data. Sensors remained stationary during the test. The sensor board has a supply voltage of 3.3 V. When the voltage drops below this threshold, the sensor is turned off, and the recording stops. This timepoint can be determined precisely because the data are recorded with absolute timestamps. The battery charge of the smartphone (in %) and the sensors (in V) are recorded regularly in a one-hour interval.
2.5.2. Pendulum Test
The goal of this test is to verify the EKF based observer algorithm and to determine the accuracy of SensAA (see Section 2.2.3). Two wearable Sensor Boxes are attached to the setup shown in
Figure 7. One Sensor Box is fixed along the vertical axis, while the other is mounted on a free-swinging pendulum. The angle α in the figure denotes the angle measured by the system. For this experiment, an optical MAS (LaiTronic GmbH, Innsbruck, Tirol, Austria, former Steinbichler) is used as reference for comparing the measurement data (cf. Section 1.2.1). The infrared markers are attached to the vertical axis and the far end of the pendulum. Therefore, the MAS measures the same angel as the wearable sensors. The sampling rate of the MAS must be configured for the test setup. The maximum sampling rate of the system is limited by the distance to the markers. Here, the MAS is set about three meters away from the test setup. In this configuration, a sampling rate of 220 Hz resulted in clean measurements of α.
2.5.3. Treadmill Test
With measurements on a treadmill the behavior of the sensor accuracy under real conditions when walking at different velocities is tested. The goal is to compare the angle progression measured by SensAA with that of MAS. The setup of the treadmill test is shown in
Figure 8.
The wearable Sensor Boxes are attached to a healthy subject’s thigh and shank of the right leg with elastic bandages. These are easy to put on and off and are adjustable to the thickness of the wearer’s leg.
As shown in
Figure 9, the infrared markers of the MAS are mounted centered on the Sensor Boxes. An additional marker is located at the rotation point of the knee joint to form a triangle with the markers on the thigh and the shank when the knee is flexed. From this triangle, the knee angle is calculated.
To perform the test, both SensAA and the MAS are started and the treadmill is initially set to 3 km/h walking speed. A dataset over at least one minute is recorded before the speed is gradually increased. The experiment was carried out three times at walking speeds of 3 km/h, 6 km/h, 9 km/h and 12 km/h. When the speed is increased to 12 km/h, the subject must change their gait from walking to jogging. This test serves as a system load test to evaluate how the quality of the knee angle progression performs at high speed.
The calculated data are transmitted via BLE and stored in the Cloud Server System as described in Sections 2.1, 2.3 and 2.4.
3. Results
3.1. Battery Life Test
The discharge curves of the Sensor Boxes batteries and the capacity estimation of the smartphone during the Battery Life Test are shown in
Figure 10 (see
Section 2.5.1). After approx. 26 hours of runtime the batteries dropped below the 3.3 V threshold, at which the sensor module can no longer be supplied, and the data recording stops. The discharge curves of the batteries show typical Li-Ion behavior. The smartphone's battery level is at 7 % after 20 hours. The battery was then recharged, but the data recording continued.
3.2. Pendulum Test
The result of the Pendulum Test (see
Section 2.5.2) is shown in
Figure 11. The graph shows the comparison of the measured angle obtained from the MAS and the proposed measurement system. The main metric used to quantify the comparison is the Euclidean distance between the two datasets, also referred to as the Root Mean Square Error (RMSE). To further evaluate the quality of the measurements, the difference of the angle curves and their mean value is calculated. For this purpose, the mean standard deviation is used, which reflects the average distance of all measured points from the mean value.
Table 1 summarizes the results.
3.3. Treadmill Test
To verify the wearable sensor data, the resulting knee angle signal is compared to the results of the MAS system. First, the offset in the time axis of both signals is determined and applied to the data. Then both datasets are interpolated onto the same sampling time points. Since the MAS system has a significantly higher sampling rate compared to SensAA, the time points of the wearable sensor data were used for interpolation.
Figure 12 shows both signals compared to each other. To quantify the comparison between the two datasets, the RMSE of SensAA in reference to the MAS was calculated. Additionally, the average, minimum, and maximum distance and the standard deviation between both signals were determined.
Table 2 shows the comparison results. The lowest RMSE value was measured for a speed of 3 km/h at 2.9°. For speeds of 6 and 9 km/h the RMSE is at 6.1° and 5.2°. The highest RMSE of 8.0°was reached at 12 km/h. The average deviation is below 5° at all four walking speeds and the standard deviation is between 1.6° and 6.7°.
Figure 13 shows the phases of the gait cycle at a speed of 12 km/h. At such speeds there are phases in which both feet no longer touch the ground and as a result the test person bounces off the ground. In the fifth sequence, it can be recognized that the knee angle experiences a significantly greater maximum in the swing phase compared to walking. Here, the maximum knee angle is between 80° and 90°, which can be seen from the knee angle curve in
Figure 12. For comparison, the maximum knee angle ranges between 60° and 70° during walking.
4. Discussion
In this paper SensAA is proposed, a low-cost, highly mobile biomechanical measurement system capable of measuring the angle of the knee joint based on Inertial Measurement Units. The system uses centralized cloud-hosted data storage and an Android smartphone to design a solution that is both inexpensive (see
Section 2.5) and easy to set up. With BLE as the wireless transmission protocol, a battery life of more than 24h was achieved. This result is well suited for long-term recordings. It should be mentioned that no other activities were performed on the smartphone during the test. No extensive screen time or other activities should be carried out on the smartphone during long-term recording.
The proposed system was first verified with a Pendulum Test. For angle measurement accuracy the RMSE of 3.5° and the standard deviation of 3.4° were achieved. This proves that the implemented observer algorithm can calculate the angle between two Sensor Boxes in the sagittal plane accurately.
The system was further tested with a Treadmill Test at different walking speeds. This test had the purpose of a first-time technical verification of the system on a human body. For this reason, only one participant took part in the measurements. The acquired results are dependent from the individual subject characteristics (e.g., age, gender, height) and do not give a reliable answer about the overall accuracy of the system. To achieve this information a higher number of participants is needed in the future. However, the presented results show, that SensAA is working in general and has the potential to reach one of the highest overall accuracies compared to other systems.
SensAA achieved an RMSE of 2.9° to 8° for walking speeds between 3 and 12 km/h. The results of walking at 3 km/h deviate less than those of most previous studies which report RMSE values between 3.2° and 5.9° [
16,
17,
18,
19,
24,
25,
28,
32]. These studies describe the walking activity during their measurement routine only as walking and do not give an exact speed. Therefore, no comparison of the measuring accuracy of the systems at the exact same speed can be made.
To our knowledge, only Robert-Lachaine et al. analyzed the motion of the human body at specified speeds [
27]. They investigated speeds from 0.6 to 1.2 m/s. At a speed of 0.8 m/s, which is about 3 km/h, the RMSE was 3.2°. Compared to this result SensAA achieved a smaller RMSE at the same walking speed.
Joukov et al. [
23] and Teufl et al. [
31] achieved lower errors with RMSE values of 2.5° and 2.38° to 2.65°. Joukov et al. [
23] proposed a system based on a Rhythmic Extended Kalman Filter, which considers the periodicity of movements when walking. This significantly improves the state estimation of a regular EKF algorithm. Teufl et al. [
31] achieved high accuracy by following an iterated extended Kalman filter approach. The inertial data were processed twice. First to obtain a converged estimate of the acceleration bias that was then used as initial guess for the second calculation [
31]. Compared to SensAA the downside of these two algorithms is the increased computing effort and runtime.
The RMSE values of SensAA increase with a higher walking speed. Other studies have experienced the same problem with increasing complexity of speed and increasing gait movement [
18,
24]. It should be noted that the error for the speed of 6 km/h (RMSE 6.1°) is greater than for 9 km/h (RMSE 5.2°), which is contrary to the expected trend. One explanation could be a slightly loose attachment of one Sensor Box during the 6 km/h run, which causes false sensor inclination calculations.
The higher increase in error compared to other studies might be caused by the way the Sensor Boxes are mounted. Sensors were not attached directly to the skin but to the participant’s pants. Fast walking leads to movement of the fabric, which could again result in inclination of the sensor and false calculations.
In order to achieve high accuracy for the measurement of joint angles using IMU sensors, Niswander et al. [
54] point out that the positioning of the sensors must be optimised. They compared different sensor positions and reached the lowest RMSE for knee angle with sensors positioned at the middle lateral shank and the lower anterior thigh [
54]. In addition to this sensor position, they also recommend the positioning which has been chosen for SensAA.
Another crucial aspect of MAS is the sensor calibration procedure [
18,
20,
55]. Di Raimondo et al. [
18] describe three possible types of IMU calibration: manual, static, and functional calibration. They propose a functional calibration method that integrates hip abduction-adduction motion, sit-to-stand, and walking movements. With this method, the RMSE could be reduced from 7.8°, with manual calibration, to 3.9°. SensAA is calibrated with a static method.
It must be considered that SensAA cannot be compared to a reliable ground truth. The optical reference system is also subject to errors. Teufl et al. [
31] showed that MAS based on optical markers can suffer from soft tissue artefacts (STA) when the markers are placed on anatomical landmarks (cp. [
21,
24,
28]). Teufl et al. [
31] achieved higher accuracy by using rigid marker clusters fixed on the thigh and shank with straps (RMSE reduction of up to 1.3°). For the Treadmill Test we attached two markers to the rigid Sensor Boxes, but one marker on the rotation axis of the knee. This marker might be affected by STA in addition to the fabric movement.
The measuring accuracy of SensAA could possibly be improved by optimising the sensor attachment, sensor positions, and the calibration method. However, SensAA shows viable performance for gait analysis purposes. Errors between 2° and 5° are considered clinically acceptable [
18]. This threshold was achieved by walking at 3 km/h. Speeds from 6 km/h to 12 km/h are rarely measured in everyday life situations, especially for elderly people [
56,
57].
At this point, SensAA has been tested in a laboratory. However, the tests conducted showed that the proposed toolchain of joint angle measuring, and cloud-based data storage works as desired. The system produces clinically acceptable results for knee joint angle measurements and is applicable for long-term observation in everyday life.
5. Conclusions and Outlook
In this paper, we introduce SensAA, a wearable cloud-based biomechanical data acquisition system. The system is verified for long-term measurements of the human knee joint angle. It uses low-cost commercially available components and open-source software. SensAA is an all-in-one solution which provides high accuracy, high usability, and high security.
While SensAA demonstrates promising performance, further optimizations are necessary to ensure consistent accuracy for walking speeds exceeding 3 km/h. Future plans include conducting a long-term study with human test subjects to validate the system's performance in real-world environments.
For future work, SensAA can be used to calculate realistic load collectives of the human leg and identify different walking activities. These measurements could be used for designing and controlling an active exoskeleton, which assists the user with ADLs like walking, climbing stairs, sitting down, and standing up.
The system is not limited to the knee joint and the lower limbs but can be used on the whole body. Additional Sensor Boxes could be used to examine other human joints simultaneously. SensAA can also be used not only for measuring joint angles, but also for measuring the acceleration and angular velocity of body parts.
SensAA provides a powerful, scalable platform for collecting and processing biomechanical data. Thanks to the cloud-based data storage solution, a large group of participants can be examined highly automated. This could help create an extensive database for human kinematics.
Author Contributions
Conceptualization and methodology, L.R., D.S., J.S. and M.G.; software, D.S. and J.S.; validation, L.R., D.S., J.S. and J.P.D.; formal analysis, L.R., D.S., J.S. and J.P.D.; resources, L.R, D.S, J.P.D., J.S., and M.G.; data curation, L.R., D.S. and J.P.D.; writing—original draft preparation, D.S., L.R. and J.P.D.; writing—review and editing, J.P.D. and M.G.; visualization, D.S, L.R. and J.P.D.; supervision, M.G.; project administration, J.P.D.; funding acquisition, J.P.D. and M.G. All authors have read and agreed to the published version of the manuscript.
Funding
Publication funded by Aalen University of Applied Sciences and Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) - 512645013.
Institutional Review Board Statement
The study was conducted in accordance with the Declaration of Helsinki. For the technical development, no ethical review and approval were obligatory.
Informed Consent Statement
Informed consent was obtained from all subjects involved in the study. Function tests and quantitative validations of several developments were performed by the authors.
Data Availability Statement
The data presented in this study are available on request from the corresponding author.
Conflicts of Interest
The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; nor in the writing of the manuscript, or in the decision to publish the results.
Abbreviations
The following abbreviations are used in this manuscript:
ADL |
Activities of Daily Living |
API |
Application Programming Interface |
BLE |
Bluetooth® Low Energy |
ECG |
Electrocardiography |
EIT |
Electrical Impedance Tomography |
EKF |
Extended Kalman Filter |
EMG |
Electromyography |
GATT |
Generic Attribute Profile |
GRF |
Ground Reaction Force |
HTTP |
Hypertext Transfer Protocol |
HTTPS |
Hypertext Transfer Protocol Secure |
IMU |
Inertial Measurement Unit |
IP |
Internet Protocol |
JSON |
Java Script Object Notation |
LDO |
Low Drop-Out Voltage-Regulator |
LiPo |
Lithium Polymer |
LTE |
Long Term Evolution |
MAS |
Motion Analysis System |
MEMS |
Micro-Electro-Mechanical Systems |
OLED |
Organic Light Emitting Diode |
OPD |
Organic Photo Diode |
PCB |
Printed Circuit Board |
RMS |
Root Mean Squared |
RMSE |
Root Mean Squared Error |
STA |
Soft Tissue Artifacts |
SQL |
Structured Query Language |
TLS |
Transport Layer Security |
USB |
Universal Serial Bus |
References
- Pirker, W.; Katzenschlager, R. Gait disorders in adults and the elderly : A clinical guide. Wiener Klinische Wochenschrift 2017, 129, 81–95. [Google Scholar] [CrossRef]
- Mahlknecht, P.; Kiechl, S.; Bloem, B.R.; Willeit, J.; Scherfler, C.; Gasperi, A.; Rungger, G.; Poewe, W.; Seppi, K. Prevalence and burden of gait disorders in elderly men and women aged 60-97 years: a population-based study. PLoS ONE 2013, 8, e69627. [Google Scholar] [CrossRef]
- Meda-Gutiérrez, J.R.; Zúñiga-Avilés, L.A.; Vilchis-González, A.H.; Ávila-Vilchis, J.C. Knee Exoskeletons Design Approaches to Boost Strength Capability: A Review. Applied Sciences 2021, 11, 9990. [Google Scholar] [CrossRef]
- Nesler, C.; Thomas, G.; Divekar, N.; Rouse, E.J.; Gregg, R.D. Enhancing Voluntary Motion with Modular, Backdrivable, Powered Hip and Knee Orthoses. IEEE Robot. Autom. Lett. 2022, 7, 6155–6162. [Google Scholar] [CrossRef]
- Toxiri, S.; Calanca, A.; Poliero, T.; Caldwell, D.G.; Ortiz, J. Actuation Requirements for Assistive Exoskeletons: Exploiting Knowledge of Task Dynamics. In Wearable Robotics: Challenges and Trends, Proceedings of the 4th International Symposium on Wearable Robotics, WeRob2018, October 16-20, 2018, Pisa, Italy.; International Symposium on Wearable Robotics; Carrozza, M.C., Micera, S., Pons, J.L., Carrozza, M.C., Eds.; Springer International Publishing: Cham, 2019; pp. 381–385. ISBN 978-3-030-01887-0. [Google Scholar]
- Wearable Robotics: Challenges and Trends: Proceedings of the 4th International Symposium on Wearable Robotics, WeRob2018, October 16-20, 2018, Pisa, Italy. Carrozza, M.C.; Micera, S.; Pons, J.L.; Carrozza, M.C., Eds., 1st ed. 2019. International Symposium on Wearable Robotics; Springer International Publishing: Cham, 2019.
- Arazpour, M.; Bani, M.A.; Hutchins, S.W. Reciprocal gait orthoses and powered gait orthoses for walking by spinal cord injury patients. Prosthet. Orthot. Int. 2013, 37, 14–21. [Google Scholar] [CrossRef]
- Contreras-Vidal, J.L.; A Bhagat, N.; Brantley, J.; Cruz-Garza, J.G.; He, Y.; Manley, Q.; Nakagome, S.; Nathan, K.; Tan, S.H.; Zhu, F.; et al. Powered exoskeletons for bipedal locomotion after spinal cord injury. J. Neural Eng. 2016, 13, 31001. [Google Scholar] [CrossRef]
- Alqahtani, M.S.; Al-Tamimi, A.; Almeida, H.; Cooper, G.; Bartolo, P. A review on the use of additive manufacturing to produce lower limb orthoses. Prog Addit Manuf 2020, 5, 85–94. [Google Scholar] [CrossRef]
- Tarbit, J.; Hartley, N.; Previte, J. Exoskeletons at your service: a multi-disciplinary structured literature review. JSM 2023, 37, 313–339. [Google Scholar] [CrossRef]
- Yan, T.; Cempini, M.; Oddo, C.M.; Vitiello, N. Review of assistive strategies in powered lower-limb orthoses and exoskeletons. Robotics and Autonomous Systems 2015, 64, 120–136. [Google Scholar] [CrossRef]
- Willwacher, S.; Robbin, J.; Eßer, T.; Mai, P. Bewegungsanalysesysteme in der Forschung und für niedergelassene Orthopädinnen und Orthopäden. Orthopadie (Heidelb) 2023, 52, 610–617. [Google Scholar] [CrossRef]
- Riener, R.; Rabuffetti, M.; Frigo, C. Stair ascent and descent at different inclinations. Gait & Posture 2002, 15, 32–44. [Google Scholar] [CrossRef]
- Laudanski, A.; Brouwer, B.; Li, Q. Measurement of lower limb joint kinematics using inertial sensors during stair ascent and descent in healthy older adults and stroke survivors. Journal of Healthcare Engineering 2013, 4, 555–576. [Google Scholar] [CrossRef]
- Brinckmann, P. Orthopädische Biomechanik: Mit 23 Tabellen; mit einem Verzeichnis der Fachausdrücke der Orthopädischen Biomechanik Englisch-Deutsch, 2., erw. Aufl; Monsenstein und Vannerdat: Münster, 2012; ISBN 978-3-8405-0059-6. [Google Scholar]
- Carcreff, L.; Payen, G.; Grouvel, G.; Massé, F.; Armand, S. Three-Dimensional Lower-Limb Kinematics from Accelerometers and Gyroscopes with Simple and Minimal Functional Calibration Tasks: Validation on Asymptomatic Participants. Sensors (Basel) 2022, 22. [Google Scholar] [CrossRef]
- Cerfoglio, S.; Capodaglio, P.; Rossi, P.; Conforti, I.; D'Angeli, V.; Milani, E.; Galli, M.; Cimolin, V. Evaluation of Upper Body and Lower Limbs Kinematics through an IMU-Based Medical System: A Comparative Study with the Optoelectronic System. Sensors 2023, 23, 6156. [Google Scholar] [CrossRef]
- Di Raimondo, G.; Vanwanseele, B.; van der Have, A.; Emmerzaal, J.; Willems, M.; Killen, B.A.; Jonkers, I. Inertial Sensor-to-Segment Calibration for Accurate 3D Joint Angle Calculation for Use in OpenSim. Sensors (Basel) 2022, 22. [Google Scholar] [CrossRef]
- Dorschky, E.; Nitschke, M.; Seifer, A.-K.; van den Bogert, A.J.; Eskofier, B.M. Estimation of gait kinematics and kinetics from inertial sensor data using optimal control of musculoskeletal models. Journal of Biomechanics 2019, 95, 109278. [Google Scholar] [CrossRef]
- Favre, J.; Aissaoui, R.; Jolles, B.M.; Guise, J.A. de; Aminian, K. Functional calibration procedure for 3D knee joint angle description using inertial sensors. Journal of Biomechanics 2009, 42, 2330–2335. [Google Scholar] [CrossRef]
- Finco, M.G.; Patterson, R.M.; Moudy, S.C. A pilot case series for concurrent validation of inertial measurement units to motion capture in individuals who use unilateral lower-limb prostheses. J. Rehabil. Assist. Technol. Eng. 2023, 10, 1–13. [Google Scholar] [CrossRef]
- Gard, S.A.P. Use of Quantitative Gait Analysis for the Evaluation of Prosthetic Walking Performance. JPO Journal of Prosthetics and Orthotics 2006, 93–104. [Google Scholar] [CrossRef]
- Joukov, V.; Bonnet, V.; Karg, M.; Venture, G.; Kulic, D. Rhythmic Extended Kalman Filter for Gait Rehabilitation Motion Estimation and Segmentation. IEEE Trans. Neural Syst. Rehabil. Eng. 2018, 26, 407–418. [Google Scholar] [CrossRef]
- Lebleu, J.; Gosseye, T.; Detrembleur, C.; Mahaudens, P.; Cartiaux, O.; Penta, M. Lower Limb Kinematics Using Inertial Sensors during Locomotion: Accuracy and Reproducibility of Joint Angle Calculations with Different Sensor-to-Segment Calibrations. Sensors (Basel) 2020, 20. [Google Scholar] [CrossRef]
- Lora-Millan, J.S.; Hidalgo, A.F.; Rocon, E. An IMUs-Based Extended Kalman Filter to Estimate Gait Lower Limb Sagittal Kinematics for the Control of Wearable Robotic Devices. IEEE Access 2021, 9, 144540–144554. [Google Scholar] [CrossRef]
- Poitras, I.; Dupuis, F.; Bielmann, M.; Campeau-Lecours, A.; Mercier, C.; Bouyer, L.J.; Roy, J.-S. Validity and Reliability of Wearable Sensors for Joint Angle Estimation: A Systematic Review. Sensors 2019, 19, 1555. [Google Scholar] [CrossRef]
- Robert-Lachaine, X.; Parent, G.; Fuentes, A.; Hagemeister, N.; Aissaoui, R. Inertial motion capture validation of 3D knee kinematics at various gait speed on the treadmill with a double-pose calibration. Gait & Posture 2020, 77, 132–137. [Google Scholar] [CrossRef]
- Seel, T.; Raisch, J.; Schauer, T. IMU-based joint angle measurement for gait analysis. Sensors 2014, 14, 6891–6909. [Google Scholar] [CrossRef]
- Shull, P.B.; Jirattigalachote, W.; Hunt, M.A.; Cutkosky, M.R.; Delp, S.L. Quantified self and human movement: a review on the clinical impact of wearable sensing and feedback for gait analysis and intervention. Gait & Posture 2014, 40, 11–19. [Google Scholar] [CrossRef]
- Storm, F.A.; Cesareo, A.; Reni, G.; Biffi, E. Wearable Inertial Sensors to Assess Gait during the 6-Minute Walk Test: A Systematic Review. Sensors 2020, 20, 2660. [Google Scholar] [CrossRef]
- Teufl, W.; Miezal, M.; Taetz, B.; Fröhlich, M.; Bleser, G. Validity, Test-Retest Reliability and Long-Term Stability of Magnetometer Free Inertial Sensor Based 3D Joint Kinematics. Sensors 2018, 18, 1980. [Google Scholar] [CrossRef]
- Weygers, I.; Kok, M.; Konings, M.; Hallez, H.; Vroey, H. de; Claeys, K. Inertial Sensor-Based Lower Limb Joint Kinematics: A Methodological Systematic Review. Sensors 2020, 20, 673. [Google Scholar] [CrossRef]
- Cloete, T.; Scheffer, C. Benchmarking of a full-body inertial motion capture system for clinical gait analysis. In 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Vancouver, BC, Canada, 21-22 August, 2008; pp 4579–4582.
- X. Robert-Lachaine; H. Mecheri; A. Muller; C. Larue; A. Plamondon. Validation of a low-cost inertial motion capture system for whole-body motion analysis. Journal of Biomechanics 2020, 99, 109520. [Google Scholar] [CrossRef]
- Iman, P.; Doik, K. Design and implementation of IMU-based human arm motion capture system. In 2012 IEEE International Conference on Mechatronics and Automation, Chengdu, China, 5-8 August, 2012; pp 670–675.
- Hamdi Mohammed, M.; Awad Mohammed, I.; Abdelhameed Magdy, M.; Tolbah Farid, A. Lower limb motion tracking using IMU sensor network. In 2014 Cairo International Biomedical Engineering Conference (CIBEC), Giza, Egypt, 11-13 December, 2014; pp 28–33.
- Zihajehzadeh, S.; Park, E.J. A Novel Biomechanical Model-Aided IMU/UWB Fusion for Magnetometer-Free Lower Body Motion Capture. IEEE Trans. Syst. Man Cybern, Syst. 2017, 47, 927–938. [Google Scholar] [CrossRef]
- Stetter, B.J.; Krafft, F.C.; Ringhof, S.; Stein, T.; Sell, S. A Machine Learning and Wearable Sensor Based Approach to Estimate External Knee Flexion and Adduction Moments During Various Locomotion Tasks. Front. Bioeng. Biotechnol. 2020, 8, 9. [Google Scholar] [CrossRef]
- Gonzales-Huisa, O.A.; Oshiro, G.; Abarca, V.E.; Chavez-Echajaya, J.G.; Elias, D.A. EMG and IMU Data Fusion for Locomotion Mode Classification in Transtibial Amputees. Prosthesis 2023, 5, 1232–1256. [Google Scholar] [CrossRef]
- Zhang, Y.; Ma, Z.; Zuo, S.; Liu, J. Gait Prediction and Assist Control of Lower Limb Exoskeleton Based on Inertia Measurement Unit. In 2022 5th International Conference on Intelligent Robotics and Control Engineering (IRCE). 2022 5th International Conference on Intelligent Robotics and Control Engineering (IRCE), Tianjin, China, 23–25 Sep. 2022; IEEE, 2022; pp 44–49, ISBN 978-1-6654-6995-1.
- Gao, F.; Liu, G.; Liang, F.; Liao, W.-H. IMU-Based Locomotion Mode Identification for Transtibial Prostheses, Orthoses, and Exoskeletons. IEEE Trans. Neural Syst. Rehabil. Eng. 2020, 28, 1334–1343. [Google Scholar] [CrossRef]
- Jasiewicz, J.M.; Allum, J.H.J.; Middleton, J.W.; Barriskill, A.; Condie, P.; Purcell, B.; Li, R.C.T. Gait event detection using linear accelerometers or angular velocity transducers in able-bodied and spinal-cord injured individuals. Gait & Posture 2006, 24, 502–509. [Google Scholar] [CrossRef]
- CHONG Yu Zheng; Z. Y. WONG; A. J. ISHAK; S. A. AHMAD. Mechanical analysis of wearable lower limb exoskeleton for rehabilitation. Journal of Engineering Science and Technology 2014, 9, 107. [Google Scholar]
- Benson, L.C.; Räisänen, A.M.; Clermont, C.A.; Ferber, R. Is This the Real Life, or Is This Just Laboratory? A Scoping Review of IMU-Based Running Gait Analysis. Sensors (Basel) 2022, 22. [Google Scholar] [CrossRef]
- O'Reilly, M.; Caulfield, B.; Ward, T.; Johnston, W.; Doherty, C. Wearable Inertial Sensor Systems for Lower Limb Exercise Detection and Evaluation: A Systematic Review. Sports Med. 2018, 48, 1221–1246. [Google Scholar] [CrossRef]
- Robert-Lachaine, X.; Mecheri, H.; Larue, C.; Plamondon, A. Validation of inertial measurement units with an optoelectronic system for whole-body motion analysis. Med. Biol. Eng. Comput. 2017, 55, 609–619. [Google Scholar] [CrossRef]
- Amin, J.; Ruthiraphong, P. Cloud-based Gait Analysis Using a Single IMU for Parkinson Disease. In 2021 18th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON). 2021 18th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON), Chiang Mai, Thailand, 19–22 May 2021; IEEE, 2021; pp 1129–1132, ISBN 978-1-6654-0382-5.
- Al Borno, M.; O'Day, J.; Ibarra, V.; Dunne, J.; Seth, A.; Habib, A.; Ong, C.; Hicks, J.; Uhlrich, S.; Delp, S. OpenSense: An open-source toolbox for inertial-measurement-unit-based measurement of lower extremity kinematics over long durations. J. Neuroeng. Rehabil. 2022, 19, 22. [Google Scholar] [CrossRef]
- ST Microelectronics. STEVAL-STLCS02V1 - Data brief. Available online: https://www.st.com/resource/en/data_brief/steval-stlcs02v1.pdf (accessed on 1 December 2022).
- ST Microelectronics. LSM6DSM - iNEMO inertial module: always-on 3D accelerometer and 3D gyroscope. Available online: https://www.st.com/resource/en/datasheet/lsm6dsm.pdf (accessed on 1 December 2022).
- Adafruit Industries. Adafruit Micro-Lipo Charger for LiPo/LiIon Batt w/MicroUSB Jack. Available online: https://www.adafruit.com/product/1904 (accessed on 27 December 2023).
- Pachi, A.; Ji, T. Frequency and velocity of people walking; London, UK, 2005.
- Karampour, H.; Piran, F.; Faircloth, A.; Talebian, N.; Miller, D. Vibration of Timber and Hybrid Floors: A Review of Methods of Measurement, Analysis, and Design. Buildings 2023, 13, 1756. [Google Scholar] [CrossRef]
- Niswander, W.; Wang, W.; Kontson, K. Optimization of IMU Sensor Placement for the Measurement of Lower Limb Joint Kinematics. Sensors 2020, 20, 5993. [Google Scholar] [CrossRef]
- Pacher, L.; Chatellier, C.; Vauzelle, R.; Fradet, L. Comparison of lower limb calibration methods for movement analysis with inertial measurement unit (IMU). Computer Methods in Biomechanics and Biomedical Engineering 2020, 23, S215–S217. [Google Scholar] [CrossRef]
- Prakash, C.; Kumar, R.; Mittal, N. Recent developments in human gait research: parameters, approaches, applications, machine learning techniques, datasets and challenges. Artif Intell Rev 2018, 49, 1–40. [Google Scholar] [CrossRef]
- Kramers-De Quervain, I.A.; Stüssi, E.; Stacoff, A. Ganganalyse beim Gehen und Laufen. Schweizerische Zeitschrift für Sportmedizin und Sporttraumatologie 2008, 56, 35–42. [Google Scholar]
Figure 1.
System Overview of SensAA.
Figure 1.
System Overview of SensAA.
Figure 2.
System Architecture of SensAA.
Figure 2.
System Architecture of SensAA.
Figure 3.
Electronic structure of SensAA.
Figure 3.
Electronic structure of SensAA.
Figure 4.
3D-printed Sensor Box; left: bottom half, right: top half.
Figure 4.
3D-printed Sensor Box; left: bottom half, right: top half.
Figure 5.
Sensor State Machine of the sensor firmware of SensAA.
Figure 5.
Sensor State Machine of the sensor firmware of SensAA.
Figure 6.
Architecture of the SensAA Cloud Server System.
Figure 6.
Architecture of the SensAA Cloud Server System.
Figure 7.
Pendulum Test setup with marked angle α and two Sensor Boxes. Sensor Box 1 is fixed on a stationary vertical axis, and Sensor Box 2 is mounted on a free-swinging pendulum. Both the axis and pendulum are marked with infrared markers to measure α with an optical MAS simultaneously.
Figure 7.
Pendulum Test setup with marked angle α and two Sensor Boxes. Sensor Box 1 is fixed on a stationary vertical axis, and Sensor Box 2 is mounted on a free-swinging pendulum. Both the axis and pendulum are marked with infrared markers to measure α with an optical MAS simultaneously.
Figure 8.
Treadmill Test setup with optical MAS positioned three meters away from the treadmill.
Figure 8.
Treadmill Test setup with optical MAS positioned three meters away from the treadmill.
Figure 9.
Sensor Boxes attached with bandages to the thigh and shank of the right leg. Additionally, three infrared markers for an optical MAS are attached to the leg. They form a triangle that covers the angle α of the knee joint.
Figure 9.
Sensor Boxes attached with bandages to the thigh and shank of the right leg. Additionally, three infrared markers for an optical MAS are attached to the leg. They form a triangle that covers the angle α of the knee joint.
Figure 10.
Discharge curves of the batteries of the sensor modules at the shank and thigh and the smartphone.
Figure 10.
Discharge curves of the batteries of the sensor modules at the shank and thigh and the smartphone.
Figure 11.
Results of the Pendulum Test; Knee joint angle of the IMU sensors of SensAA in comparison to reference MAS.
Figure 11.
Results of the Pendulum Test; Knee joint angle of the IMU sensors of SensAA in comparison to reference MAS.
Figure 12.
Comparison of the knee angle measured by IMU sensors of SensAA and reference MAS on treadmill at a) 3 km/h, b) 6 km/h, c) 9 km/h and d) 12 km/h walking speed.
Figure 12.
Comparison of the knee angle measured by IMU sensors of SensAA and reference MAS on treadmill at a) 3 km/h, b) 6 km/h, c) 9 km/h and d) 12 km/h walking speed.
Figure 13.
Gait cycle on the treadmill at 12 km/h.
Figure 13.
Gait cycle on the treadmill at 12 km/h.
Table 1.
Pendulum Test results, angle difference between SensAA and reference MAS.
Table 1.
Pendulum Test results, angle difference between SensAA and reference MAS.
RMSE |
Standard deviation |
Average Difference |
3.5° |
3.4° |
2.3° |
Table 2.
Verification Results of the Treadmill Tests, from 3 km / h up to 12 km/h.
Table 2.
Verification Results of the Treadmill Tests, from 3 km / h up to 12 km/h.
Walking Speed |
RMSE |
Standard deviation |
Difference |
Average |
Minimum |
Maximum |
3 km/h |
2.9° |
1.6° |
2.4° |
-3.0° |
7.0° |
6 km/h |
6.1° |
5.1° |
3.4° |
-11.1° |
18.2° |
9 km/h |
5.2° |
5.1° |
1,0° |
-10.1° |
16.3° |
12 km/h |
8.0° |
6.7° |
4.3° |
-11.9° |
24.2° |
|
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).