1. Introduction
From the pioneering work of Hans Berger that recorded the first human electroencephalographic signal (EEG) in 1924 [
1], the research devoted to detecting and analyzing brain waves has increased exponentially over the years, especially in medical contexts for both diagnostic and health care applications.
The automatic recognition and interpretation of brain waves permit the development of systems that allow subjects to interact and control devices through brain signals and thus provide new forms for human-machine interactions through systems called Brain Computer Interfaces (BCIs).
Several applications have been developed, especially for assistive and rehabilitative purposes [
2].
However, in the last decades, the rapid development of neurotechnologies, particularly wearable devices, has opened new perspectives and applications outside the medical field, including education, entertainment, civil, industrial, and military fields [
3]. Among the different BCI paradigms, Motor Imagery (MI) deserves particular attention, having that it can be used for a variety of applications and knowing that the research community has achieved promising results in terms of performances [
4].
Starting from these premises, this paper systematically reviews EEG-based MI-BCIs by following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) suggestions [
5].
The main research question of this review paper is:
To properly answer this question, four different sub-questions are considered here:
RQ1: Is there a significant amount of EEG-based MI-BCI studies using wearable technologies in the literature that implies a promising future development of this research field, especially in uncontrolled environments and outside the medical and clinical settings?
RQ2: Are there common pipelines of processing that can be adopted from signal acquisition to feedback generation?
RQ3: Are there consolidated experimental paradigms for wearable EEG-based MI-BCI applications?
RQ4: Are there datasets available for the research community to properly compare classification models and data analysis?
To face these questions, the work is structured as follows.
Section 2 describes how the 84 papers for the proposed systematic review have been selected, following the PRISMA suggestions.
Section 3 reports basic knowledge concepts of electroencephalographic signals, brain computer interfaces, motor imagery and wearable technologies, to provide a proper background for the comprehension of the next sections. To properly identify the contribution of this work, an overview of other survey articles present in the literature and concerning BCI systems is reported in
Section 4.
Section 5 is the core of this review paper, reporting systematically the motor imagery brain computer interface wearable systems found in the state of the art, in terms of applications, and employed technologies. A detailed description of signal processing, feature engineering, and classification and data analysis is also reported, together with the description of all the datasets and experimental paradigms adopted. A particular attention has been given in some sections to those papers that can be reproducible, either because the analyzed dataset is available, or because the computational models adopted are described with proper technical details. All information gathered from the 84 publications considered will be made available as supplementary material, organized in a detailed table (EEG-MI-BCI-Table).
Finally, the answers to the presented research questions have been provided in
Section 6, taking into consideration the detailed analyses on the different aspects discussed in the previous sections.
4. Overview of survey articles on EEG-based BCIs
In this section, an overview of survey articles present in the literature and concerning BCI systems is reported to provide a general assessment of the topics related but not superimposed to the target of the present paper.
In fact, most of the analyzed surveys address different application research areas and experimental paradigms. None of them focus exclusively on MI tasks, except the works by
Palumbo et al. (2021) [
74], who consider MI tasks in the sole field of wheelchair control, and the review study by
Al-Saegh et al. (2021) [
4], that concerns the use of deep neural network in the context of MI EEG-based BCIs.
In particular
Palumbo et al. [
74] provide a systematic survey of EEG-based BCIs for wheelchair control through motor imagination by including 16 papers published since 2010. The authors focused on (i) the MI paradigms and the type of commands provided to move the wheelchair, (ii) the employed EEG system (presenting sensors for other biomedical signal recording and the number of positioned electrodes) and the wheelchair components, and (iii) the EEG signal management procedures. The authors want to especially provide a clear assessment of the limitations of current biomedical devices when the end-user is affected by any kind of motor disability. Moreover, they point out the main challenges arising when having to face the development of an efficient and reliable BCI to control a wheelchair. Firstly, multiple commands are required to allow a correct control of the wheelchair, and thus a multi-objective problem characterizes the system. However, adding more commands may affect the performance of the BCI both in terms of accuracy and time-consumption. Secondly, the BCI performance is ultimately dependent from the user, who may fail to perform the MI tasks. Finally, the wheelchair control requires a constant concentration on the task and thus increases the users’ mental workload.
Considering instead the work of
Al-Saegh et al. [
4], the use of deep neural network in the context of EEG-based MI-BCIs is surveyed. The authors retrieved 40 papers published between January 1, 2015 and March 31, 2020. An analysis of the employed datasets has been performed and the authors find information of 15 datasets of which 7 are publicly available. They notice that they vary significantly in terms of electrodes, subjects, number of MI tasks and trials. However, most of the datasets seem to rely on experimental paradigms concerning the MI of right/left hand, feet and tongue. Moreover, the authors provide an assessment of the most used frequency ranges, extracted features, deep network architectures and input formulations, highlighting the variety of Deep Learning (DL) model designs.
In what follows, the review articles are reported according to their topics (experimental paradigms and applications, technological aspects, signal processing and analyses) and in chronological order of publication.
Considering experimental paradigms and applications, a comprehensive survey of different BCI experimental paradigms can be found in [
75], published in 2019.
A general survey on EEG technologies and their application is instead presented by
Soufineyestani et al. [
63] (2020).
Moving to the technological aspects, a brief review on wearable technologies for smart environments is presented in [
76] where the authors dedicate two sections on devices and applications for BCI systems. Considering these last topics, the technologies available at the time of the review (2016) are precisely listed and advancements of the EEG devices are easily detectable, especially considering the use of dry sensors and the presence of products for the general public. These information provide a good starting point to compare wearable technologies.
Instead, a detailed overview of the hardware components of wearable EEG-devices is provided by [
66] in 2019.
The survey by
TajDini et al. [
77] (2020) focuses on wireless sensors and in particular on the assessment of consumer-grade EEG devices for non-medical research. The authors compare 18 products in terms of sensor type (dry, wet, semi-dry), number of channels, sampling rate, accessibility to raw data, operation time and price. The analysis of the literature is explored based on the different application domains: cognition (emotion recognition and classification, attention, mental workload, memory), BCI (ERP, SSVEP, MI and other), educational research and gaming.
The review by
Portillo-Lara et al. [
78] (2021) starts from an overview of the neurophysiological mechanisms that underlie the generation of EEG signals and then focuses on the state-of-the-art technologies and applications of EEG-based BCIs. Different electrode interfaces and EEG platforms are analyzed and compared in terms of electrode type and density, functionality, portability, and device performance. The advantages and disadvantages of different electrode designs are enumerated. The technical specification of 18 commercially available EEG platforms are also compared in terms of electrodes, channel count, sampling rate, weight, battery life, resolution, and price. Both medical and non medical uses are reviewed in the article.
Instead, the review by
Jamil et al. [
79], in 2021, aims to identify the main application areas that use EEG-based BCI devices and the most common types of EEG-based equipment, considering both wired and wireless devices. They present a systematic review using four search engines (PubMed, IEEE, Scopus, and ScienceDirect). The search strings used were
(BCI OR Brain–computer interface OR BMI OR brain–machine interface) AND (EEG OR electroencephalogram) AND (rehab* OR assist* OR adapt*). The inclusion criteria were limited to publication years 2016-2020. After screening, 238 articles were selected and classified according to the following four research areas: education, engineering, entertainment, and medicine. They found that the medical area is the most frequently used (80%). Wired devices were used in the studies by 121/238 articles, while the remaining 117 reviewed manuscripts using wireless technologies.
Concerning signal processing and analyses, the feature extraction techniques widely used in the literature are reviewed in 2019 by
Aggarwal et al. [
43]. Moreover, a survey on EEG data collection and management (processing, feature exaction and classification) by considering 48 papers from high-impact journals is provided in 2021 by
Reaves et al. [
40]. The authors also include lists of devices and publicly available datasets.
A comprehensive review is presented by
Gu et al. [
80] in 2021. The authors provide a broad overview on BCI systems and their application areas. Moreover, they make a general presentation of invasive, partially and non-invasive brain imaging techniques and subsequently focus on EEG-based BCIs. Their review is organized to provide a consistent survey on (i) advances in sensors/sensing technologies, (ii) signal enhancement and real-time processing, (iii) machine learning (especially transfer learning and fuzzy models) and deep learning algorithms for BCI applications, and (iv) evolution of healthcare systems and applications in BCIs (e.g., concerning epilepsy, Parkinson’s/Alzheimer’s disease, and neurorehabilitation). Their analysis was performed on about 200 papers, considering publication years between 2015 and 2019.
6. Discussion
In this systematic review, 84 papers published in the last ten years have been deeply analyzed with the aim of answering the following main research question:
However, several aspects should be considered to properly address this point and thus 4 sub-questions have been defined, as introduced in
Section 1.
Important conclusions can be drawn to answer the first research sub-question
By analyzing the results obtained through the extensive search initially performed considering different EEG, MI, BCI related keyword combinations (
Section 2.3) and detailed in
Table 2, and the final paper pool identified through the PRISMA flow (
Figure 1).
In fact, according to the results reported in
Table 2 the MI paradigm is particularly used in the EEG domain. About 26% of the works retrieved by considering only the EEG-based BCI keywords present MI paradigms, while only the 0.71% present the use of wearable technologies for MI experiments.
Considering the timeline of the final filtered publications (
Figure 2), most of the reviewed works have been published between 2019 and 2020, denoting the relatively new interest in wearable devices and a recent increase in the availability of these technologies to the EEG community.
Notice that around 20 different devices (
Section 5.2) have been adopted in the applications reported by the 84 papers here analyzed, with different spatial resolutions (from 1 to 64 electrodes) and characteristics. This huge number of tools and variety of technical properties denote the increasing interest in this technology but make it difficult to qualitatively compare them.
Research directions have been clearly paved to provide new EEG-based MI-BCI wearable solutions with the aim of being employed for applications in heterogeneous and real-life environments.
One-third of the applications found in the reviewed literature are related to rehabilitation and assistive purposes, where the feedback of the systems plays a significant role in controlling external devices. Nearly 25% of the reviewed papers focus on methodological testing, presenting either new frameworks or particular signal processing and analysis techniques. Several works (15%) describe BCI applications developed in the entertainment field, while nearly 17% of contributions address the evaluation of new technical solutions and paradigm proposals.
Therefore, uncontrolled environments have been scrutinized by researchers to propose new EEG-based MI-BCIs wearable solutions.
Another interesting datum on the research production of the last ten years regards the development and study of BCI life-cycle pipelines, which concerns the second sub-question
Data acquisition, signal preprocessing, feature engineering and channel selection, data classification and analyses, as well as feedback modalities of the 84 papers here considered, have been extensively analyzed in this review and synthesized in
Section 5, and in particular in
Table 5 and
Figure 6. To summarize this analysis and answer RQ2, we observe that a first crucial point especially using wireless technologies and wearable devices is related to noise removal. To address this point, considering both internal and external noise sources, preprocessing algorithms can benefit of the knowledge on the frequencies of both the artifacts to be removed and the rhythms that should be preserved. However noise and signal frequencies often interfere.
Three main approaches can be identified, namely the use of blind source separation techniques, filters in the frequency domain and spatial filters. The first approach usually presents the application of ICA, which separate a mixed signal into different components, assuming the presence of different signal sources. The second type of preprocessing relies on filters in the frequency domain, especially Butterworth filters, to select the brain rhythms of interest and at the same time remove noise. The last type of approach, applies spatial filtering, like CAR filtering, taking into account the spatial correlation of the brain waves.
Even if a unique strategy is not adopted by all the applications, the noise removal procedures are quite similar among the considered publications.
For what concerns the feature engineering steps (which usually comes after the preprocessing one), the variability among different papers is relatively low. In general the ERD/ERS phenomenon is widely studied considering and rhythms, exploiting time, frequency and time-frequency handcrafted features. Only in recent years deep learning methods have begun to be used to automatically extract features from the raw signals.
Moreover, working with wearable devices and potentially in uncontrolled environments with low computational power, the reduction of data dimensionality is particularly important, especially considering the need for a low number of input data to be considered in a classification task. To this end, besides traditional feature reduction and feature selection strategies, a good number of works focuses only on specific channels that are usually chosen among the central cortical area, which is coherent with the neuroscientific literature on MI.
The last processing step represented by data analysis and classification, appears to be more heterogeneous in respect to the other ones, as depicted in
Figure 6. In particular, regarding models to perform different classification tasks, most of the works (about 54%) rely on traditional machine learning techniques, especially LDA and SVM, about 10% adopt ensemble techniques, transfer learning models or other supervised learning approaches while only 15% of them adopt deep learning strategies. It is also worth noting that 21% of the works do not face classification problems, but present statistical analysis, quality assessment and functional connectivity studies.
From these considerations, we can then conclude that there is a low variability in the initial steps of the whole BCI life cycle, while for what concerns data analysis and classification a higher variability can be identified. In particular the adoption of deep learning models is at its early stage, and it is not outstanding with respect to traditional machine learning strategies.
A clear comparison and assessment of the efficacy of different classification models would benefit from the application of these strategies on data acquired using a similar experimental paradigm or on benchmark datasets.
This observation is strictly related to RQ3 and RQ4 sub-question answering. Starting from the third sub-question
Notice that the experimental paradigm adopted by most of the considered works (39 out of 84) concerns MI of left/right hand/fist movement. However a high number of different types of other MI paradigms are considered: single hand/both hands, foot/feet or tongue movement, shoulder flexion, extension and abduction, motion of upper/lower limbs, pedalling, game character/robot/machinery movement control or generic motor intention and even the imagination of cognitive tasks. Moreover, single task duration, task order, administration modality, and experimental settings are also very heterogeneous.
From this variety of MI paradigms, several datasets have been collected or employed by the authors of the reviewed papers allowing to answer the last research sub-question
Considering data acquisition, 79 out of 84 works collect their own dataset, involving in most of the cases (76%) less then 10 subjects. In particular, about 49% of these 79 works, consider less then 5 participants. Notice that only 7 proprietary datasets are available upon request.
Moreover, among all the publicly available datasets reported in
Table 6 and that can be considered as benchmarks, only one is acquired using wearable devices [
109].
Among the 84 papers considered, only 9 adopted these benchmark datasets to evaluate the proposed models, of which 8 employed the third parties datasets acquired using wired systems.
Notice also that even if the same benchmark dataset is adopted, the classification tasks may vary from different types of binary classification: one-vs-one (for instance, left versus right hand) or one-vs-rest (for example right hand imagined movement versus resting state), and multiclass classification, with a range between 3 and 5 classes. Classification models and their performance as well as other types of analysis are reported in
Table 5 only for those works (13 out of 84) that present results either on benchmark datasets or on available proprietary ones, making the proposed analysis reproducible. As a final important note, among these 13 publications, only five declare to perform online analysis.
Considering the answers to the provided sub-questions, the main research question concerning the maturity of EEG-based MI-BCI applications in uncontrolled environments can be addressed.
Having a closer look at the applications reported by the reviewed papers, it seems that most of them pertain to the medical and rehabilitation fields and are mostly employed in controlled environments. However, the EEG-based MI-BCI systems using wearable technologies in real-life scenarios seem to provide reliable assistance to their users and to be well received in case of assistive employment, as well as promising in case of entertainment, gaming, and other applications. The scenario of wearable devices available in the market is wide, also offering a huge variability in terms of electrodes, features and costs. Even if several different computational models have been presented in the analyzed literature, with promising results, the lack of reference experimental paradigms and of publicly and validated benchmark datasets acquired using wearable devices, make the analysis of the model performance and the feasibility of real time applications not completely accessible. It is unclear whether proposed strategies, tested on wired benchmark datasets, often offline, can be effectively translated into online real-life wearable contexts.
Many concerns remain regarding the ethical aspects that permeate the use of these systems in environments managed by experts and in consumer grade platforms. Concerning this point, note that among the 84 considered works, only 39 provide an ethical statement on the approval of the performed experiments.
Regarding future research directions, two main fields can be identified. On one side, edge computing is fast evolving to improve data processing speed in real-time applications. For example, [
197] overview adaptive edge computing in wearable biomedical devices (in general, not only EEG ones), highlighting the pathway from wearable sensors to their application through intelligent learning. The authors state
The ultimate goal toward smart wearable sensing with edge computing capabilities relies on a bespoke platform embedding sensors, front-end circuit interface, neuromorphic processor and memristive devices.
Also, [
198] investigate the possibility of addressing the drawbacks of wearable devices with edge computing.
The other frontier research field regards the application of quantum computing to BCI. Although efforts are only at the initial stage, some hybrid applications of quantum computing and BCI have been found, as reviewed by [
199]. Recently, the authors in [
200,
201] discuss Quantum Brain Networks, a new interdisciplinary field integrating knowledge and methods from neurotechnology, artificial intelligence, and quantum computing. In [
201], brain signals are detected utilizing electrodes placed on the scalp of a person who learns how to produce the required mental activity to issue instructions to rotate and measure a qubit, proposing an approach to interface the brain with quantum computers.