Download as docx, pdf, or txt
Download as docx, pdf, or txt
You are on page 1of 13

BRAIN COMPUTER INTERFACE ON HAND

MOVEMENTS
Gourab Behera Rabi Narayan Sahoo
ComputerScienc eand Engineering ComputerScienceand Engineering
C.V. Raman Global University C.V. Raman Global University
Bhubaneswar, India Dr Surendra Nanda Bhubaneswar, India
Computer Science and Engineering
Biswaranjan Biswal C.V. Raman Global University Debi Prasad JaySingh
ComputerScience and Engineering Bhubaneswar, India Computer Science and Engineering
C.V.Raman Global University C.V.Raman Global University
Bhubaneswar, India Bhubaneswar, India

Abstract—This article provides an overview of the improvement in the quality of life of troubled
field of brain-computer intervention (BCI), focusing on people. Basic BCI technology is designed to
its applications in the treatment of arthritis. The first
part addresses issues related to removing artifacts
capture, interpret and use nerve signals to facilitate
during left and right-hand move- ment and highlights direct communication between the brain and
the need to improve signal quality to ensure true BCI external stimuli. It holds great promise for
operation. The operation of BCI is based on the sedentary people and opens up the possibility of
integration of neuroscience, functional settings, new technological measures to treat or support
biomedical sensors, and hardware and has attracted hands.
much research in recent years. Despite many
pioneering studies, a comprehensive review covering
the entire BCI is still lacking. This article aims to fill As our neural understanding of hand
this gap by comprehensively evaluating BCI systems. It movements continues, so does our ability to
explores different BCI applications, highlighting their develop BCI systems that convert neural signals
important role in rehabilitation. All parts of the BCI into commands. This companion is a
system are briefly described, including methods, data, comprehensive website for learning manual BCI
extraction methods, evaluation matrices, available
algorithms, and distribution components. Additionally, techniques. It reviews the principles, recent
this article provides an overview of the technology and achievements, and colorful genres of BCI research,
hardware used in BCI applications, especially sensors. highlighting the latest developments in this
revolutionary field. The statement also mentions
The study then explores the potential of the broad impact of BCI methods on mobility due
electroencephalogram (EEG) signals to produce BCI in
upper and lower extremity treatment. A systematic to their role in improving aesthetics, intelligence,
review is presented, including data collection and service technology and, finally, improving the
interpretation of EEG signals, guidelines for treating daily lives of people experiencing conflict.
limbs based on movement or assisted movement goals,
and integration of a feedback virtual environment. Additionally, brain-computer interface
Keywords—feature selection, random forest, K- technology continues to integrate technology
nearest neighbor (KNN), decision tree, Random beyond neural control, increasing the efficiency
Forest, AdaBoost, Multilayer and effectiveness of these interventions.
perceptron(MLP),Cross validation matrix,Confusion Essentially, the control system reflects BCI's
matrix, Correlation matrix, Ensemble learning. adaptation to ground change. The remainder of this
article provides an overview of the methodology
I. INTRODUCTION and explores the challenges of both invasive and
non-invasive BCI approaches. The research also
In recent years, the intersection of neuroscience covers care challenges and opportunities, the sweat
and technology has led to significant advances in of drug users, and ethical decisions regarding the
brain-computer interfaces (BCI), especially use of BCI technology to enhance hand movement.
checkpointing. This partnership provides a Biological signals such as electromyography
platform that demonstrates the complexity of the (EMG) and electroencephalography (EEG) can be
earth's soul and allows direct communication with used as feedback signals to control prostheses. A
the outside world. Movements are an important prosthesis is a permanent device used to replace a
part of human motor control and have become an missing limb (1, 2). Amputees who have lost all or
important part of brain-computer intelligence due part of their limbs can use prostheses as they wish.
to their impact on daily events and their implicit Externally powered prostheses are important
because they follow natural limb movements. But used for combination model and meta
the way they rule is far from limb. Myoelectric classification. In Section 3, the performance
signals are signals emitted by muscles that provide evaluation process is presented along with
information about muscle contraction (1). experimental results and discussions. Finally,
Section 4 provides research conclusions and
The most commonly used prostheses use recommendations for future studies.
surface electromyography (sEMG) signals. These
signals are collected from the skin surface, 1. Identifying the Problem
recorded in the remaining muscles of the Creating robust and reliable brain-computer
amputated neck, and indirectly used as signals to the interfaces (BCI) based on electroencephalogram
body controller [3, 4]. Muscle loss resulting from (EEG) signals is a major challenge in the current
amputation makes electromyography signals unusable field of neurotechnology. Although brain-computer
and therefore affects the management of prostheses [1]. interfaces have the potential to revolutionize
This makes it very difficult to perform correct communication and control for people with
movements with prostheses [5]. On the other hand, physical disabilities, EEG-based systems currently
with recent technological developments, brain- face issues with reliability, accuracy, and user
computer interfaces (BCIs) have begun to attract changes. These challenges hinder the integration of
widespread attention in the biorobotics industry. BCIs into practical applications, limiting their
Brain-computer interfaces are non-muscular brain widespread acceptance and usability.
devices (such as electroencephalography) for
communication and control. BCI is the most well- Additionally, issues such as low data
known technology by which humans can throughput further hinder the immediate response
communicate with their environment and control required for effective BCI performance.
artificial objects or other external devices using Addressing these issues is important for progress
only the brain [22]. because more reliable and effective EEG-based
brain-computer interventions have the potential to
However, brain-computer interfaces that improve the quality of life of people with
use only EEG signals as the main input have not disabilities and open new opportunities for human-
been fully adopted in biorobotic applications due to computers. In this context, research efforts should
problems such as low reliability, lack of accuracy, focus on developing new solutions to improve the
being less user-friendly and less information to be performance and user experience of EEG-based
sent. To overcome EEG and EMG-based control brain-computer interfaces, and finally on bridging
problems, combining the two systems, taking the gap between the theoretical possibilities and
advantage of each signal and reducing the limitations of this transformation.
limitation of each signal would be a promising
method [2]. Lee et al. [3] introduced a hybrid Develop a brain-computer interface that
model that uses spatial electromyography and combines EEG and EMG signals to improve the
electroencephalogram signals as input components classification and control of upper limb prostheses,
to classify five limbs and uses four time domain solve the limitations of single control, and improve
features to extract features that are then input into the quality of treatment of upper limb amputee
the discriminant analysis (LDA) classifier. Channel patients. life.
selection is done using the next selection
procedure. Ruhunag et al. [21] proposed a 2. Data Set and Operation
transhumeral prosthetic arm, which controls the
Creating robust and reliable brain-
elbow of the prosthetic arm by electromyographic
signals with RMS based on point extraction and computer interfaces (BCI) based on
fuzzy neural network algorithm, and Nature electroencephalogram (EEG) signals is a major
(SSVEP)-based EEG signals using the state of challenge in the current field of
visual ability. In this study, a hybrid brain- neurotechnology. Although brain-computer
computer interface system was developed that interfaces have the potential to revolutionize
combines EEG and EMG signals to improve the
classification of individuals and improve the communication and control for people with
management performance of upper dentures. physical disabilities, EEG-based systems
The format of this text is as follows; currently face issues with reliability, accuracy,
Section 2 introduces the various inference methods and user changes. These challenges hinder the
used in our study and the classification methods integration of BCIs into practical applications,
limiting their widespread acceptance and 3.3.3. Changing the Gaming Industry:
usability. Additionally, issues such as low data  Experience: Brain-computer interfaces
throughput further hinder the immediate contribute to the creation of interactive
games by analyzing and adapting to an
response required for effective BCI individual's cognitive workload and
performance. Addressing these issues is emotional state.
important for progress because more reliable and  Personal Environment: Games can be
effective EEG-based brain-computer dynamically adjusted to provide
interventions have the potential to improve the personalized environments based on
quality of life of people with disabilities and neural feedback, enhancing the overall
gaming experience.
open new opportunities for human-computers. In 3.3.4. Health Applications:
this context, research efforts should focus on  Care and Treatment: BCIs can monitor
developing new solutions to improve the and offer potential treatments for mental
performance and user experience of EEG-based health conditions such as depression,
brain-computer interfaces, and finally on anxiety, and emotional distress.
bridging the gap between the theoretical  Neurofeedback: Through neurofeedback,
individuals can monitor and self-regulate
possibilities and limitations of this their brain functions, providing innovative
transformation. approaches to treating mental disorders.
3.3.5. Educational Innovation:
Develop a brain-computer interface that  Thought-Controlled Learning: BCIs have
combines EEG and EMG signals to improve the the potential to revolutionize learning
classification and control of upper limb environments by allowing students to
prostheses, solve the limitations of single control educational software or devices
control, and improve the quality of treatment of through their thoughts.
upper limb amputee patients. life.  Helping with Disadvantages: This
technology transforms the learning
3. Applications environment to assist students with
identifying gaps and encouraging active
3.3.1 Advances in Neurorehabilitation: participation.
 Neurorehabilitation: BCI technology 3.5.5. Community Service:
offers a non-invasive method for  Safe Transportation: BCIs can contribute
individuals recovering from strokes or to safer transportation by identifying signs
living with spinal cord injuries to regain of driver fatigue or distraction, prompting
control over their movements. automated safety features and
 Robotic Limbs and Exoskeletons: BCIs interventions.
enable precise control of artificial limbs,  Neuroergonomics: BCI technology plays a
enhancing motor function and potentially role in neuroergonomics, influencing the
improving the overall quality of life for design of user-friendly interfaces in
those with physical disabilities. professional settings.
3.3.7. Challenges and Considerations:
 Signal Accuracy: Improving the accuracy
3.3.2. Communication: of BCI signals is crucial for reliable and
 Disability Assistance: BCI serves as a effective performance.
crucial communication tool for individuals  User Adaptability: Ensuring that BCIs are
with severe illnesses like ALS, providing adaptable to diverse users, considering
a means to express themselves by utilizing variations in neural signals and cognitive
their thoughts and interacting with the abilities.
world.  Ethical Considerations: Addressing
 Converting Brain Signals: This privacy concerns related to the collection
technology restores a basic human right and use of neural data is essential for
and strengthens relationships by responsible BCI development.
translating brain signals into text or  Interdisciplinary Collaboration: Bringing
speech. together experts from neuroscience,
engineering, ethics, and stakeholders to inherently time-consuming. The significance of
collaboratively tackle challenges and drive education is evident in the need for repeated sessions
holistic development. to guide users through the entire process and enhance
overall performance.
4. Challenges in Brain-Computer Interface
(BCI) Research Training Phases: The training process
Brain-Computer Interface (BCI) research has
encompasses either the preliminary or evaluation
garnered attention from researchers, engineers, and
phase. In the initial stage, users acquaint themselves
medical professionals, providing a glimpse of
with controlling the system through brain feedback
potential success. However, this evolution is not
signals. Resolving issues associated with training is
without hurdles, necessitating careful consideration
paramount for optimizing user engagement and
for future advancements. Three primary challenges
efficient system administration.
emerge: signal acquisition hardware, reliability, and
training.
II. LITERATURE REVIEW
4.1. Signal Acquisition Hardware:
Key Challenge: Progress in cost-effective Acqualagna et al. [7] conducted a comprehensive
electronics is pivotal for the development of non- evaluation of brain-computer interfaces (BCIs), with
pharmacological BCI applications. This entails a focus on whole motor adaptations, aiming for a
addressing the demand for a dry, comfortable, user- complete engine replacement while prioritizing
friendly, and flexible EEG sensor. To expand the
efficiency and performance. Their research likely
reach of BCIs beyond controlled environments, the
involved experiments with participants utilizing BCIs
utilized hardware must ensure high signal quality
to control various interfaces or devices, assessing
even in noisy and dynamic surroundings.
the adaptability and effectiveness of the technology.
Current Limitations: Despite evidence of BCI
use outside controlled settings, its efficacy may Agarwal et al. [3] addressed the critical issue of user
diminish in real-world conditions. Priority should be privacy in BCI applications, discussing protective
given to research that focuses on advancing high- measures to safeguard user data collected through
quality electronic equipment capable of providing BCIs. Given the sensitive nature of information
robust signal quality and resilience. obtained from brain signals, such as personal
4.2. Reliability: thoughts or emotions, the study likely explored
Usability Challenges: Existing BCI systems encryption methods, data anonymization, or other
exhibit inadequate reliability in various applications, privacy-enhancing techniques to ensure user
limiting their sustained effectiveness in processing confidentiality and trust in BCI systems.
and controlling muscular functions within the
human body. Without enhancements, BCIs risk Aricó et al. [9] explored the implementation of
being confined to communication functions for adaptive automation in a real-life air traffic control
users with serious medical conditions. environment, utilizing an EEG-based mental
workload index. Their goal was to enhance human-
Key Analytical Issues: Addressing three machine interaction by adjusting automation levels
fundamental challenges is imperative: defining based on air traffic controllers' cognitive workload.
the central role of interactive BCI capabilities, The study likely involved experiments or simulations
accurately simulating the functional aspects of to evaluate the effectiveness of the proposed
the central nervous system, and integrating adaptive automation system in improving task
additional brain signals for comprehensive performance and reducing mental fatigue.
information processing. Arpaia et al. [4] investigated the effectiveness of
combining BCIs with augmented reality in a virtual
4.3. Training: reality setting, focusing on rehabilitation.
Participants likely underwent rehabilitation exercises
Time-Consuming: User training is a
while using BCIs to control virtual environments or
crucial component of BCI utilization and is
robotic devices. The study aimed to assess the Piastra et al. [10] utilized advanced computational
efficacy of BCI-assisted rehabilitation in improving models to comprehensively examine the sensitivity
motor function and patient outcomes compared to of EEG and MEG for cortical and subcortical neuronal
traditional methods. regions. Their research likely involved simulations or
analysis of neural signals to assess the spatial
Brickwedde et al. [1] explored the role of resolution and detection capabilities of EEG and
somatosensory alpha oscillations in cognitive MEG techniques, providing insights into their
processes related to learning success. Their research applicability for studying brain function and
likely involved experiments or neuroimaging disorders.
techniques to measure brain activity during learning
tasks, aiming to understand how somatosensory III. METHODOLOGY
alpha oscillations influence perception and
understanding of information. The hybrid model proposed in this study comprises
four distinct stages:
Brunner et al. [5] outlined the BNCI Horizon 2020
project, presenting a roadmap for advancing BCI 5.EEG and EMG Data Collection Stage:
technology and fostering collaboration within the This initial phase involves the systematic
research community. The roadmap likely included collection of EEG (Electroencephalogram) and EMG
goals such as improving signal processing algorithms, (Electromyogram) data. EEG captures electrical
developing new BCI applications, and standardizing activity in the brain, while EMG records electrical
evaluation protocols to accelerate progress in BCI signals generated by muscle contractions. The
research. integration of both types of data provides a
comprehensive understanding of neural and muscular
Chiarelli et al. [2] investigated the application of responses.
deep learning techniques for hybrid EEG-fNIRS BCIs,
5.1. Pre-processing and Segmentation Stage:
focusing on motor imagery classification. They likely
Following data collection, a pre-processing and
developed deep learning models to analyze neural
segmentation stage is employed to enhance the
data from EEG and fNIRS sensors, aiming to improve
quality of the acquired signals. Common pre-
the accuracy and reliability of BCI systems for motor
processing techniques such as filtering, noise
control applications. reduction, and artifact removal are applied to ensure
the integrity and reliability of the data. Segmentation
Filiz and Arslan [8] discussed the design and is performed to divide the continuous data into
implementation of BCI video games, concentrating discrete segments, facilitating subsequent analysis.
on steady-state visual capabilities. Their research
likely involved developing interactive games utilizing 5.2.Feature Extraction and Selection Stage:
steady-state visual evoked potentials (SSVEPs) or In this stage, relevant features are extracted from the
other visual stimuli to enable control through brain pre-processed and segmented data. Feature extraction
signals, exploring the usability and effectiveness of involves identifying distinctive patterns and
BCI video games for various purposes. characteristics in the signals that are indicative of
Jin et al. [6] introduced a new tactile P300-based BCI specific cognitive or motor activities. Additionally, a
using cheek stimulation, aiming to enhance BCI feature selection process is implemented to choose
performance and usability. They likely designed and the most informative features, optimizing the
tested a tactile stimulation paradigm to evoke P300 efficiency and performance of the model.
responses, enabling communication or interaction
with devices using touch-based cues, and assessing 5.3.Classification Stage:
the accuracy, speed, and user experience of the The final stage involves the application of a
classification algorithm to accurately categorize the
proposed tactile BCI.
extracted features. Machine learning or deep learning
models are commonly employed for this purpose,
leveraging the distinctive features to classify patterns the skin surface of the stump of each participant's
and make predictions. The choice of classification hand.
algorithm is tailored to the specific objectives of the 5.4.2. EEG signals:
study, considering factors such as accuracy, speed, Recorded through a 64-channel EEG sensor
and interpretability. integrated with a state-of-the-art Neuroscan system
This holistic methodology, illustrated in Figure 1, designed for collecting and analyzing EEG data.
ensures a systematic and comprehensive approach to Electrode placement followed the System Standard
the integration of EEG and EMG data for cognitive 10-20 protocol, a widely used scalp electrode
and motor activity analysis. The distinct stages placement standard for EEG recording [3].
address data collection, preprocessing, feature Participants were instructed to initiate and cease the
extraction, and classification, collectively target movement upon the appearance and
contributing to the development of an effective disappearance of the target on the screen,
hybrid model for the study's objectives. respectively. The EEG recording system
automatically marked the beginning and end of each
movement by placing a vertical line in the EEG data
corresponding to the appearance and disappearance
of the video target on the screen.
This comprehensive data acquisition methodology, as
depicted in Figures 1 and 2, ensures the simultaneous
recording of both sEMG and EEG signals during
specific arm movements, providing a robust
foundation for subsequent analysis and interpretation
in the study [3].

5.4. Data Acquisition 5.5. Data Pre-processing and Segmentation


The dataset utilized in this study was gathered In the data pre-processing and segmentation stage,
by Li et al. [3,4] and encompasses information from several crucial steps are employed to enhance signal
four male participants who underwent humeral quality, particularly focusing on sEMG and EEG
dissection. The participants had an average age of signals.
41.50 ± 7.05 years, and the average remaining leg
length measured below the shoulder blade was 25.50
± 4.20 cm [4]. The experimental sessions included 5.5.1.sEMG Signal Processing:
five distinct hand movement groups: open hand The sEMG signal undergoes various processing
(HO), closed hand (HC), wrist pronation (WP), wrist steps to optimize its utility. Initially, a bandpass filter
supination (WS), and immobility (NM). To mitigate is applied, limiting the signal to frequencies up to 500
muscle and brain fatigue, which can introduce Hz. Subsequently, the signal is sampled at a rate of
artifacts and signal attenuation, each movement was 1024 Hz, facilitating the retention of essential
sustained for 5 seconds, with a 5-second rest period frequency information for subsequent analysis.
between consecutive movements.
5.5.2.EEG Signal Processing:
During the data recording session, each participant For EEG signals, a bandpass filter is employed
executed 10 repetitions of four arm movements (HO, to confine the signal within the range of 0.05 to 100
HC, WP, and WS). Simultaneous recordings of Hz. Sampling is conducted at a rate of 1000 Hz,
surface electromyography (sEMG) and ensuring the capture of vital temporal information.
electroencephalography (EEG) were conducted To eliminate bias, the average of each channel in the
during the arm movements, as illustrated in Figures 1 EEG signal is subtracted, contributing to a more
and 2 for EEG and sEMG data acquisition. accurate representation of the data.

5.4.1. sEMG signals: 5.5.3.Period Extraction:


Recorded using a high-density sEMG system The EEG epochs corresponding to each
comprising 32 monopolar electrodes positioned on movement group are extracted along the start-finish
line. Each EEG session for a movement group
encompasses 5 seconds of EEG recording, with an each distribution. Features of each channel are
additional 120 milliseconds of recording before extracted from segments of different lengths and then
movement onset. This results in a total of 5120 data combined to form a vector vector as shown in Figure
points per array [3]. 3.

5.5.4.Detection of Artifacts:
In the processing of EEG data periods, a
transformation is employed to identify artifacts, such
as eye movements and blinks. An adaptive threshold,
set at 1.2 times the average value of the data period,
aids in effectively detecting and mitigating artifacts
that might impact EEG signal quality.

5.5.5.Power Line Noise Removal:


To eliminate noise in both EMG and EEG
recordings, a 50 Hz filter is applied. This step ensures
the removal of unnecessary interference from
electronic equipment, providing a clearer and more 5.7. FEATURE SELECTION
accurate signal for subsequent analysis. Features should be able to show different
The combined pre-processing procedures ensure that features or characteristics of the body. Calculation
both sEMG and EEG signals are optimized for must be taken into account when applying for
subsequent extraction and classification. Meticulous transfer [19]. The purpose of feature selection is to
attention to artifacts and noise contributes select a small number of important features from the
significantly to enhancing the reliability and original features based on some evaluation, which
interpretability of the collected data [3]. usually leads to better learning. (i.e. the higher the
dispersion of the study), the lower the cost and the
better the description. Specific selection is made by
eliminating the extraction process that is not useful
for classification [24].

5.8. CLASSIFICATION
The performance of the proposed model was
tested using three classification methods: quadratic
discriminant analysis (QDA), K-nearest neighbor
(KNN), and quadratic support vector machine
Overlapping segmentation method is used with (quadratic SVM) to classify five top sports.
lengths of 150 ms, 200 ms, 250 ms in 100 ms
increments. Figure 2 shows an example of how to
5.8.1. Quadratic Discriminant Analysis
complete an overlapping segmentation.
The discriminant function generated in QDA is
given by [13]:
5.6..FEATURE EXTRACTION
In this stage, three groups of time domain,
frequency domain and entropy based features are
used to calculate the autoregressive (AR) model
coefficients of each partition. Time domain features is the covariance matrix, it should not be the
include root mean square (RMS), wavelength length identity matrix, x is the data set and is the estimation
(WL), and William amplitude (WAMP), while of mean for data and the discriminant rule is given
frequency features include autoregressive (AR) by:
coefficients, frequency ratio (FR), resulting corrected
mean, and constant mean frequency
(MMNF). ). ,MDF). Standard entropy and log power 5.8.2. K Nearest Neighbors (KNN)
entropy are entropy-based properties calculated for
This algorithm is a simple classification algorithm gressive coefficient order on performance. See model
that finds the nearest neighbors in the data and tells . All experiments were performed using
people when they should guess Yes. The main idea of MATLAB and were run on a 2.8 GHz Intel Core i7 C
the KNN method is to provide a new unsigned model PU -
for the cluster where most of its neighbors are K [23]. based laptop with 16 GB access memory (RAM).
5.8.3.Support Vector Machine The data set contains 96 channels (64 channels EEG
SVM uses nonlinear elements to create a separation + 32 channels EMG) recording all movements of five
hyperplane at the data height. Therefore, although it limbs in each study of four amputees.
uses the linear learning method as a non-linear kernel Move And repeat 10 times.
function, it is a non-linear classifier [12]. Using a
nonlinear kernel can improve learning efficiency and 7.1.Experiment 1: Using overlapping segments of a
performance. The support vector machine can be channel to examine the effects of assertions on group
expressed mathematically as: cohesion and exclusion. Calculate the AR coefficient
for each segment. The same section consisting of 96
channels (64-channel EEG + 32-channel EMG) has
where Si is the support vector, ai is the weight, and b 96 groups of AR coefficients. So (96 p) attributes
is the bias used to classify the feature vector x. Here were created; where p is the order of the AR model.
k is the kernel function. In this study, quadratic The three correlations are then added to the AR
support vector machines were tested. The numerical coefficient. Figure 3 shows the residual vectors
representation of a quadratic support vector machine calculated for each segment as (96 channels x
is given by: features) and entered into three classifications; QDA,
KNN and quadratic SVM for classification of test
words using 5-fold cross-validation method classifier
and measured by distribution. accurate measurement.
a. RESULTS AND DISCUSSION Table 1. Statistical accuracy comparison of three
different feature extraction groups using DA
6.1. PERFORMANCE METRICS classifier.
Classification efficiency is usually measured in terms
of accuracy, defined as the number of correct
classifications among all classifications [12, 13]. In
this study, the mathematical definition of statistical
analysis is as follows:

Accuracy can be measured using a number of As shown in Table 1, the best classification results
methods such as cross-validation and N-fold cross- were obtained by training the QDA classifier using
validation (CV), which divide the entire data set into sixth-order AR model coefficients and extracting
N discrete subsets of approximately similar size. The three physical parameters, including RMS, WL, and
ith subset is used as the test set and the remaining N WAMP features, from each partition. br> Long 250
× 1 subset is used as the training set; This process ms. Additionally, time domain features (WL,RMS
continues until each subset is used as a single test, and AR coefficients) are not included, facilitating use
and the accuracy of N tests is obtained from the in on-the-fly hybrid BCI applications [11] . Table 2
average accuracy [12]. In this study, classification shows the comparison of classification accuracy of
accuracy was tested using the 5-fold cross-validation QDA, KNN and Q-SVM classifiers for the proposed
method. extraction process. QDA has been shown to have the
highest accuracy in identifying the arm and wrist.
IV. EXPERIMENTAL RESULTS AND The more accurate distribution of objects can be
DISCUSSION attributed to the QDA design of the second decision
Experiments were conducted to verify the performan in the critical area to change the instability and the
ce of the hybrid BCI system and examine the effects small difference between the EEG and EMG symbol
of the three combinations, segment length, and autore [13]. Additionally, due to its ability to optimize,
QDA is considered to be very strong against the curse
of overfitting and overfitting [13, 19, 23]. The second segment length, 150ms, 200ms and 250ms and an
best classification is achieved by KNN classifier, increment of 100ms using QDA classifier.
which is more accurate than Q-SVM.
7.3 Experiment 3: Investigate the effect of the
TABLE 2. Comparison of classification accuracy (%) autoregressive coefficient order
between QDA classifier with KNN and Q-SVM In this experiment, the effect of the fourth and sixth
classifiers for different feature extraction groups, for autoregressive coefficient order on the distribution of
the proposed model. the population is analyzed using the specification and
QDA classifier. Table 3 shows that the classification
accuracy of the features mentioned by the first and
second groups, including the recording time and
frequency recording features, is high, and the
classification accuracy of the sixth-order AR
coefficient is higher than that of the fourth-order AR.
coefficient. The third method, which includes
structure and energy entropy measurement, achieves
higher accuracy using the 4th-order AR model
compared to the 6th-order AR model.

7.2. Experiment 2: Study the effect of segment 7.4 Comparison with previous methods
Length . To verify the performance of the proposed model,
The purpose of this experiment is to examine the this section compares the performance of the
dependence of the joint configuration on the long proposed method with the new model developed by
segment in the distributed BCI hybrid. Figure 4 Li et al. [3] and Ruhunag et al. [twenty one]. As
shows different dimensions of division of labor; The shown in Table 4, the proposed method is best when
results show that a segment length of 250 ms has the testing TH2 and TH4, which are 99.45% and 99.57%,
best performance using our feature set and QDA respectively. Table 5 describes the accuracy of
classifier. The third method, which involves AR and classification and the time taken to remove the film
the entropy model, has been shown to be effective by and the movement classifications for the five hands
reducing the segment length to 150 ms. Results and wrists used to control the equipment. As shown
showed that despite specific group differences, in Table 6, compared with Li et al., the proposed
performance improvements of 0.7%, 1%, and 2% model achieved a significant improvement in
were achieved using the 250 ms segment length classification accuracy, up to 8% and 8.986%,
compared to the use of other lengths. %. > first respectively. [3] and Ruhunag et al. [21] respectively.
group, second group and third group features. Moreover, the standard deviation shows that there is
no difference in the accuracy of the parameters,
which indicates the stability of the plan.
TABLE 3. The impact of the AR coefficients order
on the performance of the proposed model, for
segment length 250ms using QDA classifier.

Fig. 4. The accuracy of each set of combined features


with overlapped segmentation scheme of different
TABLE 4 Classification accuracies (%) of the five
hand and wrist movements of the four transhumeral
amputees, for segment length 250ms using 1st group
combined features and QDA classifier. 8.1.Compare data by Box plots

Box plots are used to compare data distributions,


especially when you have multiple datasets or
categories to compare. Here are some reasons why
box plots are used for this purpose:
1. Visualizing Distribution: Box plots provide
a visual summary of the central tendency,
dispersion, and skewness of the data
distribution, making it easier to compare
different datasets at a glance.
2. Identifying Outliers: Box plots help in
identifying outliers, which are data points
that significantly differ from the rest of the
data. Outliers can skew the mean and other
statistical measures, so identifying them is
important for understanding the data.
3. Comparing Medians and Quartiles: Box
plots show the median (middle value) and
Table 5 Classification accuracy and time required to
quartiles (dividing the data into four equal
extract and classify five hands and wrists with a
parts), making it easy to compare these
length of 250 ms using the first layer and the QDA
statistics between different datasets.
classifier.
4. Detecting Skewness: By observing the
symmetry of the box plot, you can determine
if the data is symmetrically distributed or
skewed to one side. This information is
valuable in understanding the nature of the
data.
8.2.Converting to freequency domain

Converting a signal from the time domain to the


frequency domain is done to analyze the signal's
frequency components. This conversion is useful
because it allows us to understand the underlying
frequencies that make up a signal and can provide
Table 6. Comparison of the proposed method with
other methods in the literature. insights into the signal's characteristics and behavior.

8.3.Continuous Wavelet Transform (CWT) : In


the context of your code, the Continuous Wavelet
Transform (CWT) converts the EEG signal from the
time domain to the frequency domain using wavelets.
This transformation helps in identifying the different
frequency components present in the EEG signal and
how they vary over time.

8.4. Short-Time Fourier Transform (STFT) :


Similar to the wavelet transform but uses a fixed
window size, providing a compromise between time
V. NEW IMPLEMENTATION
and frequency resolution. It's suitable for signals with It builds an ensemble of weak learners (usually
relatively stable frequency components. decision trees) sequentially, where each new tree
corrects errors made by the previous ones.

8.5.Visualization Comparing the performance of the Gradient Boosting


model with the Naive Bayes and Random Forest
8.5.1 Line Chart: Use a line chart to show trends models based on the provided accuracy scores:
over time or sequential categories. Each data point is  Naive Bayes:
connected by a line.  Training Accuracy: 0.1812
 Testing Accuracy: 0.225
8.5.2 Histogram: Use a histogram to visualize the  Random Forest:
distribution of a single variable.  Training Accuracy: 0.2062
 Testing Accuracy: 0.1
8.6.Classifiers (Machine Learning Algorithms)  Gradient Boosting:
8.6.1. Naive Bayes is a probabilistic classifier based  Training Accuracy: 1.0
on Bayes' theorem with the "naive" assumption of  Testing Accuracy: 0.15
independence between features. It is simple, fast, and Based on these results, the Naive Bayes model has
often performs well on small datasets. It works well the highest testing accuracy, followed by the
with categorical data and is less prone to overfitting. Gradient Boosting model and then the Random
However, it may not capture complex relationships in Forest model.
the data as well as other algorithms. In terms of accuracy alone, the Naive Bayes model
appears to be the best choice among the three.
8.6.2. Random Forest is an ensemble method that
VI. CONCLUSION AND FUTURE
uses multiple decision trees to make predictions. It is
DIRECTIONS
more complex than Naive Bayes and can capture
This paper presents a new artificial intelligence-
complex relationships in the data. Random Forest
computer interface for the segmentation of different
generally performs well on a variety of datasets and
limbs in elbow amputees whose muscles do not have
is less prone to overfitting compared to individual
sufficient signals for movement control. A good
decision trees. However, it can be computationally
combination of new feature releases and deployment
expensive and may require more tuning of
models will determine the move. Three classifiers
hyperparameters.
with improved feature extraction and phase selection
were used to classify wrist and hand in combined
signals of electroencephalogram and myoelectric
Based on the provided accuracy scores: signals. Use overlapping segmentation techniques on
 Naive Bayes has a training accuracy score of different parts. Specific selection and removal are
0.1812 and a testing accuracy score of examined using a combination of AR model
0.225. coefficients and time domain, frequency domain, and
 Random Forest has a training accuracy score entropy-based features.
of 0.2062 and a testing accuracy score of Animation classifiers were made using QDA, KNN
0.1. and second-order SVM classifiers, tested using the 5-
In this scenario, Naive Bayes performs better than fold cross-validation method and evaluated according
Random Forest in terms of testing accuracy. to the accuracy of the classification. The effects of
segment length and AR model coefficient
determination were investigated. The sixth model is a
8.7.Another classifer (Machine Learning combination model that combines AR model
Algorithm) coefficients with three time domain features such as
RMS, WL, and WAMP to show more accurate
8.7.1. Gradient Boosting classification using the QDA classifier. The recovery
Gradient Boosting is a machine learning technique is 8%. This program can be used to determine hand
used for regression, classification, and ranking tasks. and wrist movements that occur after daily living
activities. In future studies, channel reduction and features for the control of a prosthetic hand.
channel selection methods will be used to reduce the Physiological Measurement, 24(2).
number of EEG and EMG channels and achieve high [9] Zhang, Y., Liu, B., Ji, X., & Huang, D.
transmission performance. (2017). Classification of EEG Signals Based
on Autoregressive Model and Wavelet
VII. REFERENCES Packet Decomposition. Neural Process Lett,
45(2), 365–378.
[1] Madusanka, D. G. K., Wijayasingha, L. N. [10] Al-Angari, H. M., Kanitz, G., Tarantino, S.,
S., Gopura, R. A. R. C., Amarasinghe, Y. & Cipriani, C. (2016). Distance and mutual
W. R., & Mann, G. K. I. (2015). A Review information methods for EMG feature and
on Hybrid Myoelectric Control Systems for channel subset selection for classification of
Upper Limb Prosthesis. Moratuwa hand movements. Biomedical Signal
Engineering Research Conference. Processing and Control, 27, 24–31.
[2] Lalitharatne, J. T. D., Teramoto, K., [11] Tavakolan, M., Frehlick, Z., Yong, X., &
Hayashi, Y., & Kiguchi, K. (2013). Towards Menon, C. (2017). Classifying three
Hybrid EEG-EMG based control approaches imaginary states of the same upper extremity
to be used in Bio-robotics applications: using time-domain features. PLoS ONE,
current status, challenges and future 12(3), e0174161.
directions. Journal of Behavioral Robotics, [12] Quitadamo, L. R., Cavrini1, F., Sbernini, L.,
Paladyn, 4(2), 147–154. Riillo, F., Bianchi, L., Seri, S., & Saggio, G.
[3] Li, X., Samuel, O. W., Zhang, X., Wang, H., (2017). Support vector machines to detect
Fang, P., & Li, G. (2017). A motion- physiological patterns for EEG and EMG-
classification strategy based on sEMG-EEG based human–computer interaction: a
signal combination for upper-limb review. Journal of Neural Engineering,
amputees. Journal of NeuroEngineering and 14(1).
Rehabilitation, 14(2), 1–13. [13] Gull, M. A., Elahi, H., & Marwat, M.
[4] Samuel, O. W., Li, X., Geng, Y., Feng, P., (2017). A new approach to classification of
Chen, S., & Li, G. (2017). Motor imagery upper limb and wrist movements using EEG
classification of upper limb movements signals. 13th IASTED International
based on spectral domain features of EEG Conference on Biomedical Engineering
patterns. Engineering in Medicine and (BioMed).
Biology Society, 39th Annual International [14] Phinyomark, A., Phukpattaranont, P., &
Conference of the IEEE. Limsakul, C. (2012). Feature reduction and
[5] McGimpsey, G., & Bradford, T. (2010). selection for EMG signal classification.
Limb Prosthetics Services and Devices. Expert Systems with Applications, 39(8),
Bioengineering Institute Center for 7420–7431.
Neuroprosthetics. [15] Sharma, R., Pachori, R. B., & Acharya, U.
[6] Siuly, S., & Li, Y. (2012). Improving the R. (2015). Application of Entropy Measures
Separability of Motor Imagery EEG Signals on Intrinsic Mode Functions for the
Using a Cross Correlation-Based Least Automated Identification of Focal
Square Support Vector Machine for Brain– Electroencephalogram Signals. Entropy,
Computer Interface. IEEE Transactions on 17(2), 669–691.
Neural Systems and Rehabilitation [16] Mathew, B. A. (2006). Entropy of
Engineering, 20(4), 526–538. electroencephalogram (EEG) signal changes
[7] Phinyomark, A., Phukpattaranont, P., & with sleep state. University of Kentucky
Limsakul, C. (2009). A Novel Feature Master’s Theses Graduate School.
Extraction for Robust EMG Pattern [17] Zhang, X., & Zhou, P. (2012). Sample
Recognition. Journal of Computing, 1(1), entropy analysis of surface EMG for
71–80. improved muscle activity onset detection
[8] Boostani, R., & Moradi, M. H. (2003). against spurious background spikes. Journal
Evaluation of the forearm EMG signal of Electromyography and Kinesiology,
22(6), 901–907.
[18] Aydin, S., Saraog, H., & Kara, S. (2009).
Log Energy Entropy-Based EEG
Classification with Multilayer Neural
Networks in Seizure. Annals of Biomedical
Engineering, 2626–2630.
[19] Oskoei, M. A., & Hu, H. (2008). Support
vector machine based classification scheme
for myoelectric control applied to upper
limb. IEEE Transactions on Biomedical
Engineering, 55(8), 1956–1965.
[20] Al-Quraishi, M. S., Ishak, A. J., Ahmad, S.
A., & Hasan, M. K. (2015). Impact of
feature extraction techniques on
classification accuracy for EMG based ankle
joint movements. Control Conference
(ASCC), 2015 10th Asian.
[21] Ruhunage, I., Perera, C. J., Nisal, K.,
Subodha, J., & Lalitharatne, T. D. (2017).
EMG signal controlled transhumeral
prosthetic with EEG-SSVEP based approach
for hand open/close. 2017 IEEE
International Conference on Systems, Man,
and Cybernetics (SMC).
[22] Vaughan, T. M., Heetderks, W. J., Trejo, L.
J., Rymer, W. Z., Weinrich, M., Moore, M.
M., ... & Wolpaw, J. R. (2006). Brain-
computer interface technology: a review.
IEEE Transactions on Neural Systems and
Rehabilitation Engineering, 11(2), 94–109.
[23] Cover, T. M., & Hart, P. E. (1967). Nearest
neighbor pattern classification. IEEE
Transactions on Information Theory, 13,
21–27.
[24] Tang, J., Alelyani, S., & Liu, H. (2014).
Feature selection for classification: a review.
In Data Classification: Algorithms and
Applications. CRC Press, pp. 37–64.

You might also like