Professional Documents
Culture Documents
Hybrid sEMG NIRS and MMG Sensor System
Hybrid sEMG NIRS and MMG Sensor System
Hybrid sEMG NIRS and MMG Sensor System
Abstract—In recent years, surface electromyography the joint acquisition signals of MMG and sEMG to explore
(sEMG) is widely used in human-computer interface (HCI). the relationship between contractility and these two kinds of
For example, it is used for prosthetic manipulation to improve signals. It is proved that complementary knowledge could be
the quality of amputees’ life. However, sEMG approaches has obtained from the recordings of sEMG and mechano-
some drawbacks such as poor robustness of the electrode-skin myography MMG signals [4]. P Prociow identifies hand
interface. Near-infrared spectroscopy (NIRS) and movements based on MMG and sEMG signals. The
mechanomyography (MMG) can also monitor muscle motion. experimental results demonstrate the good performance of
Comparing with approaches that only use sEMG signal, hybrid the fusion acquisition system in identifying movements [5].
sEMG, NIRS and MMG sensor system will have better system
However, there are few studies fusing three kinds of signal
performance. Investigations about the fusion of sEMG, NIRS
and MMG are scant. This paper presents a hybrid sEMG,
sources to develop a hybrid sensor system. The integration of
NIRS and MMG sensor system and puts it into practice. Fuse the sEMG, MMG and NIRS will enable a more diverse range
surface electromyography, near-infrared spectroscopy and of muscle activity detection to get a more comprehensive
mechanomyography acquisition circuits into a compact sensor, understanding of muscle movement.
which can measure the muscle motion from the modalities of
electrophysiology, optics and acoustics. Using the hybrid sensor II. MEASURING PRINCIPLE
system, incremental grip force experiment is carried out to
explore the relationship between the three signals, blood A. Related Physiological Phenomena of Muscle
oxygen metabolism and grip force. And muscle fatigue is Contraction
carried out in order to explain the phenomenon of muscle
fatigue from the perspective of electrophysiology, blood oxygen Human motion is controlled by the nervous system.
metabolism and mechanomyography. Motion intention arises from the motor cortex of the anterior
cerebral cortex [6]. It is transferred to motor neuron in the
Keywords—Hybrid Sensor, Mechanomyography, Surface form of an electrical or chemical activity. The motor neurons
Electromyography, Near-infrared Spectroscopy in the spinal cord can directly control the activities of skeletal
muscle. Their axons extend to the muscle fibers and connect
I. INTRODUCTION with muscle fibers through the endplate area. A motor
neuron can control multiple muscle fibers. They make up a
With the development of technology, many researchers motor unit and every skeletal muscle contains a lot of motor
are trying to identify human motion intention through units [7]. Motion intention is transferred from a motor
physiological signals such as sEMG and use them to control neuron to muscle fibers. Then nerve impulses activate
the movement of prosthetic hand. Surface electromyography muscle fibers and muscle fibers drive skeletal muscle to
is the most practical and feasible signal source under current contract. Therefore, electromyography signals are generated
technology because of its convenient measurement and during muscle contraction. Such electrical signals can be
relatively high signal-to-noise ratio. Nevertheless, sEMG collected by implanted electrodes inserted into the skin, or
also has problems such as weak intensity and susceptible surface electrodes are used to collect surface
crosstalk [1]. electromyography signals on the skin surface.
Many related researches have been carried out to It takes energy to complete muscle contraction. The
combine NIRS or MMG with sEMG to form a hybrid energy released by the oxidation of lipids and carbohydrates
acquisition system to make up for the shortcomings of is the ultimate energy source of muscle contraction. The
sEMG. The team of Klaus Buchenriede in Germany fuses the oxygen required for oxidation of lipids and carbohydrates
NIRS with sEMG to develop a hybrid sensor for prosthetic comes from oxygenated hemoglobin in the blood. When
manipulation and shows that the combination of sEMG and human forearm muscles contract, the oxidation of free fatty
NIRS provides better classification results and improve the acids and glucose produces oxygen metabolism which can be
spatial resolution of the device [2]. J Taelman focuses on the characterized by the concentration changes of oxygenated
study of muscle fatigue parameters derived from sEMG and hemoglobin and deoxyhemoglobin. Traditional blood oxygen
NIRS, and he draws such a conclusion that both sEMG and monitoring requires blood sampling first and then using
NIRS give complementary information concerning muscle blood gas analyzer for electrochemical analysis. Near
fatigue [3]. P. Madeleine and his colleagues are working on infrared spectroscopy is a more convenient and efficient way
This work is supported in part by the National Natural Science to detect blood oxygen metabolism.
Foundation of China (Grant No. 91748119), and the Science and
Technology Commission of Shanghai Municipality (Grant No.
17JC1402700).
k,(((
Authorized licensed use limited to: Birla Institute of Technology and Science. Downloaded on January 13,2024 at 04:47:00 UTC from IEEE Xplore. Restrictions apply.
WK,QWHUQDWLRQDO&RQIHUHQFHRQ0HFKDWURQLFVDQG0DFKLQH9LVLRQLQ3UDFWLFH 09,3
There are some low-frequency vibrations or sound III. ELECTRICAL DESIGN OF THE SYSTEM
signals when skeletal muscles contract [8]. And the
mechanical vibration can cause a 500 nanometer-long A. Signal Conditioning Module
displacement on the surface of skin [9]. High sensitivity Various kinds of noise such as ambient noise (power
microphone, micro accelerometer, piezoelectric contact frequency noise), baseline noise (electrochemical noise at
sensor and laser range sensor are usually used to monitor the skin-electrode interface and thermal noise produced by
vibration characteristics of muscle contraction [10-11]. Semiconductor elements) and physiological noise are mixed
in the raw signals. The functions of signal conditioning
B. Measuring Principle of sEMG, NIRS and MMG module are filtering noise signals and amplifying useful
1) sEMG: The conduction of nerve impulse leads to the signals to get signals that can be further processed in the next
transmembrane flow of positive ions (especially potassium module.
ions and sodium ions) on the both membrane sides. It 1) Signal Conditioning Module of sEMG and MMG:
changes the potential difference between the two sides of the Signal Conditioning Module of sEMG is composed of a
cell membrane [12]. The above theory shows that the differential amplifier, a high pass filter, an operational
conduction process of nerve impulses forms current fields. amplifier and a low pass filter. Differential amplifier can
Because muscles and skin tissues are good conductors, significantly reduce interference signals, amplify differential
potential difference can be detected by surface electrode mode signals and suppress common mode signals. After
placed in the current field, which is called surface passing through it, the common mode rejection ratio and
electromyography. signal-to-noise ratio of signals will increase. Instrument
2) NIRS: It is a common phenomenon that absorption, amplifier INA326 produced by TI is chosen in this system
scattering and reflection will happen when the near-infrared because of its high common mode rejection ratio. High pass
light goes through muscle tissues. For the near-infrared light filter is used to filter low frequency noise, including low
whose wavelength is between 650 and 1000nm, muscle frequency motion artifact and noise produced by the contact
tissues are relatively transparent [13]. That means the of skin and electrode. Operational amplifier is used to
absorption effect is weak. There are two kinds of absorption achieve two-stage amplification of signals because the
sources for near-infrared light in muscle tissues. The first amplitude of sEMG signal is very small and it is not enough
kind of absorption sources has an almost fixed concentration. if only one-stage amplifier is set. AD8603, a rail to rail
These substances include water, melanin, bilirubin and so on. operational amplifier produced by Analog Devices is chosen
Oppositely, concentrations of the other one kind of in this system. It has the advantages of low noise, low power
absorption sources will have an obvious change when consumption and high precision. And the common mode
muscles are in movement state [14]. Oxyhemoglobin ( ) rejection ratio is further improved by using programmable
and deoxyhemoglobin (HHb) belong to the second kind [15]. reverse phase amplification. Last but not the least, low pass
Therefore, the absorption intensity of near-infrared light filter can filter high frequency noise.
changes with the muscle movement. Because the total Signal conditioning module of MMG is roughly the same
intensity of light remains constant, the near-infrared light as the one of sEMG. But considering the characteristics of
emitted by a near-infrared illuminant will have different MMG signal, the passband range of the filter is from 5 to
scattering intensity when the muscle tissues are in different 300Hz in signal conditioning module of MMG.
states, and this intensity can be detected by a photoelectric 2) Signal Conditioning Module of NIRS: Signal
detector. Place a near-infrared illuminant and a photoelectric conditioning module of NIRS consists of a near-infrared
detector on the surface of skeletal muscles to detect the light source, a constant current driver, a photoelectric
change of near-infrared light intensity. Then use modied detector and a low pass filter, which can detect near-infrared
Beer-Lambert law (MBLL) to calculate the change of the signal and complete signal conditioning. A near-infrared
concentrations of oxyhemoglobin and deoxyhemoglobin [16- LED produced by Epitex Inc is used to be the near-infrared
17]. The information of blood oxygen metabolism in the light source. Twelve LED chips are integrated with an AIN
muscles and muscle movement can be obtained. radiator base and three kinds of near-infrared light with
3) MMG: There are three kinds of vibrations usually different wavelengths can be emitted by this near-infrared
used to analyze the information of muscle movement. At light source. The three near-infrared wavelengths are 730nm,
first, because muscle fiber controlled by a motor unit may be 805nm and 850nm respectively. Because the long-time
activated at different times when a muscle begins to contract, luminescence will generate heat, in order to avoid prolonged
a transverse comprehensive vibration will be produced. exposure to it and injury to the skin, the LED emits light in
What’s more, in the process of continuous muscle the form of pulse. The pulse frequency is issued by four ports
contraction, a micro vibration will be produced, which is of DCK/DAI/LAT/EN, and the four ports are controlled by
decided by the resonance frequency of muscle fibers. The MCU in the signal processing module. DM11A is chosen to
third one is the size change controlled by the motor unit [18]. be the constant current driver, which can drive the near-
High sensitivity microphone can detect the three kinds of infrared light source. Photoelectric detector is used to detect
vibrations above well without contacting the skin. the near-infrared light going through the muscle tissues.
OPT101 produced by TI is chosen to undertake this task. It is
an integrated photodiode containing a mutual impedance
amplifier, and there is a linear relationship between the
Authorized licensed use limited to: Birla Institute of Technology and Science. Downloaded on January 13,2024 at 04:47:00 UTC from IEEE Xplore. Restrictions apply.
WK,QWHUQDWLRQDO&RQIHUHQFHRQ0HFKDWURQLFVDQG0DFKLQH9LVLRQLQ3UDFWLFH 09,3
Microphone
A. Hardware Implementation of Signal Conditioning
Module Conical Chamber
Authorized licensed use limited to: Birla Institute of Technology and Science. Downloaded on January 13,2024 at 04:47:00 UTC from IEEE Xplore. Restrictions apply.
WK,QWHUQDWLRQDO&RQIHUHQFHRQ0HFKDWURQLFVDQG0DFKLQH9LVLRQLQ3UDFWLFH 09,3
As shown in the Fig. 2(c), connect the signal condition- deoxyhemoglobin concentration drops. The greater the grip
ing module and the processing module with FPC line. force is, the greater concentration change of the two kinds of
Customized double-sided adhesive tape is used to fix the hemoglobin will happen. The above phenomena can be
acquisition module on the forearm. explained as: in the process of muscle contraction, because
oxygen consumption is greater than oxygen supply, the
V. EXPERIMENTS BASED ON SEMG/MMG/NIRS saturation of oxygen is reduced. Therefore, the concentration
of oxygen hemoglobin decreases, and the concentration of
A. Incremental Grip Force Experiment deoxyhemoglobin increases. As the increase of force will
lead to greater oxygen consumption, the concentration
1) Experimental Paradigm: Firstly, the subject sits on a change of oxygenated hemoglobin and deoxyhemoglobin is
chair, measure the MVC of clenching fist by a standardized positively correlated with force [20-21]. It shows that NIRS
electronic dynamometer. MVC is defined as the maximum part of the hybrid sensor can detect blood oxygen
force that a subject can keep for 3 to 5 seconds. Calculate metabolism well.
the forces of 30%, 50% and 80% of MVC respectively, and
The phenomenon of sEMG signal intensity increases
they are the three level of incremental grip force. Fix the with the increase of contractile force can be explained from
acquisition system on the extensor digitorum muscle of the perspective of electrophysiology. When the contractile
subject. After the start of the measurement, the subject force increases, more muscle fiber movement units will be
maintains resting state for 30s as the baseline. Then the raised so that the energy of the sEMG signal will increase.
subject increases grip force in the order of 30%, 50% and
The intensity of NIRS signal also increases with the
80% of MVC. Each level of grip force is maintained for 20s, increase of contractile force, but the trend of change is not
and 30s rest is arranged between the two grip force levels to obvious between 50% and 80% of MVC. Studies have
avoid muscle fatigue. The real-time curve is displayed on shown that increase of force leads to increased pressure of
the computer screen in front of the subjects to provide visual muscle and vascular, so the blood flow in the blood vessels
feedback. will be limited [22]. Therefore, the near-infrared light
2) Experimental Raw Data Results: The raw data results absorbed by human tissue chromophores is reduced, and the
are shown in Fig. 3. As is illustrated in the figure, the intensity of near-infrared light detected by photodetector
intensity of the three signals when subject clenches fist is increases. Obviously, such a change is small when the force
somewhat larger than that in the resting state. is great enough, so the increasing trend of the NIRS signal is
For sEMG, the intensity of the signal increases with the not obvious between 50% and 80% of MVC.
increase of the grip force. For MMG, the change of grip The normalized MMG signal shows that the intensity of
force has little effect on signal intensity seen from the raw MMG signal also increases with the increase of force. From
data. For NIRS, the intensity of the signal increases with the the three kinds of MMG signals mentioned above, when the
increase of the grip force, but the increase is not very force increases, the intensity of transverse comprehensive
obvious. vibration and micro vibration decided by the resonance
frequency will increase so the intensity of MMG will
Raw sEMG (mV)
increase.
Concentration Change (uMol/L)
20
HbO
2
HHb
Raw MMG (mV)
15
10
0
Raw NIRS (mV)
-5
-10
-15
-20
0 100 200 300 400 500 600 700 800
Fig. 3. The raw signals of sEMG, MMG and NIRS in incremental grip Time (s)
force experiment.
Normalized sEMG, NIRS and MMG Features
0.9
sEMG
NIRS
0.8 MMG
using the modified Lambert-Beer law in Fig. 4(a), and three 0.5
trend of curves in Fig. 4(b). The change trends of all four 0.3
good. 0.1
Authorized licensed use limited to: Birla Institute of Technology and Science. Downloaded on January 13,2024 at 04:47:00 UTC from IEEE Xplore. Restrictions apply.
WK,QWHUQDWLRQDO&RQIHUHQFHRQ0HFKDWURQLFVDQG0DFKLQH9LVLRQLQ3UDFWLFH 09,3
VI. CONCLUSION
In this paper, a hybrid sensor system with three kinds of
Raw MMG (mV)
15
HbO
HHb
2 Aided Systems Theory - EUROCAS 2011, Springer, Heidelberg,
10 2012, pp. 601-608.
[3] Taelman J, Vanderhaegen J, Robijns M, et al., “Estimation of muscle
5 fatigue using surface electromyography and near-infrared spectros-
copy,” Oxygen Transport to Tissue XXXIII 701, pp. 353-359, 2011.
0
[4] Madeleine P, Bajaj P, Søgaard K, et al., “Mechanomyography and
-5
electromyography force relationships during concentric, isometric and
eccentric contractions,” Journal of Electromyography & Kinesiology
-10
11(2), pp. 113-121, 2001.
[5] Prociow P, Wolczowski A, Amaral T G B, et al., “Identification of
-15
0 100 200 300 400 500 600 700 800
Hand Movements based on MMG and EMG Signals,” in International
Time (s) (a) Conference on Biomedical Electronics and Devices, Biosignals 2008,
1
sEMG
Funchal, Madeira, Portugal, 2008, pp. 534-539.
NIRS
0.9 MMG
[6] Li Y, Ge S S, “Human-Robot Collaboration Based on Motion
0.8 Intention Estimation,” IEEE/ASME Transactions on Mechatronics
0.7 19(3), pp. 1007-1014, 2014.
0.6 [7] Morris, Henby, “HUMAN ANATOMY,” American Journal of the
0.5 Medical Sciences 110(1), pp. 179-193, 2000.
0.4 [8] Courteville A, Gharbi T, Cornu J Y, “MMG measurement: a high-
0.3 sensitivity microphone-based sensor for clinical use,” IEEE
0.2
Transactions on Biomedical Engineering 45(2), pp. 145-150 , 2002.
0.1
[9] Silva J, Heim W, Chau T, “A Self-Contained, Mechanomyography-
0
Driven Externally Powered Prosthesis,” Archives of Physical
0 100 200 300 400 500 600 700 800
Authorized licensed use limited to: Birla Institute of Technology and Science. Downloaded on January 13,2024 at 04:47:00 UTC from IEEE Xplore. Restrictions apply.
WK,QWHUQDWLRQDO&RQIHUHQFHRQ0HFKDWURQLFVDQG0DFKLQH9LVLRQLQ3UDFWLFH 09,3
[11] Silva J, Chau T, “Coupled microphone-accelerometer sensor pair for tissue,” International Journal of Industrial Ergonomics 40(2), pp. 125-
dynamic noise reduction in MMG signal recording,” Electronics 134, 2010.
Letters 39(21), pp. 1496-1498, 2003. [18] Orizio C, “Muscle sound: bases for the introduction of a
[12] Karlsson J S, Roeleveld K, Grönlund C, et al., “Signal processing of mechanomyographic signal in muscle studies,” Critical Reviews in
the surface electromyogram to gain insight into neuromuscular phys- Biomedical Engineering 21(3), pp. 201, 1993.
iology,” Philos Trans A Math Phys Eng Sci 367(1887), pp. 337-356, [19] Ferrari M, Mottola L, Quaresima V, “Principles, Techniques, and
2009. Limitations of Near Infrared Spectroscopy,” Can J Appl Physiol
[13] Ferrari M, Quaresima V, “A brief review on the history of human 29(4), pp. 463-487, 2004.
functional near-infrared spectroscopy (fNIRS) development and fields [20] Van Beekvelt M C, Van Engelen B G, Wevers R A, et al., “In vivo
of application,” Neuroimage 63(2), pp. 921-935, 2012. quantitative near-infrared spectroscopy in skeletal muscle during
[14] Mancini D M, Bolinger L, Li H, et al., “Validation of near-infrared incremental isometric handgrip exercise,” Clin Physiol Funct Imaging
spectroscopy in humans,” Journal of Applied Physiology 77(6), pp. 22(3), pp. 210, 2002.
2740-2747, 1994. [21] Van Beekvelt M C, Colier W N, Wevers R A, et al., “Performance of
[15] Izzetoglu M, Izzetoglu K, Bunce S, et al., “Functional near-infrared near-infrared spectroscopy in measuring local O (2) consumption and
neuroimaging,” IEEE Transactions on Neural Systems & blood flow in skeletal muscle,” Journal of Applied Physiology 90(2),
Rehabilitation Engineering A Publication of the IEEE Engineering in pp. 511-519 , 2001.
Medicine & Biology Society 13(2), pp. 153, 2005. [22] Hamaoka T, Mccully K K, Quaresima V, et al., “Near-infrared
[16] Calloway D, “Beer-Lambert Law,” Journal of Chemical Education spectroscopy/imaging for monitoring muscle oxygenation and
74(7), pp. 744, 1997. oxidative metabolism in healthy and diseased humans,” Journal of
[17] Maikala R V, “Modified Beer's Law - historical perspectives and Biomedical Optics 12(6), pp. 16-20, 2007.
relevance in near-infrared monitoring of optical properties of human
Authorized licensed use limited to: Birla Institute of Technology and Science. Downloaded on January 13,2024 at 04:47:00 UTC from IEEE Xplore. Restrictions apply.