Download as docx, pdf, or txt
Download as docx, pdf, or txt
You are on page 1of 40

NEURALINK

A seminar report submitted to the

APJ ABDUL KALAM TECHNOLOGICAL UNIVERSITY


KERALA

In partial fulfillment of the requirements for the award of the degree of

BACHELOR OF TECHNOLOGY
In

ELECTRONICS AND COMMUNICATION ENGINEERING

Submitted by

SHIFNA.M
Reg.No:L MEA20EC021

Department of Electronics and Communication Engineering

M.E.A. ENGINEERING COLLEGE


VENGOOR, PERINTHALMANNA
2023-2024
M.E.A. ENGINEERING COLLEGE

PERINTHALMANNA -679325

CERTIFICATE

This is to certify that the Seminar report entitled ”NEURALINK” is a bonafide record of
the work done by SHIFNA M (LMEA20EC021) under our supervision and guidance. The
report has been submitted in partial fulfillment of the requirement for award of the Degree of
Bachelor of Technology in Electronics and Communication Engineering from the APJ Abdul
Kalam Kerala Technological University for the year 2023.

Seminar Guide: Seminar Coordinator: Head of the department:


Mr.Vinod.c Mrs. PRIYA KP Dr. RENJITH V. RAVI
Associate Professor and Assistant Professor Associate Professor and
Head Dept. Of ECE Head
Dept. Of ECE MEA Engineering Dept. Of ECE
MEA Engineering College Perinthalmanna MEA Engineering
College Perinthalmanna College Perinthalmanna
ACKNOWLEDGEMENT

An endeavor over a long period may be successful only with advice and guidance of
many well wishers. I take this opportunity to express our gratitude to all who encouraged
us to complete this seminar. I would like to express our deep sense of gratitude to our
resepcted Principal Dr. G Ramesh for his inspiration and for creating an atmosphere in
the college to do the seminar.

I would like to thank Dr. Renjith V. Ravi, Associate Professor and Head of the
department, in Electronics and Communication Engineering for providing permission
and facilities to conduct the seminar in a systematic way. I am highly indebted to
Mr.Vinod.c, Associate Professor and Head of department, in Electronics and
Communication Engineering for guiding us and giving timely advises, suggestions and
wholehearted moral support in the successful completion of this seminar.

My sincere thanks to Seminar co-ordinator Mrs. Priya KP, Asst. Professor in


Electronics and Communication Engineering for their wholehearted moral support in
completion of this seminar.

Last but not least, I would like to thank all the teaching and non-teaching staff and my
friends who have helped us in every possible way in the completion of this seminar.

SHIFNA.M
ABSTRACT

Brain-machine interfaces hold promise for the restoration of sensory and motor function and the
treatment of neurological disorders, but clinical brain-machine interfaces have not yet been widely
adopted, in part, because modest channel counts have limited their potential. In this white paper, we
describe Neuralink’s first steps toward a scalable high-bandwidth brain-machine interface system. We
have built arrays of small and flexible electrode “threads,” with as many as 3072 electrodes per array
distributed across 96 threads. We have also built a neurosurgical robot capable of inserting six threads
(192 electrodes) per minute. Each thread can be individually inserted into the brain with micron
precision for avoidance of surface vasculature and targeting specific brain regions. The electrode array
is packaged into a small implantable device that contains custom chips for low-power on-board
amplification and digitization: The package for 3072 channels occupies less than 23×18.5×2 mm3. A
single USB-C cable provides full-bandwidth data streaming from the device, recording from all
channels simultaneously. This system has achieved a spiking yield of up to 70% in chronically
implanted electrodes. Neuralink’s approach to brain-machine interface has unprecedented packaging
densityandscalabilityinaclinicallyrelevantpackage.
LIST OF
FIGURES

ADC: analog-to-digital converters


ASIC: application-specific integrated circuit
IrOx: iridium oxide
PCB: printed circuit board
LIST OF
FIGURES
TABLE OF CONTENT

CHAPTER NO. TITLE PAGE NO.

ACKNOWLEDGEMENT 3

ABSTRACT 4

LIST OF ABBREVIATIONS 5

LIST OF FIGURES 6

CHAPTER 1 INTRODUCTION 9

1.1 NEURALINK 10

CHAPTER 2 LITERATURE REVIEW 11

CHAPTER 3 SOURCE OF ELECTRICAL ENERGY 13

3.1 Mechanical Energy 14

3.2 Solar Energy 16

3.3 Electromagnetic Energy 18

3.4 Thermal Energy 20

3.5 Chemical Energy 22

3.6 Integrated Energy 24

CHAPTER 4 COUPLING OF SELF-POWERED EFFECT 26


IN

E-SKIN
4.1 Double Coupling Effects 27

4.2 Multiple Coupling Effects 29

CHAPTER 5 ADVANCED APPLICATIONS OF


SELF-POWERED E-SKIN 31
5.1 Physiological Health 31

5.2 HMI 32

5.3 VR 33

5.4 AI 34

5.5 Advantages 35

5.6 Disadvantages 35

5.7 Challenges In Self-powered E-skin Technology 36

CHAPTER 6 CONCLUSION 37

REFERENCE
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

CHAPTER 1

INTRODUCTION

Brain-machine interfaces have the potential to help people with a wide range of clinical
disorders. For example, researchers have demonstrated human neuroprosthetic control of
computer cursors [1-3], robotic limbs [4,5], and speech synthesizers [6] by using no more than
256 electrodes. Although these successes suggest that high-fidelity information transfer
between brains and machines is possible, development of brain-machine interface has been
critically limited by the inability to record from large numbers of neurons. Noninvasive
approaches can record the average of millions of neurons through the skull, but this signal is
distorted and nonspecific [7,8]. Invasive electrodes placed on the surface of the cortex can
record useful signals, but they are limited in that they average the activity of thousands of
neurons and cannot record signals deep in the brain [9]. Most brain-machine interfaces have
used invasive techniques, because the most precise readout of neural representations requires
recording single action potentials from neurons in distributed, functionally linked ensembles
[10].

Microelectrodes are the gold-standard technology for recording action potentials, but there is
no clinically translatable microelectrode technology for large-scale recordings [11]. This
would require a system with material properties that provide high biocompatibility, safety, and
longevity. Moreover, this device would also need a practical surgical approach and high-
density, low-power electronics to ultimately facilitate fully implanted wireless operation.

Most devices for long-term neural recording are arrays of electrodes made from rigid metals
or semiconductors [12-18]. Although rigid metal arrays facilitate penetrating the brain, the
size, Young modulus, and bending stiffness mismatches between stiff probes and brain tissue
can drive immune responses that limit the function and longevity of these devices [19,11].
Furthermore, the fixed geometry of these arrays constrains the populations of neurons that can
be accessed, especially due to the presence of vasculature.

An alternative approach is to use thin, flexible multielectrode polymer probes [20,21]. The
smaller size and increased flexibility of these probes should offer greater biocompatibility.
However, a drawback of this approach is that thin polymer probes are not stiff enough to
directly insert into the brain; their insertion must be facilitated by stiffeners [22,21], injection

Department of ECE 9
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

[23,24], or other approaches [25], all of which are quite slow [26,27]. To satisfy the functional
requirements for a high-bandwidth brain-machine interface, while taking advantage of the
properties of thin-film devices, we developed a robotic approach, where large numbers of fine
and flexible polymer probes are efficiently and independently inserted across multiple brain
regions [28].

Here, we report Neuralink’s progress toward a flexible, scalable brain-machine interface that
increases channel count by an order of magnitude over prior work. Our system has three main
components: ultra-fine polymer probes, a neurosurgical robot, and custom high-density
electronics (all of which are described below). We demonstrate the rapid implantation of 96
polymer threads, each thread with 32 electrodes, yielding a total of 3072 electrodes.

We developed miniaturized custom electronics that allow us to stream full broadband


electrophysiology data simultaneously from all these electrodes (described below). We
packaged this system for long-term implantation and developed custom online spike-detection
software that can detect action potentials with low latency. Together, this system serves as a
state-of-the-art research platform and the first prototype toward a fully implantable human
brain-machineinterface.

Department of ECE 10
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

CHAPTER 2

LITERATURE

REVIEW

Neuralink is a neurotechnology company founded by Elon Musk that aims to develop implantable
brain-machine interfaces. The company's goal is to create devices that can be implanted into the human
brain to help treat neurological conditions, enable direct communication between humans and
computers, and potentially enhance cognitive abilities.

Literature on Neuralink has primarily focused on the technological advancements and potential
applications of brain-machine interfaces. Some studies have explored the potential of Neuralink's
technology in treating neurological disorders such as Parkinson's disease, epilepsy, and spinal cord
injuries. Other research has discussed the ethical and privacy concerns surrounding the use of brain-
machine interfaces, as well as the potential societal implications of merging human brains with
artificial intelligence.

Overall, the literature on Neuralink suggests that while the technology holds great promise for medical
treatment and human enhancement, there are also significant ethical, regulatory, and societal
challenges that need to be addressed. As Neuralink continues to develop its technology and conduct
clinical trials, it is likely that more research will emerge on the potential benefits and risks of brain-
machineinterfaces.

Department of ECE 11
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

CHAPTER 3

WORKING

3.1 HOW DOES NEURALINK WORK

Neuralink is actively working on developing its brain-machine interface technology, with a


focus on creating high-bandwidth connections between the human brain and external devices.
The company has made significant progress in developing implantable devices that can record
and stimulate brain activity, and has conducted successful experiments with animal subjects.

In addition to its technical advancements, Neuralink has also been actively engaging with the
scientific community to discuss the potential applications and ethical considerations of its
technology. The company has presented its research at various scientific conferences and has
published papers detailing its findings and future directions.

Furthermore, Neuralink has been working on obtaining regulatory approval for its devices, as
well as addressing privacy and security concerns related to brain-machine interfaces. The
company has emphasized the importance of ethical and responsible development of its
technology, and has sought input from experts in various fields to ensure that its devices are
safe and beneficial for users.

Overall, Neuralink is making significant strides in the field of neurotechnology, and its work
has the potential to revolutionize the treatment of neurological conditions and enhance human
capabilities. As the company continues to make progress, it will be important for researchers,
policymakers, and the public to closely monitor the developments and consider the broader
implicationsbrain-machininterfaces.

Department of ECE 12
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

3.1 MECHANICAL ENERGY

Mechanical energy, as a ubiquitous energy source, is one of the most common and easily
accessible energies in our lives. The frequencies of available mechanical vibration in the
environment range from a few Hz (human steps, human heart rate, and the waves of the
sea) to a few kHz (the mechanical engine). To meet the needs of different frequencies
and pressure regions for self-powered e-skin, the piezoelectric effect and triboelectric
effect have come into being.

Piezoelectricity results from the deformation of an external object on a piezoelectric


material. The first PENG, developed by Wang and Song in 2006, is based on the
piezoelectric effect of ZnO nanowire and can convert the collect mechanical energy into
piezoelectricity. On this basis, several self-powered e-skin based on the piezoelectric
effect has been prepared to accurately identify the pressure applied to the e-skin. ( H.-
Kalantarian et.al.,2015). Recently, many studies have explored advanced structures
including nanostructures and two-dimensional (2D) materials. Mimicking human skins.
use two protective layers, two sensory layers, and one insulative layer to design the
tactile sensor array .The fundamental mechanism of e-skin based on the piezoelectric
effect , the applied pressure causes a change in the dipoles’ separation in the material,
resulting in a buildup of electric charges that occurred on the electrodes. According to ,
under the bending stimuli mode, the output voltage of the two sensory layers will be kept
synchronized and the voltage signal relates to the bending radius and angle. Attached to
the human body, this special structure of piezoelectric e-skin can easily simulate the
biological process of human beings, as depicted in 2D.

By using contact electrification and electrostatic induction mechanism to generate


electricity, TENG is a promising candidate for power supply and self-powered sensors.
Silver nanowires (AgNWs) in the middle are evenly distributed in the thermoplastic
polyurethane(TPU) nanofiber network as a stretchable electrode. When an active object
(such as hand or foot) is in contact with a dielectric layer (PDMS film), due to the strong
electronegativity of PDMS film, electrons from the active object (nylon film) are
transferred to the PDMS film .

Department of ECE 13
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

3.1.1 THREADS
Threads” are the ultra-thin, flexible polymer which will contain the elec-
trodes and will transfer the information and signals to the transmitter. These threads (4-
6 µm) are thinner than a human hair (17 µm) and have a length of 20 µm. An array
will contain 96 threads which will have 32 independent electrodes which means that an
array of threads contains 3,072 electrodes which makes transfer of high-volume of data
possible with just one array. A human brain also shifts its shape which can cause
damage to these threads, but the flexible nature of these threads makes them shift

Department of ECE 14
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

3.12 ROBORT

The “Robot” is designed


with a sole purpose of
inserting the threads in least
invasive manner. The Robot
consists of seven parts
a)
Loaded needle pincher
cartridge.
b)
Low-force contact brain
position sensor.
c)
Light modules with multiple
independent wavelengths.

Department of ECE 15
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

d)
Needle motor
.
The “Robot” is designed
with a sole purpose of
inserting the threads in least
invasive manner. The Robot
consists of seven parts
a)
Loaded needle pincher
cartridge.
b)
Low-force contact brain
position sensor.
c)
Department of ECE 16
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

Light modules with multiple


independent wavelengths.
d)
Needle motor
.
The “Robot” is designed with a sole purpose of inserting the threads in least invasive
manner. The Robot consists of seven parts
a) Loaded needle pincher cartridge.
b) Low-force contact brain position sensor.
c) Light modules with multiple independent wavelengths.
d) Needle motor.
e) One of four cameras focused on the needle during insertion

The needle is milled from 40-µm diameter tungsten-rhenium wire-stock electrochemically


etched to 24-µm diameter alongthe inserted length (Figure 2A). The tip of the needle is
designed both to hook onto insertion loops—for transporting and insertingindividual threads—
and to penetrate the meninges and braintissue. The needle is driven by a linear motor,
allowing variableinsertion speeds and rapid retraction acceleration (up to 30,000
mm/s2) to encourage separation of the probe from the needle.The pincher is a 50-µm tungsten
wire bent at the tip and driven both axially and rotationally (Figure 2B). It serves as a support
for probes during transport and as a guide to ensure that threads
are inserted along the needle path. Figure 3 shows a sequenceof photographs of the insertion
process into an agarose brain

Department of ECE 17
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

3.2 SOLAR ENERGY

The photodetector is the most common self-powered e-skin for light intensity detection.
The principle is to use the depletion layer generated by the PN junction to convert the
optical signal into an electrical signal to detect the intensity of light. Prepared a self-
powered e-skin for detecting ultraviolet light. The specific device schematic diagram in
figure ,this device made use of ZnO and PEDOT: PSS as heterojunctions and silver
nanowires(AgNWs) as conductive electrodes. prepared an infrared sensor based on this
principle.( M. Li et.al.,2020). The basic principle of the photovoltaic effect can be clearly
understood , which displays the energy band illustration of PEDOT: PSS/ZnO
heterojunction under lights. When the two are in contact, due to the difference in Fermi
level, electrons will flow from ZnO to PEDOT: PSS.

The flow of electrons stops when the thermal equilibrium is reached, thereby forming a
depletion zone at the interface. The dark current is effectively suppressed in the depletion
region. As a result, it improves the detection selectivity of the device. In the light, under
the action of the internal electric field of the PEDOT: PSS, the photo generated electrons
in the ZnO layer are ejected onto the AgNW electrode. At the same time, the photo
generated holes are attracted to the PEDOT: PSS, and the holes reach the electrodes.
With the increase of incident light intensity, more photons will participate and generate
more electron-hole pairs, and the photocurrent response will also increase. Represents
the relationship between the output current of the self-powered photodetector and
varying light intensities.

Another way to the intensity of light is to change the crystallinity of piezo-electric


material by sensing it’s temperature, thereby generating a voltage signal. Prepared
schematic plot and optical photo of the infrared sensor can be seen in figure below. The
melting under IR irradiation or after IR removal . Under IR light, localized and
microscopic PTHF-PEG crystal regions in the piezoelectric material melt, resulting in
localized volume expansion., and then compression internal stress on PVDF nanofiber .
The elastic micro-deformation f PVDF nanofibers and the peak voltage are generated.

Department of ECE 18
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

Fig 3.2 :Response of electronic skin to light intensity.


(A) Sketch map of the self-powered UV photodetector.
(B) Energy band chart of the PEDOT:PSS/ZnO heterojunction under light. (C)
Photo response under varying incident light intensity values. (D) Actual testing of
devices outdoors and indoors.
(E) Diagram and optical photographs of the infrared sensor.
(F) Working mechanism of e-skin response to IR on/off irradiation.
(G) Cyclic VOC of the photodetectors under intermittent IR lighting with
different intensity values.
(H) Reduplicative VOC and temperature signals of the e-skin under intermittent IR

Department of ECE 19
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

3.3 ELECTROMEAGNETIC ENERGY

RFID tags also have a significant place in the self-powered sensor field. Unlike normal
active RFID tags, which need to be connected to an external power source (such as a
battery) to power the radio frequency, passive RFID tags can power themselves by
extracting energy from the active radio frequency, ( A. Hande et.al.,2010). source and
using the inductance of the ring-shaped antenna to power for itself. This allows the label
to be made into different shapes such as sheets or hooks to be applied in different
environment, and the device is used almost forever. RFID tags are a very basic radio
frequency energy harvesting solution available on the market. Because the passive RFID
tag is thin and flexible, it can be easily attached anywhere. In order to achieve hydrogen
detection at room temperature, a wireless smart sensor based on RFID has been reported.
This sensor consists of a network analyzer-connected RFID antenna as a query reader,
and reduced graphene oxide (rGO) decorated by platinum (Pt) as a sensing label.( J. Li-
et.al.,2015). In the process of hydrogen detection, a robust affinity between the modified
Pt and hydrogen is generated, which changes the resistivity of the antenna and the
reflectivity of the RFID tag.

When the RFID sensor tag is located in the electromagnetic field of the RFID antenna,
the network analyzer emits an inquiry signal P1, which is feed backed to the RFID
reader antenna as P2. The target monitor can thus be analyzed based on the reflected
signal. Illustrates the sensor reflection calibration (normalized reflection change) against
different H2 concentrations. For all sensor label samples, the normalized reflection of
radio waves adds when H2 concentration adds. C-PPy nanoparticle is also a compound
that is very sensitive to gases. Prepared an RFID- based wireless sensor system with this
compound. This system consists of an RFID reader antenna and a commercial C-PPy
nanoparticles coated RFID tag.( J. Jun et.al.,2016). It can be found that the C-PPy sensor
is very sensitive to both NH3 and acetic acid, and is positively correlated with the
concentration of NH3, while the concentration of acetic acid is opposite. During the
sensing process, the network analyzer-connected RFID reader antenna emits a signal and
activates the sensor, then the emitted signal is fed back into the reader antenna, and the
network analyzer monitors the reflected signal in real-time. In an ammonia atmosphere,
the resistance change inthe chemical response material results in an impedance mismatch
between the dipole tag antennaand the IC (integrated circuit) chip.

Department of ECE 20
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

Fig 3.3: Response of electronic skin to light intensity.


(A) Schematic diagram of the RFID tag.
(B) Application of the RFID-based wireless sensor system.
(C) Reflection calibration and
(D) Phase shift calibration curves of the three tags against H2 concentration.
(E) Chart of the RFID sensor tag with carboxyl functional groups
covalently bonded to the aluminum tag.
(F) Relationship between NH3 concentration and reflectance change.
Change in reflectance properties of wireless response to
(G) acetic acid and
(H) ammonia.

Department of ECE 21
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

3.4 THERMAL ENERGY

The thermoelectric effect, self-powered temperature sensors have also arisen. Based on
the Seebeck effect, the thermoelectric effect can convert heat into electricity, which
creates a Voc between thermocouples (a combination of two different thermoelectric
materials).The heat generated by the temperature gradient of different heat sources, for
example, the body or environment, can be utilized by thermoelectric materials, which is
useful for health monitoring.( J. Wu et.al.,2014). Although the PEDOT: PSS coating is
not as efficient as ordinary inorganic thermoelectric materials, its flexibility makes it
ideal for self-powered e-skin. When the device is close to an object, the temperature
difference between the object and device can be detected through the typical
thermoelectric mechanism, resulting in an instantly measuring of the surface temperature
of objects just like human skin .On this basis, a simple stamp-printing approach was
utilized to construct a flexible temperature sensor array in translucent fabric gloves.

Due to its excellent flexibility and biocompatibility, the array of temperature sensors can
be worn on a prosthetic hand. When an adult female wrestles with the prosthetic hand,
the device can successfully detect and collect spatial resolution images with temperature
imaging characteristics. At the same time, the prepared device is also capable of very
small temperature differences. Shows the relationship between the measured voltages and
temperature gradients (0.1 to 100 K). Even the temperature difference of 0.1 K can be
easily measured by the device, indicating the very accurate temperature resolution of the
temperature sensor. Made a human hand-shaped e-skin ( J.Yuan et.al.,2020) and
attached it to a hand.

Department of ECE 22
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

Fig 3.4: Response of electronic skin to temperature.


(A) Schematic chart of temperature sensing mechanism.
(B) Optical figure of an arm-wrestling between a prosthetic hand and an adult
woman. The right figure shows the temperature mapping plots of pixel signals
during the arm-wrestling.
(C) Output voltage values of the sensor to a biased temperature gradient range
from 0 to 100 K.
(D) Schematic of the hand-shaped e-skin sensing system. (E) An amplified
view of a thermoelectric unit.
(F) The relationship between load voltages and different temperature gradients.

Department of ECE 23
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

3.5 CHEMICAL ENERGY

In addition to the temperature of the environment and the mechanical energy generated
by the human body, e-skin can also be a source of chemical potential energy. BFC can
extract chemical potential energy generated by human body fluids, such as saliva, urine,
sweat, and blood. In simple terms, ( M. Resmussen et.al.,2016) based on biocatalytic
oxidoreductase reactions, BFCs transform chemical energy into electrical energy. By
observing the amount of electricity generated, we can accurately understand the content
of biological components in the human body, and then make timely feed back to human
health.

Biofuel cells are classified according to their biochemical reactions and the properties of
their electrodes. Enzymatic BFCs uses enzymes to catalyze the oxidation of fuel, but the
life of the enzymes is very short and can only partially oxidize fuel. Microbial BFCs use
living cells to catalyze fuel, but fuel needs to be transported through cell membranes, so
the efficiency is very low. As a result, microbial BFCs are limited by low power density.
(B. Ringeisen et.al.,2006) Therefore, using BFC as a sensor for detecting chemical
substances is a very good choice. Through screen printing, flexible textile BFCs are
fabricated with the ability to detect biofuels. The bioanode is used as a redox mediator by
a single enzyme, that is, glucose oxidase (GOX) or lactate oxidase (LOx), and 1,4-
naphthoquinone (NQ).

Once the biofuel (such as glucose or lactic acid) is added, the biofuel is oxidized at the
anode by the enzyme, and electrons are liberated. In the cathode chamber, the Ag2O
receives these electrons to fulfill the power circuit. The power density of a biofuel cell
increases with the increasing concentration of added biofuel (glucose). The attractive
conductivity of the carbon nanotubes in the special inks achieves high power density,
which facilitates the electrons flowing between the anode and cathode.

Department of ECE 24
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

Fig 3.5: Response of electronic skin to chemical energy.


(A) The compositions of the stretchable lactate BFC.
(B) Power-concentration calibration chart of glucose.
(C) The self-generated current response against lactate concentration.
(D) Response of the BFC sensor to (a) 5 mmol L−1 lactate, (b) 84 mmol
L−1 creatinine, (c) 10 mmol L−1 ascorbic acid, (d) 0.17 mmol L−1 glucose,
and (e)59 mmolL-1 uric acid .
(E) Polarization of PDA with applied voltage in a humid environment.
(F) The self-powered wearable sensing system.
(G)Resistance of PDA membrane against RH
variation.
(H) Output voltage of the device to four different RH

Department of ECE 25
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

3.6 INTEGRATED ENERGY

Under the circumstances, it acts as both an energy harvesting device and a sensor. It’s
worth emphasizing that the difference between self-powered e-skin here and the self-
powered e-skin system. The former could generate sensing signals autonomously without
consuming external energy, but still requires an external power source to capture and
transmit sensing signals. The latter realizes the autonomous driving of the whole system
by integrating energy harvesting, self- sensing, signal processing, and transmission
modules efficiently. Among many physiological signals, sweat containing complex
physiological information has become a potential analysis target for noninvasive
continuous sensing of the human body. By collecting the mechanical energy in the
process of motion and using it as a sweat sensor platform, they provide a new research
idea for fully integrated self-powered e-skin.

Use all-in-one flexible circuit board processing technology to achieve the integrated
preparation of freestyle TENGs and flexible circuit modules, the platform can efficiently
capture the mechanical energy in human motion and convert it into electrical energy,
drive the stable work of electrochemical sensing units, and realize wireless signal
transmission and dynamic indicator monitoring of biomarkers (e.g., pH, sodium ions) in
sweat. ( Y. Song et.al.,2020). However, using a freestyle TENG to collect energy makes
the platform bulky, less flexible, and comfortable. On this basis, they also used biomass
energy in sweat as energy, using biofuel cells as a power supply device and integrating
biological and physical sensors on ultra-thin and transparent polyimide (PI) substrates to
build a new generation of self-powered e-skin. Key metabolic biomarkers such as
glucose, urea, NH4, and pH are collected and personalized information is wirelessly
transmitted to the user interface through Bluetooth Low Energy.

Department of ECE 26
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

Fig 3.6: Integrated self-powered electronic skin.


(A) Diagram of the sensor system for real-time health monitoring
(B) Optical photos of the sweat sensor platform attached on a human torso.
(C) Diagram of the biofuel-powered e-skin.
(D) Optical photographs of the e-skin on a healthy adult’s arm. Schematic plots of
(E) the flexible sensor and
(F) the soft e-skin interface.
(G) System-level encapsulation for biofluid sampling.

Department of ECE 27
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

CHAPTER 4

COUPLING OF SELF-POWERED EFFECT IN

ELECTRONIC SKIN

Commendable advances in the progress of e-skin have been realized recently. An e-skin
that can recognize a single physical parameter has been realized. However, the e-skin
needs to truly realize the integration of human skin’s sensing of physical parameters
including touch, temperature, humidity, etc. Only in this way can it be truly used in fields
of human–machine interface, medical and health, and so on. Single-effect self-powered
e-skins are apparently unable to meet application requirements. There is an imperative
need to develop coupled, multifunctional, integrated, and sustainable e-skin. ( H. Zhao-
et.al.,2020). Combining and integrating the above- mentioned multiple energy effects is
an effective way to develop a coupled self-powered multifunctional e-skin. For the
multifunctional coupling e-skins, the problems that need to be solved are as follows.

1. Integrate different energy effects into one structure, while ensuring the flexibility,
lightweight, and comfort of the device.

2. The e-skin system is capable of sensing multiple signals at the same time,
without signal interference. Until now, plenty of studies have conducted
systematic research on the material preparation, device assembly, and output
signal analysis of the coupled self- powered e-skin.

In this section, according to the number of coupling effects, we divide the recent
progress into two parts, “double coupling effects” and “multiple coupling effects,” for
facilitating the reader’s reading.The coupling effect of self-powered e-skin is a critical
aspect in understanding it’s overall performance . The integration of self-powered e-skin
allows the energy harvesting from environment, such as converting mechanical energy or
solar energy into electrical energy.

Department of ECE 28
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

4.1 DOUBLE COUPLING EFFECTS

Tribo-piezoelectric effects for pressure and tactile sensing, both triboelectric effect and
piezoelectric effect can convert mechanical energy into electrical energy.( C. K. Jeong-
et.al.,2019 ). Through combining them, the advantages of the two effects can be utilized
simultaneously to broaden the scope of application. Developed a self-powered e-skin
combining triboelectric effect and piezoelectric effect and achieved a wearable
multifunctional sensor. ( M. Zhu et.al.,2020). Fig 4.1 there is structure design diagram of
the hybrid e-skin. The triboelectric material is a rough and porous PDMS film designed
with a natural lotus leaf as the template. MWCNTs are doped into PVDF nanofibrous
film, which is acted as the piezoelectric material, and the electrodes are flexible
conductive fabrics. Fig 4.1 there is optical picture of the prepared sensor array. Depicts
the mechanism of the tribo- piezoelectric coupling effects.

Through the triboelectric effect, the e-skin can distinguish between different contact
materials and perform non-contact distance recognition. Displays that under the
synergistic effect of the triboelectric and piezoelectric effect, the device displays high
pressure sensitivity of 54.37 mV kPa−1 and 9.80 mV kPa−1 in 0–80 kPa and 80–240
kPa, respectively, and the device demonstrates excellent stability. In addition, Mariello et
al. also combined the two generator mechanisms to develop a conformal tribo-
piezoelectric e-skin with biocompatible materials. Are the schematic diagrams of the
structure and mechanism of the device, respectively. Its working mechanism is the three
effects of piezoelectric, skin-contact-actuation, and piezo-tribo hybrid contact. The
triboelectric signal and the piezoelectric signal overlap into one pressure signal, yielding
a hybrid output. The device has the characteristics of high sensitivity and a wide
detection range, and its highest pressure sensing sensitivity is 160 mV kPa−1between 50
and 120 kPa. The e-skin has a variety of functions, which can recognize human gait
walking, identify hand gestures through a sensor array system, and monitor joint
movements of the human body (neck, wrist, elbow, knee, ankle, etc.).

Department of ECE 29
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

Fig 4.1: Piezo-triboelectric coupling affects self-powered electronic skin.


(A) Structural sketch,
(B) optical photograph,
(C) working principle of the hybrid e-skin.
(D) Sensing performances of different materials.
(E) Voltage signal of the e-skin with different distances between PI.
(F) Pressure sensitivity ofthe 1 cm × 1 cm e-skin.
(G) The stability of the hybrid sensor.
(H) Exploded view of the hybrid sensor. The inset is an optical picture of the sensor.
(I) Working principle of the e-skin with the contraction-release cycle.
(J) Piezoelectric and triboelectric Voc signals, and the overlapped hybrid signal.
(K) Voltage output of the wearable hybrid sensor under pressure on skin

Department of ECE 30
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

4.2 MULTIPLE COUPLING EFFECT

Coupled photovoltaic, piezoelectric, and pyroelectric effects into a one-structure-based


nanogenerator for simultaneously acquiring 405 nm light, mechanical and thermal
energies. BaTiO3 (BTO), as a typical ferroelectric material, has pyroelectric and
piezoelectric effects, while the ITO (indium tinoxide)- BTO-Ag structure can generate
photovoltaic signal. The system could monitor changes in light, pressure, and
temperature, but it cannot reflect these three physical parameters at the same time.

Except for the integration of energy effects, the combination of device with power
generation effect and materials with specific sensing properties can also realize
multifunctional sensing system. Proposed a multifunctional flexible e-skin for real-time
measuring of stress, oxygen, and relative humidity.( H . H e e t . a l . , 2 0 1 7 ) . Figure
4.2 A the structure of the e-skin. Piezoelectric material PVDF and tetrapod ZnO (T-ZnO)
nanostructures are integrated in the fabric substrate. Figure 4.2 C, the optical image of
the e-skin. Are diagrams of the coupling principle. Stress can be sensed by the
piezoelectric effect of the material under the stimulation of mechanical energy.
Meanwhile, O2 can capture free electrons on T-ZnO, then decrease the electron density
and weaken the piezo-screening effect, thereby enlarging the output piezoelectric signal.
Water molecules will generate H3O+ ions after adsorption and act as charge carriers in
H2O-ZnO.

Therefore, the piezoelectric performance of e-skin will change with oxygen


concentration and humidity. This coupling effects make the e-skin has multifunctional
sensing performance. Besides, based on spider web and ant tentacle. Construct a layer-
by- layer multisensory e-skin, that can collect biomechanical energy via triboelectric
effect and achieve simultaneous measurement of pressure, RH, and temperature.
Compared with the double coupling effects, the multiple coupling effects e-skin faces
more challenges. Creating an e-skin with human like multifunctional abilities is an
inevitable trend for future wearable electronics.

Department of ECE 31
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

Fig 4.2: Multiple coupling effects self-powered e-skin.


(A) Schematic and
(B) picture of the coupled device.
(C,D) Working principles of TENG-PiENG (piezoelectric nanogenerator), and the
PyENG (pyroelectric nanogenerator).
(E) The smart visualized thermometer consists of the nanogenerator and LCD.
(F) Structure of the sensor system. Relationships between
output current of the e-skin and
(G) various light
(H) intensities, pressures, and
(I) temperature gradients. Optical photograph of
(J) ice placed on the e-skin,
(K) the e-skin under light of 405 nm, and ice cooling simultaneously.
(L) Current values of the e-skin under light of 405 nm only and simultaneous light
and cooling.

Department of ECE 32
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

CHAPTER 5

ADVANCED APPLICATIONS OF SELF-POWERED E-SKIN

By mimicking the comprehensive function of human skin perception, e-skin has realized
the perception of important physical signals such as humidity, sweat, touch, and
temperature, but e-skin has some key problems restricting its further development and
energy supply, so integrated e-skin based on various self-powered effects has become the
driving force for the further progress of e-skin. Here, self-powered e-skin applications in
physiological health, human–computer interaction(HMI), VR, and AI are described
systematically.

5.1 PHYSIOLOGICAL HEALTH

As technology continues to evolve, e-skin has become an excellent perception input end.
Because of the transmission of this perception, the field of e-skin and human health can
be matched. There are many sensing systems in the human body, and different parts have
unique physiological signal characteristics. If the e-skin is installed in the corresponding
key parts of the body, real-time monitoring of physiological parameters such as heart
rate, breathing, blood pressure, muscle tension can be achieved for disease prevention
and medical diagnosis. Designed a flexible and biodegradable e-skin based on a TENG
to effectively collect movement energy and detect systemic physiological signals. In
addition, due to the sterilization property of AgNWs, the e-skin also has significant
antibacterial property. Developed an ultra-thin electronic tattoo using carbon nanotubes
(CNTs) and silk nanofibers (SNFs), which is a typical sandwich structure
(SNF/CNT/SNF) and seamlessly connects to human skin . ( N. Gogurla et.al.,2021).
These electronic skins can monitor vital signs, such as temperature, hydration levels, and
even detect changes in blood flow. They have the potential to revolutionize healthcare by
providing real-time data for early detection of health issues and continuous monitoring
of patients. Additionally, E-skin could be used in prosthetics to enhance the integration
between artificial limbs and the human body, improving overall functionality and
comfort.

Department of ECE 33
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

5.2 HUMAN MACHINE INTERACTION

HMI is a new technology for transmitting information between humans and electronic
devices, which has attracted extensive attention from researchers in recent years. The
rapid development of wearable devices and robotics has put forward higher requirements
for traditional interactive media, such as flexibility, portability, and low power
consumption. E-skin is a new type of HMI media that enables people to seamlessly
connect with electronic devices. As a flexible sensor network, the main medium of the
next generation of HMI has gradually shifted to self-powered electronic skin due to its
multiple perception capabilities.

Prepared a simple, inexpensive, self-powered, human–machine electronic skin based on a


triboelectric-light effect. ( X .Zhao et.al.,2020). Upon contact with the electronic skin, the
stimulation is converted to electrical signals and instantaneous visible light and the device
only requires a pressure of 20 kPa to trigger. On this basis, a touch operation platform
can recognize more than 156 kinds of interaction logic, so as to easily control consumer
electronic products. The device can be used in fields such as gesture control and
intelligent prosthetics. Although HMI e-skin can project touch in space and provide
visual signal output to humans, high power consumption, complex structure, and high
cost are obstacles to practical application. E-skin can serve as an advanced interface,
allowing seamless interaction between humans and machines. This technology can be
employed in prosthetics, robotics, and wearable devices, enhancing the communication
and control between users and electronic systems. For example, users could manipulate
electronic devices or control prosthetic limbs more intuitively through touch or gestures,
facilitated by the responsive and sensitive nature of E-skin. This has the potential to
improve the overall user experience and accessibility in various technological
applications. Imagine a prosthetic limb with E-skin that can sense touch and pressure,
providing users with a more realistic and responsive feel. Advanced algorithms for real-
time data processing are embedded in the E-skin or connected devices. This processing
capability enhances the speed and accuracy of interpreting sensory data, making the
HMI more responsive.

Department of ECE 34
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

5.3VIRTUAL REALITY

Touch motions such as contact and friction between the system and the outside world are
converted into high voltage signals by TENG. The efficient conversion efficiency of
TENG drives the gap discharge between the electrodes and the skin. A high resolution,
sensitive and comfortable virtual electric touch is achieved with a low current. This
virtual electro-touch combines the effects of tactile sensing and electrostatic stimulation,
in which TENG not only recognizes and senses the tactile motions input from the outside
world but also converts the energy generated by touch into electrical stimulation signals
that are released to the human skin.

The e-skin sensing interface can act as a separate writing screen, feeding the tactile track
directly to the skin of the separated experiencer through a transmission line to achieve
virtual tactile communication. The author shows the application of this virtual tactile
system in self-powered braille recognition. ( Y. Shi et.al.,2021). By converting external
collisions into virtual electric touch, the application of self-powered e-skin in VR has
been broadened. VR technology refers to the use of computers and other technical
meansto generate a realistic visual, auditory, touch, taste, and another integrated virtual
environment, allowing participants to interact with objects in the virtual world through a
variety of senses, thus creating an experience immersed in the real environment.
However, compared with virtual hearing and vision, virtual touch often needs fast
response, high-resolution and large-scale biocompatible devices, which makes its
implementation more difficult. This technology has implications in gaming, simulation
training, and even therapeutic applications. By incorporating self-powered E-skin into
VR setups, users can experience a more comprehensive and responsive virtual world,
with the added benefit of untethered mobility due to the E-skin's ability to harvest its own
energy. This synergy between VR and self-powered E-skin contributes to the
advancement of interactive and lifelike virtual experiences.

Department of ECE 35
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

5.4 ARTIFICIAL INTELLIGENCE

Self-powered multifunctional e-skin is highly sensitive to perception characteristics. It


could generate a lot of data during the perception process. Efficient identification of
useful information has become a key issue in signal processing. The introduction of AI
and neural network algorithms could achieve good signal recognition functions.
Fabricated a fingerprint heuristic electronic skin (FE-skin) through neural network
algorithms, which can effectively identify different textures by processing electrical
signals collected through artificial neural networks, with a minimum texture size as low
as 6.5 µm.( X .Zhao et.al.,2021). In addition, the recognition accuracy of disordered and
ordered textures is 93.33% and 92.5%, respectively.

Displays the specific flow of the pressure sensing system. Once the skin in the fingertips
is under pressure, signals are transmitted to the brain through a protein transport
network. Finally, our brain will have analysis for the information of thepotential signals
to determine the type, intensity, and so on of mechanical stimulation. A biomimetic
tactile sensing system is designed by mimicking human beings in Biomimetic tactile
sensing systems could collect signals and even analyze the information contained. The
sensor senses the tactile information of the outside world and uses artificial neural
network to process the input data, thus forming the tactile nerve.

Emphasizes the time-frequency diagram of the e-skin contacting different roughness


sandpaper. and that the system has more than 90% accuracy over 20 training cycles.
How well the predicted tags overlap with the true tags and that they are accurate and
consistent. The use of artificial neural networks can greatly reduce the dependence on
specific projects. AI can enable the E-skin to adapt its functionality based on user
behavior and preferences. For instance, it can learn and adjust to the user's touch
patterns or respond differently to various stimuli, optimizing the user experience over
time. AI can be employed to optimize the energy harvesting and consumption of self-
powered E-skin. This ensures efficient use of harvested energy and potentially extends
the device's operational lifetime without the need for frequent recharging. AI can be
employed to optimize the energy harvesting and consumption of self-powered E-skin.

Department of ECE 36
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

5.5 ADVANTAGES

 It is easily portable

 It is sustainable

 Can used in real time operations

 Highly Secured and Reliable.

 Does not need any external battery for formation of signals

 Light weight

 It is versatile

 Can be used in monitoring heart rate , pressure other heart relates problems

 Used in HMI ( Human Machine Interaction) as strain sensor

 Used in Al (Artificial Intelligence) bionic tactile sensing system

 Can integrate with Internet Of Things (IoT) for efficient communication

5.6 DISADVANTAGES

 It has complex design

 It is not durable like skin , had durable issues

 Need more power than non self-powered e-skin

 High manufacturing cost

 Limited power generation

 Integration complexity

 Size and thickness constraints

Department of ECE 37
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

5.7 CHALLENGES IN SELF-POWERED E-SKIN TECHNOLOGY

Self-powered e-skin technology is facing some challenges

 E-skin can be sensitive to environmental conditions like temperature, humidity,


and light, affecting its performance and reliability.

 Integrating E-skin with other electronic systems and devices can be


challenging, requiring compatible interfaces and technologies

 Scaling up the production of E-skin for widespread use can be difficult, especially
if manufacturing processes are intricate or costly.

 If the E-skin is intended for use in medical or biological applications, ensuring


biocompatibility becomes crucial, adding an extra layer of complexity to the
design.

 Designing self-powered E-skin that is comfortable for users and meets their
expectations in terms of aesthetics and wearability is a challenge.

 Lack of standardized protocols and interfaces for self-powered E-skin


technologies hinders interoperability and may slow down the adoption

 Meeting regulatory standards for safety, environmental impact, and


electromagnetic interference can be challenging, especially as self-powered E-skin
devices

Department of ECE 38
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

REFERENCE

[1] Chen, Yunfeng, et al. “Recent progress in self‐powered multifunctional e ‐skin for
advanced applications.” Exploration, vol 2, no 1, 2022, doi.org/10.1002/exp.20210112.
PMID: 37324580; PMCID: PMC10191004.

[2] M. L. Hammock et.al, “ Recent Advances in Materials, Designs and Applications of


Skin Electronics”, volume 4, no. 1 2023, doi: 10.1109/OJNANO.2022.3218960 .

[3] S.Gong et.al, “Highly stretchy black gold e‐skin Nano patches as highly sensitive
wearablebiomedical sensors”. vol.1 no.4 2015. https://doi.org/10.1002/aelm.201400063.

[4] Byun, J et.al, “Electronic skins for soft, compact, reversible assembly of wirelessly
activated fully soft robots. Science Robotics”, vol. 18 no.3, 2018,
https://doi.org/10.1126/scirobotics.aas9020 .

[5] I. You et al, “Stretchable E‐Skin Apexcardiogram Sensor”. Advanced Materials, vol.
30 no. 28, 2016 6359–6364.https://doi.org/10.1002/adma.201600720.

[5] M. Togo et.al, “An enzyme-based microfluidic biofuel cell using vitamin K3-
mediated glucose oxidation”, vol.14 no. 52, 2007 4669–4674.
https://doi.org/10.1016/j.electacta.2007.01.067

[6] Wang C et.al, “An all-silk-derived dual- mode e-skin for simultaneous temperature–
pressure detection” , Applied Materials ; Interfaces, vol. 45 no. 9 , 2017, 39484–39492.
https://doi.org/10.1021/acsami.7b13356.

[7] X. Li et.al, “Onion-inspired Mxene/Chitosan-quercetin multilayers: Enhanced


response to H2O molecules for wearable human physiological monitoring”, vol. 329,
2021 129209. https://doi.org/10.1016/j.snb.2020.129209

[8] G. Lee, S. G. Lee, and K. Cho, “Advances in Biodegradable Electronic Skin:


Material Progress and Recent Applications in Sensing, Robotics, and Human–Machine
Interfaces,”, Advanced Materials, vol. 35, no. 4, 2023, p. 2203193,
doi:10.1002/adma.202203193

Department of ECE 39
Recent Progress In Self-powered Multifunctional E-skin For Advanced Applications

[9] Hande, A., Bridgelall, R., & Zoghi, B. “ Vibration energy harvesting for
disaster asset monitoring using active RFID tags”, Proceedings of the IEEE, vol. 9 ,
no.98, 2010, 1620–1628. https://doi.org/10.1109/jproc.2010.2050670 .

[10] J. Jun et.al, “ Wireless, room temperature volatile organic compound sensor based
on polypyrrole nanoparticle immobilized ultrahigh frequency radio frequency
identification tag”, vol. 48, no. 8 , 2016, https://doi.org/10.1021/acsami.6b08344.

[11] J. Wu et .al, “Polypyrrole nanotube film for Flexible Thermoelectric Application.


Synthetic Metals”, vol.196, 2016, .https://doi.org/10.1016/j.synthmet.2014.08.001.

[12] B. Ringeisen, “High power density from a miniature microbial fuel cell using shewanella
oneidensis DSP10”. Environmental Science & Technology, vol. 8, no.402006, 2629–
2634. https://doi.org/10.1021/es052254w.

[13] Y. Song et.al , ” Wireless battery-free wearable sweat sensor powered by human
motion” , vol.40,no.6, 2020, https://doi.org/10.1126/sciadv.aay9842.

[14] H. Zhao et.al, “Conjuncted photo-thermoelectric effect in ZNO–graphene


nanocomposite foam for self- powered simultaneous temperature and light sensing”.
Scientific Reports, vol.1 ,no.10, 2020 https://doi.org/10.1038/s41598-020-68790-w

Department of ECE 40

You might also like