Download as pdf or txt
Download as pdf or txt
You are on page 1of 8

Science Bulletin 67 (2022) 270–277

Contents lists available at ScienceDirect

Science Bulletin
journal homepage: www.elsevier.com/locate/scib

Article

An artificial neural network chip based on two-dimensional


semiconductor
Shunli Ma a,1, Tianxiang Wu a,1, Xinyu Chen a,1, Yin Wang a, Hongwei Tang a, Yuting Yao a, Yan Wang a,
Ziyang Zhu b, Jianan Deng b, Jing Wan b, Ye Lu b, Zhengzong Sun a, Zihan Xu c, Antoine Riaud a, Chenjian Wu d,
David Wei Zhang a, Yang Chai e, Peng Zhou a,⇑, Junyan Ren a,⇑, Wenzhong Bao a,⇑
a
State Key Laboratory of ASIC and System, School of Microelectronics, Fudan University, Shanghai 200433, China
b
State Key Laboratory of ASIC and System, School of Information Science and Technology, Fudan University, Shanghai 200433, China
c
Shenzhen Sixcarbon Technology, Shenzhen 518106, China
d
School of Electronic and Information Engineering, Soochow University, Suzhou 215006, China
e
Department of Applied Physics, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong, China

a r t i c l e i n f o a b s t r a c t

Article history: Recently, research on two-dimensional (2D) semiconductors has begun to translate from the fundamen-
Received 1 July 2021 tal investigation into rudimentary functional circuits. In this work, we unveil the first functional MoS2
Received in revised form 16 August 2021 artificial neural network (ANN) chip, including multiply-and-accumulate (MAC), memory and activation
Accepted 27 September 2021
function circuits. Such MoS2 ANN chip is realized through fabricating 818 field-effect transistors (FETs) on
Available online 5 October 2021
a wafer-scale and high-homogeneity MoS2 film, with a gate-last process to realize top gate structured
FETs. A 62-level simulation program with integrated circuit emphasis (SPICE) model is utilized to design
Keywords:
and optimize our analog ANN circuits. To demonstrate a practical application, a tactile digit sensing
MoS2
Two-dimensional (2D) FETs
recognition was demonstrated based on our ANN circuits. After training, the digit recognition rate
Artificial neural network (ANN) exceeds 97%. Our work not only demonstrates the protentional of 2D semiconductors in wafer-scale inte-
Multiply-and-accumulate (MAC) grated circuits, but also paves the way for its future application in AI computation.
Circuits Ó 2021 Science China Press. Published by Elsevier B.V. and Science China Press. All rights reserved.

1. Introduction ature [25], gas [26–29], and pressure sensing [30–32] for flexible
electronics, such as wearable devices [33] and electronic skins
Two-dimensional (2D) semiconductors such as semiconducting [25,34]. Meanwhile, the weak interlayer van der Waals forces
transition metal chalcogenides (TMDs) have become a promising allow different 2D materials to be vertically transferred and
material family for building circuitry owing to their outstanding stacked. Therefore, it is possible to fabricate three-dimensional
electronic transport properties, sensing capabilities, and mechani- (3D) monolithic integrated circuits by stacking multilayer 2D semi-
cal compliance [1–5]. In particular, monolayer MoS2 has been conductors with different properties and functions [35,36], which
widely investigated as a channel material for field-effect transis- may enable energy-efficient smart prosthesis (e.g., artificial retina,
tors (FETs) [6–8], mainly because of its 1.8 eV direct bandgap that nose, and skin).
gives rise to reasonably high mobility and large on/off ratio. These Natural sensing-computing is provided by sensing neurons and
characteristics make it suitable for logic circuits [3,9–11], analog the neurons located next to them. Similarly, integrating prepro-
circuits [12,13], memories [14,15], and photodetectors [16–18]. cessing directly on a sensor integrated circuit can significantly
The MoS2 FETs fabricated on the insulating substrate also share improve the speed and efficiency of the irregular signal processing
the similar structure and superiorities of the silicon-on-insulator in various types of sensors [37]. Integrating these functions into a
(SOI). Moreover, thanks to the atomic thin nature of 2D semicon- single package also ensures that power consumption is lower than
ductors, their environment-sensitive and flexible characteristics that in discrete components. Given the tremendous success of arti-
[19,20] make them promising materials for light [21–24], temper- ficial neural networks (ANN) for image processing and pattern
recognition [38-42], ANNs are foreseen to be key models used in
⇑ Corresponding authors. individual sensors and an overall system. Compared with digital
E-mail addresses: pengzhou@fudan.edu.cn (P. Zhou), junyanren@fudan.edu.cn ANN, analog ANN integrated circuits (ICs) are more suitable for
(J. Ren), baowz@fudan.edu.cn (W. Bao). preprocessing tasks due to their lower power consumption and
1
These authors contributed equally to this work.

https://doi.org/10.1016/j.scib.2021.10.005
2095-9273/Ó 2021 Science China Press. Published by Elsevier B.V. and Science China Press. All rights reserved.
S. Ma et al. Science Bulletin 67 (2022) 270–277

higher throughput. But unlike isolated sensor devices, the develop- [55,56]. All electrodes were patterned with an LED direct writer
ment of such sensing-computing architecture is more challenging (MicroWriter ML3) and subsequently deposited by electron beam
due to a large number of required transistors, accurate models, (E-beam) evaporation. CF4 and SF6 plasma etching were performed
and various types of circuits needed for signal amplification and to define the MoS2 channel region and via holes, respectively. The
data processing [43]. dielectric layer, 20-nm-thick HfO2, was deposited by atomic layer
The family of 2D semiconductors is potentially suitable for deposition (ALD). More experimental details are provided in the
building ANNs at the hardware level. First, semiconducting TMDs Supplementary materials (online).
grown on insulating substrates have a similar structure as silicon
on insulator (SOI), which provides low gate-induced drain leakage
3. Results and discussion
(GIDL) and substrate leakage current. Thus, for a device based on
TMDs with a relatively large bandgap like MoS2, its low leakage
3.1. Circuit architecture
current enables less energy consumption and a lower data refresh
rate for information storage devices such as in dynamic random-
An ANN model requires complex peripheral circuits. Previous
access memory (DRAM). Experimental results also suggest that
research into ANNs implemented in integrated circuits focused
MoS2 transistors show less 1/f noise than Si devices fabricated with
on devices built from memristors or flash memories that can per-
the complementary metal-oxide semiconductor (CMOS) process
form analog MAC operations [39–41,57]. However, most previous
[44–46]. Under the same signal energy, the signal-to-noise ratio
results lacked activation function or were complemented by
is sufficiently large that analog convolution calculations can be
peripheral silicon circuits, without which a neural network is
performed. Moreover, upon choosing appropriate voltage ranges,
merely a linear regression model.
a desirable correlation between the measured current and applied
Taking biological neurons as an example, neurons have multiple
voltage can be obtained for implementing analog matrix computa-
synapses which transmit sensed signals to soma. Each synapse can
tion [47]. Therefore, TMDs are ideal transistor candidates for
store and change the corresponding weight of the sensed signal,
implementing ANNs in application-specific integrated circuits
and a multiplication operation between the sensed signal and
[48], as they offer an advantageous combination of established
weight can be achieved. A soma then can realize an accumulation
sensing capabilities and outstanding transistor performance.
of multiplication results from all synapses. When the summation is
However, there are still obstacles to overcome before the use of
larger than the threshold, the soma will be activated and generate
2DLMs becomes practical. (1) Most previously demonstrated
output through an axon. A mathematical model of a biological neu-
devices are implemented using exfoliated 2DLM sheets with
ron is shown in Fig. 1a, where w1, w2  wn are synaptic weights,
micrometer size, limiting the circuit scale. Therefore, reliable
and x1, x2    xn are bio-electric signals. R is the integration opera-
wafer-scale material growth is under investigation [49,50]. (2)
tion in the soma and f indicates the activation function that gives
Fabricating wafer-scale 2D materials integrated circuits [5,13,51–
the output. The corresponding device model of one neuron is
53] is still in the early stage, especially gate-last technology with
shown in Fig. 1b. Its input signals come from various sensors,
accurate control over the threshold voltage VT. Additionally, an
and the MoS2 FETs perform a MAC operation, whose result is then
accurate device model for large-scale circuits still requires devel-
transmitted into an activation function circuit. The weight storage
opment. (3) An ANN requires a higher noise budget and linearity
and update can be enabled by MoS2 a-RAM, thus improving the
than a digital circuit, so that a more accurate device model is
speed of ANN. A complex ANN with multiple neurons is designed
needed. Analog convolutional neural network (CNN) design also
as shown in Fig. 1c. The proposed MoS2 ANN circuit consists of
requires additional circuits. A complete functional CNN requires
an input layer with 6 neurons with 10 synapses for each neuron,
various circuit modules, such as circuits for activation functions,
a fully connected layer, and an output layer with 10 neurons. In
memory, and the multiply-and-accumulate (MAC) operation [38–
each neuron, the MAC result is sent to a nonlinear activation func-
40,42,54].
tion circuit that maps the output results and normalizes them to
In this work, we develop a gate-last processing technique for
within a specified range (0 to 1). The fully connected layer connects
wafer-level MoS2 films and build a chip for general ANN process-
the input and output layers. Finally, an off-chip logical function
ing, which can be used for future smart sensing applications. The
classifier is used to label sensed targets. Based on our gate-last pro-
analog MAC can be realized on a dual-gate MoS2 FET. One MoS2
cessing technique for wafer-level MoS2 films [56], we then build a
transistor and one capacitor (1T-1C) form a simple storage module,
MoS2 chip for general ANN processing (Fig. 1d). Weight update and
which acts as an analog random-access memory (a-RAM). This chip
optimization come from off-chip control using the back propaga-
provides all fundamental functions required in AI computation:
tion (BP) algorithm [58]. Compared to previously reported ANN
convolution calculation, RAM, and activation function modules,
results based on RRAM or 2D semiconductors, our MoS2 chip inte-
which are all formed by 2D MoS2. A trained ANN is used for tactile
grates MAC, a-RAM, and activation function circuits (Fig. 1e), pre-
letter recognition with an accuracy greater than 97%. Thus, a
senting a major advance for practical circuitry applications.
2DLM-based ANN makes it possible to fabricate a sensing-
computation system beyond silicon.
3.2. Wafer-scale MoS2 film synthesis and device processing

2. Experimental Wafer-scale ANN circuits require high-quality 2DLM thin films.


While wafer-scale 2DLM synthesis by CVD has been recently
The wafer-scale monolayer MoS2 film used in this work was demonstrated [10,11,59], other challenges impede practical appli-
synthesized at atmospheric pressure through a two-temperature- cation, including the processing of electrical contacts and dielectric
zone chemical vapor deposition (CVD) system. An appropriate layer deposition due to the atomic thickness and complex interface
amount of sulfur powder (99.999%, Alfa Aesar) and MoO3 powder conditions. Here, based on the high-quality continuous MoS2 film
(99.95%, Alfa Aesar) were placed in a low-temperature zone (180 we previously reported [55,60,61] (Fig. 2a and Fig. S1 online), a
℃) and high-temperature zone (650 ℃) with a distance of 30 and gate-last technology is developed for MoS2 FETs (Fig. 2b) with
10 min sulfuration time, respectively. The top-gated MoS2 FETs the manufacturing processing flow shown in Fig. S2 (online). For
and circuits were fabricated directly on the 2-inch MoS2 wafer the subsequent simulations, the device parameters were esti-
upon our previously developed gate-last processing technique mated. The average mobility from 49 MoS2 TG-FETs was estimated
271
S. Ma et al. Science Bulletin 67 (2022) 270–277

x1 h1 O1
(a) x1
Synapse (c) Neuron-1 Neuron-1

w1 Neuron x2 h2 O2
Neuron-2 Neuron-2
Dendrite
x2 w2 Signals
from Output
x1w1 layer
Soma sensors x10 h6 On
x2w2 Neuron-6
Output Neuron-10
axon
Activation
function
Sum w1-w6 w7-w16
xnwn Off-chip
DAC for DAC for
xn wn control
weigh update weigh update
signals

(d) (e) Sensed


signals
Weight
update
(b)
Signal x1
Weight bias
Neuron Memory DAC DAC Memory Neuron
w1 Neuron
cell 1 cell 1 cell 4
Signal x2
Neuron
Weight Activation cell 2
w2 function
Neuron Memory DAC Neuron DAC Memory Neuron
cell 2 cell 3 cell 5
Signal xn
Artificial
Weight neuron
wn Neuron
Neuron Memory DAC cell 10 DAC Memory Neuron
cell 3 cell 6
Output signal

ANN output

Fig. 1. (Color online) Demonstration of the as-fabricated MoS2 ANN integrated circuit. (a) A mathematical analogy of a biological neuron. (b) An MoS2-based artificial neuron
cell including soma (MAC operation), dendrite (data input from sensor), and synapse (the a-RAM is to store the weight value). (c) Schematic diagram of the proposed ANN,
which consists of an activation function, MAC, a-RAM, and timing control circuits. h is the output of fully connected layer; O is the output of the ANN circuit. (d) A false-color
optical microscopic image of an as-fabricated ANN integrated circuit. Zoom in is a photograph of the integrated circuit in which the red square corresponds to the ANN circuit.
The scale bar is 1 mm. (e) Schematic circuit architecture of our MoS2-based ANN.

to be 51.1 cm2 V1 s1 with an average threshold voltage of Id / wij(l) xj(l) (see Supplementary materials (online) for more
VT = 1.4 V, as shown in Fig. 2c, d. Compared with the previously details). To better express the multiplication operation, Fig. 2f
reported gate-first processing-based MoS2-FETs [9,55,62,63], our shows a 3D plot of the measured current Id as a function of VG1
MoS2 TG-FETs exhibit E-mode characteristics and are more com- and VG2. The section cut above the gray plane corresponds to the
patible with traditional device processing, which reduces the inte- more linear region (relatively large VG1 and VG2 values), which is
gration difficulty of the large-scale circuits. apparently similar to the simulation results for an ideal multiplica-
Moreover, implementing high-performance analog circuits tion operation between VG1 and VG2, as shown in the inset. Fig. 2g
requires device modeling with higher accuracy [64–66]. For our outlines a multi-branch parallel MoS2 device and its corresponding
MoS2 FETs, we established a device model with analytic equations circuit structure. In such a structure, multiple MoS2 FET branches
and a level-62 SPICE model, whose results are consistent with the are connected in parallel by connecting all the drains together,
experimental results (Fig. 2c, d, also see Supplementary materials similar to a synapse-neuron structure. Therefore, the result of an
(online) for more details). HSPICE software can simulate and opti- accumulation operation corresponds to the total output current,
mize the analog circuits in ANNs, which reduces the excessive bur- expressed Iout = R Id. Fig. 2h shows the total current is a linear func-
den of repeated tests and ape-outs. The following section of this tion of branch number at different values of VG1 and VG2. The com-
paper shows how MoS2 can be used to build complex digital and plete matrix computation process is shown in Fig. 2i. G1 and G2 are
analog circuits for AI computation, which is a significant step for- connected to an input sensor signal xj and weight signal wij, where i
ward beyond laboratory-level 2DLM devices [6,64,65]. is the neuron, and j corresponds to the synapse in neuron i. Thus,
the total output current from the neuron i is proportional to hi =
Rwijxj, which indicates the MAC operation is now implemented.
3.3. MoS2 MAC structure for ANN computing A convolution operation can be implemented by multiple MAC
operations depending on the size of the input matrix, and our
Here, we examine how a MAC operation is implemented in MoS2 chip shown in Fig. 1d connects 10 input signals for convolu-
MoS2 circuits. As shown in Fig. 2e, a single-branch structure con- tion operations. Compared with a digital MAC circuit, which
sisting of a dual-gate transistor acts as a multiplication module, requires much more transistors and multiple types of blocks, our
which can be used for multiplication operations between the analog MoS2 transistor network is in principle more advantageous
weight w and an input signal x on dendrite j. The input data is con- in terms of chip area, calculation speed and power consumption.
nected to TG1 and the synapse weight is transmitted to TG2. Such a
dual-gate circuit is widely used for mixer or multiplier circuits
[67]. In our circuit, the channel under G1 works as a source- 3.4. Peripheral circuits: a-RAM (synapse) and activation function units
follower FET, and the G2 drain voltage is Vd-G2 = VG1–Vth-G1, where
Vth-G1 is the threshold voltage of gate G1. G2 works in the linear In addition to performing a MAC operation, the weight update
region because both VG1 and VG2 of T2 can be independently function is also the key for training an ANN, and dynamic weight
adjusted to modify output current Id. A multiplication between writing and holding can be implemented by connecting the circuit
VG1 and VG2 can be performed with only one MoS2 FET, i.e., in Fig. 2e with our a-RAM circuit, whose schematic diagram and
272
S. Ma et al. Science Bulletin 67 (2022) 270–277

(a) (b) (c) 2.5 (d) 10 -5

Experimental Experiment
Gate-last Simulation Simulation
processing 2.0 -7
10

ID (A/ m)
ID ( A/ m)
Top gate
1.5
10-9
HfO2
Source Drain 1.0
MoS2 10-11
0.5 500 m
Sapphire
0.0 10-13
-3 -2 -1 0 1 2 3 -3 -2 -1 0 1 2 3
VTG (V) VTG (V)

(e) (f) (g) TG1-1 TG2-1


TG1-2 TG2-2
(h) 0.4
HfO2
VG1 = VG2 VD = 0.1 V
TG1-n TG2-n
ID

ab
0.3 V
Drain Source 0.3

A/ m)
0.6 V
VG1 MoS2 0.9 V
ID ( A/ m)

a b Sapphire
TG1 0.2
Isum
VG2

Itotal
I1 I2 In
TG2 0.1

0
0 1 2 3 4
Branch #

VDD R h1,1=w1,1 x1,1 +w1,2x2,1 + +w1,10x10,1


(i) Vout

w1,1 w1,2 w1,10 x1,1 x1,2 x1,10 h1,1 h1,2 h1,10

wi,1 wi,2 wi,10 w2,1 x2,2 x2,10 h2,1 h2,2 h2,10


w2,1 w2,2 w2,10

x1,j x2,j x10,j h10,1 h10,2 h10,10


w10,1 w10,2 w10,10 w10,1 x10,2 x10,10

Fig. 2. (Color online) Wafer-scale MoS2 devices and working principle of the MAC module. (a) Two 2-inch-diameter sapphire wafers. The dark yellow wafer is uniformly
covered with MoS2 grown via CVD, and the other one is a bare sapphire wafer. (b) Schematic of a MoS2 TG-FET structure. (c, d) Transfer characteristics of 49 FETs located at the
center region of a wafer in linear and logarithmic scale, respectively. The red curves show simulation results. The insert shows a photograph of the MoS2 TG-FET arrays, in
which the scale bar is 500 lm. W = 30 lm, L = 20 lm. VD = 0.5 V. (e) Schematic diagram of the multiplier unit (one branch) consisting of a MoS2 FET with dual gates TG1 and
TG2. (f) 3D plot showing measured ID data as a function of VG1 and VG2 from the multiplier unit. VD = 0.5 V. At a relatively large voltage (the region cut above the gray plane),
the result is close to the ideal multiplication correlation between VG1 and VG2, and the inset shows simulation results for a∙b as a function of a and b. (g) The upper graph
shows a MoS2 device with parallel multi-branch dual-gate FETs, and the lower graph shows the corresponding schematic. (h) Total current as a function of the number of
multiplier branches, where the result shows a summation operation. (i) The corresponding simplified MAC circuit with a corresponding schematic diagram of the MAC
computation process.

electrical connections are shown in Fig. 3a. This consists of a MoS2 Due to ultralow current leakage through monolayer MoS2, the
FET T1 with a high on/off ratio for switching and a capacitor C, charge saved in the capacitor may persist in the neuronal layer
which is able to store the weight value of dendrite j. During the over many processing cycles. Consequently, Fig. 3d shows that dif-
training, the control voltage VC on the transistor is at a high level, ferent output current levels can be maintained on the order of 10 s,
and T1 is turned on to act as a low-impedance path. In the von Neu- which is sufficiently long for successive computation cycles in the
mann architecture, the computing and memory units are sepa- convolutional layer. It also confirms that the input signal Vin is suc-
rated, so that the computing unit needs to read and write the cessfully stored in the capacitor, and thus it can provide a high-
memory at high frequency, and data transmission becomes a com- resolution analog voltage control signal for VG1-T2, unlike an SRAM
puting bottleneck. Based on the aforementioned circuit design, it is structure that can only maintain binary 0 and 1 levels.
noticed that the a-RAM storage units and computing (MAC) mod- Besides the a-RAM module, activation function circuits were
ules are directly connected with each other (as shown in Fig. 3b), also designed and fabricated on our MoS2 chip. The activation func-
therefore, a computation-in-memory structure can be imple- tion circuit is used to process the convolutional output, which sim-
mented in our proposed ANN network. ply consists of two MoS2 FETs M1 and M2. The simulation results
We then test its memory functions. During a write operation, based on the 62-Level SPICE model are shown in the upper graph
the drain voltage on T1 acts as a bit line (BL) and is raised from 0 of Fig. 3e, where the gate of M2 is kept at a constant voltage and
to 1 V. Vg-T1 acts as a word line (WL) and is raised from 3 to M2 can be treated as a resistance RM2. RM2 changes accordingly to
3 V, as shown in Fig. 3c. Measured results are plotted as shown different control voltages Vc. The output voltage Vout is
in the red curve, whose first positive current pulse (in red) indi-
cates the capacitor has been recharged. During the hold state, T1 ðV in Þ
V out ðV in Þ ¼ RM1RðM1
V ÞþRM2 DD
V : ð1Þ
in
is turned off to provide a high-impedance path with low current
leakage for long-term retention. During a read operation, the BL When the input voltage Vin is small, we have Vout  VDD. By increas-
increases from 0 to 0.5 V and the WL shifts from 3 to 3 V. The ing Vin, RM1 approaches an appropriate range for Eq. (1) to act as an
negative measured current indicates charge remains stored after activation function whose gradient is gm1RM2, where gm1 is the
the hold time. transconductance of M1. When Vin continues increasing, Vout
273
S. Ma et al. Science Bulletin 67 (2022) 270–277

(a) a-RAM MAC


(c) (e)
4 80
WL 3 VDD
VDD Vc
VG M2
2 40
R BL Vin Vout
M1

Vin (V)
2

IC (nA)
Vout (V)
T1 0 0

T2
Vin
IC C -2 -40 1
0.5 V
Write Read 1.0 V
-4 -80 1.5 V 2.5 V
0 10 20 30 40 50 0
Time (ms) 2.0 V 3.0 V
(b) (d) VC 0V 1.5 V
800 T1 Vd = 0.1 V 3 0.5 V 2.0 V
T2
MAC Vin 1.0 V 2.5 V
Id 3.0 V
600

Vout (V)
Vin = 3.0 V 2
Id (nA)

400
Vin = 2.7 V 1
200
Vin = 2.3 V
a-RAM 0
0
2 4 6 8 10 -1 0 1 2 3
Time (s) Vin (V)
Fig. 3. (Color online) Peripheral circuits used to implement a complete ANN. (a) Schematic MoS2 circuit diagram resembling a neuron with one synapse, where the left a-RAM
circuit is used to store and update the weight. (b) An optical microscopic image of a multi-branch MoS2 MAC circuit with each branch connected an a-RAM. The scale bar is
150 mm. (c) Successive write and read operations of the 1T/1C unit. The retention time is longer than 10 s. (d) Measured ID value of transistor T2 controlled by the voltage
stored in the capacitor during one test cycle (10 s). Different values of Vin are used to charge the capacitance before turning off T1. (e) Simulated (upper graph) and measured
(lower graph) Vout vs. Vin for the activation function circuit with different control voltages Vc (lower graph). The inset in the upper graph shows a schematic circuit model.

approaches 0, which provides the required capability of an activa- online for more details). The skin perceives the shape of an object
tion function. By tuning VC of M2, different shapes of Vout can be because the generated pressure is similar to the shape of the
obtained, and the slope of the Vout -Vin curve corresponds to the object, which is how blind individuals can read Braille. In the
leaning speed. Thus, we can use VC as a tuning knob to control future, the pressure sensing function can be further integrated into
the ANN training process. The corresponding experimentally mea- our ANN-MoS2 circuits by taking advantage of the piezoelectric
sured results are shown in the lower graph of Fig. 3e, which properties of MoS2, which converts pressure into an electric signal
entirely satisfies the requirement of the activation function and mimics skin receptors [68–70].
described above. In Fig. 4b, we use a 3  3 array input to represent the tactile sen-
sation of touching a Braille character. Typical current distributions
3.5. Braille character recognition with a MoS2 ANN classifier for letters ‘N’, ‘V’ and ‘Z’ with different pressure levels are demon-
strated. The value of each tactile pixel is discretized into 256 pres-
Since the required synapse weight values are unknown, they sure levels. The inputs (I1, I2    I9) into the ANN correspond to 9
must be determined by training the network. Starting from small voltage values in the flattened input array. Therefore, the signals
random weight values, the network is fed with an input matrix I can be displayed as a voltage intensity mapping graph. In this
composed of sensed signals for ANN training, whose output matrix work, we generate pressure distribution library data by different
T is known. According to the current weights, the network com- samples, and three different distribution sets are designed for each
putes an output O that we want to be as close as possible to T. letter, and each set has 50 samples for further ANN testing (Fig. S9
Our proposed multilayer ANN takes inputs with 10 features and online). The input voltage range is from 0 to 3 V in our system,
classifies its output into 10 categories (Fig. S8 online). The synapse while the bias input V10 is fixed according to the algorithm. After
weights are optimized using gradient descent starting from small optimizing the weights for 23 training epochs, the obtained weight
random values. Like most machine learning applications, the values for the input and output layers are shown in Fig. 4c, which
weight optimization in our chip is realized off-chip (on a separate are subsequently updated by an off-chip algorithm implemented
computer) using the BP algorithm (details see Supplementary by Matlab (see Supplementary materials (online) for more details).
materials online). The ANN is trained by 50 sets of sample images as an input. The
Finally, we demonstrate a tactile Braille classifier algorithm that image classification is determined using forward propagation lay-
combines all the MoS2 circuits described above. The tactile sensa- ers which consist of convolution, activation in the hidden layer,
tion of skin is an important part of human perception, including and the fully connected layer. The final output layer is calculated
temperature, pain, vibration, and shapes by receptor neurons. to predict the total error as the y-axis in Fig. 4d, and the target
The skin receptors can also be divided into slow and fast adaptive matrix corresponds to vectors [0,0,1] for Z, [0, 1, 0] for N, and [1,
types, mainly depending on the location and distribution of the 0, 0] for V. Based on the simulation results, ultimately yielding a
receptor in the skin (Fig. 4a, also see Supplementary materials classification accuracy of 97%, as shown in Fig. 4d, e.
274
S. Ma et al. Science Bulletin 67 (2022) 270–277

(a) (b)
Pressure (static)

Vibration (low f )

Quiver (high f )

Applied Small pressure Large pressure


force
on skin
Current
pulse

(c) Input layer Output layer (d) (e)


103

Mean squared error (mse )


100

Recognition rate (% )
10-2 80
W (V)

W (V)

60
10-7
40

10-12 20
0
10-17
1 11 21 31 41 1 11 21 31 41
Train number Train number

Fig. 4. (Color online) A tactile sensation demonstration based on MoS2 ANN circuits. (a) Schematic showing three types of sensors in different locations on human skin
corresponding to three different vibration modes. The bottom graph shows generated current pulses with small and large pressures. (b) Current distribution for letters ‘N’, ‘V’,
and ‘Z’ with different pressure levels and classification results after successive training epochs. (c) The weights of the input and output layers which are optimized for 23
training epochs. (d) The mean squared error of the ANN network as a function of training number. (e) The recognition rate of the ANN network versus as the number of
training epochs.

4. Conclusion most of the devices. Tianxiang Wu, Xinyu Chen, Yin Wang, Hong-
wei Tang, and Jianan Deng performed electrical measurements.
To conclude, we used high-quality uniform MoS2 thin films to Yuting Yao, Yan Wang, and Ziyang Zhu performed the device sim-
produce the first analog-ANN circuit based on MoS2. These analog ulation. Zihan Xu and Zhengzong Sun prepared the 2D semicon-
circuits were designed and optimized using high-fidelity Level-62 ductors. Jing Wan, Ye Lu, Chenjian Wu, Chai Yang, and Renjun
SPICE models for MoS2 FET transistors. The chip includes 16 artificial Yan advised the circuit design and test. Antoine Riauda, Peng Zhou,
neurons organized in two layers. Each artificial neuron consists of and David Wei Zhang discussed the results. All authors contributed
MAC units acting as soma, an a-RAM memory to store the synapse to the preparation of the manuscript.
weights, and a nonlinear activation circuit. After the off-chip opti-
mization of weight values the device provides a Braille letter recog-
Appendix A. Supplementary materials
nition rate above 97%. Such illustrated proof-of-concept ANN system
integrates the essential functions required for practical ANN-
Supplementary materials to this article can be found online at
preprocessing applications, and definitely has room for further opti-
https://doi.org/10.1016/j.scib.2021.10.005.
mization since this is only an early-stage exploration. In addition,
due to the atomically thin and air-stable nature of 2DLMs, our
MoS2-based ANNs can be fabricated on flexible substrates for bio- References
compatible and implantable applications, such as energy-efficient
[1] Wang H, Yu L, Lee YH, et al. Large-scale 2D electronics based on single-layer
sensing, perception and processing functions in one device.
MoS2 grown by chemical vapor deposition. IEEE IEDM 2012:4.6.1.
[2] Akinwande D, Petrone N, Hone J. Two-dimensional flexible nanoelectronics.
Coflinct of interest Nat Commun 2014;5:5678.
[3] Fiori G, Bonaccorso F, Iannaccone G, et al. Electronics based on two-
dimensional materials. Nat Nanotechnol 2014;9:768–79.
The authors declare that they have no conflinct of interest. [4] Wang Y, Kim JC, Wu RJ, et al. Van der waals contacts between three-
dimensional metals and two-dimensional semiconductors. Nature
Acknowledgments 2019;568:70–4.
[5] Li N, Wang Q, Shen C, et al. Large-scale flexible and transparent electronics
based on monolayer molybdenum disulfide field-effect transistors. Nat
This work was supported by the National Key Research Electron 2020;3:711–7.
and Development Program of China (2016YFA0203900, [6] Verreck D, Arutchelvan G, Lockhart De La Rosa CJ, et al. The role of
nonidealities in the scaling of MoS2 FETs. IEEE Trans Electron Devices
2018YFB2202500), Innovation Program of Shanghai Municipal
2018;65:4635–40.
Education Commission (2021-01-07-00-07-E00077), Shanghai [7] Desai SB, Madhvapathy SR, Sachid AB, et al. MoS2 transistors with 1-nanometer
Municipal Science and Technology Commission (18JC1410300, gate lengths. Science 2016;354:99–102.
21DZ1100900), Research Grant Council of Hong Kong [8] Radisavljevic B, Radenovic A, Brivio J, et al. Single-layer MoS2 transistors. Nat
Nanotechnol 2011;6:147–50.
(15205619), the National Natural Science Foundation of China [9] Wachter S, Polyushkin DK, Bethge O, et al. A microprocessor based on a two-
(61925402, 61934008, and 6210030233), and the Natural Science dimensional semiconductor. Nat Commun 2017;8:14948.
Foundation of Shanghai (21ZR1405700). [10] Lin Z, Liu Y, Halim U, et al. Solution-processable 2D semiconductors for high-
performance large-area electronics. Nature 2018;562:254–8.
[11] Zhang Qi, Wang X-F, Shen S-H, et al. Simultaneous synthesis and integration of
Author contributions two-dimensional electronic components. Nat Electron 2019;2:164–70.
[12] Gao Q, Zhang Z, Xu X, et al. Scalable high performance radio frequency
electronics based on large domain bilayer MoS2. Nat Commun 2018;9:4778.
Wenzhong Bao, Junyan Ren, Shunli Ma, and Peng Zhou con- [13] Polyushkin DK, Wachter S, Mennel L, et al. Analogue two-dimensional
ceived the idea and supervised the project. Xinyu Chen fabricated semiconductor electronics. Nat Electron 2020;3:486–91.

275
S. Ma et al. Science Bulletin 67 (2022) 270–277

[14] Hou X, Chen H, Zhang Z, et al. 2D atomic crystals: a promising solution for [51] Chou AS, Shen PC, Cheng CC, et al. High on-current 2D nFET of 390 lA/lm at
next-generation data storage. Adv Electron Mater 2019;5:1800944. VDS = 1 V using monolayer CVD MoS2 without intentional doping. In:
[15] Liu C, Yan X, Song X, et al. A semi-floating gate memory based on van der waals Proceedings of the 2020 IEEE Symposium on VLSI Technology. p. 1–2.
heterostructures for quasi-non-volatile applications. Nat Nanotechnol [52] Sebastian A, Pendurthi R, Choudhury TH, et al. Benchmarking monolayer MoS2
2018;13:404–10. and WS2 field-effect transistors. Nat Commun 2021;12:693.
[16] Xiang D, Liu T, Xu J, et al. Two-dimensional multibit optoelectronic memory [53] Ahmed Z, Afzalian A, Schram T, et al. Introducing 2D-FETs in device scaling
with broadband spectrum distinction. Nat Commun 2018;9:2966. roadmap using DTCO. IEEE IEDM 2020.
[17] Roy K, Padmanabhan M, Goswami S, et al. Graphene–MoS2 hybrid structures [54] Esteva A, Kuprel B, Novoa RA, et al. Dermatologist-level classification of skin
for multifunctional photoresponsive memory devices. Nat Nanotechnol cancer with deep neural networks. Nature 2017;542:115–8.
2013;8:826–30. [55] Xu H, Zhang H, Guo Z, et al. High-performance wafer-scale MoS2 transistors
[18] Liu C, Chen H, Hou X, et al. Small footprint transistor architecture for toward practical application. Small 2018;14:1803465.
photoswitching logic and in situ memory. Nat Nanotechnol 2019;14:662–7. [56] Sheng Y, Chen X, Liao F, et al. Gate stack engineering in MoS2 field-effect
[19] Lee G-H, Yu Y-J, Cui X, et al. Flexible and transparent MoS2 field-effect transistor for reduced channel doping and hysteresis effect. Adv Electron
transistors on hexagonal boron nitride-graphene heterostructures. ACS Nano Mater 2021;7:2000395.
2013;7:7931–6. [57] Cai F, Correll JM, Lee SH, et al. A fully integrated reprogrammable memristor–
[20] Cheng R, Jiang S, Chen Y, et al. Few-layer molybdenum disulfide transistors and cmos system for efficient multiply–accumulate operations. Nat Electron
circuits for high-speed flexible electronics. Nat Commun 2014;5:5143. 2019;2:290–9.
[21] Huo N, Konstantatos G. Ultrasensitive all-2D MoS2 phototransistors enabled by [58] Fitzsimonds RM, Song HJ, Poo MM. Propagation of activity-dependent synaptic
an out-of-plane MoS2 pn homojunction. Nat Commun 2017;8:572. depression in simple neural networks. Nature 1997;388:439–48.
[22] Lopez-Sanchez O, Lembke D, Kayci M, et al. Ultrasensitive photodetectors [59] Yang P, Zou X, Zhang Z, et al. Batch production of 6-inch uniform monolayer
based on monolayer MoS2. Nat Nanotechnol 2013;8:497–501. molybdenum disulfide catalyzed by sodium in glass. Nat Commun
[23] Kim KS, Ji YJ, Kim KH, et al. Ultrasensitive MoS2 photodetector by serial nano- 2018;9:979.
bridge multi-heterojunction. Nat Commun 2019;10:4701. [60] Zhang S, Xu H, Liao F, et al. Wafer-scale transferred multilayer MoS2 for high
[24] Goossens S, Navickaite G, Monasterio C, et al. Broadband image sensor array performance field effect transistors. Nanotechnology 2019;30:174002.
based on graphene-CMOS integration. Nat Photonics 2017;11:366–71. [61] Tang H, Niu W, Liao F, et al. Realizing wafer-scale and low-voltage operation
[25] Hua Q, Sun J, Liu H, et al. Skin-inspired highly stretchable and conformable MoS2 transistors via electrolyte gating. Adv Electron Mater 2020;6:1900838.
matrix networks for multifunctional sensing. Nat Commun 2018;9:244. [62] Yu L, El-Damak D, Radhakrishna U, et al. Design, modeling, and fabrication of
[26] Schedin F, Geim AK, Morozov SV, et al. Detection of individual gas molecules chemical vapor deposition grown MoS2 circuits with E-mode FETs for large-
adsorbed on graphene. Nat Mater 2007;6:652–5. area electronics. Nano Lett 2016;16:6349–56.
[27] Perkins FK, Friedman AL, Cobas E, et al. Chemical vapor sensing with [63] Yu L, Ha S, Ling X, et al. Enhancement-mode single-layer CVD MoS2 FET
monolayer MoS2. Nano Lett 2013;13:668–73. technology for digital electronics. IEDM 2015.
[28] Cui S, Wen Z, Huang X, et al. Stabilizing MoS2 nanosheets through SnO2 [64] Kim DH, Jeon YW, Kim S, et al. Physical parameter-based spice models for
nanocrystal decoration for high-performance gas sensing in air. Small InGaZnO thin-film transistors applicable to process optimization and robust
2015;11:2305–13. circuit design. IEEE Electron Device Lett 2012;33:59–61.
[29] Late DJ, Huang Y-K, Liu B, et al. Sensing behavior of atomically thin-layered [65] You W-X, Su P. A compact subthreshold model for short-channel monolayer
MoS2 transistors. ACS Nano 2013;7:4879–91. transition metal dichalcogenide field-effect transistors. IEEE Trans Electron
[30] Schwartz G, Tee B-K, Mei J, et al. Flexible polymer transistors with high Devices 2016;63:2971–4.
pressure sensitivity for application in electronic skin and health monitoring. [66] Perumal C, Ishida K, Shabanpour R, et al. A compact a-IGZO TFT model based
Nat Commun 2013;4:1859. on MOSFET SPICE Level=3 template for Analog/RF circuit designs. IEEE Electron
[31] Yu F, Liu Q, Gan X, et al. Ultrasensitive pressure detection of few-layer MoS2. Device Lett 2013;34:1391–3.
Adv Mater 2017;29:160326. [67] Razavi B, Behzad R. Rf microelectronics. New Jersey: Prentice Hall; 1998.
[32] Gong S, Schwalb W, Wang Y, et al. A wearable and highly sensitive pressure [68] Park W, Yang JH, Kang CG, et al. Characteristics of a pressure sensitive touch
sensor with ultrathin gold nanowires. Nat Commun 2014;5:3132. sensor using a piezoelectric PVDF-TrFE/MoS2 stack. Nanotechnology
[33] Sugiyama M, Uemura T, Kondo M, et al. An ultraflexible organic differential 2013;24:475501.
amplifier for recording electrocardiograms. Nat Electron 2019;2:351–60. [69] Lee J, Feng PX. Atomically-thin MoS2 resonators for pressure sensing. In: IEEE
[34] Kim J, Lee M, Shim HJ, et al. Stretchable silicon nanoribbon electronics for skin International Frequency Control Symposium (FCS). p. 1–4.
prosthesis. Nat Commun 2014;5:5747. [70] Lu W, Yu P, Jian M, et al. Molybdenum disulfide nanosheets aligned vertically
[35] Liu Y, Weiss NO, Duan X, et al. Van der waals heterostructures and devices. Nat on carbonized silk fabric as smart textile for wearable pressure-sensing and
Rev Mater 2016;1:16042. energy devices. ACS Appl Mater Interfaces 2020;12:11825–32.
[36] Jiang J, Parto K, Cao W, et al. Monolithic-3D integration with 2D materials:
toward ultimate vertically-scaled 3D-ICs. In: IEEE SOI-3D-Subthreshold
Microelectronics Technology Unified Conference (S3S). p. 15–8.
[37] Zhou F, Zhou Z, Chen J, et al. Optoelectronic resistive random access memory Shunli Ma received his B.S. degree in Micro-electronics
for neuromorphic vision sensors. Nat Nanotechnol 2019;14:776–82. Engineering from Shanghai Jiao Tong University in 2011,
[38] Ambrogio S, Narayanan P, Tsai H, et al. Equivalent-accuracy accelerated and his Ph.D. degree in Micro-electronics Engineering
neural-network training using analogue memory. Nature 2018;558:60–7. from Fudan University in 2016. From 2012 to 2014, he
[39] Graves A, Wayne G, Reynolds M, et al. Hybrid computing using a neural was a project officer at Nanyang Technological Univer-
network with dynamic external memory. Nature 2016;538:471–6. sity. He is currently an assistant professor at the State
[40] Wang Z, Li C, Song W, et al. Reinforcement learning with analogue memristor Key Laboratory of ASIC and System, Fudan University.
arrays. Nat Electron 2019;2:115–24. His research interest includes 2D semiconductor IC
[41] Prezioso M, Merrikh-Bayat F, Hoskins BD, et al. Training and operation of an design and mm-wave integrated-circuit design, includ-
integrated neuromorphic network based on metal-oxide memristors. Nature ing mm-wave imaging sensing, mm-wave PLL and high-
2015;521:61–4. speed sampler in ADC, and biomedical RF circuits for
[42] Kim K-H, Gaba S, Wheeler D, et al. A functional hybrid memristor crossbar-
cancer detection.
array/cmos system for data storage and neuromorphic applications. Nano Lett
2012;12:389–95.
[43] Li C, Hu M, Li Y, et al. Analogue signal and image processing with large
memristor crossbars. Nat Electron 2018;1:52–9.
[44] Srinivasan P, Choi YS, Marshall A. Context dependent effects on LF (1/f) noise in Tianxiang Wu received his B.S. degree from Anhui
advanced cmos devices. IEDM 2010. University in 2014, and his M.S. degree from Southeast
[45] Xie X, Sarkar D, Liu W, et al. Low-frequency noise in bilayer MoS2 transistor. University in 2017. He is currently pursuing his Ph.D.
ACS Nano 2014;8:5633–40. degree in Micro-electronics Engineering at Fudan
[46] Sangwan VK, Arnold HN, Jariwala D, et al. Low-frequency electronic noise in University. His current research interest includes the
single-layer MoS2 transistors. Nano Lett 2013;13:4351–5. design of PLL and 2D semiconductor circuit design.
[47] Chen W-H, Dou C, Li K-X, et al. Cmos-integrated memristive non-volatile
computing-in-memory for AI edge processors. Nat Electron 2019;2:420–8.
[48] Mennel L, Symonowicz J, Wachter S, et al. Ultrafast machine vision with 2D
material neural network image sensors. Nature 2020;579:62–6.
[49] Kang K, Xie S, Huang L, et al. High-mobility three-atom-thick semiconducting
films with wafer-scale homogeneity. Nature 2015;520:656–60.
[50] Li T, Guo W, Ma L, et al. Epitaxial growth of wafer-scale molybdenum disulfide
semiconductor single crystals on sapphire. Nat Nanotechnol 2021;16:1201.

276
S. Ma et al. Science Bulletin 67 (2022) 270–277

Xinyu Chen received her B.S. degree from Xidian Junyan Ren received his B.S. degree in Physics and his
University in 2018. She is currently pursuing her Ph.D. M.S. degree in Electronics Engineering from Fudan
degree in Micro-electronics Engineering at Fudan University in 1983 and 1986, respectively. In 2000, he
University. Her current research interest includes joined Department of Microelectronics, Fudan Univer-
emerging devices and circuits based on 2D transition sity, where he is currently a full professor. Since 1992,
metal dichalcogenides (TMDS), especially MoS2, and the he has been a Research Member of the State Key Labo-
photoelectric performance of MoS2 photodetectors. ratory of ASIC and System. His research interest includes
data conversion, signal processing, and analog/RF/
mixed-signal designs.

Peng Zhou received his B.S. (2001) and Ph.D. (2006) Wenzhong Bao is a full professor at School of Micro-
degrees in Physics from Fudan University, and now he is electronics, Fudan University. He received his Ph.D.
a full professor at Fudan University. His research focuses degree from the University of California, Riverside
on novel memory devices based on two-dimensional (2011). He then worked as a joint postdoc at the
layered materials. University of Maryland College Park and the King
Abdullah University of Science and Technology from
2012 to 2015. His current research interest includes
emerging advanced materials and their applications in
next-generation electrical, optoelectrical and energy
devices.

277

You might also like