Modeling and Signal Integrity Analysis of RRAM-Based Neuromorphic Chip Crossbar Array Using Partial Equivalent Element Circuit (PEEC) Method
Modeling and Signal Integrity Analysis of RRAM-Based Neuromorphic Chip Crossbar Array Using Partial Equivalent Element Circuit (PEEC) Method
Modeling and Signal Integrity Analysis of RRAM-Based Neuromorphic Chip Crossbar Array Using Partial Equivalent Element Circuit (PEEC) Method
9, SEPTEMBER 2022
Abstract— This paper provides a comprehensive study of signal Index Terms— Neuromorphic chip, RRAM-based cross bar
integrity issues in RRAM-based neuromorphic chip crossbar array, partial equivalent element circuit (PEEC), Izhikevich
arrays due to interconnect parasitic. First, the parasitic para- neuron model, signal integrity (SI).
meters of the crossbar array are calculated by the partial equiv-
alent element circuit (PEEC) method with an efficient unit-cell
I. I NTRODUCTION
approach. Numerical experiments show that for a 50 × 50 array
scale, this method consumes only 1.5% of the calculation time
of the commercial software based 3D model, which translates
to a calculation speed up of 72 times. Moreover, the PEEC
P RESENTLY the spiking neural network (SNN) is hailed
as the third-generation neural network model and the
neuromorphic chip is the preliminary realization of SNN
circuit simulation results match well with those of the 3D model.
Then, we investigate the effects of parasitic parameters such in hardware. Its storage-calculation integration solves the
as capacitance and inductance, as well as the feature size of “storage wall” problem caused by the separation of calcula-
the crossbar array on signal integrity. All of them will lead to tion and storage units in the von Neumann architecture [1].
corresponding changes in parasitic effects, which in turn result The neuromorphic chip is designed to accelerate artificial
in the most common signal integrity issues such as crosstalk, intelligence algorithms [2] and emulate the structure of bio-
time delay and mutual capacitive coupling induced sneak path
problem. Different from other studies, the excitation used in this logical neural networks through circuits [3]. It has the advan-
paper is the neural spike signal generated by the Izhikevich tages of low power consumption and high efficiency [4], [5].
neuron model, which is both rich in dynamic characteristics and The neuromorphic chip uses spiking signals to simulate bio-
high in computational efficiency. Finally, based on the study we logically spiking neurons. There are several well-known and
propose a simple but effective design scheme for reduction of representative neuron models, mainly Hodgkin-Huxley (HH)
signal distortion, which can provide valuable design guidance
for neuromorphic systems to achieve high performance and high model [6], the integrate-and-fire (IF) model [7], the leaky
computational accuracy. integrate-and-fire (LIF) model [8], and the Izhikevich neuron
model [9]. Compared with traditional digital signal, the spiking
Manuscript received 8 March 2022; revised 20 May 2022; accepted signal has an extremely short duration with narrow rising and
31 May 2022. Date of publication 9 June 2022; date of current version
30 August 2022. This work was supported in part by the National Natural falling edges that contains infinite high-frequency harmonic
Science Foundation of China (NSFC) under Grant 62071424 and Grant components. Therefore, it inevitably leads to a series of
62027805 and in part by the Zhejiang Provincial Natural Science Foun- electromagnetic integrity problems, such as more severe signal
dation of China (ZPNSFC) under Grant LD21F010002. This article was
recommended by Associate Editor R. Joshi. (Corresponding authors: Yan Li; noise, transmission crosstalk, and signal leakage [10].
Er-Ping Li.) The emerging resistive random access memory (RRAM)
Yan Li, Lidan Fang, and Ning Jin are with the Key Laboratory of Electro- [11], also known as memristor, is a variable resistor [12].
magnetic Wave Information Technology and Metrology of Zhejiang Province,
College of Information Engineering, China Jiliang University, Hangzhou It is a neuromorphic device that is widely used as artificial
310018, China (e-mail: liyan@cjlu.edu.cn; s20030810005@cjlu.edu.cn; synapses [13]in various fields of neuromorphic systems. The
jinning1117@cjlu.edu.cn). RRAM-based crossbar array emulates the structure of a bio-
Tuomin Tao, Da Li, Manareldeen Ahmed, and Er-Ping Li are with the
Key Laboratory of Advanced Micro/Nano Electronic Devices and Smart logical neural network which can be stacked up as a three-
System, Zhejiang University, Hangzhou 310027, China, and also with the dimensional model to achieve a high-density structure [14].
Zhejiang University–University of Illinois at Urbana–Champaign Institute, However, the reliability of crossbar arrays will deteriorate due
Zhejiang University, Haining 314400, China (e-mail: tuomin@zju.edu.cn;
li-da@zju.edu.cn; ahmed@intl.zju.edu.cn; liep@zju.edu.cn). to the high interconnect density, unstable device performance,
En-Xiao Liu is with the A*STAR Institute of High Performance Computing, and complex circuit structures [15], [16]. Therefore, it is
Singapore 138632 (e-mail: liuex@ihpc.a-star.edu.sg). imperative to study the influence of the parasitic effects and
Color versions of one or more figures in this article are available at
https://doi.org/10.1109/TCSI.2022.3180199. investigate signal integrity (SI) issues so as to improve the
Digital Object Identifier 10.1109/TCSI.2022.3180199 performance of neuromorphic chips.
1549-8328 © 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: HANGZHOU DIANZI UNIVERSITY. Downloaded on April 23,2023 at 06:21:26 UTC from IEEE Xplore. Restrictions apply.
LI et al.: MODELING AND SI ANALYSIS OF RRAM-BASED NEUROMORPHIC CHIP CROSSBAR ARRAY USING PEEC METHOD 3491
Authorized licensed use limited to: HANGZHOU DIANZI UNIVERSITY. Downloaded on April 23,2023 at 06:21:26 UTC from IEEE Xplore. Restrictions apply.
3492 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: REGULAR PAPERS, VOL. 69, NO. 9, SEPTEMBER 2022
Authorized licensed use limited to: HANGZHOU DIANZI UNIVERSITY. Downloaded on April 23,2023 at 06:21:26 UTC from IEEE Xplore. Restrictions apply.
LI et al.: MODELING AND SI ANALYSIS OF RRAM-BASED NEUROMORPHIC CHIP CROSSBAR ARRAY USING PEEC METHOD 3493
a1 = x s2 − x e1 , a2 = x e2 − x e1 Fig. 5. (a) Node and numbering of capacitive surface mesh cells for three
a3 = x e2 − x s1 , a4 = x s2 − x s1 cuboids. (b) Quasistatic PEEC model for simple conductor geometry.
μ0lk 2 1 + a2 u + a3
L 11 = ∗ log + log + log (u + a1 ) − a5 − 2a7
24πu k k
μ0 l
+ ∗ k 4
(a 4 − a 3 − a 2 + k) + u 2
(u + a 4 − a 1 − a 3 ) + 1 + a 4 − a 1 − a 2
30k 2 πu⎧ ⎫
⎨ u log k+a3
− a ⎬
μ0 l log (k + a2 ) − a6 u 6 1 + a1
+ ∗ + + log − a5
12π ⎩ uk k u ⎭
μ0 l a2 − a4 u (a1 + a3 − 2a4 ) ua5 1 uk
+ ∗ + + − tan−1 (4)
π 10u 10k 2 2 3k a4
⎧
⎪
⎪ b j ck ai 2 −1 b j ck −1 ck ai −1 b j ai
⎪
⎪ − a tan + b 2
tan + c 2
tan
⎪
⎪ 6 i
2 2 ai R j bj R k
ck R
⎪
⎪
⎪
⎪ b c b 4
c 4
⎪
⎪ +
j k
−
j
− k
4 4 4 ⎪⎨ 4 24 24
μ0 ⎡ ⎛ ⎞ ⎛ ⎞ ⎛ ⎞⎤
L 12 = ∗ (6)
4π A1 A2 ⎪
⎪ a + R b + R c + R
⎪ ∗ ⎣a log ⎝
i=1 j =1 k=1 ⎪ i ⎠ + bi log ⎝ i ⎠ + ck log ⎝ k ⎠⎦
⎪
⎪ i
⎪
⎪ b 2 + c2
ck + a i
2 2 a 2 + b2
⎪
⎪ j k i j
⎪
⎪
⎪ 1 4
⎩ + b + ck + ai − 3b j ck − 3ck ai − 3b j ai R
4 4 2 2 2 2 2 2
60 j
Authorized licensed use limited to: HANGZHOU DIANZI UNIVERSITY. Downloaded on April 23,2023 at 06:21:26 UTC from IEEE Xplore. Restrictions apply.
3494 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: REGULAR PAPERS, VOL. 69, NO. 9, SEPTEMBER 2022
P12
m+k
1
Fig. 6. (a) The two parallel rectangular conductor (cuboid) model and (b) The 4 4 2 − Z2
1 bm
two orthogonal rectangular conductor (cuboid) model. = (−1) [ ak log(ak + rkm + e)
4πe S1 S2 2
k=1 m=1
Among them, [Q] and [V ] are the charge vector and a2 − Z 2 1 2
potential of each plane unit. [Cs ] is short-circuit capacitance + k bm log(bm + rkm + e) − (bm − 2Z 2 + ak2 )rkm
2 6
matrix. Assuming that the electric potential of each cuboid is ak bm
Va , Vb and Vc respectively. The surface capacitance at both −bm Z ak tan−1 ( )] (15)
rkm Z
ends of the cuboid is ignored. Then (11) can be converted to:
⎡ ⎤ ⎡ ⎤⎡ ⎤ where
Qa Csaa Csab Csac Va
⎣ Q b ⎦ = ⎣ Csba Csbb Csbc ⎦ ⎣ Vb ⎦ (11) a1 = x s2 − x e1 , a2 = x e2 − x e1
Qc Csca Cscb Cscc Vc a1 = x e2 − x s1 , a4 = x s2 − x s1
where Q a , Q b , Q c represent the sum of the surface charges b1 = ys2 − ye1 , b2 = ye2 − ye1
of each cuboid. The short-circuit capacitance of each cuboid b3 = ye2 − ys1 , b4 = ys2 − ys1 (16)
can be expressed as:
⎡ ⎤ and
Csaa Csab Csac
⎣ Csba Csbb Csbc ⎦
S1 = (x e1 − x s1)(ye1 − ys1 )
Csca Cscb Cscc
⎡ ⎤ S2 = (x e2 − x s2 )(z e2 − z s2 ) (17)
$ 4 $ 4 $ 4 $ 8 $ 4 $12
⎢ C si j C si j C si j ⎥ Z = z2 − z1 + e (18)
⎢ i=1 j =1 i=1 j =5 i=1 j =9 ⎥
⎢ 8 4 ⎥ rkm = ak2 + bm2 + Z2
⎢$ $ $ $
8 8 $ $
8 12 ⎥ (19)
=⎢ ⎢ C C C si j ⎥
si j si j ⎥ (12)
⎢ i=5 j =1 i=5 j =5 i=5 j =9 ⎥ The other model is made of two rectangular conductors
⎢$ ⎥
⎣ 12 $ 4 $12 $ 8 $12 $12
⎦ perpendicular to each other, as shown in Fig. 7(b). For this
C si j C si j C si j
i=9 j =1 i=9 j =5 i=9 j =9 case, the parasitic capacitance due to the upper and lower
vertical signal lines can be obtained by the following formula:
Therefore, the self-capacitance and mutual capacitance Ca ,
Cb , Cc , Cab , Cbc , Cca in the circuit model are: P12
(1+m+k+L)
4
12
8
12
12
12
4
2
2
Ca = C si j , C b = C si j , C c = C si j = (−1) [ak bm c L log(ak + rkm L + e)
i=1 j =1 i=4 j =1 i=8 j =1 k=1 m=1 L=1
4
8
8
12 ak2 c2L bm c L ak bm
Cab = − Csi j , Cbc = − C si j , +( − )c L log(bm +rkm L +e) − tan −1 ( )
2 6 3 c L rkm L
i=1 j =5 i=5 j =9
a2 b2 ak c2L ak bm
12
4 +bm ( k − m ) log(c L +rkm L +e) − tan −1 ( )
Cca = − C si j (13) 2 6 2 c L rkm L
a3 bm c L b 2 ak ak c L
i=9 j =1 − k tan −1 ( ) − m tan −1 ( )] (20)
6 ak rkm L 2 bm rkm L
And the short circuit capacitance matrix [Cs ] is also repre-
sented as: with
Authorized licensed use limited to: HANGZHOU DIANZI UNIVERSITY. Downloaded on April 23,2023 at 06:21:26 UTC from IEEE Xplore. Restrictions apply.
LI et al.: MODELING AND SI ANALYSIS OF RRAM-BASED NEUROMORPHIC CHIP CROSSBAR ARRAY USING PEEC METHOD 3495
TABLE II
D IMENSIONS OF THE U NIT-C ELL S TRUCTURE
TABLE III
PARASITIC PARAMETERS OF THE U NIT-C ELL
Authorized licensed use limited to: HANGZHOU DIANZI UNIVERSITY. Downloaded on April 23,2023 at 06:21:26 UTC from IEEE Xplore. Restrictions apply.
3496 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: REGULAR PAPERS, VOL. 69, NO. 9, SEPTEMBER 2022
TABLE V
PARASITIC PARAMETERS OF D IFFERENT M ODELS
Authorized licensed use limited to: HANGZHOU DIANZI UNIVERSITY. Downloaded on April 23,2023 at 06:21:26 UTC from IEEE Xplore. Restrictions apply.
LI et al.: MODELING AND SI ANALYSIS OF RRAM-BASED NEUROMORPHIC CHIP CROSSBAR ARRAY USING PEEC METHOD 3497
Fig. 11. The LRS and HRS read currents with different coupling capacitance
(a) Cm = 0.02 fF, (b) Cm = 0.2 fF, (c) Cm = 2 fF, (d) Cm = 20 fF, Fig. 13. The output currents of the four models at different crossbar array
(e) Cm = 200 fF. scales (50 × 50 and 100 × 100): (a) Model A (b) Model B and (c) Model C.
Authorized licensed use limited to: HANGZHOU DIANZI UNIVERSITY. Downloaded on April 23,2023 at 06:21:26 UTC from IEEE Xplore. Restrictions apply.
3498 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: REGULAR PAPERS, VOL. 69, NO. 9, SEPTEMBER 2022
Fig. 14. Output currents for different line length to width ratios at Fig. 15. Output current curves with different distances between bit line and
50 × 50 array scale. ground (the waveform ripple is circled in the figure).
small, the parasitic effect has less influence at different array the capacitance significantly. As a result, it reduces crosstalk,
scales. But as the dimension increases, the effect of the array avoids signal distortion and improves device performance.
scale also increases.
Then, the effect of the length (L) to width (W) ratio VI. C ONCLUSION
is discussed by changing the L to W ratio of Model C This paper is devoted to the study and analysis of the signal
while maintaining its width as 1um. Fig. 14 presents the integrity (SI) issues due to densely interconnected crossbar
simulation result of the interconnection line with different L arrays in RRAM-based neuromorphic chip. The parasitic para-
to W ratios under the 50 × 50 array scale. When the ratio meters are calculated by the PEEC method with a unit-cell
increases, the time delay becomes visible. In particular, when approach, and the transient simulation is carried out in com-
the ratio of L to W increases to 10, a 15-ns delay occurs bination with the MNA method. For an array size of 50 × 50,
as a consequence. This result is in line with the previous this method only consumes 1.5% of the calculation time of the
analysis, as the increase in dimension will lead to an increase 3D model based on ANSYS HFSS, and the calculation speed
in the value of parasitic parameters. And the parasitic effects is increased by 72 times, greatly improving the calculation
associated with larger-scale array structures will naturally efficiency. Furthermore, the transient simulation results of the
increase. Neuromorphic systems that perform more complex PEEC circuit model match well with those of the 3D model.
tasks will be more complex with a larger-scale crossbar array. The SI analysis is conducted by changing the parasitic
Then electromagnetic noise coupling at the crossbar array can capacitance, parasitic inductance, and feature size of the
significantly affect system performance. Therefore, a small- crossbar array. With the increase of array scale, the increase
dimension interconnect should be used to reduce the impact in parasitic effects leads to a series of SI problems, such as
induced by the array scale. crosstalk, time delay and sneak path. As the interconnect width
increases from 10nm to 1um and the array scale increases from
50 × 50 to 100 × 100, the parasitic effect between the signal
D. Crosstalk Reduction Method lines increases by an order of magnitude. Consequently, the
As process technology becomes finer, the density of RRAM ripple of the output becomes prominent and a significant delay
will increase, interconnect lines will be spaced closer together, occurs. Besides, when the coupling capacitance increases,
and parasitic capacitance will increase. According to the additional potential sneak paths are generated between differ-
results in previous sub-sections, crosstalk and delay are the ent lines that lead to misreading as well as loss of the operation
main SI issues. The fundamental solution to these problems accuracy of the RRAM. Therefore, it is effective to reduce
is to reduce parasitic inductance and parasitic capacitance. parasitics by increasing the distance between the bit line and
We choose Model C with the most severe signal distortion ground, which in turn reduces signal distortion and avoids
in the above experiments for further simulation by increasing device misreading. In addition, it is worth mentioning that the
the distance between the bit line and the ground from 50nm Izhikevich neuron model is used to mimic the spiking signal
to 5um. The simulation results are shown in Fig. 15. as the voltage source of the circuit, because of its superior
When d is 50nm, the output current has obvious ripples. dynamic characteristic and calculation efficiency.
For this case, there will be relatively large jitter between the In conclusion, crossbar array design requires trade-off
intervals generated by each spike. However, as the distance among density, space, and dimension to ensure signal integrity.
between the interconnect and ground increases from 50nm It is a good practice to use small-dimension and small-scale
to 5um, the jitter slowly disappears and flattens out (see the array structures. The parasitic effects decrease with an increase
circled portion in Fig. 15). As can be seen in the figure, in the spacing between interconnects and ground or a reduction
when d is 5um, the line-to-line crosstalk decreases obviously. in the interconnect length to width (L/W) ratio, which leads
The increase in the distance between the bit line and the to improved accuracy and reduced error rate of neuromorphic
ground changes little the parasitic inductance, but it decreases crossbar array circuitry.
Authorized licensed use limited to: HANGZHOU DIANZI UNIVERSITY. Downloaded on April 23,2023 at 06:21:26 UTC from IEEE Xplore. Restrictions apply.
LI et al.: MODELING AND SI ANALYSIS OF RRAM-BASED NEUROMORPHIC CHIP CROSSBAR ARRAY USING PEEC METHOD 3499
Authorized licensed use limited to: HANGZHOU DIANZI UNIVERSITY. Downloaded on April 23,2023 at 06:21:26 UTC from IEEE Xplore. Restrictions apply.
3500 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: REGULAR PAPERS, VOL. 69, NO. 9, SEPTEMBER 2022
Da Li (Member, IEEE) received the B.S. and Ph.D. Manareldeen Ahmed (Member, IEEE) received
degrees in electrical engineering from Zhejiang Uni- the Ph.D. degree in electrical engineering from the
versity, Hangzhou, China, in 2014 and 2019, respec- Hebei University of Technology, Tianjin, China,
tively. From 2017 to 2018, he worked at Nanyang in 2019. He is currently a Post-Doctoral Researcher
Technological University, Singapore, as a Project with the Zhejiang University–University of Illinois
Researcher. From 2019 to 2021, he joined the Sci- at Urbana–Champaign Institute, Zhejiang Univer-
ence and Technology on Antenna and Microwave sity, Haining, China. His current research interests
Laboratory, Nanjing, China, as a Research Fellow. include neuromorphic computing, spiking neural
He is currently an Assistant Professor at Zhejiang networks, and AI chips.
University. He has authored or coauthored more
than 30 refereed papers. His research interests
include machine learning, antennas, metasurfaces, and electromagnetic com-
patibility. He has served as a TPC member for two IEEE conferences. He has
served as a reviewer for six technical journals.
Authorized licensed use limited to: HANGZHOU DIANZI UNIVERSITY. Downloaded on April 23,2023 at 06:21:26 UTC from IEEE Xplore. Restrictions apply.