Refeerence Paper 32
Refeerence Paper 32
wearables with embedded AI for early detection of underlying capacitor IMC has better linearity for VMMs (see Fig. 1(b)).
health issues. The analog classifier uses custom activation func-
tion and performs in-memory computation (IMC) with switched-
Linearity of VMM using SRAM cells is fundamentally limited
capacitor circuits for reduced data movement. Designed in 65nm, by nonlinear relationship between discharge current (Ids ) and
the test chip achieves average accuracy of 98.2% for AFib voltage on BL/BLB, and the VMM results are not linear over
detection, and 90.7% for predicting sepsis 4 hours before onset. the full dynamic range [1]. In addition, matching capacitors is
The energy efficiency of the test-chip is 12.9nJ/classification which easier than matching transistors and Ids across large SRAM
is 4× better than state-of-the-art.
array. The proposed classifier is demonstrated on single lead
Index Terms—Machine learning, atrial fibrillation, sepsis,
mixed-signal classifier and in-memory computation ECG data from Physionet 2017 dataset and on data from a
patient cohort admitted to Emory University Hospital (EUH)
between 2014 to 2018.
I. I NTRODUCTION
On-chip ANN total energy:
Atrial fibrillation (AFib) results in more than 150,000 un- (core area: 1.67mm2) 12.9nJ/classification
0.5mm
R peak 0.8mm
derlying cause of deaths in the USA annually. However, most ECG Signal
Layer2 Layer3
FE: includes
feature extractor
1.2mm
R
AFib patients are asymptomatic, leading to reduced awareness N-N
0.6mm 2.1mm
+ pre-processing
to remove
T P T
and less chances of managing stroke risks. Sepsis is another Q
Layer1 baseline wander
S
significant cause of death in the USA with close to 40% 2.5mm
Vth1 Vout>Vth1 Normal
mortality rate after onset and with 80% of the patients having DAC
Vth2<Vout<Vth1 AFib
onset outside hospital. Abnormalities in electrocardiogram Digital Feature
Extractor + DAC
Vout
Vout>Vth3 Sepsis
using wearables with built-in artificial intelligence (AI) is a Shared hidden layer 1 Shared hidden layer 2 Vth3 Non-sepsis
(20 neurons) (6 neurons) (a)
potential solution for risk management while securing patient SRAM-IMC with peripheral ADC Switched-cap IMC with analog activation
data privacy. However, AI analysis is typically computationally BL WL BLB
Vi[1] Vi[2] Vi[n]
intensive and it is difficult to embed AI model within resource ϕs ϕs ϕs ϕs ϕs ϕs
State-of-the-art mixed-signal AI circuits have typically only 1. Ids is non-linear function of bitline voltage 1. Switched-cap MAC computation is highly linear
2. Random mismatch in Ids in each bitcell 2. Capacitors have better matching than transistors
demonstrated on-chip vector matrix multiplication (VMM) or 3. Peripheral ADC bottleneck 3. No ADCs in the ANN
4. ANN weights can be reprogrammed easily 4. ANN weights cannot be reprogrammed
the first hidden/convolutional layer, with rest of the AI model (b)
implemented in software [1], [2].
Fig. 1: a) Multi-task learning ANN for atrial fibrillation and
This work presents a mixed-signal, multi-task learning
sepsis prediction from ECG signal, b) comparison of IMC with
(MTL) classifier for detecting AFib and sepsis from temporal
SRAM vs switched-capacitor
ECG signal (Fig. 1(a)), with the 3-layer artificial neural
network (ANN) classifier implemented on-chip. The MTL
II. M ULTI - TASK LEARNING ANN T RAINING
ANN model gives high accuracy for both AFib and sepsis
prediction tasks, since both tasks are fundamentally identi- A. Description of dataset
fying abnormalities in ECG signal. The key contributions of The 2017 PhysioNet dataset comprises of ECG recordings
this work are - 1) demonstration of fully integrated analog lasting from 9 seconds to over 60 seconds. The ECG record-
MTL ANN with switched-capacitor IMC, 2) custom activation ings are sampled at 300Hz, and contain normal sinus rhythm,
had sepsis, with onset time assigned using Sepsis-3 criterion. ϕs ϕsb ϕs
0.5
ϕsb ϕs ϕsb
f(Vin) (V)
0
The goal of this work is to detect sepsis 4 hours before onset Xm[1] Xm[2] Xm[n] -0.5
-1
to allow adequate time for the 3-hour recommended sepsis Vcm -1 0 1
Vin (V)
The input features are calculated on 30 second windows ϕse C[1] C[2] C[n]
Vcm
of the ECG signal, and only time-domain features are used Vo
Vcm
for low-cost hardware implementation. The time-domain fea- ϕse C[1] C[2] C[n]
custom softmax
tures are calculated from first-order statistical measures of
shape, dispersion, location and distribution of R peaks, QRS ϕs ϕsb ϕs ϕsb ϕs ϕsb
Authorized licensed use limited to: Amrita School of Engineering. Downloaded on March 09,2023 at 08:05:00 UTC from IEEE Xplore. Restrictions apply.
with 98.8% accuracy, specificity of 1 and sensitivity of 0.89. TABLE I: Comparison with state-of-the-art ASICs
Threshold voltages for the class boundaries are calculated JSSC TBioCas JSSC ISSCC This
during foreground calibration step that applies the training 2019 [5] 2019 [6] 2020 [7] 2021 [8] work
samples to the test-chip and calculates the threshold voltages Process 65nm 180nm 40nm 65nm 65nm
to maximize classification accuracy on the training samples. Area (mm2 ) 5.9 0.92 0.24 1.74 1.67
Fig. 3(b) shows measured histogram of accuracy and sensitiv- Accuracy − 99.3% 96% 99.3% 98.2%1
ity for 1000 repeated evaluations on the test set. Small standard Type digital AMS2
deviation in accuracy and sensitivity for repeated evaluations Energy 0.33µJ 3.21µJ 51.6nJ 2.25µJ 12.9nJ
Model ANN ANN TDDL3 ANN ANN
demonstrate robustness against noise.
Class # 2 5 2 2 3
1
average of 4 chips, 2 AMS: analog/mixed-signal, 3
TDDL: task-
1 1023 driven dictionary learning
True Class
2 14 121
1 2 3
The sepsis dataset is split randomly into 620 training
Predicted Class samples and 180 test samples. Fig. 5 shows the measured
1: Normal; 2: AFib; 3: Noisy
accuracy and sensitivity of sepsis prediction as a function
Accuracy : 98.8%; Specificity: 1 of time before onset. As expected, the prediction accuracy
Sensitivity: 0.89
and sensitivity improves closer to onset. This work predicts
sepsis 4 hours before onset to allow sufficient time for sepsis
treatment [3].
Fig. 3: a) Measured confusion matrix for AFib dataset, b)
accuracy and sensitivity for 1000 evaluations 1
Accuracy
Sensitivity
Fig. 4(a) shows the measured accuracy and sensitivity 0.95
0.950.95
0.93
Acc/Sen
as the power supply voltage is swept from 1.2V to 0.8V. 0.92 0.92
0.90
0.91
0.9 0.90
Classification accuracy reduces with supply voltage. Fig. 4(b) 0.88 0.87
shows the measured accuracy and sensitivity for 4 test chips. 0.85 0.84 0.84
The class boundaries are calculated for each test-chip through
0.8
foreground calibration using training samples. The average 1 2 3 4 5 6
accuracy and sensitivity across 4 test-chips are 98.2% and 0.89 Time to onset (hours)
respectively. Table I compares our prototype with state-of-the- Fig. 5: Measured accuracy and sensitivity of sepsis prediction
art ASICs demonstrated on AFib detection tasks. The proposed before onset
ANN consumes the lowest energy thanks to analog ANN.
Fig. 6(a) shows the measured confusion matrix on the test
1.1 set. The test-chip predicts sepsis with 91.1% accuracy, speci-
Accuracy
Sensitivity ficity of 0.94 and sensitivity of 0.88. Similar to AFib dataset,
1 threshold voltage for the class boundaries are calculated on
Acc/Sen
Sensitivity
1 0.99
Acc/Sen
0.99 0.98
0.97
2 11 79
0.90
0.9 0.88 0.89 0.88 1 2
Predicted Class
1: Normal; 2: Sepsis
0.8
1 2 3 4 Accuracy : 91.1%; Specificity: 0.94
Chip # Sensitivity: 0.88
(b)
Authorized licensed use limited to: Amrita School of Engineering. Downloaded on March 09,2023 at 08:05:00 UTC from IEEE Xplore. Restrictions apply.
Fig. 7(a) shows the measured accuracy and sensitivity as the
power supply voltage is swept from 1.2V to 0.8V. Prediction
accuracy reduces with supply voltage. Fig. 7(b) shows the
measured accuracy and sensitivity for 4 test chips. The average
accuracy and sensitivity across 4 test-chips are 90.7% and 0.84
respectively. Table II compares our sepsis prediction work with
1
Accuracy
0.930.94
Sensitivity 0.90 0.91
0.9 0.88
0.86
Acc/Sen
0.82
0.80
0.8
0.73
0.7
0.64
0.6
0.8 0.9 1 1.1 1.2
Vdd (V)
(a)
1
Accuracy Fig. 8: Comparison with digital baseline and state-of-the-art
0.95 Sensitivity
0.92 0.91
Acc/Sen
0.90 0.90
0.9 0.88
distribute reprints for Government purposes notwithstanding
0.85 0.84
0.83
any copyright notation thereon. The views and conclusions
0.8
0.81 contained herein are those of the authors and should not
be interpreted as necessarily representing the official policies
0.75
1 2 3 4 or endorsements, either expressed or implied, of Air Force
Chip # Research Laboratory or the U.S. Government.
(b)
R EFERENCES
Fig. 7: Measured accuracy and sensitivity for a) as a function [1] Q. Dong et al., “ A 351TOPS/W and 372.4 GOPS compute-in-memory
of supply voltage, b) multiple chips SRAM macro in 7nm FinFET CMOS for machine-learning applica-
tions,” in ISSCC, 2020, pp. 242–244.
state-of-the-art. Our work has the highest prediction accuracy [2] H. Valavi, P. J. Ramadge, E. Nestler, and N. Verma, “A mixed-signal
4 hours before sepsis onset. To the best of our knowledge, binarized convolutional-neural-network accelerator integrating dense
weight storage and multiplication for reduced data movement,” in IEEE
there are no custom ASICs in the literature that perform sepsis Symposium on VLSI Circuits, 2018, pp. 141–142.
prediction. Fig. 8 compares our work with digital baseline [3] L. Pruinelli et al., “Delay within the 3-hour surviving sepsis campaign
synthesized in 65nm, and with state-of-the-art AI ASICs for guideline on mortality for patients with severe sepsis and septic shock,”
Critical care medicine, vol. 46, no. 4, p. 500, 2018.
different bio-medical applications. [4] S. T. Chandrasekaran et al., “Fully Integrated Analog Machine Learning
Classifier Using Custom Activation Function for Low Resolution Image
TABLE II: Comparison with state-of-the-art Classification,” IEEE TCAS–I, vol. 68, no. 3, pp. 1023–1033, 2021.
[5] S. Yin et al., “A 1.06-µ W Smart ECG Processor in 65-nm CMOS for
CinC CCM JAMIA Nature This Real-Time Biometric Authentication and Personal Cardiac Monitoring,”
2019 [9] 2019 [10] 2020 [11] 2021 [12] work IEEE JSSC, vol. 54, no. 8, pp. 2316–2326, 2019.
Accuracy 84.5% 67% − − 90.7%1 [6] Y. Zhao, Z. Shang, and Y. Lian, “A 13.34 µW Event-Driven Patient-
Sensitivity 0.66 0.85 0.84 0.86 0.841 Specific ANN Cardiac Arrhythmia Classifier for Wearable ECG Sen-
sors,” IEEE transactions on biomedical circuits and systems, vol. 14,
tonset 2 4 hours
no. 2, pp. 186–197, 2019.
Model LSTM 3 SM 4 RNN 5 RF6 ANN [7] K.-C. Chen, C.-Y. Chou, and A.-Y. Wu, “A Tri-Mode Compressed
1
average of 4 chips, 2 hours before sepsis onset; 3 LSTM: long-short Analytics Engine for Low-Power AF Detection With On-Demand EKG
term memory; 4 SM: survival model; 5 RNN: recurrent neural network; Reconstruction,” IEEE Journal of Solid-State Circuits, 2020.
6 [8] J. Liu et al., “BioAIP: A Reconfigurable Biomedical AI Processor
RF: random forest with Adaptive Learning for Versatile Intelligent Health Monitoring,” in
ISSCC, vol. 64, 2021, pp. 62–64.
IV. C ONCLUSION [9] B. Roussel, J. Behar, and J. Oster, “A Recurrent Neural Network for the
This work has presented an analog machine learning classi- Prediction of Vital Sign Evolution and Sepsis in ICU,” in Computing in
Cardiology (CinC). IEEE, 2019, pp. Page–1.
fier IC for AFib detection, and sepsis prediction from patient [10] S. Nemati et al., “An interpretable machine learning model for accurate
ECG signal. The combination of switched-capacitor IMC and prediction of sepsis in the ICU,” Critical care medicine, vol. 46, no. 4,
custom analog activation circuits results in 4× improvement p. 547, 2018.
[11] A. D. Bedoya et al., “Machine learning for early detection of sepsis: an
in energy efficiency without sacrificing prediction accuracy. internal and temporal validation study,” JAMIA open, vol. 3, no. 2, pp.
ACKNOWLEDGMENT 252–260, 2020.
This material is based on research sponsored by Air Force [12] K. H. Goh et al., “Artificial intelligence in sepsis early prediction and di-
agnosis using unstructured data in healthcare,” Nature communications,
Research Laboratory under agreement number FA8650-18-2- vol. 12, no. 1, pp. 1–10, 2021.
5402. The U.S. Government is authorized to reproduce and
Authorized licensed use limited to: Amrita School of Engineering. Downloaded on March 09,2023 at 08:05:00 UTC from IEEE Xplore. Restrictions apply.