Professional Documents
Culture Documents
Design of Spiking Neural Networks For Blood Pressure Prediction
Design of Spiking Neural Networks For Blood Pressure Prediction
DOI 10.1007/s12530-017-9176-x
ORIGINAL PAPER
Received: 7 April 2016 / Accepted: 23 January 2017 / Published online: 7 March 2017
© Springer-Verlag Berlin Heidelberg 2017
Abstract The ability to predict blood pressure changes Keywords NeuCube · Spiking neural network ·
during general anesthesia would assist anesthetists mini- Anesthesia · Prediction · Blood pressure
mize the risk of complications due to hypotensive events.
However, such prediction is not trivial. Evolving spiking
neural networks are a relatively new computational method 1 Background
that may have application to this problem. NeuCubeST con-
sists of a 3-dimensional network of locally connected neu- In the late 1980s, it was estimated that, over a given day,
rons called a Spiking Neural Network reservoir (SNNr) there was more information contained in the records
and can be used to classify time series data for prediction. of a typical 700-bed hospital than in the London Stock
There are a number of design considerations when using Exchange (Weiss et al. 1995). Some physiologic data, such
NeuCubeST as a classifier of time-series data: what pre- as mean arterial pressure (MAP) and heart rate (HR) are
processing of the raw data is required (pre-processing), now routinely and automatically collected during general
how to convert the time-series data into a spike train (input- anesthesia in many hospitals. However, beyond the imme-
encoding), which neurons the data are connected to (input- diate surgical case, these data are seldom utilized. One area
mapping), and how many nearest neighbours to use in clas- where such “big data” could be of great value is in predict-
sification (classification). However, it is still unclear how ing future physiological states. In this work, we are inter-
sensitive NeuCubeST-based systems are to perturbations ested in predicting mean arterial blood pressure (MAP) as
of any of the above. In this paper we evaluate the contri- it is essential to keep MAP within relatively narrow limits
bution of these design factors to blood pressure prediction during anesthesia (Gordon and Russell 2005; Rivers et al.
using NeuCubeST. 6000 possible combinations of those 2001). Intraoperative hypotensive (low MAP) events, for
NeuCubeST options were tested for each of 100 patients example, are common and associated with adverse events
and for each a Signal to Noise Ratio was obtained. All four (Morris et al. 2005).
investigated design factors showed significant contribution There are a variety of techniques that could be applied to
to SNR. Intra-operative MAP prediction using NeuCubeST physiological time-series data for prediction. Some exam-
can be effective but performance is sensitive to the design ples of the approaches are mathematical modeling of the
choices. cardiovascular system (Heldt et al. 2006), applications of
wavelet analysis (Saeed and Mark 2000), fuzzy inference
* David Cumin (Lowe et al. 1999), and fuzzy inference (Versaci and Mora-
d.cumin@auckland.ac.nz bito 2003). Various attempts at estimating hemodynamic
1
status have been made but the complex and nonlinear
Institute of Biomedical Technologies, Auckland University
nature of hemodynamic parameters (Wo et al. 1993) makes
of Technology, Private Bag 92006, Auckland 1142,
New Zealand a solution non-trivial.
2 Attempts at predicting MAP have included an adaptive
Department of Anaesthesiology, Faculty of Medical
and Health Sciences, The University of Auckland, Private network fuzzy inference system (FIS) using HR, previous
Bag 92019, Auckland 1142, New Zealand MAP values, fraction of inspired isoflurane, and end-tidal
13
Vol.:(0123456789)
204 Evolving Systems (2017) 8:203–210
13
Evolving Systems (2017) 8:203–210 205
emission of a feature neuron according to a Gaussian func- anesthesia as part of patient monitoring in high standard
tion of the distance between a set value and a real value. anesthesia work stations (Chilkoti et al. 2015). The data
GRF was originally proposed for spatial data, rather than was sampled at 30 s intervals.
for time-series data. In our method, we first calculate the A random sample of 100 anesthetic records with
difference between the variable value and the mean of that between 30 min and 45 min of overlapping data for all
variable. Secondly, we define a positive or negative spike physiologic variables were extracted from the database.
emission delay in accordance with how close the differ- Training patterns were extracted from these records with
ence is: when the difference is bigger, emit a spike earlier; a 20 min sliding window with 5 min steps. Leave-one-out
if the difference is positive, emit a positive spike; if nega- cross validation was performed for each record, where
tive, emit a negative spike. Thirdly, ensure the spike emis- predictions were generated every 30 s starting from
sions occur for every time point and do not overlap. Conse- 20 min into the record.
quently, this third rule gives the method features of ISI as Multiple prediction models were designed, encom-
well as that of GRF. In other words, the interval between passing every combination of options for each of the
two successive spikes represents the gradient between their chosen design factors on a NeuCubeST model of reservoir
related time points. size 6 × 6 × 6:
In short, there are a number of design considerations
when using N euCubeST as a classifier of time-series data: • Pre-processing Raw data were either pre-processed with
what pre-processing of the raw data is required (pre- a 5-step median filter or encoded without the filter. A
processing), how to convert the time-series data into a median filter was chosen to remove outliers (Saeed
spike train (input-encoding), which neurons the data are 2007). An outlier may occur for clinical reasons, for
connected to (input-mapping), and how many nearest example a blood-sampling event will interfere with
neighbors to use in classification (classification). How- the MAP reading as it uses the same cannula. Because
ever, it is unclear from published literature how sensitive blood sampling and other, similar events usually take
NeuCubeST-based systems are to perturbations of any of the less than 1 min (2 steps) to finish, the 5-step median fil-
above design considerations. ter was chosen. Thus, there were 2 options for the pre-
processing step.
• Input encoding Address event representation (AER)
3 Experimental design and results (Kasabov 2012) and the newly proposed Gaussian-
receptive-field-based encoding method (see above)
3.1 Aim were tested. For the AER, 2 different spiking thresholds
were tested. Each method was tested in forward and
The purpose of this work is to explore the sensitivity of reverse time order because the Rank-Order rule used in
NeuCubeST to different pre-processing, input-encoding, NeuCubeST supervised learning puts more importance
input-mapping, and classification settings in predicting on earlier-emitted spikes than later spikes. Thus, there
blood pressure values from intra-operative records. were a total of 6 options for input encoding.
3.2 Methods
3.2.1 Ethics approval
3.2.2 Prediction Models
13
206 Evolving Systems (2017) 8:203–210
a b
5.0 5.0
2.5 2.5
SNR
SNR
0.0 0.0
−2.5 −2.5
−5.0 −5.0
Raw Median filter AER 1 AER 2 Gaussian AER 1 reverse AER 2 reverse Gaussian reverse
Pre−processing Input Encoding
c d
5.0
5.0
2.5
2.5
SNR
SNR
0.0
0.0
−2.5
−2.5
−5.0
−5.0
1 20 40 60 80 10 1 10 10 weighted 50 50 weighted
Input Mapping
Classification
e
5.0
2.5
SNR
0.0
−2.5
−5.0
1 20 40 60 80 100
Patient
Fig. 2 Boxplots of SNR by Input encoding method and classification algorithm. Note these plots only show SNR in [−5,5]
• Input mapping Input feature neurons in each predic- Although graph-matching algorithms have been pro-
tion model were allocated to randomly-generated input posed (Tu et al. 2014), we applied none of them to keep
feature allocations. We used 100 such allocations. the experiments straightforward.
13
Evolving Systems (2017) 8:203–210 207
Table 1 ANOVA results of model with SNR as the dependent vari- 3.3 Results
able
F-value P-value The mean and standard deviation of SNR over the 600,000
experiments was −0.8675 ± 2.1732 dB. The distribution of
Pre-processing 909.6 <0.001
SNR are shown in Fig. 1.
Input encoding 851.9 <0.001
Univariate analysis suggests that there are significant
Input mapping 4.4 <0.001
differences between levels in all of the possible factors.
Classification 99,496.6 <0.001
These are represented graphically in Fig. 2 for input encod-
Patient 4142.3 <0.001
ing and classification only as exemplars.
The ANOVA results (Table 1) show that all design con-
siderations contribute to the SNR.
Table 2 ANOVA results of model with interactions and SNR as the Table 2 shows that interactions are all significant also:
dependent variable
The second order interactions can be visualized in Fig. 3.
F-value P-value
13
208 Evolving Systems (2017) 8:203–210
a −0.6 b
0
−0.7
−1
encoding
−0.8 k_knn
AER 1
1
Mean SNR
Mean SNR
AER 2
10
Gaussian
10 weighted
AER 1 reverse
50
−0.9 AER 2 reverse
50 weighted
Gaussian reverse −2
−1.0
−3
−1.1
Pre−processing Pre−processing
c
0
−1
k_knn
1
Mean SNR
10
10 weighted
−2 50
50 weighted
−3
NeuCubeST has potential to be an effective predictor of the subject of future work. Similarly, we did not use other
MAP using the proposed methodology. However, all four methods for prediction of MAP as this was outside the
investigated design factors showed highly significant con- scope of the research. Such comparisons could be the focus
tribution to SNR when controlling for patient selection. of future work.
Many other parameters such as training algorithms or other
algorithm settings may also impact results but were not
investigated. In this research, patient records were chosen 5 Conclusion
at random. More work is required to determine the applica-
bility of these results to specific patient groups and surgical This research found that MAP prediction was particularly
or anaesthetic procedures. Such work will lead to a better sensitive to output classification method. Notably, the use
understanding of how to optimize experimental designs for of larger numbers of nearest neighbours was associated
improved prediction results. with better performance (higher SNR), on average. Opti-
Although it is a natural question to ask which com- mal choice of output classification (that is, the number of
bination is best for predicting MAP, it was not the inten- nearest neighbours) is likely to be dependent on the clus-
tion of this research to answer that question, which will be tering characteristics of the application and these results
13
Evolving Systems (2017) 8:203–210 209
indicate that there is a wide variety of dynamic behaviors Jensen EW, Nebot A (1998) Comparison of FIR and ANFIS meth-
within patient time series. Median filtering as a method of odologies for prediction of mean blood pressure and auditory
evoked potentials index during anaesthesia. In: Proceedings of
preprocessing was also found to have a significant effect the 20th Annual International Conference of the IEEE Engi-
on prediction performance. Application of median filter- neering in Medicine and Biology Society, 1998. Presented at
ing improved the upper quartile of predictor performance, the Proceedings of the 20th Annual International Conference
but also reduced the lower quartile. These results indicate of the IEEE Engineering in Medicine and Biology Society,
vol. 3, 1998, pp 1385–1388. doi:10.1109/IEMBS.1998.747139
that feature extraction, particularly that which affects tem- Ji S-Y, Chen W, Ward K, Rickards C, Ryan K, Convertino V, Najar-
poral information contained in the data, affects the ease ian K (2009) Wavelet based analysis of physiological signals
with which the temporal network can distinguish between for prediction of severity of hemorrhagic shock. In: ICME
relevant and irrelevant patterns. The effect of filtering also International Conference on Complex Medical Engineering,
2009. CME. Presented at the ICME International Confer-
showed interaction with input encoding method, which, ence on Complex Medical Engineering, 2009. CME, pp 1–6.
although intuitively reasonable, is a further indication of doi:10.1109/ICCME.2009.4906672
the optimization complexity facing a system designer. Johnson C, Roychowdhury S, Venayagamoorthy GK (2011) A
Nevertheless, some configurations of NeuCubeST in this reversibility analysis of encoding methods for spiking neural
networks. In: The 2011 International Joint Conference on Neu-
research demonstrated MAP prediction performance sub- ral Networks (IJCNN). Presented at the the 2011 International
stantially greater than a naïve approach, which is promising Joint Conference on Neural Networks (IJCNN), pp 1802–1809.
evidence for both the existence of a relationship between doi:10.1109/IJCNN.2011.6033443
the measured variables and future MAP, and the ability of Kasabov N (2012) NeuCube EvoSpike architecture for spatio-tem-
poral modelling and pattern recognition of brain signals. In:
spiking neural networks to discover this relationship. Artificial Neural Networks in Pattern Recognition. Springer,
In summary, intra-operative MAP prediction using pp. 225–243
NeuCubeST can be effective but performance is sensitive Kasabov NK (2014) NeuCube: a spiking neural network archi-
to pre-processing, input encoding, input mapping and clas- tecture for mapping, learning and understanding of spatio-
temporal brain data. Neural Netw 52:62–76. doi:10.1016/j.
sification methods. Such design choices must be carefully neunet.2014.01.006
considered by anyone wishing to utilize NeuCubeST for this Kasabov N, Feigin V, Hou Z-G, Chen Y, Liang L, Krishnamurthi
purpose. R, Othman M, Parmar P (2014) Evolving spiking neural net-
works for personalised modelling, classification and prediction
Acknowledgements The work is sponsored by the Knowledge of spatio-temporal patterns with a case study on stroke. Neuro-
Engineering and Discovery Research Institute, Auckland University computing, Special issue on the 2011 Sino-foreign-interchange
of Technology, New Zealand. We are grateful for the assistance of Workshop on Intelligence Science and Intelligent Data Engi-
Prof. Chris Triggs, Statistics, University of Auckland, for his advice neering (IScIDE 2011) Learning Algorithms and Applications
regarding the analysis of these data. Selected papers from the 19th International Conference on Neu-
ral Information Processing (ICONIP2012), vol 134, pp 269–279.
doi:10.1016/j.neucom.2013.09.049
Lee J, Mark R (2011) A hypotensive episode predictor for intensive
care based on heart rate and blood pressure time series. Comput
References Cardiol 2010:81–84
Lowe A, Harrison MJ, Jones RW (1999) Diagnostic monitoring in
Bohte SM (2004) The evidence for neural information processing anaesthesia using fuzzy trend templates for matching tempo-
with precise spike-times: A survey. Nat Comput 3:195–206. ral patterns. Artif Intell Med Fuzzy Diagnosis 16:183–199.
doi:10.1023/B:NACO.0000027755.02868.60 doi:10.1016/S0933-3657(98)00072-4
Chilkoti G, Wadhwa R, Saxena AK (2015) Technological advances Lumley T, Diehr P, Emerson S, Chen L (2002) The importance of the
in perioperative monitoring: Current concepts and clini- normality assumption in large public health data sets. Annu Rev
cal perspectives. J Anaesthesiol Clin Pharmacol 31:14–24. Public Health 23:151–169
doi:10.4103/0970-9185.150521 Morris RW, Watterson LM, Westhorpe RN, Webb RK (2005) Crisis
Dhoble K, Nuntalid N, Indiveri G, Kasabov N (2012) Online spatio- management during anaesthesia: hypotension. Qual Saf Health
temporal pattern recognition with evolving spiking neural net- Care 14:e11. doi:10.1136/qshc.2002.004440
works utilising address event representation, rank order, and Rivers E, Nguyen B, Havstad S, Ressler J, Muzzin A, Knoblich B,
temporal spike learning. In: The 2012 International Joint Confer- Peterson E, Tomlanovich M (2001) Early goal-directed therapy
ence on Neural Networks (IJCNN). Presented at the The 2012 in the treatment of severe sepsis and septic shock. N Engl J Med
International Joint Conference on Neural Networks (IJCNN), pp 345:1368–1377. doi:10.1056/NEJMoa010307
1–7. doi:10.1109/IJCNN.2012.6252439 Saeed M (2007) Temporal pattern recognition in multiparameter ICU
Gordon AC, Russell JA (2005) Goal directed therapy: how long can data (Thesis). Massachusetts Institute of Technology
we wait? Crit Care 9:647–648. doi:10.1186/cc3951 Saeed M, Mark RG (2000) Multiparameter trend monitoring and
Heldt T, Long B, Verghese GC, Szolovits P, Mark RG (2006) Inte- intelligent displays using wavelet analysis. In: Computers in
grating Data, Models, and Reasoning in Critical Care. In: 28th Cardiology 2000. Presented at the Computers in Cardiology, pp
Annual International Conference of the IEEE Engineering in 797–800. doi:10.1109/CIC.2000.898645
Medicine and Biology Society, 2006. EMBS’06. Presented at the Torikai H, Shimizu Y, Saito T (2006) Various spike-trains from a
28th Annual International Conference of the IEEE Engineering digital spiking neuron: analysis of inter-spike intervals and their
in Medicine and Biology Society, 2006. EMBS’06, pp 350–353. modulation. In: International Joint Conference on Neural Net-
doi:10.1109/IEMBS.2006.259734 works, 2006. IJCNN’06. Presented at the International Joint
13
210 Evolving Systems (2017) 8:203–210
Conference on Neural Networks, 2006. IJCNN’06, pp 3860– Weiss YG, Cotev S, Drenger B, Katzenelson R (1995) Patient data
3867. doi:10.1109/IJCNN.2006.246882 management systems in anaesthesia: an emerging technol-
Tu E, Kasabov N, Othman M, Li Y, Worner S, Yang J, Jia Z (2014) ogy. Can J Anaesth J Can Anesth 42:914–921. doi:10.1007/
NeuCube(ST) for spatio-temporal data predictive modelling BF03011040
with a case study on ecological data, in: 2014 International Joint Wo CC, Shoemaker WC, Appel PL, Bishop MH, Kram HB, Hardin
Conference on Neural Networks (IJCNN). Presented at the 2014 E (1993) Unreliability of blood pressure and heart rate to evalu-
International Joint Conference on Neural Networks (IJCNN), ate cardiac output in emergency resuscitation and critical illness.
pp 638–645. doi:10.1109/IJCNN.2014.6889717 Crit Care Med 21:218–223
Versaci M, Morabito FC (2003) Fuzzy time series approach for dis-
ruption prediction in Tokamak reactors. IEEE Trans Magnetics
39(3):1503–1506
13