Professional Documents
Culture Documents
Irish Centre For Fetal and Neonatal Translational Research, University College Cork
Irish Centre For Fetal and Neonatal Translational Research, University College Cork
Irish Centre For Fetal and Neonatal Translational Research, University College Cork
Irish Centre for Fetal and Neonatal Translational Research, University College Cork
ABSTRACT The resultant characteristics are subjected to heuristic rules
and compared with empirical thresholds [6], [7].
This study presents a novel end-to-end architecture that learns The data-driven approach involves extraction of features
hierarchical representations from raw EEG data using fully from time, frequency and information theory domains to
convolutional deep neural networks for the task of neonatal capture energy, frequency, temporal and structural
seizure detection. The deep neural network acts as both information to form a generic description of the EEG signal
feature extractor and classifier, allowing for end-to-end [8]. This approach involves extraction of non-stationary and
optimization of the seizure detector. The designed system is model-based features and uses a classifier as a back-end [9].
evaluated on a large dataset of continuous unedited multi- The choice of the features for EEG representation and
channel neonatal EEG totaling 835 hours and comprising of decision-making is prompted by an understanding that during
1389 seizures. The proposed deep architecture, with sample- a seizure the EEG epoch will become more ordered, more
level filters, achieves an accuracy that is comparable to the deterministic and quasi-periodic in nature, compared to the
state-of-the-art SVM-based neonatal seizure detector, which background EEG. With both approaches (data-driven and
operates on a set of carefully designed hand-crafted features. mimicking the clinician) the prior knowledge of neonatal
The fully convolutional architecture allows for the EEG is reflected in a set of hand-crafted characteristics.
localization of EEG waveforms and patterns that result in The Support Vector Machine (SVM) based algorithm,
high seizure probabilities for further clinical examination. which is reported in [10], currently represents the state-of-
the-art in the area of neonatal seizure detection. Its
Index Terms—neonatal seizure detection, convolutional performance has been validated on a large clinical database
neural networks, support vector machine, EEG waveforms. to confirm robust functionality and a clinically acceptable
level of accuracy of detection. This SVM system relies on a
1. INTRODUCTION1 large set of engineered features.
Convolutional neural networks (CNNs) have achieved
Seizures in newborn babies are one of the most common considerable success in the area of computer vision [11], [12].
indicators of a serious neurological condition, such as The previously used manual feature-extraction approaches
hypoxic-ischemic encephalopathy or stroke [1]. Most have been outclassed by deep CNNs, with their ability to
seizures in the neonatal stage occur at the subclinical level, learn relevant features from the data through end-to-end
meaning that they cannot be detected without monitoring the hierarchical representation and incorporation of translation
EEG [2]. Interpretation of neonatal EEG requires highly invariance. Following the success in image processing, CNNs
trained healthcare professionals and is limited to specialized have been applied to speech, audio and music processing,
units. This has prompted research into automated seizure where the time series can be represented as ‘images’ by
detection systems where an objective score can be assigned means of time-frequency decomposition [13]–[15].
to each segment of EEG [3]. Similarly, EEG spectrogram images were used with
When identifying a segment of EEG as seizure, a CNNs in the prediction of epilepsy in adults [16], [17].
neurophysiologist is looking for a clear change in the EEG Likewise, EEG time-frequency images [18] or EEG spatial-
from its typical background behavior. In extracting a temporal images [19], [20] were used together with CNNs in
signature of the seizure signal with computer algorithms, data brain computer interfaces.
scientists usually follow one of two approaches – mimicking Unlike previous neonatal seizure detection studies, we
the clinician or using general data-driven EEG aim to use CNNs to learn features from the raw EEG data, in
characteristics. On the assumption that rhythmic behavior is a similar manner to CNNs that have been applied to raw audio
indicative of seizure, the former approach searches for the [21]–[23]. The small (a few samples) width of the
appearance of repetitive, pseudo-periodic waveforms by convolutional filters facilitates the learning of high frequency
means of autocorrelation [4] or wave-sequence analysis [5]. patterns in the first layers, and low frequency patterns, with
1 NVIDIA Corporation with the donation of the TitanX GPU used for this
The work was supported by Science Foundation Ireland Research Centre
Award, INFANT (12/RC/2272). We gratefully acknowledge the support of research.
The temporal relationship between the final layer and the raw of the extent to which a particular EEG waveform resembles
input EEG allows for replication of the process by which a seizure or non-seizure. By viewing these waveforms we can
healthcare professional interprets the EEG. In all layers of the learn about what the network interprets as being
network, temporal ordering is maintained, any spikes of representative of seizures in the input signal.
seizure or non-seizure activity in each of these feature maps Fig. 3 (a) shows one minute of EEG seizure activity in the
can be traced back to the corresponding receptive field in the time domain from a patient which was excluded from the
raw input EEG. This is not feasible with shallow architectures training data. The network classified this segment as seizure,
built on heavily engineered features – the features come from with a probability of 0.97. The two feature maps in the final
different domain and it is hardly possible to trace-back and network layer, before GAP, can be seen in Fig. 3, where
find out to which feature a particular (nonlinear) decision was feature map (c) represents the seizure class. Using this feature
mostly attributable to. In contrast, the two final feature maps map a segment in the time domain that corresponds to high
in the last convolutional layer correspond to the seizure and
values of the seizure feature map can be identified as
non-seizure cases. The amplitudes in this layer are indicative highlighted in green in Fig. 3.
Fig. 4 displays four examples of raw EEG which the [9] A. Temko, W. Marnane, G. Boylan, G. Lightbody, “Clinical
network considers to be highly representative of seizure implementation of a neonatal seizure detection algorithm,”
activity. All of these samples were also judged to represent Decis. Support Syst., v. 70, pp. 86–96, 2015.
seizures by clinical experts. Fig. 4 (a) plots the 10 second clip [10] A. Temko, G. Boylan, W. Marnane, G. Lightbody, “Robust
neonatal EEG seizure detection through adaptive background
highlighted in Fig. 3. Fig. 4 (b) is taken from the same patient modeling,” Int. J. Neural Syst., v. 23, 2013.
whereas plots (c) and (d) are taken from a different patient. [11] A. Krizhevsky, I. Sutskever, and G. E. Hinton, “ImageNet
classification with deep convolutional neural networks,”
5. CONCLUSION Advances in NIPS, pp. 1097–1105, 2012.
[12] G. Hinton, L. Deng, D. Yu, G. Dahl, A. Mohamed, N. Jaitly,
This work presented how fully convolutional neural network A. Senior, V. Vanhouke, P. Nguyen, T. Sainath, B. Kingsbury,
architecture with sample-size filters could be applied to raw “Deep neural networks for acoustic modeling in speech
EEG to learn relevant features and classify segments of recognition: The shared views of four research groups,” IEEE
neonatal EEG into either seizure or non-seizure classes. Signal Process Mag., v. 29, pp. 82–97, 2012.
[13] J. Schlüter, S. Böck, “Improved musical onset detection with
Evaluated on a large dataset of unedited EEG, the developed convolutional neural networks,” IEEE ICASSP, pp. 6979–
novel system has achieved a level of performance which is 6983, 2014.
comparable to the previously developed SVM-based system [14] O. Abdel-Hamid, A. R Mohamed, H. Jiang, L. Deng, G. Penn,
which was built on top of a large set of heavily engineered and D. Yu, “Convolutional neural networks for speech
features. The advantages of the proposed approach, such as recognition,” IEEE Trans. Audio Speech Lang. Process., v.
the end-to-end optimization of feature extraction and 22, pp. 1533–1545, 2014.
classification, have been discussed. [15] H. Lee, P. Pham, Y. Largman, A. Ng, “Unsupervised feature
The main advantage of using a fully convolutional learning for audio classification using convolutional deep
network is that the weight matrix at each convolutional layer belief networks,” Advances in NIPS, pp. 1096–1104, 2009.
[16] P. Mirowski, D. Madhavan, Y. LeCun, R. Kuzniecky,
can be visualized, and so further research will concentrate on “Classification of patterns of EEG synchronization for seizure
gaining new insights into the make-up of neonatal EEG prediction,” Clin. Neurophysiol., v. 120, pp. 1927–1940, 2009.
signals based on these learned weight matrices. [17] I. Korshunova, P. J. Kindermans, J. Degrave, T. Verhoeven,
B. Brinkmann, J. Dambre, “Towards improved design and
6. REFERENCES evaluation of epileptic seizure predictors,” IEEE Trans.
Biomed. Eng., in press, 10.1109/TBME.2017.2700086, 2017.
[1] J. Rennie, G. Boylan, “Treatment of neonatal seizures,” Arch. [18] H. Cecotti, A. Graser, “Convolutional neural networks for
Dis. Child. Fetal Neonatal Ed., v. 92, pp. 148–150, 2007. P300 detection with application to brain-computer interfaces,”
[2] D. Murray, G. Boylan, I. Ali, C. Ryan, B. Murphy, S. IEEE Trans. Pattern Anal. Mach. Intell., v. 33, pp. 433–445,
Connolly, “Defining the gap between electrographic seizure 2011.
burden, clinical expression and staff recognition of neonatal [19] S. Stober, A. Sternin, A. Owen, J. Grahn, “Deep feature
seizures,” Arch. Dis. Child. Fetal Neonatal Ed., v. 93, pp. learning for EEG recordings,” arXiv:1511.04306, 2015.
187–191, 2008. [20] I. Walker, M. Deisenroth, F. Aldo, “Deep convolutional neural
[3] A. Temko, E. Thomas, W. Marnane, G. Lightbody, G. Boylan, networks for brain computer interface using motor imagery,”
“EEG-based neonatal seizure detection with Support Vector MSc. Computing Science, Imperial College London, 2015.
Machines,” Clin. Neurophysiol., v. 122, pp. 464–473, 2011. [21] J. Lee, J. Park, K. Kim, J. Nam, “Sample-level deep
[4] A. Liu, J. Hahn, G. Heldt, R. Coen, “Detection of neonatal convolutional neural networks for music auto-tagging using
seizures through computerized EEG analysis,” raw waveforms,” arXiv:1703.01789, 2017.
Electroencephalogr. Clin. Neuroph, v. 82, pp. 30–37, 1992. [22] Y. Hoshen, R. Weiss, K. Wilson, “Speech acoustic modeling
[5] M. Navakatikyan, P. Colditz, C. Burke, T. Inder, J. Richmond, from raw multichannel waveforms,” IEEE ICASSP, pp. 4624–
C. Williams, “Seizure detection algorithm for neonates based 4628, 2015.
on wave-sequence analysis,” Clin. Neurophysiol., v. 117, pp. [23] Z. Tüske, P. Golik, R. Schlüter, H. Ney, “Acoustic modeling
1190–1203, 2006. with deep neural networks using raw time signal for LVCSR,”
[6] W. Deburchgraeve, P. Cherian, M. De Vos, R. Swarte, J. Blok, 15th Interspeech, 2014.
G. Visser, P. Govaert, S. Van Huffel, “Automated neonatal [24] J. Long, E. Shelhamer, T. Darrell, “Fully convolutional
seizure detection mimicking a human observer reading EEG,” networks for semantic segmentation,” IEEE CVPR, pp. 3431–
Clin. Neurophysiol., v. 119, pp. 2447–2454, 2008. 3440, 2015.
[7] J. Gotman, D. Flanagan, J. Zhang, B. Rosenblatt, “Automatic [25] F. Chollet, “Keras,” https://github.com/fchollet/keras/, 2015.
seizure detection in the newborn: methods and initial [26] S. Ioffe, C. Szegedy, "Batch Normalization: Accelerating
evaluation,” Electroencephalogr. Clin. Neurophysiol., v. 103, Deep Network Training by Reducing Internal Covariate
pp. 356–362, 1997. Shift," 32nd ICML, pp. 448-456, 2015.
[8] E. Thomas, A. Temko, W. P. Marnane, G. B. Boylan, G. [27] M. Zeiler, R. Fergus, "Visualizing and Understanding
Lightbody, “Discriminative and generative classification Convolutional Networks," Lecture Notes in Computer Sci.,
techniques applied to automated neonatal seizure detection,” v. 8689, pp. 818–833, 2014.
IEEE J. Biomed. Health Inform., v. 17, pp. 297–304, 2013.