Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Patient-specific seizure prediction based on heart rate variability and recurrence quantification analysis

  • Lucia Billeci ,

    Roles Conceptualization, Formal analysis, Methodology, Software, Writing – original draft, Writing – review & editing

    lucia.billeci@ifc.cnr.it

    Affiliation Institute of Clinical Physiology, National Research Council of Italy (CNR), Pisa, Italy

  • Daniela Marino,

    Roles Investigation, Methodology, Resources, Writing – review & editing

    Affiliation Department of Medicine, Surgery and Neuroscience, University of Siena, Siena, Italy

  • Laura Insana,

    Roles Investigation, Methodology, Resources

    Affiliation Department of Medicine, Surgery and Neuroscience, University of Siena, Siena, Italy

  • Giampaolo Vatti,

    Roles Conceptualization, Funding acquisition, Resources, Supervision

    Affiliation Department of Medicine, Surgery and Neuroscience, University of Siena, Siena, Italy

  • Maurizio Varanini

    Roles Conceptualization, Formal analysis, Funding acquisition, Supervision, Writing – review & editing

    Affiliation Institute of Clinical Physiology, National Research Council of Italy (CNR), Pisa, Italy

Abstract

Epilepsy is often associated with modifications in autonomic nervous system, which usually precede the onset of seizures of several minutes. Thus, there is a great interest in identifying these modifications enough time in advance to prevent a dangerous effect and to intervene. In addition, these changes can be a risk factor for epileptic patients and can increase the possibility of death. Notably autonomic changes associated to seizures are highly depended of seizure type, localization and lateralization. The aim of this study was to develop a patient-specific approach to predict seizures using electrocardiogram (ECG) features. Specifically, from the RR series, both time and frequency variables and features obtained by the recurrence quantification analysis were used. The algorithm was applied in a dataset of 15 patients with 38 different types of seizures. A feature selection step, was used to identify those features that were more significant in discriminating preictal and interictal phases. A preictal interval of 15 minutes was selected. A support vector machine (SVM) classifier was then built to classify preictal and interictal phases. First, a classifier was set up to classify preictal and interictal segments of each patient and an average sensibility of 89.06% was obtained, with a number of false positive per hour (FP/h) of 0.41. Then, in those patients who had at least 3 seizures, a double-cross-validation approach was used to predict unseen seizures on the basis of a training on previous ones. The results were quite variable according to seizure type, achieving the best performance in patients with more stereotypical seizure. The results of the proposed approach show that it is feasible to predict seizure in advance, considering patient-specific, and possible seizure specific, characteristics.

Introduction

Epilepsy is a neurological disorder [1], characterized by the recurrence of epileptic seizures, which constitutes a nosographic entity with a considerable social impact, both due to its high incidence due to its chronicity. The lifetime prevalence of epilepsy is estimated as 7.60 per 1,000 persons while the incidence rate as 61.44 per 100,000 person-years [2].

The disorder can occur at any age, although in about 80% of the cases the crises begin before the age of 20, particularly in childhood and adolescence. In recent years there has been however an increased need of detection of the disease in elderly, both due to the increase in the average age and the increase in the incidence of cerebrovascular disorders.

In about 2/3 of the patients, seizures are controlled with drug therapy, while in the remaining cases they persist despite appropriate treatment. This is called drug-resistant epilepsy. Resistant epilepsies represent a source of serious personal, family and social distress [3].

The electroencephalogram (EEG) is widely used in the diagnosis of epilepsy, capturing the changes in neuronal activity that occur during an epileptic seizure. Such modifications, usually coincide with clinical manifestations of crisis, sometimes they can precede them for a few seconds, while in other cases they become evident only after the onset of symptoms [4]. Recently, there has been a growing interest in the analysis of the EEG signal with the aim of predicting epileptic seizures to reduce or eliminate the risks associated with it [5, 6].

It has been observed that in addition to modifications in neural activity, seizures are associated to modifications in the autonomic nervous system (ANS). Indeed, modifications of the global state of the organism, induced by modulations of the autonomic state, can induce a variation of the neuronal microenvironment and, indirectly, produce a change of the activation state of some neuronal populations [7]. One third of epilepsy patients, in addition to the alterations of the ANS often associated with the crisis (tachycardia, bradycardia, asystole, modification of ventricular repolarization), presents an altered inter-ictal electrocardiographic activity [8]. Therefore, early identification of cardio modalities could contribute to the prevention/early interruption of the crisis or, at least, to the suspension of ongoing activities in patients with treatment-resistant crises. In addition, modifications of cardiac activity could be responsible for sudden unexpected death in epilepsy (SUDEP). Such cardiac changes precede the onset of the epileptic seizure in 70% of cases, so that it has been proposed to try to modulate the heart-brain interaction for the prevention and control of focal crises in children [9].

Previous studies have reported that the analysis of electrocardiogram activity can be useful in the prediction of epileptic seizures. Some studies have analyzed Heart Rate Variability (HRV) parameters and statistically compared these indices in preictal and inter-ictal changes and found significant modifications in these features during preictal mainly indicating a higher sympathetic activity [10, 11, 12]. These changes are observed in particular 5 minutes before the seizure onset.

Other studies have used more complicated approach to evaluate the possibility of using HRV indices to predict seizure. Behabani et al. [13] used HRV indices in an adaptive decision threshold method and reached an average sensitivity of 78.59% with an intervention time of 110 Sec and false positive (FP) rate of 0.21 h−1. Fujiwara et al. [14] described a multivariate statistical process using time and frequency domain HRV indices and obtained a seizure prediction with a sensitivity of 91% and FP rate of 0.7 h−1.

Several studies have applied techniques for data classification and machine learning, in particular Support Vector Machines (SVMs) and neural networks, for the detection and prediction of epileptic seizures, using EEG data [5, 6, 15, 16]. In particular, the SVMs [17] are classification methods equipped with learning algorithms that analyze data and recognize certain patterns through the solution of non-convex optimization problems. Only one very recent study [18] presented a method for the early detection or forecasting using an SVM approach using HRV parameters. The method allowed to reveal the beginning of a seizure rom 5 min to just before the onset of a clinical/electrical seizure with a sensitivity of 94.1% and a FP rate of 0.49 h−1. This study showed the robustness of this method for seizure characterization.

It should be observed that in the aforementioned studies, the features used are quite variable, ranging from temporal indices, frequency indices or non-linear indices like those extracted from the Poincairè analysis. This is partially due to the fact that each feature, or subgroup of features, can be relevant for specific seizure onset patterns. For example, temporal lobe seizures are characterized by elevated heart rate (HR) more than the other type of seizure [19], patients with right-sided epilepsy have increased sympathetic activity (LF, low-frequency) while patients with left-sided epilepsy have increased vagal activity (HF, high-frequency) [20]; second generalized seizures are characterized by an increase in mean HR, LF/HF and SD2/SD1 ratio when compared to complex partial seizures [21]. In our study, we included a quite high number of features, selected according to the results of the previous studies, which allowed to cover all the variability present in the dataset of patients. A feature selection step, permits than to select the features which are more relevant for a specific patient.

Notably, in all the prediction studies based on ECG signals listed above, prediction is based on classical indices of HRV analyses which are extracted in the time or in the frequency domain and reflect the regulation of sympathetic and parasympathetic ANS on HR [7]. However other complementary characteristics of the cardiac signals (RR series) can be analyzed and can be useful in revealing seizure. In particular, recurrence is a fundamental property of dynamical systems, which can be exploited to characterize the system’s behavior in phase space. A powerful tool for the visualization and analysis of recurrences is the so-called recurrence plot (RP) [22]. RPs can reveal information which are not easily obtainable by other methods. The RP is the graphical representation of a binary symmetric square matrix which encodes the times when two states are in close proximity (i.e. neighbors in phase space). Based on such a recurrence matrix, a large and diverse amount of information on the dynamics of the system can be extracted and statistically quantified using recurrence quantification analysis (RQA) [23]. Importantly, no mathematical assumptions regarding the data and the generating systems are made so this tool is particularly suitable for the analysis of physiological signals which are often non-stationary [24]. RPs have been applied in the analysis and characterization of EEG signals in epileptic subjects [25, 26]. However, to the best of our knowledge, none has applied RQA for the characterization and prediction of seizures using RR series.

The aim of this study was to test present a method for the early detection or prediction of epileptic seizures based on the combination of traditional HRV parameters and RQA parameters, and the application of a SVM approach. Our approach follows a patient-specific classification method. Indeed, we hypothesized that seizure patterns across patients vary substantially and so there may be no single generic algorithm that can be applied to all patients and can achieve high sensitivity and specificity [5, 27].

Materials and methods

Data

The signals analyzed in this study were acquired prospectively or retrospectively from patients admitted to Unit of Neurology and Neurophysiology, Department of Neurological and Neurosensorial Sciences, University of Siena, Italy. The study was approved by the Ethical Committee of the University of Siena and performed in accordance with the Declaration of Helsinki. At the time of admission at the clinics, each patient signed a written informed consent in which agrees to the video registration and to the use of the data for a possible scientific divulgation.

The diagnosis of epilepsy and the classification of seizures was performed by two expert clinicians after a careful revision of the clinical and electrophysiological data of each patient. Specifically, the clinicians evaluated and correlated the clinical aspects of seizures (semiology, onset and history), the electrical abnormalities (Video-EEG long-term monitoring) and the neuroimaging’s findings (structural Magnetic Resonance Imaging acquired at 1.5 or 3 Tesla).

All the patients were long-term monitored with a Video-EEG, with electrodes arranged on the basis of the international 10–20 system, and with ECG. ECG was measured simultaneously with a sampling rate of 512 Hz. The onset of the seizure was identified as the earliest seizure-related change in behavior (as observed on the video recording) or EEG (a modification in the EEG typical pattern associated with an epileptic seizure as recognized by two expert epileptologists). All patients were asked to lay as much as possible in the bed in order to determine as precisely as possible the onset of the seizure from the video recording and to avoid artifacts in the EEG signals that may confuse or hide the onset of the seizure. The segments of signals in which the patients are as still as possible are then selected for the analysis. This procedure allows to reduce the influence of patient’s activity on ECG features.

Data from a total of 19 patients were acquired. These patients are drug-resistant subjects, submitted to a pre-surgical evaluation, and assuming more than one antiepileptic drug. Of these subjects 2 were excluded because they had not enough interictal periods, while other 2 subjects were excluded for poor quality signal. The final database consisted of 38 seizures from 15 patients (8 females; 7 males; age 17.6±9.9 years) mostly affected by frontotemporal epilepsy. The seizure classification was performed according to the criteria of the International League Against Epilepsy (ILAE) [28] while patients’ treatment responsivity and resistance were determined on the basis of the new ILAE 2010 criteria [29]. Table 1 gives a detailed overview of the dataset.

thumbnail
Table 1. Characteristics of the patients included in the study.

https://doi.org/10.1371/journal.pone.0204339.t001

ECG signals processing

The proposed approach consists in an initial step of ECG signals preprocessing followed by feature extraction and selection. Then a classification method, based on SVM, is implemented with the aim of accurately classifying preictal and interictal segments in a patient-specific way. The flowchart of the proposed approach is represented in Fig 1. All the processing was performed using home-made Matlab scripts.

thumbnail
Fig 1. Flowchart of the proposed algorithm.

The system consists of a pre-processing module, a feature extraction module, a feature selection module and finally a classification module based on Support Vector Machine. This last module includes a learning step, in which the classifier is trained, and a validation step, in which the optimized classifier is applied on the test set to classify preictal and ictal segments.

https://doi.org/10.1371/journal.pone.0204339.g001

Pre-processing.

ECG signals were first analyzed for impulsive artefacts removal, power-line interference cancelling (50Hz), baseline wandering removal, signal-to-noise ratio improvement.

For a detailed description of these pre-processing steps see [30]. Briefly, impulsive artefacts cancelling was obtained by computing the absolute difference between the original signal and the signal obtained by median filtering (60 ms window). Then if the absolute difference of a specific segment of signal exceeded a threshold (estimated considering the maximum of this difference) that segment was considered as an artefact and its values were assigned with the average of the values of the original signal immediately before and after the segment.

Baseline wandering removal was obtained by applying a low-pass first order Butterworth filter in forward and backward directions (total cutoff frequency at 3.1 Hz) and subtracting the signal obtained from original signal. The occurrence of residual artefacts, due to the filter delay in tracking fast baseline movements, was then verified. If the amplitude and the duration of residual artefacts exceed certain thresholds, a median filtering (0.26 s window) was applied.

RR series reconstruction.

After these steps, the signal was interpolated to 1024 KHz to get a precise time location and the QRS complexes were detected to reconstruct the RR series.

For each ECG channels the QRS events were enhanced using a cascade of a (5-15Hz) bandpass filter and a derivative filter implemented as a moving average of 8 ms on the output of the comb-filter: (1) where the delay k is 13 ms.

The channel with the best ECG was identified by taking into account a priori knowledge of the QRS derivative, width and pseudo-periodicity. Pseudo-periodicity was considered to discriminate ECG from noise or sporadic artefacts. In fact, QRS should occur at least once in 2 s wide windows and only few times in 0.2 s wide windows, whereas noise likely occurs in windows of both widths. On the other hand, sporadic artefacts should occur in some 8 s wide windows but only in few 2 s wide windows.

These observations and the absolute values of the derivative signal were used to build an index of quality for each ECG channel. The maximum of quality indexes was found and all the channels whose quality index was greater than 0.9 times the maximum were selected to be used in the QRS detection algorithm. The absolute derivatives of the selected channels were summed and filtered by a forward-backward Butterworth bandpass filter (6.3–16 Hz). The QRS was detected with an adaptive threshold on derivative amplitude automatically initialized and recursively updated at each new detection. Such threshold modifies with the temporal distance from the previous QRS detection, in order to avoid erroneous detection of high T wave. The fiducial point of each detected QRS was identified as the position of the maximum (minimum) of the derivative signal whose sign was determined during the initialization phase.

Correction of the RR interval series.

The autonomic nervous system controls the heart rhythm through the atrial sinus node. The RR interval series contains numerous values that do not have a sinus origin. These values can be due to heart beats of non-sinus origin (extrasystole) or may be due to errors in the recognition of the QRS complex (false positives, false negatives). Therefore, an algorithm was applied for the recognition and correction of non-sinusoidal beats to obtain a RR series that only contains variations due to the sinus node and thus reflects the activity of the ANS. The algorithm consisted in two steps:

  • a finite-state algorithm based on simple rules derived from a priori knowledge and aimed at identifying and correcting outlier values. The algorithm moves, deletes or inserts QRS and their values into the RR interval series. The inserted values are equal to the ones that are expected on the bases of a priori knowledge. For example, in case of a long-lasting RR interval that is much greater than an expected value (due to a cardiac pause, an absence interval or a series of false negatives of the recognizer).
  • an adaptive optimal filter in predictive form is automatically initialized on an initial range of the series. The filter uses a linear combination of previous RR values to estimate the current value. If the prediction error is less than a threshold, the current value is accepted and the filter coefficients are updated otherwise the current value is replaced with that predicted by the filter. This simple decision logic is made robust by controls and criteria such as partial updating of the coefficients and correction of the predicted in the direction of the current RR value. Fig 2 shows the RR series of Patient 1 before and after correction.
thumbnail
Fig 2. RR series before and after correction.

The red line represents the series before correction and the blue line the series after the application of the correction algorithms. As an example, the RR series of Patient 1 is represented.

https://doi.org/10.1371/journal.pone.0204339.g002

After correction, the obtained RR series was resampled at 4 Hz using a linear interpolation so that its sampling points were arranged at equal intervals.

Feature extraction.

After pre-processing and RR series reconstruction and correction, features were extracted for each signal. Features were extracted within 180 R-R windows with 60 R-R of overlap. Notably, it has been recently demonstrated that the analysis of ultra-short-term recordings provide a reliable source of cardiac autonomic nervous system assessment [31, 32]. To reduce inter-individual variability, the whole RR was normalized with zero mean and a standard deviation of one before computing the features. A total of 20 features were computed, including time-domain features, frequency domain features and features obtained by RQA.

The time-domain features computed were the following:

  • MeanNN: mean of RR intervals;
  • RMSSD: root mean square of successive differences;
  • SDNN: standard deviation of RR intervals;
  • NN50: number of pairs of adjacent RRI whose difference is more than 50 ms;
  • PNN50: value of NN50 divided by the total number of N-N (R-R) intervals;
  • VAR: variance of RR intervals;
  • SD1: standard deviation of projection of the Poincaré plot on the line perpendicular to the line of identity that is a measure of short-term variability;
  • SD2: standard deviation of the projection of the Poincaré plot on the line of identity that is a measure of long-term variability;
  • CSI: Cardiac Sympathetic Index computed as: (2)
  • CSV: Cardiac Vagal Index computed as: (3)
  • CoSEn: Coefficient of Sample Entropy, which has been specifically designed for very short RR interval time series [33, 34];
  • KFD: Katz Fractal Dimension [35].

To compute frequency-domain features, the Generalized Short Time Fourier Transform (GSTFT) [36] was calculated.

The GSTFT is a generalization of the Short Time Fourier Transform (STFT) in which the width of the analysis window is not constant and changes with frequency according to a user defined function. Thus, the resolution in time (or the related resolution in frequency) is a general function of the frequency, which the user can define according to the signal characteristics and to the specific goal of the analysis. We have previously showed that the selection of a parametric sigmoid junction as function, gives good results in the analysis of cardiovascular time series [36].

From the GSTFT the following features were extracted:

  • LFn: power of the low frequency band (0.04 Hz—0.15 Hz) normalized to the total power;
  • HFn: power of the low frequency band (0.15 Hz—0.40 Hz) normalized to the total power;
  • LF/HF: ratio of LF to HF, which is related to the sympathetic-parasympathetic balance of the ANS.

Recurrence plots (RP) proposed by Eckmann et al. [22] reveals all the times when the phase space trajectory of the dynamical system visits roughly the same area in the phase space. It is a visualization of a square matrix, in which the elements correspond to those times at which a state of a dynamical system recurs.

The RP is based on the following N × N matrix: (4) where N is the number of states of xi, ɛ is a predefined cutoff distance, ‖·‖ is the norm (e.g., the Euclidean norm) and Θ(·) is the Heaviside function. The cutoff distance ɛ defines a sphere centered at xi, if xj, falls within this sphere, i.e., the state is close to xi, then Ri,j = 1; otherwise Ri,j = 0. The binary values of Ri,j can be visualized in a plot with the black (1) and white (0).

The RQA is a technique for the analysis of RPs which quantifies the density of recurrence points as well as the histograms of the lengths of the diagonal and vertical lines in a recurrence plot [37]. Features extracted using the RQA were:

  • Recurrence Rate (%REC): quantifies the percentage of recurrent points and is calculated as (5)
    The more periodic the signal dynamics, the higher the REC value.
  • Determinism (%DET): the ratio of recurrence points on the diagonal structures to all recurrence points, calculated as (6) where P(l) is the number of diagonal structures whose length is l. lmin is a threshold, which excludes the diagonal lines formed by the tangential motion of a phase space trajectory. In this study lmin = 2. Processes with stochastic behavior cause none or very short diagonals, whereas deterministic processes cause longer diagonals and less single, isolated recurrence points.
  • LMAX: the length of the longest diagonal line segment in the RP, excluding the main diagonal line. The shorter the LMAX, the more chaotic (less stable) the signal.
  • Laminarity (LAM): the ratio of recurrence points on the vertical structures to all recurrence points, calculated as (7) where P(v) is the number of vertical structures whose length is v. Here, vmin = 2 is used. LAM decrease if the RP consists of more single recurrence points than vertical structures.
  • Trapping Time (TT): the average length of vertical line structures, calculated as (8) as for LAM, P(v) is the number of diagonal structures whose length is v and vmin = 2. TT estimates the mean time at which the system will abide at a specific state or how long the state will be trapped.
  • Entropy (ENT): the Shannon entropy of the frequency distribution of the diagonal line lengths, calculated as (9) where P(l) is the probability density of the diagonal structure whose length is l and it is defined as P(l)/sum(P(l)). ENT is considered as a complexity measure of the system: the more complex the deterministic structure, the larger ENT value.

Segmentation of feature vectors

Following the feature extraction phase, each vector of features was segmented in the following states:

  • Ictal: from the seizure onset to the end of seizures, as marked by the clinicians. This segment is of varying length but is typically close to 3 minutes long;
  • Preictal: from 15 minutes prior to the seizure onset to the seizure onset;
  • Interictal: non-seizure data preceding the preictal state or proceeding the postictal state which are apart from at least 50 minutes from seizure [14].

Feature selection

Before applying classification, a feature selection step was included. Different feature selection algorithms were tested namely the neighborhood component analysis, the neighborhood component analysis for regression, the stepwise regression analysis and the ReliefF algorithm. In our sample, the stepwise regression analysis gave the most accurate results.

The stepwise regression analysis works by adding and removing terms from a multilinear model according to their statistical significance in a regression. The method begins with an initial model and then compares the explanatory power of incrementally larger and smaller models. At each step, the p value of an F-statistic is computed to test models with and without a potential term. If a term is not currently in the model, the null hypothesis is that the term would have a zero coefficient if added to the model. If there is sufficient evidence to reject the null hypothesis, the term is added to the model. Conversely, if a term is currently in the model, the null hypothesis is that the term has a zero coefficient. If there is insufficient evidence to reject the null hypothesis, the term is removed from the model. The method proceeds as follows:

  1. Fit the initial model.
  2. If any terms not in the model have p-values less than an entrance tolerance, add the one with the smallest p value and repeat this step; otherwise, go to step 3.
  3. If any terms in the model have p-values greater than an exit tolerance, remove the one with the largest p value and go to step 2; otherwise, end.

The method terminates when no single step improves the model.

Classification

Our patient-specific approach to seizure prediction is based on binary classification of ECG segments using a machine learning algorithm. The aim is to classify ECG segments as either preictal or interictal based on the selected features. Thus, the vectors of selected features were submitted to an SVM for classification. This method, developed by Vapnik [38], is a powerful tool often used for solving supervised classification problems due to its generalization ability. An SVM classifiers works by maximizing the margin between the training data and the decision boundary. The boundary is a hyperplane that optimally separate the classes. The subset of patterns those are closest to the decision boundary are called support vectors.

Let {xi,yi} with i = 1…N be the training data with the input vector containing the selected features, and yi ∈ {− 1, +1} the classes. In the case of a linearly separable classification problem, the model constructs a hyperplane as follows: (10) were the function ϕ(x) maps the vector of features x to a high dimensional space is weight vector and b is scalar bias.

The output of the classifier can be determined by the following equation: (11)

In real applications classes are not linearly separable i.e. data of classes are overlapping and misclassifications should be allowed. Thus, the unknown variables w and b can be found by solving the following optimization problem: (12) such that: (13) With C > 0, (penalty parameter of the error term) is a regularization factor which determines the trade-off between model complexity and misclassification error.

The kernel function is given by the relation: (14)

In this paper, a radial basis function (RBF) was used as the kernel function. The RBF kernel is defined as follows: (15) where xi is the input sample, x is the space of the training set, and ‖·‖ represents the Euclidean distance operator. The performance of the SVM classifier depend by two parameters: the penalty parameter (C), which controls model overfitting, and the parameter gamma (γ), which controls the model’s degree of nonlinearity. To obtain the optimal classification performance, it is important to find the best combination of these parameters. In this work, an automatic optimization function in Matlab was used, which find hyperparameters that minimize five-fold cross-validation loss.

Cost-sensitive SVMs (CSVMs) was used due to the fact that the datasets are unbalanced [39]: the number of interictal segments are much greater than the number of preictal ones.

For each dataset D, the weight values used for interictal and preictal classes were respectively set at 1 and interD/preD where interD is the number of interictal segments and preD is the number of preictal segments [6].

In a first experiment we applied a cross-validation to all patients with the aim of classifying preictal and interictal segments. For each patient, we randomly selected 80% of the dataset (set of the vectors of feature calculated in each time window) and evaluated the prediction rate by testing the model on 20% of the dataset that was reserved for testing. Due to the low number of preictal segments, the cross validation of the SVM classifier was performed on the whole dataset deserved for training. A five cross-validation training was performed. The optimal SVM classifier was selected as the one with the lower classification loss, i.e. the one with the lower predictive inaccuracy. The performance of this classifier was tested on the test set and the performance were calculated.

In a second experiment, we applied a double cross-validation just in those patients who had at least 3 seizures (5 out of 15 patients in the dataset) with the aim to predict a seizure block (preictal + interictal) on the basis of the other ones. According to double cross-validation method, data were partitioned into two subsets: training set and test set. The training set was separated into subdivisions: learning set and validation set. The double cross-validation method allows to have an unbiased estimation of SVM accuracy [40]. A similar approach was previously applied in the prediction of seizures using EEG recordings [5, 41].

In a patient with N seizures and I-hour-long interictal recordings (at least 50 minutes far from the seizure), we separated the dataset into N block, each containing (I/N)-hour of interictal recording and 15 min of preictal. Then, we used the last seizure block for testing set and the other (N − 1) blocks for training set. To consider reality and physiological condition, classifier was trained on earlier and later seizures were used for testing [41].

To establish an optimal SVM classifier in training, we perform fivefold cross-validation by randomly selecting 80% of the training set (learning set) and validating the model on the remaining 20% of the training set (validation set) to check if the model is well-fit. Once the SVM model was trained, the performance e was evaluated by testing the model on the fold that was reserved for testing. Since we want at least two seizures blocks for training, the seizure blocks that were predicted were from the third to the last one. Thus, this process is repeated (N-2) times and the average prediction rate is reported. The prediction time was also calculated as the time interval from the first vector of feature that was classified as “pre-seizure” and the seizure onset.

Performance evaluation

For each patient, the results were assessed in terms of sensitivity, specificity, accuracy and false prediction rate per hour (FP/h), Sensitivity (Sens) and specificity (Spec), which reflect performance of imbalanced classification, are defined as following [39]: (16) (17)

Accuracy (Acc) was calculated as: (18)

In addition, FP/h was calculated as the number of FP divided by the number of available hours of interictal.

TP, TN, FP, and FN were defined as follows:

  • TP: correctly classified preictal segments;
  • TN: correctly classified interictal segments;
  • FP: incorrectly classified interictal segments;
  • FN: incorrectly classified preictal segments.

Results

Different features were selected for each patient in the feature selection step. From 3 to a maximum of 13 features were selected with an average of 6.7 features per patient. Table 2 shows the features selected for each patient. In the last row of the table the number of patient for which each feature is selected are reported. The most frequently (half number of patients or more) selected features were: meanNN, pNN50, CosEn, LAM, HF and LF/HF.

thumbnail
Table 2. Selected features for each patient.

In the last row of the table were the number of patient for which each feature is selected is reported, the more frequently selected features are highlighted in bold.

https://doi.org/10.1371/journal.pone.0204339.t002

Fig 3 shows the dynamics of the most frequently selected features for one seizure in Patient 15. The signals are displayed from 25 minutes before seizure onset to 5 minutes after the end of the seizure. It can be observed that the meanNN, pNN50, CoSEn and HF decrease from preictal to the ictal phase while LAM and LF/HF increase.

thumbnail
Fig 3. Dynamics of the most discriminant features.

The image represents the dynamic of the features with the most discriminant power for preictal and interictal segments according to the stepwise regression analysis. Each panel presents dynamic changes in one particular HRV parameter from 25 minutes before seizure onset to 5 minutes after the end of the seizure. Seizure onset and seizure end are represented by the vertical red and green lines respectively. An exemplificative seizure from one patient is reported (Patient 15, Seizure 2). a) meanNN, b) pNN50, c) CosEn: coefficient of sample entropy, d) LAM: laminarity, e) HF: high frequency, f) LF/HF: ratio between low and high frequency.

https://doi.org/10.1371/journal.pone.0204339.g003

The temporal trends of the recurrence plots showed a modification of the appearance during the progression of seizure becoming more regular and ordered in the preictal phases compared to interictal and postictal phases (Fig 4).

thumbnail
Fig 4. Trend of recurrence plots.

Examples of recurrence plots (RPs) of RR intervals’ phase space trajectory for Patient 15, Seizure 2. (a) RP during the interictal phase (60 minutes from the seizure); (b) RP during preictal phase and (c) RP during postictal phase. It can be observed that the RP of the preictal phase presents more regular patterns and long diagonal lines while the RPs of the interictal a more disorganized pattern, with shorter diagonal lines, hence lower determinism. In the RPs the distance to the next recurrence point is color-coded.

https://doi.org/10.1371/journal.pone.0204339.g004

The classification results on the test epochs by the trained-SVM with the selected features for each patient are reported in Table 3. The average Acc, Sens%, Spec% and FP/h were 88.06%, 89.06% 89.34% and 0.41, respectively.

In the second experiment, we applied a double cross-validation to predict unseen seizures just in those patients who had at least 3 seizures. The results for these six patients are reported in Table 4. For each patient the performance for each seizure and the average performance are reported. The mean performance on all seizures and all patients are Acc: 74.62%, Sens: 70.08%, Spec: 76.98% and FP/h: 3.36.

Discussion

In this study, we proposed a method to predict seizures on the basis of ECG in a patient- specific way. We felt that a patient-specific approach is more suitable to characterize and predict seizure since the autonomic changes in epilepsy can be largely dependent on several factors including the localization of seizure, lateralization and drugs [20].

Two important aspects of our study were that we applied a patient-specific approach to classify preictal and interictal segments and that we evaluated the ability to predict unseen seizure on the basis of the previous ones. Notably, our dataset has quite a large variability including different type of seizures with a different region and hemisphere of onset, different conditions (sleep or awakeness) and different patient’s age. Such set allowed to evaluate how robust is the algorithms in predicting seizure of different kind and recorded in different conditions. Previous research has shown that the autonomic modifications in response to seizure are different in children and adolescents compared to adults. In particular, it has been observed that children with refractory epilepsy have lower HRV resulting from parasympathetic tonus reduction, suggesting that the decreased HRV in children occurs via different mechanisms than in adults [42, 43]. Moreover, it has been observed that tachycardia occurs in 98% of children suffering complex partial seizures of temporal lobe origin, more frequently than in adults [44]. Besides the influence of age, the localization of seizures can also influence the autonomic response. Previous studies reported that secondary generalized and complex partial subjects manifest significantly different autonomic behaviors [10]. Lateralization of seizures can also influence autonomic state with right-sided epilepsy characterized by increased sympathetic activity (tachycardia and LF) while left-sided epilepsy determined an increased vagal activity (bradycardia and HF) [9]. In addition, the autonomic response is very different between awake and the sleeping state, which has unique, stage-specific autonomic heart-rate modulation [13, 45]. In this regard, it should be noticed that in most of the patients (except for Patient 9) all the seizures are recorded during sleep or during awake state so that the condition in which the seizures are registered is homogeneous for the single patient. This allows to have a more robust prediction for each single patient. Given these considerations, we expected that, the patient-specific methodology could have been more successful for some patients than others and in predicting some seizure than others; in particular, in those patients who have repeatable and stereotypical seizures we expected the algorithm would have been more efficient.

In a first experiment, we applied a cross-validation SVM approach in all the 15 patients and we obtained a good mean accuracy of 88.86% and a good mean sensitivity of 89.06% with a low number of FP/h (0.41). This result suggests that seizures could be accurately predicted using the proposed patient-specific approach.

In a second experiment, we adopted a double-cross validation approach to predict seizure on the basis of previous ones. This approach was previously applied only for predicting seizures with EEG signals [5, 41]. Using this approach, we used in-sample optimization and assessed the results with out-of-sample testing (a test set is never involved in training corresponding to unseen seizures). Thus, we could have obtained lower sensitivity and/or specificity than algorithms trained and tested on the exact same datasets; but in this way the results are much more stable [40].

According to our expectations, seizure predictions was quite dependent on the type of seizures and/or condition and thus the algorithms worked better for some patients than others. Indeed, in both the two experiments sensitivity was quite low for Patient 9 in which seizures started in the right hemispheres and then moved to the left one and the seizures are registered both during sleep and awake state and for Patient 5, in which seizure onset is localized in several regions of the brain rather than be focal. When applying a double cross-validation to predict unseen seizures while training the model on the previous ones, we confirmed that for Patient 9 the performance of the algorithm was quite poor probably because of the changes in condition (from sleep to awakeness) and lateralization (from right to left).

The average prediction time was quite high, 13.7 min, meaning that a long period is available to trigger an intervention or to secure the patient before the upcoming seizure.

Literature regarding prediction algorithms using ECG signals is quite poor. Kerem and Geva [45] proposed an unsupervised fuzzy clustering algorithm to predict partial seizures with temporal-lobe localization. The method was applied in a quite small dataset consisting in 21 seizures collected in 8 patients both during sleep and awakeness and achieved a sensitivity of 86%. The seizure prediction window was 1.5–11 min. More recently, Behbahani et al. [13] employed an adaptive decision threshold method for raising alarms and for predicting seizures: predictions were made when selected features exceeded the decision thresholds. The dataset used for this study was quite large as it consisted in a total of 170 seizures collected in 16 patients both during sleep and awakeness. The method showed an average sensitivity of 78.59%, and an average false prediction rate of 0.21/hr with a prediction window of about 5 min. In another study [14], seizure prediction was obtained by applying multivariate statistical process control (MSPC) to eight HRV features. The application results of the proposed method obtained a sensitivity of 91%, and a false positive rate of about 0.7/hr with a prediction window of 15 min. However, the dataset was quite small as it consisted in 11 awakening seizures from 8 patients.

A very recent study applied SVM algorithm to classify preictal and interictal segments on the basis of HRV features [18]. The sample size was quite similar to our (34 seizures from 12 patients). In this study, seizures were predicted from 5 min to just before the onset of a clinical/electrical seizure with a sensitivity of 94.1% and a FP rate of 0.49/hr.

In our study, we obtained a sensitivity of 89.06% when classifying seizures from single subject which was higher than that obtained in [18] and [45]. Fujiwara et al. [14] obtained a slightly higher sensitivity but the FP rate was a bit greater than our and the dataset was smaller. The highest sensitivity was that obtained by Pavei et al. [18]. However, it is important to notice that this performance refers to the ability of correctly classifying preictal segments of the whole database and no information about the performance on each subject (or each seizure) is provided.

Another important point is that we were able to correctly classifying preictal segments from 15 min to seizure onset. A 10–20 min timeframe for seizure prediction is in accord with a transition to a low-dimensional, non-linear dynamics state in intracranially recorded electrical activity [46], as well as with a significant and sustained increase in blood flow measured by SPECT [47] and by subdural thermal diffusion flowmetry sensors [48]. Some studies wed a rather short preictal segment of 5 minutes [9, 18, 49]. This temporal restriction excludes the possibility, supported by previous studies, that changes in autonomic activity occurs much earlier [50].

As regards the more relevant features that we identified in the classification of seizure prediction, meanNN, pNN50, CosEn, LAM, HF and LF/HF resulted as the most frequently selected by the stepwise regression analysis. This finding, partially reflect the results of our previous study aimed at assessing the significant differences in ANS among the preictal, the interictal and ictal phases [51].

Previous studies have reported that heart rate changes preceded the seizure onset on EEG in 70% of the cases [9]. Limbic structures are responsible of these changes which are more prominent when the volume of cerebral structures recruited into a seizure is increased [52]. In particular, according to previous studies, tachycardia occurs in 86.9% of all seizures, whereas bradycardia is documented only in 1.4%. Localization of seizures influences this pattern with HR increase being more pronounced in patients with mesial temporal lobe epilepsy (TLE) as compared with those with non-lesional TLE or extratemporal epilepsy [53]. Consistently, we observed a decrease of meanNN (increase of HR) for example in Patient 15 (Fig 3).

We also observed a role of pNN50 in predicting seizures. In particular, in we observed a decrease in NN50 in patients with TLE (Fig 3), suggesting a deterioration of HRV which could be an indication of increased cardiovascular risk, including mortality [54]. Significantly decreased in NN50 was previously reported during epilepsy [55]. In addition, it was recently observed, using a K-nearest neighbors (KNN) classifier, that NN50 and PNN50 were the most relevant features for predicting epileptic seizures [56].

We also observed an involvement of HF and LF/HF, specifically with a decrease in HF and an increase of LF/HF (Fig 3). Literature shows that epileptic seizures affect the autonomic nervous system and consequently activities of both sympathetic and parasympathetic nerves. Most of the studies reported a decrease in HF, corresponding to a decrease in vagal activity, sometimes associated with an increase LF, mainly related to sympathetic activity [57]. The decrease in vagal activity (and possibly the increased in sympathetic activity) during the preictal phase, associated to the tachycardia and/or tachyarrhythmia usually observed, could mean a difficulty in vagal activity in restoring normal heart rhythm and thus favor the development of arrhythmias. This mechanism could be associated to the increased risk of SUDEP associated to epilepsy [57].

Importantly, we observed also a significance of RQA parameters in preictal phase, that were for the first time applied for the characterization of ANS during seizures. In particular, LAM was the most frequently selected for classification but also %REC and LMAX were often selected. These parameters usually increased in preictal state to the ictal state (Fig 3). These changes, previously observed applying RQA analysis to EEG signals in epilepsy [58, 59], suggest an increase in synchronization associated to seizures and could reflect the synchronization of neurons during seizures. Consistently CosEn is one of the most frequently selected features. Entropy estimators measure the degree of regularity of a signal by counting how many template patterns repeat themselves, thus repeated patterns imply order [33]. Previous studies have observed, marked differences in entropy between ictal and interictal periods [7, 60]. The decrease in CosEn during preictal and ictal states indicate that the time series has a predictable pattern with minimal randomness.

Overall the findings of this study suggest significant changes in ANS at least 15 min before seizures. Thus, the proposed algorithm could help in the prediction of the seizures enough time in advance to prevent adverse effects and to intervene. According to the variability in the classification performance for the different patients or seizure, we conclude that quite a large between-patient and within-patient variability exists in the autonomic response associated to seizures and thus a patient-tailored or even seizure-specific approach, rather than a universal system and features, should be adopted and realized for individualized alarm system.

Further studies are needed to confirm these preliminary results in a larger number of subjects addressing some of the limitations of the present study. First, our dataset was too small and heterogenous (in terms of age, gender, seizure location) to allow a meaningful subgroup analysis. In a larger sample, it would be possible to apply the SVM classification in different homogeneous subgroups to evaluate how the performance change according to the different characteristics of the subjects including seizure location, lateralization and patient condition (sleep or awakening). In, addition, we did not control for possible confounding factors such as antiepileptic drugs. We know that antiepileptic drugs, have an influence on measured ECG features [57]. However, in this study, due to the pharmacological variety of the different patients, the fact that most of them are in polytherapy and finally considering that there is an extreme variability in the response to the various drugs for the different patients, it was almost impossible to assess the role of the different drugs as confounding factor. This limitation, is partially addressed by using a patient-specific approach, so that the method for classification is tailored individually. In a larger sample, it could be possible to assess how the classification performance change in different subgroups with a homogeneous therapy. In the future it will be also important to combine in this patient-specific classification approach ECG and EEG data to obtained a more sensible and specific prediction of different kind of seizure. Indeed, previous research have showed that the combination of these signals improves the performance of prediction algorithms [61, 62].

References

  1. 1. Engel J, Pedley TA. Epilepsy—A Comprehensive Textbook, II edition, 3 volumes. Lippincott Williams & Wilkins; 2008.
  2. 2. Fiest KM, Sauro KM, Wiebe S, Patten SB, Kwon CS, Dykeman J, et al. Prevalence and incidence of epilepsy: A systematic review and meta-analysis of international studies. Neurology. 2017;88:296–303. Erratum in: Neurology. 2017;89:642. pmid:27986877
  3. 3. Jacoby A, Austin JK. Social stigma for adults and children with epilepsy, Epilepsia. 2007;48 Suppl 9:6–9.
  4. 4. Noachtar S, Rémi J. The role of EEG in epilepsy: a critical review. Epilepsy Behav. 2009;15: 22–33. pmid:19248841
  5. 5. Park Y, Luo L, Parhi KK, Netoff T. Seizure prediction with spectral power of eeg using cost-sensitive support vector machines. Epilepsia. 2011;52: 1761–1770. pmid:21692794
  6. 6. Moghim N, Corne DW. Predicting epileptic seizures in advance. PLoS One. 2014;9: e99334. Erratum in: PLoS One. 2015;10: e0119194. pmid:24911316
  7. 7. Ponnusamy A, Marques JL, Reuber M. Heart rate variability measures as biomarkers in patients with psychogenic nonepileptic seizures: Potential and limitations. Epilepsy Behav. 2011;22: 685–691. pmid:21975299
  8. 8. Moghimi N, Lhatoo SD. Sudden unexpected death in epilepsy or voodoo heart: analysis of heart/ brain connections. Curr Cardiol Rep. 2013;15: 424. pmid:24122216
  9. 9. Jansen K, Varon C, Van Hu el S., Lagae L. Peri-ictal ECG changes in childhood epilepsy: implications for detection systems. Epilepsy Behav. 2013;29: 72–76. pmid:23939031
  10. 10. Behbahani S, Dabanloo NJ, Nasrabadi AM, Teixeira CA, Dourado A. Preictal heart rate variability assessment of epileptic seizures by means of linear and non-linear analyses. Anadolu Kardiyol Derg. 2013;13:797–803. pmid:24108758
  11. 11. Kolsal E, Serdaroğlu A, Cilsal E, Kula S, Soysal AŞ, Kurt AN, Arhan E. Can heart rate variability in children with epilepsy be used to predict seizures? Seizure. 2014;23: 357–362. pmid:24630807
  12. 12. Moridani MK, Farhadi H. Heart rate variability as a biomarker for epilepsy seizure prediction. Bratisl Lek Listy. 2017;118: 3–8. pmid:28127975
  13. 13. Behbahani S, Dabanloo NJ, Nasrabadi AM, Dourado A. Prediction of epileptic seizures based on heart rate variability. Technol Health Care. 2016; 24: 795–810. pmid:27315150
  14. 14. Fujiwara K, Miyajima M, Yamakawa T, Abe E, Suzuki Y, Sawada Y et al. Epileptic Seizure Prediction Based on Multivariate Statistical Process Control of Heart Rate Variability Features. IEEE Trans Biomed Eng. 2016; 63: 1321–1332. pmid:26841385
  15. 15. Costa RP, Oliveira P, Rodrigues G, Leitao B, Dourado A. Epileptic seizure classification using neural networks with 14 features, In: Lovrek I, Howlett RJ, Jain LC, editors. Knowledge-Based Intelligent Information and Engineering Systems. Berlin, Heidelberg: Lecture Notes in Computer Science, 2008. p. 5178.
  16. 16. Kharbouch A, Shoeb A, Guttag J, Cash SS. An algorithm for seizure onset detection using intracranial EEG. Epilepsy Behavior 2011;22: 29–35.
  17. 17. Cortes C, Vapnik V. Support-vector networks. Mach Learn. 1995;20: 273.
  18. 18. Pavei J, Heinzen RG, Novakova B, Walz R, Serra AJ, Reuber M, et al. Early Seizure Detection Based on Cardiac Autonomic Regulation Dynamics. Front Physiol. 2017;8: 765. pmid:29051738
  19. 19. Leutmezer F, Schernthaner C, Lurger S, Pötzelberger K, Baumgartner C. Electrocardiographic changes at the onset of epileptic seizures. Epilepsia. 2003;44: 348–54. pmid:12614390
  20. 20. Jansen K, Lagae L, Cardiac changes in epilepsy. Seizure, 2010;19, 455–460. pmid:20688543
  21. 21. Behbahani S, Dabanloo NJ, Nasrabadi AM. Ictal Heart Rate Variability Assessment with Focus on Secondary Generalized and Complex Partial Epileptic Seizures. Adv Biores. 2013;4: 50–58.
  22. 22. Eckmann JP, Kamphorst SO, Ruelle D. Recurrence plots of dynamical systems, Europhys Lett. 1987;5: 973–977.
  23. 23. Marwan N, Wessel N, Meyerfeldt U, Schirdewan A, Kurths J. Recurrence Plot Based Measures of Complexity and its Application to Heart Rate Variability Data. Phys Rev E. 2002;66: 026702.
  24. 24. Rongrong S, Yuanyuan W. Predicting termination of atrial fibrillation based on the structure and quantification of the recurrence plot. Med Eng Phys. 2008;30: 1105–1111. pmid:18343707
  25. 25. Acharya UR, Vinitha Sree S, Swapna G, Martis RJ, Suri JS. Automated EEG analysis of epilepsy: A review. Knowledge-Based Systems. 2013;45: 147–165.
  26. 26. Raiesdana S, Golpayegani SMRH, Firoozabadi SMP, Mehvari Habibabadi J. On the discrimination of patho- physiological states in epilepsy by means of dynamical measures. Comput Biol Med, 2009;39: 1073–1082. pmid:19880102
  27. 27. Shoeb A, Carlson D, Panken E, Timothy D. A micro support vector machine based seizure detection architecture for embedded medical devices. Conf Proc IEEE Eng Med Biol Soc, 2009; 4202–4205. pmid:19964342
  28. 28. Fisher RS, Cross JH, French JA, Higurashi N, Hirsch E, Jansen FE, et al. Operational classification of seizure types by the International League Against Epilepsy: Position Paper of the ILAE Commission for Classification and Terminology. Epilepsia. 2017;58: 522–530. pmid:28276060
  29. 29. Kwan P, Arzimanoglou A, Berg AT, Brodie MJ, Allen Hauser W, Mathern G, et al. Definition of drug resistant epilepsy: consensus proposal by the ad hoc Task Force of the ILAE Commission on Therapeutic Strategies. Epilepsia. 2010;51: 1069–1077. pmid:19889013
  30. 30. Varanini M, Tartarisco G, Billeci L, Macerata A, Pioggia G, Balocchi R. An efficient unsupervised fetal QRS complex detection from abdominal maternal ECG, Physiol Meas. 2014;35: 1607–1619. pmid:25069520
  31. 31. Melo HM, Martins TC, Nascimento LM, Hoeller AA, Walz R, Takase E. Ultra-short heart rate variability recording reliability: The effect of controlled paced breathing. Ann Noninvasive Electrocardiol. 2018. Forthcomining.
  32. 32. Gomes RL, Vanderlei LC, Garner DM, Santana MD, de Abreu LC, Valenti VE. Poincaré plot analysis of ultra-short-term heart rate variability during recovery from exercise in physically active men. J Sports Med Phys Fitness. 2018;58: 998–1005. pmid:28474874
  33. 33. Lake DE, Moorman JR. Accurate estimation of entropy in very short physiological time series: the problem of atrial fibrillation detection in implanted ventricular devices. Am J Physiol Heart Circ Physiol, 2011;300: H319–H325. pmid:21037227
  34. 34. Carrara M, Carozzi L, Moss T, De Pasquale M, Cerutti S, Ferrario M. Heart rate dynamics distinguish among atrial fibrillation, normal sinus rhythm and sinus rhythm with frequent ectopy. Physiol Meas 2015;36: 1873–88. pmid:26246162
  35. 35. Katz M. Fractals and the analysis of waveforms. Comput Biol Med 1988;18: 145–156. pmid:3396335
  36. 36. Varanini M, De Paolis G, Emdin M, Macerat A, Pola S, Cipriani M, Marchesi C. A Multiresolution Transform for the Analysis of Cardiovascular Time Series. Comput Cardiol. 1998;25.
  37. 37. Webber CL Jr, Zbilut JP. Dynamical assessment of physiological systems and states using recurrence plot strategies. J Appl Physiol. 1994;76: 965–973. pmid:8175612
  38. 38. Vapnik V. Statistical Learning Theory, New York: Wiley; 1998.
  39. 39. Tang Y, Zhang Y-Q, Chawla NV, Krasser S. SVMs modeling for highly imbalanced classification. IEEE Trans Syst Man Cybern Cybern. 2009;39: 281–288.
  40. 40. Friedman JH. An overview of predictive learning and function approximation. NATO ASI Series F Computer and Systems Sciences, 1994;136: 1–61.
  41. 41. Ghaderyan P, Abbasi A, Sedaaghi MH. An efficient seizure prediction method using KNN-based undersampling and linear frequency measures. J Neurosci Methods. 2014;232: 134–142. pmid:24875624
  42. 42. Langan Y, Nashef L, Sander JW. Sudden unexpected death in epilepsy: a series of witnessed deaths. J Neurol Neurosurg Psychiatry. 2000;68: 211–213. pmid:10644790
  43. 43. Harnod T, Yang CCH, Hsin YL, Shieh KR, Wang PJ, Kuo TB. Heart rate variability in children with refractory generalized epilepsy. Seizure. 2008; 17:297–301. pmid:17977751
  44. 44. Mayer H, Benninger F, Urak L, Plattner B, Geldner J, Feucht M. EKG abnormalities in children and adolescents with symptomatic temporal lobe epilepsy. Neurology. 2004;63: 324–328. pmid:15277628
  45. 45. Kerem DH, Geva AB. Forecasting epilepsy from the heart rate signal. Med Biol Eng Comput. 2005;43: 230–239. pmid:15865133
  46. 46. Le Van Quyen M, Martinerie J, Navarro V, Boon P, D'have M, Adam C, et al. Anticipation of epileptic seizures from standard EEG recordings, Lancet, 2001;357 183–188 pmid:11213095
  47. 47. Baumgartner C, Serees W, Leutmezer F, Pataraia E, Ahel S, Czech T, et al. Preictal SPECT in temporal lobe epilepsy: regional cerebral blood flow is increased prior to electroencephalography- seizure onset, J. Nucl. Med., 1998;39: 978–982. pmid:9627329
  48. 48. Weinand ME, Carter LP, El-Saadany WF, Sioutos PJ, Labiner DM, Commen KJ. Cerebral blood flow and temporal lobe epileptogenicity. J Neurosurg, 1997;86: 226–232. pmid:9010424
  49. 49. Toth V, Hejjel L, Fogarasi A, Gyimesi C, Orsi G, Szucs A, et al. Periictal heart rate variability analysis suggests long-term postictal autonomic disturbance in epilepsy. Eur J Neurol. 2010;17: 780–787. pmid:20100226
  50. 50. Liyr B, Lehnertz K. Seizure prediction and the preseizure period, Cur. Opin. Neurol., 2002;15: 173–177
  51. 51. Billeci L, Varanini M. Characterizing Electrocardiographic Changes During Pre Seizure Periods Through Temporal and Spectral Features. Comput Cardiol. 2017;44.
  52. 52. Epstein M, Sperling M, O’Connor M. Cardiac rhythm during temporal lobe seizures. Neurology. 1992;42: 50–53. pmid:1734323
  53. 53. Leutmezer F, Schernthaner C, Lurger S, Pötzelberger K, Baumgartner C. Electrocardiographic changes at the onset of epileptic seizures. Epilepsia. 2003;44: 348–54. pmid:12614390
  54. 54. May O, Arildsen H. Long-term predictive power of heart rate variability on all-cause mortality in the diabetic population. Acta Diabetol 2011;48: 55–59. pmid:20844904
  55. 55. Kolsal E, Serdaroğlu A, Cilsal E, Kula S, Soysal AŞ, Kurt AN, et al. Can heart rate variability in children with epilepsy be used to predict seizures? Seizure. 2014;23: 357–362. pmid:24630807
  56. 56. Hoyos-Osorio K, Castañeda-Gonzaiez J, Daza-Santacoloma G. Automatic epileptic seizure prediction based on scalp EEG and ECG signals, 2016 XXI Symposium on Signal Processing, Images and Artificial Vision (STSIVA), Bucaramanga, 2016; 1–7. 

  57. 57. Lotufo PA, Valiengo L, Benseñor IM, Brunoni AR. A systematic review and meta-analysis of heart rate variability in epilepsy and antiepileptic drugs. Epilepsia. 2012;53: 272–282. pmid:22221253
  58. 58. Acharya UR, Sree SV, Chattopadhyay S, Yu W, Ang PC. Application of recurrence quantification analysis for the automated identification of epileptic EEG signals. Int J Neural Syst. 2011;21:199–211. pmid:21656923
  59. 59. Ngamga EJ, Bialonski S, Marwan N, Kurths J, Geier C, Lehnertz K. Evaluation of selected recurrence measures in discriminating preictal and inter-ictal periods from epileptic EEG data, Phys Lett A, 2016;380: 1419–1425.
  60. 60. Ponnusamy A, Marques JL, Reuber M. Comparison of heart rate variability parameters during complex partial seizures and psychogenic nonepileptic seizures. Epilepsia, 2012;58: 1341–1321.
  61. 61. Greene BR, Boylan GB, Reilly RB, de Chazal P, Connolly S. Combination of EEG and ECG for improved automatic neonatal seizure detection. Clin Neurophysiol. 2007;118: 1348–59. pmid:17398146
  62. 62. Shoeb HA, Guttag VJ. Application of Machine Learning To Epileptic Seizure Detection. ICML 2010—Proceedings, 27th International Conference on Machine Learning. 2010; 975–982.