Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Tracking intracellular dynamics through extracellular measurements

  • Franz Hamilton ,

    Roles Conceptualization, Formal analysis, Methodology, Writing – original draft, Writing – review & editing

    fwhamilt@ncsu.edu

    Affiliation North Carolina State University, Department of Mathematics, Raleigh, 27695, United States of America

  • Tyrus Berry,

    Roles Conceptualization, Formal analysis, Methodology, Writing – original draft, Writing – review & editing

    Affiliation George Mason University, Department of Mathematical Sciences, Fairfax, 22030, United States of America

  • Timothy Sauer

    Roles Conceptualization, Formal analysis, Funding acquisition, Methodology, Writing – original draft, Writing – review & editing

    Affiliation George Mason University, Department of Mathematical Sciences, Fairfax, 22030, United States of America

Abstract

Extracellular recordings of neuronal cells are frequently a part of in vitro and in vivo experimental studies as a means of monitoring network-level dynamics. Their connections to intracellular dynamics are not well understood. Single-unit recordings are a more direct way to measure intracellular dynamics, but are typically difficult and expensive. On the other hand, simple differential equations models exist for single neurons. In this article, we apply a recent advance in data assimilation theory, designed to correct bias in general observation functions, toward the reconstruction of model-based intracellular dynamics from extracellular recordings.

Introduction

In vitro and in vivo neuronal experiments in the laboratory are frequently centered around measurements of cell potential. While intracellular (within cell) recordings give precise, single-cell measurements of neuronal potential, they are difficult, often obtained under nonphysiological conditions, and typically do not allow for multi-site recordings. Extracellular recordings are easier to obtain, but the relation to intracellular dynamics is complicated. In particular, the morphology of the spikes and other aspects of the recordings are usually quite different.

The recorded extracellular potential is in general a complicated sum of spatially distributed currents [1] within a complex extracellular space [2]. There is a complicated relationship between the spatial location of the extracellular measurement with respect to the cell, resulting in different waveform properties based on the distance from the recording site to the neuron. Fig 1 shows an example time series [3] comparing intracellular and extracellular recordings (see [4, 5] for more details on the experimental design and study). This representative example demonstrates some of the differences between the two types of cell measurements.

thumbnail
Fig 1. Example of simultaneous intracellular and extracellular recordings from a neuronal experiment in the laboratory.

Data from [35]. Intracellular recordings (red trace) occur inside an individual cell, whereas extracellular recordings (blue trace) occur outside the cell and often result in the recording of activity from several different cells. While neuronal models describe the intracellular cell dynamics, experimental recordings often consist of extracellular measurements, particularly when examining network-level dynamics. There is a fundamental difference between the recorded potentials, for example the biphasic waveform of the extracellular recording compared to the monophasic waveform of the intracellular recording.

https://doi.org/10.1371/journal.pone.0205031.g001

Modern methods of data assimilation are adept at reconstructing hidden variables, as long as details of their relations to observations are known. If we consider the intracellular dynamics as the hidden variable, it is the lack of an explicit “observation function” that has limited the applicability of these methods. While ad hoc methods for pre-processing the extracellular measurements have been used (see for example [6, 7]), these approaches suffer from never learning the true mapping from the intracellular state to the extracellular observation space.

In this article we assume as given an extracellular recording and a model of single-cell neuronal dynamics. We will exploit a recent advance [8] in data assimilation to fit the recording to the individual cell dynamics, in absence of a known relation between them. The recent advance shows how to learn state-dependent observation function bias while filtering a signal. The approach is general enough to be used with a wide range of data assimilation methods, including nonlinear methods such as the ensemble Kalman filter. The main point is that even though the exact observation function of the single-cell dynamics that relates its activity to the extracellular recording is unknown, the connection can be gradually learned from an iterative processing of the data.

Several works have examined the error caused by bias resulting from model mismatch, when the true system dynamics are not known [911], and when the actual observation function which maps the model state to observation space is unknown [8, 12]. Our work here essentially addresses both of these problems simultaneously within the context of neuronal intracellular state reconstruction. Not only do we lack an accurate observational model, but we must also reconcile the model error resulting from our use of a simplified dynamical model to assimilate complex extracellular measurements from a population of neurons.

In the following, we will show that intracellular dynamics reconstruction can occur even though a simple, generic neuron model is used as part of the data assimilation procedure. We begin, as proof of concept, by showing the successful reconstruction of the intracellular state given extracellular observations of a stochastic Fitzhugh-Nagumo cell. To further simulate the model error we will encounter when analyzing experimental data, we consider the assimilation of extracellular data from a more sophisticated model, the Hodgkin-Huxley system. Finally, we demonstrate the utility of our method in recovering the intracellular dynamics in an experimental setting by assimilating in vivo extracellular recordings.

Methods

The filtering problem

In the general filtering problem, we assume a system with n-dimensional state vector x and m-dimensional observation vector y defined in discrete time by (1) (2) where wk−1 and vk are white noise processes with covariance matrices Q and R, respectively. f represents the system dynamics and h is an observation function that maps the model state to the observation space. The goal is to sequentially estimate the state of the system given some noisy observations.

In the case of linear system dynamics and linear observation function, the Kalman filter [13] gives the optimal estimate of the system state. Extensions of the Kalman filter to nonlinear situations include the extended Kalman filter and ensemble-based Kalman filters [1424], which approximate nonlinear systems and gives near-optimal estimates. In either linear or nonlinear situation, the assumption is that both f and h are known, allowing the filter to alternate between a forecast and analysis step. During the filter’s forecast, a model-based prediction of the system state and covariance is made. The predicted state is then mapped to observation space through known observation function h, giving a model-predicted observation. These state and covariance predictions are updated in the analysis step, which relies on the difference between the actual observation and the model predicted observation. This procedure continues iteratively for each observation.

Without loss of generality, here we consider use of the ensemble Kalman filter (EnKF) for nonlinear state estimation. The EnKF approximates a nonlinear system by forming an ensemble, such as through the unscented transformation (see for example [14]). At the kth step of the filter there is an estimate of the state and the covariance matrix . In the unscented version of the EnKF, the singular value decomposition is used to find the symmetric positive definite square root of the matrix , allowing us to form an ensemble of E state vectors where the ith ensemble member is denoted .

The model f is applied to the ensemble, and then observed with function h (3) The mean of the resulting state and observed ensembles gives the prior state estimate and predicted observation , respectively. Denoting the covariance matrices and of the resulting state and observed ensemble, and the cross-covariance matrix , we define (4) and use the equations (5) to update the state and covariance estimates with the observation yk. Q and R are generally unknown quantities that have to be estimated. We use the method of [25] for the adaptive estimation of these noise covariance matrices.

Filtering with an unknown observation function

The update of the state and covariance predictions in the analysis step is dependent on the correct observation function h being known. Of course in many applications, such as in the mapping of intracellular model state to extracellular observation space, this function is known imperfectly and in its place an incorrect function g is used. We will assume the true dynamics are represented by Eqs 1 and 2, but that the filter is supplied with Eq 1 and (6) Define b(xk) = h(xk) − g(xk) to be the state-dependent bias in the observation resulting from use of the incorrect observation function. Recent work [12] addressed the issue of error caused by an unknown observation function by using a training set consisting of observations and the corresponding true state with which to build an estimate of the bias. Here, we assume that no training data of the true state are available and implement a recent advance [8] in data assimilation that attempts to empirically estimate the bias. We present a summary of the technique here, further details of which can be found in [8].

The general idea is to iteratively update the incorrect observation function g by obtaining improved estimates of the bias. We begin with an initial estimate of the bias function b(0) = 0, and set g(0) = g + b(0) = g. The filter is given the known system dynamics f, the initial incorrect observation function g(0), and the observations y, and provides an estimate of the state at each observation time k, which we denote . This initial state estimate will be subject to large errors, due to the unaccounted-for bias. Using this imperfect state estimate, we calculate a noisy estimate of the bias, , corresponding to observation yk where (7)

Due to noise in the data as well as the imperfection of the state estimate, will not accurately reflect the true bias, b(xk). To build a better estimate of b(xk), we use Takens’ method of attractor reconstruction [2629] to reconstruct the bias function. Given observation yk, consider delay-coordinate vector zk = [yk, yk−1, …, ykd] where d is the number of delays. Delay vector zk represents the state of the system [26, 28]. To build the reconstruction, we locate the N nearest neighbors (with respect to Euclidean distance) , where within the set of observations. Once the neighbors are found, the corresponding values are used in a locally constant model to estimate b(xk) (8) where the weight for jth neighbor is defined as Here, is the distance of to the current delay-coordinate vector and σ is the bandwidth which controls the contribution of each neighbor in the local model. We set σ to be half of the mean distance of the neighbors.

Note that Eq 8 is still just an approximation of b(xk), although a more accurate estimate compared to Eq 7. The observation function can now be updated as This improved observation function is given to the filter, and the data are re-processed. An improved state estimate, , at time k is obtained, a more accurate reconstruction, b(1)(xk), of the bias is formed using Eqs 7 and 8 and the observation function is updated, g(2) = g + b(1).

The method continues iteratively, each iteration an improved reconstruction of b(xk) is obtained resulting in a better estimate of the state on the next iteration. To summarize the method for iterations

  1. Initialize g(0) = g and b(0) = 0
  2. For each observation yk, use filter to estimate state given known f and observation function g()
  3. Calculate noisy bias estimate
  4. Use Takens’ method to reconstruct estimate of bias function, b()(xk)
  5. Update observation function, g(+1) = g + b()
  6. Repeat steps 2-5 until convergence

We determine that our method has converged when the change between successive reconstructions of the bias functions falls below some threshold. Fig 2 shows a schematic view of the steps of the algorithm.

thumbnail
Fig 2. Schematic of algorithm for correcting observation error.

https://doi.org/10.1371/journal.pone.0205031.g002

Results

In the results presented below, we assume noisy extracellular data are available from a neuronal system and we implement an EnKF with a generic intracellular spiking model to reconstruct the intracellular state of the system. Specifically, our EnKF is provided the Fitzhugh-Nagumo model [30, 31] (9) where I is a known stimulating current and τ is a time-scale parameter that is used to adjust the spiking frequency of the model to that of the data. The variable v represents the intracellular potential and w is a recovery variable that lumps together the effects of different ionic currents.

Motivated by experimental scenarios, we will rely on the ansatz that measurements of the neuron extracellular potential are given by the negative time derivative of the intracellular potential. Thus give the EnKF is provided a “best guess”, though likely incorrect, observation function g (10) which is just the negative right-hand side of the differential equation in Eq 9.

Throughout, we will compare our bias corrected filter with the standard filter (essentially, the = 0 iteration of our method) which assumes no bias correction. Due to the extreme error caused by the biased observations, we limit the diagonal of the estimated noise covariances matrices to prevent overfitting or underfitting of the data.

State estimation with an incorrect observation function

We consider the noise-driven Fitzhugh-Nagumo system (11) where is a periodic forcing current and Inoise is a mean 0 Gaussian noise current with variance σ2 = 0.005. We assume that 2400 seconds of data are available, sampled at rate dt = 0.4. The true observation function (12) where , is unknown to us and in its place we give the EnKF the observation function described by Eq 10. The parameters α1, α2, α3 are used to control the amount of mismatch between the true observation function h and our filter observation function g, allowing us to test our algorithm at different error levels. Note that there is a degree of model error in this example since Eq 11 is stochastically driven whereas our assimilation model described by Eq 9 does not account for this additional noise term.

In our first example, we consider a situation where there is a small discrepancy between h and g. Specifically, we define parameters α1 = 0.1, α2 = −0.9, α3 = 0.01 in Eq 12 resulting in the observation function (13) Fig 3 shows the results of reconstructing v and w (black solid lines) given the observations (blue circles) resulting from the function in Eq 13. The solid gray line denotes the EnKF estimate without bias correction and the solid red line red line the estimate with bias correction. Note that the bias in this example is small, and as such the standard EnKF is able to handle the error and give good estimates of the system state by adjusting the Q and R covariance matrices (RMSE = 0.10, 0.07 for v and w respectively). The bias corrected filter, which uses d = 5 delays and N = 20 nearest neighbors to reconstruct the bias function, gives a slight improvement on the reconstruction of w, but in general performs comparably to the standard filter (RMSE = 0.10, 0.03 for v and w respectively). This result is not surprising, as we would not expect our bias-corrected filter to have much of an affect when the observational bias is low.

thumbnail
Fig 3. Results from reconstructing the state of a noise driven Fitzhugh-Nagumo system with small observation function error.

Reconstruction results for the (a) intracellular potential v and (b) lump ionic recovery variable w are shown. The true observation function is unknown to us, and in its place we use the observation model in Eq 10. Given the observations (blue circles), we attempt to reconstruct the true trajectories of v and w (solid black lines). In this example, the error between the filter observation function and true observation function is small enough that the standard filter (solid gray line) is able to provide accurate estimates of the variable trajectories (RMSE = 0.10, 0.07 for v and w respectively). The bias-corrected filter (solid red line) provides small, but not substantial improvements (RMSE = 0.10, 0.03 for v and w respectively).

https://doi.org/10.1371/journal.pone.0205031.g003

When the error in the observation function increases, the standard filter fails to accurately reconstruct the system dynamics. As an example, consider a large observation error scenario where α1 = 0.25, α2 = −0.85, α3 = 0.02 resulting in the observation function (14) Fig 4 shows the results of reconstructing the system state in this large bias situation. The filter with no bias correction (solid gray line) fails to track the dynamics of the variables (RMSE = 0.95, 0.53 for v and w respectively) while the bias-corrected filter (solid red line) is able to accurately reconstruct the system dynamics (RMSE = 0.26, 0.12 for v and w respectively). This significant improvement in state reconstruction highlights the capability of our method for reconciling large errors caused by observational mismatch.

thumbnail
Fig 4. Results from reconstructing the state of a noise driven Fitzhugh-Nagumo system with large observation function error.

Reconstruction results for the (a) v and (b) w system variables (solid black lines denote true trajectories) given the noisy observations (solid blue circles). The large error between the filter observation function in Eq 10 and the unknown true observation function, , causes the standard filter (solid gray line) to fail in tracking the system dynamics (RMSE = 0.95, 0.53 for v and w respectively). The bias-corrected filter (solid red line) significantly improves on the state reconstruction (RMSE = 0.26, 0.12 for v and w respectively).

https://doi.org/10.1371/journal.pone.0205031.g004

Reconstructing intracellular potential from extracellular measurements

The next example explores the assimilation of data from a Hodgkin-Huxley cell to a Fitzhugh-Nagumo model. The Hodgkin-Huxley system [32] is a detailed neuron model defined by (15) where The parameters of the Hodgkin-Huxley model are set to typical values: C = 1, E0 = −65, E1 = 50, E2 = −77, E3 = −54.4, Istim = 7, and Inoise is a noisy current. Our observations of the Hodgkin-Huxley system consist of the extracellular potential approximated as (16) where 3000 ms of extracellular data sampled at rate dt = 0.1 are available. These observations are scaled to fit the bounds of the Fitzhugh-Nagumo model in order to prevent filter instability.

This example highlights several issues that are analogous to problems encountered in a experimental applications. For starters, the model used by the data assimilation scheme (in our case the Fitzhugh-Nagumo equations) is often a simplified representation of the experimental system producing the spike data. This results in a degree of model error, or dynamical mismatch, which in effect leads to observational bias. Additionally, the frequency of the data spikes often do not match those of the assimilation model. To help account for this discrepancy prior to assimilation, we rescale the observation time of the data to help match the spiking frequency of the model to that of the data.

Fig 5 shows the results from assimilating the extracellular Hodgkin-Huxley data (blue circles) using Eq 9 with parameters I = 0.5 and τ = 14. The scaled Hodgkin-Huxley voltage variable (solid black line) is shown in Fig 5a as a reference trajectory. Without bias correction (solid gray line), the filter is unable to estimate an accurate representation of the intracellular dynamics. Using d = 9 delays and N = 20 neighbors to reconstruct the bias, the bias-corrected filter (solid red line) is able to converge to a reasonable estimate of the intracellular variables. Note that we are not able to perfectly reconstruct the Hodgkin-Huxley voltage; this is impossible due to the discrepancy between the dynamics of the Hodgkin-Huxley data and those of the Fitzhugh-Nagumo assimilation model.

thumbnail
Fig 5. Results from assimilating extracellular Hodgkin-Huxley data (solid blue circles) to a Fitzhugh-Nagumo model.

Reconstruction results for the (a) v and (b) w variables shown. The scaled Hodgkin-Huxley intracellular potential (solid black line) is shown as a reference trajectory in (a). Without bias correction (solid gray line), the filter is unable to reconcile the observational bias and as a result fails in providing a reasonable estimate of the system state. However, the bias-corrected filter (solid red line) is able to substantially improve on the state reconstruction, providing an improved estimate of the system dynamics.

https://doi.org/10.1371/journal.pone.0205031.g005

Tracking in vivo intracelluar potential

We now consider the reconstruction of experimental intracellular dynamics from recorded extracellular potential. The data analyzed were collected from an experiment [3] that performed simultaneous intracellular and extracellular recordings in the CA1 region of the hippocampus of anesthetized rats [4, 5]. Fig 6 shows example waveforms, scaled to match the bounds of the assimilation model, from typical intracellular (Fig 6a) and extracellular (Fig 6b) spikes in the dataset. Light blue traces represent individual waveforms and thick solid blue line represent the average waveform. These simultaneous recordings are difficult to make and are not typical of most experimental studies, where usually only the extracellular potential is measured. As such, we treat the intracellular data strictly as a mechanism for evaluation of our assimilation results.

thumbnail
Fig 6. Representative waveforms (light blue traces) from recorded (a) intracellular and (b) extracellular spikes in the analyzed dataset.

Dark blue lines denote the average detected waveform. Data are sampled at rate dt = 0.01 ms. While the authors in [4, 5] collected simultaneous intracellular and extracellular measurements, experiments usually are centered around the extracellular recordings. We therefore treat the intracellular data as a mechanism for comparison purposes, and focus on the assimilation of the readily available extracellular measurements.

https://doi.org/10.1371/journal.pone.0205031.g006

Our goal is to assimilate the readily available extracellular data, sampled at rate dt = 0.01, to the intracellular Fitzhugh-Nagumo model and reconstruct the appropriate intracellular dynamics. Note that the nature of extracellular recordings leads to measurements from several different cells, and thus in our assimilation of these observations we are in fact reconstructing the intracellular dynamics from several different neurons. Similarly to the Hodgkin-Huxley results, we don’t expect a perfect reconstruction of the intracellular potential given the amount of discrepancy between the Fitzhugh-Nagumo system and the experimental data.

Fig 7 shows the results of estimating the intracellular dynamics given the extracellular observations. The thin light lines represent the estimated dynamics corresponding to the individual extracellular spikes shown in Fig 6b. The thick dark lines represent the average reconstructed dynamic. Without bias correction (Fig 7a and 7b), the estimate of intracellular potential and recovery variable suffers. Using d = 9 delays and N = 10 neighbors for bias reconstruction, our bias corrected filter (Fig 7c and 7d) is able to obtain an improved reconstruction of the intracellular dynamics. While the estimate is not perfect, which is to be expected since we are using an overly simplified assimilation model, we are still able to obtain a faithful representation of the intracellular potential and recovery variable.

thumbnail
Fig 7. Results from assimilating the extracellular data to the Fitzhugh-Nagumo model.

Thin light traces indicate individual events and the thick dark lines denote the mean waveforms averaged over individual events. Without bias correction (Fig 7 a-b), the filter is unable to compensate for the error resulting in an inaccurate estimate of the (a) intracellular potential and (b) recovery variable dynamics. When we estimate the bias and correct the observation model error (Fig 7c-d), we are able to learn the mapping from intracellular to extracellular state, and thus get an improved reconstruction of the intracellular potential and recovery dynamics, (c) and (d) respectively.

https://doi.org/10.1371/journal.pone.0205031.g007

Conclusion

The successful implementation of data assimilation methods for estimation is dependent on an accurate mapping of the model state to the experimental measurements. This is done through application of an observation function. When this function is unknown or known with error, the observations are biased and the resulting state estimate suffers. The problem is exemplified in experimental neuroscience studies, where the relationship between extracellular potential observations and the corresponding intracellular state is complex. By leveraging a recent advance in data assimilation, we demonstrated the capability to learn this neuronal bias from available data, improving our ability to estimate intracellular neuronal state while reconciling severe model error resulting from dynamical mismatch.

As with most techniques that attempt to empirically learn a function, the resulting accuracy of the observation bias reconstruction is dependent on sufficient available data. In the neuroscience application examined here, enough spiking events must be available within the analyzed time series so that the extracellular-to-intracellular relationship can be approximated using the nearest-neighbors algorithm. Additionally, the use of any Kalman filter relies on Gaussian noise assumptions. For non-Gaussian noise processes, more sophisticated data assimilation schemes may have to be considered.

The ability to reconcile observation model error and improve on intracellular state estimation opens up several avenues for improved neuronal data analysis. As discussed in [6], the assimilation of extracellular data to intracellular models results in the filter using some of the model’s free parameters to compensate for the error. This can result in parameter estimates that have little to no interpretability. We hypothesize that our method for correcting observational bias will help improve the parameter estimation process, resulting in estimates that have greater biological meaning. Future work will examine this bias reconstruction problem in network neuroscience studies, where the goal is an accurate estimation of network connectivity given extracelluar measurements. While more sophisticated neuron models are available in the literature, one of our motivations behind choosing the Fitzhugh-Nagumo equations as our assimilation model is their scalability to network-level analysis due to the simplicity of their governing dynamics. Finally, we believe that this technique will have wide-ranging applicability to biological problems where the observation function may be known with error.

References

  1. 1. Pettersen K, Einevoll G. Amplitude variability and extracellular low-pass filtering of neuronal spikes. Biophysical Journal. 2008;94:784–802. pmid:17921225
  2. 2. Kinney J, Spacek J, Bartol T, Bajaj C, Harris K, Sejnowski T. Extracellular sheets and tunnels modulate glutamate diffusion in hippocampal neuropil. J Comp Neurol. 2013;521:448–464. pmid:22740128
  3. 3. Henze D, Harris K, Borhegyi Z, Csicsvari J, Mamiya A, Hirase H, et al. Simultaneous intracellular and extracellular recordings from hippocampus region CA1 of anesthetized rats; 2009. CRCNS.org. http://dx.doi.org/10.6080/K02Z13FP.
  4. 4. Henze D, Borhegyi Z, Csicsvari J, Mamiya A, Harris K, Buzsáki G. Intracellular features predicted by extracellular recordings in the hippocampus in vivo. Journal of Neurophysiology. 2000;84:390–400. pmid:10899213
  5. 5. Harris K, Henze D, Csicsvari J, Hirase H, Buzsáki G. Accuracy of tetrode spike separation as determined by simultaneous intracellular and extracellular measurements. Journal of Neurophysiology. 2000;84:401–414. pmid:10899214
  6. 6. Hamilton F, Berry T, Peixoto N, Sauer T. Real-time tracking of neuronal network structure using data assimilation. Physical Review E. 2013;88:052715.
  7. 7. Hamilton F, Cressman J, Peixoto N, Sauer T. Reconstructing neural dynamics using data assimilation with multiple models. Europhysics Letters. 2014;107:68005.
  8. 8. Hamilton F, Berry T, Sauer T. Correcting observation model error in data assimilation; 2018. Preprint, https://arxiv.org/abs/1803.06918.
  9. 9. Toth Z, Pena M. Data assimilation and numerical forecasting with imperfect models: The mapping paradigm. Physica D. 2007;230:146–158.
  10. 10. Baek S, Hunt B, Kalnay E, Ott E, Szunyogh I. Local ensemble Kalman filtering in the presence of model bias. Tellus A. 2006;58:293–306.
  11. 11. Son J, Hou D, Toth Z. An assessment of Bayesian bias estimator for numerical weather prediction. Nonlin Processes Geophys. 2008;15:1013–1022.
  12. 12. Berry T, Harlim J. Correcting biased observation model error in data assimilation. Monthly Weather Review. 2017;145:2833–2853.
  13. 13. Kalman R. A new approach to linear filtering and prediction problems. J Basic Eng. 1960;82:35–45.
  14. 14. Simon D. Optimal State Estimation: Kalman, H, and Nonlinear Approaches. John Wiley and Sons; 2006.
  15. 15. Kalnay E. Atmospheric modeling, data assimilation, and predictability. Cambridge Univ. Press; 2003.
  16. 16. Evensen G. Data assimilation: The Ensemble Kalman Filter. Springer: Heidelberg; 2009.
  17. 17. Julier S, Uhlmann J, Durrant-Whyte H. A new method for the nonlinear transformation of means and covariances in filters and estimators. IEEE Trans Automat Control. 2000;45:477–482.
  18. 18. Julier S, Uhlmann J, Durrant-Whyte H. Unscented filtering and nonlinear estimation. Proc IEEE. 2004;92:401–422.
  19. 19. Rabier F. Overview of global data assimilation developments in numerical weather-prediction centres. Quarterly Journal of the Royal Meteorological Society. 2005;131(613):3215–3233.
  20. 20. Hunt BR, Kalnay E, Kostelich E, Ott E, Patil DJ, Sauer T, et al. Four-dimensional ensemble Kalman filtering. Tellus A. 2004;56(4):273–277.
  21. 21. Cummings JA. Operational multivariate ocean data assimilation. Quarterly Journal of the Royal Meteorological Society. 2005;131(613):3583–3604.
  22. 22. Yoshida K, Yamaguchi J, Kaneda Y. Regeneration of Small Eddies by Data Assimilation in Turbulence. Phys Rev Lett. 2005;94:014501. pmid:15698086
  23. 23. Law K, Stuart A. Evaluating data stimulation algorithms. Mon Wea Rev. 2012;140:3757–3782.
  24. 24. Schiff SJ. Neural control engineering. MIT Press; 2012.
  25. 25. Berry T, Sauer T. Adaptive ensemble Kalman filtering of nonlinear systems. Tellus A. 2013;65:20331.
  26. 26. Takens F. Detecting strange attractors in turbulence. Lecture Notes in Math Springer-Verlag: Berlin. 1981;898.
  27. 27. Packard N, Crutchfield J, Farmer D, Shaw R. Geometry from a time series. Phys Rev Lett. 1980;45:712–715.
  28. 28. Sauer T, Yorke JA, Casdagli M. Embedology. J Stat Phys. 1991;65:579–616.
  29. 29. Sauer T. Reconstruction of shared nonlinear dynamics in a network. Phys Rev Lett. 2004;93:198701–4. pmid:15600893
  30. 30. Fitzhugh R. Impulses and physiological states in theoretical models of nerve membrane. Biophysical Journal. 1961;1:445–466. pmid:19431309
  31. 31. Nagumo J, Arimoto S, Yoshizawa S. An active pulse transmission line simulating nerve axon. Proceedings of the IRE. 1962;50:2061–2070.
  32. 32. Hodgkin A, Huxley A. A quantitative description of membrane current and its application to conduction and excitation in nerve. J Physiology. 1952;117:500–544.