Multi-dimensional Feedback Particle Filter for Coupled Oscillators

Size: px
Start display at page:

Download "Multi-dimensional Feedback Particle Filter for Coupled Oscillators"

Transcription

1 3 American Control Conference (ACC) Washington, DC, USA, June 7-9, 3 Multi-dimensional Feedback Particle Filter for Coupled Oscillators Adam K. Tilton, Prashant G. Mehta and Sean P. Meyn Abstract This paper presents a methodology for state estimation of coupled oscillators from noisy observations. The methodology is comprised of two parts: modeling and estimation. The objective of the modeling is to express dynamics in terms of the so-called phase variables. For nonlinear estimation, a coupled-oscillator feedback particle filter is introduced. The filter is based on the construction of a large population of oscillators with mean-field coupling. The empirical distribution of the population encodes the posterior distribution of the phase variables. The methodology is illustrated with two numerical examples. I. INTRODUCTION This paper is concerned with the problem of estimating phases of coupled oscillators from noisy observation data. The motivation comes from biology where rhythmicity underlies several important behaviors e.g., periodic gaits exhibited by animals during locomotion (walking, hopping, running etc); cf., 5. The importance of the phase estimation problem is discussed in 3 and in several references therein. An important motivation for us comes from the problem of controlling rhythmic behaviors e.g., by using feedback control to stabilize walking gaits 4. For such applications, estimation is seen as an intermediate step towards control. The methodology proposed here comprises of two parts:. Modeling: The objective of the modeling is to obtain a reduced order model of the dynamics. The reduced order model comprises of weakly coupled oscillators, expressed in their phase variables; cf., 7, 8,. As an example, consider a dynamical system with two weakly coupled oscillators: The reduced order model has two phase variables, θ (t),) and θ (t),), representing the instantaneous phase of the two oscillators at time t. The dynamics evolve according to, dθ (t) = ω dt + εi (t),θ (t))dt, dθ (t) = ω dt + εi (t),θ (t))dt, (a) (b) where ω,ω are the frequency parameters and I ( ),I ( ) are the interaction functions.. Estimation: The objective of the estimation problem is to construct a filter for estimating the instantaneous phase ( (t),θ (t)) in the example above) given a time-history of noisy observations. A Bayesian procedure is described for synthesis of the coupled oscillator feedback particle filter. Financial support from the AFOSR grant FA and the NSF CPS grant 9346 is gratefully acknowledged. A. K. Tilton and P. G. Mehta are both with the Coordinated Science Laboratory and the Department of Mechanical Science and Engineering at the University of Illinois at Urbana-Champaign (UIUC) atilton@illinois.edu; mehtapg@illinois.edu S. P. Meyn is with the Department of Electrical and Computer Engineering at the University of Florida meyn@ece.ufl.edu. The filter comprises of a large population of oscillators coupled through a mean-field coupling. The empirical distribution of the population encodes the posterior distribution of the phase variables. The distribution is continuously updated based on noisy observations. Our approach is influenced by the conceptual framework in Lee and Mumford s work, who proposed a Bayesian inference framework for the visual cortex based on particle filtering. For the model described in (a, b) the coupled oscillator particle filter is comprised of N stochastic processes { i (t),θi (t)) : i N}, where the value i (t),θi (t)),),) is the state of the i th particle at time t. The dynamics evolve according to, dθ i (t) = ω dt + εi i (t),θi (t))dt + du i (t), dθ i (t) = ω dt + εi i (t),θi (t))dt + du i (t), where (U i(t),u i (t)) is the control input. It is chosen such that the empirical distribution of the population (for large N) approximates the posterior distribution of the phase variables (t),θ (t)). A constructive design procedure for control synthesis is described, based on the feedback particle filter methodology 8, 7. The two-state model is used here for illustrative purposes; the methodology is applicable to models with arbitrarily many phase variables. The contributions of this paper are summarized as follows: The paper is amongst the first to explicitly use phase models to construct nonlinear estimators. This is important because a single oscillator is a model of the repetitive firing of a single neuron; cf., 7. A coupled oscillator particle filter can thus be realized as a neuronal network. The activity of the network is encoded in the phase variables e.g., {θ i(t)}n i= and {θ i(t)}n i= encode the posterior distribution of the (hidden) phase variables θ (t) and θ (t), respectively. Apart from this paper, the problem of estimating phase variables appears in our own prior work 5, which applies the feedback particle filter to estimating a single phase variable associated with a walking gait cycle. In 3, a computational method, Phaser, is described based on taking a Hilbert transform and applying a Fourier series based correction (see also 6). Dynamical systems techniques for recovering phase via delay coordinate embedding appear in 4. In, an approach for invariant reconstruction of phase equations from measurement data is discussed. The outline of the remainder of this paper is as follows. The problem statement appears in Sec. II. The methodology is comprised of two parts, modeling and estimation, which are discussed in Sec. III-Sec. IV, respectively. Two illustrative numerical examples are described in Sec. V /$3. 3 AACC 4

2 II. PROBLEM STATEMENT A. Preliminaries and Notation The dynamic model describes r weakly coupled oscillator systems. The state of the k th -system is denoted as X k (t) R d. The uncoupled dynamic model of the k th -system is given by, dx k (t) = ã k (X k (t))dt, (3) where ã k is a C function. The system is assumed to have an isolated asymptotically stable periodic orbit (limit cycle) with period /ω k. Denote the limit cycle solution as XLC k k(t)) where θ k (t) = θ k () + ω k t mod. Denote the set of points on the limit cycle as P k. By construction, the map XLC k :,) Pk R d is invertible and denote the inverse map as φ k. The inverse map φ k : P k,) is defined as φ k (x) = θ iff XLC k ) = x, for x P k, θ,). The inverse map is extended to a small neighborhood N k of the limit cycle P k by using the notion of asymptotic phase: Let Φ k : N k R N k be the flow map so Φ k (x,t) is the solution of (3) from initial condition x N k. The asymptotic phase of the point x N k is defined as the phase of the point y P k such that Φ k (x,t) Φ k (y,t) as t. Denote the extended map as φ k where note φ k : N k,) and φ k = φ k on the periodic orbit P k. The instantaneous phase is defined in terms of the extended map: θ k (t) = φ k (X k (t)), for X k (t) N k. (4) The set of points with same phase are called isochrons. The phase model reduction is standard; cf., and references therein. Example : Consider the Hopf oscillator model. The state X(t) = (x(t),y(t)) R and the dynamics are given by, where J = dx(t) = ωjx(t)dt + γ( r )X(t)dt, (5), ω =, γ =. and r = (x(t)) + (y(t)). The system has a limit cycle, X LC ) = (cos),sin)), where θ = ωt mod. The set P = {(x,y) R : x + y = }. For points (x,y) N, a small neighborhood of P, the phase φ(x, y) = arctan(y/x), i.e., the isochrons are rays originating at origin. Using (4), the instantaneous phase is given by θ(t) = φ(x(t)) = arctan ( ) y(t), for (x(t),y(t)) N. x(t) B. Problem Statement For the coupled system, the state is denoted as X(t) := (X (t),x (t),...,x r (t)). The dynamical system is given by, for k =,,...,r: dx k (t) = ã k (X k (t))dt + ε r b kl (X k (t),x l (t))dt, (6) where ã k, b kl are C functions. The coupling parameter ε is assumed to be small enough such that X k (t) N k, a small neighborhood of the limit cycle P k of the uncoupled system, for all k =,,...,r and t. The observation model is given by, dz(t) = h(x(t))dt + σ W dw(t), where Z(t) R m is the observation process, {W(t)} is a Wiener process, σ W R is the standard deviation parameter, and h( ) is a C function; h is a column vector whose j- th coordinate is denoted as h j (i.e., h = ( h, h,..., h m ) T ). By scaling, we assume without loss of generality that the covariance matrix associated with {W(t)} is an identity matrix. The objective of the filtering problem is to estimate the posterior distribution of θ(t) := (t),θ (t),...,θ r (t)) given the filtration (time history of observations) Z t := σ(z s : s t). Note that the phase θ k (t) is well-defined by (4) for X k (t) N k. The posterior is denoted by p, so that for any measurable set A,) r, p (ϑ,t) dϑ = P{θ(t) A Z t }. ϑ A The filter is infinite-dimensional since it defines the evolution, in the space of probability measures, of {p (,t) : t }. Example : Consider the coupled Hopf oscillator model of the form (6) with r =. The state X(t) = (X (t),x (t)) is four dimensional, with X k (t) = (x k (t),y k (t)) for k =,. The dynamics of the coupled model is given by, dx (t) = ( ωjx (t) + γ( r )X (t) + ε(x (t) X (t))) ) dt, (7a) dx (t) = ( ωjx (t) + γ( r )X (t) + ε(x (t) X (t)) ) dt, (7b) where r k = (x k(t)) + (y k (t)) for k =,, and other parameters are as in Example. The observation process is two-dimensional Z(t) = (Z (t),z (t)), and the observation model is given by, dz (t) = x (t)dt + σ W dw (t), dz (t) = x (t)dt + σ W dw (t), (8a) (8b) where W,W are mutually independent standard Wiener processes, and σ W is the standard deviation parameter. We revisit this example in Sec. V-B. 4

3 A. Signal model III. MODELING: PHASE MODELS For the uncoupled limit cycling system (3), the state of the k th oscillator is θ k (t),), and the dynamics evolve according to, dθ k (t) = ω k mod. The solution of (3) is expressed as X k (t) = X k LC k(t)). The modeling technique that is used in this paper is based on interpreting the original weakly coupled system (6), as a perturbation of this ideal uncoupled system. It can be shown that the approximation X k (t) = X k LC k(t)) + O(ε) holds for (6). That is, to O(ε), the effect of weak coupling is manifested through changes in the phase variable only. The state of the reduced order model is θ(t) = (t),θ (t),...,θ r (t)),) r, and the dynamics (to O(ε)) evolve according to, dθ k (t) = ω k + ε r I kl k (t),θ l (t)) mod, (9) for k =,...,r and t. The interaction terms I kl k,θ l ) are obtained from the corresponding terms b kl (X k,x l ) in (6). An algorithm for the same, based on a standard singular perturbation approach (see ), appears in Appendix VII. Example 3: For the single-hopf model (5) in Example, the state is θ(t),) and the dynamics are given by, dθ(t) = dt mod. In terms of θ(t), the (limit cycle) solution of (5) is given by X(t) = X LC (t)) = (cos(t)),sin(t))). For the coupled model (7a, 7b) in Example, the state θ(t) = (t),θ (t)),) and the dynamics are given by, dθ (t) = + ε sin (t) θ (t)) mod, dθ (t) = + ε sin (t) θ (t)) mod. This reduced order phase model is derived as part of the Example 5 in Appendix VII. In terms of θ(t), the (limit cycle) solution of the coupled full-order model (7a, 7b) is given by, X (t) = X LC (t)) + O(ε) = (cos (t)),sin (t))) + O(ε), X (t) = X LC (t)) + O(ε) = (cos (t)),sin (t))) + O(ε). B. Observation model On the limit cycle, X k (t) = X k LC k(t)) + O(ε). We thus define an observation function on the limit cycle as, h) := h(x LC )), for θ =,θ,...,θ r ),) r where X LC ) := (X LC ),X LC ),...,X r LC r)). Example 4: Consider the observation model (8a, 8b) introduced in Example : the observation function x h((x,y ),(x,y )) =. So, x h,θ ) = h(x LC ),X LC )) = cos ) cos ). IV. ESTIMATION: FEEDBACK PARTICLE FILTER Consider the multivariable filtering problem: dθ(t) = a(t))dt + db(t), mod, (a) dz(t) = h(t))dt + dw(t), (b) where θ(t) = (t),θ (t),...,θ r (t)),) r is the state at time t, Z(t) R m is the observation process, a( ), h( ) are -periodic C functions, and {B(t)}, {W(t)} are mutually independent Wiener processes of appropriate dimension. By scaling, we assume without loss of generality that the covariance matrices associated with {B(t)}, {W(t)} are identity matrices. Recall here that our objective is to obtain the posterior distribution p of θ(t) given the filtration Z t. Remark : The signal model (a) is allowed to be more general than (9) primarily to simplify the notation. Note, however, that the formulation allows one the option to include process noise in oscillator models. A. Feedback Particle Filter In our prior work 8, 7, 6, a feedback control-based approach to the solution of the nonlinear filtering problem was introduced. The resulting algorithm is referred to as the feedback particle filter. The feedback particle filter is a controlled system. The state of the filter is {θ i (t) : i N}: The value θ i (t) = i(t),θi (t),...,θi r(t)),) r is the state for the i th particle at time t. Note that the i th particle comprises of r-oscillators. The dynamics of the i th particle have the following gain feedback form, expressed in its Stratonovich form, dθ i (t) = a i (t))dt + db i (t) + K i (t),t) di i (t), mod, where {B i (t)} are mutually independent standard Wiener processes, and I i is similar to the innovation process that appears in the nonlinear filter, di i (t)=:dz(t) (h i (t)) + ĥ(t))dt, where ĥ(t) := Eh i (t)) Z t. In a numerical implementation, we approximate ĥ N N i= h i (t)) =: ĥ (N). The gain function K is obtained as a solution to an Euler-Lagrange boundary value problem (E-L BVP): For j =,,...,m, the function φ j is a solution to the secondorder differential equation, (p,t) φ j,t)) = (h j ) ĥ j )p,t),,) r φ j,t)p,t)dθ =, () 43

4 where p denotes the conditional distribution of θ i (t) given Z t. In terms of these solutions, the gain function is given by, K l j,t) = φ j l,t). Note that the gain function needs to be obtained for each value of time t. It is shown in 7 that the feedback particle filter is consistent with the nonlinear filter, given consistent initializations p(,) = p (,). Consequently, if the initial conditions {θ i ()} N i= are drawn from the initial distribution p (,) of θ(), then, as N, the empirical distribution of the particle system approximates the posterior distribution p (,t) for each t (see 6, 7 for details). Notation: L (,) r ; p) is used to denote the Hilbert space of -periodic functions on,) r that are squareintegrable with respect to density p(,t); H k (,) r ; p) is used to denote the Hilbert space of functions whose first k- derivatives (defined in the weak sense) are in L (,) r ; p). Denote H (,) r ; p) := {φ } H φ(ϑ)p(ϑ,t)dϑ =. A function φ j H (,)r ; p) is said to be a weak solution of the BVP () if φ j (ϑ,t) ψ(ϑ)p(ϑ,t)dϑ = (h j (ϑ) ĥ j )ψ(ϑ)p(ϑ,t)dϑ, The finite-dimensional approximation of () is to choose constants {κ l } L such that L κ l E ψ l ψ = E(h ĥ)ψ, ψ S, (3) where S := span{ψ,ψ,...,ψ L } H (,) r ; p). Denoting A kl = E ψ l ψ k, b k = E(h ĥ)ψ k, κ = (κ,κ,...,κ L ) T, the finite-dimensional approximation (3) is expressed as a linear matrix equation: Aκ = b. (4) The matrix A and vector b are approximated by using only the particles: A kl = E ψ l ψ k N b k = E(h ĥ)ψ k N N i= N i= ψ l i (t)) ψ k i (t)), (h i (t)) ĥ)ψ k i (t)), where recall ĥ N N i= h i (t)). The important point to note is that the gain function is expressed in terms of averages taken over the population. A. Single Hopf oscillator V. EXAMPLES for all ψ H (,) r ; p). Denoting E := p(ϑ,t)dϑ, the weak form of the BVP () can also be expressed as follows: E φ j ψ = E(h j ĥ j )ψ, ψ H (,) r ; p). () This representation is useful for the numerical algorithm described next. B. Synthesis of Gain Function In this section, a Galerkin algorithm is described to obtain an approximate solution of (). Since there are m uncoupled BVPs, without loss of generality, we assume scalar-valued observation in this section, with m =, so that K = φ. The time t is fixed. The explicit dependence on time is suppressed for notational ease (That is, p, t) is denoted as p), φ,t) as φ) etc.). The function φ is approximated as, φ) = L κ l ψ l ), where {ψ l )} L are the Fourier basis functions on,)r. The gain function K is given by, K) = φ) = L κ l ψ l ). Fig.. Observations over one cycle for example. Consider the filtering problem for the single-hopf model (see Example ): dx(t) = ωjx(t)dt + γ( r )X(t), dz(t) = h(x(t))dt + σ W dw(t), where X(t) = (x(t),y(t)) R, r = x (t)+y (t), h(x,y) = x, and parameters ω =, γ =. and σ W =.. Fig. depicts the trajectory x(t) and noisy observations Y (t). At each discrete time, these are obtained as Y (t) := Z t / t, where t denotes the discrete time step, and Z t = Z(t + t) Z(t). In numerical simulations, t =. is chosen. Recall that the limit cycle solution is given by X(t) = X LC (t)) = (cos(t)),sin(t))), where θ(t) = θ() + ωt mod. The objective is to approximate the posterior of the instantaneous phase θ(t) given Z t. 44

5 θ i(t) ±σ True State: θ Estimate: ˆθ ±σ Estimate: ˆθ True State: θ p, t) p, t3) θ θ θ t (a) t t 3 t t t 3 t 4 t (b) p) (c) Fig.. Summary of numerical results for example : (a) Initial transients as particles converge starting from a uniform initial distribution; (b) Comparison of estimated mean { ˆθ(t) (N) } with the true state {θ(t)}, where the shaded region show ± two standard deviations; and (c) Representative empirical distributions at two times, t and t 3. The feedback particle filter is given by, dθ i (t) = ω i dt + σ B db i (t) ( ) + K i (t),t) dz(t) h i (t)) + ĥ, mod, (6) where h i (t)) = cos i (t)) and ĥ = N N j= cos j (t)). For the exact filter, ω i = ω and σ B =. In numerical simulations, we include a small noise (σ B > ) and pick ω i from a uniform distribution on ω δ,ω +δ. Such a model is more realistic from an implementation standpoint, even though it is not exact. The gain function K,t) = φ,t) is obtained via the solution of the E-L equation: (p,t) φ,t)) = (h) ĥ)p,t). An approximate solution is obtained by using the Galerkin method described in Sec. IV-B with basis functions {cos),sin)}. In terms of basis functions, K,t) = κ (t)sin) + κ (t)cos), where κ(t) := κ (t),κ (t) are obtained at each time by solving the linear matrix equation (see (4)): N j sin j (t)) N j sin j (t))cos j (t)) N j sin j (t))cos j (t)) N j cos j (t)) N j (h j (t)) ĥ)cos j (t)) = N j (h j (t)) ĥ)sin j (t)) κ (t) κ (t). (7) We next discuss the result of numerical experiments. The particle filter model is given by (6) with gain function K i (t),t), obtained using solution of (7). The number of particles N =, and their initial condition {θ i ()} N i= was sampled from a uniform distribution on circle, ). The noise parameter σ B =. and the frequencies ω i are sampled from a uniform distribution on δ, + δ with δ =.5. Fig. summarizes some of the results of the numerical simulation. The initial transients due to the initial condition converge rapidly as shown in part (a). A single cycle from a time-window after transients have converged is depicted in part (b): the figure compares the sample path of the actual state θ(t) (as a solid line) with the estimated mean ˆθ (N) (t) (as a dashed line). The shaded area indicates ± two standard deviation bounds. The density at two time instants is depicted in part (c). These results show that the filter is able to track the phase accurately. Note that at each time instant t, the estimated mean, the bounds and the density p, t) shown here are all approximated from the ensemble {θ i (t)} N i=. B. Coupled Hopf oscillator Consider next the filtering problem for the coupled Hopf model. The problem is described in Example : The signal model is the 4-dimensional coupled Hopf model (7a, 7b) and the observation model (8a, 8b) is two-dimensional. Starting from an arbitrary initial condition, one asymptotically obtains an anti-phase limit cycle solution where X k (t) X LC k (t)) = (cos k (t)),sin k (t))) for k =, and θ (t) and θ (t) are out of phase. Fig. 3 (a) depicts this solution for ε =.5. The objective is to approximate the posterior of the phase θ (t),θ (t) given Z t. The feedback particle filter is given by, dθi (t) = ω,i dt + ε sin (t) θ i (t))dt + σ B db i ( ) (t) + K i (t),t) dz(t) h i (t)) + ĥ(t), mod, dθ i (t) = ω,i dt + ε sin (t) θ i (t))dt + σ B db i ( ) (t) + K i (t),t) dz(t) h i (t)) + ĥ(t), mod, where θ i (t) = i(t),θi (t)),), h i h (t)) = i(t)) cos i h i(t)) = (t)) cos i(t)) and ĥ(t) = N N j= cos j (t)). As in the preceding section, we include small noise (σ B > ) and pick frequencies ω,i,ω,i from a uniform distribution on ω δ,ω + δ. The gain function, K,θ,t) K,θ,t) = φ,θ,t) φ,θ,t), φ,θ,t) φ,,θ,t) 45

6 True State: θ Estimate:ˆθ p) x t t t 3 t 4 t θ θ θ - - θ p ) (a) (b) (c) Fig. 3. Summary of numerical results for example : (a) Convergence of trajectories to the anti-phase limit cycle solution; (b) Comparison of (t),θ (t)) with the estimated mean ( ˆθ (N) (t), ˆθ (N) (t)); and (c) Representative empirical distribution at a fixed time instant (where the true state θ = and θ = ). where each column is obtained by solving the E-L equation: (p,t) φ j,t)) = (h j ) ĥ j )p,t), for j =,. An approximate solution is obtained by using the Galerkin method described in Sec. IV-B with basis functions {sin ),cos ),sin ),cos )}. This leads to a 4 4 linear matrix problem (4), whose solution is obtained numerically. As in the preceding section, the calculation of the gain function requires averages taken over the population. We next discuss the result of numerical experiments. The number of particles N =, and their initial condition {θ i()}n i= and {θ i()}n i= was sampled from a uniform distribution on the torus,). The noise parameter σ B =. and frequencies are sampled uniformly from.5,.5. Fig. 3 (b) compares the sample path of the actual state (t),θ (t)) (as a solid line) with the estimated mean ( ˆθ (N) (t), ˆθ (N) (t)) (as a dashed line). The standard deviation bounds are tight: the density at a single time instant is depicted in part (c). These results show that the filter is able to track the phase variables on the torus accurately. VI. CONCLUSIONS The application of singular perturbation techniques to obtain a reduced order model provides an approach to nonlinear filter design for a coupled oscillator model. This technique is general, and is expected to find many applications. The importance of coupled oscillators as models of both movement in animals (periodic gaits), and of central pattern generators in nervous system provided the impetus to this work; cf., 3, 9,. The filtering viewpoint espoused in this paper is useful because it connects naturally to feedback control of periodic behavior. This is a subject of ongoing work. In addition, we are currently applying these techniques to phase estimation in the power grid, which is of significant interest in industry. Reliable power system operations require the balance of supply and demand on a second-by-second basis: The frequency must be kept at 6Hz, and consistency of the phase of generation at neighboring nodes in the grid must be maintained. Control requires state estimation of precisely the kind described in this paper. VII. APPENDIX: MODEL REDUCTION In this section, an algorithm is described to obtain the reduced order phase model (9) starting from the weakly coupled dynamical system model (6). We use the notation of Sec. II-A. For the k th -system (3), the phase response curve (PRC), denoted as P k ), is defined to be the -periodic solution of the adjoint equation: ω k dp k dθ ) + (Dak (X k LC )))T P k ) =, for θ,), where Da k (XLC k )) is the Jacobian of the vector-field ak evaluated on the limit cycle XLC k ), and P k) satisfies the normalizing condition < P k (),a k (XLC k ()) >=, where <, > denotes the standard inner product in R d. In terms of PRC, the interaction term in (9) is obtained as I kl k,θ l ) =< P k k ),b kl (X k LC k),x l LC l)) >. (9) The derivation relies on a singular perturbation argument; cf., 7, 8,. Example 5: Consider the single-hopf model (5) in Example. The limit cycle solution is given by XLC ) = (cos),sin)), and a (XLC )) = ( sin),cos)). The adjoint equation is where A = dp dθ ) + AP ) =, cos ) sin)cos) and the normalizing constraint sin)cos) sin ) < P (),a (X LC ()) >=< P (),(,) >=. The solution to the adjoint equation, the phase response curve P ) = ( sin),cos)). Consider now the coupled model (7a, 7b) in Example with b = X X. Using (9), the interaction term for the, 46

7 phase model is obtained as, I,θ ) = sin ) cos ) cos ) cos ) sin ) sin ) = sin θ ). REFERENCES E. Brown, J. Moehlis, and P. Holmes. On the phase reduction and response dynamics of neural oscillator populations. Neural Comp., 6:673 75, 4. Z. Chen, L. Zhu, and T. Iwasaki. Autonomous locomotion of multilink mechanical systems via natural oscillation pattern. In In Proc. of IEEE Conference on Decision and Control, pages ,. 3 R. J. Full and D. E. Koditschek. Templates and anchors: neuromechanical hypotheses of legged locomotion on land. J. Exp. Biol., (3): , December J. W. Grizzle, J.-H. Choi, H. Hammouri, and B. Morris. On Observer- Based Feedback Stabilization of Periodic Orbits in Bipedal Locomotion. Methods and Models in Automation and Robotics (MMAR 7), August 7. Plenary Talk. 5 P. Holmes, R. J. Full, D. Koditschek, and J. Guckenheimer. The dynamics of legged locomotion: models, analyses, and challenges. SIAM Rev., 48():7 34, 6. 6 N. E. Huang, Z. Shen, S. R. Long, M. C. Wu, H. H. Shih, Q. Zheng, N. C. Yen, C. C. Tung, and H. H. Liu. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences, 454(97):93 995, March E. M. Izhikevich. Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting (Computational Neuroscience), chapter. The MIT Press, edition, November 6. 8 N. Kopell and G. B. Ermentrout. Symmetry and phaselocking in chains of weakly coupled oscillators. Commun. Pure Appl. Math., 39:63 66, N. Kopell and G.B. Ermentrout. Coupled oscillators and the design of central pattern generators. Math. Biosci., 9:87 9, 988. B. Kralemann, A. Pikovsky, and M. Rosenblum. Reconstructing phase dynamics of oscillator networks. Chaos, ():54,. P. S. Krishnaprasad. Motion control and coupled oscillators. In Proceedings of Symposium on Motion, Control and Geometry, Board of Mathematical Sciences, National Academy of Sciences, Washington, DC, 995. T. S. Lee and D. Mumford. Hierarchical Bayesian inference in the visual cortex. Journal of the Optical Society of America, A, (7): , 3. 3 S. Revzen and J. M. Guckenheimer. Estimating the phase of synchronized oscillators. Physical Review E, 78(5):597, 8. 4 T. Schreiber. Interdisciplinary application of nonlinear time series methods. Phys. Rep., 38: 64, A. K. Tilton, E. T. Hsiao-Wecksler, and P. G. Mehta. Filtering with rhythms: Application to estimation of gait cycle. In Proc. of American Control Conference, pages , June. 6 T. Yang, R. S. Laugesen, P. G. Mehta, and S. P. Meyn. Multivariable feedback particle filter. In Proc. of IEEE Conference on Decision and Control, pages , Dec. 7 T. Yang, P. G. Mehta, and S. P. Meyn. Feedback particle filter with mean-field coupling. In Proc. of IEEE Conference on Decision and Control, pages , December. 8 T. Yang, P. G. Mehta, and S. P. Meyn. A mean-field controloriented approach to particle filtering. In Proc. of American Control Conference, pages 37 43, June. 47

c 2014 Krishna Kalyan Medarametla

c 2014 Krishna Kalyan Medarametla c 2014 Krishna Kalyan Medarametla COMPARISON OF TWO NONLINEAR FILTERING TECHNIQUES - THE EXTENDED KALMAN FILTER AND THE FEEDBACK PARTICLE FILTER BY KRISHNA KALYAN MEDARAMETLA THESIS Submitted in partial

More information

Feedback Particle Filter and its Application to Coupled Oscillators Presentation at University of Maryland, College Park, MD

Feedback Particle Filter and its Application to Coupled Oscillators Presentation at University of Maryland, College Park, MD Feedback Particle Filter and its Application to Coupled Oscillators Presentation at University of Maryland, College Park, MD Prashant Mehta Dept. of Mechanical Science and Engineering and the Coordinated

More information

arxiv: v1 [math.na] 26 Feb 2013

arxiv: v1 [math.na] 26 Feb 2013 1 Feedback Particle Filter Tao Yang, Prashant G. Mehta and Sean P. Meyn Abstract arxiv:1302.6563v1 [math.na] 26 Feb 2013 A new formulation of the particle filter for nonlinear filtering is presented, based

More information

Bayesian Inference with Oscillator Models: A Possible Role of Neural Rhythms

Bayesian Inference with Oscillator Models: A Possible Role of Neural Rhythms Bayesian Inference with Oscillator Models: A Possible Role of Neural Rhythms Qualcomm/Brain Corporation/INC Lecture Series on Computational Neuroscience University of California, San Diego, March 5, 2012

More information

Dynamical modelling of systems of coupled oscillators

Dynamical modelling of systems of coupled oscillators Dynamical modelling of systems of coupled oscillators Mathematical Neuroscience Network Training Workshop Edinburgh Peter Ashwin University of Exeter 22nd March 2009 Peter Ashwin (University of Exeter)

More information

Synchronization and Phase Oscillators

Synchronization and Phase Oscillators 1 Synchronization and Phase Oscillators Richard Bertram Department of Mathematics and Programs in Neuroscience and Molecular Biophysics Florida State University Tallahassee, Florida 32306 Synchronization

More information

LYAPUNOV EXPONENTS AND STABILITY FOR THE STOCHASTIC DUFFING-VAN DER POL OSCILLATOR

LYAPUNOV EXPONENTS AND STABILITY FOR THE STOCHASTIC DUFFING-VAN DER POL OSCILLATOR LYAPUNOV EXPONENTS AND STABILITY FOR THE STOCHASTIC DUFFING-VAN DER POL OSCILLATOR Peter H. Baxendale Department of Mathematics University of Southern California Los Angeles, CA 90089-3 USA baxendal@math.usc.edu

More information

A conjecture on sustained oscillations for a closed-loop heat equation

A conjecture on sustained oscillations for a closed-loop heat equation A conjecture on sustained oscillations for a closed-loop heat equation C.I. Byrnes, D.S. Gilliam Abstract The conjecture in this paper represents an initial step aimed toward understanding and shaping

More information

Phase Oscillators. and at r, Hence, the limit cycle at r = r is stable if and only if Λ (r ) < 0.

Phase Oscillators. and at r, Hence, the limit cycle at r = r is stable if and only if Λ (r ) < 0. 1 Phase Oscillators Richard Bertram Department of Mathematics and Programs in Neuroscience and Molecular Biophysics Florida State University Tallahassee, Florida 32306 2 Phase Oscillators Oscillations

More information

Stochastic contraction BACS Workshop Chamonix, January 14, 2008

Stochastic contraction BACS Workshop Chamonix, January 14, 2008 Stochastic contraction BACS Workshop Chamonix, January 14, 2008 Q.-C. Pham N. Tabareau J.-J. Slotine Q.-C. Pham, N. Tabareau, J.-J. Slotine () Stochastic contraction 1 / 19 Why stochastic contraction?

More information

Chapter 1. Introduction

Chapter 1. Introduction Chapter 1 Introduction 1.1 What is Phase-Locked Loop? The phase-locked loop (PLL) is an electronic system which has numerous important applications. It consists of three elements forming a feedback loop:

More information

Lecture 6: Bayesian Inference in SDE Models

Lecture 6: Bayesian Inference in SDE Models Lecture 6: Bayesian Inference in SDE Models Bayesian Filtering and Smoothing Point of View Simo Särkkä Aalto University Simo Särkkä (Aalto) Lecture 6: Bayesian Inference in SDEs 1 / 45 Contents 1 SDEs

More information

Gain Function Approximation in the Feedback Particle Filter

Gain Function Approximation in the Feedback Particle Filter Gain Function Approimation in the Feedback Particle Filter Amirhossein Taghvaei, Prashant G. Mehta Abstract This paper is concerned with numerical algorithms for gain function approimation in the feedback

More information

A Comparative Study of Nonlinear Filtering Techniques

A Comparative Study of Nonlinear Filtering Techniques A Comparative Study of onlinear Filtering Techniques Adam K. Tilton, Shane Ghiotto and Prashant G. Mehta Abstract In a recent work it is shown that importance sampling can be avoided in the particle filter

More information

Data assimilation with and without a model

Data assimilation with and without a model Data assimilation with and without a model Tim Sauer George Mason University Parameter estimation and UQ U. Pittsburgh Mar. 5, 2017 Partially supported by NSF Most of this work is due to: Tyrus Berry,

More information

Target Localization and Circumnavigation Using Bearing Measurements in 2D

Target Localization and Circumnavigation Using Bearing Measurements in 2D Target Localization and Circumnavigation Using Bearing Measurements in D Mohammad Deghat, Iman Shames, Brian D. O. Anderson and Changbin Yu Abstract This paper considers the problem of localization and

More information

Gain Function Approximation in the Feedback Particle Filter

Gain Function Approximation in the Feedback Particle Filter Gain Function Approimation in the Feedback Particle Filter Amirhossein Taghvaei, Prashant G. Mehta Abstract This paper is concerned with numerical algorithms for gain function approimation in the feedback

More information

Data assimilation with and without a model

Data assimilation with and without a model Data assimilation with and without a model Tyrus Berry George Mason University NJIT Feb. 28, 2017 Postdoc supported by NSF This work is in collaboration with: Tim Sauer, GMU Franz Hamilton, Postdoc, NCSU

More information

Linear Algebra Review (Course Notes for Math 308H - Spring 2016)

Linear Algebra Review (Course Notes for Math 308H - Spring 2016) Linear Algebra Review (Course Notes for Math 308H - Spring 2016) Dr. Michael S. Pilant February 12, 2016 1 Background: We begin with one of the most fundamental notions in R 2, distance. Letting (x 1,

More information

Approximately dual frames in Hilbert spaces and applications to Gabor frames

Approximately dual frames in Hilbert spaces and applications to Gabor frames Approximately dual frames in Hilbert spaces and applications to Gabor frames Ole Christensen and Richard S. Laugesen October 22, 200 Abstract Approximately dual frames are studied in the Hilbert space

More information

Data assimilation in high dimensions

Data assimilation in high dimensions Data assimilation in high dimensions David Kelly Courant Institute New York University New York NY www.dtbkelly.com February 12, 2015 Graduate seminar, CIMS David Kelly (CIMS) Data assimilation February

More information

A Monte Carlo Sequential Estimation for Point Process Optimum Filtering

A Monte Carlo Sequential Estimation for Point Process Optimum Filtering 2006 International Joint Conference on Neural Networks Sheraton Vancouver Wall Centre Hotel, Vancouver, BC, Canada July 16-21, 2006 A Monte Carlo Sequential Estimation for Point Process Optimum Filtering

More information

Ergodicity in data assimilation methods

Ergodicity in data assimilation methods Ergodicity in data assimilation methods David Kelly Andy Majda Xin Tong Courant Institute New York University New York NY www.dtbkelly.com April 15, 2016 ETH Zurich David Kelly (CIMS) Data assimilation

More information

c 2014 Shane T. Ghiotto

c 2014 Shane T. Ghiotto c 2014 Shane T. Ghiotto COMPARISON OF NONLINEAR FILTERING TECHNIQUES BY SHANE T. GHIOTTO THESIS Submitted in partial fulfillment of the requirements for the degree of Master of Science in Mechanical Engineering

More information

Chapter 2 Distributed Parameter Systems: Controllability, Observability, and Identification

Chapter 2 Distributed Parameter Systems: Controllability, Observability, and Identification Chapter 2 Distributed Parameter Systems: Controllability, Observability, and Identification 2.1 Mathematical Description We introduce the class of systems to be considered in the framework of this monograph

More information

Latent state estimation using control theory

Latent state estimation using control theory Latent state estimation using control theory Bert Kappen SNN Donders Institute, Radboud University, Nijmegen Gatsby Unit, UCL London August 3, 7 with Hans Christian Ruiz Bert Kappen Smoothing problem Given

More information

Lecture 4: Numerical solution of ordinary differential equations

Lecture 4: Numerical solution of ordinary differential equations Lecture 4: Numerical solution of ordinary differential equations Department of Mathematics, ETH Zürich General explicit one-step method: Consistency; Stability; Convergence. High-order methods: Taylor

More information

2.152 Course Notes Contraction Analysis MIT, 2005

2.152 Course Notes Contraction Analysis MIT, 2005 2.152 Course Notes Contraction Analysis MIT, 2005 Jean-Jacques Slotine Contraction Theory ẋ = f(x, t) If Θ(x, t) such that, uniformly x, t 0, F = ( Θ + Θ f x )Θ 1 < 0 Θ(x, t) T Θ(x, t) > 0 then all solutions

More information

State Space Representation of Gaussian Processes

State Space Representation of Gaussian Processes State Space Representation of Gaussian Processes Simo Särkkä Department of Biomedical Engineering and Computational Science (BECS) Aalto University, Espoo, Finland June 12th, 2013 Simo Särkkä (Aalto University)

More information

Enhanced Active Power Filter Control for Nonlinear Non- Stationary Reactive Power Compensation

Enhanced Active Power Filter Control for Nonlinear Non- Stationary Reactive Power Compensation Enhanced Active Power Filter Control for Nonlinear Non- Stationary Reactive Power Compensation Phen Chiak See, Vin Cent Tai, Marta Molinas, Kjetil Uhlen, and Olav Bjarte Fosso Norwegian University of Science

More information

Decentralized Stochastic Control with Partial Sharing Information Structures: A Common Information Approach

Decentralized Stochastic Control with Partial Sharing Information Structures: A Common Information Approach Decentralized Stochastic Control with Partial Sharing Information Structures: A Common Information Approach 1 Ashutosh Nayyar, Aditya Mahajan and Demosthenis Teneketzis Abstract A general model of decentralized

More information

Stochastic Processes. A stochastic process is a function of two variables:

Stochastic Processes. A stochastic process is a function of two variables: Stochastic Processes Stochastic: from Greek stochastikos, proceeding by guesswork, literally, skillful in aiming. A stochastic process is simply a collection of random variables labelled by some parameter:

More information

AC&ST AUTOMATIC CONTROL AND SYSTEM THEORY SYSTEMS AND MODELS. Claudio Melchiorri

AC&ST AUTOMATIC CONTROL AND SYSTEM THEORY SYSTEMS AND MODELS. Claudio Melchiorri C. Melchiorri (DEI) Automatic Control & System Theory 1 AUTOMATIC CONTROL AND SYSTEM THEORY SYSTEMS AND MODELS Claudio Melchiorri Dipartimento di Ingegneria dell Energia Elettrica e dell Informazione (DEI)

More information

On Stochastic Adaptive Control & its Applications. Bozenna Pasik-Duncan University of Kansas, USA

On Stochastic Adaptive Control & its Applications. Bozenna Pasik-Duncan University of Kansas, USA On Stochastic Adaptive Control & its Applications Bozenna Pasik-Duncan University of Kansas, USA ASEAS Workshop, AFOSR, 23-24 March, 2009 1. Motivation: Work in the 1970's 2. Adaptive Control of Continuous

More information

{ =y* (t)=&y(t)+ f(x(t&1), *)

{ =y* (t)=&y(t)+ f(x(t&1), *) Journal of Differential Equations 69, 6463 (00) doi:0.006jdeq.000.390, available online at http:www.idealibrary.com on The Asymptotic Shapes of Periodic Solutions of a Singular Delay Differential System

More information

Lecture 1: Pragmatic Introduction to Stochastic Differential Equations

Lecture 1: Pragmatic Introduction to Stochastic Differential Equations Lecture 1: Pragmatic Introduction to Stochastic Differential Equations Simo Särkkä Aalto University, Finland (visiting at Oxford University, UK) November 13, 2013 Simo Särkkä (Aalto) Lecture 1: Pragmatic

More information

Introduction to numerical simulations for Stochastic ODEs

Introduction to numerical simulations for Stochastic ODEs Introduction to numerical simulations for Stochastic ODEs Xingye Kan Illinois Institute of Technology Department of Applied Mathematics Chicago, IL 60616 August 9, 2010 Outline 1 Preliminaries 2 Numerical

More information

ADAPTIVE FEEDBACK LINEARIZING CONTROL OF CHUA S CIRCUIT

ADAPTIVE FEEDBACK LINEARIZING CONTROL OF CHUA S CIRCUIT International Journal of Bifurcation and Chaos, Vol. 12, No. 7 (2002) 1599 1604 c World Scientific Publishing Company ADAPTIVE FEEDBACK LINEARIZING CONTROL OF CHUA S CIRCUIT KEVIN BARONE and SAHJENDRA

More information

13. Power Spectrum. For a deterministic signal x(t), the spectrum is well defined: If represents its Fourier transform, i.e., if.

13. Power Spectrum. For a deterministic signal x(t), the spectrum is well defined: If represents its Fourier transform, i.e., if. For a deterministic signal x(t), the spectrum is well defined: If represents its Fourier transform, i.e., if jt X ( ) = xte ( ) dt, (3-) then X ( ) represents its energy spectrum. his follows from Parseval

More information

A Novel Integral-Based Event Triggering Control for Linear Time-Invariant Systems

A Novel Integral-Based Event Triggering Control for Linear Time-Invariant Systems 53rd IEEE Conference on Decision and Control December 15-17, 2014. Los Angeles, California, USA A Novel Integral-Based Event Triggering Control for Linear Time-Invariant Systems Seyed Hossein Mousavi 1,

More information

Dynamical systems in neuroscience. Pacific Northwest Computational Neuroscience Connection October 1-2, 2010

Dynamical systems in neuroscience. Pacific Northwest Computational Neuroscience Connection October 1-2, 2010 Dynamical systems in neuroscience Pacific Northwest Computational Neuroscience Connection October 1-2, 2010 What do I mean by a dynamical system? Set of state variables Law that governs evolution of state

More information

1. Find the solution of the following uncontrolled linear system. 2 α 1 1

1. Find the solution of the following uncontrolled linear system. 2 α 1 1 Appendix B Revision Problems 1. Find the solution of the following uncontrolled linear system 0 1 1 ẋ = x, x(0) =. 2 3 1 Class test, August 1998 2. Given the linear system described by 2 α 1 1 ẋ = x +

More information

Stochastic Integration and Stochastic Differential Equations: a gentle introduction

Stochastic Integration and Stochastic Differential Equations: a gentle introduction Stochastic Integration and Stochastic Differential Equations: a gentle introduction Oleg Makhnin New Mexico Tech Dept. of Mathematics October 26, 27 Intro: why Stochastic? Brownian Motion/ Wiener process

More information

Introduction to asymptotic techniques for stochastic systems with multiple time-scales

Introduction to asymptotic techniques for stochastic systems with multiple time-scales Introduction to asymptotic techniques for stochastic systems with multiple time-scales Eric Vanden-Eijnden Courant Institute Motivating examples Consider the ODE {Ẋ = Y 3 + sin(πt) + cos( 2πt) X() = x

More information

Parameter Estimation

Parameter Estimation 1 / 44 Parameter Estimation Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay October 25, 2012 Motivation System Model used to Derive

More information

Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications

Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications Dongbin Xiu Department of Mathematics, Purdue University Support: AFOSR FA955-8-1-353 (Computational Math) SF CAREER DMS-64535

More information

The Rationale for Second Level Adaptation

The Rationale for Second Level Adaptation The Rationale for Second Level Adaptation Kumpati S. Narendra, Yu Wang and Wei Chen Center for Systems Science, Yale University arxiv:1510.04989v1 [cs.sy] 16 Oct 2015 Abstract Recently, a new approach

More information

Phase Model for the relaxed van der Pol oscillator and its application to synchronization analysis

Phase Model for the relaxed van der Pol oscillator and its application to synchronization analysis Phase Model for the relaxed van der Pol oscillator and its application to synchronization analysis Mimila Prost O. Collado J. Automatic Control Department, CINVESTAV IPN, A.P. 4 74 Mexico, D.F. ( e mail:

More information

Gaussian, Markov and stationary processes

Gaussian, Markov and stationary processes Gaussian, Markov and stationary processes Gonzalo Mateos Dept. of ECE and Goergen Institute for Data Science University of Rochester gmateosb@ece.rochester.edu http://www.ece.rochester.edu/~gmateosb/ November

More information

Quasi Stochastic Approximation American Control Conference San Francisco, June 2011

Quasi Stochastic Approximation American Control Conference San Francisco, June 2011 Quasi Stochastic Approximation American Control Conference San Francisco, June 2011 Sean P. Meyn Joint work with Darshan Shirodkar and Prashant Mehta Coordinated Science Laboratory and the Department of

More information

Stochastic Processes

Stochastic Processes Elements of Lecture II Hamid R. Rabiee with thanks to Ali Jalali Overview Reading Assignment Chapter 9 of textbook Further Resources MIT Open Course Ware S. Karlin and H. M. Taylor, A First Course in Stochastic

More information

Phase Response Curves, Delays and Synchronization in Matlab

Phase Response Curves, Delays and Synchronization in Matlab Phase Response Curves, Delays and Synchronization in Matlab W. Govaerts and B. Sautois Department of Applied Mathematics and Computer Science, Ghent University, Krijgslaan 281-S9, B-9000 Ghent, Belgium

More information

Analog Signals and Systems and their properties

Analog Signals and Systems and their properties Analog Signals and Systems and their properties Main Course Objective: Recall course objectives Understand the fundamentals of systems/signals interaction (know how systems can transform or filter signals)

More information

A NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1

A NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1 A NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1 Jinglin Zhou Hong Wang, Donghua Zhou Department of Automation, Tsinghua University, Beijing 100084, P. R. China Control Systems Centre,

More information

The multidimensional Ito Integral and the multidimensional Ito Formula. Eric Mu ller June 1, 2015 Seminar on Stochastic Geometry and its applications

The multidimensional Ito Integral and the multidimensional Ito Formula. Eric Mu ller June 1, 2015 Seminar on Stochastic Geometry and its applications The multidimensional Ito Integral and the multidimensional Ito Formula Eric Mu ller June 1, 215 Seminar on Stochastic Geometry and its applications page 2 Seminar on Stochastic Geometry and its applications

More information

DAMOCO: MATLAB toolbox for multivariate data analysis, based on coupled oscillators approach Version 1.0

DAMOCO: MATLAB toolbox for multivariate data analysis, based on coupled oscillators approach Version 1.0 DAMOCO: MATLAB toolbox for multivariate data analysis, based on coupled oscillators approach Version 1.0 Björn Kralemann 1, Michael Rosenblum 2, Arkady Pikovsky 2 1 Institut für Pädagogik, Christian-Albrechts-Universität

More information

Real-time Attitude Estimation Techniques Applied to a Four Rotor Helicopter

Real-time Attitude Estimation Techniques Applied to a Four Rotor Helicopter 43rd IEEE Conference on Decision and Control December 14-17, 4 Atlantis, Paradise Island, Bahamas ThC9.3 Real- Attitude Estimation Techniques Applied to a Four Rotor Helicopter Matthew G. Earl and Raffaello

More information

Nonlinear State Estimation! Extended Kalman Filters!

Nonlinear State Estimation! Extended Kalman Filters! Nonlinear State Estimation! Extended Kalman Filters! Robert Stengel! Optimal Control and Estimation, MAE 546! Princeton University, 2017!! Deformation of the probability distribution!! Neighboring-optimal

More information

Proceedings of Neural, Parallel, and Scientific Computations 4 (2010) xx-xx PHASE OSCILLATOR NETWORK WITH PIECEWISE-LINEAR DYNAMICS

Proceedings of Neural, Parallel, and Scientific Computations 4 (2010) xx-xx PHASE OSCILLATOR NETWORK WITH PIECEWISE-LINEAR DYNAMICS Proceedings of Neural, Parallel, and Scientific Computations 4 (2010) xx-xx PHASE OSCILLATOR NETWORK WITH PIECEWISE-LINEAR DYNAMICS WALTER GALL, YING ZHOU, AND JOSEPH SALISBURY Department of Mathematics

More information

1 Math 241A-B Homework Problem List for F2015 and W2016

1 Math 241A-B Homework Problem List for F2015 and W2016 1 Math 241A-B Homework Problem List for F2015 W2016 1.1 Homework 1. Due Wednesday, October 7, 2015 Notation 1.1 Let U be any set, g be a positive function on U, Y be a normed space. For any f : U Y let

More information

Bayesian Inference and the Symbolic Dynamics of Deterministic Chaos. Christopher C. Strelioff 1,2 Dr. James P. Crutchfield 2

Bayesian Inference and the Symbolic Dynamics of Deterministic Chaos. Christopher C. Strelioff 1,2 Dr. James P. Crutchfield 2 How Random Bayesian Inference and the Symbolic Dynamics of Deterministic Chaos Christopher C. Strelioff 1,2 Dr. James P. Crutchfield 2 1 Center for Complex Systems Research and Department of Physics University

More information

Nonlinear Observers. Jaime A. Moreno. Eléctrica y Computación Instituto de Ingeniería Universidad Nacional Autónoma de México

Nonlinear Observers. Jaime A. Moreno. Eléctrica y Computación Instituto de Ingeniería Universidad Nacional Autónoma de México Nonlinear Observers Jaime A. Moreno JMorenoP@ii.unam.mx Eléctrica y Computación Instituto de Ingeniería Universidad Nacional Autónoma de México XVI Congreso Latinoamericano de Control Automático October

More information

Optimal input design for nonlinear dynamical systems: a graph-theory approach

Optimal input design for nonlinear dynamical systems: a graph-theory approach Optimal input design for nonlinear dynamical systems: a graph-theory approach Patricio E. Valenzuela Department of Automatic Control and ACCESS Linnaeus Centre KTH Royal Institute of Technology, Stockholm,

More information

Data assimilation in high dimensions

Data assimilation in high dimensions Data assimilation in high dimensions David Kelly Kody Law Andy Majda Andrew Stuart Xin Tong Courant Institute New York University New York NY www.dtbkelly.com February 3, 2016 DPMMS, University of Cambridge

More information

Prediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother

Prediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother Prediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother Simo Särkkä, Aki Vehtari and Jouko Lampinen Helsinki University of Technology Department of Electrical and Communications

More information

SYSTEMTEORI - KALMAN FILTER VS LQ CONTROL

SYSTEMTEORI - KALMAN FILTER VS LQ CONTROL SYSTEMTEORI - KALMAN FILTER VS LQ CONTROL 1. Optimal regulator with noisy measurement Consider the following system: ẋ = Ax + Bu + w, x(0) = x 0 where w(t) is white noise with Ew(t) = 0, and x 0 is a stochastic

More information

A Concise Course on Stochastic Partial Differential Equations

A Concise Course on Stochastic Partial Differential Equations A Concise Course on Stochastic Partial Differential Equations Michael Röckner Reference: C. Prevot, M. Röckner: Springer LN in Math. 1905, Berlin (2007) And see the references therein for the original

More information

Bringing the Compass-Gait Bipedal Walker to Three Dimensions

Bringing the Compass-Gait Bipedal Walker to Three Dimensions October 14, 2009 IROS 2009, St. Louis, MO 1 1 Bringing the Compass-Gait Bipedal Walker to Three Dimensions Robert D. Gregg* and Mark W. Spong Coordinated Science Laboratory University of Illinois at Urbana-Champaign

More information

Stability of Stochastic Differential Equations

Stability of Stochastic Differential Equations Lyapunov stability theory for ODEs s Stability of Stochastic Differential Equations Part 1: Introduction Department of Mathematics and Statistics University of Strathclyde Glasgow, G1 1XH December 2010

More information

Intelligent Control. Module I- Neural Networks Lecture 7 Adaptive Learning Rate. Laxmidhar Behera

Intelligent Control. Module I- Neural Networks Lecture 7 Adaptive Learning Rate. Laxmidhar Behera Intelligent Control Module I- Neural Networks Lecture 7 Adaptive Learning Rate Laxmidhar Behera Department of Electrical Engineering Indian Institute of Technology, Kanpur Recurrent Networks p.1/40 Subjects

More information

Topic # /31 Feedback Control Systems. Analysis of Nonlinear Systems Lyapunov Stability Analysis

Topic # /31 Feedback Control Systems. Analysis of Nonlinear Systems Lyapunov Stability Analysis Topic # 16.30/31 Feedback Control Systems Analysis of Nonlinear Systems Lyapunov Stability Analysis Fall 010 16.30/31 Lyapunov Stability Analysis Very general method to prove (or disprove) stability of

More information

Spatial Statistics with Image Analysis. Lecture L08. Computer exercise 3. Lecture 8. Johan Lindström. November 25, 2016

Spatial Statistics with Image Analysis. Lecture L08. Computer exercise 3. Lecture 8. Johan Lindström. November 25, 2016 C3 Repetition Creating Q Spectral Non-grid Spatial Statistics with Image Analysis Lecture 8 Johan Lindström November 25, 216 Johan Lindström - johanl@maths.lth.se FMSN2/MASM25L8 1/39 Lecture L8 C3 Repetition

More information

Sequential Monte Carlo Methods for Bayesian Computation

Sequential Monte Carlo Methods for Bayesian Computation Sequential Monte Carlo Methods for Bayesian Computation A. Doucet Kyoto Sept. 2012 A. Doucet (MLSS Sept. 2012) Sept. 2012 1 / 136 Motivating Example 1: Generic Bayesian Model Let X be a vector parameter

More information

Stochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno

Stochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function.

More information

ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process

ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random

More information

Phase synchronization of an ensemble of weakly coupled oscillators: A paradigm of sensor fusion

Phase synchronization of an ensemble of weakly coupled oscillators: A paradigm of sensor fusion Phase synchronization of an ensemble of weakly coupled oscillators: A paradigm of sensor fusion Ariën J. van der Wal Netherlands Defence Academy (NLDA) 15 th ICCRTS Santa Monica, CA, June 22-24, 2010 Copyright

More information

Weakly interacting particle systems on graphs: from dense to sparse

Weakly interacting particle systems on graphs: from dense to sparse Weakly interacting particle systems on graphs: from dense to sparse Ruoyu Wu University of Michigan (Based on joint works with Daniel Lacker and Kavita Ramanan) USC Math Finance Colloquium October 29,

More information

ENGI Linear Approximation (2) Page Linear Approximation to a System of Non-Linear ODEs (2)

ENGI Linear Approximation (2) Page Linear Approximation to a System of Non-Linear ODEs (2) ENGI 940 4.06 - Linear Approximation () Page 4. 4.06 Linear Approximation to a System of Non-Linear ODEs () From sections 4.0 and 4.0, the non-linear system dx dy = x = P( x, y), = y = Q( x, y) () with

More information

Neuroscience applications: isochrons and isostables. Alexandre Mauroy (joint work with I. Mezic)

Neuroscience applications: isochrons and isostables. Alexandre Mauroy (joint work with I. Mezic) Neuroscience applications: isochrons and isostables Alexandre Mauroy (joint work with I. Mezic) Outline Isochrons and phase reduction of neurons Koopman operator and isochrons Isostables of excitable systems

More information

A variational radial basis function approximation for diffusion processes

A variational radial basis function approximation for diffusion processes A variational radial basis function approximation for diffusion processes Michail D. Vrettas, Dan Cornford and Yuan Shen Aston University - Neural Computing Research Group Aston Triangle, Birmingham B4

More information

Inferring biological dynamics Iterated filtering (IF)

Inferring biological dynamics Iterated filtering (IF) Inferring biological dynamics 101 3. Iterated filtering (IF) IF originated in 2006 [6]. For plug-and-play likelihood-based inference on POMP models, there are not many alternatives. Directly estimating

More information

Some asymptotic properties of solutions for Burgers equation in L p (R)

Some asymptotic properties of solutions for Burgers equation in L p (R) ARMA manuscript No. (will be inserted by the editor) Some asymptotic properties of solutions for Burgers equation in L p (R) PAULO R. ZINGANO Abstract We discuss time asymptotic properties of solutions

More information

Smoothers: Types and Benchmarks

Smoothers: Types and Benchmarks Smoothers: Types and Benchmarks Patrick N. Raanes Oxford University, NERSC 8th International EnKF Workshop May 27, 2013 Chris Farmer, Irene Moroz Laurent Bertino NERSC Geir Evensen Abstract Talk builds

More information

Poincaré Map, Floquet Theory, and Stability of Periodic Orbits

Poincaré Map, Floquet Theory, and Stability of Periodic Orbits Poincaré Map, Floquet Theory, and Stability of Periodic Orbits CDS140A Lecturer: W.S. Koon Fall, 2006 1 Poincaré Maps Definition (Poincaré Map): Consider ẋ = f(x) with periodic solution x(t). Construct

More information

Robust Control of Linear Quantum Systems

Robust Control of Linear Quantum Systems B. Ross Barmish Workshop 2009 1 Robust Control of Linear Quantum Systems Ian R. Petersen School of ITEE, University of New South Wales @ the Australian Defence Force Academy, Based on joint work with Matthew

More information

An Uncertain Control Model with Application to. Production-Inventory System

An Uncertain Control Model with Application to. Production-Inventory System An Uncertain Control Model with Application to Production-Inventory System Kai Yao 1, Zhongfeng Qin 2 1 Department of Mathematical Sciences, Tsinghua University, Beijing 100084, China 2 School of Economics

More information

The Phase Response Curve of Reciprocally Inhibitory Model Neurons Exhibiting Anti-Phase Rhythms

The Phase Response Curve of Reciprocally Inhibitory Model Neurons Exhibiting Anti-Phase Rhythms The Phase Response Curve of Reciprocally Inhibitory Model Neurons Exhibiting Anti-Phase Rhythms Jiawei Zhang Timothy J. Lewis Department of Mathematics, University of California, Davis Davis, CA 9566,

More information

Control, Stabilization and Numerics for Partial Differential Equations

Control, Stabilization and Numerics for Partial Differential Equations Paris-Sud, Orsay, December 06 Control, Stabilization and Numerics for Partial Differential Equations Enrique Zuazua Universidad Autónoma 28049 Madrid, Spain enrique.zuazua@uam.es http://www.uam.es/enrique.zuazua

More information

OPTIMAL PERTURBATION OF UNCERTAIN SYSTEMS

OPTIMAL PERTURBATION OF UNCERTAIN SYSTEMS Stochastics and Dynamics, Vol. 2, No. 3 (22 395 42 c World Scientific Publishing Company OPTIMAL PERTURBATION OF UNCERTAIN SYSTEMS Stoch. Dyn. 22.2:395-42. Downloaded from www.worldscientific.com by HARVARD

More information

Massachusetts Institute of Technology

Massachusetts Institute of Technology Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.11: Introduction to Communication, Control and Signal Processing QUIZ 1, March 16, 21 QUESTION BOOKLET

More information

Introduction to Biomedical Engineering

Introduction to Biomedical Engineering Introduction to Biomedical Engineering Biosignal processing Kung-Bin Sung 6/11/2007 1 Outline Chapter 10: Biosignal processing Characteristics of biosignals Frequency domain representation and analysis

More information

Gaussian processes. Chuong B. Do (updated by Honglak Lee) November 22, 2008

Gaussian processes. Chuong B. Do (updated by Honglak Lee) November 22, 2008 Gaussian processes Chuong B Do (updated by Honglak Lee) November 22, 2008 Many of the classical machine learning algorithms that we talked about during the first half of this course fit the following pattern:

More information

Dynamical Systems and Chaos Part II: Biology Applications. Lecture 10: Coupled Systems. Ilya Potapov Mathematics Department, TUT Room TD325

Dynamical Systems and Chaos Part II: Biology Applications. Lecture 10: Coupled Systems. Ilya Potapov Mathematics Department, TUT Room TD325 Dynamical Systems and Chaos Part II: Biology Applications Lecture 10: Coupled Systems. Ilya Potapov Mathematics Department, TUT Room TD325 Foreword In order to model populations of physical/biological

More information

ECONOMETRIC METHODS II: TIME SERIES LECTURE NOTES ON THE KALMAN FILTER. The Kalman Filter. We will be concerned with state space systems of the form

ECONOMETRIC METHODS II: TIME SERIES LECTURE NOTES ON THE KALMAN FILTER. The Kalman Filter. We will be concerned with state space systems of the form ECONOMETRIC METHODS II: TIME SERIES LECTURE NOTES ON THE KALMAN FILTER KRISTOFFER P. NIMARK The Kalman Filter We will be concerned with state space systems of the form X t = A t X t 1 + C t u t 0.1 Z t

More information

Internal and external synchronization of self-oscillating oscillators with non-identical control parameters

Internal and external synchronization of self-oscillating oscillators with non-identical control parameters Internal and external synchronization of self-oscillating oscillators with non-identical control parameters Emelianova Yu.P., Kuznetsov A.P. Department of Nonlinear Processes, Saratov State University,

More information

Nonlinear systems, chaos and control in Engineering

Nonlinear systems, chaos and control in Engineering Nonlinear systems, chaos and control in Engineering Module 1 block 3 One-dimensional nonlinear systems Cristina Masoller Cristina.masoller@upc.edu http://www.fisica.edu.uy/~cris/ Schedule Flows on the

More information

Development of novel deep brain stimulation techniques: Coordinated reset and Nonlinear delayed feedback

Development of novel deep brain stimulation techniques: Coordinated reset and Nonlinear delayed feedback Development of novel deep brain stimulation techniques: Coordinated reset and Nonlinear delayed feedback Oleksandr Popovych 1, Christian Hauptmann 1, Peter A. Tass 1,2 1 Institute of Medicine and Virtual

More information

Computer Intensive Methods in Mathematical Statistics

Computer Intensive Methods in Mathematical Statistics Computer Intensive Methods in Mathematical Statistics Department of mathematics johawes@kth.se Lecture 16 Advanced topics in computational statistics 18 May 2017 Computer Intensive Methods (1) Plan of

More information

Coupling in Networks of Neuronal Oscillators. Carter Johnson

Coupling in Networks of Neuronal Oscillators. Carter Johnson Coupling in Networks of Neuronal Oscillators Carter Johnson June 15, 2015 1 Introduction Oscillators are ubiquitous in nature. From the pacemaker cells that keep our hearts beating to the predator-prey

More information

Synchronization of a General Delayed Complex Dynamical Network via Adaptive Feedback

Synchronization of a General Delayed Complex Dynamical Network via Adaptive Feedback Synchronization of a General Delayed Complex Dynamical Network via Adaptive Feedback Qunjiao Zhang and Junan Lu College of Mathematics and Statistics State Key Laboratory of Software Engineering Wuhan

More information