Stability of Stochastic Differential Equations
|
|
- Alison Goodwin
- 5 years ago
- Views:
Transcription
1 Lyapunov stability theory for ODEs s Stability of Stochastic Differential Equations Part 1: Introduction Department of Mathematics and Statistics University of Strathclyde Glasgow, G1 1XH December 2010
2 Outline Lyapunov stability theory for ODEs s 1 Lyapunov stability theory for ODEs Concept of stability The Lyapunov method 2 s SDEs Definition of stochastic stability Diffusion operator
3 Outline Lyapunov stability theory for ODEs s 1 Lyapunov stability theory for ODEs Concept of stability The Lyapunov method 2 s SDEs Definition of stochastic stability Diffusion operator
4 Outline Lyapunov stability theory for ODEs s Concept of stability The Lyapunov method 1 Lyapunov stability theory for ODEs Concept of stability The Lyapunov method 2 s SDEs Definition of stochastic stability Diffusion operator
5 Lyapunov stability theory for ODEs s Concept of stability The Lyapunov method In 1892, A.M. Lyapunov introduced the concept of stability of a dynamic system. Roughly speaking, the stability means insensitivity of the state of the system to small changes in the initial state or the parameters of the system. For a stable system, the trajectories which are close" to each other at a specific instant should therefore remain close to each other at all subsequent instants.
6 Lyapunov stability theory for ODEs s Concept of stability The Lyapunov method In 1892, A.M. Lyapunov introduced the concept of stability of a dynamic system. Roughly speaking, the stability means insensitivity of the state of the system to small changes in the initial state or the parameters of the system. For a stable system, the trajectories which are close" to each other at a specific instant should therefore remain close to each other at all subsequent instants.
7 Lyapunov stability theory for ODEs s Concept of stability The Lyapunov method In 1892, A.M. Lyapunov introduced the concept of stability of a dynamic system. Roughly speaking, the stability means insensitivity of the state of the system to small changes in the initial state or the parameters of the system. For a stable system, the trajectories which are close" to each other at a specific instant should therefore remain close to each other at all subsequent instants.
8 Lyapunov stability theory for ODEs s Concept of stability The Lyapunov method Consider a d-dimensional ordinary differential equation (ODE) dx(t) dt = f (x(t), t) on t 0, where f = (f 1,, f d ) T : R d R + R d. Assume that for every initial value x(0) = x 0 R d, there exists a unique global solution which is denoted by x(t; x 0 ). Assume furthermore that f (0, t) = 0 for all t 0. So the ODE has the solution x(t) 0 corresponding to the initial value x(0) = 0. This solution is called the trivial solution or equilibrium position.
9 Lyapunov stability theory for ODEs s Concept of stability The Lyapunov method Definition The trivial solution is said to be stable if, for every ε > 0, there exists a δ = δ(ε) > 0 such that x(t; x 0 ) < ε for all t 0. whenever x 0 < δ. Otherwise, it is said to be unstable. The trivial solution is said to be asymptotically stable if it is stable and if there moreover exists a δ 0 > 0 such that whenever x 0 < δ 0. lim x(t; x 0) = 0 t
10 Lyapunov stability theory for ODEs s Concept of stability The Lyapunov method If the ODE can be solved explicitly, it would be rather easy to determine whether the trivial solution is stable or not. However, the ODE can only be solved explicitly in some special cases. Fortunately, Lyapunov in 1892 developed a method for determining stability without solving the equation. This method is now known as the method of Lyapunov functions or the Lyapunov method.
11 Lyapunov stability theory for ODEs s Concept of stability The Lyapunov method If the ODE can be solved explicitly, it would be rather easy to determine whether the trivial solution is stable or not. However, the ODE can only be solved explicitly in some special cases. Fortunately, Lyapunov in 1892 developed a method for determining stability without solving the equation. This method is now known as the method of Lyapunov functions or the Lyapunov method.
12 Outline Lyapunov stability theory for ODEs s Concept of stability The Lyapunov method 1 Lyapunov stability theory for ODEs Concept of stability The Lyapunov method 2 s SDEs Definition of stochastic stability Diffusion operator
13 Notation Lyapunov stability theory for ODEs s Concept of stability The Lyapunov method Let K denote the family of all continuous nondecreasing functions µ : R + R + such that µ(0) = 0 and µ(r) > 0 if r > 0. Let K denote the family of all functions µ K such that lim r µ(r) =. For h > 0, let S h = {x R d : x < h}. Let C 1,1 (S h R + ; R + ) denote the family of all continuous functions V (x, t) from S h R + to R + with continuous first partial derivatives with respect to every component of x and to t.
14 Lyapunov stability theory for ODEs s Concept of stability The Lyapunov method Basic ideas of the Lyapunov method Let x(t) be a solution of the ODE and V C 1,1 (S h R + ; R + ). Then v(t) = V (x(t), t) represents a function of t with the derivative dv(t) = dt V (x(t), t), where V (x, t) = V t (x, t) + (V x1 (x, t),, V xd (x, t))f (x, t). If dv(t)/dt 0, then v(t) will not increase so the distance of x(t) from the equilibrium point measured by V (x(t), t) does not increase. If dv(t)/dt < 0, then v(t) will decrease to zero so the distance will decrease to zero, that is x(t) 0.
15 Lyapunov stability theory for ODEs s Concept of stability The Lyapunov method Basic ideas of the Lyapunov method Let x(t) be a solution of the ODE and V C 1,1 (S h R + ; R + ). Then v(t) = V (x(t), t) represents a function of t with the derivative dv(t) = dt V (x(t), t), where V (x, t) = V t (x, t) + (V x1 (x, t),, V xd (x, t))f (x, t). If dv(t)/dt 0, then v(t) will not increase so the distance of x(t) from the equilibrium point measured by V (x(t), t) does not increase. If dv(t)/dt < 0, then v(t) will decrease to zero so the distance will decrease to zero, that is x(t) 0.
16 Lyapunov stability theory for ODEs s Concept of stability The Lyapunov method Theorem Assume that there exist V C 1,1 (S h R + ; R + ) and µ K such that V (0, t) = 0, µ( x ) V (x, t) and V (x, t) 0 for all (x, t) S h R +. Then the trivial solution of the ODE is stable.
17 Lyapunov stability theory for ODEs s Concept of stability The Lyapunov method Theorem Assume that there exist V C 1,1 (S h R + ; R + ) and µ 1, µ 2, µ 3 K such that µ 1 ( x ) V (x, t) µ 2 ( x ) and V (x, t) µ 3 ( x ) for all (x, t) S h R +. Then the trivial solution of the ODE is asymptotically stable.
18 Outline Lyapunov stability theory for ODEs s SDEs Definition of stochastic stability Diffusion operator 1 Lyapunov stability theory for ODEs Concept of stability The Lyapunov method 2 s SDEs Definition of stochastic stability Diffusion operator
19 Lyapunov stability theory for ODEs s SDEs Definition of stochastic stability Diffusion operator Consider a d-dimensional stochastic differential equation (SDE) dx(t) = f (x(t), t)dt + g(x(t), t)db(t) on t 0, where f : R d R + R d and g : R d R + R d m, and B(t) = (B 1 (t),, B m (t)) T is an m-dimensional Brownian motion. As a standing hypothesis in this course, we assume that both f and g obey the local Lipschitz condition and the linear growth condition. Hence, for any given initial value x(0) = x 0 R d, the SDE has a unique global solution denoted by x(t; x 0 ). Assume furthermore that f (0, t) = 0 and g(0, t) = 0 for all t 0. Hence the SDE admits the trivial solution x(t; 0) 0.
20 Lyapunov stability theory for ODEs s SDEs Definition of stochastic stability Diffusion operator When we try to carry over the principles of the Lyapunov stability theory to to SDEs, we face the following problems: What is a suitable definition of stochastic stability? With what should the derivative dv(t)/dt or V (x, t) be replaced? What conditions should a stochastic Lyapunov function satisfy?
21 Lyapunov stability theory for ODEs s SDEs Definition of stochastic stability Diffusion operator When we try to carry over the principles of the Lyapunov stability theory to to SDEs, we face the following problems: What is a suitable definition of stochastic stability? With what should the derivative dv(t)/dt or V (x, t) be replaced? What conditions should a stochastic Lyapunov function satisfy?
22 Lyapunov stability theory for ODEs s SDEs Definition of stochastic stability Diffusion operator When we try to carry over the principles of the Lyapunov stability theory to to SDEs, we face the following problems: What is a suitable definition of stochastic stability? With what should the derivative dv(t)/dt or V (x, t) be replaced? What conditions should a stochastic Lyapunov function satisfy?
23 Outline Lyapunov stability theory for ODEs s SDEs Definition of stochastic stability Diffusion operator 1 Lyapunov stability theory for ODEs Concept of stability The Lyapunov method 2 s SDEs Definition of stochastic stability Diffusion operator
24 Lyapunov stability theory for ODEs s SDEs Definition of stochastic stability Diffusion operator It turns out that there are various different types of stochastic stability. In this course, we will only concentrate on stability in probability; pth moment exponential stability; almost sure exponential stability.
25 Lyapunov stability theory for ODEs s SDEs Definition of stochastic stability Diffusion operator It turns out that there are various different types of stochastic stability. In this course, we will only concentrate on stability in probability; pth moment exponential stability; almost sure exponential stability.
26 Lyapunov stability theory for ODEs s SDEs Definition of stochastic stability Diffusion operator It turns out that there are various different types of stochastic stability. In this course, we will only concentrate on stability in probability; pth moment exponential stability; almost sure exponential stability.
27 Lyapunov stability theory for ODEs s SDEs Definition of stochastic stability Diffusion operator Definition The trivial solution of the SDE is said to be stochastically stable or stable in probability if for every pair of ε (0, 1) and r > 0, there exists a δ = δ(ε, r) > 0 such that P{ x(t; x 0 ) < r for all t 0} 1 ε whenever x 0 < δ. Otherwise, it is said to be stochastically unstable.
28 Lyapunov stability theory for ODEs s SDEs Definition of stochastic stability Diffusion operator Definition The trivial solution is said to be stochastically asymptotically stable if it is stochastically stable and, moreover, for every ε (0, 1), there exists a δ 0 = δ 0 (ε) > 0 such that whenever x 0 < δ 0. P{ lim t x(t; x 0 ) = 0} 1 ε
29 Lyapunov stability theory for ODEs s SDEs Definition of stochastic stability Diffusion operator Definition The trivial solution is said to be stochastically asymptotically stable in the large if it is stochastically stable and, moreover, for all x 0 R d P{ lim t x(t; x 0 ) = 0} = 1.
30 Lyapunov stability theory for ODEs s SDEs Definition of stochastic stability Diffusion operator Definition The trivial solution is said to be almost surely exponentially stable if for all x 0 R d lim sup t 1 t log( x(t; x 0) ) < 0 a.s. It is said to be pth moment exponentially stable if for all x 0 R d lim sup t 1 t log(e x(t; x 0) p ) < 0.
31 Outline Lyapunov stability theory for ODEs s SDEs Definition of stochastic stability Diffusion operator 1 Lyapunov stability theory for ODEs Concept of stability The Lyapunov method 2 s SDEs Definition of stochastic stability Diffusion operator
32 Lyapunov stability theory for ODEs s SDEs Definition of stochastic stability Diffusion operator To figure out with what the derivative dv(t)/dt or V (x, t) should be replaced, we naturally consider the Itô differential of the process V (x(t), t), where x(t) is a solution of the SDE and V is a Lyapunov function. According to the Itô formula, we of course require V C 2,1 (S h R + ; R + ), which denotes the family of all nonnegative functions V (x, t) defined on S h R + such that they are continuously twice differentiable in x and once in t.
33 Lyapunov stability theory for ODEs s SDEs Definition of stochastic stability Diffusion operator By the Itô formula, we have dv (x(t), t) = LV (x(t), t)dt + V x (x(t), t)g(x(t), t)db(t), where LV (x, t) = V t (x, t)+v x (x, t)f (x, t)+ 1 ] [g 2 trace T (x, t)v xx (x, t)g(x, t), in which V x = (V x1,, V xd ) and V xx = (V xi x j ) d d.
34 Lyapunov stability theory for ODEs s SDEs Definition of stochastic stability Diffusion operator We shall see that V (x, t) will be replaced by the diffusion operator LV (x, t) in the study of stochastic stability. For example, the inequality V (x, t) 0 will sometimes be replaced by LV (x, t) 0 to get the stochastic stability. However, it is not necessary to require LV (x, t) 0 to get other stabilities e.g. almost sure exponential stability. The study of stochastic stability is therefore much richer than the classical stability of ODEs. Let us begin to explore this wonderful world of stochastic stability.
35 Theory Examples Stability of Stochastic Differential Equations Part 2: Stability in Probability Department of Mathematics and Statistics University of Strathclyde Glasgow, G1 1XH December 2010
36 Outline Theory Examples 1 Theory Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large 2 Examples Scale SDEs Multi-dimensional SDEs
37 Outline Theory Examples 1 Theory Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large 2 Examples Scale SDEs Multi-dimensional SDEs
38 Theory Examples Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large In this part, we shall see how the classical Lyapunov method is developed to study stochastic stability in such a similar way that the results in this part are natural generalizations of the Lyapunov stability theory for ODEs. Of course, such results may not be surprising but we will see some surprising results in the next part.
39 Outline Theory Examples Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large 1 Theory Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large 2 Examples Scale SDEs Multi-dimensional SDEs
40 Theory Examples Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large Theorem Assume that there exist V C 2,1 (S h R + ; R + ) and µ K such that V (0, t) = 0, µ( x ) V (x, t) and LV (x, t) 0 for all (x, t) S h R +. Then the trivial solution of the SDE is stochastically stable.
41 Theory Examples Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large Proof. Let ε (0, 1) and r (0, h) be arbitrary. Clearly, we can find a δ = δ(ε, r) (0, r) such that 1 ε sup x S δ V (x, 0) µ(r). Now fix any x 0 S δ and write x(t; x 0 ) = x(t) simply. Define τ = inf{t 0 : x(t) S r }. (Throughout this course we set inf =.) By Itô s formula, for any t 0, τ t V (x(τ t), τ t) = V (x 0, 0) + LV (x(s), s)ds + τ t 0 0 V x (x(s), s)g(x(s), s)db(s).
42 Theory Examples Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large Taking the expectation on both sides, we obtain EV (x(τ t), τ t) = V (x 0, 0)+E τ t 0 LV (x(s), s)ds V (x 0, 0). Noting that x(τ t) = x(τ) = r if τ t, we get [ ] EV (x(τ t), τ t) E I {τ t} V (x(τ), τ) µ(r)p{τ t}. (Throughout this course I A denotes the indicator function of set A.) We therefore obtain P{τ t} ε. Letting t we get P{τ < } ε, that is as required. P{ x(t) < r for all t 0} 1 ε
43 Outline Theory Examples Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large 1 Theory Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large 2 Examples Scale SDEs Multi-dimensional SDEs
44 Theory Examples Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large Theorem Assume that there exist V C 2,1 (S h R + ; R + ) and µ 1, µ 2, µ 3 K such that and µ 1 ( x ) V (x, t) µ 2 ( x ) LV (x, t) µ 3 ( x ) for all (x, t) S h R +. Then the trivial solution of the SDE is stochastically asymptotically stable.
45 Theory Examples Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large Proof. We know from the previous theorem that the trivial solution is stochastically stable. So we only need to show that for any ε (0, 1), there is a δ 0 = δ 0 (ε) > 0 such that P{ lim t x(t; x 0 ) = 0} 1 ε whenever x 0 < δ 0, or for any β (0, h/2), P{lim sup x(t; x 0 ) β} 1 ε. t By the previous theorem, we can find a δ 0 = δ 0 (ε) (0, h/2) such that P{ x(t; x 0 ) < h/2} 1 ε 2. (1.1) whenever x 0 S δ0.
46 Theory Examples Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large Moreover, in the same way as the previous theorem was proved, we can show that for any β (0, h/2), there is a α (0, β) such that P{ x(t; x 0 ) < β for all t s} 1 ε 2 (1.2) whenever x(s; x 0 ) α and s 0. Now fix any x 0 S δ and write x(t; x 0 ) = x(t) simply. Define τ α = inf{t 0 : x(t) α} and τ h = inf{t 0 : x(t) h/2}.
47 Theory Examples Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large By Itô s formula and the conditions, we can show that Consequently 0 V (x 0, 0) + E τα τ h t 0 LV (x(s), s)ds V (x 0, 0) µ 3 (α)e(τ α τ h t). tµ 3 (α)p{τ α τ h t} E(τ α τ h t) V (x 0, 0). This implies immediately that P{τ α τ h < } = 1. But, by (1.1), P{τ h < } ε/2. Hence
48 Theory Examples Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large 1 = P{τ α τ h < } P{τ α < }+P{τ h < } P{τ α < }+ ε 2, which yields P{τ α < } 1 ε 2. We now compute, using (1.2), P{lim sup x(t) β} t P{τ α < and x(t) β for all t τ α } = P{τ α < }P{ x(t) β for all t τ α τ α < } as required. P{τ α < }(1 ε/2) (1 ε/2) 2 1 ε
49 Outline Theory Examples Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large 1 Theory Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large 2 Examples Scale SDEs Multi-dimensional SDEs
50 Theory Examples Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large Theorem Assume that there exist V C 2,1 (R d R + ; R + ) and µ 1, µ 2 K and µ 3 K such that and µ 1 ( x ) V (x, t) µ 2 ( x ) LV (x, t) µ 3 ( x ) for all (x, t) R d R +. Then the trivial solution of the SDE is stochastically asymptotically stable in the large.
51 Theory Examples Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large Proof. Clearly, we only need to show P{ lim t x(t; x 0 ) = 0} = 1 for all x 0 R d, or for any pair of ε (0, 1) and β > 0, P{lim sup x(t; x 0 ) β} 1 ε. t To show this, let us fix any x 0 and write x(t; x 0 ) = x(t) again. Let h sufficiently large for h/2 > x 0 and µ 1 (h/2) 2V (x 0, 0). ε As in the previous proof, define the stopping time τ h = inf{t 0 : x(t) h/2}.
52 Theory Examples Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large By Itô s formula, we can show that for any t 0, But EV (x(τ h t), τ h t) V (x 0, 0). EV (x(τ h t), τ h t) µ 1 (h/2)p{τ h t}. Hence P{τ h t} ε 2. Letting t gives P{τ h < } ε/2. That is P{ x(t) < h/2 for all t 0} 1 ε 2, which is the same as (1.1). From here, we can show in the same way as in the previous proof that as desired. P{lim sup x(t) β} 1 ε t
53 Outline Theory Examples Scale SDEs Multi-dimensional SDEs 1 Theory Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large 2 Examples Scale SDEs Multi-dimensional SDEs
54 Theory Examples Scale SDEs Multi-dimensional SDEs Consider a scale SDE dx(t) = f (x(t), t)dt + g(x(t), t)db(t) on t 0 with initial value x(0) = x 0 R. Assume that f : R R + R and g : R R + R m have the expansions f (x, t) = a(t)x+o( x ), g(x, t) = (b 1 (t)x,, b m (t)x) T +o( x ). in a neighbourhood of x = 0 uniformly with respect to t 0, where a(t), b i (t) are all bounded Borel-measurable real-valued functions. We impose a condition that there is a pair of positive constants θ and K such that K t 0 ( a(s) 1 2 m bi )ds 2 (s) + θ K for all t 0. i=1
55 Theory Examples Scale SDEs Multi-dimensional SDEs Let 0 < ε < and define the Lyapunov function θ sup t 0 m i=1 b2 i (t) [ t ( V (x, t) = x ε exp ε a(s) Then, by the condition, m i=1 x ε e εk V (x, t) x ε e εk. ] bi )ds 2 (s) + θ.
56 Theory Examples Scale SDEs Multi-dimensional SDEs Moreover, compute [ LV (x, t) = ε x ε exp ε ( ε 2 t 0 ( a(s) 1 2 m i=1 m ) bi 2 (t) θ + o( x ε ) i=1 1 2 εθe εk x ε + o( x ε ). ] bi )ds 2 (s) + θ We hence see that LV (x, t) is negative-definite in a sufficiently small neighbourhood of x = 0 for t 0. We can therefore conclude that the trivial solution of the scale SDE is stochastically asymptotically stable.
57 Outline Theory Examples Scale SDEs Multi-dimensional SDEs 1 Theory Stochastic stability Stochastic asymptotic stability Stochastic asymptotic stability in the large 2 Examples Scale SDEs Multi-dimensional SDEs
58 Theory Examples Scale SDEs Multi-dimensional SDEs Assume that the coefficients f and g of the underlying SDE have the expansions f (x, t) = F(t)x +o( x ), g(x, t) = (G 1 (t)x,, G m (t)x)+o( x ) in a neighbourhood of x = 0 uniformly with respect to t 0, where F(t), G i (t) are all bounded Borel-measurable d d-matrix-valued functions. Assume that there is a symmetric positive-definite matrix Q such that λ max (QF(t) + F T (t)q + m i=1 ) Gi T (t)qg i (t) λ < 0 for all t 0, where (and throughout this course) λ max (A) denotes the largest eigenvalue of matrix A.
59 Theory Examples Scale SDEs Multi-dimensional SDEs Now, define the Lyapunov function V (x, t) = x T Qx. Clearly, Moreover, λ min (Q) x 2 V (x, t) λ max (Q) x 2. LV (x, t) = x T ( QF (t) + F T (t)q + λ x 2 + o( x 2 ). m i=1 ) Gi T (t)qg i (t) x + o( x 2 ) Hence LV (x, t) is negative-definite in a sufficiently small neighbourhood of x = 0 for t 0. We therefore conclude that the trivial solution of the SDE is stochastically asymptotically stable.
60 Theory Examples Stability of Stochastic Differential Equations Part 3: Almost Sure Exponential Stability Department of Mathematics and Statistics University of Strathclyde Glasgow, G1 1XH December 2010
61 Outline Theory Examples 1 Theory Almost sure exponential stability Almost sure exponential instability 2 Examples Linear SDEs Nonlinear case
62 Outline Theory Examples 1 Theory Almost sure exponential stability Almost sure exponential instability 2 Examples Linear SDEs Nonlinear case
63 Theory Examples Almost sure exponential stability Almost sure exponential instability In this part, we shall develop the classical Lyapunov method to study the almost sure exponential stability. In contrast to the classical Lyapunov stability theory, we will no longer require LV (x, t) be negative-definite but we still obtain the almost sure exponential stability making full use of the diffusion (noise) terms. It is this new feature that makes the stochastic stability more interesting and more useful as well.
64 Theory Examples Almost sure exponential stability Almost sure exponential instability To establish the theory on the almost sure exponential stability, we need prepare an important lemma. Recall that we assume, throughout this course, that both coefficients f and g obey the local Lipschitz condition and the linear growth condition and, moreover, f (0, t) 0, g(0, t) 0. Under these standing hypotheses, we have the following useful lemma. Lemma For all x 0 0 in R d P{x(t; x 0 ) 0 for all t 0} = 1. That is, almost all the sample path of any solution starting from a non-zero state will never reach the origin with probability 1.
65 Theory Examples Almost sure exponential stability Almost sure exponential instability Proof. If the lemma were false, there would exist some x 0 0 such that P{τ < } > 0, where τ = inf{t 0 : x(t) = 0} in which we write x(t; x 0 ) = x(t) simply. So we can find a pair of constants T > 0 and θ > 1 sufficiently large for P(B) > 0, where B = {τ T and x(t) θ 1 for all 0 t τ}. But, by the standing hypotheses, there exists a positive constant K θ such that f (x, t) g(x, t) K θ x for all x θ, 0 t T.
66 Theory Examples Almost sure exponential stability Almost sure exponential instability Let V (x, t) = x 1. Then, for 0 < x θ and 0 t T, LV (x, t) = x 3 x T f (x, t) + 1 ( x 3 g(x, t) x 5 x T g(x, t) 2) 2 x 2 f (x, t) + x 3 g(x, t) 2 K θ x 1 + Kθ 2 x 1 = K θ (1 + K θ )V (x, t). Now, for any ε (0, x 0 ), define the stopping time τ ε = inf{t 0 : x(t) (ε, θ)}. By Itô s formula,
67 Theory Examples Almost sure exponential stability Almost sure exponential instability = E 0. [ ] E e K θ(1+k θ )(τ ε T ) V (x(τ ε T ), τ ε T ) τε T 0 V (x 0, 0) [ ] e K θ(1+k θ )s (K θ (1 + K θ ))V (x(s), s) + LV (x(s), s) ds Note that for ω B, τ ε T and x(τ ε ) = ε. The above inequality therefore implies that ] E [e K θ(1+k θ )T ε 1 I B x 0 1. Hence P(B) ε x 0 1 e K θ(1+k θ )T. Letting ε 0 yields that P(B) = 0, but this contradicts the definition of B. The proof is complete.
68 Theory Examples Almost sure exponential stability Almost sure exponential instability We will also need the well-known exponential martingale inequality which we state here as a lemma. Lemma Let g = (g 1,, g m ) L 2 (R + ; R 1 m ), and let T, α, β be any positive numbers. Then { [ t P sup g(s)db(s) α t ] } g(s) 2 ds > β e αβ. 0 t T 0 2 0
69 Outline Theory Examples Almost sure exponential stability Almost sure exponential instability 1 Theory Almost sure exponential stability Almost sure exponential instability 2 Examples Linear SDEs Nonlinear case
70 Theory Examples Almost sure exponential stability Almost sure exponential instability Theorem Assume that there exists a function V C 2,1 (R d R + ; R + ), and constants p > 0, c 1 > 0, c 2 R, c 3 0, such that for all x 0 and t 0, Then lim sup t c 1 x p V (x, t), LV (x, t) c 2 V (x, t), V x (x, t)g(x, t) 2 c 3 V 2 (x, t). 1 t log x(t; x 0) c 3 2c 2 2p a.s. (1.1) for all x 0 R d. In particular, if c 3 > 2c 2, then the trivial solution of the SDE is almost surely exponentially stable.
71 Theory Examples Almost sure exponential stability Almost sure exponential instability Proof. Clearly, the assertion holds for x 0 = 0 since x(t; 0) 0. Fix any x 0 0 and write x(t; x 0 ) = x(t). By the lemma, x(t) 0 for all t 0 almost surely. Thus, one can apply Itô s formula and the condition to show that, for t 0, where log V (x(t), t) log V (x 0, 0) + c 2 t + M(t) M(t) = 1 2 t 0 t 0 V x (x(s), s)g(x(s), s) 2 V 2 ds, (1.2) (x(s), s) V x (x(s), s)g(x(s), s) db(s) V (x(s), s) is a continuous martingale with initial value M(0) = 0. Assign ε (0, 1) arbitrarily and let n = 1, 2,. By the exponential martingale inequality,
72 Theory Examples Almost sure exponential stability Almost sure exponential instability { [ P sup M(t) ε t 0 t n 2 0 V x (x(s), s)g(x(s), s) 2 V 2 (x(s), s) ] ds > 2ε } log n 1 n 2. Applying the Borel Cantelli lemma we see that for almost all ω Ω, there is an integer n 0 = n 0 (ω) such that if n n 0, M(t) 2 ε log n + ε 2 t 0 V x (x(s), s)g(x(s), s) 2 V 2 ds (x(s), s) holds for all 0 t n. Substituting this into (1.2) and then using the condition we obtain that log V (x(t), t) log V (x 0, 0) 1 2 [(1 ε)c 3 2c 2 ]t + 2 ε log n for all 0 t n, n n 0 almost surely.
73 Theory Examples Almost sure exponential stability Almost sure exponential instability Consequently, for almost all ω Ω, if n 1 t n and n n 0, 1 t log V (x(t), t) 1 2 [(1 ε)c 3 2c 2 ] + log V (x 0, 0) + 2 ε log n. n 1 This implies lim sup t 1 t log V (x(t), t) 1 2 [(1 ε)c 3 2c 2 ] a.s. Hence lim sup t 1 t log x(t) (1 ε)c 3 2c 2 2p a.s. and the required assertion follows since ε > 0 is arbitrary.
74 Outline Theory Examples Almost sure exponential stability Almost sure exponential instability 1 Theory Almost sure exponential stability Almost sure exponential instability 2 Examples Linear SDEs Nonlinear case
75 Theory Examples Almost sure exponential stability Almost sure exponential instability Theorem Assume that there exists a function V C 2,1 (R d R + ; R + ), and constants p > 0, c 1 > 0, c 2 R, c 3 > 0, such that for all x 0 and t 0, Then c 1 x p V (x, t) > 0, LV (x, t) c 2 V (x, t), V x (x, t)g(x, t) 2 c 3 V 2 (x, t). lim inf t 1 t log x(t; x 0) 2c 2 c 3 2p a.s. for all x 0 0 in R d. In particular, if 2c 2 > c 3, then almost all the sample paths of x(t; x 0 ) will tend to infinity exponentially.
76 Theory Examples Almost sure exponential stability Almost sure exponential instability Proof. Fix any x 0 0 and write x(t; x 0 ) = x(t). By Itô s formula and the conditions, we can easily show that for t 0, where log V (x(t), t) log V (x 0, 0) (2c 2 c 3 )t + M(t), (1.3) M(t) = t 0 V x (x(s), s)g(x(s), s) db(s) V (x(s), s) is a continuous martingale with the quadratic variation M(t), M(t) = t 0 V x (x(s), s)g(x(s), s) 2 V 2 ds c 3 t. (x(s), s)
77 Theory Examples Almost sure exponential stability Almost sure exponential instability By the strong law of large numbers for the martingales, M(t) lim = 0 a.s. t t It therefore follows from (1.3) that lim inf t 1 t log V (x(t), t) 1 2 (2c 2 c 3 ) a.s. which implies the required assertion immediately by using the condition.
78 Outline Theory Examples Linear SDEs Nonlinear case 1 Theory Almost sure exponential stability Almost sure exponential instability 2 Examples Linear SDEs Nonlinear case
79 Theory Examples Linear SDEs Nonlinear case Consider the scalar linear SDE dx(t) = ax(t) + m b i x(t)db i (t) on t 0. i=1 It is known that it has the explicit solution ( x(t) = x 0 exp [a 0.5 This implies that, for x 0 0, m m bi 2 ]t + i=1 i=1 ) b i B i (t). 1 m lim t t log x(t) = a 0.5 i=1 b 2 i a.s.
80 Theory Examples Linear SDEs Nonlinear case Let us now apply the stability theorem to obtain the same conclusion. Let V (x, t) = x 2. Then LV (x, t) = ( 2a + m i=1 and, writing g(x, t) = (b 1 x,, b m x), V x (x, t)g(x, t) 2 = 4 b 2 i ) x 2 m bi 2 x 4. In other words, the conditions in the Theorems holds with p = 2, c 1 = 1, c 2 = 2a + i=1 i=1 m m bi 2, c 3 = 4 bi 2. i=1
81 Theory Examples Linear SDEs Nonlinear case We hence have and lim sup t lim inf t 1 t log x(t) a t log x(t) a 1 2 Combining these gives what we want. m i=1 m i=1 b 2 i b 2 i a.s. a.s.
82 Theory Examples Linear SDEs Nonlinear case Consider, for example, dx(t) = x(t)dt + 2x(t)dB(t) with initial value x(0) = x 0 0, where B(t) is a one-dimensional Brownian motion. The theory above shows that the solution of this linear sde obeys lim inf t 1 t log x(t) = 1 a.s. The following simulation shows a typical sample path of the solution with initial value x(0) = 10.
83 Theory Examples Linear SDEs Nonlinear case x(t) t
84 Outline Theory Examples Linear SDEs Nonlinear case 1 Theory Almost sure exponential stability Almost sure exponential instability 2 Examples Linear SDEs Nonlinear case
85 Theory Examples Linear SDEs Nonlinear case Consider the two-dimensional SDE dx(t) = f (x(t))dt + Gx(t)dB(t) on t 0 with initial value x(0) = x 0 R 2 and x 0 0, where B(t) is a one-dimensional Brownian motion, ( ) ( ) x2 cos x f (x) = , G = 2x 1 sin x
86 Theory Examples Linear SDEs Nonlinear case Let V (x, t) = x 2. It is easy to verify that 4.29 x 2 LV (x, t) = 2x 1 x 2 cos x 1 +4x 1 x 2 sin x 2 + Gx x 2 and x 2 V x (x, t)gx 2 = 2x T Gx x 4. Applying the Theorems we then have lim inf t 1 t log x(t; x 1 0) lim sup t t log x(t; x 0) almost surely. The following figure is a compute simulation.
87 Theory Examples Linear SDEs Nonlinear case X1(t) X2(t) t t x 1 (0) = x 2 (0) = 1.
88 Moment verse Almost Sure Exponential Stability Criteria A Case Study Stability of Stochastic Differential Equations Part 4: Moment Exponential Stability Department of Mathematics and Statistics University of Strathclyde Glasgow, G1 1XH December 2010
89 Moment verse Almost Sure Exponential Stability Criteria A Case Study Outline 1 Moment verse Almost Sure Exponential Stability 2 Criteria Nonlinear case Linear case 3 A Case Study
90 Moment verse Almost Sure Exponential Stability Criteria A Case Study Outline 1 Moment verse Almost Sure Exponential Stability 2 Criteria Nonlinear case Linear case 3 A Case Study
91 Moment verse Almost Sure Exponential Stability Criteria A Case Study Outline 1 Moment verse Almost Sure Exponential Stability 2 Criteria Nonlinear case Linear case 3 A Case Study
92 Moment verse Almost Sure Exponential Stability Criteria A Case Study Generally speaking, the pth moment exponential stability and the almost sure exponential stability do not imply each other and additional conditions are required in order to deduce one from the other. The following theorem gives the conditions under which the pth moment exponential stability implies the almost sure exponential stability. However we still do not know under what conditions the almost sure exponential stability implies the pth moment exponential stability.
93 Moment verse Almost Sure Exponential Stability Criteria A Case Study Theorem Assume that there is a positive constant K such that x T f (x, t) g(x, t) 2 K x 2 for all (x, t) R d R +. Then the pth moment exponential stability of the trivial solution of the SDE implies the almost sure exponential stability.
94 Moment verse Almost Sure Exponential Stability Criteria A Case Study To prove this theorem we need the Burkholder Davis Gundy inequality which we cite as a lemma. Lemma Let g L 2 (R + ; R d m ). Define, for t 0, x(t) = t 0 g(s)db(s) and A(t) = t 0 g(s) 2 ds. Then for every p > 0, there exist universal positive constants c p, C p (depending only on p), such that ( c p E A(t) p 2 E sup x(s) p) C p E A(t) p 2. 0 s t
95 Moment verse Almost Sure Exponential Stability Criteria A Case Study In particular, one may take c p = (p/2) p, C p = (32/p) p/2 if 0 < p < 2; c p = 1, C p = 4 if p = 2; c p = (2p) p/2, C p = [ p p+1 /2(p 1) p 1] p/2 if p > 2.
96 Moment verse Almost Sure Exponential Stability Criteria A Case Study Proof of the theorem. Fix any x 0 0 in R d and write x(t; x 0 ) = x(t) simply. By the definition of the pth moment exponential stability, there is a pair of positive constants and C such that E x(t) p Ce λt on t 0. Let n = 1, 2,. By Itô s formula and the condition, one can show that for n 1 t n, x(t) p x(n 1) p + c 1 t + t n 1 n 1 x(s) p ds p x(s) p 2 x T (s)g(x(s), s)db(s), where c 1 = pk + p(1 + p 2 )K /2. Hence
97 Moment verse Almost Sure Exponential Stability Criteria A Case Study ( E sup n 1 t n ( +E x(t) p) E x(n 1) p + c 1 n sup n 1 t n t n 1 n 1 E x(s) p ds ) p x(s) p 2 x T (s)g(x(s), s)db(s). On the other hand, by the well-known Burkholder Davis Gundy inequality we compute
98 Moment verse Almost Sure Exponential Stability Criteria A Case Study ( E sup n 1 t n 4 ( n 2E 4 ( 2E 1 2 E ( t n 1 ) p x(s) p 2 x T (s)g(x(s), s)db(s) p 2 x(s) 2(p 2) x T (s)g(x(s), s) 2 ds n 1 n sup x(s) p p 2 K x(s) p ds n 1 s n n 1 sup n 1 s n x(s) p) + 16p 2 K n n 1 Substituting this into the previous inequality yields ) 1 2 E x(s) p ds. ) 1 2
99 Moment verse Almost Sure Exponential Stability Criteria A Case Study ( E sup n 1 t n x(t) p) 2E x(n 1) p + c 2 n n 1 E x(s) p ds, where c 2 = 2c p 2 K. By the property of the pth moment exponential stability, we then have ( E x(t) p) c 3 e λ(n 1), sup n 1 t n where c 3 = C(2 + c 2 ). Now, let ε (0, λ) be arbitrary. Then { P x(t) p > e (λ ε)(n 1)} c 3 e ε(n 1). sup n 1 t n
100 Moment verse Almost Sure Exponential Stability Criteria A Case Study In view of the Borel Cantelli lemma we see that for almost all ω Ω, sup x(t) p e (λ ε)(n 1) n 1 t n holds for all but finitely many n. Hence, there exists an n 0 = n 0 (ω), for all ω Ω excluding a P-null set, for which the inequality above holds whenever n n 0. Consequently, for almost all ω Ω, 1 t log x(t) = 1 (λ ε)(n 1) pt log( x(t) p ) pn if n 1 t n, n n 0.
101 Moment verse Almost Sure Exponential Stability Criteria A Case Study Hence lim sup t 1 t log x(t) (λ ε) p Since ε > 0 is arbitrary, we must have a.s. lim sup t 1 t log x(t) λ p a.s. By definition, the trivial solution of the SDE is almost surely exponentially stable.
102 Outline Moment verse Almost Sure Exponential Stability Criteria A Case Study Nonlinear case Linear case 1 Moment verse Almost Sure Exponential Stability 2 Criteria Nonlinear case Linear case 3 A Case Study
103 Moment verse Almost Sure Exponential Stability Criteria A Case Study Nonlinear case Linear case Theorem Assume that there is a function V ( C 2,1 (R d R + ; R + ), and positive constants c 1 c 3, such that c 1 x p V (x, t) c 2 x p and LV (x, t) c 3 V (x, t) for all (x, t) R d R +. Then E x(t; x 0 ) p c 2 c 1 x 0 p e c 3t on t 0 for all x 0 R d.
104 Moment verse Almost Sure Exponential Stability Criteria A Case Study Nonlinear case Linear case Proof. Fix any x 0 R d and write x(t; x 0 ) = x(t). For each n x 0, define the stopping time τ n = inf{t 0 : x(t) n}. Obviously, τ n as n almost surely. By Itô s formula, we can derive that for t 0, [ ] E e c 3(t τ n) V (x(t τ n ), t τ n ) V (x 0, 0) = E t τn 0 e c 3s [ c 3 V (x(s), s) + LV (x(s), s) ] ds 0
105 Moment verse Almost Sure Exponential Stability Criteria A Case Study Nonlinear case Linear case Hence [ c 1 E e c 3(t τ n) E x(t τ n ) p] V (x 0, 0) c 2 x 0 p. Letting n yields that c 1 e c 3t E x(t) p c 2 x 0 p which implies the desired assertion.
106 Moment verse Almost Sure Exponential Stability Criteria A Case Study Nonlinear case Linear case Theorem Assume that there exists a symmetric positive-definite d d matrix Q, and constants α 1 R, 0 α 2 < α 3, such that for all (x, t) R d R +, and x T Qf (x, t) trace[gt (x, t)qg(x, t)] α 1 x T Qx α 2 x T Qx x T Qg(x, t) α 3 x T Qx. (i) If α 1 < 0, then the trivial solution of the SDE is pth moment exponentially stable provided p < α 1 /α3 2. (ii) If 0 α 1 < α2 2, then the trivial solution of equation (1.2) is pth moment exponentially stable provided p < 2 2α 1 /α2 2.
107 Moment verse Almost Sure Exponential Stability Criteria A Case Study Nonlinear case Linear case Proof. Let V (x, t) = (x T Qx) p 2. Then It is also easy to verify that λ p 2 min (Q) x p V (x, t) λ p 2 max (Q) x p. LV (x, t) = p(x T Qx) p 1( 2 x T Qf (x, t) + 1 ) 2 trace[gt (x, t)qg(x, t)] ( p ) + p 2 1 (x T Qx) p 2 2 x T Qg(x, t) 2.
108 Moment verse Almost Sure Exponential Stability Criteria A Case Study Nonlinear case Linear case (i) Assume that α 1 < 0 and p < α 1 /α3 2. Without loss of generality, we can let p 2. Then [ ( p ) ] LV (x, t) p α α3 2 V (x, t). (ii) Assume that 0 α 1 < α 2 2 and p < 2 2α 1/α 2 2. Then [( p ) ] LV (x, t) p 2 1 α2 2 α 1 V (x, t). So in both cases the stability assertion follows from the previous theorem.
109 Outline Moment verse Almost Sure Exponential Stability Criteria A Case Study Nonlinear case Linear case 1 Moment verse Almost Sure Exponential Stability 2 Criteria Nonlinear case Linear case 3 A Case Study
110 Moment verse Almost Sure Exponential Stability Criteria A Case Study Nonlinear case Linear case Consider a d-dimensional linear SDE dx(t) = Fx(t)dt + m G i x(t)db i (t), where F, G i R d d. This is of course a special case of the underlying SDE where i=1 f (x, t) = Fx, g(x, t) = (G 1 x,, G m x).
111 Moment verse Almost Sure Exponential Stability Criteria A Case Study Nonlinear case Linear case Corollary Assume that there exists a symmetric positive-definite d d matrix Q such that the following LMI holds: QF + F T Q + m Gi T QG i < 0. Then the trivial solution of the linear SDE is mean-square exponentially stable as well as almost surely exponentially stable. i=1
112 Moment verse Almost Sure Exponential Stability Criteria A Case Study Nonlinear case Linear case Proof. Let V (x, t) = x T Qx. Then Moreover λ min (Q) x 2 V (x, t) λ max (Q) x 2. LV (x, t) = x T Qx λmax ( Q) x 2. where Q = QF + F T Q + m i=1 GT i QG i. By the condition, λ max ( Q) < 0. Hence LV (x, t) λ max( Q) V (x, t). λ max (Q) The assertions follow therefore from the theory established above.
113 Moment verse Almost Sure Exponential Stability Criteria A Case Study Nonlinear case Linear case In the case when m QF + F T Q + Gi T QG i i=1 is not negative-definite, the following result is useful.
114 Moment verse Almost Sure Exponential Stability Criteria A Case Study Nonlinear case Linear case Corollary Assume that there exists a symmetric positive-definite d d matrix Q, and nonnegative constants β and β i (1 i m), such that β < m i=1 β i, QF + F T Q + m Gi T QG i βq 0, i=1 and, moreover, for each i = 1,, m, either QG i + G T i Q 2β i Q 0 or QG i + G T i Q + 2β i Q 0. If 0 < p < 2 2β/( m i=1 β i), then the trivial solution of the linear SDE is pth moment exponentially stable, whence it is also almost surely exponentially stable.
115 Moment verse Almost Sure Exponential Stability Criteria A Case Study Nonlinear case Linear case Proof. We will use the 2nd theorem established above to show this corollary. We first have that x T Qf (x, t) trace[gt (x, t)qg(x, t)] = 0.5x T ( QF + F T Q + m Gi T QG i )x 0.5βx T Qx. i=1 We also observe from the condition that for each i, Hence x T QG i x 2 = 0.25 x T (QG i + G T i Q)x 2 0.5β i (x T Qx) 2.
116 Moment verse Almost Sure Exponential Stability Criteria A Case Study Nonlinear case Linear case x T Qg(x, t) = m x T QG i x 2 m 0.5 β i x T Qx. i=1 Applying the theorem with α 1 = 0.5β, α 2 = m 0.5 β i, we can therefore conclude that the trivial solution of the linear SDE is pth moment exponentially stable if 0 < p < 2 2β/( m i=1 β i). This implies that the trivial solution of the linear SDE is also almost surely exponentially stable. i=1 i=1
117 Moment verse Almost Sure Exponential Stability Criteria A Case Study Nonlinear case Linear case As an even more special case, let us consider the scalar linear SDE m dx(t) = ax(t)dt + b i x(t)db i (t), where a, b i are all real numbers. Using the corollaries above, we can conclude: i=1
118 Moment verse Almost Sure Exponential Stability Criteria A Case Study Nonlinear case Linear case If 2a + m i=1 b2 i < 0, then the trivial solution of this scalar linear SDE is mean-square exponentially stable as well as almost surely exponentially stable. If 0 2a + m i=1 b2 i < 2 m i=1 b2 i, then the trivial solution of this scalar linear SDE is pth moment exponentially stable provided 0 < p < 1 2a m, i=1 b2 i whence it is also almost surely exponentially stable.
119 Moment verse Almost Sure Exponential Stability Criteria A Case Study Nonlinear case Linear case If 2a + m i=1 b2 i < 0, then the trivial solution of this scalar linear SDE is mean-square exponentially stable as well as almost surely exponentially stable. If 0 2a + m i=1 b2 i < 2 m i=1 b2 i, then the trivial solution of this scalar linear SDE is pth moment exponentially stable provided 0 < p < 1 2a m, i=1 b2 i whence it is also almost surely exponentially stable.
120 Moment verse Almost Sure Exponential Stability Criteria A Case Study This example is from the satellite dynamics. Sagirow in 1970 derived the equation ÿ(t) + β(1 + αḃ(t))ẏ(t) + (1 + αḃ(t))y(t) γ sin(2y(t)) = 0 in the study of the influence of a rapidly fluctuating density of the atmosphere of the earth on the motion of a satellite in a circular orbit. Here Ḃ(t) is a scalar white noise, α is a constant representing the intensity of the disturbance, and β, γ are two positive constants.
121 Moment verse Almost Sure Exponential Stability Criteria A Case Study Introducing x = (x 1, x 2 ) T = (y, ẏ) T, we can write this equation as the two-dimensional SDE dx 1 (t) = x 2 (t)dt, dx 2 (t) = [ x 1 (t) + γ sin(2x 1 (t)) βx 2 (t)]dt α[x 1 (t) + βx 2 (t)]db(t). For the Lyapunov function, we try an expression consisting of a quadratic form and integral of the nonlinear component: x1 V (x, t) = ax1 2 + bx 1x 2 + x2 2 + c sin(2y)dy = ax bx 1x 2 + x c sin2 x 1. 0
122 Moment verse Almost Sure Exponential Stability Criteria A Case Study This yields LV (x, t) = (b α 2 )x1 2 + bγx 1 sin(2x 1 ) (2β b α 2 β 2 )x2 2 + (2a bβ 2 + 2α 2 β)x 1 x 2 + (c + 2γ)x 2 sin(2x 1 ). Setting 2a bβ 2 + 2α 2 β = 0 and c + 2γ = 0 we obtain and V (x, t) = 1 2 (bβ + 2 2α2 β)x bx 1x 2 + x 2 2 2γ sin2 x 1 LV (x, t) = (b α 2 )x bγx 1 sin(2x 1 ) (2β b α 2 β 2 )x 2 2.
123 Moment verse Almost Sure Exponential Stability Criteria A Case Study Note that V (x, t) 1 2 (bβ + 2 2α2 β 4γ)x1 2 + bx 1x 2 + x2 2. So V (x, t) ε x 2 for some ε > 0 if 2(bβ + 2 2α 2 β 4γ) b 2 or equivalently β β γ 4α 2 β < b < β + β γ 4α 2 β. Note also that LV (x, t) (b α 2 2bγ)x1 2 (2β b α2 β 2 )x2 2.
124 Moment verse Almost Sure Exponential Stability Criteria A Case Study So LV (x, t) ε x 2 for some ε > 0 provided both b α 2 2bγ > 0 and 2β b α 2 β 2 > 0, that is 2γ < 1 and α 2 /(1 2γ) < b < 2β α 2 β 2. We can therefore conclude that if γ < 1/2 and { max α 2 /(1 2γ), β } β γ 4α 2 β { < min 2β α 2 β 2, β + } β γ 4α 2 β then the trivial solution of the SDE is exponentially stable in mean square.
125 Motivating Examples and History Stochastic Stabilization Stochastic Destabilization Stability of Stochastic Differential Equations Part 5: Stochastic Stabilization and Destabilization Department of Mathematics and Statistics University of Strathclyde Glasgow, G1 1XH December 2010
126 Outline Motivating Examples and History Stochastic Stabilization Stochastic Destabilization 1 Motivating Examples and History Destabilization Stabilization A brief history 2 Stochastic Stabilization Theory Examples and Simulations 3 Stochastic Destabilization Theory Case study and simulations
127 Outline Motivating Examples and History Stochastic Stabilization Stochastic Destabilization 1 Motivating Examples and History Destabilization Stabilization A brief history 2 Stochastic Stabilization Theory Examples and Simulations 3 Stochastic Destabilization Theory Case study and simulations
128 Outline Motivating Examples and History Stochastic Stabilization Stochastic Destabilization 1 Motivating Examples and History Destabilization Stabilization A brief history 2 Stochastic Stabilization Theory Examples and Simulations 3 Stochastic Destabilization Theory Case study and simulations
129 Outline Motivating Examples and History Stochastic Stabilization Stochastic Destabilization Destabilization Stabilization A brief history 1 Motivating Examples and History Destabilization Stabilization A brief history 2 Stochastic Stabilization Theory Examples and Simulations 3 Stochastic Destabilization Theory Case study and simulations
130 Motivating Examples and History Stochastic Stabilization Stochastic Destabilization Destabilization Stabilization A brief history It is not surprising that noise can destabilize a stable system.
131 Motivating Examples and History Stochastic Stabilization Stochastic Destabilization Destabilization Stabilization A brief history Consider a 2-dimensional ODE ẏ(t) = y(t) on t 0, y(0) = y 0 R 2. This is an exponentially stable system. Perturb it by noise and assume the stochastically perturbed system is described by an SDE dx(t) = x(t)dt + Gx(t)dB(t) on t 0, x(0) = y 0 R 2, where B(t) is a scalar Brownian motion and ( ) 0 2 G = 2 0
132 Motivating Examples and History Stochastic Stabilization Stochastic Destabilization Destabilization Stabilization A brief history The SDE has the explicit solution x(t) = exp[( I 0.5G 2 )t + GB(t)]x(0) = exp[it + GB(t)]x(0), where I is the 2 2 identity matrix. Consequently 1 lim t t log( x(t) ) = 1 a.s. That is, the stochastically perturbed system has become unstable with probability one.
133 Motivating Examples and History Stochastic Stabilization Stochastic Destabilization Destabilization Stabilization A brief history x1(t) or y1(t) x1(t) y1(t) x2(t) or y2(t) x2(t) y2(t) t t
134 Motivating Examples and History Stochastic Stabilization Stochastic Destabilization Destabilization Stabilization A brief history Do you believe that noise can also stabilize an unstable system?
135 Outline Motivating Examples and History Stochastic Stabilization Stochastic Destabilization Destabilization Stabilization A brief history 1 Motivating Examples and History Destabilization Stabilization A brief history 2 Stochastic Stabilization Theory Examples and Simulations 3 Stochastic Destabilization Theory Case study and simulations
136 Motivating Examples and History Stochastic Stabilization Stochastic Destabilization Destabilization Stabilization A brief history Consider the scalar ODE The solution is ẏ(t) = y(t) on t 0, y(0) = y 0 R. y(t) = y(0)e t. So y(t) if y(0) 0. That is, the ODE is an exponentially unstable system. Perturb it by noise and assume the stochastically perturbed system is described by an SDE dx(t) = x(t)dt + σx(t)db(t) on t 0, x(0) = y 0 R,
137 Motivating Examples and History Stochastic Stabilization Stochastic Destabilization Destabilization Stabilization A brief history The SDE has the explicit solution Consequently x(t) = x(0) exp[(1 0.5σ 2 )t + σb(t)]. x(t) 0 a.s. if σ > 2. That is, the stochastically perturbed system has become stable with probability one.
138 Motivating Examples and History Stochastic Stabilization Stochastic Destabilization Destabilization Stabilization A brief history x(t) or y(t) x(t) y(t) t σ = 2
139 Motivating Examples and History Stochastic Stabilization Stochastic Destabilization Destabilization Stabilization A brief history Of course, if the noise is not strong enough, it will not be able to stabilize the system.
140 Motivating Examples and History Stochastic Stabilization Stochastic Destabilization Destabilization Stabilization A brief history x(t) or y(t) x(t) y(t) t σ = 0.5
141 Motivating Examples and History Stochastic Stabilization Stochastic Destabilization Destabilization Stabilization A brief history x(t) or y(t) x(t) y(t) t σ = 2
142 Outline Motivating Examples and History Stochastic Stabilization Stochastic Destabilization Destabilization Stabilization A brief history 1 Motivating Examples and History Destabilization Stabilization A brief history 2 Stochastic Stabilization Theory Examples and Simulations 3 Stochastic Destabilization Theory Case study and simulations
Theoretical Tutorial Session 2
1 / 36 Theoretical Tutorial Session 2 Xiaoming Song Department of Mathematics Drexel University July 27, 216 Outline 2 / 36 Itô s formula Martingale representation theorem Stochastic differential equations
More informationEXPONENTIAL STABILITY AND INSTABILITY OF STOCHASTIC NEURAL NETWORKS 1. X. X. Liao 2 and X. Mao 3
EXPONENTIAL STABILITY AND INSTABILITY OF STOCHASTIC NEURAL NETWORKS X. X. Liao 2 and X. Mao 3 Department of Statistics and Modelling Science University of Strathclyde Glasgow G XH, Scotland, U.K. ABSTRACT
More informationReflected Brownian Motion
Chapter 6 Reflected Brownian Motion Often we encounter Diffusions in regions with boundary. If the process can reach the boundary from the interior in finite time with positive probability we need to decide
More informationChapter III. Stability of Linear Systems
1 Chapter III Stability of Linear Systems 1. Stability and state transition matrix 2. Time-varying (non-autonomous) systems 3. Time-invariant systems 1 STABILITY AND STATE TRANSITION MATRIX 2 In this chapter,
More informationNonlinear Control. Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems
Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems Time-varying Systems ẋ = f(t,x) f(t,x) is piecewise continuous in t and locally Lipschitz in x for all t 0 and all x D, (0 D). The origin
More informationStochastic Differential Equations.
Chapter 3 Stochastic Differential Equations. 3.1 Existence and Uniqueness. One of the ways of constructing a Diffusion process is to solve the stochastic differential equation dx(t) = σ(t, x(t)) dβ(t)
More informationStationary distribution and pathwise estimation of n-species mutualism system with stochastic perturbation
Available online at www.tjnsa.com J. Nonlinear Sci. Appl. 9 6), 936 93 Research Article Stationary distribution and pathwise estimation of n-species mutualism system with stochastic perturbation Weiwei
More informationSolution of Additional Exercises for Chapter 4
1 1. (1) Try V (x) = 1 (x 1 + x ). Solution of Additional Exercises for Chapter 4 V (x) = x 1 ( x 1 + x ) x = x 1 x + x 1 x In the neighborhood of the origin, the term (x 1 + x ) dominates. Hence, the
More informationResearch Article Mean Square Stability of Impulsive Stochastic Differential Systems
International Differential Equations Volume 011, Article ID 613695, 13 pages doi:10.1155/011/613695 Research Article Mean Square Stability of Impulsive Stochastic Differential Systems Shujie Yang, Bao
More informationExercises. T 2T. e ita φ(t)dt.
Exercises. Set #. Construct an example of a sequence of probability measures P n on R which converge weakly to a probability measure P but so that the first moments m,n = xdp n do not converge to m = xdp.
More informationIntroduction to Nonlinear Control Lecture # 3 Time-Varying and Perturbed Systems
p. 1/5 Introduction to Nonlinear Control Lecture # 3 Time-Varying and Perturbed Systems p. 2/5 Time-varying Systems ẋ = f(t, x) f(t, x) is piecewise continuous in t and locally Lipschitz in x for all t
More informationAsymptotic behaviour of the stochastic Lotka Volterra model
J. Math. Anal. Appl. 87 3 56 www.elsevier.com/locate/jmaa Asymptotic behaviour of the stochastic Lotka Volterra model Xuerong Mao, Sotirios Sabanis, and Eric Renshaw Department of Statistics and Modelling
More informationI forgot to mention last time: in the Ito formula for two standard processes, putting
I forgot to mention last time: in the Ito formula for two standard processes, putting dx t = a t dt + b t db t dy t = α t dt + β t db t, and taking f(x, y = xy, one has f x = y, f y = x, and f xx = f yy
More informationFiltrations, Markov Processes and Martingales. Lectures on Lévy Processes and Stochastic Calculus, Braunschweig, Lecture 3: The Lévy-Itô Decomposition
Filtrations, Markov Processes and Martingales Lectures on Lévy Processes and Stochastic Calculus, Braunschweig, Lecture 3: The Lévy-Itô Decomposition David pplebaum Probability and Statistics Department,
More informationSolution for Problem 7.1. We argue by contradiction. If the limit were not infinite, then since τ M (ω) is nondecreasing we would have
362 Problem Hints and Solutions sup g n (ω, t) g(ω, t) sup g(ω, s) g(ω, t) µ n (ω). t T s,t: s t 1/n By the uniform continuity of t g(ω, t) on [, T], one has for each ω that µ n (ω) as n. Two applications
More information2012 NCTS Workshop on Dynamical Systems
Barbara Gentz gentz@math.uni-bielefeld.de http://www.math.uni-bielefeld.de/ gentz 2012 NCTS Workshop on Dynamical Systems National Center for Theoretical Sciences, National Tsing-Hua University Hsinchu,
More informationA Stochastic Viral Infection Model with General Functional Response
Nonlinear Analysis and Differential Equations, Vol. 4, 16, no. 9, 435-445 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/1.1988/nade.16.664 A Stochastic Viral Infection Model with General Functional Response
More informationDynamical systems with Gaussian and Levy noise: analytical and stochastic approaches
Dynamical systems with Gaussian and Levy noise: analytical and stochastic approaches Noise is often considered as some disturbing component of the system. In particular physical situations, noise becomes
More informationA Concise Course on Stochastic Partial Differential Equations
A Concise Course on Stochastic Partial Differential Equations Michael Röckner Reference: C. Prevot, M. Röckner: Springer LN in Math. 1905, Berlin (2007) And see the references therein for the original
More informationBernardo D Auria Stochastic Processes /12. Notes. March 29 th, 2012
1 Stochastic Calculus Notes March 9 th, 1 In 19, Bachelier proposed for the Paris stock exchange a model for the fluctuations affecting the price X(t) of an asset that was given by the Brownian motion.
More informationMath Ordinary Differential Equations
Math 411 - Ordinary Differential Equations Review Notes - 1 1 - Basic Theory A first order ordinary differential equation has the form x = f(t, x) (11) Here x = dx/dt Given an initial data x(t 0 ) = x
More informationBrownian Motion. 1 Definition Brownian Motion Wiener measure... 3
Brownian Motion Contents 1 Definition 2 1.1 Brownian Motion................................. 2 1.2 Wiener measure.................................. 3 2 Construction 4 2.1 Gaussian process.................................
More informationMathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio ( )
Mathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio (2014-2015) Etienne Tanré - Olivier Faugeras INRIA - Team Tosca November 26th, 2014 E. Tanré (INRIA - Team Tosca) Mathematical
More informationLyapunov Stability Theory
Lyapunov Stability Theory Peter Al Hokayem and Eduardo Gallestey March 16, 2015 1 Introduction In this lecture we consider the stability of equilibrium points of autonomous nonlinear systems, both in continuous
More information6. Brownian Motion. Q(A) = P [ ω : x(, ω) A )
6. Brownian Motion. stochastic process can be thought of in one of many equivalent ways. We can begin with an underlying probability space (Ω, Σ, P) and a real valued stochastic process can be defined
More information1 Lyapunov theory of stability
M.Kawski, APM 581 Diff Equns Intro to Lyapunov theory. November 15, 29 1 1 Lyapunov theory of stability Introduction. Lyapunov s second (or direct) method provides tools for studying (asymptotic) stability
More informationHalf of Final Exam Name: Practice Problems October 28, 2014
Math 54. Treibergs Half of Final Exam Name: Practice Problems October 28, 24 Half of the final will be over material since the last midterm exam, such as the practice problems given here. The other half
More informationStochastic Viral Dynamics with Beddington-DeAngelis Functional Response
Stochastic Viral Dynamics with Beddington-DeAngelis Functional Response Junyi Tu, Yuncheng You University of South Florida, USA you@mail.usf.edu IMA Workshop in Memory of George R. Sell June 016 Outline
More informationLecture 4: Ito s Stochastic Calculus and SDE. Seung Yeal Ha Dept of Mathematical Sciences Seoul National University
Lecture 4: Ito s Stochastic Calculus and SDE Seung Yeal Ha Dept of Mathematical Sciences Seoul National University 1 Preliminaries What is Calculus? Integral, Differentiation. Differentiation 2 Integral
More informationLecture 4. Chapter 4: Lyapunov Stability. Eugenio Schuster. Mechanical Engineering and Mechanics Lehigh University.
Lecture 4 Chapter 4: Lyapunov Stability Eugenio Schuster schuster@lehigh.edu Mechanical Engineering and Mechanics Lehigh University Lecture 4 p. 1/86 Autonomous Systems Consider the autonomous system ẋ
More informationLMI Methods in Optimal and Robust Control
LMI Methods in Optimal and Robust Control Matthew M. Peet Arizona State University Lecture 15: Nonlinear Systems and Lyapunov Functions Overview Our next goal is to extend LMI s and optimization to nonlinear
More informationz x = f x (x, y, a, b), z y = f y (x, y, a, b). F(x, y, z, z x, z y ) = 0. This is a PDE for the unknown function of two independent variables.
Chapter 2 First order PDE 2.1 How and Why First order PDE appear? 2.1.1 Physical origins Conservation laws form one of the two fundamental parts of any mathematical model of Continuum Mechanics. These
More information6 Linear Equation. 6.1 Equation with constant coefficients
6 Linear Equation 6.1 Equation with constant coefficients Consider the equation ẋ = Ax, x R n. This equating has n independent solutions. If the eigenvalues are distinct then the solutions are c k e λ
More informationENGI 9420 Lecture Notes 4 - Stability Analysis Page Stability Analysis for Non-linear Ordinary Differential Equations
ENGI 940 Lecture Notes 4 - Stability Analysis Page 4.01 4. Stability Analysis for Non-linear Ordinary Differential Equations A pair of simultaneous first order homogeneous linear ordinary differential
More informationPartial Differential Equations with Applications to Finance Seminar 1: Proving and applying Dynkin s formula
Partial Differential Equations with Applications to Finance Seminar 1: Proving and applying Dynkin s formula Group 4: Bertan Yilmaz, Richard Oti-Aboagye and Di Liu May, 15 Chapter 1 Proving Dynkin s formula
More informationLecture 17 Brownian motion as a Markov process
Lecture 17: Brownian motion as a Markov process 1 of 14 Course: Theory of Probability II Term: Spring 2015 Instructor: Gordan Zitkovic Lecture 17 Brownian motion as a Markov process Brownian motion is
More informationON THE PATHWISE UNIQUENESS OF SOLUTIONS OF STOCHASTIC DIFFERENTIAL EQUATIONS
PORTUGALIAE MATHEMATICA Vol. 55 Fasc. 4 1998 ON THE PATHWISE UNIQUENESS OF SOLUTIONS OF STOCHASTIC DIFFERENTIAL EQUATIONS C. Sonoc Abstract: A sufficient condition for uniqueness of solutions of ordinary
More informationNonlinear Control Systems
Nonlinear Control Systems António Pedro Aguiar pedro@isr.ist.utl.pt 3. Fundamental properties IST-DEEC PhD Course http://users.isr.ist.utl.pt/%7epedro/ncs2012/ 2012 1 Example Consider the system ẋ = f
More informationCDS Solutions to the Midterm Exam
CDS 22 - Solutions to the Midterm Exam Instructor: Danielle C. Tarraf November 6, 27 Problem (a) Recall that the H norm of a transfer function is time-delay invariant. Hence: ( ) Ĝ(s) = s + a = sup /2
More informationUniformly Uniformly-ergodic Markov chains and BSDEs
Uniformly Uniformly-ergodic Markov chains and BSDEs Samuel N. Cohen Mathematical Institute, University of Oxford (Based on joint work with Ying Hu, Robert Elliott, Lukas Szpruch) Centre Henri Lebesgue,
More informationTopic # /31 Feedback Control Systems. Analysis of Nonlinear Systems Lyapunov Stability Analysis
Topic # 16.30/31 Feedback Control Systems Analysis of Nonlinear Systems Lyapunov Stability Analysis Fall 010 16.30/31 Lyapunov Stability Analysis Very general method to prove (or disprove) stability of
More informationApplied Mathematics Letters. Stationary distribution, ergodicity and extinction of a stochastic generalized logistic system
Applied Mathematics Letters 5 (1) 198 1985 Contents lists available at SciVerse ScienceDirect Applied Mathematics Letters journal homepage: www.elsevier.com/locate/aml Stationary distribution, ergodicity
More informationNonlinear Control. Nonlinear Control Lecture # 2 Stability of Equilibrium Points
Nonlinear Control Lecture # 2 Stability of Equilibrium Points Basic Concepts ẋ = f(x) f is locally Lipschitz over a domain D R n Suppose x D is an equilibrium point; that is, f( x) = 0 Characterize and
More informationMA8109 Stochastic Processes in Systems Theory Autumn 2013
Norwegian University of Science and Technology Department of Mathematical Sciences MA819 Stochastic Processes in Systems Theory Autumn 213 1 MA819 Exam 23, problem 3b This is a linear equation of the form
More informationẋ = f(x, y), ẏ = g(x, y), (x, y) D, can only have periodic solutions if (f,g) changes sign in D or if (f,g)=0in D.
4 Periodic Solutions We have shown that in the case of an autonomous equation the periodic solutions correspond with closed orbits in phase-space. Autonomous two-dimensional systems with phase-space R
More informationELEMENTS OF PROBABILITY THEORY
ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable
More informationOn pathwise stochastic integration
On pathwise stochastic integration Rafa l Marcin Lochowski Afican Institute for Mathematical Sciences, Warsaw School of Economics UWC seminar Rafa l Marcin Lochowski (AIMS, WSE) On pathwise stochastic
More informationERRATA: Probabilistic Techniques in Analysis
ERRATA: Probabilistic Techniques in Analysis ERRATA 1 Updated April 25, 26 Page 3, line 13. A 1,..., A n are independent if P(A i1 A ij ) = P(A 1 ) P(A ij ) for every subset {i 1,..., i j } of {1,...,
More informationModeling and Analysis of Dynamic Systems
Modeling and Analysis of Dynamic Systems Dr. Guillaume Ducard Fall 2017 Institute for Dynamic Systems and Control ETH Zurich, Switzerland G. Ducard c 1 / 57 Outline 1 Lecture 13: Linear System - Stability
More informationfor all subintervals I J. If the same is true for the dyadic subintervals I D J only, we will write ϕ BMO d (J). In fact, the following is true
3 ohn Nirenberg inequality, Part I A function ϕ L () belongs to the space BMO() if sup ϕ(s) ϕ I I I < for all subintervals I If the same is true for the dyadic subintervals I D only, we will write ϕ BMO
More informationODE Final exam - Solutions
ODE Final exam - Solutions May 3, 018 1 Computational questions (30 For all the following ODE s with given initial condition, find the expression of the solution as a function of the time variable t You
More informationNonlinear Systems Theory
Nonlinear Systems Theory Matthew M. Peet Arizona State University Lecture 2: Nonlinear Systems Theory Overview Our next goal is to extend LMI s and optimization to nonlinear systems analysis. Today we
More informationNonlinear Systems and Control Lecture # 12 Converse Lyapunov Functions & Time Varying Systems. p. 1/1
Nonlinear Systems and Control Lecture # 12 Converse Lyapunov Functions & Time Varying Systems p. 1/1 p. 2/1 Converse Lyapunov Theorem Exponential Stability Let x = 0 be an exponentially stable equilibrium
More information1 Independent increments
Tel Aviv University, 2008 Brownian motion 1 1 Independent increments 1a Three convolution semigroups........... 1 1b Independent increments.............. 2 1c Continuous time................... 3 1d Bad
More informationUsing Lyapunov Theory I
Lecture 33 Stability Analysis of Nonlinear Systems Using Lyapunov heory I Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Outline Motivation Definitions
More informationChapter 2 Mathematical Preliminaries
Chapter 2 Mathematical Preliminaries 2.1 Introduction In this chapter, the fundamental mathematical concepts and analysis tools in systems theory are summarized, which will be used in control design and
More informationProperties of an infinite dimensional EDS system : the Muller s ratchet
Properties of an infinite dimensional EDS system : the Muller s ratchet LATP June 5, 2011 A ratchet source : wikipedia Plan 1 Introduction : The model of Haigh 2 3 Hypothesis (Biological) : The population
More informationNonlinear Control. Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems
Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems Time-varying Systems ẋ = f(t,x) f(t,x) is piecewise continuous in t and locally Lipschitz in x for all t 0 and all x D, (0 D). The origin
More informationp 1 ( Y p dp) 1/p ( X p dp) 1 1 p
Doob s inequality Let X(t) be a right continuous submartingale with respect to F(t), t 1 P(sup s t X(s) λ) 1 λ {sup s t X(s) λ} X + (t)dp 2 For 1 < p
More informationBernardo D Auria Stochastic Processes /10. Notes. Abril 13 th, 2010
1 Stochastic Calculus Notes Abril 13 th, 1 As we have seen in previous lessons, the stochastic integral with respect to the Brownian motion shows a behavior different from the classical Riemann-Stieltjes
More informationLecture 4: Numerical solution of ordinary differential equations
Lecture 4: Numerical solution of ordinary differential equations Department of Mathematics, ETH Zürich General explicit one-step method: Consistency; Stability; Convergence. High-order methods: Taylor
More informationCalculus C (ordinary differential equations)
Calculus C (ordinary differential equations) Lesson 1: Ordinary first order differential equations Separable differential equations Autonomous differential equations Logistic growth Frank Hansen Institute
More informationExercises in stochastic analysis
Exercises in stochastic analysis Franco Flandoli, Mario Maurelli, Dario Trevisan The exercises with a P are those which have been done totally or partially) in the previous lectures; the exercises with
More informationSDE Coefficients. March 4, 2008
SDE Coefficients March 4, 2008 The following is a summary of GARD sections 3.3 and 6., mainly as an overview of the two main approaches to creating a SDE model. Stochastic Differential Equations (SDE)
More information1+t 2 (l) y = 2xy 3 (m) x = 2tx + 1 (n) x = 2tx + t (o) y = 1 + y (p) y = ty (q) y =
DIFFERENTIAL EQUATIONS. Solved exercises.. Find the set of all solutions of the following first order differential equations: (a) x = t (b) y = xy (c) x = x (d) x = (e) x = t (f) x = x t (g) x = x log
More information1. Find the solution of the following uncontrolled linear system. 2 α 1 1
Appendix B Revision Problems 1. Find the solution of the following uncontrolled linear system 0 1 1 ẋ = x, x(0) =. 2 3 1 Class test, August 1998 2. Given the linear system described by 2 α 1 1 ẋ = x +
More information(2m)-TH MEAN BEHAVIOR OF SOLUTIONS OF STOCHASTIC DIFFERENTIAL EQUATIONS UNDER PARAMETRIC PERTURBATIONS
(2m)-TH MEAN BEHAVIOR OF SOLUTIONS OF STOCHASTIC DIFFERENTIAL EQUATIONS UNDER PARAMETRIC PERTURBATIONS Svetlana Janković and Miljana Jovanović Faculty of Science, Department of Mathematics, University
More informationFunctional Limit theorems for the quadratic variation of a continuous time random walk and for certain stochastic integrals
Functional Limit theorems for the quadratic variation of a continuous time random walk and for certain stochastic integrals Noèlia Viles Cuadros BCAM- Basque Center of Applied Mathematics with Prof. Enrico
More informationNotes on uniform convergence
Notes on uniform convergence Erik Wahlén erik.wahlen@math.lu.se January 17, 2012 1 Numerical sequences We begin by recalling some properties of numerical sequences. By a numerical sequence we simply mean
More informationf(s)ds, i.e. to write down the general solution in
1. First order ODEs. Simplest examples. Existence and uniqueness theorem Example 1.1. Consider the equation (1.1) x (t) = 1 This is an equation because there is an unknown: the function x(t). This is a
More informationConvergence at first and second order of some approximations of stochastic integrals
Convergence at first and second order of some approximations of stochastic integrals Bérard Bergery Blandine, Vallois Pierre IECN, Nancy-Université, CNRS, INRIA, Boulevard des Aiguillettes B.P. 239 F-5456
More informationSolutions to the Exercises in Stochastic Analysis
Solutions to the Exercises in Stochastic Analysis Lecturer: Xue-Mei Li 1 Problem Sheet 1 In these solution I avoid using conditional expectations. But do try to give alternative proofs once we learnt conditional
More informationEntrance Exam, Differential Equations April, (Solve exactly 6 out of the 8 problems) y + 2y + y cos(x 2 y) = 0, y(0) = 2, y (0) = 4.
Entrance Exam, Differential Equations April, 7 (Solve exactly 6 out of the 8 problems). Consider the following initial value problem: { y + y + y cos(x y) =, y() = y. Find all the values y such that the
More informationSome Properties of NSFDEs
Chenggui Yuan (Swansea University) Some Properties of NSFDEs 1 / 41 Some Properties of NSFDEs Chenggui Yuan Swansea University Chenggui Yuan (Swansea University) Some Properties of NSFDEs 2 / 41 Outline
More informationDepartment of Mathematics IIT Guwahati
Stability of Linear Systems in R 2 Department of Mathematics IIT Guwahati A system of first order differential equations is called autonomous if the system can be written in the form dx 1 dt = g 1(x 1,
More informationPUTNAM PROBLEMS DIFFERENTIAL EQUATIONS. First Order Equations. p(x)dx)) = q(x) exp(
PUTNAM PROBLEMS DIFFERENTIAL EQUATIONS First Order Equations 1. Linear y + p(x)y = q(x) Muliply through by the integrating factor exp( p(x)) to obtain (y exp( p(x))) = q(x) exp( p(x)). 2. Separation of
More informationWeak convergence. Amsterdam, 13 November Leiden University. Limit theorems. Shota Gugushvili. Generalities. Criteria
Weak Leiden University Amsterdam, 13 November 2013 Outline 1 2 3 4 5 6 7 Definition Definition Let µ, µ 1, µ 2,... be probability measures on (R, B). It is said that µ n converges weakly to µ, and we then
More informationOn the submartingale / supermartingale property of diffusions in natural scale
On the submartingale / supermartingale property of diffusions in natural scale Alexander Gushchin Mikhail Urusov Mihail Zervos November 13, 214 Abstract Kotani 5 has characterised the martingale property
More informationVerona Course April Lecture 1. Review of probability
Verona Course April 215. Lecture 1. Review of probability Viorel Barbu Al.I. Cuza University of Iaşi and the Romanian Academy A probability space is a triple (Ω, F, P) where Ω is an abstract set, F is
More informationSelected Exercises on Expectations and Some Probability Inequalities
Selected Exercises on Expectations and Some Probability Inequalities # If E(X 2 ) = and E X a > 0, then P( X λa) ( λ) 2 a 2 for 0 < λ
More informationBIBO STABILITY AND ASYMPTOTIC STABILITY
BIBO STABILITY AND ASYMPTOTIC STABILITY FRANCESCO NORI Abstract. In this report with discuss the concepts of bounded-input boundedoutput stability (BIBO) and of Lyapunov stability. Examples are given to
More information1. Stochastic Processes and filtrations
1. Stochastic Processes and 1. Stoch. pr., A stochastic process (X t ) t T is a collection of random variables on (Ω, F) with values in a measurable space (S, S), i.e., for all t, In our case X t : Ω S
More informationOn the martingales obtained by an extension due to Saisho, Tanemura and Yor of Pitman s theorem
On the martingales obtained by an extension due to Saisho, Tanemura and Yor of Pitman s theorem Koichiro TAKAOKA Dept of Applied Physics, Tokyo Institute of Technology Abstract M Yor constructed a family
More informationNonlinear Control. Nonlinear Control Lecture # 3 Stability of Equilibrium Points
Nonlinear Control Lecture # 3 Stability of Equilibrium Points The Invariance Principle Definitions Let x(t) be a solution of ẋ = f(x) A point p is a positive limit point of x(t) if there is a sequence
More informationThe multidimensional Ito Integral and the multidimensional Ito Formula. Eric Mu ller June 1, 2015 Seminar on Stochastic Geometry and its applications
The multidimensional Ito Integral and the multidimensional Ito Formula Eric Mu ller June 1, 215 Seminar on Stochastic Geometry and its applications page 2 Seminar on Stochastic Geometry and its applications
More informationµ X (A) = P ( X 1 (A) )
1 STOCHASTIC PROCESSES This appendix provides a very basic introduction to the language of probability theory and stochastic processes. We assume the reader is familiar with the general measure and integration
More informationNonlinear Control Lecture 5: Stability Analysis II
Nonlinear Control Lecture 5: Stability Analysis II Farzaneh Abdollahi Department of Electrical Engineering Amirkabir University of Technology Fall 2010 Farzaneh Abdollahi Nonlinear Control Lecture 5 1/41
More informationPROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS
PROBABILITY: LIMIT THEOREMS II, SPRING 218. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please
More informationStability of Nonlinear Systems An Introduction
Stability of Nonlinear Systems An Introduction Michael Baldea Department of Chemical Engineering The University of Texas at Austin April 3, 2012 The Concept of Stability Consider the generic nonlinear
More informationAn adaptive numerical scheme for fractional differential equations with explosions
An adaptive numerical scheme for fractional differential equations with explosions Johanna Garzón Departamento de Matemáticas, Universidad Nacional de Colombia Seminario de procesos estocásticos Jointly
More informationBrownian Motion and Stochastic Calculus
ETHZ, Spring 17 D-MATH Prof Dr Martin Larsson Coordinator A Sepúlveda Brownian Motion and Stochastic Calculus Exercise sheet 6 Please hand in your solutions during exercise class or in your assistant s
More informationProf. Krstic Nonlinear Systems MAE281A Homework set 1 Linearization & phase portrait
Prof. Krstic Nonlinear Systems MAE28A Homework set Linearization & phase portrait. For each of the following systems, find all equilibrium points and determine the type of each isolated equilibrium. Use
More informationOn the Ψ - Exponential Asymptotic Stability of Nonlinear Lyapunov Matrix Differential Equations
DOI: 1.2478/awutm-213-12 Analele Universităţii de Vest, Timişoara Seria Matematică Informatică LI, 2, (213), 7 28 On the Ψ - Exponential Asymptotic Stability of Nonlinear Lyapunov Matrix Differential Equations
More informationSTABILITY. Phase portraits and local stability
MAS271 Methods for differential equations Dr. R. Jain STABILITY Phase portraits and local stability We are interested in system of ordinary differential equations of the form ẋ = f(x, y), ẏ = g(x, y),
More informationThe Pedestrian s Guide to Local Time
The Pedestrian s Guide to Local Time Tomas Björk, Department of Finance, Stockholm School of Economics, Box 651, SE-113 83 Stockholm, SWEDEN tomas.bjork@hhs.se November 19, 213 Preliminary version Comments
More informationDeterministic Dynamic Programming
Deterministic Dynamic Programming 1 Value Function Consider the following optimal control problem in Mayer s form: V (t 0, x 0 ) = inf u U J(t 1, x(t 1 )) (1) subject to ẋ(t) = f(t, x(t), u(t)), x(t 0
More informationlim n C1/n n := ρ. [f(y) f(x)], y x =1 [f(x) f(y)] [g(x) g(y)]. (x,y) E A E(f, f),
1 Part I Exercise 1.1. Let C n denote the number of self-avoiding random walks starting at the origin in Z of length n. 1. Show that (Hint: Use C n+m C n C m.) lim n C1/n n = inf n C1/n n := ρ.. Show that
More informationIntroduction to numerical simulations for Stochastic ODEs
Introduction to numerical simulations for Stochastic ODEs Xingye Kan Illinois Institute of Technology Department of Applied Mathematics Chicago, IL 60616 August 9, 2010 Outline 1 Preliminaries 2 Numerical
More informationExistence and uniqueness of solutions for nonlinear ODEs
Chapter 4 Existence and uniqueness of solutions for nonlinear ODEs In this chapter we consider the existence and uniqueness of solutions for the initial value problem for general nonlinear ODEs. Recall
More informationdx n a 1(x) dy
HIGHER ORDER DIFFERENTIAL EQUATIONS Theory of linear equations Initial-value and boundary-value problem nth-order initial value problem is Solve: a n (x) dn y dx n + a n 1(x) dn 1 y dx n 1 +... + a 1(x)
More information