SUPPLEMENT TO CONTROLLED EQUILIBRIUM SELECTION IN STOCHASTICALLY PERTURBED DYNAMICS
|
|
- Todd Benson
- 5 years ago
- Views:
Transcription
1 SUPPLEMENT TO CONTROLLED EQUILIBRIUM SELECTION IN STOCHASTICALLY PERTURBED DYNAMICS By Ari Arapostathis, Anup Biswas, and Vivek S. Borkar The University of Texas at Austin, Indian Institute of Science Education and Research, Pune, and Indian Institute of Technology Bombay This document contains the proofs of Lemma.3 and Theorem.4 in Section.3, and Lemma.7 and Theorem.9 in Section.5.. Proofs of Lemma.3 and Theorem.4. We start with the proof of Lemma.3. Proof of Lemma.3. The proof is standard. Let U be given, and define M t := E [ t U s 2 ds, t R +. For T >, let HT 2 denote the space of {F t }-adapted processes Y defined on [, T, having continuous sample paths, and satisfying E [ sup t T Y t 2 <. The space HT 2 more precisely the set of equivalence classes in HT 2 ) is a Banach space under the norm Y H 2 T := [ ) /2 E sup Y t 2. t T It is standard to show, for example following the proof of Arapostathis, Borkar and Ghosh, 22, Theorem 2.2.2), that any solution X of ) X t = X + satisfies t mxs ) + ε U s ) ds + ε ν W t, t, 2) X X 2 H 2 t κ t + t) + M t + E [ X 2) e κ t t, for some constants κ and κ that depend only on m. The existence of a pathwise unique solution then follows by applying the contraction mapping theorem as in Arapostathis, Borkar and Ghosh, 22, Theorem 2.2.4). The rest of this section is devoted to the proof of Theorem.4. Without loss of generality we fix ε =, and suppress the dependence on ε in all the
2 2 A. ARAPOSTATHIS, A. BISWAS, AND V. S. BORKAR variables. Also, throughout the rest of this section, without loss of generality we assume that l. We proceed by establishing two key lemmas, followed by the proof of Theorem.4. Recall that the running cost R is defined by Rx, u) := lx) + 2 u 2, and that since l is Lipschitz, there exists a constant c l independent of ε such that 3) l dη ε c l. For x R d, and α >, we define the subset U α x of admissible controls by { [ } 4) U α x := U U : E U x e αs RX s, U s ) ds <, where E U x denotes the expectation under the law of X, U) which solves the Itô equation 5) X t = x + with X = x. t mx s ) ds + t U s ds + W t, t, Lemma. The equation 6) 2 V α + m, V α 2 V α 2 + l = αv α has a solution in C 2 R d ) for all α, ). Moreover, for all α, ), we have the following. i) For some constant c >, not depending on α, it holds that 7) V α x) c + x, and αvα x) lx) + c α for all x R d. ii) The function V α satisfies 8) V α x) inf U U α x E U x [ iii) With c l the constant in 3), we have e αs RX s, U s ) ds, x R d. inf {x : lx) c l } αv α = inf R d αv α c l.
3 SUPPLEMENT TO CONTROLLED EQUILIBRIUM SELECTION 3 Proof. In Bensoussan and Frehse, 22, Theorem 4.8, p. 77) it is proved that 6) has a solution in C 2 R d ), and it is also shown in the proof of this theorem that there exists a constant κ > which does not depend on α such that 9) α V α x) κ x R d. By Ichihara, 22, Theorem B.) there exists a constant C not depending on R > such that ) ) sup V α C + sup αvα ) + sup l + + sup l /3, B R B R+ B R+ B R+ from which gradient estimate in 7) follows. The following structural hypothesis on the Hamiltonian hx, p) is assumed in Ichihara, 22, Theorem B.): p hx, p) is strictly convex for all x R d, and there exists some constant k > such that ) k p 2 hx, p) k p 2, x hx, p) k + p 2 ), for x, p) R 2d. This Hamiltonian corresponds to hx, p) = 2 p 2 m, p for the equation in 6), and the first bound in ) is not satisfied. However, replacing this bound with k p 2 k ) hx, p) k p 2 + k ), for some constant k, the proof of Ichihara, 22, Theorem B.) goes through unmodified. Recall that the class of controls Û is defined by { [ t } Û := U U : E U s 2 ds < for all t. Writing 6) in HJB form, and applying Itô s formula, we obtain 2) V α x) e αt E U [ x Vα X t ) [ t E U x e αs RX s, U s ) ds t >, and all U Û. Since m is bounded, it is standard to show using 5) that [ 3) E U x sup Xs) x m t + [ t t + E U x U s ds < s t for all U Û and t >. Also, if E x denotes the expectation E U x with U =, then by 5), we have the estimate 4) E x[ Xt 2 κ 2 + t 2 + x 2) < t >,
4 4 A. ARAPOSTATHIS, A. BISWAS, AND V. S. BORKAR for some constant κ 2. As shown in the proof of Bensoussan and Frehse, 22, Theorem 4.8, p. 77), α αv α ) is bounded on, ), which together with the gradient estimate in 7) we have already established, provides us with a liberal bound of V α of the form V α x) C + x 2 ) for some constant C. This combined with 4) implies that e αt E x[ Vα X t ) as t. Therefore, using 3), and the Lipschitz constant C l of l, we obtain by 2) that [ αv α x) E x α e αs lx s ) ds lx) + C l α e αs m s + 2 s ) ds x R d, which results in the estimate given in 7), where without loss of generality we use a common constant c for the two inequalities. This completes the proof of part i). Let gx, t) := x + m t + 2 t. Multiplying both sides of 3) by e αt, then strengthening the inequality, and applying the Hölder inequality, we obtain e αt E U [ x Xt [ t 5) gx, t) e αt + e α 2 t E U x e α 2 s U s ds gx, t) e αt + te α 4 t E U x t U Uα x, [ t ) /2 e αs U s 2 ds with U α x as defined in 4). Taking limits as t in 2), and using 5), and the bound of V α in 7) together with the inequality lx) C l x + l), we obtain 8). We now turn to part iii). Let and χx) := 3 min y B x) [ly) d d m ) 2) /2, ψx) := V α x) + 2κ α χx ) x x 2), x B x ),
5 SUPPLEMENT TO CONTROLLED EQUILIBRIUM SELECTION 5 where κ > is the constant in 9). With φx) := x x 2, we have 2 ψ m V α, ψ + αψ ) = 2 V α m, V α + 2 V α 2 + αv α + 2 V α χx ) φ 2 2χ 2 x )φ + 2κ ) χx ) 2 φ + m, φ + α φ) l 2χ 2 x ) + 2κ d + 2 d m + ) χx ) l 3χ 2 x ) d d m ) 2 in B x ), for all α, ), where we use 6) and the fact that κ. Since ψ > on B x ) by 9), an application of the strong maximum principle shows that ψ in B x ), which implies that αv α x) αχx) + κ x R d. Since l is inf-compact, and the same is true for χ by its definition, this shows that αv α is inf-compact. In particular, it attains its infimum in R d. With η denoting the invariant probability measure of the diffusion in 5) under the control U =, using 8), we obtain 6) inf R d V α V α dη R d E x [ e αs lx s ) ds η dx) c l α, where the last inequality follows by 3). One more application of the maximum principle implies that if V α attains its infimum at ˆx R d then lˆx) αv α ˆx). This together with 6) implies part iii). Remark 2. We should mention, even though we do not need it for the proof of the main theorem, that 8) holds with equality, and thus V α is indeed the value of the infinite horizon discounted control problem. The proof of this assertion goes as follows. Since V α has at most linear growth, the diffusion in 5) under the Markov control v α = V α has a unique strong solution. It is also clear by 7) that for any α > we can select a constant κ α) such that V α x) κ α) + α 6x. Thus using a standard estimate Arapostathis, Borkar and Ghosh, 22, Theorem 2.2.2) we obtain [ 7) E vα x sup Xs) 2 κ 2 α) + t 2 ) + x 2 )e α 2 t s t
6 6 A. ARAPOSTATHIS, A. BISWAS, AND V. S. BORKAR for some constant κ 2 α) >. With τ R denoting the first exit time from B R, applying Dynkin s formula we obtain [ t τr V α x) = E vα x e αs [ RX s, v α X s )) ds + E vα x e αt τ R ) V α X t τr ). We write with [ E vα x e αt τ R ) V α X t τr ) = A t, R) + A 2 t, R), [ A t, R) := E vα x e αt V α X t τr ) {t τr }, A 2 t, R) := E vα x [ e ατ R V α X t τr ) {τr < t}. Since V α has at most linear growth in x by 7), it follows by 7) that lim t lim sup R A t, R) =. We also have lim sup R A 2 t, R) = by dominated convergence, since τr < t ) as R. Thus, taking limits first as R, and then P vα x as t in 7), we obtain V α x) E vα x [ Thus the converse inequality to 8) also holds. e αs RX s, v α X s )) ds. Define the class of controls U x by { [ T U x := U U : lim sup T T EU x RX s, U s ) ds } <. Lemma 3. There exists an inf-compact V C 2 R d ) which satisfies 8) A[V x) := 2 V + m, V 2 V 2 + l = β, with and β = β := inf U U x lim sup T [ T T EU x RX s, U s ) ds, 9) V x) c + x x R d, and for some positive constant c. In addition, under the Markov control U t = v X t ), with v = V, the diffusion in 5) is positive recurrent, and β = R R[v d x) dη, where η is the invariant probability measure corresponding to the control v.
7 SUPPLEMENT TO CONTROLLED EQUILIBRIUM SELECTION 7 Proof. The existence of a solution to 8) is established as a limit of V α ) V α ), along some sequence α n, where V α is the solution of 6) in Lemma Bensoussan and Frehse, 22, p. 75). That V is inf-compact follows by Bensoussan and Frehse, 22, Theorem 4.2). It also follows from the proof of this convergence result that β lim sup α αv α x) for all x R d. We first show that β β. For this, we employ the following assertion which is a special case of the Hardy Littlewood theorem Sznajder and Filar 992). For any sequence {a n } of non-negative real numbers, it holds that 2) lim sup θ θ) θ n a n n= lim sup N N N a n. n= Concerning this assertion, note that if the right hand side of 2) is finite, then the set { an n } is bounded. Therefore, n= θn a n is finite for every θ <. Hence, we can apply Sznajder and Filar, 992, Theorem 2.2) to obtain 2). Fix x R d, and U U x. Define [ n a n := E U x RX s, U s ) ds, n, n and let θ = e α. Applying 2), with N running over the set of natural numbers, we obtain 2) lim sup N [ N N EU x RX s, U s ) ds lim sup θ lim sup α lim sup α θ) n= θ n a n [ n ) e α ) E U x e αs RX s, U s ) ds n= n [ e α ) E U x e αs RX s, U s ) ds β. For the last inequality in 2), we use the fact that lim sup α αv α x) β. Since U U x is arbitrary, 2) together with the definition of β imply that β β. Note also that 2) implies that U α x U x for all α, ). Next, we prove the converse inequality. It is clear that 9) follows from 7). Therefore, since the Markov control v := V x) has at most linear
8 8 A. ARAPOSTATHIS, A. BISWAS, AND V. S. BORKAR growth, there exists a unique strong solution to 7) under the control v. Applying Itô s formula to 8), and using the notation R[vx) := R x, vx) ) = lx) + 2 vx) 2, we obtain [ E v x V XT τr ) [ T τr V x) + E x R[v X s ) ds = β E x [ T τr, where τ R denotes the exit time from the ball of radius R > centered at. Since V is bounded from below and τ R a.s., as R, by first using Fatou s lemma for the integral term in the above display, and then dividing by T and taking limits as T, we obtain lim sup T [ T T Ev x R[v X s ) ds β. Thus β = β. Since l is inf-compact, this also implies that the diffusion under the control v is positive recurrent, and by Birkhoff s ergodic theorem we obtain β = R d R[v x) dη. This completes the proof. and Let L: C 2 R d ) CR d R d ), and L v denote the operators defined by L[fx, u) := 2 fx) + mx) + u, fx), L v fx) := 2 fx) + mx) + vx), fx), f C 2 R d ), respectively. Also, let P denote the set of infinitesimal ergodic occupation measures, i.e., the set of probability measures π PR d R d ) which satisfy 22) L[fx, u) πdx, du) = f Cc R d ), R d R d where Cc R d ) denotes the class of real-valued smooth functions with compact support. Note that if π = η v v P then 22) can be written as R L d v fx) η v dx) =. Let ˆvx) = vdu x). Since 23) u 2 η v dx) vdu x) R d R d ˆvx) 2 η v dx), R d
9 SUPPLEMENT TO CONTROLLED EQUILIBRIUM SELECTION 9 and since η v ˆv is also an infinitesimal ergodic occupation measure, it is evident that as far as the proof of strong duality is concerned we may restrict our attention to the subset of P that corresponds to precise controls, which we denote as P. We have the following lemma. 24) then 25) Lemma 4. If π = η v v P is such that R d R[vx) η v dx) = β + 2 R d R d R[vx) η v dx) <, R d vx) + V x) 2 ηv dx). In addition the measure η v has a density ϱ v L d /d ) R d ). Proof. Let χ be a concave C 2 R d ) function such that χx) = x for x, and χx) = for x. Then χ and χ are nonnegative on, ). Define χ R x) := R + χx R) for R >. Using 8), and completing the square, we obtain L v V 2 v + V 2 + R[v β =. Applying L v to the function χ R V ), results in 26) L v χ R V ) 2 χ RV ) V 2 2 χ RV ) v + V 2 + χ RV )R[v χ RV )β =. Observe that χ R V ) R is compactly supported by construction. Thus R L d v χ R V x))η v dx) = for all R >. Since R lx)η d v dx) < by 24), the bound in ) shows that 27) V x) 2 η v dx) <. R d Integrating 26) with respect to η v, using 27), and passing to the limit as R, we obtain 25). We have thus shown that R d mx) + vx) 2 η v dx) <. By Theorem. in Bogachev, Krylov and Röckner 996), this implies that the measure η v has a density in L d /d ) R d ). This completes the proof.
10 A. ARAPOSTATHIS, A. BISWAS, AND V. S. BORKAR Proof of Theorem.4. Without loss of generality we assume ε =, and we suppress the explicit dependence on ε in the notation used in the theorem. The statement concerning existence of solutions and the behavior above and below a critical value for β follows by the results in Ichihara 2). For this, we need to first verify a Foster Lyapunov type hypothesis, which is part of the assumptions. Note that the operator F in Ichihara 2) has a negative sign in the Laplacian so that A[ϕ = F [ϕ, where A is the operator defined in 8). So, given that l is inf-compact, ϕ = is an obvious choice to satisfy A4) in Ichihara 2). Then of course A[ϕ as x. Note that Theorem 2.2 in Ichihara 2) then asserts that V is bounded below in R d. Next, consider ϕ = a V with a := inf K c m, V V, where K is as V 2 in Hypothesis. 3), and V is as in Lemma 2.3. Since V agrees with V outside some compact set by Lemma 2.3, it follows by Hypothesis. 3) that a >. Then we obtain 2 ϕ + m, ϕ 2 ϕ 2 = a 4 V V a a 4 V 2 m, V + a V V 4V V 2) ) V m, V on K c. Thus, since V is bounded by Hypothesis. 3b), we obtain A[ϕ as x. It is also clear that φ x) φ x) as x. Thus, Hypothesis A.4) in Ichihara 2) is also satisfied. Therefore, as shown in Ichihara, 2, Theorem 2.), there exists some critical value λ such that the HJB equation [ V + min m + u, V + l + 2 u R d 2 u 2 = β has no solution for β > λ. Also by Theorem 2.2 and Corollary 2.3 in Ichihara 2), if V is a solution for β < λ, then under the control v = V, the diffusion is transient. Moreover, for β = λ there exists a unique solution V = V up to an additive constant), and under the control v = V the diffusion X t = X + t mxs ) + vx s ) ) ds + W t, t, is positive recurrent. It is clear then that Lemma 3 implies that λ = β. We next turn to the proof of items a) e). Part a) follows directly by Metafune, Pallara and Rhandi, 25, Lemma 5.). Note that a sharper estimate was established in the proof of Lemma 3 when β = β. The uniqueness
11 SUPPLEMENT TO CONTROLLED EQUILIBRIUM SELECTION of the solution for β = β follows by the results in Ichihara 2, 22) discussed above, while the rest of the assertions in part b) follow by Lemma 3. Part c) follows by Lemma 4. We now turn to part d). It is enough to show that for any sequence {U n } Û and a sequence of times {t n} diverging to, 28) lim inf n [ tn E x RXs n, Us n ) ds t n β ε, where X n denotes the process controlled by U n. All the terms in 28) are finite, since T EU x [RX s, U s ds < for any U Û, a fact which clearly follows by 2). We include the dependence on the initial condition X n = x explicitly in the notation, and thus we denote the corresponding sequence of mean empirical measures by Φ U n x,t n. Recall that this is defined by R d R d fx, u) Φ U n x,t n dx, du) = E [ tn fx n s, U n s ) ds X n = x for all f C b R d U). Extract a subsequence of {t n } over which the terms on the left hand side of 28) converge to the lim inf and suppose without loss of generality that this limit is finite. Then the corresponding subsequence of mean empirical measures is tight. Let π P be any limit point of this subsequence. It follows that the left hand side of 28) is lower bounded by πr). However, πr) β by 23) and Lemma 4. This completes the proof of part d). It remains to prove part e). Let π = η v v P be any optimal ergodic occupation measure, and π := η v, with v = V. By Lemma 4, η v has density, which we denote by ρ v. Let ξ v := ρ v ρ v + ρ, and ξ := ρ ρ v + ρ, and also define v := ξ v v + ξ v and η := 2 η v + η ). Using the property that the drift of ) is an affine function of the control, together with Arapostathis, Borkar and Ghosh, 22, Lemma 3.2.3), it is straightforward to verify that η v P.
12 2 A. ARAPOSTATHIS, A. BISWAS, AND V. S. BORKAR By optimality, we have 29) 2 R[ v d η R[v dη v R[v dη R d R d R d = = ξ v v + ξ v 2 d η R d 2 v 2 dη v R d 2 v 2 dη R d ξ v v + ξ v 2 ξ v v 2 ξ v 2) d η R d = 2 R d ρ v x) ρ x) ρ v x) + ρ x) vx) v x) 2 dx. Since ρ is strictly positive, 29) implies that ρ v v v = a.e. in R d, and thus v = v on the support of η v. It is clear that if v is modified outside the support of η v, then the modified η v v is also an infinitesimal ergodic occupation measure. Therefore η v v P. The uniqueness of the invariant measure of the diffusion with generator L v then implies that η v = η, which in turn implies since v = v on the support of η v ) that v = V a.e. in R d. This completes the proof of part e), and also of the theorem. 2. Proofs of Lemma.7 and Theorem.9. We start with the proof of Lemma.7. Proof of Lemma.7. Suppose that M has a number q of eigenvalues on the open right half complex plane. Using a similarity transformation we can transform M to a matrix of the form diagm, M 2 ) where M R d q) d q) and M 2 R q q are Hurwitz matrices. So without loss of generality, we assume M has this form. Let S and S 2 be the unique symmetric positive definite matrices solving the Lyapunov equations S M + M T S = I, and S 2 M 2 + M T 2 S 2 = I, respectively. Extend these to symmetric matrices in R d d by defining S = diags, ) and S 2 = diag, S 2 ), and also define, for α >, ϕ x) := e α x, S x, ϕ 2 x) := e α x, S 2 x, and ϕ := + ϕ ϕ 2. Let T = diagi d q) d q), q q ), and T 2 = diag d q) d q), I q q ). Then,
13 SUPPLEMENT TO CONTROLLED EQUILIBRIUM SELECTION 3 with L v fx) := 2 fx) + Mx + vx), fx), we obtain L v ϕ2 x) ) 3) = αϕ 2 x) trace S 2 ) 2α x, S 2x 2 + T 2 x vx), S ) 2 x αϕ 2 x) trace S 2 ) + T 2 x 2 2 T 2x 2 For the inequality in 3) we use 2α S 2 2 T 2 x 2 2 S 2 2 vx) 2) = αϕ 2 x) traces 2 ) + 2 2α S 2 2) T 2 x 2 2 S 2 2 vx) 2). 2 vx), S 2 x = 2 S2 vx), T 2 x T 2 x S2 vx) 2 2 T 2x 2 2 S 2 2 vx) 2. Using the analogous inequality for L v ϕ x) and combining the equations we obtain 3) L v ϕx) αe α x, S x traces ) α S 2) T x 2 2 S 2 T vx) 2) + αe α x, S 2 x traces 2 ) + 2 2α S 2 2) T 2 x 2 2 S 2 2 T 2 vx) 2) α traces ) + e α x,sx 2 2α S 2) x 2 2 S 2 vx) 2), with S := diags, S 2 ). Applying Itô s formula to 3), dividing by α, and also using the fact that ϕ and ϕ = 2, we obtain E x [ T traces ) + e α Xt,SXt 2 2α S 2) X t 2 2 S 2 vx t ) 2) dt 2 α.
14 4 A. ARAPOSTATHIS, A. BISWAS, AND V. S. BORKAR Dividing by T, letting T and rearranging terms, we conclude that e α x,sx x 2 is integrable with respect to invariant probability measure µ v under the control v for any α <, and the following bound holds 4 S 2 e α x,sx x 2 µ v dx) traces ) 2 S 2 R d + 2 2α S 2 2 vx) 2 µ v dx). 2α S 2 R d Taking limits as α, using monotone convergence, we obtain x 2 µ v dx) 2 traces ) + 4 S 2 vx) 2 µ v dx). R d R d The proof is complete. Proof Theorem.9. It is well known Brockett, 97, Theorem 3, p. 5) that there exists at most one symmetric matrix Q satisfying 32) M T Q + QM = Q 2 and 33) M Q)Σ + ΣM Q) T = I. For κ >, consider the ergodic control problem of minimizing [ T 34) J κ v) := lim sup T T E κ X s vx s) 2) ds, over v U SSM, subject to the linear controlled diffusion 35) X t = X + t MXs + vx s ) ) ds + W t, t. As is also well known, an optimal stationary Markov control for this problem takes the form vx) = Q κ x, where Q κ is the unique positive definite symmetric solution to the matrix Riccati equation 36) Q 2 κ M T Q κ Q κ M = 2 κi. Moreover, Q κ has the following property. Consider a deterministic linear control system ẋt) = Mxt) + ut), with x, u R d, and initial condition x) = x. Let U denote the space of controls u satisfying T ut) 2 dt < for all T >, and φ u t x ) denote the solution of the differential equation under a control u U. Then 37) x, Q κ x = min u U ut) 2 + 2κ φ u t x ) 2) dt.
15 SUPPLEMENT TO CONTROLLED EQUILIBRIUM SELECTION 5 For these assertions, see Brockett, 97, Theorem, p. 47, and Theorem 5, p. 5). On the other hand, Ψ κ x) = 2 x, Qκ x is a solution of the associated HJB equation 38) 2 Ψ κx)+ min u R d [ Mx+u, Ψκ x) + 2 u 2 +κ x 2 = 2 traceq κ). The HJB equation 38) characterizes the optimal cost, i.e., inf J κ v) = 2 traceq κ). v U SSM Let GM), M R d d, denote the collection of all matrices G R d d such that M G is Hurwitz. Also, for G GM), let Σ G denote the unique) symmetric solution of the Lyapunov equation 39) M G) Σ G + Σ G M G) T = I, and define 4) J G M) := 2 trace G Σ G G T), J M) := inf J GM). G GM) Since the stationary probability distribution of 35) under the control vx) = Q κ x is Gaussian, it follows by 34) that G = Q κ minimizes J G;κ M) := κ trace Σ G ) + 2 trace G Σ G G T) over all matrices G GM), where Σ G is as in 39) note that J G; M) = J G M) which is the right hand side of 4)). Combining this with 38), we obtain 4) inf G GM) By Lemma.7, we have 42) J G;κ M) = traceσ Qκ ) J Qκ;κM) = 2 traceq κ). C + JQκ;κM) ) = C + 2 traceq κ) ). It also follows by 37) that Q κ Q κ is nonnegative definite if κ κ. Therefore Q κ has a unique limit Q as κ. It is evident that Q is nonnegative semidefinite, and 36) shows that it satisfies 32). Since traceσ Qκ )
16 6 A. ARAPOSTATHIS, A. BISWAS, AND V. S. BORKAR is bounded by 42), it follows that Σ Qκ converges along some subsequence κ n to a symmetric positive semidefinite matrix Σ. Thus 33) holds. However, 33) implies that Σ is invertible, and therefore, it is positive definite. In turn, 33) implies that M Q is Hurwitz. Since v G x) = Gx, G GM), is in general suboptimal for the criterion J κ v), applying Lemma.7 once more, we obtain J Qκ M) Therefore, we have J Qκ;κM) κ C + JG M) ) + J G M) G GM). J M) J Qκ;κM) κ C + J M) ) + J M), and taking limits as κ, this implies by 4) that J M) = 2 traceq). It remains to show that Λ + M) = 2 traceq). Let T be a unitary matrix such that Q := T QT T takes the form Q = diag, Q 2 ), with Q 2 R q q a positive definite matrix, for some q d. Write the corresponding block structure of T MT T as ) M := T MT T = M M2 with M 22 R q q. Since M T Q+QM = Q 2, we obtain M T Q+ Q M = Q2, and block multiplication shows that Q 2 M2 =, which implies that M 2 =. Since M Q is similar to M Q, the latter must be Hurwitz, which implies that M is Hurwitz. By block multiplication we have M 2 43) M T 22 Q2 + Q 2 M22 = Q 2 2. Since Q 2 is positive definite, the matrix M 22 is Hurwitz by the Lyapunov theorem. Thus Λ + M) = trace M 22 ), since M is Hurwitz. Therefore, since Q 2 is invertible, and traceq) = trace Q), we obtain by 43) that M22 traceq) = trace Q 2 ) = trace M T 22 + M 22 ) = 2 trace M 22 ) = 2Λ + M). This proves part a). Now let ˆv U SSM be any control. Let V x) = 2 x, Qx. Then V satisfies 38) with κ =. Since [ Mx min + u, V x) + u R d 2 u 2 = Mx, V x) 2 Qx 2, = Mx + ˆvx), V x) + 2 ˆvx) 2 Qx + ˆvx) 2, 2
17 we obtain SUPPLEMENT TO CONTROLLED EQUILIBRIUM SELECTION 7 44) 2 V x) + Mx + ˆvx), V x) + 2 ˆvx) 2 = 2 traceq) + 2 Qx + ˆvx) 2. Applying Itô s formula to 44), and using the fact that µˆv has finite second moments as shown in Lemma.7, and V is quadratic, a standard argument gives 45) 2 ˆvx) 2 2 Qx + ˆvx) 2) µˆv dx) = 2 traceq). R d Thus R d 2 ˆvx) 2 µˆv dx) 2 traceq) = J M). Therefore, we have 46) inf v U SSM R d 2 vx) 2 µ v dx) = Λ + M). Suppose ˆv is optimal, i.e., attains the infimum in 46). By 45), we obtain R d Qx + ˆvx) 2 µˆv dx) =. Therefore, since µˆv has a positive density, it holds that ˆvx) = Qx a.e. in R d. This completes the proof of part b). We have already shown that V x) = 2 x, Qx satisfies 2 V x) + Mx, V x) V x) 2 = Λ + M), 2 and that the associated process is positive recurrent. Therefore, as in the proof of Theorem.4 for a bounded m, part c) follows by Theorems and Corollary 2.3 in Ichihara 2). Note that Hypothesis A4) in Ichihara 2) is easily satisfied for the linear problem. Indeed, since M is exponentially dichotomous, then as seen in the proof of Theorem 2.2, there exist symmetric matrices S and Ŝ, with Ŝ positive definite such that M T S +SM = Ŝ. Consider the function ϕ x) := a x, Sx, with a := 4 Ŝ S 2). Since Ŝ x, Ŝx x 2 S 2 Sx 2, we obtain Ā[ϕ x) := 2 ϕ x) + Mx, ϕ x) 2 ϕ x) 2 = a trace S + a x, Ŝx 2a2 Sx 2 > a 2 2 trace S+ x, Ŝx ). Thus Ā[ϕ x) as x. This completes the proof.
18 8 A. ARAPOSTATHIS, A. BISWAS, AND V. S. BORKAR References. Arapostathis, A., Borkar, V. S. and Ghosh, M. K. 22). Ergodic control of diffusion processes. Encyclopedia of Mathematics and its Applications 43. Cambridge University Press, Cambridge. Bensoussan, A. and Frehse, J. 22). Regularity results for nonlinear elliptic systems and applications. Applied Mathematical Sciences 5. Springer-Verlag, Berlin. Bogachev, V. I., Krylov, N. and Röckner, M. 996). Regularity of invariant measures: the case of non-constant diffusion part. J. Funct. Anal Brockett, R. W. 97). Finite dimensional linear systems. John Wiley & Sons. Ichihara, N. 2). Recurrence and transience of optimal feedback processes associated with Bellman equations of ergodic type. SIAM J. Control Optim Ichihara, N. 22). Large time asymptotic problems for optimal stochastic control with superlinear cost. Stochastic Process. Appl Metafune, G., Pallara, D. and Rhandi, A. 25). Global properties of invariant measures. J. Funct. Anal Sznajder, R. and Filar, J. A. 992). Some comments on a theorem of Hardy and Littlewood. J. Optim. Theory Appl Dept. of Electrical and Computer Eng. The University of Texas at Austin 25 Speedway, EER Austin, TX ari@ece.utexas.edu Department of Electrical Engineering Indian Institute of Technology Powai, Mumbai, India borkar@ee.iitb.ac.in Indian Institute of Science Education and Research Dr. Homi Bhabha Road Pune 48, India anup@iiserpune.ac.in
b i (µ, x, s) ei ϕ(x) µ s (dx) ds (2) i=1
NONLINEAR EVOLTION EQATIONS FOR MEASRES ON INFINITE DIMENSIONAL SPACES V.I. Bogachev 1, G. Da Prato 2, M. Röckner 3, S.V. Shaposhnikov 1 The goal of this work is to prove the existence of a solution to
More informationLarge deviations and averaging for systems of slow fast stochastic reaction diffusion equations.
Large deviations and averaging for systems of slow fast stochastic reaction diffusion equations. Wenqing Hu. 1 (Joint work with Michael Salins 2, Konstantinos Spiliopoulos 3.) 1. Department of Mathematics
More informationOn Ergodic Impulse Control with Constraint
On Ergodic Impulse Control with Constraint Maurice Robin Based on joint papers with J.L. Menaldi University Paris-Sanclay 9119 Saint-Aubin, France (e-mail: maurice.robin@polytechnique.edu) IMA, Minneapolis,
More informationLaplace s Equation. Chapter Mean Value Formulas
Chapter 1 Laplace s Equation Let be an open set in R n. A function u C 2 () is called harmonic in if it satisfies Laplace s equation n (1.1) u := D ii u = 0 in. i=1 A function u C 2 () is called subharmonic
More informationTHE VALUE FUNCTION IN ERGODIC CONTROL OF DIFFUSION PROCESSES WITH PARTIAL OBSERVATIONS II
APPLICATIONES MATHEMATICAE 27,4(2), pp. 455 464 V.S.BORKAR(Mumbai) THE VALUE FUNCTION IN ERGODIC CONTROL OF DIFFUSION PROCESSES WITH PARTIAL OBSERVATIONS II Abstract. The problem of minimizing the ergodic
More informationON THE POLICY IMPROVEMENT ALGORITHM IN CONTINUOUS TIME
ON THE POLICY IMPROVEMENT ALGORITHM IN CONTINUOUS TIME SAUL D. JACKA AND ALEKSANDAR MIJATOVIĆ Abstract. We develop a general approach to the Policy Improvement Algorithm (PIA) for stochastic control problems
More information1 The Observability Canonical Form
NONLINEAR OBSERVERS AND SEPARATION PRINCIPLE 1 The Observability Canonical Form In this Chapter we discuss the design of observers for nonlinear systems modelled by equations of the form ẋ = f(x, u) (1)
More informationHarmonic Functions and Brownian motion
Harmonic Functions and Brownian motion Steven P. Lalley April 25, 211 1 Dynkin s Formula Denote by W t = (W 1 t, W 2 t,..., W d t ) a standard d dimensional Wiener process on (Ω, F, P ), and let F = (F
More informationLecture No 1 Introduction to Diffusion equations The heat equat
Lecture No 1 Introduction to Diffusion equations The heat equation Columbia University IAS summer program June, 2009 Outline of the lectures We will discuss some basic models of diffusion equations and
More informationPartial Differential Equations
Part II Partial Differential Equations Year 2015 2014 2013 2012 2011 2010 2009 2008 2007 2006 2005 2015 Paper 4, Section II 29E Partial Differential Equations 72 (a) Show that the Cauchy problem for u(x,
More informationA variational formula for risk-sensitive control
A variational formula for risk-sensitive control Vivek S. Borkar, IIT Bombay May 9, 2018, IMA, Minneapolis PART I: Risk-sensitive reward for Markov chains (joint work with V. Anantharam, Uni. of California,
More informationStochastic optimal control with rough paths
Stochastic optimal control with rough paths Paul Gassiat TU Berlin Stochastic processes and their statistics in Finance, Okinawa, October 28, 2013 Joint work with Joscha Diehl and Peter Friz Introduction
More informationContinuous dependence estimates for the ergodic problem with an application to homogenization
Continuous dependence estimates for the ergodic problem with an application to homogenization Claudio Marchi Bayreuth, September 12 th, 2013 C. Marchi (Università di Padova) Continuous dependence Bayreuth,
More informationSHARP BOUNDARY TRACE INEQUALITIES. 1. Introduction
SHARP BOUNDARY TRACE INEQUALITIES GILES AUCHMUTY Abstract. This paper describes sharp inequalities for the trace of Sobolev functions on the boundary of a bounded region R N. The inequalities bound (semi-)norms
More informationNonlinear Control. Nonlinear Control Lecture # 3 Stability of Equilibrium Points
Nonlinear Control Lecture # 3 Stability of Equilibrium Points The Invariance Principle Definitions Let x(t) be a solution of ẋ = f(x) A point p is a positive limit point of x(t) if there is a sequence
More informationA Concise Course on Stochastic Partial Differential Equations
A Concise Course on Stochastic Partial Differential Equations Michael Röckner Reference: C. Prevot, M. Röckner: Springer LN in Math. 1905, Berlin (2007) And see the references therein for the original
More informationAsymptotics of minimax stochastic programs
Asymptotics of minimax stochastic programs Alexander Shapiro Abstract. We discuss in this paper asymptotics of the sample average approximation (SAA) of the optimal value of a minimax stochastic programming
More informationRégularité des équations de Hamilton-Jacobi du premier ordre et applications aux jeux à champ moyen
Régularité des équations de Hamilton-Jacobi du premier ordre et applications aux jeux à champ moyen Daniela Tonon en collaboration avec P. Cardaliaguet et A. Porretta CEREMADE, Université Paris-Dauphine,
More informationThuong Nguyen. SADCO Internal Review Metting
Asymptotic behavior of singularly perturbed control system: non-periodic setting Thuong Nguyen (Joint work with A. Siconolfi) SADCO Internal Review Metting Rome, Nov 10-12, 2014 Thuong Nguyen (Roma Sapienza)
More informationUniformly Uniformly-ergodic Markov chains and BSDEs
Uniformly Uniformly-ergodic Markov chains and BSDEs Samuel N. Cohen Mathematical Institute, University of Oxford (Based on joint work with Ying Hu, Robert Elliott, Lukas Szpruch) Centre Henri Lebesgue,
More informationRichard F. Bass Krzysztof Burdzy University of Washington
ON DOMAIN MONOTONICITY OF THE NEUMANN HEAT KERNEL Richard F. Bass Krzysztof Burdzy University of Washington Abstract. Some examples are given of convex domains for which domain monotonicity of the Neumann
More information1 Lyapunov theory of stability
M.Kawski, APM 581 Diff Equns Intro to Lyapunov theory. November 15, 29 1 1 Lyapunov theory of stability Introduction. Lyapunov s second (or direct) method provides tools for studying (asymptotic) stability
More informationTHE MULTIPLICATIVE ERGODIC THEOREM OF OSELEDETS
THE MULTIPLICATIVE ERGODIC THEOREM OF OSELEDETS. STATEMENT Let (X, µ, A) be a probability space, and let T : X X be an ergodic measure-preserving transformation. Given a measurable map A : X GL(d, R),
More informationOn a Class of Multidimensional Optimal Transportation Problems
Journal of Convex Analysis Volume 10 (2003), No. 2, 517 529 On a Class of Multidimensional Optimal Transportation Problems G. Carlier Université Bordeaux 1, MAB, UMR CNRS 5466, France and Université Bordeaux
More informationDynamical systems with Gaussian and Levy noise: analytical and stochastic approaches
Dynamical systems with Gaussian and Levy noise: analytical and stochastic approaches Noise is often considered as some disturbing component of the system. In particular physical situations, noise becomes
More informationNonlinear stabilization via a linear observability
via a linear observability Kaïs Ammari Department of Mathematics University of Monastir Joint work with Fathia Alabau-Boussouira Collocated feedback stabilization Outline 1 Introduction and main result
More informationScaling Limits of Waves in Convex Scalar Conservation Laws under Random Initial Perturbations
Scaling Limits of Waves in Convex Scalar Conservation Laws under Random Initial Perturbations Jan Wehr and Jack Xin Abstract We study waves in convex scalar conservation laws under noisy initial perturbations.
More informationZero-sum semi-markov games in Borel spaces: discounted and average payoff
Zero-sum semi-markov games in Borel spaces: discounted and average payoff Fernando Luque-Vásquez Departamento de Matemáticas Universidad de Sonora México May 2002 Abstract We study two-person zero-sum
More informationHalf of Final Exam Name: Practice Problems October 28, 2014
Math 54. Treibergs Half of Final Exam Name: Practice Problems October 28, 24 Half of the final will be over material since the last midterm exam, such as the practice problems given here. The other half
More informationA new approach for investment performance measurement. 3rd WCMF, Santa Barbara November 2009
A new approach for investment performance measurement 3rd WCMF, Santa Barbara November 2009 Thaleia Zariphopoulou University of Oxford, Oxford-Man Institute and The University of Texas at Austin 1 Performance
More informationElliptic Operators with Unbounded Coefficients
Elliptic Operators with Unbounded Coefficients Federica Gregorio Universitá degli Studi di Salerno 8th June 2018 joint work with S.E. Boutiah, A. Rhandi, C. Tacelli Motivation Consider the Stochastic Differential
More informationINFINITE TIME HORIZON OPTIMAL CONTROL OF THE SEMILINEAR HEAT EQUATION
Nonlinear Funct. Anal. & Appl., Vol. 7, No. (22), pp. 69 83 INFINITE TIME HORIZON OPTIMAL CONTROL OF THE SEMILINEAR HEAT EQUATION Mihai Sîrbu Abstract. We consider here the infinite horizon control problem
More informationPDEs in Image Processing, Tutorials
PDEs in Image Processing, Tutorials Markus Grasmair Vienna, Winter Term 2010 2011 Direct Methods Let X be a topological space and R: X R {+ } some functional. following definitions: The mapping R is lower
More informationGLOBAL ATTRACTIVITY IN A CLASS OF NONMONOTONE REACTION-DIFFUSION EQUATIONS WITH TIME DELAY
CANADIAN APPLIED MATHEMATICS QUARTERLY Volume 17, Number 1, Spring 2009 GLOBAL ATTRACTIVITY IN A CLASS OF NONMONOTONE REACTION-DIFFUSION EQUATIONS WITH TIME DELAY XIAO-QIANG ZHAO ABSTRACT. The global attractivity
More informationMaximum Process Problems in Optimal Control Theory
J. Appl. Math. Stochastic Anal. Vol. 25, No., 25, (77-88) Research Report No. 423, 2, Dept. Theoret. Statist. Aarhus (2 pp) Maximum Process Problems in Optimal Control Theory GORAN PESKIR 3 Given a standard
More informationSome lecture notes for Math 6050E: PDEs, Fall 2016
Some lecture notes for Math 65E: PDEs, Fall 216 Tianling Jin December 1, 216 1 Variational methods We discuss an example of the use of variational methods in obtaining existence of solutions. Theorem 1.1.
More informationThe principle of least action and two-point boundary value problems in orbital mechanics
The principle of least action and two-point boundary value problems in orbital mechanics Seung Hak Han and William M McEneaney Abstract We consider a two-point boundary value problem (TPBVP) in orbital
More informationOn an uniqueness theorem for characteristic functions
ISSN 392-53 Nonlinear Analysis: Modelling and Control, 207, Vol. 22, No. 3, 42 420 https://doi.org/0.5388/na.207.3.9 On an uniqueness theorem for characteristic functions Saulius Norvidas Institute of
More informationMeasure and Integration: Solutions of CW2
Measure and Integration: s of CW2 Fall 206 [G. Holzegel] December 9, 206 Problem of Sheet 5 a) Left (f n ) and (g n ) be sequences of integrable functions with f n (x) f (x) and g n (x) g (x) for almost
More informationIntroduction to Nonlinear Control Lecture # 3 Time-Varying and Perturbed Systems
p. 1/5 Introduction to Nonlinear Control Lecture # 3 Time-Varying and Perturbed Systems p. 2/5 Time-varying Systems ẋ = f(t, x) f(t, x) is piecewise continuous in t and locally Lipschitz in x for all t
More informationHOPF S DECOMPOSITION AND RECURRENT SEMIGROUPS. Josef Teichmann
HOPF S DECOMPOSITION AND RECURRENT SEMIGROUPS Josef Teichmann Abstract. Some results of ergodic theory are generalized in the setting of Banach lattices, namely Hopf s maximal ergodic inequality and the
More information3 (Due ). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure?
MA 645-4A (Real Analysis), Dr. Chernov Homework assignment 1 (Due ). Show that the open disk x 2 + y 2 < 1 is a countable union of planar elementary sets. Show that the closed disk x 2 + y 2 1 is a countable
More informationLecture 8. Chapter 5: Input-Output Stability Chapter 6: Passivity Chapter 14: Passivity-Based Control. Eugenio Schuster.
Lecture 8 Chapter 5: Input-Output Stability Chapter 6: Passivity Chapter 14: Passivity-Based Control Eugenio Schuster schuster@lehigh.edu Mechanical Engineering and Mechanics Lehigh University Lecture
More informationLyapunov Stability Theory
Lyapunov Stability Theory Peter Al Hokayem and Eduardo Gallestey March 16, 2015 1 Introduction In this lecture we consider the stability of equilibrium points of autonomous nonlinear systems, both in continuous
More informationOn the bang-bang property of time optimal controls for infinite dimensional linear systems
On the bang-bang property of time optimal controls for infinite dimensional linear systems Marius Tucsnak Université de Lorraine Paris, 6 janvier 2012 Notation and problem statement (I) Notation: X (the
More informationLINEAR-CONVEX CONTROL AND DUALITY
1 LINEAR-CONVEX CONTROL AND DUALITY R.T. Rockafellar Department of Mathematics, University of Washington Seattle, WA 98195-4350, USA Email: rtr@math.washington.edu R. Goebel 3518 NE 42 St., Seattle, WA
More informationarxiv: v1 [math.oc] 9 Oct 2018
A Convex Optimization Approach to Dynamic Programming in Continuous State and Action Spaces Insoon Yang arxiv:1810.03847v1 [math.oc] 9 Oct 2018 Abstract A convex optimization-based method is proposed to
More informationVariational approach to mean field games with density constraints
1 / 18 Variational approach to mean field games with density constraints Alpár Richárd Mészáros LMO, Université Paris-Sud (based on ongoing joint works with F. Santambrogio, P. Cardaliaguet and F. J. Silva)
More informationPresenter: Noriyoshi Fukaya
Y. Martel, F. Merle, and T.-P. Tsai, Stability and Asymptotic Stability in the Energy Space of the Sum of N Solitons for Subcritical gkdv Equations, Comm. Math. Phys. 31 (00), 347-373. Presenter: Noriyoshi
More informationAsymptotic stability of an evolutionary nonlinear Boltzmann-type equation
Acta Polytechnica Hungarica Vol. 14, No. 5, 217 Asymptotic stability of an evolutionary nonlinear Boltzmann-type equation Roksana Brodnicka, Henryk Gacki Institute of Mathematics, University of Silesia
More informationIntroduction to Random Diffusions
Introduction to Random Diffusions The main reason to study random diffusions is that this class of processes combines two key features of modern probability theory. On the one hand they are semi-martingales
More informationAn introduction to Mathematical Theory of Control
An introduction to Mathematical Theory of Control Vasile Staicu University of Aveiro UNICA, May 2018 Vasile Staicu (University of Aveiro) An introduction to Mathematical Theory of Control UNICA, May 2018
More informationApplied Math Qualifying Exam 11 October Instructions: Work 2 out of 3 problems in each of the 3 parts for a total of 6 problems.
Printed Name: Signature: Applied Math Qualifying Exam 11 October 2014 Instructions: Work 2 out of 3 problems in each of the 3 parts for a total of 6 problems. 2 Part 1 (1) Let Ω be an open subset of R
More informationHypoelliptic multiscale Langevin diffusions and Slow fast stochastic reaction diffusion equations.
Hypoelliptic multiscale Langevin diffusions and Slow fast stochastic reaction diffusion equations. Wenqing Hu. 1 (Joint works with Michael Salins 2 and Konstantinos Spiliopoulos 3.) 1. Department of Mathematics
More informationA MODEL FOR THE LONG-TERM OPTIMAL CAPACITY LEVEL OF AN INVESTMENT PROJECT
A MODEL FOR HE LONG-ERM OPIMAL CAPACIY LEVEL OF AN INVESMEN PROJEC ARNE LØKKA AND MIHAIL ZERVOS Abstract. We consider an investment project that produces a single commodity. he project s operation yields
More informationNonlinear Elliptic Systems and Mean-Field Games
Nonlinear Elliptic Systems and Mean-Field Games Martino Bardi and Ermal Feleqi Dipartimento di Matematica Università di Padova via Trieste, 63 I-35121 Padova, Italy e-mail: bardi@math.unipd.it and feleqi@math.unipd.it
More informationApproximating a Diffusion by a Finite-State Hidden Markov Model
Approximating a Diffusion by a Finite-State Hidden Markov Model I. Kontoyiannis S.P. Meyn November 28, 216 Abstract For a wide class of continuous-time Markov processes evolving on an open, connected subset
More informationSobolev embeddings and interpolations
embed2.tex, January, 2007 Sobolev embeddings and interpolations Pavel Krejčí This is a second iteration of a text, which is intended to be an introduction into Sobolev embeddings and interpolations. The
More informationDuality and dynamics in Hamilton-Jacobi theory for fully convex problems of control
Duality and dynamics in Hamilton-Jacobi theory for fully convex problems of control RTyrrell Rockafellar and Peter R Wolenski Abstract This paper describes some recent results in Hamilton- Jacobi theory
More informationBrownian Motion. 1 Definition Brownian Motion Wiener measure... 3
Brownian Motion Contents 1 Definition 2 1.1 Brownian Motion................................. 2 1.2 Wiener measure.................................. 3 2 Construction 4 2.1 Gaussian process.................................
More informationON THE HÖLDER CONTINUITY OF MATRIX FUNCTIONS FOR NORMAL MATRICES
Volume 10 (2009), Issue 4, Article 91, 5 pp. ON THE HÖLDER CONTINUITY O MATRIX UNCTIONS OR NORMAL MATRICES THOMAS P. WIHLER MATHEMATICS INSTITUTE UNIVERSITY O BERN SIDLERSTRASSE 5, CH-3012 BERN SWITZERLAND.
More informationSobolev Spaces. Chapter 10
Chapter 1 Sobolev Spaces We now define spaces H 1,p (R n ), known as Sobolev spaces. For u to belong to H 1,p (R n ), we require that u L p (R n ) and that u have weak derivatives of first order in L p
More informationEXISTENCE OF SOLUTIONS TO ASYMPTOTICALLY PERIODIC SCHRÖDINGER EQUATIONS
Electronic Journal of Differential Equations, Vol. 017 (017), No. 15, pp. 1 7. ISSN: 107-6691. URL: http://ejde.math.txstate.edu or http://ejde.math.unt.edu EXISTENCE OF SOLUTIONS TO ASYMPTOTICALLY PERIODIC
More informationu xx + u yy = 0. (5.1)
Chapter 5 Laplace Equation The following equation is called Laplace equation in two independent variables x, y: The non-homogeneous problem u xx + u yy =. (5.1) u xx + u yy = F, (5.) where F is a function
More informationStrong uniqueness for stochastic evolution equations with possibly unbounded measurable drift term
1 Strong uniqueness for stochastic evolution equations with possibly unbounded measurable drift term Enrico Priola Torino (Italy) Joint work with G. Da Prato, F. Flandoli and M. Röckner Stochastic Processes
More informationThe heat equation in time dependent domains with Neumann boundary conditions
The heat equation in time dependent domains with Neumann boundary conditions Chris Burdzy Zhen-Qing Chen John Sylvester Abstract We study the heat equation in domains in R n with insulated fast moving
More informationWeak convergence and large deviation theory
First Prev Next Go To Go Back Full Screen Close Quit 1 Weak convergence and large deviation theory Large deviation principle Convergence in distribution The Bryc-Varadhan theorem Tightness and Prohorov
More informationTHEOREMS, ETC., FOR MATH 515
THEOREMS, ETC., FOR MATH 515 Proposition 1 (=comment on page 17). If A is an algebra, then any finite union or finite intersection of sets in A is also in A. Proposition 2 (=Proposition 1.1). For every
More informationA CONVEX-CONCAVE ELLIPTIC PROBLEM WITH A PARAMETER ON THE BOUNDARY CONDITION
A CONVEX-CONCAVE ELLIPTIC PROBLEM WITH A PARAMETER ON THE BOUNDARY CONDITION JORGE GARCÍA-MELIÁN, JULIO D. ROSSI AND JOSÉ C. SABINA DE LIS Abstract. In this paper we study existence and multiplicity of
More informationMath The Laplacian. 1 Green s Identities, Fundamental Solution
Math. 209 The Laplacian Green s Identities, Fundamental Solution Let be a bounded open set in R n, n 2, with smooth boundary. The fact that the boundary is smooth means that at each point x the external
More informationAn iterative procedure for constructing subsolutions of discrete-time optimal control problems
An iterative procedure for constructing subsolutions of discrete-time optimal control problems Markus Fischer version of November, 2011 Abstract An iterative procedure for constructing subsolutions of
More informationMulti-dimensional Stochastic Singular Control Via Dynkin Game and Dirichlet Form
Multi-dimensional Stochastic Singular Control Via Dynkin Game and Dirichlet Form Yipeng Yang * Under the supervision of Dr. Michael Taksar Department of Mathematics University of Missouri-Columbia Oct
More informationExponential stability of families of linear delay systems
Exponential stability of families of linear delay systems F. Wirth Zentrum für Technomathematik Universität Bremen 28334 Bremen, Germany fabian@math.uni-bremen.de Keywords: Abstract Stability, delay systems,
More informationMean Field Games on networks
Mean Field Games on networks Claudio Marchi Università di Padova joint works with: S. Cacace (Rome) and F. Camilli (Rome) C. Marchi (Univ. of Padova) Mean Field Games on networks Roma, June 14 th, 2017
More information2 (Bonus). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure?
MA 645-4A (Real Analysis), Dr. Chernov Homework assignment 1 (Due 9/5). Prove that every countable set A is measurable and µ(a) = 0. 2 (Bonus). Let A consist of points (x, y) such that either x or y is
More informationVISCOSITY SOLUTIONS. We follow Han and Lin, Elliptic Partial Differential Equations, 5.
VISCOSITY SOLUTIONS PETER HINTZ We follow Han and Lin, Elliptic Partial Differential Equations, 5. 1. Motivation Throughout, we will assume that Ω R n is a bounded and connected domain and that a ij C(Ω)
More informationOPTIMAL SCALING FOR P -NORMS AND COMPONENTWISE DISTANCE TO SINGULARITY
published in IMA Journal of Numerical Analysis (IMAJNA), Vol. 23, 1-9, 23. OPTIMAL SCALING FOR P -NORMS AND COMPONENTWISE DISTANCE TO SINGULARITY SIEGFRIED M. RUMP Abstract. In this note we give lower
More informationfor all subintervals I J. If the same is true for the dyadic subintervals I D J only, we will write ϕ BMO d (J). In fact, the following is true
3 ohn Nirenberg inequality, Part I A function ϕ L () belongs to the space BMO() if sup ϕ(s) ϕ I I I < for all subintervals I If the same is true for the dyadic subintervals I D only, we will write ϕ BMO
More informationOn Stopping Times and Impulse Control with Constraint
On Stopping Times and Impulse Control with Constraint Jose Luis Menaldi Based on joint papers with M. Robin (216, 217) Department of Mathematics Wayne State University Detroit, Michigan 4822, USA (e-mail:
More information2 Statement of the problem and assumptions
Mathematical Notes, 25, vol. 78, no. 4, pp. 466 48. Existence Theorem for Optimal Control Problems on an Infinite Time Interval A.V. Dmitruk and N.V. Kuz kina We consider an optimal control problem on
More informationProbability and Measure
Part II Year 2018 2017 2016 2015 2014 2013 2012 2011 2010 2009 2008 2007 2006 2005 2018 84 Paper 4, Section II 26J Let (X, A) be a measurable space. Let T : X X be a measurable map, and µ a probability
More informationParameter Dependent Quasi-Linear Parabolic Equations
CADERNOS DE MATEMÁTICA 4, 39 33 October (23) ARTIGO NÚMERO SMA#79 Parameter Dependent Quasi-Linear Parabolic Equations Cláudia Buttarello Gentile Departamento de Matemática, Universidade Federal de São
More informationOn some weighted fractional porous media equations
On some weighted fractional porous media equations Gabriele Grillo Politecnico di Milano September 16 th, 2015 Anacapri Joint works with M. Muratori and F. Punzo Gabriele Grillo Weighted Fractional PME
More informationNONTRIVIAL SOLUTIONS TO INTEGRAL AND DIFFERENTIAL EQUATIONS
Fixed Point Theory, Volume 9, No. 1, 28, 3-16 http://www.math.ubbcluj.ro/ nodeacj/sfptcj.html NONTRIVIAL SOLUTIONS TO INTEGRAL AND DIFFERENTIAL EQUATIONS GIOVANNI ANELLO Department of Mathematics University
More information1 Stochastic Dynamic Programming
1 Stochastic Dynamic Programming Formally, a stochastic dynamic program has the same components as a deterministic one; the only modification is to the state transition equation. When events in the future
More informationMean-field dual of cooperative reproduction
The mean-field dual of systems with cooperative reproduction joint with Tibor Mach (Prague) A. Sturm (Göttingen) Friday, July 6th, 2018 Poisson construction of Markov processes Let (X t ) t 0 be a continuous-time
More informationOBSERVABILITY INEQUALITY AND DECAY RATE FOR WAVE EQUATIONS WITH NONLINEAR BOUNDARY CONDITIONS
Electronic Journal of Differential Equations, Vol. 27 (27, No. 6, pp. 2. ISSN: 72-669. URL: http://ejde.math.txstate.edu or http://ejde.math.unt.edu OBSERVABILITY INEQUALITY AND DECAY RATE FOR WAVE EQUATIONS
More informationTHE INVERSE FUNCTION THEOREM
THE INVERSE FUNCTION THEOREM W. PATRICK HOOPER The implicit function theorem is the following result: Theorem 1. Let f be a C 1 function from a neighborhood of a point a R n into R n. Suppose A = Df(a)
More informationODE Final exam - Solutions
ODE Final exam - Solutions May 3, 018 1 Computational questions (30 For all the following ODE s with given initial condition, find the expression of the solution as a function of the time variable t You
More informationSYMMETRY RESULTS FOR PERTURBED PROBLEMS AND RELATED QUESTIONS. Massimo Grosi Filomena Pacella S. L. Yadava. 1. Introduction
Topological Methods in Nonlinear Analysis Journal of the Juliusz Schauder Center Volume 21, 2003, 211 226 SYMMETRY RESULTS FOR PERTURBED PROBLEMS AND RELATED QUESTIONS Massimo Grosi Filomena Pacella S.
More informationSome Properties of NSFDEs
Chenggui Yuan (Swansea University) Some Properties of NSFDEs 1 / 41 Some Properties of NSFDEs Chenggui Yuan Swansea University Chenggui Yuan (Swansea University) Some Properties of NSFDEs 2 / 41 Outline
More informationErgodic Theorems. Samy Tindel. Purdue University. Probability Theory 2 - MA 539. Taken from Probability: Theory and examples by R.
Ergodic Theorems Samy Tindel Purdue University Probability Theory 2 - MA 539 Taken from Probability: Theory and examples by R. Durrett Samy T. Ergodic theorems Probability Theory 1 / 92 Outline 1 Definitions
More informationInternal Stabilizability of Some Diffusive Models
Journal of Mathematical Analysis and Applications 265, 91 12 (22) doi:1.16/jmaa.21.7694, available online at http://www.idealibrary.com on Internal Stabilizability of Some Diffusive Models Bedr Eddine
More informationRobotics. Control Theory. Marc Toussaint U Stuttgart
Robotics Control Theory Topics in control theory, optimal control, HJB equation, infinite horizon case, Linear-Quadratic optimal control, Riccati equations (differential, algebraic, discrete-time), controllability,
More informationSolving Stochastic Partial Differential Equations as Stochastic Differential Equations in Infinite Dimensions - a Review
Solving Stochastic Partial Differential Equations as Stochastic Differential Equations in Infinite Dimensions - a Review L. Gawarecki Kettering University NSF/CBMS Conference Analysis of Stochastic Partial
More informationLARGE DEVIATIONS OF TYPICAL LINEAR FUNCTIONALS ON A CONVEX BODY WITH UNCONDITIONAL BASIS. S. G. Bobkov and F. L. Nazarov. September 25, 2011
LARGE DEVIATIONS OF TYPICAL LINEAR FUNCTIONALS ON A CONVEX BODY WITH UNCONDITIONAL BASIS S. G. Bobkov and F. L. Nazarov September 25, 20 Abstract We study large deviations of linear functionals on an isotropic
More informationξ,i = x nx i x 3 + δ ni + x n x = 0. x Dξ = x i ξ,i = x nx i x i x 3 Du = λ x λ 2 xh + x λ h Dξ,
1 PDE, HW 3 solutions Problem 1. No. If a sequence of harmonic polynomials on [ 1,1] n converges uniformly to a limit f then f is harmonic. Problem 2. By definition U r U for every r >. Suppose w is a
More informationMODULUS OF CONTINUITY OF THE DIRICHLET SOLUTIONS
MODULUS OF CONTINUITY OF THE DIRICHLET SOLUTIONS HIROAKI AIKAWA Abstract. Let D be a bounded domain in R n with n 2. For a function f on D we denote by H D f the Dirichlet solution, for the Laplacian,
More informationBLOWUP THEORY FOR THE CRITICAL NONLINEAR SCHRÖDINGER EQUATIONS REVISITED
BLOWUP THEORY FOR THE CRITICAL NONLINEAR SCHRÖDINGER EQUATIONS REVISITED TAOUFIK HMIDI AND SAHBI KERAANI Abstract. In this note we prove a refined version of compactness lemma adapted to the blowup analysis
More informationFunctional Analysis. Franck Sueur Metric spaces Definitions Completeness Compactness Separability...
Functional Analysis Franck Sueur 2018-2019 Contents 1 Metric spaces 1 1.1 Definitions........................................ 1 1.2 Completeness...................................... 3 1.3 Compactness......................................
More information