Semiconcave Functions, Hamilton Jacobi Equations, and Optimal Control. Piermarco Cannarsa & Carlo Sinestrari

Size: px
Start display at page:

Download "Semiconcave Functions, Hamilton Jacobi Equations, and Optimal Control. Piermarco Cannarsa & Carlo Sinestrari"

Transcription

1 Semiconcave Funcions, Hamilon Jacobi Equaions, and Opimal Conrol Piermarco Cannarsa & Carlo Sinesrari May 16, 2003

2 ii

3 Preface A gifed Briish crime novelis 1 once wroe ha mahemaics is like one of hose languages ha are simple, sraighforward and logical in he early sages, bu which rapidly spiral ou of conrol in a frenzy of idioms, oddiies, idiosyncrasies and excepions o he rule which even naive speakers canno always ge righ, never mind explain. In fac, providing evidence o conradic such a saemen has been one of our guidelines in wriing his monograph. I may hen be recommendable o describe, righ from he beginning, he essenial objec of our ineres, ha is, semiconcaviy, a propery ha plays a cenral role in opimizaion. There are differen possible ways of inroducing semiconcaviy. For insance, one can say ha a funcion u is semiconcave if i can be represened, locally, as he sum of a concave funcion plus a smooh one. Thus, semiconcave funcions share many regulariy properies wih concave funcions, bu include many oher significan examples. Roughly speaking, semiconcave funcions can be obained as envelopes of smooh funcions, jus in he same way as concave funcions are obained as envelopes of linear funcions. Typical examples of semiconcave funcions are: he disance funcion from a closed se S IR n, he leas eigenvalue of a symmeric marix depending smoohly on parameers, and he so-called inf-convoluions. Anoher example we are paricularly ineresed in because of applicaions o conrol heory, are he generalized soluions of Hamilon-Jacobi-Bellman equaions. A his poin, he reader may wonder why we concenrae on semiconcaviy raher han on he equivalen ye more usual noion of semiconvexiy. The answer is ha his choice beer fis minimizaion, as opposed o maximizaion, and his is he formulaion we have adoped for he opimizaion problems of ineres here. Ineres in semiconcave funcions was iniially moivaed by research on nonlinear parial differenial equaions. In fac, i was exacly in classes of semiconcave funcions ha he firs global exisence and uniqueness resuls were obained for Hamilon-Jacobi-Bellman equaions, see Douglis [67] and Kruzhkov [97, 98, 100]. Aferwards, more powerful uniqueness heo- 1 M. Dibdin, Blood rain, Faber and Faber, London, iii

4 iv ries, such as viscosiy soluions and minimax soluions, were developed. Neverheless, semiconcaviy mainains is imporance even in modern PDE heory, as he maximal ype of regulariy ha can be expeced for cerain nonlinear problems. As such, i has been invesigaed in he modern exbooks on Hamilon-Jacobi equaions by Lions [107], Bardi and Capuzzo Dolcea [20], Fleming and Soner [79], and Li and Yong [106]. In he conex of nonsmooh analysis and opimizaion, semiconcave funcions have also received aenion under he name of lower-c k funcions, see, e.g., Rockafellar [120]. We adop, here, a differen perspecive. Firs, in Chapers 2,3 and 4, we develop he heory of semiconcave funcions wihou aiming a one specific applicaion, bu as a opic in convex analysis wih is own ineres. The exposiion ranges from well-known properies for he expers in he field ha are exposed here in a comprehensive way for he firs ime o recen resuls, like he laes developmens in he analysis of singulariies. Then, in Chapers 5 o 8, we discuss some ypical problems for which semiconcaviy plays an imporan role, such as Hamilon-Jacobi equaions and conrol heory. Moreover, he book opens wih an inroducory chaper analyzing a model problem from calculus of variaions: his allows us o presen in a simple conex some of he main ideas of he res of he work. An aracive feaure of he presen exposiion is ha he proofs even of he mos advanced resuls require lile more han a sandard background in real analysis and PDE s. We use noions and echniques from several differen fields, like conrol heory, nonsmooh analysis, geomeric measure heory and viscosiy soluions; however, we have ried o keep he book as self-conained as possible, by providing all definiions and proofs of he basic resuls, and giving deailed references for he more advanced ones. Thus, we hope ha he book can be of ineres for differen kinds of readers. Researchers in opimal conrol heory and Hamilon-Jacobi equaions will find he recen progress of his heory as well as a sysemaic collecion of classical resuls, for which a precise ciaion is a imes hard o find in he lieraure. For readers a graduae level, learning he basic properies of semiconcave funcions can also be an occasion o become familiar wih imporan fields of modern analysis like he ones we menioned above. A deailed descripion of he conens is provided a he beginning of each chaper. Here, we would like o propose shorcus for readers wih specific ineress. The firs secion of chaper 2 and mos of chaper 3 are essenial for he comprehension of anyhing ha follows. Chaper 4, on singulariies, could be omied on firs reading. A his poin, he PDEoriened reader could move on o chaper 5 on HJB equaions and, hen, o chaper 6 on calculus of variaions, where sharp regulariy resuls are obained for cerain classes of HJB equaions. On he oher hand, a direc

5 pah o dynamic opimizaion would go direcly o chaper 6 and/or o chapers 7 and 8 dealing wih finie horizon opimal conrol problems and opimal exi ime problems, respecively. v

6 vi

7 Conens 1 A model problem Semiconcave funcions A problem in calculus of variaions The Hopf formula Hamilon Jacobi equaions The mehod of characerisics Semiconcaviy of Hopf s soluion Semiconcaviy and enropy soluions Semiconcave funcions Definiion and basic properies Examples Special properies of SCL (A) A differenial Harnack inequaliy A generalized semiconcaviy esimae Generalized gradiens and semiconcaviy Generalized differenials Direcional derivaives The superdifferenial of a semiconcave funcion Marginal funcions Inf convoluions Proximal analysis and semiconcaviy Singulariies of semiconcave funcions Recifiabiliy of he singular ses Propagaion along Lipschiz arcs Singular ses of higher dimension Applicaion o he disance funcion vii

8 viii 5 Hamilon Jacobi equaions The mehod of characerisics Viscosiy soluions Semiconcaviy and viscosiy Propagaion of singulariies Generalized characerisics Examples Calculus of variaions Exisence of minimizers Necessary condiions and regulariy The problem wih one free endpoin The value funcion The singular se of u Recifiabiliy of Σ Opimal conrol problems The Mayer problem The value funcion Opimaliy condiions The Bolza problem Conrol problems wih exi ime Opimal conrol problems wih exi ime Lipschiz coninuiy and semiconcaviy Semiconvexiy resuls in he linear case Opimaliy condiions A 297 A.1 Convex ses and convex funcions A.2 The Legendre ransform A.3 Hausdorff measure and recifiable ses A.4 Ordinary differenial equaions A.5 Se-valued analysis A.6 BV funcions

9 Chaper 1 A model problem The purpose of his chaper is o ouline some of he main opics of he book hrough he analysis of a simple problem in calculus of variaions. The sudy of his model problem allows us o inroduce he dynamic programming approach and o show how he class of semiconcave funcions naurally appears in his conex. In Secion 1.1 we inroduce semiconcave funcions and give some equivalen definiions. Then, in Secion 1.2 we sae our variaional problem, give he dynamic programming principle and define he value funcion associaed wih he problem. In Secion 1.3, we resric our aenion o he case where he inegrand has no explici (, x) dependence; in his case he value funcion admis a simple represenaion formula due o Hopf. In Secion 1.4 we observe ha he value funcion is a soluion of a specific parial differenial equaion, called he Hamilon Jacobi (or someimes Hamilon Jacobi Bellman) equaion. However, he equaion is no saisfied in a classical sense. In fac, he value funcion in general is no differeniable everywhere, bu only Lipschiz coninuous, and he equaion holds a he poins of differeniabiliy. Such a propery is no sufficien o characerize he value funcion, since a Hamilon Jacobi equaion may have infiniely many Lipschiz coninuous soluions aking he same iniial daa. Before seeing how o handle his difficuly, we give in Secion 1.5 an accoun of he classical mehod of characerisics for Hamilon Jacobi equaions. This echnique gives in an elemenary way a local exisence resul for smooh soluions, and a he same ime shows ha no global smooh soluion exiss in general. Alhough he mehod is compleely independen of he conrol heoreic inerpreaion of he equaion, here is an ineresing connecion beween he soluions of he characerisic sysem and he opimal rajecories of he corresponding problem in conrol or calculus of variaions. In Secion 1.6 we use he semiconcaviy propery o characerize he 1

10 2 A model problem value funcion among he many possible soluions of he Hamilon Jacobi equaion. In fac, we prove ha he value funcion is semiconcave, and ha semiconcave Lipschiz coninuous soluions of Hamilon Jacobi equaions are unique. We conclude he chaper by describing, in Secion 1.7, he connecion beween Hamilon-Jacobi equaions and anoher class of parial differenial equaions, called hyperbolic conservaion laws. In he one-dimensional case he wo classes of equaions are sricly relaed; in paricular, we show ha semiconcaviy corresponds o a well-known esimae for soluions of conservaion laws due o Oleinik. Le us menion ha a more general reamen of he problem in calculus of variaions inroduced here, including a deailed analysis of he singulariies of he value funcion, will be given in Chaper Semiconcave funcions Before saring he analysis of our variaional problem, le us inroduce semiconcave funcions, which are he cenral opic in his monograph and will play an imporan role laer in his chaper. I is convenien o consider, firs, a special class of semiconcave funcions, while he general definiion will be given in Chaper 2. Here and in he following we wrie [x, y] o denoe he segmen wih endpoins x, y, for any x, y IR n. Definiion Le A IR n be an open se. We say ha a funcion u : A IR is semiconcave wih linear modulus if i is coninuous in A and here exiss C 0 such ha u(x + h) + u(x h) 2u(x) C h 2, (1.1) for all x, h IR n such ha [x h, x + h] A. The consan C above is called a semiconcaviy consan for u in S. Remark The above definiion is ofen aken in he lieraure as he definiion of a semiconcave funcion. For us, insead, i is a paricular case of Definiion 2.1.1, where he righ-hand side of (1.1) is replaced by a erm of he form h ω( h ) for some funcion ω( ) such ha ω(ρ) 0 as ρ 0. The funcion ω is called modulus of semiconcaviy, and herefore we say ha a funcion which saisfies (1.1) is semiconcave wih a linear modulus. Semiconcave funcions wih a linear modulus admi some ineresing characerizaions, as he nex resul shows.

11 Chaper 1 3 Proposiion Given u : A IR, wih A IR n open convex, and given C 0, he following properies are equivalen: (a) u is semiconcave wih a linear modulus in A wih semiconcaviy consan C; (b) u saisfies λu(x) + (1 λ)u(y) u(λx + (1 λ)y) C λ(1 λ) 2 for all x, y such ha [x, y] A and for all λ [0, 1]; (c) he funcion x u(x) C 2 x 2 is concave in A; x y 2, (1.2) (d) here exis wo funcions u 1, u 2 : A IR such ha u = u 1 + u 2, u 1 is concave, u 2 C 2 (A) and saisfies D 2 u 2 C; (e) for any ν IR n such ha ν = 1 we have 2 u ν 2 C in A in he sense of disribuions, ha is A u(x) 2 φ ν (x) dx C φ(x) dx, φ C A 2 0 (A), φ 0; (f) u can be represened as u(x) = inf i I u i (x), where {u i } i I is a family of funcions of C 2 (A) such ha D 2 u i C for all i I. Proof Le us se v(x) = u(x) C 2 x 2. Using he ideniy we see ha (1.1) is equivalen o x + h 2 + x h 2 2 x 2 = 2 h 2, v(x + h) + v(x h) 2v(x) 0 for all x, h such ha [x h, x + h] A. I is well known (see Proposiion A.1.2) ha such a propery, ogeher wih coninuiy, is equivalen o he concaviy of v, and so (a) and (c) are equivalen. The equivalence of (b) and (c) is proved analogously. In fac, using he ideniy λ x 2 + (1 λ) y 2 λx + (1 λ)y 2 = λ(1 λ) x y 2, we see ha inequaliy (1.2) is equivalen o λv(x) + (1 λ)v(y) v(λx + (1 λ)y) 0

12 4 A model problem for all x, y such ha [x, y] A and for all λ [0, 1]. Now le us show he equivalence of (c) and (d). If (c) holds, hen (d) immediaely follows aking u 1 (x) = u(x) C 2 x 2 and u 2 (x) = C 2 x 2. Conversely, if (d) holds, hen for any uni vecor ν we have 2 (u ν 2 2 C ) 2 x 2 = 2 u 2 ν C 0, 2 which implies ha u 2 (x) C 2 x 2 is concave. Thus, u(x) C 2 x 2 is concave since i is he sum of he wo concave funcions u 1 (x) and u 2 (x) C 2 x 2. The equivalence beween (c) and (e) is an easy consequence of he characerizaion of concave funcions as he funcions having nonposiive disribuional hessian. Finally, le us prove he equivalence of (c) and (f). We recall ha any concave funcion can be wrien as he infimum of linear funcions (see Corollary A.1.14). Thus, if (b) holds, we have ha u(x) C 2 x 2 = inf i I v i (x), where he v i s are linear. Therefore, u(x) = inf i I u i (x), where u i (x) = v i (x) + C 2 x 2, and his proves (e). Conversely, assume ha (e) is saisfied. Then, seing v i (x) = u i (x) C 2 x 2, we see ha 2 ννv i 0 for all ν IR n, and so v i is concave. Therefore u(x) C 2 x 2 is concave, being he infimum of concave funcions, and his proves (b). From he previous proposiion one can have an inuiive idea of he behavior of semiconcave funcions wih a linear modulus. Propery (e) shows ha hey are he funcions whose second derivaives are bounded above, in conras wih concave funcions whose second derivaives are nonposiive. Propery (d) shows ha a semiconcave funcion can be regarded as a smooh perurbaion of a concave funcion: hus, is graph can have a nonconcave shape in he smooh pars, bu any corner poins upwards, as for concave funcions. Propery (f) gives a firs explanaion of why semiconcave funcions naurally occur in minimizaion problems. Examples of semiconcave funcions will be given hroughou he book and in paricular in Chaper 2. We conclude he secion, insead, wih a ypical example of a funcion which is no semiconcave. Example The funcion u(x) = x is no semiconcave in any open se conaining 0. In fac, inequaliy (1.1) is violaed for any C > 0 if one akes x = 0 and h small enough. More generally, we find ha u(x) = x α, is no semiconcave wih a linear modulus if α < 2; we will see, however, ha, if α > 1, i is semiconcave according o he general definiion which will be given in Chaper 2.

13 Chaper A problem in calculus of variaions We now sar he analysis of our model problem. Given 0 < T +, we se Q T =]0, T[ IR n. We suppose ha wo coninuous funcions L : Q T IR n IR, u 0 : IR n IR are given. The funcion L will be called he running cos, or lagrangian, while u 0 is called he iniial cos. We assume ha boh funcions are bounded from below. For fixed (, x) Q T, we inroduce he se of admissible arcs and he cos funcional A(, x) = {y W 1,1 ([0, ]; IR n ) : y() = x} J [y] = Then we consider he following problem: 0 L(s, y(s), ẏ(s)) ds + u 0 (y(0)). minimize J [y] over all arcs y A(, x). (1.3) Problems of his form are classical in calculus of variaions. In he case we are considering he iniial endpoin of he admissible rajecories is free, and he erminal one is fixed. Cases where he endpoins are boh fixed or boh free are also ineresing and could be sudied by similar echniques, bu will no be considered here. The firs sep in he dynamic programming approach o he above problem is he inroducion of he value funcion. Definiion The funcion u : Q T IR defined as u(, x) = inf J [y] (1.4) y A(,x) is called he value funcion of he minimizaion problem (1.3). By our assumpions u is finie everywhere. In addiion we have u(0, x) = u 0 (x). (1.5) The basic idea of he approach is o show ha u admis an alernaive characerizaion as he soluion of a suiable parial differenial equaion, and hus i can be obained wihou referring direcly o he definiion. Once u is known, he minimizaion problem is subsanially simplified. The following resul is called Bellman s opimaliy principle or dynamic programming principle and is he saring poin for he sudy of he properies of u.

14 6 A model problem Theorem Le (, x) Q T and y A(, x). Then, for all [0, ], u(, x) L(s, y(s), ẏ(s)) ds + u(, y( )). (1.6) In addiion, he arc y is a minimizer for problem (1.3) if and only if equaliy holds in (1.6) for all [0, ]. Proof For fixed [0, ], le z be any arc in W 1,1 ([0, ]; IR n ) such ha z( ) = y( ). If we se { z(s), s [0, ξ(s) = ], y(s), s [, ], we have ha ξ A(, x) and herefore u(, x) J [ξ] = L(s, y, ẏ) ds + L(s, z, ż) ds + u 0 (z(0)). 0 Taking he infimum over all z A(, y( )) we obain (1.6). If (1.6) holds as an equaliy for all [0, ], hen choosing = 0 yields ha y is a minimizer for J. Conversely, if y is a minimizer we find, by he definiion of u and by inequaliy (1.6), L(s, y, ẏ) ds + u 0 (y(0)) = u(, x) L(s, y, ẏ) ds + u(, y( )) (1.7) 0 for any given [0, ]. This implies ha J [y] u(, y( )). Since by definiion J [y] u(, y( )), we mus have equaliy in (1.7), and herefore also in (1.6). We can give a sharper formulaion of he dynamic programming principle, as in following resul. Theorem Le (, x) Q T. Then, for all [0, ], { } u(, x) = inf L(s, y(s), ẏ(s)) ds + u(, y( )) y A(,x). (1.8) Proof Given ε > 0, le y A(, x) be such ha Then u(, x) u(, x) + ε 0 L(s, y, ẏ) ds + L(s, y, ẏ) ds + u 0 (y(0)). 0 L(s, y, ẏ) ds + u 0 (y(0)) ε L(s, y, ẏ) ds + u(, y( )) ε. By he arbirariness of ε we deduce ha u(, x) is greaer han or equal o he righ hand side of (1.8). The converse inequaliy follows from Theorem

15 Chaper The Hopf formula From now on we consider he special case of L(, x, q) = L(q) and T = +. We assume ha L(q) (i) L is convex and lim = + q q (ii) u 0 Lip (IR n ). (1.9) Then we can show ha he value funcion of our problem admis a simple represenaion formula, called Hopf s formula. Theorem Under hypoheses (1.9) he value funcion u saisfies for all (, x) Q T. [ u(, x) = min L z IR n ( ) x z ] + u 0 (z) (1.10) Proof Observe ha he minimum in (1.10) exiss hanks o hypoheses (1.9). Le us denoe by v(, x) he lef hand side of (1.10). For fixed (, x) Q T and z IR n, le us se Then y A(, x) and herefore y(s) = z + s (x z), 0 s. ( ) x z u(, x) J [y] = L + u 0 (z). Taking he infimum over z we obain ha u(, x) v(, x). To prove he opposie inequaliy, le us ake ζ A(, x). From Jensen s inequaliy i follows ha L ( ) x ζ(0) ( 1 = L 0 ) ζ(s) ds 1 L( ζ(s)) ds 0 and herefore ( ) x ζ(0) v(, x) u 0 (ζ(0)) + L J [ζ]. Taking he infimum over ζ A(, x) we conclude ha v(, x) u(, x). Using Hopf s formula we can prove a firs regulariy propery of u.

16 8 A model problem Theorem Under he assumpions (1.9) he value funcion u is Lipschiz coninuous in Q T. More precisely, we have u(, x ) u(, x) L 0 x x + L 1, (1.11) where L 0 = Lip (u 0 ) and L 1 0 is a suiable consan. Proof Le us firs observe ha (1.10) implies u(, x) u 0 (x) L(0) (1.12) for all (, x) wih > 0. Le us now ake (, x), (, x ) Q T and le y IR n be such ha ( ) x y u(, x) = L + u 0 (y). Then we find, using (1.12), ( ) x y L = u(, x) u 0(x) x y L(0) + L 0. + u 0(x) u 0 (y) Since L is superlinear, we can find a consan C 1 > 0 depending on L 0 and L(0) such ha L(q) L(0)+L 0 q if q > C 1. Then he previous inequaliy implies Le us now se Then we have x y C 1. (1.13) y = x x y. x y = x y, y y = x x + ( ) x y, and so Hopf s formula (1.10), ogeher wih (1.13), yields ( ) x y u(, x ) u(, x) ( )L + u 0 (y ) u 0 (y) max L(q) + L 0 y y q C 1 ( ) L 0 C 1 + max q C 1 L(q) + L 0 x x.

17 Chaper 1 9 By inerchanging he role of (x, ) and (x, ), we obain he reverse inequaliy. This proves he conclusion in he case of, > 0. If we have, for insance, = 0, we can esimae ( ) u(, x) u(0, x ) = x y L + u 0 (y) u 0 (x ) max L(q) + L 0 ( y x + x x ) q C 1 ( ) max q C 1 L(q) + L 0 C 1 + L 0 x x. A well-known heorem due o Rademacher (see e.g. [69, 70, 14]) assers ha a Lipschiz coninuous funcion is differeniable almos everywhere, and so he previous resul immediaely implies Corollary Under hypoheses (1.9), he value funcion u is differeniable a.e. in Q T. On he oher hand, i is easy o see ha, in general, u fails o be everywhere differeniable, even if u 0 and L are differeniable. Example Le us consider problem (1.4) wih n = 1, L(q) = q 2 /2 and he iniial cos given by z 2 if z < 1 u 0 (z) = 1 2 z if z 1. Observe ha u 0 is of class C 1 bu no C 2. This is no essenial for he behavior we are going o describe; one can build examples wih C daa exhibiing similar properies (see Example 6.3.5). Le us compue he value funcion using Hopf s formula. We find ha he minimum in (1.10) is aained a z = x 1 2 if < 1/2 and x < 1 2 z = x + sgn(x)2 if x or if 1/2, whence x2 if < 1/2 and x < 1 2 u(, x) = ( x + ) if x or if 1/2. Therefore u(, x) is no differeniable a he poins of he form (,0) wih 1/2.

18 10 A model problem 1.4 Hamilon Jacobi equaions In his secion we inroduce a parial differenial equaion which is solved by he value funcion of our variaional problem. We assume hroughou ha hypoheses (1.9) are saisfied. We use he noaion u = u, u = ( u x 1,..., u x n Theorem Le u be differeniable a a poin (, x) Q T. Then u (, x) + H( u(, x)) = 0, (1.14) ). where H(p) = sup q IR n [p q L(q)]. (1.15) Equaion (1.14) is called he Hamilon Jacobi equaion of our problem of calculus of variaions. In he erminology of conrol heory, such an equaion is also called Bellman s equaion or dynamic programming equaion. The funcion H is called he hamilonian. In general, a funcion defined as in (1.15) is called he Legendre ransform of L (see Appendix A.1). Proof Le (, x) be a poin a which u is differeniable. Given q IR n, s > 0, le us se y(τ) = x + (τ )q. Then we obain from (1.6) u( + s, x + sq) +s L(ẏ(τ))dτ + u(, x), which implies u( + s, x + sq) u(, x) L(q). s Leing s 0 we obain u (, x) + q u(, x) L(q) 0, and we deduce, by he arbirariness of q, u (, x) + H( u(, x)) 0. To prove he converse inequaliy, le us ake ˆx IR n such ha ( ) x ˆx u(, x) = L + u 0 (ˆx). Such an ˆx exiss by Hopf s formula. We hen se, for s [0, [, x s = s ( x + 1 s ) ˆx.

19 Chaper 1 11 Since (x ˆx)/ = (x s ˆx)/s, we deduce from Hopf s formula ( ) ( ) x ˆx xs ˆx u(, x) u(s, x s ) L + u 0 (ˆx) sl + u 0 (ˆx) s ( ) x ˆx = ( s)l. Dividing by s and leing s we obain u (, x) + x ˆx ( ) x ˆx u(, x) L 0, and we conclude ha u (, x) + H( u(, x)) 0. From Corollary and Theorem i follows ha he value funcion u given from (1.10) saisfies u + H( u) = 0 (, x) IR + IR n a.e. (1.16) u(0, x) = u 0 (x) x IR n. The involuive characer of he Legendre ransform implies ha he correspondence beween calculus of variaions and Hamilon Jacobi equaions is valid in boh direcions. More precisely, le H, u 0 be given such ha H(p) (i) H is convex and lim = + p p (ii) u 0 Lip (IR n ) (1.17) and suppose ha we wan o solve problem (1.16). To his purpose, we can define L o be he Legendre ransform of H: L(q) = max p IR n[p q H(p)]. Then (see Theorem A.2.3) L saisfies propery (1.9)-(i) and H is he Legendre ransform of L, i.e. (1.15) holds. Therefore, Hopf s formula (1.10) yields a Lipschiz funcion u ha solves (1.16). The propery of solving problem (1.16) almos everywhere, however, is no enough o characerize he value funcion u. Indeed, such a problem can have more han one soluion in he class Lip(IR + IR n ), as he nex example shows. Example The problem u + u 2 x = 0 u(0, x) = 0 (, x) IR + IR a.e. x IR (1.18)

20 12 A model problem admis he soluion u 0. However, for any a > 0, he funcion u a defined as 0 if x a u a (, x) = a x a 2 if x < a is a Lipschiz funcion saisfying he equaion almos everywhere ogeher wih is iniial condiion. Simple examples like he one above show ha he propery of solving he equaion almos everywhere is oo weak and does no suffice o provide a saisfacory noion of generalized soluion. I is herefore desirable o find addiional condiions o ensure uniqueness and characerize he value funcion among he Lipschiz coninuous soluions of he equaion. A possible way of doing his relies on he semiconcaviy propery and will be pursued in Secion The mehod of characerisics We describe in his secion he mehod of characerisics, which is a classical approach o he sudy of firs order parial differenial equaions like he Hamilon-Jacobi equaion (1.16). This mehod explains why such equaions do no possess in general smooh soluions for all imes, and has some ineresing connecions wih he variaional problem associaed o he equaion. A more general reamen of hese opics will be given in Secion 5.1. Suppose ha H, u 0 are in C 2 (IR n ), and suppose ha we already know ha problem (1.16) has a soluion u of class C 2 in some srip Q T. For fixed z IR n, le us denoe by X(; z) he soluion of he ordinary differenial equaion (here he do denoes differeniaion wih respec o ) Ẋ = DH( u(, X)), X(0) = z. (1.19) Such a soluion is defined in some maximal inerval [0, T z [ (alhough i will laer urn ou ha T z = T for all z). The curve (, X(; z)) is called he characerisic curve associaed wih u and saring from he poin (0, z). Le us now se U(; z) = u(, X(; z)), P(; z) = u(, X(; z)). (1.20) Then, using he fac ha u solves problem (1.16) we find ha U = u (, X) + u(, X) Ẋ = H(P) + DH(P) P, P = u (, X) + 2 u(, X)Ẋ = (u + H( u))(, X) = 0.

21 Chaper 1 13 Therefore P is consan, and so he righ hand side of (1.19) is also consan. Thus, X is defined in [0, T[ and we can compue explicily X, U, P obaining P(; z) = Du 0 (z) X(; z) = z + DH(Du 0 (z)) U(; z) = u 0 (z) + [DH(Du 0 (z)) Du 0 (z) H(Du 0 (z))]. (1.21) Observe ha he righ hand side of (1.21) is no longer defined in erms of he soluion u, bu only depends on he iniial value u 0. This suggess ha, even wihou assuming in advance he exisence of a soluion, one can use hese formulas o define one. As we are now going o show, such a consrucion can be in general carried ou only locally in ime. We need he following classical resul abou he global inveribiliy of maps (see e.g. [11, Th ]). Theorem Le F : IR n IR n be of class C 1 and proper (ha is, F 1 (K) is compac whenever K is compac). If de DF(x) 0 for all x IR n, hen F is a global C 1 -diffeomorphism from IR n ono iself. As a consequence, we obain he following inveribiliy resul for maps depending on a parameer. Theorem Le Φ : [a, b] IR n IR n be of class C 1. Suppose ha here exiss M > 0 such ha Φ(, z) z M for all (, z) [a, b] IR n. Suppose also ha he jacobian wih respec o he z-variable D z F(, z) has nonzero deerminan for all (, z). Then here exiss a unique map Ψ : [a, b] IR n IR n of class C 1 such ha Φ(,Ψ(, x)) = x for all (, x) [a, b] IR n. Proof For fixed [a, b], define F(z) = Φ(, z). Then F : IR n IR n is of class C 1 and de F(z) 0 for all z by our assumpions. To show ha F is proper, le us ake any compac se K IR n. Then F 1 (K) is closed by he coninuiy of F. To prove ha i is also bounded, le us denoe by d he diameer of K and ake any z 1, z 2 in F 1 (K). Then we have, by our assumpions on Φ, z 2 z 1 z 2 F(z 2 ) + z 1 F(z 1 ) + F(z 2 ) F(z 1 ) 2M + d, showing ha F 1 (K) is bounded. Hence F is proper. Now we can apply Theorem o obain ha F has a global inverse. Since he same holds for all, we obain ha here exiss Ψ(, x) such ha Φ(, Ψ(, x)) = x for all (, x) [a, b] IR n. I remains o prove ha Ψ is regular wih respec o boh argumens. For his purpose, we se Φ(, z) = (, Φ(, z)) and Ψ(, x) = (, Φ(, x)).

22 14 A model problem Then Φ and Ψ are reciprocal inverse. Since Φ is of class C 1, we have ha Ψ (and herefore Ψ) is also of class C 1 provided he Jacobian of Φ has nonzero deerminan. Bu his follows from our hypoheses on Φ, since we have D Φ(, z) = ( 1 0 Φ(, z) D z Φ(, z) We can now give he local exisence resul for classical soluions based on he mehod of characerisics. Theorem Le u 0, H C 2 (IR n ) be given, and suppose ha Du 0 and D 2 u 0 are bounded. Le us se T = sup{ > 0 : I + D 2 H(Du 0 (z))d 2 u 0 (z) is inverible for all z IR n }. Then problem (1.16) has a unique soluion u C 2 ([0, T [ IR n ). Proof Le X, U, P be defined as in (1.21). Then, for any T < T, we can apply Theorem o he map X in [0, T] IR n. In fac, he jacobian X z (; z) = I + D 2 H(Du 0 (z))d 2 u 0 (z) is inverible by hypohesis, and he quaniy X(; z) z = DH(Du 0 (z)) is uniformly bounded. Therefore we can find a map Z(; x) of class C 1 such ha X(; Z(; x)) = x for all (, x) [0, T] IR n. Afer seing u(, x) = U(; Z(; x)), (, x) [0, T] IR n, le us prove ha u is a C 2 soluion of problem (1.16). To check ha he iniial condiion is saisfied, i suffices o observe ha X(0; z) = z and U(0; z) = u 0 (z) for all z; herefore Z(0; x) = x and u(x, 0) = u 0 (x) for all x. The verificaion ha u is of class C 2 and saisfies he equaion is echnical bu sraighforward, as we now show. From he definiion i is clear ha u is of class a leas C 1. Le us compue is derivaives. By (1.21) we have U z (; z) = Du 0 (z) + Du 0 (z) D 2 H(Du 0 (z)) D 2 u 0 (z) = P(; z) X z (; z), where he subscrip denoes parial differeniaion. This implies, by he definiion of Z, We also find u(, x) = U z (; Z(; x)) Z x (; x) = P(; Z(, x)). (1.22) u (, x) = U (; Z(, x)) + U z (; Z(, x)) Z (; x) = DH(P) P H(P) + PX z Z, ).

23 Chaper 1 15 where we have wrien for simpliciy P, Z, ec. insead of P(; Z(, x)), Z = Z(; x) respecively. Keeping ino accoun ha X(; Z(; x)) x we obain X (; Z) + X z (; Z)Z = 0. Therefore, since X = DH(P) by (1.21), u (, x) = X P H(P) + P X z Z = H(P). This equaliy, ogeher wih (1.22), implies ha u C 2 and saisfies problem (1.16). Uniqueness follows from he remarks a he beginning of his secion. Indeed, if we have anoher soluion v, we can define he characerisic curves associaed o v, which are also given by (1.21), since hey only depend on H and u 0. In paricular, we have v(, X(; z)) = U(, z) for all, z. Therefore, v(, x) = v(, X(; Z(; x))) = U(; Z(, x)) = u(, x) for all (, x) [0, T] IR n, showing ha u and v coincide. Le us recall an elemenary propery from linear algebra. Lemma Le B be a symmeric posiive semidefinie n n-marix. Then, for any v IR n we have Bv, v = 0 if and only if Bv = 0. Proof Le e 1,..., e n be an orhonormal basis of eigenvecors of B, and le λ 1,..., λ n be he corresponding eigenvalues. If we se v i = v e i, we have n Bv, v = λ i vi 2. i=1 Since B is posiive semidefinie, we have λ i 0 for all i and so all erms in he above sum are nonnegaive. If Bv, v = 0, hen λ i vi 2 = 0 for all i = 1,..., n. Bu hen also λ 2 i v2 i = 0 for all i, and we deduce n Bv 2 = Bv, Bv = λ 2 i v2 i = 0. i=1 Corollary Le u 0 and H be as in Theorem Se M 0 = sup z IR n Du 0 (z), M 1 = sup z IR n D 2 u 0 (z), M 2 = sup p M 0 D 2 H(p). Then problem (1.16) has a C 2 soluion a leas for ime [0, (M 1 M 2 ) 1 [. If H and u 0 are boh convex (or boh concave) hen he problem has a C 2 soluion for all posiive imes.

24 16 A model problem Proof If M 1, M 2 are defined as above, he marix D 2 H(Du 0 (z))d 2 u 0 (z) has norm less han M 1 M 2. Thus, if < (M 1 M 2 ) 1 we have D 2 H(Du 0 (z))d 2 u 0 (z)v < v for all v IR n, v 0, showing ha he marix I + D 2 H(Du 0 (z))d 2 u 0 (z) is inverible. Le us now prove he las par of he saemen in he case when H, u 0 are convex (he concave case is compleely analogous). I suffices o show ha he marix I + D 2 H(Du 0 (z))d 2 u 0 (z) is inverible for all, z. Le us argue by conradicion and suppose ha here exis, z and a nonzero vecor v such ha v + D 2 H(Du 0 (z))d 2 u 0 (z)v = 0. Le us se for simpliciy A = D 2 H(Du 0 (z)), B = D 2 u 0 (z). Then A, B are boh posiive semidefinie, and we have v = ABv. Bu hen 0 ABv, Bv = v, Bv 0, which implies ha v, Bv = 0. By Lemma 1.5.4, we deduce ha Bv = 0, in conradicion wih he propery ha v = ABv. The ime T given by Theorem is opimal, as shown by he nex resul. Theorem Le H, u 0 and T be as in Theorem If T > T, hen no C 2 soluion of problem (1.16) exiss in [0, T [ IR n. We give wo differen proofs of his saemen; he argumen of he second one is more inuiive, bu can be applied only in he case n = 1. Firs proof We argue by conradicion and suppose ha here exiss a soluion u C 2 ([0, T [ IR n ), wih T > T. By definiion of T, here exis ]T, T [, z IR n and θ IR n \ {0} such ha X z ( ; z ) θ = θ + D 2 H(Du 0 (z )) D 2 u 0 (z ) θ = 0. This implies in paricular ha P z ( ; z ) θ = D 2 u 0 (z ) θ 0. Differeniaing (1.20) wih respec o z we obain 2 u(, X(, z )) X z (, z ) = P z (, z ).

25 Chaper 1 17 Taking he scalar produc wih θ of boh sides of he equaliy yields a conradicion. Second proof Here we resric ourselves o he case n = 1. As in he firs proof, we argue by conradicion and suppose ha here exiss a soluion u up o some ime T > T. By definiion of T we can find < T and z IR such ha 1 + H (u 0 (z ))u 0 (z ) = 0. Then H (u 0 (z ))u 0 (z ) < 0 and so, if we fix any ˆ ], T [, we have 1 + ˆH (u 0 (z ))u 0 (z ) < 1 + H (u 0 (z ))u 0 (z ) = 0. This shows ha he funcion z X(ˆ; z) has a negaive derivaive a z = z and so is decreasing in some neighborhood of z. Thus, here exis z 1 < z 2 such ha X(ˆ; z 1 ) > X(ˆ; z 2 ). On he oher hand, we have X(0; z 1 ) = z 1 < z 2 = X(0; z 2 ). By coninuiy, here exiss s ]0, ˆ[ such ha X(s; z 1 ) = X(s; z 2 ). I follows ha u 0 (z i) = P(s; z i ) = u x (s, X(s; z i )), i = 1, 2, which implies u 0(z 1 ) = u 0(z 2 ). Bu hen we deduce from (1.21) ha X(s; z 2 ) X(s; z 1 ) = z 2 z 1 0, in conradicion wih our choice of s. Remark As i is clear from he second proof, he criical ime T is he ime a which he characerisic lines sar o cross. Inuiively speaking, since u x is consan along any of hese lines, he crossing of characerisics corresponds o he formaion of disconinuiies in he gradien of u. Le us do some observaions abou his behavior. From he compuaions of he second proof we see ha he map z X(; z) is sricly increasing if < T and no monoone for > T. Thus, he map z X(T ; z) is increasing; i is eiher sricly increasing or i is consan on some inerval. In he firs case we can inuiively say ha he characerisics are no ye crossing a he criical ime = T, bu sar crossing immediaely aferwards. In he laer case here is a family of characerisics which are all converging o he same poin a = T, like in Example However, i is easily seen ha his second behavior is nongeneric, in he sense ha i is no sable under small perurbaions of he iniial value. In fac, i only occurs if he derivaive of z X(T ; z) vanishes idenically on an inerval. Le us now focus on he case of a Hamilon-Jacobi equaion coming from a variaional problem of he form considered in he previous secions. We have seen ha he value funcion is Lipschiz coninuous and solves

26 18 A model problem he equaion almos everywhere; we now sudy he relaionship beween he value funcion and he smooh soluion obained by he mehod of characerisics. We will show ha he wo funcions agree as long as he laer exiss, and ha here is a connecion beween he value funcion and he characerisics which is valid for all imes. We make some more regulariy assumpions on L, u 0 wih respec o he previous secions; namely we assume, in addiion o (1.9), ha L is sricly convex and ha u 0 is differeniable. Then, if we denoe by H he Legendre ransform of L, we have ha H is differeniable (see Theorem A.2.4 in he Appendix). Observe ha such properies of H and u 0 are weaker han he ones which are needed in Theorem 1.5.3, bu are enough o ensure ha he funcions P, X, U in (1.21) are well defined. Our firs remark is ha minimizers for he problem in calculus of variaions are also characerisic curves for he Hamilon Jacobi equaion. Proposiion Le L, u 0 : IR n IR saisfy assumpions (1.9); suppose in addiion ha L is sricly convex and ha u 0 is of class C 1. Given (, x) [0, [ IR n, le y( ) be a minimizer for problem (1.3). Then y( ) = X(, z) for some z IR n. Proof Le y( ) be a minimizer for problem (1.3) and le z = y(0). In he proof of Hopf s formula (Theorem 1.3.1) we have seen ha y has he form y(s) = z + s(x z)/ for some z IR n. In addiion, z is a minimizer for he righ hand side of (1.10), which implies ha DL((x z)/) = Du 0 (z). By well known properies of he Legendre ransform (see (A.19)), his implies ha DH(Du 0 (z)) = (x z)/, and so y(s) = X(s; z). Le us se for (, x) [0, + [ IR n, Z(; x) = {z IR n : X(; z) = x}. (1.23) If he hypoheses of Theorem are saisfied hen such a se is a singleon for small imes; in general i is a compac se, as a consequence of he definiion of X and of he properies of u 0, H. Proposiion Given L, u 0 as in he previous proposiion, le u(, x) be he value funcion of problem (1.4). Then u(, x) = min U(; z). (1.24) z Z(;x) Proof As we have seen in he proof of he previous proposiion, when one akes he minimum in Hopf s formula (1.10) i is enough o consider he values of z such ha x = X(; z). Therefore u(, x) = min z Z(;x) [ u 0 (z) + L ( x z )].

27 Chaper 1 19 The condiion z Z(; x) is equivalen o DH(Du 0 (z)) = (x z)/. Recalling ideniy (A.21), we have, for z Z(; x), ( ) x z U(; z) = u 0 (z) + L and so he wo sides of (1.24) coincide. In oher words, he soluion given by Hopf s formula is a suiable selecion of he mulivalued funcion obained by he mehod of characerisics. Le us poin ou ha such a behavior is peculiar of Hamilon Jacobi equaions wih convex hamilonian: if H is neiher convex nor concave here is in general no way of finding a weak soluion by aking such a selecion. Corollary Le L, u 0 C 2 (IR n ) saisfy assumpions (1.9). Suppose in addiion ha D 2 L is posiive definie everywhere and ha D 2 u 0 is uniformly bounded. Then here exiss T > 0 such ha he value funcion of problem (1.4) is of class C 2 in [0, T [ IR n. If u 0 is convex, hen T = + and so he value funcion is C 2 everywhere. In addiion, given (, x) wih < T, here exiss a unique minimizer for problem (1.3), which is given by y(s) = x + (s )DH( u(, x)). (1.25) Proof By Theorem A.2.5 he Legendre ransform of L is of class C 2 and sricly convex. Hence, Theorem ensures he exisence of T > 0 such ha Z(, x) is a singleon for < T and such ha he mehod of characerisics yields a smooh soluion of he Hamilon Jacobi equaion in [0, T [ IR n. By he previous heorem, his smooh soluion coincides wih he value funcion. As observed in Corollary 1.5.5, T = + if u 0 is convex. Finally, (1.25) follows from Proposiion 1.5.8, from (1.22) and (1.21). The previous heorem shows how he dynamic programming approach can provide a soluion o he problem of calculus of variaions we are considering. Such a resul, however, relies on he smoohness of he value funcion and we have seen ha such a propery does no hold in general for all imes. When one ries o exend his approach o he cases when he value funcion is only Lipschiz, several difficulies arise. We have already menioned he non uniqueness of Lipschiz coninuous soluions of he Hamilon Jacobi equaion. I is also no obvious how o resae equaion (1.25) a he poins where u is no differeniable. These issues will be discussed in deail in he remainder of he book.

28 20 A model problem 1.6 Semiconcaviy of Hopf s soluion In his secion we show ha he semiconcaviy propery characerizes he value funcion among all possible Lipschiz coninuous soluions of he Hamilon-Jacobi equaion (1.16). Theorem Le L, u 0 saisfy assumpions (1.9). Suppose in addiion ha (i) L C 2 (IR n ), D 2 L(q) 2 α I q IRn (1.26) (ii) u 0 (x + h) + u 0 (x h) 2u 0 (x) C 0 h 2, x, h IR n for suiable consans α > 0, C 0 0. Then here exiss a consan C 1 0 such ha u( + s, x + h) + u( s, x h) 2u(, x) 2C α( 2 s 2 )C 0 ( h + C 1 s ) 2 (1.27) for all > 0, s ], [, x, h IR n. Proof For fixed, s, x, h as in he saemen of he heorem, le us choose ˆx IR n such ha ( ) x ˆx u(, x) = L + u 0 (ˆx). (1.28) Such a ˆx exiss by Hopf s formula; in addiion, by (1.13), here exiss C 1, depending only on L, such ha We se, for λ 0, x ˆx C 1. (1.29) ( x + λ = ˆx + λ h s x ˆx ) (, x λ = ˆx λ h s x ˆx ). Then we have x + λ + x λ 2 = ˆx, x + λ x λ 2 = λ ( h s x ˆx ). (1.30) By (1.29) we have x + λ x λ 2 λ( h + C 1 s ). (1.31)

29 Chaper 1 21 By Hopf s formula (1.10) we have u( ± s, x ± h) ( ± s)l ( x ± h x ± λ ± s Thus, keeping ino accoun (1.28), we can esimae u( + s, x + h) + u( s, x h) 2u(, x) [ ( ) + s x + h x L λ + s ( x h x L λ + s 2 s ) + u 0 (x ± λ ). ) L ( )] x ˆx +u 0 (x + λ ) + u 0(x λ ) 2u 0(ˆx). (1.32) From (1.31) and (1.26)(ii) i follows ha u 0 (x + λ ) + u 0(x λ ) 2u 0(ˆx) C 0 λ 2 ( h + C 1 s ) 2. (1.33) We now ake q 0, q 1 IR n, θ [0, 1] and se q θ = θq 1 + (1 θ)q 0. Using assumpion (1.26)(i) and he equivalence beween (b) and (e) in Proposiion 1.1.3, we have θl(q 1 ) + (1 θ)l(q 0 ) L(q θ ) Therefore, observing ha θ(1 θ) q 1 q 0 2. (1.34) α + s 2 x + h x + λ + s + s 2 we obain from (1.34) ( ) + s x + h x + 2 L λ + s L + s 2 2 s 2 α(2) 2 In addiion x h x λ s x + h x + λ + s ( x h x λ s = x ˆx, x h x λ s ) ( ) x ˆx L 2. (1.35) x + h x + λ x h x λ + s s ( s)(x + h) ( + s)(x h) = ( s)x+ λ ( + s)x λ 2 s 2 2 s 2 h sx + sˆx = 2 2λ ( h s x ˆx ) 2 s 2 2 s 2 ( ) = 2(1 λ) 2 s 2 h s x ˆx,

30 22 A model problem which implies, by (1.29) x + h x + λ x h x λ + s s 2(1 λ) 2 s 2 ( h + C 1 s ). (1.36) From (1.32), (1.33), (1.35) and (1.36) we obain, for all λ 0, where u( + s, x + h) + u( s, x h) 2u(, x) C(λ) = I is easily checked ha and his proves (1.27). C(λ)[ h + C 1 s ] 2, 2 α( 2 s 2 ) (1 λ)2 + C 0 λ 2. min C(λ) = 2C 0 λ αc 0 ( 2 s 2 ), (1.37) Esimae (1.30) of he previous heorem easily implies ha u is semiconcave wih a linear modulus. Acually, o have a semiconcaviy esimae for u i is no necessary ha boh assumpions in (1.26) are saisfied, bu i is enough o assume one of he wo, as shown in he nex corollary. Corollary Le assumpions (1.9) be saisfied and le u be he funcion defined by Hopf s formula (1.10). (i) If L saisfies propery (1.26)(i) for some α > 0, hen here exiss C 1 such ha u( + s, x + h) + u( s, x h) 2u(, x) 2 α( 2 s 2 ) ( h + C 1 s ) 2. (ii) If u 0 saisfies (1.26)(ii) for some C 0 0, hen here exiss C 1 such ha u( + s, x + h) + u( s, x h) 2u(, x) C 0 ( h + C 1 s ) 2. (iii) If u 0 is concave, hen u is concave (joinly in, x). Proof Formally, saemens (i) and (ii) are obained by leing respecively C 0 and α 0 in esimae (1.27). A precise moivaion can be obained by a suiable adapaion of he proof of he previous heorem. To prove (i), we apply inequaliy (1.32) wih λ = 0. Wih his choice of λ we have x + λ = x λ = ˆx; hus, he erms wih u 0 drop ou while he erms

31 Chaper 1 23 involving L can be esimaed as before. To prove (ii) we choose insead λ = 1; hen i is easily checked ha he oal conribuion of he erms wih L in (1.32) is zero, while he remaining erms can be esimaed as before. Finally, saemen (iii) follows from (ii) aking C 0 = 0. If boh hypoheses in (1.26) are violaed, i.e. L is no wice differeniable and u 0 is no semiconcave, hen u may fail o be semiconcave, as shown by he nex example. Example Consider a one-dimensional problem wih lagrangian and iniial cos given respecively by L(q) = q2 2 + q, u 0(x) = x 2. Clearly, hypoheses (1.9) are saisfied. On he oher hand, assumpions (1.26) are boh violaed, since L is no wice differeniable a q = 0 and u 0 is no semiconcave (see Example 1.1.4). By Hopf s formula he value funcion is given by u(, x) = min z IR { z 2 + (x z)2 2 + x z I is easily found ha he quaniy o minimize is a decreasing funcion of z for z < x and increasing for z > x. Hence he minimum is aained for z = x, i.e. u(, x) = x, 0, x IR. 2 Thus, he value funcion is no semiconcave. }. We now show ha he semiconcaviy propery singles ou Hopf s soluion among all Lipschiz coninuous soluions of he Hamilon Jacobi equaion. Theorem Le H C 2 (IR n ) be convex and le u 1, u 2 Lip (Q T ) be soluions of (1.16) such ha, for any > 0 and i = 1, 2, u i (, x+h)+u i (, x h) 2u i (, x) C for some C > 0. Then u 1 = u 2 everywhere in Q T. We firs recall an elemenary algebraic propery. ( ) h 2, x, h IR n (1.38)

32 24 A model problem Lemma Le A, B be wo symmeric n n marices. Suppose ha 0 A ΛI and B ki for some Λ, k > 0. Then race(ab) nkλ. Proof Le {e 1,..., e n } be on orhonormal basis of eigenvecors of B and le {µ 1,..., µ n } be he corresponding eigenvalues. Then our assumpions imply µ i k, 0 e i, Ae i Λ, i = 1,..., n. I follows race(ab) = n n e i, ABe i = µ i e i, Ae i i=1 i=1 n k e i, Ae i nkλ. i=1 Proof of Theorem Seing ū(, x) = u 1 (, x) u 2 (, x) we have, for (, x) Q T a.e., where ū (, x) = H( u 2 (, x)) H( u 1 (, x)) = b(, x) ū(, x), b(, x) = 1 0 DH(r u 2 (, x) + (1 r) u 1 (, x))dr. Le φ : IR [0, [ be a C 1 funcion o be fixed laer. Seing v = φ(ū) we obain, for (, x) Q T a.e., v (, x) + b(, x) v(, x) = 0. (1.39) Le k C (IR n ) be a nonnegaive funcion whose suppor is conained in he uni sphere and whose inegral is 1. We define, for i = 1, 2, ε > 0 and (, x) Q T, u ε i (, x) = 1 ( ) x y u ε IR n i (, y)k dy. n ε By well-known properies of convoluions he funcions u ε i are of class C wih respec o x and saisfy (i) u ε i Lip (u i) (ii) for all > 0, u ε i (, ) u i(, ) a.e. as ε 0. (1.40) In addiion, u ε i saisfies he semiconcaviy esimae (1.38) for all ε > 0. Therefore, using propery (e) in Proposiion 1.1.3, ( 2 u ε i (, x) C ) I, (, x) Q T. (1.41)

33 Chaper 1 25 Seing b ε (, x) = 1 we can rewrie equaion (1.39) in he form Le us se 0 DH(r u ε 2 (, x) + (1 r) uε 1 (, x))dr, v + div (vb ε ) = (div b ε )v + (b ε b) v. R = max{ DH(p) : p max(lip(u 1 ), Lip (u 2 ))}, Λ = max{ D 2 H(p) : p max(lip(u 1 ), Lip (u 2 ))}. By (1.41) and Lemma i follows div b ε = = 1 0 n k,l=1 2 ( H (r u ε 2 p k p + (1 r) uε 1 ) r 2 u ε 2 + (1 r) 2 u ε ) 1 dr l x k x l x k x l nλc(1 + 1/). (1.42) This is he esimae where he semiconcaviy assumpion on he u i s is used. Given ( 0, x 0 ) Q T, le us inroduce he funcion E() = v(, x)dx, 0 0 and he cone where we use he noaion B(x 0,R( 0 )) C = {(, x) : 0 0, x B(x 0, R( 0 ))}, B(x 0, R( 0 )) = {x IR n : x x 0 < R( 0 )}. Then E is Lipschiz coninuous and saisfies, for a.e. > 0, E () = v dx R vds B(x 0,R( 0 )) B(x 0,R( 0 )) = { div(vb ε ) + (div b ε )v + (b ε b) v}dx B(x 0,R( 0 )) R vds B(x 0,R( 0 )) = v(b ε ν + R)dS B(x 0,R( 0 )) + {(div b ε )v + (b ε b) v}dx B(x 0,R( 0 )) {(div b ε )v + (b ε b) v}dx B(x 0,R( 0 )) nλc ( ) E() + (b ε b) v dx. B(x 0,R( 0 ))

34 26 A model problem Leing ε 0 we obain, by (1.40)(ii), ( E () nλc ) E(), ]0, 0 [ a.e. (1.43) We now choose he funcion φ in he definiion of v. We fix η > 0 and ake φ such ha φ(z) = 0 if z η[lip (u 1 ) + Lip (u 2 )] and φ(z) > 0 oherwise. Then he assumpion ha u 1 = u 2 for = 0 implies ha v(, x) = 0 if η. Thus we obain, from (1.43) and Gronwall s inequaliy, for any [0, 0 ]. Hence ( 0 E() E(η) exp nλc η ( s ) ds u 2 u 1 η [ Lip (u 1 ) + Lip (u 2 )] on C. ) = 0 By he arbirariness of η > 0, we deduce ha u 1 and u 2 coincide in C, and, in paricular, u 1 ( 0, x 0 ) = u 2 ( 0, x 0 ). We can summarize he resuls we have obained abou problem (1.16) as follows. Corollary Le H, u 0 saisfy hypoheses (1.17). Suppose in addiion ha H C 2 (IR n ) and ha eiher H is uniformly convex or u 0 is semiconcave wih a linear modulus. Then here exiss a unique u Lip ([0, [ IR n ) which solves problem (1.16) almos everywhere and which saisfies u(, x + h) + u(, x h) 2u(, x) C ( ) h 2, x, h IR n, > 0, (1.44) for a suiable C > 0. In addiion, u is given by Hopf s formula (1.10), aking as L he Legendre ransform of H. Proof We recall ha, if H is uniformly convex and L is he Legendre ransform of H, hen L saisfies propery (1.26)-(i) (see (A.20) in he appendix). The resul hen follows from Theorem 1.4.1, Corollary and Theorem Le us poin ou ha, nowadays, using semiconcaviy o obain uniqueness resuls is a procedure ha has mainly an hisorical ineres, since i has been laer incorporaed in he more general heory of viscosiy soluions. A sronger moivaion for he sudy of he semiconcaviy lies in he consequences for he regulariy of he value funcion. As we will see, he generalized differenial of a semiconcave funcion enjoys special properies, which play in imporan role in applicaions o calculus of variaions and opimal conrol heory.

35 Chaper Semiconcaviy and enropy soluions In his secion we discuss briefly he connecion beween Hamilon Jacobi equaions and anoher class of parial differenial equaions, called hyperbolic conservaion laws. Given H C 2 (IR) and T ]0, ], le u C 2 ([0, T[ IR) be a soluion of u + H(u x ) = 0. (1.45) Then, if we se v(, x) := u x (, x) and differeniae (1.45) wih respec o x, we see ha v solves v + H(v) x = 0. (1.46) Conversely, if v is a C 1 soluion of (1.46) and we se, for a given x 0 IR, u(, x) := x x 0 v(, y) dy 0 H(v(s, x 0 )) ds (1.47) hen u is a soluion of (1.45). Equaion (1.46) is called a hyperbolic conservaion law. We observe ha he above ransformaion can no longer be done when one considers equaions in several space dimensions or sysems of equaions. Jus like Hamilon Jacobi equaions, conservaion laws do no possess in general global smooh soluions. I is ineresing herefore o invesigae he relaion beween he wo equaions when dealing wih generalized soluions. Conservaion laws are in divergence form and i is naural o consider soluions in he sense of disribuions. More precisely, le us consider equaion (1.46) wih iniial daa v(0, x) = v 0 (x), x IR a.e., (1.48) where v 0 L (IR). Then we say ha v L ([0, T[ IR) is a weak soluion of problem (1.46) (1.48) if i saisfies T 0 [v(, x)φ (, x) + H(v(, x))φ x (, x)] dxd IR = v 0 (x)φ(0, x) dx, φ C0 ([0, T[ IR). (1.49) IR Here C0 denoes he class of C funcions wih compac suppor. I can be proved ha he weak soluions o hyperbolic conservaion laws defined above correspond o Lipschiz coninuous almos everywhere soluions o Hamilon-Jacobi equaions, as saed in he nex resul.

Hamilton Jacobi equations

Hamilton Jacobi equations Hamilon Jacobi equaions Inoducion o PDE The rigorous suff from Evans, mosly. We discuss firs u + H( u = 0, (1 where H(p is convex, and superlinear a infiniy, H(p lim p p = + This by comes by inegraion

More information

Hamilton- J acobi Equation: Weak S olution We continue the study of the Hamilton-Jacobi equation:

Hamilton- J acobi Equation: Weak S olution We continue the study of the Hamilton-Jacobi equation: M ah 5 7 Fall 9 L ecure O c. 4, 9 ) Hamilon- J acobi Equaion: Weak S oluion We coninue he sudy of he Hamilon-Jacobi equaion: We have shown ha u + H D u) = R n, ) ; u = g R n { = }. ). In general we canno

More information

Hamilton- J acobi Equation: Explicit Formulas In this lecture we try to apply the method of characteristics to the Hamilton-Jacobi equation: u t

Hamilton- J acobi Equation: Explicit Formulas In this lecture we try to apply the method of characteristics to the Hamilton-Jacobi equation: u t M ah 5 2 7 Fall 2 0 0 9 L ecure 1 0 O c. 7, 2 0 0 9 Hamilon- J acobi Equaion: Explici Formulas In his lecure we ry o apply he mehod of characerisics o he Hamilon-Jacobi equaion: u + H D u, x = 0 in R n

More information

2. Nonlinear Conservation Law Equations

2. Nonlinear Conservation Law Equations . Nonlinear Conservaion Law Equaions One of he clear lessons learned over recen years in sudying nonlinear parial differenial equaions is ha i is generally no wise o ry o aack a general class of nonlinear

More information

Finish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details!

Finish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details! MAT 257, Handou 6: Ocober 7-2, 20. I. Assignmen. Finish reading Chaper 2 of Spiva, rereading earlier secions as necessary. handou and fill in some missing deails! II. Higher derivaives. Also, read his

More information

10. State Space Methods

10. State Space Methods . Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he

More information

Optimality Conditions for Unconstrained Problems

Optimality Conditions for Unconstrained Problems 62 CHAPTER 6 Opimaliy Condiions for Unconsrained Problems 1 Unconsrained Opimizaion 11 Exisence Consider he problem of minimizing he funcion f : R n R where f is coninuous on all of R n : P min f(x) x

More information

Chapter 2. First Order Scalar Equations

Chapter 2. First Order Scalar Equations Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.

More information

Lecture 20: Riccati Equations and Least Squares Feedback Control

Lecture 20: Riccati Equations and Least Squares Feedback Control 34-5 LINEAR SYSTEMS Lecure : Riccai Equaions and Leas Squares Feedback Conrol 5.6.4 Sae Feedback via Riccai Equaions A recursive approach in generaing he marix-valued funcion W ( ) equaion for i for he

More information

4 Sequences of measurable functions

4 Sequences of measurable functions 4 Sequences of measurable funcions 1. Le (Ω, A, µ) be a measure space (complee, afer a possible applicaion of he compleion heorem). In his chaper we invesigae relaions beween various (nonequivalen) convergences

More information

An Introduction to Malliavin calculus and its applications

An Introduction to Malliavin calculus and its applications An Inroducion o Malliavin calculus and is applicaions Lecure 5: Smoohness of he densiy and Hörmander s heorem David Nualar Deparmen of Mahemaics Kansas Universiy Universiy of Wyoming Summer School 214

More information

Chapter 6. Systems of First Order Linear Differential Equations

Chapter 6. Systems of First Order Linear Differential Equations Chaper 6 Sysems of Firs Order Linear Differenial Equaions We will only discuss firs order sysems However higher order sysems may be made ino firs order sysems by a rick shown below We will have a sligh

More information

Heat kernel and Harnack inequality on Riemannian manifolds

Heat kernel and Harnack inequality on Riemannian manifolds Hea kernel and Harnack inequaliy on Riemannian manifolds Alexander Grigor yan UHK 11/02/2014 onens 1 Laplace operaor and hea kernel 1 2 Uniform Faber-Krahn inequaliy 3 3 Gaussian upper bounds 4 4 ean-value

More information

arxiv: v2 [math.ap] 16 Oct 2017

arxiv: v2 [math.ap] 16 Oct 2017 Unspecified Journal Volume 00, Number 0, Pages 000 000 S????-????XX0000-0 MINIMIZATION SOLUTIONS TO CONSERVATION LAWS WITH NON-SMOOTH AND NON-STRICTLY CONVEX FLUX CAREY CAGINALP arxiv:1708.02339v2 [mah.ap]

More information

23.2. Representing Periodic Functions by Fourier Series. Introduction. Prerequisites. Learning Outcomes

23.2. Representing Periodic Functions by Fourier Series. Introduction. Prerequisites. Learning Outcomes Represening Periodic Funcions by Fourier Series 3. Inroducion In his Secion we show how a periodic funcion can be expressed as a series of sines and cosines. We begin by obaining some sandard inegrals

More information

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t...

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t... Mah 228- Fri Mar 24 5.6 Marix exponenials and linear sysems: The analogy beween firs order sysems of linear differenial equaions (Chaper 5) and scalar linear differenial equaions (Chaper ) is much sronger

More information

Math 527 Lecture 6: Hamilton-Jacobi Equation: Explicit Formulas

Math 527 Lecture 6: Hamilton-Jacobi Equation: Explicit Formulas Mah 527 Lecure 6: Hamilon-Jacobi Equaion: Explici Formulas Sep. 23, 2 Mehod of characerisics. We r o appl he mehod of characerisics o he Hamilon-Jacobi equaion: u +Hx, Du = in R n, u = g on R n =. 2 To

More information

Class Meeting # 10: Introduction to the Wave Equation

Class Meeting # 10: Introduction to the Wave Equation MATH 8.5 COURSE NOTES - CLASS MEETING # 0 8.5 Inroducion o PDEs, Fall 0 Professor: Jared Speck Class Meeing # 0: Inroducion o he Wave Equaion. Wha is he wave equaion? The sandard wave equaion for a funcion

More information

Ordinary Differential Equations

Ordinary Differential Equations Ordinary Differenial Equaions 5. Examples of linear differenial equaions and heir applicaions We consider some examples of sysems of linear differenial equaions wih consan coefficiens y = a y +... + a

More information

Matrix Versions of Some Refinements of the Arithmetic-Geometric Mean Inequality

Matrix Versions of Some Refinements of the Arithmetic-Geometric Mean Inequality Marix Versions of Some Refinemens of he Arihmeic-Geomeric Mean Inequaliy Bao Qi Feng and Andrew Tonge Absrac. We esablish marix versions of refinemens due o Alzer ], Carwrigh and Field 4], and Mercer 5]

More information

Two Coupled Oscillators / Normal Modes

Two Coupled Oscillators / Normal Modes Lecure 3 Phys 3750 Two Coupled Oscillaors / Normal Modes Overview and Moivaion: Today we ake a small, bu significan, sep owards wave moion. We will no ye observe waves, bu his sep is imporan in is own

More information

EXERCISES FOR SECTION 1.5

EXERCISES FOR SECTION 1.5 1.5 Exisence and Uniqueness of Soluions 43 20. 1 v c 21. 1 v c 1 2 4 6 8 10 1 2 2 4 6 8 10 Graph of approximae soluion obained using Euler s mehod wih = 0.1. Graph of approximae soluion obained using Euler

More information

SPECTRAL EVOLUTION OF A ONE PARAMETER EXTENSION OF A REAL SYMMETRIC TOEPLITZ MATRIX* William F. Trench. SIAM J. Matrix Anal. Appl. 11 (1990),

SPECTRAL EVOLUTION OF A ONE PARAMETER EXTENSION OF A REAL SYMMETRIC TOEPLITZ MATRIX* William F. Trench. SIAM J. Matrix Anal. Appl. 11 (1990), SPECTRAL EVOLUTION OF A ONE PARAMETER EXTENSION OF A REAL SYMMETRIC TOEPLITZ MATRIX* William F Trench SIAM J Marix Anal Appl 11 (1990), 601-611 Absrac Le T n = ( i j ) n i,j=1 (n 3) be a real symmeric

More information

Math-Net.Ru All Russian mathematical portal

Math-Net.Ru All Russian mathematical portal Mah-Ne.Ru All Russian mahemaical poral Aleksei S. Rodin, On he srucure of singular se of a piecewise smooh minimax soluion of Hamilon-Jacobi-Bellman equaion, Ural Mah. J., 2016, Volume 2, Issue 1, 58 68

More information

Math 334 Fall 2011 Homework 11 Solutions

Math 334 Fall 2011 Homework 11 Solutions Dec. 2, 2 Mah 334 Fall 2 Homework Soluions Basic Problem. Transform he following iniial value problem ino an iniial value problem for a sysem: u + p()u + q() u g(), u() u, u () v. () Soluion. Le v u. Then

More information

arxiv: v1 [math.fa] 9 Dec 2018

arxiv: v1 [math.fa] 9 Dec 2018 AN INVERSE FUNCTION THEOREM CONVERSE arxiv:1812.03561v1 [mah.fa] 9 Dec 2018 JIMMIE LAWSON Absrac. We esablish he following converse of he well-known inverse funcion heorem. Le g : U V and f : V U be inverse

More information

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,

More information

THE WAVE EQUATION. part hand-in for week 9 b. Any dilation v(x, t) = u(λx, λt) of u(x, t) is also a solution (where λ is constant).

THE WAVE EQUATION. part hand-in for week 9 b. Any dilation v(x, t) = u(λx, λt) of u(x, t) is also a solution (where λ is constant). THE WAVE EQUATION 43. (S) Le u(x, ) be a soluion of he wave equaion u u xx = 0. Show ha Q43(a) (c) is a. Any ranslaion v(x, ) = u(x + x 0, + 0 ) of u(x, ) is also a soluion (where x 0, 0 are consans).

More information

t 2 B F x,t n dsdt t u x,t dxdt

t 2 B F x,t n dsdt t u x,t dxdt Evoluion Equaions For 0, fixed, le U U0, where U denoes a bounded open se in R n.suppose ha U is filled wih a maerial in which a conaminan is being ranspored by various means including diffusion and convecion.

More information

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still.

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still. Lecure - Kinemaics in One Dimension Displacemen, Velociy and Acceleraion Everyhing in he world is moving. Nohing says sill. Moion occurs a all scales of he universe, saring from he moion of elecrons in

More information

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation Course Noes for EE7C Spring 018: Convex Opimizaion and Approximaion Insrucor: Moriz Hard Email: hard+ee7c@berkeley.edu Graduae Insrucor: Max Simchowiz Email: msimchow+ee7c@berkeley.edu Ocober 15, 018 3

More information

Convergence of the Neumann series in higher norms

Convergence of the Neumann series in higher norms Convergence of he Neumann series in higher norms Charles L. Epsein Deparmen of Mahemaics, Universiy of Pennsylvania Version 1.0 Augus 1, 003 Absrac Naural condiions on an operaor A are given so ha he Neumann

More information

Essential Microeconomics : OPTIMAL CONTROL 1. Consider the following class of optimization problems

Essential Microeconomics : OPTIMAL CONTROL 1. Consider the following class of optimization problems Essenial Microeconomics -- 6.5: OPIMAL CONROL Consider he following class of opimizaion problems Max{ U( k, x) + U+ ( k+ ) k+ k F( k, x)}. { x, k+ } = In he language of conrol heory, he vecor k is he vecor

More information

Lecture 10: The Poincaré Inequality in Euclidean space

Lecture 10: The Poincaré Inequality in Euclidean space Deparmens of Mahemaics Monana Sae Universiy Fall 215 Prof. Kevin Wildrick n inroducion o non-smooh analysis and geomery Lecure 1: The Poincaré Inequaliy in Euclidean space 1. Wha is he Poincaré inequaliy?

More information

14 Autoregressive Moving Average Models

14 Autoregressive Moving Average Models 14 Auoregressive Moving Average Models In his chaper an imporan parameric family of saionary ime series is inroduced, he family of he auoregressive moving average, or ARMA, processes. For a large class

More information

Differential Harnack Estimates for Parabolic Equations

Differential Harnack Estimates for Parabolic Equations Differenial Harnack Esimaes for Parabolic Equaions Xiaodong Cao and Zhou Zhang Absrac Le M,g be a soluion o he Ricci flow on a closed Riemannian manifold In his paper, we prove differenial Harnack inequaliies

More information

15. Vector Valued Functions

15. Vector Valued Functions 1. Vecor Valued Funcions Up o his poin, we have presened vecors wih consan componens, for example, 1, and,,4. However, we can allow he componens of a vecor o be funcions of a common variable. For example,

More information

MATH 4330/5330, Fourier Analysis Section 6, Proof of Fourier s Theorem for Pointwise Convergence

MATH 4330/5330, Fourier Analysis Section 6, Proof of Fourier s Theorem for Pointwise Convergence MATH 433/533, Fourier Analysis Secion 6, Proof of Fourier s Theorem for Poinwise Convergence Firs, some commens abou inegraing periodic funcions. If g is a periodic funcion, g(x + ) g(x) for all real x,

More information

MATH 5720: Gradient Methods Hung Phan, UMass Lowell October 4, 2018

MATH 5720: Gradient Methods Hung Phan, UMass Lowell October 4, 2018 MATH 5720: Gradien Mehods Hung Phan, UMass Lowell Ocober 4, 208 Descen Direcion Mehods Consider he problem min { f(x) x R n}. The general descen direcions mehod is x k+ = x k + k d k where x k is he curren

More information

SMT 2014 Calculus Test Solutions February 15, 2014 = 3 5 = 15.

SMT 2014 Calculus Test Solutions February 15, 2014 = 3 5 = 15. SMT Calculus Tes Soluions February 5,. Le f() = and le g() =. Compue f ()g (). Answer: 5 Soluion: We noe ha f () = and g () = 6. Then f ()g () =. Plugging in = we ge f ()g () = 6 = 3 5 = 5.. There is a

More information

Homogenization of random Hamilton Jacobi Bellman Equations

Homogenization of random Hamilton Jacobi Bellman Equations Probabiliy, Geomery and Inegrable Sysems MSRI Publicaions Volume 55, 28 Homogenizaion of random Hamilon Jacobi Bellman Equaions S. R. SRINIVASA VARADHAN ABSTRACT. We consider nonlinear parabolic equaions

More information

A remark on the H -calculus

A remark on the H -calculus A remark on he H -calculus Nigel J. Kalon Absrac If A, B are secorial operaors on a Hilber space wih he same domain range, if Ax Bx A 1 x B 1 x, hen i is a resul of Auscher, McInosh Nahmod ha if A has

More information

Linear Response Theory: The connection between QFT and experiments

Linear Response Theory: The connection between QFT and experiments Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and

More information

A Note on Superlinear Ambrosetti-Prodi Type Problem in a Ball

A Note on Superlinear Ambrosetti-Prodi Type Problem in a Ball A Noe on Superlinear Ambrosei-Prodi Type Problem in a Ball by P. N. Srikanh 1, Sanjiban Sanra 2 Absrac Using a careful analysis of he Morse Indices of he soluions obained by using he Mounain Pass Theorem

More information

Math Week 14 April 16-20: sections first order systems of linear differential equations; 7.4 mass-spring systems.

Math Week 14 April 16-20: sections first order systems of linear differential equations; 7.4 mass-spring systems. Mah 2250-004 Week 4 April 6-20 secions 7.-7.3 firs order sysems of linear differenial equaions; 7.4 mass-spring sysems. Mon Apr 6 7.-7.2 Sysems of differenial equaions (7.), and he vecor Calculus we need

More information

CHAPTER 2 Signals And Spectra

CHAPTER 2 Signals And Spectra CHAPER Signals And Specra Properies of Signals and Noise In communicaion sysems he received waveform is usually caegorized ino he desired par conaining he informaion, and he undesired par. he desired par

More information

The Asymptotic Behavior of Nonoscillatory Solutions of Some Nonlinear Dynamic Equations on Time Scales

The Asymptotic Behavior of Nonoscillatory Solutions of Some Nonlinear Dynamic Equations on Time Scales Advances in Dynamical Sysems and Applicaions. ISSN 0973-5321 Volume 1 Number 1 (2006, pp. 103 112 c Research India Publicaions hp://www.ripublicaion.com/adsa.hm The Asympoic Behavior of Nonoscillaory Soluions

More information

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon 3..3 INRODUCION O DYNAMIC OPIMIZAION: DISCREE IME PROBLEMS A. he Hamilonian and Firs-Order Condiions in a Finie ime Horizon Define a new funcion, he Hamilonian funcion, H. H he change in he oal value of

More information

RANDOM LAGRANGE MULTIPLIERS AND TRANSVERSALITY

RANDOM LAGRANGE MULTIPLIERS AND TRANSVERSALITY ECO 504 Spring 2006 Chris Sims RANDOM LAGRANGE MULTIPLIERS AND TRANSVERSALITY 1. INTRODUCTION Lagrange muliplier mehods are sandard fare in elemenary calculus courses, and hey play a cenral role in economic

More information

ODEs II, Lecture 1: Homogeneous Linear Systems - I. Mike Raugh 1. March 8, 2004

ODEs II, Lecture 1: Homogeneous Linear Systems - I. Mike Raugh 1. March 8, 2004 ODEs II, Lecure : Homogeneous Linear Sysems - I Mike Raugh March 8, 4 Inroducion. In he firs lecure we discussed a sysem of linear ODEs for modeling he excreion of lead from he human body, saw how o ransform

More information

Inventory Analysis and Management. Multi-Period Stochastic Models: Optimality of (s, S) Policy for K-Convex Objective Functions

Inventory Analysis and Management. Multi-Period Stochastic Models: Optimality of (s, S) Policy for K-Convex Objective Functions Muli-Period Sochasic Models: Opimali of (s, S) Polic for -Convex Objecive Funcions Consider a seing similar o he N-sage newsvendor problem excep ha now here is a fixed re-ordering cos (> 0) for each (re-)order.

More information

Monotonic Solutions of a Class of Quadratic Singular Integral Equations of Volterra type

Monotonic Solutions of a Class of Quadratic Singular Integral Equations of Volterra type In. J. Conemp. Mah. Sci., Vol. 2, 27, no. 2, 89-2 Monoonic Soluions of a Class of Quadraic Singular Inegral Equaions of Volerra ype Mahmoud M. El Borai Deparmen of Mahemaics, Faculy of Science, Alexandria

More information

Differential Equations

Differential Equations Mah 21 (Fall 29) Differenial Equaions Soluion #3 1. Find he paricular soluion of he following differenial equaion by variaion of parameer (a) y + y = csc (b) 2 y + y y = ln, > Soluion: (a) The corresponding

More information

MODULE 3 FUNCTION OF A RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES PROBABILITY DISTRIBUTION OF A FUNCTION OF A RANDOM VARIABLE

MODULE 3 FUNCTION OF A RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES PROBABILITY DISTRIBUTION OF A FUNCTION OF A RANDOM VARIABLE Topics MODULE 3 FUNCTION OF A RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES 2-6 3. FUNCTION OF A RANDOM VARIABLE 3.2 PROBABILITY DISTRIBUTION OF A FUNCTION OF A RANDOM VARIABLE 3.3 EXPECTATION AND MOMENTS

More information

Chapter 3 Boundary Value Problem

Chapter 3 Boundary Value Problem Chaper 3 Boundary Value Problem A boundary value problem (BVP) is a problem, ypically an ODE or a PDE, which has values assigned on he physical boundary of he domain in which he problem is specified. Le

More information

STATE-SPACE MODELLING. A mass balance across the tank gives:

STATE-SPACE MODELLING. A mass balance across the tank gives: B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing

More information

Vanishing Viscosity Method. There are another instructive and perhaps more natural discontinuous solutions of the conservation law

Vanishing Viscosity Method. There are another instructive and perhaps more natural discontinuous solutions of the conservation law Vanishing Viscosiy Mehod. There are anoher insrucive and perhaps more naural disconinuous soluions of he conservaion law (1 u +(q(u x 0, he so called vanishing viscosiy mehod. This mehod consiss in viewing

More information

Endpoint Strichartz estimates

Endpoint Strichartz estimates Endpoin Sricharz esimaes Markus Keel and Terence Tao (Amer. J. Mah. 10 (1998) 955 980) Presener : Nobu Kishimoo (Kyoo Universiy) 013 Paricipaing School in Analysis of PDE 013/8/6 30, Jeju 1 Absrac of he

More information

1. Introduction The present paper is concerned with the scalar conservation law in one space dimension: u t + (A(u)) x = 0 (1.0.1)

1. Introduction The present paper is concerned with the scalar conservation law in one space dimension: u t + (A(u)) x = 0 (1.0.1) SINGLE ENTROPY CONDITION FOR BURGERS EQUATION VIA THE RELATIVE ENTROPY METHOD SAM G. KRUPA AND ALEXIS F. VASSEUR Absrac. This paper provides a new proof of uniqueness of soluions o scalar conservaion laws

More information

IMPLICIT AND INVERSE FUNCTION THEOREMS PAUL SCHRIMPF 1 OCTOBER 25, 2013

IMPLICIT AND INVERSE FUNCTION THEOREMS PAUL SCHRIMPF 1 OCTOBER 25, 2013 IMPLICI AND INVERSE FUNCION HEOREMS PAUL SCHRIMPF 1 OCOBER 25, 213 UNIVERSIY OF BRIISH COLUMBIA ECONOMICS 526 We have exensively sudied how o solve sysems of linear equaions. We know how o check wheher

More information

6.2 Transforms of Derivatives and Integrals.

6.2 Transforms of Derivatives and Integrals. SEC. 6.2 Transforms of Derivaives and Inegrals. ODEs 2 3 33 39 23. Change of scale. If l( f ()) F(s) and c is any 33 45 APPLICATION OF s-shifting posiive consan, show ha l( f (c)) F(s>c)>c (Hin: In Probs.

More information

1 Review of Zero-Sum Games

1 Review of Zero-Sum Games COS 5: heoreical Machine Learning Lecurer: Rob Schapire Lecure #23 Scribe: Eugene Brevdo April 30, 2008 Review of Zero-Sum Games Las ime we inroduced a mahemaical model for wo player zero-sum games. Any

More information

POSITIVE SOLUTIONS OF NEUTRAL DELAY DIFFERENTIAL EQUATION

POSITIVE SOLUTIONS OF NEUTRAL DELAY DIFFERENTIAL EQUATION Novi Sad J. Mah. Vol. 32, No. 2, 2002, 95-108 95 POSITIVE SOLUTIONS OF NEUTRAL DELAY DIFFERENTIAL EQUATION Hajnalka Péics 1, János Karsai 2 Absrac. We consider he scalar nonauonomous neural delay differenial

More information

Oscillation of an Euler Cauchy Dynamic Equation S. Huff, G. Olumolode, N. Pennington, and A. Peterson

Oscillation of an Euler Cauchy Dynamic Equation S. Huff, G. Olumolode, N. Pennington, and A. Peterson PROCEEDINGS OF THE FOURTH INTERNATIONAL CONFERENCE ON DYNAMICAL SYSTEMS AND DIFFERENTIAL EQUATIONS May 4 7, 00, Wilmingon, NC, USA pp 0 Oscillaion of an Euler Cauchy Dynamic Equaion S Huff, G Olumolode,

More information

Solutions from Chapter 9.1 and 9.2

Solutions from Chapter 9.1 and 9.2 Soluions from Chaper 9 and 92 Secion 9 Problem # This basically boils down o an exercise in he chain rule from calculus We are looking for soluions of he form: u( x) = f( k x c) where k x R 3 and k is

More information

THE BELLMAN PRINCIPLE OF OPTIMALITY

THE BELLMAN PRINCIPLE OF OPTIMALITY THE BELLMAN PRINCIPLE OF OPTIMALITY IOANID ROSU As I undersand, here are wo approaches o dynamic opimizaion: he Ponrjagin Hamilonian) approach, and he Bellman approach. I saw several clear discussions

More information

Section 3.5 Nonhomogeneous Equations; Method of Undetermined Coefficients

Section 3.5 Nonhomogeneous Equations; Method of Undetermined Coefficients Secion 3.5 Nonhomogeneous Equaions; Mehod of Undeermined Coefficiens Key Terms/Ideas: Linear Differenial operaor Nonlinear operaor Second order homogeneous DE Second order nonhomogeneous DE Soluion o homogeneous

More information

1. An introduction to dynamic optimization -- Optimal Control and Dynamic Programming AGEC

1. An introduction to dynamic optimization -- Optimal Control and Dynamic Programming AGEC This documen was generaed a :45 PM 8/8/04 Copyrigh 04 Richard T. Woodward. An inroducion o dynamic opimizaion -- Opimal Conrol and Dynamic Programming AGEC 637-04 I. Overview of opimizaion Opimizaion is

More information

An Introduction to Backward Stochastic Differential Equations (BSDEs) PIMS Summer School 2016 in Mathematical Finance.

An Introduction to Backward Stochastic Differential Equations (BSDEs) PIMS Summer School 2016 in Mathematical Finance. 1 An Inroducion o Backward Sochasic Differenial Equaions (BSDEs) PIMS Summer School 2016 in Mahemaical Finance June 25, 2016 Chrisoph Frei cfrei@ualbera.ca This inroducion is based on Touzi [14], Bouchard

More information

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8) I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression

More information

This document was generated at 1:04 PM, 09/10/13 Copyright 2013 Richard T. Woodward. 4. End points and transversality conditions AGEC

This document was generated at 1:04 PM, 09/10/13 Copyright 2013 Richard T. Woodward. 4. End points and transversality conditions AGEC his documen was generaed a 1:4 PM, 9/1/13 Copyrigh 213 Richard. Woodward 4. End poins and ransversaliy condiions AGEC 637-213 F z d Recall from Lecure 3 ha a ypical opimal conrol problem is o maimize (,,

More information

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB Elecronic Companion EC.1. Proofs of Technical Lemmas and Theorems LEMMA 1. Le C(RB) be he oal cos incurred by he RB policy. Then we have, T L E[C(RB)] 3 E[Z RB ]. (EC.1) Proof of Lemma 1. Using he marginal

More information

( ) ( ) if t = t. It must satisfy the identity. So, bulkiness of the unit impulse (hyper)function is equal to 1. The defining characteristic is

( ) ( ) if t = t. It must satisfy the identity. So, bulkiness of the unit impulse (hyper)function is equal to 1. The defining characteristic is UNIT IMPULSE RESPONSE, UNIT STEP RESPONSE, STABILITY. Uni impulse funcion (Dirac dela funcion, dela funcion) rigorously defined is no sricly a funcion, bu disribuion (or measure), precise reamen requires

More information

Theory of! Partial Differential Equations!

Theory of! Partial Differential Equations! hp://www.nd.edu/~gryggva/cfd-course/! Ouline! Theory o! Parial Dierenial Equaions! Gréar Tryggvason! Spring 011! Basic Properies o PDE!! Quasi-linear Firs Order Equaions! - Characerisics! - Linear and

More information

11!Hí MATHEMATICS : ERDŐS AND ULAM PROC. N. A. S. of decomposiion, properly speaking) conradics he possibiliy of defining a counably addiive real-valu

11!Hí MATHEMATICS : ERDŐS AND ULAM PROC. N. A. S. of decomposiion, properly speaking) conradics he possibiliy of defining a counably addiive real-valu ON EQUATIONS WITH SETS AS UNKNOWNS BY PAUL ERDŐS AND S. ULAM DEPARTMENT OF MATHEMATICS, UNIVERSITY OF COLORADO, BOULDER Communicaed May 27, 1968 We shall presen here a number of resuls in se heory concerning

More information

18 Biological models with discrete time

18 Biological models with discrete time 8 Biological models wih discree ime The mos imporan applicaions, however, may be pedagogical. The elegan body of mahemaical heory peraining o linear sysems (Fourier analysis, orhogonal funcions, and so

More information

23.5. Half-Range Series. Introduction. Prerequisites. Learning Outcomes

23.5. Half-Range Series. Introduction. Prerequisites. Learning Outcomes Half-Range Series 2.5 Inroducion In his Secion we address he following problem: Can we find a Fourier series expansion of a funcion defined over a finie inerval? Of course we recognise ha such a funcion

More information

Vehicle Arrival Models : Headway

Vehicle Arrival Models : Headway Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where

More information

arxiv: v1 [math.ap] 22 Oct 2018

arxiv: v1 [math.ap] 22 Oct 2018 A varifold formulaion of mean curvaure flow wih Dirichle or dynamic boundary condiions Yoshikazu Giga, Fumihiko Onoue, Keisuke Takasao Ocober 3, 18 arxiv:181.917v1 [mah.ap] Oc 18 Absrac We consider he

More information

On Oscillation of a Generalized Logistic Equation with Several Delays

On Oscillation of a Generalized Logistic Equation with Several Delays Journal of Mahemaical Analysis and Applicaions 253, 389 45 (21) doi:1.16/jmaa.2.714, available online a hp://www.idealibrary.com on On Oscillaion of a Generalized Logisic Equaion wih Several Delays Leonid

More information

Lecture 6: Wiener Process

Lecture 6: Wiener Process Lecure 6: Wiener Process Eric Vanden-Eijnden Chapers 6, 7 and 8 offer a (very) brief inroducion o sochasic analysis. These lecures are based in par on a book projec wih Weinan E. A sandard reference for

More information

Theory of! Partial Differential Equations-I!

Theory of! Partial Differential Equations-I! hp://users.wpi.edu/~grear/me61.hml! Ouline! Theory o! Parial Dierenial Equaions-I! Gréar Tryggvason! Spring 010! Basic Properies o PDE!! Quasi-linear Firs Order Equaions! - Characerisics! - Linear and

More information

MATH 128A, SUMMER 2009, FINAL EXAM SOLUTION

MATH 128A, SUMMER 2009, FINAL EXAM SOLUTION MATH 28A, SUMME 2009, FINAL EXAM SOLUTION BENJAMIN JOHNSON () (8 poins) [Lagrange Inerpolaion] (a) (4 poins) Le f be a funcion defined a some real numbers x 0,..., x n. Give a defining equaion for he Lagrange

More information

Representation of Stochastic Process by Means of Stochastic Integrals

Representation of Stochastic Process by Means of Stochastic Integrals Inernaional Journal of Mahemaics Research. ISSN 0976-5840 Volume 5, Number 4 (2013), pp. 385-397 Inernaional Research Publicaion House hp://www.irphouse.com Represenaion of Sochasic Process by Means of

More information

Optima and Equilibria for Traffic Flow on a Network

Optima and Equilibria for Traffic Flow on a Network Opima and Equilibria for Traffic Flow on a Nework Albero Bressan Deparmen of Mahemaics, Penn Sae Universiy bressan@mah.psu.edu Albero Bressan (Penn Sae) Opima and equilibria for raffic flow 1 / 1 A Traffic

More information

Boundedness and Exponential Asymptotic Stability in Dynamical Systems with Applications to Nonlinear Differential Equations with Unbounded Terms

Boundedness and Exponential Asymptotic Stability in Dynamical Systems with Applications to Nonlinear Differential Equations with Unbounded Terms Advances in Dynamical Sysems and Applicaions. ISSN 0973-531 Volume Number 1 007, pp. 107 11 Research India Publicaions hp://www.ripublicaion.com/adsa.hm Boundedness and Exponenial Asympoic Sabiliy in Dynamical

More information

4. Advanced Stability Theory

4. Advanced Stability Theory Applied Nonlinear Conrol Nguyen an ien - 4 4 Advanced Sabiliy heory he objecive of his chaper is o presen sabiliy analysis for non-auonomous sysems 41 Conceps of Sabiliy for Non-Auonomous Sysems Equilibrium

More information

1 Solutions to selected problems

1 Solutions to selected problems 1 Soluions o seleced problems 1. Le A B R n. Show ha in A in B bu in general bd A bd B. Soluion. Le x in A. Then here is ɛ > 0 such ha B ɛ (x) A B. This shows x in B. If A = [0, 1] and B = [0, 2], hen

More information

Positive continuous solution of a quadratic integral equation of fractional orders

Positive continuous solution of a quadratic integral equation of fractional orders Mah. Sci. Le., No., 9-7 (3) 9 Mahemaical Sciences Leers An Inernaional Journal @ 3 NSP Naural Sciences Publishing Cor. Posiive coninuous soluion of a quadraic inegral equaion of fracional orders A. M.

More information

On Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature

On Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature On Measuring Pro-Poor Growh 1. On Various Ways of Measuring Pro-Poor Growh: A Shor eview of he Lieraure During he pas en years or so here have been various suggesions concerning he way one should check

More information

Essential Maps and Coincidence Principles for General Classes of Maps

Essential Maps and Coincidence Principles for General Classes of Maps Filoma 31:11 (2017), 3553 3558 hps://doi.org/10.2298/fil1711553o Published by Faculy of Sciences Mahemaics, Universiy of Niš, Serbia Available a: hp://www.pmf.ni.ac.rs/filoma Essenial Maps Coincidence

More information

On Boundedness of Q-Learning Iterates for Stochastic Shortest Path Problems

On Boundedness of Q-Learning Iterates for Stochastic Shortest Path Problems MATHEMATICS OF OPERATIONS RESEARCH Vol. 38, No. 2, May 2013, pp. 209 227 ISSN 0364-765X (prin) ISSN 1526-5471 (online) hp://dx.doi.org/10.1287/moor.1120.0562 2013 INFORMS On Boundedness of Q-Learning Ieraes

More information

Robust estimation based on the first- and third-moment restrictions of the power transformation model

Robust estimation based on the first- and third-moment restrictions of the power transformation model h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,

More information

Clarke s Generalized Gradient and Edalat s L-derivative

Clarke s Generalized Gradient and Edalat s L-derivative 1 21 ISSN 1759-9008 1 Clarke s Generalized Gradien and Edala s L-derivaive PETER HERTLING Absrac: Clarke [2, 3, 4] inroduced a generalized gradien for real-valued Lipschiz coninuous funcions on Banach

More information

DISCRETE GRONWALL LEMMA AND APPLICATIONS

DISCRETE GRONWALL LEMMA AND APPLICATIONS DISCRETE GRONWALL LEMMA AND APPLICATIONS JOHN M. HOLTE MAA NORTH CENTRAL SECTION MEETING AT UND 24 OCTOBER 29 Gronwall s lemma saes an inequaliy ha is useful in he heory of differenial equaions. Here is

More information

6. Stochastic calculus with jump processes

6. Stochastic calculus with jump processes A) Trading sraegies (1/3) Marke wih d asses S = (S 1,, S d ) A rading sraegy can be modelled wih a vecor φ describing he quaniies invesed in each asse a each insan : φ = (φ 1,, φ d ) The value a of a porfolio

More information

Let us start with a two dimensional case. We consider a vector ( x,

Let us start with a two dimensional case. We consider a vector ( x, Roaion marices We consider now roaion marices in wo and hree dimensions. We sar wih wo dimensions since wo dimensions are easier han hree o undersand, and one dimension is a lile oo simple. However, our

More information

Single and Double Pendulum Models

Single and Double Pendulum Models Single and Double Pendulum Models Mah 596 Projec Summary Spring 2016 Jarod Har 1 Overview Differen ypes of pendulums are used o model many phenomena in various disciplines. In paricular, single and double

More information

After the completion of this section the student. Theory of Linear Systems of ODEs. Autonomous Systems. Review Questions and Exercises

After the completion of this section the student. Theory of Linear Systems of ODEs. Autonomous Systems. Review Questions and Exercises Chaper V ODE V.5 Sysems of Ordinary Differenial Equaions 45 V.5 SYSTEMS OF FIRST ORDER LINEAR ODEs Objecives: Afer he compleion of his secion he suden - should recall he definiion of a sysem of linear

More information

Admissible Solution for Hyperbolic Conservation Laws

Admissible Solution for Hyperbolic Conservation Laws Admissible Soluion for Hyperbolic Conservaion Laws M.Sc. Projec Repor (Firs Sage) By Bankim Chandra Mandal Roll No: 08509016 Under he Guidance of Prof. S. Baskar Deparmen of Mahemaics Indian Insiue of

More information