MAXIMUM PROCESS PROBLEMS IN OPTIMAL CONTROL THEORY

Size: px
Start display at page:

Download "MAXIMUM PROCESS PROBLEMS IN OPTIMAL CONTROL THEORY"

Transcription

1 MAXIMUM PROCESS PROBLEMS IN OPTIMAL CONTROL THEORY GORAN PESKIR Receied 16 January 24 and in reised form 23 June 24 Gien a standard Brownian motion B t ) t and the equation of motion dx t = t dt+ 2dBt,wesetS t = max s t X s and consider the optimal control problem sup ES τ cτ), where c> and the supremum is taken oer all admissible controls satisfying t [µ,µ 1 ]forallt up to τ = inf{t> X t / l,l 1 )} with µ < <µ 1 and l < <l 1 gien and fixed. The following control is proed to be optimal: pull as hard as possible, that is, t = µ if X t <g S t ), and push as hard as possible, that is, t = µ 1 if X t >g S t ), where s g s) is a switching cure that is determined explicitly as the unique solution to a nonlinear differential equation). The solution found demonstrates that the problem formulations based on a maximum functional can be successfully included in optimal control theory calculus of ariations) in addition to the classic problem formulations due to Lagrange, Mayer, and Bolza. 1. Introduction Stochastic control theory deals with three basic problem formulations which were inherited from classical calculus of ariations cf. [4, pages 25-26]). Gien the equation of motion dx t = µ X t,u t ) dt + σ Xt,u t ) dbt, 1.1) where B t ) t is standard Brownian motion, consider the optimal control problem inf u E x τd L X t,u t ) dt + M XτD ) ), 1.2) where the infimum is taken oer all admissible controls u = u t ) t applied before the exit time τ D = inf{t> X t / C} for some open set C = D c and the process X t ) t starts at x under P x.ifm andl, problem 1.2) issaidtobelagrange formulated. If L andm, problem 1.2)issaidtobeMayer formulated. If both L andm, problem 1.2)is said to be Bolza formulated. Copyright 25 Applied Mathematics and Stochastic Analysis 25:1 25) DOI: /JAMSA.25.77

2 78 Maximum process and optimal control The Lagrange formulation goes back to the 18th century, the Mayer formulation originated in the 19th century, and the Bolza formulation [2] was introduced in We refer to [1, pages ] and the references therein for a historical account of the Lagrange, Mayer, and Bolza problems. Although the three problem formulations are formally known to be equialent see, e.g., [1, pages ], [4, pages 25 26]), this fact is rarely proed to be essential when soling a concrete problem. Setting Z t = LX t,u t )orz t = MX t ), and focusing upon the sample path t Z t for t [,τ D ], we see that the three problem formulations measure the performance associated with a control u by means of the following two functionals: τd Z t dt, Z τd, 1.3) where the first one represents the surface area below or aboe) the sample path, and the second one represents the sample path terminal alue. In addition to these two functionals, it is suggested by elementary geometric considerations that the maximal alue of the sample path max Z t 1.4) t τ D proides yet another performance measure which, to a certain extent, is more sensitie than the preious two. Clearly, a sample path can hae a small integral but still a large maximum, while a large maximum cannot be detected by the terminal alue either. The main purpose of the present paper is to show that the problem formulations based on a maximum functional can be successfully added to optimal control theory calculus of ariations). This is done by formulating a specific problem of this type Section 2)and soling it in a closed form Section 3). The result suggests a number of new aenues for further research upon extending the Bolza formulation 1.2) to optimize the following expression: E x max K ) τd X t,u t + L ) ) ) X t,u t dt + M XτD, 1.5) t τ D wheresomeofthemapsk, L,andM may also be identically zero. Optimal stopping problems for the maximum process hae been studied by a number of authors in the 199 s see, e.g., [6, 3, 1, 8, 5]) and the subject seems to be wellunderstood now. 2. Formulation of the problem Consider a process X = X t ) t soling the stochastic differential equation s.d.e.) dx t = t dt + 2dB t, 2.1)

3 Goran Peskir 79 where B = B t ) t is standard Brownian motion, and associate with X the maximum process ) S t = max X r s 2.2) r t so that X = x and S = s under P x,s,wherex s. Introduce the exit time τ = inf { t> X t / l,l 1 )}, 2.3) where l < <l 1 are gien and fixed, and so let c> in the sequel. The optimal control problem to be examined in this paper is formulated as follows: Jx,s):= supe x,s Sτ cτ ), 2.4) where the supremum is taken oer all admissible controls satisfying t [µ,µ 1 ]for all t τ with some µ < <µ 1 gien and fixed. By admissible we mean that the s.d.e. 2.1) can be soled in Itô s sense either strongly or weakly). Since t is required to be uniformly bounded, it is well known that a weak solution unique in law) always exists under a measurability condition see, e.g., [9, page 155]), where t may depend on theentiresamplepathr X r up to time t. Moreoer,if t = X t ) for some bounded) measurable function, then a strong solution pathwise unique) also exists see, e.g., [9, pages ]). The optimal control problem 2.4) has some interesting interpretations. Equation 2.1) may be iewed as describing the motion of a Brownian particle subject to a fluctuating force Ḃ t ) that is under the influence of a slowly arying) external force t see [7,pages 53 78]).The objectie in 2.4) is therefore to determine an optimum of the externalforcethatoneneedstoexertupontheparticlesoastomakeitsmaximalheight at the time of exit as large as possible in the course of time needed for the same exit to happen as short as possible. Clearly, the interpretation and objectie just described carry oer to many other problems where 2.1) plays a role. It appears intuitiely clear that the optimal control should be of the following bangbang type: at each time either push or pull as hard as possible so as to reach either l 1 or l as soon as possible. The solution of the problem presented in the next section confirms this guess and makes the statement precise in analytic terms. It is also apparent that at each time t we need to keep track of both X t and S t so that the problem is inherently two dimensional. 3. Solution of the problem 1) In the setting of the preious section, consider the optimal control problem 2.4). Note that X t = X t,s t ) is a two-dimensional process with the state space S ={x,s) R 2 x s} that changes increases) in the second coordinate only after hitting the diagonal x = s in R 2.Off the diagonal, the process X = X t ) t changes only in the first coordinate and thus may be identified with X. Moreoer,if t = X t ) for some bounded) measurable function in 2.1), then X is a Marko process. The later feedback controls are sufficient

4 8 Maximum process and optimal control to be considered under fairly general hypotheses see, e.g., [4, pages ]), and this fact will also be proed below. The infinitesimalgeneratorof X may be therefore formally described as follows: L X = L X in x<s, 3.1) = s atx = s, 3.2) where L X is the infinitesimal generator of X. This means that the infinitesimal generator of X is acting on a space of C 2 functions f on S satisfying lim x s f/ s)x,s) =. The formal description 3.1)+3.2) appears in[8, pages ], where the latter fact is also erified. The condition of normal reflection 3.2) was used for the first time in [3] in the case of Bessel processes it was also noted in [6, page 181] in the case of a Bessel process of dimension one). 2) Assuming for a moment that the supremum in 2.4) is attained at some feedback control, and making use of the formal description of the infinitesimal generator 3.1)+3.2), we are naturally led to formulate the following HJB system: sup L X J) c ) = inc for x<s, 3.3) J s x,s) x=s = normal reflection), 3.4) Jx,s) x=l+ = s instantaneous stopping), 3.5) Jx,s) x=l1 = s instantaneous stopping), 3.6) for l <s<l 1, where the infinitesimal generator of X gien is expressed by L X = x + 2 x 2 3.7) and we set C ={x,s) R 2 l <x s<l 1 }.Ourmaineffort in the sequel will be directed to soling the system 3.3) 3.6)in a closed form. More explicitly, the HJB equation 3.3) with J = Jx,s) reads as follows: sup Jx + J xx c ) = 3.8) so that we may expect a bang-bang solution depending on the sign of J x.ifj x <, then t = µ,andifj x >, then t = µ 1. The equation J x = defines an optimal switching cure s g s), and the main task in the sequel will be to determine it explicitly. Further heuristic considerations based on the bang-bang principle just stated when close to l apply µ so to exit at l, and when close to l 1 apply µ 1 so to exit at l 1 )suggest to partition C into the following three subsets modulo two cures x = g s) ands = s

5 l 1 l x l 1 Goran Peskir 81 C 1 C 2 s g s) s x S C 3 l Figure 3.1. The case of small c in problem 2.4). to be found): C 1 = { x,s) R 2 } l <x<g s), s <s<l 1, 3.9) C 2 = { x,s) R 2 } g s) <x s, s <s<l 1, 3.1) C 3 = { x,s) R 2 } l <x s<s, 3.11) where s is a unique point in l,l 1 ) satisfying In addition to 3.11), we also set g s ) = l. 3.12) g l1 ) = x 3.13) to denote another point in l,l 1 ) playing a role. We refer to Figure 3.1 to obtain a better geometric understanding of 3.9) 3.13). [In Figure 3.1 the state space triangle) of the process X t,s t )from2.1)+2.2) splits into three regions. In the region C 1,theoptimal control t equals µ, and in the region C 2 C 3 the optimal control t equals µ 1. The switching cure s g s) isdeterminedastheuniquesolutionofthedifferential equation 3.26) satisfying g l 1 ) = x,wherex l,l 1 ) is the unique solution of the transcendental equation 3.25). In this specific case, we took l = µ = 1, l 1 = µ 1 = 1, and c = 2. It turns out that x =, s = ands = The point s is a singularity point at which dg /ds = + and g takes a finite alue.)]

6 82 Maximum process and optimal control 3) We construct a solution to the system 3.3) 3.6) in three steps. In the first two steps, we determine C 1 C 2 together with a boundary cure s g s) separating C 1 from C 2. Step 1. Consider the HJB equation in C 1 to be found. The general solution of 3.14)isgienby µ J x + J xx c = 3.14) Jx,s) = 1 µ a s)e µx + c µ x + b s), 3.15) where a s)andb s) are some undetermined functions of s. Using 3.5), we can eliminate b s)from3.15) and this yields Jx,s) = 1 µ a s) e µx e µl) + c µ x l ) + s. 3.16) Soling J x x,s) = forx gies x = g s) as a candidate for the switching cure, and also that a s) can be expressed in terms of g s)asfollows: Inserting this back into 3.16)gies J 1) x,s) = a s) = c µ e µg s). 3.17) c µ ) 2 e µg s) e µx e µl) + c µ x l ) + s 3.18) as a candidate for the alue function 2.4)whenx,s) C 1. Step 2. Consider the HJB equation in C 2 to be found. The general solution of 3.19)isgienby µ 1 J x + J xx c = 3.19) Jx,s) = 1 µ 1 a 1 s)e µ1x + c µ 1 x + b 1 s), 3.2) where a 1 s) andb 1 s) are some undetermined functions of s. Soling J x x,s) = forx gies x = g s) as a candidate for the switching cure, and also that a 1 s) canbeexpressed in terms of g s)asfollows: Inserting this back into 3.2)gies J 2) x,s) = a 1 s) = c µ 1 e µ1g s). 3.21) c µ1 ) 2 e µ1g s) x) + c µ 1 x + b 1 s). 3.22)

7 Goran Peskir 83 The two functions 3.18)and3.22) must coincide at the switching cure, that is, J 1) x,s) x=g s)+ = J2) x,s) x=g s) 3.23) giing a closed expression for b 1 s), which after being inserted back into 3.22)yields J 2) x,s) = c ) 2 e µ1g s) x) c ) 2 e µg s) l) µ1 µ c µ 1 g s) x ) + c µ g s) l ) + s + c µ ) 2 c µ1 ) ) as a candidate for the alue function 2.4)whenx,s) C 2. The condition 3.6) withx = s = l 1 can now be used to determine a unique x l,l 1 ) satisfying 3.13). It follows from the expression 3.24)aboethatx soles and is uniquely determined by) the following transcendental equation: 1 ) 2 1 e µ ) 1x l 1) 1 ) 2 1 e µ ) x l ) ) l1 x l ) =. 3.25) µ1 µ µ 1 µ µ 1 µ It may be noted that this equation, and therefore x as well, does not depend on c. Finally, applying the condition 3.4) to the expression 3.24), we obtain a differential equation for the switching cure s g s) that takes the following form: g s) = 1 c/µ1 ) 1 e µ 1gs) s) ) c/µ ) 1 e µ gs) l ) ) 3.26) for all s s,l 1 ), where s <l 1 happens to be a singularity point at which dg/ds = +. Equation 3.26) is soled backwards under the initial condition 3.13), where x l,l 1 ) is found by soling 3.25). The switching cure s g s) is a unique solution of 3.26) obtained in this way. It can also be erified that 3.12)holdsforsomes s,l 1 ). 4) It turns out that the solution of 3.26) satisfying 3.13) can hit the diagonal in R 2 at apoints l,l 1 ) taken to be closest to x,ifc c for some large c to be determined below. When this happens, the construction of the solution becomes more complicated, and the solution of 3.26) fors s,s )isofnouse.wethusfirsttreatthesimpler case when the solution of 3.26) stays below the diagonal the case of small c), and this case is then followed by the more complicated case when the solution of 3.26) hits the diagonal the case of large c). Step 3 the case of small c). Haing characterized the cure s g s)for[s,l 1 ], we hae obtained a candidate 3.18)+3.24) for the alue function 2.4) whenx,s) C 1 C 2.It remains to determine Jx,s)forx,s) C 3, and this is what we do in the final step. As clearly the control µ 1 should be applied, consider the HJB equation µ 1 J x + J xx c = 3.27) in C 3 gien and fixed. The general solution of 3.27)isgienby Jx,s) = 1 µ 1 a 2 s)e µ1x + c µ 1 x + b 2 s), 3.28)

8 84 Maximum process and optimal control where a 2 s) andb 2 s) are some undetermined functions of s. Using the condition 3.5), we can eliminate b 2 s)from3.28) and this yields J 3) x,s) = 1 µ 1 a 2 s) e µ1x e µ1l) + c µ 1 x l ) + s. 3.29) Applying the condition 3.4) to the expression 3.29), we find that a 2 s) should sole µ a 1 2s) = e µ1s 3.3) e µ1l for l <s<s. This equation can be soled explicitly and this gies a 2 s) = e µ1l µ 1 s +log e µ1s e µ1l)) + d, 3.31) where d is an undetermined constant. To determine d, we may use the fact that the maps 3.24)and3.29)mustcoincideats,s ), that is, J 2) x,s) x=s=s = J 3) x,s) x=s=s, 3.32) thelatterbeingknownexplicitlydueto3.12). With this d we can then rewrite 3.31)as follows: a 2 s) = e µ µ1l 1 s s ) e µ ) 1s e log µ1l c ). 3.33) e µ1s e µ1l µ1 Inserting this expression back into 3.29), we obtain a candidate for the alue function 2.4)whenx,s) C 3, thus completing the construction of a solution to the system 3.3) 3.6). Steps 3 5 the case of large c). In this case, the solution s g s) of3.26) satisfying 3.13) hits the diagonal in R 2 at some s l,l 1 ). The set C 1 from 3.9) naturally splits into the following three subsets modulo two cures): C 1,1 = { x,s) R 2 } l <x<g s), s <s<l 1, 3.34) C 1,2 = { x,s) R 2 l <x<s, s <s<s }, 3.35) C 1,3 = { x,s) R 2 l <x<h s), s <s<s }, 3.36) where s,themaps h s), and s in this context will soon be defined. Similarly, the set C 2 from 3.1) naturally splits into the following two subsets modulo one cure): C 2,1 = { x,s) R 2 } g s) <x s, s <s<l 1, 3.37) C 2,2 = { x,s) R 2 h s) <x s, s <s<s }. 3.38) The set C 3 from 3.11) remains the same, howeer, with a new alue for s to be introduced. We refer to Figure 3.2 to obtain a better geometric understanding of 3.34) 3.38). [In Figure 3.2 the state space triangle) of the process X t,s t )from2.1)+2.2) splits into six regions. In the region C 1,1 C 1,2 C 1,3,theoptimalcontrolt equals

9 Goran Peskir 85 l 1 l x l 1 C 2,1 C 1,1 s g s) s x s h s) s C 1,3 s s C 1,2 l C 2,2 C 3 Figure 3.2. The case of large c in problem 2.4). µ, and in the region C 2,1 C 2,2 C 3,theoptimalcontrolt equals µ 1. The switching cure s g s) is determined as the unique solution of the differential equation 3.26) satisfying g l 1 ) = x,wherex l,l 1 ) is the unique solution of the transcendental equation 3.25). The switching cure s h s) differs from the solution s g s) of 3.26) and is determined to meet the condition 3.4) as explained in the text. In this specific case, we took l = µ = 1, l 1 = µ 1 = 1, and c = 3.8. It turns out that x =, s = , s =.82273, and s = For comparison, we state that the smaller of two) s satisfying g s ) = s equals , that s satisfying g s ) = l equals , and that s = The point s is a singularity point at which dg /ds = + and g takes a finite alue.)] It is clear from the construction aboe that in C 1,1 the alue function 2.4)isgienby 3.18), and that in C 2,1 the alue function 2.4) isgienby3.24), where s g s) isthe solution of 3.26) satisfying 3.13). For the points s<s close to s ) we can no longer make use of the solution g s), and the expression 3.18), as clearly the condition 3.4) fails to hold. We need, moreoer, to apply the control µ instead of µ 1, and thus Step 3 presented aboe must be modified. The HJB equation 3.27) is considered with µ in place of µ 1, and this again using 3.5) leads to the expression 3.29)withµ in place of µ 1 : J 1,2) x,s) = 1 µ a 3 s) e µx e µl) + c µ x l ) + s 3.39)

10 86 Maximum process and optimal control as well as 3.3)anditssolution3.31). To determine d in 3.31), we may use that J 1,2) x,s) x=s=s = J i,1) x,s) x=s=s 3.4) for i either 1 or 2, where we set J 1,1) = J 1) and J 2,1) = J 2) with J 1) from 3.18) and J 2) from 3.24). The latter expression in 3.4) is known explicitly due to the fact that g s ) = s. With this d,wecanthenrewriteananalogueof3.33)asfollows: a 3 s) = e µ µl s s ) )) e µ s e log µl c e µs e µ l e µs. 3.41) µ Inserting this expression back into 3.39), we obtain a candidate for the alue function 2.4)whenx,s) C 1,2. Moreoer, the equation J x 1,2) = determines an optimal switching cure h s) = 1 log µ ) µ c a 3s) 3.42) and the points s l,s )ands l,s ) appearing in 3.35)+3.36) and3.38) are determined by the following identities: ) h s = s, 3.43) ) h s = l. 3.44) Note that 3.44) is reminiscent of 3.12), and so is h s)ofg s). Howeer, the two functions are different for s<s. It is clear that the alue function 2.4) is also gien by the formula 3.39) forx,s) C 1,3. To determine the alue function 2.4) inc 2,2, where clearly the control µ 1 is to be applied, we can use the result of Step 2 aboe which leads to the following analogue of 3.24)aboe: J 2,2) x,s) = c ) 2 e µ1h s) x) c ) 2 e µh s) l) µ1 µ c µ 1 h s) x ) + c µ h s) l ) + s + c µ ) 2 c µ1 ) ) for x,s) C 2,2. Finally, in C 3 we should also apply the control µ 1, and thus the result of Step 3 the case of small c ) aboe can be used. Due to 3.44), the expressions 3.29)+3.33)carryoer unchanged to the present case. It must be kept in mind, howeer, that s satisfies 3.44) and not 3.12). This completes the construction of a solution to the system 3.3) 3.6). 5) In this way, we hae obtained a candidate for the alue function 2.4) whenx,s) C in both cases of small and large c. The preceding considerations can now be summarized as follows. Theorem 3.1. In the setting of 2.1) 2.3), consider the optimal control problem 2.4), where the supremum is taken oer all admissible controls as explained.

11 Goran Peskir 87 1) In the case of small c in the sense that the solution of 3.26) stays below the diagonal in R 2, the alue function J = Jx,s) soles the system 3.3) 3.6) and is explicitly gien by 3.18)inC 1 from 3.9), by 3.24)inC 2 from 3.1), and by 3.29)+3.33) in C 3 from 3.11) with s from 3.12), where s g s) is the unique solution of the differential equation 3.26) for s s,l 1 ) satisfying g l 1 ) = x,andx l,l 1 ) is the unique solution of the transcendental equation 3.25). The alues of J at the two boundary cures in C not mentioned are determined by continuity.) 2) In the case of large c in the sense that the solution of 3.26) hits the diagonal in R 2, the alue function J = Jx,s) soles the system 3.3) 3.6) and is explicitly gien by 3.18) inc 1,1 from 3.34), by 3.24) inc 2,1 from 3.37), by 3.39)+3.41) in C 1,2 C 1,3 from 3.35)+3.36), by3.45) inc 2,2 from 3.38), and by 3.29)+3.33) in C 3 from 3.11) with s from 3.44), where s g s) is the unique solution of the differential equation 3.26) for s s,l 1 ) satisfying g l 1 ) = x with x l,l 1 ) as aboe, and s h s) is gien by 3.42)+3.41). ThealuesofJ at the four boundary cures in C not mentioned are determined by continuity.) 3) The optimal control in problem 2.4) is described as follows: pull as hard as possible, that is, t = µ if X t <g S t ),and pushashardaspossible, thatis,t = µ 1 if X t >g S t ),bothaslongast τ,whereτ is gien in 2.3). This description holds in the case of large c by modifying the solution g s) of 3.26) fors<s as follows: g s):= s +1if s s,s ) and g s):= h s) for s s,s ). In both cases of small and large c, formally set g s):= l for s l,s ).Thecontrolt for X t = g S t ) is arbitrary and has no effect on optimality of the result.) To erify the statements, denote the candidate function by Jx,s) forx,s) C. Then, by construction, it is clear that x,s) Jx,s)isC 2 outside the set {g s),s) s <s<l 1 } in C, andx Jx,s) isc 1 at gs) whens is fixed. Actually, the latter mapping is also C 2 as is easily seen from 3.14)and3.19).) Thus, Itô s formula can be applied to the process JX t,s t ) with any admissible,andunderp x,s in this way we get J ) t ) t ) X t,s t = Jx,s)+ J x Xr,S r dxr + J s Xr,S r dsr + 1 t ) J xx Xr,S r d X,X r 3.46) 2 t ) t = Jx,s)+ 2Jx Xr,S r dbr + L ) ) ) X J) Xr,S r dr, where the integral with respect to ds r is zero, since the increment S r equals zero off the diagonal in R 2, and at the diagonal we hae 3.4). Since X τ equals either l or l 1,weseeby3.5)+3.6)thatJX τ,s τ ) = S τ, and thus 3.46) implies the following identity: S τ = Jx,s)+M τ + τ L X ) J) ) Xr,S r ) dr, 3.47) where M t = t 2Jx X r,s r )db r is a continuous local) martingale. Since x,s) J x x,s)is uniformly bounded in C, it follows by the optional sampling theorem that E x,s M τ ) =.

12 88 Maximum process and optimal control Note that there is no restriction to consider only those controls for which E x,s τ) < so that E x,s τ) < as well.) On the other hand, by 3.3) weknowthatl XJ))x,s) c for all x,s) C, with equality if =, and thus 3.47)yields ) τ Jx,s) = E x,s S τ L ) ) ) X J) Xr,S r dr E x,s Sτ cτ ) 3.48) with equality if =. This establishes that the candidate function equals the alue function, and that the optimal control equals, thus completing the proof. Acknowledgment The author was supported by Centre for Mathematical Physics and Stochastics funded by the Danish National Research Foundation). References [1] G. A. Bliss,Lectures on the Calculus of Variations, Uniersity of Chicago Press, Illinois, [2] O. Bolza, Über den Anormalen Fall beim Lagrangeschen und Mayerschen Problem mit gemischten Bedingungen und ariablen Endpunkten, Math. Ann ), German). [3] L. E. Dubins, L. A. Shepp, and A. N. Shiryae, Optimal stopping rules and maximal inequalities for Bessel processes, Theory Probab. Appl ), no. 2, [4] W. H. Fleming and R. W. Rishel, Deterministic and Stochastic Optimal Control, Springer-Verlag, Berlin, [5] S.E.Graersen,G.Peskir,andA.N.Shiryae,Stopping Brownian motion without anticipation ascloseaspossibletoitsultimatemaximum, Theory Probab. Appl ), no. 1, [6] S. D. Jacka, Optimal stopping and best constants for Doob-like inequalities. I. The case p = 1, Ann. Probab ), no. 4, [7] E. Nelson, Dynamical Theories of Brownian Motion, Princeton Uniersity Press, New Jersey, [8] G. Peskir, Optimal stopping of the maximum process: the maximality principle, Ann. Probab ), no. 4, [9] L. C. G. Rogers and D. Williams, Diffusions, Marko Processes, and Martingales. Vol. 2. ItôCalculus, Wiley Series in Probability and Mathematical Statistics: Probability and Mathematical Statistics, John Wiley & Sons, New York, [1] L. Shepp and A. N. Shiryae, The Russian option: reduced regret, Ann. Appl. Probab ), no. 3, Goran Peskir: Department of Mathematical Sciences, Uniersity of Aarhus, Ny Munkegade, 8 Aarhus, Denmark address: goran@imf.au.dk

13 Adances in Operations Research Volume 214 Adances in Decision Sciences Volume 214 Applied Mathematics Algebra Volume 214 Probability and Statistics Volume 214 The Scientific World Journal Volume 214 International Differential Equations Volume 214 Volume 214 Submit your manuscripts at International Adances in Combinatorics Mathematical Physics Volume 214 Complex Analysis Volume 214 International Mathematics and Mathematical Sciences Mathematical Problems in Engineering Mathematics Volume 214 Volume 214 Volume 214 Volume 214 Discrete Mathematics Volume 214 Discrete Dynamics in Nature and Society Function Spaces Abstract and Applied Analysis Volume 214 Volume 214 Volume 214 International Stochastic Analysis Optimization Volume 214 Volume 214

Maximum Process Problems in Optimal Control Theory

Maximum Process Problems in Optimal Control Theory J. Appl. Math. Stochastic Anal. Vol. 25, No., 25, (77-88) Research Report No. 423, 2, Dept. Theoret. Statist. Aarhus (2 pp) Maximum Process Problems in Optimal Control Theory GORAN PESKIR 3 Given a standard

More information

Albert N. Shiryaev Steklov Mathematical Institute. On sharp maximal inequalities for stochastic processes

Albert N. Shiryaev Steklov Mathematical Institute. On sharp maximal inequalities for stochastic processes Albert N. Shiryaev Steklov Mathematical Institute On sharp maximal inequalities for stochastic processes joint work with Yaroslav Lyulko, Higher School of Economics email: albertsh@mi.ras.ru 1 TOPIC I:

More information

The Azéma-Yor Embedding in Non-Singular Diffusions

The Azéma-Yor Embedding in Non-Singular Diffusions Stochastic Process. Appl. Vol. 96, No. 2, 2001, 305-312 Research Report No. 406, 1999, Dept. Theoret. Statist. Aarhus The Azéma-Yor Embedding in Non-Singular Diffusions J. L. Pedersen and G. Peskir Let

More information

Solving the Poisson Disorder Problem

Solving the Poisson Disorder Problem Advances in Finance and Stochastics: Essays in Honour of Dieter Sondermann, Springer-Verlag, 22, (295-32) Research Report No. 49, 2, Dept. Theoret. Statist. Aarhus Solving the Poisson Disorder Problem

More information

Predicting the Time of the Ultimate Maximum for Brownian Motion with Drift

Predicting the Time of the Ultimate Maximum for Brownian Motion with Drift Proc. Math. Control Theory Finance Lisbon 27, Springer, 28, 95-112 Research Report No. 4, 27, Probab. Statist. Group Manchester 16 pp Predicting the Time of the Ultimate Maximum for Brownian Motion with

More information

On Doob s Maximal Inequality for Brownian Motion

On Doob s Maximal Inequality for Brownian Motion Stochastic Process. Al. Vol. 69, No., 997, (-5) Research Reort No. 337, 995, Det. Theoret. Statist. Aarhus On Doob s Maximal Inequality for Brownian Motion S. E. GRAVERSEN and G. PESKIR If B = (B t ) t

More information

A Barrier Version of the Russian Option

A Barrier Version of the Russian Option A Barrier Version of the Russian Option L. A. Shepp, A. N. Shiryaev, A. Sulem Rutgers University; shepp@stat.rutgers.edu Steklov Mathematical Institute; shiryaev@mi.ras.ru INRIA- Rocquencourt; agnes.sulem@inria.fr

More information

The Wiener Sequential Testing Problem with Finite Horizon

The Wiener Sequential Testing Problem with Finite Horizon Research Report No. 434, 3, Dept. Theoret. Statist. Aarhus (18 pp) The Wiener Sequential Testing Problem with Finite Horizon P. V. Gapeev and G. Peskir We present a solution of the Bayesian problem of

More information

Optimal Prediction of the Ultimate Maximum of Brownian Motion

Optimal Prediction of the Ultimate Maximum of Brownian Motion Optimal Prediction of the Ultimate Maximum of Brownian Motion Jesper Lund Pedersen University of Copenhagen At time start to observe a Brownian path. Based upon the information, which is continuously updated

More information

Optimal Stopping Problems for Time-Homogeneous Diffusions: a Review

Optimal Stopping Problems for Time-Homogeneous Diffusions: a Review Optimal Stopping Problems for Time-Homogeneous Diffusions: a Review Jesper Lund Pedersen ETH, Zürich The first part of this paper summarises the essential facts on general optimal stopping theory for time-homogeneous

More information

Introduction to Random Diffusions

Introduction to Random Diffusions Introduction to Random Diffusions The main reason to study random diffusions is that this class of processes combines two key features of modern probability theory. On the one hand they are semi-martingales

More information

On the American Option Problem

On the American Option Problem Math. Finance, Vol. 5, No., 25, (69 8) Research Report No. 43, 22, Dept. Theoret. Statist. Aarhus On the American Option Problem GORAN PESKIR 3 We show how the change-of-variable formula with local time

More information

On Reflecting Brownian Motion with Drift

On Reflecting Brownian Motion with Drift Proc. Symp. Stoch. Syst. Osaka, 25), ISCIE Kyoto, 26, 1-5) On Reflecting Brownian Motion with Drift Goran Peskir This version: 12 June 26 First version: 1 September 25 Research Report No. 3, 25, Probability

More information

I forgot to mention last time: in the Ito formula for two standard processes, putting

I forgot to mention last time: in the Ito formula for two standard processes, putting I forgot to mention last time: in the Ito formula for two standard processes, putting dx t = a t dt + b t db t dy t = α t dt + β t db t, and taking f(x, y = xy, one has f x = y, f y = x, and f xx = f yy

More information

Purpose of the experiment

Purpose of the experiment Impulse and Momentum PES 116 Adanced Physics Lab I Purpose of the experiment Measure a cart s momentum change and compare to the impulse it receies. Compare aerage and peak forces in impulses. To put the

More information

Lectures in Mathematics ETH Zürich Department of Mathematics Research Institute of Mathematics. Managing Editor: Michael Struwe

Lectures in Mathematics ETH Zürich Department of Mathematics Research Institute of Mathematics. Managing Editor: Michael Struwe Lectures in Mathematics ETH Zürich Department of Mathematics Research Institute of Mathematics Managing Editor: Michael Struwe Goran Peskir Albert Shiryaev Optimal Stopping and Free-Boundary Problems Birkhäuser

More information

Applications of Optimal Stopping and Stochastic Control

Applications of Optimal Stopping and Stochastic Control Applications of and Stochastic Control YRM Warwick 15 April, 2011 Applications of and Some problems Some technology Some problems The secretary problem Bayesian sequential hypothesis testing the multi-armed

More information

On pathwise stochastic integration

On pathwise stochastic integration On pathwise stochastic integration Rafa l Marcin Lochowski Afican Institute for Mathematical Sciences, Warsaw School of Economics UWC seminar Rafa l Marcin Lochowski (AIMS, WSE) On pathwise stochastic

More information

ON THE POLICY IMPROVEMENT ALGORITHM IN CONTINUOUS TIME

ON THE POLICY IMPROVEMENT ALGORITHM IN CONTINUOUS TIME ON THE POLICY IMPROVEMENT ALGORITHM IN CONTINUOUS TIME SAUL D. JACKA AND ALEKSANDAR MIJATOVIĆ Abstract. We develop a general approach to the Policy Improvement Algorithm (PIA) for stochastic control problems

More information

Stochastic optimal control with rough paths

Stochastic optimal control with rough paths Stochastic optimal control with rough paths Paul Gassiat TU Berlin Stochastic processes and their statistics in Finance, Okinawa, October 28, 2013 Joint work with Joscha Diehl and Peter Friz Introduction

More information

Bernardo D Auria Stochastic Processes /12. Notes. March 29 th, 2012

Bernardo D Auria Stochastic Processes /12. Notes. March 29 th, 2012 1 Stochastic Calculus Notes March 9 th, 1 In 19, Bachelier proposed for the Paris stock exchange a model for the fluctuations affecting the price X(t) of an asset that was given by the Brownian motion.

More information

STOPPING AT THE MAXIMUM OF GEOMETRIC BROWNIAN MOTION WHEN SIGNALS ARE RECEIVED

STOPPING AT THE MAXIMUM OF GEOMETRIC BROWNIAN MOTION WHEN SIGNALS ARE RECEIVED J. Appl. Prob. 42, 826 838 (25) Printed in Israel Applied Probability Trust 25 STOPPING AT THE MAXIMUM OF GEOMETRIC BROWNIAN MOTION WHEN SIGNALS ARE RECEIVED X. GUO, Cornell University J. LIU, Yale University

More information

Pavel V. Gapeev, Neofytos Rodosthenous Perpetual American options in diffusion-type models with running maxima and drawdowns

Pavel V. Gapeev, Neofytos Rodosthenous Perpetual American options in diffusion-type models with running maxima and drawdowns Pavel V. Gapeev, Neofytos Rodosthenous Perpetual American options in diffusion-type models with running maxima and drawdowns Article (Accepted version) (Refereed) Original citation: Gapeev, Pavel V. and

More information

Lecture 12. F o s, (1.1) F t := s>t

Lecture 12. F o s, (1.1) F t := s>t Lecture 12 1 Brownian motion: the Markov property Let C := C(0, ), R) be the space of continuous functions mapping from 0, ) to R, in which a Brownian motion (B t ) t 0 almost surely takes its value. Let

More information

Solution of Stochastic Optimal Control Problems and Financial Applications

Solution of Stochastic Optimal Control Problems and Financial Applications Journal of Mathematical Extension Vol. 11, No. 4, (2017), 27-44 ISSN: 1735-8299 URL: http://www.ijmex.com Solution of Stochastic Optimal Control Problems and Financial Applications 2 Mat B. Kafash 1 Faculty

More information

Deterministic Dynamic Programming

Deterministic Dynamic Programming Deterministic Dynamic Programming 1 Value Function Consider the following optimal control problem in Mayer s form: V (t 0, x 0 ) = inf u U J(t 1, x(t 1 )) (1) subject to ẋ(t) = f(t, x(t), u(t)), x(t 0

More information

lim n C1/n n := ρ. [f(y) f(x)], y x =1 [f(x) f(y)] [g(x) g(y)]. (x,y) E A E(f, f),

lim n C1/n n := ρ. [f(y) f(x)], y x =1 [f(x) f(y)] [g(x) g(y)]. (x,y) E A E(f, f), 1 Part I Exercise 1.1. Let C n denote the number of self-avoiding random walks starting at the origin in Z of length n. 1. Show that (Hint: Use C n+m C n C m.) lim n C1/n n = inf n C1/n n := ρ.. Show that

More information

n E(X t T n = lim X s Tn = X s

n E(X t T n = lim X s Tn = X s Stochastic Calculus Example sheet - Lent 15 Michael Tehranchi Problem 1. Let X be a local martingale. Prove that X is a uniformly integrable martingale if and only X is of class D. Solution 1. If If direction:

More information

On the principle of smooth fit in optimal stopping problems

On the principle of smooth fit in optimal stopping problems 1 On the principle of smooth fit in optimal stopping problems Amir Aliev Moscow State University, Faculty of Mechanics and Mathematics, Department of Probability Theory, 119992, Moscow, Russia. Keywords:

More information

ON THE FIRST TIME THAT AN ITO PROCESS HITS A BARRIER

ON THE FIRST TIME THAT AN ITO PROCESS HITS A BARRIER ON THE FIRST TIME THAT AN ITO PROCESS HITS A BARRIER GERARDO HERNANDEZ-DEL-VALLE arxiv:1209.2411v1 [math.pr] 10 Sep 2012 Abstract. This work deals with first hitting time densities of Ito processes whose

More information

Multi-dimensional Stochastic Singular Control Via Dynkin Game and Dirichlet Form

Multi-dimensional Stochastic Singular Control Via Dynkin Game and Dirichlet Form Multi-dimensional Stochastic Singular Control Via Dynkin Game and Dirichlet Form Yipeng Yang * Under the supervision of Dr. Michael Taksar Department of Mathematics University of Missouri-Columbia Oct

More information

On the martingales obtained by an extension due to Saisho, Tanemura and Yor of Pitman s theorem

On the martingales obtained by an extension due to Saisho, Tanemura and Yor of Pitman s theorem On the martingales obtained by an extension due to Saisho, Tanemura and Yor of Pitman s theorem Koichiro TAKAOKA Dept of Applied Physics, Tokyo Institute of Technology Abstract M Yor constructed a family

More information

Bernardo D Auria Stochastic Processes /10. Notes. Abril 13 th, 2010

Bernardo D Auria Stochastic Processes /10. Notes. Abril 13 th, 2010 1 Stochastic Calculus Notes Abril 13 th, 1 As we have seen in previous lessons, the stochastic integral with respect to the Brownian motion shows a behavior different from the classical Riemann-Stieltjes

More information

Stochastic Hamiltonian systems and reduction

Stochastic Hamiltonian systems and reduction Stochastic Hamiltonian systems and reduction Joan Andreu Lázaro Universidad de Zaragoza Juan Pablo Ortega CNRS, Besançon Geometric Mechanics: Continuous and discrete, nite and in nite dimensional Ban,

More information

The Russian option: Finite horizon. Peskir, Goran. MIMS EPrint: Manchester Institute for Mathematical Sciences School of Mathematics

The Russian option: Finite horizon. Peskir, Goran. MIMS EPrint: Manchester Institute for Mathematical Sciences School of Mathematics The Russian option: Finite horizon Peskir, Goran 25 MIMS EPrint: 27.37 Manchester Institute for Mathematical Sciences School of Mathematics The University of Manchester Reports available from: And by contacting:

More information

A new approach for investment performance measurement. 3rd WCMF, Santa Barbara November 2009

A new approach for investment performance measurement. 3rd WCMF, Santa Barbara November 2009 A new approach for investment performance measurement 3rd WCMF, Santa Barbara November 2009 Thaleia Zariphopoulou University of Oxford, Oxford-Man Institute and The University of Texas at Austin 1 Performance

More information

Optimal Stopping and Maximal Inequalities for Poisson Processes

Optimal Stopping and Maximal Inequalities for Poisson Processes Optimal Stopping and Maximal Inequalities for Poisson Processes D.O. Kramkov 1 E. Mordecki 2 September 10, 2002 1 Steklov Mathematical Institute, Moscow, Russia 2 Universidad de la República, Montevideo,

More information

OPTIMAL STOPPING OF A BROWNIAN BRIDGE

OPTIMAL STOPPING OF A BROWNIAN BRIDGE OPTIMAL STOPPING OF A BROWNIAN BRIDGE ERIK EKSTRÖM AND HENRIK WANNTORP Abstract. We study several optimal stopping problems in which the gains process is a Brownian bridge or a functional of a Brownian

More information

SOME LIMIT THEOREMS CONNECTED WITH BROWNIAN LOCAL TIME

SOME LIMIT THEOREMS CONNECTED WITH BROWNIAN LOCAL TIME SOME LIMIT THEOEMS CONNECTED WITH BOWNIAN LOCAL TIME AOUF GHOMASNI eceived 26 October 24; evised April 25; Accepted 2 April 25 Let B = (B t ) t be a standard Brownian motion and let (L x t ; t, x ) be

More information

Runge-Kutta Method for Solving Uncertain Differential Equations

Runge-Kutta Method for Solving Uncertain Differential Equations Yang and Shen Journal of Uncertainty Analysis and Applications 215) 3:17 DOI 1.1186/s4467-15-38-4 RESEARCH Runge-Kutta Method for Solving Uncertain Differential Equations Xiangfeng Yang * and Yuanyuan

More information

ON THE PATHWISE UNIQUENESS OF SOLUTIONS OF STOCHASTIC DIFFERENTIAL EQUATIONS

ON THE PATHWISE UNIQUENESS OF SOLUTIONS OF STOCHASTIC DIFFERENTIAL EQUATIONS PORTUGALIAE MATHEMATICA Vol. 55 Fasc. 4 1998 ON THE PATHWISE UNIQUENESS OF SOLUTIONS OF STOCHASTIC DIFFERENTIAL EQUATIONS C. Sonoc Abstract: A sufficient condition for uniqueness of solutions of ordinary

More information

for all f satisfying E[ f(x) ] <.

for all f satisfying E[ f(x) ] <. . Let (Ω, F, P ) be a probability space and D be a sub-σ-algebra of F. An (H, H)-valued random variable X is independent of D if and only if P ({X Γ} D) = P {X Γ}P (D) for all Γ H and D D. Prove that if

More information

Research Article A Necessary Characteristic Equation of Diffusion Processes Having Gaussian Marginals

Research Article A Necessary Characteristic Equation of Diffusion Processes Having Gaussian Marginals Abstract and Applied Analysis Volume 01, Article ID 598590, 9 pages doi:10.1155/01/598590 Research Article A Necessary Characteristic Equation of Diffusion Processes Having Gaussian Marginals Syeda Rabab

More information

Research Article Existence and Uniqueness of Homoclinic Solution for a Class of Nonlinear Second-Order Differential Equations

Research Article Existence and Uniqueness of Homoclinic Solution for a Class of Nonlinear Second-Order Differential Equations Applied Mathematics Volume 2012, Article ID 615303, 13 pages doi:10.1155/2012/615303 Research Article Existence and Uniqueness of Homoclinic Solution for a Class of Nonlinear Second-Order Differential

More information

On Wald-Type Optimal Stopping for Brownian Motion

On Wald-Type Optimal Stopping for Brownian Motion J Al Probab Vol 34, No 1, 1997, (66-73) Prerint Ser No 1, 1994, Math Inst Aarhus On Wald-Tye Otimal Stoing for Brownian Motion S RAVRSN and PSKIR The solution is resented to all otimal stoing roblems of

More information

SUPPLEMENTARY MATERIAL. Authors: Alan A. Stocker (1) and Eero P. Simoncelli (2)

SUPPLEMENTARY MATERIAL. Authors: Alan A. Stocker (1) and Eero P. Simoncelli (2) SUPPLEMENTARY MATERIAL Authors: Alan A. Stocker () and Eero P. Simoncelli () Affiliations: () Dept. of Psychology, Uniersity of Pennsylania 34 Walnut Street 33C Philadelphia, PA 94-68 U.S.A. () Howard

More information

Hölder norms and the support theorem for diffusions

Hölder norms and the support theorem for diffusions Hölder norms and the support theorem for diffusions Gérard Ben Arous, Mihai Gradinaru Uniersité de Paris-Sud, Mathématiques, Bât. 45, 9145 Orsay Cedex, France and Michel Ledoux Laboratoire de Statistique

More information

A Concise Course on Stochastic Partial Differential Equations

A Concise Course on Stochastic Partial Differential Equations A Concise Course on Stochastic Partial Differential Equations Michael Röckner Reference: C. Prevot, M. Röckner: Springer LN in Math. 1905, Berlin (2007) And see the references therein for the original

More information

Chapter 2 Optimal Control Problem

Chapter 2 Optimal Control Problem Chapter 2 Optimal Control Problem Optimal control of any process can be achieved either in open or closed loop. In the following two chapters we concentrate mainly on the first class. The first chapter

More information

Stochastic Calculus (Lecture #3)

Stochastic Calculus (Lecture #3) Stochastic Calculus (Lecture #3) Siegfried Hörmann Université libre de Bruxelles (ULB) Spring 2014 Outline of the course 1. Stochastic processes in continuous time. 2. Brownian motion. 3. Itô integral:

More information

THE MINIMUM MATCHING ENERGY OF BICYCLIC GRAPHS WITH GIVEN GIRTH

THE MINIMUM MATCHING ENERGY OF BICYCLIC GRAPHS WITH GIVEN GIRTH ROCKY MOUNTAIN JOURNAL OF MATHEMATICS Volume 46, Number 4, 2016 THE MINIMUM MATCHING ENERGY OF BICYCLIC GRAPHS WITH GIVEN GIRTH HONG-HAI LI AND LI ZOU ABSTRACT. The matching energy of a graph was introduced

More information

Research Article Wave Scattering in Inhomogeneous Strings

Research Article Wave Scattering in Inhomogeneous Strings International Scholarly Research Network ISRN Mathematical Analysis Volume 011, Article ID 64049, 14 pages doi:10.540/011/64049 Research Article Wave Scattering in Inhomogeneous Strings Nezam Iraniparast

More information

Brownian Motion and the Dirichlet Problem

Brownian Motion and the Dirichlet Problem Brownian Motion and the Dirichlet Problem Mario Teixeira Parente August 29, 2016 1/22 Topics for the talk 1. Solving the Dirichlet problem on bounded domains 2. Application: Recurrence/Transience of Brownian

More information

On the sequential testing problem for some diffusion processes

On the sequential testing problem for some diffusion processes To appear in Stochastics: An International Journal of Probability and Stochastic Processes (17 pp). On the sequential testing problem for some diffusion processes Pavel V. Gapeev Albert N. Shiryaev We

More information

Chapter 2 Event-Triggered Sampling

Chapter 2 Event-Triggered Sampling Chapter Event-Triggered Sampling In this chapter, some general ideas and basic results on event-triggered sampling are introduced. The process considered is described by a first-order stochastic differential

More information

Lecture 21 Representations of Martingales

Lecture 21 Representations of Martingales Lecture 21: Representations of Martingales 1 of 11 Course: Theory of Probability II Term: Spring 215 Instructor: Gordan Zitkovic Lecture 21 Representations of Martingales Right-continuous inverses Let

More information

p 1 ( Y p dp) 1/p ( X p dp) 1 1 p

p 1 ( Y p dp) 1/p ( X p dp) 1 1 p Doob s inequality Let X(t) be a right continuous submartingale with respect to F(t), t 1 P(sup s t X(s) λ) 1 λ {sup s t X(s) λ} X + (t)dp 2 For 1 < p

More information

Reflected Brownian Motion

Reflected Brownian Motion Chapter 6 Reflected Brownian Motion Often we encounter Diffusions in regions with boundary. If the process can reach the boundary from the interior in finite time with positive probability we need to decide

More information

STAT 331. Martingale Central Limit Theorem and Related Results

STAT 331. Martingale Central Limit Theorem and Related Results STAT 331 Martingale Central Limit Theorem and Related Results In this unit we discuss a version of the martingale central limit theorem, which states that under certain conditions, a sum of orthogonal

More information

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS PROBABILITY: LIMIT THEOREMS II, SPRING 15. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please

More information

On the submartingale / supermartingale property of diffusions in natural scale

On the submartingale / supermartingale property of diffusions in natural scale On the submartingale / supermartingale property of diffusions in natural scale Alexander Gushchin Mikhail Urusov Mihail Zervos November 13, 214 Abstract Kotani 5 has characterised the martingale property

More information

Applied Mathematics Letters. Stationary distribution, ergodicity and extinction of a stochastic generalized logistic system

Applied Mathematics Letters. Stationary distribution, ergodicity and extinction of a stochastic generalized logistic system Applied Mathematics Letters 5 (1) 198 1985 Contents lists available at SciVerse ScienceDirect Applied Mathematics Letters journal homepage: www.elsevier.com/locate/aml Stationary distribution, ergodicity

More information

On maximal inequalities via comparison principle

On maximal inequalities via comparison principle Makasu Journal of Inequalities and Appliations (2015 2015:348 DOI 10.1186/s13660-015-0873-3 R E S E A R C H Open Aess On maximal inequalities via omparison priniple Cloud Makasu * * Correspondene: makasu@uw.a.za

More information

On the quantiles of the Brownian motion and their hitting times.

On the quantiles of the Brownian motion and their hitting times. On the quantiles of the Brownian motion and their hitting times. Angelos Dassios London School of Economics May 23 Abstract The distribution of the α-quantile of a Brownian motion on an interval [, t]

More information

OPTIMAL SOLUTIONS TO STOCHASTIC DIFFERENTIAL INCLUSIONS

OPTIMAL SOLUTIONS TO STOCHASTIC DIFFERENTIAL INCLUSIONS APPLICATIONES MATHEMATICAE 29,4 (22), pp. 387 398 Mariusz Michta (Zielona Góra) OPTIMAL SOLUTIONS TO STOCHASTIC DIFFERENTIAL INCLUSIONS Abstract. A martingale problem approach is used first to analyze

More information

STOCHASTIC PERRON S METHOD AND VERIFICATION WITHOUT SMOOTHNESS USING VISCOSITY COMPARISON: OBSTACLE PROBLEMS AND DYNKIN GAMES

STOCHASTIC PERRON S METHOD AND VERIFICATION WITHOUT SMOOTHNESS USING VISCOSITY COMPARISON: OBSTACLE PROBLEMS AND DYNKIN GAMES STOCHASTIC PERRON S METHOD AND VERIFICATION WITHOUT SMOOTHNESS USING VISCOSITY COMPARISON: OBSTACLE PROBLEMS AND DYNKIN GAMES ERHAN BAYRAKTAR AND MIHAI SÎRBU Abstract. We adapt the Stochastic Perron s

More information

A Change of Variable Formula with Local Time-Space for Bounded Variation Lévy Processes with Application to Solving the American Put Option Problem 1

A Change of Variable Formula with Local Time-Space for Bounded Variation Lévy Processes with Application to Solving the American Put Option Problem 1 Chapter 3 A Change of Variable Formula with Local Time-Space for Bounded Variation Lévy Processes with Application to Solving the American Put Option Problem 1 Abstract We establish a change of variable

More information

NOTES ON THE REGULAR E-OPTIMAL SPRING BALANCE WEIGHING DESIGNS WITH CORRE- LATED ERRORS

NOTES ON THE REGULAR E-OPTIMAL SPRING BALANCE WEIGHING DESIGNS WITH CORRE- LATED ERRORS REVSTAT Statistical Journal Volume 3, Number 2, June 205, 9 29 NOTES ON THE REGULAR E-OPTIMAL SPRING BALANCE WEIGHING DESIGNS WITH CORRE- LATED ERRORS Authors: Bronis law Ceranka Department of Mathematical

More information

Risk-Minimality and Orthogonality of Martingales

Risk-Minimality and Orthogonality of Martingales Risk-Minimality and Orthogonality of Martingales Martin Schweizer Universität Bonn Institut für Angewandte Mathematik Wegelerstraße 6 D 53 Bonn 1 (Stochastics and Stochastics Reports 3 (199, 123 131 2

More information

Online Companion to Pricing Services Subject to Congestion: Charge Per-Use Fees or Sell Subscriptions?

Online Companion to Pricing Services Subject to Congestion: Charge Per-Use Fees or Sell Subscriptions? Online Companion to Pricing Serices Subject to Congestion: Charge Per-Use Fees or Sell Subscriptions? Gérard P. Cachon Pnina Feldman Operations and Information Management, The Wharton School, Uniersity

More information

Stochastic differential equations in neuroscience

Stochastic differential equations in neuroscience Stochastic differential equations in neuroscience Nils Berglund MAPMO, Orléans (CNRS, UMR 6628) http://www.univ-orleans.fr/mapmo/membres/berglund/ Barbara Gentz, Universität Bielefeld Damien Landon, MAPMO-Orléans

More information

Solution for Problem 7.1. We argue by contradiction. If the limit were not infinite, then since τ M (ω) is nondecreasing we would have

Solution for Problem 7.1. We argue by contradiction. If the limit were not infinite, then since τ M (ω) is nondecreasing we would have 362 Problem Hints and Solutions sup g n (ω, t) g(ω, t) sup g(ω, s) g(ω, t) µ n (ω). t T s,t: s t 1/n By the uniform continuity of t g(ω, t) on [, T], one has for each ω that µ n (ω) as n. Two applications

More information

Estimating transition times for a model of language change in an age-structured population

Estimating transition times for a model of language change in an age-structured population Estimating transition times for a model of language change in an age-structured population W. Garrett Mitchener MitchenerG@cofc.edu http://mitchenerg.people.cofc.edu Abstract: Human languages are stable

More information

Mathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio ( )

Mathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio ( ) Mathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio (2014-2015) Etienne Tanré - Olivier Faugeras INRIA - Team Tosca November 26th, 2014 E. Tanré (INRIA - Team Tosca) Mathematical

More information

Likelihood Functions for Stochastic Signals in White Noise* TYRONE E. DUNCAN

Likelihood Functions for Stochastic Signals in White Noise* TYRONE E. DUNCAN INFORMATION AND CONTROL 16, 303-310 (1970) Likelihood Functions for Stochastic Signals in White Noise* TYRONE E. DUNCAN Computer, Information and Control Engineering, The University of Nlichigan, Ann Arbor,

More information

On Mean-Square and Asymptotic Stability for Numerical Approximations of Stochastic Ordinary Differential Equations

On Mean-Square and Asymptotic Stability for Numerical Approximations of Stochastic Ordinary Differential Equations On Mean-Square and Asymptotic Stability for Numerical Approximations of Stochastic Ordinary Differential Equations Rózsa Horváth Bokor and Taketomo Mitsui Abstract This note tries to connect the stochastic

More information

The Lebesgue Integral

The Lebesgue Integral The Lebesgue Integral Brent Nelson In these notes we give an introduction to the Lebesgue integral, assuming only a knowledge of metric spaces and the iemann integral. For more details see [1, Chapters

More information

6. Brownian Motion. Q(A) = P [ ω : x(, ω) A )

6. Brownian Motion. Q(A) = P [ ω : x(, ω) A ) 6. Brownian Motion. stochastic process can be thought of in one of many equivalent ways. We can begin with an underlying probability space (Ω, Σ, P) and a real valued stochastic process can be defined

More information

ITO OLOGY. Thomas Wieting Reed College, Random Processes 2 The Ito Integral 3 Ito Processes 4 Stocastic Differential Equations

ITO OLOGY. Thomas Wieting Reed College, Random Processes 2 The Ito Integral 3 Ito Processes 4 Stocastic Differential Equations ITO OLOGY Thomas Wieting Reed College, 2000 1 Random Processes 2 The Ito Integral 3 Ito Processes 4 Stocastic Differential Equations 1 Random Processes 1 Let (, F,P) be a probability space. By definition,

More information

The multidimensional Ito Integral and the multidimensional Ito Formula. Eric Mu ller June 1, 2015 Seminar on Stochastic Geometry and its applications

The multidimensional Ito Integral and the multidimensional Ito Formula. Eric Mu ller June 1, 2015 Seminar on Stochastic Geometry and its applications The multidimensional Ito Integral and the multidimensional Ito Formula Eric Mu ller June 1, 215 Seminar on Stochastic Geometry and its applications page 2 Seminar on Stochastic Geometry and its applications

More information

A NEW PROOF OF THE WIENER HOPF FACTORIZATION VIA BASU S THEOREM

A NEW PROOF OF THE WIENER HOPF FACTORIZATION VIA BASU S THEOREM J. Appl. Prob. 49, 876 882 (2012 Printed in England Applied Probability Trust 2012 A NEW PROOF OF THE WIENER HOPF FACTORIZATION VIA BASU S THEOREM BRIAN FRALIX and COLIN GALLAGHER, Clemson University Abstract

More information

Stability of Stochastic Differential Equations

Stability of Stochastic Differential Equations Lyapunov stability theory for ODEs s Stability of Stochastic Differential Equations Part 1: Introduction Department of Mathematics and Statistics University of Strathclyde Glasgow, G1 1XH December 2010

More information

Stochastic Differential Equations.

Stochastic Differential Equations. Chapter 3 Stochastic Differential Equations. 3.1 Existence and Uniqueness. One of the ways of constructing a Diffusion process is to solve the stochastic differential equation dx(t) = σ(t, x(t)) dβ(t)

More information

Malliavin Calculus in Finance

Malliavin Calculus in Finance Malliavin Calculus in Finance Peter K. Friz 1 Greeks and the logarithmic derivative trick Model an underlying assent by a Markov process with values in R m with dynamics described by the SDE dx t = b(x

More information

Partial Differential Equations with Applications to Finance Seminar 1: Proving and applying Dynkin s formula

Partial Differential Equations with Applications to Finance Seminar 1: Proving and applying Dynkin s formula Partial Differential Equations with Applications to Finance Seminar 1: Proving and applying Dynkin s formula Group 4: Bertan Yilmaz, Richard Oti-Aboagye and Di Liu May, 15 Chapter 1 Proving Dynkin s formula

More information

Final Exam (Solution) Economics 501b Microeconomic Theory

Final Exam (Solution) Economics 501b Microeconomic Theory Dirk Bergemann and Johannes Hoerner Department of Economics Yale Uniersity Final Exam (Solution) Economics 5b Microeconomic Theory May This is a closed-book exam. The exam lasts for 8 minutes. Please write

More information

Lie Symmetry of Ito Stochastic Differential Equation Driven by Poisson Process

Lie Symmetry of Ito Stochastic Differential Equation Driven by Poisson Process American Review of Mathematics Statistics June 016, Vol. 4, No. 1, pp. 17-30 ISSN: 374-348 (Print), 374-356 (Online) Copyright The Author(s).All Rights Reserved. Published by American Research Institute

More information

UNDERSTAND MOTION IN ONE AND TWO DIMENSIONS

UNDERSTAND MOTION IN ONE AND TWO DIMENSIONS SUBAREA I. COMPETENCY 1.0 UNDERSTAND MOTION IN ONE AND TWO DIMENSIONS MECHANICS Skill 1.1 Calculating displacement, aerage elocity, instantaneous elocity, and acceleration in a gien frame of reference

More information

An Elastic Contact Problem with Normal Compliance and Memory Term

An Elastic Contact Problem with Normal Compliance and Memory Term Machine Dynamics Research 2012, Vol. 36, No 1, 15 25 Abstract An Elastic Contact Problem with Normal Compliance and Memory Term Mikäel Barboteu, Ahmad Ramadan, Mircea Sofonea Uniersité de Perpignan, France

More information

Normal approximation of Poisson functionals in Kolmogorov distance

Normal approximation of Poisson functionals in Kolmogorov distance Normal approximation of Poisson functionals in Kolmogorov distance Matthias Schulte Abstract Peccati, Solè, Taqqu, and Utzet recently combined Stein s method and Malliavin calculus to obtain a bound for

More information

Solutions to the Exercises in Stochastic Analysis

Solutions to the Exercises in Stochastic Analysis Solutions to the Exercises in Stochastic Analysis Lecturer: Xue-Mei Li 1 Problem Sheet 1 In these solution I avoid using conditional expectations. But do try to give alternative proofs once we learnt conditional

More information

Network Flow Problems Luis Goddyn, Math 408

Network Flow Problems Luis Goddyn, Math 408 Network Flow Problems Luis Goddyn, Math 48 Let D = (V, A) be a directed graph, and let s, t V (D). For S V we write δ + (S) = {u A : u S, S} and δ (S) = {u A : u S, S} for the in-arcs and out-arcs of S

More information

Lecture 22 Girsanov s Theorem

Lecture 22 Girsanov s Theorem Lecture 22: Girsanov s Theorem of 8 Course: Theory of Probability II Term: Spring 25 Instructor: Gordan Zitkovic Lecture 22 Girsanov s Theorem An example Consider a finite Gaussian random walk X n = n

More information

HJB equations. Seminar in Stochastic Modelling in Economics and Finance January 10, 2011

HJB equations. Seminar in Stochastic Modelling in Economics and Finance January 10, 2011 Department of Probability and Mathematical Statistics Faculty of Mathematics and Physics, Charles University in Prague petrasek@karlin.mff.cuni.cz Seminar in Stochastic Modelling in Economics and Finance

More information

Recent results in game theoretic mathematical finance

Recent results in game theoretic mathematical finance Recent results in game theoretic mathematical finance Nicolas Perkowski Humboldt Universität zu Berlin May 31st, 2017 Thera Stochastics In Honor of Ioannis Karatzas s 65th Birthday Based on joint work

More information

A Representation of Excessive Functions as Expected Suprema

A Representation of Excessive Functions as Expected Suprema A Representation of Excessive Functions as Expected Suprema Hans Föllmer & Thomas Knispel Humboldt-Universität zu Berlin Institut für Mathematik Unter den Linden 6 10099 Berlin, Germany E-mail: foellmer@math.hu-berlin.de,

More information

Some Tools From Stochastic Analysis

Some Tools From Stochastic Analysis W H I T E Some Tools From Stochastic Analysis J. Potthoff Lehrstuhl für Mathematik V Universität Mannheim email: potthoff@math.uni-mannheim.de url: http://ls5.math.uni-mannheim.de To close the file, click

More information

Convergence of Feller Processes

Convergence of Feller Processes Chapter 15 Convergence of Feller Processes This chapter looks at the convergence of sequences of Feller processes to a iting process. Section 15.1 lays some ground work concerning weak convergence of processes

More information

March 16, Abstract. We study the problem of portfolio optimization under the \drawdown constraint" that the

March 16, Abstract. We study the problem of portfolio optimization under the \drawdown constraint that the ON PORTFOLIO OPTIMIZATION UNDER \DRAWDOWN" CONSTRAINTS JAKSA CVITANIC IOANNIS KARATZAS y March 6, 994 Abstract We study the problem of portfolio optimization under the \drawdown constraint" that the wealth

More information

(2m)-TH MEAN BEHAVIOR OF SOLUTIONS OF STOCHASTIC DIFFERENTIAL EQUATIONS UNDER PARAMETRIC PERTURBATIONS

(2m)-TH MEAN BEHAVIOR OF SOLUTIONS OF STOCHASTIC DIFFERENTIAL EQUATIONS UNDER PARAMETRIC PERTURBATIONS (2m)-TH MEAN BEHAVIOR OF SOLUTIONS OF STOCHASTIC DIFFERENTIAL EQUATIONS UNDER PARAMETRIC PERTURBATIONS Svetlana Janković and Miljana Jovanović Faculty of Science, Department of Mathematics, University

More information