MAXIMUM PROCESS PROBLEMS IN OPTIMAL CONTROL THEORY
|
|
- Naomi Brown
- 5 years ago
- Views:
Transcription
1 MAXIMUM PROCESS PROBLEMS IN OPTIMAL CONTROL THEORY GORAN PESKIR Receied 16 January 24 and in reised form 23 June 24 Gien a standard Brownian motion B t ) t and the equation of motion dx t = t dt+ 2dBt,wesetS t = max s t X s and consider the optimal control problem sup ES τ cτ), where c> and the supremum is taken oer all admissible controls satisfying t [µ,µ 1 ]forallt up to τ = inf{t> X t / l,l 1 )} with µ < <µ 1 and l < <l 1 gien and fixed. The following control is proed to be optimal: pull as hard as possible, that is, t = µ if X t <g S t ), and push as hard as possible, that is, t = µ 1 if X t >g S t ), where s g s) is a switching cure that is determined explicitly as the unique solution to a nonlinear differential equation). The solution found demonstrates that the problem formulations based on a maximum functional can be successfully included in optimal control theory calculus of ariations) in addition to the classic problem formulations due to Lagrange, Mayer, and Bolza. 1. Introduction Stochastic control theory deals with three basic problem formulations which were inherited from classical calculus of ariations cf. [4, pages 25-26]). Gien the equation of motion dx t = µ X t,u t ) dt + σ Xt,u t ) dbt, 1.1) where B t ) t is standard Brownian motion, consider the optimal control problem inf u E x τd L X t,u t ) dt + M XτD ) ), 1.2) where the infimum is taken oer all admissible controls u = u t ) t applied before the exit time τ D = inf{t> X t / C} for some open set C = D c and the process X t ) t starts at x under P x.ifm andl, problem 1.2) issaidtobelagrange formulated. If L andm, problem 1.2)issaidtobeMayer formulated. If both L andm, problem 1.2)is said to be Bolza formulated. Copyright 25 Applied Mathematics and Stochastic Analysis 25:1 25) DOI: /JAMSA.25.77
2 78 Maximum process and optimal control The Lagrange formulation goes back to the 18th century, the Mayer formulation originated in the 19th century, and the Bolza formulation [2] was introduced in We refer to [1, pages ] and the references therein for a historical account of the Lagrange, Mayer, and Bolza problems. Although the three problem formulations are formally known to be equialent see, e.g., [1, pages ], [4, pages 25 26]), this fact is rarely proed to be essential when soling a concrete problem. Setting Z t = LX t,u t )orz t = MX t ), and focusing upon the sample path t Z t for t [,τ D ], we see that the three problem formulations measure the performance associated with a control u by means of the following two functionals: τd Z t dt, Z τd, 1.3) where the first one represents the surface area below or aboe) the sample path, and the second one represents the sample path terminal alue. In addition to these two functionals, it is suggested by elementary geometric considerations that the maximal alue of the sample path max Z t 1.4) t τ D proides yet another performance measure which, to a certain extent, is more sensitie than the preious two. Clearly, a sample path can hae a small integral but still a large maximum, while a large maximum cannot be detected by the terminal alue either. The main purpose of the present paper is to show that the problem formulations based on a maximum functional can be successfully added to optimal control theory calculus of ariations). This is done by formulating a specific problem of this type Section 2)and soling it in a closed form Section 3). The result suggests a number of new aenues for further research upon extending the Bolza formulation 1.2) to optimize the following expression: E x max K ) τd X t,u t + L ) ) ) X t,u t dt + M XτD, 1.5) t τ D wheresomeofthemapsk, L,andM may also be identically zero. Optimal stopping problems for the maximum process hae been studied by a number of authors in the 199 s see, e.g., [6, 3, 1, 8, 5]) and the subject seems to be wellunderstood now. 2. Formulation of the problem Consider a process X = X t ) t soling the stochastic differential equation s.d.e.) dx t = t dt + 2dB t, 2.1)
3 Goran Peskir 79 where B = B t ) t is standard Brownian motion, and associate with X the maximum process ) S t = max X r s 2.2) r t so that X = x and S = s under P x,s,wherex s. Introduce the exit time τ = inf { t> X t / l,l 1 )}, 2.3) where l < <l 1 are gien and fixed, and so let c> in the sequel. The optimal control problem to be examined in this paper is formulated as follows: Jx,s):= supe x,s Sτ cτ ), 2.4) where the supremum is taken oer all admissible controls satisfying t [µ,µ 1 ]for all t τ with some µ < <µ 1 gien and fixed. By admissible we mean that the s.d.e. 2.1) can be soled in Itô s sense either strongly or weakly). Since t is required to be uniformly bounded, it is well known that a weak solution unique in law) always exists under a measurability condition see, e.g., [9, page 155]), where t may depend on theentiresamplepathr X r up to time t. Moreoer,if t = X t ) for some bounded) measurable function, then a strong solution pathwise unique) also exists see, e.g., [9, pages ]). The optimal control problem 2.4) has some interesting interpretations. Equation 2.1) may be iewed as describing the motion of a Brownian particle subject to a fluctuating force Ḃ t ) that is under the influence of a slowly arying) external force t see [7,pages 53 78]).The objectie in 2.4) is therefore to determine an optimum of the externalforcethatoneneedstoexertupontheparticlesoastomakeitsmaximalheight at the time of exit as large as possible in the course of time needed for the same exit to happen as short as possible. Clearly, the interpretation and objectie just described carry oer to many other problems where 2.1) plays a role. It appears intuitiely clear that the optimal control should be of the following bangbang type: at each time either push or pull as hard as possible so as to reach either l 1 or l as soon as possible. The solution of the problem presented in the next section confirms this guess and makes the statement precise in analytic terms. It is also apparent that at each time t we need to keep track of both X t and S t so that the problem is inherently two dimensional. 3. Solution of the problem 1) In the setting of the preious section, consider the optimal control problem 2.4). Note that X t = X t,s t ) is a two-dimensional process with the state space S ={x,s) R 2 x s} that changes increases) in the second coordinate only after hitting the diagonal x = s in R 2.Off the diagonal, the process X = X t ) t changes only in the first coordinate and thus may be identified with X. Moreoer,if t = X t ) for some bounded) measurable function in 2.1), then X is a Marko process. The later feedback controls are sufficient
4 8 Maximum process and optimal control to be considered under fairly general hypotheses see, e.g., [4, pages ]), and this fact will also be proed below. The infinitesimalgeneratorof X may be therefore formally described as follows: L X = L X in x<s, 3.1) = s atx = s, 3.2) where L X is the infinitesimal generator of X. This means that the infinitesimal generator of X is acting on a space of C 2 functions f on S satisfying lim x s f/ s)x,s) =. The formal description 3.1)+3.2) appears in[8, pages ], where the latter fact is also erified. The condition of normal reflection 3.2) was used for the first time in [3] in the case of Bessel processes it was also noted in [6, page 181] in the case of a Bessel process of dimension one). 2) Assuming for a moment that the supremum in 2.4) is attained at some feedback control, and making use of the formal description of the infinitesimal generator 3.1)+3.2), we are naturally led to formulate the following HJB system: sup L X J) c ) = inc for x<s, 3.3) J s x,s) x=s = normal reflection), 3.4) Jx,s) x=l+ = s instantaneous stopping), 3.5) Jx,s) x=l1 = s instantaneous stopping), 3.6) for l <s<l 1, where the infinitesimal generator of X gien is expressed by L X = x + 2 x 2 3.7) and we set C ={x,s) R 2 l <x s<l 1 }.Ourmaineffort in the sequel will be directed to soling the system 3.3) 3.6)in a closed form. More explicitly, the HJB equation 3.3) with J = Jx,s) reads as follows: sup Jx + J xx c ) = 3.8) so that we may expect a bang-bang solution depending on the sign of J x.ifj x <, then t = µ,andifj x >, then t = µ 1. The equation J x = defines an optimal switching cure s g s), and the main task in the sequel will be to determine it explicitly. Further heuristic considerations based on the bang-bang principle just stated when close to l apply µ so to exit at l, and when close to l 1 apply µ 1 so to exit at l 1 )suggest to partition C into the following three subsets modulo two cures x = g s) ands = s
5 l 1 l x l 1 Goran Peskir 81 C 1 C 2 s g s) s x S C 3 l Figure 3.1. The case of small c in problem 2.4). to be found): C 1 = { x,s) R 2 } l <x<g s), s <s<l 1, 3.9) C 2 = { x,s) R 2 } g s) <x s, s <s<l 1, 3.1) C 3 = { x,s) R 2 } l <x s<s, 3.11) where s is a unique point in l,l 1 ) satisfying In addition to 3.11), we also set g s ) = l. 3.12) g l1 ) = x 3.13) to denote another point in l,l 1 ) playing a role. We refer to Figure 3.1 to obtain a better geometric understanding of 3.9) 3.13). [In Figure 3.1 the state space triangle) of the process X t,s t )from2.1)+2.2) splits into three regions. In the region C 1,theoptimal control t equals µ, and in the region C 2 C 3 the optimal control t equals µ 1. The switching cure s g s) isdeterminedastheuniquesolutionofthedifferential equation 3.26) satisfying g l 1 ) = x,wherex l,l 1 ) is the unique solution of the transcendental equation 3.25). In this specific case, we took l = µ = 1, l 1 = µ 1 = 1, and c = 2. It turns out that x =, s = ands = The point s is a singularity point at which dg /ds = + and g takes a finite alue.)]
6 82 Maximum process and optimal control 3) We construct a solution to the system 3.3) 3.6) in three steps. In the first two steps, we determine C 1 C 2 together with a boundary cure s g s) separating C 1 from C 2. Step 1. Consider the HJB equation in C 1 to be found. The general solution of 3.14)isgienby µ J x + J xx c = 3.14) Jx,s) = 1 µ a s)e µx + c µ x + b s), 3.15) where a s)andb s) are some undetermined functions of s. Using 3.5), we can eliminate b s)from3.15) and this yields Jx,s) = 1 µ a s) e µx e µl) + c µ x l ) + s. 3.16) Soling J x x,s) = forx gies x = g s) as a candidate for the switching cure, and also that a s) can be expressed in terms of g s)asfollows: Inserting this back into 3.16)gies J 1) x,s) = a s) = c µ e µg s). 3.17) c µ ) 2 e µg s) e µx e µl) + c µ x l ) + s 3.18) as a candidate for the alue function 2.4)whenx,s) C 1. Step 2. Consider the HJB equation in C 2 to be found. The general solution of 3.19)isgienby µ 1 J x + J xx c = 3.19) Jx,s) = 1 µ 1 a 1 s)e µ1x + c µ 1 x + b 1 s), 3.2) where a 1 s) andb 1 s) are some undetermined functions of s. Soling J x x,s) = forx gies x = g s) as a candidate for the switching cure, and also that a 1 s) canbeexpressed in terms of g s)asfollows: Inserting this back into 3.2)gies J 2) x,s) = a 1 s) = c µ 1 e µ1g s). 3.21) c µ1 ) 2 e µ1g s) x) + c µ 1 x + b 1 s). 3.22)
7 Goran Peskir 83 The two functions 3.18)and3.22) must coincide at the switching cure, that is, J 1) x,s) x=g s)+ = J2) x,s) x=g s) 3.23) giing a closed expression for b 1 s), which after being inserted back into 3.22)yields J 2) x,s) = c ) 2 e µ1g s) x) c ) 2 e µg s) l) µ1 µ c µ 1 g s) x ) + c µ g s) l ) + s + c µ ) 2 c µ1 ) ) as a candidate for the alue function 2.4)whenx,s) C 2. The condition 3.6) withx = s = l 1 can now be used to determine a unique x l,l 1 ) satisfying 3.13). It follows from the expression 3.24)aboethatx soles and is uniquely determined by) the following transcendental equation: 1 ) 2 1 e µ ) 1x l 1) 1 ) 2 1 e µ ) x l ) ) l1 x l ) =. 3.25) µ1 µ µ 1 µ µ 1 µ It may be noted that this equation, and therefore x as well, does not depend on c. Finally, applying the condition 3.4) to the expression 3.24), we obtain a differential equation for the switching cure s g s) that takes the following form: g s) = 1 c/µ1 ) 1 e µ 1gs) s) ) c/µ ) 1 e µ gs) l ) ) 3.26) for all s s,l 1 ), where s <l 1 happens to be a singularity point at which dg/ds = +. Equation 3.26) is soled backwards under the initial condition 3.13), where x l,l 1 ) is found by soling 3.25). The switching cure s g s) is a unique solution of 3.26) obtained in this way. It can also be erified that 3.12)holdsforsomes s,l 1 ). 4) It turns out that the solution of 3.26) satisfying 3.13) can hit the diagonal in R 2 at apoints l,l 1 ) taken to be closest to x,ifc c for some large c to be determined below. When this happens, the construction of the solution becomes more complicated, and the solution of 3.26) fors s,s )isofnouse.wethusfirsttreatthesimpler case when the solution of 3.26) stays below the diagonal the case of small c), and this case is then followed by the more complicated case when the solution of 3.26) hits the diagonal the case of large c). Step 3 the case of small c). Haing characterized the cure s g s)for[s,l 1 ], we hae obtained a candidate 3.18)+3.24) for the alue function 2.4) whenx,s) C 1 C 2.It remains to determine Jx,s)forx,s) C 3, and this is what we do in the final step. As clearly the control µ 1 should be applied, consider the HJB equation µ 1 J x + J xx c = 3.27) in C 3 gien and fixed. The general solution of 3.27)isgienby Jx,s) = 1 µ 1 a 2 s)e µ1x + c µ 1 x + b 2 s), 3.28)
8 84 Maximum process and optimal control where a 2 s) andb 2 s) are some undetermined functions of s. Using the condition 3.5), we can eliminate b 2 s)from3.28) and this yields J 3) x,s) = 1 µ 1 a 2 s) e µ1x e µ1l) + c µ 1 x l ) + s. 3.29) Applying the condition 3.4) to the expression 3.29), we find that a 2 s) should sole µ a 1 2s) = e µ1s 3.3) e µ1l for l <s<s. This equation can be soled explicitly and this gies a 2 s) = e µ1l µ 1 s +log e µ1s e µ1l)) + d, 3.31) where d is an undetermined constant. To determine d, we may use the fact that the maps 3.24)and3.29)mustcoincideats,s ), that is, J 2) x,s) x=s=s = J 3) x,s) x=s=s, 3.32) thelatterbeingknownexplicitlydueto3.12). With this d we can then rewrite 3.31)as follows: a 2 s) = e µ µ1l 1 s s ) e µ ) 1s e log µ1l c ). 3.33) e µ1s e µ1l µ1 Inserting this expression back into 3.29), we obtain a candidate for the alue function 2.4)whenx,s) C 3, thus completing the construction of a solution to the system 3.3) 3.6). Steps 3 5 the case of large c). In this case, the solution s g s) of3.26) satisfying 3.13) hits the diagonal in R 2 at some s l,l 1 ). The set C 1 from 3.9) naturally splits into the following three subsets modulo two cures): C 1,1 = { x,s) R 2 } l <x<g s), s <s<l 1, 3.34) C 1,2 = { x,s) R 2 l <x<s, s <s<s }, 3.35) C 1,3 = { x,s) R 2 l <x<h s), s <s<s }, 3.36) where s,themaps h s), and s in this context will soon be defined. Similarly, the set C 2 from 3.1) naturally splits into the following two subsets modulo one cure): C 2,1 = { x,s) R 2 } g s) <x s, s <s<l 1, 3.37) C 2,2 = { x,s) R 2 h s) <x s, s <s<s }. 3.38) The set C 3 from 3.11) remains the same, howeer, with a new alue for s to be introduced. We refer to Figure 3.2 to obtain a better geometric understanding of 3.34) 3.38). [In Figure 3.2 the state space triangle) of the process X t,s t )from2.1)+2.2) splits into six regions. In the region C 1,1 C 1,2 C 1,3,theoptimalcontrolt equals
9 Goran Peskir 85 l 1 l x l 1 C 2,1 C 1,1 s g s) s x s h s) s C 1,3 s s C 1,2 l C 2,2 C 3 Figure 3.2. The case of large c in problem 2.4). µ, and in the region C 2,1 C 2,2 C 3,theoptimalcontrolt equals µ 1. The switching cure s g s) is determined as the unique solution of the differential equation 3.26) satisfying g l 1 ) = x,wherex l,l 1 ) is the unique solution of the transcendental equation 3.25). The switching cure s h s) differs from the solution s g s) of 3.26) and is determined to meet the condition 3.4) as explained in the text. In this specific case, we took l = µ = 1, l 1 = µ 1 = 1, and c = 3.8. It turns out that x =, s = , s =.82273, and s = For comparison, we state that the smaller of two) s satisfying g s ) = s equals , that s satisfying g s ) = l equals , and that s = The point s is a singularity point at which dg /ds = + and g takes a finite alue.)] It is clear from the construction aboe that in C 1,1 the alue function 2.4)isgienby 3.18), and that in C 2,1 the alue function 2.4) isgienby3.24), where s g s) isthe solution of 3.26) satisfying 3.13). For the points s<s close to s ) we can no longer make use of the solution g s), and the expression 3.18), as clearly the condition 3.4) fails to hold. We need, moreoer, to apply the control µ instead of µ 1, and thus Step 3 presented aboe must be modified. The HJB equation 3.27) is considered with µ in place of µ 1, and this again using 3.5) leads to the expression 3.29)withµ in place of µ 1 : J 1,2) x,s) = 1 µ a 3 s) e µx e µl) + c µ x l ) + s 3.39)
10 86 Maximum process and optimal control as well as 3.3)anditssolution3.31). To determine d in 3.31), we may use that J 1,2) x,s) x=s=s = J i,1) x,s) x=s=s 3.4) for i either 1 or 2, where we set J 1,1) = J 1) and J 2,1) = J 2) with J 1) from 3.18) and J 2) from 3.24). The latter expression in 3.4) is known explicitly due to the fact that g s ) = s. With this d,wecanthenrewriteananalogueof3.33)asfollows: a 3 s) = e µ µl s s ) )) e µ s e log µl c e µs e µ l e µs. 3.41) µ Inserting this expression back into 3.39), we obtain a candidate for the alue function 2.4)whenx,s) C 1,2. Moreoer, the equation J x 1,2) = determines an optimal switching cure h s) = 1 log µ ) µ c a 3s) 3.42) and the points s l,s )ands l,s ) appearing in 3.35)+3.36) and3.38) are determined by the following identities: ) h s = s, 3.43) ) h s = l. 3.44) Note that 3.44) is reminiscent of 3.12), and so is h s)ofg s). Howeer, the two functions are different for s<s. It is clear that the alue function 2.4) is also gien by the formula 3.39) forx,s) C 1,3. To determine the alue function 2.4) inc 2,2, where clearly the control µ 1 is to be applied, we can use the result of Step 2 aboe which leads to the following analogue of 3.24)aboe: J 2,2) x,s) = c ) 2 e µ1h s) x) c ) 2 e µh s) l) µ1 µ c µ 1 h s) x ) + c µ h s) l ) + s + c µ ) 2 c µ1 ) ) for x,s) C 2,2. Finally, in C 3 we should also apply the control µ 1, and thus the result of Step 3 the case of small c ) aboe can be used. Due to 3.44), the expressions 3.29)+3.33)carryoer unchanged to the present case. It must be kept in mind, howeer, that s satisfies 3.44) and not 3.12). This completes the construction of a solution to the system 3.3) 3.6). 5) In this way, we hae obtained a candidate for the alue function 2.4) whenx,s) C in both cases of small and large c. The preceding considerations can now be summarized as follows. Theorem 3.1. In the setting of 2.1) 2.3), consider the optimal control problem 2.4), where the supremum is taken oer all admissible controls as explained.
11 Goran Peskir 87 1) In the case of small c in the sense that the solution of 3.26) stays below the diagonal in R 2, the alue function J = Jx,s) soles the system 3.3) 3.6) and is explicitly gien by 3.18)inC 1 from 3.9), by 3.24)inC 2 from 3.1), and by 3.29)+3.33) in C 3 from 3.11) with s from 3.12), where s g s) is the unique solution of the differential equation 3.26) for s s,l 1 ) satisfying g l 1 ) = x,andx l,l 1 ) is the unique solution of the transcendental equation 3.25). The alues of J at the two boundary cures in C not mentioned are determined by continuity.) 2) In the case of large c in the sense that the solution of 3.26) hits the diagonal in R 2, the alue function J = Jx,s) soles the system 3.3) 3.6) and is explicitly gien by 3.18) inc 1,1 from 3.34), by 3.24) inc 2,1 from 3.37), by 3.39)+3.41) in C 1,2 C 1,3 from 3.35)+3.36), by3.45) inc 2,2 from 3.38), and by 3.29)+3.33) in C 3 from 3.11) with s from 3.44), where s g s) is the unique solution of the differential equation 3.26) for s s,l 1 ) satisfying g l 1 ) = x with x l,l 1 ) as aboe, and s h s) is gien by 3.42)+3.41). ThealuesofJ at the four boundary cures in C not mentioned are determined by continuity.) 3) The optimal control in problem 2.4) is described as follows: pull as hard as possible, that is, t = µ if X t <g S t ),and pushashardaspossible, thatis,t = µ 1 if X t >g S t ),bothaslongast τ,whereτ is gien in 2.3). This description holds in the case of large c by modifying the solution g s) of 3.26) fors<s as follows: g s):= s +1if s s,s ) and g s):= h s) for s s,s ). In both cases of small and large c, formally set g s):= l for s l,s ).Thecontrolt for X t = g S t ) is arbitrary and has no effect on optimality of the result.) To erify the statements, denote the candidate function by Jx,s) forx,s) C. Then, by construction, it is clear that x,s) Jx,s)isC 2 outside the set {g s),s) s <s<l 1 } in C, andx Jx,s) isc 1 at gs) whens is fixed. Actually, the latter mapping is also C 2 as is easily seen from 3.14)and3.19).) Thus, Itô s formula can be applied to the process JX t,s t ) with any admissible,andunderp x,s in this way we get J ) t ) t ) X t,s t = Jx,s)+ J x Xr,S r dxr + J s Xr,S r dsr + 1 t ) J xx Xr,S r d X,X r 3.46) 2 t ) t = Jx,s)+ 2Jx Xr,S r dbr + L ) ) ) X J) Xr,S r dr, where the integral with respect to ds r is zero, since the increment S r equals zero off the diagonal in R 2, and at the diagonal we hae 3.4). Since X τ equals either l or l 1,weseeby3.5)+3.6)thatJX τ,s τ ) = S τ, and thus 3.46) implies the following identity: S τ = Jx,s)+M τ + τ L X ) J) ) Xr,S r ) dr, 3.47) where M t = t 2Jx X r,s r )db r is a continuous local) martingale. Since x,s) J x x,s)is uniformly bounded in C, it follows by the optional sampling theorem that E x,s M τ ) =.
12 88 Maximum process and optimal control Note that there is no restriction to consider only those controls for which E x,s τ) < so that E x,s τ) < as well.) On the other hand, by 3.3) weknowthatl XJ))x,s) c for all x,s) C, with equality if =, and thus 3.47)yields ) τ Jx,s) = E x,s S τ L ) ) ) X J) Xr,S r dr E x,s Sτ cτ ) 3.48) with equality if =. This establishes that the candidate function equals the alue function, and that the optimal control equals, thus completing the proof. Acknowledgment The author was supported by Centre for Mathematical Physics and Stochastics funded by the Danish National Research Foundation). References [1] G. A. Bliss,Lectures on the Calculus of Variations, Uniersity of Chicago Press, Illinois, [2] O. Bolza, Über den Anormalen Fall beim Lagrangeschen und Mayerschen Problem mit gemischten Bedingungen und ariablen Endpunkten, Math. Ann ), German). [3] L. E. Dubins, L. A. Shepp, and A. N. Shiryae, Optimal stopping rules and maximal inequalities for Bessel processes, Theory Probab. Appl ), no. 2, [4] W. H. Fleming and R. W. Rishel, Deterministic and Stochastic Optimal Control, Springer-Verlag, Berlin, [5] S.E.Graersen,G.Peskir,andA.N.Shiryae,Stopping Brownian motion without anticipation ascloseaspossibletoitsultimatemaximum, Theory Probab. Appl ), no. 1, [6] S. D. Jacka, Optimal stopping and best constants for Doob-like inequalities. I. The case p = 1, Ann. Probab ), no. 4, [7] E. Nelson, Dynamical Theories of Brownian Motion, Princeton Uniersity Press, New Jersey, [8] G. Peskir, Optimal stopping of the maximum process: the maximality principle, Ann. Probab ), no. 4, [9] L. C. G. Rogers and D. Williams, Diffusions, Marko Processes, and Martingales. Vol. 2. ItôCalculus, Wiley Series in Probability and Mathematical Statistics: Probability and Mathematical Statistics, John Wiley & Sons, New York, [1] L. Shepp and A. N. Shiryae, The Russian option: reduced regret, Ann. Appl. Probab ), no. 3, Goran Peskir: Department of Mathematical Sciences, Uniersity of Aarhus, Ny Munkegade, 8 Aarhus, Denmark address: goran@imf.au.dk
13 Adances in Operations Research Volume 214 Adances in Decision Sciences Volume 214 Applied Mathematics Algebra Volume 214 Probability and Statistics Volume 214 The Scientific World Journal Volume 214 International Differential Equations Volume 214 Volume 214 Submit your manuscripts at International Adances in Combinatorics Mathematical Physics Volume 214 Complex Analysis Volume 214 International Mathematics and Mathematical Sciences Mathematical Problems in Engineering Mathematics Volume 214 Volume 214 Volume 214 Volume 214 Discrete Mathematics Volume 214 Discrete Dynamics in Nature and Society Function Spaces Abstract and Applied Analysis Volume 214 Volume 214 Volume 214 International Stochastic Analysis Optimization Volume 214 Volume 214
Maximum Process Problems in Optimal Control Theory
J. Appl. Math. Stochastic Anal. Vol. 25, No., 25, (77-88) Research Report No. 423, 2, Dept. Theoret. Statist. Aarhus (2 pp) Maximum Process Problems in Optimal Control Theory GORAN PESKIR 3 Given a standard
More informationAlbert N. Shiryaev Steklov Mathematical Institute. On sharp maximal inequalities for stochastic processes
Albert N. Shiryaev Steklov Mathematical Institute On sharp maximal inequalities for stochastic processes joint work with Yaroslav Lyulko, Higher School of Economics email: albertsh@mi.ras.ru 1 TOPIC I:
More informationThe Azéma-Yor Embedding in Non-Singular Diffusions
Stochastic Process. Appl. Vol. 96, No. 2, 2001, 305-312 Research Report No. 406, 1999, Dept. Theoret. Statist. Aarhus The Azéma-Yor Embedding in Non-Singular Diffusions J. L. Pedersen and G. Peskir Let
More informationSolving the Poisson Disorder Problem
Advances in Finance and Stochastics: Essays in Honour of Dieter Sondermann, Springer-Verlag, 22, (295-32) Research Report No. 49, 2, Dept. Theoret. Statist. Aarhus Solving the Poisson Disorder Problem
More informationPredicting the Time of the Ultimate Maximum for Brownian Motion with Drift
Proc. Math. Control Theory Finance Lisbon 27, Springer, 28, 95-112 Research Report No. 4, 27, Probab. Statist. Group Manchester 16 pp Predicting the Time of the Ultimate Maximum for Brownian Motion with
More informationOn Doob s Maximal Inequality for Brownian Motion
Stochastic Process. Al. Vol. 69, No., 997, (-5) Research Reort No. 337, 995, Det. Theoret. Statist. Aarhus On Doob s Maximal Inequality for Brownian Motion S. E. GRAVERSEN and G. PESKIR If B = (B t ) t
More informationA Barrier Version of the Russian Option
A Barrier Version of the Russian Option L. A. Shepp, A. N. Shiryaev, A. Sulem Rutgers University; shepp@stat.rutgers.edu Steklov Mathematical Institute; shiryaev@mi.ras.ru INRIA- Rocquencourt; agnes.sulem@inria.fr
More informationThe Wiener Sequential Testing Problem with Finite Horizon
Research Report No. 434, 3, Dept. Theoret. Statist. Aarhus (18 pp) The Wiener Sequential Testing Problem with Finite Horizon P. V. Gapeev and G. Peskir We present a solution of the Bayesian problem of
More informationOptimal Prediction of the Ultimate Maximum of Brownian Motion
Optimal Prediction of the Ultimate Maximum of Brownian Motion Jesper Lund Pedersen University of Copenhagen At time start to observe a Brownian path. Based upon the information, which is continuously updated
More informationOptimal Stopping Problems for Time-Homogeneous Diffusions: a Review
Optimal Stopping Problems for Time-Homogeneous Diffusions: a Review Jesper Lund Pedersen ETH, Zürich The first part of this paper summarises the essential facts on general optimal stopping theory for time-homogeneous
More informationIntroduction to Random Diffusions
Introduction to Random Diffusions The main reason to study random diffusions is that this class of processes combines two key features of modern probability theory. On the one hand they are semi-martingales
More informationOn the American Option Problem
Math. Finance, Vol. 5, No., 25, (69 8) Research Report No. 43, 22, Dept. Theoret. Statist. Aarhus On the American Option Problem GORAN PESKIR 3 We show how the change-of-variable formula with local time
More informationOn Reflecting Brownian Motion with Drift
Proc. Symp. Stoch. Syst. Osaka, 25), ISCIE Kyoto, 26, 1-5) On Reflecting Brownian Motion with Drift Goran Peskir This version: 12 June 26 First version: 1 September 25 Research Report No. 3, 25, Probability
More informationI forgot to mention last time: in the Ito formula for two standard processes, putting
I forgot to mention last time: in the Ito formula for two standard processes, putting dx t = a t dt + b t db t dy t = α t dt + β t db t, and taking f(x, y = xy, one has f x = y, f y = x, and f xx = f yy
More informationPurpose of the experiment
Impulse and Momentum PES 116 Adanced Physics Lab I Purpose of the experiment Measure a cart s momentum change and compare to the impulse it receies. Compare aerage and peak forces in impulses. To put the
More informationLectures in Mathematics ETH Zürich Department of Mathematics Research Institute of Mathematics. Managing Editor: Michael Struwe
Lectures in Mathematics ETH Zürich Department of Mathematics Research Institute of Mathematics Managing Editor: Michael Struwe Goran Peskir Albert Shiryaev Optimal Stopping and Free-Boundary Problems Birkhäuser
More informationApplications of Optimal Stopping and Stochastic Control
Applications of and Stochastic Control YRM Warwick 15 April, 2011 Applications of and Some problems Some technology Some problems The secretary problem Bayesian sequential hypothesis testing the multi-armed
More informationOn pathwise stochastic integration
On pathwise stochastic integration Rafa l Marcin Lochowski Afican Institute for Mathematical Sciences, Warsaw School of Economics UWC seminar Rafa l Marcin Lochowski (AIMS, WSE) On pathwise stochastic
More informationON THE POLICY IMPROVEMENT ALGORITHM IN CONTINUOUS TIME
ON THE POLICY IMPROVEMENT ALGORITHM IN CONTINUOUS TIME SAUL D. JACKA AND ALEKSANDAR MIJATOVIĆ Abstract. We develop a general approach to the Policy Improvement Algorithm (PIA) for stochastic control problems
More informationStochastic optimal control with rough paths
Stochastic optimal control with rough paths Paul Gassiat TU Berlin Stochastic processes and their statistics in Finance, Okinawa, October 28, 2013 Joint work with Joscha Diehl and Peter Friz Introduction
More informationBernardo D Auria Stochastic Processes /12. Notes. March 29 th, 2012
1 Stochastic Calculus Notes March 9 th, 1 In 19, Bachelier proposed for the Paris stock exchange a model for the fluctuations affecting the price X(t) of an asset that was given by the Brownian motion.
More informationSTOPPING AT THE MAXIMUM OF GEOMETRIC BROWNIAN MOTION WHEN SIGNALS ARE RECEIVED
J. Appl. Prob. 42, 826 838 (25) Printed in Israel Applied Probability Trust 25 STOPPING AT THE MAXIMUM OF GEOMETRIC BROWNIAN MOTION WHEN SIGNALS ARE RECEIVED X. GUO, Cornell University J. LIU, Yale University
More informationPavel V. Gapeev, Neofytos Rodosthenous Perpetual American options in diffusion-type models with running maxima and drawdowns
Pavel V. Gapeev, Neofytos Rodosthenous Perpetual American options in diffusion-type models with running maxima and drawdowns Article (Accepted version) (Refereed) Original citation: Gapeev, Pavel V. and
More informationLecture 12. F o s, (1.1) F t := s>t
Lecture 12 1 Brownian motion: the Markov property Let C := C(0, ), R) be the space of continuous functions mapping from 0, ) to R, in which a Brownian motion (B t ) t 0 almost surely takes its value. Let
More informationSolution of Stochastic Optimal Control Problems and Financial Applications
Journal of Mathematical Extension Vol. 11, No. 4, (2017), 27-44 ISSN: 1735-8299 URL: http://www.ijmex.com Solution of Stochastic Optimal Control Problems and Financial Applications 2 Mat B. Kafash 1 Faculty
More informationDeterministic Dynamic Programming
Deterministic Dynamic Programming 1 Value Function Consider the following optimal control problem in Mayer s form: V (t 0, x 0 ) = inf u U J(t 1, x(t 1 )) (1) subject to ẋ(t) = f(t, x(t), u(t)), x(t 0
More informationlim n C1/n n := ρ. [f(y) f(x)], y x =1 [f(x) f(y)] [g(x) g(y)]. (x,y) E A E(f, f),
1 Part I Exercise 1.1. Let C n denote the number of self-avoiding random walks starting at the origin in Z of length n. 1. Show that (Hint: Use C n+m C n C m.) lim n C1/n n = inf n C1/n n := ρ.. Show that
More informationn E(X t T n = lim X s Tn = X s
Stochastic Calculus Example sheet - Lent 15 Michael Tehranchi Problem 1. Let X be a local martingale. Prove that X is a uniformly integrable martingale if and only X is of class D. Solution 1. If If direction:
More informationOn the principle of smooth fit in optimal stopping problems
1 On the principle of smooth fit in optimal stopping problems Amir Aliev Moscow State University, Faculty of Mechanics and Mathematics, Department of Probability Theory, 119992, Moscow, Russia. Keywords:
More informationON THE FIRST TIME THAT AN ITO PROCESS HITS A BARRIER
ON THE FIRST TIME THAT AN ITO PROCESS HITS A BARRIER GERARDO HERNANDEZ-DEL-VALLE arxiv:1209.2411v1 [math.pr] 10 Sep 2012 Abstract. This work deals with first hitting time densities of Ito processes whose
More informationMulti-dimensional Stochastic Singular Control Via Dynkin Game and Dirichlet Form
Multi-dimensional Stochastic Singular Control Via Dynkin Game and Dirichlet Form Yipeng Yang * Under the supervision of Dr. Michael Taksar Department of Mathematics University of Missouri-Columbia Oct
More informationOn the martingales obtained by an extension due to Saisho, Tanemura and Yor of Pitman s theorem
On the martingales obtained by an extension due to Saisho, Tanemura and Yor of Pitman s theorem Koichiro TAKAOKA Dept of Applied Physics, Tokyo Institute of Technology Abstract M Yor constructed a family
More informationBernardo D Auria Stochastic Processes /10. Notes. Abril 13 th, 2010
1 Stochastic Calculus Notes Abril 13 th, 1 As we have seen in previous lessons, the stochastic integral with respect to the Brownian motion shows a behavior different from the classical Riemann-Stieltjes
More informationStochastic Hamiltonian systems and reduction
Stochastic Hamiltonian systems and reduction Joan Andreu Lázaro Universidad de Zaragoza Juan Pablo Ortega CNRS, Besançon Geometric Mechanics: Continuous and discrete, nite and in nite dimensional Ban,
More informationThe Russian option: Finite horizon. Peskir, Goran. MIMS EPrint: Manchester Institute for Mathematical Sciences School of Mathematics
The Russian option: Finite horizon Peskir, Goran 25 MIMS EPrint: 27.37 Manchester Institute for Mathematical Sciences School of Mathematics The University of Manchester Reports available from: And by contacting:
More informationA new approach for investment performance measurement. 3rd WCMF, Santa Barbara November 2009
A new approach for investment performance measurement 3rd WCMF, Santa Barbara November 2009 Thaleia Zariphopoulou University of Oxford, Oxford-Man Institute and The University of Texas at Austin 1 Performance
More informationOptimal Stopping and Maximal Inequalities for Poisson Processes
Optimal Stopping and Maximal Inequalities for Poisson Processes D.O. Kramkov 1 E. Mordecki 2 September 10, 2002 1 Steklov Mathematical Institute, Moscow, Russia 2 Universidad de la República, Montevideo,
More informationOPTIMAL STOPPING OF A BROWNIAN BRIDGE
OPTIMAL STOPPING OF A BROWNIAN BRIDGE ERIK EKSTRÖM AND HENRIK WANNTORP Abstract. We study several optimal stopping problems in which the gains process is a Brownian bridge or a functional of a Brownian
More informationSOME LIMIT THEOREMS CONNECTED WITH BROWNIAN LOCAL TIME
SOME LIMIT THEOEMS CONNECTED WITH BOWNIAN LOCAL TIME AOUF GHOMASNI eceived 26 October 24; evised April 25; Accepted 2 April 25 Let B = (B t ) t be a standard Brownian motion and let (L x t ; t, x ) be
More informationRunge-Kutta Method for Solving Uncertain Differential Equations
Yang and Shen Journal of Uncertainty Analysis and Applications 215) 3:17 DOI 1.1186/s4467-15-38-4 RESEARCH Runge-Kutta Method for Solving Uncertain Differential Equations Xiangfeng Yang * and Yuanyuan
More informationON THE PATHWISE UNIQUENESS OF SOLUTIONS OF STOCHASTIC DIFFERENTIAL EQUATIONS
PORTUGALIAE MATHEMATICA Vol. 55 Fasc. 4 1998 ON THE PATHWISE UNIQUENESS OF SOLUTIONS OF STOCHASTIC DIFFERENTIAL EQUATIONS C. Sonoc Abstract: A sufficient condition for uniqueness of solutions of ordinary
More informationfor all f satisfying E[ f(x) ] <.
. Let (Ω, F, P ) be a probability space and D be a sub-σ-algebra of F. An (H, H)-valued random variable X is independent of D if and only if P ({X Γ} D) = P {X Γ}P (D) for all Γ H and D D. Prove that if
More informationResearch Article A Necessary Characteristic Equation of Diffusion Processes Having Gaussian Marginals
Abstract and Applied Analysis Volume 01, Article ID 598590, 9 pages doi:10.1155/01/598590 Research Article A Necessary Characteristic Equation of Diffusion Processes Having Gaussian Marginals Syeda Rabab
More informationResearch Article Existence and Uniqueness of Homoclinic Solution for a Class of Nonlinear Second-Order Differential Equations
Applied Mathematics Volume 2012, Article ID 615303, 13 pages doi:10.1155/2012/615303 Research Article Existence and Uniqueness of Homoclinic Solution for a Class of Nonlinear Second-Order Differential
More informationOn Wald-Type Optimal Stopping for Brownian Motion
J Al Probab Vol 34, No 1, 1997, (66-73) Prerint Ser No 1, 1994, Math Inst Aarhus On Wald-Tye Otimal Stoing for Brownian Motion S RAVRSN and PSKIR The solution is resented to all otimal stoing roblems of
More informationSUPPLEMENTARY MATERIAL. Authors: Alan A. Stocker (1) and Eero P. Simoncelli (2)
SUPPLEMENTARY MATERIAL Authors: Alan A. Stocker () and Eero P. Simoncelli () Affiliations: () Dept. of Psychology, Uniersity of Pennsylania 34 Walnut Street 33C Philadelphia, PA 94-68 U.S.A. () Howard
More informationHölder norms and the support theorem for diffusions
Hölder norms and the support theorem for diffusions Gérard Ben Arous, Mihai Gradinaru Uniersité de Paris-Sud, Mathématiques, Bât. 45, 9145 Orsay Cedex, France and Michel Ledoux Laboratoire de Statistique
More informationA Concise Course on Stochastic Partial Differential Equations
A Concise Course on Stochastic Partial Differential Equations Michael Röckner Reference: C. Prevot, M. Röckner: Springer LN in Math. 1905, Berlin (2007) And see the references therein for the original
More informationChapter 2 Optimal Control Problem
Chapter 2 Optimal Control Problem Optimal control of any process can be achieved either in open or closed loop. In the following two chapters we concentrate mainly on the first class. The first chapter
More informationStochastic Calculus (Lecture #3)
Stochastic Calculus (Lecture #3) Siegfried Hörmann Université libre de Bruxelles (ULB) Spring 2014 Outline of the course 1. Stochastic processes in continuous time. 2. Brownian motion. 3. Itô integral:
More informationTHE MINIMUM MATCHING ENERGY OF BICYCLIC GRAPHS WITH GIVEN GIRTH
ROCKY MOUNTAIN JOURNAL OF MATHEMATICS Volume 46, Number 4, 2016 THE MINIMUM MATCHING ENERGY OF BICYCLIC GRAPHS WITH GIVEN GIRTH HONG-HAI LI AND LI ZOU ABSTRACT. The matching energy of a graph was introduced
More informationResearch Article Wave Scattering in Inhomogeneous Strings
International Scholarly Research Network ISRN Mathematical Analysis Volume 011, Article ID 64049, 14 pages doi:10.540/011/64049 Research Article Wave Scattering in Inhomogeneous Strings Nezam Iraniparast
More informationBrownian Motion and the Dirichlet Problem
Brownian Motion and the Dirichlet Problem Mario Teixeira Parente August 29, 2016 1/22 Topics for the talk 1. Solving the Dirichlet problem on bounded domains 2. Application: Recurrence/Transience of Brownian
More informationOn the sequential testing problem for some diffusion processes
To appear in Stochastics: An International Journal of Probability and Stochastic Processes (17 pp). On the sequential testing problem for some diffusion processes Pavel V. Gapeev Albert N. Shiryaev We
More informationChapter 2 Event-Triggered Sampling
Chapter Event-Triggered Sampling In this chapter, some general ideas and basic results on event-triggered sampling are introduced. The process considered is described by a first-order stochastic differential
More informationLecture 21 Representations of Martingales
Lecture 21: Representations of Martingales 1 of 11 Course: Theory of Probability II Term: Spring 215 Instructor: Gordan Zitkovic Lecture 21 Representations of Martingales Right-continuous inverses Let
More informationp 1 ( Y p dp) 1/p ( X p dp) 1 1 p
Doob s inequality Let X(t) be a right continuous submartingale with respect to F(t), t 1 P(sup s t X(s) λ) 1 λ {sup s t X(s) λ} X + (t)dp 2 For 1 < p
More informationReflected Brownian Motion
Chapter 6 Reflected Brownian Motion Often we encounter Diffusions in regions with boundary. If the process can reach the boundary from the interior in finite time with positive probability we need to decide
More informationSTAT 331. Martingale Central Limit Theorem and Related Results
STAT 331 Martingale Central Limit Theorem and Related Results In this unit we discuss a version of the martingale central limit theorem, which states that under certain conditions, a sum of orthogonal
More informationPROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS
PROBABILITY: LIMIT THEOREMS II, SPRING 15. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please
More informationOn the submartingale / supermartingale property of diffusions in natural scale
On the submartingale / supermartingale property of diffusions in natural scale Alexander Gushchin Mikhail Urusov Mihail Zervos November 13, 214 Abstract Kotani 5 has characterised the martingale property
More informationApplied Mathematics Letters. Stationary distribution, ergodicity and extinction of a stochastic generalized logistic system
Applied Mathematics Letters 5 (1) 198 1985 Contents lists available at SciVerse ScienceDirect Applied Mathematics Letters journal homepage: www.elsevier.com/locate/aml Stationary distribution, ergodicity
More informationOn maximal inequalities via comparison principle
Makasu Journal of Inequalities and Appliations (2015 2015:348 DOI 10.1186/s13660-015-0873-3 R E S E A R C H Open Aess On maximal inequalities via omparison priniple Cloud Makasu * * Correspondene: makasu@uw.a.za
More informationOn the quantiles of the Brownian motion and their hitting times.
On the quantiles of the Brownian motion and their hitting times. Angelos Dassios London School of Economics May 23 Abstract The distribution of the α-quantile of a Brownian motion on an interval [, t]
More informationOPTIMAL SOLUTIONS TO STOCHASTIC DIFFERENTIAL INCLUSIONS
APPLICATIONES MATHEMATICAE 29,4 (22), pp. 387 398 Mariusz Michta (Zielona Góra) OPTIMAL SOLUTIONS TO STOCHASTIC DIFFERENTIAL INCLUSIONS Abstract. A martingale problem approach is used first to analyze
More informationSTOCHASTIC PERRON S METHOD AND VERIFICATION WITHOUT SMOOTHNESS USING VISCOSITY COMPARISON: OBSTACLE PROBLEMS AND DYNKIN GAMES
STOCHASTIC PERRON S METHOD AND VERIFICATION WITHOUT SMOOTHNESS USING VISCOSITY COMPARISON: OBSTACLE PROBLEMS AND DYNKIN GAMES ERHAN BAYRAKTAR AND MIHAI SÎRBU Abstract. We adapt the Stochastic Perron s
More informationA Change of Variable Formula with Local Time-Space for Bounded Variation Lévy Processes with Application to Solving the American Put Option Problem 1
Chapter 3 A Change of Variable Formula with Local Time-Space for Bounded Variation Lévy Processes with Application to Solving the American Put Option Problem 1 Abstract We establish a change of variable
More informationNOTES ON THE REGULAR E-OPTIMAL SPRING BALANCE WEIGHING DESIGNS WITH CORRE- LATED ERRORS
REVSTAT Statistical Journal Volume 3, Number 2, June 205, 9 29 NOTES ON THE REGULAR E-OPTIMAL SPRING BALANCE WEIGHING DESIGNS WITH CORRE- LATED ERRORS Authors: Bronis law Ceranka Department of Mathematical
More informationRisk-Minimality and Orthogonality of Martingales
Risk-Minimality and Orthogonality of Martingales Martin Schweizer Universität Bonn Institut für Angewandte Mathematik Wegelerstraße 6 D 53 Bonn 1 (Stochastics and Stochastics Reports 3 (199, 123 131 2
More informationOnline Companion to Pricing Services Subject to Congestion: Charge Per-Use Fees or Sell Subscriptions?
Online Companion to Pricing Serices Subject to Congestion: Charge Per-Use Fees or Sell Subscriptions? Gérard P. Cachon Pnina Feldman Operations and Information Management, The Wharton School, Uniersity
More informationStochastic differential equations in neuroscience
Stochastic differential equations in neuroscience Nils Berglund MAPMO, Orléans (CNRS, UMR 6628) http://www.univ-orleans.fr/mapmo/membres/berglund/ Barbara Gentz, Universität Bielefeld Damien Landon, MAPMO-Orléans
More informationSolution for Problem 7.1. We argue by contradiction. If the limit were not infinite, then since τ M (ω) is nondecreasing we would have
362 Problem Hints and Solutions sup g n (ω, t) g(ω, t) sup g(ω, s) g(ω, t) µ n (ω). t T s,t: s t 1/n By the uniform continuity of t g(ω, t) on [, T], one has for each ω that µ n (ω) as n. Two applications
More informationEstimating transition times for a model of language change in an age-structured population
Estimating transition times for a model of language change in an age-structured population W. Garrett Mitchener MitchenerG@cofc.edu http://mitchenerg.people.cofc.edu Abstract: Human languages are stable
More informationMathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio ( )
Mathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio (2014-2015) Etienne Tanré - Olivier Faugeras INRIA - Team Tosca November 26th, 2014 E. Tanré (INRIA - Team Tosca) Mathematical
More informationLikelihood Functions for Stochastic Signals in White Noise* TYRONE E. DUNCAN
INFORMATION AND CONTROL 16, 303-310 (1970) Likelihood Functions for Stochastic Signals in White Noise* TYRONE E. DUNCAN Computer, Information and Control Engineering, The University of Nlichigan, Ann Arbor,
More informationOn Mean-Square and Asymptotic Stability for Numerical Approximations of Stochastic Ordinary Differential Equations
On Mean-Square and Asymptotic Stability for Numerical Approximations of Stochastic Ordinary Differential Equations Rózsa Horváth Bokor and Taketomo Mitsui Abstract This note tries to connect the stochastic
More informationThe Lebesgue Integral
The Lebesgue Integral Brent Nelson In these notes we give an introduction to the Lebesgue integral, assuming only a knowledge of metric spaces and the iemann integral. For more details see [1, Chapters
More information6. Brownian Motion. Q(A) = P [ ω : x(, ω) A )
6. Brownian Motion. stochastic process can be thought of in one of many equivalent ways. We can begin with an underlying probability space (Ω, Σ, P) and a real valued stochastic process can be defined
More informationITO OLOGY. Thomas Wieting Reed College, Random Processes 2 The Ito Integral 3 Ito Processes 4 Stocastic Differential Equations
ITO OLOGY Thomas Wieting Reed College, 2000 1 Random Processes 2 The Ito Integral 3 Ito Processes 4 Stocastic Differential Equations 1 Random Processes 1 Let (, F,P) be a probability space. By definition,
More informationThe multidimensional Ito Integral and the multidimensional Ito Formula. Eric Mu ller June 1, 2015 Seminar on Stochastic Geometry and its applications
The multidimensional Ito Integral and the multidimensional Ito Formula Eric Mu ller June 1, 215 Seminar on Stochastic Geometry and its applications page 2 Seminar on Stochastic Geometry and its applications
More informationA NEW PROOF OF THE WIENER HOPF FACTORIZATION VIA BASU S THEOREM
J. Appl. Prob. 49, 876 882 (2012 Printed in England Applied Probability Trust 2012 A NEW PROOF OF THE WIENER HOPF FACTORIZATION VIA BASU S THEOREM BRIAN FRALIX and COLIN GALLAGHER, Clemson University Abstract
More informationStability of Stochastic Differential Equations
Lyapunov stability theory for ODEs s Stability of Stochastic Differential Equations Part 1: Introduction Department of Mathematics and Statistics University of Strathclyde Glasgow, G1 1XH December 2010
More informationStochastic Differential Equations.
Chapter 3 Stochastic Differential Equations. 3.1 Existence and Uniqueness. One of the ways of constructing a Diffusion process is to solve the stochastic differential equation dx(t) = σ(t, x(t)) dβ(t)
More informationMalliavin Calculus in Finance
Malliavin Calculus in Finance Peter K. Friz 1 Greeks and the logarithmic derivative trick Model an underlying assent by a Markov process with values in R m with dynamics described by the SDE dx t = b(x
More informationPartial Differential Equations with Applications to Finance Seminar 1: Proving and applying Dynkin s formula
Partial Differential Equations with Applications to Finance Seminar 1: Proving and applying Dynkin s formula Group 4: Bertan Yilmaz, Richard Oti-Aboagye and Di Liu May, 15 Chapter 1 Proving Dynkin s formula
More informationFinal Exam (Solution) Economics 501b Microeconomic Theory
Dirk Bergemann and Johannes Hoerner Department of Economics Yale Uniersity Final Exam (Solution) Economics 5b Microeconomic Theory May This is a closed-book exam. The exam lasts for 8 minutes. Please write
More informationLie Symmetry of Ito Stochastic Differential Equation Driven by Poisson Process
American Review of Mathematics Statistics June 016, Vol. 4, No. 1, pp. 17-30 ISSN: 374-348 (Print), 374-356 (Online) Copyright The Author(s).All Rights Reserved. Published by American Research Institute
More informationUNDERSTAND MOTION IN ONE AND TWO DIMENSIONS
SUBAREA I. COMPETENCY 1.0 UNDERSTAND MOTION IN ONE AND TWO DIMENSIONS MECHANICS Skill 1.1 Calculating displacement, aerage elocity, instantaneous elocity, and acceleration in a gien frame of reference
More informationAn Elastic Contact Problem with Normal Compliance and Memory Term
Machine Dynamics Research 2012, Vol. 36, No 1, 15 25 Abstract An Elastic Contact Problem with Normal Compliance and Memory Term Mikäel Barboteu, Ahmad Ramadan, Mircea Sofonea Uniersité de Perpignan, France
More informationNormal approximation of Poisson functionals in Kolmogorov distance
Normal approximation of Poisson functionals in Kolmogorov distance Matthias Schulte Abstract Peccati, Solè, Taqqu, and Utzet recently combined Stein s method and Malliavin calculus to obtain a bound for
More informationSolutions to the Exercises in Stochastic Analysis
Solutions to the Exercises in Stochastic Analysis Lecturer: Xue-Mei Li 1 Problem Sheet 1 In these solution I avoid using conditional expectations. But do try to give alternative proofs once we learnt conditional
More informationNetwork Flow Problems Luis Goddyn, Math 408
Network Flow Problems Luis Goddyn, Math 48 Let D = (V, A) be a directed graph, and let s, t V (D). For S V we write δ + (S) = {u A : u S, S} and δ (S) = {u A : u S, S} for the in-arcs and out-arcs of S
More informationLecture 22 Girsanov s Theorem
Lecture 22: Girsanov s Theorem of 8 Course: Theory of Probability II Term: Spring 25 Instructor: Gordan Zitkovic Lecture 22 Girsanov s Theorem An example Consider a finite Gaussian random walk X n = n
More informationHJB equations. Seminar in Stochastic Modelling in Economics and Finance January 10, 2011
Department of Probability and Mathematical Statistics Faculty of Mathematics and Physics, Charles University in Prague petrasek@karlin.mff.cuni.cz Seminar in Stochastic Modelling in Economics and Finance
More informationRecent results in game theoretic mathematical finance
Recent results in game theoretic mathematical finance Nicolas Perkowski Humboldt Universität zu Berlin May 31st, 2017 Thera Stochastics In Honor of Ioannis Karatzas s 65th Birthday Based on joint work
More informationA Representation of Excessive Functions as Expected Suprema
A Representation of Excessive Functions as Expected Suprema Hans Föllmer & Thomas Knispel Humboldt-Universität zu Berlin Institut für Mathematik Unter den Linden 6 10099 Berlin, Germany E-mail: foellmer@math.hu-berlin.de,
More informationSome Tools From Stochastic Analysis
W H I T E Some Tools From Stochastic Analysis J. Potthoff Lehrstuhl für Mathematik V Universität Mannheim email: potthoff@math.uni-mannheim.de url: http://ls5.math.uni-mannheim.de To close the file, click
More informationConvergence of Feller Processes
Chapter 15 Convergence of Feller Processes This chapter looks at the convergence of sequences of Feller processes to a iting process. Section 15.1 lays some ground work concerning weak convergence of processes
More informationMarch 16, Abstract. We study the problem of portfolio optimization under the \drawdown constraint" that the
ON PORTFOLIO OPTIMIZATION UNDER \DRAWDOWN" CONSTRAINTS JAKSA CVITANIC IOANNIS KARATZAS y March 6, 994 Abstract We study the problem of portfolio optimization under the \drawdown constraint" that the wealth
More information(2m)-TH MEAN BEHAVIOR OF SOLUTIONS OF STOCHASTIC DIFFERENTIAL EQUATIONS UNDER PARAMETRIC PERTURBATIONS
(2m)-TH MEAN BEHAVIOR OF SOLUTIONS OF STOCHASTIC DIFFERENTIAL EQUATIONS UNDER PARAMETRIC PERTURBATIONS Svetlana Janković and Miljana Jovanović Faculty of Science, Department of Mathematics, University
More information