arxiv: v5 [math.pr] 31 Mar 2015

Transcription

1 STOCHASTIC CONTROL REPRESENTATIONS FOR PENALIZED BACKWARD STOCHASTIC DIFFERENTIAL EQUATIONS GECHUN LIANG arxv:132.48v5 [mah.pr 31 Mar 215 Absrac. Ths paper shows ha penalzed backward sochasc dfferenal equaon (BSDE), whch s ofen used o approxmae and solve he correspondng refleced BSDE, adms boh opmal soppng represenaon and opmal conrol represenaon. The new feaure of he opmal soppng represenaon s ha he player s allowed o sop a exogenous Posson arrval mes. The convergence rae of he penalzed BSDE hen follows from he opmal soppng represenaon. The paper hen apples o wo classes of equaons, namely muldmensonal refleced BSDE and refleced BSDE wh a consran on he hedgng par, and gves sochasc conrol represenaons for her correspondng penalzed equaons. Key words. Refleced BSDE, Penalzed BSDE, Opmal soppng, Opmal conrol, Opmal swchng, Regme swchng AMS subjec classfcaons. 6H1, 6G4, 93E2. 1. Inroducon. El Karou e al [8 nroduced penalzed backward sochasc dfferenal equaon (penalzed BSDE for shor) o solve refleced backward sochasc dfferenal equaon (refleced BSDE for shor), and hey showed ha he soluon of a refleced BSDE corresponds o he value of a nonlnear opmal soppng me problem. In hs paper, our man resul s o show ha he soluon of he assocaed penalzed BSDE also corresponds o he value of some nonlnear opmal soppng me problem, and he parameer λ appearng n he penalzed equaon s nohng bu he nensy of some exogenous Posson process. Le (W ) be a d-dmensonal sandard Brownan moon defned on a flered probably space (Ω,F,F = {F,P) sasfyng he usual condons,.e. he flraon F s rgh connuous and complee. In El Karou e al [8, he auhors nroduced he followng refleced BSDE (1.1) Y = ξ + f s (Y s,z s )ds+ dk s Z s dw s under he consrans (Domnang Condon) : Y S for [,T, (Skorohod Condon) : (Y S )dk = for K connuous and ncreasng, where he ermnal daa ξ, he drver f s (y,z), and he obsacle (S ) T are he gven daa for he equaon. A soluon o he refleced BSDE (1.1) s a rple of F- adaped processes (Y,Z,K), where Z s a knd of hedgng process, and K s a knd of local me process. The equaon (1.1) corresponds o a backward Skorohod problem, whch n urn gves he local me process K a Skorohod represenaon. See Qan and Xu [27 n hs drecon. The work s parally suppored by a sar-up research fund from Kng s College London, and he Oxford-Man Insue, Unversy of Oxford. Deparmen of Mahemacs, Kng s College London, London, WC2R 2LS, U.K.. Emal adress: gechun.lang@kcl.ac.uk. 1

2 2 Gechun Lang On he oher hand, as shown n [8, (1.1) also has an neresng nerpreaon n he sense ha s soluon s he value of a nonlnear opmal soppng me problem: For any me [,T, he value of he followng opmal soppng me problem [ τ T (1.2) y = esssupe τ R() where he conrol se R() s defned as f s (Y s,z s )ds+s τ 1 {τ<t +ξ1 {τ T F R() = {F-soppng me τ for τ T, s gven by he soluon o he refleced BSDE (1.1): y = Y a.s.. The opmal soppng me s gven by τ = nf{s : Y s = S s T. The nonlnear opmal soppng problem (1.2) s closely relaed o prcng and hedgng Amercan opons as shown n El Karou e al [9. One way o solve he refleced BSDE (1.1) s o erae he soluon of he correspondng backward Skorohod problem by Pcard eraon. The oher way, whch seems more commonly used n he leraure, s o approxmae he local me process K by K λ = λmax{,s s Y λ s ds, where (Y λ,z λ ) s he soluon of he followng penalzed BSDE (1.3) Y λ = ξ + f s (Ys λ,zs)ds+ λ λmax{,s s Ys λ ds ZsdW λ s. Under Assumpon 1.1 nroduced below, El Karou e al [8 proved ha Y λ s ncreasng n λ, and [ (1.4) lm λ E sup Y λ Y 2 + [,T Z λ Z 2 d+ sup K λ K 2 =. [,T Our am s o gve sochasc conrol represenaons for he penalzed BSDE(1.3). Our man resul s o prove ha he penalzed BSDE (1.3) also adms an opmal soppng represenaon, whch wll n urn converge o he orgnal opmal soppng me problem (1.2) wh convergence rae 1 λ (see (1.6) and (3.1) below). We mpose he followng sandard assumpon on he daa se (ξ,f,s) as n El Karou [8, so ha boh (1.1) and (1.3) adm unque soluons. Assumpon 1.1. The ermnal daa ξ s L 2 -square negrable: E[ ξ 2 < ; The drver f : Ω [,T R R d R s unformly Lpschz connuous: f (y,z) f (ȳ, z) C( y ȳ + z z ) a.s. for some C >, [ wh f (,) beng F-adaped and H 2 T -square negrable: E f (,) 2 d < ; The obsacle process S s a connuous F-adaped process, and unformly square negrable: E [sup [,T S 2 <.,

3 Sochasc Conrol Represenaons for Penalzed BSDEs 3 In fac, he abovecondons could be relaxed. See, for example, Pengand Xu [25 and Lepeler and Xu [19 exendng o RCLL obsacles, and Kobylansk e al [15 and Bayrakar and Song [1 among ohers exendng o he drver f s (y,z) wh quadrac growh n z. However, we only sck wh he above sandard assumpon n hs paper. Under he above sandard assumpon, we have he followng represenaon whch s he man resul of hs paper. Le {T n n be he arrvalmes ofan ndependen Possonprocess wh nensy λ and mnmal augmened flraon {H. Defne G = F H and G = {G. Snce T = and T =, here exss an neger-valued random varable M < such ha T M T < T M+1,.e. M(ω) = n n1 {T n(ω) T<T n+1(ω). Theorem 1.2. Suppose ha Assumpon 1.1 holds. Denoe (Y λ,z λ ) as he unque soluon o he penalzed BSDE (1.3). For any neger 1, defne he conrol se R T (λ) as R T (λ) = {G-soppng me τ for τ(ω) = T N (ω) where N M +1. Then condonal on {T 1 < T, he value of he followng opmal soppng me problem [ τ T (1.5) y λ = esssup E f s (Ys λ,zλ s )ds+s τ1 {τ<t +ξ1 {τ T G τ R T (λ) s gven by he soluon o he penalzed BSDE (1.3): y λ = Y λ a.s.. The opmal soppng me s gven by τt = nf{t N T : YT λ N S TN T M+1. Noe ha on {T 1 < < T, here exss an F -measurable random varable ỹ λ such ha ỹ λ = y λ, so y λ can also be regarded as F -measurable n hs suaon. On he oher hand, he subscrp T n R T (λ) represens he smalles soppng me ha s allowed o choose, and λ represens he nensy of he underlyng Posson process. There are wo new feaures of he opmal soppng me problem (1.5): Frs, here s a conrol consran n he sense ha only soppng a Posson arrval mes s allowed; Secondly, he player s no allowed o sop a he nal sarng me. By he convergence (1.4) and Theorem 1.2, he values of he wo opmal soppng me problems (1.2) and (1.5) are relaed by [ (1.6) lm λ E sup y λ y 2 =. [,T Moreover, by usng he opmal soppng represenaon(1.5), we wll furher esablsh he convergence rae of (1.6) n Secon 3. The above opmal soppng wh Posson random nervenon mes was frsly nroduced by Dupus and Wang [7 (generalzed by Lempa [17 recenly), where hey used o model perpeual Amercan opons n a Markovan seng. Snce he sae space s one dmensonal and he me horzon s nfne, hey dd no even need o nroduce any penalzed equaon. Insead, hey worked ou wo ordnary dfferenal equaons (ODE for shor) defned n connuy regon and soppng regon respecvely. Recenly, Lang e al [21 esablshed a connecon beween such knd of opmal soppng wh Posson random nervenon mes and dynamc bank run problems. In a Markovan seng, Da e al [6 nuvely showed ha he penaly mehod for her opmal soppng me problem s closely relaed o some nensy framework. However, hey dd no nroduce any sochasc conrol nerpreaon for

4 4 Gechun Lang her penaly mehod. The paper s organzed as follows: Theorem 1.2 s proved n Secon 2. Then we provde four applcaons of he opmal soppng represenaon (1.5) n he followng secons. In Secon 3 we gve he convergence rae of he penalzed BSDE (1.3) n a Markovan seng. We also gve an opmal conrol represenaon for (1.3) n he sense of randomzed soppng n Secon 4. Then n Secon 5, we apply o muldmensonal refleced (oblque) BSDE, and gve wo opmal swchng represenaons for he assocaed muldmensonal penalzed BSDEs, one of whch s closely relaed o BSDE wh regme swchng. In Secon 6, we apply o refleced BSDE wh a convex consran on Z (consraned refleced BSDE for shor), and gve an opmal conrol/opmal soppng represenaon for he assocaed penalzed BSDE. Fnally, Secon 7 concludes. 2. Proof of Theorem 1.2. The opmal soppng me problem (1.5) has a consran on s conrol se,.e. he opmal soppng me mus be chosen from he arrval mes {T n n of he underlyng Posson process. Gven he arrval me T n, by defnng pre-t n σ-feld G Tn = A G s : A {T n s G s for s s and denong G = {G Tn n, s obvous ha he problem (1.5) s equvalen o he followng dscree opmal soppng me problem (where he conrol consran does no appear): Condonal on {T 1 < T, [ N T (2.1) y λ = esssup E N N (λ) f s (Y λ s,z λ s)ds+s TN 1 {TN<T +ξ1 {TN T G, where N (λ) = { G-soppng me N for N M +1. Once agan, he subscrp n N (λ) represens he smalles soppng me ha s allowed o choose, and λ represens he nensy of he underlyng flraon G. Noe ha (2.1) s a dscree opmal soppng problem, as he player s allowed o sop a a sequence of negers, + 1,...,M + 1. The opmal soppng me s hen some neger-valuedrandomvarablen such ha N = nf{n : Y λ T N S TN (M+1). In he followng, we wll work on he opmal soppng me problem wh he form (2.1) Represenaon for Lnear Case. In hs secon, we consder he case where he drver f s (y,z) s ndependen of (y,z), and smply wre as f s n such a suaon. Noe ha he correspondng refleced BSDE (1.1) becomes lnear, and so s he opmal soppng represenaon (1.2). Lemma 2.1. Suppose ha Assumpon 1.1 holds, and ha f s (y,z) = f s. Then condonal on {T 1 < T, he soluon of he penalzed BSDE (1.3) s he unque soluon of he followng recursve equaon [ T (2.2) Y λ = E f s ds+max { S T,Y λ T 1{T T +ξ1 {T>T G.

5 Sochasc Conrol Represenaons for Penalzed BSDEs 5 Proof. We nroduce he dual equaon for he penalzed BSDE (1.3), α = 1 Applyng Iô s formula o α Y λ, we oban λα s ds, for [,T. so ha (2.3) α Y λ = α T Y λ T + Y λ = α T ξ + α [ = E e λ(t ) ξ + α s ( fs +λmax{s s,y λ s ) ds α s ( fs +λmax { S s,y λ ) T s ds α Tn α s Z λ s dw s, α s α Z λ s dw s e λ(s Tn)( f s +λmax { S s,ys λ ) ds F. Nex, condonal on {T 1 < < T, we use he condonal densy λe λ(x ) dx of T o calculae (2.3): [ [ T T T E f s ds G = E f s ds F [ = E e λ(t ) f s ds+ λe λ(x ) ( [ T = E e λ(s ) f s ds F, x f u du)dx F where we used negraon by pars n he second equaly. Smlarly, we have ha E [ max { S T,YT λ 1{T T +ξ1 {T>T G [ = E λe λ(s ) max { S s,ys λ ds+e λ(t ) ξ F. Hence, we oban (2.2) on {T 1 < < T by pluggng he above wo expressons no (2.3). I s smlar o oban (2.2) on T 1 : [ T YT λ 1 = E f s ds+max { S T,YT λ 1{T T +ξ1 {T>T G T 1. T 1 Snce he recursve equaon (2.2) obvously adms a unque soluon, Y λ s hen he unque soluon o (2.2). As a drec consequence of Lemma 2.1, f we defne Ŷ λ = max { S,Y λ, hen Ŷ λ sasfes he followng recursve equaon: For 1 M +1, { [ T T (2.4) ŶT λ 1 = max S T 1,E f s ds+ŷλ T 1 {T T +ξ1 {T>T G T 1, T 1

6 6 Gechun Lang whch adms a unque soluon, as we can calculae s soluon backwards n a recursve way. In he followng, we show ha Ŷ T λ 1 s he value of anoher opmal soppng problem. Inroduce an auxlary opmal soppng problem assocaed wh (2.1): [ TN T (2.5) ŷt λ 1 = esssup E N N 1(λ) T 1 f s ds+s TN 1 {TN<T +ξ1 {TN T G T 1, where N 1 (λ) = { G-soppng me N for 1 N M +1. The dfference beween (2.5) and (2.1) sarng from T 1 s ha he former s allowed o sop a he nal sarng me T 1, whle he laer no. Lemma 2.2. Suppose ha Assumpon 1.1 holds, and ha f s (y,z) = f s. For any neger 1 M +1, he value ŷt λ 1 of he auxlary opmal soppng me problem (2.5) sasfes he recursve equaon (2.4): { [ T T ŷt λ 1 = max S T 1,E f s ds+ŷt λ 1 {T<T +ξ1 {T T G T 1. T 1 The opmal soppng me s gven by N 1 = nf{n 1 : ŷλ T N S TN (M +1). Hence, Ŷ λ T 1 = ŷ λ T 1 a.s.. Proof. Defne he followng processes ȳ λ = ŷ λ + S = S + ξ = ξ + f s ds; f s ds; f s ds. Snce T M T < T M+1, he auxlary opmal soppng problem (2.5) s equvalen o ȳt λ 1 = esssup E [ STN 1 {TN<T + ξ1 {TN T G T 1 N N 1(λ) = esssup E [ STN 1 { 1 N M + ξ1 {N=M+1 G T 1. N N 1(λ) We clam ha ȳt λ M = max { STM,E [ ξ GTM, (2.6) ȳt λ n = max{ STn,E [ȳ λ G Tn+1 Tn, for 1 n M 1. If (2.6) holds, hen ȳ λ T 1 = max { ST 1,E [ ȳ λ T 1 { M + ξ1 {>M G T 1 = max { ST 1,E [ ȳ λ T 1 {T<T + ξ1 {T T G T 1,

7 Sochasc Conrol Represenaons for Penalzed BSDEs 7 whch s he recursve equaon (2.4) f we express he above equaon n erms of ŷ λ, S and ξ. Therefore, n order o complee he proof, we only need o show (2.6). Indeed, for n = M, ȳt λ M = esssup E [ STN 1 {N=M + ξ1 {N=M+1 G TM N N M(λ) In general, for 1 n M 1, = max { STM,E [ ξ GTM. ȳt λ n = esssup E [ STN 1 {n N M + ξ1 {N=M+1 G Tn N N n(λ) = esssup E [ E [ STN 1 {n N M + ξ1 {N=M+1 G Tn+1 GTn N N n(λ) = esssup E [ STN 1 {N=n +E [ STN 1 {n+1 N M + ξ1 {N=M+1 G Tn+1 GTn N N n(λ) = max{ STn,E [ȳ λ Tn+1 G Tn. Fnally, we prove ha N 1 s ndeed he opmal soppng me for he auxlary opmalsoppngproblem(2.5). Forhs, suffcesoshowhaŷt λ form 1 m N 1 s a G-marngale: [ m E ŷt λ G (m+1) N 1 Tm = E 1 { N 1 =j +1 { N ŷ 1 m+1 T λ (m+1) N 1 j= 1 m = E 1 { N =jŷλ 1 T j +1 { N >mŷλ 1 T m+1 G Tm = = m j= 1 m j= 1 j= 1 1 { N 1 =jŷλ T j +1 { N 1 >m E [ ŷ λ T m+1 G Tm 1 { N =jŷλ 1 T j +1 { N >mŷλ 1 T m = ŷt λ, m N 1 G Tm where we used he defnon of N 1 s he second las equaly, and he proof s complee. We are now n a poson o prove he lnear suaon of Theorem 1.2. From Lemma 2.1 and he defnon of Ŷ λ, condonal on {T 1 < T, [ T T Y λ = E f s ds+ŷλ T 1 {T<T +ξ1 {T T G. Thanks o Lemma 2.2, Ŷ λ T = ŷ λ T, whch s he value of he auxlary opmal soppng

8 8 Gechun Lang problem (2.5) sarng from T. Hence, for any G-soppng me N N (λ), [ T T Y λ = E f s ds+ŷt λ 1 {T<T +ξ1 {T T G [ [ T T TN T E f s ds+e f s ds+s TN 1 {TN<T +ξ1 {TN T G T T + ξ1 {T T G [ T ( N T ) = E f s ds+ f s ds 1 {T<T +S TN 1 {TN<T,T <T T + ξ ( ) 1 {TN T, T <T +1 {T T G [ TN T = E f s ds+s TN 1 {TN<T +ξ1 {TN T G, 1 {T<T where we used he fac ha {T T {T N T n he las wo equales. By akng he supremum over N N (λ), we oban ha Y λ y λ. We now choose N = N, where N s he opmal soppng me for ŷt λ gven n Lemma 2.2, o ge he reverse nequaly. Indeed, [ T T Y λ = E f s ds+ŷt λ 1 {T<T +ξ1 {T T G [ [ T T T N T = E f s ds +E f s ds+s T N 1 T {T N <T + ξ1 {T N + ξ1 {T T G [ ( T T ) T N T = E f s ds+ f s ds 1 {T<T +S T N T ( ) + ξ 1 {T N T, T <T +1 {T T G [ T N T = E f s ds+s T N T G y λ. 1 {T N <T +ξ1 {T N 1 {T N <T,T <T T G T 1 {T<T Hence, Y λ = y λ, and he opmal soppng me s N, whch s jus N defned a he begnnng of Secon 2, N = nf{n : ŷλ T N S TN (M +1) = nf{n : Ŷ λ T N S TN (M +1) = nf{n : Y λ T N S TN (M +1) = N Represenaon for Nonlnear Case. In hs secon, we exend he opmal soppng represenaon o he nonlnear case, and complee he proof of Theorem 1.2. Denoe (Y λ,z λ ) as he unque soluon o he penalzed BSDE (1.3). Consder

9 Sochasc Conrol Represenaons for Penalzed BSDEs 9 he opmal soppng me problem (2.1) condonal on {T 1 < T : [ TN T y λ = esssup E f s (Ys λ,zλ s )ds+s T N 1 {TN<T +ξ1 {TN T G. N N (λ) From Secon 2.1, y λ = Ỹ λ adms he followng BSDE represenaon Ỹ λ = ξ + f s (Ys λ,zs)ds+ λ λmax{,s s Ỹλ s ds Z λ dw s. On he oher hand, (Y λ,z λ ) sasfes he penalzed BSDE (1.3) Defne Y λ = ξ + f s (Ys λ,zλ s )ds+ λmax{,s s Ys λ ds Zs λ dw s. δy λ = Ỹ λ Y λ ; δzλ = Z λ Zλ. Then (δy λ,δz λ ) sasfes he followng lnear BSDE (2.7) δy λ = λβ s δys λ ds δzsdw λ s wh β s = max{,s s Ỹλ s max{,s s Ys λ δys λ 1 {δy λ s. Obvously, β s 1, so BSDE (2.7) adms a unque soluon (see for example [1 for he proof). On he oher hand, δy λ = δz λ = s one obvous soluon o BSDE (2.7). Therefore, we conclude ha Ỹ λ = Y λ a.s., whch proves Theorem 1.2. We conclude hs secon by reformulang he opmal soppng represenaon (1.5) as he followng remark, whch wll be used n Secon 3. Remark 2.3. Suppose ha Assumpon 1.1 holds. Then for any neger 1, condonal on {T 1 T < T T, he soluon o he penalzed BSDE (1.3) s he value of he opmal soppng me (1.5): Y λ = y λ a.s.. Moreover, he value y λ sasfes he recursve equaon: [ T T y λ = E f s (Ys λ,zλ s )ds+max{ S T,yT λ 1{T T +ξ1 {T>T G = E [ T f s (Y λ s,z λ s)ds+max { S T,y λ T 1{T T +ξ1 {T>T F. 3. Applcaon I: Convergence Rae of Penalzed BSDE. The penalzaon mehod only provdes he convergence of he soluon (Y λ,z λ,k λ ) of he penalzed BSDE (1.3) o he soluon (Y,Z,K) of he refleced BSDE (1.1), bu whou any convergence rae, because he proof of he convergence s based on compacness argumens. Wha s even worse s ha he penalzed BSDE (1.3) does no provde an effcen numercal algorhm, as he Lpschz consan of he drver depends on

10 1 Gechun Lang λ whch wll explode when λ. Acually, s sll an open queson on how o numercally approxmae he correspondng penalzed BSDE (1.3) wh an even fxed (bu large) nensy λ (see Page 26 n [3). Thanks o our opmal soppng represenaon, he penalzed BSDE (1.3) s nohng bu a random me dscrezaon of he opmal soppng represenaon for he correspondng refleced BSDE (1.1), where he me s dscrezed by Posson arrval mes. On he oher hand, has been known he convergence rae of he fxed me dscrezaon of he opmal soppng represenaon for (1.1), so called he Bermudan approxmaon n [2 and [23. Hence, s plausble o oban he convergence rae of he penalzed BSDE (1.3), or equvalenly, he convergence rae of he opmal soppng represenaon (1.5). Assumpon 3.1. The ermnal daa ξ, he drver f s (y,z) and he obsacle S sasfy Assumpon 1.1; Moreover, he drver f s (y,z) = f(x s,y,z), he ermnal dae ξ = g(x T ) for g( ) beng Lpschz connuous, and he obsacle process S s = l(x s ) for l( ) C 2, where X s a dffuson process wh enough regaly. We refer o [2, 3, 23 for more deal assumpons on he dffuson X. In he followng, we mprove he convergence (1.6) by gvng s convergence rae. Proposon 3.2. Suppose ha Assumpon 3.1 holds. Then for any neger M 1, he value of he opmal soppng me problem (1.5) wll converge o he value of (1.2) wh he followng rae: [ (3.1) E sup E [ y λ y 2 C [,T M T λ. for some consan C. Proof. For any M 1, Theorem 1.2 and Remark 2.3 mply ha y λ = E [ T f s (Y λ s,zλ s )ds+ŷλ T 1 {T T +g(x T )1 {T>T F condonal on [T 1 T,T T), where ŷ λ T = max { l(x T ),y λ T for 1 M. Ths s exacly he Bermudan approxmaon of he opmal soppng me problem (1.2) f we condon on H. Hence, by a smlar argumen as n Proposon 3.1 of [3 (see also Secon 4 of [2 and Secon 3 of [23), condonal on H, we oban ha (3.2) sup E [ y λ y 2 max (T T T 1 T) max (T T 1 ), [,T M T 1 M 1 M and moreover, [ E sup E [ [ [ y λ y 2 = E E sup E [ y λ y 2 H [,T M T [,T M T [ [ E E max (T T 1 ) 1 M H [ = E max (T T 1 ). 1 M

11 Sochasc Conrol Represenaons for Penalzed BSDEs 11 The concluson hen follows by observng ha (T 1 T ) s exponenally dsrbued wh parameer λ and ha [ E max (T T 1 ) = P( max (T T 1 ) > x)dx 1 M 1 M = = 1 λ 1 (1 (1 e λx ) M )dx 1 u M 1 u du = 1 λ M =1 ( ) 1. Remark 3.3. Thanks o he opmal soppng represenaon (1.5), s also possble o oban a numercal algorhm o solve he penalzed BSDE (1.3), where he parameer λ s hdden n he Posson arrval mes {T 1, and we only need o numercally solve he BSDE wh he sandard drver f(x,y,z) nsead of f(x,y,z)+ λmax{,l(x) y: Y λ = max { l(x T ),Y λ T 1{T T +g(x T )1 {T>T + T f(x s,y λ s,zλ s )ds T Z λ s dw s on {T 1 < T. Snce he numercal approxmaon s of ndependen neres, we wll leave for fuure research. 4. Applcaon II: Randomzed Soppng and Opmal Conrol Represenaon. Krylov n [16 showed ha opmal soppng for conrolled dffuson processes can always be ransformed o opmal conrol by usng randomzed soppng. See also Gyöngy and Sska [11 for s recen developmen. In hs secon, our am s o gve opmal conrol nerpreaons of boh he refleced BSDE (1.1) and he penalzed BSDE (1.3). Le us frs recall he basc dea of Krylov s randomzed soppng. For smplcy, we only consder he lnear case f s (y,z) = f s. For any fxed me [,T, consder a nonnegave conrol process (r s ) s. Le he payoff funconal f sds + S sop wh nensy r s n an nfnesmal nerval (s,s + ). Then he probably ha soppng does no occur before me s s e s rudu. The probably ha soppng does no occur before me s and does occur n he nfnesmal nerval (s,s+ ) s e s rudu r s. Therefore, he payoff funconal assocaed wh he conrol process r from [, T s gven by ( s f u du+s s )e s rudu r s ds+( f u du+ξ)e rudu, where he frs erm s he payoff f soppng does occur before me T, and he second erm corresponds o he payoff f soppng does no occur n he me nerval [,T.

12 12 Gechun Lang By applyng negraon by pars, he payoff funconal s furher smplfed o (f s +r s S s )e s rudu +e rudu ξ. We have he followng opmal conrol represenaon for he penalzed BSDE (1.3): Proposon 4.1. Suppose ha Assumpon 1.1 holds. Denoe (Y λ,z λ ) as he unque soluon o he penalzed BSDE (1.3). For any fxed me [,T, defne he conrol se A(,λ) as A(,λ) = {F-adaped process (r s ) s : r s = or λ. Then he value of he followng opmal conrol problem [ (4.1) y λ = esssup E r A(,λ) (f s (Ys λ,zλ s )+r ss s )e s rudu ds+e rudu ξ F s gven by he soluon o he penalzed BSDE (1.3): y λ = Y λ a.s. for [,T. The opmal conrol s gven by rs = λ1 {Y λ s S s for s. Proof. We only consder he lnear case f s (y,z) = f s. The proof for he nonlnear case f s (y,z) s he same as he one n Secon 2.2. Frs, smlar o Lemma 2.1, s easy o show ha he followng expeced payoff process assocaed wh any gven conrol r A(,λ): [ T y λ (r) = E (f s +r s S s )e s rudu +e rudu ξ F s he unque soluon o he followng lnear BSDE y λ (r) = ξ + { T fs +r s (S s ys ds λ (r)) zs λ (r)dw s. Noe ha he conrol r only appears n he drver. For any conrol r A(,λ), we have f s +r s (S s y λ s (r)) f s +λmax{,s s y λ s (r), and for r s = λ1 {y λ s (r) S s, we oban he equaly f s +λ1 {y λ s (r) S s(s s y λ s (r)) = f s +λmax{,s s y λ s (r). By he BSDE comparson heorem (see for example [1), y λ (r) Y λ for any r A(,λ), where Y λ s he soluon o he penalzed BSDE (1.3): Y λ { = ξ + fs +λmax{,s s Ys λ ds ZsdW λ s. and y λ(r ) = Y λ for rs = λ1 {Ys λ Ss. Snce y λ = esssup r A(,λ)y λ (r), we conclude ha y λ = Y λ a.s. for [,T, and he opmal conrol s rs for s. Remark 4.2. The opmal conrol represenaon for he refleced BSDE (1.1) s he same as (4.1) excep ha he conrol se s changed o A() = λ A(,λ). As

13 Sochasc Conrol Represenaons for Penalzed BSDEs 13 shown n Krylov [16 for he dffuson case, he value of he followng opmal conrol problem [ T (4.2) y = esssupe (f s (Ys λ,zλ s )+r ss s )e s rudu ds+e rudu ξ F r A() s gven by he soluon o he refleced BSDE (1.1): y = Y a.s. for [,T. 5. Applcaon III: Muldmensonal Refleced BSDE and Regme Swchng. Muldmensonal refleced BSDE was frsly nroduced by Hamadène and Jeanblanc [12, where hey used s soluon o characerze he value of an opmal swchng problem, n parcular n he seng of power plan managemen. The relaed equaonwassolvedby Hu and Tang[14 usnghe penalymehod, and byhamadène and Zhang [13 usng he eraed opmal soppng me mehod. See also Chassagneux e al [4 for s recen developmen. A muldmensonal refleced BSDE s a d-dmensonal sysem, where each componen 1 d represenng regme, (5.1) Y = ξ + fs(y s,z s )ds+ dks ZsdW s under he consrans (Domnang Condon) : Y MY for [,T, (Skorohod Condon) : where he mpulse erm MY s gven by (Y MY )dk = for K connuous and ncreasng, MY = max{y j j C,j represenng he payoff of swchng o regme j from regme. The ermnal daa ξ, he drver fs (y,z) and he swchng cos (C,j s ) s T are he gven daa. Dfferen from one-dmensonal refleced BSDE whose soluon mus say above an obsacle process, he soluon of he muldmensonal refleced BSDE (5.1) evolves n he random closed and convex se { y R d : y max j {yj C,j. The followng sandard assumpon on he daa se (ξ,f,c,j ) s mposed. Assumpon 5.1. The ermnal daa ξ and he drver fs(y,z) sasfy Assumpon 1.1; The swchng cos (C j ) 1,j d s a bounded F-adaped process sasfyng () C = ; () nf [,T C j C > for j; and () nf [,T C j +C jl C l C > for j l. In Hu and Tang [14, hey furher assume ha fs(y,z) = fs(y,z ) so ha (5.1) adms a soluon. Ths condon was relaxed n Hamadène and Zhang [13 and Chassagneux e al [4, where he drver s even allowed o be coupled n y,.e. havng he form fs (y,z ). However, s sll an open problem for he case ofhe fully coupled drver fs (y,z).

14 14 Gechun Lang Under Assumpon 5.1 wh he decoupled drver fs (y,z) = f s (y,z ), Hu and Tang [14 proved ha he soluon o he muldmensonal refleced BSDE (5.1) corresponds o he value of an opmal swchng problem. Indeed, nroduce he conrol se K () as K () = F-adaped process (u s) s : u s = α 1 [,τ1(s)+ α k 1 (τk,τ k+1 (s), k 1 where (τ k ) k 1 s an ncreasng sequence of F-soppng mes valued n [,T wh τ M T < τ M+1 for some neger-valued random varable M <. (α k ) k s a sequence of random varables valued n {1,,d such ha α k s F τk -measurable, and α =. Then he value of he followng opmal swchng problem (5.2) y = esssupe u K () f us s (Y s,z s )ds+ξ ut k 1 C α k 1,α k τ k 1 {<τk <T F s gven by he soluon o he muldmensonal refleced BSDE (5.1): y = Y a.s. for [,T. The opmal swchng sraegy s gven as follows: τ =, α = and for k, (5.3) τ k+1 = nf {s > τ k : Y α k s MY α k s T, where { α k+1 = argmax Y j τ j α k+1 k C α k,j τ. k+1 Hence, he opmal swchng sraegy a any me s s u s = 1 [,τ 1 (s)+ α k1 (τ k,τk+1 (s), M k=1 where M M s some neger-valued random varable such ha τ M T < τ M +1. On he oher hand, Hu and Tang [14 nroduced he followng muldmensonal penalzed BSDE o approxmae and solve he muldmensonal refleced BSDE (5.1): (5.4) Y,λ = ξ + fs(y s λ,zs)ds+ λ λmax{,mys,λ Ys,λ ds Zs,λ dw s, and hey proved ha under Assumpon 5.1 wh fs(y,z) = fs(y,z ), Y,λ s ncreasng n λ, and [ (5.5) lm λ E sup Y,λ Y 2 + [,T Z,λ Z 2 d+ sup K,λ K 2 =. [,T However, he solvably of (5.4) does no rely on he assumpon ha f s (y,z) = f s (y,z ). Our am s herefore o gve a sochasc conrol nerpreaon of he

15 Sochasc Conrol Represenaons for Penalzed BSDEs 15 muldmensonal penalzed BSDE (5.4) wh he coupled drver fs (y,z), so we are a leas one sep closer o solve he general opmal swchng problem wh he coupled drver fs (y,z) s some sense. Recall ha {T n n are he arrval mes of he underlyng Posson process wh nensy λ, G = {G s s wh G s = F s H s, and M < s some neger-valued random varable such ha T M T < T M+1. Proposon 5.2. Suppose ha Assumpon 5.1 holds. Denoe (Y,λ,Z,λ ) as he unque soluon o he muldmensonal penalzed BSDE (5.4). For any neger n 1, condonal on {T n 1 < T n, defne he conrol se K (λ,) as K (,λ) = G-adaped process (u s) s : u s = α n 1 1 [,τn(s)+ α k 1 (τk,τ k+1 (s), k n where τ k (ω) = T k (ω) for n k M +1, and α k G Tk valued n {1,,d wh α n 1 =. Then he value of he followng opmal swchng problem (5.6) y,λ = esssup E u K (,λ) f us s (Y λ s,zλ s )ds+ξut k n C α k 1,α k τ k 1 {<τk <T G s gven by he soluon of he muldmensonal penalzed BSDE (5.4): y,λ = Y,λ a.s.. The opmal swchng sraegy for (5.6) s gven as follows: τ n 1 =, α n 1 = and for k n 1, (5.7) τ k+1 = nf { T N > τ k : Y α k,λ T N MY α k,λ T N T M+1, where { α k+1 = argmax Y j,λ τ j α k+1 k C α k,j τ. k+1 Hence, he opmal swchng sraegy a any me s s u s = 1 [,τ n (s)+ α k1 (τ k,τk+1 (s), M k=n where M M s some neger-valued random varable such ha τ M T < τ M +1. Proof. For any neger n 1 and 1 d, we nroduce he followng auxlary opmal soppng me problem on {T n 1 < T n : (5.8) ỹ,λ = esssup E τ R Tn (λ) [ τ T fs (Y s λ,zλ,λ s )ds+myτ 1 {τ<t +ξ 1 {τ T G. From Theorem 1.2 (and Remark 2.3), we know ha s value s gven by ỹ,λ a.s., and he opmal soppng me s gven by { τt n = nf T N T n : Y,λ T N MY,λ T N T M+1. = Y,λ

16 16 Gechun Lang Now for any swchng sraegy u K (,λ) wh he form u s = 1 [,Tn(s)+ M α k 1 (Tk,T k+1 (s), k=n we consder he auxlary opmal soppng problem (5.8) soppng a he Posson arrval me T n, and swchng o α n, [ Tn T (5.9) ỹ,λ E fs (Y s λ,zλ αn,λ s )ds+(yt n C,αn T n )1 {Tn<T +ξ 1 {Tn T G. From Theorem 1.2, Y αn,λ T n s he value of he opmal soppng problem (5.8) sarng from T n. We consder such an opmal soppng problem soppng a he Posson arrval me T n+1, and swchng o α n+1, (5.1) Y αn,λ T n E = ỹ αn,λ T [ n Tn+1 T T n fs αn (Ys λ,zλ αn+1,λ s )ds+(yt n+1 By pluggng (5.1) no (5.9), we have [ n T ỹ,λ E C αn,αn+1 T n+1 )1 {Tn+1<T +ξ αn 1 {Tn+1 T G Tn n+1 T fs(y s λ,zs)ds+ λ fs αn (Ys λ,zs)ds C λ,αn T n 1 {Tn<T T n T C αn,αn+1 T n+1 1 {Tn+1<T +ξ 1 {Tn T +ξ αn 1 {Tn<T T n+1 +Y αn+1,λ T n+1 1 {Tn+1<T G. We repea he above procedure M mes, and oban [ n T ỹ,λ E fs (Y s λ,zλ s )ds+ξ 1 {Tn T + ( M k+1 T k=n T k T f α k s (Y λ s,zλ s )ds Cα k 1,α k T k 1 {Tk <T +ξ α k 1 {Tk <T T k+1 Snce T M T < T M+1, he above nequaly s furher smplfed o ỹ,λ E f us s (Y λ s,z λ s)ds+ξ ut k n C α k 1,α k T k 1 {<Tk <T G By akng he supremum over u K (,λ) and usng Theorem 1.2 once agan, we prove ha on {T n 1 < T n, Y,λ = ỹ,λ y,λ. To prove he reverse nequaly, we ake he swchng sraegy u = u. From Theorem 1.2 (and Remark 2.3), τn s he opmal soppng me for (5.8). By he defnon of α n, MY,λ τ n = max j,λ {Yτ j n C,j τ n = Y α n,λ τ n C,α n τ n.. ) G..

17 Therefore, (5.11) ỹ,λ = E Sochasc Conrol Represenaons for Penalzed BSDEs 17 [ τ n T f s (Y λ s,zλ s )ds+ ( Y α n,λ τ n ) C,α n τ 1 n {τ n <T +ξ 1 {τ n T G. Smlarly, τn+1 s he opmal soppng me for (5.8) sarng from τ n, and Y α n,λ τn ỹ α n,λ τ. By he defnon of α n n+1, Hence, (5.12) Y α n,λ τn = ỹ α n,λ τn [ τ n+1 T = E τ n MY α n,λ τ n+1 { = max Y j,λ j α τn+1 n ( f α n s (Ys λ,zs)ds+ λ Y α n+1,λ τn+1 Pluggng (5.12) no (5.11) gves us ỹ,λ = E C α n,α n+1 τ n+1 [ τ n T τ fs(y s λ,zs)ds+ λ n+1 T τn T C α n,j τ = Y α n+1 n+1,λ τn+1 C α n,α n+1 τ. n+1 ) C α n,α n+1 τ 1 n+1 {τ n+1 <T +ξ α n 1{τ n+1 T G τ n. f α n s (Y λ s,z λ s)ds C,α n τ n 1 {τ n <T 1 {τ n+1 <T +ξ 1 {τ n T +ξ αn 1 {τ n <T τn+1 +Y α n+1,λ τ 1 n+1 {τ n+1 <T G. We repea he above procedure M mes, and oban [ τ ỹ,λ n T = E fs (Y s λ,zλ s )ds+ξ 1 {τ n T + M k=n ( τ k+1 T = E τ k T f α k s (Y λ f u s s (Y λ Theorem 1.2 hen mples ha ) s,zs)ds C λ α k 1,α k 1 {τ k <T +ξ α k 1{τ k <T τk+1 G τ k s,zλ s )ds+ξu T Y,λ k n = ỹ,λ C α k 1,α k τ k y,λ, 1 {<τ k <T G y,λ. and u s he opmal swchng sraegy. Remark 5.3. The opmal swchng represenaon (5.6) of he muldmensonal penalzed BSDE (5.4) has a naural economc applcaon o he menu cos model of Sokey [28, whch allows he occasonal arrval of opporunes o adjus whou payng he fxed cos, and hose opporunes are modeled as Posson arrvals. See also [22 for an exenson o an nfne horzon BSDE seng wh he analyss of he correspondng free boundares n he sense of Ly Vah and Pham [18. =

18 18 Gechun Lang The oher commonly used penalzaon scheme for he muldmensonal refleced BSDE (5.1) s he followng equaon: (5.13) Y,λ = ξ + fs(y s λ,zs)ds+ λ d j=1 λmax{,ys j,λ Cs,j Ys,λ ds Zs,λ dw s, and we sll have he convergence (5.5) as shown n [14. In he followng, we show ha (5.13) s closely relaed o he BSDE wh regme swchng on a Markov chan. Regme swchng on Markov chans has been found useful n many applcaons as shown n [3 and [31. Is applcaon n BSDE can be found n a recen work [29 among ohers. Defne a Markov chan (X ) wh sae space {1,2,...,d, and s Q-marx: q j = λ f j, and q j = (d 1)λ f = j. The jump mes are denoed as {T n n 1. A each jump me T n, he player has he rgh o choose f swchng from he curren sae or no, and f she swches, a cos C,j T n ncurs f he Markov chan jumps from he sae o j. For any neger n 1, condonal on {T n 1 < T n, defne he followng conrol se: K (,Q) = G-adaped process (u s) s : u s = X τn 1 1 [,τn(s)+ X τk 1 (τk,τ k+1 (s), k n where (τ k ) k n chosen from T N for n N M +1, and X τn 1 =. Proposon 5.4. Suppose ha Assumpon 5.1 holds. Denoe (Y,λ,Z,λ ) as he unque soluon o he muldmensonal penalzed BSDE (5.13). Then he value of he followng opmal swchng problem (5.14) y,λ = esssup E u K (,Q) f us s (Y λ s,zλ s )ds+ξut k n C Xτ k 1,Xτ k τ k 1 {<τk <T G s gven by he soluon of he muldmensonal penalzed BSDE (5.13): y,λ = Y,λ a.s.. The opmal swchng sraegy for (5.6) s gven as follows: τn 1 =, and for k n 1, { (5.15) τk+1 = nf T N > τk : Y X τ k,λ T N Y XT N,λ T N C Xτ,X TN k T N T M+1. Hence, he opmal swchng sraegy a any me s s u s = 1 [,τn (s)+ X τ k 1 (τ k,τk+1 (s), M k=n where M M s some neger-valued random varable such ha τ M T < τ M +1. Proof. We frs rewre (5.13) n erms of q j as follows, Y,λ = ξ + fs(y s λ,zs)ds+ λ d j=1 q j max{,ys j,λ Cs,j Ys,λ ds Zs,λ dw s.

19 Sochasc Conrol Represenaons for Penalzed BSDEs 19 Then smlar o Lemma 2.1, we have ha (5.16) Y,λ =E [ n T +max f s (Y λ s,zλ s )ds { Y XTn,λ T n C,XTn T n,y,λ T n 1 {Tn T +ξ 1 {Tn>T G. condonal on {T n 1 < T n. From Theorem 1.2, Y,λ opmal soppng me problem: (5.17) ess sup E τ R Tn (Q) where [ τ T f s (Y λ s,zλ s )ds+( Y Xτ,λ τ s he value of he followng ) Cτ,Xτ 1{τ<T +ξ 1 {τ T G, R Tn (Q) = {G-soppng me τ for τ(ω) = T N (ω) where n N M +1. wh he opmal soppng me gven by { τt n = nf T N T n : Y,λ T N Y XT N,λ T N C,XT N T N T M+1. The res of he proof s hen smlar o ha of Proposon 5.2, so we om. Remark 5.5. If we compare beween he opmal swchng represenaons (5.6) and (5.14), he former only allows he player o choose he swchng regmes on a sequence of Posson arrval mes, whle he laer only allows he player o choose he swchng mes wh he regmes followng a Markov chan. 6. Applcaon VI: Consraned Refleced BSDE. In Cvanc e al [5, he auhors nroduced a new class of BSDEs wh a convex consran on he hedgng process Z, and solved he equaon usng he sochasc conrol mehod 1. Ther equaon was furher generalzed by Peng [24, and n parcular, by Peng and Xu [26 o refleced BSDE wh a general consran on Z (consraned refleced BSDE for shor), where he monoonc lm heorem was nroduced n order o show he assocaed penalzed equaon converges o he consraned refleced BSDE. A consran refleced BSDE has he form (6.1) Y = ξ + f s (Y s,z s )ds+ dks Y + dks Z Z s dw s under he consrans (Domnang Condon) : Y S for [,T, (Skorohod Condon) : (Hedgng Consran) : Z Γ for [,T. (Y S )dk Y = for K Y connuous and ncreasng, The ermnal daa ξ, he drver f s (y,z), he obsacle (S ) T, and he consran se Γ R d are he gven daa. A soluon o he consraned refleced BSDE (6.1) s a quadruple of F-adaped processes (Y,Z,K Y,K Z ), where K Y s used o pushed 1 I would lke o hank Ioanns Karazas for he suggeson of hs secon.

20 2 Gechun Lang up he soluon Y n order o sasfy he domnang condon, and K Z (RCLL and ncreasng) s used o enforce he soluon Z sayng n he consran se Γ. The followng sandard assumpon on he daa se (ξ,f,s,γ) s mposed as n Peng and Xu [26, so (6.1) adms a smalles soluon (Y,Z,K Y,K Z ), n he sense ha f (Y,Z,K Y,K Z ) s anoher soluon o (6.1), hen Y Y a.s. for [,T. Assumpon 6.1. The ermnal daa ξ, he drver f s (y,z), and he obsacle S sasfy Assumpon 1.1; The se Γ s a closed and convex se n R d ncludng he orgn; There exss a leas one soluon (Y,Z,K Y,K Z ) o (6.1). When he drverf s (y,z) s ndependen of(y,z), denoed asf s n such asuaon, Cvanc e al [5 gave a sochasc conrol represenaon for he soluon of he consraned refleced BSDE (6.1). Indeed, defne he conrol se D() as D() = m 1{ F-adaped process (νs ) s : H 2 -square negrable, valued n Γ, and ν s m for s [,T. The valued se Γ s defned as follows: Gven he closed and convex se Γ, defne s suppor funcon δ Γ ( ) as he convex dual of he characersc funcon δ Γ( ) of Γ, δγ (z) = sup { z z δ Γ ( z), z R d whch s bounded on compac subses of he barrer cone Γ, Γ = { z R d : δ Γ(z) <. Gven ν D(), defne an equvalen probably measure P ν as dp ν { dp = exp ν s dw s 1 2 ν s 2 ds. Then he value of he followng sochasc conrol problem [ τ T (6.2) y = esssup E Pν [f s δγ (ν s)ds+s τ 1 {τ<t +ξ1 {τ T F τ R(),ν D() s gven by he soluon o he consraned refleced BSDE (6.1) wh he drver f s : y = Y a.s. for [,T. On he oher hand, (6.1) can be solved by approxmang wo local me processes K Y and K Z by and K Z,m = K Y,λ = m ds Γ (Z (λ,m) s )ds = λmax{,s s Y s (λ,m) ds m nf z Z(λ,m) s ds z Γ

21 Sochasc Conrol Represenaons for Penalzed BSDEs 21 respecvely, where (Y (λ,m),z (λ,m) ) s he soluon of he followng consraned penalzed BSDE (6.3) Y (λ,m) = ξ + f s (Y (λ,m) s Z (λ,m) s dw s.,zs λ,m )+λmax{,s s Y (λ,m) +m ds Γ (Z (λ,m) )ds Peng and Xu [26 proved ha he soluon (Y (λ,m),z (λ,m),k Y,λ,K Z,m ) converges o he smalles soluon (Y,Z,K Y,K Z ) of he consraned refleced BSDE (6.1) n he sense of monoonc lm heorem as λ,m. Our am n hs secon s o gve a sochasc conrol represenaon of he consraned penalzed BSDE (6.3), whch has a smlar srucure o he sochasc conrol represenaon (6.2). Proposon 6.2. Suppose ha Assumpon 6.1 holds. Denoe (Y (λ,m),z (λ,m) ) as he unque soluon o he consraned penalzed BSDE (6.3). For any [,T, defne he conrol se D(,m) as D(,m) = { F-adaped process (ν s ) s : H 2 -square negrable, valued n Γ and ν s m for s [,T, and for any neger 1, he conrol se R T (λ) as n Theorem 1.2. Then condonal on {T < T, he value of he followng sochasc conrol problem s s (6.4) y (λ,m) = ess sup τ R T (λ),ν D(,m) E Pν [ τ T [f s (Y (λ,m) s,z s (λ,m) +S τ 1 {τ<t +ξ1 {τ T G ) δ Γ (ν s)ds s gven by he soluon o he consraned penalzed BSDE (6.3): y (λ,m) a.s.. The opmal soppng me τt R T (λ) s gven by = Y (λ,m) (6.5) τ T = nf{t N T : Y (λ,m) T N S TN T M+1, and he opmal conrol v D(,m) s he soluon of he followng algebrac equaon (6.6) m ds Γ (Z s (λ,m) ) = Z s (λ,m) vs δγ(v s), for a.e. (s,ω) [,T Ω. Proof. We onlyconsderhelnearcasef s (y,z) = f s, asheproofforhenonlnear case f s (y,z) s he same as he one n Secon 2.2. Frs, we remark ha f v D(,m), n parcular v s m, hen he suppor funcon δ Γ (v s) has he convex dual represenaon δ Γ(v s ) = sup z R d {z v s m ds Γ (z), for a.e. (s,ω) [,T Ω. See Lemma 3.1 n [5 for he proof. Inuvely, means ha we use m ds Γ ( ) o approxmae he characersc funcon δ Γ ( ). Moreover, as shown n [5, snce m ds Γ ( ) s convex, m ds Γ (Z s (λ,m) ) = sup {Z s (λ,m) ν s δγ (ν s), for a.e. (s,ω) [,T Ω, ν D(,m)

22 22 Gechun Lang and here exss v D(,m) solvng he algebrac equaon (6.6). Now for any conrol ν D(,m), we rewre (6.3) as (6.7) Y (λ,m) = ξ + Snce + [ [ f s +λmax{,s s Y s (λ,m) δγ (ν s)+z s (λ,m) ν s ds m ds Γ (Z (λ,m) s s ν s +δγ (ν s) ds ) Z (λ,m) m ds Γ (Z s (λ,m) ) Z s (λ,m) ν s +δγ(ν s ) for any ν D(,m), from he BSDE comparson heorem, Y (λ,m) Y (λ,m) (ν) s he soluon of he followng BSDE Y (λ,m) (ν) = ξ + [ f s +λmax{,s s Y (λ,m) s Z (λ,m) s (ν)dw s, or equvalenly, under he probably measure P ν, Z (λ,m) s dw s. Y (λ,m) (ν), where (ν) δ Γ (ν s)+z (λ,m) s (ν) ν s ds [ Y (λ,m) (ν) = ξ+ f s +λmax{,s s Y s (λ,m) (ν) δγ (ν s) ds Z s (λ,m) (ν)dws ν, where Ws ν = W s s v udu for s s he Brownan moon under he probably measure P ν. y (λ,m) From Theorem 1.2, we know ha condonal on {T 1 < T, Y (λ,m) (τ,ν) for any soppng me τ R T (λ), where (6.8) y (λ,m) [ τ T (τ,ν) = E Pν [f s δγ(ν s )ds+s τ 1 {τ<t +ξ1 {τ T G. (ν) Hence, Y (λ,m) y (λ,m) (τ,ν). Takng he supremum over τ R T (λ) and ν D(,m) gves us Y (λ,m) y (λ,m) on {T 1 < T. Nex, we choose ν = ν and τ = τt o ge he reverse nequaly. Indeed, for v solvng (6.6), Y (λ,m) ge τ T = nf{t n T : Y (λ,m) T n = Y (λ,m) (ν ). Moreover, f we choose ν = ν and τ = τt, we S Tn T M+1 = nf{t n T : Y (λ,m) T n (ν ) S Tn T M+1. From Theorem 1.2, Y (λ,m) (ν ) = y (λ,m) (τt,ν ) y (λ,m). Therefore, Y (λ,m) = y (λ,m) on {T 1 < T, and (ν,τt ) are he opmal conrol and opmal soppng me of (6.4) respecvely. 7. Concluson. In hs paper, we fnd he sochasc conrol represenaons of (muldmensonal, consraned) refleced BSDEs and assocaed penalzed BSDEs, whch are summarzed n he followng able. The man feaure of he relaed opmal

23 Sochasc Conrol Represenaons for Penalzed BSDEs 23 Table 7.1 Sochasc Conrol Represenaons of Refleced BSDEs and Penalzed BSDEs Sochasc conrol represenaons Refleced BSDE (1.2) wh τ R()/(4.2) wh r A() Penalzed BSDE (1.5) wh τ R T (λ)/ (4.1) wh r A(,λ) Muldmensonal Refleced BSDE (5.2) wh u K () Muldmensonal Penalzed BSDE (5.6) wh u K (,λ)/(5.14) wh u K (,Q) Consraned Refleced BSDE (6.2) wh τ R() and ν D() Consraned Penalzed BSDE (6.4) wh τ R T (,λ) and ν D(,m) soppng represenaon s ha he player only sops a arrval mes of some exogenous Posson process. Fnally, seems ha he only exsng represenaon resul for penalzed BSDE was gven by Lepeler and Xu n [19 and [2 2, where hey found a connecon beween penalzed BSDE and a sandard opmal soppng problem wh modfed. Our represen resuls are dfferen, and seem more naural: Penalzed BSDE s nohng bu a random me dscrezaon of he opmal soppng represenaon for he correspondng refleced BSDE, where he me s dscrezed by Posson arrval mes. obsacle mn{s,y λ Acknowledgmens. The auhor would lke o hank he edor Prof.Qng Zhang, an assocae edor, and a referee for her valuable commens and suggesons on he manuscrp, and for her paen handlng of he paper. The auhor s graeful o Erhan Bayrakar, Davd Hobson, Yng Jao, Ioanns Karazas, Shge Peng and Mngyu Xu for helpful dscussons, and especally o Sam Cohen for ponng ou a msake n an early verson. The auhor also hanks parcpans n semnars a Unversy of Mchgan, Oxford and Warwck, and a he Frs Asan Quanave Fnance Conference (Sngapore, January 213), he Rsk and Sochascs Conference, (LSE, May 213), he Workshop on New Developmen n Sochasc Analyss: Probably and PDE neracons, (Bejng, July 213), and he INFORMS Annual Meeng 213, (Mnneapols, Ocober 213). REFERENCES [1 Bayrakar, E. and Song, Y., Quadrac refleced BSDEs wh unbounded obsacles, Sochasc Processes and Ther Applcaons, 122, (212), [2 Bouchard, B. and Chassagneux, J.-F., Dscree-me approxmaon for connuously and dscreely refleced BSDEs, Sochasc Processes and her Applcaons, 118(12), (28), [3 Chassagneux, J.-F., An nroducon o he numercal approxmaon of BSDEs, Lecure noes of second school of CREMMA, (212). [4 Chassagneux, J.-F., Ele, R. and Kharroub, I., A noe on exsence and unqueness for soluons of muldmensonal refleced BSDEs, Elecronc Communcaons n Probably, 16, (211), [5 Cvanć, J., Karazas, I. and Soner, H. M., Backward sochasc dfferenal equaons wh consrans on he gans-process, The Annals of Probably, 26(4), (1998), [6 Da, M., Kwok, Y. and You, H., Inensy-based framework and penaly formulaon of opmal soppng problems, Journal of Economc Dynamcs and Conrol, 31(12), (27), [7 Dupus, P. and Wang, H., Opmal soppng wh random nervenon mes, Adv. n Appl. Probab., 34(1), (22), I would lke o hank Mngyu Xu for provdng me wh hese wo references.

24 24 Gechun Lang [8 El Karou, N., Kapoudjan, C., Pardoux, E., Peng, S. and Quenez, M. C., Refleced soluons of backward SDEs, and relaed obsacle problems for PDEs, Ann. Probab., 25(2), (1997), [9 El Karou, N., Pardoux, E. and Quenez, M. C., Refleced backward SDEs and Amercan opons, Numercal mehods n fnance, Publ. Newon Ins., Cambrdge Unv. Press, 13, (1997), [1 El Karou, N., Peng, S., Quenez, M., Backward SDEs n fnance, Mah. Fnance, 7(1), (1997), [11 Gyöngy, I. and Sska, D., On randomzed soppng, Bernoull, 14(2), (28), [12 Hamadène, S. and Jeanblanc, M., On he sarng and soppng problem: Applcaon n reversble nvesmens, Mah. Oper. Res., 32 (1), (27), [13 Hamadène, S. and Zhang, J., Swchng problem and relaed sysem of refleced backward SDEs, Sochasc Processes and Ther Applcaons, 12, (21), [14 Hu, Y. and Tang, S., Mul-dmensonal BSDE wh oblque reflecon and opmal swchng, Probab. Theory Relaed Felds, 147, (21), [15 Kobylansk, M., Lepeler, J. P., Quenez, M. C. and Torres, S., Refleced BSDE wh superlnear quadrac coeffcen, Probably and Mahemacal Sascs, 22(1), (22), [16 Krylov, N.V., Conrolled dffuson processes. Sprnger, (28), 2nd prnng edon. [17 Lempa, J., Opmal soppng wh nformaon consran, Appled Mahemacs and Opmzaon, 66(2), (212): [18 Ly Vah, V., and Pham, H., Explc soluon o an opmal swchng problem n he wo-regme case, SIAM Journal on Conrol and Opmzaon, 46(2), (27), [19 Lepeler, J.-P. and Xu, M., Penalzaon mehod for refleced backward sochasc dfferenal equaons wh one RCLL barrer, Sascs and Probably Leers, 75, (25), [2 Lepeler, J.-P., Xu, M., Refleced backward sochasc dfferenal equaons wh wo RCLL barrers, ESAIM: Probably and Sascs, 11, (27), [21 Lang, G., Lükebohmer, E. and We, W., Fundng lqudy, deb enor srucure, and credor s belef: an exogenous dynamc deb run model, Mahemacs and Fnancal Economcs, o appear. [22 Lang, G. and We, W., Opmal swchng a Posson random nervenon mes, Dscree and Connuous Dynamcal Sysems-Seres B, o appear. [23 Ma, J. and Zhang, J., Represenaons and regulares for soluons o BSDEs wh reflecons, Sochasc processes and her applcaons, 115, (25), [24 Peng, S., Monoonc lm heory of BSDE and nonlnear decomposon heorem of Doob- Meyer s ype, Probably Theory and Relaed Felds, 113, (1999), [25 Peng, S. and Xu, M., Smalles g-supermarngale and relaed refleced BSDE wh sngle and double L2 barrers, Annales of I Insu de H. Poncare, 41, (25), [26 Peng, S. and Xu, M., Refleced BSDE wh a consran and s applcaons n an ncomplee marke, Bernoull, 16(3), (21), [27 Qan, Z. and Xu, M., Skorohod equaon and refleced backward sochasc dfferenal equaons, Preprn. [28 Sokey, N. L., The economcs of nacon: Sochasc conrol models wh fxed coss, Prnceon Unversy Press, (28). [29 Tao, R., Wu, Z., and Zhang, Q., BSDEs wh regme swchng: Weak convergence and applcaons, Journal of Mahemacal Analyss and Applcaons, 47(1), (213), [3 Yn, G., Zhang, Q., Connuous-Tme Markov Chans and Applcaons: A Two-Tme-Scale Approach, Sprnger-Verlag, New York, (212). [31 Yn, G., Zhu, C., Hybrd Swchng Dffusons: Properes and Applcaons, Sprnger-Verlag, New York, (21).