MATHEMATICS IN CONTRACT THEORY (PRELIMINARY VERSION)

Size: px
Start display at page:

Download "MATHEMATICS IN CONTRACT THEORY (PRELIMINARY VERSION)"

Transcription

1 MATHEMATICS IN CONTRACT THEORY (PRELIMINARY VERSION) HAO XING For general inroducion o conrac heory, refer o Bolon and Dewaripon, 25]. For mahemaical heory for coninuous-ime models, refer o Cvianić and Zhang, 23].. One-period model.. Problem formulaion. To undersand he flavor of quesions in conrac heory, we sar wih an one-period model in his secion. Consider an agen whose uiliy is modelled by an exponenial uiliy wih he risk aversion, i.e., U A (c) = e c. If hired a ime, his agen manages a projec, which produces an oupu a ime. The oupu is random, and i is modelled by a normal random variable X wih he mean α and he sandard deviaion σ, i.e., X N(α, σ). The mean α is deermined by he agen s effor. If he agen works hard, α is high, oherwise α is low. The randomness of he oupu is characerized by σ which canno be conrolled by he agen. The effor is cosly o he agen. The cos is given by a cos funcion g(α) which is he moneary cos o he agen if he exers effor α. We consider he following cos funcion g(α) = 2 α2. If hired, he agen will receive a lump-sum compensaion ξ a ime. We call his compensaion he conrac paymen, or simply conrac. The agen chooses his opimal sraegy o maximize he expeced effor ne cos, i.e., E U A (ξ 2 α2 ) ] Max. Assuming ha his opimizaion problem has an opimizer α ξ, EU A (ξ 2 (αξ ) 2 )] is he opimal value associaed o he conrac ξ for he agen. The agen has a reservaion value U A (R), which describes he minimal uiliy ha he agen needs o ake on a job; i.e., he agen will only ake on a conrac if he associaed opimal value is no smaller han his reservaion value. Consider a principal whose uiliy is modelled by an exponenial uiliy wih he risk aversion, i.e., U P (c) = e c. The principal wans o hire he agen o work on he projec. However, he principal canno monior or observe agen s effor. The principal can only observe he realizaion of X a ime. (I is impossible o esimae he mean Dae: June 24, 27.

2 MATHEMATICS IN CONTRACT THEORY 2 of a normal random variable wih only one realizaion.) Therefore, here is informaion asymmery beween he agen and he principal. This informaion asymmery is called moral hazard in he economics lieraure. A ime, he principal receives he oupu X and pays he agen ξ. The principal aims o choose conrac ξ o maximize her expeced uiliy, i.e., E U P (X ξ ξ) ] Max, subjec o E U A (ξ 2 (αξ ) 2 ) ] U A (R). Here X ξ is he oupu when he agen employs he effor α ξ. The consrain is called agen s paricipaion consrain. The goal of his problem is o find principal s opimal conrac ξ and agen s opimal effor a ξ..2. Agen s opimizaion problem. Firs, i is no opimal for he principal o pay a consan salary ξ, because if agen receives a compensaion which does no depend on he oupu, he will no exer any cosly effor a all. depends on X. Le us consider he following linear conrac Therefore, ξ needs o be random and ξ = ax + b, a, b R, (.) where b is he fixed salary and ax is he performance-based compensaion. The consans a and b are called conrac sensiiviies. For a given linear conrac in (.), he agen wans o maximize he expeced uiliy Recall ha The previous expeced uiliy equals o E e (ax+b 2 α2 ) ]. Ee cx ] = e αc+ 2 σ2 c 2. (.2) e b aα+ 2 σ2 a 2 γ 2 A + 2 α 2. Is opimizer minimizes aα + 2 α 2. Therefore, he opimal effor is and agen s opimal value is a ξ = a, (.3) e b+ 2 σ2 a 2 γ 2 A 2 a 2.

3 MATHEMATICS IN CONTRACT THEORY 3.3. Principal s opimizaion problem. Given agen s opimal effor a ξ and he associaed oupu X ξ, he principal aims o maximize E U P (X ξ ξ) ] = E e (X ξ ax ξ b) ] = e b ( a)a+ 2 σ2 γ 2 P ( a)2, where (.2) is used o obain he second ideniy. (.4) Observe ha principal s opimal uiliy is decreasing in b. Therefore he principal wans o choose he smalles b such ha he paricipaion consrain is saisfied. This implies leading o b = 2 σ 2 a 2 2 a2 + R. e b aα+ 2 σ2 a 2 γ 2 A + 2 α 2 = e R, Plugging he previous expression of b back o (.4), we obain E U P (X ξ ξ) ] = exp ( R + 2 σ 2 a 2 2 a 2 ( a)a + 2 σ2 γ 2 P ( a) 2). Therefore, we jus need o minimize he exponen of he righ-hand side. The opimizer is a = + σ 2 + ( + )σ 2. Proposiion.. Among all linear conracs of ype (.), he opimal linear conrac is given by ξ = a X + b, where a = + σ 2 + ( + )σ 2 and b = 2 σ 2 (a ) 2 2 (a ) 2 + R. Remark.2. From he expression of a, we can see ha a, when eiher σ,, or. Therefore, he principal sells he whole projec o he agen for cash a ime, when eiher he projec is riskless, he agen is risk neural, or he principal is exremely risk averse. Remark.3. The opimal conrac in he linear class is obained in he previous proposiion. However, if he principal is allowed o choose from nonlinear conracs, i is no clear wheher nonlinear conracs will improve her uiliy. Consider a N-period model, where he oupu a he end of period N is X + X 2 + X N. If he principal can observe all X i, she can choose from pah-dependen conracs f(x, X 2,..., X N ). In his case, i is resricive o consider only linear conracs. We will ackle hese problems in a coninuous-ime framework in he nex secion. 2.. Preliminaries. 2. Holmsröm and Milgrom (987)

4 MATHEMATICS IN CONTRACT THEORY Problem formulaion. We presen Holmsrom and Milgrom, 987] in his secion. Le (Ω, F, (F,T ] ), P) be a filered probabiliy space, where he filraion is he augmened filraion generaed by a -dimensional sandard Brownian moion B. The agen, if hired a ime, works for a projec coninuously from ime o T. His effor is an adaped process α. The oupu process X saisfies he dynamics where σ is a posiive consan, dx = α d + σdb α, (2.) B α = B α s σ ds. (2.2) One can observe ha X = σb. Define a new probabiliy measure P α via dp α dp = exp ( α s σ db s 2 ( αs σ )2 ds ). We assume ha α saisfies enough inegrabiliy so ha he righ-hand side has expecaion under P. Therefore, P α is a probabiliy measure equivalen o P. In wha follows, we denoe E Pα ] by E α and E Pα F ] by E α ]. By Girsanov heorem, B α is a Brownian moion under P α. Therefore, if α is deerminisic, X T has normal disribuion under P α wih he mean α d and he sandard deviaion σ T. Remark 2.. The formulaion in (2.) is called he weak formulaion. In such a formulaion, conrolling he drif of X is equivalen o conrolling he probabiliy measure P α. The cos of agen s effor is assumed o be sraegy o maximize E U A (ξ 2 α2 sds. The agen chooses his opimal 2 α2 sds) ]. Assume ha his problem admis an opimal sraegy α. The principal observes he oupu process coninuously. However, she canno disinguish he drif α from he noise. In oher words, when he oupu process increases, she does no know if he agen works hard or she is jus lucky. This informaion asymmery beween he principal and agen creaes moral hazard. Given agen s opimal effor a ξ and he associaed oupu process X ξ, he principal aims o maximize subjec o agen s paricipaion consrain. E U P (X ξ T ξ)],

5 MATHEMATICS IN CONTRACT THEORY Agen s opimizaion problem. Le us firs define a dynamic version of agen s value funcion: v := ess sup α E α UA (ξ 2 α2 sds) ]. (2.3) One can hink v as he opimal value a ime if he agen acs opimally from ime onwards. Therefore v is called he coninuaion value. Define u via U A (u ) = v. (2.4) The process u is called he cerainy equivalence, which is he moneary equivalence of agen s opimal value. Now we presen a heurisic argumen o idenify he dynamics of u. Assume ha u has he following dynamics where H will be deermined in wha follows. Since U A is an exponenial uiliy, γ e u e du = H d + Z db, 2 α2sds = ess sup α E α exp ( ( T ξ 2 α2 sds ))]. The maringale principal expecs ha γ e u e γ A 2 α2 s ds is a supermaringale under P α for any sraegy α; γ e u e γ A 2 α2sds is a maringale under P α for he opimal sraegy α. We will use his maringale principal o idenify H, hence he dynamics of u. To his end, applying Iô s formula, we obain d γ e u e e u e 2 α2 sds = H + γ 2 α2 s ds 2 AZ α2 ] d Z db = H + 2 Z α2 Z α σ where he second ideniy follows from (2.2). Having γ e u e 2 α2 s ds as a supermaringale implies ha H + 2 Z α2 Z α σ Moreover, having one α such ha γ e u e previous inequaliy is an ideniy when α = α. Therefore, d Ω a.s. ] d Z db α, 2 (α s )2 ds is a maringale implies ha he and he opimal α is H = inf α { 2 α2 Z α σ = 2 ( σ 2 )Z 2, α = Z σ. } + 2 Z 2

6 Therefore, he maringale principal implies ha MATHEMATICS IN CONTRACT THEORY 6 du = 2 ( σ 2 )Z 2 d + Z db, u T = ξ, (2.5) where he erminal condiion follows from (2.3) and (2.4). One can view (2.5) as a Backward Sochasic Differenial Equaion (BSDE), whose soluion is a pair of adaped processes (u, Z). The BSDE (2.5) can be solved explicily. Consider he process e ( σ 2 )u. Iô s formula implies ha de ( σ 2 )u = ( σ 2 ) e ( σ 2 )u Z db, e ( σ 2 )u T = e ( σ 2 )ξ. Given ha E e ( σ 2 )ξ ] <, we have e ( σ 2 )u = E e ( σ 2 )ξ ], and Z is idenified by he maringale represenaion heorem. In conclusion, for any conrac ξ such ha E e ( σ 2 )ξ ] <, we can idenify (u, Z) saisfying (2.5). This pair is also unique in he class where e ( σ 2 )u is of class (D). The equaion (2.5) also provides a handy represenaion of he conrac ξ. Given u and he process Z, running he dynamics (2.5) forward in ime yields ξ = u + 2 A )Z 2 σ 2 d + Z db. (2.6) This represenaion will be useful for principal s opimizaion problem. We have derived he dynamics of u from he maringale principal. Le us now sar from (2.5) and verify ha is soluion is he cerainy equivalence defined in (2.4). Proposiion 2.2. We resric he conrac ξ and agen s sraegy α o he class such ha he BSDE (2.5) admis a soluion (u, Z) and exp ( (u 2 α2 sds) ) is of class (D). Then agen s opimal sraegy is α = Z/σ and u is agen s cerainy equivalence. Proof. For arbirary α, he consrucion of H ensures ha e γ A(u 2 α2 s ds) is a local supermaringale. Since we assume ha his process if of class (D), i is also a supermaringale. Therefore U A (u ) = e u E α e ( u T 2 α2 sds) ] = E α ( e ξ ]. 2 sds) α2 When α = α, e γ A(u 2 (α ) 2 sds) is a local maringale, hence a maringale due o is class (D) propery. Therefore, he previous inequaliy is an ideniy, verifying he opimaliy of α.

7 MATHEMATICS IN CONTRACT THEORY Principal s opimizaion problem. Using (2.6), principal s expeced uiliy is reduced o E α UP (X ξ T ξ)] = E α ( ( exp = E α ( ( exp u + Z d + σ σdb α u ( Z σ 2 ( + σ 2 )Z 2 where (2.2) is used o obain he second ideniy. sochasic exponenial E ( We obain (σ Z )db α ) = exp ( ))] (γ 2 A )Z 2 σ 2 d Z db ) d + (σ Z )db α ))], Rewrie he righ-hand side using he (σ Z )db α 2 γ2 P ) (σ Z ) 2 d. where E α UP (X ξ T ξ)] ( = E exp u + ) ( f(z )d E )] (σ Z )db α, f(z) = 2 γ2 P (σ Z) 2 Z + γ ( ) σ 2 P γa + σ Z 2. 2 (2.7) Se Z = argminf(z). Calculaion yields Z + σ 2 = σ + σ 2 ( + ). Now we are ready o presen he opimal conrac for he principal. In conras o he one-period model, a linear conrac is proved o be opimal in a large class of conracs, which saisfies proper inegrabiliy condiions and includes nonlinear and pah-dependen conracs. Theorem 2.3. Consider he class of conracs specified in Proposiion 2.2, moreover E ( γ p (σ Z )db Z/σ) is a P Z/σ -maringale. Then he linear conrac ξ = + σ 2 + σ 2 ( + ) X T + b, where b = R + 2 ( σ 2 )(Z ) 2 T, is he opimal conrac. Proof. From (2.7), we can see ha principal s expeced uiliy is a decreasing funcion of u. On he oher hand, u is agen s cerainy equivalence a ime. Therefore, in order o

8 MATHEMATICS IN CONTRACT THEORY 8 saisfy he paricipaion consrain, he principal chooses u = R. From (2.7), we also obain E α UP (X ξ T ξ)] e R+f(Z )T E α ( E = e R+f(Z )T, )] (σ Z )db α where he ideniy follows he assumpion ha he expecaion of he sochasic exponenial is. The inequaliy above is an ideniy, when Z in (2.6) is chosen as Z. Recalling ha B = X/σ, we have verified he opimaliy of he conrac in he saemen. 3. Sannikov (28) 3.. Problem formulaion. Raher han a conrac of lump sum paymens in he las secion, we consider a model of coninuous paymens in Sannikov, 28]. The oupu process X is formulaed weakly as in (2.), whose drif is conrolled by he agen. The agen s preference is represened by a uiliy funcion U and he rae of cos for agen s effor is given by a funcion g. We do no specify explicily forms for U and g, only assume ha g is sricly convex. Raher han he moneary cos as in he las secion, we consider g(α) as he cos o agen s uiliy per uni of ime. A conrac is a sream of paymens {c ; }. The agen receives he cash flow c and consume i righ away wihou saving. The agen s opimizaion problem is re α e r( u(c ) g(α ) ) d ] Max, where r is he discouning rae and he r in fron of he expecaion is a normalizaion consan. We assume ha agen s opimizaion problem admis an opimal sraegy α. Agen s reservaion uiliy is R; i.e., he agen will no work for he projec if he opimal value is less han R. Define agen s coninuaion value as W = ess sup α re α e r(s )( u(c s ) g(α s ) ) ds ]. (3.) The agen has limied liabiliy. He does no accep negaive W in any siuaion. The principal is risk neural. She chooses he compensaion sream c o maximize her expeced profi sup re α τ τ e e r( ) ] α c d, c,τ e where τ is he firs ime ha agen s coninuaion value reaches zero, i.e., τ = inf{ : W = }, and τ e. A ime τ, he conrac is erminaed, he agen is no longer paid and he exers zero effor afer τ. A ime τ e, he principal reires he agen by paying him a

9 MATHEMATICS IN CONTRACT THEORY 9 consan rae forever, hen agen sops working. This consan reiremen rae is deermined so ha agen s coninuaion value remains he same a reiremen ime Agen s opimizaion problem. Le us firs use he maringale principle o heurisically derive he dynamics of agen s coninuaion value W. Define W as W = e r W + r e rs( U(c s ) g(α s ) ) ds. Given c, we expec from he maringale principle ha W is a supermaringale under P α for arbirary sraegy α, and a maringale under P α he dynamics Iô s formula implies ha dw = H d + rσz db. for he opimal α. Suppose ha W has d W =e r( H d + rσz db rw d + r ( U(c ) g(α ) ) d ) =re r( r H W + α Z + U(c ) g(α ) ) d + re r σz db α. The maringale principle implies ha he drif is nonnegaive for arbirary α and zero for he opimal α. Therefore, H = r ( inf α {g(α) αz} + W U(c)) = r ( ĝ(z) + W U(c) ), where ĝ(z) = inf α {g(α) αz} and he opimal sraegy α = (g ) (Z). As a resul, W follows he dynamics dw = r ( ĝ(z ) + W U(c ) ) d + rσz db. (3.2) Raher han a erminal condiion a a finie ime, he erminal condiion for (3.2) is replaced by he following ransversaliy condiion lim Eα ] e rτ W τ =, for sraegy α and any sopping ime τ. (3.3) τ From a BSDE poin of view, (3.2), ogeher wih (3.3), is called an infinie horizon BSDE, sudied by Royer (24). The following resul makes he heurisic argumen rigorous. Le us resric he compensaion sream and agen s sraegy α such ha E α e r U(c )d ] < and E α e r g(α )d ] <. Proposiion 3.. For a given compensaion sream c, suppose ha here exiss processes W and Z saisfying (3.2) and (3.3). Then α = (g ) (Z) is agen s opimal sraegy and W is agen s coninuaion value defined in (3.).

10 MATHEMATICS IN CONTRACT THEORY Proof. From he consrucion of H, we have ha W is a local supermaringale. localizaion sequence {τ n } of is local maringale par. We have Take a τn W E α e rτ n W τn + r e r( U(c ) g(α ) ) d ]. (3.4) Sending τ n on he righ-hand side, and using (3.3) and he dominaed convergence heorem, we obain W E α e r( U(c ) g(α ) ) d ]. For he sraegy α, he inequaliy in (3.4) is an ideniy. A similar limi argumen yields W = E α e r( U(c ) g(α ) ) d ], confirming he opimaliy of α Principal s opimizaion problem. The key observaion by Sannikov is ha agen s coninuaion value can be used as he sae variable for principal s problem. Consider he dynamics (3.2), where boh Z and c are considered as he conrol variables for he principal. Define principal s value funcion as τ τ F (W ) = sup E α r e r( ) α c d W = W ], c,z,τ where α = α(z) = (g ) (Z) and τ = inf{ : W = }. This is an opimal conrolsopping problem. To derive an equaion saisfied by F, we use he maringale principle again. To his end, consider and define F (W ) = ess sup c,z,τ E α(z) r M = r e r(s )( α(z s ) c s ) ds ], e rs( α(z s ) c s ) ds + e r F (W ). We expec from he maringale principle ha M is a supermaringale under P α(z) for arbirary c, Z, τ, and M is a maringale under P α(z) unil τ for opimal c, Z, τ. Assuming ha F C 2 (R), applying Iô s formula o M, we obain dm =e r r(α(z ) c ) rf (W ) + r ( ĝ(z ) + W U(c ) ) F (W ) + r2 σ 2 2 Z2 F (W ) ] d + re r σz F (W )db =re r α(z ) c F (W ) + ( g(α(z )) + W U(c ) ) F (W ) + rσ2 2 Z2 F (W ) ] d + re r σz F (W )db α(z).

11 MATHEMATICS IN CONTRACT THEORY The drif mus be nonnegaive for all conrols and zero for opimal conrols. Therefore, we obain he following Hamilon-Jacobi-Bellman (HJB) equaion for F : { = sup α(z) c F (W ) + ( g(α(z)) + W U(c) ) } F (W ) + rσ2 2 Z2 F (W ). (3.5) c,z This HJB equaion needs wo boundary condiions. On he one hand, F () =. (3.6) On he oher hand, define a reiremen funcion F (U(c)) = c. This is he value o he principal if she pays he agen a consan rae c. In his case, he agen no longer works. The oher boundary condiion is F ( W ) = F ( W ) and F ( W ) = F ( W ). (3.7) This is a free-boundary condiion, since W is deermined ogeher wih he soluion F. The condiion on he firs order derivaive is called he smooh pasing condiion. Now we are ready o sae he main heorem. Theorem 3.2. Suppose ha he HJB equaion (3.5) ogeher wih is boundary condiions (3.6) and (3.7) admi a soluion F C 2 (, W ) and W R, ). Le Z(W ) maximizes α(z) + g(α(z))f (W ) + rσ2 2 Z2 F (W ), and c(w ) maximizes c U(c)F (W ). Choose W = max W R, W ] F (W ) and define W via he following SDE dw = r ( ĝ(z(w ) + W U(c(W ))) ) d + rσz(w )db, W = W. Then principal s opimal conrac is given by c(w ), agen s opimal effor is α(z(w )), τ = inf{ : W = }, and τ e = inf{ : W = W }. Remark 3.3. The proof is a verificaion argumen, see Sannikov, 28] and Srulovici and Szydlowski, 25 In paricular, in order o ensure (3.5) admis a C 2 soluion, one needs o resric Z Z for some posiive consan Z. This ensures (3.5) is uniformly ellipic, bu resrics principal s admissible conracs. An numeric example is given in Figure. 4. DeMarzo and Sannikov (26) 4.. Problem formulaion. We presen DeMarzo and Sannikov, 26] in his secion. The agen, if hired, produces an oupu process X which follows dx = (µ α )d + db α,

12 MATHEMATICS IN CONTRACT THEORY 2 where µ is a consan and db α = db + α d. The agen s effor α is a shirking acion, which can be inerpreed as inefficien implemenaion or working less hard han he should be. This shirking acion yields privae benefi o he agen. The agen can choose any nonnegaive α. The benefi is described by a parameer λ, ]. The larger λ is, he higher benefi agen ges. The cumulaive compensaion paid by he principal is described by a non-decreasing process C. The agen is risk neural and has a reservaion uiliy R. Given C, Agen s opimizaion problem is E α e γ( dc + λα d )] Max. Le α be agen s opimal sraegy for he problem above. The principal pays he agen a non-decreasing process C. The agen has limied liabiliy. When his coninuaion value reaches zero, he projec is liquidaed, he principal ges L and he agen ges nohing more and sops shirking. Principal s opimizaion problem is subjec o agen s paricipaion consrain. τ E α e r (µ α )d dc ] + e rτ L ], 4.2. Agen s opimizaion problem. Define agen s coninuaion value W = ess sup α E α e γ(s )( dc s + λα s ds )]. Using he maringale principal similarly as before, we obain he dynamics of W as dw = γw + inf α {α (Z λ)} ] d dc + Z db. (4.) When Z λ, he opimizer α = and inf α {α (Z λ)} =. If Z < λ has posiive measure under d dp, he drif of (4.) is. Therefore, wellposedness for agen s problem impose a consrain for he conrac sensiiviy We also need he ransversaliy condiion Z λ d dp a.s. (4.2) lim Eα ] e rτ W τ =, for sraegy α and any sopping ime τ. (4.3) τ We consrain he compensaion process C and agen s sraegy α o he classes which saisfy he following inegrabiliy propery. E α e r U(c )d ] < and E α e r g(α )d ] <. An argumen similar o Proposiion 3. yields

13 MATHEMATICS IN CONTRACT THEORY 3 Proposiion 4.. Le W and Z be wo processes saisfying dw = γw d dc + Z db, he consrain (4.2) and he ransversaliy condiion (4.3). Then α = is agen s opimal sraegy and W is agen s coninuaion value Principal s opimizaion problem. Consider W as he sae variable for principal s opimizaion problem. Define principal s value funcion as τ F (W ) = ess sup Z λ E e r(s ) µds dc s ] + e r(τ ) L ], where τ = inf{s : W s }. This is called a singular conrol problem. Applying he maringale principal o principal s opimizaion problem, assuming ha C is differeniable, we can ge he following HJB equaion rf (W ) = max Z λ,c { µ + γw F (W ) ( + F (W ))C + Z2 2 F (W ) }. (4.4) However, C can be arbirarily large, in order o keep he HJB equaion well-posed, we need F (W ). This inequaliy can also be undersood from an economics poin of view. The principal can always pay he agen C >. In his case, agen s coninuaion value decreases by C F (W ) F (W C) C, which implies F (W ). On can also see from (4.4) ha C = whenever F (W ) >. Therefore, he principal delay he paymen o he agen unil F (W ) =. The boundary condiions are F () = L, F ( W ) =, and F ( W ) =. The hird condiion is he smooh pasing condiion. The boundary condiions a W imply rf ( W ) + γ W = µ. Tha is, he paymens are posponed unil he projec s expeced reurn is used up by he sum of he individual expeced reurns. Theorem 4.2. Suppose ha γ > r. Consider he ODE sysem : µ + γw F (W ) + 2 λ2 F (W ) rf (W ) =, F (W ), W, W ), F (W ) = W W, F () = L, F ( W ) =. Assume ha i admis a concave soluion F C 2 and W <. Then,

14 (i) F is Principal s value funcion. MATHEMATICS IN CONTRACT THEORY 4 (ii) When W, W ], ruh-elling is opimal, i.e., a. Moreover, i is opimal o se Z λ, and he paymens C o be he reflecion process which keeps W wihin, W ]. Tha is, C is he smalles increasing process such ha W = W + γw s ds C + λb says wihin, W ]. In paricular, when W (, W ), dc =. The conrac erminaes once W his. (iii) When W > W, hen he opimal conrac pays an immediae paymen of W W o he agen, and he conrac coninues wih he agen s new iniial uiliy W. Proof. Le F denoe he soluion o he ODE sysem and ˆF denoe he value funcion. We firs show ha ˆF F. To see ha, inroduce G := C + e rs (µ α s )ds dc s ] + e r F (W ). By Iô s formula we have ] e r dg = µ α + Z F (W )] + γw F (W ) + 2 Z2 F (W ) rf (W ) d + F (W )]dc + Z F (W )db α. Since F (W ) for W, W ], we have + lf (W ), + F (W ). This, ogeher wih he assumpions ha F is concave and Z λ, implies ha e r dg µ + γw F (W ) + ] 2 λ2 F (W ) rf (W ) d + Z F (W )db α. When W, W ], he drif is zero. When W > W, by rf ( W ) + γ W = µ and oher boundary condiions, we can compue ha he drif is r γ]w W ] <, hanks o r < γ. Therefore, in boh he cases we have e r dg Z F (W )db α. Thus, G is a P α -supermaringale. Noice ha F (W ) = G and F (W τ ) = F () = L. We have hen F (W ) = G E α G τ ]. for all a, τ. Taking he supremum, we ge F = G ˆF. For he sraegy in he heorem, G is a maringale. e r dg = Z F (W )db.

15 MATHEMATICS IN CONTRACT THEORY 5 Then, we have F (W ) = G = EG τ ]. Thus, he upper bound is aained, and ˆF (W ) = F (W ) for W, W ]. Finally, for W > W, noe ha, by he immediae paymen argumen above, he value funcion saisfies, for W > W > W, ˆF (W ) ˆF ( W ) W + W Since we have ˆF ( W ) = F ( W ) = F (W ) W + W, we have ˆF (W ) F (W ) Implemenaion Using Sandard Securiies. We now wan o show ha he above conrac can be implemened using real-world securiies, namely, equiy, long-erm deb and credi line. The implemenaion will be accomplished using he following: - The firm sars wih iniial capial K and possibly an addiional amoun needed for iniial dividends or cash reserves. - The firm has access o a credi line up o a limi of C L. The ineres rae on he credi line balance is γ. The agen decides on borrowing money from he credi line and on repaymens o he credi line. If he limi C L is reached, he firm/projec is erminaed. - Shareholders receive dividends which are paid from cash reserves or he credi line, a he discreion of he agen. - The firm issues a long (infinie) erm deb wih coninuous coupons paying a rae x. If he firm canno pay a coupon paymen, he projec is erminaed. The agen will be paid by a fracion of dividends. We assume ha once he projec is erminaed he agen does no receive anyhing from his holdings of equiy. Here is he resul ha shows precisely how he opimal conrac is implemened. Theorem 4.3. Suppose ha he credi line has ineres rae γ, and ha he long-erm deb saisfies x = µ γc L. (4.5) Assume he dividends are paid only a he imes he credi line balance his zero, making he credi line balance he process ha reflecs a zero. If he agen is paid by a proporion λ of he firm s dividends, he will no misrepor he cash flows, and will use hem o pay he deb coupons and he credi line before issuing dividends. Denoing he curren balance of he credi line by M, he agen s expeced uiliy process saisfies W = λ(c L M ). (4.6) If in addiion C L = W /λ (4.7) hen he above capial srucure of he firm implemens he opimal conrac.

16 MATHEMATICS IN CONTRACT THEORY 6 Proof. Denoe by δ he cumulaive dividends process. By ha, we mean ha dδ is equal o whaever money is lef afer paying he ineres γm d on he credi line and he deb coupons xd. Since he oal amoun of available funds is equal o he balance of he credi line M plus he repored profi X, and since M +X is divided beween he credi line ineres paymens, deb coupon paymens and dividends, we have dm = γm d + xd + dδ dx Wih W as in (4.6), and from (4.5), we have dw = λdm = γw d λdδ + λdb If we se dc = λdδ, hen his corresponds o he agen s uiliy wih zero savings and Z λ, which implies ha he agen will no have incenives o misrepor. Moreover, since he dividends are paid when M =, which, by (4.7) is equivalen o W = W, we see ha he opimal sraegy is implemened by his capial srucure. References Bolon and Dewaripon, 25] Bolon, P. and Dewaripon, M. (25). Conrac Theory. MIT Press. Cvianić and Zhang, 23] Cvianić, J. and Zhang, J. (23). Conrac Theory in Coninuous-Time Models. Springer. DeMarzo and Sannikov, 26] DeMarzo, P. M. and Sannikov, Y. (26). Opimal securiy design and dynamic capial srucure in a coninuous-ime agency model. Journal of Finance, 6: Holmsrom and Milgrom, 987] Holmsrom, B. and Milgrom, P. (987). Aggregaion and lineariy in he provision of ineremporal incenives. Economerica, 55: Sannikov, 28] Sannikov, Y. (28). A coninuous-ime version of he principal-agen problem. Review of Economic Sudies, 75: Srulovici and Szydlowski, 25] Srulovici, B. and Szydlowski, M. (25). On he smoohness of value funcions and he exisence of opimal sraegies in diffusion models. Journal of Economic Theory, 59:6 55.

17 MATHEMATICS IN CONTRACT THEORY 7 Figure. Sannikov (28) DeMarzo and Sannikov (26)

Utility maximization in incomplete markets

Utility maximization in incomplete markets Uiliy maximizaion in incomplee markes Marcel Ladkau 27.1.29 Conens 1 Inroducion and general seings 2 1.1 Marke model....................................... 2 1.2 Trading sraegy.....................................

More information

An Introduction to Backward Stochastic Differential Equations (BSDEs) PIMS Summer School 2016 in Mathematical Finance.

An Introduction to Backward Stochastic Differential Equations (BSDEs) PIMS Summer School 2016 in Mathematical Finance. 1 An Inroducion o Backward Sochasic Differenial Equaions (BSDEs) PIMS Summer School 2016 in Mahemaical Finance June 25, 2016 Chrisoph Frei cfrei@ualbera.ca This inroducion is based on Touzi [14], Bouchard

More information

Cash Flow Valuation Mode Lin Discrete Time

Cash Flow Valuation Mode Lin Discrete Time IOSR Journal of Mahemaics (IOSR-JM) e-issn: 2278-5728,p-ISSN: 2319-765X, 6, Issue 6 (May. - Jun. 2013), PP 35-41 Cash Flow Valuaion Mode Lin Discree Time Olayiwola. M. A. and Oni, N. O. Deparmen of Mahemaics

More information

Essential Microeconomics : OPTIMAL CONTROL 1. Consider the following class of optimization problems

Essential Microeconomics : OPTIMAL CONTROL 1. Consider the following class of optimization problems Essenial Microeconomics -- 6.5: OPIMAL CONROL Consider he following class of opimizaion problems Max{ U( k, x) + U+ ( k+ ) k+ k F( k, x)}. { x, k+ } = In he language of conrol heory, he vecor k is he vecor

More information

The Optimal Stopping Time for Selling an Asset When It Is Uncertain Whether the Price Process Is Increasing or Decreasing When the Horizon Is Infinite

The Optimal Stopping Time for Selling an Asset When It Is Uncertain Whether the Price Process Is Increasing or Decreasing When the Horizon Is Infinite American Journal of Operaions Research, 08, 8, 8-9 hp://wwwscirporg/journal/ajor ISSN Online: 60-8849 ISSN Prin: 60-8830 The Opimal Sopping Time for Selling an Asse When I Is Uncerain Wheher he Price Process

More information

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon 3..3 INRODUCION O DYNAMIC OPIMIZAION: DISCREE IME PROBLEMS A. he Hamilonian and Firs-Order Condiions in a Finie ime Horizon Define a new funcion, he Hamilonian funcion, H. H he change in he oal value of

More information

1 Consumption and Risky Assets

1 Consumption and Risky Assets Soluions o Problem Se 8 Econ 0A - nd Half - Fall 011 Prof David Romer, GSI: Vicoria Vanasco 1 Consumpion and Risky Asses Consumer's lifeime uiliy: U = u(c 1 )+E[u(c )] Income: Y 1 = Ȳ cerain and Y F (

More information

E β t log (C t ) + M t M t 1. = Y t + B t 1 P t. B t 0 (3) v t = P tc t M t Question 1. Find the FOC s for an optimum in the agent s problem.

E β t log (C t ) + M t M t 1. = Y t + B t 1 P t. B t 0 (3) v t = P tc t M t Question 1. Find the FOC s for an optimum in the agent s problem. Noes, M. Krause.. Problem Se 9: Exercise on FTPL Same model as in paper and lecure, only ha one-period govenmen bonds are replaced by consols, which are bonds ha pay one dollar forever. I has curren marke

More information

Principal-Agent Problems with Exit Options

Principal-Agent Problems with Exit Options Principal-Agen Problems wih Exi Opions Jakša Cvianić, Xuhu Wan and Jianfeng Zhang June 12, 28 Absrac. We consider he problem of when o deliver he conrac payoff, in a coninuousime Principal-Agen seing,

More information

Economics 8105 Macroeconomic Theory Recitation 6

Economics 8105 Macroeconomic Theory Recitation 6 Economics 8105 Macroeconomic Theory Reciaion 6 Conor Ryan Ocober 11h, 2016 Ouline: Opimal Taxaion wih Governmen Invesmen 1 Governmen Expendiure in Producion In hese noes we will examine a model in which

More information

Optimal Investment, Consumption and Retirement Decision with Disutility and Borrowing Constraints

Optimal Investment, Consumption and Retirement Decision with Disutility and Borrowing Constraints Opimal Invesmen, Consumpion and Reiremen Decision wih Disuiliy and Borrowing Consrains Yong Hyun Shin Join Work wih Byung Hwa Lim(KAIST) June 29 July 3, 29 Yong Hyun Shin (KIAS) Workshop on Sochasic Analysis

More information

Examples of Dynamic Programming Problems

Examples of Dynamic Programming Problems M.I.T. 5.450-Fall 00 Sloan School of Managemen Professor Leonid Kogan Examples of Dynamic Programming Problems Problem A given quaniy X of a single resource is o be allocaed opimally among N producion

More information

f(s)dw Solution 1. Approximate f by piece-wise constant left-continuous non-random functions f n such that (f(s) f n (s)) 2 ds 0.

f(s)dw Solution 1. Approximate f by piece-wise constant left-continuous non-random functions f n such that (f(s) f n (s)) 2 ds 0. Advanced Financial Models Example shee 3 - Michaelmas 217 Michael Tehranchi Problem 1. Le f : [, R be a coninuous (non-random funcion and W a Brownian moion, and le σ 2 = f(s 2 ds and assume σ 2

More information

1. Consider a pure-exchange economy with stochastic endowments. The state of the economy

1. Consider a pure-exchange economy with stochastic endowments. The state of the economy Answer 4 of he following 5 quesions. 1. Consider a pure-exchange economy wih sochasic endowmens. The sae of he economy in period, 0,1,..., is he hisory of evens s ( s0, s1,..., s ). The iniial sae is given.

More information

Macroeconomic Theory Ph.D. Qualifying Examination Fall 2005 ANSWER EACH PART IN A SEPARATE BLUE BOOK. PART ONE: ANSWER IN BOOK 1 WEIGHT 1/3

Macroeconomic Theory Ph.D. Qualifying Examination Fall 2005 ANSWER EACH PART IN A SEPARATE BLUE BOOK. PART ONE: ANSWER IN BOOK 1 WEIGHT 1/3 Macroeconomic Theory Ph.D. Qualifying Examinaion Fall 2005 Comprehensive Examinaion UCLA Dep. of Economics You have 4 hours o complee he exam. There are hree pars o he exam. Answer all pars. Each par has

More information

The B.E. Journal of Theoretical Economics

The B.E. Journal of Theoretical Economics The B.E. Journal of Theoreical Economics Conribuions Volume 8, Issue 1 28 Aricle 23 Principal-Agen Problems wih Exi Opions Jaksa Cvianic Xuhu Wan Jianfeng Zhang Calech, cvianic@hss.calech.edu Hong Kong

More information

Algorithmic Trading: Optimal Control PIMS Summer School

Algorithmic Trading: Optimal Control PIMS Summer School Algorihmic Trading: Opimal Conrol PIMS Summer School Sebasian Jaimungal, U. Torono Álvaro Carea,U. Oxford many hanks o José Penalva,(U. Carlos III) Luhui Gan (U. Torono) Ryan Donnelly (Swiss Finance Insiue,

More information

Expert Advice for Amateurs

Expert Advice for Amateurs Exper Advice for Amaeurs Ernes K. Lai Online Appendix - Exisence of Equilibria The analysis in his secion is performed under more general payoff funcions. Wihou aking an explici form, he payoffs of he

More information

Chapter 2. First Order Scalar Equations

Chapter 2. First Order Scalar Equations Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.

More information

Hamilton- J acobi Equation: Weak S olution We continue the study of the Hamilton-Jacobi equation:

Hamilton- J acobi Equation: Weak S olution We continue the study of the Hamilton-Jacobi equation: M ah 5 7 Fall 9 L ecure O c. 4, 9 ) Hamilon- J acobi Equaion: Weak S oluion We coninue he sudy of he Hamilon-Jacobi equaion: We have shown ha u + H D u) = R n, ) ; u = g R n { = }. ). In general we canno

More information

Solutions Problem Set 3 Macro II (14.452)

Solutions Problem Set 3 Macro II (14.452) Soluions Problem Se 3 Macro II (14.452) Francisco A. Gallego 04/27/2005 1 Q heory of invesmen in coninuous ime and no uncerainy Consider he in nie horizon model of a rm facing adjusmen coss o invesmen.

More information

Inventory Analysis and Management. Multi-Period Stochastic Models: Optimality of (s, S) Policy for K-Convex Objective Functions

Inventory Analysis and Management. Multi-Period Stochastic Models: Optimality of (s, S) Policy for K-Convex Objective Functions Muli-Period Sochasic Models: Opimali of (s, S) Polic for -Convex Objecive Funcions Consider a seing similar o he N-sage newsvendor problem excep ha now here is a fixed re-ordering cos (> 0) for each (re-)order.

More information

THE BELLMAN PRINCIPLE OF OPTIMALITY

THE BELLMAN PRINCIPLE OF OPTIMALITY THE BELLMAN PRINCIPLE OF OPTIMALITY IOANID ROSU As I undersand, here are wo approaches o dynamic opimizaion: he Ponrjagin Hamilonian) approach, and he Bellman approach. I saw several clear discussions

More information

6. Stochastic calculus with jump processes

6. Stochastic calculus with jump processes A) Trading sraegies (1/3) Marke wih d asses S = (S 1,, S d ) A rading sraegy can be modelled wih a vecor φ describing he quaniies invesed in each asse a each insan : φ = (φ 1,, φ d ) The value a of a porfolio

More information

Reserves measures have an economic component eg. what could be extracted at current prices?

Reserves measures have an economic component eg. what could be extracted at current prices? 3.2 Non-renewable esources A. Are socks of non-renewable resources fixed? eserves measures have an economic componen eg. wha could be exraced a curren prices? - Locaion and quaniies of reserves of resources

More information

Lecture Notes 5: Investment

Lecture Notes 5: Investment Lecure Noes 5: Invesmen Zhiwei Xu (xuzhiwei@sju.edu.cn) Invesmen decisions made by rms are one of he mos imporan behaviors in he economy. As he invesmen deermines how he capials accumulae along he ime,

More information

EXERCISES FOR SECTION 1.5

EXERCISES FOR SECTION 1.5 1.5 Exisence and Uniqueness of Soluions 43 20. 1 v c 21. 1 v c 1 2 4 6 8 10 1 2 2 4 6 8 10 Graph of approximae soluion obained using Euler s mehod wih = 0.1. Graph of approximae soluion obained using Euler

More information

On a Fractional Stochastic Landau-Ginzburg Equation

On a Fractional Stochastic Landau-Ginzburg Equation Applied Mahemaical Sciences, Vol. 4, 1, no. 7, 317-35 On a Fracional Sochasic Landau-Ginzburg Equaion Nguyen Tien Dung Deparmen of Mahemaics, FPT Universiy 15B Pham Hung Sree, Hanoi, Vienam dungn@fp.edu.vn

More information

Online Appendix to Optimal Regulation of Financial Intermediaries

Online Appendix to Optimal Regulation of Financial Intermediaries Online Appendix o Opimal Regulaion of Financial Inermediaries Sebasian Di Tella Sanford GSB June 217 Absrac In Secion 1 I develop he conrac environmen in deail. I provide a verificaion heorem for he HJB

More information

Generalized Snell envelope and BSDE With Two general Reflecting Barriers

Generalized Snell envelope and BSDE With Two general Reflecting Barriers 1/22 Generalized Snell envelope and BSDE Wih Two general Reflecing Barriers EL HASSAN ESSAKY Cadi ayyad Universiy Poly-disciplinary Faculy Safi Work in progress wih : M. Hassani and Y. Ouknine Iasi, July

More information

This document was generated at 7:34 PM, 07/27/09 Copyright 2009 Richard T. Woodward

This document was generated at 7:34 PM, 07/27/09 Copyright 2009 Richard T. Woodward his documen was generaed a 7:34 PM, 07/27/09 Copyrigh 2009 Richard. Woodward 15. Bang-bang and mos rapid approach problems AGEC 637 - Summer 2009 here are some problems for which he opimal pah does no

More information

ANSWERS TO EVEN NUMBERED EXERCISES IN CHAPTER 6 SECTION 6.1: LIFE CYCLE CONSUMPTION AND WEALTH T 1. . Let ct. ) is a strictly concave function of c

ANSWERS TO EVEN NUMBERED EXERCISES IN CHAPTER 6 SECTION 6.1: LIFE CYCLE CONSUMPTION AND WEALTH T 1. . Let ct. ) is a strictly concave function of c John Riley December 00 S O EVEN NUMBERED EXERCISES IN CHAPER 6 SECION 6: LIFE CYCLE CONSUMPION AND WEALH Eercise 6-: Opimal saving wih more han one commodiy A consumer has a period uiliy funcion δ u (

More information

SZG Macro 2011 Lecture 3: Dynamic Programming. SZG macro 2011 lecture 3 1

SZG Macro 2011 Lecture 3: Dynamic Programming. SZG macro 2011 lecture 3 1 SZG Macro 2011 Lecure 3: Dynamic Programming SZG macro 2011 lecure 3 1 Background Our previous discussion of opimal consumpion over ime and of opimal capial accumulaion sugges sudying he general decision

More information

Uniqueness of solutions to quadratic BSDEs. BSDEs with convex generators and unbounded terminal conditions

Uniqueness of solutions to quadratic BSDEs. BSDEs with convex generators and unbounded terminal conditions Recalls and basic resuls on BSDEs Uniqueness resul Links wih PDEs On he uniqueness of soluions o quadraic BSDEs wih convex generaors and unbounded erminal condiions IRMAR, Universié Rennes 1 Châeau de

More information

Problem Set on Differential Equations

Problem Set on Differential Equations Problem Se on Differenial Equaions 1. Solve he following differenial equaions (a) x () = e x (), x () = 3/ 4. (b) x () = e x (), x (1) =. (c) xe () = + (1 x ()) e, x () =.. (An asse marke model). Le p()

More information

Risk Aversion Asymptotics for Power Utility Maximization

Risk Aversion Asymptotics for Power Utility Maximization Risk Aversion Asympoics for Power Uiliy Maximizaion Marcel Nuz ETH Zurich AnSAp10 Conference Vienna, 12.07.2010 Marcel Nuz (ETH) Risk Aversion Asympoics 1 / 15 Basic Problem Power uiliy funcion U(x) =

More information

Hamilton Jacobi equations

Hamilton Jacobi equations Hamilon Jacobi equaions Inoducion o PDE The rigorous suff from Evans, mosly. We discuss firs u + H( u = 0, (1 where H(p is convex, and superlinear a infiniy, H(p lim p p = + This by comes by inegraion

More information

(MS, ) Problem 1

(MS, ) Problem 1 MS, 7.6.4) AKTUAREKSAMEN KONTROL I FINANSIERING OG LIVSFORSIKRING ved Københavns Universie Sommer 24 Skriflig prøve den 4. juni 24 kl..-4.. All wrien aids are allowed. The wo problems of oally 3 quesions

More information

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB Elecronic Companion EC.1. Proofs of Technical Lemmas and Theorems LEMMA 1. Le C(RB) be he oal cos incurred by he RB policy. Then we have, T L E[C(RB)] 3 E[Z RB ]. (EC.1) Proof of Lemma 1. Using he marginal

More information

This document was generated at 1:04 PM, 09/10/13 Copyright 2013 Richard T. Woodward. 4. End points and transversality conditions AGEC

This document was generated at 1:04 PM, 09/10/13 Copyright 2013 Richard T. Woodward. 4. End points and transversality conditions AGEC his documen was generaed a 1:4 PM, 9/1/13 Copyrigh 213 Richard. Woodward 4. End poins and ransversaliy condiions AGEC 637-213 F z d Recall from Lecure 3 ha a ypical opimal conrol problem is o maimize (,,

More information

Optimal Investment under Dynamic Risk Constraints and Partial Information

Optimal Investment under Dynamic Risk Constraints and Partial Information Opimal Invesmen under Dynamic Risk Consrains and Parial Informaion Wolfgang Puschögl Johann Radon Insiue for Compuaional and Applied Mahemaics (RICAM) Ausrian Academy of Sciences www.ricam.oeaw.ac.a 2

More information

1. An introduction to dynamic optimization -- Optimal Control and Dynamic Programming AGEC

1. An introduction to dynamic optimization -- Optimal Control and Dynamic Programming AGEC This documen was generaed a :37 PM, 1/11/018 Copyrigh 018 Richard T. Woodward 1. An inroducion o dynamic opimiaion -- Opimal Conrol and Dynamic Programming AGEC 64-018 I. Overview of opimiaion Opimiaion

More information

Dynamic Programming Approach to Principal-Agent Problems

Dynamic Programming Approach to Principal-Agent Problems Dynamic Programming Approach o Principal-Agen Problems Jakša Cvianić, Dylan Possamaï and Nizar ouzi Sepember 23, 215 Absrac We consider a general formulaion of he Principal-Agen problem from Conrac heory,

More information

Seminar 4: Hotelling 2

Seminar 4: Hotelling 2 Seminar 4: Hoelling 2 November 3, 211 1 Exercise Par 1 Iso-elasic demand A non renewable resource of a known sock S can be exraced a zero cos. Demand for he resource is of he form: D(p ) = p ε ε > A a

More information

Solutions to Assignment 1

Solutions to Assignment 1 MA 2326 Differenial Equaions Insrucor: Peronela Radu Friday, February 8, 203 Soluions o Assignmen. Find he general soluions of he following ODEs: (a) 2 x = an x Soluion: I is a separable equaion as we

More information

Backward stochastic dynamics on a filtered probability space

Backward stochastic dynamics on a filtered probability space Backward sochasic dynamics on a filered probabiliy space Gechun Liang Oxford-Man Insiue, Universiy of Oxford based on join work wih Terry Lyons and Zhongmin Qian Page 1 of 15 gliang@oxford-man.ox.ac.uk

More information

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation Course Noes for EE7C Spring 018: Convex Opimizaion and Approximaion Insrucor: Moriz Hard Email: hard+ee7c@berkeley.edu Graduae Insrucor: Max Simchowiz Email: msimchow+ee7c@berkeley.edu Ocober 15, 018 3

More information

arxiv: v1 [math.pr] 21 May 2010

arxiv: v1 [math.pr] 21 May 2010 ON SCHRÖDINGER S EQUATION, 3-DIMENSIONAL BESSEL BRIDGES, AND PASSAGE TIME PROBLEMS arxiv:15.498v1 [mah.pr 21 May 21 GERARDO HERNÁNDEZ-DEL-VALLE Absrac. In his work we relae he densiy of he firs-passage

More information

BU Macro BU Macro Fall 2008, Lecture 4

BU Macro BU Macro Fall 2008, Lecture 4 Dynamic Programming BU Macro 2008 Lecure 4 1 Ouline 1. Cerainy opimizaion problem used o illusrae: a. Resricions on exogenous variables b. Value funcion c. Policy funcion d. The Bellman equaion and an

More information

IMPLICIT AND INVERSE FUNCTION THEOREMS PAUL SCHRIMPF 1 OCTOBER 25, 2013

IMPLICIT AND INVERSE FUNCTION THEOREMS PAUL SCHRIMPF 1 OCTOBER 25, 2013 IMPLICI AND INVERSE FUNCION HEOREMS PAUL SCHRIMPF 1 OCOBER 25, 213 UNIVERSIY OF BRIISH COLUMBIA ECONOMICS 526 We have exensively sudied how o solve sysems of linear equaions. We know how o check wheher

More information

Online Appendix to Solution Methods for Models with Rare Disasters

Online Appendix to Solution Methods for Models with Rare Disasters Online Appendix o Soluion Mehods for Models wih Rare Disasers Jesús Fernández-Villaverde and Oren Levinal In his Online Appendix, we presen he Euler condiions of he model, we develop he pricing Calvo block,

More information

1. An introduction to dynamic optimization -- Optimal Control and Dynamic Programming AGEC

1. An introduction to dynamic optimization -- Optimal Control and Dynamic Programming AGEC This documen was generaed a :45 PM 8/8/04 Copyrigh 04 Richard T. Woodward. An inroducion o dynamic opimizaion -- Opimal Conrol and Dynamic Programming AGEC 637-04 I. Overview of opimizaion Opimizaion is

More information

Cooperative Ph.D. Program in School of Economic Sciences and Finance QUALIFYING EXAMINATION IN MACROECONOMICS. August 8, :45 a.m. to 1:00 p.m.

Cooperative Ph.D. Program in School of Economic Sciences and Finance QUALIFYING EXAMINATION IN MACROECONOMICS. August 8, :45 a.m. to 1:00 p.m. Cooperaive Ph.D. Program in School of Economic Sciences and Finance QUALIFYING EXAMINATION IN MACROECONOMICS Augus 8, 213 8:45 a.m. o 1: p.m. THERE ARE FIVE QUESTIONS ANSWER ANY FOUR OUT OF FIVE PROBLEMS.

More information

Vehicle Arrival Models : Headway

Vehicle Arrival Models : Headway Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where

More information

Dual Representation as Stochastic Differential Games of Backward Stochastic Differential Equations and Dynamic Evaluations

Dual Representation as Stochastic Differential Games of Backward Stochastic Differential Equations and Dynamic Evaluations arxiv:mah/0602323v1 [mah.pr] 15 Feb 2006 Dual Represenaion as Sochasic Differenial Games of Backward Sochasic Differenial Equaions and Dynamic Evaluaions Shanjian Tang Absrac In his Noe, assuming ha he

More information

Dynamic Programming Approach to Principal-Agent Problems

Dynamic Programming Approach to Principal-Agent Problems Dynamic Programming Approach o Principal-Agen Problems Jakša Cvianić, Dylan Possamaï and Nizar ouzi November 21, 2015 Absrac We consider a general formulaion of he Principal-Agen problem wih a lump-sum

More information

An Introduction to Malliavin calculus and its applications

An Introduction to Malliavin calculus and its applications An Inroducion o Malliavin calculus and is applicaions Lecure 5: Smoohness of he densiy and Hörmander s heorem David Nualar Deparmen of Mahemaics Kansas Universiy Universiy of Wyoming Summer School 214

More information

Optimal Consumption and Investment Portfolio in Jump markets. Optimal Consumption and Portfolio of Investment in a Financial Market with Jumps

Optimal Consumption and Investment Portfolio in Jump markets. Optimal Consumption and Portfolio of Investment in a Financial Market with Jumps Opimal Consumpion and Invesmen Porfolio in Jump markes Opimal Consumpion and Porfolio of Invesmen in a Financial Marke wih Jumps Gan Jin Lingnan (Universiy) College, China Insiue of Economic ransformaion

More information

Predator - Prey Model Trajectories and the nonlinear conservation law

Predator - Prey Model Trajectories and the nonlinear conservation law Predaor - Prey Model Trajecories and he nonlinear conservaion law James K. Peerson Deparmen of Biological Sciences and Deparmen of Mahemaical Sciences Clemson Universiy Ocober 28, 213 Ouline Drawing Trajecories

More information

The Asymptotic Behavior of Nonoscillatory Solutions of Some Nonlinear Dynamic Equations on Time Scales

The Asymptotic Behavior of Nonoscillatory Solutions of Some Nonlinear Dynamic Equations on Time Scales Advances in Dynamical Sysems and Applicaions. ISSN 0973-5321 Volume 1 Number 1 (2006, pp. 103 112 c Research India Publicaions hp://www.ripublicaion.com/adsa.hm The Asympoic Behavior of Nonoscillaory Soluions

More information

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,

More information

Sophisticated Monetary Policies. Andrew Atkeson. V.V. Chari. Patrick Kehoe

Sophisticated Monetary Policies. Andrew Atkeson. V.V. Chari. Patrick Kehoe Sophisicaed Moneary Policies Andrew Akeson UCLA V.V. Chari Universiy of Minnesoa Parick Kehoe Federal Reserve Bank of Minneapolis and Universiy of Minnesoa Barro, Lucas-Sokey Approach o Policy Solve Ramsey

More information

On the Timing Option in a Futures Contract

On the Timing Option in a Futures Contract On he Timing Opion in a Fuures Conrac Francesca Biagini, Mahemaics Insiue Universiy of Munich Theresiensr. 39 D-80333 Munich, Germany phone: +39-051-2094459 Francesca.Biagini@mahemaik.uni-muenchen.de Tomas

More information

and Applications Alexander Steinicke University of Graz Vienna Seminar in Mathematical Finance and Probability,

and Applications Alexander Steinicke University of Graz Vienna Seminar in Mathematical Finance and Probability, Backward Sochasic Differenial Equaions and Applicaions Alexander Seinicke Universiy of Graz Vienna Seminar in Mahemaical Finance and Probabiliy, 6-20-2017 1 / 31 1 Wha is a BSDE? SDEs - he differenial

More information

2. Nonlinear Conservation Law Equations

2. Nonlinear Conservation Law Equations . Nonlinear Conservaion Law Equaions One of he clear lessons learned over recen years in sudying nonlinear parial differenial equaions is ha i is generally no wise o ry o aack a general class of nonlinear

More information

Singular control of SPDEs and backward stochastic partial diffe. reflection

Singular control of SPDEs and backward stochastic partial diffe. reflection Singular conrol of SPDEs and backward sochasic parial differenial equaions wih reflecion Universiy of Mancheser Join work wih Bern Øksendal and Agnès Sulem Singular conrol of SPDEs and backward sochasic

More information

Dynamic Contracts with Learning under Ambiguity

Dynamic Contracts with Learning under Ambiguity Dynamic Conracs wih Learning under Ambiguiy Shaolin Ji Li Li Jianjun Miao This Version: March 216 Firs Version: Augus 215 Absrac We sudy a coninuous-ime principal-agen problem wih learning under ambiguiy.

More information

arxiv: v1 [math.pr] 6 Oct 2008

arxiv: v1 [math.pr] 6 Oct 2008 MEASURIN THE NON-STOPPIN TIMENESS OF ENDS OF PREVISIBLE SETS arxiv:8.59v [mah.pr] 6 Oc 8 JU-YI YEN ),) AND MARC YOR 3),4) Absrac. In his paper, we propose several measuremens of he nonsopping imeness of

More information

Finance Research Letters. Maximizing utility of consumption subject to a constraint on the probability of lifetime ruin

Finance Research Letters. Maximizing utility of consumption subject to a constraint on the probability of lifetime ruin Finance Research Leers 5 (28 24 212 Conens liss available a ScienceDirec Finance Research Leers www.elsevier.com/locae/frl Maximizing uiliy of consumpion subjec o a consrain on he probabiliy of lifeime

More information

Dynamic Optimal Contract under Parameter Uncertainty with Risk Averse Agent and Principal

Dynamic Optimal Contract under Parameter Uncertainty with Risk Averse Agent and Principal Dynamic Opimal Conrac under Parameer Uncerainy wih Risk Averse Agen and Principal Kerem Uğurlu Tuesday 19 h Sepember, 2017 Deparmen of Applied Mahemaics, Universiy of Washingon, Seale, WA 98195 e-mails:keremu@uw.edu

More information

Lecture 20: Riccati Equations and Least Squares Feedback Control

Lecture 20: Riccati Equations and Least Squares Feedback Control 34-5 LINEAR SYSTEMS Lecure : Riccai Equaions and Leas Squares Feedback Conrol 5.6.4 Sae Feedback via Riccai Equaions A recursive approach in generaing he marix-valued funcion W ( ) equaion for i for he

More information

SUPPLEMENT TO ROBUST CONTRACTS IN CONTINUOUS TIME (Econometrica, Vol. 84, No. 4, July 2016, )

SUPPLEMENT TO ROBUST CONTRACTS IN CONTINUOUS TIME (Econometrica, Vol. 84, No. 4, July 2016, ) Economerica Supplemenary Maerial SUPPLEMENT TO ROBUST CONTRACTS IN CONTINUOUS TIME (Economerica, Vol. 84, No. 4, July 216, 145 144) BY JIANJUN MIAO ANDALEJANDRO RIVERA THIS SUPPLEMENT CONSIST of wo appendices.

More information

Unit Root Time Series. Univariate random walk

Unit Root Time Series. Univariate random walk Uni Roo ime Series Univariae random walk Consider he regression y y where ~ iid N 0, he leas squares esimae of is: ˆ yy y y yy Now wha if = If y y hen le y 0 =0 so ha y j j If ~ iid N 0, hen y ~ N 0, he

More information

Introduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate.

Introduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate. Inroducion Gordon Model (1962): D P = r g r = consan discoun rae, g = consan dividend growh rae. If raional expecaions of fuure discoun raes and dividend growh vary over ime, so should he D/P raio. Since

More information

1 Review of Zero-Sum Games

1 Review of Zero-Sum Games COS 5: heoreical Machine Learning Lecurer: Rob Schapire Lecure #23 Scribe: Eugene Brevdo April 30, 2008 Review of Zero-Sum Games Las ime we inroduced a mahemaical model for wo player zero-sum games. Any

More information

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance

More information

Physics 127b: Statistical Mechanics. Fokker-Planck Equation. Time Evolution

Physics 127b: Statistical Mechanics. Fokker-Planck Equation. Time Evolution Physics 7b: Saisical Mechanics Fokker-Planck Equaion The Langevin equaion approach o he evoluion of he velociy disribuion for he Brownian paricle migh leave you uncomforable. A more formal reamen of his

More information

Lecture 6: Wiener Process

Lecture 6: Wiener Process Lecure 6: Wiener Process Eric Vanden-Eijnden Chapers 6, 7 and 8 offer a (very) brief inroducion o sochasic analysis. These lecures are based in par on a book projec wih Weinan E. A sandard reference for

More information

MATH 5720: Gradient Methods Hung Phan, UMass Lowell October 4, 2018

MATH 5720: Gradient Methods Hung Phan, UMass Lowell October 4, 2018 MATH 5720: Gradien Mehods Hung Phan, UMass Lowell Ocober 4, 208 Descen Direcion Mehods Consider he problem min { f(x) x R n}. The general descen direcions mehod is x k+ = x k + k d k where x k is he curren

More information

13.3 Term structure models

13.3 Term structure models 13.3 Term srucure models 13.3.1 Expecaions hypohesis model - Simples "model" a) shor rae b) expecaions o ge oher prices Resul: y () = 1 h +1 δ = φ( δ)+ε +1 f () = E (y +1) (1) =δ + φ( δ) f (3) = E (y +)

More information

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II Roland Siegwar Margaria Chli Paul Furgale Marco Huer Marin Rufli Davide Scaramuzza ETH Maser Course: 151-0854-00L Auonomous Mobile Robos Localizaion II ACT and SEE For all do, (predicion updae / ACT),

More information

An introduction to the theory of SDDP algorithm

An introduction to the theory of SDDP algorithm An inroducion o he heory of SDDP algorihm V. Leclère (ENPC) Augus 1, 2014 V. Leclère Inroducion o SDDP Augus 1, 2014 1 / 21 Inroducion Large scale sochasic problem are hard o solve. Two ways of aacking

More information

The Brock-Mirman Stochastic Growth Model

The Brock-Mirman Stochastic Growth Model c December 3, 208, Chrisopher D. Carroll BrockMirman The Brock-Mirman Sochasic Growh Model Brock and Mirman (972) provided he firs opimizing growh model wih unpredicable (sochasic) shocks. The social planner

More information

O Q L N. Discrete-Time Stochastic Dynamic Programming. I. Notation and basic assumptions. ε t : a px1 random vector of disturbances at time t.

O Q L N. Discrete-Time Stochastic Dynamic Programming. I. Notation and basic assumptions. ε t : a px1 random vector of disturbances at time t. Econ. 5b Spring 999 C. Sims Discree-Time Sochasic Dynamic Programming 995, 996 by Chrisopher Sims. This maerial may be freely reproduced for educaional and research purposes, so long as i is no alered,

More information

Appendix 14.1 The optimal control problem and its solution using

Appendix 14.1 The optimal control problem and its solution using 1 Appendix 14.1 he opimal conrol problem and is soluion using he maximum principle NOE: Many occurrences of f, x, u, and in his file (in equaions or as whole words in ex) are purposefully in bold in order

More information

Stochastic Modelling in Finance - Solutions to sheet 8

Stochastic Modelling in Finance - Solutions to sheet 8 Sochasic Modelling in Finance - Soluions o shee 8 8.1 The price of a defaulable asse can be modeled as ds S = µ d + σ dw dn where µ, σ are consans, (W ) is a sandard Brownian moion and (N ) is a one jump

More information

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t...

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t... Mah 228- Fri Mar 24 5.6 Marix exponenials and linear sysems: The analogy beween firs order sysems of linear differenial equaions (Chaper 5) and scalar linear differenial equaions (Chaper ) is much sronger

More information

Introduction to Probability and Statistics Slides 4 Chapter 4

Introduction to Probability and Statistics Slides 4 Chapter 4 Inroducion o Probabiliy and Saisics Slides 4 Chaper 4 Ammar M. Sarhan, asarhan@mahsa.dal.ca Deparmen of Mahemaics and Saisics, Dalhousie Universiy Fall Semeser 8 Dr. Ammar Sarhan Chaper 4 Coninuous Random

More information

Guest Lectures for Dr. MacFarlane s EE3350 Part Deux

Guest Lectures for Dr. MacFarlane s EE3350 Part Deux Gues Lecures for Dr. MacFarlane s EE3350 Par Deux Michael Plane Mon., 08-30-2010 Wrie name in corner. Poin ou his is a review, so I will go faser. Remind hem o go lisen o online lecure abou geing an A

More information

Lecture Notes 3: Quantitative Analysis in DSGE Models: New Keynesian Model

Lecture Notes 3: Quantitative Analysis in DSGE Models: New Keynesian Model Lecure Noes 3: Quaniaive Analysis in DSGE Models: New Keynesian Model Zhiwei Xu, Email: xuzhiwei@sju.edu.cn The moneary policy plays lile role in he basic moneary model wihou price sickiness. We now urn

More information

Optimal Contracts in Continuous-Time Models

Optimal Contracts in Continuous-Time Models Opimal Conracs in Coninuous-Time Models Jakša Cvianić Xuhu Wan Jianfeng Zhang This draf: November 8, 25. Absrac In his paper we presen a unified approach o solving conracing problems wih full informaion

More information

Games Against Nature

Games Against Nature Advanced Course in Machine Learning Spring 2010 Games Agains Naure Handous are joinly prepared by Shie Mannor and Shai Shalev-Shwarz In he previous lecures we alked abou expers in differen seups and analyzed

More information

Online Appendix to Optimal Regulation of Financial Intermediaries

Online Appendix to Optimal Regulation of Financial Intermediaries Online Appendix o Opimal Regulaion of Financial Inermediaries Sebasian Di Tella Sanford GSB Sepember 216 Absrac In Secion 1 I develop he conrac environmen in deail, and provide a verificaion heorem for

More information

Lecture Notes 2. The Hilbert Space Approach to Time Series

Lecture Notes 2. The Hilbert Space Approach to Time Series Time Series Seven N. Durlauf Universiy of Wisconsin. Basic ideas Lecure Noes. The Hilber Space Approach o Time Series The Hilber space framework provides a very powerful language for discussing he relaionship

More information

KEY. Math 334 Midterm III Winter 2008 section 002 Instructor: Scott Glasgow

KEY. Math 334 Midterm III Winter 2008 section 002 Instructor: Scott Glasgow KEY Mah 334 Miderm III Winer 008 secion 00 Insrucor: Sco Glasgow Please do NOT wrie on his exam. No credi will be given for such work. Raher wrie in a blue book, or on your own paper, preferably engineering

More information

Math 333 Problem Set #2 Solution 14 February 2003

Math 333 Problem Set #2 Solution 14 February 2003 Mah 333 Problem Se #2 Soluion 14 February 2003 A1. Solve he iniial value problem dy dx = x2 + e 3x ; 2y 4 y(0) = 1. Soluion: This is separable; we wrie 2y 4 dy = x 2 + e x dx and inegrae o ge The iniial

More information

Optimality Conditions for Unconstrained Problems

Optimality Conditions for Unconstrained Problems 62 CHAPTER 6 Opimaliy Condiions for Unconsrained Problems 1 Unconsrained Opimizaion 11 Exisence Consider he problem of minimizing he funcion f : R n R where f is coninuous on all of R n : P min f(x) x

More information

Math 10B: Mock Mid II. April 13, 2016

Math 10B: Mock Mid II. April 13, 2016 Name: Soluions Mah 10B: Mock Mid II April 13, 016 1. ( poins) Sae, wih jusificaion, wheher he following saemens are rue or false. (a) If a 3 3 marix A saisfies A 3 A = 0, hen i canno be inverible. True.

More information

10. State Space Methods

10. State Space Methods . Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he

More information

Approximation Algorithms for Unique Games via Orthogonal Separators

Approximation Algorithms for Unique Games via Orthogonal Separators Approximaion Algorihms for Unique Games via Orhogonal Separaors Lecure noes by Konsanin Makarychev. Lecure noes are based on he papers [CMM06a, CMM06b, LM4]. Unique Games In hese lecure noes, we define

More information