arxiv: v7 [q-fin.pm] 20 Mar 2019

Transcription

1 Porfolio choice, porfolio liquidaion, and porfolio raniion under drif uncerainy arxiv: v7 [q-finpm] 20 Mar 2019 Alexi Bimuh, Olivier Guéan, Jiang Pu Abrac hi paper preen everal model addreing opimal porfolio choice, opimal porfolio liquidaion, and opimal porfolio raniion iue, in which he expeced reurn of riky ae are unknown Our approach i baed on a coupling beween Bayeian learning and dynamic programming echnique ha lead o parial differenial equaion I enable o recover he well-known reul of Karaza and Zhao in a framework à la Meron, bu alo o deal wih cae where maringale mehod are no longer available In paricular, we addre opimal porfolio choice, porfolio liquidaion, and porfolio raniion problem in a framework à la Almgren-Chri, and we build herefore a model in which he agen ake ino accoun in hi deciion proce boh he liquidiy of ae and he uncerainy wih repec o heir expeced reurn Key word: Opimal porfolio choice, Opimal execuion, Opimal porfolio liquidaion, Opimal porfolio raniion, Bayeian learning, Online learning, Sochaic opimal conrol, Hamilon-Jacobi-Bellman equaion 1 Inroducion he modern heory of porfolio elecion ared in 1952 wih he eminal paper [34] of Markowiz 1 In hi paper, Markowiz conidered he problem of an agen who wihe o build a porfolio wih he maximum poible level of expeced reurn, given a limi level of variance He hen coined he concep of efficien porfolio and decribed how o find uch porfolio Markowiz paved he way for udying heoreically he opimal porfolio choice of rik-avere agen A few year afer Markowiz paper, obin publihed indeed hi famou reearch work on he liquidiy preference of agen and he eparaion heorem ee [45], which i baed on he idea developed by Markowiz A few year laer, in he ixie, reynor, Sharpe, Linner, and Moin inroduced independenly he Capial Ae Pricing Model CAPM which i alo buil on op of he idea of Markowiz he ubiquiou noion of α and β owe a lo herefore o Markowiz modern porfolio heory Alhough iniially wrien wihin a mean-variance opimizaion framework, he o-called Markowiz problem can alo be wrien wihin he Von Neumann-Morgenern expeced uiliy framework hi reearch ha been conduced wih he uppor of he Reearch Iniiaive Modéliaion de marché acion e dérivé financed by HSBC France under he aegi of he Europlace Iniue of Finance he auhor would like o hank Rama Con Imperial College, Nicola Grandchamp de Raux HSBC France, Charle-Alber Lehalle CFM and Imperial College, Jean-Michel Lary Iniu Loui Bachelier, Huyên Pham Univerié Pari-Didero, and Chriopher Ulph HSBC London for he converaion hey had on he ubjec Univerié Pari 1 Panhéon-Sorbonne Cenre d Economie de la Sorbonne 106, Boulevard de l Hôpial, Pari Den-Service de hermo-hydraulique e de mécanique de fluide - Laboraoire de Génie Logiciel pour la Simulaion DEN/SMF/LGLS, CEA, Univerié Pari-Saclay, F-91191, Gif-ur-Yvee, France Iniu Europlace de Finance 28 Place de la Boure, Pari 1 Markowiz wa awarded he Nobel Prize in 1990 for hi work For a brief hiory of porfolio heory, ee [35] 1

2 hi wa for inance done by Samuelon and Meron ee [36, 37, 42], who, in addiion, generalized Markowiz problem by exending he iniial one-period framework o a muli-period one Samuelon did i in dicree ime, wherea Meron did i in coninuou ime I i noeworhy ha hey boh embedded he ineremporal porfolio choice problem ino a more general opimal invemen/conumpion problem 2 In [36], Meron ued parial differenial equaion PDE echnique for characerizing he opimal conumpion proce of an agen and i opimal porfolio choice In paricular, Meron managed o find cloed-form oluion in he conan abolue rik averion CARA cae ie, for exponenial uiliy funcion, and in he conan relaive rik averion CRRA cae ie, for power and log uiliy funcion Meron problem ha hen been exended o incorporae everal feaure uch a ranacion co proporional and fixed or credi conrain Major advance o olve Meron problem in full generaliy have been made in he eighie by Karaza e al uing dual maringale mehod In [26], Karaza, Lehoczky, and Shreve ued a maringale mehod o olve Meron problem for almo any mooh uiliy funcion and howed how o parially dienangle he conumpion maximizaion problem and he erminal wealh maximizaion problem Conrained problem and exenion o incomplee marke were hen conidered ee for inance he paper [11] by Cvianić and Karaza In he lieraure on porfolio elecion or in he lighly more general lieraure on Meron problem, inpu parameer for inance he expeced reurn of riky ae are conidered known conan, or ochaic procee wih known iniial value and dynamic In pracice however, one canno ae for ure ha price reurn will follow a given diribuion Uncerainy on model parameer i he raion d êre of he celebraed Black-Lierman model ee [7], which i buil on op of Markowiz model and he CAPM Neverhele, like Markowiz model, Black-Lierman model i a aic one In paricular, he agen of Black-Lierman model doe no ue empirical reurn o dynamically learn he diribuion of ae reurn Generalizaion of opimal allocaion model or model dealing wih Meron problem involving filering and learning echnique in a parial informaion framework have been propoed in he lieraure he problem ha are addreed are of hree ype depending on he aumpion regarding he drif: unknown conan drif eg [10], [13], [28], unoberved drif wih Ornein- Uhlenbeck dynamic eg [8], [17], [32], [41], and unoberved drif modelled by a hidden Markov chain eg [9], [25], [40], [43] In he differen model, filering or learning enable o eimae he unknown parameer from he dynamic of he price, and omeime alo from addiional informaion uch a analy view or exper opinion ee [14] and [18] or inide informaion ee [13] and [38] Mo model ee [6], [10], [13], [28], [29], [30], [38], [39] ue maringale dual mehod o olve opimal allocaion problem under parial informaion For inance, in a framework imilar o our, Karaza and Zhao [28] conidered a model where he ae reurn are Gauian wih unknown mean and hey ued maringale mehod under he filraion of obervable o compue, for almo any uiliy funcion, he opimal porfolio allocaion here i no conumpion in heir model Some model, like our, ue inead Hamilon-Jacobi-Bellman HJB equaion and herefore PDE echnique Rihel [41] propoed a model wih one riky ae where he drif ha an Ornein- Uhlenbeck dynamic and olved he HJB equaion aociaed wih CRRA uiliy funcion Inereingly, i i one of he rare reference o ackle he queion of exploion when Bayeian filering and opimizaion are carried ou imulaneouly Brendle [8] generalized he reul of [41] o a muli-ae framework and alo conidered he cae of CARA uiliy funcion Fouque e al [17] olved a relaed problem wih correlaion beween he noie proce of he price and ha of he 2 hi problem in coninuou ime i now referred o a Meron problem 2

3 drif and ued perurbaion analyi o obain approximaion Li e al [32] alo udied a imilar problem wih a mean-variance objecive funcion Rieder and Bäuerle [40] propoed a model wih one riky ae where he drif i modelled by a hidden Markov chain and olved i wih PDE in he cae of CRRA uiliy funcion Ouide of he opimal porfolio choice lieraure, everal auhor propoed financial model in which boh online learning and ochaic opimal conrol coexi For inance, Laruelle e al propoed in [31] a model in which an agen opimize i execuion raegy wih limi order and imulaneouly learn he parameer of he Poion proce modelling he execuion of limi order Inereing idea in he ame field of algorihmic rading can alo be found in he work of Fernandez-apia ee [16] An inereing paper i alo ha of Ekröm and Vaicenaviciu [15] who ackled he problem of he opimal ime a which o ell an ae wih unknown drif Recenly, Cagrain and Jaimungal [9] alo ued imilar idea for deigning algorihmic rading raegie In hi paper, we conider everal problem of porfolio choice, porfolio liquidaion, and porfolio raniion in coninuou ime in which he conan expeced reurn of he riky ae are unknown bu eimaed online In he fir ecion, we conider a mulidimenional porfolio choice problem imilar o he one ackled by Karaza and Zhao in [28] wih a raher general Bayeian prior for he drif our family of prior include compacly uppored and Gauian diribuion 3 For hi problem, wih general Bayeian prior, we derive HJB equaion and how ha, in he CARA and CRRA cae, hee equaion can be ranformed ino linear parabolic PDE he inere of he paper lie here in he fac ha our framework i mulidimenional and general in erm of poible prior Moreover, unlike oher paper, we provide a verificaion reul and hi i imporan in view of he exploion occurring for ome couple of prior and uiliy funcion We hen pecify our reul in he cae of a Gauian prior for he drif and recover formula already preen in he lieraure ee [28] or limi cae of [8] he Gauian prior cae i dicued in deph, i becaue he aociaed PDE can be implified ino imple ODE a lea for CARA and CRRA uiliy funcion ha can be olved in cloed form by uing claical rick, and ii becaue Gauian prior provide example of exploion: he problem may no be well poed in he CRRA cae when he relaive rik averion parameer i oo mall he PDE approach i inereing in ielf and we believe ha i enable o avoid he laboriou compuaion needed o implify he general expreion of Karaza and Zhao However, our meage i of coure no limied o ha one he PDE approach can indeed be ued in iuaion where he dual maringale approach canno be ued In he la ecion of hi paper, we ue our approach o olve he opimal allocaion problem in a rading framework à la Almgren-Chri he Almgren-Chri framework wa iniially buil for olving opimal execuion problem ee [1, 2] bu i i alo very ueful ouide of he cah-equiy world For inance, Almgren and Li [3], and Guéan and Pu [22] ued i for he pricing and hedging of vanilla opion when liquidiy maer 4 he model we propoe i one of he fir model ha ue he Almgren-Chri framework for addreing an ae managemen problem, and definiely he fir paper in hi area in which he Almgren-Chri framework i ued in combinaion wih Bayeian learning echnique 5 We alo how how our framework can be lighly modified for addreing opimal porfolio liquidaion and raniion iue hi paper aim a proving ha online learning in our cae on-he-fly Bayeian eimaion combined wih ochaic opimal conrol can be very efficien o ackle a lo of financial problem 3 I i noeworhy ha hi approach can be carried ou in he frequeni cae a well 4 Guéan e al alo ued he Almgren-Chri framework o ackle he pricing, hedging, and execuion iue of Acceleraed Share Repurchae conrac ee [20, 23] 5 Almgren and Lorenz ued Bayeian echnique in opimal execuion ee [4], bu hey conidered myopic agen wih repec o learning 3

4 I i eenial o underand ha online learning i a forward proce wherea dynamic programming claically relie on backward inducion By uing hee wo claical ool imulaneouly, we do no only benefi from he power of online and Bayeian learning o coninuouly learn he value of unknown parameer, bu we alo develop a framework in which agen learn and make deciion knowing ha hey will go on learning in he fuure in he ame manner a hey have learn in he pa he ame idea are for inance a play in he lieraure on Bayeian muliarmed bandi where he unknown parameer are he parameer of he prior diribuion of he differen reward In Secion 2, we provide he main reul relaed o our Bayeian framework We fir compue he Bayeian eimaor of he drif enering he dynamic of price more preciely he condiional mean given he price rajecory and he prior We hen derive he dynamic of ha Bayeian eimaor hee reul are claical and can be found in [5] or [33], bu hey are recalled for he ake of compleene In Secion 3, we conider he porfolio allocaion problem of an agen in a conex wih one rik-free ae and d riky ae, and we how how he aociaed HJB equaion can be ranformed ino linear parabolic PDE in he cae of a CARA uiliy funcion and of a CRRA uiliy funcion A oppoed o mo of he paper in he lieraure, we alo provide verificaion heorem hi i of paricular imporance becaue he Bayeian framework lead o blowup for ome of he opimal conrol problem In Secion 4, we olve he ame porfolio allocaion problem a in Secion 3 bu in he pecific cae of a Gauian prior We how ha a more naural e of ae variable can be ued o olve he ame problem We alo provide an example of blowup in he Gauian cae In Secion 4, hank o cloed-form oluion, we alo analyze he role of learning on he dynamic of he allocaion proce of he agen In Secion 5, we inroduce liquidiy co hrough a modelling framework à la Almgren-Chri and we ue our combinaion of Bayeian learning and ochaic opimal conrol echnique for olving variou porfolio choice, porfolio liquidaion, and porfolio raniion problem 2 Bayeian learning 21 Noaion and fir properie We conider an agen facing a porfolio allocaion problem wih one rik-free ae and d riky ae Le Ω, F W, P be a filered probabiliy pace, wih F W R + aifying he uual condiion Le W R+ R + be a d-dimenional Brownian moion adaped o F W R +, wih correlaion rucure given by d W i, W j = ρij d for all i, j in {1,, d} he rik-free inere rae i denoed by r We index by i {1,, d} he d riky ae For i {1,, d}, he price of he i h ae S i ha he claical log-normal dynamic ds i = µ i S i d + σ i S i dw i, 1 where he volailiy vecor σ = σ 1,, σ d aifie i {1,, d}, σ i > 0, and where he drif vecor µ = µ 1,, µ d i unknown We aume ha he prior diribuion of µ, denoed by m µ, i ub-gauian 6 In paricular, i aifie he following propery: η > 0, E[e η µ 2 2 ] = m µ dz < + 2 z R d e η z 6 hi aumpion can be lighly relaxed, bu we conider hi imple one o implify he aemen of our reul 4

5 hroughou, we hall repecively denoe by ρ = ρ ij 1 i,j d and Σ = ρ ij σ i σ j 1 i,j d he correlaion and covariance marice aociaed wih he dynamic of price We alo denoe by Y R+ he proce defined by i {1,, d}, R +, Y i = log S i 3 Remark 1 Boh µ and W R+ are unoberved by he agen, bu for each index i {1,, d}, µ i + σ i W i i oberved a ime R + becaue µ i + σ i W i = Y i Y i σi2 4 he evoluion of he price reveal informaion o he agen abou he rue value of he drif vecor µ In wha follow we denoe by F S = F S R + he filraion generaed by S R+ or equivalenly by Y R+ Remark 2 W R+ i no an F S -Brownian moion, becaue i i no F S -adaped We inroduce he proce β R+ defined by R +, β = E [ µ F S ] 5 Remark 3 β R+ i well defined becaue of he aumpion 2 on he prior m µ From an inveor poin of view, β R+ i of main concern I encapulae he informaion gahered o far abou he reurn one can expec from he ae he fir reul aed in heorem 1 i a formula for β heorem 1 Le u define [ F :, y R + R d exp z r 1 Σ 1 y Y 0 + r σ σ ] R 2 z r 1 m µ dz, d where denoe he elemen-wie muliplicaion of vecor F i a well-defined finie-valued C R + R d funcion We have R +, β = ΣG, Y + r 1, 7 6 where G = yf F, 8 and where we denoe by 1 he vecor 1,, 1 R d Before we prove heorem 1, le u inroduce he probabiliy meaure Q defined by αµ ρ 1 W 1 2 αµ ρ 1 αµ dq dp = exp, 9 where α : z = z 1,, z d R d z 1 r σ,, zd r 1 σ and i an arbirary conan in R d + 5

6 Giranov heorem implie ha he proce W Q defined by [0, ] i {1,, d}, [0, ], i W Q = W i + µi r σ i, 10 i a d-dimenional Brownian moion wih correlaion rucure given by ρ under Q and adaped o he filraion F S Moreover [0, ] i {1,, d}, ds i S i = rd + σ i dw Q i and dy i = he following propoiion will be ued in he proof of heorem 1 r σi2 2 d + σ i dw Q Propoiion 1 Under he probabiliy meaure Q, µ i independen of W Q for all [0, ] i 11 Proof Since, for all [0, ], µ i independen of W under he probabiliy meaure P, we have, for, a, b [0, ] R d R d, [ ] E Q exp ia µ + ib W Q [ = E exp ia µ + ib W + αµ αµ ρ 1 W 1 ] 2 αµ ρ 1 αµ [ = E exp ia µ + ib αµ 1 2 αµ ρ 1 αµ E [ exp ib W αµ ρ 1 ] ] W µ [ = E exp ia µ + ib αµ 1 2 αµ ρ 1 αµ E [ exp ib W αµ ρ 1 W W αµ ρ 1 ] ] W µ [ = E exp ia µ + ib αµ 1 2 αµ ρ 1 αµ 1 1 exp 2 αµ ρ 1 αµ exp ib ρ 1 αµ ρ ib ρ 1 αµ ] 2 = E [exp ia µ] exp 2 b ρb Now, le u noice ha [ E Q [exp ia µ] = E exp ia µ dq ] [ ] = E dq dp exp ia µ E dp µ = E [exp ia µ] }{{} =1 and exp 2 b ρb i he Fourier ranform of W Q under he probabiliy meaure Q herefore, [ ] E Q exp ia µ + ib W Q [ ] = E Q [exp ia µ] E Q exp ib W Q, hence he reul 6

7 We are now ready o prove heorem 1 Proof of heorem 1 Le u fir how ha F i a well-defined finie-valued C R + R d funcion We have, y, z R + R d R d, [ exp z r 1 Σ 1 y Y 0 + exp z r 1 Σ 1 [ y Y 0 + r σ σ r σ σ herefore, o how ha F ake finie value, we ju need o prove ha for a R d, R d expa zm µ dz = E [expa µ] < + hank o condiion 2 on he prior, here exi η > 0 uch ha E herefore, [ a R d, E [exp µ a] =E exp a µ η µ 2 exp η µ 2] exp up a z η z 2 E z R d a 2 [ exp E exp η µ 2] 4η < + Conequenly, F i well defined and ake finie value ] 2 z r 1 ] [ exp η µ 2] < + [ exp η µ 2] For proving ha F i in fac a C R + R d funcion, we ee by formal derivaion ha i i ufficien o prove ha, for all n N, a R d z n expa zm µ dz = E [ µ n expa µ] R d i bounded over all compac e of R d We have [ a R d, n N, E [ µ n exp a µ] =E µ n exp a µ η µ 2 exp η µ 2] z n exp a z η z 2 E hence he reul up z R d up z R d z n < +, We are now ready o prove he formula for β By Baye heorem we have, for all in [0, ], ] E [µ Q dp dq F S β = [ ] E Q dp F S [ exp η µ 2] exp z a η z 2 [ E exp η µ 2] dq 7

8 Since we have β = dp dq = exp αµ ρ 1 W Q 2 αµ ρ 1 αµ, E [µ Q exp αµ ρ 1 W Q 2 αµ ρ 1 αµ E [exp Q αµ ρ 1 W Q 2 αµ ρ 1 αµ F S F S ] ] Propoiion 1 now yield ] E [µ Q exp αµ ρ 1 W Q 2 αµ ρ 1 αµ F S β = ] E [exp Q αµ ρ 1 W Q 2 αµ ρ 1 αµ F S z exp αz ρ 1 W Q 2 αz ρ 1 αz m µ dz = R d exp αz ρ 1 W Q 2 αz ρ 1 αz m µ dz R d z exp z r 1 Σ 1 Y Y 0 + r σ σ 2 αz ρ 1 αz m µ dz = R d R d exp z r 1 Σ 1 Y Y 0 + r σ σ 2 αz ρ 1 αz m µ dz Conequenly Σ 1 β r 1 Σ 1 z r 1 exp z r 1 Σ 1 Y Y 0 + r σ σ 2 αz ρ 1 αz m µ dz = R d exp z r 1 Σ 1 Y Y 0 + r σ σ 2 αz ρ 1 αz m µ dz R d = yf F, Y = G, Y herefore, and becaue i arbirary, we have R +, β = ΣG, Y + r 1 hroughou hi aricle, we aume ha he prior m µ i uch ha G ha he following Lipchiz propery wih repec o y: > 0, K > 0, [0, ], y R d, D y G, y K 12 A we hall ee below, hi aumpion i verified if m µ ha a compac uppor I i alo verified for m µ Gauian ee Propoiion 12 for inance 7 However, i i no rue in general for all ub-gauian prior 7 Becaue we are dealing wih ae reurn, he cla of compacly uppored diribuion i ufficien, from a financial poin of view, o deal wih almo all relevan cae Gauian diribuion are no in ha cla bu Gauian prior are approximaion of real-life belief ha are ued mainly for heir convenience in compuaion 8

9 22 Dynamic of β R+ Le u define he proce Ŵ R + by i {1,, d}, R +, Ŵ i = W i µ i β i + 0 σ i d 13 Remark 4 he proce Ŵ R+ i called he innovaion proce in filering heory A hown below for he ake of compleene, i i claically known o be a Brownian moion ee for inance [5] on coninuou Kalman filering Propoiion 2 Ŵ i a d-dimenional Brownian moion adaped o F S R R +, wih he + ame correlaion rucure a W R+, ie, i, j {1,, d}, d Ŵ i, Ŵ j = d W i, W j = ρ ij d Proof o prove hi reul, we ue Lévy characerizaion of a Brownian moion Le R + By definiion, we have i {1,, d}, Ŵ i = 1 S i log σ i hence he F S -meaurabiliy of Ŵ Le, R +, wih < For i {1,, d}, ] i E [Ŵ Ŵ i F S S i 0 = E [ [ W i W i F S ] + E + 1 β 2 σi2 i 0 σ i d, 1 σ i µi βudu i F S For he fir erm, he incremen W i W i i independen of F W and independen of µ herefore, i i independen of F S and we have E [ W i W i ] F S = E[W i W] i = 0 ] Regarding he econd erm, we have [ ] 1 E σ i µi βudu i F S = = = 0, [ 1 E E σ i µi βu i F S [ 1 σ i µi βu i F u S [ E ] du ] ] F S du by definiion of β i u We obain ha Ŵ R + i an F S -maringale Since Ŵ R+ ha coninuou pah and d Ŵ i, Ŵ j = ρ ij d, we conclude ha Ŵ R+ i a d-dimenional F S -Brownian moion wih correlaion rucure given by ρ We are now ready o ae he dynamic of β R+ 9

10 heorem 2 β R+ ha he following dynamic: dβ = ΣD y G, Y σ dŵ 14 Proof By Iō formula and heorem 1, we have = G, Y d + = G, Y + + Σ 1 dβ = G, Y d + d i=1 yi G, Y dy i d ρ ij σ i σ j y 2 iy j G, Y d i,j=1 d yi G, Y βd i + σ i dŵ i σi2 2 d i=1 d yi G, Y r + ΣG i, Y σi i=1 d σ i yi G, Y dŵ i i=1 d ρ ij σ i σ j y 2 iy j G, Y d i,j=1 d ρ ij σ i σ j y 2 iy j G, Y d i,j=1 Becaue β R+ i a maringale under P, F S, we have dβ = d i=1 σ i Σ yi G, Y dŵ i = ΣD y G, Y σ dŵ he reul obained above heorem 1 and 2 will be ueful in he nex ecion on opimal porfolio choice he proce β R+ indeed repreen he be eimae of he drif in he dynamic of he price 23 A few remark on he compac uppor cae he reul preened in he nex ecion of hi paper are valid for ub-gauian prior diribuion m µ aifying 12 A pecial cla of uch prior diribuion i ha of diribuion wih compac uppor We have indeed he following propoiion: Propoiion 3 If m µ ha a compac uppor, hen G and all i derivaive are bounded over R + R d Proof Le u conider i {1,, d} By definiion, he i h coordinae of G i G i = y i F F herefore, by immediae inducion, n N, j 1,, j n {1,, d}, n N, n n y j 1 y jn G i i he um and produc of erm of he form m m y k 1 y km F F, for m, m N, k 1,, k m {1,, d} 10

11 Now, for, y R + R d, and for m, m N, k 1,, k m {1,, d}, = m m y k 1 ykm F, y F, y z r 1 Σ r σ σ 1 m m 2 αz ρ 1 αz z r 1 Σ 1 e kp f, y, zm µ dz R d f, y, zm µ dz p=1, R d where f, y, z = exp z r 1 Σ 1 y Y 0 + r σ σ 2 αz ρ 1 αz, and where e k 1 k d i he canonical bai of R d herefore km F, y F, y up z r 1 Σ r σ σ m m y k 1 y z upporm µ < +, hence he reul 1 m m 2 αz ρ 1 αz p=1 z r 1 Σ 1 e kp In addiion o howing ha he Lipchiz hypohei 12 i rue when m µ ha a compac uppor, Propoiion 3 will be ueful in Secion 3 o provide a large cla of prior for which here i no blowup phenomenon in he equaion characerizing he opimal porfolio choice of an agen 3 Opimal porfolio choice In hi ecion we proceed wih he udy of opimal porfolio choice For ha purpoe, le u e an invemen horizon R + Le u alo inroduce he noion of linear growh for a proce in our d-dimenional conex hi noion play an imporan par in he verificaion heorem Definiion 1 Le u conider [0, ] An R d -valued, meaurable, and F S -adaped proce ζ [, ] i aid o aify he linear growh condiion wih repec o ξ = ξ [, ] if, C > 0, [, ], ζ C 1 + up ξ τ τ [,] he fir ubecion i devoed o he CARA cae, and he econd one focue on he CRRA cae 11

12 31 CARA cae We conider he porfolio choice of he agen in he CARA cae We denoe by γ > 0 hi abolue rik averion parameer We define, for [0, ] he e { A = M [, ], R d -valued F S -adaped proce aifying he linear growh condiion wih repec o Y [, ] } We denoe by M [0, ] A = A 0 he R d -valued proce modelling he raegy of he agen More preciely, i {1,, d}, M i repreen he amoun inveed in he i h ae a ime he reuling value of he agen porfolio i modelled by a proce V [0, ] wih V 0 > 0 he dynamic of V [0, ] i given by he following ochaic differenial equaion SDE: dv = M µ r 1 + rv d + M σ dw 15 Wih he noaion inroduced in Secion 2, we have dv = M β r 1 + rv d + M σ dŵ = M ΣG, Y + rv d + M σ dŵ, and dy = r 1 + ΣG, Y 12 σ σ d + σ dŵ Given M A and, we define herefore Y,y = y + V,V,y,M = V + r 1 + ΣGτ, Y,y τ 1 2 σ σ dτ + σ Ŵ Ŵ, 16 M τ ΣGτ, Y,y τ + rv,v,y,m τ dτ + M τ σ dŵτ 17 For an arbirary iniial ae V 0, y 0, he agen maximize, over M in he e of admiible raegie A, he expeced uiliy of hi porfolio value a ime, ie, [ ] E exp γv 0,V0,y0,M he value funcion v aociaed wih hi problem i hen defined by [ v :, V, y [0, ] R R d up E exp M [, ] A γv,v,y,m he HJB equaion aociaed wih hi problem i u + rv V u + y u r 1 + ΣG 1 2 σ σ r Σ 2 yyu + up M R d wih erminal condiion { V um ΣG M ΣM 2 V V u + M Σ V y u ] 18 } = 0, 19 V, y R R d, u, V, y = exp γv 20 o olve he HJB equaion, we ue he following anaz: [ ] u, V, y = exp γ e r V + φ, y 21 12

13 Propoiion 4 Suppoe here exi φ C 1,2 [0, ] R d aifying wih erminal condiion φ + y φ r σ σ r Σ 2 yyφ + 1 2γ G ΣG = 0, 22 y R d, φ, y = 0 23 hen u defined by 21 i oluion of he HJB equaion 19 wih erminal condiion 20 Moreover, he upremum in 19 i achieved a: M, y = e r G, y γ y φ, y 24 Proof Le u conider φ C 1,2 [0, ] R d oluion of 22 wih erminal condiion 23 For u defined by 21 and by conidering M = Me r, we have u + rv V u + y u r 1 + ΣG 1 2 σ σ r Σ 2 yyu + up = γu M R d γu 2 { V um ΣG + 1 } 2 M ΣM V 2 V u + M Σ V y u rv e r + φ γue r rv γu y φ r 1 + ΣG 1 2 σ σ γr Σ y φ y φ + r Σ 2 yyφ γu up { M ΣG γ 2 M Σ M γ M } Σ y φ M R d he upremum in he above expreion i reached a M = G γ yφ, correponding o M, y = e r G, y γ y φ, y 25 Plugging hi expreion in he parial differenial equaion, we ge: u + rv V u + y u r 1 + ΣG 1 2 σ σ r Σ 2 yyu + up M R d { V um ΣG + 1 } 2 M ΣM V 2 V u + M Σ V y u [ = γu rv e r + φ + e r rv + y φ r 1+ ΣG 12 σ σ γ 2 yφ Σ y φ r Σ 2 yyφ + γ [ ] [ ] ] G G 2 γ yφ Σ γ yφ = γu [ φ + y φ r 1 + ΣG 12 σ σ ΣG r Σ 2 yyφ + 1 ] 2γ G ΣG = 0 A i i raighforward o verify ha u aifie he erminal condiion 20, he reul i proved 13

14 From he previou propoiion, we ee ha olving he HJB equaion 19 wih erminal condiion 20 boil down o olving 22 wih erminal condiion 23 Becaue 22 i a imple parabolic PDE, we can eaily build a rong oluion Propoiion 5 Le u define φ :, y [0, ] R d E Q [ 1 2γ G, Y,y ΣG, Y,y d ], 26 where, y [0, ] R d, [, ], Y,y = y + r 1 12 σ σ + σ W Q W Q hen φ i a C 1,2 [0, ] R d funcion, oluion of 22 wih erminal condiion 23 Furhermore, A > 0, [0, ], y R d, i {1,, d}, y φ, y A 1 + y 27 Proof Becaue of he aumpion 12 on G, he fir par of he propoiion i a conequence of claical reul for parabolic PDE and of he claical Feynman-Kac repreenaion ee for inance [19, 27] For he econd par, we noice fir ha, y [0, ] R d, y φ, y = E Q [ ] 1 γ D Y G, Y,y ΣG, Y,y d herefore, by 12, here exi a conan C 0 uch ha, y [0, ] R d, y φ, y C up E Q [ G, Y,y ] 28 [, ] By 12 again, here exi a conan C 0 uch ha G, Y,y G, Y,y G, y + G, y G, Y,y G, y + C 1 + y 29 Now, by heorem 2, [, ], herefore, G, Y,y G, y = D Y Gτ, Y,y τ σ dŵτ E Q [ G, Y,y G, y ] [ = E D Y Gτ, Yτ,y σ dŵτ Now, for p 1, we have [ p ] dq E dp ] dq dp [ = E exp pαµ ρ 1 W p ] 2 αµ ρ 1 αµ [ ] pp 1 = E exp αµ ρ 1 αµ 2 14

15 Becaue m µ i ub-gauian, here exi p > 1 uch ha dq dp Lp Ω, P Becaue of he Lipchiz aumpion on G, we have for any q > 1, and in paricular for q uch ha 1 p + 1 q = 1, ha [ q] up up E D Y Gτ, Yτ,y σ dŵτ < + herefore,,y [0, ] R d [, ] up up,y [0, ] R d [, ] [ E D Y Gτ, Y,y τ σ dŵτ ] dq < + dp We can conclude ha E Q [ G, Y,y G, y ] i bounded uniformly, and herefore uing Eq 28 and 29 ha y φ i indeed a mo linear in y uniformly in [0, ] Uing he above reul, we know ha here exi a C 1,2,2 [0, ] R R d funcion u oluion of he HJB equaion 19 wih erminal condiion 20 By uing a verificaion argumen, we can how ha u i in fac he value funcion v defined in Eq 18 and hen olve he problem faced by he agen hi i he purpoe of he following heorem heorem 3 Le u conider he C 1,2 [0, ] R d funcion φ defined by 26 Le u hen conider he aociaed funcion u defined by 21 For all, V, y [0, ] R R d and M = M [, ] A, we have [ ] E exp u, V, y 30 γv,v,y,m Moreover, equaliy in 30 i obained by aking he opimal conrol M [, ] A given by 24, ie, G, Y [, ], M = e r,y y φ, Y,y γ In paricular u = v Proof From he Lipchiz propery of G aed in Eq 12 and he propery of φ aed in Eq 27, we ee ha M [, ] i indeed admiible ie, M [, ] A Le u hen conider, V, y [0, ] R R d and M = M [, ] A By Iō formula, we have for all [, ] du, V,V,y,M, Y,y = u, V,V,y,M, Y,y V V u, V,V,y,M d + V u, V,V,y,M, Y,y +M Σ V y u, V,V,y,M = L M u, V,V,y,M, Y,y d where + V u, V,V,y,M, Y,y L M u, V,V,y,M = u, V,V,y,M + y u, V,V,y,M, Y,y dv,v,y,m M ΣM d r Σ 2 yyu, V,V,y,M, Y,y d M + y u, V,V,y,M, Y,y, Y,y + V u, V,V,y,M, Y,y V V u, V,V,y,M + y u, V,V,y,M d, Y,y, Y,y σ dŵ, r 1 + ΣG, Y,y 1 2 σ σ, Y,y +M Σ V y u, V,V,y,M, Y,y rv,v,y,m + M ΣG, Y,y M ΣM r Σ 2 yyu, V,V,y,M, Y,y 15, Y,y, Y,y dy,y

16 Noe ha we have V u, V,V,y,M = γu, V,V,y,M, Y,y, Y,y M + y u, V,V,y,M, Y,y e r M + y φ, Y,y Le u ubequenly define, for all [, ], κ M = γ e r M + y φ, Y,y, and We have and herefore d ξ, M = exp κ M τ σ dŵτ dξ M, = ξ M,κ M 1 2 σ dŵ κ M τ Σκ M τ dτ d ξ, M 1 = ξ M 1, κ M σ dŵ + ξ, M 1 κ M Σκ M d u, V,V,y,M = u, V,V,y,M, Y,y ξ M 1,, Y,y ξ, M 1 L M u, V,V,y,M 1 κ M σ dŵ + ξ, M 1 κ M Σκ M d + ξ, M, Y,y d + u, V,V,y,M, Y,y κ M σ dŵ ξ, M 1 u, V,V,y,M, Y,y κ M Σκ M d = ξ, M 1 L M u, V,V,y,M, Y,y d By definiion of u, L M u, V,V,y,M, Y,y 0 and L M u, V,V,y,M conequence, u, V,V,y,M, Y,y ξ M 1, i nonincreaing, and herefore wih equaliy when M [, ] = M [, ] Subequenly, E [ exp γv,v,y,m [, ] u, V,V,y,M, Y,y u, V, yξm,, ] [ = E wih equaliy when M [, ] = M [, ] u, V,V,y,M, Y,y = 0 if M = M A a, Y,y ] u, V, ye [ ξ M, ], o conclude he proof le u how ha E [ ] ξ, M = 1 o do o, we will ue he fac ha ξ M, = 1 and prove ha ξ, M [, i a maringale under P, F S ] [, ] Becaue M A, and becaue of Eq 27, we know ha here exi a conan C uch ha up κ M 2 C 1 + up Y,y 2 [, ] [, ] By definiion of Y,y [, ], here exi herefore a conan C uch ha up κ M [, ] 2 C 1 + µ 2 + up W W 2 [, ] 16

17 Now, by uing he above inequaliy along wih Eq 2 and claical properie of he Brownian moion, we eaily prove ha [ ] 1 +ɛ ɛ > 0, [, ], E exp κ M Σκ M 2 d < + 31 From Novikov condiion or more exacly one of i corollary ee for inance Corollary 514 in [27], we ee ha ξ, M [, i a maringale under P, F S ], hence he reul [, ] [ ] E exp u, V, y, γv,v,y,m wih equaliy when M [, ] = M [, ] herefore, [ u, V, y = v, V, y = up exp M [, ] A E γv,v,y,m ] [ = E exp γv,v,y,m ] he opimal porfolio choice of an agen wih a CARA uiliy funcion i herefore fully characerized Le u now urn o he cae of an agen wih a CRRA uiliy funcion 32 CRRA cae We conider he porfolio choice of he agen in he CRRA cae We denoe by γ > 0 he relaive rik averion parameer We denoe by U γ he uiliy funcion of he agen, ie, V 1 γ U γ : V R if γ γ log V if γ = 1 If γ < 1, we define for [0, ] he e { [ ] } A γ = θ [, ], R d -valued F S -adaped proce, E θd 2 < + If γ 1, we define for [0, ] he e { A γ = θ [, ], R d -valued F S -adaped proce aifying he linear growh condiion wih repec o Y [, ] } We denoe by θ [0, ] A γ = A γ 0 he Rd -valued proce modelling he raegy of he agen More preciely, i {1,, d}, θ i repreen he par of he wealh inveed in he i h riky ae a ime he reuling value of he agen porfolio i modelled by a proce V [0, ] wih V 0 > 0 he dynamic of V [0, ] i given by he following ochaic differenial equaion SDE: dv = θ µ r 1 + r V d + V θ σ dw 32 Wih he noaion inroduced in Secion 2, we have dv = θ β r 1 + r V d + V θ σ dŵ = θ ΣG, Y + r V d + V θ σ dŵ, 17

18 and dy = r 1 + ΣG, Y 12 σ σ d + σ dŵ Given θ A γ Y,y = y + V,V,y,θ = V + and, we define r 1 + ΣGτ, Y,y τ 1 2 σ σ dτ + σ Ŵ Ŵ, 33 θ τ ΣGτ, Yτ,y + r Vτ,V,y,θ dτ + V,V,y,θ τ θ τ σ dŵτ 34 For an arbirary iniial ae V 0, y 0, he agen maximize, over θ in he e of admiible raegie A γ, he expeced uiliy of hi porfolio value a ime, ie, [ ] E U γ V 0,V0,y0,θ he value funcion v aociaed wih hi problem i hen defined by [ v :, V, y [0, ] R + R d up θ [, ] A γ E U γ V,V,y,θ ] 35 he HJB equaion aociaed wih hi problem i given by u + y u r 1 + ΣG 1 2 σ σ r Σ 2 yyu + rv V u + up {V V uθ ΣG + V 2 } θ R 2 θ Σθ V 2 V u + V θ Σ V y u d wih erminal condiion = 0, 36 V R +, y R d, u, V, y = U γ V 37 o olve he HJB equaion and hen olve he opimal porfolio choice problem, we need o conider eparaely he cae γ = 1 and γ he γ 1 cae o olve he HJB equaion when γ 1, we ue he following anaz: u, V, y = U γ e r V φ, y γ 38 Propoiion 6 Suppoe here exi a poiive funcion φ C 1,2 [0, ] R d aifying φ + y φ r γ ΣG 1 2 σ σ r Σ 2 yyφ 1 γ + φ 2γ 2 G ΣG = 0, 39 wih erminal condiion y R d, φ, y = 1 40 hen u defined by 38 i oluion of he HJB equaion 36 wih erminal condiion 37 Moreover, he upremum in 36 i achieved a θ, y = G, y γ + yφ, y φ, y 41 18

19 Proof Le u conider φ C 1,2 [0, ] R d, poiive oluion of 39 wih erminal condiion 40 For u defined by 38, we have: u + y u r 1 + ΣG 1 2 σ σ r Σ 2 yyu + rv V u + up {V V uθ ΣG + V 2 θ R d = γu φ φ + γu yφ φ +1 γu up θ R d } 2 θ Σθ V 2 V u + V θ Σ V y u r 1 + ΣG 12 σ σ + γu { θ ΣG γ 2 θ Σθ + γθ Σ } yφ φ he upremum in he above expreion i reached a = γu φ θ, y = G, y γ 2φ r Σ 2 yyφ + + yφ, y φ, y Plugging hi expreion in he parial differenial equaion, we ge: u + y u r 1 + ΣG 1 2 σ σ r Σ 2 yyu + rv V u + up {V V uθ ΣG + V 2 } θ R 2 θ Σθ V 2 V u + V θ Σ V y u [ d φ + y φ r 1 + ΣG 12 σ σ r Σ 2 yyφ + = γu φ = 0 +1 γ φ G 2 γ + yφ G Σ φ γ + ] yφ φ [ φ + y φ r 1 + 1γ ΣG 12 σ σ r Σ 2 yyφ + γγ 1u 2φ 2 r Σ y φ y φ γ 1 2φ yφ Σ y φ ] 1 γφ 2γ 2 G ΣG A i i raighforward o verify ha u aifie he erminal condiion 37, he reul i proved For olving our problem, we would like o prove ha here exi a poiive C 1,2 [0, ] R d funcion φ oluion of 39 wih erminal condiion 40 uch ha yφ φ i a mo linear in y However, unlike wha happened in he CARA cae, here i no guaranee, in general, ha uch a funcion exi We will even how in Secion 4 ha here are blowup cae for ome Gauian prior in he cae γ < 1 Even hough here i no general reul, we can ae for inance a reul in he cae of a prior diribuion m µ wih compac uppor Propoiion 7 Le u uppoe ha he prior diribuion m µ ha compac uppor Le u define φ :, y [0, ] R d E [ exp 1 γ 2γ 2 G, Z,y ΣG, Z,y d ], 42 19

20 where, y [0, ] R d, we inroduce for [, ], dz,y = r ΣG, Z,y 1 γ 2 σ σ d + σ dw, Z,y = y Furhermore, in ha cae A > 0, [0, ], y R d, i {1,, d}, y φ, y φ, y A 43 Proof By uing heorem 1 and Propoiion 3, we eaily ee ha formal differeniaion are auhorized herefore φ i a C 1,2 [0, ] R d funcion oluion of 39 wih erminal condiion 40 For he econd poin, we wrie, for, y [0, ] R d, y φ, y = [ 1 γ E γ 2 D y Z,y D Z G, Z,y ΣG, Z,y d exp 1 γ 2γ 2 G, Z,y ΣG, Z,y d ] We have dd y Z,y = 1 γ ΣD ZG, Z,y D y Z,y d, D y Z,y = I d Becaue of he Lipchiz propery of G and Grönwall inequaliy, up [, ] D y Z,y i uniformly bounded on [0, ] R d By Propoiion 3, we hen deduce ha here exi C 0 uch ha herefore,, y [0, ] R d, up [, ] y φ, y E Hence he reul [ D y Z,y 1 γ 1 γ γ 2 C exp 2γ 2 1 γ γ 2 C φ, y D Z G, Z,y ΣG, Z,y C G, Z,y ΣG, Z,y d We now wrie a verificaion heorem and provide a reul for olving he problem faced by he agen under addiional hypohee heorem 4 Le u uppoe ha here exi a poiive funcion φ C 1,2 [0, ] R d oluion of 39 wih erminal condiion 40 Le u alo uppoe ha A > 0, [0, ], y R d, i {1,, d}, y φ, y φ, y A 1 + y 44 Le u hen conider he funcion u defined by 38 For all, V, y [0, ] R + R d and θ = θ [, ] A γ, we have [ ] E U γ V,V,y,θ u, V, y 45 Moreover, equaliy in 45 i obained by aking he opimal conrol θ [, ] A γ given by 41, ie, [, ], θ,y G, Y = + yφ, Y,y γ φ, Y,y 46 In paricular u = v ] 20

21 Proof he proof i imilar o ha of he CARA cae, herefore we do no deail all he compuaion From he Lipchiz propery of G aed in Eq 12 and aumpion 44 on φ, we ee ha θ [, ] i indeed admiible ie, θ [, ] A γ Le u hen conider, V, y [0, ] R + R d and θ = θ [, ] A γ By Iō formula, we have for all [, ] d u, V,V,y,θ, Y,y = L θ u, V,V,y,θ, Y,y d where + V u, V,V,y,θ L θ u, V,V,y,θ = u, V,V,y,θ, Y,y, Y,y + y u, V,V,y,θ V,V,y,θ, Y,y θ V,V,y,θ + V u, V,V,y,θ, Y,y V y u, V,V,y,θ r Σ 2 yyu, V,V,y,θ + y u, V,V,y,θ, Y,y r 1 + ΣG, Y,y 1 2 σ σ, Y,y, Y,y, Y,y σ dŵ, θ ΣG, Y,y + r V,V,y,θ Σθ V V u, V,V,y,θ, Y,y V,V,y,θ 2 θ Σθ Noe ha we have V u, V,V,y,θ = u, V,V,y,θ, Y,y θ V,V,y,θ + y u, V,V,y,θ, Y,y 1 γθ + γ yφ, Y,y φ, Y,y, Y,y Le u ubequenly define, for all [, ], κ θ = 1 γθ + γ yφ, Y,y φ, Y,y, and ξ, θ = exp κ θ τ σ dŵτ 1 2 κ θ τ Σκ θ τ dτ We have d u, V,V,y,θ, Y,y ξ θ 1, = ξ, θ 1 L θ u, V,V,y,θ, Y,y d By definiion of u, L θ u, V,V,y,θ, Y,y 0 and L θ u, V,V,y,θ, Y,y = 0 if θ = θ A a conequence, u, V,V,y,θ, Y,y ξ θ 1, i nonincreaing, and herefore u, V,V,y,θ wih equaliy when θ [, ] = θ [, ] [, ], Y,y u, V, y ξ θ,, 47 21

22 Subequenly, [ ] E U γ V,V,y,θ [ = E u, V,V,y,θ, Y,y ] u, V, ye [ ξ θ, ], wih equaliy when θ [, ] = θ [, ] Uing he ame mehod a in he proof of heorem 3, we ee ha E[ξ, θ ] = 1 herefore, u, V, y = E [U ] γ V,V,y,θ We have ju hown he econd par of he heorem For he fir par, we conider he cae γ 1 and γ < 1 eparaely becaue he e of admiible raegie i larger in he econd cae a If γ 1, θ [, ] A γ verifie he linear growh condiion herefore, uing he aumpion on yφ φ and he ame argumen a in heorem 3, we ee ha ξ, θ i a maringale [, ] wih E [ ξ,] θ = 1 for all [, ] We obain [ ] E U γ V,V,y,θ u, V, y b If γ < 1, hen we define he opping ime τ n = inf { [, ], κ θ n } We ue hi opping ime in order o localize Eq 47 u τ n, Vτ,V,y,θ n, Yτ,y n ξ,τ θ n u, V, y By aking he expecaion, we have, for all n N, E [ u τ n, Vτ,V,y,θ n, Yτ,y ] n u, V, y A u i nonnegaive when γ < 1, we can apply Faou lemma [ E lim inf u τ n, Vτ,V,y,θ n + n, Yτ,y ] n lim inf E [ u τ n, Vτ,V,y,θ n + n, Yτ,y ] n u, V, y Becaue θ [, ] A γ, τ n n + almo urely herefore E [ U γ V,V,y,θ ] u, V, y In boh cae, we conclude ha u, V, y = v, V, y = up θ [, ] A γ [ ] E U γ V,V,y,θ = E [U ] γ V,V,y,θ he above verificaion heorem can be ued for inance when m µ ha a compac uppor becaue of 43 In he nex ecion, we addre he cae of Gauian prior and we hall ee ha here i a blowup phenomenon aociaed wih he oluion of he parial differenial equaion 39 wih erminal condiion 40 when γ i oo mall Before we urn o he Gauian cae, le u conider he pecific cae γ = 1 22

23 322 he γ = 1 cae o olve he HJB equaion when γ = 1, we ue he following anaz: u, V, y = r + logv + φ, y 48 Propoiion 8 Suppoe here exi a funcion φ C 1,2 [0, ] R d aifying φ + y φ r 1 + ΣG 1 2 σ σ r Σ 2 yyφ G ΣG = 0, 49 wih erminal condiion y R d, φ, y = 0 50 hen u defined by 48 i oluion of he HJB equaion 36 wih erminal condiion 37 Moreover, he upremum in 36 i achieved a θ, y = G, y 51 Proof Le u conider φ C 1,2 [0, ] R d, oluion of 49 wih erminal condiion 50 For u defined by 48, we have: u + y u r 1 + ΣG 1 2 σ σ r Σ 2 yyu + rv V u + up {V V uθ ΣG + V 2 } θ R 2 θ Σθ V 2 V u + V θ Σ V y u d = r + φ + y φ r 1 + ΣG 1 2 σ σ r Σ 2 yyφ { + r + up θ ΣG 1 } θ R 2 θ Σθ d he upremum in he above expreion i reached a θ, y = G, y herefore u + y u r 1 + ΣG 1 2 σ σ r Σ 2 yyu + rv V u + up {V V uθ ΣG + V 2 } θ R 2 θ Σθ V 2 V u + V θ Σ V y u d = φ + y φ r 1 + ΣG 1 2 σ σ r Σ 2 yyφ G ΣG = 0 A i i raighforward o verify ha u aifie he erminal condiion 37, he reul i proved From he previou propoiion, we ee ha olving he HJB equaion 36 wih erminal condiion 37 boil down o olving 49 wih erminal condiion 50 Becaue 49 i a imple parabolic PDE, we can eaily build a rong oluion 23

24 Propoiion 9 Le u define φ :, y [0, ] R d E where, y [0, ] R d, [, ], Y,y = y + [ 1 2 G, Y,y ΣG, Y,y d r 1 + ΣGτ, Y,y τ 1 2 σ σ dτ + σ Ŵ Ŵ hen φ i a C 1,2 [0, ] R d funcion, oluion of 49 wih erminal condiion 50 Furhermore, ], 52 A > 0, [0, ], y R d, i {1,, d}, y φ, y A 1 + y 53 Proof Becaue of he aumpion 12 on G, he fir par of he propoiion i a conequence of claical reul for parabolic PDE and of he claical Feynman-Kac repreenaion ee for inance [19, 27] For he econd par, we noice fir ha, y [0, ] R d, y φ, y = E [ 1 γ D yy,y D Y G, Y,y ΣG, Y,y d ] We have dd y Y,y = ΣD Y G, Y,y D y Y,y d, D y Y,y = I d Becaue of he Lipchiz propery of G and Grönwall inequaliy, up [, ] D y Y,y i uniformly bounded on [0, ] R d herefore, by 12, here exi a conan C 0 uch ha, y [0, ] R d, [, ] Dy Y,y D Y G, Y,y ΣG, Y,y C G, Y,y 54 By 12 here exi a conan C 0 uch ha G, Y,y G, Y,y G, y + C 1 + y 55 Bu, by uing heorem 2 G, Y,y G, y = D Y Gτ, Y,y τ σ dŵτ herefore, uing he Lipchiz propery of G we ee ha E [ G, Y,y G, y ] i bounded by a conan ha depend on only Combining hi reul wih Eq 54 and 55, we obain he propery 53 We now wrie a verificaion heorem and provide a reul for olving he problem faced by he agen heorem 5 Le u conider he funcion φ C 1,2 [0, ] R d defined by 52 conider he funcion u defined by 48 Le u hen For all, V, y [0, ] R + R d and θ = θ [, ] A 1, we have [ ] E log u, V, y 56 V,V,y,θ Moreover, equaliy in 45 i obained by aking he opimal conrol θ [, ] A 1 given by 51, ie, [, ], θ = G, Y,y 57 In paricular u = v 24

25 Proof he proof i imilar o ha of he γ > 1 cae, herefore we do no deail all he compuaion From he Lipchiz propery of G aed in Eq 12, we ee ha θ [, ] i indeed admiible ie, θ [, ] A 1 Le u hen conider, V, y [0, ] R + R d and θ = θ [, ] A 1 By Iō formula, we have for all [, ] d u, V,V,y,θ, Y,y = L θ u, V,V,y,θ, Y,y d where + V u, V,V,y,θ L θ u, V,V,y,θ = u, V,V,y,θ, Y,y, Y,y + y u, V,V,y,θ V,V,y,θ Noe ha we have, Y,y θ V,V,y,θ + V u, V,V,y,θ, Y,y V y u, V,V,y,θ r Σ 2 yyu, V,V,y,θ + y u, V,V,y,θ, Y,y r 1 + ΣG, Y,y 1 2 σ σ, Y,y, Y,y V u, V,V,y,θ = θ + y φ, Y,y, Y,y Le u ubequenly define, for all [, ],, Y,y σ dŵ, θ ΣG, Y,y + r V,V,y,θ Σθ V V u, V,V,y,θ θ V,V,y,θ κ θ = θ + y φ, Y,y + y u, V,V,y,θ,, Y,y V,V,y,θ 2 θ Σθ, Y,y and ξ, θ = exp κ θ τ σ dŵτ 1 2 κ θ τ Σκ θ τ dτ We have d u, V,V,y,θ, Y,y ξ θ 1, = ξ, θ 1 L θ u, V,V,y,θ, Y,y d By definiion of u, L θ u, V,V,y,θ, Y,y 0 and L θ u, V,V,y,θ, Y,y = 0 if θ = θ A a conequence, u, V,V,y,θ, Y,y ξ θ 1, i nonincreaing, and herefore u, V,V,y,θ wih equaliy when θ [, ] = θ [, ] [, ], Y,y u, V, y ξ θ,, 58 Subequenly, [ E log V,V,y,θ ] [ = E u, V,V,y,θ, Y,y ] u, V, ye [ ξ θ, ], 25

26 wih equaliy when θ [, ] = θ [, ] θ [, ] A 1 verifie he linear growh condiion herefore, uing Eq 53 and he ame argumen a in heorem 3, we ee ha ξ, θ i a maringale wih E [ ] ξ θ [, ], = 1 for all [, ] We obain [ E log V,V,y,θ ] u, V, y, wih equaliy when θ [, ] = θ [, ] We conclude ha u, V, y = v, V, y = up θ [, ] A 1 [ E log V,V,y,θ ] [ = E log V,V,y,θ ] 4 Opimal porfolio choice in he Gauian cae: a ale of wo roue We howed in Secion 3 ha olving he opimal porfolio choice problem boil down o olving linear parabolic PDE in he CARA and CRRA cae One imporan cae in which hee PDE can be olved in cloed form i ha of a Gauian prior Moreover, in he Gauian prior cae, here are wo roue o olve he problem wih PDE becaue, a we hall ee below, β appear o be a far more naural ae variable han y In hi ecion, we olve he opimal porfolio choice problem in he cae of a Gauian prior uing hee wo differen roue and we dicu wo eenial poin: i he influence of online learning on he opimal invemen raegy, and ii he occurrence of blowup in ome CRRA cae 41 Bayeian learning in he Gauian cae Le u conider a non-degenerae mulivariae Gauian prior m µ, ie, 1 m µ dz = 2π d 2 Γ exp 1 2 z β 0 Γ 1 0 z β 0 dz, 59 where β 0 R d and Γ 0 S ++ d R Our fir goal i o obain cloed-form expreion for F and G in he Gauian cae In order o obain hee expreion we hall ue he following lemma: Lemma 1 M S ++ d R, N R d, exp x Mx + x N dx = π d 2 M exp R 4 N M 1 N d Proof Uing he canonical form of a polynomial of degree 2, we ge x Mx + x N = x 1 N 2 M 1 M x 1 2 M 1 N N M 1 N 26

27 herefore, exp x Mx + x N dx R d = exp x 1 N R 2 M 1 M x 1 2 M 1 N N M 1 N dx d = 2π d 2 2M exp 4 N M 1 N = π d 2 M exp 4 N M 1 N We are now ready o derive he expreion of F and G Propoiion 10 For he mulivariae Gauian prior m µ given by 59, F and G are given by: R +, y R d, F, y = Γ Σ exp { r 1 Σ [y 1 Y ] σ σ + 2 r2 1Σ 1 1 Γ β 0Γ 1 0 β [Σ y 1 Y ] 2 σ σ + Γ 1 0 β 0 Γ Σ 1 1 [Σ y 1 Y ]} σ σ + Γ 1 0 β 0, 60 [Σ y 1 Y ] σ σ + Γ 1 0 β 0 G, y = rσ Σ 1 Γ Σ 1 1 Proof R +, y R d, F, y = exp R d z r 1 Σ 1 y Y r σ σ 1 2 z r 1 Σ 1 z r 1 m µ dz herefore, F, y = = [ 1 exp {z r 1 Σ 1 y Y 2π d 2 Γ r ] σ σ 2 R d 1 2 z r 1 Σ 1 z r 1 1 } 2 z β 0 Γ 1 0 z β 0 dz exp D exp z Mz + z N dz, 2π d 2 Γ R d where M = 1 Γ Σ 1, 2 N = Σ [y 1 Y 0 + r ] σ σ [ = Σ 1 y Y 0 + ] 2 σ σ + Γ 1 0 β 0, + rσ Γ 1 0 β 0 27

28 and D = r 1 Σ [y 1 Y 0 + r ] σ σ 2 r2 1 Σ β 0Γ 1 0 β 0 [ = r 1 Σ 1 y Y 0 + ] 2 σ σ + 2 r2 1 Σ β 0Γ 1 0 β 0 hank o he above lemma, we have F, y = exp D π d 2π d 2 Γ M exp 2 4 N M 1 N = Γ Σ exp { r 1 Σ [y 1 Y Γ ] σ σ r2 1Σ β 0Γ 1 0 β 0 Differeniaing log F bring [Σ 1 y Y σ σ [Σ y 1 Y σ σ + Γ 1 0 β 0 G, y = rσ Σ 1 Γ Σ 1 1 ] + Γ 1 0 β 0 Γ Σ 1 1 ]} [Σ y 1 Y ] σ σ + Γ 1 0 β 0 Uing heorem 1 and 2, we now deduce raighforwardly he value of β and i dynamic Propoiion 11 where Γ = Γ Σ 1 1 β = Γ Σ 1 Y Y σ σ + Γ 1 0 β 0, 62 dβ = Γ Σ 1 σ dŵ, 63 Remark 5 Claical Bayeian analyi or applicaion of claical filering ool enable o prove ha he poerior diribuion of µ given F S i in fac he Gauian diribuion N β, Γ In paricular, i i noeworhy ha he covariance marix proce Γ R+ i deerminiic he above analyi how ha, in he Gauian prior cae, he problem can be wrien wih wo differen e of ae variable: y, V or β, V We can conider indeed ha he problem i decribed, a in Secion 3, by he ochaic differenial equaion dy = r 1 + ΣG, Y 12 σ σ d + σ dŵ 64 dv = M ΣG, Y + rv d + M σ dŵ, or alernaively by he following ochaic differenial equaion dβ = Γ Σ σ 1 dŵ dv = M β r 1 + rv d + M σ dŵ 65 In wha follow, we are going o olve he opimal porfolio choice problem in he Gauian prior cae by uing alernaively he wo differen roue aociaed wih hee wo way of decribing he dynamic of he yem 28

29 Remark 6 I i noeworhy ha he dynamic of β R+ in he Gauian cae, a wrien in Eq 65, doe no involve any erm in Y From heorem 2, we ee ha hi i relaed o he fac ha he marix D y G, i independen of y in he Gauian cae A naural queion i wheher or no hi propery i pecific o a Gauian prior diribuion In fac, he anwer i poiive If indeed D y G, i independen of y, hen log F, i a polynomial of maximum degree 2, ie, F, y = exp A + B y + y Cy, where A R, B R d, and C S d R Since F 0, y = exp z r 1 Σ 1 y Y 0 m µ dz = expa0 + B0 y + y C0y, R d he Laplace ranform of m µ i he exponenial of a polynomial of maximum degree 2, and m µ i herefore Gauian poibly degenerae, even in he form of a Dirac ma Before we olve he PDE in he CARA and CRRA cae in he nex ubecion, le u ae ome addiional properie ha will be ueful o implify fuure compuaion Propoiion 12 he dynamic of he condiional covariance marix proce Γ R+ i given by: he fir order parial derivaive of G are given by: R +, y R d, dγ = Γ Σ 1 Γ d 66 D y G, y = Σ 1 Γ Σ 1, 67 G, y = Σ 1 Γ G, y D y G, y r 1 12 σ σ 68 Proof Eq 66 i a imple conequence of he definiion of Γ Eq 67 derive from he differeniaion of Eq 61 wih repec o y For Eq 68, we ue Eq 61 and 66 o obain G, y [ = Σ 1 Γ Σ 1 Γ Σ 1 y Y 0 + ] 2 σ σ + Γ 1 0 β Σ 1 Γ Σ 1 σ σ = Σ 1 Γ G, y + rσ Σ 1 Γ Σ 1 σ σ = Σ 1 Γ G, y Σ 1 Γ Σ 1 r σ σ = Σ 1 Γ G, y D y G, y r 1 12 σ σ Remark 7 From Eq 67, we ee ha up D y G, y up Σ 1 Γ Σ 1 < +,y [0, ] R d [0, ] herefore Gauian prior aify 12 a announced in Secion 2 We are now ready o olve he PDE and derive he opimal porfolio in he CARA and CRRA cae 29

30 42 Porfolio choice in he CARA cae 421 he general mehod wih y Following he reul of Secion 3, olving he opimal porfolio choice of he agen in he CARA cae boil down o olving he linear parabolic PDE 22 wih erminal condiion 23 Becaue G, i affine in y for all [0, ] in he Gauian cae, we eaily ee from he Feynman- Kac repreenaion 26 ha for all [0, ], φ, i a polynomial of degree 2 in y However looking for ha polynomial of degree 2 in y by uing he PDE 22 or Eq 26 i cumberome A we hall ee, he main reaon for hi i ha β i in fac a more naural variable o olve he problem han y In fac, a beer anaz han a general polynomial of degree 2 in y i he following: where a R and B S d R We indeed have he following propoiion: φ, y = a G, y BG, y, 69 Propoiion 13 Aume here exi a C 1 [0, ] and B C 1 [0, ], S d R aifying he following yem of linear ODE for [0, ]: ȧ r Γ Σ 1 B Σ 1 Γ Σ 1 = 0 Ḃ Γ Σ 1 B B Σ 1 Γ + 1 γ Σ = 0, 70 wih erminal condiion { a = 0 B = 0 hen, he funcion φ defined by 69 aifie 22 wih erminal condiion Proof Le u conider a, B oluion of 70 wih erminal condiion 71 For φ defined by 69, we have, by uing he formula of Propoiion 12 ha φ + y φ r σ σ r Σ 2 yyφ + 1 2γ G ΣG = ȧ G ḂG G BG G B G + D y GBG r σ σ r ΣD ygbd y G + 1 2γ G ΣG = ȧ G ḂG 1 2 G Γ Σ 1 BG 1 2 G BΣ 1 Γ G r Γ Σ 1 BΣ 1 Γ Σ γ G ΣG = ȧ + 12 r Γ Σ 1 BΣ 1 Γ Σ Ḃ G Γ Σ 1 B BΣ 1 Γ + 1γ Σ G = 0 herefore φ i oluion of he PDE 22 and i aifie obviouly he erminal condiion 23 he yem of linear ODE 70 wih erminal condiion 71 can be olved in cloed form hi i he purpoe of he following propoiion 30

31 Propoiion 14 he funcion a and B defined for [0, ] by a = 1 2γ B = 1 γ Σ Γ 1 r Σ 1 Γ Γ d Γ 1 aify he yem 70 wih erminal condiion 71 Γ Γ 1 Σ Wrapping up our reul, we can ae he opimal porfolio choice of an agen wih a CARA uiliy funcion in he cae of he Gauian prior 59 Propoiion 15 In he cae of he Gauian prior 59, he opimal raegy M [0, ] of an agen wih a CARA uiliy funcion i given by M = e r 1 γ Σ 1 Γ Γ 1 ΣG, Y 72 Proof Le u conider a and B a defined in Propoiion 14 hen, le u define φ by 69 We know from he verificaion heorem heorem 3 and epecially from Eq 24 ha G, M = e r Y y φ, Y γ G, = e r Y D y G, Y BG, Y γ = e r 1 Id Σ 1 Γ Σ 1 Σ Γ 1 Γ 1 Γ Γ 1 Σ G, Y γ = e r 1 γ Σ 1 Γ Γ 1 ΣG, Y We ee from he form 69 of he oluion φ and from Eq 72 ha G, Y raher han Y ielf i he driver of he opimal behavior of he agen a ime Becaue of Eq 7, hi mean ha β raher han y i he naural variable for addreing he problem In wha follow, we olve he opimal porfolio choice problem in he cae of a Gauian prior by aking anoher roue, on which he dynamic of he yem i given by he ochaic differenial equaion 65 raher han Solving he problem uing β On our fir roue for olving he above opimal porfolio choice problem, he cenral equaion wa he HJB equaion 19 aociaed wih he ochaic differenial equaion 64 Inead of uing he ochaic differenial equaion 64, we now reconider he problem in he Gauian prior cae by uing he ochaic differenial equaion 65 8 he value funcion ṽ aociaed wih he problem i now given by [ ṽ :, V, β [0, ] R R d up E exp M Ã where he e of admiible raegie i { Ã = M [, ], R d -valued F S -adaped proce γv,v,β,m ], aifying he linear growh condiion wih repec o β [, ] }, 8 We omi he proof in hi ubecion hey are imilar o hoe preened in Secion 3 31

32 and where, [0, ], V, β, M R R d Ã, [, ], β,β = β + Γ τ Σ 1 σ dŵτ, 73 V,V,β,M = V + M τ β,β τ r 1 + rvτ,v,β,m dτ + M τ σ dŵτ 74 I i noeworhy ha for all [0, ], Ã = A here i indeed no difference beween he linear growh condiion wih repec o β and he linear growh condiion wih repec o Y in he Gauian prior cae hi i eay o ee on Eq 62, recalling ha β 0 and Y 0 are known conan he HJB equaion aociaed wih hi opimizaion problem i 0 = ũ, V, β r Γ Σ 1 Γ 2 ββũ, V, β { + up M β r 1 + rv V ũ, V, β + 1 } M R 2 M ΣM V 2 V ũ, V, β + M Γ V β ũ, V, β, d 75 wih erminal condiion V R, β R d, ũ, V, β = exp γv 76 By uing he anaz [ ũ, V, β = exp γ e r V + φ ], β, 77 we obain he following propoiion: Propoiion 16 Suppoe here exi φ C 1,2 [0, ] R d aifying, β [0, ] R d, 1 φ, β + 2 r Γ Σ 1 Γ 2 φ ββ, β + 1 β r 1 Σ 1 β r 1 2γ Γ β φ, β Σ 1 β r 1 = 0, 78 wih erminal condiion β R d, φ, β = 0 79 hen ũ defined by 77 i oluion of he HJB equaion 75 wih erminal condiion 76 Moreover, he upremum in 75 i achieved a β r 1 M, β = e r Σ 1 Γ β φ, β 80 γ For olving Eq 78 wih erminal condiion 79, i i naural 9 o conider he following anaz: φ, β = ã + 1 β r 1 B β r 1, 81 2 where ã R and B S d R he nex propoiion ae he ODE ha ã and B mu aify 9 I i clear from he form of Eq 78 ha he oluion i a polynomial of degree 2 in β r 1 32