arxiv: v2 [math.st] 15 Apr 2016

Size: px
Start display at page:

Download "arxiv: v2 [math.st] 15 Apr 2016"

Transcription

1 Maximum Likelihoo Estimation for Wishart processes Aurélien Alfonsi, Ahme Kebaier, an Clément Rey CERMICS, École es Ponts, UPE, Projet MathRisk ENPC-INRIA-UMLV, Champs-sur-Marne, France Université Paris 3, Sorbonne Paris Cité, LAGA, CNRS UMR 7539 arxiv:58.333v math.s] 5 Apr 6 April 8, 6 Abstract In the last ecae, there has been a growing interest to use Wishart processes for moelling, especially for financial applications. However, there are still few stuies on the estimation of its parameters. Here, we stuy the Maximum Likelihoo Estimator MLE in orer to estimate the rift parameters of a Wishart process. We obtain precise convergence rates an limits for this estimator in the ergoic case an in some nonergoic cases. We check that the MLE achieves the optimal convergence rate in each case. Motivate by this stuy, we also present new results on the Laplace transform that exten the recent finings of Gnoatto an Grasselli 7] an are of inepenent interest. Keywors : Wishart processes, Laplace transform, parameter inference, maximum likelihoo, limit theorems, local asymptotic properties. AMS MSC : 6F, 44A, 6F5, 9B7. Introuction an preliminary results he goal of this paper is to stuy the maximum likelihoo estimation of the parameters of Wishart processes. hese processes have been introuce by Bru 7] an take values in the set of positive semiefinite matrices. Let N enote the imension, M be the set of real -square matrices, S + resp. S+, be the subset of positive semiefinite resp. efinite matrices, S resp. A the subset of symmetric resp. antisymmetric matrices. Wishart processes are efine by the following SDE { Xt = αa a + bx t + X t b ] t + X t W t a + a Wt Xt, t > X = x S +, where α, a M, b M an W t t enotes a -square matrix mae of inepenent Brownian motions. We recall that for x S +, x is the unique matrix in S + such that s : alfonsi@cermics.enpc.fr, kebaier@math.univ-paris3.fr, reyc@cermics.enpc.fr. his research benefite from the support of the Chaire Risques Financiers, Fonation u Risque an the Laboratories of Excellence Bézout an MME-DII

2 INRODUCION AND PRELIMINARY RESULS x = x. It is shown by Bru 7] an Cuchiero et al. 8] in a more general affine setting that the SDE has a unique strong solution when α + an a unique weak solution when α. Besies, we have X t S +, for any t when x S +, an α +. In this paper, we will enote by W IS x, α, b, a the law of X t, t an W IS x, α, b, a; t the law of X t. In imension =, Wishart processes are known as Cox-Ingersoll-Ross processes in the literature. It is worth recalling that the law of X only epens on a through a a since we have W IS x, α, b, a = W IS x, α, b, a a, law see e.g. equation in ]. herefore, the parameters to estimate are α, b an a a. Wishart processes have been originally consiere by Bru 6] to moel some biological ata. Recently, they have been wiely use in financial moels in orer to escribe the evolution of the epenence between assets. Namely, Gourieroux an Sufana 9] an Da Fonseca et al. ] have propose a stochastic volatility moel for a basket of assets that assumes that the instantaneous covariance between the assets follows a Wishart process. his extens the well-known Heston moel ] to many assets. Wishart processes have also been use for interest rates moels. Affine term structure moels involving these processes have been propose for example by Gourieroux an Sufana ], Gnoatto 6] an Ahia et al. ]. For these moels, the question of estimating the parameters of the unerlying Wishart process may be important for practical purposes an shoul be possible thanks to the profusion of financial ata. his issue has been consiere by Da Fonseca et al. 9] for the moel presente in ]. However, there is no eicate stuy on the Maximum Likelihoo Estimator MLE for Wishart processes. For the Cox-Ingersoll-Ross process, the estimation of parameters has been stuie earlier, motivate in particular by its use for interest rates see Fournié an alay 4]. Later on, the MLE has been stuie by Overbeck 3] incluing some nonergoic cases, an more recently by Ben Alaya an Kebaier 4, 5]. his paper completes the literature by stuying the MLE for Wishart processes. In this paper, we will follow the theory evelope in the books by Lipster an Shiryaev 7] an Kutoyants 3] an assume that we observe the full path X t, t, ] up to time >. his choice will be convenient from a mathematical point of view to stuy the convergence of the MLE. Of course, in practice it can be relevant to stuy precisely the estimation when we only observe the process on a iscrete time-gri. his is left for further research, but we alreay observe in our numerical experiments that the iscrete approximation of the MLE gives a satisfactory estimation of Wishart parameters see Section 6. It is worth noticing that once we observe the path X t, t, ], the parameter a a is known. In fact, we can calculate the quaratic covariation see for example Lemma in ] an get for i, j, k, l {,, } X i,j, X k,l = his leas to a a j,l X s i,k + a a j,k X s i,l + a a i,l X s j,k + a a i,k X s j,l s. a a i,i =, 4 X i,i X s i,i s 3 a a i,j = X i,j, X i,i a a i,i, X s i,j s X s i,i s

3 INRODUCION AND PRELIMINARY RESULS 3 for i, j an j i. We note that these quantities are well efine as soon as the path X t, t, ] has a finite quaratic variation an is such that X t S +, t-a.e., which is satisfie by the paths of Wishart processes see Proposition 4 in 7]. We will assume that a a S +, an enote by a M an invertible matrix that matches the observe value of a a: a can be for example the square root of a a or the Cholesky ecomposition of a a. hen, we know that Y t = a X t a follows the law W IS a xa, α, a ba, I, see e.g. equation 3 in ]. It is therefore sufficient to focus on the estimation of the parameters α an b when a = I, which we consier now. We first present the MLE of θ = b, α, an we enote by P θ the original probability measure uner which X satisfies X t = αi + bx t + X t b ] t + X t W t + Wt Xt. 4 When no confusion is possible, we also enote P this probability. We consier α + an set θ = α,. We will assume for the joint estimation of α an b that α + an x S +,. 5 he latter assumption is not restrictive in practice since the conition α + ensures that X t S +, for any t >. Due to this assumption, we know by heorem 4. in Mayerhofer 9] that P θ, := exp rh s W s ] rh s Hs ]s, with H t = α α X t b X t P θ, efines a probability measure uner which W t = W t t H s s is a -Brownian motion, where P θ, is the restriction of P θ to the σ-algebra σw s, s, ]. We have X t = α I t + X t W t + W t Xt, an the likelihoo is then efine by see Lipster an Shiryaev 7], Chapter 7 L θ,θ = E exp rh sw s ] where F X t t enote the filtration generate by the process X. rh shs ]s ], 6 F X Proposition.. For X S +,, let L X : S S be the linear application efine by L X Y = XY + Y X. It is invertible, an the likelihoo of X t, t, ] is given by L θ,θ + α α = exp 4 log etx ] etx] r L X t bx t + X t b ] X t 4 α α α + α 4 r rxs ]s α rb] L X t bx t + X t b bx t + X t b Lemmas B. an B. states some properties of L X, an the proof of Proposition. is given in Appenix A. In particular, we see from this proof that P θ, P θ, F X if, an only if b S, ] t. 7

4 INRODUCION AND PRELIMINARY RESULS 4 in which case the likelihoo has the following simpler form L θ,θ α α etx ] = exp log + rbx ] rbx] 4 etx] α α 4 α + α rb X s ]s rx s ]s α rb], 8 since L X t bx t + X t b = b. Now, we want to maximize the likelihoo an observe that the quantity in the exponential 7 is quaratic with respect to b, α an goes almost surely to when b, α +. o o so, we first remark that rb] = rl X bxt t + X t b ] by Lemma B.. hen, Cauchy- Schwarz inequality yiels to rαb] = r = L X s bx s + X s b α Xs Xs r L X s bx s + X s b ] X s s + α 4 r L X s bx s + X s b bx s + X s b ] s ] s + α 4 r Xs ] s 9 r Xs ] s, an it is strict almost surely, which gives that the quaratic form in the exponential 7 is negative efinite. here is thus a unique global maximum of 7 on R M. We know from Lemma B. that L X s is self-ajoint, an we get with straightforwar calculations that the MLE ˆθ = ˆb, ˆα is characterize by the following equations: { 4 log etx ] etx] ˆα 4 rx s ]s rˆb ] =, L X s X s X s L X s ˆb X s + X sˆb X s s ˆα I =. Unless in the ergoic case, we will not be able to obtain convergence results for this estimator. Instea, we will mostly work with the MLE estimator when b is known to be symmetric. his enables us to work with more tractable formulas, even if the calculations are alreay quite involve in case. Analyzing the general case woul require evelopment of further arguments. Besies, we can consier that Wishart processes with b symmetric alreay form an interesting family of processes that may be rich enough in many applications. When b S, the unique global maximum ˆθ = ˆb, ˆα of 8 on R S is characterize by the following equations: { 4 log etx ] etx] X x ˆα 4 rx s ]s rˆb ] =, ˆb X s + X sˆb s ˆα I =. o get more explicit formulas, we have to invert this linear system. For X S an a R, we efine the linear applications L X : S S Y Y X + XY an L X,a : S S Y Y X + XY a ry ]I. We introuce the following shorthan notation R := X s s, Q := rx s ]s, Z := log etx ], 3 etx]

5 INRODUCION AND PRELIMINARY RESULS 5 an note that Q an Z are efine only for α + while R is efine for α an belongs almost surely to S +,. By using the convexity property of the inverse, see e.g. Mon an Pecaric 3], we have when α + R ] r < Q, a.s. 4 We get ˆα = ++Q Z rˆb ] an L R, Q ˆb = X x Q Z + + I. By 4 an Lemma B., the latter equation can be inverte, which leas to ˆα = + + Q Z r L R, Q X x Q Z + + ] I ] ˆb = L R, Q X x Q Z + + ] I. he estimator of α when α, + given by the MLE is no longer well efine. he same thing alreay occurs in imension = for the CIR process, see Ben Alaya an Kebaier 4]. However, it is still possible to estimate the parameter b M when α is known. In this case, we enote θ = b, α an θ =, α an get by repeating the same arguments that L θ,θ = exp r L X t bx t + X t b ] X t 4 an the MLE is characterize by r L X t bx t + X t b ] bx t + X t b t α rb], 5 L X s X s X s L X s ˆb X s + X sˆb X s s α I =. 6 When b is known a priori to be symmetric, the likelihoo an the MLE are then given by rbx ] rbx] = exp rb X s ]s α, rb] 7 ˆb = L R X x α I. 8 L θ,θ he goal of the paper is to stuy the convergence of the MLE uner the original probability P θ. o o so, we first consier the case where the Wishart process is ergoic. By Lemma C., this hols if b + b S +, when b M, an the ergoicity is equivalent to b S +, when b S. hen, we can use Birkhoff s ergoic theorem to etermine the convergence of the MLE. Section presents these results for 5 when α +, for 7 when α > + an for both 8 an 6 when α. Section 3 stuies the convergence of the MLE in some nonergoic cases, namely when b = λ I with λ an when b is known to be symmetric. More precisely, when b =, we obtain convergence results for 5 when α + an for 8 when α. When λ >, we only obtain convergence results his is obvious when α > since X t S +, a.s. by Proposition 4 in 7]. For α =, we woul have by contraiction the existence of v F X such that t, ], v X tv =. his is clearly not possible by using the connection with matrix-value Ornstein-Uhlenbeck in this case, see eq. 5.7 in 7].

6 SAISICAL INFERENCE: HE ERGODIC CASE 6 for 8 when α. In all these cases, we analyse the convergence by the mean of Laplace transforms. hough limite to some nonergoic cases, we however recover an exten the recent convergence results obtaine by Ben Alaya an Kebaier for the one-imensional CIR process 4, 5]. In Section 4, we check that the MLE achieves the optimal rate of convergence in the ifferent cases by proving local asymptotic properties. Last, we stuy in Section 5 the Laplace transform of X, R. his stuy can be of inepenent interest an improves the recent results of Gnoatto an Grasselli 7]. Statistical Inference of the Wishart process: the ergoic case When b + b S +,, the Wishart process X t converges in law when t + to the stationary law X W IS, α,, q ; / with q = e sb e sb s for any starting point x S + by Lemma C.. herefore this is the unique stationary law which is thus extremal, an we know by Stroock 35], heorem that it is then ergoic, see also Pagès 3], Annex A. We introuce the following quantity From the ergoic Birkhoff s theorem, we have R Besies, when α +, Q = E θ rx ] R := E θ X. a.s. R, as +. 9 is finite an satisfies Q rr ] <, ue to the convexity property of the inverse, see e.g. Mon an Pecaric 3]. Again, the ergoic Birkhoff s theorem gives Q a.s. Q = E θ rx, as +. ] his section is organize as follows. First, we stuy the MLE 5 when b is known to be symmetric in the cases α > + an α = +. hen, we focus on the MLE when b M an α > +. he analysis follows the same steps an reuses some calculations mae in the symmetric case. Last, we stuy the convergence of the MLE when α is known, in both symmetric an general cases.. he global MLE estimator of θ = b, α when b is known to be symmetric When b S, the ergoicity is by Lemma C. equivalent to b S +,, which we assume in this subsection. We have X W IS, α,, b ; / an it is easy to get from 4 that αi + br + R b =, which gives R = α b S +,. We will also show in the proof of heorem. that Q := α +. r b]

7 SAISICAL INFERENCE: HE ERGODIC CASE 7 We consier the convergence of the MLE given by 5 when α +. We introuce the following martingales: M t := N t := t t Xs W s + t W s Xs, 3 r X s W s ]. 4 We use the ynamics of X t t uner P θ an Itô s formula for Z t t see e.g. Bru 7], equation.6 to get on the one han X = x + α I + L R b + M, Z = α Q + rb] + N. 5 On the other han, we obtain from an 3 that X = x + ˆα I + L R ˆb an Z = ˆα Q + rˆb ], which yiels to ˆα α = Q rb ˆb ] + Q N 6 L R ˆb b = α ˆα I + M = Q rˆb b]i + M Q N I. heorem.. Assume that b S +, an α > +. Uner P θ, ˆb b, ˆα α converges in law when + to the centere Gaussian vector G, H that takes values in S R an has the following Laplace transform: for c, λ S R, Q E θ exp rcg] + λh] = exp λ Q rr ] Q λ Q rr ] rcr ] + rcl c]. R,Q Proof. By 4 an Lemma B., we can rewrite the system 6 as follows N ˆα α = Q Q r L R, Q ˆb b = L M N R Q I., Q Note that, for i, j, k, l {,..., } we have ] M N Q I M i,j, M k,l t = δ jl R t i,k + δ jk R t i,l + δ il R t j,k + δ ik R t j,l ], M i,j, N t = tδ ij an N t = Q t, 7 where δ ij stans for the Kronecker symbol. So, it follows from the central limit theorem for martingales see e.g., Kutoyants 3], Proposition., that M, N converges in law uner P θ towars a centere Gaussian vector G, H taking values in S R such that E θ G i,j Gk,l = δ jl R i,k + δ jk R i,l + δ il R j,k + δ ik R j,l ], 8 E θ G i,j H = δi,j an E θ H = Q.

8 SAISICAL INFERENCE: HE ERGODIC CASE 8 From 5 an, we obtain. From Lemma B., the function X, Y, a L X,a Y is continuous, an we get by Slutsky s theorem that ˆb b, ˆα α converges in law to the Gaussian vector ] G, H = L R G Q HI, Q,Q H r L R G Q HI.,Q We are intereste to calculate the Laplace transform of this law. Laplace transform of G, H: c S, λ R, E θ exp rc G] + λ H ] = exp We want to calculate for c S an λ R, E θ exp rcg] + λh] = E θ exp First, we calculate the λ Q + 4λ rc] + 4 rc R ]. 9 ] rc λq I G] + λq H. Due to an Lemma B., we can introuce c = L R,Q c λq I. We have an thus R c + cr Q r c]i = c λq I, rc λq I G] = rr c + cr Q r c]i G] We therefore obtain from 9 = r cr G + GR Q rg]i ] = r c G Q HI ]. E θ exp rcg] + λh] = E θ exp r c G ] Q HI ] + λq H = E θ exp r c G] + Q λ r c] H ] = exp { λ r c] Q + λ r c] r c]q + r c R ] }. Since r c R ] = r c cr + R c] = r cc] + Q r c] λ r c], we get E θ exp rcg] + λh] = exp λλ r c]q + r cc]. We now use that L I R =,Q Q rr ] R to get c = L c λ R,Q Since we have rl c] = R,Q result. rr c] Q rr ] Q R Q rr ]. by Lemma B., this yiels to the claime When α = +, the rate of convergence of the MLE of α is even better as state by the following theorem. heorem.. Assume b S +, an α = +. hen, uner P θ, ˆb b, ˆα α converges in law when + to G, τ rb], where τ rb] a = inf{t, B t = a} with B t t a given one-imensional stanar Brownian motion an G is a Gaussian vector inepenent of B such that E θ exp rcg]] = exp rcl c], c S R.

9 SAISICAL INFERENCE: HE ERGODIC CASE 9 Proof. By 4 an Lemma B., we can rewrite the system 6 as follows ] ˆα α = N Q r L M R 3/ N Q I, Q ˆb b = L M R 3/ N Q I., Q 3 From 5, we have N = log etx ] rb]. etx] As for b S +, the Wishart process X t t is stationary with invariant limit istribution X we easily euce that N converges in probability to rb] when. hen, it follows from 9 that R, N P θ R, rb], as. 3 Hence, we only nee to stuy the asymptotic behavior of the couple / M, Q. Accoring to heorem 4. in Mayerhofer 9], we have for λ an Γ S λ E θ exp N λ Q + rγm ] Now, let us introuce the quantity A = E θ exp λ N + λ rb] exp λ Q exp + ] rγ X s ]s λ rγ] =. 3 rγm ] ] rγ X s ]s + rγ R ]. hen, by 3 we easily get A = exp λ rb] + rγ R ] + λ rγ]. We now write ] A = à + E θ exp λ Q + rγm ] with à = E θ exp ξ exp λ ξ = λ N + λ rb] Cauchy-Schwarz inequality an Q > give Q + à E / θ exp ξ exp ξ + ]E / θ On the one han, Proposition 5. with m = b S +, ] E θ exp rγm ] E θ exp ] rγm ] rγ X s ]s + rγ R ]. ] exp rγm ]. gives ] rγ R ] <.

10 SAISICAL INFERENCE: HE ERGODIC CASE On the other han, we have for any r, From 5, we have E θ exp rξ ] E θ exp ] λr N expr rγ R ]. ] etx λr ] λr E θ exp N ] = exp λr rb]e θ. etx] he sublinear growth of the coefficients of the Wishart SDE an the convergence to a stationary law gives that E θ etx ] λr etx] ] λ] is uniformly boune in >, λ < an there- fore sup > λr E etx ] θ etx] <. his gives the uniform integrability of the family exp ξ, > λ. hen, we euce from 3 that E θ exp ξ exp ξ + ] an thus Ã. + Hence, we obtain lim E θ exp λ Q + rγm ] ] + = lim A = exp λ rb] + rγ R ]. herefore, we euce by Lemma B.4 the following convergence in law Q, M τ rb], R G + G R as, where G i,j i, j are inepenent stanar normal variables. ogether with 3, we obtain that R, Q, N, / M R, /τ rb], rb], R G + G R, 33 which gives the claim by 3 an Lemma B.4.. he global MLE estimator of θ = b, α when b M We efine the linear operators L X, L X,a : M M by L X Y = L X Y X + XY X, LX,a Y = L X Y a ry ]I. From 4, we get Z = α Q + rb] + N. his yiels with to ˆα α = Q rb ˆb ] + Q N We now efine L Xs ˆb bs Q rˆb b]i = L X s M s X s Q N I. ˆL Y = L Xs Y s Q ry ]I, 34

11 SAISICAL INFERENCE: HE ERGODIC CASE which is a linear operator on M. By using the convexity of the inverse function, there exists γ, that epens on X s, s, ] such that Q = γ s. We get ˆL Y = L Xs, rx s γ Y s. By Lemma B.3, ˆL is self ajoint an positive. It is even rxs ] positive efinite since ˆL Y Y ] = implies by using Lemmas B.3 that Y X s +X s Y = a.s. on, ] uner P θ, an therefore the quaratic variation of ruy X s ] is equal to zero for any u S. his gives ruy + Y ux s uy + Y u]s = an thus uy + Y u = for all u S, which necessarily implies Y =. hus, we rewrite 34 as ˆα α = Q r N ˆb b] + Q ˆb b = ˆL L N X s M s X s Q I. We will assume b+b S +, an know from Lemma C. that X converges in law uner P θ to the stationary law X W IS, α,, q ; /. We efine ] 35 ˆL Y = E θ L X Y ] Q ry ]I. 36 Note that for Y S, ˆL Y = Y R Q ry ]I. From the convexity of the inverse function, Q = γe θ / rx ]] with γ,, an thus ˆL Y = E θ L X, γ Y ] is a selfajoint positive operator by Lemma B.3. It is even positive efinite since r ˆL Y Y ] = rx ] implies by Lemma B.3 that Y X + X Y = almost surely. Since the law X has a positive ensity on S +,, this gives Y u + uy = for any u S an thus Y =. heorem.3. Assume b+b S +, an α > +. hen, uner P θ, ˆb b, ˆα α converges in law when + to the centere Gaussian vector G, H that takes values in M R an has the following Laplace transform: for c, λ M R, E θ exprc Q G] + λh] = exp λ Q rr ] Q λ Q rr ] rcr ] E θrl X ˆL + rcr ]Q Q rr ] cx + X ˆL c rcr ] Q rr ] ˆL cx + X ˆL c ]] r ˆL c] Proof. From the ergoic Birkhoff s theorem, ˆL converges almost surely to ˆL, an thus ˆL converges almost surely to ˆL. We efine the martingale ˆM = L X s M s X s. We have We get from 7 that ˆM s i,j = re i,jl X s M s X s ] = rl X s e i,j X s + X s e i,jm s ] = L X s e i,j X s + X s e i,j k,l M s k,l. k,l ˆM s i,j, ˆM s i,j = r L X s e i,j X s + X s e i,je i,j X s + X s e i,j ] s, ˆM s i,j, N s = rl X s e i,j X s + X s e i,j]s = δ i,j s.

12 SAISICAL INFERENCE: HE ERGODIC CASE From the central limit theorem for martingales, ˆM, N converges in law uner P θ towars a centere Gaussian vector Ĝ, Ĥ taking values in M R such that E θ Ĝi,jĜi,j = ]] E θ r L X e i,j X + X e i,je i,j X + X e i,j E θ Ĝi,jĤ = δ i,j an E θ Ĥ = Q. We thus have the following Laplace transform for c M, λ R, E θ exprc Ĝ] + λĥ] = exp 4 E θrl X cx + X c cx + X c ]] + λ rc] + λ Q. 39 By using Slutsky s heorem, we get from 35 that ˆb b, ˆα α converges in law uner P θ when + to the centere Gaussian vector G, H = ˆL Ĝ Q ĤI, Q Ĥ r ˆL Ĝ Q ĤI ]. Now, we use that rc G] = r 38 ˆL I = Q rr ]R an that ˆL is self-ajoint to get for c M, ˆL ] c Ĝ] Q Ĥ rc R Q rr ], H = Q Q rr Ĥ rr ] Ĝ]]. From 39, we obtain after some calculations 37, using in particular that for m M, s S, E θ rl X m + sx + X m + s m + sx + X m + s ]] 4 = E θ rl X mx + X m mx + X m ]] + rsmr + R m ] + rs R ] an taking m = ˆL c an s = λ Q Q rr ] R. Remark.. It is interesting to compare heorems. an.3 an see that the asymptotic variance of ˆα α is the same in both cases. Instea, for the estimation of the symmetric part of b, we can check that the asymptotic variance is greater when we o not know a priori that b is symmetric. For c S, we have c = ˆL cr + R ˆL c ] Q r ˆL c]i an c = L cr R + R L c Q,Q R,Q rl c]i R. Multiplying by R,Q, we get an then r ˆL c] = rcr ] Q rr ] = rl c], R,Q ˆL c = L R,Q c + with R + R =. his gives from 4 4 E θrl X ˆL + rcr ]Q Q rr ] cx + X ˆL c rcr ] Q rr ] ˆL cx + X ˆL c ]] r ˆL c] = rl R,Q c R ] + 4 E θrl X X + X X + X ]] Q rl R,Q c] = rl R,Q cc] + 4 E θrl X X + X X + X ]] rl R,Q cc], since L X is a self-ajoint positive operator.

13 3 SAISICAL INFERENCE: SOME NONERGODIC CASES 3.3 he MLE estimator of b When α, +, we are no longer able to stuy the convergence of the MLE of α. It is however still possible to get the spee of convergence of the MLE of b. heorem.4. Assume that b S +, an α. For >, we consier ˆb efine by 8. hen, uner P θ, ˆb b converges in law to a centere Gaussian vector G on S with the following Laplace transform E θ exp rcg]] = exp rcl c], c S R. Assume that b + b S +, an α. For >, we consier ˆb efine by 6. hen, uner P θ, ˆb b converges in law to a centere Gaussian vector G on M with the following Laplace transform: for c M, E θ exp rc G] ] = exp 4 E θrl X Ľ cx + X Ľ c Ľ cx + X Ľ c ]], with Ľ c = E θ L X Y ]. Proof. We coul prove the result for 8 by using the explicit Laplace transform Proposition 5.. Here, we use the same arguments as before base on the ergoic property. From 8, we have ˆb b = L R As in the proof of heorem., X x br R b α I M = L R M. converges in law to the centere Gaussian vector G efine by 8. Slutsky s theorem an 9 give then the convergence of ˆb b to G = L R G, whose Laplace transform is given by Lemma B.4. Similarly, we get from 6 that ˆb b = Ľ ˆM / with Ľ Y = L Xs Y s. We easily check that rľ Y Y ] r ˆL Y Y ] an rľ Y Y ] r ˆL Y Y ] for Y M. herefore, Ľ an Ľ are positive efinite an thus invertible. Besies, the ergoic theorem gives that Ľ converges almost surely to Ľ. he result follows from 39 an the self-ajoint property of Ľ. 3 Statistical Inference of the Wishart process: some nonergoic cases his section stuies the convergence of the MLE in the case b = b I with b. When b = an α +, we are able to escribe the rate of convergence of the MLE of b, α given by 5, when b is known to be symmetric. When b > an α, we can also obtain the rate of convergence of the MLE of b given by 8. Last, when b is known a priori to be iagonal, the MLE of b has a simpler form an we can escribe precisely its convergence. 3. he global MLE of θ = b, α when b = he following result provies the asymptotic behavior of the estimator of the couple when α > + an b = in 4.

14 3 SAISICAL INFERENCE: SOME NONERGODIC CASES 4 heorem 3.. Assume that b = an α > +. Let ˆb, ˆα be the MLE efine by 5. hen, ˆb b, log ˆα α converges in law uner P θ when + to L R X α + αi, G, where Xt = αti + t X s W s + Ws X s is a Wishart process with the same parameters but starting from, Rt = t X s s an G N, is an inepenent stanar Normal variable. Proof. From 5 an 6, we obtain log ˆα α = rˆb ] log log Q + log Q N log ˆb = L X R,Q x Q Z + + I, N an we are intereste in stuying the convergence in law of, X log. By heorem 4. in 9], for µ an >, P P θ = exp µn µ log Q log, R efines a change of probability an X t t, ] is a Wishart process with egree α + uner P. Let λ, λ S +, A = E θ exp an µn log By Proposition 5., we have A = E exp where = r etv ] α+µ/ log µ ] ] ] λ exp r Q log X λ r R. ] λ X λ r exp ]] R r V V x ] µ log, 4 + etv ] α V = λ sinh λ λ + cosh λ, V = cosh λ λ + λ sinh λ. 4 We note that this limit oes not epen on µ an is the Laplace transform of X, R by Proposition 5.. We now use that Q log à = E θ expξ ] an ξ = + α + a.s., see Lemma C. an we efine µn µ ] ] log α + r λ X λ r R

15 3 SAISICAL INFERENCE: SOME NONERGODIC CASES 5 that is finite by using equation 73 of Lemma C. since ξ A = Ã + E θ {exp he Cauchy-Schwarz inequality gives { A Ã E θ exp µ α + µ Q log µ α + µ Q log µn log. We have } ] exp ξ. } ] E θ exp ξ ]. Since Q log is positive for > an converges a.s. to α +, the first expectation goes to while the secon one is boune by using again 73. herefore, A Ã, + an we get E θ exp N hus,, X log µn log r, R inepenent of X. From 5, we have ] ] ] λ X λ exp r R + µ α + etv ] α converges in law to α + G, X, R, where G N, is N Q Z + + = log Q + α, log log. an therefore Q Z + + converges in probability to α. Slutsky s theorem gives then the following convergence in law: as +, N log, X, R, Q Z + +, Q log α + G, X, R, α, α his gives the claime convergence for ˆα, ˆb ue to the continuity property given in Lemma B.. heorem 3.. Assume that b = an α = +. Let ˆb, ˆα be the MLE efine by 5. hen, ˆb b, log ˆα α converges in law uner P θ when + to L R X 4 αi,, τ where Xt = αti + t X s W s + Ws X s is a Wishart process with the same parameters but starting from, Rt = t X s s an τ = inf{t, B t = } where B is a stanar Brownian motion inepenent from W. Proof. he proof follows the same line as the one of heorem 3., but we now write log ˆα α = rˆb ] log log Q + log N Q log,

16 3 SAISICAL INFERENCE: SOME NONERGODIC CASES 6 while we still have ˆb = L X R,Q x Q Z + + I. By heorem 4. in 9], for µ an >, P P = exp µn log µ Q efines a change of probability, an we log efine for λ, λ S +,, µn A = E θ exp log µ ] ]] λ Q log exp r X λ r R. By Proposition 5., we have A = etv ] α+µ/log exp r V V x ], + etv ] α where V an V are efine by 4. We now use that in probability, see Lemma C., an efine an have N log à = E θ expξ ], ξ = µ µ ] ] Q log r λ X λ r R We note that expξ exp we get that A à E θ exp µn A = à + E θ {exp log µ } ] exp ξ. µ. By using Lemma C. an the uniform integrability 74, an therefore + µ Q log r ] ]] λ X λ r R + exp µ/. etv ] α herefore, X, R, Q log converges in law to X, R, τ, where τ is inepenent of X. We observe that Q Z = log Q log Z log. Lemma C. an Slutsky s theorem gives N log, X, R, Q Z + +, Q log, X, R, +, which gives the claim by using the formulas for ˆb an log ˆα α. 3. he MLE of b, 44 τ Until the en of this section we consier that α is known an stuy the spee of convergence of the estimator of b efine by Case b =. heorem 3.3. Assume that b = an α. For >, let ˆb be efine by 8. When +, ˆb b converges in law uner P θ to L R X αi, where X t t is the solution to Xt = αti + t X s W s + Ws X s an Rt = t X s s.

17 3 SAISICAL INFERENCE: SOME NONERGODIC CASES 7 Proof. From 8, we have ˆb = L R X Similarly to 4, we have by Proposition 5. for λ, λ S +, E θ exp r ] ]] λ X λ r R = his gives the convergence in law of 3.. Case b = b I, b >. x αi. Let V an V be efine by 4. exp r V V x ]. + etv ] α etv ] α X, R to X, R an then the claime result. In this case b = b I with b >. In orer to ientify the spee of convergence an the limit law, we use the Laplace transform approach. We have the following result, heorem 3.4. Assume that b = b I, b >, an α. For > let ˆb efine by X 8. When +, expb ˆb b converges in law uner P θ to L X G + G X where X W IS x b, α,, I ; an G is an inepenent -square matrix whose elements 4b are inepenent stanar Normal variables. he proof of this results relies on the explicit calculation of the Laplace transform of X, R an is postpone to Subsection 5.. Obviously, the case b = b I is very particular. One woul like to consier more general nonergoic cases or ieally to be able to state a general convergence results of ˆb towars b for any b S. Despite our efforts, we have not been able to get such a result. he reason why we can hanle the ergoic case an the nonergoic case b = b I with b is that the convergence of all the matrix terms occurs at the same spee, namely / for the ergoic case, / for b = an e b when b >. In the other cases, there is no such a simple scalar rescaling. Heuristically, there may be ifferent spees of convergence that are ifficult to isentangle because of the ifferent matrix proucts. o get an iea of this, we present now the case of the estimation of b when b is known to be a iagonal matrix. In this case, we obtain ifferent spee of convergence for each iagonal terms he MLE of b when b is known a priori to be iagonal. We assume that α is known an that b is a iagonal matrix, i.e. b = iagb,, b. We want to estimate the iagonal elements by maximizing the likelihoo. We enote θ =, α. As in 7, we have L θ,θ rbx ] rbx] = exp rb X s ]s α. rb] By ifferentiating this with respect to b i, i, we get bi L θ,θ L θ,θ = an therefore the MLE of b is given by X i,i x i,i αti b i X s i,i s, ˆb i = X i,i x i,i α R i,i. 45

18 4 OPIMALIY OF HE MLE 8 We therefore obtain ˆb i b i = X i,i x i,i α b i R i,i R i,i. 46 Let us observe that this estimator is precisely the one obtaine by Ben Alaya an Kebaier 5] for the CIR process. his is not very surprising since we know from 4, an b iagonal that there exists inepenent Brownian motions β i, i such that X t i,i = α + b i X t i,i t + X t i,i βt. i hus, the iagonal elements follow inepenent CIR processes, an the observation of the non iagonal elements oes not improve the ML estimation. We can obtain the asymptotic convergence by applying heorem in 4], up to a small correction in the nonergoic case which is given by our heorem 3.4 in imension =. his yiels to the following proposition. Proposition 3.. Let α an b a iagonal matrix. Let ɛ t = iagɛ t,, ɛ t be a iagonal matrix with ɛ i t = t if b i < t if b i = exp b i t if b i > hen, uner P θ, ɛ iagˆb b,, ˆb b converges in law to a iagonal matrix D mae with inepenent elements. Each iagonal element D i is istribute as follows: b i α G if b i < X i {,, }, D i = α if b R i = law G, if b i > X x i,i /b i /4b i where X x t = x + αt + t X x s W s, Rt = t X s s, an G N, is inepenent of X. 4 Optimality of the MLE In parametric estimation theory, a funamental role is playe by the local asymptotic normality LAN property since the work of Le Cam 4]. his general concept evelope by Le Cam is extene later by Le Cam an Yang 5] an Jeganathan ] to local asymptotic mixe normality LAMN an local asymptotic quaraticity LAQ properties. hese notions are mainly eicate to stuy the asymptotic efficiency of estimators of a given parametric moel. he aim of this section is to check the valiity of either LAN, LAMN or LAQ properties for the global moel in orer to get the asymptotic efficiency of our maximum likelihoo estimators stuie in the previous section. Here we prove these properties only for the global moel θ = b, α when b is known to be symmetric. he same technique applies for all the other cases consiere in this paper where we have been able to obtain the corresponing local asymptotic property.

19 4 OPIMALIY OF HE MLE 9 Let us consier the Wishart process X t t S + α + an b S. { Xt = αi + bx t + X t b] t + X t W t + Wt with parameters θ := b, α, with Xt, t > X S We recall that P θ enotes the istributions inuce by the solutions of 47 on canonical space CR +, S + with the natural filtration F t X := σx s, s t an P θ,t = P θ Ft X enotes the restriction of P θ on the filtration F t. For α + an b S +, we set θ = b, α, an we introuce the log-likelihoo function H t = α α X t + b b X t, P θ, l θ θ = log = rh s W s ] rh s Hs ]s 48 P θ, he process W t = W t t H s s, t is a -Brownian motion uner P θ,. In the sequel, let us introuce the quantity δ := δ,, δ, R where for i {, } the localizing rates satisfy δ i, when. For all u := u, u R S, we efine δ u := δ, u, δ, u R S. Now, we rewrite 48 with θ = θ + δ u l θ θ + δ u = 8 δ, u X s ] r W s + δ, u Xs W s r δ, u X s δ, u ] s δ, u r δ, u ] δ, u r X s ] s. Hence, by using the efinitions 3, 3 an 4 of the martingales processes N t t an M t t an the processes R t t an Q t t, it is easy to check that l θ θ + δ u = where Λ u = u R S + δ, u N + r δ, u M ] r δ, u R δ, u ] δ, u r δ, u ] 8 δ, u Q = Λ u Γ u, 49 δ, u N + r δ, u M ] is a linear ranom function with respect to with quaratic variation Γ u = δ, ru R ] + δ, δ, u r u ] + 4 δ, u Q.

20 4 OPIMALIY OF HE MLE 4. Case b S + an α + We first consier α > +. In this ergoic case, we set δ i, = / for i {, }, an we get from 9 an Γ u a.s. Γ u := r u R ] + u r u ] + 4 u r Q ], as +. 5 his yiels the valiity of the so calle Raykov type conition. Hence, accoring to heorem in 8], relations 49 an 5 ensure the valiity of the local asymptotic normality LAN property, that is uner P θ we have Λ u, Γ u Γ / uz, Γ u, as, 5 with Z a stanar normal real ranom variable. It is worth noting that the above convergence can also be obtaine using the proof of heorem.. In fact, we have alreay proven that uner P θ N, M G, H 5 where G, H is a centere Gaussian vector taking values in R S + such that E θ G i,j Gk,l = δ jl R i,k + δ jk R i,l + δ il R j,k + δ ik R j,l ], E θ G i,j H = δi,j an E θ H = Q. herefore, LAN property 5 follows from relations 5 an 5. We now consier the case α = + an set δ, = an δ, = /. By using 33, we get that uner P θ, Λ u, Γ u u rb] + r ] u R G, ru R ] + 4 u τ rb], as, where τ rb] is efine as in heorem. an G is an inepenent matrix, whose elements G i,j, i, j, are inepenent stanar normal variables. Hence, accoring to Le Cam an Yang 5] an Jeganathan ] this last convergence yiels the LAQ property for this ergoic case. 4. Case b = an α + We first assume α > +. From 47 with b = an 3, we have M = X x αi. From 43, it follows that as N, M log, R, Q log α + G, X αi, R,, α + where X an R are efine as in heorem 3.. hus, in the same way as in the previous case if we set δ, = an δ, =, then Λ u, Γ u converges in law uner P θ log to α + u G + r u X αi ], r ] u R + u, as. 4α +

21 5 HE LAPLACE RANSFORM AND IS USE O SUDY HE MLE his ensures the valiity of the LAQ property in this non-ergoic case. When α = +, we use the notation of heorem 3. an get from 44 N log, M, R, Q log, X αi, R, τ. With δ, = log an δ, =, we get that Λ u, Γ u converges in law uner P θ to 4 u + ] ru X αi ], r u R + u 8 τ, as. his gives again the LAQ property. 5 he Laplace transform an its use to stuy the MLE 5. he Laplace transform of X, R We present our main result on the joint Laplace transform of X, R, that can be of inepenent interest. his Laplace transform is given by Bru 7], eq. 4.7 when b = an has been recently stuie an obtaine explicitly by Gnoatto an Grasselli 7]. Here, we present another proof that enables us to get the Laplace transform for any α, as well as a more precise result concerning its set of convergence, see Remarks 5. an 5. below for a further iscussion. Proposition 5.. Let α, x S +, b S an X W IS x, α, b, I. Let v, w S be such that v m S, mb bm m S + an w + m S+. 53 hen, we have for t E exp rwx t] rvr ] ] t = exp α rb]t etv v,w t] α exp r V v,wtv v,w t + bx ], 54 with V v,w t = k= t k+ ṽ k k +! w + k= t k ṽk k!, ṽ = v + b, an w = w b. If besies ṽ = v + b S +,, we have V v,w t = ṽ sinh ṽt w + cosh ṽt an then V v,wt = cosh ṽt w + sinh ṽt ṽ. Before proving this result, we recall the following fact: x, y S +, rxy], 55 which is clear once we have observe that rxy] = r xy x] an xy x S +. We also recall a result on matrix Riccati equations, see Dieci an Eirola ] Proposition..

22 5 HE LAPLACE RANSFORM AND IS USE O SUDY HE MLE Lemma 5.. Let b S an δ S +. Let ξ enote the solution of the following matrix Riccati ifferential equation ξ + ξ = bξ + ξ b + δ, ξ S. 56 If ξ S +, the solution ξ is well-efine for any t an satisfies ξt S+. Proof of Proposition 5.. Let > be given. We first assume w, v S +, which ensures that E exp rwx + vr ] ] <. We consier the martingale M t = E exp ] rwx + vr ] F t, t, ]. Due to the affine structure, we are looking for smooth functions β : R + R, γ, δ : R + S such that M t = exp β t + rγ tx t ] + rδ tr t ]. We necessarily have β =, γ = w/ an δ = v/. Itô s formula gives M { t = β t rγ tx t ] rδ tr t ] + rγ tαi + bx t + X t b] M t } + rδ tx t ] + rγ t X t ] t + rγ t X t W t + Wt Xt ]. Since M is a martingale, the rift term shoul vanish almost surely. he rift term being a eterministic affine function of X t, R t, we obtain the following system of ifferential equations: δ =, 57 γ + γb + bγ + γ + δ =, 58 β + α rγ] =. 59 he first equation gives δt = v/. he secon equation is a matrix Riccati ifferential equation. We now consier ξ = m γ with m satisfying 53. It solves 56 with b = b + m, δ = bm mb m + v/ an ξ = m + w/. We know then by Lemma 5. that ξ is well efine for any t an stays in S +. In particular, γ is well efine for any t. We set γ = γ + b. We have γ = γ b γ + γb + 4 b an thus γ solves the following matrix Riccati ifferential equation: γ = γ ṽ, γ = w, with ṽ = v + b an w = w b. ] M t M We set Mt = t M 3 t M 4 t that γt = = exp t ṽ/ I M t ] M t w M 4 t M 3t w]. ] M an get by Levin 6] We check that the matrix M 4 t M 3t w is inee invertible. In fact, let { τ = inf t, et M 4 t ] } M 3t w =.

23 5 HE LAPLACE RANSFORM AND IS USE O SUDY HE MLE 3 We have τ > an for t, τ, t M 4t M 3t w] = M t M t w ] an thus t et M 4 t ] M 3t w = et M 4 t ] M 3t w r γt]. his gives et M 4 t M 3t w ] = exp t r γs]s >, an we necessary get τ = + since γ an thus γ is well efine for t. Since ] k ] ] k+ ṽ/ ṽk ṽ/ ṽ = I ṽ k an = k+ ] / I ṽ k, we get M t = M 4 t = k= t k ṽ k k!, M t = k= t k+ ṽ k+ k +!, M 3t = k= t k+ ṽ k k +!. If ṽ = v + b S +, ṽ, is well efine an we have M t = M 4 t = cosht ṽ, M t = ṽ ṽ sinht an M3 t = ṽ sinht ṽ. Now, we efine V t = M 4 t M 3t w = k= t k+ Since V t = M t + M t w, we obtain that ṽ k k +! γt = V tv t an thus γt = w + k= t k ṽk k!. V tv t + b. Last, we have β t = α rv tv t ] α rb] an we obtain that βt = α logetv t] α rb]t, etv t] since t = etv t] rv tv t ]. It remains to show that we inee have 54 for v an w satisfying 53. E t = expβ t+rγ txt]+r v Rt] expβ +rγ x]. By Itô s formula, we have We efine E t E t = rγ t X t W t + W t Xt ]. his is a positive local martingale an thus a supermartingale which gives EE ], an we want to prove that this is a martingale. o o so, we use the argument presente by Ryberg in 34]. For L >, we efine L τ L = inf{t, rx t ] L}, an π L x = x rx] L + rx] x rx]>l for x S +. We consier EL t, t, ] the solution of Et L = Et L rγ t π L X t W t + Wt πl X t ], E L =.

24 5 HE LAPLACE RANSFORM AND IS USE O SUDY HE MLE 4 We clearly have EE L] =. Besies, uner PL given by PL P F W L t = W t π L X t γ tt, t, ], = E L, the process is a matrix Brownian motion. Since E t = Et L for t τ L, we have EE ] = EE L τ L > ]+EE τl ]. By Lebesgue s theorem, we get EE τl ]. On the other han, EE L τ L > ] = P L τ L >. L + Let us consier the Wishart process X starting from x such that X t = αi + b + γ t X t + X ] t b + γ t t + Xt W t + Wt Xt. We also efine τ L = inf{t, ], r X t ] L} with convention inf = +. he process X solves the same SDE on, τ L ] uner P as X on, τ L ] uner P L. We therefore have which finally gives EE ] =. P L τ L > = P τ L >, L + Corollary 5.. Let Y W IS y, α, b, a be a Wishart process with parameters α, y S +, a, b M satisfying Let v, w S be such that m S, hen, we have awa + m S + E exp r wy + v = exp α rb]t etv v,w t] α with V v,w t = ba a = a ab an a invertible. 6 an ava ]] Y s s ab a m ma ba m S +. 6 exp r V v,wtv v,w t + a ba a ya ], ṽk k= tk+ k! w + ṽk k= tk k! an ṽ = ava + a b a, an w = awa a ba. Proof. We know that Y = a Xa with x = a ya an X W IS x, α, a ba, I, law see e.g. equation 3 in ]. We notice that a ba = ab a ba a = a ab an thus a ba S. We have E exp ]] r wy + v Y s s = E exp ]] awa r X + ava X s s, which gives the result by applying Proposition 5..

25 5 HE LAPLACE RANSFORM AND IS USE O SUDY HE MLE 5 By setting m = a ma, the conition 6 is equivalent to the existence of m S, such that w + m S+ an v b m mb ma a m S +. 6 he case m = gives back the finiteness of the Laplace transform when v, w S +. If we take m = w/, we get also the finiteness when v + b w + wb wa aw S Another interesting choice is m = a ba. We have m S from 6. his choice gives the finiteness of the Laplace transform when v+b a a b S + an w a a b S +. Let us note that ṽ = av + b a a ba so that the first conition is the same as ṽ S +. Another interesting choice of m is given by the next remark. Remark 5.. Proposition 5. extens the result of Gnoatto an Grasselli 7] to α, an the sufficient conition 6 that ensures the finiteness of the Laplace transform is also less restrictive, which is crucial in our stuy especially in the nonergoic case. In particular, it oes not assume a priori that v+b a a b S +. We can recover the result of 7] as follows. Let us assume v+b a a b S + an take m = a ba + av + b a a ba. We have m S from 6 an it satisfies ava ab a m ma ba m = S +. herefore, 6 hols if w a a b + a av + b a a ba a S +. his is precisely the conition state in 7]. Remark 5.. It is possible to get similarly the Laplace transform of Y, Y ss when Y solves Y t = α + by t + Y t b ] t + Y t W t a + a Wt Y t, Y = y S +, with a, b satisfying 6 an α a a S +. Y = a Xa, where law X t = ˆα + ˆbX t + X tˆb ] t + X t W t + W t Again, equation 3 in ] gives Xt, X = x, with x = a ya S, ˆb = a ba S an ˆα = a αa S. Repeating the proof of Proposition 5., we observe that the Riccati equation 58 an equation 57 remain unchange while 59 is replace by β = rˆαγ] = rˆαv tv t ] rˆαˆb]. herefore, we euce that uner the same conition 6, we have E exp r wy + v ]] Y s s = expβ exp r V v,wtv v,w t + a ba a ya ],

26 5 HE LAPLACE RANSFORM AND IS USE O SUDY HE MLE 6 t with βt = ra αa V v,wsv v,w s ]s t rαa a b] an V v,w t efine as in Corollary 5.. hus, the formula is no longer totally explicit. In Gnoatto an Grasselli 7], the result is state with ra αa logv v,w t] instea of the first integral. However, this replacement oes not seem clear to us unless V v,ws an V v,w s commute for all s this happens when the matrices ṽ an w in V v,w commute or α = αa a by using the trace cyclic theorem. Corollary 5.. Let Y W IS y, α, b, a be a Wishart process with parameters such that ba a = a ab an a invertible. hen, u S, E exp ru Y s W s a]s ] rauy s ua ]s =. Proof. We have ru Y s W s a]s = ruy y] α rua a] r ub + b u ] Y ss. We apply Corollary 5. with w = u an v = ub + b u + ua au. herefore, 63 hols. We then have w = aua + a ba an ṽ = w an the result follows by simple calculations. 5. Stuy of the MLE of b with the Laplace transform We consier ɛ : R + R + a eterministic ecreasing function such that lim t + ɛ t =. From the efinition of the MLE of b 8, we get that ɛ ˆb b = L ɛ R ɛ X x α I br R b]. hus, we want to calculate the Laplace transform of ɛ X x α I br R b], ɛ R in orer to stuy the convergence of ɛ ˆb b. For λ, λ S, we efine ] E, λ, λ := E θ exp ɛ rλ X x α I br R b] ɛ rλ R ] 64 ] = exp ɛ rλ x + α I ] E θ exp rɛ λ X ] rɛ λ ɛ λ b + bλ R ]. We now consier λ, λ S such that We efine 65 λ λ S +,. 66 v = λ ɛ bλ + λ bɛ, ṽ = v + b, w = λ ɛ, w = w b, 67 an have v + bw + w b w = ɛ λ 4λ S+,. hus, by applying Proposition 5. with m = ɛ λ, we get that E, λ, λ is finite an given by E, λ, λ = exp α rb] exp etv v,w ] α r V v,w V v,w + bx ] exp ɛ r λ x + α I ] 68

27 5 HE LAPLACE RANSFORM AND IS USE O SUDY HE MLE 7 with V v,w = ṽ sinh ṽ w + cosh v V v,w = cosh ṽ w + sinh ṽ ṽ. Besies, we have ṽ = b ɛ λ + ɛ λ 4λ S+,. When b S +, an ɛ = /, we can make explicit calculations an get lim E, λ, λ = exp rλ R ] rλ R ], + which gives another mean to prove heorem.4. Here, we prove heorem 3.4. Proof of heorem 3.4. Here, we focus on the case b = b I with b > an set ɛ = e b. Since the square root function is analytic on the set of positive efinite matrices see e.g. 33], p. 34 we get that ṽ = b I ɛ λ + ɛ b λ λ + Oɛ 3, since the squares of each sies coincies up to a Oɛ 3 term. We observe that w = ɛ λ b I, an thus ṽ + w = ɛ b λ λ + Oɛ3. We now write V v,w = ṽ exp ṽ ṽ + w + exp ṽ ] ṽ w V v,w = exp ṽ ṽ + w + exp ṽ w ṽ. Since ɛ exp ṽ ɛ V v,w I, we get + ɛ V v,w + b λ λ b I. his yiels to ] + b b λ λ + b I V v,w V v,w + b I λ λ λ λ + b + b I. b λ λ +b I ]], an there- We also have exp α rb I ] etv v,w ] α fore = etɛ Vv,w ] α + et b an ] exp lim E, λ b r λ λ λ b λ + I x, λ = ] et λ b λ + I We now want to ientify the limit. We know that X W IS x b, α,, I ; has the 4b following Laplace transform u S +, Eexp rux]] = exp r ui + u x b eti + u] b b ].

28 6 NUMERICAL SUDY 8 Let G enote a -square matrix inepenent from X, whose entries are inepenent an follow a stanar Normal istribution. By Lemma B.4, we have Eexp rλ X + λ X G + G X]] = Eexp rλ λ X]]. hus, 69 shows the convergence in law of ɛ X x α I br R b, ɛ R to X, X G + G X uner P θ, which gives the claim of heorem Numerical Stuy In this section, we test the convergence of the MLE given by 5 an 8. o o so, we consier a given large value of an simulate the Wishart process exactly on the regular time gri t i = i N, i =,, N. his can be one by using the metho presente in Ahia an Alfonsi ], see also Alfonsi 3]. We take N sufficiently large an approximate the integrals R an Q applying the trapezoial rule along this time gri. hus, we will use the estimator with the exact value of X an these approximate values of R an Q. his section has three goals. First, we check numerically the convergence results that we have obtaine. Secon, we investigate numerically the convergence of the MLE in some nonergoic cases, where no theoretical result of convergence have been foun. Last, we test the estimation of the parameters of a full Wishart process. o o so, we estimate first a with the quaratic variation an then the parameters α an b by using the MLE 5 on the process a Xa. 6. Numerical valiation of the convergence results Using the metho mentione above, we have checke the convergence results obtaine in this paper. Namely, we sample M = inepenent paths of X in orer to raw an histogram of the properly rescale value of ˆb i,j b i,j or ˆα α. We o not reprouce all these graphics here, an present for example in Figure an illustration of the convergence given by heorem a Limit law of exp.5 b ˆb,. b Limit law of exp.5 b ˆb,. Figure : Asymptotic law of the error for the estimation of θ = b with for: x =.5...3, =, N =, α = 4.5 an b =.5I.

29 6 NUMERICAL SUDY 9 6. Experimental convergence in a nonergoic case In this paragraph, we try to guess the asymptotic behavior of the MLE in a nonergoic case, where no theoretical convergence result is known. Namely, we observe in Figure the asymptotic estimation error, when b = iag.,.5 is iagonal with positive an istinct terms on its iagonal an when we use the estimator 8. As one might have guess, the convergence of the iagonal terms seems to be with an exponential rate, with the exponential spee corresponing to its value. Namely, ˆb seems to converge to b with a spee of exp. while ˆb seems to converge to b with a spee of exp.5. More interesting is the antiiagonal term. One coul have imagine that the convergence rate is the slowest of these two rates. Instea, on our experiment, the convergence of ˆb towars b seems to happen with the rate exp.. We have observe the same behaviour for other parameter values. Of course, it woul be hasty to raw a global conclusion from few particular experiments. However, it is interesting to note that these numerical tests are a way to guess or check the convergence rate of the MLE a Limit law of exp. b ˆb,. b Limit law of exp.5 b ˆb, c Limit law of exp. b ˆb,. Figure : Asymptotic law of the error for the estimation of θ = b with x = N =, α = 3.5 an b = iag., , =, 6.3 Estimation of the whole Wishart process In this last part of the numerical stuy, we perform the estimation of all the parameters of the Wishart process. We consier a case where a is upper triangular an a ba is symmetric. We procee as follows. First, we sample exactly a iscrete path X i/n, i N.

30 6 NUMERICAL SUDY 3 hen, we estimate the matrix a a by using 3, where the quaratic variations are replace by their classical approximations an the integrals are replace by the trapezoial rule. By a Cholesky ecomposition we get then an estimator â of a. hen, we use the MLE 5 on the path â X i/n â, i N. his gives an estimator of α an a ba, an therefore an estimator of b. As a comparison, we also calculate similarly the estimator of α an b when a is known an has not to be estimate. o raw histograms or calculate empirical expectations, we run M = inepenent paths of X. We consier a sufficiently large value of an are intereste in looking at the convergence with respect to N. First, we plot the the error on the estimator of a with respect to the number of time step in Log-Log scale. We observe that the convergence to zero takes place with experimental rate close to /. his is in line with the general results on the estimation of the iffusion coefficient, see Dohnal ] an Genon-Catalot an Jaco 5]. hen, we focus on the influence of the iscretization an the unknown parameter a on the convergence of the MLE of b an α. In able, we give in function of N the Mean Square Error MSE θ N θ = E θ N θ ] of the estimator θ N, with θ = b, α. It is estimate with the empirical expectation. First, we observe that the convergence of the estimator of α is roughly the same whether we know a or not. his is expecte since the estimation of α oes not epen on the estimation of a. Instea, the bias on b is much higher when a is estimate than when a is known. However, it ecreases also faster at an experimental orer of.7 while the bias when a is known ecreases at an experimental orer of.45. his latter rate is in line with the rate of / obtaine in imension by Ben Alaya an Kebaier 5]. In our case, it seems that the influence of the estimation of a vanishes aroun N = 5. Last, we have plotte in Figure 4 the limit law of the estimator θ N θ with N =. his short numerical stuy shows that the estimator obtaine by iscretizing the continuous time estimator is efficient in practice. Of course, it woul be nice to obtain general convergence results in function of an N, but we leave this for further research Figure 3: Log-Log representation of the empirical expectation of Era â N ]] / for x =.8.5.5, =, a =, α = 4.5, b =., where the line is the simple linear regression i.e. logera â N ]] /.6.58 logn.

Self-normalized Martingale Tail Inequality

Self-normalized Martingale Tail Inequality Online-to-Confience-Set Conversions an Application to Sparse Stochastic Banits A Self-normalize Martingale Tail Inequality The self-normalize martingale tail inequality that we present here is the scalar-value

More information

6 General properties of an autonomous system of two first order ODE

6 General properties of an autonomous system of two first order ODE 6 General properties of an autonomous system of two first orer ODE Here we embark on stuying the autonomous system of two first orer ifferential equations of the form ẋ 1 = f 1 (, x 2 ), ẋ 2 = f 2 (, x

More information

Introduction to the Vlasov-Poisson system

Introduction to the Vlasov-Poisson system Introuction to the Vlasov-Poisson system Simone Calogero 1 The Vlasov equation Consier a particle with mass m > 0. Let x(t) R 3 enote the position of the particle at time t R an v(t) = ẋ(t) = x(t)/t its

More information

Computing Exact Confidence Coefficients of Simultaneous Confidence Intervals for Multinomial Proportions and their Functions

Computing Exact Confidence Coefficients of Simultaneous Confidence Intervals for Multinomial Proportions and their Functions Working Paper 2013:5 Department of Statistics Computing Exact Confience Coefficients of Simultaneous Confience Intervals for Multinomial Proportions an their Functions Shaobo Jin Working Paper 2013:5

More information

Affine processes on positive semidefinite matrices

Affine processes on positive semidefinite matrices Affine processes on positive semiefinite matrices Josef Teichmann (joint work with C. Cuchiero, D. Filipović an E. Mayerhofer) ETH Zürich Zürich, June 2010 C. Cuchiero, D. Filipović, E. Mayerhofer, J.

More information

Conservation Laws. Chapter Conservation of Energy

Conservation Laws. Chapter Conservation of Energy 20 Chapter 3 Conservation Laws In orer to check the physical consistency of the above set of equations governing Maxwell-Lorentz electroynamics [(2.10) an (2.12) or (1.65) an (1.68)], we examine the action

More information

Euler equations for multiple integrals

Euler equations for multiple integrals Euler equations for multiple integrals January 22, 2013 Contents 1 Reminer of multivariable calculus 2 1.1 Vector ifferentiation......................... 2 1.2 Matrix ifferentiation........................

More information

Convergence of Random Walks

Convergence of Random Walks Chapter 16 Convergence of Ranom Walks This lecture examines the convergence of ranom walks to the Wiener process. This is very important both physically an statistically, an illustrates the utility of

More information

Diagonalization of Matrices Dr. E. Jacobs

Diagonalization of Matrices Dr. E. Jacobs Diagonalization of Matrices Dr. E. Jacobs One of the very interesting lessons in this course is how certain algebraic techniques can be use to solve ifferential equations. The purpose of these notes is

More information

Entanglement is not very useful for estimating multiple phases

Entanglement is not very useful for estimating multiple phases PHYSICAL REVIEW A 70, 032310 (2004) Entanglement is not very useful for estimating multiple phases Manuel A. Ballester* Department of Mathematics, University of Utrecht, Box 80010, 3508 TA Utrecht, The

More information

Math 342 Partial Differential Equations «Viktor Grigoryan

Math 342 Partial Differential Equations «Viktor Grigoryan Math 342 Partial Differential Equations «Viktor Grigoryan 6 Wave equation: solution In this lecture we will solve the wave equation on the entire real line x R. This correspons to a string of infinite

More information

Least-Squares Regression on Sparse Spaces

Least-Squares Regression on Sparse Spaces Least-Squares Regression on Sparse Spaces Yuri Grinberg, Mahi Milani Far, Joelle Pineau School of Computer Science McGill University Montreal, Canaa {ygrinb,mmilan1,jpineau}@cs.mcgill.ca 1 Introuction

More information

θ x = f ( x,t) could be written as

θ x = f ( x,t) could be written as 9. Higher orer PDEs as systems of first-orer PDEs. Hyperbolic systems. For PDEs, as for ODEs, we may reuce the orer by efining new epenent variables. For example, in the case of the wave equation, (1)

More information

Time-of-Arrival Estimation in Non-Line-Of-Sight Environments

Time-of-Arrival Estimation in Non-Line-Of-Sight Environments 2 Conference on Information Sciences an Systems, The Johns Hopkins University, March 2, 2 Time-of-Arrival Estimation in Non-Line-Of-Sight Environments Sinan Gezici, Hisashi Kobayashi an H. Vincent Poor

More information

ELEC3114 Control Systems 1

ELEC3114 Control Systems 1 ELEC34 Control Systems Linear Systems - Moelling - Some Issues Session 2, 2007 Introuction Linear systems may be represente in a number of ifferent ways. Figure shows the relationship between various representations.

More information

Lower bounds on Locality Sensitive Hashing

Lower bounds on Locality Sensitive Hashing Lower bouns on Locality Sensitive Hashing Rajeev Motwani Assaf Naor Rina Panigrahy Abstract Given a metric space (X, X ), c 1, r > 0, an p, q [0, 1], a istribution over mappings H : X N is calle a (r,

More information

Lecture Introduction. 2 Examples of Measure Concentration. 3 The Johnson-Lindenstrauss Lemma. CS-621 Theory Gems November 28, 2012

Lecture Introduction. 2 Examples of Measure Concentration. 3 The Johnson-Lindenstrauss Lemma. CS-621 Theory Gems November 28, 2012 CS-6 Theory Gems November 8, 0 Lecture Lecturer: Alesaner Mąry Scribes: Alhussein Fawzi, Dorina Thanou Introuction Toay, we will briefly iscuss an important technique in probability theory measure concentration

More information

Permanent vs. Determinant

Permanent vs. Determinant Permanent vs. Determinant Frank Ban Introuction A major problem in theoretical computer science is the Permanent vs. Determinant problem. It asks: given an n by n matrix of ineterminates A = (a i,j ) an

More information

The derivative of a function f(x) is another function, defined in terms of a limiting expression: f(x + δx) f(x)

The derivative of a function f(x) is another function, defined in terms of a limiting expression: f(x + δx) f(x) Y. D. Chong (2016) MH2801: Complex Methos for the Sciences 1. Derivatives The erivative of a function f(x) is another function, efine in terms of a limiting expression: f (x) f (x) lim x δx 0 f(x + δx)

More information

A Note on Exact Solutions to Linear Differential Equations by the Matrix Exponential

A Note on Exact Solutions to Linear Differential Equations by the Matrix Exponential Avances in Applie Mathematics an Mechanics Av. Appl. Math. Mech. Vol. 1 No. 4 pp. 573-580 DOI: 10.4208/aamm.09-m0946 August 2009 A Note on Exact Solutions to Linear Differential Equations by the Matrix

More information

The Principle of Least Action

The Principle of Least Action Chapter 7. The Principle of Least Action 7.1 Force Methos vs. Energy Methos We have so far stuie two istinct ways of analyzing physics problems: force methos, basically consisting of the application of

More information

1. Aufgabenblatt zur Vorlesung Probability Theory

1. Aufgabenblatt zur Vorlesung Probability Theory 24.10.17 1. Aufgabenblatt zur Vorlesung By (Ω, A, P ) we always enote the unerlying probability space, unless state otherwise. 1. Let r > 0, an efine f(x) = 1 [0, [ (x) exp( r x), x R. a) Show that p f

More information

Linear First-Order Equations

Linear First-Order Equations 5 Linear First-Orer Equations Linear first-orer ifferential equations make up another important class of ifferential equations that commonly arise in applications an are relatively easy to solve (in theory)

More information

The total derivative. Chapter Lagrangian and Eulerian approaches

The total derivative. Chapter Lagrangian and Eulerian approaches Chapter 5 The total erivative 51 Lagrangian an Eulerian approaches The representation of a flui through scalar or vector fiels means that each physical quantity uner consieration is escribe as a function

More information

Acute sets in Euclidean spaces

Acute sets in Euclidean spaces Acute sets in Eucliean spaces Viktor Harangi April, 011 Abstract A finite set H in R is calle an acute set if any angle etermine by three points of H is acute. We examine the maximal carinality α() of

More information

Parameter estimation: A new approach to weighting a priori information

Parameter estimation: A new approach to weighting a priori information Parameter estimation: A new approach to weighting a priori information J.L. Mea Department of Mathematics, Boise State University, Boise, ID 83725-555 E-mail: jmea@boisestate.eu Abstract. We propose a

More information

Lectures - Week 10 Introduction to Ordinary Differential Equations (ODES) First Order Linear ODEs

Lectures - Week 10 Introduction to Ordinary Differential Equations (ODES) First Order Linear ODEs Lectures - Week 10 Introuction to Orinary Differential Equations (ODES) First Orer Linear ODEs When stuying ODEs we are consiering functions of one inepenent variable, e.g., f(x), where x is the inepenent

More information

Energy behaviour of the Boris method for charged-particle dynamics

Energy behaviour of the Boris method for charged-particle dynamics Version of 25 April 218 Energy behaviour of the Boris metho for charge-particle ynamics Ernst Hairer 1, Christian Lubich 2 Abstract The Boris algorithm is a wiely use numerical integrator for the motion

More information

Topic 7: Convergence of Random Variables

Topic 7: Convergence of Random Variables Topic 7: Convergence of Ranom Variables Course 003, 2016 Page 0 The Inference Problem So far, our starting point has been a given probability space (S, F, P). We now look at how to generate information

More information

Separation of Variables

Separation of Variables Physics 342 Lecture 1 Separation of Variables Lecture 1 Physics 342 Quantum Mechanics I Monay, January 25th, 2010 There are three basic mathematical tools we nee, an then we can begin working on the physical

More information

Jointly continuous distributions and the multivariate Normal

Jointly continuous distributions and the multivariate Normal Jointly continuous istributions an the multivariate Normal Márton alázs an álint Tóth October 3, 04 This little write-up is part of important founations of probability that were left out of the unit Probability

More information

Robust Forward Algorithms via PAC-Bayes and Laplace Distributions. ω Q. Pr (y(ω x) < 0) = Pr A k

Robust Forward Algorithms via PAC-Bayes and Laplace Distributions. ω Q. Pr (y(ω x) < 0) = Pr A k A Proof of Lemma 2 B Proof of Lemma 3 Proof: Since the support of LL istributions is R, two such istributions are equivalent absolutely continuous with respect to each other an the ivergence is well-efine

More information

Problem set 2: Solutions Math 207B, Winter 2016

Problem set 2: Solutions Math 207B, Winter 2016 Problem set : Solutions Math 07B, Winter 016 1. A particle of mass m with position x(t) at time t has potential energy V ( x) an kinetic energy T = 1 m x t. The action of the particle over times t t 1

More information

SINGULAR PERTURBATION AND STATIONARY SOLUTIONS OF PARABOLIC EQUATIONS IN GAUSS-SOBOLEV SPACES

SINGULAR PERTURBATION AND STATIONARY SOLUTIONS OF PARABOLIC EQUATIONS IN GAUSS-SOBOLEV SPACES Communications on Stochastic Analysis Vol. 2, No. 2 (28) 289-36 Serials Publications www.serialspublications.com SINGULAR PERTURBATION AND STATIONARY SOLUTIONS OF PARABOLIC EQUATIONS IN GAUSS-SOBOLEV SPACES

More information

An Optimal Algorithm for Bandit and Zero-Order Convex Optimization with Two-Point Feedback

An Optimal Algorithm for Bandit and Zero-Order Convex Optimization with Two-Point Feedback Journal of Machine Learning Research 8 07) - Submitte /6; Publishe 5/7 An Optimal Algorithm for Banit an Zero-Orer Convex Optimization with wo-point Feeback Oha Shamir Department of Computer Science an

More information

Notes on Lie Groups, Lie algebras, and the Exponentiation Map Mitchell Faulk

Notes on Lie Groups, Lie algebras, and the Exponentiation Map Mitchell Faulk Notes on Lie Groups, Lie algebras, an the Exponentiation Map Mitchell Faulk 1. Preliminaries. In these notes, we concern ourselves with special objects calle matrix Lie groups an their corresponing Lie

More information

On a limit theorem for non-stationary branching processes.

On a limit theorem for non-stationary branching processes. On a limit theorem for non-stationary branching processes. TETSUYA HATTORI an HIROSHI WATANABE 0. Introuction. The purpose of this paper is to give a limit theorem for a certain class of iscrete-time multi-type

More information

SOME LYAPUNOV TYPE POSITIVE OPERATORS ON ORDERED BANACH SPACES

SOME LYAPUNOV TYPE POSITIVE OPERATORS ON ORDERED BANACH SPACES Ann. Aca. Rom. Sci. Ser. Math. Appl. ISSN 2066-6594 Vol. 5, No. 1-2 / 2013 SOME LYAPUNOV TYPE POSITIVE OPERATORS ON ORDERED BANACH SPACES Vasile Dragan Toaer Morozan Viorica Ungureanu Abstract In this

More information

The Exact Form and General Integrating Factors

The Exact Form and General Integrating Factors 7 The Exact Form an General Integrating Factors In the previous chapters, we ve seen how separable an linear ifferential equations can be solve using methos for converting them to forms that can be easily

More information

Calculus of Variations

Calculus of Variations 16.323 Lecture 5 Calculus of Variations Calculus of Variations Most books cover this material well, but Kirk Chapter 4 oes a particularly nice job. x(t) x* x*+ αδx (1) x*- αδx (1) αδx (1) αδx (1) t f t

More information

LATTICE-BASED D-OPTIMUM DESIGN FOR FOURIER REGRESSION

LATTICE-BASED D-OPTIMUM DESIGN FOR FOURIER REGRESSION The Annals of Statistics 1997, Vol. 25, No. 6, 2313 2327 LATTICE-BASED D-OPTIMUM DESIGN FOR FOURIER REGRESSION By Eva Riccomagno, 1 Rainer Schwabe 2 an Henry P. Wynn 1 University of Warwick, Technische

More information

Iterated Point-Line Configurations Grow Doubly-Exponentially

Iterated Point-Line Configurations Grow Doubly-Exponentially Iterate Point-Line Configurations Grow Doubly-Exponentially Joshua Cooper an Mark Walters July 9, 008 Abstract Begin with a set of four points in the real plane in general position. A to this collection

More information

Sturm-Liouville Theory

Sturm-Liouville Theory LECTURE 5 Sturm-Liouville Theory In the three preceing lectures I emonstrate the utility of Fourier series in solving PDE/BVPs. As we ll now see, Fourier series are just the tip of the iceberg of the theory

More information

Equilibrium in Queues Under Unknown Service Times and Service Value

Equilibrium in Queues Under Unknown Service Times and Service Value University of Pennsylvania ScholarlyCommons Finance Papers Wharton Faculty Research 1-2014 Equilibrium in Queues Uner Unknown Service Times an Service Value Laurens Debo Senthil K. Veeraraghavan University

More information

19 Eigenvalues, Eigenvectors, Ordinary Differential Equations, and Control

19 Eigenvalues, Eigenvectors, Ordinary Differential Equations, and Control 19 Eigenvalues, Eigenvectors, Orinary Differential Equations, an Control This section introuces eigenvalues an eigenvectors of a matrix, an iscusses the role of the eigenvalues in etermining the behavior

More information

Logarithmic spurious regressions

Logarithmic spurious regressions Logarithmic spurious regressions Robert M. e Jong Michigan State University February 5, 22 Abstract Spurious regressions, i.e. regressions in which an integrate process is regresse on another integrate

More information

Linear Algebra- Review And Beyond. Lecture 3

Linear Algebra- Review And Beyond. Lecture 3 Linear Algebra- Review An Beyon Lecture 3 This lecture gives a wie range of materials relate to matrix. Matrix is the core of linear algebra, an it s useful in many other fiels. 1 Matrix Matrix is the

More information

A LIMIT THEOREM FOR RANDOM FIELDS WITH A SINGULARITY IN THE SPECTRUM

A LIMIT THEOREM FOR RANDOM FIELDS WITH A SINGULARITY IN THE SPECTRUM Teor Imov r. ta Matem. Statist. Theor. Probability an Math. Statist. Vip. 81, 1 No. 81, 1, Pages 147 158 S 94-911)816- Article electronically publishe on January, 11 UDC 519.1 A LIMIT THEOREM FOR RANDOM

More information

APPROXIMATE SOLUTION FOR TRANSIENT HEAT TRANSFER IN STATIC TURBULENT HE II. B. Baudouy. CEA/Saclay, DSM/DAPNIA/STCM Gif-sur-Yvette Cedex, France

APPROXIMATE SOLUTION FOR TRANSIENT HEAT TRANSFER IN STATIC TURBULENT HE II. B. Baudouy. CEA/Saclay, DSM/DAPNIA/STCM Gif-sur-Yvette Cedex, France APPROXIMAE SOLUION FOR RANSIEN HEA RANSFER IN SAIC URBULEN HE II B. Bauouy CEA/Saclay, DSM/DAPNIA/SCM 91191 Gif-sur-Yvette Ceex, France ABSRAC Analytical solution in one imension of the heat iffusion equation

More information

LOGISTIC regression model is often used as the way

LOGISTIC regression model is often used as the way Vol:6, No:9, 22 Secon Orer Amissibilities in Multi-parameter Logistic Regression Moel Chie Obayashi, Hiekazu Tanaka, Yoshiji Takagi International Science Inex, Mathematical an Computational Sciences Vol:6,

More information

LECTURE NOTES ON DVORETZKY S THEOREM

LECTURE NOTES ON DVORETZKY S THEOREM LECTURE NOTES ON DVORETZKY S THEOREM STEVEN HEILMAN Abstract. We present the first half of the paper [S]. In particular, the results below, unless otherwise state, shoul be attribute to G. Schechtman.

More information

Markov Chains in Continuous Time

Markov Chains in Continuous Time Chapter 23 Markov Chains in Continuous Time Previously we looke at Markov chains, where the transitions betweenstatesoccurreatspecifietime- steps. That it, we mae time (a continuous variable) avance in

More information

Lower Bounds for the Smoothed Number of Pareto optimal Solutions

Lower Bounds for the Smoothed Number of Pareto optimal Solutions Lower Bouns for the Smoothe Number of Pareto optimal Solutions Tobias Brunsch an Heiko Röglin Department of Computer Science, University of Bonn, Germany brunsch@cs.uni-bonn.e, heiko@roeglin.org Abstract.

More information

PDE Notes, Lecture #11

PDE Notes, Lecture #11 PDE Notes, Lecture # from Professor Jalal Shatah s Lectures Febuary 9th, 2009 Sobolev Spaces Recall that for u L loc we can efine the weak erivative Du by Du, φ := udφ φ C0 If v L loc such that Du, φ =

More information

Math Notes on differentials, the Chain Rule, gradients, directional derivative, and normal vectors

Math Notes on differentials, the Chain Rule, gradients, directional derivative, and normal vectors Math 18.02 Notes on ifferentials, the Chain Rule, graients, irectional erivative, an normal vectors Tangent plane an linear approximation We efine the partial erivatives of f( xy, ) as follows: f f( x+

More information

ANALYSIS OF A GENERAL FAMILY OF REGULARIZED NAVIER-STOKES AND MHD MODELS

ANALYSIS OF A GENERAL FAMILY OF REGULARIZED NAVIER-STOKES AND MHD MODELS ANALYSIS OF A GENERAL FAMILY OF REGULARIZED NAVIER-STOKES AND MHD MODELS MICHAEL HOLST, EVELYN LUNASIN, AND GANTUMUR TSOGTGEREL ABSTRACT. We consier a general family of regularize Navier-Stokes an Magnetohyroynamics

More information

State observers and recursive filters in classical feedback control theory

State observers and recursive filters in classical feedback control theory State observers an recursive filters in classical feeback control theory State-feeback control example: secon-orer system Consier the riven secon-orer system q q q u x q x q x x x x Here u coul represent

More information

Table of Common Derivatives By David Abraham

Table of Common Derivatives By David Abraham Prouct an Quotient Rules: Table of Common Derivatives By Davi Abraham [ f ( g( ] = [ f ( ] g( + f ( [ g( ] f ( = g( [ f ( ] g( g( f ( [ g( ] Trigonometric Functions: sin( = cos( cos( = sin( tan( = sec

More information

Improved Rate-Based Pull and Push Strategies in Large Distributed Networks

Improved Rate-Based Pull and Push Strategies in Large Distributed Networks Improve Rate-Base Pull an Push Strategies in Large Distribute Networks Wouter Minnebo an Benny Van Hout Department of Mathematics an Computer Science University of Antwerp - imins Mielheimlaan, B-00 Antwerp,

More information

Levy Process and Infinitely Divisible Law

Levy Process and Infinitely Divisible Law Stat205B: Probability Theory (Spring 2003) Lecture: 26 Levy Process an Infinitely Divisible Law Lecturer: James W. Pitman Scribe: Bo Li boli@stat.berkeley.eu Levy Processes an Infinitely Divisible Law

More information

arxiv: v1 [math.co] 15 Sep 2015

arxiv: v1 [math.co] 15 Sep 2015 Circular coloring of signe graphs Yingli Kang, Eckhar Steffen arxiv:1509.04488v1 [math.co] 15 Sep 015 Abstract Let k, ( k) be two positive integers. We generalize the well stuie notions of (k, )-colorings

More information

1 Math 285 Homework Problem List for S2016

1 Math 285 Homework Problem List for S2016 1 Math 85 Homework Problem List for S016 Note: solutions to Lawler Problems will appear after all of the Lecture Note Solutions. 1.1 Homework 1. Due Friay, April 8, 016 Look at from lecture note exercises:

More information

Influence of weight initialization on multilayer perceptron performance

Influence of weight initialization on multilayer perceptron performance Influence of weight initialization on multilayer perceptron performance M. Karouia (1,2) T. Denœux (1) R. Lengellé (1) (1) Université e Compiègne U.R.A. CNRS 817 Heuiasyc BP 649 - F-66 Compiègne ceex -

More information

A new proof of the sharpness of the phase transition for Bernoulli percolation on Z d

A new proof of the sharpness of the phase transition for Bernoulli percolation on Z d A new proof of the sharpness of the phase transition for Bernoulli percolation on Z Hugo Duminil-Copin an Vincent Tassion October 8, 205 Abstract We provie a new proof of the sharpness of the phase transition

More information

Monotonicity for excited random walk in high dimensions

Monotonicity for excited random walk in high dimensions Monotonicity for excite ranom walk in high imensions Remco van er Hofsta Mark Holmes March, 2009 Abstract We prove that the rift θ, β) for excite ranom walk in imension is monotone in the excitement parameter

More information

A Unified Theorem on SDP Rank Reduction

A Unified Theorem on SDP Rank Reduction A Unifie heorem on SDP Ran Reuction Anthony Man Cho So, Yinyu Ye, Jiawei Zhang November 9, 006 Abstract We consier the problem of fining a low ran approximate solution to a system of linear equations in

More information

Schrödinger s equation.

Schrödinger s equation. Physics 342 Lecture 5 Schröinger s Equation Lecture 5 Physics 342 Quantum Mechanics I Wenesay, February 3r, 2010 Toay we iscuss Schröinger s equation an show that it supports the basic interpretation of

More information

Multi-View Clustering via Canonical Correlation Analysis

Multi-View Clustering via Canonical Correlation Analysis Technical Report TTI-TR-2008-5 Multi-View Clustering via Canonical Correlation Analysis Kamalika Chauhuri UC San Diego Sham M. Kakae Toyota Technological Institute at Chicago ABSTRACT Clustering ata in

More information

Generalized Tractability for Multivariate Problems

Generalized Tractability for Multivariate Problems Generalize Tractability for Multivariate Problems Part II: Linear Tensor Prouct Problems, Linear Information, an Unrestricte Tractability Michael Gnewuch Department of Computer Science, University of Kiel,

More information

u!i = a T u = 0. Then S satisfies

u!i = a T u = 0. Then S satisfies Deterministic Conitions for Subspace Ientifiability from Incomplete Sampling Daniel L Pimentel-Alarcón, Nigel Boston, Robert D Nowak University of Wisconsin-Maison Abstract Consier an r-imensional subspace

More information

QF101: Quantitative Finance September 5, Week 3: Derivatives. Facilitator: Christopher Ting AY 2017/2018. f ( x + ) f(x) f(x) = lim

QF101: Quantitative Finance September 5, Week 3: Derivatives. Facilitator: Christopher Ting AY 2017/2018. f ( x + ) f(x) f(x) = lim QF101: Quantitative Finance September 5, 2017 Week 3: Derivatives Facilitator: Christopher Ting AY 2017/2018 I recoil with ismay an horror at this lamentable plague of functions which o not have erivatives.

More information

Hyperbolic Moment Equations Using Quadrature-Based Projection Methods

Hyperbolic Moment Equations Using Quadrature-Based Projection Methods Hyperbolic Moment Equations Using Quarature-Base Projection Methos J. Koellermeier an M. Torrilhon Department of Mathematics, RWTH Aachen University, Aachen, Germany Abstract. Kinetic equations like the

More information

Tutorial on Maximum Likelyhood Estimation: Parametric Density Estimation

Tutorial on Maximum Likelyhood Estimation: Parametric Density Estimation Tutorial on Maximum Likelyhoo Estimation: Parametric Density Estimation Suhir B Kylasa 03/13/2014 1 Motivation Suppose one wishes to etermine just how biase an unfair coin is. Call the probability of tossing

More information

DIFFERENTIAL GEOMETRY, LECTURE 15, JULY 10

DIFFERENTIAL GEOMETRY, LECTURE 15, JULY 10 DIFFERENTIAL GEOMETRY, LECTURE 15, JULY 10 5. Levi-Civita connection From now on we are intereste in connections on the tangent bunle T X of a Riemanninam manifol (X, g). Out main result will be a construction

More information

TMA 4195 Matematisk modellering Exam Tuesday December 16, :00 13:00 Problems and solution with additional comments

TMA 4195 Matematisk modellering Exam Tuesday December 16, :00 13:00 Problems and solution with additional comments Problem F U L W D g m 3 2 s 2 0 0 0 0 2 kg 0 0 0 0 0 0 Table : Dimension matrix TMA 495 Matematisk moellering Exam Tuesay December 6, 2008 09:00 3:00 Problems an solution with aitional comments The necessary

More information

Differentiation ( , 9.5)

Differentiation ( , 9.5) Chapter 2 Differentiation (8.1 8.3, 9.5) 2.1 Rate of Change (8.2.1 5) Recall that the equation of a straight line can be written as y = mx + c, where m is the slope or graient of the line, an c is the

More information

Extreme Values by Resnick

Extreme Values by Resnick 1 Extreme Values by Resnick 1 Preliminaries 1.1 Uniform Convergence We will evelop the iea of something calle continuous convergence which will be useful to us later on. Denition 1. Let X an Y be metric

More information

Lecture XII. where Φ is called the potential function. Let us introduce spherical coordinates defined through the relations

Lecture XII. where Φ is called the potential function. Let us introduce spherical coordinates defined through the relations Lecture XII Abstract We introuce the Laplace equation in spherical coorinates an apply the metho of separation of variables to solve it. This will generate three linear orinary secon orer ifferential equations:

More information

CLARK-OCONE FORMULA BY THE S-TRANSFORM ON THE POISSON WHITE NOISE SPACE

CLARK-OCONE FORMULA BY THE S-TRANSFORM ON THE POISSON WHITE NOISE SPACE CLARK-OCONE FORMULA BY THE S-TRANSFORM ON THE POISSON WHITE NOISE SPACE YUH-JIA LEE*, NICOLAS PRIVAULT, AND HSIN-HUNG SHIH* Abstract. Given ϕ a square-integrable Poisson white noise functionals we show

More information

Some vector algebra and the generalized chain rule Ross Bannister Data Assimilation Research Centre, University of Reading, UK Last updated 10/06/10

Some vector algebra and the generalized chain rule Ross Bannister Data Assimilation Research Centre, University of Reading, UK Last updated 10/06/10 Some vector algebra an the generalize chain rule Ross Bannister Data Assimilation Research Centre University of Reaing UK Last upate 10/06/10 1. Introuction an notation As we shall see in these notes the

More information

Math 1B, lecture 8: Integration by parts

Math 1B, lecture 8: Integration by parts Math B, lecture 8: Integration by parts Nathan Pflueger 23 September 2 Introuction Integration by parts, similarly to integration by substitution, reverses a well-known technique of ifferentiation an explores

More information

A Review of Multiple Try MCMC algorithms for Signal Processing

A Review of Multiple Try MCMC algorithms for Signal Processing A Review of Multiple Try MCMC algorithms for Signal Processing Luca Martino Image Processing Lab., Universitat e València (Spain) Universia Carlos III e Mari, Leganes (Spain) Abstract Many applications

More information

12.11 Laplace s Equation in Cylindrical and

12.11 Laplace s Equation in Cylindrical and SEC. 2. Laplace s Equation in Cylinrical an Spherical Coorinates. Potential 593 2. Laplace s Equation in Cylinrical an Spherical Coorinates. Potential One of the most important PDEs in physics an engineering

More information

On the Cauchy Problem for Von Neumann-Landau Wave Equation

On the Cauchy Problem for Von Neumann-Landau Wave Equation Journal of Applie Mathematics an Physics 4 4-3 Publishe Online December 4 in SciRes http://wwwscirporg/journal/jamp http://xoiorg/436/jamp4343 On the Cauchy Problem for Von Neumann-anau Wave Equation Chuangye

More information

THE EFFICIENCIES OF THE SPATIAL MEDIAN AND SPATIAL SIGN COVARIANCE MATRIX FOR ELLIPTICALLY SYMMETRIC DISTRIBUTIONS

THE EFFICIENCIES OF THE SPATIAL MEDIAN AND SPATIAL SIGN COVARIANCE MATRIX FOR ELLIPTICALLY SYMMETRIC DISTRIBUTIONS THE EFFICIENCIES OF THE SPATIAL MEDIAN AND SPATIAL SIGN COVARIANCE MATRIX FOR ELLIPTICALLY SYMMETRIC DISTRIBUTIONS BY ANDREW F. MAGYAR A issertation submitte to the Grauate School New Brunswick Rutgers,

More information

Role of parameters in the stochastic dynamics of a stick-slip oscillator

Role of parameters in the stochastic dynamics of a stick-slip oscillator Proceeing Series of the Brazilian Society of Applie an Computational Mathematics, v. 6, n. 1, 218. Trabalho apresentao no XXXVII CNMAC, S.J. os Campos - SP, 217. Proceeing Series of the Brazilian Society

More information

Generalization of the persistent random walk to dimensions greater than 1

Generalization of the persistent random walk to dimensions greater than 1 PHYSICAL REVIEW E VOLUME 58, NUMBER 6 DECEMBER 1998 Generalization of the persistent ranom walk to imensions greater than 1 Marián Boguñá, Josep M. Porrà, an Jaume Masoliver Departament e Física Fonamental,

More information

Implicit Differentiation

Implicit Differentiation Implicit Differentiation Thus far, the functions we have been concerne with have been efine explicitly. A function is efine explicitly if the output is given irectly in terms of the input. For instance,

More information

arxiv: v1 [math-ph] 5 May 2014

arxiv: v1 [math-ph] 5 May 2014 DIFFERENTIAL-ALGEBRAIC SOLUTIONS OF THE HEAT EQUATION VICTOR M. BUCHSTABER, ELENA YU. NETAY arxiv:1405.0926v1 [math-ph] 5 May 2014 Abstract. In this work we introuce the notion of ifferential-algebraic

More information

Stable and compact finite difference schemes

Stable and compact finite difference schemes Center for Turbulence Research Annual Research Briefs 2006 2 Stable an compact finite ifference schemes By K. Mattsson, M. Svär AND M. Shoeybi. Motivation an objectives Compact secon erivatives have long

More information

BEYOND THE CONSTRUCTION OF OPTIMAL SWITCHING SURFACES FOR AUTONOMOUS HYBRID SYSTEMS. Mauro Boccadoro Magnus Egerstedt Paolo Valigi Yorai Wardi

BEYOND THE CONSTRUCTION OF OPTIMAL SWITCHING SURFACES FOR AUTONOMOUS HYBRID SYSTEMS. Mauro Boccadoro Magnus Egerstedt Paolo Valigi Yorai Wardi BEYOND THE CONSTRUCTION OF OPTIMAL SWITCHING SURFACES FOR AUTONOMOUS HYBRID SYSTEMS Mauro Boccaoro Magnus Egerstet Paolo Valigi Yorai Wari {boccaoro,valigi}@iei.unipg.it Dipartimento i Ingegneria Elettronica

More information

Convergence rates of moment-sum-of-squares hierarchies for optimal control problems

Convergence rates of moment-sum-of-squares hierarchies for optimal control problems Convergence rates of moment-sum-of-squares hierarchies for optimal control problems Milan Kora 1, Diier Henrion 2,3,4, Colin N. Jones 1 Draft of September 8, 2016 Abstract We stuy the convergence rate

More information

Computing Derivatives

Computing Derivatives Chapter 2 Computing Derivatives 2.1 Elementary erivative rules Motivating Questions In this section, we strive to unerstan the ieas generate by the following important questions: What are alternate notations

More information

Characterizing Real-Valued Multivariate Complex Polynomials and Their Symmetric Tensor Representations

Characterizing Real-Valued Multivariate Complex Polynomials and Their Symmetric Tensor Representations Characterizing Real-Value Multivariate Complex Polynomials an Their Symmetric Tensor Representations Bo JIANG Zhening LI Shuzhong ZHANG December 31, 2014 Abstract In this paper we stuy multivariate polynomial

More information

Witt#5: Around the integrality criterion 9.93 [version 1.1 (21 April 2013), not completed, not proofread]

Witt#5: Around the integrality criterion 9.93 [version 1.1 (21 April 2013), not completed, not proofread] Witt vectors. Part 1 Michiel Hazewinkel Sienotes by Darij Grinberg Witt#5: Aroun the integrality criterion 9.93 [version 1.1 21 April 2013, not complete, not proofrea In [1, section 9.93, Hazewinkel states

More information

Connections Between Duality in Control Theory and

Connections Between Duality in Control Theory and Connections Between Duality in Control heory an Convex Optimization V. Balakrishnan 1 an L. Vanenberghe 2 Abstract Several important problems in control theory can be reformulate as convex optimization

More information

Lecture 2 Lagrangian formulation of classical mechanics Mechanics

Lecture 2 Lagrangian formulation of classical mechanics Mechanics Lecture Lagrangian formulation of classical mechanics 70.00 Mechanics Principle of stationary action MATH-GA To specify a motion uniquely in classical mechanics, it suffices to give, at some time t 0,

More information

SYMMETRIC KRONECKER PRODUCTS AND SEMICLASSICAL WAVE PACKETS

SYMMETRIC KRONECKER PRODUCTS AND SEMICLASSICAL WAVE PACKETS SYMMETRIC KRONECKER PRODUCTS AND SEMICLASSICAL WAVE PACKETS GEORGE A HAGEDORN AND CAROLINE LASSER Abstract We investigate the iterate Kronecker prouct of a square matrix with itself an prove an invariance

More information

CHAPTER 1 : DIFFERENTIABLE MANIFOLDS. 1.1 The definition of a differentiable manifold

CHAPTER 1 : DIFFERENTIABLE MANIFOLDS. 1.1 The definition of a differentiable manifold CHAPTER 1 : DIFFERENTIABLE MANIFOLDS 1.1 The efinition of a ifferentiable manifol Let M be a topological space. This means that we have a family Ω of open sets efine on M. These satisfy (1), M Ω (2) the

More information

d dx But have you ever seen a derivation of these results? We ll prove the first result below. cos h 1

d dx But have you ever seen a derivation of these results? We ll prove the first result below. cos h 1 Lecture 5 Some ifferentiation rules Trigonometric functions (Relevant section from Stewart, Seventh Eition: Section 3.3) You all know that sin = cos cos = sin. () But have you ever seen a erivation of

More information