Point Process Models for Multivariate High-Frequency Irregularly

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Point Process Models for Multivariate High-Frequency Irregularly"

Transcription

1 oit rocess Models for Multivariate High-Frequecy Irregularly Spaced Data Stephe Crowley Abstract. Defiitios from the theory of poit processes are recalled. Models of itesity fuctio parametrizatio ad maximum likelihood estimatio from data are explored. Closed-form log-likelihood expressios are give for the Hawkes uivariate ad multivariate)process, Autoregressive Coditioal DuratioACD), with both expoetial ad Weibull distributed errors, ad a hybrid model combiig the ACD ad the Hawkes models. Diural, or daily, adjustmet of the determiistic predictable part of the itesity variatio via piecewise polyomial splies is discussed. Data from the symbol SY o three differet electroic markets is used to estimate model parameters ad geerate illustrative plots. The parameters were estimated without diural adjustmets, a repeat of the aalysis with adjustmets is due i a future versio of this article. The coectio of the Hawkes process to quatum theory is briefly metioed. The Hawkess process with a Weibull kerel is also briefly metioed ad will be explored more i the future. Table of cotets 1. Defitios oit rocesses ad Itesities Stochastic Itegrals The Expoetial Autoregressive Coditioal DuratioEACD) Model The Weibull-ACD Model The Hawkes rocess Liear Self-Excitig rocesses The Hawkes1) Model Maximum Likelihood Estimatio The Hawkes rocess i Quatum Theory The Hawkes rocess Havig a Weibull Kerel Combiig the ACD ad Hawkes Models Multivariate Hawkes Models The Compesator Log-Likelihood Numerical Methods The Nelder-Mead Algorithm Startig oits for Optimizig the Hawkes rocess of Order Examples Millisecod Resolutio Trade Sequeces Adjustig for the Determiistic Daily Itesity Variatio Uivarate Hawkes model fit to SY SDR S& 5 ETF Trust) Multivariate SY Data for Multivariate SY Data for Bibliography oit rocesses ad Itesities. 1. Defitios 1

2 2 oit rocess Models for Multivariate High-Frequecy Irregularly Spaced Data Cosider a K dimesioal multivariate poit process. Let N k t deote the coutig process associated with the k-th poit process which is simply the umber of evets which have occured by time t. Let F t deote the filtratio of the pooled process N t of K poit processes cosistig of the set t k <t k 1 <t k 2 < <t k i < deotig the history of arrival times of each evet type associated with the k=1 K poit processes. At time t, the most recet arrival time will be deoted t k k Nt. A process is said to be simple if o poits occur at the same time, thas, there are o zero-legth duratios. The coutig process ca be represeted as a sum of Heaviside step fuctios θt)= { t< 1 t N t k = ti k t θt k ) 1) The coditioal itesity fuctio gives the coditioal probability per uit time that a evet of type k occurs i the exstat. For small values of t we have λ k t F t )= lim t k rn t+ t N k t > F t ) t 2) so that λ k k t F t ) t=en t+ t N k t F t )+o t) 3) k EN t+ t N k t ) λ k t F t ) t)=o t) 4) ad 4) will be ucorrelated with the past of F t as t. Next cosider lim t s 1 s ) t k Ns+j t = lim N s k N s1 t =N k s N k s1 ) k ) s ) k N s +j 1) t λ k s +j t F t ) t s 1 s ) t s 1 λ k t F t )dt λ k j t F t ) t 5) which will be ucorrelated with F s, thas s 1 E λ k t F t )dt) =N k k s N s1 6) s The itegrated itesity fuctio is kow as the compesator, or more precisely, the F t -compesator ad will be deoted by Λ k s 1 s,s 1 )= λ k t F t )dt 7) s Let x k = t k k i 1 deote the time iterval, or duratio, betwee the i-th ad i 1)-th arrival times. The F t -coditioal survivor fuctio for the k-th process is give by Let S k x i k )= k k >x i k F ti 1+τ) 8) Ẽ k i = λ k t F t )dt=λ k 1, ) 1 the provided the survivor fuctio is absolutely cotiuous with respect to Lebesgue measurewhich is a assumptio that eeds to be verified, usually by graphical tests) we have S k x k i )=e t λ k t F t )dt k i 1 =e Ẽ i 9)

3 ,, 3 ad Ẽ Nt) is a i.i.d. expoetial radom variable with uit mea ad variace. Sice E Ẽ Nt) ) =1 the radom variable k E Nt) =1 Ẽ Nt) 1) has zero mea ad uit variace. ositive values of E Nt) idicate that the path of coditioal itesity fuctio λ k t F t ) uder-predicted the umber of evets i the time iterval ad egative values of E Nt) idicate that λ k t F t ) over-predicted the umber of evets i the iterval. I this way, 8) ca be iterpreated as a geeralized residual. The backwards recurrece time give by icreases liearly with jumps back to at each ew poit. U k) t)=t t N k t) 11) Stochastic Itegrals. The stochastic Stieltjes itegral[1, 2.1][8, 2.2] of a measurable process, havig either locally bouded or oegative sample paths, Xt) with respect to N k exists ad for each t we have Xs)dN k s = θt t k i )Xt k i ) 12),t] i The Expoetial Autoregressive Coditioal DuratioEACD) Model. Lettig p i be the family of coditioal probability desity fuctios for arrival time, the log likelihood of the expoetial) ACD model ca be expressed i terms of the coditioal desities or itesities as [11] ll{ } i= ) = logp i t,, 1 ) i= ) t = logλ i 1,t,, 1 ) λu,t,,t Nu )du i=1 = i=1 = i=1 logλ i 1,t,, 1 ) λu,t,,t Nu )du 1 ) logλ i 1,t,, 1 ) Ẽ i t = lλt)dnt t t t λt)dt We will see that λ ca be parameterized i terms of t ) 13) λt N t,t 1,,t Nt )=ω+ i=1 N t π i t Nt+1 i t Nt i) 14) so that the impact of a duratio betwee successive evets depeds upo the umber of iterveig evets. Let x i = 1 be the iterval betwee cosecutive arrival times; the x i is a sequece of duratios or waitig times. The coditioal desity of x i give its pass the give directly by Ex i x i 1,,x 1 )=ψ i x i 1,,x 1 ;θ)=ψ i 15) The the ACD models are those that cosist of the assumptio x i =ψ i ε i 16) where ε i is idepedetly ad idetically distributed with desity pε; φ) where θ ad φ are variatio free. ACD processes are limited to the uivariate settig but later we will see that this model ca be combied with a Hawkes process i a multivariate framework. [6] The coditioal itesity of a ACD model ca be expressed i geeral as λt N t,t 1,,t Nt )=λ t tnt ψ Nt+1 ) 1 ψ Nt+1 17)

4 4 oit rocess Models for Multivariate High-Frequecy Irregularly Spaced Data where λ t) is a determiistic baselie hazard, so that the past history iflueces the coditioal itesity by both a multiplicative effect ad a shif the baselie hazard. This is called a accelerated failure time model sice pasformatio iflueces the rate at which time passes. The simplest model is the expoetial ACD which assumes that the duratios are coditioally expoetial so that the baselie hazard λ t)=1 ad the coditioal itesity is λt x Nt,,x 1 )= 1 ψ Nt +1 18) The compesator for cosecutive evets of the ACD model i the case of costat baselie itesity λ t)=1 is simply Ẽ i =Λ k 1, ) = λt x i,,x 1 )dt t i 1 1 = dt 1 ψ Nt +1 1 = dt ψ i 1 = 1 ψ i = x i ψ i where x i = 1. A geeral model without limited memory is referred to as ACDm,q) where m ad q refer to the order of the lags so that there are m+q+1) parameters. m ψ i =ω+ q α j x i j + 19) ψ i j 2) ω 1 q j=q where ω,α j, ad ψ i = for i=1 maxm,q) so the coditioal itesity is the writte 1 λt x Nt,,x 1 )= ω+ m α j x q 21) Nt+1 j+ ψ Nt+1 j The log-likelihood for the ACDm,q) model is the writte i terms of the duratios x i = 1 ) ll{x i } i=1,, ) = lλ i 1,t,, 1 ) Ẽ i i=1 = ) Sxi ) l ψ i i=1 ) e Ẽi ψ i = l i=1 = i=1 = i=1 l e xi ψ i ψ i 1 l ψ i ) x i ψ i 22) A ACD process is statioary if m α j + q i=1 i=1 <1 23)

5 ,, 5 i which case the ucoditioal mea exists ad is give by ω µ=e[x i ]= 1 m i=1 α j + q i=1 ) 24) The goodess of fit ca be checked by testig that residuals Ẽ i have mea ad variace equal to 1 ad o autocorrelatio The Weibull-ACD Model. The WACDWeibull-ACD) model exteds the EACD model by assumig a Weibull distributio for the residuals ε i i 16) istead of a expoetial. We have the itesity give by ad log-likelihood by 1+ λt x Nt,,x 1 )= Γ 1 γ ψ Nt+1 ) ) ll{x i } i=1,, ) = ) γ 1+ l +γl Γ 1 γ x i ψ i i=1 γ t t Nt ) γ 1 γ 25) x i ) 1+ Γ 1 γ ψ i x i γ 26) The goodess of fit ca be checked by testig that the mea of Ẽ i is equal to 1 ad graphically checkig whas kow as a weibull plot. If is a good fit, the empirical curve will be ear the straight lie. I the example show below, the weibull does better tha the expoetial bus still ot a great fit Weibull robability lot.1 robability Data Figure 1. Weibull plot for WACD1,1) model fit to SY INET o The Hawkes rocess.

6 6 oit rocess Models for Multivariate High-Frequecy Irregularly Spaced Data Liear Self-Excitig rocesses. A uivariate) liear self-excitig coutig) process N s oe that ca be expressed as [15][7][14][3] t λt) =λ t)κ+ νt s)dn s =λ t)κ+ 27) νt ) <t where λ t) is a determiistic base itesity, see 77), ν: R + R + expresses the positive ifluece of past evets o the curret value of the itesity process, ad κ takes the place of the λ costa the refereced papers. The expoetial) Hawkes process of order is a liear selfexcitig process defied by the expoetial kerel so that the itesity is writte as νt)= α j e βjt 28) λt) =λ t)κ+ t N t 1 α j e βjt s) dn s =λ t)κ+ α j e βjt ti) i= =λ t)κ+ N t 1 α j e βjt ti) =λ t)κ+ =λ t)κ+ i= N t 1 α j e βjt tk) i= α j B j N t ) 29) where B j i) is give recursively by i 1 A uivariate Hawkes process is statioary if B j i) = 3) k= =1+B j i 1))e βjt ti) e βjt tk) αj If a Hawkes process is statioary the the ucoditioal mea is <1 31) λ µ=e[λt)] = 1 νt)dt = λ 1 λ = 1 α j α j e βjt dt 32)

7 ,, 7 For cosecutive evets, we have the compesator 7) Λ 1, ) = λt)dt 1 = λ t)+ α j B j N t ) dt 1 = λ s)ds+ i 1 αj e 1 t k) e βjti tk)) 1 k= = λ s)ds+ αj ) 1 e 1) A j i 1) 1 where there is the recursio A j i) = e βjti tk) t k i 1 e βjti tk) = k= 33) 34) =1+e βjti ti 1) A j i 1) with A j )=. If λ t)=λ the 33) simplifies to Λ 1, ) = 1 )λ + k= = 1 )λ + i 1 αj αj e 1 t k) e βjti tk)) 1 e 1) ) A j i 1) 35) Similiarly, aother parameterizatio is give by Λ 1, ) = κλ s)ds+ αj ) 1 e 1) A j i 1) 1 =κ λ s)ds+ αj ) 1 e 1) A j i 1) 1 36) =κλ 1, )+ αj 1 e 1) ) A j i 1) where κ scales the predetermied baselie itesity λ s). I this parameterizatio the itesity is also scaled by κ λt) =κλ t)+ α j B j N t ) 37) this allows to precompute the determiistic part of the compesator Λ 1, )= 1 λ s)ds The Hawkes1) Model. The simplest case occurs whe the baselie itesity λ t) is costat ad =1 where we have λt)=λ + αe βt ti) 38) <t

8 8 oit rocess Models for Multivariate High-Frequecy Irregularly Spaced Data which has the ucoditioal mea E[λt)]= λ 1 α β 39) Maximum Likelihood Estimatio. The log-likelihood of a simple poit process is writte as T llnt) t [,T] ) = =T 1 λs))ds+ T λs)ds + T T lλs)dn s lλs)dn s 4) which i the case of the Hawkes model of order ca be explicitly writte [13] as ll{ } i=1 ) =T Λ,T)+ i=1 =T + i=1 lλ ) lλ ) Λ 1, ) =T Λ,T)+ lλ ) i=1 =T Λ,T)+ l κλ )+ i=1 =T Λ,T)+ i=1 i 1 k=1 l κλ )+ α j R j i) α j e βjti tk) 41) =T + i=1 T κλ s)ds αj i=1 l κλ )+ α j R j i) ) 1 e t ) where T =t ad we have the recursio[12] i 1 e βjti tk) R j i) = k=1 =e βjti ti 1) 1+R j i 1)) 42) If we have costat baselie itesity λ t)=1 the the log-likelihood ca be writte ll{ } i=1 ) =T κt i=1 + i=1 αj l λ + α j R j i) ) 1 e t ) 43) Note that was ecessary to shift each by t 1 so that t 1 = ad t =T. Also ote that T is just a additive costat which does ot vary with the parameters so for the purposes of estimatio ca be removed from the equatio The Hawkes rocess i Quatum Theory.

9 ,, 9 The Hawkes process arises i quatum theory by cosiderig feedback via cotiuous measuremets where the quatum aalog of a self-excitig poit process is a source of irreversibility whose stregth is cotrolled by the rate of detectios from that source. [16] The Hawkes rocess Havig a Weibull Kerel. The expoetial kerel of the Hawkes process ca be replaced with that of a Weibull kerel. [1, 6.3] Recall that the itesity is defied by 27) t λt) =λ t)κ+ νt s)dn s =λ t)κ+ νt ) <t 44) where the expoetial kerel νt)= so the Weibull-Hawkes itesity is writte is λt) =λ t)κ+ α j e βjs replaced by the Weibull kerel νt)= ) ) ) κj κj t κj 1 t ω α j e j 45) ω j ω j =λ t)κ+ i= t N t 1 α j κj ω j α j κj ω j ) t s ω j ) t ti ω j ) ) κj κj 1 e βj t s ω j dn s ) κj 1 e t ω j ) κj 46) 1.5. Combiig the ACD ad Hawkes Models. The ACD ad Hawkes models ca be combied to provide a model for itraday volatility. [2] Let λt) =λ t)+ 1 t + νt s)dn s 47) ψ Nt where λ t) is the determistic baselie itesity77) ad where the ACD2) pars m ψ i =ω+ q α j x i j + ψ i j 48) ad the Hawkes part has the expoetial kerel28) νt)= γ j e ϕjt 49) so that t νt s)dn s = t γ j e ϕjt s) dn s N t νt t k ) = k= N t = k= = N t γ j k= = γ j B j N t ) γ j e ϕjt tk) e ϕjt tk) 5)

10 1 oit rocess Models for Multivariate High-Frequecy Irregularly Spaced Data where we have replaced α=γ ad β=ϕ i the Hawkes part so that the parameter ames do ot coflict with the ACD part where α ad β are also used as parameter ames. The Hawkes part of the itesity has a recursive structure similiar to that of the compesator. Let where B j )=. The we have i 1 B j i) = 51) k= =1+B j i 1))e ϕjt ti) e ϕjt tk) 1 λt) =λ t)+ ω+ m α j x q + γ j B j N t ) 52) Nt j+ ψ Nt j The log-likelihood for this hybrid model ca be writte as ll{ } i=1,.., ) = i=1 lλ ) 1 ) λt)dt = lλ ) Λ 1, )) i=1 53) = i=1 lλti ) Ẽ i ) By direct calculatio, combiig 19) ad 33), ad lettig x i = 1 we have the compesator Ẽ i =Λ 1, ) = λt)dt t i 1 = λ t)+ 1 1 ψ Nt +1 = x i + λ t)+ ψ i 1 ti = λ t)dt+ x i + ψ ti 1 i k= = 1 + t t νt s)dn s )dt νt s)dn s )dt i 1 γj e ϕjti 1 tk) e ϕjti tk)) ϕ j λ t)dt+ x i + γj 1 e ϕjxi )A j i 1) ψ i ϕ j 54) where ψ i is defied by 48) ad is give by 34) so that 53) ca be wriitte as A j i)=1+e ϕjxi A j i 1) 55) ll{ } i=,.., ) = lλ ) Ẽ i ) i=1 = lλti ) x i + γj 1 e ϕjxi )A j i 1) ψ i ϕ j i=1 = l 1 i 1 + γ ψ j e ϕjti tk) x i + γj 1 e ϕjxi )A i ψ i ϕ j i 1) j i=1 k= = l 1 + γ ψ j B j i) x i + γj 1 e ϕjxi )A i ψ i ϕ j i 1) j i= Multivariate Hawkes Models. Let M N ad { m )} m=1,,m be a M-dimesioal poit process. The associated coutig process will be deoted N t =N t 1,,N t M ). A multivariate Hawkes process[7][5][9] is defied with 56)

11 ,, 11 itesities λ m t),m=1 M give by M λ m t) =λ m t)κ m + =1 =λ m t)κ m + =1 =λ m t)κ m + =1 =λ m t)κ m + =1 =λ m t)κ m + =1 =λ m t)κ m + =1 t M t k <t M M M M α m, j e β m, j t s) dn s α j m, α m, j e β m, j t t k ) t k <t α j m, t k <t N t 1 α j m, k= α j m, B j m, N t ) e β m, j t t k ) e β m, j t t k ) e β m, j t t k ) where i this parameterizatio κ is a vector which scales the baselie itesities, i this case, specified by piecewise polyomial splies 77). We ca write B j m, i) recursively 57) B j m, i) = i 1 k= e β m, j t t k ) =1+B j m, i 1))e m, t ) I the simplest versio with =1 ad λ m t)=1 costat we have λ m t) =κ m + =1 =κ m + =1 M t M M =κ m + =1 N t 1 α m, e βm, t s) dn s α m, e βm, t t k ) k= N t 1 e βm, t t k ) α m, k= 58) 59) M =κ m + =1 Rewritig 59) i vectorial otio, we have λt)=κ+ where α m, B 1 m, N t ) t Gt s)dn s 6) Gt)=α m, e βm, t s) ) m,=1 M 61) Assumig statioarity gives E[λt)] = µ a costat vector ad thus κ µ = I Gu)du κ = I αm, ) β m, = κ I Γ A sufficiet coditio for a multivariate Hawkes process to be statioary is that the spectral radius of the brachig matrix Γ= Gs)ds= αm, β m, 63) 62)

12 12 oit rocess Models for Multivariate High-Frequecy Irregularly Spaced Data be strictly less tha 1. The spectral radius of the matrix G is defied as where SG) deotes the set of eigevalues of G. ρg)= max a 64) a SG) The Compesator. The compesator of the m-th coordiate of a multivariate Hawkes process betwee two cosecutive evets t m i 1 ad t m i of type m is give by Λ m t m i 1,t m i ) = m m 1 M + =1 M + =1 λ m s)ds t m k < 1 t m i 1 t m k < m, α j β m,[e β m, j t m i 1 t ) k e β m, j t m i t ) k ] j m, α j β m,[1 e β m, j t m i t ) k ] j To save a cosiderable amout of computatioal complexity, ote that we have the recursio A m, j i) = e β m, j t m i t k ) t m k < =e β m, j t m i 1 m ) A j m, i 1)+ t m i 1 t m k < 65) e β 66) m, j t m i t k ) ad rewrite 65) as Λ m t m i 1,t m i ) =κ m ti m λ s)ds+ m m m 1 1 =κ m ti m λ m s)ds m 1 M m, α j m, β j m + =1 =κ m + =1 tm i 1 M [ λ m s)ds ti m M =1 t k <s α j m, e m, s tk ) ds 1 e β m, j ti m ti 1 m ) ) A m, j i 1)+ m, αj m, β 1 e β m, j m ti ti 1 m ) ) j t k <tm i 1 e β m, j m ti 1 t k ) + t m i 1 t m k < t m i 1 t k <tm i ] 1 e βjm, ti m ) tk ) 1 e m, m ti t ) k ) 67) where we have the iitial coditios A j m, )= Log-Likelihood. The log-likelihood of the multivariate Hawkes process ca be computed as the sum of the loglikelihoods for each coordiate. Let where each term is defied by ll m { })= M ll{ } i=1,,nt )= m=1 which i this case ca be writte as ll m { }) =T Λ m,t)+ N T z m i l m λ )κ m + i=1 =1 N T m =T Λ m,t)+ i=1 T ll m { }) 68) 1 λ m T s))ds+ lλ m m s)dn s 69) l m λ t m i )κ m + =1 M α m, j e βjm, t k ) t k < M t m k < α j m, e m, m t k ) 7)

13 ,, 13 where agai t NT =T ad ad { z m 1 evetti of typem i = otherwise 71) Λ m T,T)= λ m t)dt= m N T Λ m t m i 1,t m i ) 72) i=1 where Λ m t m i 1,t m i ) is give by 67). Similiar to to the oe-dimesioal case, we have the recursio R m, j i) = t k <t j m = e β m, j t m i t k ) e β m, j t m i t m i 1 ) R m, j i 1)+ t m i 1 t m k <t e β m, j t m i t k ) i e β m, j t m i t m i 1 ) 1+R m, j i 1)) ifm ifm= 73) so that 7) ca be rewritte as ll m { }) =T κ m T λ m t)dt i=1 m N T M N T m + i=1 =1 m, αj m, β 1 e β m, j ti m ti 1 m ) ) A m, i 1)+ j j l m λ t m i )κ m + =1 M t m i 1 t m k < α m, j R m, j i) 1 e βjm, ti m t ) k ) + 74) with iitial coditios R j m, ) = ad A j m, ) = where T = t N where N is the umber of observatios, M is the umber of dimesios, ad is the order of the model. Agai, T ca be dropped from the equatio for the purposes of optimizatio. 2. Numerical Methods 2.1. The Nelder-Mead Algorithm. The Nelder-Mead simplex algorithm[4] was used to optimize the likelihood expressios give above Startig oits for Optimizig the Hawkes rocess of Order. A startig poit for the optimizatio of a Hawkes process of order with a exact ucoditioal itesity was chose as the most reasoable startig poit, bus by o meas claimed to be the best. Letx i = 1 be the iterval betwee cosecutive arrival times as i the ACD model 16). The set the iitial value of λ to.5 E[x i], α 1 = 1 ad β 1 =2. This gives a ucoditioal mea of E[x i ] for these parameters used as a startig poit for the Nelder-Mead algorithm. 3. Examples 3.1. Millisecod Resolutio Trade Sequeces. The source data has resolutio of millisecods but the data is trasformed prior to estimatio by dividig each time by 1 so that the uit of time is secods. Also, trades occurig at the same price withi 2ms of each other are dropped from the aalysis. Further work will be doe to fid the optimal level of time aggregatio, ideally the data would be timestamped with aosecod resolutio ad this will be doe i the future Adjustig for the Determiistic Daily Itesity Variatio. Is a well kow fact that arrival ratesad the closely related volatility) have daily seasoal or diural patters where tradig activity peaks after ope ad before close ad has a low aroud the middle of the day kow as the luchtime effect. I order to accout for this we will fit a cubic splie with 14 kot poits spaced every 3 miutes, icludig the opeig ad closig times of t= ad t= =234 respectively sice t has uits of secods. Let the adjusted duratios be defied x i=φ )x i 75)

14 14 oit rocess Models for Multivariate High-Frequecy Irregularly Spaced Data where x i = 1 is the uadjusted duratio ad φ ) is a piecewise polyomial) cubic splie with kot poits at tzj) with values give by j 1 j = N tzj)+w N tzj) w ) N tzj)+w i=n tzj) w 1 xi forj= 13 76) where z= 6 3=18 is the umber of secods i a half-hour ad j= 6.5 2). The first ad last kots have a widow of 3-miutes whereas the iterior kot poits have a widow of 1 hour lookig forward ad backward i time 3-miutes, the first kot poit oly looks forward ad the last kot poit oly looks backward. This gives us the determiistic baselie itesity which is a piecewise polyomial cubic splie fuctio whose exact form is ot metioed here sice is ot the focus of the paper. λ t)=ft,,, j ) 77) The followig figure shows the determiistic part of the itesity estimated for SY o for INET, BATS, ad ARCA. 2 φt) 1.8 INET BATS ARCA Figure 2. Iterpolatig splie φt) for SY o Uivarate Hawkes model fit to SY SDR S& 5 ETF Trust). Cosider these parameter estimates for the uivariate) Hawkes model of various orders fitted to data geerated by trades of the symbol SY traded o the NASDAQ o Nov 3th, 212. The ucoditioal sample mea itesity for this symbol o this day o this exchage was trades per secod where the umber of samples is = The data preseted here has ot bee deseasoalized, the aalysis with determiistic diural variatio accouted for will be preseted i the ext sectio. As ca be see, = 6 provides the best likelihood but a more rigorous method to choose would be to use some iformatio criterio like Bayes or Akaike to decide the order. Error bars are ot provided, but presumably they could be estimated with derivative iformatio. Note that the closer E[λt)] to ad E[Λ] ad Var[Λ] to 1. the better, sice Λ should be expoetially distributed with mea

15 ,, 15 1 by desig ad for a oisso process the mea ad variace are equal. The ext thig to check is that the Λ series is ot autocorrelated. κ α 1 β 1 ll{ }) E[λt)] E[Λ] Var[Λ] Table 1. arameters ad statistics for model fitted to data without diural adjustmets κ α 1 β 1 ll{ }) E[λt)] E[Λ] Var[Λ] Table 2. arameters ad statistics for model fitted to data with diural adjustmets

16 16 oit rocess Models for Multivariate High-Frequecy Irregularly Spaced Data Autocorrelatio of Λ for =1 Autocorrelatio of Λ for =2.8.8 Sample Autocorrelatio Sample Autocorrelatio Autocorrelatio of Λ for =3 Autocorrelatio of Λ for =4.8.8 Sample Autocorrelatio Sample Autocorrelatio Autocorrelatio of Λ for =5 Autocorrelatio of Λ for =6.8.8 Sample Autocorrelatio Sample Autocorrelatio Figure 3. Autocorrelatios of Λ 1, ) for =1 6 without diural adjustmets

17 ,, 17 Autocorrelatio of Λ for =1 Autocorrelatio of Λ for =2.8.8 Sample Autocorrelatio Sample Autocorrelatio Autocorrelatio of Λ for =3 Autocorrelatio of Λ for =4.8.8 Sample Autocorrelatio Sample Autocorrelatio Autocorrelatio of Λ for =5 Autocorrelatio of Λ for =6.8.8 Sample Autocorrelatio Sample Autocorrelatio Figure 4. Autocorrelatios of Λ 1, ) for =1 6 with diural adjustmets As ca be see by visually ispectig the autocorrelatios, all of the residual series are prettymuch acceptable *without* diural adjustmets except for = 1 with still had sigificat leftover autocorrelatio. Stragely, it seems thaclusio of the diural adjustmet sigificatly worses the model fi early all cases. I am tempted to suspect somethig wrog with the code.

18 18 oit rocess Models for Multivariate High-Frequecy Irregularly Spaced Data x 1 4 Figure 5. rice history for SY traded o INET o Oct 22d, Figure 6. x i = 1 i blue ad {Λ 1, ): =1} i gree

19 ,, Figure 7. x i = 1 i blue ad {Λ 1, ): =6} i gree

20 2 oit rocess Models for Multivariate High-Frequecy Irregularly Spaced Data x 1 4 Figure 8. Zoomed i view of x i = 1 i blue ad {Λ 1, ): =6} i gree Multivariate SY Data for Cosider a 5-dimesioal multivariate Hawkes model of order =1 fit to data for SY from 3 exchages, INET, BATS, ad ARCA o Both INET ad BATS distiguish buys from sells whereas ARCA does ot, hece 5 dimesioal, 2 dimesios each for INET ad BATS ad 1 dimesio for ARCA which will aturally have twice as high a rate as that for buys ad sells cosidered seperately. The 5 dimesios are orgaized as follows: BATS Buys BATS Sells INET Buys INET Sells ARCA Trades 78)

21 ,, SY Trades o BATS Buys Λ BATS Sells Λ INET Buys Λ INET Sells Λ ARCA Trades Λ x 1 4 Figure 9. We say trades for ARCA because the type set from the data broker is Ukow, idiciatig thas ukow whether is a buyer or seller iitiated trade. We have the followig parameter estimates where large values of α >.1) are highlighted i bold. α= λ= β= ) 8) 81) with a log-likelihood score of Multivariate SY Data for

22 22 oit rocess Models for Multivariate High-Frequecy Irregularly Spaced Data Cosider the same symbol, SY, as a 5-dimesioal Hawkes process as i 3.1.3, for a differet day, o , estimated with order = 2 for a total of 15 parameters. α j coefficiets that are >.1 are highlighted i bold. The parameters listed below resulted i a log-likelihood value of A iterestig patter emerges i the β coefficiets where it takes o some approximate stair-step patter ragig from 2 to 22. This might be idicitative of some fixedfrequecy algorithms operatig across the differet exchages at approximate 1-secod itervals. λ= α 1= α 2= β 1 = β 2 = Bibliography 82) 83) 84) [1] C.G. Bowsher. Modellig security market evets i cotiuous time: itesity based, multivariate poit process models. Joural of Ecoometrics, 1412): , 27. [2] Y. Cai, B. Kim, M. Leduc, K. Szczegot, Y. Yixiao ad M. Zamfir. A model for itraday volatility.,, 27. [3] V. Chavez-Demouli ad JA McGill. High-frequecy fiacial data modelig usig hawkes processes. Joural of Bakig & Fiace,, 212. [4] JE Deis ad D.J. Woods. Optimizatio o microcomputers: the elder-mead simplex algorithm. New Computig Eviromets: Microcomputers i Large-Scale Computig, : , [5]. Embrechts, T. Liiger ad L. Li. Multivariate hawkes processes: a applicatio to fiacial data. Joural of Applied robability, 48: , 211. [6] R.F. Egle ad J.R. Russell. Autoregressive coditioal duratio: a ew model for irregularly spaced trasactio data. Ecoometrica, : , [7] A.G. Hawkes. Spectra of some self-excitig ad mutually excitig poit processes. Biometrika, 581):83 9, [8] A. Karr. oit processes ad their statistical iferece, volume 7. CRC, [9] T.J. Liiger. Multivariate Hawkes rocesses. hd thesis, Swiss Federal Istitute Of Techology Zurich, 29. [1] F. Loreze. Aalysis of Order Clusterig Usig High Frequecy Data: A oit rocess Approach. hd thesis, Tilburg School of Ecoomics ad Maagemet, Fiace Departmet, August 212. [11] Y. Ogata. The asymptotic behaviour of maximum likelihood estimators for statioary poit processes. Aals of the Istitute of Statistical Mathematics, 31): , [12] Y. Ogata. O lewis simulatio method for poit processes. Iformatio Theory, IEEE Trasactios o, 271):23 31, [13] T. Ozaki. Maximum likelihood estimatio of hawkes self-excitig poit processes. Aals of the Istitute of Statistical Mathematics, 311): , [14] H. Shek. Modelig high frequecy market order dyamics usig self-excited poit process. Available at SSRN ,, ) 86)

23 ,, 23 [15] Ioae Mui Toke. A itroductio to hawkes processes with applicatios to fiace., [16] HM Wisema. Quatum theory of cotiuous feedback. hysical Review A, 493):2133, 1994.

Generalized Semi- Markov Processes (GSMP)

Generalized Semi- Markov Processes (GSMP) Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual

More information

A statistical method to determine sample size to estimate characteristic value of soil parameters

A statistical method to determine sample size to estimate characteristic value of soil parameters A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig

More information

The Poisson Process *

The Poisson Process * OpeStax-CNX module: m11255 1 The Poisso Process * Do Johso This work is produced by OpeStax-CNX ad licesed uder the Creative Commos Attributio Licese 1.0 Some sigals have o waveform. Cosider the measuremet

More information

Exponential Families and Bayesian Inference

Exponential Families and Bayesian Inference Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where

More information

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values Iteratioal Joural of Applied Operatioal Research Vol. 4 No. 1 pp. 61-68 Witer 2014 Joural homepage: www.ijorlu.ir Cofidece iterval for the two-parameter expoetiated Gumbel distributio based o record values

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.

More information

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio

More information

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic

More information

1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable

More information

STAT331. Example of Martingale CLT with Cox s Model

STAT331. Example of Martingale CLT with Cox s Model STAT33 Example of Martigale CLT with Cox s Model I this uit we illustrate the Martigale Cetral Limit Theorem by applyig it to the partial likelihood score fuctio from Cox s model. For simplicity of presetatio

More information

Recurrence Relations

Recurrence Relations Recurrece Relatios Aalysis of recursive algorithms, such as: it factorial (it ) { if (==0) retur ; else retur ( * factorial(-)); } Let t be the umber of multiplicatios eeded to calculate factorial(). The

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

MA Advanced Econometrics: Properties of Least Squares Estimators

MA Advanced Econometrics: Properties of Least Squares Estimators MA Advaced Ecoometrics: Properties of Least Squares Estimators Karl Whela School of Ecoomics, UCD February 5, 20 Karl Whela UCD Least Squares Estimators February 5, 20 / 5 Part I Least Squares: Some Fiite-Sample

More information

Kolmogorov-Smirnov type Tests for Local Gaussianity in High-Frequency Data

Kolmogorov-Smirnov type Tests for Local Gaussianity in High-Frequency Data Proceedigs 59th ISI World Statistics Cogress, 5-30 August 013, Hog Kog (Sessio STS046) p.09 Kolmogorov-Smirov type Tests for Local Gaussiaity i High-Frequecy Data George Tauche, Duke Uiversity Viktor Todorov,

More information

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f. Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

Probability, Expectation Value and Uncertainty

Probability, Expectation Value and Uncertainty Chapter 1 Probability, Expectatio Value ad Ucertaity We have see that the physically observable properties of a quatum system are represeted by Hermitea operators (also referred to as observables ) such

More information

1 Inferential Methods for Correlation and Regression Analysis

1 Inferential Methods for Correlation and Regression Analysis 1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet

More information

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber

More information

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course Sigal-EE Postal Correspodece Course 1 SAMPLE STUDY MATERIAL Electrical Egieerig EE / EEE Postal Correspodece Course GATE, IES & PSUs Sigal System Sigal-EE Postal Correspodece Course CONTENTS 1. SIGNAL

More information

Kernel density estimator

Kernel density estimator Jauary, 07 NONPARAMETRIC ERNEL DENSITY ESTIMATION I this lecture, we discuss kerel estimatio of probability desity fuctios PDF Noparametric desity estimatio is oe of the cetral problems i statistics I

More information

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense, 3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

Problems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman:

Problems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman: Math 224 Fall 2017 Homework 4 Drew Armstrog Problems from 9th editio of Probability ad Statistical Iferece by Hogg, Tais ad Zimmerma: Sectio 2.3, Exercises 16(a,d),18. Sectio 2.4, Exercises 13, 14. Sectio

More information

Lecture 7: October 18, 2017

Lecture 7: October 18, 2017 Iformatio ad Codig Theory Autum 207 Lecturer: Madhur Tulsiai Lecture 7: October 8, 207 Biary hypothesis testig I this lecture, we apply the tools developed i the past few lectures to uderstad the problem

More information

THE KALMAN FILTER RAUL ROJAS

THE KALMAN FILTER RAUL ROJAS THE KALMAN FILTER RAUL ROJAS Abstract. This paper provides a getle itroductio to the Kalma filter, a umerical method that ca be used for sesor fusio or for calculatio of trajectories. First, we cosider

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Statistical Pattern Recognition

Statistical Pattern Recognition Statistical Patter Recogitio Classificatio: No-Parametric Modelig Hamid R. Rabiee Jafar Muhammadi Sprig 2014 http://ce.sharif.edu/courses/92-93/2/ce725-2/ Ageda Parametric Modelig No-Parametric Modelig

More information

Discrete Mathematics for CS Spring 2008 David Wagner Note 22

Discrete Mathematics for CS Spring 2008 David Wagner Note 22 CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig

More information

A New Solution Method for the Finite-Horizon Discrete-Time EOQ Problem

A New Solution Method for the Finite-Horizon Discrete-Time EOQ Problem This is the Pre-Published Versio. A New Solutio Method for the Fiite-Horizo Discrete-Time EOQ Problem Chug-Lu Li Departmet of Logistics The Hog Kog Polytechic Uiversity Hug Hom, Kowloo, Hog Kog Phoe: +852-2766-7410

More information

Mathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution

Mathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution America Joural of Theoretical ad Applied Statistics 05; 4(: 6-69 Published olie May 8, 05 (http://www.sciecepublishiggroup.com/j/ajtas doi: 0.648/j.ajtas.05040. ISSN: 6-8999 (Prit; ISSN: 6-9006 (Olie Mathematical

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

6. Sufficient, Complete, and Ancillary Statistics

6. Sufficient, Complete, and Ancillary Statistics Sufficiet, Complete ad Acillary Statistics http://www.math.uah.edu/stat/poit/sufficiet.xhtml 1 of 7 7/16/2009 6:13 AM Virtual Laboratories > 7. Poit Estimatio > 1 2 3 4 5 6 6. Sufficiet, Complete, ad Acillary

More information

The target reliability and design working life

The target reliability and design working life Safety ad Security Egieerig IV 161 The target reliability ad desig workig life M. Holický Kloker Istitute, CTU i Prague, Czech Republic Abstract Desig workig life ad target reliability levels recommeded

More information

Last time: Moments of the Poisson distribution from its generating function. Example: Using telescope to measure intensity of an object

Last time: Moments of the Poisson distribution from its generating function. Example: Using telescope to measure intensity of an object 6.3 Stochastic Estimatio ad Cotrol, Fall 004 Lecture 7 Last time: Momets of the Poisso distributio from its geeratig fuctio. Gs () e dg µ e ds dg µ ( s) µ ( s) µ ( s) µ e ds dg X µ ds X s dg dg + ds ds

More information

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam. Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the

More information

MAS275 Probability Modelling

MAS275 Probability Modelling MAS275 Probability Modellig 6 Poisso processes 6.1 Itroductio Poisso processes are a particularly importat topic i probability theory. The oe-dimesioal Poisso process, which most of this sectio will be

More information

Limit Theorems. Convergence in Probability. Let X be the number of heads observed in n tosses. Then, E[X] = np and Var[X] = np(1-p).

Limit Theorems. Convergence in Probability. Let X be the number of heads observed in n tosses. Then, E[X] = np and Var[X] = np(1-p). Limit Theorems Covergece i Probability Let X be the umber of heads observed i tosses. The, E[X] = p ad Var[X] = p(-p). L O This P x p NM QP P x p should be close to uity for large if our ituitio is correct.

More information

Study the bias (due to the nite dimensional approximation) and variance of the estimators

Study the bias (due to the nite dimensional approximation) and variance of the estimators 2 Series Methods 2. Geeral Approach A model has parameters (; ) where is ite-dimesioal ad is oparametric. (Sometimes, there is o :) We will focus o regressio. The fuctio is approximated by a series a ite

More information

Math 155 (Lecture 3)

Math 155 (Lecture 3) Math 55 (Lecture 3) September 8, I this lecture, we ll cosider the aswer to oe of the most basic coutig problems i combiatorics Questio How may ways are there to choose a -elemet subset of the set {,,,

More information

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015 ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],

More information

On an Application of Bayesian Estimation

On an Application of Bayesian Estimation O a Applicatio of ayesia Estimatio KIYOHARU TANAKA School of Sciece ad Egieerig, Kiki Uiversity, Kowakae, Higashi-Osaka, JAPAN Email: ktaaka@ifokidaiacjp EVGENIY GRECHNIKOV Departmet of Mathematics, auma

More information

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated

More information

Approximations and more PMFs and PDFs

Approximations and more PMFs and PDFs Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.

More information

Discrete-Time Systems, LTI Systems, and Discrete-Time Convolution

Discrete-Time Systems, LTI Systems, and Discrete-Time Convolution EEL5: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we begi our mathematical treatmet of discrete-time s. As show i Figure, a discrete-time operates or trasforms some iput sequece x [

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

On Random Line Segments in the Unit Square

On Random Line Segments in the Unit Square O Radom Lie Segmets i the Uit Square Thomas A. Courtade Departmet of Electrical Egieerig Uiversity of Califoria Los Ageles, Califoria 90095 Email: tacourta@ee.ucla.edu I. INTRODUCTION Let Q = [0, 1] [0,

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

Slide Set 13 Linear Model with Endogenous Regressors and the GMM estimator

Slide Set 13 Linear Model with Endogenous Regressors and the GMM estimator Slide Set 13 Liear Model with Edogeous Regressors ad the GMM estimator Pietro Coretto pcoretto@uisa.it Ecoometrics Master i Ecoomics ad Fiace (MEF) Uiversità degli Studi di Napoli Federico II Versio: Friday

More information

A Note on Box-Cox Quantile Regression Estimation of the Parameters of the Generalized Pareto Distribution

A Note on Box-Cox Quantile Regression Estimation of the Parameters of the Generalized Pareto Distribution A Note o Box-Cox Quatile Regressio Estimatio of the Parameters of the Geeralized Pareto Distributio JM va Zyl Abstract: Makig use of the quatile equatio, Box-Cox regressio ad Laplace distributed disturbaces,

More information

ADVANCED SOFTWARE ENGINEERING

ADVANCED SOFTWARE ENGINEERING ADVANCED SOFTWARE ENGINEERING COMP 3705 Exercise Usage-based Testig ad Reliability Versio 1.0-040406 Departmet of Computer Ssciece Sada Narayaappa, Aeliese Adrews Versio 1.1-050405 Departmet of Commuicatio

More information

Linear Regression Demystified

Linear Regression Demystified Liear Regressio Demystified Liear regressio is a importat subject i statistics. I elemetary statistics courses, formulae related to liear regressio are ofte stated without derivatio. This ote iteds to

More information

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4 MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.

More information

SINGLE-CHANNEL QUEUING PROBLEMS APPROACH

SINGLE-CHANNEL QUEUING PROBLEMS APPROACH SINGLE-CHANNEL QUEUING ROBLEMS AROACH Abdurrzzag TAMTAM, Doctoral Degree rogramme () Dept. of Telecommuicatios, FEEC, BUT E-mail: xtamta@stud.feec.vutbr.cz Supervised by: Dr. Karol Molár ABSTRACT The paper

More information

Estimation for Complete Data

Estimation for Complete Data Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of

More information

Mathematical Statistics - MS

Mathematical Statistics - MS Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios

More information

First Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise

First Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >

More information

1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series.

1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series. .3 Covergece Theorems of Fourier Series I this sectio, we preset the covergece of Fourier series. A ifiite sum is, by defiitio, a limit of partial sums, that is, a cos( kx) b si( kx) lim a cos( kx) b si(

More information

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A.

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A. Radom Walks o Discrete ad Cotiuous Circles by Jeffrey S. Rosethal School of Mathematics, Uiversity of Miesota, Mieapolis, MN, U.S.A. 55455 (Appeared i Joural of Applied Probability 30 (1993), 780 789.)

More information

Chandrasekhar Type Algorithms. for the Riccati Equation of Lainiotis Filter

Chandrasekhar Type Algorithms. for the Riccati Equation of Lainiotis Filter Cotemporary Egieerig Scieces, Vol. 3, 00, o. 4, 9-00 Chadrasekhar ype Algorithms for the Riccati Equatio of Laiiotis Filter Nicholas Assimakis Departmet of Electroics echological Educatioal Istitute of

More information

ECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations

ECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations ECE-S352 Itroductio to Digital Sigal Processig Lecture 3A Direct Solutio of Differece Equatios Discrete Time Systems Described by Differece Equatios Uit impulse (sample) respose h() of a DT system allows

More information

The Method of Least Squares. To understand least squares fitting of data.

The Method of Least Squares. To understand least squares fitting of data. The Method of Least Squares KEY WORDS Curve fittig, least square GOAL To uderstad least squares fittig of data To uderstad the least squares solutio of icosistet systems of liear equatios 1 Motivatio Curve

More information

Goodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)

Goodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen) Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................

More information

Comparison of Minimum Initial Capital with Investment and Non-investment Discrete Time Surplus Processes

Comparison of Minimum Initial Capital with Investment and Non-investment Discrete Time Surplus Processes The 22 d Aual Meetig i Mathematics (AMM 207) Departmet of Mathematics, Faculty of Sciece Chiag Mai Uiversity, Chiag Mai, Thailad Compariso of Miimum Iitial Capital with Ivestmet ad -ivestmet Discrete Time

More information

Statistical Inference Based on Extremum Estimators

Statistical Inference Based on Extremum Estimators T. Rotheberg Fall, 2007 Statistical Iferece Based o Extremum Estimators Itroductio Suppose 0, the true value of a p-dimesioal parameter, is kow to lie i some subset S R p : Ofte we choose to estimate 0

More information

Sample Size Estimation in the Proportional Hazards Model for K-sample or Regression Settings Scott S. Emerson, M.D., Ph.D.

Sample Size Estimation in the Proportional Hazards Model for K-sample or Regression Settings Scott S. Emerson, M.D., Ph.D. ample ie Estimatio i the Proportioal Haards Model for K-sample or Regressio ettigs cott. Emerso, M.D., Ph.D. ample ie Formula for a Normally Distributed tatistic uppose a statistic is kow to be ormally

More information

Stochastic Simulation

Stochastic Simulation Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso

More information

Session 5. (1) Principal component analysis and Karhunen-Loève transformation

Session 5. (1) Principal component analysis and Karhunen-Loève transformation 200 Autum semester Patter Iformatio Processig Topic 2 Image compressio by orthogoal trasformatio Sessio 5 () Pricipal compoet aalysis ad Karhue-Loève trasformatio Topic 2 of this course explais the image

More information

R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State

R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio if the Locatio Parameter Ca Take o Ay Value Betwee Mius Iity ad Plus Iity R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com

More information

Vector Quantization: a Limiting Case of EM

Vector Quantization: a Limiting Case of EM . Itroductio & defiitios Assume that you are give a data set X = { x j }, j { 2,,, }, of d -dimesioal vectors. The vector quatizatio (VQ) problem requires that we fid a set of prototype vectors Z = { z

More information

Appendix: The Laplace Transform

Appendix: The Laplace Transform Appedix: The Laplace Trasform The Laplace trasform is a powerful method that ca be used to solve differetial equatio, ad other mathematical problems. Its stregth lies i the fact that it allows the trasformatio

More information

Subject: Differential Equations & Mathematical Modeling-III

Subject: Differential Equations & Mathematical Modeling-III Power Series Solutios of Differetial Equatios about Sigular poits Subject: Differetial Equatios & Mathematical Modelig-III Lesso: Power series solutios of differetial equatios about Sigular poits Lesso

More information

Basics of Probability Theory (for Theory of Computation courses)

Basics of Probability Theory (for Theory of Computation courses) Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.

More information

Modeling and Performance Analysis with Discrete-Event Simulation

Modeling and Performance Analysis with Discrete-Event Simulation Simulatio Modelig ad Performace Aalysis with Discrete-Evet Simulatio Chapter 5 Statistical Models i Simulatio Cotets Basic Probability Theory Cocepts Useful Statistical Models Discrete Distributios Cotiuous

More information

Bayesian and E- Bayesian Method of Estimation of Parameter of Rayleigh Distribution- A Bayesian Approach under Linex Loss Function

Bayesian and E- Bayesian Method of Estimation of Parameter of Rayleigh Distribution- A Bayesian Approach under Linex Loss Function Iteratioal Joural of Statistics ad Systems ISSN 973-2675 Volume 12, Number 4 (217), pp. 791-796 Research Idia Publicatios http://www.ripublicatio.com Bayesia ad E- Bayesia Method of Estimatio of Parameter

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

Lecture 33: Bootstrap

Lecture 33: Bootstrap Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece

More information

J. Stat. Appl. Pro. Lett. 2, No. 1, (2015) 15

J. Stat. Appl. Pro. Lett. 2, No. 1, (2015) 15 J. Stat. Appl. Pro. Lett. 2, No. 1, 15-22 2015 15 Joural of Statistics Applicatios & Probability Letters A Iteratioal Joural http://dx.doi.org/10.12785/jsapl/020102 Martigale Method for Rui Probabilityi

More information

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters

More information

STA6938-Logistic Regression Model

STA6938-Logistic Regression Model Dr. Yig Zhag STA6938-Logistic Regressio Model Topic -Simple (Uivariate) Logistic Regressio Model Outlies:. Itroductio. A Example-Does the liear regressio model always work? 3. Maximum Likelihood Curve

More information

Problem Set 2 Solutions

Problem Set 2 Solutions CS271 Radomess & Computatio, Sprig 2018 Problem Set 2 Solutios Poit totals are i the margi; the maximum total umber of poits was 52. 1. Probabilistic method for domiatig sets 6pts Pick a radom subset S

More information

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample. Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized

More information

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality

More information

Approximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation

Approximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation Metodološki zvezki, Vol. 13, No., 016, 117-130 Approximate Cofidece Iterval for the Reciprocal of a Normal Mea with a Kow Coefficiet of Variatio Wararit Paichkitkosolkul 1 Abstract A approximate cofidece

More information

Notes on iteration and Newton s method. Iteration

Notes on iteration and Newton s method. Iteration Notes o iteratio ad Newto s method Iteratio Iteratio meas doig somethig over ad over. I our cotet, a iteratio is a sequece of umbers, vectors, fuctios, etc. geerated by a iteratio rule of the type 1 f

More information

11 Correlation and Regression

11 Correlation and Regression 11 Correlatio Regressio 11.1 Multivariate Data Ofte we look at data where several variables are recorded for the same idividuals or samplig uits. For example, at a coastal weather statio, we might record

More information

5. Likelihood Ratio Tests

5. Likelihood Ratio Tests 1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5 CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio

More information

Discrete Mathematics and Probability Theory Fall 2013 Vazirani Note 15

Discrete Mathematics and Probability Theory Fall 2013 Vazirani Note 15 CS 70 Discrete Mathematics ad Probability Theory Fall 2013 Vazirai Note 15 Some Importat Distributios I this ote we will itroduce three importat probability distributios that are widely used to model realworld

More information

Recursive Algorithms. Recurrences. Recursive Algorithms Analysis

Recursive Algorithms. Recurrences. Recursive Algorithms Analysis Recursive Algorithms Recurreces Computer Sciece & Egieerig 35: Discrete Mathematics Christopher M Bourke cbourke@cseuledu A recursive algorithm is oe i which objects are defied i terms of other objects

More information

(b) What is the probability that a particle reaches the upper boundary n before the lower boundary m?

(b) What is the probability that a particle reaches the upper boundary n before the lower boundary m? MATH 529 The Boudary Problem The drukard s walk (or boudary problem) is oe of the most famous problems i the theory of radom walks. Oe versio of the problem is described as follows: Suppose a particle

More information

CHAPTER 8 FUNDAMENTAL SAMPLING DISTRIBUTIONS AND DATA DESCRIPTIONS. 8.1 Random Sampling. 8.2 Some Important Statistics

CHAPTER 8 FUNDAMENTAL SAMPLING DISTRIBUTIONS AND DATA DESCRIPTIONS. 8.1 Random Sampling. 8.2 Some Important Statistics CHAPTER 8 FUNDAMENTAL SAMPLING DISTRIBUTIONS AND DATA DESCRIPTIONS 8.1 Radom Samplig The basic idea of the statistical iferece is that we are allowed to draw ifereces or coclusios about a populatio based

More information

Direction: This test is worth 250 points. You are required to complete this test within 50 minutes.

Direction: This test is worth 250 points. You are required to complete this test within 50 minutes. Term Test October 3, 003 Name Math 56 Studet Number Directio: This test is worth 50 poits. You are required to complete this test withi 50 miutes. I order to receive full credit, aswer each problem completely

More information

Optimization Methods MIT 2.098/6.255/ Final exam

Optimization Methods MIT 2.098/6.255/ Final exam Optimizatio Methods MIT 2.098/6.255/15.093 Fial exam Date Give: December 19th, 2006 P1. [30 pts] Classify the followig statemets as true or false. All aswers must be well-justified, either through a short

More information

The Sample Variance Formula: A Detailed Study of an Old Controversy

The Sample Variance Formula: A Detailed Study of an Old Controversy The Sample Variace Formula: A Detailed Study of a Old Cotroversy Ky M. Vu PhD. AuLac Techologies Ic. c 00 Email: kymvu@aulactechologies.com Abstract The two biased ad ubiased formulae for the sample variace

More information

AAEC/ECON 5126 FINAL EXAM: SOLUTIONS

AAEC/ECON 5126 FINAL EXAM: SOLUTIONS AAEC/ECON 5126 FINAL EXAM: SOLUTIONS SPRING 2015 / INSTRUCTOR: KLAUS MOELTNER This exam is ope-book, ope-otes, but please work strictly o your ow. Please make sure your ame is o every sheet you re hadig

More information