Point Process Models for Multivariate HighFrequency Irregularly


 Sharleen Johnston
 1 years ago
 Views:
Transcription
1 oit rocess Models for Multivariate HighFrequecy Irregularly Spaced Data Stephe Crowley Abstract. Defiitios from the theory of poit processes are recalled. Models of itesity fuctio parametrizatio ad maximum likelihood estimatio from data are explored. Closedform loglikelihood expressios are give for the Hawkes uivariate ad multivariate)process, Autoregressive Coditioal DuratioACD), with both expoetial ad Weibull distributed errors, ad a hybrid model combiig the ACD ad the Hawkes models. Diural, or daily, adjustmet of the determiistic predictable part of the itesity variatio via piecewise polyomial splies is discussed. Data from the symbol SY o three differet electroic markets is used to estimate model parameters ad geerate illustrative plots. The parameters were estimated without diural adjustmets, a repeat of the aalysis with adjustmets is due i a future versio of this article. The coectio of the Hawkes process to quatum theory is briefly metioed. The Hawkess process with a Weibull kerel is also briefly metioed ad will be explored more i the future. Table of cotets 1. Defitios oit rocesses ad Itesities Stochastic Itegrals The Expoetial Autoregressive Coditioal DuratioEACD) Model The WeibullACD Model The Hawkes rocess Liear SelfExcitig rocesses The Hawkes1) Model Maximum Likelihood Estimatio The Hawkes rocess i Quatum Theory The Hawkes rocess Havig a Weibull Kerel Combiig the ACD ad Hawkes Models Multivariate Hawkes Models The Compesator LogLikelihood Numerical Methods The NelderMead Algorithm Startig oits for Optimizig the Hawkes rocess of Order Examples Millisecod Resolutio Trade Sequeces Adjustig for the Determiistic Daily Itesity Variatio Uivarate Hawkes model fit to SY SDR S& 5 ETF Trust) Multivariate SY Data for Multivariate SY Data for Bibliography oit rocesses ad Itesities. 1. Defitios 1
2 2 oit rocess Models for Multivariate HighFrequecy Irregularly Spaced Data Cosider a K dimesioal multivariate poit process. Let N k t deote the coutig process associated with the kth poit process which is simply the umber of evets which have occured by time t. Let F t deote the filtratio of the pooled process N t of K poit processes cosistig of the set t k <t k 1 <t k 2 < <t k i < deotig the history of arrival times of each evet type associated with the k=1 K poit processes. At time t, the most recet arrival time will be deoted t k k Nt. A process is said to be simple if o poits occur at the same time, thas, there are o zerolegth duratios. The coutig process ca be represeted as a sum of Heaviside step fuctios θt)= { t< 1 t N t k = ti k t θt k ) 1) The coditioal itesity fuctio gives the coditioal probability per uit time that a evet of type k occurs i the exstat. For small values of t we have λ k t F t )= lim t k rn t+ t N k t > F t ) t 2) so that λ k k t F t ) t=en t+ t N k t F t )+o t) 3) k EN t+ t N k t ) λ k t F t ) t)=o t) 4) ad 4) will be ucorrelated with the past of F t as t. Next cosider lim t s 1 s ) t k Ns+j t = lim N s k N s1 t =N k s N k s1 ) k ) s ) k N s +j 1) t λ k s +j t F t ) t s 1 s ) t s 1 λ k t F t )dt λ k j t F t ) t 5) which will be ucorrelated with F s, thas s 1 E λ k t F t )dt) =N k k s N s1 6) s The itegrated itesity fuctio is kow as the compesator, or more precisely, the F t compesator ad will be deoted by Λ k s 1 s,s 1 )= λ k t F t )dt 7) s Let x k = t k k i 1 deote the time iterval, or duratio, betwee the ith ad i 1)th arrival times. The F t coditioal survivor fuctio for the kth process is give by Let S k x i k )= k k >x i k F ti 1+τ) 8) Ẽ k i = λ k t F t )dt=λ k 1, ) 1 the provided the survivor fuctio is absolutely cotiuous with respect to Lebesgue measurewhich is a assumptio that eeds to be verified, usually by graphical tests) we have S k x k i )=e t λ k t F t )dt k i 1 =e Ẽ i 9)
3 ,, 3 ad Ẽ Nt) is a i.i.d. expoetial radom variable with uit mea ad variace. Sice E Ẽ Nt) ) =1 the radom variable k E Nt) =1 Ẽ Nt) 1) has zero mea ad uit variace. ositive values of E Nt) idicate that the path of coditioal itesity fuctio λ k t F t ) uderpredicted the umber of evets i the time iterval ad egative values of E Nt) idicate that λ k t F t ) overpredicted the umber of evets i the iterval. I this way, 8) ca be iterpreated as a geeralized residual. The backwards recurrece time give by icreases liearly with jumps back to at each ew poit. U k) t)=t t N k t) 11) Stochastic Itegrals. The stochastic Stieltjes itegral[1, 2.1][8, 2.2] of a measurable process, havig either locally bouded or oegative sample paths, Xt) with respect to N k exists ad for each t we have Xs)dN k s = θt t k i )Xt k i ) 12),t] i The Expoetial Autoregressive Coditioal DuratioEACD) Model. Lettig p i be the family of coditioal probability desity fuctios for arrival time, the log likelihood of the expoetial) ACD model ca be expressed i terms of the coditioal desities or itesities as [11] ll{ } i= ) = logp i t,, 1 ) i= ) t = logλ i 1,t,, 1 ) λu,t,,t Nu )du i=1 = i=1 = i=1 logλ i 1,t,, 1 ) λu,t,,t Nu )du 1 ) logλ i 1,t,, 1 ) Ẽ i t = lλt)dnt t t t λt)dt We will see that λ ca be parameterized i terms of t ) 13) λt N t,t 1,,t Nt )=ω+ i=1 N t π i t Nt+1 i t Nt i) 14) so that the impact of a duratio betwee successive evets depeds upo the umber of iterveig evets. Let x i = 1 be the iterval betwee cosecutive arrival times; the x i is a sequece of duratios or waitig times. The coditioal desity of x i give its pass the give directly by Ex i x i 1,,x 1 )=ψ i x i 1,,x 1 ;θ)=ψ i 15) The the ACD models are those that cosist of the assumptio x i =ψ i ε i 16) where ε i is idepedetly ad idetically distributed with desity pε; φ) where θ ad φ are variatio free. ACD processes are limited to the uivariate settig but later we will see that this model ca be combied with a Hawkes process i a multivariate framework. [6] The coditioal itesity of a ACD model ca be expressed i geeral as λt N t,t 1,,t Nt )=λ t tnt ψ Nt+1 ) 1 ψ Nt+1 17)
4 4 oit rocess Models for Multivariate HighFrequecy Irregularly Spaced Data where λ t) is a determiistic baselie hazard, so that the past history iflueces the coditioal itesity by both a multiplicative effect ad a shif the baselie hazard. This is called a accelerated failure time model sice pasformatio iflueces the rate at which time passes. The simplest model is the expoetial ACD which assumes that the duratios are coditioally expoetial so that the baselie hazard λ t)=1 ad the coditioal itesity is λt x Nt,,x 1 )= 1 ψ Nt +1 18) The compesator for cosecutive evets of the ACD model i the case of costat baselie itesity λ t)=1 is simply Ẽ i =Λ k 1, ) = λt x i,,x 1 )dt t i 1 1 = dt 1 ψ Nt +1 1 = dt ψ i 1 = 1 ψ i = x i ψ i where x i = 1. A geeral model without limited memory is referred to as ACDm,q) where m ad q refer to the order of the lags so that there are m+q+1) parameters. m ψ i =ω+ q α j x i j + 19) ψ i j 2) ω 1 q j=q where ω,α j, ad ψ i = for i=1 maxm,q) so the coditioal itesity is the writte 1 λt x Nt,,x 1 )= ω+ m α j x q 21) Nt+1 j+ ψ Nt+1 j The loglikelihood for the ACDm,q) model is the writte i terms of the duratios x i = 1 ) ll{x i } i=1,, ) = lλ i 1,t,, 1 ) Ẽ i i=1 = ) Sxi ) l ψ i i=1 ) e Ẽi ψ i = l i=1 = i=1 = i=1 l e xi ψ i ψ i 1 l ψ i ) x i ψ i 22) A ACD process is statioary if m α j + q i=1 i=1 <1 23)
5 ,, 5 i which case the ucoditioal mea exists ad is give by ω µ=e[x i ]= 1 m i=1 α j + q i=1 ) 24) The goodess of fit ca be checked by testig that residuals Ẽ i have mea ad variace equal to 1 ad o autocorrelatio The WeibullACD Model. The WACDWeibullACD) model exteds the EACD model by assumig a Weibull distributio for the residuals ε i i 16) istead of a expoetial. We have the itesity give by ad loglikelihood by 1+ λt x Nt,,x 1 )= Γ 1 γ ψ Nt+1 ) ) ll{x i } i=1,, ) = ) γ 1+ l +γl Γ 1 γ x i ψ i i=1 γ t t Nt ) γ 1 γ 25) x i ) 1+ Γ 1 γ ψ i x i γ 26) The goodess of fit ca be checked by testig that the mea of Ẽ i is equal to 1 ad graphically checkig whas kow as a weibull plot. If is a good fit, the empirical curve will be ear the straight lie. I the example show below, the weibull does better tha the expoetial bus still ot a great fit Weibull robability lot.1 robability Data Figure 1. Weibull plot for WACD1,1) model fit to SY INET o The Hawkes rocess.
6 6 oit rocess Models for Multivariate HighFrequecy Irregularly Spaced Data Liear SelfExcitig rocesses. A uivariate) liear selfexcitig coutig) process N s oe that ca be expressed as [15][7][14][3] t λt) =λ t)κ+ νt s)dn s =λ t)κ+ 27) νt ) <t where λ t) is a determiistic base itesity, see 77), ν: R + R + expresses the positive ifluece of past evets o the curret value of the itesity process, ad κ takes the place of the λ costa the refereced papers. The expoetial) Hawkes process of order is a liear selfexcitig process defied by the expoetial kerel so that the itesity is writte as νt)= α j e βjt 28) λt) =λ t)κ+ t N t 1 α j e βjt s) dn s =λ t)κ+ α j e βjt ti) i= =λ t)κ+ N t 1 α j e βjt ti) =λ t)κ+ =λ t)κ+ i= N t 1 α j e βjt tk) i= α j B j N t ) 29) where B j i) is give recursively by i 1 A uivariate Hawkes process is statioary if B j i) = 3) k= =1+B j i 1))e βjt ti) e βjt tk) αj If a Hawkes process is statioary the the ucoditioal mea is <1 31) λ µ=e[λt)] = 1 νt)dt = λ 1 λ = 1 α j α j e βjt dt 32)
7 ,, 7 For cosecutive evets, we have the compesator 7) Λ 1, ) = λt)dt 1 = λ t)+ α j B j N t ) dt 1 = λ s)ds+ i 1 αj e 1 t k) e βjti tk)) 1 k= = λ s)ds+ αj ) 1 e 1) A j i 1) 1 where there is the recursio A j i) = e βjti tk) t k i 1 e βjti tk) = k= 33) 34) =1+e βjti ti 1) A j i 1) with A j )=. If λ t)=λ the 33) simplifies to Λ 1, ) = 1 )λ + k= = 1 )λ + i 1 αj αj e 1 t k) e βjti tk)) 1 e 1) ) A j i 1) 35) Similiarly, aother parameterizatio is give by Λ 1, ) = κλ s)ds+ αj ) 1 e 1) A j i 1) 1 =κ λ s)ds+ αj ) 1 e 1) A j i 1) 1 36) =κλ 1, )+ αj 1 e 1) ) A j i 1) where κ scales the predetermied baselie itesity λ s). I this parameterizatio the itesity is also scaled by κ λt) =κλ t)+ α j B j N t ) 37) this allows to precompute the determiistic part of the compesator Λ 1, )= 1 λ s)ds The Hawkes1) Model. The simplest case occurs whe the baselie itesity λ t) is costat ad =1 where we have λt)=λ + αe βt ti) 38) <t
8 8 oit rocess Models for Multivariate HighFrequecy Irregularly Spaced Data which has the ucoditioal mea E[λt)]= λ 1 α β 39) Maximum Likelihood Estimatio. The loglikelihood of a simple poit process is writte as T llnt) t [,T] ) = =T 1 λs))ds+ T λs)ds + T T lλs)dn s lλs)dn s 4) which i the case of the Hawkes model of order ca be explicitly writte [13] as ll{ } i=1 ) =T Λ,T)+ i=1 =T + i=1 lλ ) lλ ) Λ 1, ) =T Λ,T)+ lλ ) i=1 =T Λ,T)+ l κλ )+ i=1 =T Λ,T)+ i=1 i 1 k=1 l κλ )+ α j R j i) α j e βjti tk) 41) =T + i=1 T κλ s)ds αj i=1 l κλ )+ α j R j i) ) 1 e t ) where T =t ad we have the recursio[12] i 1 e βjti tk) R j i) = k=1 =e βjti ti 1) 1+R j i 1)) 42) If we have costat baselie itesity λ t)=1 the the loglikelihood ca be writte ll{ } i=1 ) =T κt i=1 + i=1 αj l λ + α j R j i) ) 1 e t ) 43) Note that was ecessary to shift each by t 1 so that t 1 = ad t =T. Also ote that T is just a additive costat which does ot vary with the parameters so for the purposes of estimatio ca be removed from the equatio The Hawkes rocess i Quatum Theory.
9 ,, 9 The Hawkes process arises i quatum theory by cosiderig feedback via cotiuous measuremets where the quatum aalog of a selfexcitig poit process is a source of irreversibility whose stregth is cotrolled by the rate of detectios from that source. [16] The Hawkes rocess Havig a Weibull Kerel. The expoetial kerel of the Hawkes process ca be replaced with that of a Weibull kerel. [1, 6.3] Recall that the itesity is defied by 27) t λt) =λ t)κ+ νt s)dn s =λ t)κ+ νt ) <t 44) where the expoetial kerel νt)= so the WeibullHawkes itesity is writte is λt) =λ t)κ+ α j e βjs replaced by the Weibull kerel νt)= ) ) ) κj κj t κj 1 t ω α j e j 45) ω j ω j =λ t)κ+ i= t N t 1 α j κj ω j α j κj ω j ) t s ω j ) t ti ω j ) ) κj κj 1 e βj t s ω j dn s ) κj 1 e t ω j ) κj 46) 1.5. Combiig the ACD ad Hawkes Models. The ACD ad Hawkes models ca be combied to provide a model for itraday volatility. [2] Let λt) =λ t)+ 1 t + νt s)dn s 47) ψ Nt where λ t) is the determistic baselie itesity77) ad where the ACD2) pars m ψ i =ω+ q α j x i j + ψ i j 48) ad the Hawkes part has the expoetial kerel28) νt)= γ j e ϕjt 49) so that t νt s)dn s = t γ j e ϕjt s) dn s N t νt t k ) = k= N t = k= = N t γ j k= = γ j B j N t ) γ j e ϕjt tk) e ϕjt tk) 5)
10 1 oit rocess Models for Multivariate HighFrequecy Irregularly Spaced Data where we have replaced α=γ ad β=ϕ i the Hawkes part so that the parameter ames do ot coflict with the ACD part where α ad β are also used as parameter ames. The Hawkes part of the itesity has a recursive structure similiar to that of the compesator. Let where B j )=. The we have i 1 B j i) = 51) k= =1+B j i 1))e ϕjt ti) e ϕjt tk) 1 λt) =λ t)+ ω+ m α j x q + γ j B j N t ) 52) Nt j+ ψ Nt j The loglikelihood for this hybrid model ca be writte as ll{ } i=1,.., ) = i=1 lλ ) 1 ) λt)dt = lλ ) Λ 1, )) i=1 53) = i=1 lλti ) Ẽ i ) By direct calculatio, combiig 19) ad 33), ad lettig x i = 1 we have the compesator Ẽ i =Λ 1, ) = λt)dt t i 1 = λ t)+ 1 1 ψ Nt +1 = x i + λ t)+ ψ i 1 ti = λ t)dt+ x i + ψ ti 1 i k= = 1 + t t νt s)dn s )dt νt s)dn s )dt i 1 γj e ϕjti 1 tk) e ϕjti tk)) ϕ j λ t)dt+ x i + γj 1 e ϕjxi )A j i 1) ψ i ϕ j 54) where ψ i is defied by 48) ad is give by 34) so that 53) ca be wriitte as A j i)=1+e ϕjxi A j i 1) 55) ll{ } i=,.., ) = lλ ) Ẽ i ) i=1 = lλti ) x i + γj 1 e ϕjxi )A j i 1) ψ i ϕ j i=1 = l 1 i 1 + γ ψ j e ϕjti tk) x i + γj 1 e ϕjxi )A i ψ i ϕ j i 1) j i=1 k= = l 1 + γ ψ j B j i) x i + γj 1 e ϕjxi )A i ψ i ϕ j i 1) j i= Multivariate Hawkes Models. Let M N ad { m )} m=1,,m be a Mdimesioal poit process. The associated coutig process will be deoted N t =N t 1,,N t M ). A multivariate Hawkes process[7][5][9] is defied with 56)
11 ,, 11 itesities λ m t),m=1 M give by M λ m t) =λ m t)κ m + =1 =λ m t)κ m + =1 =λ m t)κ m + =1 =λ m t)κ m + =1 =λ m t)κ m + =1 =λ m t)κ m + =1 t M t k <t M M M M α m, j e β m, j t s) dn s α j m, α m, j e β m, j t t k ) t k <t α j m, t k <t N t 1 α j m, k= α j m, B j m, N t ) e β m, j t t k ) e β m, j t t k ) e β m, j t t k ) where i this parameterizatio κ is a vector which scales the baselie itesities, i this case, specified by piecewise polyomial splies 77). We ca write B j m, i) recursively 57) B j m, i) = i 1 k= e β m, j t t k ) =1+B j m, i 1))e m, t ) I the simplest versio with =1 ad λ m t)=1 costat we have λ m t) =κ m + =1 =κ m + =1 M t M M =κ m + =1 N t 1 α m, e βm, t s) dn s α m, e βm, t t k ) k= N t 1 e βm, t t k ) α m, k= 58) 59) M =κ m + =1 Rewritig 59) i vectorial otio, we have λt)=κ+ where α m, B 1 m, N t ) t Gt s)dn s 6) Gt)=α m, e βm, t s) ) m,=1 M 61) Assumig statioarity gives E[λt)] = µ a costat vector ad thus κ µ = I Gu)du κ = I αm, ) β m, = κ I Γ A sufficiet coditio for a multivariate Hawkes process to be statioary is that the spectral radius of the brachig matrix Γ= Gs)ds= αm, β m, 63) 62)
12 12 oit rocess Models for Multivariate HighFrequecy Irregularly Spaced Data be strictly less tha 1. The spectral radius of the matrix G is defied as where SG) deotes the set of eigevalues of G. ρg)= max a 64) a SG) The Compesator. The compesator of the mth coordiate of a multivariate Hawkes process betwee two cosecutive evets t m i 1 ad t m i of type m is give by Λ m t m i 1,t m i ) = m m 1 M + =1 M + =1 λ m s)ds t m k < 1 t m i 1 t m k < m, α j β m,[e β m, j t m i 1 t ) k e β m, j t m i t ) k ] j m, α j β m,[1 e β m, j t m i t ) k ] j To save a cosiderable amout of computatioal complexity, ote that we have the recursio A m, j i) = e β m, j t m i t k ) t m k < =e β m, j t m i 1 m ) A j m, i 1)+ t m i 1 t m k < 65) e β 66) m, j t m i t k ) ad rewrite 65) as Λ m t m i 1,t m i ) =κ m ti m λ s)ds+ m m m 1 1 =κ m ti m λ m s)ds m 1 M m, α j m, β j m + =1 =κ m + =1 tm i 1 M [ λ m s)ds ti m M =1 t k <s α j m, e m, s tk ) ds 1 e β m, j ti m ti 1 m ) ) A m, j i 1)+ m, αj m, β 1 e β m, j m ti ti 1 m ) ) j t k <tm i 1 e β m, j m ti 1 t k ) + t m i 1 t m k < t m i 1 t k <tm i ] 1 e βjm, ti m ) tk ) 1 e m, m ti t ) k ) 67) where we have the iitial coditios A j m, )= LogLikelihood. The loglikelihood of the multivariate Hawkes process ca be computed as the sum of the loglikelihoods for each coordiate. Let where each term is defied by ll m { })= M ll{ } i=1,,nt )= m=1 which i this case ca be writte as ll m { }) =T Λ m,t)+ N T z m i l m λ )κ m + i=1 =1 N T m =T Λ m,t)+ i=1 T ll m { }) 68) 1 λ m T s))ds+ lλ m m s)dn s 69) l m λ t m i )κ m + =1 M α m, j e βjm, t k ) t k < M t m k < α j m, e m, m t k ) 7)
13 ,, 13 where agai t NT =T ad ad { z m 1 evetti of typem i = otherwise 71) Λ m T,T)= λ m t)dt= m N T Λ m t m i 1,t m i ) 72) i=1 where Λ m t m i 1,t m i ) is give by 67). Similiar to to the oedimesioal case, we have the recursio R m, j i) = t k <t j m = e β m, j t m i t k ) e β m, j t m i t m i 1 ) R m, j i 1)+ t m i 1 t m k <t e β m, j t m i t k ) i e β m, j t m i t m i 1 ) 1+R m, j i 1)) ifm ifm= 73) so that 7) ca be rewritte as ll m { }) =T κ m T λ m t)dt i=1 m N T M N T m + i=1 =1 m, αj m, β 1 e β m, j ti m ti 1 m ) ) A m, i 1)+ j j l m λ t m i )κ m + =1 M t m i 1 t m k < α m, j R m, j i) 1 e βjm, ti m t ) k ) + 74) with iitial coditios R j m, ) = ad A j m, ) = where T = t N where N is the umber of observatios, M is the umber of dimesios, ad is the order of the model. Agai, T ca be dropped from the equatio for the purposes of optimizatio. 2. Numerical Methods 2.1. The NelderMead Algorithm. The NelderMead simplex algorithm[4] was used to optimize the likelihood expressios give above Startig oits for Optimizig the Hawkes rocess of Order. A startig poit for the optimizatio of a Hawkes process of order with a exact ucoditioal itesity was chose as the most reasoable startig poit, bus by o meas claimed to be the best. Letx i = 1 be the iterval betwee cosecutive arrival times as i the ACD model 16). The set the iitial value of λ to.5 E[x i], α 1 = 1 ad β 1 =2. This gives a ucoditioal mea of E[x i ] for these parameters used as a startig poit for the NelderMead algorithm. 3. Examples 3.1. Millisecod Resolutio Trade Sequeces. The source data has resolutio of millisecods but the data is trasformed prior to estimatio by dividig each time by 1 so that the uit of time is secods. Also, trades occurig at the same price withi 2ms of each other are dropped from the aalysis. Further work will be doe to fid the optimal level of time aggregatio, ideally the data would be timestamped with aosecod resolutio ad this will be doe i the future Adjustig for the Determiistic Daily Itesity Variatio. Is a well kow fact that arrival ratesad the closely related volatility) have daily seasoal or diural patters where tradig activity peaks after ope ad before close ad has a low aroud the middle of the day kow as the luchtime effect. I order to accout for this we will fit a cubic splie with 14 kot poits spaced every 3 miutes, icludig the opeig ad closig times of t= ad t= =234 respectively sice t has uits of secods. Let the adjusted duratios be defied x i=φ )x i 75)
14 14 oit rocess Models for Multivariate HighFrequecy Irregularly Spaced Data where x i = 1 is the uadjusted duratio ad φ ) is a piecewise polyomial) cubic splie with kot poits at tzj) with values give by j 1 j = N tzj)+w N tzj) w ) N tzj)+w i=n tzj) w 1 xi forj= 13 76) where z= 6 3=18 is the umber of secods i a halfhour ad j= 6.5 2). The first ad last kots have a widow of 3miutes whereas the iterior kot poits have a widow of 1 hour lookig forward ad backward i time 3miutes, the first kot poit oly looks forward ad the last kot poit oly looks backward. This gives us the determiistic baselie itesity which is a piecewise polyomial cubic splie fuctio whose exact form is ot metioed here sice is ot the focus of the paper. λ t)=ft,,, j ) 77) The followig figure shows the determiistic part of the itesity estimated for SY o for INET, BATS, ad ARCA. 2 φt) 1.8 INET BATS ARCA Figure 2. Iterpolatig splie φt) for SY o Uivarate Hawkes model fit to SY SDR S& 5 ETF Trust). Cosider these parameter estimates for the uivariate) Hawkes model of various orders fitted to data geerated by trades of the symbol SY traded o the NASDAQ o Nov 3th, 212. The ucoditioal sample mea itesity for this symbol o this day o this exchage was trades per secod where the umber of samples is = The data preseted here has ot bee deseasoalized, the aalysis with determiistic diural variatio accouted for will be preseted i the ext sectio. As ca be see, = 6 provides the best likelihood but a more rigorous method to choose would be to use some iformatio criterio like Bayes or Akaike to decide the order. Error bars are ot provided, but presumably they could be estimated with derivative iformatio. Note that the closer E[λt)] to ad E[Λ] ad Var[Λ] to 1. the better, sice Λ should be expoetially distributed with mea
15 ,, 15 1 by desig ad for a oisso process the mea ad variace are equal. The ext thig to check is that the Λ series is ot autocorrelated. κ α 1 β 1 ll{ }) E[λt)] E[Λ] Var[Λ] Table 1. arameters ad statistics for model fitted to data without diural adjustmets κ α 1 β 1 ll{ }) E[λt)] E[Λ] Var[Λ] Table 2. arameters ad statistics for model fitted to data with diural adjustmets
16 16 oit rocess Models for Multivariate HighFrequecy Irregularly Spaced Data Autocorrelatio of Λ for =1 Autocorrelatio of Λ for =2.8.8 Sample Autocorrelatio Sample Autocorrelatio Autocorrelatio of Λ for =3 Autocorrelatio of Λ for =4.8.8 Sample Autocorrelatio Sample Autocorrelatio Autocorrelatio of Λ for =5 Autocorrelatio of Λ for =6.8.8 Sample Autocorrelatio Sample Autocorrelatio Figure 3. Autocorrelatios of Λ 1, ) for =1 6 without diural adjustmets
17 ,, 17 Autocorrelatio of Λ for =1 Autocorrelatio of Λ for =2.8.8 Sample Autocorrelatio Sample Autocorrelatio Autocorrelatio of Λ for =3 Autocorrelatio of Λ for =4.8.8 Sample Autocorrelatio Sample Autocorrelatio Autocorrelatio of Λ for =5 Autocorrelatio of Λ for =6.8.8 Sample Autocorrelatio Sample Autocorrelatio Figure 4. Autocorrelatios of Λ 1, ) for =1 6 with diural adjustmets As ca be see by visually ispectig the autocorrelatios, all of the residual series are prettymuch acceptable *without* diural adjustmets except for = 1 with still had sigificat leftover autocorrelatio. Stragely, it seems thaclusio of the diural adjustmet sigificatly worses the model fi early all cases. I am tempted to suspect somethig wrog with the code.
18 18 oit rocess Models for Multivariate HighFrequecy Irregularly Spaced Data x 1 4 Figure 5. rice history for SY traded o INET o Oct 22d, Figure 6. x i = 1 i blue ad {Λ 1, ): =1} i gree
19 ,, Figure 7. x i = 1 i blue ad {Λ 1, ): =6} i gree
20 2 oit rocess Models for Multivariate HighFrequecy Irregularly Spaced Data x 1 4 Figure 8. Zoomed i view of x i = 1 i blue ad {Λ 1, ): =6} i gree Multivariate SY Data for Cosider a 5dimesioal multivariate Hawkes model of order =1 fit to data for SY from 3 exchages, INET, BATS, ad ARCA o Both INET ad BATS distiguish buys from sells whereas ARCA does ot, hece 5 dimesioal, 2 dimesios each for INET ad BATS ad 1 dimesio for ARCA which will aturally have twice as high a rate as that for buys ad sells cosidered seperately. The 5 dimesios are orgaized as follows: BATS Buys BATS Sells INET Buys INET Sells ARCA Trades 78)
21 ,, SY Trades o BATS Buys Λ BATS Sells Λ INET Buys Λ INET Sells Λ ARCA Trades Λ x 1 4 Figure 9. We say trades for ARCA because the type set from the data broker is Ukow, idiciatig thas ukow whether is a buyer or seller iitiated trade. We have the followig parameter estimates where large values of α >.1) are highlighted i bold. α= λ= β= ) 8) 81) with a loglikelihood score of Multivariate SY Data for
22 22 oit rocess Models for Multivariate HighFrequecy Irregularly Spaced Data Cosider the same symbol, SY, as a 5dimesioal Hawkes process as i 3.1.3, for a differet day, o , estimated with order = 2 for a total of 15 parameters. α j coefficiets that are >.1 are highlighted i bold. The parameters listed below resulted i a loglikelihood value of A iterestig patter emerges i the β coefficiets where it takes o some approximate stairstep patter ragig from 2 to 22. This might be idicitative of some fixedfrequecy algorithms operatig across the differet exchages at approximate 1secod itervals. λ= α 1= α 2= β 1 = β 2 = Bibliography 82) 83) 84) [1] C.G. Bowsher. Modellig security market evets i cotiuous time: itesity based, multivariate poit process models. Joural of Ecoometrics, 1412): , 27. [2] Y. Cai, B. Kim, M. Leduc, K. Szczegot, Y. Yixiao ad M. Zamfir. A model for itraday volatility.,, 27. [3] V. ChavezDemouli ad JA McGill. Highfrequecy fiacial data modelig usig hawkes processes. Joural of Bakig & Fiace,, 212. [4] JE Deis ad D.J. Woods. Optimizatio o microcomputers: the eldermead simplex algorithm. New Computig Eviromets: Microcomputers i LargeScale Computig, : , [5]. Embrechts, T. Liiger ad L. Li. Multivariate hawkes processes: a applicatio to fiacial data. Joural of Applied robability, 48: , 211. [6] R.F. Egle ad J.R. Russell. Autoregressive coditioal duratio: a ew model for irregularly spaced trasactio data. Ecoometrica, : , [7] A.G. Hawkes. Spectra of some selfexcitig ad mutually excitig poit processes. Biometrika, 581):83 9, [8] A. Karr. oit processes ad their statistical iferece, volume 7. CRC, [9] T.J. Liiger. Multivariate Hawkes rocesses. hd thesis, Swiss Federal Istitute Of Techology Zurich, 29. [1] F. Loreze. Aalysis of Order Clusterig Usig High Frequecy Data: A oit rocess Approach. hd thesis, Tilburg School of Ecoomics ad Maagemet, Fiace Departmet, August 212. [11] Y. Ogata. The asymptotic behaviour of maximum likelihood estimators for statioary poit processes. Aals of the Istitute of Statistical Mathematics, 31): , [12] Y. Ogata. O lewis simulatio method for poit processes. Iformatio Theory, IEEE Trasactios o, 271):23 31, [13] T. Ozaki. Maximum likelihood estimatio of hawkes selfexcitig poit processes. Aals of the Istitute of Statistical Mathematics, 311): , [14] H. Shek. Modelig high frequecy market order dyamics usig selfexcited poit process. Available at SSRN ,, ) 86)
23 ,, 23 [15] Ioae Mui Toke. A itroductio to hawkes processes with applicatios to fiace., [16] HM Wisema. Quatum theory of cotiuous feedback. hysical Review A, 493):2133, 1994.
Generalized Semi Markov Processes (GSMP)
Geeralized Semi Markov Processes (GSMP) Summary Some Defiitios Markov ad SemiMarkov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More informationThe Poisson Process *
OpeStaxCNX module: m11255 1 The Poisso Process * Do Johso This work is produced by OpeStaxCNX ad licesed uder the Creative Commos Attributio Licese 1.0 Some sigals have o waveform. Cosider the measuremet
More informationExponential Families and Bayesian Inference
Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a dparameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where
More informationConfidence interval for the twoparameter exponentiated Gumbel distribution based on record values
Iteratioal Joural of Applied Operatioal Research Vol. 4 No. 1 pp. 6168 Witer 2014 Joural homepage: www.ijorlu.ir Cofidece iterval for the twoparameter expoetiated Gumbel distributio based o record values
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More informationDouble Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution
Iteratioal Mathematical Forum, Vol., 3, o. 3, 353 HIKARI Ltd, www.mhikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationECONOMETRIC THEORY. MODULE XIII Lecture  34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture  34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a realvalued radom variable
More informationSTAT331. Example of Martingale CLT with Cox s Model
STAT33 Example of Martigale CLT with Cox s Model I this uit we illustrate the Martigale Cetral Limit Theorem by applyig it to the partial likelihood score fuctio from Cox s model. For simplicity of presetatio
More informationRecurrence Relations
Recurrece Relatios Aalysis of recursive algorithms, such as: it factorial (it ) { if (==0) retur ; else retur ( * factorial()); } Let t be the umber of multiplicatios eeded to calculate factorial(). The
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationMA Advanced Econometrics: Properties of Least Squares Estimators
MA Advaced Ecoometrics: Properties of Least Squares Estimators Karl Whela School of Ecoomics, UCD February 5, 20 Karl Whela UCD Least Squares Estimators February 5, 20 / 5 Part I Least Squares: Some FiiteSample
More informationKolmogorovSmirnov type Tests for Local Gaussianity in HighFrequency Data
Proceedigs 59th ISI World Statistics Cogress, 530 August 013, Hog Kog (Sessio STS046) p.09 KolmogorovSmirov type Tests for Local Gaussiaity i HighFrequecy Data George Tauche, Duke Uiversity Viktor Todorov,
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Crosssectioal data. 2. Time series data.
More informationProbability, Expectation Value and Uncertainty
Chapter 1 Probability, Expectatio Value ad Ucertaity We have see that the physically observable properties of a quatum system are represeted by Hermitea operators (also referred to as observables ) such
More information1 Inferential Methods for Correlation and Regression Analysis
1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet
More informationEXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY
EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber
More informationEE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course
SigalEE Postal Correspodece Course 1 SAMPLE STUDY MATERIAL Electrical Egieerig EE / EEE Postal Correspodece Course GATE, IES & PSUs Sigal System SigalEE Postal Correspodece Course CONTENTS 1. SIGNAL
More informationKernel density estimator
Jauary, 07 NONPARAMETRIC ERNEL DENSITY ESTIMATION I this lecture, we discuss kerel estimatio of probability desity fuctios PDF Noparametric desity estimatio is oe of the cetral problems i statistics I
More information3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,
3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationProblems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman:
Math 224 Fall 2017 Homework 4 Drew Armstrog Problems from 9th editio of Probability ad Statistical Iferece by Hogg, Tais ad Zimmerma: Sectio 2.3, Exercises 16(a,d),18. Sectio 2.4, Exercises 13, 14. Sectio
More informationLecture 7: October 18, 2017
Iformatio ad Codig Theory Autum 207 Lecturer: Madhur Tulsiai Lecture 7: October 8, 207 Biary hypothesis testig I this lecture, we apply the tools developed i the past few lectures to uderstad the problem
More informationTHE KALMAN FILTER RAUL ROJAS
THE KALMAN FILTER RAUL ROJAS Abstract. This paper provides a getle itroductio to the Kalma filter, a umerical method that ca be used for sesor fusio or for calculatio of trajectories. First, we cosider
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationStatistical Pattern Recognition
Statistical Patter Recogitio Classificatio: NoParametric Modelig Hamid R. Rabiee Jafar Muhammadi Sprig 2014 http://ce.sharif.edu/courses/9293/2/ce7252/ Ageda Parametric Modelig NoParametric Modelig
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationA New Solution Method for the FiniteHorizon DiscreteTime EOQ Problem
This is the PrePublished Versio. A New Solutio Method for the FiiteHorizo DiscreteTime EOQ Problem ChugLu Li Departmet of Logistics The Hog Kog Polytechic Uiversity Hug Hom, Kowloo, Hog Kog Phoe: +85227667410
More informationMathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution
America Joural of Theoretical ad Applied Statistics 05; 4(: 669 Published olie May 8, 05 (http://www.sciecepublishiggroup.com/j/ajtas doi: 0.648/j.ajtas.05040. ISSN: 68999 (Prit; ISSN: 69006 (Olie Mathematical
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More information6. Sufficient, Complete, and Ancillary Statistics
Sufficiet, Complete ad Acillary Statistics http://www.math.uah.edu/stat/poit/sufficiet.xhtml 1 of 7 7/16/2009 6:13 AM Virtual Laboratories > 7. Poit Estimatio > 1 2 3 4 5 6 6. Sufficiet, Complete, ad Acillary
More informationThe target reliability and design working life
Safety ad Security Egieerig IV 161 The target reliability ad desig workig life M. Holický Kloker Istitute, CTU i Prague, Czech Republic Abstract Desig workig life ad target reliability levels recommeded
More informationLast time: Moments of the Poisson distribution from its generating function. Example: Using telescope to measure intensity of an object
6.3 Stochastic Estimatio ad Cotrol, Fall 004 Lecture 7 Last time: Momets of the Poisso distributio from its geeratig fuctio. Gs () e dg µ e ds dg µ ( s) µ ( s) µ ( s) µ e ds dg X µ ds X s dg dg + ds ds
More informationThis exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.
Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the
More informationMAS275 Probability Modelling
MAS275 Probability Modellig 6 Poisso processes 6.1 Itroductio Poisso processes are a particularly importat topic i probability theory. The oedimesioal Poisso process, which most of this sectio will be
More informationLimit Theorems. Convergence in Probability. Let X be the number of heads observed in n tosses. Then, E[X] = np and Var[X] = np(1p).
Limit Theorems Covergece i Probability Let X be the umber of heads observed i tosses. The, E[X] = p ad Var[X] = p(p). L O This P x p NM QP P x p should be close to uity for large if our ituitio is correct.
More informationStudy the bias (due to the nite dimensional approximation) and variance of the estimators
2 Series Methods 2. Geeral Approach A model has parameters (; ) where is itedimesioal ad is oparametric. (Sometimes, there is o :) We will focus o regressio. The fuctio is approximated by a series a ite
More informationMath 155 (Lecture 3)
Math 55 (Lecture 3) September 8, I this lecture, we ll cosider the aswer to oe of the most basic coutig problems i combiatorics Questio How may ways are there to choose a elemet subset of the set {,,,
More informationECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015
ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a twoclass discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],
More informationOn an Application of Bayesian Estimation
O a Applicatio of ayesia Estimatio KIYOHARU TANAKA School of Sciece ad Egieerig, Kiki Uiversity, Kowakae, HigashiOsaka, JAPAN Email: ktaaka@ifokidaiacjp EVGENIY GRECHNIKOV Departmet of Mathematics, auma
More informationGoodnessOfFit For The Generalized Exponential Distribution. Abstract
GoodessOfFit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated
More informationApproximations and more PMFs and PDFs
Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.
More informationDiscreteTime Systems, LTI Systems, and DiscreteTime Convolution
EEL5: DiscreteTime Sigals ad Systems. Itroductio I this set of otes, we begi our mathematical treatmet of discretetime s. As show i Figure, a discretetime operates or trasforms some iput sequece x [
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationOn Random Line Segments in the Unit Square
O Radom Lie Segmets i the Uit Square Thomas A. Courtade Departmet of Electrical Egieerig Uiversity of Califoria Los Ageles, Califoria 90095 Email: tacourta@ee.ucla.edu I. INTRODUCTION Let Q = [0, 1] [0,
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationSlide Set 13 Linear Model with Endogenous Regressors and the GMM estimator
Slide Set 13 Liear Model with Edogeous Regressors ad the GMM estimator Pietro Coretto pcoretto@uisa.it Ecoometrics Master i Ecoomics ad Fiace (MEF) Uiversità degli Studi di Napoli Federico II Versio: Friday
More informationA Note on BoxCox Quantile Regression Estimation of the Parameters of the Generalized Pareto Distribution
A Note o BoxCox Quatile Regressio Estimatio of the Parameters of the Geeralized Pareto Distributio JM va Zyl Abstract: Makig use of the quatile equatio, BoxCox regressio ad Laplace distributed disturbaces,
More informationADVANCED SOFTWARE ENGINEERING
ADVANCED SOFTWARE ENGINEERING COMP 3705 Exercise Usagebased Testig ad Reliability Versio 1.0040406 Departmet of Computer Ssciece Sada Narayaappa, Aeliese Adrews Versio 1.1050405 Departmet of Commuicatio
More informationLinear Regression Demystified
Liear Regressio Demystified Liear regressio is a importat subject i statistics. I elemetary statistics courses, formulae related to liear regressio are ofte stated without derivatio. This ote iteds to
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More informationSINGLECHANNEL QUEUING PROBLEMS APPROACH
SINGLECHANNEL QUEUING ROBLEMS AROACH Abdurrzzag TAMTAM, Doctoral Degree rogramme () Dept. of Telecommuicatios, FEEC, BUT Email: xtamta@stud.feec.vutbr.cz Supervised by: Dr. Karol Molár ABSTRACT The paper
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationMathematical Statistics  MS
Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios
More informationFirst Year Quantitative Comp Exam Spring, Part I  203A. f X (x) = 0 otherwise
First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I1 Part I  203A A radom variable X is distributed with the margial desity: >
More information1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series.
.3 Covergece Theorems of Fourier Series I this sectio, we preset the covergece of Fourier series. A ifiite sum is, by defiitio, a limit of partial sums, that is, a cos( kx) b si( kx) lim a cos( kx) b si(
More informationRandom Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A.
Radom Walks o Discrete ad Cotiuous Circles by Jeffrey S. Rosethal School of Mathematics, Uiversity of Miesota, Mieapolis, MN, U.S.A. 55455 (Appeared i Joural of Applied Probability 30 (1993), 780 789.)
More informationChandrasekhar Type Algorithms. for the Riccati Equation of Lainiotis Filter
Cotemporary Egieerig Scieces, Vol. 3, 00, o. 4, 900 Chadrasekhar ype Algorithms for the Riccati Equatio of Laiiotis Filter Nicholas Assimakis Departmet of Electroics echological Educatioal Istitute of
More informationECES352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations
ECES352 Itroductio to Digital Sigal Processig Lecture 3A Direct Solutio of Differece Equatios Discrete Time Systems Described by Differece Equatios Uit impulse (sample) respose h() of a DT system allows
More informationThe Method of Least Squares. To understand least squares fitting of data.
The Method of Least Squares KEY WORDS Curve fittig, least square GOAL To uderstad least squares fittig of data To uderstad the least squares solutio of icosistet systems of liear equatios 1 Motivatio Curve
More informationGoodnessofFit Tests and Categorical Data Analysis (Devore Chapter Fourteen)
GoodessofFit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH25201: Probability ad Statistics II Sprig 2019 Cotets 1 ChiSquared Tests with Kow Probabilities 1 1.1 ChiSquared Testig................
More informationComparison of Minimum Initial Capital with Investment and Noninvestment Discrete Time Surplus Processes
The 22 d Aual Meetig i Mathematics (AMM 207) Departmet of Mathematics, Faculty of Sciece Chiag Mai Uiversity, Chiag Mai, Thailad Compariso of Miimum Iitial Capital with Ivestmet ad ivestmet Discrete Time
More informationStatistical Inference Based on Extremum Estimators
T. Rotheberg Fall, 2007 Statistical Iferece Based o Extremum Estimators Itroductio Suppose 0, the true value of a pdimesioal parameter, is kow to lie i some subset S R p : Ofte we choose to estimate 0
More informationSample Size Estimation in the Proportional Hazards Model for Ksample or Regression Settings Scott S. Emerson, M.D., Ph.D.
ample ie Estimatio i the Proportioal Haards Model for Ksample or Regressio ettigs cott. Emerso, M.D., Ph.D. ample ie Formula for a Normally Distributed tatistic uppose a statistic is kow to be ormally
More informationStochastic Simulation
Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso
More informationSession 5. (1) Principal component analysis and KarhunenLoève transformation
200 Autum semester Patter Iformatio Processig Topic 2 Image compressio by orthogoal trasformatio Sessio 5 () Pricipal compoet aalysis ad KarhueLoève trasformatio Topic 2 of this course explais the image
More informationR. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State
Bayesia Cotrol Charts for the Twoparameter Expoetial Distributio if the Locatio Parameter Ca Take o Ay Value Betwee Mius Iity ad Plus Iity R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com
More informationVector Quantization: a Limiting Case of EM
. Itroductio & defiitios Assume that you are give a data set X = { x j }, j { 2,,, }, of d dimesioal vectors. The vector quatizatio (VQ) problem requires that we fid a set of prototype vectors Z = { z
More informationAppendix: The Laplace Transform
Appedix: The Laplace Trasform The Laplace trasform is a powerful method that ca be used to solve differetial equatio, ad other mathematical problems. Its stregth lies i the fact that it allows the trasformatio
More informationSubject: Differential Equations & Mathematical ModelingIII
Power Series Solutios of Differetial Equatios about Sigular poits Subject: Differetial Equatios & Mathematical ModeligIII Lesso: Power series solutios of differetial equatios about Sigular poits Lesso
More informationBasics of Probability Theory (for Theory of Computation courses)
Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.
More informationModeling and Performance Analysis with DiscreteEvent Simulation
Simulatio Modelig ad Performace Aalysis with DiscreteEvet Simulatio Chapter 5 Statistical Models i Simulatio Cotets Basic Probability Theory Cocepts Useful Statistical Models Discrete Distributios Cotiuous
More informationBayesian and E Bayesian Method of Estimation of Parameter of Rayleigh Distribution A Bayesian Approach under Linex Loss Function
Iteratioal Joural of Statistics ad Systems ISSN 9732675 Volume 12, Number 4 (217), pp. 791796 Research Idia Publicatios http://www.ripublicatio.com Bayesia ad E Bayesia Method of Estimatio of Parameter
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: YeChi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationLecture 33: Bootstrap
Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece
More informationJ. Stat. Appl. Pro. Lett. 2, No. 1, (2015) 15
J. Stat. Appl. Pro. Lett. 2, No. 1, 1522 2015 15 Joural of Statistics Applicatios & Probability Letters A Iteratioal Joural http://dx.doi.org/10.12785/jsapl/020102 Martigale Method for Rui Probabilityi
More informationEconomics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator
Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters
More informationSTA6938Logistic Regression Model
Dr. Yig Zhag STA6938Logistic Regressio Model Topic Simple (Uivariate) Logistic Regressio Model Outlies:. Itroductio. A ExampleDoes the liear regressio model always work? 3. Maximum Likelihood Curve
More informationProblem Set 2 Solutions
CS271 Radomess & Computatio, Sprig 2018 Problem Set 2 Solutios Poit totals are i the margi; the maximum total umber of poits was 52. 1. Probabilistic method for domiatig sets 6pts Pick a radom subset S
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More informationApproximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation
Metodološki zvezki, Vol. 13, No., 016, 117130 Approximate Cofidece Iterval for the Reciprocal of a Normal Mea with a Kow Coefficiet of Variatio Wararit Paichkitkosolkul 1 Abstract A approximate cofidece
More informationNotes on iteration and Newton s method. Iteration
Notes o iteratio ad Newto s method Iteratio Iteratio meas doig somethig over ad over. I our cotet, a iteratio is a sequece of umbers, vectors, fuctios, etc. geerated by a iteratio rule of the type 1 f
More information11 Correlation and Regression
11 Correlatio Regressio 11.1 Multivariate Data Ofte we look at data where several variables are recorded for the same idividuals or samplig uits. For example, at a coastal weather statio, we might record
More information5. Likelihood Ratio Tests
1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationCS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5
CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio
More informationDiscrete Mathematics and Probability Theory Fall 2013 Vazirani Note 15
CS 70 Discrete Mathematics ad Probability Theory Fall 2013 Vazirai Note 15 Some Importat Distributios I this ote we will itroduce three importat probability distributios that are widely used to model realworld
More informationRecursive Algorithms. Recurrences. Recursive Algorithms Analysis
Recursive Algorithms Recurreces Computer Sciece & Egieerig 35: Discrete Mathematics Christopher M Bourke cbourke@cseuledu A recursive algorithm is oe i which objects are defied i terms of other objects
More information(b) What is the probability that a particle reaches the upper boundary n before the lower boundary m?
MATH 529 The Boudary Problem The drukard s walk (or boudary problem) is oe of the most famous problems i the theory of radom walks. Oe versio of the problem is described as follows: Suppose a particle
More informationCHAPTER 8 FUNDAMENTAL SAMPLING DISTRIBUTIONS AND DATA DESCRIPTIONS. 8.1 Random Sampling. 8.2 Some Important Statistics
CHAPTER 8 FUNDAMENTAL SAMPLING DISTRIBUTIONS AND DATA DESCRIPTIONS 8.1 Radom Samplig The basic idea of the statistical iferece is that we are allowed to draw ifereces or coclusios about a populatio based
More informationDirection: This test is worth 250 points. You are required to complete this test within 50 minutes.
Term Test October 3, 003 Name Math 56 Studet Number Directio: This test is worth 50 poits. You are required to complete this test withi 50 miutes. I order to receive full credit, aswer each problem completely
More informationOptimization Methods MIT 2.098/6.255/ Final exam
Optimizatio Methods MIT 2.098/6.255/15.093 Fial exam Date Give: December 19th, 2006 P1. [30 pts] Classify the followig statemets as true or false. All aswers must be welljustified, either through a short
More informationThe Sample Variance Formula: A Detailed Study of an Old Controversy
The Sample Variace Formula: A Detailed Study of a Old Cotroversy Ky M. Vu PhD. AuLac Techologies Ic. c 00 Email: kymvu@aulactechologies.com Abstract The two biased ad ubiased formulae for the sample variace
More informationAAEC/ECON 5126 FINAL EXAM: SOLUTIONS
AAEC/ECON 5126 FINAL EXAM: SOLUTIONS SPRING 2015 / INSTRUCTOR: KLAUS MOELTNER This exam is opebook, opeotes, but please work strictly o your ow. Please make sure your ame is o every sheet you re hadig
More information