BOOTSTRAP BIAS CORRECTION IN SEMIPARAMETRIC ESTIMATION METHODS FOR ARFIMA MODELS
|
|
- Blake Gilmore
- 6 years ago
- Views:
Transcription
1 A pesquisa Operacioal e os Recursos Reováveis 4 a 7 de ovembro de 2003, Natal-RN BOOTSTRAP BIAS CORRECTION IN SEMIPARAMETRIC ESTIMATION METHODS FOR ARFIMA MODELS Glaura C. Fraco Depto. Estatística UFMG - Belo Horizote - MG glaura@est.ufmg.br Valdério A. Reise Depto. de Estatística - UFES, Av. Ferado Ferrari, s/, Goiabeiras, , valderio@cce.ufes.br Summary This paper compares the effect of bootstrap bias correctio for ivestigatig semiparametric estimatio of the fractioal parameter d i a particular case of log memory processes, i.e. for ARFIMA models with d i (0.0,0.5). The bootstrap techiques studied here are the local bootstrap, the bootstrap i the residuals of the frequecy-domai regressio equatio ad the well-kow parametric ad oparametric bootstrap i the residuals of the fitted model (Fraco ad Reise, 2003). Through simulatio, these bootstrap methods are compared, based o the mea ad the mea square error of the estimators, ad the bootstrap bias correctio proposed by Efro ad Tibshirai (993) is evaluated. Keywords: Semiparametric procedures, Fractioally itegrated ARMA process, Bootstrap i the residuals, Local Bootstrap, Bias correctio. Itroductio Methods for estimatig d i a log memory process are available usig several procedures, beig the semiparametric methods very easy to be implemeted. The methods i this class are called semiparametric i the sese that the spectral desity is parameterised oly withi a eighbourhood of zero frequecy. Also, to obtai the estimates these methods do ot require the full specificatios of the spectral desity of the process, icludig ARMA compoets. The most popular is the oe proposed by Geweke ad Porter-Hudak (983), hereafter deoted by GPH. The GPH estimator is obtaied through the regressio equatio of the spectral desity of the process. Followig the same idea, Reise (994) (hereafter called by SPR) suggested the regressio estimator based o the smoothed periodogram fuctio. Robiso (995) established the asymptotic distributioal properties of a modified form of the GPH estimator. I a differet cotext of the regressio methods, Robiso (994) preseted a semiparametric method based o the average of the periodogram fuctio. This method, deoted here by LBR, was also ivestigated by Lobato ad Robiso (996), who described the limitig distributio of LBR ad also provided a study for this estimator. The bootstrap techique (Efro, 979) is geerally accepted as a powerful tool for approximatig certai characteristics (for example, bias ad variace, or the distributio of the estimators that caot at all or oly with excessive effort be calculated by aalytical meas). Bootstrappig time series data has received cosiderable iterest i recet years ad it is ot straightforward to implemet, as the observatios are usually ot idepedet. I the time domai, a alterative is to bootstrap the residuals if the model is correctly specified. This approach is usually called oparametric bootstrap ad it is completely model depedet, sice the residuals will be approximately idepedet if the corrected model is used. The parametric
2 bootstrap is aother possibility i the time domai. I this situatio the data geeratig process of the time series should be kow, ad the residuals are resampled from this distributio, with the parameters estimated from the sample. Recet works o bootstrappig time series i the frequecy domai have provided a cosiderable cotributio o the subect. Amog them is the paper by Paparoditis ad Politis (999), which follows the local bootstrap idea of Shi (99), i which the author proposes drawig samples from a eighbourhood of each data poit. Paparoditis ad Politis (999) suggest a simple ad direct way of bootstrappig the periodogram ad give the asymptotic properties of this procedure applied to several classes of periodogrambased statistics. A alterative bootstrap method based o the residuals obtaied through the regressio of the spectral desity of the process is also used i this work. For a compariso of the bootstrap procedures metioed above, see Fraco ad Reise (2003). The mai goal of our simulatio study is to evaluate the bias i the estimatio of d, obtaied through the bootstrap techiques ad to use this measure to correct the origial estimatives i the way proposed by Efro ad Tibshirai (993). The pla of the paper is as follows. Sectio 2 briefly itroduces the ARFIMA model ad the estimates of d. Sectio 3 describes the bootstrappig procedures ad the bootstrap bias crrectio. Simulatio results are preseted i Sectio 4 ad some coclusio remarks are reported i Sectio 5. 2 The Model ad the Estimates of the Log Memory Parameter x be a statioary ARFIMA process defied by Let { t } t = where φ ( B) ad ( B) d ( B)( B) x t ( B) ε t φ = θ () θ are the polyomials of order p ad q, respectively, with all roots outside the uit circle ad B is the backshift operator defied by B X t = X t-. ε t is a White Noise process 2 Normally distributed with zero mea ad fiite variace σ ε ad ( B) d is the fractioal d 0.5; 0.5 the process defied i () is statioary ad ivertible differecig operator. For ( ) ad its spectral desity, f ( ω ), is give by 2d ( ω ) = f u ( ω )( 2si( ω / 2) ), ω [ π, π ] f (2) d where the fuctio f u ( ω ) is the spectral desity of the ARMA(p,q) process ut ( B) xt =. A more detailed descriptio of ARFIMA models ca be foud i Hoskig (98) ad Reise (994). A class of semiparametric estimators for d may be obtaied takig the logarithm of the spectral desity (2), l f ( ω ), which approximates a regressio equatio, havig the spectral desity as the depedet variable l ( ω ) ( 0). 2 fu f ( ω ) = l fu ( 0) d l( 2si( ω / 2) ) + l (3) fu 727
3 We cosider two estimators derived from the regressio equatio (3). The first oe was iitially proposed by Geweke ad Porter-Hudak (983) (GPH), ad uses a estimate of the spectral ω I ω, give by desity f ( ), the periodogram fuctio, ( ) ( ) = ( ) + I ω R 0 2 R( k) cos( kω ) (4) 2π k= where R(.) deotes the sample autocovariace of x t ad is the sample size. The GPH estimator is obtaied through the regressio equatio betwee l I(ω ) ad l(2si(ω /2)) 2. The secod oe, the smoothed periodogram estimator (SPR), was proposed by Reise (994). I this case, the estimate of the spectral desity is give by the smoothed periodogram fuctio, f sp (ω ): where ( k) ( ) fsp ω = λ( k) R( k) cos( kω ) (5) 2π k= ( ) λ is give by the Parze lag widow λ ( k) = 6 k m 3 k 2 m 2 3 k + 6 m 0,,, m / 2 < k > m k m / 2 k < m β where m =, 0 < β < (see, for example, Reise (994)). The SPR estimator is obtaied through the regressio equatio betwee l f sp (ω ) ad l (2si(ω /2)) 2. I both methods the umber of observatios i the regressio equatio (the badwidth) is a fuctio of the sample g =, with 0.0 α. 0. size, i.e. ( ) α The third semiparametric estimator cosidered hereby is the oe proposed by Robiso (994) (LBR). This estimator is the weighted averages of the ulogged periodogram based o the umber of frequecies, the badwidthτ, ad a costat q (0.0,.0). The estimator is Fˆ ( qωτ ) LBR ( q) = 0.5 log 2 log ˆ (6 ) q F( ωτ ) [ / 2π ] where ˆ 2π ωτ F( ωτ ) = I( ω ) ad [.] meas the iteger part. Our choices of τ = α ad = q=0.5 are based o the work by Lobato ad Robiso (996). They ivestigated through simulatio the fiite sample distributio of LBR ad the sesitivity of quatitiesτ ad q. 728
4 3 Bootstrap methods ad bootstrap estimate of bias I time series there are two ways of performig the bootstrap: the bootstrap i the residuals of the fitted model ad the movig blocks bootstrap. Refereces for the first approach iclude Stoffer ad Wall (99), Fraco ad Souza (2002), amog others. The secod method is cosidered i Kusch (989) ad Politis ad Romao (994) ad refereces therei. It is well-kow that the mai difficulty i the use of the movig block approach is to specify the appropriate choice of the block size to obtai series approximately ucorrelated. Also, we believe this gets harder i log memory process because the observatios are correlated for a log period of time. Due to these facts the movig block is ot cosidered i our study. However, we still thik it is a iterestig topic to be ivestigated for those iterested i the area. I this work, for the estimatio of the fractioal parameter, other classes of bootstrap methods are proposed ad compared with the bootstrap i the residuals of the fitted model. The first oe (BOOT-LOCAL) is the local bootstrap applied to the GPH, SPR ad LBR estimatio methods. I the secod approach (BOOT-REG) the bootstrap is performed i the residuals of the regressio equatio of GPH ad SPR procedures. Let x t, t =,..., be a observed part of a stochastic process. The bootstrap methods are summarised below. 3. The local bootstrap (BOOT-LOCAL) The local bootstrap is based o the asymptotic idepedece of the ordiates of the periodogram fuctio. The term "local" refers to the way the resamplig is doe. Assumig that the spectral desity f ( ω ) is a smooth fuctio of ω, the periodogram replicates ca be obtaied locally, that is, samplig the respective frequecies that are i a small eighbourhood of the frequecy ω of iterest. This procedure does ot require iitial estimatio of the ukow spectral desity to obtai frequecy domai residuals. Let I ( ),, =, L, N ω, where N = [ / 2] be the periodogram ordiates of { x } t. The local bootstrap procedure, as show i Paparoditis ad Politis (999), is summarized as follows:. Select a resamplig width κ where κ N ad κ [ N / 2]. 2. Defie i.i.d. discrete radom variables S,..., S N takig values i the set { 0, ±, L,±κ }. 3. Each oe of the 2 κ + ordiates ca be resampled with probability p κ, s 4. The bootstrap periodogram is the defied by I I I = 2κ + ( ω ) I ( ω ), =,2, L, [ / 2] = + S ( ω ) = I( ω ), ( ω ) = 0, ω = 0 ω < 0 729
5 The asymptotic validity of the local bootstrap is give i Paparoditis ad Politis (999). The choice of the resamplig width κ, i the case of a fiite sample size, deserves some precautios. Paparoditis ad Politis (999) show that, give a appropriate choice of p κ, s as a ~ Kerel estimator of f ( ω ), κ ca be chose by miimizig the mea square error of f ( ω ), I ω. the expected value of ( ) I particular, takig pκ, s = ( 2κ + ) for ay particular poit ω, a "optimal" resamplig width κ, ca be obtaied from / / 5 9 f ( ω ) κ, = (7) 4{ ( 2 ) 2 8π f ( ω )} assumig that ( 2 ) ( ) 0 f ω (see Paparoditis ad Politis (999) for more details). I our simulatio exercise, the local bootstrap is performed by cosiderig the simplest case of p κ, s, which is give above, ad the method will be used i the fractioal parameter estimatio procedure where a estimate of the spectral desity is required. I the regressio estimators GPH ad SPR the local bootstrap will be applied i equatio (3) to resample I(ω ) ad f sp (ω ) to obtai the respective bootstrap estimates. I the LBR method, this bootstrap Fˆ. procedure will be cosidered by resamplig I(ω ) to obtai ( ) As far as the authors are cocered, the use of the above bootstrap techique to resample I(ω ) i the GPH ad LBR methods ad f sp (ω ) i the SPR has ever bee doe previously. Thus, it is proposed i this work as a alterative bootstrap method to deal with the semiparametric fractioal estimator approaches cosidered here. 3.2 Bootstrap i the residuals of the regressio equatio (BOOT-REG) I this case, the bootstrap is performed i the residuals obtaied from the approximated regressio equatio (3). The procedure is summarized as follows: The equatio (3) may be writte as where y 2 ( 2si( ω / 2 ) + ε = A d l (8) 2π g ω =, with =,2,..., g( ) ad g( ) is chose such as 0 as. For the GPH method we have I ( ω ) y = l( I ( ω ), ε = l = ε GPH, f ( ω ) ad for the Reise (994) estimator, ( ) 730
6 y = l ( f ( ) sp where l( f ( 0) ) ( ω ) ε SPR, ( ω ) f sp ω, ε = l = f A = u is a costat (see equatio (3)). The above errors are asymptotically idepedet ad idetically distributed (see, for example, Reise (994) for more details). Thus, sice the umber of observatios ivolved i the regressio equatio is a fuctio of the frequecies, the oparametric bootstrap i the frequecy domai ca be applied i the ε GPH, ε, so that the bootstrap series i the case of the GPH method, ( ) ad SPR, calculated as ad for the SPR method 2 ( ) = A dˆ l( 2si( ω / 2 ) e l I ω ca be ω p GPH, (9) l I + l 2 ( ) = A dˆ l( 2si( ω / 2 ) e sp ω sp SPR, (0) f + where e i,, i = GPH or SPR, are the residual bootstrap estimates ad all the terms without a star are kept fixed. It is well-kow that the residuals i the regressio equatios are oly asymptotically idepedet whe usig both estimates of f ( ω ), the periodogram ad the smoothed periodogram fuctios. This could ivalidate the use of the bootstrap techique i the regressio equatios (9) ad (0). However, as we will observe from the results of the simulatios, the bootstrap i the residuals of the regressio model has led to results very close to the simulatios, especially whe compared to the bootstrap o the residuals of the fitted model. Thus, i spite of this, we strogly believe i the ability of this kid of bootstrap to estimate the bias of the fractioal d i log memory processes. 3.3 Noparametric bootstrap i the residuals of the fitted model (BOOTNP-) The estimated residuals of the ARFIMA model, e t, are calculated by e t ˆ ˆ θ () = φ d ( B) ˆ( B)( B) xt which are supposed to be i.i.d. The oparametric bootstrap cosists of resamplig these residuals with replacemet, so that the bootstrap series x t ca be costructed as where e t is the residual bootstrap series. x ˆ ˆ d ( )( ) ˆ t = φ B B θ ( B) et (2) 73
7 Note that ˆd, φˆ ad θˆ are kept fixed durig the bootstrap replicatios, i.e., they are treated as the true populatio parameters. This method is called oparametric bootstrap, sice the distributio of the residuals is ot specified. 3.4 Parametric bootstrap i the residuals of the fitted model (BOOTPA-) The parametric bootstrap i the residuals of the fitted model (equatio ()) is aother way of performig the bootstrap i time series. The procedure is very similar to the BOOTNP-, but ow the distributio of the residuals is supposed to be kow. Hece, the samplig will be doe from the distributio that geerated the residuals with the parameters estimated from the origial series. A good review of both BOOTNP- ad BOOTPA- may be foud i Efro ad Tibshirai (993) ad Daviso ad Hikley (997). It should be oted that, i these last two approaches, we have made the assumptio that the true model was kow ad oly the parameters eeded to be estimated. Although this is ot realistic i practice, Smith et al. (997) show that the bias estimates of d may cause the choice of a icorrect ARFIMA specificatio by the model selectio criterio. Cosequetly, the errors will ot be idepedet, which may cause some problems whe applyig these bootstrap techiques. 3.5 Bootstrap estimate of bias The bootstrap estimate of bias is obtaied, accordig to Efro ad Tibshirai (993), by Bias ˆ = dˆ where ˆd is the estimate of d obtaied i the bootstrap replicatios ad dˆ is the estimate of d from the simulated series. Thus, the bias correctio ca be performed i the followig way dˆ d ˆ Corr = d ˆ Bias. 4 Simulatio Results All simulated ARFIMA time series throughout the paper were geerated via the algorithm suggested by Hoskig (984) for sample sizes = 00 ad 300, d = 0.2 ad three differet values of φ. The radom umbers N(0,) were obtaied by the subroutie RNNOR from the IMSL-FORTRAN. The umber of bootstrap ad replicatios were set equal to 000. The badwidth values of the GPH ad SPR methods were fixed for α = 0.5 ad 0.8. The trucatio poit β i the lag Parze widow, for the smoothed periodogram fuctio, was chose equal to 0.9 (see Reise (994) for more details). The tables preset the simulatio results of the mea ad the mea square error (mse) of the estimators of d, based o the ad Bootstrap methods. I the tables 4. ad 4.2 oe fids the results for ARFIMA (,d,0) models with d = 0.2 ad φ = 0.0, ± 0.2. I the colums uder the title Origi are preseted the results for the bootstrap before a bias correctio is performed. The values i bold face i this colum are the oes closer to the results. Uder the title Correc are the results after the bias correctio. The values i bold face i this colum are the oes closer to the real value d = 0.2 The results before the bias correctio (uder the colum Origi ) were already aalysed i aother work (Fraco ad Reise, 2003) ad the mai coclusios were that the bootstrap i the 732
8 regressio equatio (BOOT-REG) outperforms the other bootstrap approaches by presetig mea ad mse values very close to the method, except i the LBR estimates where this bootstrap techique caot be applied. Comparig the BOOT-LOCAL with the BOOTNP- ad the BOOTPA-, the first oe is superior showig closer values to those obtaied by the. As should be expected, for series of size = 300 the estimates are closer to the true value ad the MSE values are smaller compared to series of size = 00. After the bias correctio is performed, we ca draw the followig coclusios: For GPH, the estimates are very close to the real value of the parameter d = 0.2, thus BOOT-REG is the better bootstrap method to perform the bias correctio, as it has give the best performaces before the correctios. The exceptio occurs for φ = 0.2, where the BOOTNP- ad BOOTPA- show the best performaces. For the SPR estimator a iterestig fact happes. Although the BOOT-REG gives very close approximatios to the simulatios, the bias corrected estimates for BOOTNP- ad BOOTPA- are much closer to the real value of d = 0.2. This occurs because the differece from the bootstrap to the estimates compesates the differeces from the to the real value of d. For this estimator the bias correctio shows a real gai, as the results, usig BOOTNP- ad BOOTPA-, are closer to 0.2 tha the. Besides, the mse for the bootstrap bias corrected estimates is eve smaller tha it was for the origial estimates. The same happes to LBR, although for this method the estimates are much far from the real value d = 0.2, but they are still better tha the ad the origial bootstrap estimates, uless for φ = 0.2 It ca be oticed also that, i geeral, a bias correctio ca approximate reasoably the real value of d i all of the estimatio methods studied here. 733
9 GPH SPR LBR.209 (.053).754 (.00).527 (.0470) Origi Correc Origi Correc Origi Correc (.0673) (.046) (.028) (.0098) (.059) (.040) (.0673) (.046) (.029) (.0097) (.059) (.040) (.052) (.0535) (.00) (.03) (.0479) (.0486) (.053) (.0) (.0) (.0470) (.0470) Table 4. - Mea ad mse values for ARFIMA(,d,0) models ( = 00, d = 0.2) φ (.082).200 (.062).2283 (.089) Origi Correc Origi Correc Origi Correc BOOTNP-.279 (.0985).77 (.0686).24 (.080).906 (.047).255 (.0994).204 (.0699) BOOTPA-.283 (.0987).73 (.0684).28 (.08).902 (.046).2559 (.0999).2007 (.0696) BOOT- LOCAL.200 (.0788).894 (.03).2002 (.06).208 (.072).2365 (.0798).220 (.03) BOOT-REG (.08) (.085) (.062) (.062) (.087) (.082) BOOTNP- BOOTPA- BOOT- LOCAL BOOT-REG.20 (.053).073 (.0466).52 (.0096).324 (.0388) Origi Correc Origi Correc Origi Correc BOOTNP (.0600).237 (.5).0822 (.0397).222 (.0460).768 (.0028).0880 (.448) BOOTPA (.060).238 (.56).0824 (.0397).229 (.0459).770 (.0028).0878 (.453) BOOT LOCAL (.0433) (.0603) (.000) (.0098) (.0353) (.0523) Note: Numbers i brackets are the mse 734
10 Table Mea ad mse values for ARFIMA(,d,0) models ( = 300, d = 0.2) φ Origi Correc Origi Correc Origi Correc.938 (.0384).204 (.0057).209 (.0360) BOOTNP (.0272).868 (.089).2003 (.0034).2025 (.0027).235 (.0250).903 (.076) GPH BOOTPA (.0274).969 (.090).2002 (.0034).2026 (.0023).238 (.0252).900 (.075) BOOT LOCAL (.0386) BOOT-REG.938 (.0384) (.0505).938 (.0385) (.0058).202 (.0057) (.0062).206 (.0057) (.0364).209 (.036) (.0470).209 (.0363) SPR.465 (.0274) BOOTNP (.0228) (.04) BOOTPA (.0229) (.04) BOOT LOCAL (.0275) (.0287) BOOT-REG (.0274) (.0274).883 (.0040) (.003) (.0024) (.003) (.0024) (.0040) (.004) (.0040) (.0040).590 (.025) (.077) (.023) (.077) (.023) (.0253) (.0257) (.025) (.025) LBR.03 (.0332).77 (.0040) BOOTNP (.027) (.0682) (.0047) (.0054) BOOTPA (.0272) (.0686) (.0047) (.0054) BOOT LOCAL (.0340) (.0473) (.0042) (.004) Note: Numbers i brackets are the mse.38 (.0293) (.008) (.093) (.009) (.0986) (.033) (.0464) 5. Coclusios We show i this work that a bootstrap bias correctio for the semiparametric estimates of parameter d i ARFIMA(,d,0) models ca be a alterative to obtai better estimates for this parameter. For GPH, the BOOT-REG is the better bootstrap method to perform the bias correctio, as it has give the best performaces before the correctios. For the SPR, the bias corrected estimates for BOOTNP- ad BOOTPA- are much closer to the real value d = 0.2 ad we have a substacial gai, as the results are closer to 0.2 tha the. The same happes to LBR, although for this method the estimates are much far from the real value d = 0.2. It ca be oticed also that, i geeral, a bias correctio ca approximate reasoably the real value of d i all of the estimatio methods studied here. 735
11 Refereces Daviso, A.C. ad Hikley, D.V. (997), Bootstrap Methods ad their Applicatio. Cambridge: Cambridge Uiversity Press. Efro, B. (979), Bootstrap methods: aother look at the Jackkife. The Aals of Statistics, 7, -26. Efro, B. ad Tibshirai, R. (993), A itroductio to the bootstrap. New York: Chapma ad Hall. Fraco, G.C ad Reise, V.A. (2003), Bootstrap Techiques i Semiparametric Estimatio Methods for ARFIMA Models: A Compariso Study, Computatioal Statistics. To appear. Fraco, G.C ad Souza, R.C. (2002), A compariso of methods for bootstrappig i the local level model, Joural of Forecastig, 2, Geweke, J. ad Porter-Hudak, S. (983), The estimatio ad applicatio of log memory time series model. Joural of Time Series Aalysis, 4(4), Hoskig, J. (98), Fractioal differecig. Biometrika, 68(), Hoskig, J. (984), Modellig persistece i hydrological time series usig fractioal differecig. Water Resources Research, 20(2), Kusch, H.R. (989), The ackkife ad the bootstrap for geeral statioary observatios. The Aals of Statistics, 7, Lobato, I. ad Robiso, P. M. (996), Averaged periodogram estimatio of log Memory. Joural of Ecoometrics, 73, Paparoditis, E. ad Politis, D.N. (999), The local bootstrap for periodogram statistics. Joural of Time Series Aalysis, 20(2), Politis, D.N. ad Romao, J.R. (994), The statioary bootstrap. Joural of the America Statistical Associatio. 89, Reise, V.A. (994), Estimatio of the fractioal differece parameter i the ARIMA(p,d,q) model usig the smoothed periodogram. Joural of Time Series Aalysis, 5(3), Robiso, P.M. (994), Semiparametric aalysis of log-memory time series. The Aals of Statistics. 22(), Robiso, P.M. (995), Log-periodogram regressio of time series with log rage depedece. The Aals of Statistics, 23(3), Shi, S.G. (99), Local bootstrap. A. Ist. Stat. Math., 43, Smith, J., Taylor, N. ad Yadav, S. (997), Comparig the bias ad misspecificatio i ARFIMA models. Joural of Time Series Aalysis, 8(5), Stoffer, D.S. ad Wall, K.D. (99), Bootstrappig state-space models: gaussia maximum likelihood estimatio ad the Kalma filter. Joural of the America Statistical Associatio, 86,
Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationIt should be unbiased, or approximately unbiased. Variance of the variance estimator should be small. That is, the variance estimator is stable.
Chapter 10 Variace Estimatio 10.1 Itroductio Variace estimatio is a importat practical problem i survey samplig. Variace estimates are used i two purposes. Oe is the aalytic purpose such as costructig
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationInvestigating the Significance of a Correlation Coefficient using Jackknife Estimates
Iteratioal Joural of Scieces: Basic ad Applied Research (IJSBAR) ISSN 2307-4531 (Prit & Olie) http://gssrr.org/idex.php?joural=jouralofbasicadapplied ---------------------------------------------------------------------------------------------------------------------------
More informationDouble Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution
Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.
More information3 Resampling Methods: The Jackknife
3 Resamplig Methods: The Jackkife 3.1 Itroductio I this sectio, much of the cotet is a summary of material from Efro ad Tibshirai (1993) ad Maly (2007). Here are several useful referece texts o resamplig
More informationA goodness-of-fit test based on the empirical characteristic function and a comparison of tests for normality
A goodess-of-fit test based o the empirical characteristic fuctio ad a compariso of tests for ormality J. Marti va Zyl Departmet of Mathematical Statistics ad Actuarial Sciece, Uiversity of the Free State,
More informationLecture 33: Bootstrap
Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece
More informationStudy the bias (due to the nite dimensional approximation) and variance of the estimators
2 Series Methods 2. Geeral Approach A model has parameters (; ) where is ite-dimesioal ad is oparametric. (Sometimes, there is o :) We will focus o regressio. The fuctio is approximated by a series a ite
More informationA Note on Box-Cox Quantile Regression Estimation of the Parameters of the Generalized Pareto Distribution
A Note o Box-Cox Quatile Regressio Estimatio of the Parameters of the Geeralized Pareto Distributio JM va Zyl Abstract: Makig use of the quatile equatio, Box-Cox regressio ad Laplace distributed disturbaces,
More informationSimulation. Two Rule For Inverting A Distribution Function
Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationBasis for simulation techniques
Basis for simulatio techiques M. Veeraraghava, March 7, 004 Estimatio is based o a collectio of experimetal outcomes, x, x,, x, where each experimetal outcome is a value of a radom variable. x i. Defiitios
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationStochastic Simulation
Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso
More informationA General Family of Estimators for Estimating Population Variance Using Known Value of Some Population Parameter(s)
Rajesh Sigh, Pakaj Chauha, Nirmala Sawa School of Statistics, DAVV, Idore (M.P.), Idia Floreti Smaradache Uiversity of New Meico, USA A Geeral Family of Estimators for Estimatig Populatio Variace Usig
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More informationL = n i, i=1. dp p n 1
Exchageable sequeces ad probabilities for probabilities 1996; modified 98 5 21 to add material o mutual iformatio; modified 98 7 21 to add Heath-Sudderth proof of de Fietti represetatio; modified 99 11
More informationBecause it tests for differences between multiple pairs of means in one test, it is called an omnibus test.
Math 308 Sprig 018 Classes 19 ad 0: Aalysis of Variace (ANOVA) Page 1 of 6 Itroductio ANOVA is a statistical procedure for determiig whether three or more sample meas were draw from populatios with equal
More informationInformation-based Feature Selection
Iformatio-based Feature Selectio Farza Faria, Abbas Kazeroui, Afshi Babveyh Email: {faria,abbask,afshib}@staford.edu 1 Itroductio Feature selectio is a topic of great iterest i applicatios dealig with
More informationON POINTWISE BINOMIAL APPROXIMATION
Iteratioal Joural of Pure ad Applied Mathematics Volume 71 No. 1 2011, 57-66 ON POINTWISE BINOMIAL APPROXIMATION BY w-functions K. Teerapabolar 1, P. Wogkasem 2 Departmet of Mathematics Faculty of Sciece
More information1 Inferential Methods for Correlation and Regression Analysis
1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet
More informationOrthogonal Gaussian Filters for Signal Processing
Orthogoal Gaussia Filters for Sigal Processig Mark Mackezie ad Kiet Tieu Mechaical Egieerig Uiversity of Wollogog.S.W. Australia Abstract A Gaussia filter usig the Hermite orthoormal series of fuctios
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More informationDS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10
DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set
More informationLecture 7: Density Estimation: k-nearest Neighbor and Basis Approach
STAT 425: Itroductio to Noparametric Statistics Witer 28 Lecture 7: Desity Estimatio: k-nearest Neighbor ad Basis Approach Istructor: Ye-Chi Che Referece: Sectio 8.4 of All of Noparametric Statistics.
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationThere is no straightforward approach for choosing the warmup period l.
B. Maddah INDE 504 Discrete-Evet Simulatio Output Aalysis () Statistical Aalysis for Steady-State Parameters I a otermiatig simulatio, the iterest is i estimatig the log ru steady state measures of performace.
More informationTHE DATA-BASED CHOICE OF BANDWIDTH FOR KERNEL QUANTILE ESTIMATOR OF VAR
Iteratioal Joural of Iovative Maagemet, Iformatio & Productio ISME Iteratioal c2013 ISSN 2185-5439 Volume 4, Number 1, Jue 2013 PP. 17-24 THE DATA-BASED CHOICE OF BANDWIDTH FOR KERNEL QUANTILE ESTIMATOR
More informationEstimation of the Mean and the ACVF
Chapter 5 Estimatio of the Mea ad the ACVF A statioary process {X t } is characterized by its mea ad its autocovariace fuctio γ ), ad so by the autocorrelatio fuctio ρ ) I this chapter we preset the estimators
More informationGoodness-Of-Fit For The Generalized Exponential Distribution. Abstract
Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated
More information4.5 Multiple Imputation
45 ultiple Imputatio Itroductio Assume a parametric model: y fy x; θ We are iterested i makig iferece about θ I Bayesia approach, we wat to make iferece about θ from fθ x, y = πθfy x, θ πθfy x, θdθ where
More informationA Risk Comparison of Ordinary Least Squares vs Ridge Regression
Joural of Machie Learig Research 14 (2013) 1505-1511 Submitted 5/12; Revised 3/13; Published 6/13 A Risk Compariso of Ordiary Least Squares vs Ridge Regressio Paramveer S. Dhillo Departmet of Computer
More informationModule 1 Fundamentals in statistics
Normal Distributio Repeated observatios that differ because of experimetal error ofte vary about some cetral value i a roughly symmetrical distributio i which small deviatios occur much more frequetly
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationTHE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS
R775 Philips Res. Repts 26,414-423, 1971' THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS by H. W. HANNEMAN Abstract Usig the law of propagatio of errors, approximated
More information11 Correlation and Regression
11 Correlatio Regressio 11.1 Multivariate Data Ofte we look at data where several variables are recorded for the same idividuals or samplig uits. For example, at a coastal weather statio, we might record
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationResampling modifications for the Bagai test
Joural of the Korea Data & Iformatio Sciece Society 2018, 29(2), 485 499 http://dx.doi.org/10.7465/jkdi.2018.29.2.485 한국데이터정보과학회지 Resamplig modificatios for the Bagai test Youg Mi Kim 1 Hyug-Tae Ha 2 1
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More informationBayesian Methods: Introduction to Multi-parameter Models
Bayesia Methods: Itroductio to Multi-parameter Models Parameter: θ = ( θ, θ) Give Likelihood p(y θ) ad prior p(θ ), the posterior p proportioal to p(y θ) x p(θ ) Margial posterior ( θ, θ y) is Iterested
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationConfidence Interval for Standard Deviation of Normal Distribution with Known Coefficients of Variation
Cofidece Iterval for tadard Deviatio of Normal Distributio with Kow Coefficiets of Variatio uparat Niwitpog Departmet of Applied tatistics, Faculty of Applied ciece Kig Mogkut s Uiversity of Techology
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More informationElement sampling: Part 2
Chapter 4 Elemet samplig: Part 2 4.1 Itroductio We ow cosider uequal probability samplig desigs which is very popular i practice. I the uequal probability samplig, we ca improve the efficiecy of the resultig
More informationECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More informationNumber of fatalities X Sunday 4 Monday 6 Tuesday 2 Wednesday 0 Thursday 3 Friday 5 Saturday 8 Total 28. Day
LECTURE # 8 Mea Deviatio, Stadard Deviatio ad Variace & Coefficiet of variatio Mea Deviatio Stadard Deviatio ad Variace Coefficiet of variatio First, we will discuss it for the case of raw data, ad the
More informationPOWER COMPARISON OF EMPIRICAL LIKELIHOOD RATIO TESTS: SMALL SAMPLE PROPERTIES THROUGH MONTE CARLO STUDIES*
Kobe Uiversity Ecoomic Review 50(2004) 3 POWER COMPARISON OF EMPIRICAL LIKELIHOOD RATIO TESTS: SMALL SAMPLE PROPERTIES THROUGH MONTE CARLO STUDIES* By HISASHI TANIZAKI There are various kids of oparametric
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationFirst Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise
First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >
More informationKernel density estimator
Jauary, 07 NONPARAMETRIC ERNEL DENSITY ESTIMATION I this lecture, we discuss kerel estimatio of probability desity fuctios PDF Noparametric desity estimatio is oe of the cetral problems i statistics I
More informationChapter 6 Sampling Distributions
Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to
More informationG. R. Pasha Department of Statistics Bahauddin Zakariya University Multan, Pakistan
Deviatio of the Variaces of Classical Estimators ad Negative Iteger Momet Estimator from Miimum Variace Boud with Referece to Maxwell Distributio G. R. Pasha Departmet of Statistics Bahauddi Zakariya Uiversity
More informationComparison of Minimum Initial Capital with Investment and Non-investment Discrete Time Surplus Processes
The 22 d Aual Meetig i Mathematics (AMM 207) Departmet of Mathematics, Faculty of Sciece Chiag Mai Uiversity, Chiag Mai, Thailad Compariso of Miimum Iitial Capital with Ivestmet ad -ivestmet Discrete Time
More informationProvläsningsexemplar / Preview TECHNICAL REPORT INTERNATIONAL SPECIAL COMMITTEE ON RADIO INTERFERENCE
TECHNICAL REPORT CISPR 16-4-3 2004 AMENDMENT 1 2006-10 INTERNATIONAL SPECIAL COMMITTEE ON RADIO INTERFERENCE Amedmet 1 Specificatio for radio disturbace ad immuity measurig apparatus ad methods Part 4-3:
More informationPrecise Rates in Complete Moment Convergence for Negatively Associated Sequences
Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo
More informationStatistical and Mathematical Methods DS-GA 1002 December 8, Sample Final Problems Solutions
Statistical ad Mathematical Methods DS-GA 00 December 8, 05. Short questios Sample Fial Problems Solutios a. Ax b has a solutio if b is i the rage of A. The dimesio of the rage of A is because A has liearly-idepedet
More informationInvestigating a new estimator of the serial correlation coefficient
Ivestigatig a ew estimator of the serial correlatio coefficiet Mafred Mudelsee Istitute of Mathematics ad Statistics Uiversity of Ket at Caterbury Caterbury Ket CT2 7NF Uited Kigdom 8 May 1998 1 Abstract
More informationMATH/STAT 352: Lecture 15
MATH/STAT 352: Lecture 15 Sectios 5.2 ad 5.3. Large sample CI for a proportio ad small sample CI for a mea. 1 5.2: Cofidece Iterval for a Proportio Estimatig proportio of successes i a biomial experimet
More information4.3 Growth Rates of Solutions to Recurrences
4.3. GROWTH RATES OF SOLUTIONS TO RECURRENCES 81 4.3 Growth Rates of Solutios to Recurreces 4.3.1 Divide ad Coquer Algorithms Oe of the most basic ad powerful algorithmic techiques is divide ad coquer.
More informationCS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5
CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio
More informationQuantile regression with multilayer perceptrons.
Quatile regressio with multilayer perceptros. S.-F. Dimby ad J. Rykiewicz Uiversite Paris 1 - SAMM 90 Rue de Tolbiac, 75013 Paris - Frace Abstract. We cosider oliear quatile regressio ivolvig multilayer
More information5. Fractional Hot deck Imputation
5. Fractioal Hot deck Imputatio Itroductio Suppose that we are iterested i estimatig θ EY or eve θ 2 P ry < c where y fy x where x is always observed ad y is subject to missigess. Assume MAR i the sese
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More informationStatistical Analysis on Uncertainty for Autocorrelated Measurements and its Applications to Key Comparisons
Statistical Aalysis o Ucertaity for Autocorrelated Measuremets ad its Applicatios to Key Comparisos Nie Fa Zhag Natioal Istitute of Stadards ad Techology Gaithersburg, MD 0899, USA Outlies. Itroductio.
More informationKolmogorov-Smirnov type Tests for Local Gaussianity in High-Frequency Data
Proceedigs 59th ISI World Statistics Cogress, 5-30 August 013, Hog Kog (Sessio STS046) p.09 Kolmogorov-Smirov type Tests for Local Gaussiaity i High-Frequecy Data George Tauche, Duke Uiversity Viktor Todorov,
More informationIntroduction to Machine Learning DIS10
CS 189 Fall 017 Itroductio to Machie Learig DIS10 1 Fu with Lagrage Multipliers (a) Miimize the fuctio such that f (x,y) = x + y x + y = 3. Solutio: The Lagragia is: L(x,y,λ) = x + y + λ(x + y 3) Takig
More informationARIMA Models. Dan Saunders. y t = φy t 1 + ɛ t
ARIMA Models Da Sauders I will discuss models with a depedet variable y t, a potetially edogeous error term ɛ t, ad a exogeous error term η t, each with a subscript t deotig time. With just these three
More informationBootstrap Intervals of the Parameters of Lognormal Distribution Using Power Rule Model and Accelerated Life Tests
Joural of Moder Applied Statistical Methods Volume 5 Issue Article --5 Bootstrap Itervals of the Parameters of Logormal Distributio Usig Power Rule Model ad Accelerated Life Tests Mohammed Al-Ha Ebrahem
More informationA NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES. Dennis D. Boos
.- A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES by Deis D. Boos Departmet of Statistics North Carolia State Uiversity Istitute of Statistics Mimeo Series #1198 September,
More informationUnderstanding Samples
1 Will Moroe CS 109 Samplig ad Bootstrappig Lecture Notes #17 August 2, 2017 Based o a hadout by Chris Piech I this chapter we are goig to talk about statistics calculated o samples from a populatio. We
More informationRandom Models. Tusheng Zhang. February 14, 2013
Radom Models Tusheg Zhag February 14, 013 1 Radom Walks Let me describe the model. Radom walks are used to describe the motio of a movig particle (object). Suppose that a particle (object) moves alog the
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More informationApproximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation
Metodološki zvezki, Vol. 13, No., 016, 117-130 Approximate Cofidece Iterval for the Reciprocal of a Normal Mea with a Kow Coefficiet of Variatio Wararit Paichkitkosolkul 1 Abstract A approximate cofidece
More informationLecture 9: September 19
36-700: Probability ad Mathematical Statistics I Fall 206 Lecturer: Siva Balakrisha Lecture 9: September 9 9. Review ad Outlie Last class we discussed: Statistical estimatio broadly Pot estimatio Bias-Variace
More information4.1 Non-parametric computational estimation
Chapter 4 Resamplig Methods 4.1 No-parametric computatioal estimatio Let x 1,...,x be a realizatio of the i.i.d. r.vs X 1,...,X with a c.d.f. F. We are iterested i the precisio of estimatio of a populatio
More informationEstimation of Gumbel Parameters under Ranked Set Sampling
Joural of Moder Applied Statistical Methods Volume 13 Issue 2 Article 11-2014 Estimatio of Gumbel Parameters uder Raked Set Samplig Omar M. Yousef Al Balqa' Applied Uiversity, Zarqa, Jorda, abuyaza_o@yahoo.com
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationOn a Smarandache problem concerning the prime gaps
O a Smaradache problem cocerig the prime gaps Felice Russo Via A. Ifate 7 6705 Avezzao (Aq) Italy felice.russo@katamail.com Abstract I this paper, a problem posed i [] by Smaradache cocerig the prime gaps
More informationMathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution
America Joural of Theoretical ad Applied Statistics 05; 4(: 6-69 Published olie May 8, 05 (http://www.sciecepublishiggroup.com/j/ajtas doi: 0.648/j.ajtas.05040. ISSN: 6-8999 (Prit; ISSN: 6-9006 (Olie Mathematical
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More informationA sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as
More informationMA Advanced Econometrics: Properties of Least Squares Estimators
MA Advaced Ecoometrics: Properties of Least Squares Estimators Karl Whela School of Ecoomics, UCD February 5, 20 Karl Whela UCD Least Squares Estimators February 5, 20 / 5 Part I Least Squares: Some Fiite-Sample
More informationLecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting
Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would
More informationRank tests and regression rank scores tests in measurement error models
Rak tests ad regressio rak scores tests i measuremet error models J. Jurečková ad A.K.Md.E. Saleh Charles Uiversity i Prague ad Carleto Uiversity i Ottawa Abstract The rak ad regressio rak score tests
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationA proposed discrete distribution for the statistical modeling of
It. Statistical Ist.: Proc. 58th World Statistical Cogress, 0, Dubli (Sessio CPS047) p.5059 A proposed discrete distributio for the statistical modelig of Likert data Kidd, Marti Cetre for Statistical
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More informationImproved Class of Ratio -Cum- Product Estimators of Finite Population Mean in two Phase Sampling
Global Joural of Sciece Frotier Research: F Mathematics ad Decisio Scieces Volume 4 Issue 2 Versio.0 Year 204 Type : Double Blid Peer Reviewed Iteratioal Research Joural Publisher: Global Jourals Ic. (USA
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015
ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],
More information1 6 = 1 6 = + Factorials and Euler s Gamma function
Royal Holloway Uiversity of Lodo Departmet of Physics Factorials ad Euler s Gamma fuctio Itroductio The is a self-cotaied part of the course dealig, essetially, with the factorial fuctio ad its geeralizatio
More informationThe standard deviation of the mean
Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider
More informationFirst, note that the LS residuals are orthogonal to the regressors. X Xb X y = 0 ( normal equations ; (k 1) ) So,
0 2. OLS Part II The OLS residuals are orthogoal to the regressors. If the model icludes a itercept, the orthogoality of the residuals ad regressors gives rise to three results, which have limited practical
More informationTHE KALMAN FILTER RAUL ROJAS
THE KALMAN FILTER RAUL ROJAS Abstract. This paper provides a getle itroductio to the Kalma filter, a umerical method that ca be used for sesor fusio or for calculatio of trajectories. First, we cosider
More informationApproximating the ruin probability of finite-time surplus process with Adaptive Moving Total Exponential Least Square
WSEAS TRANSACTONS o BUSNESS ad ECONOMCS S. Khotama, S. Boothiem, W. Klogdee Approimatig the rui probability of fiite-time surplus process with Adaptive Movig Total Epoetial Least Square S. KHOTAMA, S.
More information