A New Iterative Procedure for Estimation of RCA Parameters Based on Estimating Functions
|
|
- Aubrey Cunningham
- 5 years ago
- Views:
Transcription
1 Applied Mathematical Sciences, Vol. 5, 011, no. 4, A New Iterative Procedure for Estimation of RCA Parameters Based on Estimating Functions Norli Anida Abdullah, Ibrahim Mohamed 1 Shelton Peiris and Nor Azlinna Azizan Institute of Mathematical Sciences University of Malaya Kuala Lumpur, Malaysia Abstract This paper considers a novel approach for estimation of random coefficient autoregressive models using an iterative (IT) procedure based on estimating functions (EF). We compare the performance of these new estimates with the traditional least squares (LS) and the standard EF estimates via a large scale simulation study. It is shown that the proposed IT procedure performs better than the other two methods. Keywords: Estimating function; Least squares; Random coefficient autoregressive model; Iterative method; Estimation; Bias; Standard error 1 Introduction Random coefficient autoregressive (RCA) models have attracted a growing interest in recent years due to its wide range of applications in biology, economics, meteorology and, recently, in finance. See, for example, Nicholls and Quinn (198) and references therein, Bera et. al (1997), Rahiala (1999), Wang and Gosh (00) and Lee et. al (006) for details and various applications of RCA models. In estimating the parameters of RCA models, Nicholls and Quinn (1981) employed the traditional least squares (LS) and the maximum likelihood (ML) methods while Wang and Gosh (00) used the Bayesian approach. Another method that has been considered is the theory of estimating functions originally proposed by Godambe (1985). Thavaneswaran and Abraham (1988) 1 Corresponding author: imohamed@um.edu.my Visiting from the University of Sydney, Australia, shelton.peiris@sydney.edu.au
2 194 Norli Anida Abdullah et al applied this estimating functions (EF) theory to nonlinear time series estimation problems and Thavaneswaran and Peiris (1996) have extended these results further with applications. For an RCA model, the estimation using the EF technique is equivalent to the weighted least squares estimator which has been discussed by Hwang and Basawa (1998) and Chandra and Taniguchi (001). This paper considers RCA models and propose a new iterative (IT) procedure for estimating the AR parameter. Unlike the EF method, this algorithm can be used to estimate variances of the random variables involved in addition to the AR parameter θ. We finally compare the performance of the IT method with the traditional LS and the standard EF methods. With that view in mind, this paper is organized as follows: The section reports the parameter estimation for an RCA(p) model using LS, EF and IT methods. The section 3 compares the performance of these three estimates through a simulation study. Finally, a conclusion is given in section 4 to summarize the work of this paper. Random Coefficient Autoregressive Model of Order p The general class of random coefficient autoregressive model of order p, RCA(p), is given by p y t = [θ i + b i (t)]y t i + ε t, (.1) i=1 where θ =(θ 1,θ,,θ p ) is a p 1 vector of constants, {ε t } is a sequence of iid (independent and identically distributed) random variable with mean zero and variance σε, b(t) =(b 1 (t),..., b p (t)) is a sequence of iid random variables with mean zero and E[b(t)b (t)] = Σ = diag(σ b 1,σ b,,σ b p ) for each t, {b(t)} is independent of {ε t } for each t and θ 0 θ +tr(σ) < 1 to ensure stability and ergodicity. It can be seen if the elements of Σ are small compared with those of θ, then {y t } would be expected to resemble realizations of constant coefficient autoregressions. See, for example, Nicholls and Quinn (198) and references therein for details. It is easy to see that p p y t = θ i y t i + b i (t)y t i + ε t i=1 i=1 = Y t 1 θ + u t, (.) where Y t 1 =(y t 1,y t,,y t p ) and u t = p i=1 b i(t)y t i + ε t.
3 Iterative procedure for estimation of RCA parameters 195 Given a sample size n observations y 1,y,..., y n, where n>>p,the least squares estimate ˆθ LS of θ is given by ˆθ LS =( Y t 1 Y t 1) 1 Y t 1 y t. (.3) Having estimated θ, we may then estimate σb i equation (.) such that for all i and σ e by considering û t,ls = y t Y t 1ˆθ LS Let η =û t,ls σ e p i=1 σ b i Yt i. Nicholls and Quinn (1981) showed the least squares estimates of σb i for all i and σe can be obtained by regressing û t,ls on 1 and y t i, which is reduced to a standard regression problem y = Xβ + η, where y = û 1,LS. û n,ls, X = 1 y t 1,1 y t p, yt 1,n yt p,n, β = σ e σ b 1. σ b p and η = η 1. η n (.4) Hence, the solution of the least squares estimates is ˆβ = (X 0 X) 1 X 0 y (.5) On the other hand, Thavaneswaran and Abraham (1988) obtained the corresponding EF estimate (by solving the optimal estimating equations) ˆθ EF of θ given by ˆθ EF =( Y t 1 Y t 1 /W t) 1 N Y t 1 y t /W t, (.6) where W t = σε + n y t i σ b i. In practice, σb i and σε in (.5) are replaced by the corresponding LS estimates as given in (.4). Now we look at an alternative estimation procedure.
4 196 Norli Anida Abdullah et al.1 An Iterative Estimation (IT) Method It is clear that the evaluation of (.5) depends on (.4) and therefore we suggest the following efficient iterative algorithm to estimate θ in (.1). Since the LS estimates are used to evaluate the estimate in (.5), now we show that the quality of the estimate ˆθ EF can be improved as follows: Let θ (k) IT be an estimate of θ based on n observation at step k, k =1,,. 1. Take θ (0) IT = ˆθ LS from (.3) while σ (0) ε,it i =1,,..., p from (.5). Let u (0) t,it =û t,ls. =ˆσ ε,ls. Now obtain the following values for k=1,,...: and σ(0) b i,it =ˆσ b i,ls, for W (k 1) t = σ (k 1) ε,it + y t i σ(k 1) b i (.7) θ (k) IT =( Y t 1 Y t 1 N (k 1) /W t ) 1 Y t 1 y t /W (k 1) t (.8) u (k) t,it = y t ˆθ 0(k) IT Y t 1 (.9) σ (k) ε,it = ˆβ (k) σ e (.10) σ (k) b i,it = ˆβ (k) σ b i, i =1,,.., p. (.11) where β (k) σ refers the first entry of ˆβ at step k in equation (.4). Similarly e for β (k), i =1,,..., p. σb i 3. The process in step two will continue until all of θ (k) IT,σ(k) ε,it i = 1,,..., p converge with a certain pre-specified tolerance. and σ(k) b i,it, The section 3 considers a large scale simulation study to investigate the performance of this suggested IT procedure for the simplest case of RCA(1) model.
5 Iterative procedure for estimation of RCA parameters Simulation This section reports a simulation study for investigating the performance of IT method compared to the EF and LS methods. In the case of p = 1 in (.1), the corresponding LS estimates are n t= ˆθ LS = y ty t 1 n, (3.1) t= y t 1 ˆσ b,ls = n t= û t,ls (y t 1 z) n t= y4 t 1 z, (3.) ˆσ e,ls = n t= û t,ls σ b,ls z n 1 (3.3) where z = n yt 1 t= and û n 1 t,ls = y t ˆθ LS y t 1. The EF estimate is given by ˆθ EF = y t y t 1 σe + / σ b y t 1 t= yt 1 σe +. (3.4) σ b y t 1 t= Whilst for IT estimates are θ (k) IT = t= σ (k 1) e,it y t y t 1 / + σ (k 1) b,it yt 1 t= σ (k 1) e,it y t 1 + σ (k 1) b,it yt 1 (3.5) u (k) t,it = y t θ (k) IT y t 1 (3.6) n b,it = t= û(k) t,it (y t 1 z) n (3.7) t= y4 t 1 z σ (k) σ (k) n e,it = t= û(k) n 1 Below are the steps taken in our study. t,it σ(k) b,it z. (3.8)
6 198 Norli Anida Abdullah et al 1. Generate RCA(1) series of lengths N = 50, 700, 100 with known parameter values of θ, σb and σ ε assuming ε t and b t follow normal distributions with means 0 and variances 1 and σb (known) respectively. The initial value y 0 is chosen to be 0 and the first 00 values from each generated the series are discarded to remove the initial value effect giving the effective lengths of each series used in estimation are n =50, 500, Estimate θ, σ b and σ ε using the LS, EF and IT methods. 3. Repeat the steps in (1) and () for s times so that we have 3s estimates for each method of estimation. 4. Let ξ =(θ, σb,σ ε)=(ξ 1,ξ,ξ 3 ) and let ˆξ (j) i be an estimate of ξi at step j = 1,..., s. The following calculations for each parameter is obtained for each i =1,, 3. Mean: ξi = 1 s (j) s j=1 ˆξ i, Bias: ξi ξ i, Root mean square error (RMSE): 1 s [ˆξ (j) i ξ i ] s, (3.9) j=1 Standard error (SE): 1 s 1 s j=1 [ˆξ (j) i ξ i ]. (3.10) 5. Throughout our simulation, we fixed the tolerance of the IT method to be 10 6 and the number of simulation to be s =1, 000. The section 3.1 below will review the criteria for comparison of LS, EF and IT methods. 3.1 Model Comparison Several criteria are available in comparing the estimates given by LS, EF and IT methods when fitted on time series data such as the Akaike s information criteria, Bayesian Akaike s information criteria and Schwartz criteria. We use the Akaike s information criteria (AIC) given by AIC = lnl(θ)+ p, (3.11)
7 Iterative procedure for estimation of RCA parameters 199 where lnl(θ) is the log likelihood function and p is the number of parameters to be estimated. For the RCA model, the log-likelihood function is given by Nicholls and Quinn (1981). 3. The Results Table 1 gives the simulation results for the true parameter value θ =0.1 and σb =0.16. Whilst for Table, we choose the true parameter value θ = 0.3 and σb =0.5. In table 3, the true parameter value θ=0.8 and σ b =o.3 are chosen representing the extreme case satisfying the stationary condition θ + σb <1. Lastly, Table 4 considers the true value of σ b =0.5 which is greater than the true value of θ=0.3. The first three rows of the tables give the bias for each parameter θ, σb and σ e using LS, EF and IT approaches. The next six rows report the RMSE and SE results. Based on our simulation results, we note that the EF and IT methods perform better than the LS method in all cases considered, the bias, RMSE and SE of the three parameters are smaller for EF and IT methods, the LS, EF and IT methods give almost similar bias for θ, the IT method gives smaller bias of σ ε and σ b, the RMSE and SE get smaller as n increases (as expected). These values for EF are generally smaller than those for LS and IT. Table 5 gives the proportion data accurately fitted by one of the three estimation methods based on AIC values. Using 1000 samples from RCA(1) process with different sets of parameter values, it can be seen that the EF or the IT methods always perform better than the LS method. Further, it is interesting to note that the IT method has a higher proportion of models having smaller AIC values than the EF method. This conjecture that the IT method is a better alternative estimation method for an RCA(1) model. 4 Conclusion This work shows that the proposed IT procedure works well in the estimation of RCA(1) parameters. Simulation results and the illustration of a real data further support the performance of the IT method.
8 00 Norli Anida Abdullah et al Table 1: Simulation Results for θ=0.1 and σ b =0.16 n =50 n = 500 n = 1000 Statistics LS EF IT LS EF IT LS EF IT Bias θ Bias σb Bias σe RMSE θ RMSE σb RMSE σe SE θ SE σb SE σe Table : Simulation Results for θ=-0.3 and σ b =0.5 n =50 n = 500 n = 1000 Statistics LS EF IT LS EF IT LS EF IT Bias θ Bias σb Bias σe RMSE θ RMSE σb RMSE σe SE θ SE σb SE σe Table 3: Simulation Results for θ=0.8 and σ b =0.3 n =50 n = 500 n = 1000 Statistics LS EF IT LS EF IT LS EF IT Bias θ Bias σb Bias σe RMSE θ RMSE σb RMSE σe SE θ SE σb SE σe Table 4: Simulation Results for θ=0.3 and σ b =0.5 n =50 n = 500 n = 1000 Statistics LS EF IT LS EF IT LS EF IT Bias θ Bias σb Bias σe RMSE θ RMSE σb RMSE σe SE θ SE σb SE σe
9 Iterative procedure for estimation of RCA parameters 01 Table 5: AIC-frequency of model preference for each estimation method Model F requencyaic LS F requencyaic EF F requencyaic IT n = 100, θ =0.1, σb = n = 100, θ =0.8, σb = n = 100, θ =0.3, σb = n = 100, θ = 0.3, σb = n = 100, θ =0.5, σb = n = 100, θ =0.7, σb = References [1] A. K. Bera, P. Garcia and J. S. Roh, Estimation of Time-varying Hedge Ratios for Corn and Soybeans: BGARCH and Random Coefficient Approaches, The Indian Journal of Statistics, 59(3)(1997), [] A. Thavaneswaran and B. Abraham, Estimation for Nonlinear Time Series Model using Estimating Function, J. Time Ser. Anal., 9(1988), [3] A. Thavaneswaran and S. Peiris, Nonparametric Estimation for Some Nonlinear Models, Statistics and Probability Letters, 8(1996), [4] D.F. Nicholls and B.G. Quinn, The Estimation of Random Coefficient Autoregressive Models. II, Journal of Time Series Analysis, (1981), [5] D.F. Nicholls and B.G. Quinn, Random Coefficient Autoregressive Models: An Introduction, Lecture Notes in Statistics, 11, Springer-Verlag, New York, 198. [6] D. Wang and S. K. Ghosh, Bayesian Analysis of Random Coefficient Autoregressive Models, Model Assisted Statistics and Applications, 3()(00), [7] H.T. Lee, K.J. Yoder, R. C Mittlehammer and J.J. McCluskey, A Random Coefficient Autoregressive Markov Regime Switching Model for Dynamic Futures Hedging, The journal of Futures Markets, 6()(006), [8] M. Rahiala, Random Coefficient Autoregressive Model for Longitudinal Data, Biometrika, 86(3)(1999), [9] S.A. Chandra and M. Taniguchi, Estimating Functions for Nonlinear Time Series Model, Ann. Inst. Statist. Math., 53(1)(001), [10] S.Y. Hwang and I.V. Basawa, Parameter Estimation for Generalized Random Coefficient Autoregressive Processes, Journal of Statistical Planning and Inference, 68(1998),
10 0 Norli Anida Abdullah et al [11] V.P. Godambe, The Foundations of Finite Sample Estimation in Stochastic Processes, Biometrika, 7(1985), Received: August, 010
First-order random coefficient autoregressive (RCA(1)) model: Joint Whittle estimation and information
ACTA ET COMMENTATIONES UNIVERSITATIS TARTUENSIS DE MATHEMATICA Volume 9, Number, June 05 Available online at http://acutm.math.ut.ee First-order random coefficient autoregressive RCA model: Joint Whittle
More informationAsymptotic inference for a nonstationary double ar(1) model
Asymptotic inference for a nonstationary double ar() model By SHIQING LING and DONG LI Department of Mathematics, Hong Kong University of Science and Technology, Hong Kong maling@ust.hk malidong@ust.hk
More information[1] Thavaneswaran, A.; Heyde, C. C. A note on filtering for long memory processes. Stable non-gaussian models in finance and econometrics. Math.
[1] Thavaneswaran, A.; Heyde, C. C. A note on filtering for long memory processes. Stable non-gaussian models in finance and econometrics. Math. Comput. Modelling 34 (2001), no. 9-11, 1139--1144. [2] Peiris,
More informationEfficient Estimation for the Partially Linear Models with Random Effects
A^VÇÚO 1 33 ò 1 5 Ï 2017 c 10 Chinese Journal of Applied Probability and Statistics Oct., 2017, Vol. 33, No. 5, pp. 529-537 doi: 10.3969/j.issn.1001-4268.2017.05.009 Efficient Estimation for the Partially
More informationOn Autoregressive Order Selection Criteria
On Autoregressive Order Selection Criteria Venus Khim-Sen Liew Faculty of Economics and Management, Universiti Putra Malaysia, 43400 UPM, Serdang, Malaysia This version: 1 March 2004. Abstract This study
More informationGoodness-of-Fit Tests for Time Series Models: A Score-Marked Empirical Process Approach
Goodness-of-Fit Tests for Time Series Models: A Score-Marked Empirical Process Approach By Shiqing Ling Department of Mathematics Hong Kong University of Science and Technology Let {y t : t = 0, ±1, ±2,
More informationTerence Tai-Leung Chong. Abstract
Estimation of the Autoregressive Order in the Presence of Measurement Errors Terence Tai-Leung Chong The Chinese University of Hong Kong Yuanxiu Zhang University of British Columbia Venus Liew Universiti
More informationPanel Threshold Regression Models with Endogenous Threshold Variables
Panel Threshold Regression Models with Endogenous Threshold Variables Chien-Ho Wang National Taipei University Eric S. Lin National Tsing Hua University This Version: June 29, 2010 Abstract This paper
More informationMS&E 226: Small Data. Lecture 11: Maximum likelihood (v2) Ramesh Johari
MS&E 226: Small Data Lecture 11: Maximum likelihood (v2) Ramesh Johari ramesh.johari@stanford.edu 1 / 18 The likelihood function 2 / 18 Estimating the parameter This lecture develops the methodology behind
More information9. Model Selection. statistical models. overview of model selection. information criteria. goodness-of-fit measures
FE661 - Statistical Methods for Financial Engineering 9. Model Selection Jitkomut Songsiri statistical models overview of model selection information criteria goodness-of-fit measures 9-1 Statistical models
More informationDynamic Regression Models (Lect 15)
Dynamic Regression Models (Lect 15) Ragnar Nymoen University of Oslo 21 March 2013 1 / 17 HGL: Ch 9; BN: Kap 10 The HGL Ch 9 is a long chapter, and the testing for autocorrelation part we have already
More informationIntroduction to Estimation Methods for Time Series models. Lecture 1
Introduction to Estimation Methods for Time Series models Lecture 1 Fulvio Corsi SNS Pisa Fulvio Corsi Introduction to Estimation () Methods for Time Series models Lecture 1 SNS Pisa 1 / 19 Estimation
More informationMarkov Switching Models
Applications with R Tsarouchas Nikolaos-Marios Supervisor Professor Sophia Dimelis A thesis presented for the MSc degree in Business Mathematics Department of Informatics Athens University of Economics
More informationModel selection using penalty function criteria
Model selection using penalty function criteria Laimonis Kavalieris University of Otago Dunedin, New Zealand Econometrics, Time Series Analysis, and Systems Theory Wien, June 18 20 Outline Classes of models.
More informationA Functional Central Limit Theorem for an ARMA(p, q) Process with Markov Switching
Communications for Statistical Applications and Methods 2013, Vol 20, No 4, 339 345 DOI: http://dxdoiorg/105351/csam2013204339 A Functional Central Limit Theorem for an ARMAp, q) Process with Markov Switching
More informationForecasting Egyptian GDP Using ARIMA Models
Reports on Economics and Finance, Vol. 5, 2019, no. 1, 35-47 HIKARI Ltd, www.m-hikari.com https://doi.org/10.12988/ref.2019.81023 Forecasting Egyptian GDP Using ARIMA Models Mohamed Reda Abonazel * and
More informationPh.D. Qualifying Exam Friday Saturday, January 3 4, 2014
Ph.D. Qualifying Exam Friday Saturday, January 3 4, 2014 Put your solution to each problem on a separate sheet of paper. Problem 1. (5166) Assume that two random samples {x i } and {y i } are independently
More informationKALMAN-TYPE RECURSIONS FOR TIME-VARYING ARMA MODELS AND THEIR IMPLICATION FOR LEAST SQUARES PROCEDURE ANTONY G AU T I E R (LILLE)
PROBABILITY AND MATHEMATICAL STATISTICS Vol 29, Fasc 1 (29), pp 169 18 KALMAN-TYPE RECURSIONS FOR TIME-VARYING ARMA MODELS AND THEIR IMPLICATION FOR LEAST SQUARES PROCEDURE BY ANTONY G AU T I E R (LILLE)
More informationSGN Advanced Signal Processing: Lecture 8 Parameter estimation for AR and MA models. Model order selection
SG 21006 Advanced Signal Processing: Lecture 8 Parameter estimation for AR and MA models. Model order selection Ioan Tabus Department of Signal Processing Tampere University of Technology Finland 1 / 28
More informationPanel Data Models. James L. Powell Department of Economics University of California, Berkeley
Panel Data Models James L. Powell Department of Economics University of California, Berkeley Overview Like Zellner s seemingly unrelated regression models, the dependent and explanatory variables for panel
More informationTesting for Regime Switching in Singaporean Business Cycles
Testing for Regime Switching in Singaporean Business Cycles Robert Breunig School of Economics Faculty of Economics and Commerce Australian National University and Alison Stegman Research School of Pacific
More informationAn Extended BIC for Model Selection
An Extended BIC for Model Selection at the JSM meeting 2007 - Salt Lake City Surajit Ray Boston University (Dept of Mathematics and Statistics) Joint work with James Berger, Duke University; Susie Bayarri,
More informationConsistency of Quasi-Maximum Likelihood Estimators for the Regime-Switching GARCH Models
Consistency of Quasi-Maximum Likelihood Estimators for the Regime-Switching GARCH Models Yingfu Xie Research Report Centre of Biostochastics Swedish University of Report 2005:3 Agricultural Sciences ISSN
More information10. Time series regression and forecasting
10. Time series regression and forecasting Key feature of this section: Analysis of data on a single entity observed at multiple points in time (time series data) Typical research questions: What is the
More informationOn Properties of QIC in Generalized. Estimating Equations. Shinpei Imori
On Properties of QIC in Generalized Estimating Equations Shinpei Imori Graduate School of Engineering Science, Osaka University 1-3 Machikaneyama-cho, Toyonaka, Osaka 560-8531, Japan E-mail: imori.stat@gmail.com
More informationThe Effects of Monetary Policy on Stock Market Bubbles: Some Evidence
The Effects of Monetary Policy on Stock Market Bubbles: Some Evidence Jordi Gali Luca Gambetti ONLINE APPENDIX The appendix describes the estimation of the time-varying coefficients VAR model. The model
More informationInformation Criteria and Model Selection
Information Criteria and Model Selection Herman J. Bierens Pennsylvania State University March 12, 2006 1. Introduction Let L n (k) be the maximum likelihood of a model with k parameters based on a sample
More informationRegression I: Mean Squared Error and Measuring Quality of Fit
Regression I: Mean Squared Error and Measuring Quality of Fit -Applied Multivariate Analysis- Lecturer: Darren Homrighausen, PhD 1 The Setup Suppose there is a scientific problem we are interested in solving
More informationUse of Eigen values and eigen vectors to calculate higher transition probabilities
The Lecture Contains : Markov-Bernoulli Chain Note Assignments Random Walks which are correlated Actual examples of Markov Chains Examples Use of Eigen values and eigen vectors to calculate higher transition
More informationPerformance of Autoregressive Order Selection Criteria: A Simulation Study
Pertanika J. Sci. & Technol. 6 (2): 7-76 (2008) ISSN: 028-7680 Universiti Putra Malaysia Press Performance of Autoregressive Order Selection Criteria: A Simulation Study Venus Khim-Sen Liew, Mahendran
More informationThe Role of "Leads" in the Dynamic Title of Cointegrating Regression Models. Author(s) Hayakawa, Kazuhiko; Kurozumi, Eiji
he Role of "Leads" in the Dynamic itle of Cointegrating Regression Models Author(s) Hayakawa, Kazuhiko; Kurozumi, Eiji Citation Issue 2006-12 Date ype echnical Report ext Version publisher URL http://hdl.handle.net/10086/13599
More informationMultivariate Least Weighted Squares (MLWS)
() Stochastic Modelling in Economics and Finance 2 Supervisor : Prof. RNDr. Jan Ámos Víšek, CSc. Petr Jonáš 23 rd February 2015 Contents 1 2 3 4 5 6 7 1 1 Introduction 2 Algorithm 3 Proof of consistency
More informationUnit Root and Cointegration
Unit Root and Cointegration Carlos Hurtado Department of Economics University of Illinois at Urbana-Champaign hrtdmrt@illinois.edu Oct 7th, 016 C. Hurtado (UIUC - Economics) Applied Econometrics On the
More informationAn introduction to volatility models with indices
Applied Mathematics Letters 20 (2007) 177 182 www.elsevier.com/locate/aml An introduction to volatility models with indices S. Peiris,A.Thavaneswaran 1 School of Mathematics and Statistics, The University
More informationInflation Revisited: New Evidence from Modified Unit Root Tests
1 Inflation Revisited: New Evidence from Modified Unit Root Tests Walter Enders and Yu Liu * University of Alabama in Tuscaloosa and University of Texas at El Paso Abstract: We propose a simple modification
More informationEconometrics I, Estimation
Econometrics I, Estimation Department of Economics Stanford University September, 2008 Part I Parameter, Estimator, Estimate A parametric is a feature of the population. An estimator is a function of the
More informationState Space Model, Official Statistics, Bayesian Statistics Introduction to Durbin s paper and related topics
State Space Model, Official Statistics, Bayesian Statistics Introduction to Durbin s paper and related topics Yasuto Yoshizoe Aoyama Gakuin University yoshizoe@econ.aoyama.ac.jp yasuto yoshizoe@post.harvard.edu
More informationEstimation Theory. as Θ = (Θ 1,Θ 2,...,Θ m ) T. An estimator
Estimation Theory Estimation theory deals with finding numerical values of interesting parameters from given set of data. We start with formulating a family of models that could describe how the data were
More informationCross-sectional space-time modeling using ARNN(p, n) processes
Cross-sectional space-time modeling using ARNN(p, n) processes W. Polasek K. Kakamu September, 006 Abstract We suggest a new class of cross-sectional space-time models based on local AR models and nearest
More informationPh.D. Qualifying Exam Friday Saturday, January 6 7, 2017
Ph.D. Qualifying Exam Friday Saturday, January 6 7, 2017 Put your solution to each problem on a separate sheet of paper. Problem 1. (5106) Let X 1, X 2,, X n be a sequence of i.i.d. observations from a
More informationEmpirical Market Microstructure Analysis (EMMA)
Empirical Market Microstructure Analysis (EMMA) Lecture 3: Statistical Building Blocks and Econometric Basics Prof. Dr. Michael Stein michael.stein@vwl.uni-freiburg.de Albert-Ludwigs-University of Freiburg
More informationCUSUM TEST FOR PARAMETER CHANGE IN TIME SERIES MODELS. Sangyeol Lee
CUSUM TEST FOR PARAMETER CHANGE IN TIME SERIES MODELS Sangyeol Lee 1 Contents 1. Introduction of the CUSUM test 2. Test for variance change in AR(p) model 3. Test for Parameter Change in Regression Models
More informationEstimation for Nonlinear Time Series Models Using Estimating Equations by
Estimation for Nonlinear Time Series Models Using Estimating Equations by A. Thavaneswaran Department of Biostatistics University of North Carolina at Chapel Hill and B. Abraham Department of Statistics
More informationAkaike Information Criterion
Akaike Information Criterion Shuhua Hu Center for Research in Scientific Computation North Carolina State University Raleigh, NC February 7, 2012-1- background Background Model statistical model: Y j =
More informationDEPARTMENT OF ECONOMICS
ISSN 0819-64 ISBN 0 7340 616 1 THE UNIVERSITY OF MELBOURNE DEPARTMENT OF ECONOMICS RESEARCH PAPER NUMBER 959 FEBRUARY 006 TESTING FOR RATE-DEPENDENCE AND ASYMMETRY IN INFLATION UNCERTAINTY: EVIDENCE FROM
More informationMISCELLANEOUS TOPICS RELATED TO LIKELIHOOD. Copyright c 2012 (Iowa State University) Statistics / 30
MISCELLANEOUS TOPICS RELATED TO LIKELIHOOD Copyright c 2012 (Iowa State University) Statistics 511 1 / 30 INFORMATION CRITERIA Akaike s Information criterion is given by AIC = 2l(ˆθ) + 2k, where l(ˆθ)
More informationEconometric Forecasting
Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 1, 2014 Outline Introduction Model-free extrapolation Univariate time-series models Trend
More informationModel comparison and selection
BS2 Statistical Inference, Lectures 9 and 10, Hilary Term 2008 March 2, 2008 Hypothesis testing Consider two alternative models M 1 = {f (x; θ), θ Θ 1 } and M 2 = {f (x; θ), θ Θ 2 } for a sample (X = x)
More informationAnalysis of the AIC Statistic for Optimal Detection of Small Changes in Dynamic Systems
Analysis of the AIC Statistic for Optimal Detection of Small Changes in Dynamic Systems Jeremy S. Conner and Dale E. Seborg Department of Chemical Engineering University of California, Santa Barbara, CA
More informationPractical Econometrics. for. Finance and Economics. (Econometrics 2)
Practical Econometrics for Finance and Economics (Econometrics 2) Seppo Pynnönen and Bernd Pape Department of Mathematics and Statistics, University of Vaasa 1. Introduction 1.1 Econometrics Econometrics
More informationConditions for convergence of random coefficient AR(1) processes and perpetuities in higher dimensions
Bernoulli 202, 2014, 990 1005 DOI: 10.3150/13-BEJ513 Conditions for convergence of random coefficient AR1 processes and perpetuities in higher dimensions TORKEL ERHARDSSON Department of Mathematics, Linköping
More informationSUPPLEMENT TO MARKET ENTRY COSTS, PRODUCER HETEROGENEITY, AND EXPORT DYNAMICS (Econometrica, Vol. 75, No. 3, May 2007, )
Econometrica Supplementary Material SUPPLEMENT TO MARKET ENTRY COSTS, PRODUCER HETEROGENEITY, AND EXPORT DYNAMICS (Econometrica, Vol. 75, No. 3, May 2007, 653 710) BY SANGHAMITRA DAS, MARK ROBERTS, AND
More informationEcon 583 Final Exam Fall 2008
Econ 583 Final Exam Fall 2008 Eric Zivot December 11, 2008 Exam is due at 9:00 am in my office on Friday, December 12. 1 Maximum Likelihood Estimation and Asymptotic Theory Let X 1,...,X n be iid random
More informationEcon 623 Econometrics II Topic 2: Stationary Time Series
1 Introduction Econ 623 Econometrics II Topic 2: Stationary Time Series In the regression model we can model the error term as an autoregression AR(1) process. That is, we can use the past value of the
More informationTAKEHOME FINAL EXAM e iω e 2iω e iω e 2iω
ECO 513 Spring 2015 TAKEHOME FINAL EXAM (1) Suppose the univariate stochastic process y is ARMA(2,2) of the following form: y t = 1.6974y t 1.9604y t 2 + ε t 1.6628ε t 1 +.9216ε t 2, (1) where ε is i.i.d.
More informationStatistics for analyzing and modeling precipitation isotope ratios in IsoMAP
Statistics for analyzing and modeling precipitation isotope ratios in IsoMAP The IsoMAP uses the multiple linear regression and geostatistical methods to analyze isotope data Suppose the response variable
More informationBIO5312 Biostatistics Lecture 13: Maximum Likelihood Estimation
BIO5312 Biostatistics Lecture 13: Maximum Likelihood Estimation Yujin Chung November 29th, 2016 Fall 2016 Yujin Chung Lec13: MLE Fall 2016 1/24 Previous Parametric tests Mean comparisons (normality assumption)
More informationECON 4160, Lecture 11 and 12
ECON 4160, 2016. Lecture 11 and 12 Co-integration Ragnar Nymoen Department of Economics 9 November 2017 1 / 43 Introduction I So far we have considered: Stationary VAR ( no unit roots ) Standard inference
More informationQuick Review on Linear Multiple Regression
Quick Review on Linear Multiple Regression Mei-Yuan Chen Department of Finance National Chung Hsing University March 6, 2007 Introduction for Conditional Mean Modeling Suppose random variables Y, X 1,
More informationSELECTIVE ANGLE MEASUREMENTS FOR A 3D-AOA INSTRUMENTAL VARIABLE TMA ALGORITHM
SELECTIVE ANGLE MEASUREMENTS FOR A 3D-AOA INSTRUMENTAL VARIABLE TMA ALGORITHM Kutluyıl Doğançay Reza Arablouei School of Engineering, University of South Australia, Mawson Lakes, SA 595, Australia ABSTRACT
More informationPerformance of lag length selection criteria in three different situations
MPRA Munich Personal RePEc Archive Performance of lag length selection criteria in three different situations Zahid Asghar and Irum Abid Quaid-i-Azam University, Islamabad Aril 2007 Online at htts://mra.ub.uni-muenchen.de/40042/
More informationOn the Behavior of Marginal and Conditional Akaike Information Criteria in Linear Mixed Models
On the Behavior of Marginal and Conditional Akaike Information Criteria in Linear Mixed Models Thomas Kneib Institute of Statistics and Econometrics Georg-August-University Göttingen Department of Statistics
More informationApplied Econometrics (QEM)
Applied Econometrics (QEM) based on Prinicples of Econometrics Jakub Mućk Department of Quantitative Economics Jakub Mućk Applied Econometrics (QEM) Meeting #3 1 / 42 Outline 1 2 3 t-test P-value Linear
More informationSMOOTHED BLOCK EMPIRICAL LIKELIHOOD FOR QUANTILES OF WEAKLY DEPENDENT PROCESSES
Statistica Sinica 19 (2009), 71-81 SMOOTHED BLOCK EMPIRICAL LIKELIHOOD FOR QUANTILES OF WEAKLY DEPENDENT PROCESSES Song Xi Chen 1,2 and Chiu Min Wong 3 1 Iowa State University, 2 Peking University and
More informationFormulary Applied Econometrics
Department of Economics Formulary Applied Econometrics c c Seminar of Statistics University of Fribourg Formulary Applied Econometrics 1 Rescaling With y = cy we have: ˆβ = cˆβ With x = Cx we have: ˆβ
More informationLasso Maximum Likelihood Estimation of Parametric Models with Singular Information Matrices
Article Lasso Maximum Likelihood Estimation of Parametric Models with Singular Information Matrices Fei Jin 1,2 and Lung-fei Lee 3, * 1 School of Economics, Shanghai University of Finance and Economics,
More informationA TIME SERIES PARADOX: UNIT ROOT TESTS PERFORM POORLY WHEN DATA ARE COINTEGRATED
A TIME SERIES PARADOX: UNIT ROOT TESTS PERFORM POORLY WHEN DATA ARE COINTEGRATED by W. Robert Reed Department of Economics and Finance University of Canterbury, New Zealand Email: bob.reed@canterbury.ac.nz
More informationGeneralized Quasi-likelihood (GQL) Inference* by Brajendra C. Sutradhar Memorial University address:
Generalized Quasi-likelihood (GQL) Inference* by Brajendra C. Sutradhar Memorial University Email address: bsutradh@mun.ca QL Estimation for Independent Data. For i = 1,...,K, let Y i denote the response
More informationECONOMICS 7200 MODERN TIME SERIES ANALYSIS Econometric Theory and Applications
ECONOMICS 7200 MODERN TIME SERIES ANALYSIS Econometric Theory and Applications Yongmiao Hong Department of Economics & Department of Statistical Sciences Cornell University Spring 2019 Time and uncertainty
More informationGeneralized Concomitant Multi-Task Lasso for sparse multimodal regression
Generalized Concomitant Multi-Task Lasso for sparse multimodal regression Mathurin Massias https://mathurinm.github.io INRIA Saclay Joint work with: Olivier Fercoq (Télécom ParisTech) Alexandre Gramfort
More informationEstimation of Threshold Cointegration
Estimation of Myung Hwan London School of Economics December 2006 Outline Model Asymptotics Inference Conclusion 1 Model Estimation Methods Literature 2 Asymptotics Consistency Convergence Rates Asymptotic
More informationCalibration Estimation of Semiparametric Copula Models with Data Missing at Random
Calibration Estimation of Semiparametric Copula Models with Data Missing at Random Shigeyuki Hamori 1 Kaiji Motegi 1 Zheng Zhang 2 1 Kobe University 2 Renmin University of China Econometrics Workshop UNC
More informationPENALIZED LIKELIHOOD PARAMETER ESTIMATION FOR ADDITIVE HAZARD MODELS WITH INTERVAL CENSORED DATA
PENALIZED LIKELIHOOD PARAMETER ESTIMATION FOR ADDITIVE HAZARD MODELS WITH INTERVAL CENSORED DATA Kasun Rathnayake ; A/Prof Jun Ma Department of Statistics Faculty of Science and Engineering Macquarie University
More informationShort Questions (Do two out of three) 15 points each
Econometrics Short Questions Do two out of three) 5 points each ) Let y = Xβ + u and Z be a set of instruments for X When we estimate β with OLS we project y onto the space spanned by X along a path orthogonal
More informationSymmetric btw positive & negative prior returns. where c is referred to as risk premium, which is expected to be positive.
Advantages of GARCH model Simplicity Generates volatility clustering Heavy tails (high kurtosis) Weaknesses of GARCH model Symmetric btw positive & negative prior returns Restrictive Provides no explanation
More informationWavelet Regression Estimation in Longitudinal Data Analysis
Wavelet Regression Estimation in Longitudinal Data Analysis ALWELL J. OYET and BRAJENDRA SUTRADHAR Department of Mathematics and Statistics, Memorial University of Newfoundland St. John s, NF Canada, A1C
More informationEstimation theory. Parametric estimation. Properties of estimators. Minimum variance estimator. Cramer-Rao bound. Maximum likelihood estimators
Estimation theory Parametric estimation Properties of estimators Minimum variance estimator Cramer-Rao bound Maximum likelihood estimators Confidence intervals Bayesian estimation 1 Random Variables Let
More informationIs the Basis of the Stock Index Futures Markets Nonlinear?
University of Wollongong Research Online Applied Statistics Education and Research Collaboration (ASEARC) - Conference Papers Faculty of Engineering and Information Sciences 2011 Is the Basis of the Stock
More informationHolzmann, Min, Czado: Validating linear restrictions in linear regression models with general error structure
Holzmann, Min, Czado: Validating linear restrictions in linear regression models with general error structure Sonderforschungsbereich 386, Paper 478 (2006) Online unter: http://epub.ub.uni-muenchen.de/
More informationMassachusetts Institute of Technology Department of Economics Time Series Lecture 6: Additional Results for VAR s
Massachusetts Institute of Technology Department of Economics Time Series 14.384 Guido Kuersteiner Lecture 6: Additional Results for VAR s 6.1. Confidence Intervals for Impulse Response Functions There
More informationMEI Exam Review. June 7, 2002
MEI Exam Review June 7, 2002 1 Final Exam Revision Notes 1.1 Random Rules and Formulas Linear transformations of random variables. f y (Y ) = f x (X) dx. dg Inverse Proof. (AB)(AB) 1 = I. (B 1 A 1 )(AB)(AB)
More informationLikelihood-Based Methods
Likelihood-Based Methods Handbook of Spatial Statistics, Chapter 4 Susheela Singh September 22, 2016 OVERVIEW INTRODUCTION MAXIMUM LIKELIHOOD ESTIMATION (ML) RESTRICTED MAXIMUM LIKELIHOOD ESTIMATION (REML)
More informationLecture Stat Information Criterion
Lecture Stat 461-561 Information Criterion Arnaud Doucet February 2008 Arnaud Doucet () February 2008 1 / 34 Review of Maximum Likelihood Approach We have data X i i.i.d. g (x). We model the distribution
More informationSession 5B: A worked example EGARCH model
Session 5B: A worked example EGARCH model John Geweke Bayesian Econometrics and its Applications August 7, worked example EGARCH model August 7, / 6 EGARCH Exponential generalized autoregressive conditional
More informationVector Autoregressive Model. Vector Autoregressions II. Estimation of Vector Autoregressions II. Estimation of Vector Autoregressions I.
Vector Autoregressive Model Vector Autoregressions II Empirical Macroeconomics - Lect 2 Dr. Ana Beatriz Galvao Queen Mary University of London January 2012 A VAR(p) model of the m 1 vector of time series
More informationSTAT Financial Time Series
STAT 6104 - Financial Time Series Chapter 4 - Estimation in the time Domain Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 1 / 46 Agenda 1 Introduction 2 Moment Estimates 3 Autoregressive Models (AR
More informationDo Markov-Switching Models Capture Nonlinearities in the Data? Tests using Nonparametric Methods
Do Markov-Switching Models Capture Nonlinearities in the Data? Tests using Nonparametric Methods Robert V. Breunig Centre for Economic Policy Research, Research School of Social Sciences and School of
More informationA MEDIAN UNBIASED ESTIMATOR OF THE AR(1) COEFFICIENT
A MEDIAN UNBIASED ESTIMATOR OF THE AR) COEFFICIENT Ryszard Zielińsi Inst. Math. Polish Acad. Sc., Poland P.O.Box 37 Warszawa, Poland Key words: autoregressive model, median-unbiasedness ABSTRACT A proof
More informationModel selection criteria Λ
Model selection criteria Λ Jean-Marie Dufour y Université de Montréal First version: March 1991 Revised: July 1998 This version: April 7, 2002 Compiled: April 7, 2002, 4:10pm Λ This work was supported
More informationComparison with RSS-Based Model Selection Criteria for Selecting Growth Functions
TR-No. 14-07, Hiroshima Statistical Research Group, 1 12 Comparison with RSS-Based Model Selection Criteria for Selecting Growth Functions Keisuke Fukui 2, Mariko Yamamura 1 and Hirokazu Yanagihara 2 1
More information(θ θ ), θ θ = 2 L(θ ) θ θ θ θ θ (θ )= H θθ (θ ) 1 d θ (θ )
Setting RHS to be zero, 0= (θ )+ 2 L(θ ) (θ θ ), θ θ = 2 L(θ ) 1 (θ )= H θθ (θ ) 1 d θ (θ ) O =0 θ 1 θ 3 θ 2 θ Figure 1: The Newton-Raphson Algorithm where H is the Hessian matrix, d θ is the derivative
More informationHeteroskedasticity in Panel Data
Essex Summer School in Social Science Data Analysis Panel Data Analysis for Comparative Research Heteroskedasticity in Panel Data Christopher Adolph Department of Political Science and Center for Statistics
More informationOn the Behavior of Marginal and Conditional Akaike Information Criteria in Linear Mixed Models
On the Behavior of Marginal and Conditional Akaike Information Criteria in Linear Mixed Models Thomas Kneib Department of Mathematics Carl von Ossietzky University Oldenburg Sonja Greven Department of
More informationIntroduction to Statistical modeling: handout for Math 489/583
Introduction to Statistical modeling: handout for Math 489/583 Statistical modeling occurs when we are trying to model some data using statistical tools. From the start, we recognize that no model is perfect
More informationMohsen Pourahmadi. 1. A sampling theorem for multivariate stationary processes. J. of Multivariate Analysis, Vol. 13, No. 1 (1983),
Mohsen Pourahmadi PUBLICATIONS Books and Editorial Activities: 1. Foundations of Time Series Analysis and Prediction Theory, John Wiley, 2001. 2. Computing Science and Statistics, 31, 2000, the Proceedings
More informationA stationarity test on Markov chain models based on marginal distribution
Universiti Tunku Abdul Rahman, Kuala Lumpur, Malaysia 646 A stationarity test on Markov chain models based on marginal distribution Mahboobeh Zangeneh Sirdari 1, M. Ataharul Islam 2, and Norhashidah Awang
More informationPREDICTION AND NONGAUSSIAN AUTOREGRESSIVE STATIONARY SEQUENCES 1. Murray Rosenblatt University of California, San Diego
PREDICTION AND NONGAUSSIAN AUTOREGRESSIVE STATIONARY SEQUENCES 1 Murray Rosenblatt University of California, San Diego Abstract The object of this paper is to show that under certain auxiliary assumptions
More informationOverview of Spatial Statistics with Applications to fmri
with Applications to fmri School of Mathematics & Statistics Newcastle University April 8 th, 2016 Outline Why spatial statistics? Basic results Nonstationary models Inference for large data sets An example
More informationChapter 4: Constrained estimators and tests in the multiple linear regression model (Part III)
Chapter 4: Constrained estimators and tests in the multiple linear regression model (Part III) Florian Pelgrin HEC September-December 2010 Florian Pelgrin (HEC) Constrained estimators September-December
More informationECON 4160, Spring term Lecture 12
ECON 4160, Spring term 2013. Lecture 12 Non-stationarity and co-integration 2/2 Ragnar Nymoen Department of Economics 13 Nov 2013 1 / 53 Introduction I So far we have considered: Stationary VAR, with deterministic
More information