STAD57 Time Series Analysis. Lecture 5

Size: px
Start display at page:

Download "STAD57 Time Series Analysis. Lecture 5"

Transcription

1 STAD57 Time Series Analysis Lecure 5 1

2 Exploraory Daa Analysis Check if given TS is saionary: µ is consan σ 2 is consan γ(s,) is funcion of h= s If no, ry o make i saionary using some of he mehods below: De-rending Differencing Transformaions 2

3 De-rending Plo TS and/or is MA: if µ seems changing, ry o esimae µ & subrac i from series Y esimae rend ˆ Since E[ ], we have How do we esimae µ? work wih Yˆ ˆ E[ Yˆ ] E[ ˆ ] 0 For deerminisic rend (i.e. funcion of ), can use regression 3

4 Esimaing Trend Assume deerminisic rend µ =f() For linear rend, use simple linear regression Y 0 1 For nonlinear rend, can use polynomial regression Y or some oher nonlinear regression mehod Regression s explanaory variable is ime (), or some funcion hereof Response could be MA of (o reduce variabiliy) 4

5 Example Umbrella sales w/ fied linear rend De-rended TS ˆ ˆ

6 Example J&J sales w/ fied quadraic rend De-rended TS ˆ b b b

7 Regression in R Fi linear model Yi 0 11, i... p p, i i wih command: lm( Y ~ n ) Can save oupu o R objec: ou=lm(y~1+ ) Use summary(ou) o see model summary Coefficien & error sd esimaes, significance ess Feed oupu o oher funcions o ge: ANOVA able: aov(ou) Fied values: fied(ou) Akaike s crierion: AIC(ou), ec 7

8 Differencing Alernaive o fiing linear rend is differencing: Y ( ) ( Y Y ) If {Y } saionary {Y Y 1 } also saionary Differencing more appropriae when {Y } is random walk { } is random walk w/ drif Use when { } seems o hover around linear rend In his case, de-rending is no enough o make series saionary Disadvanage of differencing is ha we canno model dynamics of {Y }, only of {Y Y 1 } 8

9 Differencing Define backshif operaor B as B k exend i o powers so ha B 1 k Define 1 s order difference operaor as (1 B) Exend i o higher (d h ) order differences d d (1 B) by algebraically expanding operaor (1 B) d E.g. (1 B) (1 2 B B ) B B 1 and

10 Differencing in R For 1 s order differences, i.e. use diff() 1 For d h order differences, i.e. use diff(, differences=d) d d (1 B) For simple (1 s order) differences a lag k, i.e. k (1 B ) k, use diff(, lag=k) 10

11 gemp Example Global Temperaure TS w/ fied linear rend gempd gempdif de-rended series differenced series ˆ

12 ACF of ˆ Example Global Temperaure ACF ACF of Differencing considerably decreases auo-correlaions random walk w/ drif is more plausible model for series ACF ACF ACF of

13 Seasonaliy Differencing can also be used for seasonaliy If series has seasonal paern wih period d, hen d-lag differences remove paern Define Z (1 B d ) d If d, E[ Z ] E[ d ] 0 paern of period d ( ) d 13

14 ˆ Example Umbrella sales (quarerly daa, annual paern d=4) y ˆ differencing also removed linear rend

15 Time Series Regression Can also use regression model o esimae relaionship of one TS o ohers E.g. Y e, where {,Y } are joinly saionary TS Usual leas squares esimaion is no opimal when dealing wih non-i.i.d. TS daa However, resuls are sill consisen (reliable for large n) if series are saionary Bu never use leas squares for non-saionary TS (e.g. random walks); can ge very bad resuls 15

16 Example M Cardiovascular Moraliy Temperaure T Pariculaes P Scaer-plo marix of TS relaionships Moraliy Temperaure Pariculaes fi model: M 0 1 2T 3T 4P 16

17 Transformaions If TS has non-consan variance, a nonlinear ransformaion can someimes help For posiive series in paricular, he Box-Cox family of power ransforms can be useful: Y ( 1) /, 0 log( ), 0 Try differen values of λ, and check which one seems o give bes resuls Noe: nonlinear ransforms can also change µ 17

18 Example Series w/ rend De-rended series J&J sales Original daa: quadraic rend Transformed daa: Y log( ) linear rend

19 Saionariy Saionariy of γ(s,) is mos difficul o check In pracice, canno verify saionariy since here is no way o esimae γ(s,), only γ(h) Essenially, we assume saionariy in order o carry on wih any TS analysis There are, however, 2 hings we can check: Sample ACF does no change a lo when calculaed from separae sub-sequences of daa Auocorrelaions drop o zero relaively fas (i.e. exponenially) for large lags 19

20 Example Saionary ACF (AR model) Non-saionary ACF (Random walk)

STAD57 Time Series Analysis. Lecture 17

STAD57 Time Series Analysis. Lecture 17 STAD57 Time Series Analysis Lecure 17 1 Exponenially Weighed Moving Average Model Consider ARIMA(0,1,1), or IMA(1,1), model 1 s order differences follow MA(1) X X W W Y X X W W 1 1 1 1 Very common model

More information

STAD57 Time Series Analysis. Lecture 17

STAD57 Time Series Analysis. Lecture 17 STAD57 Time Series Analysis Lecure 17 1 Exponenially Weighed Moving Average Model Consider ARIMA(0,1,1), or IMA(1,1), model 1 s order differences follow MA(1) X X W W Y X X W W 1 1 1 1 Very common model

More information

Time series Decomposition method

Time series Decomposition method Time series Decomposiion mehod A ime series is described using a mulifacor model such as = f (rend, cyclical, seasonal, error) = f (T, C, S, e) Long- Iner-mediaed Seasonal Irregular erm erm effec, effec,

More information

Stationary Time Series

Stationary Time Series 3-Jul-3 Time Series Analysis Assoc. Prof. Dr. Sevap Kesel July 03 Saionary Time Series Sricly saionary process: If he oin dis. of is he same as he oin dis. of ( X,... X n) ( X h,... X nh) Weakly Saionary

More information

Licenciatura de ADE y Licenciatura conjunta Derecho y ADE. Hoja de ejercicios 2 PARTE A

Licenciatura de ADE y Licenciatura conjunta Derecho y ADE. Hoja de ejercicios 2 PARTE A Licenciaura de ADE y Licenciaura conjuna Derecho y ADE Hoja de ejercicios PARTE A 1. Consider he following models Δy = 0.8 + ε (1 + 0.8L) Δ 1 y = ε where ε and ε are independen whie noise processes. In

More information

OBJECTIVES OF TIME SERIES ANALYSIS

OBJECTIVES OF TIME SERIES ANALYSIS OBJECTIVES OF TIME SERIES ANALYSIS Undersanding he dynamic or imedependen srucure of he observaions of a single series (univariae analysis) Forecasing of fuure observaions Asceraining he leading, lagging

More information

Wisconsin Unemployment Rate Forecast Revisited

Wisconsin Unemployment Rate Forecast Revisited Wisconsin Unemploymen Rae Forecas Revisied Forecas in Lecure Wisconsin unemploymen November 06 was 4.% Forecass Poin Forecas 50% Inerval 80% Inerval Forecas Forecas December 06 4.0% (4.0%, 4.0%) (3.95%,

More information

Estimation Uncertainty

Estimation Uncertainty Esimaion Uncerainy The sample mean is an esimae of β = E(y +h ) The esimaion error is = + = T h y T b ( ) = = + = + = = = T T h T h e T y T y T b β β β Esimaion Variance Under classical condiions, where

More information

Cointegration and Implications for Forecasting

Cointegration and Implications for Forecasting Coinegraion and Implicaions for Forecasing Two examples (A) Y Y 1 1 1 2 (B) Y 0.3 0.9 1 1 2 Example B: Coinegraion Y and coinegraed wih coinegraing vecor [1, 0.9] because Y 0.9 0.3 is a saionary process

More information

Distribution of Least Squares

Distribution of Least Squares Disribuion of Leas Squares In classic regression, if he errors are iid normal, and independen of he regressors, hen he leas squares esimaes have an exac normal disribuion, no jus asympoic his is no rue

More information

Quarterly ice cream sales are high each summer, and the series tends to repeat itself each year, so that the seasonal period is 4.

Quarterly ice cream sales are high each summer, and the series tends to repeat itself each year, so that the seasonal period is 4. Seasonal models Many business and economic ime series conain a seasonal componen ha repeas iself afer a regular period of ime. The smalles ime period for his repeiion is called he seasonal period, and

More information

Lesson 2, page 1. Outline of lesson 2

Lesson 2, page 1. Outline of lesson 2 Lesson 2, page Ouline of lesson 2 Inroduce he Auocorrelaion Coefficien Undersand and define saionariy Discuss ransformaion Discuss rend and rend removal C:\Kyrre\sudier\drgrad\Kurs\series\lecure 02 03022.doc,

More information

Regression with Time Series Data

Regression with Time Series Data Regression wih Time Series Daa y = β 0 + β 1 x 1 +...+ β k x k + u Serial Correlaion and Heeroskedasiciy Time Series - Serial Correlaion and Heeroskedasiciy 1 Serially Correlaed Errors: Consequences Wih

More information

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8) I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression

More information

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance

More information

Dynamic Models, Autocorrelation and Forecasting

Dynamic Models, Autocorrelation and Forecasting ECON 4551 Economerics II Memorial Universiy of Newfoundland Dynamic Models, Auocorrelaion and Forecasing Adaped from Vera Tabakova s noes 9.1 Inroducion 9.2 Lags in he Error Term: Auocorrelaion 9.3 Esimaing

More information

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t Exercise 7 C P = α + β R P + u C = αp + βr + v (a) (b) C R = α P R + β + w (c) Assumpions abou he disurbances u, v, w : Classical assumions on he disurbance of one of he equaions, eg. on (b): E(v v s P,

More information

Nonstationarity-Integrated Models. Time Series Analysis Dr. Sevtap Kestel 1

Nonstationarity-Integrated Models. Time Series Analysis Dr. Sevtap Kestel 1 Nonsaionariy-Inegraed Models Time Series Analysis Dr. Sevap Kesel 1 Diagnosic Checking Residual Analysis: Whie noise. P-P or Q-Q plos of he residuals follow a normal disribuion, he series is called a Gaussian

More information

Exponential Smoothing

Exponential Smoothing Exponenial moohing Inroducion A simple mehod for forecasing. Does no require long series. Enables o decompose he series ino a rend and seasonal effecs. Paricularly useful mehod when here is a need o forecas

More information

- The whole joint distribution is independent of the date at which it is measured and depends only on the lag.

- The whole joint distribution is independent of the date at which it is measured and depends only on the lag. Saionary Processes Sricly saionary - The whole join disribuion is indeenden of he dae a which i is measured and deends only on he lag. - E y ) is a finie consan. ( - V y ) is a finie consan. ( ( y, y s

More information

Properties of Autocorrelated Processes Economics 30331

Properties of Autocorrelated Processes Economics 30331 Properies of Auocorrelaed Processes Economics 3033 Bill Evans Fall 05 Suppose we have ime series daa series labeled as where =,,3, T (he final period) Some examples are he dail closing price of he S&500,

More information

5. NONLINEAR MODELS [1] Nonlinear (NL) Regression Models

5. NONLINEAR MODELS [1] Nonlinear (NL) Regression Models 5. NONLINEAR MODELS [1] Nonlinear (NL) Regression Models General form of nonlinear or linear regression models: y = h(x,β) + ε, ε iid N(0,σ ). Assume ha he x and ε sochasically independen. his assumpion

More information

1. Diagnostic (Misspeci cation) Tests: Testing the Assumptions

1. Diagnostic (Misspeci cation) Tests: Testing the Assumptions Business School, Brunel Universiy MSc. EC5501/5509 Modelling Financial Decisions and Markes/Inroducion o Quaniaive Mehods Prof. Menelaos Karanasos (Room SS269, el. 01895265284) Lecure Noes 6 1. Diagnosic

More information

Types of Exponential Smoothing Methods. Simple Exponential Smoothing. Simple Exponential Smoothing

Types of Exponential Smoothing Methods. Simple Exponential Smoothing. Simple Exponential Smoothing M Business Forecasing Mehods Exponenial moohing Mehods ecurer : Dr Iris Yeung Room No : P79 Tel No : 788 8 Types of Exponenial moohing Mehods imple Exponenial moohing Double Exponenial moohing Brown s

More information

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number

More information

Lecture 3: Exponential Smoothing

Lecture 3: Exponential Smoothing NATCOR: Forecasing & Predicive Analyics Lecure 3: Exponenial Smoohing John Boylan Lancaser Cenre for Forecasing Deparmen of Managemen Science Mehods and Models Forecasing Mehod A (numerical) procedure

More information

ECON 482 / WH Hong Time Series Data Analysis 1. The Nature of Time Series Data. Example of time series data (inflation and unemployment rates)

ECON 482 / WH Hong Time Series Data Analysis 1. The Nature of Time Series Data. Example of time series data (inflation and unemployment rates) ECON 48 / WH Hong Time Series Daa Analysis. The Naure of Time Series Daa Example of ime series daa (inflaion and unemploymen raes) ECON 48 / WH Hong Time Series Daa Analysis The naure of ime series daa

More information

ACE 564 Spring Lecture 7. Extensions of The Multiple Regression Model: Dummy Independent Variables. by Professor Scott H.

ACE 564 Spring Lecture 7. Extensions of The Multiple Regression Model: Dummy Independent Variables. by Professor Scott H. ACE 564 Spring 2006 Lecure 7 Exensions of The Muliple Regression Model: Dumm Independen Variables b Professor Sco H. Irwin Readings: Griffihs, Hill and Judge. "Dumm Variables and Varing Coefficien Models

More information

Lecture 5. Time series: ECM. Bernardina Algieri Department Economics, Statistics and Finance

Lecture 5. Time series: ECM. Bernardina Algieri Department Economics, Statistics and Finance Lecure 5 Time series: ECM Bernardina Algieri Deparmen Economics, Saisics and Finance Conens Time Series Modelling Coinegraion Error Correcion Model Two Seps, Engle-Granger procedure Error Correcion Model

More information

Nature Neuroscience: doi: /nn Supplementary Figure 1. Spike-count autocorrelations in time.

Nature Neuroscience: doi: /nn Supplementary Figure 1. Spike-count autocorrelations in time. Supplemenary Figure 1 Spike-coun auocorrelaions in ime. Normalized auocorrelaion marices are shown for each area in a daase. The marix shows he mean correlaion of he spike coun in each ime bin wih he spike

More information

Introduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate.

Introduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate. Inroducion Gordon Model (1962): D P = r g r = consan discoun rae, g = consan dividend growh rae. If raional expecaions of fuure discoun raes and dividend growh vary over ime, so should he D/P raio. Since

More information

The Simple Linear Regression Model: Reporting the Results and Choosing the Functional Form

The Simple Linear Regression Model: Reporting the Results and Choosing the Functional Form Chaper 6 The Simple Linear Regression Model: Reporing he Resuls and Choosing he Funcional Form To complee he analysis of he simple linear regression model, in his chaper we will consider how o measure

More information

Vectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1

Vectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1 Vecorauoregressive Model and Coinegraion Analysis Par V Time Series Analysis Dr. Sevap Kesel 1 Vecorauoregression Vecor auoregression (VAR) is an economeric model used o capure he evoluion and he inerdependencies

More information

NCSS Statistical Software. , contains a periodic (cyclic) component. A natural model of the periodic component would be

NCSS Statistical Software. , contains a periodic (cyclic) component. A natural model of the periodic component would be NCSS Saisical Sofware Chaper 468 Specral Analysis Inroducion This program calculaes and displays he periodogram and specrum of a ime series. This is someimes nown as harmonic analysis or he frequency approach

More information

Solutions to Odd Number Exercises in Chapter 6

Solutions to Odd Number Exercises in Chapter 6 1 Soluions o Odd Number Exercises in 6.1 R y eˆ 1.7151 y 6.3 From eˆ ( T K) ˆ R 1 1 SST SST SST (1 R ) 55.36(1.7911) we have, ˆ 6.414 T K ( ) 6.5 y ye ye y e 1 1 Consider he erms e and xe b b x e y e b

More information

Lecture 15. Dummy variables, continued

Lecture 15. Dummy variables, continued Lecure 15. Dummy variables, coninued Seasonal effecs in ime series Consider relaion beween elecriciy consumpion Y and elecriciy price X. The daa are quarerly ime series. Firs model ln α 1 + α2 Y = ln X

More information

(10) (a) Derive and plot the spectrum of y. Discuss how the seasonality in the process is evident in spectrum.

(10) (a) Derive and plot the spectrum of y. Discuss how the seasonality in the process is evident in spectrum. January 01 Final Exam Quesions: Mark W. Wason (Poins/Minues are given in Parenheses) (15) 1. Suppose ha y follows he saionary AR(1) process y = y 1 +, where = 0.5 and ~ iid(0,1). Le x = (y + y 1 )/. (11)

More information

Distribution of Estimates

Distribution of Estimates Disribuion of Esimaes From Economerics (40) Linear Regression Model Assume (y,x ) is iid and E(x e )0 Esimaion Consisency y α + βx + he esimaes approach he rue values as he sample size increases Esimaion

More information

Methodology. -ratios are biased and that the appropriate critical values have to be increased by an amount. that depends on the sample size.

Methodology. -ratios are biased and that the appropriate critical values have to be increased by an amount. that depends on the sample size. Mehodology. Uni Roo Tess A ime series is inegraed when i has a mean revering propery and a finie variance. I is only emporarily ou of equilibrium and is called saionary in I(0). However a ime series ha

More information

Stability. Coefficients may change over time. Evolution of the economy Policy changes

Stability. Coefficients may change over time. Evolution of the economy Policy changes Sabiliy Coefficiens may change over ime Evoluion of he economy Policy changes Time Varying Parameers y = α + x β + Coefficiens depend on he ime period If he coefficiens vary randomly and are unpredicable,

More information

THE UNIVERSITY OF TEXAS AT AUSTIN McCombs School of Business

THE UNIVERSITY OF TEXAS AT AUSTIN McCombs School of Business THE UNIVERITY OF TEXA AT AUTIN McCombs chool of Business TA 7.5 Tom hively CLAICAL EAONAL DECOMPOITION - MULTIPLICATIVE MODEL Examples of easonaliy 8000 Quarerly sales for Wal-Mar for quarers a l e s 6000

More information

Summer Term Albert-Ludwigs-Universität Freiburg Empirische Forschung und Okonometrie. Time Series Analysis

Summer Term Albert-Ludwigs-Universität Freiburg Empirische Forschung und Okonometrie. Time Series Analysis Summer Term 2009 Alber-Ludwigs-Universiä Freiburg Empirische Forschung und Okonomerie Time Series Analysis Classical Time Series Models Time Series Analysis Dr. Sevap Kesel 2 Componens Hourly earnings:

More information

Box-Jenkins Modelling of Nigerian Stock Prices Data

Box-Jenkins Modelling of Nigerian Stock Prices Data Greener Journal of Science Engineering and Technological Research ISSN: 76-7835 Vol. (), pp. 03-038, Sepember 0. Research Aricle Box-Jenkins Modelling of Nigerian Sock Prices Daa Ee Harrison Euk*, Barholomew

More information

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin ACE 56 Fall 005 Lecure 4: Simple Linear Regression Model: Specificaion and Esimaion by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Simple Regression: Economic and Saisical Model

More information

TÁMOP /2/A/KMR

TÁMOP /2/A/KMR ECONOMIC STATISTICS ECONOMIC STATISTICS Sonsored by a Gran TÁMOP-4..2-08/2/A/KMR-2009-004 Course Maerial Develoed by Dearmen of Economics, Faculy of Social Sciences, Eövös Loránd Universiy Budaes (ELTE)

More information

Financial Econometrics Jeffrey R. Russell Midterm Winter 2009 SOLUTIONS

Financial Econometrics Jeffrey R. Russell Midterm Winter 2009 SOLUTIONS Name SOLUTIONS Financial Economerics Jeffrey R. Russell Miderm Winer 009 SOLUTIONS You have 80 minues o complee he exam. Use can use a calculaor and noes. Try o fi all your work in he space provided. If

More information

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when

More information

Forecasting. Summary. Sample StatFolio: tsforecast.sgp. STATGRAPHICS Centurion Rev. 9/16/2013

Forecasting. Summary. Sample StatFolio: tsforecast.sgp. STATGRAPHICS Centurion Rev. 9/16/2013 STATGRAPHICS Cenurion Rev. 9/16/2013 Forecasing Summary... 1 Daa Inpu... 3 Analysis Opions... 5 Forecasing Models... 9 Analysis Summary... 21 Time Sequence Plo... 23 Forecas Table... 24 Forecas Plo...

More information

GDP Advance Estimate, 2016Q4

GDP Advance Estimate, 2016Q4 GDP Advance Esimae, 26Q4 Friday, Jan 27 Real gross domesic produc (GDP) increased a an annual rae of.9 percen in he fourh quarer of 26. The deceleraion in real GDP in he fourh quarer refleced a downurn

More information

14 Autoregressive Moving Average Models

14 Autoregressive Moving Average Models 14 Auoregressive Moving Average Models In his chaper an imporan parameric family of saionary ime series is inroduced, he family of he auoregressive moving average, or ARMA, processes. For a large class

More information

ψ(t) = V x (0)V x (t)

ψ(t) = V x (0)V x (t) .93 Home Work Se No. (Professor Sow-Hsin Chen Spring Term 5. Due March 7, 5. This problem concerns calculaions of analyical expressions for he self-inermediae scaering funcion (ISF of he es paricle in

More information

The Effect of Nonzero Autocorrelation Coefficients on the Distributions of Durbin-Watson Test Estimator: Three Autoregressive Models

The Effect of Nonzero Autocorrelation Coefficients on the Distributions of Durbin-Watson Test Estimator: Three Autoregressive Models EJ Exper Journal of Economi c s ( 4 ), 85-9 9 4 Th e Au h or. Publi sh ed by Sp rin In v esify. ISS N 3 5 9-7 7 4 Econ omics.e xp erjou rn a ls.com The Effec of Nonzero Auocorrelaion Coefficiens on he

More information

Outline. lse-logo. Outline. Outline. 1 Wald Test. 2 The Likelihood Ratio Test. 3 Lagrange Multiplier Tests

Outline. lse-logo. Outline. Outline. 1 Wald Test. 2 The Likelihood Ratio Test. 3 Lagrange Multiplier Tests Ouline Ouline Hypohesis Tes wihin he Maximum Likelihood Framework There are hree main frequenis approaches o inference wihin he Maximum Likelihood framework: he Wald es, he Likelihood Raio es and he Lagrange

More information

4.1 Other Interpretations of Ridge Regression

4.1 Other Interpretations of Ridge Regression CHAPTER 4 FURTHER RIDGE THEORY 4. Oher Inerpreaions of Ridge Regression In his secion we will presen hree inerpreaions for he use of ridge regression. The firs one is analogous o Hoerl and Kennard reasoning

More information

Chapter 16. Regression with Time Series Data

Chapter 16. Regression with Time Series Data Chaper 16 Regression wih Time Series Daa The analysis of ime series daa is of vial ineres o many groups, such as macroeconomiss sudying he behavior of naional and inernaional economies, finance economiss

More information

STAD57 Time Series Analysis. Lecture 14

STAD57 Time Series Analysis. Lecture 14 STAD57 Time Series Analysis Lecure 14 1 Maximum Likelihood AR(p) Esimaion Insead of Yule-Walker (MM) for AR(p) model, can use Maximum Likelihood (ML) esimaion Likelihood is join densiy of daa {x 1,,x n

More information

Modeling and Forecasting Volatility Autoregressive Conditional Heteroskedasticity Models. Economic Forecasting Anthony Tay Slide 1

Modeling and Forecasting Volatility Autoregressive Conditional Heteroskedasticity Models. Economic Forecasting Anthony Tay Slide 1 Modeling and Forecasing Volailiy Auoregressive Condiional Heeroskedasiciy Models Anhony Tay Slide 1 smpl @all line(m) sii dl_sii S TII D L _ S TII 4,000. 3,000.1.0,000 -.1 1,000 -. 0 86 88 90 9 94 96 98

More information

Exercise: Building an Error Correction Model of Private Consumption. Part II Testing for Cointegration 1

Exercise: Building an Error Correction Model of Private Consumption. Part II Testing for Cointegration 1 Bo Sjo 200--24 Exercise: Building an Error Correcion Model of Privae Consumpion. Par II Tesing for Coinegraion Learning objecives: This lab inroduces esing for he order of inegraion and coinegraion. The

More information

Chapter 15. Time Series: Descriptive Analyses, Models, and Forecasting

Chapter 15. Time Series: Descriptive Analyses, Models, and Forecasting Chaper 15 Time Series: Descripive Analyses, Models, and Forecasing Descripive Analysis: Index Numbers Index Number a number ha measures he change in a variable over ime relaive o he value of he variable

More information

Økonomisk Kandidateksamen 2005(II) Econometrics 2. Solution

Økonomisk Kandidateksamen 2005(II) Econometrics 2. Solution Økonomisk Kandidaeksamen 2005(II) Economerics 2 Soluion his is he proposed soluion for he exam in Economerics 2. For compleeness he soluion gives formal answers o mos of he quesions alhough his is no always

More information

Smoothing. Backward smoother: At any give T, replace the observation yt by a combination of observations at & before T

Smoothing. Backward smoother: At any give T, replace the observation yt by a combination of observations at & before T Smoohing Consan process Separae signal & noise Smooh he daa: Backward smooher: A an give, replace he observaion b a combinaion of observaions a & before Simple smooher : replace he curren observaion wih

More information

Section 4 NABE ASTEF 232

Section 4 NABE ASTEF 232 Secion 4 NABE ASTEF 3 APPLIED ECONOMETRICS: TIME-SERIES ANALYSIS 33 Inroducion and Review The Naure of Economic Modeling Judgemen calls unavoidable Economerics an ar Componens of Applied Economerics Specificaion

More information

GMM - Generalized Method of Moments

GMM - Generalized Method of Moments GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................

More information

12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j =

12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j = 1: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME Moving Averages Recall ha a whie noise process is a series { } = having variance σ. The whie noise process has specral densiy f (λ) = of

More information

Lecture 10 Estimating Nonlinear Regression Models

Lecture 10 Estimating Nonlinear Regression Models Lecure 0 Esimaing Nonlinear Regression Models References: Greene, Economeric Analysis, Chaper 0 Consider he following regression model: y = f(x, β) + ε =,, x is kx for each, β is an rxconsan vecor, ε is

More information

Chapter 5. Heterocedastic Models. Introduction to time series (2008) 1

Chapter 5. Heterocedastic Models. Introduction to time series (2008) 1 Chaper 5 Heerocedasic Models Inroducion o ime series (2008) 1 Chaper 5. Conens. 5.1. The ARCH model. 5.2. The GARCH model. 5.3. The exponenial GARCH model. 5.4. The CHARMA model. 5.5. Random coefficien

More information

Generalized Least Squares

Generalized Least Squares Generalized Leas Squares Augus 006 1 Modified Model Original assumpions: 1 Specificaion: y = Xβ + ε (1) Eε =0 3 EX 0 ε =0 4 Eεε 0 = σ I In his secion, we consider relaxing assumpion (4) Insead, assume

More information

Linear Gaussian State Space Models

Linear Gaussian State Space Models Linear Gaussian Sae Space Models Srucural Time Series Models Level and Trend Models Basic Srucural Model (BSM Dynamic Linear Models Sae Space Model Represenaion Level, Trend, and Seasonal Models Time Varying

More information

Modeling Rainfall in Dhaka Division of Bangladesh Using Time Series Analysis.

Modeling Rainfall in Dhaka Division of Bangladesh Using Time Series Analysis. Journal of Mahemaical Modelling and Applicaion 01, Vol. 1, No.5, 67-73 ISSN: 178-43 67 Modeling Rainfall in Dhaka Division of Bangladesh Using Time Series Analysis. Md. Mahsin Insiue of Saisical Research

More information

Department of Economics East Carolina University Greenville, NC Phone: Fax:

Department of Economics East Carolina University Greenville, NC Phone: Fax: March 3, 999 Time Series Evidence on Wheher Adjusmen o Long-Run Equilibrium is Asymmeric Philip Rohman Eas Carolina Universiy Absrac The Enders and Granger (998) uni-roo es agains saionary alernaives wih

More information

ST4064. Time Series Analysis. Lecture notes

ST4064. Time Series Analysis. Lecture notes ST4064 Time Series Analysis ST4064 Time Series Analysis Lecure noes ST4064 Time Series Analysis Ouline I II Inroducion o ime series analysis Saionariy and ARMA modelling. Saionariy a. Definiions b. Sric

More information

Mathcad Lecture #8 In-class Worksheet Curve Fitting and Interpolation

Mathcad Lecture #8 In-class Worksheet Curve Fitting and Interpolation Mahcad Lecure #8 In-class Workshee Curve Fiing and Inerpolaion A he end of his lecure, you will be able o: explain he difference beween curve fiing and inerpolaion decide wheher curve fiing or inerpolaion

More information

Chickens vs. Eggs: Replicating Thurman and Fisher (1988) by Arianto A. Patunru Department of Economics, University of Indonesia 2004

Chickens vs. Eggs: Replicating Thurman and Fisher (1988) by Arianto A. Patunru Department of Economics, University of Indonesia 2004 Chicens vs. Eggs: Relicaing Thurman and Fisher (988) by Ariano A. Paunru Dearmen of Economics, Universiy of Indonesia 2004. Inroducion This exercise lays ou he rocedure for esing Granger Causaliy as discussed

More information

Applied Time Series Notes White noise: e t mean 0, variance 5 2 uncorrelated Moving Average

Applied Time Series Notes White noise: e t mean 0, variance 5 2 uncorrelated Moving Average Applied Time Series Noes Whie noise: e mean 0, variance 5 uncorrelaed Moving Average Order 1: (Y. ) œ e ) 1e -1 all Order q: (Y. ) œ e ) e â ) e all 1-1 q -q ( 14 ) Infinie order: (Y. ) œ e ) 1e -1 ) e

More information

Let. x y. denote a bivariate time series with zero mean.

Let. x y. denote a bivariate time series with zero mean. Linear Filer Le x y : T denoe a bivariae ime erie wih zero mean. Suppoe ha he ime erie {y : T} i conruced a follow: y a x The ime erie {y : T} i aid o be conruced from {x : T} by mean of a Linear Filer.

More information

Dynamic Econometric Models: Y t = + 0 X t + 1 X t X t k X t-k + e t. A. Autoregressive Model:

Dynamic Econometric Models: Y t = + 0 X t + 1 X t X t k X t-k + e t. A. Autoregressive Model: Dynamic Economeric Models: A. Auoregressive Model: Y = + 0 X 1 Y -1 + 2 Y -2 + k Y -k + e (Wih lagged dependen variable(s) on he RHS) B. Disribued-lag Model: Y = + 0 X + 1 X -1 + 2 X -2 + + k X -k + e

More information

Wednesday, November 7 Handout: Heteroskedasticity

Wednesday, November 7 Handout: Heteroskedasticity Amhers College Deparmen of Economics Economics 360 Fall 202 Wednesday, November 7 Handou: Heeroskedasiciy Preview Review o Regression Model o Sandard Ordinary Leas Squares (OLS) Premises o Esimaion Procedures

More information

(a) Set up the least squares estimation procedure for this problem, which will consist in minimizing the sum of squared residuals. 2 t.

(a) Set up the least squares estimation procedure for this problem, which will consist in minimizing the sum of squared residuals. 2 t. Insrucions: The goal of he problem se is o undersand wha you are doing raher han jus geing he correc resul. Please show your work clearly and nealy. No credi will be given o lae homework, regardless of

More information

How to Deal with Structural Breaks in Practical Cointegration Analysis

How to Deal with Structural Breaks in Practical Cointegration Analysis How o Deal wih Srucural Breaks in Pracical Coinegraion Analysis Roselyne Joyeux * School of Economic and Financial Sudies Macquarie Universiy December 00 ABSTRACT In his noe we consider he reamen of srucural

More information

Chapter 3, Part IV: The Box-Jenkins Approach to Model Building

Chapter 3, Part IV: The Box-Jenkins Approach to Model Building Chaper 3, Par IV: The Box-Jenkins Approach o Model Building The ARMA models have been found o be quie useful for describing saionary nonseasonal ime series. A parial explanaion for his fac is provided

More information

7 Detrending. 7.1 Identifying trend: a frequency-domain approach

7 Detrending. 7.1 Identifying trend: a frequency-domain approach 7 Derending Trend in a ime series is a slow, gradual change in some propery of he series over he whole inerval under invesigaion. Trend is someimes loosely defined as a long erm change in he mean, bu can

More information

Innova Junior College H2 Mathematics JC2 Preliminary Examinations Paper 2 Solutions 0 (*)

Innova Junior College H2 Mathematics JC2 Preliminary Examinations Paper 2 Solutions 0 (*) Soluion 3 x 4x3 x 3 x 0 4x3 x 4x3 x 4x3 x 4x3 x x 3x 3 4x3 x Innova Junior College H Mahemaics JC Preliminary Examinaions Paper Soluions 3x 3 4x 3x 0 4x 3 4x 3 0 (*) 0 0 + + + - 3 3 4 3 3 3 3 Hence x or

More information

You must fully interpret your results. There is a relationship doesn t cut it. Use the text and, especially, the SPSS Manual for guidance.

You must fully interpret your results. There is a relationship doesn t cut it. Use the text and, especially, the SPSS Manual for guidance. POLI 30D SPRING 2015 LAST ASSIGNMENT TRUMPETS PLEASE!!!!! Due Thursday, December 10 (or sooner), by 7PM hrough TurnIIn I had his all se up in my mind. You would use regression analysis o follow up on your

More information

Fourier Transformation on Model Fitting for Pakistan Inflation Rate

Fourier Transformation on Model Fitting for Pakistan Inflation Rate Fourier Transformaion on Model Fiing for Pakisan Inflaion Rae Anam Iqbal (Corresponding auhor) Dep. of Saisics, Gov. Pos Graduae College (w), Sargodha, Pakisan Tel: 92-321-603-4232 E-mail: anammughal343@gmail.com

More information

Unit Root Time Series. Univariate random walk

Unit Root Time Series. Univariate random walk Uni Roo ime Series Univariae random walk Consider he regression y y where ~ iid N 0, he leas squares esimae of is: ˆ yy y y yy Now wha if = If y y hen le y 0 =0 so ha y j j If ~ iid N 0, hen y ~ N 0, he

More information

Testing the Random Walk Model. i.i.d. ( ) r

Testing the Random Walk Model. i.i.d. ( ) r he random walk heory saes: esing he Random Walk Model µ ε () np = + np + Momen Condiions where where ε ~ i.i.d he idea here is o es direcly he resricions imposed by momen condiions. lnp lnp µ ( lnp lnp

More information

Use of Unobserved Components Model for Forecasting Non-stationary Time Series: A Case of Annual National Coconut Production in Sri Lanka

Use of Unobserved Components Model for Forecasting Non-stationary Time Series: A Case of Annual National Coconut Production in Sri Lanka Tropical Agriculural Research Vol. 5 (4): 53 531 (014) Use of Unobserved Componens Model for Forecasing Non-saionary Time Series: A Case of Annual Naional Coconu Producion in Sri Lanka N.K.K. Brinha, S.

More information

y = β 1 + β 2 x (11.1.1)

y = β 1 + β 2 x (11.1.1) Chaper 11 Heeroskedasiciy 11.1 The Naure of Heeroskedasiciy In Chaper 3 we inroduced he linear model y = β 1 + β x (11.1.1) o explain household expendiure on food (y) as a funcion of household income (x).

More information

Why is Chinese Provincial Output Diverging? Joakim Westerlund, University of Gothenburg David Edgerton, Lund University Sonja Opper, Lund University

Why is Chinese Provincial Output Diverging? Joakim Westerlund, University of Gothenburg David Edgerton, Lund University Sonja Opper, Lund University Why is Chinese Provincial Oupu Diverging? Joakim Weserlund, Universiy of Gohenburg David Edgeron, Lund Universiy Sonja Opper, Lund Universiy Purpose of his paper. We re-examine he resul of Pedroni and

More information

Institute for Mathematical Methods in Economics. University of Technology Vienna. Singapore, May Manfred Deistler

Institute for Mathematical Methods in Economics. University of Technology Vienna. Singapore, May Manfred Deistler MULTIVARIATE TIME SERIES ANALYSIS AND FORECASTING Manfred Deisler E O S Economerics and Sysems Theory Insiue for Mahemaical Mehods in Economics Universiy of Technology Vienna Singapore, May 2004 Inroducion

More information

Mechanical Fatigue and Load-Induced Aging of Loudspeaker Suspension. Wolfgang Klippel,

Mechanical Fatigue and Load-Induced Aging of Loudspeaker Suspension. Wolfgang Klippel, Mechanical Faigue and Load-Induced Aging of Loudspeaker Suspension Wolfgang Klippel, Insiue of Acousics and Speech Communicaion Dresden Universiy of Technology presened a he ALMA Symposium 2012, Las Vegas

More information

Chapter 2. First Order Scalar Equations

Chapter 2. First Order Scalar Equations Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.

More information

Advanced Organic Chemistry

Advanced Organic Chemistry Lalic, G. Chem 53A Chemisry 53A Advanced Organic Chemisry Lecure noes 1 Kineics: A racical Approach Simple Kineics Scenarios Fiing Experimenal Daa Using Kineics o Deermine he Mechanism Doughery, D. A.,

More information

Chapter 11. Heteroskedasticity The Nature of Heteroskedasticity. In Chapter 3 we introduced the linear model (11.1.1)

Chapter 11. Heteroskedasticity The Nature of Heteroskedasticity. In Chapter 3 we introduced the linear model (11.1.1) Chaper 11 Heeroskedasiciy 11.1 The Naure of Heeroskedasiciy In Chaper 3 we inroduced he linear model y = β+β x (11.1.1) 1 o explain household expendiure on food (y) as a funcion of household income (x).

More information

A Specification Test for Linear Dynamic Stochastic General Equilibrium Models

A Specification Test for Linear Dynamic Stochastic General Equilibrium Models Journal of Saisical and Economeric Mehods, vol.1, no.2, 2012, 65-70 ISSN: 2241-0384 (prin), 2241-0376 (online) Scienpress Ld, 2012 A Specificaion Tes for Linear Dynamic Sochasic General Equilibrium Models

More information

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé Bias in Condiional and Uncondiional Fixed Effecs Logi Esimaion: a Correcion * Tom Coupé Economics Educaion and Research Consorium, Naional Universiy of Kyiv Mohyla Academy Address: Vul Voloska 10, 04070

More information

BOX-JENKINS MODEL NOTATION. The Box-Jenkins ARMA(p,q) model is denoted by the equation. pwhile the moving average (MA) part of the model is θ1at

BOX-JENKINS MODEL NOTATION. The Box-Jenkins ARMA(p,q) model is denoted by the equation. pwhile the moving average (MA) part of the model is θ1at BOX-JENKINS MODEL NOAION he Box-Jenkins ARMA(,q) model is denoed b he equaion + + L+ + a θ a L θ a 0 q q. () he auoregressive (AR) ar of he model is + L+ while he moving average (MA) ar of he model is

More information

FORECASTING WITH REGRESSION

FORECASTING WITH REGRESSION FORECASTING WITH REGRESSION MODELS Overview of basic regression echniques. Daa analysis and forecasing using muliple regression analysis. 106 Visualizaion of Four Differen Daa Ses Daa Se A Daa Se B Daa

More information

Linear Combinations of Volatility Forecasts for the WIG20 and Polish Exchange Rates

Linear Combinations of Volatility Forecasts for the WIG20 and Polish Exchange Rates Eliza Buszkowska Universiy of Poznań, Poland Linear Combinaions of Volailiy Forecass for he WIG0 and Polish Exchange Raes Absrak. As is known forecas combinaions may be beer forecass hen forecass obained

More information

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation Course Noes for EE7C Spring 018: Convex Opimizaion and Approximaion Insrucor: Moriz Hard Email: hard+ee7c@berkeley.edu Graduae Insrucor: Max Simchowiz Email: msimchow+ee7c@berkeley.edu Ocober 15, 018 3

More information