Stochastic Processes

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Stochastic Processes"

Transcription

1 Stochastic Processes Stochastic Process Non Formal Definition: Non formal: A stochastic process (random process) is the opposite of a deterministic process such as one defined by a differential equation. A stochastic process deals with more than one possible reality of how a process might evolve. This means that even if the starting point (initial condition) is known there are many paths that a process may follow some are more probable than others. For processes in time, a stochastic process is simply a process that develops in time according to probabilistic rules. Stochastic Process Formal Definition Stochastic Process (X) is a family of random variables, dependent upon a parameter which usually denotes time (T) and defined on some sample space (Ω). Mathematically, {X t, t є T} = { X t (ω), t є T, ω є Ω} Of course the parameter does not have to always denote time. It could be a vector representing location in space. In such a case the process will represent a random variable that varies across two dimensional space. In our case we will not delve into this level of details. Stochastic Processes Edited: February 2011 Page 1

2 Stochastic Process Discrete Time When T is a set of integers, representing specific time points we have a stochastic process in discrete time. In this case we generally define the random variable as X n. The random variable X n will depend on earlier values of the process, That is: X n 1, X n 2, Stochastic Processes Edited: February 2011 Page 2

3 Stochastic Process Continuous Time When T is the real line (or some interval of the real line) we have a stochastic process in continuous time. We will focus on this definition for our study. The random variable X(t) will depend on values of X(u) for u < t. Stochastic Processes Edited: February 2011 Page 3

4 Examples of Stochastic Processes Random Walk Models such as exchange rate data. In a random walk model changes in the rate are independent normal random variables with zero mean and standard deviation of the actual data. In essence, the upward and downward movement in the rate is equally likely and there is no scope for profiteering by speculation except by luck. Aside: J.P. Morgan s famous stock market prediction was that, Prices will fluctuate. Bachelier s Theory of Speculation in 1900 postulated that prices fluctuate randomly. These models make sense in a world where: 1. Most price changes result from temporary imbalances between buyers and sellers. 2. Stronger price shocks are unpredictable. 3. Under efficient capital market hypothesis the current price of a stock reflects all information about it. Stochastic Processes Edited: February 2011 Page 4

5 These models do not make sense if: 1. One believes in technical analysis 2. Random walk models assume that returns are normally or log normally distributed. Thus, frequency of extreme events is underestimated. NOTE: These models will be the focus of our study. Poisson Processes such as photon emissions. A photon is a minute particle of light measured by a special machine. The problem the machine has a dead time period. That is, after it counts the photon it has to recharge before it can count the next photon. Therefore, the counts are underestimated. A stochastic model would need to be formulated that not only deals with the emissions but also the dead time based on some probability of occurrence. A homogenous poisson process satisfies: o Starts at zero o It is stationary, and has independent increments o For every t > 0, X(t) has a poisson distribution NOTE: Because poisson processes are counting processes they inherently have a jump. Epidemics such as SARS. The disease is detected, spread, and eventually controlled to eradicate it. The question arises, how soon will it spread. How widespread will it be. How many should you vaccinate because some will die anyway so the ultimate goal of eradication is reached. The graphs generally have a peak when the epidemic is at its peak. Stochastic Processes Edited: February 2011 Page 5

6 Point Processes such as Earthquakes. Empirically we say that on average there is one earthquake per year. However, in actuality there are years when there have been no recorded earthquakes. Thus, there is a clustering effect in the processes. The question would be, is it related to magnitude? is it strictly by chance?, etc. Reproduction Processes Yeast cells. Mother yeast cells produces daughter yeast cells after a random time. Each daughter cell has to evolve to a mother stage before it can reproduce. But that evolution also takes a random time. Each cell can only reproduce a fixed number of times before it dies. Question, how many cells will there be give some fixed time. Evolutionary Processes Interest to evolutionary biologists. When they study gene behavior of plants. These processes all exhibit the Markov property. Stochastic Processes Edited: February 2011 Page 6

7 Definition of Terms Used in Stochastic Processes Recall: Financial Time Series for this course is a collection of financial measurements over time. Example the log returns over time can be stated as: { r t } = {r 1, r 2,, r T } for T observations Time Invariant A system in which all quantities that make up the systems behavior remain constant with time. That is, the system s response to a given input does not depend on the time it is applied. For example: System A: not time in variant System B: 10 time invariant White Noise White Noise is a simple type of stochastic process (random signal) whose terms are iid with zero mean. However, the iid requirement is too restrictive in practice. A Gaussian white noise is a stochastic process having the following characteristics: Mean = zero. Variance is finite. Zero autocorrelations. Finite Dimensional Disturbances (fidis) A fidis of the stochastic process X are the distributions of the finite dimensional vectors,,, t 1,, t n є T for all possible choices of times t i and every n 1. A collection of fidis is the distribution of the stochastic process. Stochastic Processes Edited: February 2011 Page 7

8 Stationarity A strict stationary process is a stochastic process whose joint probability distribution does not change when shifted in time or space. Thus, Stationarity explores the timeinvariant behavior of a time series. Determining the stationarity condition of the time series allows for proper identification and development of forecasting models. Two types of Stationarities: Strict Stationarity distributions are time invariant Weak Stationarity only the first 2 moments are time invariant. That is, the data values fluctuate with constant variation around a constant level. How used in Time Series Analysis Raw data are often transformed to remove the trend effect (de trended). If the time plot of { r t } varies around a fixed level with a finite range the series is said to be weakly stationary. The first 2 moments of future r t are the same as those of the data we infer the series is weakly stationary. Most financial time series exhibit weak form stationarity. Markov Property Given the present (X k 1 ) the future (X k ) is independent of the past (X k 1, X k 3,, X 1 ). In other words, the lack of memory property of a time series. Counting Process It is a process X(t) in discrete or continuous time for which the possible values of X(t) are the natural numbers (0, 1, 2, ) with the property that X(t) is a non decreasing function of t. Stochastic Processes Edited: February 2011 Page 8

9 A Sample Path A sample path of a stochastic process is a particular realization of the process. That is, a particular set of values X(t) for all t, which is generated according to the (stochastic) rules of the process. Increments An increments of a stochastic process are the changes X(t) X(s) between time points s and t (s < t). Processes in which the increments for non overlapping time intervals are independent and stationary are of important. Examples: Random Walks. Levy processes such as Poisson processes; and Brownian Motion. Stochastic Processes Edited: February 2011 Page 9

10 Statistical Measures for Linear Time Series Gaussian Processes A stochastic process is called Gaussian if all its fidis are multivariate Gaussian. The distribution of a Gaussian stochastic process is determined only by the collection of the expectations and covariance matrices of the fidis. Mean or Expectation Variance Mean and Variance of Returns To Test H 0 : µ = 0 v/s H 0 : µ 0 compute, / ~ 0,1 Reject H 0 of zero mean if t > Z α/2 Covariance and Correlation The covariance of random variables X and Y is defined: Cov(X,Y) = E[(X µ x )(Y µ y )]. If X and Y are in sync the covariances will be high; If they are independent, the positive and negative terms should cancel out to give a score around zero. Stochastic Processes Edited: February 2011 Page 10

11 The lag l auto covariance Cov(r t, r t 1 ) = γ l has two interesting properties: γ 0 = Var(r t ); γ l = γ l 1 The correlation coefficient of random variables X and Y, is defined:,,, It measures the strength of linear dependence between X and Y, and lies between ± 1. Correlation and Causation NOTE: Correlation does not imply causation. The meaningfulness of the correlation can be evaluated by considering: the number of pairs tested the number of points in each time series the sniff test statistical tests Lag k auto covariance, Serial (or auto ) correlations, Existence of serial correlation implies that the return is predictable indicating market inefficiency. Aside: Market inefficiency is a condition that occurs when the current prices don t reflect the available information regarding securities. Stochastic Processes Edited: February 2011 Page 11

12 Sample Autocorrelation Function (ACF) Where: is the sample mean and T is the sample size Test zero serial correlations (market efficiency) Single Test : 0 : 0 1 ~ 0,1 Reject H 0 if t > Z α/2 Joint Test Ljung Box statistics : 0 : 0 2 ~ Reject H 0 if Q(m) > Stochastic Processes Edited: February 2011 Page 12

13 What are we looking for when studying autocorrelations? If stock returns are truly random, we expect all lags to show a correlation of around zero. Today s volatility is a good predictor for tomorrow, so we expect high autocorrelations for short lags. Macro variables such as today s sales are a good predictor for yesterday s sales, so we expect high autocorrelations for short lags. If the analysis period is changed you may be able to study day of week effects, or day of year effects. These will show up as lags of 7, and 365 respectively. Stochastic Processes Edited: February 2011 Page 13

14 Univariate Time Series Purpose 1. A model for 2. Understanding models for : properties, forecasting, etc. Linear Time Series is linear if the predictable part is a linear function of F t 1, and are independent and have the same distribution (iid). That is, Where: : is a constant 1 associated with impulse responses is an iid sequence with mean zero and a well defined distribution. Generally these are shock (or innovations) Univariate Linear Time Series Models 1. Autoregressive (AR) Models 2. Moving Average (MA) Models 3. Mixed ARMA Models 4. Seasonal Models 5. Regression Models with Time Series Errors 6. Fractionally differenced Models (long memory models) Stochastic Processes Edited: February 2011 Page 14

15 Important Properties of a Model 1. Stationarity Conditions 2. Basic properties: mean, variance, and serial dependence 3. Empirical model building: specification, estimation, and checking 4. Forecasting Consideration for Empirical Model Building 1. Ethical and Financial considerations 2. Art as much as a Science 3. How much detail over / under specification 4. NOTE: All models are wrong that is they only approximate reality they are not the reality 5. Constant tweaking is essential before one that stands the test of time is found Stochastic Processes Edited: February 2011 Page 15

16 AR Models Simple AR Models: Similar to a Simple Linear Regression model with lagged variables. AR(1) Model An AR(1) model can be stated as follows: Where:, : are real numbers, which are referred to as parameters. : is assumed to be a white noise series with mean = 0 and a finite variance. AR(p) Model An AR(p) model (similar to a multiple regression model with lagged variables) can be stated as follows: Both models suggest that the past period values jointly determine the conditional expectation of today s value. Stochastic Processes Edited: February 2011 Page 16

17 Properties of AR(1) Model Stationarity Assume: weak stationarity a necessary and sufficient condition is 1 < 1 Recall: Under stationarity E(r t ) = E(r t 1 ) = µ. Therefore, taking the expectation of We have, And the Mean = μ Recall: Under stationarity Var(r t ) = Var(r t 1 ). Therefore, taking the square and expectation of: We have, μ μ Or, the Variance = Stochastic Processes Edited: February 2011 Page 17

18 Autocorrelations: ρ0 1, ρ1 1, ρ2, etc. In general, ρk, and ACF ρk decays exponentially as k increases. Note: if 1 0, the decay rate 1. If if 1 0 the decay rate Stochastic Processes Edited: February 2011 Page 18

19 AR(2) Model An AR(2) model can be stated as follows: Where:,, : are real numbers, which are referred to as parameters. : is assumed to be a white noise series with mean = 0 and a finite variance. Stationarity of AR(2) Stochastic Processes Edited: February 2011 Page 19

Prof. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis

Prof. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis Introduction to Time Series Analysis 1 Contents: I. Basics of Time Series Analysis... 4 I.1 Stationarity... 5 I.2 Autocorrelation Function... 9 I.3 Partial Autocorrelation Function (PACF)... 14 I.4 Transformation

More information

Empirical Market Microstructure Analysis (EMMA)

Empirical Market Microstructure Analysis (EMMA) Empirical Market Microstructure Analysis (EMMA) Lecture 3: Statistical Building Blocks and Econometric Basics Prof. Dr. Michael Stein michael.stein@vwl.uni-freiburg.de Albert-Ludwigs-University of Freiburg

More information

1. Fundamental concepts

1. Fundamental concepts . Fundamental concepts A time series is a sequence of data points, measured typically at successive times spaced at uniform intervals. Time series are used in such fields as statistics, signal processing

More information

Multivariate GARCH models.

Multivariate GARCH models. Multivariate GARCH models. Financial market volatility moves together over time across assets and markets. Recognizing this commonality through a multivariate modeling framework leads to obvious gains

More information

Chapter 2: Unit Roots

Chapter 2: Unit Roots Chapter 2: Unit Roots 1 Contents: Lehrstuhl für Department Empirische of Wirtschaftsforschung Empirical Research and undeconometrics II. Unit Roots... 3 II.1 Integration Level... 3 II.2 Nonstationarity

More information

Time Series: Theory and Methods

Time Series: Theory and Methods Peter J. Brockwell Richard A. Davis Time Series: Theory and Methods Second Edition With 124 Illustrations Springer Contents Preface to the Second Edition Preface to the First Edition vn ix CHAPTER 1 Stationary

More information

For a stochastic process {Y t : t = 0, ±1, ±2, ±3, }, the mean function is defined by (2.2.1) ± 2..., γ t,

For a stochastic process {Y t : t = 0, ±1, ±2, ±3, }, the mean function is defined by (2.2.1) ± 2..., γ t, CHAPTER 2 FUNDAMENTAL CONCEPTS This chapter describes the fundamental concepts in the theory of time series models. In particular, we introduce the concepts of stochastic processes, mean and covariance

More information

Marcel Dettling. Applied Time Series Analysis FS 2012 Week 01. ETH Zürich, February 20, Institute for Data Analysis and Process Design

Marcel Dettling. Applied Time Series Analysis FS 2012 Week 01. ETH Zürich, February 20, Institute for Data Analysis and Process Design Marcel Dettling Institute for Data Analysis and Process Design Zurich University of Applied Sciences marcel.dettling@zhaw.ch http://stat.ethz.ch/~dettling ETH Zürich, February 20, 2012 1 Your Lecturer

More information

Basic concepts and terminology: AR, MA and ARMA processes

Basic concepts and terminology: AR, MA and ARMA processes ECON 5101 ADVANCED ECONOMETRICS TIME SERIES Lecture note no. 1 (EB) Erik Biørn, Department of Economics Version of February 1, 2011 Basic concepts and terminology: AR, MA and ARMA processes This lecture

More information

The Identification of ARIMA Models

The Identification of ARIMA Models APPENDIX 4 The Identification of ARIMA Models As we have established in a previous lecture, there is a one-to-one correspondence between the parameters of an ARMA(p, q) model, including the variance of

More information

1 Random walks and data

1 Random walks and data Inference, Models and Simulation for Complex Systems CSCI 7-1 Lecture 7 15 September 11 Prof. Aaron Clauset 1 Random walks and data Supposeyou have some time-series data x 1,x,x 3,...,x T and you want

More information

University of Oxford. Statistical Methods Autocorrelation. Identification and Estimation

University of Oxford. Statistical Methods Autocorrelation. Identification and Estimation University of Oxford Statistical Methods Autocorrelation Identification and Estimation Dr. Órlaith Burke Michaelmas Term, 2011 Department of Statistics, 1 South Parks Road, Oxford OX1 3TG Contents 1 Model

More information

Understanding Regressions with Observations Collected at High Frequency over Long Span

Understanding Regressions with Observations Collected at High Frequency over Long Span Understanding Regressions with Observations Collected at High Frequency over Long Span Yoosoon Chang Department of Economics, Indiana University Joon Y. Park Department of Economics, Indiana University

More information

Stat 5100 Handout #12.e Notes: ARIMA Models (Unit 7) Key here: after stationary, identify dependence structure (and use for forecasting)

Stat 5100 Handout #12.e Notes: ARIMA Models (Unit 7) Key here: after stationary, identify dependence structure (and use for forecasting) Stat 5100 Handout #12.e Notes: ARIMA Models (Unit 7) Key here: after stationary, identify dependence structure (and use for forecasting) (overshort example) White noise H 0 : Let Z t be the stationary

More information

EC408 Topics in Applied Econometrics. B Fingleton, Dept of Economics, Strathclyde University

EC408 Topics in Applied Econometrics. B Fingleton, Dept of Economics, Strathclyde University EC408 Topics in Applied Econometrics B Fingleton, Dept of Economics, Strathclyde University Applied Econometrics What is spurious regression? How do we check for stochastic trends? Cointegration and Error

More information

1.1. VARs, Wold representations and their limits

1.1. VARs, Wold representations and their limits 1. Shocks Nr. 1 1.1. VARs, Wold representations and their limits A brief review of VARs. Assume a true model, in MA form: X = A 0 e + A 1 e( 1) + A 2 e( 2) +...; E(ee ) = I = (A 0 + A 1 L + A 2 L 2 +...)

More information

MA Advanced Econometrics: Applying Least Squares to Time Series

MA Advanced Econometrics: Applying Least Squares to Time Series MA Advanced Econometrics: Applying Least Squares to Time Series Karl Whelan School of Economics, UCD February 15, 2011 Karl Whelan (UCD) Time Series February 15, 2011 1 / 24 Part I Time Series: Standard

More information

E 4101/5101 Lecture 9: Non-stationarity

E 4101/5101 Lecture 9: Non-stationarity E 4101/5101 Lecture 9: Non-stationarity Ragnar Nymoen 30 March 2011 Introduction I Main references: Hamilton Ch 15,16 and 17. Davidson and MacKinnon Ch 14.3 and 14.4 Also read Ch 2.4 and Ch 2.5 in Davidson

More information

The ARIMA Procedure: The ARIMA Procedure

The ARIMA Procedure: The ARIMA Procedure Page 1 of 120 Overview: ARIMA Procedure Getting Started: ARIMA Procedure The Three Stages of ARIMA Modeling Identification Stage Estimation and Diagnostic Checking Stage Forecasting Stage Using ARIMA Procedure

More information

11.1 Gujarati(2003): Chapter 12

11.1 Gujarati(2003): Chapter 12 11.1 Gujarati(2003): Chapter 12 Time Series Data 11.2 Time series process of economic variables e.g., GDP, M1, interest rate, echange rate, imports, eports, inflation rate, etc. Realization An observed

More information

APPLIED TIME SERIES ECONOMETRICS

APPLIED TIME SERIES ECONOMETRICS APPLIED TIME SERIES ECONOMETRICS Edited by HELMUT LÜTKEPOHL European University Institute, Florence MARKUS KRÄTZIG Humboldt University, Berlin CAMBRIDGE UNIVERSITY PRESS Contents Preface Notation and Abbreviations

More information

Test for Parameter Change in ARIMA Models

Test for Parameter Change in ARIMA Models Test for Parameter Change in ARIMA Models Sangyeol Lee 1 Siyun Park 2 Koichi Maekawa 3 and Ken-ichi Kawai 4 Abstract In this paper we consider the problem of testing for parameter changes in ARIMA models

More information

Financial Time Series Analysis: Part II

Financial Time Series Analysis: Part II Department of Mathematics and Statistics, University of Vaasa, Finland Spring 2017 1 Unit root Deterministic trend Stochastic trend Testing for unit root ADF-test (Augmented Dickey-Fuller test) Testing

More information

in the time series. The relation between y and x is contemporaneous.

in the time series. The relation between y and x is contemporaneous. 9 Regression with Time Series 9.1 Some Basic Concepts Static Models (1) y t = β 0 + β 1 x t + u t t = 1, 2,..., T, where T is the number of observation in the time series. The relation between y and x

More information

Vector Autoregression

Vector Autoregression Vector Autoregression Prabakar Rajasekaran December 13, 212 1 Introduction Vector autoregression (VAR) is an econometric model used to capture the evolution and the interdependencies between multiple time

More information

LATVIAN GDP: TIME SERIES FORECASTING USING VECTOR AUTO REGRESSION

LATVIAN GDP: TIME SERIES FORECASTING USING VECTOR AUTO REGRESSION LATVIAN GDP: TIME SERIES FORECASTING USING VECTOR AUTO REGRESSION BEZRUCKO Aleksandrs, (LV) Abstract: The target goal of this work is to develop a methodology of forecasting Latvian GDP using ARMA (AutoRegressive-Moving-Average)

More information

An Analysis of the INFFC Cotton Futures Time Series: Lower Bounds and Testbed Design Recommendations

An Analysis of the INFFC Cotton Futures Time Series: Lower Bounds and Testbed Design Recommendations An Analysis of the INFFC Cotton Futures Time Series: Lower Bounds and Testbed Design Recommendations Radu Drossu & Zoran Obradovic rdrossu@eecs.wsu.edu & zoran@eecs.wsu.edu School of Electrical Engineering

More information

On Monitoring Shift in the Mean Processes with. Vector Autoregressive Residual Control Charts of. Individual Observation

On Monitoring Shift in the Mean Processes with. Vector Autoregressive Residual Control Charts of. Individual Observation Applied Mathematical Sciences, Vol. 8, 14, no. 7, 3491-3499 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.12988/ams.14.44298 On Monitoring Shift in the Mean Processes with Vector Autoregressive Residual

More information

TESTING FOR CO-INTEGRATION PcGive and EViews 1

TESTING FOR CO-INTEGRATION PcGive and EViews 1 Bo Sjö 203--27 Lab 3 TESTING FOR CO-INTEGRATION PcGive and EViews To be used in combination with Sjö (203) Testing for Unit Roots and Cointegration A Guide and the special instructions below for EViews

More information

Forecasting Stock Prices using Hidden Markov Models and Support Vector Regression with Firefly Algorithm

Forecasting Stock Prices using Hidden Markov Models and Support Vector Regression with Firefly Algorithm June 20 22, 2017 Forecasting Sck Prices using Hidden Markov Models and Support Vecr Regression with Firefly Algorithm Joshua Reno S. Cantuba 1,*, Patrick Emilio U. Nicolas 1,*, and Frumencio F. Co 1 1Mathematics

More information

Time Series 3. Robert Almgren. Sept. 28, 2009

Time Series 3. Robert Almgren. Sept. 28, 2009 Time Series 3 Robert Almgren Sept. 28, 2009 Last time we discussed two main categories of linear models, and their combination. Here w t denotes a white noise: a stationary process with E w t ) = 0, E

More information

ARIMA Models. Jamie Monogan. January 25, University of Georgia. Jamie Monogan (UGA) ARIMA Models January 25, / 38

ARIMA Models. Jamie Monogan. January 25, University of Georgia. Jamie Monogan (UGA) ARIMA Models January 25, / 38 ARIMA Models Jamie Monogan University of Georgia January 25, 2012 Jamie Monogan (UGA) ARIMA Models January 25, 2012 1 / 38 Objectives By the end of this meeting, participants should be able to: Describe

More information

Part 1. Multiple Choice (50 questions, 1 point each) Part 2. Problems/Short Answer (10 questions, 5 points each)

Part 1. Multiple Choice (50 questions, 1 point each) Part 2. Problems/Short Answer (10 questions, 5 points each) GROUND RULES: This exam contains two parts: Part 1. Multiple Choice (50 questions, 1 point each) Part 2. Problems/Short Answer (10 questions, 5 points each) The maximum number of points on this exam is

More information

Teletrac modeling and estimation

Teletrac modeling and estimation Teletrac modeling and estimation File 1 José Roberto Amazonas Alexandre Barbosa de Lima jra,ablima@lcs.poli.usp.br Telecommunications and Control Engineering Dept. - PTC Escola Politécnica University of

More information

Available online at ScienceDirect. Procedia Computer Science 72 (2015 )

Available online at  ScienceDirect. Procedia Computer Science 72 (2015 ) Available online at www.sciencedirect.com ScienceDirect Procedia Computer Science 72 (2015 ) 630 637 The Third Information Systems International Conference Performance Comparisons Between Arima and Arimax

More information

Applied Time. Series Analysis. Wayne A. Woodward. Henry L. Gray. Alan C. Elliott. Dallas, Texas, USA

Applied Time. Series Analysis. Wayne A. Woodward. Henry L. Gray. Alan C. Elliott. Dallas, Texas, USA Applied Time Series Analysis Wayne A. Woodward Southern Methodist University Dallas, Texas, USA Henry L. Gray Southern Methodist University Dallas, Texas, USA Alan C. Elliott University of Texas Southwestern

More information

Serial Correlation. Edps/Psych/Stat 587. Carolyn J. Anderson. Fall Department of Educational Psychology

Serial Correlation. Edps/Psych/Stat 587. Carolyn J. Anderson. Fall Department of Educational Psychology Serial Correlation Edps/Psych/Stat 587 Carolyn J. Anderson Department of Educational Psychology c Board of Trustees, University of Illinois Fall 017 Model for Level 1 Residuals There are three sources

More information

Stochastic Processes. Monday, November 14, 11

Stochastic Processes. Monday, November 14, 11 Stochastic Processes 1 Definition and Classification X(, t): stochastic process: X : T! R (, t) X(, t) where is a sample space and T is time. {X(, t) is a family of r.v. defined on {, A, P and indexed

More information

What s more chaotic than chaos itself? Brownian Motion - before, after, and beyond.

What s more chaotic than chaos itself? Brownian Motion - before, after, and beyond. Include Only If Paper Has a Subtitle Department of Mathematics and Statistics What s more chaotic than chaos itself? Brownian Motion - before, after, and beyond. Math Graduate Seminar March 2, 2011 Outline

More information

Linear Regression. Junhui Qian. October 27, 2014

Linear Regression. Junhui Qian. October 27, 2014 Linear Regression Junhui Qian October 27, 2014 Outline The Model Estimation Ordinary Least Square Method of Moments Maximum Likelihood Estimation Properties of OLS Estimator Unbiasedness Consistency Efficiency

More information

γ 0 = Var(X i ) = Var(φ 1 X i 1 +W i ) = φ 2 1γ 0 +σ 2, which implies that we must have φ 1 < 1, and γ 0 = σ2 . 1 φ 2 1 We may also calculate for j 1

γ 0 = Var(X i ) = Var(φ 1 X i 1 +W i ) = φ 2 1γ 0 +σ 2, which implies that we must have φ 1 < 1, and γ 0 = σ2 . 1 φ 2 1 We may also calculate for j 1 4.2 Autoregressive (AR) Moving average models are causal linear processes by definition. There is another class of models, based on a recursive formulation similar to the exponentially weighted moving

More information

Normal Random Variables and Probability

Normal Random Variables and Probability Normal Random Variables and Probability An Undergraduate Introduction to Financial Mathematics J. Robert Buchanan 2015 Discrete vs. Continuous Random Variables Think about the probability of selecting

More information

The Functional Central Limit Theorem and Testing for Time Varying Parameters

The Functional Central Limit Theorem and Testing for Time Varying Parameters NBER Summer Institute Minicourse What s New in Econometrics: ime Series Lecture : July 4, 008 he Functional Central Limit heorem and esting for ime Varying Parameters Lecture -, July, 008 Outline. FCL.

More information

Cointegration and Tests of Purchasing Parity Anthony Mac Guinness- Senior Sophister

Cointegration and Tests of Purchasing Parity Anthony Mac Guinness- Senior Sophister Cointegration and Tests of Purchasing Parity Anthony Mac Guinness- Senior Sophister Most of us know Purchasing Power Parity as a sensible way of expressing per capita GNP; that is taking local price levels

More information

Stat 565. (S)Arima & Forecasting. Charlotte Wickham. stat565.cwick.co.nz. Feb

Stat 565. (S)Arima & Forecasting. Charlotte Wickham. stat565.cwick.co.nz. Feb Stat 565 (S)Arima & Forecasting Feb 2 2016 Charlotte Wickham stat565.cwick.co.nz Today A note from HW #3 Pick up with ARIMA processes Introduction to forecasting HW #3 The sample autocorrelation coefficients

More information

Introduction to Modern Time Series Analysis

Introduction to Modern Time Series Analysis Introduction to Modern Time Series Analysis Gebhard Kirchgässner, Jürgen Wolters and Uwe Hassler Second Edition Springer 3 Teaching Material The following figures and tables are from the above book. They

More information

1 Introduction to Generalized Least Squares

1 Introduction to Generalized Least Squares ECONOMICS 7344, Spring 2017 Bent E. Sørensen April 12, 2017 1 Introduction to Generalized Least Squares Consider the model Y = Xβ + ɛ, where the N K matrix of regressors X is fixed, independent of the

More information

KALMAN-TYPE RECURSIONS FOR TIME-VARYING ARMA MODELS AND THEIR IMPLICATION FOR LEAST SQUARES PROCEDURE ANTONY G AU T I E R (LILLE)

KALMAN-TYPE RECURSIONS FOR TIME-VARYING ARMA MODELS AND THEIR IMPLICATION FOR LEAST SQUARES PROCEDURE ANTONY G AU T I E R (LILLE) PROBABILITY AND MATHEMATICAL STATISTICS Vol 29, Fasc 1 (29), pp 169 18 KALMAN-TYPE RECURSIONS FOR TIME-VARYING ARMA MODELS AND THEIR IMPLICATION FOR LEAST SQUARES PROCEDURE BY ANTONY G AU T I E R (LILLE)

More information

CPSC 540: Machine Learning

CPSC 540: Machine Learning CPSC 540: Machine Learning MCMC and Non-Parametric Bayes Mark Schmidt University of British Columbia Winter 2016 Admin I went through project proposals: Some of you got a message on Piazza. No news is

More information

STAT Financial Time Series

STAT Financial Time Series STAT 6104 - Financial Time Series Chapter 9 - Heteroskedasticity Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 1 / 43 Agenda 1 Introduction 2 AutoRegressive Conditional Heteroskedastic Model (ARCH)

More information

Practicing forecasters seek techniques

Practicing forecasters seek techniques HOW TO SELECT A MOST EFFICIENT OLS MODEL FOR A TIME SERIES DATA By John C. Pickett, David P. Reilly and Robert M. McIntyre Ordinary Least Square (OLS) models are often used for time series data, though

More information

Eksamen på Økonomistudiet 2006-II Econometrics 2 June 9, 2006

Eksamen på Økonomistudiet 2006-II Econometrics 2 June 9, 2006 Eksamen på Økonomistudiet 2006-II Econometrics 2 June 9, 2006 This is a four hours closed-book exam (uden hjælpemidler). Please answer all questions. As a guiding principle the questions 1 to 4 have equal

More information

EC327: Advanced Econometrics, Spring 2007

EC327: Advanced Econometrics, Spring 2007 EC327: Advanced Econometrics, Spring 2007 Wooldridge, Introductory Econometrics (3rd ed, 2006) Chapter 14: Advanced panel data methods Fixed effects estimators We discussed the first difference (FD) model

More information

Forecasting Gold Price. A Comparative Study

Forecasting Gold Price. A Comparative Study Course of Financial Econometrics FIRM Forecasting Gold Price A Comparative Study Alessio Azzutti, University of Florence Abstract: This paper seeks to evaluate the appropriateness of a variety of existing

More information

Introduction to Probability Theory for Graduate Economics Fall 2008

Introduction to Probability Theory for Graduate Economics Fall 2008 Introduction to Probability Theory for Graduate Economics Fall 008 Yiğit Sağlam October 10, 008 CHAPTER - RANDOM VARIABLES AND EXPECTATION 1 1 Random Variables A random variable (RV) is a real-valued function

More information

A Primer on Vector Autoregressions

A Primer on Vector Autoregressions A Primer on Vector Autoregressions Ambrogio Cesa-Bianchi VAR models 1 [DISCLAIMER] These notes are meant to provide intuition on the basic mechanisms of VARs As such, most of the material covered here

More information

Nonsense Regressions due to Neglected Time-varying Means

Nonsense Regressions due to Neglected Time-varying Means Nonsense Regressions due to Neglected Time-varying Means Uwe Hassler Free University of Berlin Institute of Statistics and Econometrics Boltzmannstr. 20 D-14195 Berlin Germany email: uwe@wiwiss.fu-berlin.de

More information

Heteroskedasticity; Step Changes; VARMA models; Likelihood ratio test statistic; Cusum statistic.

Heteroskedasticity; Step Changes; VARMA models; Likelihood ratio test statistic; Cusum statistic. 47 3!,57 Statistics and Econometrics Series 5 Febrary 24 Departamento de Estadística y Econometría Universidad Carlos III de Madrid Calle Madrid, 126 2893 Getafe (Spain) Fax (34) 91 624-98-49 VARIANCE

More information

by Søren Johansen Department of Economics, University of Copenhagen and CREATES, Aarhus University

by Søren Johansen Department of Economics, University of Copenhagen and CREATES, Aarhus University 1 THE COINTEGRATED VECTOR AUTOREGRESSIVE MODEL WITH AN APPLICATION TO THE ANALYSIS OF SEA LEVEL AND TEMPERATURE by Søren Johansen Department of Economics, University of Copenhagen and CREATES, Aarhus University

More information

Random Number Generation. CS1538: Introduction to simulations

Random Number Generation. CS1538: Introduction to simulations Random Number Generation CS1538: Introduction to simulations Random Numbers Stochastic simulations require random data True random data cannot come from an algorithm We must obtain it from some process

More information

Applied Time Series Topics

Applied Time Series Topics Applied Time Series Topics Ivan Medovikov Brock University April 16, 2013 Ivan Medovikov, Brock University Applied Time Series Topics 1/34 Overview 1. Non-stationary data and consequences 2. Trends and

More information

Forecasting Ships Prices and Their Influence on Maritime Insurance Market

Forecasting Ships Prices and Their Influence on Maritime Insurance Market Forecasting Ships Prices and Their Influence on Maritime Insurance Market Ghiorghe Bătrînca Constanta Maritime University, Constanta, Romania gbatrinca@imc.ro Ana-Maria Burcă Academy of Economic Studies,

More information

Keller: Stats for Mgmt & Econ, 7th Ed July 17, 2006

Keller: Stats for Mgmt & Econ, 7th Ed July 17, 2006 Chapter 17 Simple Linear Regression and Correlation 17.1 Regression Analysis Our problem objective is to analyze the relationship between interval variables; regression analysis is the first tool we will

More information

Time Series Analysis (Econometrics II)

Time Series Analysis (Econometrics II) Time Series Analysis (Econometrics II) Saarland University PD Dr. Stefan Klößner Summer Term 2017 U N I V E R S I T A S S A R A V I E N I S S Time Series Analysis (SS 2017) Lecture 1 Slide 1 Topics of

More information

MISCELLANEOUS REGRESSION TOPICS

MISCELLANEOUS REGRESSION TOPICS DEPARTMENT OF POLITICAL SCIENCE AND INTERNATIONAL RELATIONS Posc/Uapp 816 MISCELLANEOUS REGRESSION TOPICS I. AGENDA: A. Example of correcting for autocorrelation. B. Regression with ordinary independent

More information

The Generalized Cochrane-Orcutt Transformation Estimation For Spurious and Fractional Spurious Regressions

The Generalized Cochrane-Orcutt Transformation Estimation For Spurious and Fractional Spurious Regressions The Generalized Cochrane-Orcutt Transformation Estimation For Spurious and Fractional Spurious Regressions Shin-Huei Wang and Cheng Hsiao Jan 31, 2010 Abstract This paper proposes a highly consistent estimation,

More information

CONTROL SYSTEMS, ROBOTICS, AND AUTOMATION - Vol. V - Prediction Error Methods - Torsten Söderström

CONTROL SYSTEMS, ROBOTICS, AND AUTOMATION - Vol. V - Prediction Error Methods - Torsten Söderström PREDICTIO ERROR METHODS Torsten Söderström Department of Systems and Control, Information Technology, Uppsala University, Uppsala, Sweden Keywords: prediction error method, optimal prediction, identifiability,

More information

Forecasting locally stationary time series

Forecasting locally stationary time series Forecasting locally stationary time series Rebecca Killick r.killick@lancs.ac.uk Joint work with Idris Eckley (Lancaster), Marina Knight (York) & Guy Nason (Bristol) June 30, 2014 Rebecca Killick (Lancaster

More information

Wavelet Analysis on financial time series

Wavelet Analysis on financial time series Wavelet Analysis on financial time series Tobias Setz Semester Thesis Winter 2011 Computational Science and Engineering, ETH Supervised by PD Diethelm Würtz Presented at the ZurichR on January 19 in 2012

More information

Beyond the color of the noise: what is memory in random phenomena?

Beyond the color of the noise: what is memory in random phenomena? Beyond the color of the noise: what is memory in random phenomena? Gennady Samorodnitsky Cornell University September 19, 2014 Randomness means lack of pattern or predictability in events according to

More information

Autocorrelation. Jamie Monogan. Intermediate Political Methodology. University of Georgia. Jamie Monogan (UGA) Autocorrelation POLS / 20

Autocorrelation. Jamie Monogan. Intermediate Political Methodology. University of Georgia. Jamie Monogan (UGA) Autocorrelation POLS / 20 Autocorrelation Jamie Monogan University of Georgia Intermediate Political Methodology Jamie Monogan (UGA) Autocorrelation POLS 7014 1 / 20 Objectives By the end of this meeting, participants should be

More information

Matching DSGE models,vars, and state space models. Fabio Canova EUI and CEPR September 2012

Matching DSGE models,vars, and state space models. Fabio Canova EUI and CEPR September 2012 Matching DSGE models,vars, and state space models Fabio Canova EUI and CEPR September 2012 Outline Alternative representations of the solution of a DSGE model. Fundamentalness and finite VAR representation

More information

Cointegration Lecture I: Introduction

Cointegration Lecture I: Introduction 1 Cointegration Lecture I: Introduction Julia Giese Nuffield College julia.giese@economics.ox.ac.uk Hilary Term 2008 2 Outline Introduction Estimation of unrestricted VAR Non-stationarity Deterministic

More information

CONTROL CHARTS FOR MULTIVARIATE NONLINEAR TIME SERIES

CONTROL CHARTS FOR MULTIVARIATE NONLINEAR TIME SERIES REVSTAT Statistical Journal Volume 13, Number, June 015, 131 144 CONTROL CHARTS FOR MULTIVARIATE NONLINEAR TIME SERIES Authors: Robert Garthoff Department of Statistics, European University, Große Scharrnstr.

More information

ARMA (and ARIMA) models are often expressed in backshift notation.

ARMA (and ARIMA) models are often expressed in backshift notation. Backshift Notation ARMA (and ARIMA) models are often expressed in backshift notation. B is the backshift operator (also called the lag operator ). It operates on time series, and means back up by one time

More information

Simultaneous Equation Models Learning Objectives Introduction Introduction (2) Introduction (3) Solving the Model structural equations

Simultaneous Equation Models Learning Objectives Introduction Introduction (2) Introduction (3) Solving the Model structural equations Simultaneous Equation Models. Introduction: basic definitions 2. Consequences of ignoring simultaneity 3. The identification problem 4. Estimation of simultaneous equation models 5. Example: IS LM model

More information

Analysis of the 500 mb height fields and waves: testing Rossby wave theory

Analysis of the 500 mb height fields and waves: testing Rossby wave theory Analysis of the 500 mb height fields and waves: testing Rossby wave theory Jeffrey D. Duda, Suzanne Morris, Michelle Werness, and Benjamin H. McNeill Department of Geologic and Atmospheric Sciences, Iowa

More information

Lecture 8a: Spurious Regression

Lecture 8a: Spurious Regression Lecture 8a: Spurious Regression 1 Old Stuff The traditional statistical theory holds when we run regression using (weakly or covariance) stationary variables. For example, when we regress one stationary

More information

Stochastic Problems. 1 Examples. 1.1 Neoclassical Growth Model with Stochastic Technology. 1.2 A Model of Job Search

Stochastic Problems. 1 Examples. 1.1 Neoclassical Growth Model with Stochastic Technology. 1.2 A Model of Job Search Stochastic Problems References: SLP chapters 9, 10, 11; L&S chapters 2 and 6 1 Examples 1.1 Neoclassical Growth Model with Stochastic Technology Production function y = Af k where A is random Let A s t

More information

Estimators of long range dependence A survey of finite samples and robustness

Estimators of long range dependence A survey of finite samples and robustness Estimators of long range dependence A survey of finite samples and robustness Lars Tjensvold Olsen Supervisor Jochen Jungeilges This Master s Thesis is carried out as a part of the education at the University

More information

Applied Regression Modeling: A Business Approach Chapter 2: Simple Linear Regression Sections

Applied Regression Modeling: A Business Approach Chapter 2: Simple Linear Regression Sections Applied Regression Modeling: A Business Approach Chapter 2: Simple Linear Regression Sections 2.1 2.3 by Iain Pardoe 2.1 Probability model for and 2 Simple linear regression model for and....................................

More information

Statistical concepts in climate research

Statistical concepts in climate research Statistical concepts in climate research (some misuses of statistics in climatology) Slava Kharin Canadian Centre for Climate Modelling and Analysis, Environment Canada, Victoria, British Columbia, Canada

More information

Verification of Air Temperature Variation with Form of Potential

Verification of Air Temperature Variation with Form of Potential Original Paper Forma, 6, 339 356, 00 Verification of Air Temperature Variation with Form of Potential Yuuki SHIMIZU and Hiroki TAKADA Institute for Hydrospheric-Atmospheric Sciences, Nagoya University,

More information

Bias-Correction in Vector Autoregressive Models: A Simulation Study

Bias-Correction in Vector Autoregressive Models: A Simulation Study Econometrics 2014, 2, 45-71; doi:10.3390/econometrics2010045 OPEN ACCESS econometrics ISSN 2225-1146 www.mdpi.com/journal/econometrics Article Bias-Correction in Vector Autoregressive Models: A Simulation

More information

Nonlinear Characterization of Activity Dynamics in Online Collaboration Websites

Nonlinear Characterization of Activity Dynamics in Online Collaboration Websites Nonlinear Characterization of Activity Dynamics in Online Collaboration Websites Tiago Santos 1 Simon Walk 2 Denis Helic 3 1 Know-Center, Graz, Austria 2 Stanford University 3 Graz University of Technology

More information

Order book resilience, price manipulation, and the positive portfolio problem

Order book resilience, price manipulation, and the positive portfolio problem Order book resilience, price manipulation, and the positive portfolio problem Alexander Schied Mannheim University Workshop on New Directions in Financial Mathematics Institute for Pure and Applied Mathematics,

More information

Stochastic Trends & Economic Fluctuations

Stochastic Trends & Economic Fluctuations Stochastic Trends & Economic Fluctuations King, Plosser, Stock & Watson (AER, 1991) Cesar E. Tamayo Econ508 - Economics - Rutgers November 14, 2011 Cesar E. Tamayo Stochastic Trends & Economic Fluctuations

More information

Weak Identification in Maximum Likelihood: A Question of Information

Weak Identification in Maximum Likelihood: A Question of Information Weak Identification in Maximum Likelihood: A Question of Information By Isaiah Andrews and Anna Mikusheva Weak identification commonly refers to the failure of classical asymptotics to provide a good approximation

More information

Application of Time Sequence Model Based on Excluded Seasonality in Daily Runoff Prediction

Application of Time Sequence Model Based on Excluded Seasonality in Daily Runoff Prediction Send Orders for Reprints to reprints@benthamscience.ae 546 The Open Cybernetics & Systemics Journal, 2014, 8, 546-552 Open Access Application of Time Sequence Model Based on Excluded Seasonality in Daily

More information

An algorithm for robust fitting of autoregressive models Dimitris N. Politis

An algorithm for robust fitting of autoregressive models Dimitris N. Politis An algorithm for robust fitting of autoregressive models Dimitris N. Politis Abstract: An algorithm for robust fitting of AR models is given, based on a linear regression idea. The new method appears to

More information

05 Regression with time lags: Autoregressive Distributed Lag Models. Andrius Buteikis,

05 Regression with time lags: Autoregressive Distributed Lag Models. Andrius Buteikis, 05 Regression with time lags: Autoregressive Distributed Lag Models Andrius Buteikis, andrius.buteikis@mif.vu.lt http://web.vu.lt/mif/a.buteikis/ Introduction The goal of a researcher working with time

More information

Longitudinal Data Analysis Using Stata Paul D. Allison, Ph.D. Upcoming Seminar: May 18-19, 2017, Chicago, Illinois

Longitudinal Data Analysis Using Stata Paul D. Allison, Ph.D. Upcoming Seminar: May 18-19, 2017, Chicago, Illinois Longitudinal Data Analysis Using Stata Paul D. Allison, Ph.D. Upcoming Seminar: May 18-19, 217, Chicago, Illinois Outline 1. Opportunities and challenges of panel data. a. Data requirements b. Control

More information

Time Series. Anthony Davison. c

Time Series. Anthony Davison. c Series Anthony Davison c 2008 http://stat.epfl.ch Periodogram 76 Motivation............................................................ 77 Lutenizing hormone data..................................................

More information

IDENTIFICATION OF PERIODIC AUTOREGRESSIVE MOVING-AVERAGE TIME SERIES MODELS WITH R

IDENTIFICATION OF PERIODIC AUTOREGRESSIVE MOVING-AVERAGE TIME SERIES MODELS WITH R Journal of Mathematics and Statistics (3): 358-367, 4 ISSN: 549-3644 4 doi:.3844/jmssp.4.358.367 Published Online (3) 4 (http://www.thescipub.com/jmss.toc) IDENTIFICATION OF PERIODIC AUTOREGRESSIVE MOVING-AVERAGE

More information

Long-Range Dependence and Self-Similarity. c Vladas Pipiras and Murad S. Taqqu

Long-Range Dependence and Self-Similarity. c Vladas Pipiras and Murad S. Taqqu Long-Range Dependence and Self-Similarity c Vladas Pipiras and Murad S. Taqqu January 24, 2016 Contents Contents 2 Preface 8 List of abbreviations 10 Notation 11 1 A brief overview of times series and

More information

System Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang

System Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang System Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang 1-1 Course Description Emphases Delivering concepts and Practice Programming Identification Methods using Matlab Class

More information

Statistical Uncertainty Budget in a Reverberation Chamber

Statistical Uncertainty Budget in a Reverberation Chamber ADVANCED ELECTROMAGNETICS SYMPOSIUM, AES 2012, 16 19 APRIL 2012, PARIS FRANCE Statistical Uncertainty Budget in a Reverberation Chamber Philippe Besnier, Christophe Lemoine, Abdou Khadir Fall Université

More information

Real currency exchange rate prediction. - A time series analysis.

Real currency exchange rate prediction. - A time series analysis. Real currency exchange rate prediction. - A time series analysis. Malin Varenius Kandidatuppsats i matematisk statistik Bachelor Thesis in Mathematical Statistics Kandidatuppsats 2017:13 Matematisk statistik

More information

F9 F10: Autocorrelation

F9 F10: Autocorrelation F9 F10: Autocorrelation Feng Li Department of Statistics, Stockholm University Introduction In the classic regression model we assume cov(u i, u j x i, x k ) = E(u i, u j ) = 0 What if we break the assumption?

More information

arxiv: v1 [q-fin.st] 9 Mar 2009

arxiv: v1 [q-fin.st] 9 Mar 2009 Inference on multivariate ARCH processes with large sizes Gilles Zumbach arxiv:93.53v [q-fin.st] 9 Mar 9 RiskMetrics Group Av. des Morgines 3 Petit-Lancy Geneva, Switzerland gilles.zumbach@riskmetrics.com

More information