STAT Financial Time Series
|
|
- Elvin Shelton
- 5 years ago
- Views:
Transcription
1 STAT Financial Time Series Chapter 2 - Probability Models Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 1 / 34
2 Agenda 1 Introduction 2 Stochastic Process Definition 1 Stochastic Definition 2 Finite dimensional distribution function Definition 3 Strictly Stationary Definition 4 Weakly Stationary Definition 5 Auto covariance function 3 Strictly and Weakly Stationary 4 Examples 5 Sample Correlation Function 6 Summary Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 2 / 34
3 Introduction Assume that we have done the preliminary analysis to remove trend T t and seasonality S t N t = X t T t S t We use basic probability theories and construct models to describe the microscopic component {N t } Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 3 / 34
4 Agenda 1 Introduction 2 Stochastic Process Definition 1 Stochastic Definition 2 Finite dimensional distribution function Definition 3 Strictly Stationary Definition 4 Weakly Stationary Definition 5 Auto covariance function 3 Strictly and Weakly Stationary 4 Examples 5 Sample Correlation Function 6 Summary Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 4 / 34
5 Agenda 1 Introduction 2 Stochastic Process Definition 1 Stochastic Definition 2 Finite dimensional distribution function Definition 3 Strictly Stationary Definition 4 Weakly Stationary Definition 5 Auto covariance function 3 Strictly and Weakly Stationary 4 Examples 5 Sample Correlation Function 6 Summary Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 5 / 34
6 Stochastic Process - Definition 1 Stochastic A collection of random variable {X t : t R} is called a stochastic process Continuous {X(t) : 0 t < } Discrete {X t : t = 1, 2,..., n} Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 6 / 34
7 Stochastic Process - Definition 1 Stochastic Understand the meaning of stochastic: {X t : t = 1, 2,..., n} can be regarded as a function of time t We assume that there is a sample space Ω (a set of all possible scenario) that generate the randomness Ω = (ω 1, ω 2, ω 3,......) ω 1 X t (ω 1 ), ω 2 X t (ω 2 ) For a fixed ω, X t (ω) is called a sample function/ realization/ sample path In practice, we can only observe one sample path (i.e. the situation is generated by one particular ω ) Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 7 / 34
8 Agenda 1 Introduction 2 Stochastic Process Definition 1 Stochastic Definition 2 Finite dimensional distribution function Definition 3 Strictly Stationary Definition 4 Weakly Stationary Definition 5 Auto covariance function 3 Strictly and Weakly Stationary 4 Examples 5 Sample Correlation Function 6 Summary Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 8 / 34
9 Stochastic Process - Definition 2 Finite dimensional distribution function Finite dimensional distribution functions: F t (x) = P (X t1 x 1,..., X tn x n ) for all possible t = (t 1, t 2,..., t n ) where, 1 t 1 < t 2 < < t n and (X 1, X 2,..., X n ) R n, n = 1, 2,... Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 9 / 34
10 Agenda 1 Introduction 2 Stochastic Process Definition 1 Stochastic Definition 2 Finite dimensional distribution function Definition 3 Strictly Stationary Definition 4 Weakly Stationary Definition 5 Auto covariance function 3 Strictly and Weakly Stationary 4 Examples 5 Sample Correlation Function 6 Summary Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 10 / 34
11 Stochastic Process - Definition 3 Strictly Stationary Strictly stationary - distribution of a process does not change {X t } is said to be strictly stationary if 1. for all n 2. for all (t 1, t 2,..., t n ) 3. for all τ (X t1,..., X tn ) d = (X t1 +τ,..., X tn+τ ) where d = means equal in distribution Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 11 / 34
12 Agenda 1 Introduction 2 Stochastic Process Definition 1 Stochastic Definition 2 Finite dimensional distribution function Definition 3 Strictly Stationary Definition 4 Weakly Stationary Definition 5 Auto covariance function 3 Strictly and Weakly Stationary 4 Examples 5 Sample Correlation Function 6 Summary Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 12 / 34
13 Stochastic Process - Definition 4 Weakly Stationary Weakly Stationary: same mean same variance same covariance {X t } is said to be weakly stationary/ second order stationary/ wide-sense stationary if 1) E(X t ) = µ constant mean 2) Cov(X t, X t+τ ) = γ(τ) for all t and all τ (auto-covariance only depends on time lag τ, but not time t) Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 13 / 34
14 Agenda 1 Introduction 2 Stochastic Process Definition 1 Stochastic Definition 2 Finite dimensional distribution function Definition 3 Strictly Stationary Definition 4 Weakly Stationary Definition 5 Auto covariance function 3 Strictly and Weakly Stationary 4 Examples 5 Sample Correlation Function 6 Summary Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 14 / 34
15 Stochastic Process - Definition 5 Auto covariance function Auto covariance function(acvf) γ(τ) = Cov(X t, X t+τ) ) Auto correlation function(acf) ρ(τ) = Cov(X t,x t+τ ) Var(Xt )Var(X t+τ ) = γ(τ) γ(0) γ(0) = Var(X t ) Stationary = Var(X t+τ ) Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 15 / 34
16 Agenda 1 Introduction 2 Stochastic Process Definition 1 Stochastic Definition 2 Finite dimensional distribution function Definition 3 Strictly Stationary Definition 4 Weakly Stationary Definition 5 Auto covariance function 3 Strictly and Weakly Stationary 4 Examples 5 Sample Correlation Function 6 Summary Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 16 / 34
17 Strictly vs Weakly Stationary Strictly: distribution of the process unchange Weakly: mean/covariance unchange Strictly stationary implies weakly stationary whenever E(X 2 t ) < Weakly stationary implies strictly stationary when {X t } is normal,but in general not true Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 17 / 34
18 Strictly vs Weakly Stationary 1. X 1, X 2,..., X n iid t 2 {X t } : Strictly stationary But E(X 2 t ) =, {X t } : NOT weakly stationary 2. X 1, X 2,..., X n iid t 3 Now E(X 2 t ) <, {X t } : Strictly and Weakly stationary 3. X 1 exp(1) 1, X 2, X 3,... iid N (0, 1) {X t } : Weakly stationary, E(X i ) = 0, Var(X i ) = 1, Cov(X i, X i+k ) = 0 {X t } : NOT Strictly stationary, since distribution of X 1,X 2 are not equal (i.e.f X1 (x 1 ) F Xt (x 2 )) Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 18 / 34
19 Agenda 1 Introduction 2 Stochastic Process Definition 1 Stochastic Definition 2 Finite dimensional distribution function Definition 3 Strictly Stationary Definition 4 Weakly Stationary Definition 5 Auto covariance function 3 Strictly and Weakly Stationary 4 Examples 5 Sample Correlation Function 6 Summary Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 19 / 34
20 Example 1 {X t } : i.i.d. random variables ρ(τ) = { 1, τ = 0 0, τ 1 (1) If a time series satisfies (1), it is called a white noise sequence i.i.d. white noise white noise i.i.d. (e.g.x 1 exp(1), X k N (0, 1), k 2) Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 20 / 34
21 Example 2 If {Y t } satisfies {Y 1 = Y 2 = = Y }, then ρ(τ) = Cov(Y, Y ) = 1 for all τ Essentially there is only one observation (all the observations are equal) Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 21 / 34
22 Example 3 X t = A cos θt + B sin θt where A and B are i.i.d. random variables with mean 0 and variance σ 2 Cov(X t+h, X t ) E(X t ) = E(A) cos θt + E(B) sin θt = 0 = Cov(A cos θ(t + h) + B sin θ(t + h), A cos θt + B sin θt) = cos θtcos θ(t + h)var(a) + sin θtsin θ(t + h)var(b) = σ 2 cos(θ(t + h) θt) ( cos(a B) = cos A cos B + sin A sin B) = σ 2 cos θh X t is weakly stationary! Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 22 / 34
23 Agenda 1 Introduction 2 Stochastic Process Definition 1 Stochastic Definition 2 Finite dimensional distribution function Definition 3 Strictly Stationary Definition 4 Weakly Stationary Definition 5 Auto covariance function 3 Strictly and Weakly Stationary 4 Examples 5 Sample Correlation Function 6 Summary Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 23 / 34
24 ACVF and ACF ACVF : γ(τ) = Cov(X t, X t+τ ) ACF : ρ(τ) = Cov(X t,x t+τ ) = γ(τ) Var(X t )Var(X t+τ ) γ(0) Both ACVF and ACF are population quantities. It means that they involve the true distribution of the process {X t } If we have a dataset X 1, X 2,..., X n but we do not know the true probability distribution of the time series, we can estimate the ACF/ACVF by Sample ACVF: C k = 1 n Sample ACF : r k = C k /C 0 n k t=1 (X t X)(X t+k X) Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 24 / 34
25 Correlogram - ACF plot Correlogram - ACF plot: A graph to summarize r k Example 1 Example 2 Use k up to k = n/3, otherwise r k is not accurate By definition, r 0 = c 0 c 0 = 1 Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 25 / 34
26 Sample Correlation Function Questions need to address: Is Corr(X t, X t+k ) = 0? Is r k significantly different from 0? Solution: r k N (0, 1 n ) for each fixed k when n is large Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 26 / 34
27 Short Memory vs Long Memory Short Memory = Short term correlation Long Memory = long term correlation Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 27 / 34
28 Examples of ACF function Y t = Z t, {Z t } are i.i.d. Y t = 0.9Y t 1 + Z t Y t = 0.4Y t 1 + Z t Y t = 0.5Y t 1 + Z t Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 28 / 34
29 Examples of ACF function Y t = a cos(tω), where a, ω are constants Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 29 / 34
30 Examples of ACF function Y t = Y t 1 + Z t Y t = at + Z t 1. For both cases, ACF decay very slowly (Non-stationary) 2. In practice, we need to detrend and study Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 30 / 34
31 Agenda 1 Introduction 2 Stochastic Process Definition 1 Stochastic Definition 2 Finite dimensional distribution function Definition 3 Strictly Stationary Definition 4 Weakly Stationary Definition 5 Auto covariance function 3 Strictly and Weakly Stationary 4 Examples 5 Sample Correlation Function 6 Summary Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 31 / 34
32 Summary of Chapter 2 ACVF : γ(τ) = Cov(X t, X t+τ ) ACF : ρ(τ) = Cov(X t, X t+τ ) Var(X t )Var(X t+τ ) = γ(τ) γ(0) Sample ACVF : C k = 1 n n k Sample ACF : r k = C k /C 0 t=1 (X t X)(X t+k X) Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 32 / 34
33 Summary of Chapter 2 ACF plot (ACF r k against lag k): r k N (0, 1 n ) Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 33 / 34
34 Summary of Chapter 2 Short memory Long memory Non-stationary Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 34 / 34
Econometría 2: Análisis de series de Tiempo
Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 II. Basic definitions A time series is a set of observations X t, each
More informationLECTURES 2-3 : Stochastic Processes, Autocorrelation function. Stationarity.
LECTURES 2-3 : Stochastic Processes, Autocorrelation function. Stationarity. Important points of Lecture 1: A time series {X t } is a series of observations taken sequentially over time: x t is an observation
More informationSTAT 248: EDA & Stationarity Handout 3
STAT 248: EDA & Stationarity Handout 3 GSI: Gido van de Ven September 17th, 2010 1 Introduction Today s section we will deal with the following topics: the mean function, the auto- and crosscovariance
More informationModule 9: Stationary Processes
Module 9: Stationary Processes Lecture 1 Stationary Processes 1 Introduction A stationary process is a stochastic process whose joint probability distribution does not change when shifted in time or space.
More informationStochastic Processes: I. consider bowl of worms model for oscilloscope experiment:
Stochastic Processes: I consider bowl of worms model for oscilloscope experiment: SAPAscope 2.0 / 0 1 RESET SAPA2e 22, 23 II 1 stochastic process is: Stochastic Processes: II informally: bowl + drawing
More informationSTAT Financial Time Series
STAT 6104 - Financial Time Series Chapter 1 - Introduction Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 1 / 42 Agenda 1 Basic Description 2 Simple Descriptive Techniques 3 Examples 4 Summary Chun
More informationSTAT Financial Time Series
STAT 6104 - Financial Time Series Chapter 9 - Heteroskedasticity Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 1 / 43 Agenda 1 Introduction 2 AutoRegressive Conditional Heteroskedastic Model (ARCH)
More informationStat 248 Lab 2: Stationarity, More EDA, Basic TS Models
Stat 248 Lab 2: Stationarity, More EDA, Basic TS Models Tessa L. Childers-Day February 8, 2013 1 Introduction Today s section will deal with topics such as: the mean function, the auto- and cross-covariance
More informationStatistics of stochastic processes
Introduction Statistics of stochastic processes Generally statistics is performed on observations y 1,..., y n assumed to be realizations of independent random variables Y 1,..., Y n. 14 settembre 2014
More informationSTAT Financial Time Series
STAT 6104 - Financial Time Series Chapter 4 - Estimation in the time Domain Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 1 / 46 Agenda 1 Introduction 2 Moment Estimates 3 Autoregressive Models (AR
More informationEcon 424 Time Series Concepts
Econ 424 Time Series Concepts Eric Zivot January 20 2015 Time Series Processes Stochastic (Random) Process { 1 2 +1 } = { } = sequence of random variables indexed by time Observed time series of length
More informationTIME SERIES AND FORECASTING. Luca Gambetti UAB, Barcelona GSE Master in Macroeconomic Policy and Financial Markets
TIME SERIES AND FORECASTING Luca Gambetti UAB, Barcelona GSE 2014-2015 Master in Macroeconomic Policy and Financial Markets 1 Contacts Prof.: Luca Gambetti Office: B3-1130 Edifici B Office hours: email:
More informationNonlinear time series
Based on the book by Fan/Yao: Nonlinear Time Series Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 27, 2009 Outline Characteristics of
More informationTime Series Analysis -- An Introduction -- AMS 586
Time Series Analysis -- An Introduction -- AMS 586 1 Objectives of time series analysis Data description Data interpretation Modeling Control Prediction & Forecasting 2 Time-Series Data Numerical data
More informationClass 1: Stationary Time Series Analysis
Class 1: Stationary Time Series Analysis Macroeconometrics - Fall 2009 Jacek Suda, BdF and PSE February 28, 2011 Outline Outline: 1 Covariance-Stationary Processes 2 Wold Decomposition Theorem 3 ARMA Models
More informationLesson 7: Estimation of Autocorrelation and Partial Autocorrela
Lesson 7: Estimation of Autocorrelation and Partial Autocorrelation Function Dipartimento di Ingegneria e Scienze dell Informazione e Matematica Università dell Aquila, umberto.triacca@ec.univaq.it Estimation
More informationENSC327 Communications Systems 19: Random Processes. Jie Liang School of Engineering Science Simon Fraser University
ENSC327 Communications Systems 19: Random Processes Jie Liang School of Engineering Science Simon Fraser University 1 Outline Random processes Stationary random processes Autocorrelation of random processes
More informationSTAT 153, FALL 2015 HOMEWORK 1 SOLUTIONS
STAT 153, FALL 015 HOMEWORK 1 SOLUTIONS Problem 1 (a) A solution in R is provided in Figure 1. We conclude that if δ = 0 the process is a random walk without drift. When δ 0 there is a linear drift with
More informationWeek 5 Quantitative Analysis of Financial Markets Characterizing Cycles
Week 5 Quantitative Analysis of Financial Markets Characterizing Cycles Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036
More informationLesson 4: Stationary stochastic processes
Dipartimento di Ingegneria e Scienze dell Informazione e Matematica Università dell Aquila, umberto.triacca@univaq.it Stationary stochastic processes Stationarity is a rather intuitive concept, it means
More informationReliability and Risk Analysis. Time Series, Types of Trend Functions and Estimates of Trends
Reliability and Risk Analysis Stochastic process The sequence of random variables {Y t, t = 0, ±1, ±2 } is called the stochastic process The mean function of a stochastic process {Y t} is the function
More informationStochastic Processes
Stochastic Processes Stochastic Process Non Formal Definition: Non formal: A stochastic process (random process) is the opposite of a deterministic process such as one defined by a differential equation.
More informationWhite Noise Processes (Section 6.2)
White Noise Processes (Section 6.) Recall that covariance stationary processes are time series, y t, such. E(y t ) = µ for all t. Var(y t ) = σ for all t, σ < 3. Cov(y t,y t-τ ) = γ(τ) for all t and τ
More informationSTA 6857 Autocorrelation and Cross-Correlation & Stationary Time Series ( 1.4, 1.5)
STA 6857 Autocorrelation and Cross-Correlation & Stationary Time Series ( 1.4, 1.5) Outline 1 Announcements 2 Autocorrelation and Cross-Correlation 3 Stationary Time Series 4 Homework 1c Arthur Berg STA
More informationLecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications
Lecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications Prof. Massimo Guidolin 20192 Financial Econometrics Winter/Spring 2018 Overview Moving average processes Autoregressive
More informationApplied time-series analysis
Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 18, 2011 Outline Introduction and overview Econometric Time-Series Analysis In principle,
More information1. Fundamental concepts
. Fundamental concepts A time series is a sequence of data points, measured typically at successive times spaced at uniform intervals. Time series are used in such fields as statistics, signal processing
More informationIntroduction to Stochastic processes
Università di Pavia Introduction to Stochastic processes Eduardo Rossi Stochastic Process Stochastic Process: A stochastic process is an ordered sequence of random variables defined on a probability space
More information1. Stochastic Processes and Stationarity
Massachusetts Institute of Technology Department of Economics Time Series 14.384 Guido Kuersteiner Lecture Note 1 - Introduction This course provides the basic tools needed to analyze data that is observed
More informationEstimation of the Mean and the ACVF
Chapter 5 Estimatio of the Mea ad the ACVF A statioary process {X t } is characterized by its mea ad its autocovariace fuctio γ ), ad so by the autocorrelatio fuctio ρ ) I this chapter we preset the estimators
More informationProf. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis
Introduction to Time Series Analysis 1 Contents: I. Basics of Time Series Analysis... 4 I.1 Stationarity... 5 I.2 Autocorrelation Function... 9 I.3 Partial Autocorrelation Function (PACF)... 14 I.4 Transformation
More informationSTAT 443 Final Exam Review. 1 Basic Definitions. 2 Statistical Tests. L A TEXer: W. Kong
STAT 443 Final Exam Review L A TEXer: W Kong 1 Basic Definitions Definition 11 The time series {X t } with E[X 2 t ] < is said to be weakly stationary if: 1 µ X (t) = E[X t ] is independent of t 2 γ X
More informationThe autocorrelation and autocovariance functions - helpful tools in the modelling problem
The autocorrelation and autocovariance functions - helpful tools in the modelling problem J. Nowicka-Zagrajek A. Wy lomańska Institute of Mathematics and Computer Science Wroc law University of Technology,
More information2. (a) What is gaussian random variable? Develop an equation for guassian distribution
Code No: R059210401 Set No. 1 II B.Tech I Semester Supplementary Examinations, February 2007 PROBABILITY THEORY AND STOCHASTIC PROCESS ( Common to Electronics & Communication Engineering, Electronics &
More informationSome Time-Series Models
Some Time-Series Models Outline 1. Stochastic processes and their properties 2. Stationary processes 3. Some properties of the autocorrelation function 4. Some useful models Purely random processes, random
More informationProperties of Summation Operator
Econ 325 Section 003/004 Notes on Variance, Covariance, and Summation Operator By Hiro Kasahara Properties of Summation Operator For a sequence of the values {x 1, x 2,..., x n, we write the sum of x 1,
More informationOn 1.9, you will need to use the facts that, for any x and y, sin(x+y) = sin(x) cos(y) + cos(x) sin(y). cos(x+y) = cos(x) cos(y) - sin(x) sin(y).
On 1.9, you will need to use the facts that, for any x and y, sin(x+y) = sin(x) cos(y) + cos(x) sin(y). cos(x+y) = cos(x) cos(y) - sin(x) sin(y). (sin(x)) 2 + (cos(x)) 2 = 1. 28 1 Characteristics of Time
More informationLecture 1: Brief Review on Stochastic Processes
Lecture 1: Brief Review on Stochastic Processes A stochastic process is a collection of random variables {X t (s) : t T, s S}, where T is some index set and S is the common sample space of the random variables.
More informationStochastic Processes. Monday, November 14, 11
Stochastic Processes 1 Definition and Classification X(, t): stochastic process: X : T! R (, t) X(, t) where is a sample space and T is time. {X(, t) is a family of r.v. defined on {, A, P and indexed
More informationwhite noise Time moving average
1.3 Time Series Statistical Models 13 white noise w 3 1 0 1 0 100 00 300 400 500 Time moving average v 1.5 0.5 0.5 1.5 0 100 00 300 400 500 Fig. 1.8. Gaussian white noise series (top) and three-point moving
More informationThe distribution inherited by Y is called the Cauchy distribution. Using that. d dy ln(1 + y2 ) = 1 arctan(y)
Stochastic Processes - MM3 - Solutions MM3 - Review Exercise Let X N (0, ), i.e. X is a standard Gaussian/normal random variable, and denote by f X the pdf of X. Consider also a continuous random variable
More informationMODELING INFLATION RATES IN NIGERIA: BOX-JENKINS APPROACH. I. U. Moffat and A. E. David Department of Mathematics & Statistics, University of Uyo, Uyo
Vol.4, No.2, pp.2-27, April 216 MODELING INFLATION RATES IN NIGERIA: BOX-JENKINS APPROACH I. U. Moffat and A. E. David Department of Mathematics & Statistics, University of Uyo, Uyo ABSTRACT: This study
More informationFor a stochastic process {Y t : t = 0, ±1, ±2, ±3, }, the mean function is defined by (2.2.1) ± 2..., γ t,
CHAPTER 2 FUNDAMENTAL CONCEPTS This chapter describes the fundamental concepts in the theory of time series models. In particular, we introduce the concepts of stochastic processes, mean and covariance
More informationIV. Covariance Analysis
IV. Covariance Analysis Autocovariance Remember that when a stochastic process has time values that are interdependent, then we can characterize that interdependency by computing the autocovariance function.
More informationDeterministic. Deterministic data are those can be described by an explicit mathematical relationship
Random data Deterministic Deterministic data are those can be described by an explicit mathematical relationship Deterministic x(t) =X cos r! k m t Non deterministic There is no way to predict an exact
More information8.2 Harmonic Regression and the Periodogram
Chapter 8 Spectral Methods 8.1 Introduction Spectral methods are based on thining of a time series as a superposition of sinusoidal fluctuations of various frequencies the analogue for a random process
More informationMinitab Project Report Assignment 3
3.1.1 Simulation of Gaussian White Noise Minitab Project Report Assignment 3 Time Series Plot of zt Function zt 1 0. 0. zt 0-1 0. 0. -0. -0. - -3 1 0 30 0 50 Index 0 70 0 90 0 1 1 1 1 0 marks The series
More informationPart III Example Sheet 1 - Solutions YC/Lent 2015 Comments and corrections should be ed to
TIME SERIES Part III Example Sheet 1 - Solutions YC/Lent 2015 Comments and corrections should be emailed to Y.Chen@statslab.cam.ac.uk. 1. Let {X t } be a weakly stationary process with mean zero and let
More informationPure Random process Pure Random Process or White Noise Process: is a random process {X t, t 0} which has: { σ 2 if k = 0 0 if k 0
MODULE 9: STATIONARY PROCESSES 7 Lecture 2 Autoregressive Processes 1 Moving Average Process Pure Random process Pure Random Process or White Noise Process: is a random process X t, t 0} which has: E[X
More informationIntroduction to Signal Processing
to Signal Processing Davide Bacciu Dipartimento di Informatica Università di Pisa bacciu@di.unipi.it Intelligent Systems for Pattern Recognition Signals = Time series Definitions Motivations A sequence
More informationLecture 1: Fundamental concepts in Time Series Analysis (part 2)
Lecture 1: Fundamental concepts in Time Series Analysis (part 2) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEA-Nice) Sept. 2011 - Jan. 2012 Florian Pelgrin (HEC)
More informationELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random
More informationMidterm Suggested Solutions
CUHK Dept. of Economics Spring 2011 ECON 4120 Sung Y. Park Midterm Suggested Solutions Q1 (a) In time series, autocorrelation measures the correlation between y t and its lag y t τ. It is defined as. ρ(τ)
More informationReview Session: Econometrics - CLEFIN (20192)
Review Session: Econometrics - CLEFIN (20192) Part II: Univariate time series analysis Daniele Bianchi March 20, 2013 Fundamentals Stationarity A time series is a sequence of random variables x t, t =
More informationModule 3. Descriptive Time Series Statistics and Introduction to Time Series Models
Module 3 Descriptive Time Series Statistics and Introduction to Time Series Models Class notes for Statistics 451: Applied Time Series Iowa State University Copyright 2015 W Q Meeker November 11, 2015
More information{ } Stochastic processes. Models for time series. Specification of a process. Specification of a process. , X t3. ,...X tn }
Stochastic processes Time series are an example of a stochastic or random process Models for time series A stochastic process is 'a statistical phenomenon that evolves in time according to probabilistic
More informationRandom Variables. Random variables. A numerically valued map X of an outcome ω from a sample space Ω to the real line R
In probabilistic models, a random variable is a variable whose possible values are numerical outcomes of a random phenomenon. As a function or a map, it maps from an element (or an outcome) of a sample
More informationECON 616: Lecture 1: Time Series Basics
ECON 616: Lecture 1: Time Series Basics ED HERBST August 30, 2017 References Overview: Chapters 1-3 from Hamilton (1994). Technical Details: Chapters 2-3 from Brockwell and Davis (1987). Intuition: Chapters
More informationAppendix A Random Variables and Stochastic Processes
Appendix A Random Variables and Stochastic Processes In view of the modeling, forecasting, and forecast verification aspects covered throughout the various chapters of this book, it might be necessary
More informationNANYANG TECHNOLOGICAL UNIVERSITY SEMESTER II EXAMINATION MAS451/MTH451 Time Series Analysis TIME ALLOWED: 2 HOURS
NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER II EXAMINATION 2012-2013 MAS451/MTH451 Time Series Analysis May 2013 TIME ALLOWED: 2 HOURS INSTRUCTIONS TO CANDIDATES 1. This examination paper contains FOUR (4)
More informationIntroduction to Probability and Stochastic Processes I
Introduction to Probability and Stochastic Processes I Lecture 3 Henrik Vie Christensen vie@control.auc.dk Department of Control Engineering Institute of Electronic Systems Aalborg University Denmark Slides
More informationCh.10 Autocorrelated Disturbances (June 15, 2016)
Ch10 Autocorrelated Disturbances (June 15, 2016) In a time-series linear regression model setting, Y t = x tβ + u t, t = 1, 2,, T, (10-1) a common problem is autocorrelation, or serial correlation of the
More informationSolar irradiance forecasting for Chulalongkorn University location using time series models
Senior Project Proposal 2102490 Year 2016 Solar irradiance forecasting for Chulalongkorn University location using time series models Vichaya Layanun ID 5630550721 Advisor: Assist. Prof. Jitkomut Songsiri
More informationSTAT 520: Forecasting and Time Series. David B. Hitchcock University of South Carolina Department of Statistics
David B. University of South Carolina Department of Statistics What are Time Series Data? Time series data are collected sequentially over time. Some common examples include: 1. Meteorological data (temperatures,
More informationSpectral representations and ergodic theorems for stationary stochastic processes
AMS 263 Stochastic Processes (Fall 2005) Instructor: Athanasios Kottas Spectral representations and ergodic theorems for stationary stochastic processes Stationary stochastic processes Theory and methods
More informationRegression with correlation for the Sales Data
Regression with correlation for the Sales Data Scatter with Loess Curve Time Series Plot Sales 30 35 40 45 Sales 30 35 40 45 0 10 20 30 40 50 Week 0 10 20 30 40 50 Week Sales Data What is our goal with
More informationMATH4210 Financial Mathematics ( ) Tutorial 7
MATH40 Financial Mathematics (05-06) Tutorial 7 Review of some basic Probability: The triple (Ω, F, P) is called a probability space, where Ω denotes the sample space and F is the set of event (σ algebra
More informationDiscrete time processes
Discrete time processes Predictions are difficult. Especially about the future Mark Twain. Florian Herzog 2013 Modeling observed data When we model observed (realized) data, we encounter usually the following
More informationfor valid PSD. PART B (Answer all five units, 5 X 10 = 50 Marks) UNIT I
Code: 15A04304 R15 B.Tech II Year I Semester (R15) Regular Examinations November/December 016 PROBABILITY THEY & STOCHASTIC PROCESSES (Electronics and Communication Engineering) Time: 3 hours Max. Marks:
More informationStochastic process for macro
Stochastic process for macro Tianxiao Zheng SAIF 1. Stochastic process The state of a system {X t } evolves probabilistically in time. The joint probability distribution is given by Pr(X t1, t 1 ; X t2,
More informationTime Series Solutions HT 2009
Time Series Solutions HT 2009 1. Let {X t } be the ARMA(1, 1) process, X t φx t 1 = ɛ t + θɛ t 1, {ɛ t } WN(0, σ 2 ), where φ < 1 and θ < 1. Show that the autocorrelation function of {X t } is given by
More information3. ARMA Modeling. Now: Important class of stationary processes
3. ARMA Modeling Now: Important class of stationary processes Definition 3.1: (ARMA(p, q) process) Let {ɛ t } t Z WN(0, σ 2 ) be a white noise process. The process {X t } t Z is called AutoRegressive-Moving-Average
More informationE X A M. Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours. Number of pages incl.
E X A M Course code: Course name: Number of pages incl. front page: 6 MA430-G Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours Resources allowed: Notes: Pocket calculator,
More informationStochastic processes: basic notions
Stochastic processes: basic notions Jean-Marie Dufour McGill University First version: March 2002 Revised: September 2002, April 2004, September 2004, January 2005, July 2011, May 2016, July 2016 This
More informationTime Series Models and Inference. James L. Powell Department of Economics University of California, Berkeley
Time Series Models and Inference James L. Powell Department of Economics University of California, Berkeley Overview In contrast to the classical linear regression model, in which the components of the
More informationDefinition of a Stochastic Process
Definition of a Stochastic Process Balu Santhanam Dept. of E.C.E., University of New Mexico Fax: 505 277 8298 bsanthan@unm.edu August 26, 2018 Balu Santhanam (UNM) August 26, 2018 1 / 20 Overview 1 Stochastic
More informationECE353: Probability and Random Processes. Lecture 18 - Stochastic Processes
ECE353: Probability and Random Processes Lecture 18 - Stochastic Processes Xiao Fu School of Electrical Engineering and Computer Science Oregon State University E-mail: xiao.fu@oregonstate.edu From RV
More informationEEM 409. Random Signals. Problem Set-2: (Power Spectral Density, LTI Systems with Random Inputs) Problem 1: Problem 2:
EEM 409 Random Signals Problem Set-2: (Power Spectral Density, LTI Systems with Random Inputs) Problem 1: Consider a random process of the form = + Problem 2: X(t) = b cos(2π t + ), where b is a constant,
More informationMultivariate Time Series
Multivariate Time Series Notation: I do not use boldface (or anything else) to distinguish vectors from scalars. Tsay (and many other writers) do. I denote a multivariate stochastic process in the form
More informationSTAT 720 TIME SERIES ANALYSIS. Lecture Notes. Dewei Wang. Department of Statistics. University of South Carolina
STAT 720 TIME SERIES ANALYSIS Spring 2015 Lecture Notes Dewei Wang Department of Statistics University of South Carolina 1 Contents 1 Introduction 1 1.1 Some examples........................................
More informationPart II. Time Series
Part II Time Series 12 Introduction This Part is mainly a summary of the book of Brockwell and Davis (2002). Additionally the textbook Shumway and Stoffer (2010) can be recommended. 1 Our purpose is to
More informationRoss Bettinger, Analytical Consultant, Seattle, WA
ABSTRACT DYNAMIC REGRESSION IN ARIMA MODELING Ross Bettinger, Analytical Consultant, Seattle, WA Box-Jenkins time series models that contain exogenous predictor variables are called dynamic regression
More information13. Time Series Analysis: Asymptotics Weakly Dependent and Random Walk Process. Strict Exogeneity
Outline: Further Issues in Using OLS with Time Series Data 13. Time Series Analysis: Asymptotics Weakly Dependent and Random Walk Process I. Stationary and Weakly Dependent Time Series III. Highly Persistent
More informationRandom Vectors 1. STA442/2101 Fall See last slide for copyright information. 1 / 30
Random Vectors 1 STA442/2101 Fall 2017 1 See last slide for copyright information. 1 / 30 Background Reading: Renscher and Schaalje s Linear models in statistics Chapter 3 on Random Vectors and Matrices
More informationQuestions and Answers on Unit Roots, Cointegration, VARs and VECMs
Questions and Answers on Unit Roots, Cointegration, VARs and VECMs L. Magee Winter, 2012 1. Let ɛ t, t = 1,..., T be a series of independent draws from a N[0,1] distribution. Let w t, t = 1,..., T, be
More informationNon-Stationary Time Series and Unit Root Testing
Econometrics II Non-Stationary Time Series and Unit Root Testing Morten Nyboe Tabor Course Outline: Non-Stationary Time Series and Unit Root Testing 1 Stationarity and Deviation from Stationarity Trend-Stationarity
More informationStochastic Process II Dr.-Ing. Sudchai Boonto
Dr-Ing Sudchai Boonto Department of Control System and Instrumentation Engineering King Mongkuts Unniversity of Technology Thonburi Thailand Random process Consider a random experiment specified by the
More information1 Time Series Concepts and Challenges
Forecasting Time Series Data Notes from Rebecca Sela Stern Business School Spring, 2004 1 Time Series Concepts and Challenges The linear regression model (and most other models) assume that observations
More informationEmpirical Market Microstructure Analysis (EMMA)
Empirical Market Microstructure Analysis (EMMA) Lecture 3: Statistical Building Blocks and Econometric Basics Prof. Dr. Michael Stein michael.stein@vwl.uni-freiburg.de Albert-Ludwigs-University of Freiburg
More informationTime Series Analysis - Part 1
Time Series Analysis - Part 1 Dr. Esam Mahdi Islamic University of Gaza - Department of Mathematics April 19, 2017 1 of 189 What is a Time Series? Fundamental concepts Time Series Decomposition Estimating
More informationELEMENTS OF PROBABILITY THEORY
ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable
More informationCommunication Theory II
Communication Theory II Lecture 8: Stochastic Processes Ahmed Elnakib, PhD Assistant Professor, Mansoura University, Egypt March 5 th, 2015 1 o Stochastic processes What is a stochastic process? Types:
More informationTime Series Analysis. Solutions to problems in Chapter 5 IMM
Time Series Analysis Solutions to problems in Chapter 5 IMM Solution 5.1 Question 1. [ ] V [X t ] = V [ǫ t + c(ǫ t 1 + ǫ t + )] = 1 + c 1 σǫ = The variance of {X t } is not limited and therefore {X t }
More informationChapter 7. Confidence Sets Lecture 30: Pivotal quantities and confidence sets
Chapter 7. Confidence Sets Lecture 30: Pivotal quantities and confidence sets Confidence sets X: a sample from a population P P. θ = θ(p): a functional from P to Θ R k for a fixed integer k. C(X): a confidence
More informationIn terms of measures: Exercise 1. Existence of a Gaussian process: Theorem 2. Remark 3.
1. GAUSSIAN PROCESSES A Gaussian process on a set T is a collection of random variables X =(X t ) t T on a common probability space such that for any n 1 and any t 1,...,t n T, the vector (X(t 1 ),...,X(t
More informationUniversity of Oxford. Statistical Methods Autocorrelation. Identification and Estimation
University of Oxford Statistical Methods Autocorrelation Identification and Estimation Dr. Órlaith Burke Michaelmas Term, 2011 Department of Statistics, 1 South Parks Road, Oxford OX1 3TG Contents 1 Model
More informationMA 575 Linear Models: Cedric E. Ginestet, Boston University Revision: Probability and Linear Algebra Week 1, Lecture 2
MA 575 Linear Models: Cedric E Ginestet, Boston University Revision: Probability and Linear Algebra Week 1, Lecture 2 1 Revision: Probability Theory 11 Random Variables A real-valued random variable is
More information18.S096 Problem Set 4 Fall 2013 Time Series Due Date: 10/15/2013
18.S096 Problem Set 4 Fall 2013 Time Series Due Date: 10/15/2013 1. Covariance Stationary AR(2) Processes Suppose the discrete-time stochastic process {X t } follows a secondorder auto-regressive process
More informationProblem Set 1 Solution Sketches Time Series Analysis Spring 2010
Problem Set 1 Solution Sketches Time Series Analysis Spring 2010 1. Construct a martingale difference process that is not weakly stationary. Simplest e.g.: Let Y t be a sequence of independent, non-identically
More information1.1 Review of Probability Theory
1.1 Review of Probability Theory Angela Peace Biomathemtics II MATH 5355 Spring 2017 Lecture notes follow: Allen, Linda JS. An introduction to stochastic processes with applications to biology. CRC Press,
More information