Wavelet Methods for Time Series Analysis. Part IV: Wavelet-Based Decorrelation of Time Series

Size: px
Start display at page:

Download "Wavelet Methods for Time Series Analysis. Part IV: Wavelet-Based Decorrelation of Time Series"

Transcription

1 Wavelet Methods for Time Series Analysis Part IV: Wavelet-Based Decorrelation of Time Series DWT well-suited for decorrelating certain time series, including ones generated from a fractionally differenced (FD) process on synthesis side, leads to DWT-based simulation of FD processes wavelet-based bootstrapping on analysis side, leads to wavelet-based estimators for FD parameters test for homogeneity of variance test for trends (won t discuss see Craigmile et al., 24, for details) IV

2 Wavelets and FD Processes: I wavelet filters are approximate band-pass filters, with nominal pass-bands [/2 j+, /2 j ] (called jth octave band ) suppose { t } has S ( ) as its spectral density function (SDF) statistical properties of {W j,t } are simple if S ( ) has simple structure within jth octave band example: FD process with SDF S (f) = σ 2 ε [4 sin 2 (πf)] δ WMTSA: IV 2

3 Wavelets and FD Processes: II FD process controlled by two parameters: δ and σ 2 ε for small f, have S (f) C f 2δ ; i.e., a power law log(s (f)) vs. log(f) is approximately linear with slope 2δ for large τ j, wavelet variance at scale τ j, namely ν 2 (τ j), satisfies ν 2 (τ j) C τ 2δ j log (ν 2 (τ j)) vs. log (τ j ) is approximately linear, slope 2δ approximately self-similar (or fractal ) FD process is stationary with long memory if < δ < /2: correlation between t & t+τ dies down slowly as τ increases WMTSA: 297, 284 IV 3

4 Wavelets and FD Processes: III power law model ubiquitous in physical sciences voltage fluctuations across cell membranes density fluctuations in hour glass traffic fluctuations on Japanese expressway impedance fluctuations in geophysical borehole fluctuations in the rotation of the earth -ray time variability of galaxies DWT well-suited to study FD and related processes self-similar filters used on self-similar processes key idea: DWT approximately decorrelates LMPs WMTSA: 34 IV 4

5 DWT of an FD Process: I 5 ˆρ,τ t τ (lag) realization of an FD(.4) time series along with its sample autocorrelation sequence (ACS): for τ, P N τ ˆρ,τ t= t t+τ P N t= 2 t note that ACS dies down slowly WMTSA: IV 5

6 DWT of an FD Process: II V 7 W 7 W 6 W 5 W 4 W 3 W 2 W τ (lag) LA(8) DWT of FD(.4) series and sample ACSs for each W j & V 7, along with 95% confidence intervals for white noise WMTSA: IV 6

7 ev 7 fw 7 fw 6 fw 5 fw 4 fw 3 fw MODWT of an FD Process fw τ (lag) LA(8) MODWT of FD(.4) series & sample ACSs for MODWT coefficients, none of which are approximately uncorrelated IV 7

8 DWT of an FD Process: III in contrast to, ACSs for W j consistent with white noise variance of W j increases with j can argue that var {W j,t } 2 j 2 j+ Z /2 j /2 j+ S (f) df C j, where C j is average value of S ( ) over [/2 j+, /2 j ] for FD process, have C j S (/2 j+ 2), where /2 j+ 2 is midpoint of interval [/2 j+, /2 j ] WMTSA: IV 8

9 DWT of an FD Process: IV.. O O O O. O O O..... f plot shows cvar {W j,t } (circles) & S (/2 j+ 2) (curve) versus /2 j+ 2, along with 95% confidence intervals for var {W j,t } observed cvar {W j,t } agrees well with theoretical var {W j,t } WMTSA: IV 9

10 Correlations Within a Scale and Between Two Scales let {s,τ } denote autocovariance sequence (ACVS) for { t }; i.e., s,τ = cov { t, t+τ } let {h j,l } denote equivalent wavelet filter for jth level to quantify decorrelation, can write cov {W j,t, W j,t } = L j l= L j l = h j,l h j,l s,2 j (t+) l 2 j (t +)+l, from which we can get ACVS (and hence within-scale correlations) for {W j,t }: cov {W j,t, W j,t+τ } = L j m= (L j ) s,2 j τ+m L j m l= h j,l h j,l+ m WMTSA: 345 IV

11 Correlations Within a Scale j = j = 2 j = 3 j = 4 Haar D(4) LA(8) τ τ τ τ correlations between W j,t and W j,t+τ for an FD(.4) process correlations within scale are slightly smaller for Haar maximum magnitude of correlation is less than.2 WMTSA: IV

12 Correlations Between Two Scales: I j = 2 j = 3 j = τ 8 8 τ τ j = j = 2 j = 3 correlation between Haar wavelet coefficients W j,t and W j,t from FD(.4) process and for levels satisfying j < j 4 WMTSA: IV 2

13 Correlations Between Two Scales: II j = 2 j = 3 j = τ 8 8 τ τ j = j = 2 j = 3 same as before, but now for LA(8) wavelet coefficients correlations between scales decrease as L increases WMTSA: IV 3

14 Wavelet Domain Description of FD Process DWT acts as a decorrelating transform for FD process (also true for fractional Gaussian noise, pure power law etc.) wavelet domain description is simple wavelet coefficients within a given scale approximately uncorrelated (refinement: assume st order autoregressive model) wavelet coefficients have scale-dependent variance controlled by the two FD parameters (δ and σ 2 ε) wavelet coefficients between scales also approximately uncorrelated (approximation improves as filter width L increases) WMTSA: IV 4

15 DWT-Based Simulation properties of DWT of FD processes lead to schemes for simulating time series [,..., N ] T with zero mean and with a multivariate Gaussian distribution with N = 2 J, recall that = W T W, where W W 2. W = W j. W J V J WMTSA: 355 IV 5

16 Basic DWT-Based Simulation Scheme assume W to contain N uncorrelated Gaussian (normal) random variables (RVs) with zero mean assume W j to have variance C j S (/2 j+ 2) assume single RV in V J to have variance C J+ (see Percival and Walden, 2, for details on how to set C J+ ) approximate FD time series via Y W T Λ /2 Z, where Λ /2 is N N diagonal matrix with diagonal elements C /2,..., C /2 {z, C /2 } 2,..., C /2 {z 2,..., C /2 } J {z, C/2 J, C /2 } 2 of these N 2 of these N 4 of these J, C/2 J+ Z is vector of deviations drawn from a Gaussian distribution with zero mean and unit variance WMTSA: 355 IV 6

17 Refinements to Basic Scheme: I covariance matrix for approximation Y does not correspond to that of a stationary process recall W treats as if it were circular let T be N N circular shift matrix: Y Y Y T Y Y 2 = Y 2 Y 3 ; T 2 Y Y 2 = Y 3 Y Y 3 Y 2 Y 3 Y Y let κ be uniformily distributed over,..., N define e Y T κ Y e Y is stationary with ACVS given by, say, s ey,τ ; etc. WMTSA: IV 7

18 Refinements to Basic Scheme: II Q: how well does {s ey,τ } match {s,τ }? due to circularity, find that s ey,n τ = s ey,τ for τ =,..., N/2 implies s ey,τ cannot approximate s,τ well for τ close to N can patch up by simulating e Y with M > N elements and then extracting first N deviates (M = 4N works well) WMTSA: IV 8

19 Refinements to Basic Scheme: III M = N M = 2N M = 4N τ τ τ plot shows true ACVS {s,τ } (thick curves) for FD(.4) process and wavelet-based approximate ACVSs {s ey,τ } (thin curves) based on an LA(8) DWT in which an N = 64 series is extracted from M = N, M = 2N and M = 4N series WMTSA: IV 9

20 Example and Some Notes t simulated FD(.4) series (LA(8), N = 24 and M = 4N) notes: can form realizations faster than best exact method can efficiently simulate extremely long time series in realtime (e.g, N = 2 3 =, 73, 74, 824 or even longer!) effect of random circular shifting is to render time series slightly non-gaussian (a Gaussian mixture model) WMTSA: IV 2

21 Wavelet-Domain Bootstrapping for many (but not all!) time series, DWT acts as a decorrelating transform: to a good approximation, each W j is a sample of a white noise process, and coefficients from different sub-vectors W j and W j are also pairwise uncorrelated variance of coefficients in W j depends on j scaling coefficients V J are still autocorrelated, but there will be just a few of them if J is selected to be large decorrelating property holds particularly well for FD and other processes with long-range dependence above suggests the following recipe for wavelet-domain bootstrapping of a statistic of interest, e.g., sample autocorrelation sequence ˆρ,τ at unit lag τ = IV 2

22 Recipe for Wavelet-Domain Bootstrapping. given of length N = 2 J, compute level J DWT (the choice J = J 3 yields 8 coefficients in W J and V J ) 2. randomly sample with replacement from W j to create bootstrapped vector W (b) j, j =,..., J 3. create V (b) J using st-order autoregressive parametric bootstrap 4. apply W T to W (b),..., W(b) J and V (b) J to obtain bootstrapped time series (b) and then form ˆρ (b), repeat above many times to build up sample distribution of bootstrapped autocorrelations IV 22

23 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

24 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

25 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

26 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

27 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

28 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

29 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

30 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

31 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

32 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

33 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

34 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

35 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

36 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

37 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

38 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

39 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

40 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

41 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

42 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

43 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

44 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

45 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

46 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

47 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

48 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

49 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

50 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

51 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

52 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

53 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

54 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

55 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

56 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

57 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

58 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

59 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 22

60 Illustration of Wavelet-Domain Bootstrapping V 4 W 4 W 3 W 2 W Haar DWT of FD(.45) series (left-hand column) and waveletdomain bootstrap thereof (right-hand) IV 23

61 Wavelet-Domain Bootstrapping of FD Series approximations to true PDF using (a) Haar & (b) LA(8) wavelets (a) (b) ˆρ (m) ˆρ (m) using 5 FD time series and the Haar DWT yields: average of 5 sample means. =.35 (truth. =.53) average of 5 sample SDs. =.96 (truth. =.7) using 5 FD time series and the LA(8) DWT yields: average of 5 sample means. =.43 (truth. =.53) average of 5 sample SDs. =.98 (truth. =.7) vertical line indicates ˆρ, IV 24

62 MLEs of FD Parameters: I FD process depends on 2 parameters, namely, δ and σ 2 ε: S (f) = σ 2 ε [4 sin 2 (πf)] δ given = [,,..., N ] T with N = 2 J, suppose we want to estimate δ and σ 2 ε if is stationary (i.e. δ < /2) and multivariate Gaussian, can use the maximum likelihood (ML) method WMTSA: 36 IV 25

63 MLEs of FD Parameters: II definition of Gaussian likelihood function: L(δ, σε 2 Σ ) (2π) N/2 Σ /2e T /2 where Σ is covariance matrix for, with (s, t)th element given by s,s t, and Σ & Σ denote determinant & inverse ML estimators of δ and σε 2 maximize L(δ, σε 2 ) or, equivalently, mininize 2 log (L(δ, σ 2 ε )) = N log (2π) + log ( Σ ) + T Σ exact MLEs computationally intensive, mainly because of the need to deal with Σ and Σ good approximate MLEs of considerable interest WMTSA: IV 26

64 MLEs of FD Parameters: III key ideas behind first wavelet-based approximate MLEs have seen that we can approximate FD time series by Y = W T Λ /2 Z, where Λ /2 is a diagonal matrix, all of whose diagonal elements are positive since covariance matrix for Z is I N, the one for Y is W T Λ /2 I N (W T Λ /2 ) T = W T Λ /2 Λ /2 W = W T ΛW e Σ, where Λ Λ /2 Λ /2 is also diagonal can consider e Σ to be an approximation to Σ leads to approximation of log likelihood: 2 log (L(δ, σ 2 ε )) N log (2π) + log ( e Σ ) + T e Σ WMTSA: IV 27

65 MLEs of FD Parameters: IV Q: so how does this help us? easy to invert e Σ : eσ = W T ΛW = (W) Λ W T = W T Λ W, where Λ is another diagonal matrix, leading to T e Σ = T W T Λ W = W T Λ W easy to compute the determinant of e Σ : e Σ = W T ΛW = ΛWW T = ΛI N = Λ, and the determinant of a diagonal matrix is just the product of its diagonal elements WMTSA: IV 28

66 MLEs of FD Parameters: V define the following three functions of δ: C j (δ) Z /2 j CJ+ NΓ( 2δ) (δ) Γ 2 ( δ) σ 2 ε(δ) N /2 j+ 2 j+ [4 sin 2 (πf)] δ df J j= V J, 2 J CJ+ (δ) + j= N 2 j C j (δ) C j (δ) Z /2 j 2 j+ df /2 j+ [2πf] 2δ N 2 j t= W 2 j,t WMTSA: IV 29

67 MLEs of FD Parameters: VI wavelet-based approximate MLE δ for δ is the value that minimizes the following function of δ: l(δ ) N log(σ 2 ε(δ)) + log(c J+ (δ)) + J j= N 2 j log(c j (δ)) once δ has been determined, MLE for σ 2 ε is given by σ 2 ε( δ) computer experiments indicate scheme works quite well WMTSA: IV 3

68 Other Wavelet-Based Estimators of FD Parameters second MLE approach: formulate likelihood directly in terms of nonboundary wavelet coefficients handles stationary or nonstationary FD processes (i.e., need not assume δ < /2) handles certain deterministic trends alternative to MLEs are least square estimators (LSEs) recall that, for large τ and for β = 2δ, have log (ν 2 (τ j)) ζ + β log (τ j ) suggests determining δ by regressing log (ˆν 2 (τ j)) on log (τ j ) over range of τ j weighted LSE takes into account fact that variance of log (ˆν 2 (τ j)) depends upon scale τ j (increases as τ j increases) WMTSA: IV 3

69 Homogeneity of Variance: I because DWT decorrelates LMPs, nonboundary coefficients in W j should resemble white noise; i.e., cov {W j,t, W j,t } when t 6= t, and var {W j,t } should not depend upon t can test for homogeneity of variance in using W j over a range of levels j suppose U,..., U N are independent normal RVs with E{U t } = and var {U t } = σ 2 t want to test null hypothesis H : σ 2 = σ2 = = σ2 N can test H versus a variety of alternatives, e.g., H : σ 2 = = σ2 k 6= σ2 k+ = = σ2 N using normalized cumulative sum of squares WMTSA: IV 32

70 Homogeneity of Variance: II to define test statistic D, start with P kj= Uj 2 P k, k =,..., N 2 max k N 2 P N j= U2 j and then compute D max (D +, D ), where µ D + k + N P k & D max k N 2 µ P k k N can reject H if observed D is too large, where too large is quantified by considering distribution of D under H need to find critical value x α such that P[D x α ] = α for, e.g., α =.,.5 or. WMTSA: IV 33

71 Homogeneity of Variance: III once determined, can perform α level test of H : compute D statistic from data U,..., U N reject H at level α if D x α fail to reject H at level α if D < x α can determine critical values x α in two ways Monte Carlo simulations large sample approximation to distribution of D: P[(N/2) /2 D x] + 2 ( ) l e 2l2 x 2 l= (reasonable approximation for N 28) WMTSA: IV 34

72 Homogeneity of Variance: IV idea: given time series { t }, compute D using nonboundary wavelet coefficients W j,t (there are Mj N j L j of these): P k P kt=l j W 2 j,t PN j t=l j W 2 j,t, k = L j,..., N j 2 if null hypothesis rejected at level j, can use nonboundary MODWT coefficients to locate change point based on P kt=lj W ep f j,t 2 k P N t=l j W f j,t 2, k = L j,..., N 2 along with analogs e D + k and e D k of D+ k and D k WMTSA: IV 35

73 Example Annual Minima of Nile River: I 5 x years scale (years) left-hand plot: annual minima of Nile River.. new measuring device introduced around year 75 right: Haar ˆν 2 (τ j) before (x s) and after (o s) year 75.5, with 95% confidence intervals based upon χ 2 η 3 approximation o x o x o x o WMTSA: IV 36

74 Example Annual Minima of Nile River: II l(δ ) based upon last 52 values (years 773 to 284), plot shows l(δ ) versus δ for the first wavelet-based approximate MLE using the LA(8) wavelet (upper curve) and corresponding curve for exact MLE (lower) δ wavelet-based approximate MLE is value minimizing upper curve: δ. =.4532 exact MLE is value minimizing lower curve: ˆδ. =.4452 WMTSA: IV 37

75 Example Annual Minima of Nile River: III. O. O O O O. O O O..... f using last 52 values again, variance of wavelet coefficients computed via LA(8) MLEs δ and σ 2 ε( δ) (solid curve) as compared to sample variances of LA(8) wavelet coefficients (circles) agreement is almost too good to be true! O WMTSA: IV 38

76 Example Annual Minima of Nile River: IV results of testing all Nile River minima for homogeneity of variance using the Haar wavelet filter with critical values determined by computer simulations critical levels τ j Mj D % 5% % year years years years can reject null hypothesis of homogeneity of variance at level of significance.5 for scales τ & τ 2, but not at larger scales WMTSA: IV 39

77 Example Annual Minima of Nile River: V year Nile River minima (top plot) along with curves (constructed per Equation (382)) for scales τ & τ 2 (middle & bottom) to identify change point via time of maximum deviation (vertical lines denote year 75) WMTSA: IV 4

78 Summary DWT approximately decorrelate certain time series, including ones coming from FD and related processes leads to schemes for simulating time series and bootstrapping also leads to schemes for estimating parameters of FD process approximate maximum likelihood estimators (two varieties) weighted least squares estimator can also devise wavelet-based tests for homogeneity of variance trends (see Craigmile et al., 24, for details) WMTSA: IV 4

79 References: I bootstrapping A. C. Davison and D. V. Hinkley (997), Bootstrap Methods and their Applications, Cambridge, England: Cambridge University Press D. B. Percival, S. Sardy and A. C. Davison (2), Wavestrapping Time Series: Adaptive Wavelet-Based Bootstrapping, in Nonlinear and Nonstationary Signal Processing, edited by W. J. Fitzgerald, R. L. Smith, A. T. Walden and P. C. Young. Cambridge, England: Cambridge University Press, pp A. M. Sabatini (999), Wavelet-Based Estimation of /f-type Signal Parameters: Confidence Intervals Using the Bootstrap, IEEE Transactions on Signal Processing, 47(2), pp A. M. Sabatini (26), A Wavelet-Based Bootstrap Method Applied to Inertial Sensor Stochastic Error Modelling Using the Allan Variance, Measurement Science and Technology, 7, pp B. J Whitcher (26), Wavelet-Based Bootstrapping of Spatial Patterns on a Finite Lattice, Computational Statistics & Data Analysis, 5(9), pp IV 42

80 References: II decorrelation property of DWTs P. F. Craigmile and D. B. Percival (25), Asymptotic Decorrelation of Between-Scale Wavelet Coefficients, IEEE Transactions on Information Theory, 5, pp parameter estimation for FD processes P. F. Craigmile, P. Guttorp and D. B. Percival (25), Wavelet-Based Parameter Estimation for Polynomial Contaminated Fractionally Differenced Processes, IEEE Transactions on Signal Processing, 53, pp testing for homogeneity of variance B. J Whitcher, S. D. Byers, P. Guttorp and D. B. Percival (22), Testing for Homogeneity of Variance in Time Series: Long Memory, Wavelets and the Nile River, Water Resources Research, 38,.29/2WR59. wavelet-based trend assessment P. F. Craigmile, P. Guttorp and D. B. Percival (24), Trend Assessment in a Long Memory Dependence Model using the Discrete Wavelet Transform, Environmetrics, 5, pp IV 43

An Introduction to Wavelets with Applications in Environmental Science

An Introduction to Wavelets with Applications in Environmental Science An Introduction to Wavelets with Applications in Environmental Science Don Percival Applied Physics Lab, University of Washington Data Analysis Products Division, MathSoft overheads for talk available

More information

Wavelet Methods for Time Series Analysis. Motivating Question

Wavelet Methods for Time Series Analysis. Motivating Question Wavelet Methods for Time Series Analysis Part VII: Wavelet-Based Bootstrapping start with some background on bootstrapping and its rationale describe adjustments to the bootstrap that allow it to work

More information

Wavelet Methods for Time Series Analysis. Part IX: Wavelet-Based Bootstrapping

Wavelet Methods for Time Series Analysis. Part IX: Wavelet-Based Bootstrapping Wavelet Methods for Time Series Analysis Part IX: Wavelet-Based Bootstrapping start with some background on bootstrapping and its rationale describe adjustments to the bootstrap that allow it to work with

More information

Wavelet-Based Bootstrapping for Non-Gaussian Time Series. Don Percival

Wavelet-Based Bootstrapping for Non-Gaussian Time Series. Don Percival Wavelet-Based Bootstrapping for Non-Gaussian Time Series Don Percival Applied Physics Laboratory Department of Statistics University of Washington Seattle, Washington, USA overheads for talk available

More information

Wavelet Methods for Time Series Analysis. Part II: Wavelet-Based Statistical Analysis of Time Series

Wavelet Methods for Time Series Analysis. Part II: Wavelet-Based Statistical Analysis of Time Series Wavelet Methods for Time Series Analysis Part II: Wavelet-Based Statistical Analysis of Time Series topics to covered: wavelet variance (analysis phase of MODWT) wavelet-based signal extraction (synthesis

More information

Wavelet Methods for Time Series Analysis

Wavelet Methods for Time Series Analysis Wavelet Methods for Time Series Analysis Donald B. Percival UNIVERSITY OF WASHINGTON, SEATTLE Andrew T. Walden IMPERIAL COLLEGE OF SCIENCE, TECHNOLOGY AND MEDICINE, LONDON CAMBRIDGE UNIVERSITY PRESS Contents

More information

A Tutorial on Stochastic Models and Statistical Analysis for Frequency Stability Measurements

A Tutorial on Stochastic Models and Statistical Analysis for Frequency Stability Measurements A Tutorial on Stochastic Models and Statistical Analysis for Frequency Stability Measurements Don Percival Applied Physics Lab, University of Washington, Seattle overheads for talk available at http://staff.washington.edu/dbp/talks.html

More information

Testing for Homogeneity of Variance in Time Series: Long Memory, Wavelets and the Nile River

Testing for Homogeneity of Variance in Time Series: Long Memory, Wavelets and the Nile River Testing for Homogeneity of Variance in Time Series: Long Memory, Wavelets and the Nile River Brandon Whitcher Geophysical Statistics Project National Center for Atmospheric Research Boulder, Colorado Peter

More information

A Tutorial on Stochastic Models and Statistical Analysis for Frequency Stability Measurements

A Tutorial on Stochastic Models and Statistical Analysis for Frequency Stability Measurements A Tutorial on Stochastic Models and Statistical Analysis for Frequency Stability Measurements Don Percival Applied Physics Lab, University of Washington, Seattle overheads for talk available at http://staffwashingtonedu/dbp/talkshtml

More information

Wavelet Analysis of Discrete Time Series

Wavelet Analysis of Discrete Time Series Wavelet Analysis of Discrete Time Series Andrew T. Walden Abstract. We give a brief review of some of the wavelet-based techniques currently available for the analysis of arbitrary-length discrete time

More information

Wavelet domain test for long range dependence in the presence of a trend

Wavelet domain test for long range dependence in the presence of a trend Wavelet domain test for long range dependence in the presence of a trend Agnieszka Jach and Piotr Kokoszka Utah State University July 24, 27 Abstract We propose a test to distinguish a weakly dependent

More information

FGN 1.0 PPL 1.0 FD

FGN 1.0 PPL 1.0 FD FGN PPL FD f f Figure SDFs for FGN, PPL and FD processes (top to bottom rows, respectively) on both linear/log and log/log aes (left- and right-hand columns, respectively) Each SDF S X ( ) is normalized

More information

Asymptotic Decorrelation of Between-Scale Wavelet Coefficients

Asymptotic Decorrelation of Between-Scale Wavelet Coefficients Asymptotic Decorrelation of Between-Scale Wavelet Coefficients Peter F. Craigmile 1 and Donald B. Percival 2 1 Department of Statistics, The Ohio State University, 44 Cockins Hall, 1958 Neil Avenue, Columbus.

More information

Ch.10 Autocorrelated Disturbances (June 15, 2016)

Ch.10 Autocorrelated Disturbances (June 15, 2016) Ch10 Autocorrelated Disturbances (June 15, 2016) In a time-series linear regression model setting, Y t = x tβ + u t, t = 1, 2,, T, (10-1) a common problem is autocorrelation, or serial correlation of the

More information

Wavestrapping Time Series: Adaptive Wavelet-Based Bootstrapping

Wavestrapping Time Series: Adaptive Wavelet-Based Bootstrapping Wavestrapping Time Series: Adaptive Wavelet-Based Bootstrapping D. B. Percival, S. Sardy and A. C. Davison 1 Introduction Suppose we observe a time series that can be regarded as a realization of a portion

More information

Testing for homogeneity of variance in time series: Long memory, wavelets, and the Nile River

Testing for homogeneity of variance in time series: Long memory, wavelets, and the Nile River WATER RESOURCES RESEARCH, VOL. 38, NO. 5, 1054, 10.109/001WR000509, 00 Testing for homogeneity of variance in time series: Long memory, wavelets, and the Nile River B. Whitcher, 1 S. D. Byers, P. Guttorp,

More information

Differencing Revisited: I ARIMA(p,d,q) processes predicated on notion of dth order differencing of a time series {X t }: for d = 1 and 2, have X t

Differencing Revisited: I ARIMA(p,d,q) processes predicated on notion of dth order differencing of a time series {X t }: for d = 1 and 2, have X t Differencing Revisited: I ARIMA(p,d,q) processes predicated on notion of dth order differencing of a time series {X t }: for d = 1 and 2, have X t 2 X t def in general = (1 B)X t = X t X t 1 def = ( X

More information

Wavelet-based estimation for Gaussian time series and spatio-temporal processes

Wavelet-based estimation for Gaussian time series and spatio-temporal processes Wavelet-based estimation for Gaussian time series and spatio-temporal processes Dissertation Presented in Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy in the Graduate School

More information

Wavelet-Based Test for Time Series Non-Stationarity 1

Wavelet-Based Test for Time Series Non-Stationarity 1 STATISTIKA 2015 95 (4) Wavelet-Based Test for Time Series Non-Stationarity 1 Milan Bašta 2 University of Economics, Prague, Czech Republic Abstract In the present paper, we propose a wavelet-based hypothesis

More information

If we want to analyze experimental or simulated data we might encounter the following tasks:

If we want to analyze experimental or simulated data we might encounter the following tasks: Chapter 1 Introduction If we want to analyze experimental or simulated data we might encounter the following tasks: Characterization of the source of the signal and diagnosis Studying dependencies Prediction

More information

Using wavelet tools to estimate and assess trends in atmospheric data

Using wavelet tools to estimate and assess trends in atmospheric data NRCSE Using wavelet tools to estimate and assess trends in atmospheric data Wavelets Fourier analysis uses big waves Wavelets are small waves Requirements for wavelets Integrate to zero Square integrate

More information

Prof. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis

Prof. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis Introduction to Time Series Analysis 1 Contents: I. Basics of Time Series Analysis... 4 I.1 Stationarity... 5 I.2 Autocorrelation Function... 9 I.3 Partial Autocorrelation Function (PACF)... 14 I.4 Transformation

More information

Topic 4 Unit Roots. Gerald P. Dwyer. February Clemson University

Topic 4 Unit Roots. Gerald P. Dwyer. February Clemson University Topic 4 Unit Roots Gerald P. Dwyer Clemson University February 2016 Outline 1 Unit Roots Introduction Trend and Difference Stationary Autocorrelations of Series That Have Deterministic or Stochastic Trends

More information

Empirical Market Microstructure Analysis (EMMA)

Empirical Market Microstructure Analysis (EMMA) Empirical Market Microstructure Analysis (EMMA) Lecture 3: Statistical Building Blocks and Econometric Basics Prof. Dr. Michael Stein michael.stein@vwl.uni-freiburg.de Albert-Ludwigs-University of Freiburg

More information

Multiscale Detection and Location of Multiple Variance Changes in the Presence of Long Memory Brandon Whitcher EURANDOM Peter

Multiscale Detection and Location of Multiple Variance Changes in the Presence of Long Memory Brandon Whitcher EURANDOM Peter Multiscale Detection and Location of Multiple Variance Changes in the Presence of Long Memory Brandon Whitcher EURANDOM whitcher@eurandom.tue.nl Peter Guttorp University of Washington peter@stat.washington.edu

More information

Quantitative Finance II Lecture 10

Quantitative Finance II Lecture 10 Quantitative Finance II Lecture 10 Wavelets III - Applications Lukas Vacha IES FSV UK May 2016 Outline Discrete wavelet transformations: MODWT Wavelet coherence: daily financial data FTSE, DAX, PX Wavelet

More information

Nontechnical introduction to wavelets Continuous wavelet transforms Fourier versus wavelets - examples

Nontechnical introduction to wavelets Continuous wavelet transforms Fourier versus wavelets - examples Nontechnical introduction to wavelets Continuous wavelet transforms Fourier versus wavelets - examples A major part of economic time series analysis is done in the time or frequency domain separately.

More information

Testing for Homogeneity of Variance in Time Series: Long Memory, Wavelets and the Nile River NRCSE. T e c h n i c a l R e p o r t S e r i e s

Testing for Homogeneity of Variance in Time Series: Long Memory, Wavelets and the Nile River NRCSE. T e c h n i c a l R e p o r t S e r i e s Testing for Homogeneity of Variance in Time Series: Long Memory, Wavelets and the Nile River Brandon Whitcher Peter Guttorp Simon D Byers Donald B Percival NRCSE T e c h n i c a l R e p o r t S e r i e

More information

Econ 424 Time Series Concepts

Econ 424 Time Series Concepts Econ 424 Time Series Concepts Eric Zivot January 20 2015 Time Series Processes Stochastic (Random) Process { 1 2 +1 } = { } = sequence of random variables indexed by time Observed time series of length

More information

Wavelet Analysis of Variance for Time Series with Missing Values. Technical Report no. 535 Department of Statistics, University of Washington

Wavelet Analysis of Variance for Time Series with Missing Values. Technical Report no. 535 Department of Statistics, University of Washington Wavelet Analysis of Variance for Time Series with Missing Values Debashis Mondal 1 and Donald B. Percival Technical Report no. 535 Department of Statistics, University of Washington Abstract The wavelet

More information

Stochastic Processes: I. consider bowl of worms model for oscilloscope experiment:

Stochastic Processes: I. consider bowl of worms model for oscilloscope experiment: Stochastic Processes: I consider bowl of worms model for oscilloscope experiment: SAPAscope 2.0 / 0 1 RESET SAPA2e 22, 23 II 1 stochastic process is: Stochastic Processes: II informally: bowl + drawing

More information

Week 5 Quantitative Analysis of Financial Markets Characterizing Cycles

Week 5 Quantitative Analysis of Financial Markets Characterizing Cycles Week 5 Quantitative Analysis of Financial Markets Characterizing Cycles Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036

More information

Chapter 3 - Temporal processes

Chapter 3 - Temporal processes STK4150 - Intro 1 Chapter 3 - Temporal processes Odd Kolbjørnsen and Geir Storvik January 23 2017 STK4150 - Intro 2 Temporal processes Data collected over time Past, present, future, change Temporal aspect

More information

TAKEHOME FINAL EXAM e iω e 2iω e iω e 2iω

TAKEHOME FINAL EXAM e iω e 2iω e iω e 2iω ECO 513 Spring 2015 TAKEHOME FINAL EXAM (1) Suppose the univariate stochastic process y is ARMA(2,2) of the following form: y t = 1.6974y t 1.9604y t 2 + ε t 1.6628ε t 1 +.9216ε t 2, (1) where ε is i.i.d.

More information

Examples of DWT & MODWT Analysis: Overview

Examples of DWT & MODWT Analysis: Overview Examples of DWT & MODWT Analysis: Overview look at DWT analysis of electrocardiogram (ECG) data discuss potential alignment problems with the DWT and how they are alleviated with the MODWT look at MODWT

More information

(a) (3 points) Construct a 95% confidence interval for β 2 in Equation 1.

(a) (3 points) Construct a 95% confidence interval for β 2 in Equation 1. Problem 1 (21 points) An economist runs the regression y i = β 0 + x 1i β 1 + x 2i β 2 + x 3i β 3 + ε i (1) The results are summarized in the following table: Equation 1. Variable Coefficient Std. Error

More information

Use of the Autocorrelation Function for Frequency Stability Analysis

Use of the Autocorrelation Function for Frequency Stability Analysis Use of the Autocorrelation Function for Frequency Stability Analysis W.J. Riley, Hamilton Technical Services Introduction This paper describes the use of the autocorrelation function (ACF) as a complement

More information

EXAMINATION OF RELATIONSHIPS BETWEEN TIME SERIES BY WAVELETS: ILLUSTRATION WITH CZECH STOCK AND INDUSTRIAL PRODUCTION DATA

EXAMINATION OF RELATIONSHIPS BETWEEN TIME SERIES BY WAVELETS: ILLUSTRATION WITH CZECH STOCK AND INDUSTRIAL PRODUCTION DATA EXAMINATION OF RELATIONSHIPS BETWEEN TIME SERIES BY WAVELETS: ILLUSTRATION WITH CZECH STOCK AND INDUSTRIAL PRODUCTION DATA MILAN BAŠTA University of Economics, Prague, Faculty of Informatics and Statistics,

More information

Decline of Arctic Sea-Ice Thickness as Evidenced by Submarine Measurements. Don Percival

Decline of Arctic Sea-Ice Thickness as Evidenced by Submarine Measurements. Don Percival Decline of Arctic Sea-Ice Thickness as Evidenced by Submarine Measurements Don Percival Applied Physics Laboratory Department of Statistics University of Washington Seattle, Washington, USA http://facultywashingtonedu/dbp

More information

Wavelet-based confidence intervals for the self-similarity parameter

Wavelet-based confidence intervals for the self-similarity parameter Journal of Statistical Computation and Simulation Vol. 78, No. 12, December 2008, 1179 1198 Wavelet-based confidence intervals for the self-similarity parameter AGNIESZKA JACH and PIOTR KOKOSZKA* Department

More information

Solutions to Odd-Numbered End-of-Chapter Exercises: Chapter 14

Solutions to Odd-Numbered End-of-Chapter Exercises: Chapter 14 Introduction to Econometrics (3 rd Updated Edition) by James H. Stock and Mark W. Watson Solutions to Odd-Numbered End-of-Chapter Exercises: Chapter 14 (This version July 0, 014) 015 Pearson Education,

More information

Inference. Undercoverage of Wavelet-Based Resampling Confidence Intervals

Inference. Undercoverage of Wavelet-Based Resampling Confidence Intervals Communications in Statistics Simulation and Computation, 37: 1307 1315, 2008 Copyright Taylor & Francis Group, LLC ISSN: 0361-0918 print/1532-4141 online DOI: 10.1080/03610910802050902 Inference Undercoverage

More information

TIME SERIES ANALYSIS. Forecasting and Control. Wiley. Fifth Edition GWILYM M. JENKINS GEORGE E. P. BOX GREGORY C. REINSEL GRETA M.

TIME SERIES ANALYSIS. Forecasting and Control. Wiley. Fifth Edition GWILYM M. JENKINS GEORGE E. P. BOX GREGORY C. REINSEL GRETA M. TIME SERIES ANALYSIS Forecasting and Control Fifth Edition GEORGE E. P. BOX GWILYM M. JENKINS GREGORY C. REINSEL GRETA M. LJUNG Wiley CONTENTS PREFACE TO THE FIFTH EDITION PREFACE TO THE FOURTH EDITION

More information

On the Power of Tests for Regime Switching

On the Power of Tests for Regime Switching On the Power of Tests for Regime Switching joint work with Drew Carter and Ben Hansen Douglas G. Steigerwald UC Santa Barbara May 2015 D. Steigerwald (UCSB) Regime Switching May 2015 1 / 42 Motivating

More information

Econometrics of Panel Data

Econometrics of Panel Data Econometrics of Panel Data Jakub Mućk Meeting # 9 Jakub Mućk Econometrics of Panel Data Meeting # 9 1 / 22 Outline 1 Time series analysis Stationarity Unit Root Tests for Nonstationarity 2 Panel Unit Root

More information

An estimate of the long-run covariance matrix, Ω, is necessary to calculate asymptotic

An estimate of the long-run covariance matrix, Ω, is necessary to calculate asymptotic Chapter 6 ESTIMATION OF THE LONG-RUN COVARIANCE MATRIX An estimate of the long-run covariance matrix, Ω, is necessary to calculate asymptotic standard errors for the OLS and linear IV estimators presented

More information

Statistics of Stochastic Processes

Statistics of Stochastic Processes Prof. Dr. J. Franke All of Statistics 4.1 Statistics of Stochastic Processes discrete time: sequence of r.v...., X 1, X 0, X 1, X 2,... X t R d in general. Here: d = 1. continuous time: random function

More information

IS THE NORTH ATLANTIC OSCILLATION A RANDOM WALK? A COMMENT WITH FURTHER RESULTS

IS THE NORTH ATLANTIC OSCILLATION A RANDOM WALK? A COMMENT WITH FURTHER RESULTS INTERNATIONAL JOURNAL OF CLIMATOLOGY Int. J. Climatol. 24: 377 383 (24) Published online 11 February 24 in Wiley InterScience (www.interscience.wiley.com). DOI: 1.12/joc.13 IS THE NORTH ATLANTIC OSCILLATION

More information

1. Fundamental concepts

1. Fundamental concepts . Fundamental concepts A time series is a sequence of data points, measured typically at successive times spaced at uniform intervals. Time series are used in such fields as statistics, signal processing

More information

Covariance Stationary Time Series. Example: Independent White Noise (IWN(0,σ 2 )) Y t = ε t, ε t iid N(0,σ 2 )

Covariance Stationary Time Series. Example: Independent White Noise (IWN(0,σ 2 )) Y t = ε t, ε t iid N(0,σ 2 ) Covariance Stationary Time Series Stochastic Process: sequence of rv s ordered by time {Y t } {...,Y 1,Y 0,Y 1,...} Defn: {Y t } is covariance stationary if E[Y t ]μ for all t cov(y t,y t j )E[(Y t μ)(y

More information

Bayesian Regression Linear and Logistic Regression

Bayesian Regression Linear and Logistic Regression When we want more than point estimates Bayesian Regression Linear and Logistic Regression Nicole Beckage Ordinary Least Squares Regression and Lasso Regression return only point estimates But what if we

More information

Utility of Correlation Functions

Utility of Correlation Functions Utility of Correlation Functions 1. As a means for estimating power spectra (e.g. a correlator + WK theorem). 2. For establishing characteristic time scales in time series (width of the ACF or ACV). 3.

More information

Multivariate Time Series Analysis and Its Applications [Tsay (2005), chapter 8]

Multivariate Time Series Analysis and Its Applications [Tsay (2005), chapter 8] 1 Multivariate Time Series Analysis and Its Applications [Tsay (2005), chapter 8] Insights: Price movements in one market can spread easily and instantly to another market [economic globalization and internet

More information

Econometric Methods for Panel Data

Econometric Methods for Panel Data Based on the books by Baltagi: Econometric Analysis of Panel Data and by Hsiao: Analysis of Panel Data Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies

More information

Wavelet Methods for Time Series Analysis. Part III: Wavelet-Based Signal Extraction and Denoising

Wavelet Methods for Time Series Analysis. Part III: Wavelet-Based Signal Extraction and Denoising Wavelet Methods for Time Series Analysis Part III: Wavelet-Based Signal Extraction and Denoising overview of key ideas behind wavelet-based approach description of four basic models for signal estimation

More information

Wavelet methods and null models for spatial pattern analysis

Wavelet methods and null models for spatial pattern analysis Wavelet methods and null models for spatial pattern analysis Pavel Dodonov Part of my PhD thesis, by the Federal University of São Carlos (São Carlos, SP, Brazil), supervised by Dr Dalva M. Silva-Matos

More information

covariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of

covariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of Index* The Statistical Analysis of Time Series by T. W. Anderson Copyright 1971 John Wiley & Sons, Inc. Aliasing, 387-388 Autoregressive {continued) Amplitude, 4, 94 case of first-order, 174 Associated

More information

Statistical signal processing

Statistical signal processing Statistical signal processing Short overview of the fundamentals Outline Random variables Random processes Stationarity Ergodicity Spectral analysis Random variable and processes Intuition: A random variable

More information

Notes on Time Series Modeling

Notes on Time Series Modeling Notes on Time Series Modeling Garey Ramey University of California, San Diego January 17 1 Stationary processes De nition A stochastic process is any set of random variables y t indexed by t T : fy t g

More information

Comments on New Approaches in Period Analysis of Astronomical Time Series by Pavlos Protopapas (Or: A Pavlosian Response ) Don Percival

Comments on New Approaches in Period Analysis of Astronomical Time Series by Pavlos Protopapas (Or: A Pavlosian Response ) Don Percival Comments on New Approaches in Period Analysis of Astronomical Time Series by Pavlos Protopapas (Or: A Pavlosian Response ) Don Percival Applied Physics Laboratory Department of Statistics University of

More information

A nonparametric test for seasonal unit roots

A nonparametric test for seasonal unit roots Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna To be presented in Innsbruck November 7, 2007 Abstract We consider a nonparametric test for the

More information

Time Series: Theory and Methods

Time Series: Theory and Methods Peter J. Brockwell Richard A. Davis Time Series: Theory and Methods Second Edition With 124 Illustrations Springer Contents Preface to the Second Edition Preface to the First Edition vn ix CHAPTER 1 Stationary

More information

Measurement Error and Linear Regression of Astronomical Data. Brandon Kelly Penn State Summer School in Astrostatistics, June 2007

Measurement Error and Linear Regression of Astronomical Data. Brandon Kelly Penn State Summer School in Astrostatistics, June 2007 Measurement Error and Linear Regression of Astronomical Data Brandon Kelly Penn State Summer School in Astrostatistics, June 2007 Classical Regression Model Collect n data points, denote i th pair as (η

More information

ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process

ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random

More information

Computational Data Analysis!

Computational Data Analysis! 12.714 Computational Data Analysis! Alan Chave (alan@whoi.edu)! Thomas Herring (tah@mit.edu),! http://geoweb.mit.edu/~tah/12.714! Introduction to Spectral Analysis! Topics Today! Aspects of Time series

More information

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY & Contents PREFACE xiii 1 1.1. 1.2. Difference Equations First-Order Difference Equations 1 /?th-order Difference

More information

Testing for IID Noise/White Noise: I

Testing for IID Noise/White Noise: I Testing for IID Noise/White Noise: I want to be able to test null hypothesis that time series {x t } or set of residuals {r t } is IID(0, σ 2 ) or WN(0, σ 2 ) many such tests exist, including informal

More information

Stochastic Processes. A stochastic process is a function of two variables:

Stochastic Processes. A stochastic process is a function of two variables: Stochastic Processes Stochastic: from Greek stochastikos, proceeding by guesswork, literally, skillful in aiming. A stochastic process is simply a collection of random variables labelled by some parameter:

More information

Hypothesis Testing for Var-Cov Components

Hypothesis Testing for Var-Cov Components Hypothesis Testing for Var-Cov Components When the specification of coefficients as fixed, random or non-randomly varying is considered, a null hypothesis of the form is considered, where Additional output

More information

A Diagnostic for Seasonality Based Upon Autoregressive Roots

A Diagnostic for Seasonality Based Upon Autoregressive Roots A Diagnostic for Seasonality Based Upon Autoregressive Roots Tucker McElroy (U.S. Census Bureau) 2018 Seasonal Adjustment Practitioners Workshop April 26, 2018 1 / 33 Disclaimer This presentation is released

More information

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY PREFACE xiii 1 Difference Equations 1.1. First-Order Difference Equations 1 1.2. pth-order Difference Equations 7

More information

A Bootstrap Test for Causality with Endogenous Lag Length Choice. - theory and application in finance

A Bootstrap Test for Causality with Endogenous Lag Length Choice. - theory and application in finance CESIS Electronic Working Paper Series Paper No. 223 A Bootstrap Test for Causality with Endogenous Lag Length Choice - theory and application in finance R. Scott Hacker and Abdulnasser Hatemi-J April 200

More information

CHANGE DETECTION IN TIME SERIES

CHANGE DETECTION IN TIME SERIES CHANGE DETECTION IN TIME SERIES Edit Gombay TIES - 2008 University of British Columbia, Kelowna June 8-13, 2008 Outline Introduction Results Examples References Introduction sunspot.year 0 50 100 150 1700

More information

Defect Detection using Nonparametric Regression

Defect Detection using Nonparametric Regression Defect Detection using Nonparametric Regression Siana Halim Industrial Engineering Department-Petra Christian University Siwalankerto 121-131 Surabaya- Indonesia halim@petra.ac.id Abstract: To compare

More information

1 Class Organization. 2 Introduction

1 Class Organization. 2 Introduction Time Series Analysis, Lecture 1, 2018 1 1 Class Organization Course Description Prerequisite Homework and Grading Readings and Lecture Notes Course Website: http://www.nanlifinance.org/teaching.html wechat

More information

Volatility. Gerald P. Dwyer. February Clemson University

Volatility. Gerald P. Dwyer. February Clemson University Volatility Gerald P. Dwyer Clemson University February 2016 Outline 1 Volatility Characteristics of Time Series Heteroskedasticity Simpler Estimation Strategies Exponentially Weighted Moving Average Use

More information

Linear Model Under General Variance Structure: Autocorrelation

Linear Model Under General Variance Structure: Autocorrelation Linear Model Under General Variance Structure: Autocorrelation A Definition of Autocorrelation In this section, we consider another special case of the model Y = X β + e, or y t = x t β + e t, t = 1,..,.

More information

Trend Assessment of Correlated Data

Trend Assessment of Correlated Data Trend Assessment of Correlated Data Malaak Kallache, Henning Rust and Jürgen Kropp Potsdam Institute for Climate Impact Research P.O. Box 60 12 03 14412 Potsdam, Germany Abstract The assessment of trends

More information

Wavelet semi-parametric inference for long memory in volatility in the presence of a trend

Wavelet semi-parametric inference for long memory in volatility in the presence of a trend Journal of Statistical Computation and Simulation ISSN: 0094-9655 (Print) 1563-5163 (Online) Journal homepage: http://www.tandfonline.com/loi/gscs20 Wavelet semi-parametric inference for long memory in

More information

Stochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno

Stochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function.

More information

{ } Stochastic processes. Models for time series. Specification of a process. Specification of a process. , X t3. ,...X tn }

{ } Stochastic processes. Models for time series. Specification of a process. Specification of a process. , X t3. ,...X tn } Stochastic processes Time series are an example of a stochastic or random process Models for time series A stochastic process is 'a statistical phenomenon that evolves in time according to probabilistic

More information

Exchange rates expectations and chaotic dynamics: a replication study

Exchange rates expectations and chaotic dynamics: a replication study Discussion Paper No. 2018-34 April 19, 2018 http://www.economics-ejournal.org/economics/discussionpapers/2018-34 Exchange rates expectations and chaotic dynamics: a replication study Jorge Belaire-Franch

More information

MA 575 Linear Models: Cedric E. Ginestet, Boston University Non-parametric Inference, Polynomial Regression Week 9, Lecture 2

MA 575 Linear Models: Cedric E. Ginestet, Boston University Non-parametric Inference, Polynomial Regression Week 9, Lecture 2 MA 575 Linear Models: Cedric E. Ginestet, Boston University Non-parametric Inference, Polynomial Regression Week 9, Lecture 2 1 Bootstrapped Bias and CIs Given a multiple regression model with mean and

More information

Christopher Dougherty London School of Economics and Political Science

Christopher Dougherty London School of Economics and Political Science Introduction to Econometrics FIFTH EDITION Christopher Dougherty London School of Economics and Political Science OXFORD UNIVERSITY PRESS Contents INTRODU CTION 1 Why study econometrics? 1 Aim of this

More information

Statistics of stochastic processes

Statistics of stochastic processes Introduction Statistics of stochastic processes Generally statistics is performed on observations y 1,..., y n assumed to be realizations of independent random variables Y 1,..., Y n. 14 settembre 2014

More information

For a stochastic process {Y t : t = 0, ±1, ±2, ±3, }, the mean function is defined by (2.2.1) ± 2..., γ t,

For a stochastic process {Y t : t = 0, ±1, ±2, ±3, }, the mean function is defined by (2.2.1) ± 2..., γ t, CHAPTER 2 FUNDAMENTAL CONCEPTS This chapter describes the fundamental concepts in the theory of time series models. In particular, we introduce the concepts of stochastic processes, mean and covariance

More information

Discrete time processes

Discrete time processes Discrete time processes Predictions are difficult. Especially about the future Mark Twain. Florian Herzog 2013 Modeling observed data When we model observed (realized) data, we encounter usually the following

More information

Cointegrated VARIMA models: specification and. simulation

Cointegrated VARIMA models: specification and. simulation Cointegrated VARIMA models: specification and simulation José L. Gallego and Carlos Díaz Universidad de Cantabria. Abstract In this note we show how specify cointegrated vector autoregressive-moving average

More information

Testing Restrictions and Comparing Models

Testing Restrictions and Comparing Models Econ. 513, Time Series Econometrics Fall 00 Chris Sims Testing Restrictions and Comparing Models 1. THE PROBLEM We consider here the problem of comparing two parametric models for the data X, defined by

More information

Defining the Discrete Wavelet Transform (DWT)

Defining the Discrete Wavelet Transform (DWT) Defining the Discrete Wavelet Transform (DWT) can formulate DWT via elegant pyramid algorithm defines W for non-haar wavelets (consistent with Haar) computes W = WX using O(N) multiplications brute force

More information

Obtaining Critical Values for Test of Markov Regime Switching

Obtaining Critical Values for Test of Markov Regime Switching University of California, Santa Barbara From the SelectedWorks of Douglas G. Steigerwald November 1, 01 Obtaining Critical Values for Test of Markov Regime Switching Douglas G Steigerwald, University of

More information

Multivariate Time Series: VAR(p) Processes and Models

Multivariate Time Series: VAR(p) Processes and Models Multivariate Time Series: VAR(p) Processes and Models A VAR(p) model, for p > 0 is X t = φ 0 + Φ 1 X t 1 + + Φ p X t p + A t, where X t, φ 0, and X t i are k-vectors, Φ 1,..., Φ p are k k matrices, with

More information

Part II. Time Series

Part II. Time Series Part II Time Series 12 Introduction This Part is mainly a summary of the book of Brockwell and Davis (2002). Additionally the textbook Shumway and Stoffer (2010) can be recommended. 1 Our purpose is to

More information

Expressions for the covariance matrix of covariance data

Expressions for the covariance matrix of covariance data Expressions for the covariance matrix of covariance data Torsten Söderström Division of Systems and Control, Department of Information Technology, Uppsala University, P O Box 337, SE-7505 Uppsala, Sweden

More information

Time series models in the Frequency domain. The power spectrum, Spectral analysis

Time series models in the Frequency domain. The power spectrum, Spectral analysis ime series models in the Frequency domain he power spectrum, Spectral analysis Relationship between the periodogram and the autocorrelations = + = ( ) ( ˆ α ˆ ) β I Yt cos t + Yt sin t t= t= ( ( ) ) cosλ

More information

Minitab Project Report Assignment 3

Minitab Project Report Assignment 3 3.1.1 Simulation of Gaussian White Noise Minitab Project Report Assignment 3 Time Series Plot of zt Function zt 1 0. 0. zt 0-1 0. 0. -0. -0. - -3 1 0 30 0 50 Index 0 70 0 90 0 1 1 1 1 0 marks The series

More information

11. Further Issues in Using OLS with TS Data

11. Further Issues in Using OLS with TS Data 11. Further Issues in Using OLS with TS Data With TS, including lags of the dependent variable often allow us to fit much better the variation in y Exact distribution theory is rarely available in TS applications,

More information

Nonstationary Time Series:

Nonstationary Time Series: Nonstationary Time Series: Unit Roots Egon Zakrajšek Division of Monetary Affairs Federal Reserve Board Summer School in Financial Mathematics Faculty of Mathematics & Physics University of Ljubljana September

More information

Generalised AR and MA Models and Applications

Generalised AR and MA Models and Applications Chapter 3 Generalised AR and MA Models and Applications 3.1 Generalised Autoregressive Processes Consider an AR1) process given by 1 αb)x t = Z t ; α < 1. In this case, the acf is, ρ k = α k for k 0 and

More information

Linear Models for Regression

Linear Models for Regression Linear Models for Regression CSE 4309 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington 1 The Regression Problem Training data: A set of input-output

More information