Teletrac modeling and estimation

Size: px
Start display at page:

Download "Teletrac modeling and estimation"

Transcription

1 Teletrac modeling and estimation File 2 José Roberto Amazonas jra@lcs.poli.usp.br Telecommunications and Control Engineering Dept. - PTC Escola Politécnica University of São Paulo - USP São Paulo 11/2008 Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

2 Outline 1 Teletrac Fractal Nature Fractals The Hurst Exponent LRD Self-similarity Impulsiveness Final remarks Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

3 Fractals Outline 1 Teletrac Fractal Nature Fractals The Hurst Exponent LRD Self-similarity Impulsiveness Final remarks Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

4 Fractals Introduction The shapes of classical geometry - triangles, circles, spheres, etc. - loose their structures when magnied. For example, a person on the Earth's surface has the impression that it is at. On the other hand, an astronaut in orbit sees a round Earth. Suppose that someone has not been informed of being on a point of a circle which has a radius of hundreds of kilometers. This observer realizes the circle as a straight line even though it is not true. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

5 Fractals Mandelbrot set Benoit B. Mandelbrot proposed in 1975 the term fractal (from latin fractus, that means fractured, broken) to describe mathematical objects having a details rich structure along several observation scales. The Mandelbrot set is a mathematical fractal with a detailed structure (i. e., highly irregular) along an innite series of scales. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

6 Fractals Mandelbrot set 2 y interval: [ 1.5, 1.5] x interval: [ 2.5, 1.5] y interval: [ , ] x interval: [ , ] Self-similarity: a self-similar object contains smaller copies of itself in all scales. The Mandelbrot set is a deterministic fractal as it is exactly self-similar. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

7 Fractals Random fractals Physical and human sciences provide several examples of random fractals, in which self-similarity occurs in a statistical sense: climatology and hydrology time series; functional magnetic resonance of the human brain; uids turbulent movements; nancial data series; Sweden coast; cauliower. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

8 Fractals Sweden coast Figure: Resolution = 500 m Figure: Resolution = 1.4 km Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

9 Fractals Sweden coast 2 Figure: Resolution = 250 m Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

10 Fractals Cauliower Figure: Cauliower self-similarity Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

11 Fractals Cantor set Figure: Five initial iterations of the Cantor set Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

12 Fractals Ethernet trac Fig. 6 shows the Ethernet trac collected at the Drexel University's local network; It is self-similar and highly impulsive at four aggregation time scales: (10 ms, 100 ms, 1 s and 10 s).; The 100 ms scale series was obtained by aggregating the 10 ms scale series, i. e., a point at the 100 ms scale corresponds to the bytes addition in 10 consecutive bins of the 10 ms scale; It is surprising that successive aggregations do not smooth the trac; Smoothing would happen if the trac could be well modeled by the Poisson process. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

13 Fractals Ethernet trac 2 Figure: Drexel University's local area network Ethernet trac Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

14 Fractals Figure: (l) Ethernet real trac; (c) Poisson simulated trac; (r) Self-similar simulated trac Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61 Ethernet real trac vs. simulated trac

15 The Hurst Exponent Outline 1 Teletrac Fractal Nature Fractals The Hurst Exponent LRD Self-similarity Impulsiveness Final remarks Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

16 The Hurst Exponent General remarks Due to historical reasons, the persistence degree (LRD) of a time series is characterized by means of the Hurst parameter H, 0 < H < 1; A time series is LRD (self-similar) when 1/2 < H < 1; It is SRD (Short Range Dependence) when 0 < H 1/2; Closer is H to 1, higher is the series persistence degree; We say the series is monofractal if H is time invariant; We say the series is multifractal, if H varies in time, both in a deterministic or random way. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

17 The Hurst Exponent General remarks 2 It has been shown that the WAN trac may be multifractal, with non-gaussian marginal distribution, at rened time scales; On the other hand, a monofractal behavior has been observed for the LAN trac; Fig. 8 shows a realization produced by the Riedi's MWM model. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

18 The Hurst Exponent MWM realization 7 MWM c/ a mesma AC do FGN, H= Figure: Multifractal trac simulated by means of the MWM model. The time series impulsiveness varies in time: hateroscedasticity Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

19 The Hurst Exponent A long-memory process ACF Series : lrd1h09noiir.df ACF Lag Figure: A LRD series' ACF with H = 0.9 and N = 4096 samples. The continuous line is the autocorrelation function of the AR model that could be adjusted by the ar function of the S+FinMetrics software according to the AIC criterion. An AR(15) model was obtained. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

20 The Hurst Exponent Long memory behavior Aggregate trac can also show an ACF with long and short memory mixed characteristics. This behavior is typical of the ARFIMA model class. Long memory is characterized in the frequency domain by an 1/f α singularity, 0 < α < 1 (α = 2H 1), for f 0. Fig. 10 shows that the SDF of a FD model class with d = 0.4 (d = H 1/2) has an 1/f α behavior at the spectrum origin, while the AR(4) has not. FD(d) corresponds to an ARFIMA(p, d, q) with p = q = 0. The literature refers the LRD processes as 1/f noise. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

21 The Hurst Exponent Long memory FD(0.4) AR(4) 20 PSD (db) frequency Figure: SDF for same power AR(4) and FD(0.4) models. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

22 LRD Outline 1 Teletrac Fractal Nature Fractals The Hurst Exponent LRD Self-similarity Impulsiveness Final remarks Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

23 LRD Sample mean variance Consider a stationary random process x t, t Z, with mean µ x and variance σ 2. x Let x 1, x 2,..., x N be the observations of a realization of x t. If the random variables x 1, x 2,..., x N are independent or uncorrelated, then, the sample mean x variance is given by σ 2 x = σ2 x N. (1) Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

24 LRD Condence interval If the sample is large enough, the x estimator's sample distribution is normal. The expression for the µ x condence interval, at (1 β) condence level is given by σ x x z β/2 N µ x x + z β/2 N, (2) σ x in which z β/2 denotes the quantile q (1 β/2) of the standard normal distribution. The quantile q α of a distribution function F x is the value for which F qα = α. The median, for example, corresponds to q 0,5. Given a probability 1 β, we nd z β/2 for which P{ z β/2 < Z < z β/2 } = 1 β (z β/2 = 1, 96 para 1 β = 95%). Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

25 LRD Long range dependence Denition (Long range dependence) x t is a long range dependence or long memory process if there are constants α and C P, satisfying 0 < α < 1 and C P > 0, for which P x (f ) lim = 1, (3) f 0 C P f α where P x (f ) denotes the SDF of x t and f represents the normalized frequency ( 1/2 f 1/2), in cycles/sample. This is an asymptotic denition because the SDF is not specied for frequencies far from the origin. H = α + 1, 1/2 < H < 1. (4) 2 Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

26 LRD Long range dependence 2 An alternate denition may be given in the time domain. x t is a 1/f α process if its autocorrelation R x (τ), for suciently large values of the lag τ, decreases according to a power function: in which C R > 0. lim τ The singularity at the spectrum's origin implies R x (τ) = 1, (5) C R τ (1 α) τ= R x (τ) =, (6) for 1/2 < H < 1, i. e., the autocorrelations decay towards zero so slowly that they are not summable. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

27 LRD Long range dependence 3 This behavior is drastically dierent from that presented by an ARMA process in which the autocorrelation's decay is fast, i. e., exponential: in which C > 0 and 0 < r < 1. R x (τ) Cr τ, τ = 1, 2,..., (7) ARMA processes have short range dependence. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

28 LRD Long range dependence 4 If x t is LRD, the variance of x decreases with the sample size N more slowly than in the traditional case( independent or uncorrelated variables): σ 2 x σ 2 x c(ρ x)n α 1, (8) in which c(ρ x ) is dened by lim N (1+α) ρ x (i, j). (9) N i j In this case, the x distribution is asymptotically Gaussian with E[ x] = µ x. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

29 LRD Long range dependence 5 The LRD behavior of x t makes parameters estimation, as x, more dicult than that of uncorrelated observations. In this case, the condence interval equation for µ x (given by (2)) is no longer valid. In fact, for a given condence level (1 β), the condence interval must be streched multiplying it by a factor F : F = N α/2 c(ρ x ). (10) This correction factor F increases with N, and in the limit goes to innity. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

30 LRD Aggregate process The M order aggregate process of x t, denoted by X (M) t, corresponds to a moving average of M size blocks without overlap of x t, i. e., X (M) i = 1 M Mi t=m(i 1)+1 x t. (11) The following property is valid for a long memory process x t : in which c is a constant. lim M Var X (M) Aggregation is equivalent to a time scale change. t = c, (12) M (2H 2) Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

31 LRD Aggregate process 2 It can be realized that the aggregate process is statistically similar to the original process, in the sense that a nite number of successive aggregations does not destroy the original proccess' impulsive character. Therefore, (12) suggests that long range dependence and self-similarity properties are closely related. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

32 Self-similarity Outline 1 Teletrac Fractal Nature Fractals The Hurst Exponent LRD Self-similarity Impulsiveness Final remarks Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

33 Self-similarity Denition Denition (Processo H-ss) A stochastic process {y t } t R is self-similar with parameter 0 < H < 1, i. e., it is H-ss if, for any a > 0, {y(t)} d = {a H y(at)}, (13) in which d = denotes equality between the nite-dimensions distributions. A H-ss process is LRD if 1/2 < H < 1. The Brownian Movement (continuous time), also known as Wiener's process, is self-similar with H = 1/2 (but it is not LRD). Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

34 Self-similarity Stationary increments If the process x t = y t, called process of y t increments or rst dierence of y t, is stationary, then y t is called H-sssi (H self-similar with stationary increments). In this case, the process H-sssi y t is a rst order integrated process, y t I (1). If the moments of y(t) of order lower or equal to q exist, from (13) we conclude that E y t q = E y 1 q t qh. (14) So, the process y t I (1) cannot be stationary. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

35 Self-similarity Autocovariance of a H-ss process Assuming E[y t ] = 0 for the sake of simplifying notation 1, it can be shown that the y t autocovariance is given by C y (t, s) = E[y t y s ] = σ2 x 2 [t2h + s 2H (t s) 2H ]. (15) in which is σ 2 x = E[(y t y t 1 ) 2 ] = E[y 2 (1)] is the variance of the x t process of increments. 1 So, E[x t] = E[y t y t 1 ] = 0 Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

36 Self-similarity DFBM and FGN Consider the sampled version y t, t Z, of a y t H-sssi process, with unit sampling interval. There are many y t H-sssi non-gaussian processes. However, for value of H (0, 1) there is exactly just one y t H-sssi Gaussian process, called Discrete-time Fractional Brownian Motion or DFBM. The Fractional Gaussian Noise - FGN, proposed by Mandelbrot and van Ness in 1968, corresponds to the DFBM process of increments. The FGN is a model widely used in LRD trac simulations. The DFBM and FGN models are non-parametric and are not used in trac future values predictions. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

37 Self-similarity Exact second order self-similarity Denition (Exact second order self-similarity) Consider the discrete time stationary process x t = y t y t 1. x t is an exact second order self-similar process with Hurst parameter H (1/2 < H < 1) if its autocovariance exists and is given by C x (τ) = σ2 x 2 [ τ +1 2H 2 τ 2H + τ 1 2H ], τ =..., 1, 0, 1,.... (16) It can be shown that the autocovariance given by (16) satises lim τ i. e., C x (τ) has a hyperbolic decay. C x (τ) = 1, (17) σxτ 2 2H 2 H(2H 1) Second order self-similarity implies LRD when 1/2 < H < 1. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

38 Self-similarity Exact second order self-similarity 2 Consider the aggregate process X (M) t of an exact second order self-similar process x t, at the M aggregation level. It can be shown that C (M) x (τ) = C x (τ), M = 2, 3,... (18) Eq. (18) says that the second order statistics of the original process with a scale change, justifying the term exact second order self similar. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

39 Self-similarity Asymptotic second order self-similarity Denition (Asymptotic second order self-similarity) A process x t is asymptotically second order self-similar with Hurst parameter H (1/2 < H < 1) if its autocovariance and its aggregate process autocovariance are related by lim C (M) x (τ) = C x (τ). (19) M Tsybarov and Georganas have shown that (12) implies (19). Therefore, a LRD process is asymptotically second order self similar too. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

40 Impulsiveness Outline 1 Teletrac Fractal Nature Fractals The Hurst Exponent LRD Self-similarity Impulsiveness Final remarks Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

41 Impulsiveness Introduction Several phenomena exhibit impulsive behavior, as low frequency atmospheric noise, man-made noise, submarine acoustic noise, transmission lines transients, seismic activity, nancial series, telephone circuits cluster errors, computer networks trac. In this context, stable probability distributions is a fundamental statistical modeling tool of impulsive signals. Its use is justied by the generalized central limit theorem. This theorem states that: if the limit of the sum of independent and identically distributed (i.i.d) random variables converges, then this limit can only be a stable distributed random variable. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

42 Impulsiveness Heavy tail distributions Denition (Heavy tail distribution) A random variable x has a heavy tail distribution with index α if P(x x) cx α L(x), x, (20) for c > 0 and 0 < α < 2, in which L(x) is a positive function that varies slowly for large values of x, i. e., lim x L(bx)/L(x) = 1 for any positive b. Eq. (20) states that observations of a heavy tail distributed random variables may occur with non-negligible probabilities, with values very dierent from the mean (outliers). So, this kind of random variable has high variability. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

43 Impulsiveness Pareto I distribution A simple example of a heavy tail distribution is the Pareto I distribution, dened by means of its complementary distribution function (survival function): ( ) α x F (x) = P(x x) = x m, x xm, 1, x < x m, (21) Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

44 Impulsiveness Pareto I distribution - cont. Figure: Pareto I probability density functions with xm = 1. Figure: Pareto I probability distribution functions with xm = 1. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

45 Impulsiveness Heavy tail distributions' variance The heavy distributions' p order statistics are nite if, and only if, p α. It is for this reason that such distributions have innite variance. The mean is innite if α < 1. The heavy tail distributions are also known as innite variance probability distributions. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

46 Impulsiveness Stable distributions An important member of the heavy tail distributions class is the stable distribution, discovered by Levy in the 1920 decade. The stable distribution does not have an analytic expression 2. It can be dened in terms of its characteristic function: Φ x (w) = E[e jw x ] = f x (x)e jwx dx = exp{jµw σw α [1 jη sign(w)ϕ(w, α)]}. (22) 2 The exceptions are the limit cases α = 1 (Cauchy) and α = 2 (Gaussian). Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

47 Impulsiveness Stable distributions 2 In (22) ϕ(w, α) = { tan (απ/2) if α 1 2 π ln w if α = 1, (23) sign(.) stands for the sign function, α (0 < α 2) is the characteristic exponent, µ (µ R) is the localization parameter η ( 1 η 1) is the asymmetry parameter and σ 0 is the dispersion parameter or scale. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

48 Impulsiveness Stable distribution realization example Figure: Realization of Sα(σ, η, µ) = S 1.2 (1, 1, 0) (256 samples). Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

49 Impulsiveness Symmetric stable distribution and density functions examples Figure: Probability density functions Figure: Probability distribution functions. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

50 Impulsiveness Asymmetric stable distribution and density functions examples Figure: Probability density functions. Figure: Probability distribution functions. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

51 Impulsiveness Stable distributions' property It can be shown that, if x S α (σ, η, µ) with 0 < α < 2, then, { P(x>λ) 1+η lim λ = λ α C α 2 σα, P(x< λ) 1 η lim λ = λ α C α 2 σα, in which ( { 1 C α = x α 1 α Γ(2 α) cos(πα/2) if α 1 sin x) = 0 2/π if α = 1. (24) (25) Therefore, (24) shows that the survival function of x decreases according to a power function for large values of λ. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

52 Impulsiveness Stability property Theorem (Stability property) A random variable x is stable if and only if for any independent random variables x 1 and x 2 that have the same distribution as x, and for arbitrary constants a 1, a 2, there are constants a and b as a 1 x 1 + a 2 x 2 d = ax + b, (26) Using the characteristic function of the stable distribution, it can be shown that: if x 1, x 2,..., x N are independent and follow stable distributions with the same (α, η), then all linear combinations N j=1 a j x j are stable with the same parameters α and η. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

53 Impulsiveness The central limit theorem The central limit states that the normalized sum of (i.i.d) random variables with nite variance σ 2 and mean µ converges to a Gaussian distribution. Formally, x µ σ/ N The relation (27) may be rewritten as d x N(0, 1) for N. (27) a N (x 1 + x x N ) b N d x N(0, 1) for x, (28) in which a N = 1/(σ N) and b N = Nµ/σ. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

54 Impulsiveness The generalized central limit theorem Theorem (Generalized central limit theorem) Let {x 1, x 2, x 3...} be a sequence of i.i.d random variables. There are constants a N > 0, b N R and a random variable x with a N (x 1 + x x N ) b N d x if and only if x is α-stable with 0 < α 2. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

55 Impulsiveness Impulsive stochastic process Denition (Impulsive stochastic process) A stochastic process x t is impulsive if it has a heavy tail marginal probability distribution. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

56 Impulsiveness Impulsive processes dependence measurements Covariances (or correlations) cannot be dened in the stable random variables space. Remember, the stable random variable variance is innite. Two kinds of measurements have been proposed: Co-variation; Co-dierence; Co-variation will not be used in this course. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

57 Impulsiveness Co-dierence The co-dierence of two jointly SαS random variables x 1 and x 2, 0 < α 2, is given by γ x1,x2 = (σ x1 )α + (σ x2 ) α (σ x1 x2 )α, (29) in which σ x is the scale parameter of the SαS x random variable. The co-dierence is symmetric, i. e., γ = γ x1,x2 x2,x1 the covariance when α = 2. If x 1 e x 2 are independent, then γ x1,x2 = 0. and reduces to Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

58 Impulsiveness Generalized co-dierence Denition (Generalized co-dierence) I (w 1, w 2 ; x 1, x 2 ) = ln E[e j(w 1x1+w 2 x2) ] + ln E[e jw 1x1 ] + ln E[e jw 2x2 ], (w 1, w 2 ) R 2 (30) If x 1 and x 2 are independent, then I (w 1, w 2 ; x 1, x 2 ) = 0. For jointly Gaussian random variables I (w 1, w 2 ; x 1, x 2 ) = w 1 w 2 C(x 1, x 2 ), in which C(x 1, x 2 ) is the covariance between x 1 and x 2. For stationary random processes we have I (w 1, w 2 ; τ) = I (w 1, w 2 ; x t+τ, x t ). Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

59 Impulsiveness Long memory - generalized sense Denition (Long memory in the generalized sense) Let {x t } t R be a stationary random process. We say that x t has long memory - generalized sense if its generalized co-diiference I (w 1, w 2 ; τ) w1 = w 2 =1 satises lim I (1, 1; τ)/τ β = L(τ), (31) τ in which L(τ) is a slow varying function for τ and 0 < β < 1. For LRD gaussian processes, the denition given above reduces to the classical denition of a LRD process. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

60 Final remarks Outline 1 Teletrac Fractal Nature Fractals The Hurst Exponent LRD Self-similarity Impulsiveness Final remarks Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

61 Final remarks Why is the data networks trac fractal? Several authors have been stated that the Internet trac self-similarity is caused by the packets size large variability of the individual sessions (FTP, HTTP, etc.) that make the aggregate trac. Those papers argue that the IP trac is self-similar because the individual sessions sizes that make the Internet trac are generated by a heavy tail probability distribution. On the other hand, the recent study by Gong et al reexamines this question and claims that there is little evidence that the distribution's heavy tail has any impact on the algorithms' design and the Internet's infrastructure. Gong et al propose an on-o Markovian hierarchical model that explain the IP trac's LRD and state that the multiple time scales involved in the trac generation mechanism and transport protocols make the observation of LRD behavior unavoidable. Amazonas (Escola Politécnica da USP) Teletrac modeling and estimation São Paulo 11/ / 61

Teletrac modeling and estimation

Teletrac modeling and estimation Teletrac modeling and estimation File 1 José Roberto Amazonas Alexandre Barbosa de Lima jra,ablima@lcs.poli.usp.br Telecommunications and Control Engineering Dept. - PTC Escola Politécnica University of

More information

Teletrac modeling and estimation

Teletrac modeling and estimation Teletrac modeling and estimation File 3 José Roberto Amazonas jra@lcs.poli.usp.br Telecommunications and Control Engineering Dept. - PTC Escola Politécnica University of São Paulo - USP São Paulo 11/2008

More information

Multiplicative Multifractal Modeling of. Long-Range-Dependent (LRD) Trac in. Computer Communications Networks. Jianbo Gao and Izhak Rubin

Multiplicative Multifractal Modeling of. Long-Range-Dependent (LRD) Trac in. Computer Communications Networks. Jianbo Gao and Izhak Rubin Multiplicative Multifractal Modeling of Long-Range-Dependent (LRD) Trac in Computer Communications Networks Jianbo Gao and Izhak Rubin Electrical Engineering Department, University of California, Los Angeles

More information

Teletrac modeling and estimation

Teletrac modeling and estimation Teletrac modeling and estimation File 4 José Roberto Amazonas jra@lcs.poli.usp.br Telecommunications and Control Engineering Dept. - PTC Escola Politécnica University of São Paulo - USP São Paulo 11/2008

More information

Network Traffic Characteristic

Network Traffic Characteristic Network Traffic Characteristic Hojun Lee hlee02@purros.poly.edu 5/24/2002 EL938-Project 1 Outline Motivation What is self-similarity? Behavior of Ethernet traffic Behavior of WAN traffic Behavior of WWW

More information

Gaussian distributions and processes have long been accepted as useful tools for stochastic

Gaussian distributions and processes have long been accepted as useful tools for stochastic Chapter 3 Alpha-Stable Random Variables and Processes Gaussian distributions and processes have long been accepted as useful tools for stochastic modeling. In this section, we introduce a statistical model

More information

Statistical analysis of peer-to-peer live streaming traffic

Statistical analysis of peer-to-peer live streaming traffic Statistical analysis of peer-to-peer live streaming traffic Levente Bodrog 1 Ákos Horváth 1 Miklós Telek 1 1 Technical University of Budapest Probability and Statistics with Applications, 2009 Outline

More information

ECON 616: Lecture 1: Time Series Basics

ECON 616: Lecture 1: Time Series Basics ECON 616: Lecture 1: Time Series Basics ED HERBST August 30, 2017 References Overview: Chapters 1-3 from Hamilton (1994). Technical Details: Chapters 2-3 from Brockwell and Davis (1987). Intuition: Chapters

More information

Capturing Network Traffic Dynamics Small Scales. Rolf Riedi

Capturing Network Traffic Dynamics Small Scales. Rolf Riedi Capturing Network Traffic Dynamics Small Scales Rolf Riedi Dept of Statistics Stochastic Systems and Modelling in Networking and Finance Part II Dependable Adaptive Systems and Mathematical Modeling Kaiserslautern,

More information

From Fractional Brownian Motion to Multifractional Brownian Motion

From Fractional Brownian Motion to Multifractional Brownian Motion From Fractional Brownian Motion to Multifractional Brownian Motion Antoine Ayache USTL (Lille) Antoine.Ayache@math.univ-lille1.fr Cassino December 2010 A.Ayache (USTL) From FBM to MBM Cassino December

More information

Stochastic Processes

Stochastic Processes Elements of Lecture II Hamid R. Rabiee with thanks to Ali Jalali Overview Reading Assignment Chapter 9 of textbook Further Resources MIT Open Course Ware S. Karlin and H. M. Taylor, A First Course in Stochastic

More information

Normal Probability Plot Probability Probability

Normal Probability Plot Probability Probability Modelling multivariate returns Stefano Herzel Department ofeconomics, University of Perugia 1 Catalin Starica Department of Mathematical Statistics, Chalmers University of Technology Reha Tutuncu Department

More information

Nonlinear Time Series Modeling

Nonlinear Time Series Modeling Nonlinear Time Series Modeling Part II: Time Series Models in Finance Richard A. Davis Colorado State University (http://www.stat.colostate.edu/~rdavis/lectures) MaPhySto Workshop Copenhagen September

More information

Fractal Analysis of Intraflow Unidirectional Delay over W-LAN and W-WAN WAN Environments

Fractal Analysis of Intraflow Unidirectional Delay over W-LAN and W-WAN WAN Environments Fractal Analysis of Intraflow Unidirectional Delay over W-LAN and W-WAN WAN Environments Dimitrios Pezaros with Manolis Sifalakis and Laurent Mathy Computing Department Lancaster University [dp@comp.lancs.ac.uk]

More information

Estimation of the long Memory parameter using an Infinite Source Poisson model applied to transmission rate measurements

Estimation of the long Memory parameter using an Infinite Source Poisson model applied to transmission rate measurements of the long Memory parameter using an Infinite Source Poisson model applied to transmission rate measurements François Roueff Ecole Nat. Sup. des Télécommunications 46 rue Barrault, 75634 Paris cedex 13,

More information

Econ 424 Time Series Concepts

Econ 424 Time Series Concepts Econ 424 Time Series Concepts Eric Zivot January 20 2015 Time Series Processes Stochastic (Random) Process { 1 2 +1 } = { } = sequence of random variables indexed by time Observed time series of length

More information

If we want to analyze experimental or simulated data we might encounter the following tasks:

If we want to analyze experimental or simulated data we might encounter the following tasks: Chapter 1 Introduction If we want to analyze experimental or simulated data we might encounter the following tasks: Characterization of the source of the signal and diagnosis Studying dependencies Prediction

More information

Beyond the color of the noise: what is memory in random phenomena?

Beyond the color of the noise: what is memory in random phenomena? Beyond the color of the noise: what is memory in random phenomena? Gennady Samorodnitsky Cornell University September 19, 2014 Randomness means lack of pattern or predictability in events according to

More information

Network Traffic Modeling using a Multifractal Wavelet Model

Network Traffic Modeling using a Multifractal Wavelet Model 5-th International Symposium on Digital Signal Processing for Communication Systems, DSPCS 99, Perth, 1999 Network Traffic Modeling using a Multifractal Wavelet Model Matthew S. Crouse, Rudolf H. Riedi,

More information

Characterization and Modeling of Long-Range Dependent Telecommunication Traffic

Characterization and Modeling of Long-Range Dependent Telecommunication Traffic -- -- Characterization and Modeling of Long-Range Dependent Telecommunication Traffic Sponsor: Sprint Yong-Qing Lu David W. Petr Victor Frost Technical Report TISL-10230-4 Telecommunications and Information

More information

ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process

ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random

More information

ON THE CONVERGENCE OF FARIMA SEQUENCE TO FRACTIONAL GAUSSIAN NOISE. Joo-Mok Kim* 1. Introduction

ON THE CONVERGENCE OF FARIMA SEQUENCE TO FRACTIONAL GAUSSIAN NOISE. Joo-Mok Kim* 1. Introduction JOURNAL OF THE CHUNGCHEONG MATHEMATICAL SOCIETY Volume 26, No. 2, May 2013 ON THE CONVERGENCE OF FARIMA SEQUENCE TO FRACTIONAL GAUSSIAN NOISE Joo-Mok Kim* Abstract. We consider fractional Gussian noise

More information

Modelling internet round-trip time data

Modelling internet round-trip time data Modelling internet round-trip time data Keith Briggs Keith.Briggs@bt.com http://research.btexact.com/teralab/keithbriggs.html University of York 2003 July 18 typeset 2003 July 15 13:55 in LATEX2e on a

More information

Financial Econometrics and Quantitative Risk Managenent Return Properties

Financial Econometrics and Quantitative Risk Managenent Return Properties Financial Econometrics and Quantitative Risk Managenent Return Properties Eric Zivot Updated: April 1, 2013 Lecture Outline Course introduction Return definitions Empirical properties of returns Reading

More information

Class 1: Stationary Time Series Analysis

Class 1: Stationary Time Series Analysis Class 1: Stationary Time Series Analysis Macroeconometrics - Fall 2009 Jacek Suda, BdF and PSE February 28, 2011 Outline Outline: 1 Covariance-Stationary Processes 2 Wold Decomposition Theorem 3 ARMA Models

More information

Exploring regularities and self-similarity in Internet traffic

Exploring regularities and self-similarity in Internet traffic Exploring regularities and self-similarity in Internet traffic FRANCESCO PALMIERI and UGO FIORE Centro Servizi Didattico Scientifico Università degli studi di Napoli Federico II Complesso Universitario

More information

Systems Driven by Alpha-Stable Noises

Systems Driven by Alpha-Stable Noises Engineering Mechanics:A Force for the 21 st Century Proceedings of the 12 th Engineering Mechanics Conference La Jolla, California, May 17-20, 1998 H. Murakami and J. E. Luco (Editors) @ASCE, Reston, VA,

More information

Topic 4 Unit Roots. Gerald P. Dwyer. February Clemson University

Topic 4 Unit Roots. Gerald P. Dwyer. February Clemson University Topic 4 Unit Roots Gerald P. Dwyer Clemson University February 2016 Outline 1 Unit Roots Introduction Trend and Difference Stationary Autocorrelations of Series That Have Deterministic or Stochastic Trends

More information

Discrete time processes

Discrete time processes Discrete time processes Predictions are difficult. Especially about the future Mark Twain. Florian Herzog 2013 Modeling observed data When we model observed (realized) data, we encounter usually the following

More information

Stochastic Processes

Stochastic Processes Stochastic Processes Stochastic Process Non Formal Definition: Non formal: A stochastic process (random process) is the opposite of a deterministic process such as one defined by a differential equation.

More information

Stochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno

Stochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function.

More information

Name of the Student: Problems on Discrete & Continuous R.Vs

Name of the Student: Problems on Discrete & Continuous R.Vs Engineering Mathematics 05 SUBJECT NAME : Probability & Random Process SUBJECT CODE : MA6 MATERIAL NAME : University Questions MATERIAL CODE : JM08AM004 REGULATION : R008 UPDATED ON : Nov-Dec 04 (Scan

More information

for valid PSD. PART B (Answer all five units, 5 X 10 = 50 Marks) UNIT I

for valid PSD. PART B (Answer all five units, 5 X 10 = 50 Marks) UNIT I Code: 15A04304 R15 B.Tech II Year I Semester (R15) Regular Examinations November/December 016 PROBABILITY THEY & STOCHASTIC PROCESSES (Electronics and Communication Engineering) Time: 3 hours Max. Marks:

More information

Design of IP networks with Quality of Service

Design of IP networks with Quality of Service Course of Multimedia Internet (Sub-course Reti Internet Multimediali ), AA 2010-2011 Prof. Pag. 1 Design of IP networks with Quality of Service 1 Course of Multimedia Internet (Sub-course Reti Internet

More information

Introduction to ARMA and GARCH processes

Introduction to ARMA and GARCH processes Introduction to ARMA and GARCH processes Fulvio Corsi SNS Pisa 3 March 2010 Fulvio Corsi Introduction to ARMA () and GARCH processes SNS Pisa 3 March 2010 1 / 24 Stationarity Strict stationarity: (X 1,

More information

Problem set 1 - Solutions

Problem set 1 - Solutions EMPIRICAL FINANCE AND FINANCIAL ECONOMETRICS - MODULE (8448) Problem set 1 - Solutions Exercise 1 -Solutions 1. The correct answer is (a). In fact, the process generating daily prices is usually assumed

More information

Effect of the Traffic Bursts in the Network Queue

Effect of the Traffic Bursts in the Network Queue RICE UNIVERSITY Effect of the Traffic Bursts in the Network Queue by Alireza KeshavarzHaddad A Thesis Submitted in Partial Fulfillment of the Requirements for the Degree Master of Science Approved, Thesis

More information

Lecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications

Lecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications Lecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications Prof. Massimo Guidolin 20192 Financial Econometrics Winter/Spring 2018 Overview Moving average processes Autoregressive

More information

Some functional (Hölderian) limit theorems and their applications (II)

Some functional (Hölderian) limit theorems and their applications (II) Some functional (Hölderian) limit theorems and their applications (II) Alfredas Račkauskas Vilnius University Outils Statistiques et Probabilistes pour la Finance Université de Rouen June 1 5, Rouen (Rouen

More information

Econometría 2: Análisis de series de Tiempo

Econometría 2: Análisis de series de Tiempo Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 II. Basic definitions A time series is a set of observations X t, each

More information

STA205 Probability: Week 8 R. Wolpert

STA205 Probability: Week 8 R. Wolpert INFINITE COIN-TOSS AND THE LAWS OF LARGE NUMBERS The traditional interpretation of the probability of an event E is its asymptotic frequency: the limit as n of the fraction of n repeated, similar, and

More information

Ch. 14 Stationary ARMA Process

Ch. 14 Stationary ARMA Process Ch. 14 Stationary ARMA Process A general linear stochastic model is described that suppose a time series to be generated by a linear aggregation of random shock. For practical representation it is desirable

More information

Econ 623 Econometrics II Topic 2: Stationary Time Series

Econ 623 Econometrics II Topic 2: Stationary Time Series 1 Introduction Econ 623 Econometrics II Topic 2: Stationary Time Series In the regression model we can model the error term as an autoregression AR(1) process. That is, we can use the past value of the

More information

3. ARMA Modeling. Now: Important class of stationary processes

3. ARMA Modeling. Now: Important class of stationary processes 3. ARMA Modeling Now: Important class of stationary processes Definition 3.1: (ARMA(p, q) process) Let {ɛ t } t Z WN(0, σ 2 ) be a white noise process. The process {X t } t Z is called AutoRegressive-Moving-Average

More information

Packet Size

Packet Size Long Range Dependence in vbns ATM Cell Level Trac Ronn Ritke y and Mario Gerla UCLA { Computer Science Department, 405 Hilgard Ave., Los Angeles, CA 90024 ritke@cs.ucla.edu, gerla@cs.ucla.edu Abstract

More information

Empirical Market Microstructure Analysis (EMMA)

Empirical Market Microstructure Analysis (EMMA) Empirical Market Microstructure Analysis (EMMA) Lecture 3: Statistical Building Blocks and Econometric Basics Prof. Dr. Michael Stein michael.stein@vwl.uni-freiburg.de Albert-Ludwigs-University of Freiburg

More information

2. (a) What is gaussian random variable? Develop an equation for guassian distribution

2. (a) What is gaussian random variable? Develop an equation for guassian distribution Code No: R059210401 Set No. 1 II B.Tech I Semester Supplementary Examinations, February 2007 PROBABILITY THEORY AND STOCHASTIC PROCESS ( Common to Electronics & Communication Engineering, Electronics &

More information

Gaussian Processes. 1. Basic Notions

Gaussian Processes. 1. Basic Notions Gaussian Processes 1. Basic Notions Let T be a set, and X : {X } T a stochastic process, defined on a suitable probability space (Ω P), that is indexed by T. Definition 1.1. We say that X is a Gaussian

More information

TIME SERIES AND FORECASTING. Luca Gambetti UAB, Barcelona GSE Master in Macroeconomic Policy and Financial Markets

TIME SERIES AND FORECASTING. Luca Gambetti UAB, Barcelona GSE Master in Macroeconomic Policy and Financial Markets TIME SERIES AND FORECASTING Luca Gambetti UAB, Barcelona GSE 2014-2015 Master in Macroeconomic Policy and Financial Markets 1 Contacts Prof.: Luca Gambetti Office: B3-1130 Edifici B Office hours: email:

More information

Stochastic Processes: I. consider bowl of worms model for oscilloscope experiment:

Stochastic Processes: I. consider bowl of worms model for oscilloscope experiment: Stochastic Processes: I consider bowl of worms model for oscilloscope experiment: SAPAscope 2.0 / 0 1 RESET SAPA2e 22, 23 II 1 stochastic process is: Stochastic Processes: II informally: bowl + drawing

More information

Nonlinear time series

Nonlinear time series Based on the book by Fan/Yao: Nonlinear Time Series Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 27, 2009 Outline Characteristics of

More information

Differencing Revisited: I ARIMA(p,d,q) processes predicated on notion of dth order differencing of a time series {X t }: for d = 1 and 2, have X t

Differencing Revisited: I ARIMA(p,d,q) processes predicated on notion of dth order differencing of a time series {X t }: for d = 1 and 2, have X t Differencing Revisited: I ARIMA(p,d,q) processes predicated on notion of dth order differencing of a time series {X t }: for d = 1 and 2, have X t 2 X t def in general = (1 B)X t = X t X t 1 def = ( X

More information

Name of the Student: Problems on Discrete & Continuous R.Vs

Name of the Student: Problems on Discrete & Continuous R.Vs Engineering Mathematics 08 SUBJECT NAME : Probability & Random Processes SUBJECT CODE : MA645 MATERIAL NAME : University Questions REGULATION : R03 UPDATED ON : November 07 (Upto N/D 07 Q.P) (Scan the

More information

Time Series 3. Robert Almgren. Sept. 28, 2009

Time Series 3. Robert Almgren. Sept. 28, 2009 Time Series 3 Robert Almgren Sept. 28, 2009 Last time we discussed two main categories of linear models, and their combination. Here w t denotes a white noise: a stationary process with E w t ) = 0, E

More information

Statistical signal processing

Statistical signal processing Statistical signal processing Short overview of the fundamentals Outline Random variables Random processes Stationarity Ergodicity Spectral analysis Random variable and processes Intuition: A random variable

More information

A NOVEL APPROACH TO THE ESTIMATION OF THE HURST PARAMETER IN SELF-SIMILAR TRAFFIC

A NOVEL APPROACH TO THE ESTIMATION OF THE HURST PARAMETER IN SELF-SIMILAR TRAFFIC Proceedings of IEEE Conference on Local Computer Networks, Tampa, Florida, November 2002 A NOVEL APPROACH TO THE ESTIMATION OF THE HURST PARAMETER IN SELF-SIMILAR TRAFFIC Houssain Kettani and John A. Gubner

More information

Utility of Correlation Functions

Utility of Correlation Functions Utility of Correlation Functions 1. As a means for estimating power spectra (e.g. a correlator + WK theorem). 2. For establishing characteristic time scales in time series (width of the ACF or ACV). 3.

More information

A method for tting stable autoregressive models using the autocovariationfunction

A method for tting stable autoregressive models using the autocovariationfunction Statistics & Probability Letters 53 (2001) 381 390 A method for tting stable autoregressive models using the autocovariationfunction ColinM. Gallagher Mathematical Sciences, Clemson University, Clemson,

More information

When is a copula constant? A test for changing relationships

When is a copula constant? A test for changing relationships When is a copula constant? A test for changing relationships Fabio Busetti and Andrew Harvey Bank of Italy and University of Cambridge November 2007 usetti and Harvey (Bank of Italy and University of Cambridge)

More information

Point Process Approaches to the Modeling. and Analysis of Self-Similar Trac { Center for Telecommunications Research

Point Process Approaches to the Modeling. and Analysis of Self-Similar Trac { Center for Telecommunications Research Proc. IEEE INFOCOM '96, San Francisco, CA, March 996. Point Process Approaches to the Modeling and Analysis of Self-Similar Trac { Part I: Model Construction Bong K. Ryu Steven B. Lowen Department of Electrical

More information

ECE 636: Systems identification

ECE 636: Systems identification ECE 636: Systems identification Lectures 3 4 Random variables/signals (continued) Random/stochastic vectors Random signals and linear systems Random signals in the frequency domain υ ε x S z + y Experimental

More information

IP Packet Level vbns Trac. fjbgao, vwani,

IP Packet Level vbns Trac.   fjbgao, vwani, IP Packet Level vbns Trac Analysis and Modeling Jianbo Gao a,vwani P. Roychowdhury a, Ronn Ritke b, and Izhak Rubin a a Electrical Engineering Department, University of California, Los Angeles, Los Angeles,

More information

ELEG 833. Nonlinear Signal Processing

ELEG 833. Nonlinear Signal Processing Nonlinear Signal Processing ELEG 833 Gonzalo R. Arce Department of Electrical and Computer Engineering University of Delaware arce@ee.udel.edu February 15, 2005 1 INTRODUCTION 1 Introduction Signal processing

More information

Heteroskedasticity in Time Series

Heteroskedasticity in Time Series Heteroskedasticity in Time Series Figure: Time Series of Daily NYSE Returns. 206 / 285 Key Fact 1: Stock Returns are Approximately Serially Uncorrelated Figure: Correlogram of Daily Stock Market Returns.

More information

Multiple Random Variables

Multiple Random Variables Multiple Random Variables Joint Probability Density Let X and Y be two random variables. Their joint distribution function is F ( XY x, y) P X x Y y. F XY ( ) 1, < x

More information

In Proceedings of the Tenth International Conference on on Parallel and Distributed Computing Systems (PDCS-97), pages , October 1997

In Proceedings of the Tenth International Conference on on Parallel and Distributed Computing Systems (PDCS-97), pages , October 1997 In Proceedings of the Tenth International Conference on on Parallel and Distributed Computing Systems (PDCS-97), pages 322-327, October 1997 Consequences of Ignoring Self-Similar Data Trac in Telecommunications

More information

3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE

3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE 3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE 3.0 INTRODUCTION The purpose of this chapter is to introduce estimators shortly. More elaborated courses on System Identification, which are given

More information

ELEMENTS OF PROBABILITY THEORY

ELEMENTS OF PROBABILITY THEORY ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable

More information

Limit theorems for Hawkes processes

Limit theorems for Hawkes processes Limit theorems for nearly unstable and Mathieu Rosenbaum Séminaire des doctorants du CMAP Vendredi 18 Octobre 213 Limit theorems for 1 Denition and basic properties Cluster representation of Correlation

More information

Linear Regression and Its Applications

Linear Regression and Its Applications Linear Regression and Its Applications Predrag Radivojac October 13, 2014 Given a data set D = {(x i, y i )} n the objective is to learn the relationship between features and the target. We usually start

More information

Intermittency, Fractals, and β-model

Intermittency, Fractals, and β-model Intermittency, Fractals, and β-model Lecture by Prof. P. H. Diamond, note by Rongjie Hong I. INTRODUCTION An essential assumption of Kolmogorov 1941 theory is that eddies of any generation are space filling

More information

where r n = dn+1 x(t)

where r n = dn+1 x(t) Random Variables Overview Probability Random variables Transforms of pdfs Moments and cumulants Useful distributions Random vectors Linear transformations of random vectors The multivariate normal distribution

More information

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS PROBABILITY: LIMIT THEOREMS II, SPRING 15. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please

More information

Tail empirical process for long memory stochastic volatility models

Tail empirical process for long memory stochastic volatility models Tail empirical process for long memory stochastic volatility models Rafa l Kulik and Philippe Soulier Carleton University, 5 May 2010 Rafa l Kulik and Philippe Soulier Quick review of limit theorems and

More information

Chapter 3 - Temporal processes

Chapter 3 - Temporal processes STK4150 - Intro 1 Chapter 3 - Temporal processes Odd Kolbjørnsen and Geir Storvik January 23 2017 STK4150 - Intro 2 Temporal processes Data collected over time Past, present, future, change Temporal aspect

More information

A Stochastic Model for TCP with Stationary Random Losses

A Stochastic Model for TCP with Stationary Random Losses A Stochastic Model for TCP with Stationary Random Losses Eitan Altman, Kostya Avrachenkov Chadi Barakat INRIA Sophia Antipolis - France ACM SIGCOMM August 31, 2000 Stockholm, Sweden Introduction Outline

More information

MAT3379 (Winter 2016)

MAT3379 (Winter 2016) MAT3379 (Winter 2016) Assignment 4 - SOLUTIONS The following questions will be marked: 1a), 2, 4, 6, 7a Total number of points for Assignment 4: 20 Q1. (Theoretical Question, 2 points). Yule-Walker estimation

More information

Time Series 2. Robert Almgren. Sept. 21, 2009

Time Series 2. Robert Almgren. Sept. 21, 2009 Time Series 2 Robert Almgren Sept. 21, 2009 This week we will talk about linear time series models: AR, MA, ARMA, ARIMA, etc. First we will talk about theory and after we will talk about fitting the models

More information

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS PROBABILITY: LIMIT THEOREMS II, SPRING 218. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please

More information

Chapter 4: Models for Stationary Time Series

Chapter 4: Models for Stationary Time Series Chapter 4: Models for Stationary Time Series Now we will introduce some useful parametric models for time series that are stationary processes. We begin by defining the General Linear Process. Let {Y t

More information

Self-Similarity and Long Range Dependence on the Internet: A Second Look at the Evidence, Origins and Implications

Self-Similarity and Long Range Dependence on the Internet: A Second Look at the Evidence, Origins and Implications Self-Similarity and Long Range Dependence on the Internet: A Second Look at the Evidence, Origins and Implications Wei-Bo Gong Dept. of Electrical Engineering University of Massachusetts Amherst, MA 13

More information

Network Traffic Modeling using a Multifractal Wavelet Model

Network Traffic Modeling using a Multifractal Wavelet Model Proceedings European Congress of Mathematics, Barcelona 2 Network Traffic Modeling using a Multifractal Wavelet Model Rudolf H. Riedi, Vinay J. Ribeiro, Matthew S. Crouse, and Richard G. Baraniuk Abstract.

More information

P 1.5 X 4.5 / X 2 and (iii) The smallest value of n for

P 1.5 X 4.5 / X 2 and (iii) The smallest value of n for DHANALAKSHMI COLLEGE OF ENEINEERING, CHENNAI DEPARTMENT OF ELECTRONICS AND COMMUNICATION ENGINEERING MA645 PROBABILITY AND RANDOM PROCESS UNIT I : RANDOM VARIABLES PART B (6 MARKS). A random variable X

More information

Prof. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis

Prof. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis Introduction to Time Series Analysis 1 Contents: I. Basics of Time Series Analysis... 4 I.1 Stationarity... 5 I.2 Autocorrelation Function... 9 I.3 Partial Autocorrelation Function (PACF)... 14 I.4 Transformation

More information

Review Session: Econometrics - CLEFIN (20192)

Review Session: Econometrics - CLEFIN (20192) Review Session: Econometrics - CLEFIN (20192) Part II: Univariate time series analysis Daniele Bianchi March 20, 2013 Fundamentals Stationarity A time series is a sequence of random variables x t, t =

More information

Monte Carlo Methods for Statistical Inference: Variance Reduction Techniques

Monte Carlo Methods for Statistical Inference: Variance Reduction Techniques Monte Carlo Methods for Statistical Inference: Variance Reduction Techniques Hung Chen hchen@math.ntu.edu.tw Department of Mathematics National Taiwan University 3rd March 2004 Meet at NS 104 On Wednesday

More information

This is the author s version of a work that was submitted/accepted for publication in the following source:

This is the author s version of a work that was submitted/accepted for publication in the following source: This is the author s version of a work that was submitted/accepted for publication in the following source: Anh, Vo, Lam, K, Leung, Y, & Yu, Zu-Guo (5) Multifractal Characterization of Hong Kong Air Quality

More information

A Probability Review

A Probability Review A Probability Review Outline: A probability review Shorthand notation: RV stands for random variable EE 527, Detection and Estimation Theory, # 0b 1 A Probability Review Reading: Go over handouts 2 5 in

More information

For a stochastic process {Y t : t = 0, ±1, ±2, ±3, }, the mean function is defined by (2.2.1) ± 2..., γ t,

For a stochastic process {Y t : t = 0, ±1, ±2, ±3, }, the mean function is defined by (2.2.1) ± 2..., γ t, CHAPTER 2 FUNDAMENTAL CONCEPTS This chapter describes the fundamental concepts in the theory of time series models. In particular, we introduce the concepts of stochastic processes, mean and covariance

More information

ECE 673-Random signal analysis I Final

ECE 673-Random signal analysis I Final ECE 673-Random signal analysis I Final Q ( point) Comment on the following statement "If cov(x ; X 2 ) 0; then the best predictor (without limitation on the type of predictor) of the random variable X

More information

The distribution inherited by Y is called the Cauchy distribution. Using that. d dy ln(1 + y2 ) = 1 arctan(y)

The distribution inherited by Y is called the Cauchy distribution. Using that. d dy ln(1 + y2 ) = 1 arctan(y) Stochastic Processes - MM3 - Solutions MM3 - Review Exercise Let X N (0, ), i.e. X is a standard Gaussian/normal random variable, and denote by f X the pdf of X. Consider also a continuous random variable

More information

CHAPTER 2 RANDOM PROCESSES IN DISCRETE TIME

CHAPTER 2 RANDOM PROCESSES IN DISCRETE TIME CHAPTER 2 RANDOM PROCESSES IN DISCRETE TIME Shri Mata Vaishno Devi University, (SMVDU), 2013 Page 13 CHAPTER 2 RANDOM PROCESSES IN DISCRETE TIME When characterizing or modeling a random variable, estimates

More information

Internet Traffic Modeling and Its Implications to Network Performance and Control

Internet Traffic Modeling and Its Implications to Network Performance and Control Internet Traffic Modeling and Its Implications to Network Performance and Control Kihong Park Department of Computer Sciences Purdue University park@cs.purdue.edu Outline! Motivation! Traffic modeling!

More information

arxiv:cond-mat/ v1 24 May 2000

arxiv:cond-mat/ v1 24 May 2000 A multifractal random walk E. Bacry Centre de Mathématiques Appliquées, Ecole Polytechnique, 91128 Palaiseau Cedex, France J. Delour and J.F. Muzy Centre de Recherche Paul Pascal, Avenue Schweitzer 336

More information

A multifractal random walk

A multifractal random walk A multifractal random walk E. Bacry Centre de Mathématiques Appliquées, Ecole Polytechnique, 91128 Palaiseau Cedex, France J. Delour and J.F. Muzy Centre de Recherche Paul Pascal, Avenue Schweitzer 33600

More information

Prof. Dr.-Ing. Armin Dekorsy Department of Communications Engineering. Stochastic Processes and Linear Algebra Recap Slides

Prof. Dr.-Ing. Armin Dekorsy Department of Communications Engineering. Stochastic Processes and Linear Algebra Recap Slides Prof. Dr.-Ing. Armin Dekorsy Department of Communications Engineering Stochastic Processes and Linear Algebra Recap Slides Stochastic processes and variables XX tt 0 = XX xx nn (tt) xx 2 (tt) XX tt XX

More information

An Evaluation of Errors in Energy Forecasts by the SARFIMA Model

An Evaluation of Errors in Energy Forecasts by the SARFIMA Model American Review of Mathematics and Statistics, Vol. 1 No. 1, December 13 17 An Evaluation of Errors in Energy Forecasts by the SARFIMA Model Leila Sakhabakhsh 1 Abstract Forecasting is tricky business.

More information

Modelling using ARMA processes

Modelling using ARMA processes Modelling using ARMA processes Step 1. ARMA model identification; Step 2. ARMA parameter estimation Step 3. ARMA model selection ; Step 4. ARMA model checking; Step 5. forecasting from ARMA models. 33

More information

Definition of a Stochastic Process

Definition of a Stochastic Process Definition of a Stochastic Process Balu Santhanam Dept. of E.C.E., University of New Mexico Fax: 505 277 8298 bsanthan@unm.edu August 26, 2018 Balu Santhanam (UNM) August 26, 2018 1 / 20 Overview 1 Stochastic

More information

N! (N h)!h! ph 1(1 p 1 ) N h. (2) Suppose we make a change of variables from h to x through h = p 1 N + p 1 1 2

N! (N h)!h! ph 1(1 p 1 ) N h. (2) Suppose we make a change of variables from h to x through h = p 1 N + p 1 1 2 Physics 48-0 Lab : An example of statistical error analysis in coin ip experiment Intro This worksheet steps you through the reasoning behind how statistical errors in simple experimental measurements

More information