Deterministic. Deterministic data are those can be described by an explicit mathematical relationship

Transcription

1 Random data

2 Deterministic Deterministic data are those can be described by an explicit mathematical relationship

3 Deterministic x(t) =X cos r! k m t

4 Non deterministic There is no way to predict an exact value at a future instant of time These data are random in character and must be described in terms of probability statements and statistical averages

5 In practical terms The decision of whether physical data are deterministic or random is usually based on the ability of reproduce the data by controlled experiments

6 In practical terms If the experiment can be repeated producing identical data, within the limits of experimental error -> deterministic If an experiment cannot be designed that will produce identical results when repeated -> non deterministic (random)

7 Terminology A single time history representing a random phenomena is called a sample function or a sample record The collection of all sample function that a random phenomenon might have produced is called random process or stochastic process A sample record of data may be thought of as one physical realization of a random process

8 Classification of random data

9 Random data classification Random Stationary Nonstationary Ergodic Nonergodic

10 Statistical properties Considering a collection of sample functions:

11 Statistical properties Considering a collection of sample functions: mean value of a random process at some time ti can be computed averaging all instantaneous values of each sample correlation between values at two different times is the average of the product of instantaneous values at time ti and ti+tau

12 Statistical properties µ x (t i )= lim N!+1 1 N NX k=1 x k (t i ) R xx (t i,t i + ) = lim N!+1 1 N NX x k (t i )x k (t i + ) k=1

13 Stationary vs Nonstationary When mean value and autocorrelation vary as time ti varies, the random process is said to be nonstationary When mean value and autocorrelation do not vary as time ti varies, the random process is said to be weakly stationary or stationary in a wide sense

14 Weakly stationary For weakly stationary random process, the mean value is constant and the autocorrelation function is dependent only on the time displacement tau. µ x (t i )=µ x R xx (t i,t i + ) =R xx ( )

15 Weakly stationary In most case it is possible to describe the properties of a stationary random process by computing time averages over specific sample function µ x (k) = lim T!1 R xx (,k)= lim T!1 1 T 1 T Z T 0 Z T 0 x k (t) dt x k (t)x k (t + ) dt

16 Ergodic random data If mean value and autocorrelation function do not differ over different sample functions the random process is said to be ergodic!! µ x (k) =µ x R xx (,k)=r xx ( ) Only stationary random process can be ergodic

17 Ergodic random data Ergodic random process are an important class of random processes All properties of ergodic random process can be determined by a single sample function Fortunately, in practice, random data representing stationary physical phenomena are generally ergodic

18 Nonstationary random data The properties of nonstationary random process are generally time-varying function In practice it is often not feasible to obtain a sufficient number of sample records to permit an accurate measurement of properties of the ensemble This has tend to impede the development of practical techniques for measuring and analyzing nonstationary random data

19 Stationary sample records Data in the form of sample records are referred to be stationary or nonstationary Z ti +T µ x (t i,k)= 1 T x k (t) dt t i Z ti +T R xx (t i,t i +,k)= 1 T x k (t)x k (t + ) dt t i

20 Stationary sample records A single time series is referred to be stationary if properties computed over short time intervals do not vary significantly from one interval to the next If the sample properties vary significantly as the starting time ti varies the individual sample record is said to be nonstationary

21 Stationary sample records A sample record obtained from an ergodic random process will be stationary Sample records from nonstationary random process will be nonstationary Hence if an ergodic assumption is justified verification of stationarity of a single sample records will justify an assumption of stationarity and ergodicity for the random process

22 Analysis of random data

23 Analysis of random data Since no explicit mathematical equation can be written, statistical procedures must be used to define the descriptive properties of the data

24 Basic descriptive properties Mean and mean square values Probability density functions Autocorrelation functions Power spectral density functions

25 Joint statistical properties Joint probability density functions Cross-correlation functions Cross-spectral density functions Frequency response functions Coherence functions

26 Probability density function Is a function that describes the relative likelihood for this random variable to take on a given value The probability of the random variable falling within a particular range of values is given by the integral of this variable s density over that range

27 Probability density function Z b Pr[a apple X apple b] = a f X (x) dx Z x CDF X (x) =P (X apple x) = 1 f X (u) du

28 Probability density function

29 Time domain analysis

30 Expected value E[X] = 1X x i p i,! i=1! E[X] = Z 1 xf(x) dx! 1 Arithmetic mean is an estimator of the expected value of a random process nx 2 x = 1 n i=1 x i Var( x) = n

31 Expected value E[X + c] =E[X]+c E[X + Y ]=E[X]+E[Y] E[aX] =a E[X] E[XY ]= Z Z xy j(x, y) dx dy Cov(X, Y )=E[XY ] E[X]E[Y ] E[XY ]= = Z Z Z Z xy j(x, y) dx dy = xyf(x)g(y) dy dx applez applez xf(x) dx yg(y) dy =E[X]E[Y ]

32 Variance Var(X) =E (X µ) 2 =E X 2 2X E[X]+(E[X]) 2 =E X 2 2E[X]E[X]+(E[X]) 2 =E X 2 (E[X]) 2 S 2 n(x) = 1 n nx (x i x) 2 s 2 n(x) = 1 i=1 n 1 nx (x i x) 2 i=1

33 Variance E[Sn]= 2 n 1 n Var(Sn)= 2 n 1 n n E[s 2 n]= 2 Var(s 2 n)= 2 4 n 1 biased unbiased smaller variance greater variance

34 Variance of biased and unbiased estimator σ =

35 Markov's inequality 8a >0 P(X a) apple 1 a E[X] more in general: P(g(X) a) apple 1 a E[g(X)] g(x) g : R! R 0, 8x 2 R

36 Chebyshev's inequality 8a >0 P( X µ a) apple 2 a 2 P( X µ a ) apple 1 a 2 no more than 1/a 2 of the distribution's values can be more than a standard deviations away from the mean

37 Autocorrelation C xx ( ) =E[(X t µ)(x t+ µ)] R xx ( ) = E[(X t µ)(x t+ µ)] 2 Often the autocovariance is called autocorrelation even if this normalization has not been performed and vice-versa

38 Frequency domain analysis

39 Fourier transform The Fourier transform is given by! and the inverse transform is given by! The Fourier transform is also a random variable X(f) = lim T!1 x(t) = lim F!1 Z T/2 Z F/2 F/2 T/2 e i2 ft x(t) dt e i2 ft X(f) df

40 Power spectral density Average value of the squared magnitude of the Fourier transform S(f) =h X(f) 2 i = hx(f)x (f)i = lim T!1 1 T Z T/2 T/2 e i2 ft x(t) dt Z T/2 T/2 e i2 ft x(t 0 ) dt 0

41 = Z 1 Z = lim T!1 = lim T!1 = lim T!1 Wiener-Khinchin S(f)e i2 f df hx(f)x (f)ie i2 f df 1 T 1 T 1 T 1 Z 1 1 Z 1 1 Z T/2 T/2 Z T/2 = lim T!1 T T/2 = hx(t)x(t )i Z T/2 T/2 Z T/2 Z T/2 T/2 Z T/2 T/2 x(t)x(t theorem e i2 ft x(t) dt T/2 Z T/2 T/2 e i2 ft0 x(t 0 ) dt 0 e i2 f df e i2 f(t t0 ) df x(t)x(t 0 ) dt dt 0 (t t 0 )x(t)x(t 0 ) dt dt 0 ) dt

42 Examples

43 Parseval s theorem Z 1 hx(t)x(t )i = Z 1 1 S(f)e i2 f df )hx 2 (t)i = 1 S(f) df The average value of the square of the signal (variance if the signal has zero mean) is equal to the integral of the power spectral density

44 Examples

45 Shot noise Generated by discrete arrival electrons in a wire rain on a roof Interactions can be ignored Arrival independent Poisson process

46 Shot noise <I>= qn/t I(t) =q NX n=1 (t t n ) Z T/2 NX NX I(f) = lim T!1 T/2 e i2 ft q n=1 (t t n ) dt = q n=1 e i2 ft n S I (f) =<I(f)I (f) >= lim T!1 = lim T!1 q 2 N T = q<i> q 2 T NX n=1 e i2 ft n NX m=1 e i2 ft m! <I 2 noise >= 2q<I> f

47 Johnson noise Relaxation of thermal fluctuation in a resistor Small voltage fluctuation associated with thermal motion of electrons <V 2 noise >= 4kTR f