Stochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno
|
|
- Brooke Bryant
- 5 years ago
- Views:
Transcription
1 Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1
2 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function. 2
3 Deterministic vs. Random Signals Deterministic Signal: Exactly predictable. V t = Acos ωt + θ, A, ω, t, θ R Random Signal: Associated with a chance occurrence. a) Continuous or discrete (time series). b) May have a deterministic structure. V t = Acos ωt + θ, ω, t, R, A & θ random e. g. A 0,1, θ N 0,1, or t Z (integer) 3
4 Example: No deterministic structure. X(t) t 4
5 Random Processes Map the elements of the sample space S to the set of continuous time functions C. For a fixed time point = random variable. Example: Measurement of any physical quantity (with additive noise) over time. X: S C x(t, s )=ordinary time function X(t, s)=random variable 5
6 Random Process x(t, s ) X t, s = random variable X t, s Sample Function 5 s t t
7 Random Sequence Map the elements of the sample space S to the set of discrete time functions X(n, s). For a fixed time point = random variable. Example: Samples of any physical quantity (with additive noise) over time. Discrete random process, time series. 7
8 Example: Random Binary Signal Random sequence of pulses s.t. 1. Rectangular pulses of fixed duration T. 2. Amplitude +1 or 1, equally likely. 3. Statistically independent amplitudes. 4. Start time D for sequence uniformly distributed in the interval [0, T]. 8
9 Random Binary Signal 1 T 2T t 1 D 2T D~U 0, T 9
10 Mathematical Description X t = k= A k p t kt D p(t) = unit amplitude pulse of duration T. A k = binary r.v. in 1, 1 = amplitude of k th pulse. D = random start time, uniformly distributed in [0, T]. 10
11 Moments of Random Process Fix time to obtain a random variable. Obtain moments as a function of time. m X t = E X t = න k th moment = E X k t = න xf X x, t dx x k f X x, t dx 11
12 Properties of Binary Signal m X t = E X t = X i P i 2 i=1 = 1(1/2) + 1(1/2) = 0 2 nd moment = E X 2 t = = 1 Second moment =variance (zero mean). Special Case: Constant moments (not functions of time). 12
13 Joint Densities f Xi X j x i, x j, i j X i = X t i Specify how fast X t time changes with Later: related to spectral content. Higher order densities provide more information (hard to compute). 13
14 Statistically Independent Random Signals f X1 X 2 Y 1 Y 2 = f X1 X 2 f Y1 Y 2 X i = X t i, Y j = Y t j Any choice of t i and t j Possibly t i t j 14
15 Gaussian Random Process All density functions (any order) normal. Multivariate normal density: completely specified by the mean and covariance matrix. f X x = 1 2π n/2 det C x exp 1 2 x m x T C x 1 x m x X = X 1 X i X j T, i j X i = X t i 15
16 Autocorrelation R XX t 1, t 2 = E X t 1 X t 2 = න න x t 1 x t 2 f X1 X 2 x 1, x 2 dx 1 dx 2 Autocorrelation is an ensemble average using the joint density function. Recall: for fixed t, random process = r.v. Similarly define, autocovariance (same as autocorrelation for zero mean). 16
17 Autocorrelation of Binary Signal Choose 2 time points t 1 & t 2, 0 < t 1 < t 2 < T D = random start time, D~U 0, T Switching point D t 1, t 2 : t 1 &t 2 in the same pulse. Switching point D t 1, t 2 : t 1 &t 2 not in the same pulse. 1 T 2T t 2T 1 D 17
18 0 < D < t 1 or t 2 < D < T 1 T 2T t 1 D t 1 t 2 2T D t 1, t 2 t 1 & t 2 in same interval X t 1 = X t 2 = 1, with equal probability =
19 t 1 < D < t 2 1 T 2T t 1 D t 1 t 2 2T D t 1, t 2 t 1 & t 2 not in same interval X t 1 = X t 2 = ±1, with equal probability =
20 1/T Probabilities D = uniformly distributed in [0,T]. P t 1 < D < t 2 = t 2 t 1, 0 < t T 1 < t 2 < T P 0 < D < t 1 or t 2 < D < T = 1 P t 1 < D < t 2 = 1 t 2 t 1 T T D 20
21 Product of Amplitudes Sign of amplitude is the same if in the same pulse 0 < D < t 1 or t 2 < D < T. Sign of amplitude can be the same or different if in consecutive pulses (t 1 < D < 21
22 Autocorrelation t 2 t 1 < T Pr X t 1 X t 2 = 1 t 1 in same pulse as t 2 = 1 Use t 2 t 1 < T to include t 2 < t 1 R XX t 1, t 2 = E X t 1 X t 2 = 3 cases X t 1 X t 2 P X t 1 X t 2 = 1 1 t 2 t 1 /T t 2 t 1 /T t 2 t 1 /T = 1 t 2 t 1 /T 22
23 Autocorrelation t 2 t 1 > T Independent amplitudes for t 2 t 1 > T Independent implies uncorrelated. R XX t 1, t 2 = E X t 1 X t 2 = E X t 1 E X t 2 = 0 23
24 Autocorrelation of Binary Signal R XX t 1, t 2 = E X t 1 X t 2 = ቐ 1 t 2 t 1, t T 2 t 1 < T 0, t 2 t 1 > T Function of t 2 t t 2 t 1 24
25 Stationary Random Process Two definitions Strictly stationary random process Wide sense stationary random process (WSS) (Strictly) Stationary implies wide-sense stationary. 25
26 Strictly Stationary All pdfs describing the process are unaffected by any time shift. X i = X t i, i = 1,2,, k X i = X t i + τ, i = 1,2,, k Both governed by the same pdfs f Xi, f Xi X j, f Xi X k Wide Sense Stationary: Constant mean, shift-invariant autocorrelation. 26
27 Wide Sense Stationary Random Signal Stationarity of the mean (constant). m = E X(t) Stationary of the autocorrelation. R XX τ = E X t X t + τ (depends on separation τ only) 27
28 Nonstationary Signal Y(t )= X+cos(t), X~N(0,9), m Y (t) = cos(t) 28
29 Example: WSS only Equally probable outcomes Y t ±5 sin t, ±5 cos t E Y t = 0.25 ±5 sin t ± 5 cos t = 0 Joint pdf: Assume four possible joint outcomes only (equally probable) with two sines or two cosines of the same sign R Y t + τ, t = sin t sin t + τ cos t cos t + τ = 12.5 cos τ = R Y τ 29
30 Not Strict Sense Stationary Y t ±5 sin t, ±5 cos t Take two time points (say 0 and π/4) Values at t = 0: Y t 0, ±5 Values at t = π : Y t ±5/ 2 4 First-order distributions are different (even though their mean is the same). 30
31 Ergodic Random Processes Single realization is enough. Time average = ensemble average. Ergodicity, like stationarity, is an idealization. Can be approximately true in practice. Ergodic signals tend to look random.
32 Stationarity Necessary Explanation Single realization has a single average for any property: all moments, autocorrelation etc. Can only obtain expected value if it is constant. 32
33 Example: Stationary not Ergodic Random constant amplitude X t = A Amplitude A~N 0, σ 2 Sample realization with amplitude A 1 0 Mean of constant A 1 = A 1 0 Stationarity is not sufficient. 33
34 Ergodicity in Mean Time Average m xa = Lim T 1 T න 0 T x A t dt = E X t Ergodicity in the mean: Cov XX τ 0, as τ For zero mean R τ 0, as τ 34
35 Ergodicity in Autocorrelation Time Autocorrelation R XA τ = Lim T 1 T න 0 T x A t x A t + τ dt = E X t X t + τ = R XX τ Ergodicity in autocorrelation: Need 4 th moment. Cov ZZ τ 1 0 as τ 1, Z = X t X t + τ 35
36 Example Deterministic structure X t = A sin ωt A~ N(0, 2 ), constant Sample realization X A t = A 1 sin ωt, fix A 1 Compare time autocorrelation & autocorrelation. 36
37 Time Autocorrelation R X A ( ) Lim T Lim T Lim T A T 1 T 2 A1 2T cos T 0 T 0 0 A T X 2 1 A sin cos ( t) X A ( t ) dt t sin t dt cos 2t dt (finite integral)/t T න cos ω 2t + τ 0 T dt = න 0 cos ωτ cos 2ωt sin ωτ sin 2ωt dt 37
38 Autocorrelation R XX t 1, t 2 = E X t 1 X t 2 = E A 2 sin ωt 1 sin ωt 2 = σ2 2 cos ω t 1 t 2 cos ω t 1 + t 2 Not a function of the time shift only. Not equal to time autocorrelation. Not an ergodic process. 38
39 Properties of Autocorrelation Useful general properties used throughout the course. Several apply to the stationary case only. Assume real scalar processes. 39
40 Mean Square Value From autocorrelation R XX t, t = E X 2 (t) = R XX t For X stationary R XX t = R XX 0, t 40
41 Even Function R XX t 1, t 2 = E X t 1 X t 2 = E X t 2 X t 1 = R XX t 2, t 1 Stationary X t R XX t 2 t 1 = R XX t 1 t 2 R XX τ =even function of τ = t 2 t 1 41
42 Peak Value Consider a zero-mean process w.l.o.g. (subtract mean if not zero) ρ = E X t X t + τ E X 2 t E X 2 t + τ ρ = R X τ R X 0 1 R X τ R X 0 = R X τ R X 0 42
43 Periodic Component R has A periodic component of the same period. No information about phase. X =zero-mean X np + uncorrelated X p X p = A cos ωt + θ, θ~u 0,2π R XX τ = E X t X t + τ = E X np t + X p t X np t + τ + X p t + τ X = Sum of uncorrelated terms R XX τ = R Xnp X np τ + R Xp X p τ 43
44 Periodic Component (cont.) R Xp X p τ = E X p t X p t + τ = A 2 E cos ωt + θ cos ωt + ωτ + θ = A 2 /2 E cos ωτ + cos ω 2t + τ + 2θ cos ω 2t + τ + 2θ = cos ω 2t + τ cos 2θ sin ω 2t + τ sin 2θ E cos 2θ = E sin 2θ = 0, θ~u 0,2π R Xp X p τ = A 2 /2 cos ωτ 44
45 Periodic Component (cont.) R Xp X p τ = A 2 /2 cos ωτ R XX τ = R Xnp X np τ + R Xp X p τ R has = R Xnp X np τ + A 2 /2 cos ωτ A periodic component of the same period. No information about phase. 45
46 Zero-mean Zero-mean, ergodic process R XX τ 0 as τ R XX τ = E X t X t + τ = E X zm t + m x X zm t + τ + m x 2 = R Xzm X zm τ + m x R XX τ m 2 x as τ 46
47 Autocorrelation for Vector x R XX t 1, t 2 = E x t 1 x t 2 = E x t 2 x t 1 = R XX t 2, t 1 =conjugate transpose =transpose for real x Stationary: R XX t 2 t 1 = R XX t 1 t 2 47
48 Crosscorrelation Function R XY t 1, t 2 = E X t 1 Y t 2 Stationary: skew-symmetric R XY τ = E X t Y t + τ R YX τ = E Y t X t + τ = E X t Y t τ = R XY ( τ)} 48
49 Properties of Crosscorrelation R XY τ = R YX τ R XY τ R XX 0 R YY 0, ρ 1 R XY τ 1 [R 2 XX 0 + R YY 0 ] 0, orthogonal R XY τ = ቊ m X m Y, uncorrelated 49
50 Example: Cross-correlation X t = A sin ωt + θ, θ~u 0,2π Y t = B cos ωt + θ, θ~u 0,2π R XY τ = E X t Y t + τ = AB. E sin ωt + θ cos ω t + τ + θ = AB 2. E sin ω 2t + τ + 2θ + sin ωτ = AB 2 sin ωτ Zero at τ = 0 not maximum Zero mean as shown earlier 50
51 Combination of Random Processes Sum of two random processes. R ZZ τ = E Z t = X t + Y(t) X t + Y(t) X t + τ + Y(t + τ) = R XX τ + R XY τ + R YX τ + R YY τ Uncorrelated and at least one zeromean. R ZZ τ = R XX τ + R YY τ 51
52 Time Delay Estimation Transmit signal to object. Receive signal. Find cross-correlation of two signals. Location of peak = time delay. R XY τ = E X t X t + τ T d + n t = R XX τ T d T d 52
53 Power Spectral Density Function (SDF) Stationary Process: Fourier transform of autocorrelation. S XX jω = F R XX τ = න R XX τ e jωτ dτ R XX τ = 1 2π න S XX jω e jωτ dω Wiener-Khinchine Relation S XX s = L 2 R XX τ = න S XX s e sτ dω 53
54 Example R XX τ = σ 2 β τ e S XX jω = F R XX τ = 2σ2 β ω 2 + β 2 S XX s = L 2 R XX τ = 2σ2 β s 2 + β 2 Same as Gauss-Markov process but autocorrelation does not tell the whole story. 54
55 Autocorrelation and PSD R τ S jω 55
56 For = 0 Mean-square Value of Output R XX τ = 1 2π න S XX jω e jωτ dω R XX 0 = E X 2 (t) = 1 2π න S XX jω dω = 1 j 2πj න S XX s ds j 56
57 Power in a Finite Band Power spectral density gives distribution of power over frequencies. 1 Power for ω ω 1, ω 2 : ω 1SXX jω dω + 1 ω 2SXX jω dω 2π න ω 2 2π න ω 1 57
58 2 1 ω 2 2π න ω 1 Example S XX jω = 2σ2 β ω 2 + β 2 Power for ω ω 1, ω 2 : 2σ 2 β ω 2 + β 2 dω = Integration tables. 2σ2 β π ω 2 1 ω β tan 1 β ω1 Power = 2σ2 ω π tan 1 2 β ω tan 1 1 β 58
59 Example: Mean Square E X 2 (t) = 1 2π න S XX jω dω = 1 j 2πj න S XX s ds j = 2σ2 β 1 ω 2π β tan 1 β = σ 2 Later: Table 3.1 for s-domain integral. 59
60 Cross Spectral Density Function S XY jω = F R XY τ = න R XY τ e jωτ dτ Skew-symmetry of cross-correlation: R XY τ =R YX τ S XY jω = න R YX τ e jω τ d τ = S YX jω 60
61 Properties of SDF The autocorrelation is real, even. Real function f τ : F f τ Even function f τ : F f τ = even + j odd = even S XX jω = S XX ω 2 = real, even Nonnegative: since its integral gives the energy over BW. 61
62 Spectral Density of Sum Z t = X t + Y t R ZZ τ = R XX τ +R XY τ + R YX τ + R YY τ S ZZ jω = S XX jω +S XY jω + S YX jω + S YY jω Zero cross-correlation: S XY jω = 0 S ZZ jω = S XX jω +S YY jω X & Y uncorrelated & X or Y zero mean. 62
63 Coherence Function S 2 XY jω 2 γ XY jω = 1, ω S XX jω S YY jω 2 1, X t = Y t jω = ቊ 0, zero crosscorrelation X t &Y t γ XY Used in applications (e.g. acoustics). 63
64 Conclusion Probabilistic description of random signals. Autocorrelation and crosscorrelation. Power spectral density function. Experimental determination: necessary but difficult. 64
65 References R. G. Brown and P. Y. C. Hwang, Introduction to Random Signals and Applied Kalman Filtering, 3ed, J. Wiley, NY, G. R. Cooper and C. D. MaGillem, Probabilistic Methods of Signal and System Analysis, Oxford Univ. Press, NY, 1999 Binary signal example is from K. S. Shanmugan & A. M. Breipohl, Detection, Estimation & Data Analysis, J. Wiley, NY, 1988, pp
ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random
More informationEAS 305 Random Processes Viewgraph 1 of 10. Random Processes
EAS 305 Random Processes Viewgraph 1 of 10 Definitions: Random Processes A random process is a family of random variables indexed by a parameter t T, where T is called the index set λ i Experiment outcome
More informationStochastic Processes
Elements of Lecture II Hamid R. Rabiee with thanks to Ali Jalali Overview Reading Assignment Chapter 9 of textbook Further Resources MIT Open Course Ware S. Karlin and H. M. Taylor, A First Course in Stochastic
More informationStochastic Processes. A stochastic process is a function of two variables:
Stochastic Processes Stochastic: from Greek stochastikos, proceeding by guesswork, literally, skillful in aiming. A stochastic process is simply a collection of random variables labelled by some parameter:
More informationStatistical signal processing
Statistical signal processing Short overview of the fundamentals Outline Random variables Random processes Stationarity Ergodicity Spectral analysis Random variable and processes Intuition: A random variable
More informationENSC327 Communications Systems 19: Random Processes. Jie Liang School of Engineering Science Simon Fraser University
ENSC327 Communications Systems 19: Random Processes Jie Liang School of Engineering Science Simon Fraser University 1 Outline Random processes Stationary random processes Autocorrelation of random processes
More informationChapter 2 Random Processes
Chapter 2 Random Processes 21 Introduction We saw in Section 111 on page 10 that many systems are best studied using the concept of random variables where the outcome of a random experiment was associated
More informationPROBABILITY AND RANDOM PROCESSESS
PROBABILITY AND RANDOM PROCESSESS SOLUTIONS TO UNIVERSITY QUESTION PAPER YEAR : JUNE 2014 CODE NO : 6074 /M PREPARED BY: D.B.V.RAVISANKAR ASSOCIATE PROFESSOR IT DEPARTMENT MVSR ENGINEERING COLLEGE, NADERGUL
More informationFundamentals of Digital Commun. Ch. 4: Random Variables and Random Processes
Fundamentals of Digital Commun. Ch. 4: Random Variables and Random Processes Klaus Witrisal witrisal@tugraz.at Signal Processing and Speech Communication Laboratory www.spsc.tugraz.at Graz University of
More information16.584: Random (Stochastic) Processes
1 16.584: Random (Stochastic) Processes X(t): X : RV : Continuous function of the independent variable t (time, space etc.) Random process : Collection of X(t, ζ) : Indexed on another independent variable
More information3F1 Random Processes Examples Paper (for all 6 lectures)
3F Random Processes Examples Paper (for all 6 lectures). Three factories make the same electrical component. Factory A supplies half of the total number of components to the central depot, while factories
More informationUCSD ECE153 Handout #40 Prof. Young-Han Kim Thursday, May 29, Homework Set #8 Due: Thursday, June 5, 2011
UCSD ECE53 Handout #40 Prof. Young-Han Kim Thursday, May 9, 04 Homework Set #8 Due: Thursday, June 5, 0. Discrete-time Wiener process. Let Z n, n 0 be a discrete time white Gaussian noise (WGN) process,
More informationIntroduction to Probability and Stochastic Processes I
Introduction to Probability and Stochastic Processes I Lecture 3 Henrik Vie Christensen vie@control.auc.dk Department of Control Engineering Institute of Electronic Systems Aalborg University Denmark Slides
More informationfor valid PSD. PART B (Answer all five units, 5 X 10 = 50 Marks) UNIT I
Code: 15A04304 R15 B.Tech II Year I Semester (R15) Regular Examinations November/December 016 PROBABILITY THEY & STOCHASTIC PROCESSES (Electronics and Communication Engineering) Time: 3 hours Max. Marks:
More informationECE 636: Systems identification
ECE 636: Systems identification Lectures 3 4 Random variables/signals (continued) Random/stochastic vectors Random signals and linear systems Random signals in the frequency domain υ ε x S z + y Experimental
More informationProbability Space. J. McNames Portland State University ECE 538/638 Stochastic Signals Ver
Stochastic Signals Overview Definitions Second order statistics Stationarity and ergodicity Random signal variability Power spectral density Linear systems with stationary inputs Random signal memory Correlation
More informationProblem Sheet 1 Examples of Random Processes
RANDOM'PROCESSES'AND'TIME'SERIES'ANALYSIS.'PART'II:'RANDOM'PROCESSES' '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''Problem'Sheets' Problem Sheet 1 Examples of Random Processes 1. Give
More informationName of the Student: Problems on Discrete & Continuous R.Vs
Engineering Mathematics 05 SUBJECT NAME : Probability & Random Process SUBJECT CODE : MA6 MATERIAL NAME : University Questions MATERIAL CODE : JM08AM004 REGULATION : R008 UPDATED ON : Nov-Dec 04 (Scan
More informationChapter 6. Random Processes
Chapter 6 Random Processes Random Process A random process is a time-varying function that assigns the outcome of a random experiment to each time instant: X(t). For a fixed (sample path): a random process
More informationSpectral Analysis of Random Processes
Spectral Analysis of Random Processes Spectral Analysis of Random Processes Generally, all properties of a random process should be defined by averaging over the ensemble of realizations. Generally, all
More informationParametric Signal Modeling and Linear Prediction Theory 1. Discrete-time Stochastic Processes
Parametric Signal Modeling and Linear Prediction Theory 1. Discrete-time Stochastic Processes Electrical & Computer Engineering North Carolina State University Acknowledgment: ECE792-41 slides were adapted
More informationIV. Covariance Analysis
IV. Covariance Analysis Autocovariance Remember that when a stochastic process has time values that are interdependent, then we can characterize that interdependency by computing the autocovariance function.
More informationName of the Student: Problems on Discrete & Continuous R.Vs
Engineering Mathematics 08 SUBJECT NAME : Probability & Random Processes SUBJECT CODE : MA645 MATERIAL NAME : University Questions REGULATION : R03 UPDATED ON : November 07 (Upto N/D 07 Q.P) (Scan the
More informationStochastic Processes. Chapter Definitions
Chapter 4 Stochastic Processes Clearly data assimilation schemes such as Optimal Interpolation are crucially dependent on the estimates of background and observation error statistics. Yet, we don t know
More informationProblems on Discrete & Continuous R.Vs
013 SUBJECT NAME SUBJECT CODE MATERIAL NAME MATERIAL CODE : Probability & Random Process : MA 61 : University Questions : SKMA1004 Name of the Student: Branch: Unit I (Random Variables) Problems on Discrete
More informationProbability and Statistics
Probability and Statistics 1 Contents some stochastic processes Stationary Stochastic Processes 2 4. Some Stochastic Processes 4.1 Bernoulli process 4.2 Binomial process 4.3 Sine wave process 4.4 Random-telegraph
More informationSignals and Spectra - Review
Signals and Spectra - Review SIGNALS DETERMINISTIC No uncertainty w.r.t. the value of a signal at any time Modeled by mathematical epressions RANDOM some degree of uncertainty before the signal occurs
More informationDefinition of a Stochastic Process
Definition of a Stochastic Process Balu Santhanam Dept. of E.C.E., University of New Mexico Fax: 505 277 8298 bsanthan@unm.edu August 26, 2018 Balu Santhanam (UNM) August 26, 2018 1 / 20 Overview 1 Stochastic
More informationUCSD ECE 153 Handout #46 Prof. Young-Han Kim Thursday, June 5, Solutions to Homework Set #8 (Prepared by TA Fatemeh Arbabjolfaei)
UCSD ECE 53 Handout #46 Prof. Young-Han Kim Thursday, June 5, 04 Solutions to Homework Set #8 (Prepared by TA Fatemeh Arbabjolfaei). Discrete-time Wiener process. Let Z n, n 0 be a discrete time white
More informationRandom Processes Why we Care
Random Processes Why we Care I Random processes describe signals that change randomly over time. I Compare: deterministic signals can be described by a mathematical expression that describes the signal
More informationBasics on 2-D 2 D Random Signal
Basics on -D D Random Signal Spring 06 Instructor: K. J. Ray Liu ECE Department, Univ. of Maryland, College Park Overview Last Time: Fourier Analysis for -D signals Image enhancement via spatial filtering
More informationCommunication Theory II
Communication Theory II Lecture 8: Stochastic Processes Ahmed Elnakib, PhD Assistant Professor, Mansoura University, Egypt March 5 th, 2015 1 o Stochastic processes What is a stochastic process? Types:
More informationA Probability Review
A Probability Review Outline: A probability review Shorthand notation: RV stands for random variable EE 527, Detection and Estimation Theory, # 0b 1 A Probability Review Reading: Go over handouts 2 5 in
More informationStochastic Process II Dr.-Ing. Sudchai Boonto
Dr-Ing Sudchai Boonto Department of Control System and Instrumentation Engineering King Mongkuts Unniversity of Technology Thonburi Thailand Random process Consider a random experiment specified by the
More informationFig 1: Stationary and Non Stationary Time Series
Module 23 Independence and Stationarity Objective: To introduce the concepts of Statistical Independence, Stationarity and its types w.r.to random processes. This module also presents the concept of Ergodicity.
More information2. (a) What is gaussian random variable? Develop an equation for guassian distribution
Code No: R059210401 Set No. 1 II B.Tech I Semester Supplementary Examinations, February 2007 PROBABILITY THEORY AND STOCHASTIC PROCESS ( Common to Electronics & Communication Engineering, Electronics &
More informationP 1.5 X 4.5 / X 2 and (iii) The smallest value of n for
DHANALAKSHMI COLLEGE OF ENEINEERING, CHENNAI DEPARTMENT OF ELECTRONICS AND COMMUNICATION ENGINEERING MA645 PROBABILITY AND RANDOM PROCESS UNIT I : RANDOM VARIABLES PART B (6 MARKS). A random variable X
More information13. Power Spectrum. For a deterministic signal x(t), the spectrum is well defined: If represents its Fourier transform, i.e., if.
For a deterministic signal x(t), the spectrum is well defined: If represents its Fourier transform, i.e., if jt X ( ) = xte ( ) dt, (3-) then X ( ) represents its energy spectrum. his follows from Parseval
More informationwhere r n = dn+1 x(t)
Random Variables Overview Probability Random variables Transforms of pdfs Moments and cumulants Useful distributions Random vectors Linear transformations of random vectors The multivariate normal distribution
More information13.42 READING 6: SPECTRUM OF A RANDOM PROCESS 1. STATIONARY AND ERGODIC RANDOM PROCESSES
13.42 READING 6: SPECTRUM OF A RANDOM PROCESS SPRING 24 c A. H. TECHET & M.S. TRIANTAFYLLOU 1. STATIONARY AND ERGODIC RANDOM PROCESSES Given the random process y(ζ, t) we assume that the expected value
More informationEEM 409. Random Signals. Problem Set-2: (Power Spectral Density, LTI Systems with Random Inputs) Problem 1: Problem 2:
EEM 409 Random Signals Problem Set-2: (Power Spectral Density, LTI Systems with Random Inputs) Problem 1: Consider a random process of the form = + Problem 2: X(t) = b cos(2π t + ), where b is a constant,
More information2A1H Time-Frequency Analysis II Bugs/queries to HT 2011 For hints and answers visit dwm/courses/2tf
Time-Frequency Analysis II (HT 20) 2AH 2AH Time-Frequency Analysis II Bugs/queries to david.murray@eng.ox.ac.uk HT 20 For hints and answers visit www.robots.ox.ac.uk/ dwm/courses/2tf David Murray. A periodic
More informationD.S.G. POLLOCK: BRIEF NOTES
BIVARIATE SPECTRAL ANALYSIS Let x(t) and y(t) be two stationary stochastic processes with E{x(t)} = E{y(t)} =. These processes have the following spectral representations: (1) x(t) = y(t) = {cos(ωt)da
More informationMassachusetts Institute of Technology
Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.011: Introduction to Communication, Control and Signal Processing QUIZ, April 1, 010 QUESTION BOOKLET Your
More informationUCSD ECE250 Handout #27 Prof. Young-Han Kim Friday, June 8, Practice Final Examination (Winter 2017)
UCSD ECE250 Handout #27 Prof. Young-Han Kim Friday, June 8, 208 Practice Final Examination (Winter 207) There are 6 problems, each problem with multiple parts. Your answer should be as clear and readable
More information2A1H Time-Frequency Analysis II
2AH Time-Frequency Analysis II Bugs/queries to david.murray@eng.ox.ac.uk HT 209 For any corrections see the course page DW Murray at www.robots.ox.ac.uk/ dwm/courses/2tf. (a) A signal g(t) with period
More informationFor a stochastic process {Y t : t = 0, ±1, ±2, ±3, }, the mean function is defined by (2.2.1) ± 2..., γ t,
CHAPTER 2 FUNDAMENTAL CONCEPTS This chapter describes the fundamental concepts in the theory of time series models. In particular, we introduce the concepts of stochastic processes, mean and covariance
More informationLecture Notes 7 Stationary Random Processes. Strict-Sense and Wide-Sense Stationarity. Autocorrelation Function of a Stationary Process
Lecture Notes 7 Stationary Random Processes Strict-Sense and Wide-Sense Stationarity Autocorrelation Function of a Stationary Process Power Spectral Density Continuity and Integration of Random Processes
More information7 The Waveform Channel
7 The Waveform Channel The waveform transmitted by the digital demodulator will be corrupted by the channel before it reaches the digital demodulator in the receiver. One important part of the channel
More informationStochastic Processes. Monday, November 14, 11
Stochastic Processes 1 Definition and Classification X(, t): stochastic process: X : T! R (, t) X(, t) where is a sample space and T is time. {X(, t) is a family of r.v. defined on {, A, P and indexed
More informationSignals and Spectra (1A) Young Won Lim 11/26/12
Signals and Spectra (A) Copyright (c) 202 Young W. Lim. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version.2 or any later
More informationSRI VIDYA COLLEGE OF ENGINEERING AND TECHNOLOGY UNIT 3 RANDOM PROCESS TWO MARK QUESTIONS
UNIT 3 RANDOM PROCESS TWO MARK QUESTIONS 1. Define random process? The sample space composed of functions of time is called a random process. 2. Define Stationary process? If a random process is divided
More informationSignal Processing Signal and System Classifications. Chapter 13
Chapter 3 Signal Processing 3.. Signal and System Classifications In general, electrical signals can represent either current or voltage, and may be classified into two main categories: energy signals
More informationChapter 6 - Random Processes
EE385 Class Notes //04 John Stensby Chapter 6 - Random Processes Recall that a random variable X is a mapping between the sample space S and the extended real line R +. That is, X : S R +. A random process
More informationProbability and Statistics for Final Year Engineering Students
Probability and Statistics for Final Year Engineering Students By Yoni Nazarathy, Last Updated: May 24, 2011. Lecture 6p: Spectral Density, Passing Random Processes through LTI Systems, Filtering Terms
More informationCommunication Systems Lecture 21, 22. Dong In Kim School of Information & Comm. Eng. Sungkyunkwan University
Communication Systems Lecture 1, Dong In Kim School of Information & Comm. Eng. Sungkyunkwan University 1 Outline Linear Systems with WSS Inputs Noise White noise, Gaussian noise, White Gaussian noise
More informationChapter 5 Random Variables and Processes
Chapter 5 Random Variables and Processes Wireless Information Transmission System Lab. Institute of Communications Engineering National Sun Yat-sen University Table of Contents 5.1 Introduction 5. Probability
More informationconditional cdf, conditional pdf, total probability theorem?
6 Multiple Random Variables 6.0 INTRODUCTION scalar vs. random variable cdf, pdf transformation of a random variable conditional cdf, conditional pdf, total probability theorem expectation of a random
More informationHomework 3 (Stochastic Processes)
In the name of GOD. Sharif University of Technology Stochastic Processes CE 695 Dr. H.R. Rabiee Homework 3 (Stochastic Processes). Explain why each of the following is NOT a valid autocorrrelation function:
More information2. SPECTRAL ANALYSIS APPLIED TO STOCHASTIC PROCESSES
2. SPECTRAL ANALYSIS APPLIED TO STOCHASTIC PROCESSES 2.0 THEOREM OF WIENER- KHINTCHINE An important technique in the study of deterministic signals consists in using harmonic functions to gain the spectral
More information5 Operations on Multiple Random Variables
EE360 Random Signal analysis Chapter 5: Operations on Multiple Random Variables 5 Operations on Multiple Random Variables Expected value of a function of r.v. s Two r.v. s: ḡ = E[g(X, Y )] = g(x, y)f X,Y
More informationDeterministic. Deterministic data are those can be described by an explicit mathematical relationship
Random data Deterministic Deterministic data are those can be described by an explicit mathematical relationship Deterministic x(t) =X cos r! k m t Non deterministic There is no way to predict an exact
More informationLOPE3202: Communication Systems 10/18/2017 2
By Lecturer Ahmed Wael Academic Year 2017-2018 LOPE3202: Communication Systems 10/18/2017 We need tools to build any communication system. Mathematics is our premium tool to do work with signals and systems.
More informationStochastic Processes: I. consider bowl of worms model for oscilloscope experiment:
Stochastic Processes: I consider bowl of worms model for oscilloscope experiment: SAPAscope 2.0 / 0 1 RESET SAPA2e 22, 23 II 1 stochastic process is: Stochastic Processes: II informally: bowl + drawing
More informationELEMENTS OF PROBABILITY THEORY
ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable
More informationLecture 15. Theory of random processes Part III: Poisson random processes. Harrison H. Barrett University of Arizona
Lecture 15 Theory of random processes Part III: Poisson random processes Harrison H. Barrett University of Arizona 1 OUTLINE Poisson and independence Poisson and rarity; binomial selection Poisson point
More information4 Classical Coherence Theory
This chapter is based largely on Wolf, Introduction to the theory of coherence and polarization of light [? ]. Until now, we have not been concerned with the nature of the light field itself. Instead,
More informationMassachusetts Institute of Technology Department of Electrical Engineering and Computer Science : Discrete-Time Signal Processing
Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.34: Discrete-Time Signal Processing OpenCourseWare 006 ecture 8 Periodogram Reading: Sections 0.6 and 0.7
More informationOutline. Random Variables. Examples. Random Variable
Outline Random Variables M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno Random variables. CDF and pdf. Joint random variables. Correlated, independent, orthogonal. Correlation,
More informationLecture 2. Spring Quarter Statistical Optics. Lecture 2. Characteristic Functions. Transformation of RVs. Sums of RVs
s of Spring Quarter 2018 ECE244a - Spring 2018 1 Function s of The characteristic function is the Fourier transform of the pdf (note Goodman and Papen have different notation) C x(ω) = e iωx = = f x(x)e
More informationE X A M. Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours. Number of pages incl.
E X A M Course code: Course name: Number of pages incl. front page: 6 MA430-G Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours Resources allowed: Notes: Pocket calculator,
More informationParticle Filters. Outline
Particle Filters M. Sami Fadali Professor of EE University of Nevada Outline Monte Carlo integration. Particle filter. Importance sampling. Degeneracy Resampling Example. 1 2 Monte Carlo Integration Numerical
More informationMultiple Random Variables
Multiple Random Variables This Version: July 30, 2015 Multiple Random Variables 2 Now we consider models with more than one r.v. These are called multivariate models For instance: height and weight An
More informationEEL 5544 Noise in Linear Systems Lecture 30. X (s) = E [ e sx] f X (x)e sx dx. Moments can be found from the Laplace transform as
L30-1 EEL 5544 Noise in Linear Systems Lecture 30 OTHER TRANSFORMS For a continuous, nonnegative RV X, the Laplace transform of X is X (s) = E [ e sx] = 0 f X (x)e sx dx. For a nonnegative RV, the Laplace
More informationFourier Analysis Linear transformations and lters. 3. Fourier Analysis. Alex Sheremet. April 11, 2007
Stochastic processes review 3. Data Analysis Techniques in Oceanography OCP668 April, 27 Stochastic processes review Denition Fixed ζ = ζ : Function X (t) = X (t, ζ). Fixed t = t: Random Variable X (ζ)
More informationChapter 4 The Fourier Series and Fourier Transform
Chapter 4 The Fourier Series and Fourier Transform Representation of Signals in Terms of Frequency Components Consider the CT signal defined by N xt () = Acos( ω t+ θ ), t k = 1 k k k The frequencies `present
More informationChapter 6: Random Processes 1
Chapter 6: Random Processes 1 Yunghsiang S. Han Graduate Institute of Communication Engineering, National Taipei University Taiwan E-mail: yshan@mail.ntpu.edu.tw 1 Modified from the lecture notes by Prof.
More informationName of the Student: Problems on Discrete & Continuous R.Vs
SUBJECT NAME : Probability & Random Processes SUBJECT CODE : MA645 MATERIAL NAME : Additional Problems MATERIAL CODE : JM08AM004 REGULATION : R03 UPDATED ON : March 05 (Scan the above QR code for the direct
More informationMA6451 PROBABILITY AND RANDOM PROCESSES
MA6451 PROBABILITY AND RANDOM PROCESSES UNIT I RANDOM VARIABLES 1.1 Discrete and continuous random variables 1. Show that the function is a probability density function of a random variable X. (Apr/May
More informationLINEAR RESPONSE THEORY
MIT Department of Chemistry 5.74, Spring 5: Introductory Quantum Mechanics II Instructor: Professor Andrei Tokmakoff p. 8 LINEAR RESPONSE THEORY We have statistically described the time-dependent behavior
More informationUNIT-4: RANDOM PROCESSES: SPECTRAL CHARACTERISTICS
UNIT-4: RANDOM PROCESSES: SPECTRAL CHARACTERISTICS In this unit we will study the characteristics of random processes regarding correlation and covariance functions which are defined in time domain. This
More informationUCSD ECE250 Handout #24 Prof. Young-Han Kim Wednesday, June 6, Solutions to Exercise Set #7
UCSD ECE50 Handout #4 Prof Young-Han Kim Wednesday, June 6, 08 Solutions to Exercise Set #7 Polya s urn An urn initially has one red ball and one white ball Let X denote the name of the first ball drawn
More informationContinuous Stochastic Processes
Continuous Stocastic Processes Te term stocastic is often applied to penomena tat vary in time, wile te word random is reserved for penomena tat vary in space. Apart from tis distinction, te modelling
More informationThis examination consists of 10 pages. Please check that you have a complete copy. Time: 2.5 hrs INSTRUCTIONS
THE UNIVERSITY OF BRITISH COLUMBIA Department of Electrical and Computer Engineering EECE 564 Detection and Estimation of Signals in Noise Final Examination 08 December 2009 This examination consists of
More informationECE 650 Lecture #10 (was Part 1 & 2) D. van Alphen. D. van Alphen 1
ECE 650 Lecture #10 (was Part 1 & 2) D. van Alphen D. van Alphen 1 Lecture 10 Overview Part 1 Review of Lecture 9 Continuing: Systems with Random Inputs More about Poisson RV s Intro. to Poisson Processes
More informationTSKS01 Digital Communication Lecture 1
TSKS01 Digital Communication Lecture 1 Introduction, Repetition, and Noise Modeling Emil Björnson Department of Electrical Engineering (ISY) Division of Communication Systems Emil Björnson Course Director
More informationEcon 424 Time Series Concepts
Econ 424 Time Series Concepts Eric Zivot January 20 2015 Time Series Processes Stochastic (Random) Process { 1 2 +1 } = { } = sequence of random variables indexed by time Observed time series of length
More informationFundamentals of Noise
Fundamentals of Noise V.Vasudevan, Department of Electrical Engineering, Indian Institute of Technology Madras Noise in resistors Random voltage fluctuations across a resistor Mean square value in a frequency
More informationEE538 Final Exam Fall :20 pm -5:20 pm PHYS 223 Dec. 17, Cover Sheet
EE538 Final Exam Fall 005 3:0 pm -5:0 pm PHYS 3 Dec. 17, 005 Cover Sheet Test Duration: 10 minutes. Open Book but Closed Notes. Calculators ARE allowed!! This test contains five problems. Each of the five
More informationECE Homework Set 3
ECE 450 1 Homework Set 3 0. Consider the random variables X and Y, whose values are a function of the number showing when a single die is tossed, as show below: Exp. Outcome 1 3 4 5 6 X 3 3 4 4 Y 0 1 3
More information3.0 PROBABILITY, RANDOM VARIABLES AND RANDOM PROCESSES
3.0 PROBABILITY, RANDOM VARIABLES AND RANDOM PROCESSES 3.1 Introduction In this chapter we will review the concepts of probabilit, rom variables rom processes. We begin b reviewing some of the definitions
More informationLecture 1: Pragmatic Introduction to Stochastic Differential Equations
Lecture 1: Pragmatic Introduction to Stochastic Differential Equations Simo Särkkä Aalto University, Finland (visiting at Oxford University, UK) November 13, 2013 Simo Särkkä (Aalto) Lecture 1: Pragmatic
More informationRandom Process. Random Process. Random Process. Introduction to Random Processes
Random Process A random variable is a function X(e) that maps the set of experiment outcomes to the set of numbers. A random process is a rule that maps every outcome e of an experiment to a function X(t,
More informationGaussian Basics Random Processes Filtering of Random Processes Signal Space Concepts
White Gaussian Noise I Definition: A (real-valued) random process X t is called white Gaussian Noise if I X t is Gaussian for each time instance t I Mean: m X (t) =0 for all t I Autocorrelation function:
More informationEE4601 Communication Systems
EE4601 Communication Systems Week 4 Ergodic Random Processes, Power Spectrum Linear Systems 0 c 2011, Georgia Institute of Technology (lect4 1) Ergodic Random Processes An ergodic random process is one
More informationSystem Identification & Parameter Estimation
System Identification & Parameter Estimation Wb3: SIPE lecture Correlation functions in time & frequency domain Alfred C. Schouten, Dept. of Biomechanical Engineering (BMechE), Fac. 3mE // Delft University
More informationCh 4: The Continuous-Time Fourier Transform
Ch 4: The Continuous-Time Fourier Transform Fourier Transform of x(t) Inverse Fourier Transform jt X ( j) x ( t ) e dt jt x ( t ) X ( j) e d 2 Ghulam Muhammad, King Saud University Continuous-time aperiodic
More informationBasics on Probability. Jingrui He 09/11/2007
Basics on Probability Jingrui He 09/11/2007 Coin Flips You flip a coin Head with probability 0.5 You flip 100 coins How many heads would you expect Coin Flips cont. You flip a coin Head with probability
More informationName of the Student: Problems on Discrete & Continuous R.Vs
Engineering Mathematics 03 SUBJECT NAME : Probability & Random Process SUBJECT CODE : MA 6 MATERIAL NAME : Problem Material MATERIAL CODE : JM08AM008 (Scan the above QR code for the direct download of
More informationProperties of the Autocorrelation Function
Properties of the Autocorrelation Function I The autocorrelation function of a (real-valued) random process satisfies the following properties: 1. R X (t, t) 0 2. R X (t, u) =R X (u, t) (symmetry) 3. R
More information