PROBABILITY AND RANDOM PROCESSESS
|
|
- Martin Floyd
- 5 years ago
- Views:
Transcription
1 PROBABILITY AND RANDOM PROCESSESS SOLUTIONS TO UNIVERSITY QUESTION PAPER YEAR : JUNE 2014 CODE NO : 6074 /M PREPARED BY: D.B.V.RAVISANKAR ASSOCIATE PROFESSOR IT DEPARTMENT MVSR ENGINEERING COLLEGE, NADERGUL
2 PROBABILITY & RAMDOM PROCESSESS SOLUTIONS OF JUNE-2014, CODE NO /M (B.E. 2/4 IT II-SEM MAIN EXAMINATION) PART-A (25M) 1.Define properties of Joint Cumulative distribution function. (2M) Sol. The following are the properties of Joint cdf I.F(-,y) = 0, F(x,-) =0, F(,) =1 II. P{x 1 <X x 2,Y y} = F(x 2,y) F(x 1,y) P{X x,y 1 Y y 2 } = F(x,y 2 ) F(x,y 1) III. P{x 1 X x 2, y 1 Y y 2 } = F(x 2,y 2 ) F(x 1,y 2 ) F(x 2,y 1) +F(x 1,y 1) 2. If A and B are independent events, prove that A and B are also independent (2M) Sol. We know that if A and B are independent P(AB) = P(A). P(B) P A = 1 P A, P B = 1 P B P A P B = 1 P A 1 P B = 1 P A P B + P A P B = 1 P A + P B P AB = 1 P A B = P A B = P(A B) (The above two identities are from addition theorem and Demorgan s theorem) 3.State any three properties of characteristic function (3M) Sol. I) The n th order moment m n is the coefficient of j n ω n in the expansion of Ф(ω) =E{e jωx } II) m n = 1 dn (ω at ω = 0 j n dω n III) If X and Y are independent RVs, then Ф X+Y (ω) = Ф X (ω) Ф Y (ω) 4.Define Axiomatic definition of probability (2M) Sol. Let S be the sample space and A be an event associated with a random experiment. Then the probability of the event A denoted by P(A) is defined as a real number satisfying the following axioms. 1.0 P(A) 1 2.P(S)=1 3. If A and B are mutually exclusive events, P(AՍB) = P(A) + P(B) 5.What is the difference between random variable and random processes (3M) Sol. A random variable is a rule that assigns a real number to every outcome of a random experiment, while a random process is a rule that assigns a time function to every outcome of a random experiment. n!
3 6. Find the mean and variance of poisson distribution (3M) Sol. For a random variable X with parameter λ the probability function of poisson distribution λ λk is given by P X = k = e k = 0,1,2,. k! The mean of poisson distribution E X = k P X = k k=0 = k=0 k λ λk e k! = λ E X 2 = k 2 k=0 λ k 1 ke λ k k 1! =λ e λ e λ k=1 = λ P X = k, k = 0,1,.., = k=2 k(k 1) λ 2 e λ λ k 2 k k 1 k 2! + k=0 k λ λk e k! = λ 2 + λ The variance of poisson distribution = E{X 2 } [ E{x}] 2 = λ 2 + λ - λ 2 = λ Hence the mean and variance of poisson distribution is λ 7. Write any three properties of auto-correlation (3M) Sol. I. R xx (τ) = R xx (-τ) II. R xx (0)= E{X 2 (t)} III. X 2 = lim τ R xx (τ), if X(t) is a stationary process with no periodic component 8. Define Gaussian process (3M) Sol. A real valued random process X(t) is called a Gaussian process or normal process if the r random variables X(t 1 ), X(t 2 ), X(t 3 ),., X(t n ) at the n time instants t 1,t 2,., t n will have a n th order density function given by f x x 1, x 2,., x N ; t 1, t 2,, t N = exp { 1 2 [x X]t [C x ] 1 x X } (2π) N C x Where matrix[x X] t = [x X 1 x X 2.. x X N ] C 11 C 1N Co-Variance matrix [C x ] = is a N N matrix C N1 C NN
4 9.State any three properties of power spectral density function (2M) Sol. I. S xx (ω)=s xx (-ω) II.S xx (ω) = d2 dω 2 S xx (ω) III. S xx (ω) State Wiener-Khinchin thorem Sol. For a random process X(t) the power spectral density and auto correlation function will form a Fourier transform pair. S ω = R τ = 1 2π R τ e jωτ dτ S(ω)ejωτ dω (OR) The area of the power spectrum of any random process is positive. i.ee{x 2 t } = R 0 = 1 S ω dω 0 2π PART-B (50 M) 11. (a) Suppose box 1 contains a white balls and b black balls, and box 2 contain c white balls and b black balls. One ball of unknown color is transferred from the first box into the second one and then a ball is drawn from the later. What is the probability that it will be white ball. (5M) (Papoulis Example 2.14) Sol. Let us define the following events W={ transferred ball is white} B={transferred ball is black} We know that W U B = S P(W) = a a+b and P(B) = b a+b The event of interest A ={ white ball is drawn from the second box} The probability of A P A = P A W B = P{ A W A B } =P A W + P(A B) ( Using Axiom 3) = P(A W) P(W) + P(A B) P(B)
5 But P(A W) = c+1 c +d+1 and P(A B) = c Hence P A = a c+1 + a+b c+d+1 which is the required probability c+d+1 bc a+b c+d+1 = ac +bc +a a+b c+d+1 (b) Show that P A 1 A 2 A 3 A n = P A 1 + P A P A n P(A 1 A 2 A 3.. A n ) (5M) Sol. Consider two events A 1 and A 2 which can be represented on a venn Diagram From the venn diagram event A 1 = (A 1 A 2 ) U (A 1 A 2 ) andevent A 2 = (A 1 A 2 ) U (A 1 A 2 ) The events on the R.H.S of the above two are mutually exclusive. Hence by applying the probability on both the sides and by using axiom 3 P(A 1 )= P(A 1 A 2 ) + P(A 1 A 2 ) and P(A 2 ) = P(A 1 A 2 ) +P(A 1 A 2 ) Adding both of them we have P(A 1 )+P(A 2 )= P(A 1 A 2 ) + P(A 1 A 2 ) +P(A 1 A 2 ) +P(A 1 A 2 ) The first 3 terms on the R.H.S of above represents P(A 1 U A 2 ) Therefore P(A 1 )+P(A 2 )= P(A 1 U A 2 ) +P(A 1 A 2 ) Or P(A 1 U A 2 ) = P(A 1 )+P(A 2 )-P(A 1 A 2 ), which is the desired result and A 1 A 2 is the intersection of A 1 and A 2 The above proof can be extended to n events A 1,A 2,.,A n to obtain the desired result P A 1 A 2 A 3 A n = P A 1 + P A P A n P(A 1 A 2 A 3.. A n ) This is also called as addition theorem of probability 12.Three switches S 1,S 2,and S 3 connected in parallel operate independently and each switch remains closed with probability p. (10 M) ( Papoulis Example 2.21) (a) Find the probability of receiving an input signal at the output (b) Find the probability that the switch S 1 is open given that an input signal is received at the output. Sol. (a) Let A i = Switch S i is closed Then P(A i )=p, i=1,2,3 Since switches operate independently P(A 1 A 2 A 3 ) = P(A 1 ) P(A 2 ) P(A 3 ) The event R ={ Input signal is received at the output } Because the 3 switches S 1,S 2,and S 3 are connected in parallel R =A 1 U A 2 U A 3
6 P(R) = 1-P(R ) = 1-P(A 1 A 2 A 3 ) = 1-P(A 1 ) P(A 2 ) P(A 3 ) = 1-(1-p) 3 = 3p-3p 2 +p 3 (b) We have to determine P(A 1 R) From Baye s theorem P(A 1 R) = P R A 1 ) P(A 1 ) P(R) 13.Given f xy (x,y) = Cx(x-y), 0<x<2, y and 0 elsewhere, a)evaluate C, b) find f x (x) c) find f y/x (y/x) = 2p p2 (1 p) 3 3p+p 2 solution: For the given problem the limits are x < y <x, o< x<2 a) we know that f xy x, y dxdy = 1 x x 0 2 cx x y dxdy = 1 8c=1, c=1/8 b) we know that f x x = f xy x, y dy = 1 x x y dy y= x 8 c) f y x = f(x,y) f(x) = 1 2x 2 x = x 3 4, o < x < (a) If Y=X 2 where X is a Gausssian random variable with zero mean and variance σ 2, find the Pdf of the random variable Y. (b) If the continuous random variable X has pdf f x (x) = 2/9 (x+1), 1<x<2 and 0 elsewhere. Find the pdf of Y=X 2 Sol. (a) Given Y=g(X)= X 2 Define function y=g(x) =x 2, there are two solutions x 1 = y and x 2 = y dy dx = 2x dx dy = 1 2x = 1 2 y Therefore the density of Y f y (y) = dx dy [f x x 1 + f x x 2 ] f y (y) = 1 2 y [f x( y) +f x ( y)] (b)since f x (x) = 2/9 (x+1), 1<x<2 The density of Y f y (y) = f x (x) dx dy f y (y)= 2 9 x x = 1 9 (1 + 1 y )
7 15 (a) Show that the random X(t) = a cos(ω 0 +θ) is wide-sense stationary (WSS), if A and ω 0 are constants and θ is a uniformly distributed random variable in (0,2ᴨ) (5M) Sol. The density of θ f θ (θ) = 1 2π To prove X(t) as a WSS process we have to show that mean of X(t) is constant and Auto-correlation function (ACF) of X(t) must depend on difference in the time intervals 2π θ=0 Mean of X(t) E{X(t)} = X t f θ θ dθ = acos ω 0 t + θ 1 2π 0 By solving the above integral E{X(t)} = 0 2π dθ ACF of X(t),R xx (т) = E{X(t) X(t+т)} = E{acos ω 0 t + θ acos (ω 0 t + τ + θ)} 2π = a 2 cos ω 0 t + θ cos ω θ=0 0 t + τ + θ 1 dθ 2π By applying trigonometric identity and solving the above integral we will get R xx (т) = a 2 2 cos (ω 0τ). Since the mean is constant and ACF is dependent on the difference in the time intervals the given process X(t) is a WSS process. (b) Find the power spectral density (PSD) of a WSS process with auto correlation function (ACF) R(t) = a 2 e -2β t Sol. We know that the PSD and ACF form a fourier transform pair. Therefore the PSD S ω = R t e jωt dt = a 2 e 2β t e jωt dt The above integral can be splitted into two parts containing real and imaginary terms as following S ω = a 2 e 2β t cos ωt dt j a 2 e 2β t sin ωt dt The frirst integral is an even function i.e f(x) = f(-x) and second integral is a odd function i.e f(x) = -f(-x). Hence the second integral is equated to zero. S ω = 2 0 a 2 e 2βt cos ωt dt By solving the above integral using the following identity ʃe ax cos bx =e ax / a 2 +b 2 [ a cos bx +bsinbx] and subsituiting the limits o and The PSD of the given problem is given by S ω = 4a 2 β 4β 2 +ω 2
8 16. (a) If the power spectral density (PSD) of a WSS process is given by S ω = b a ω, ω a a = 0 ω a Find the auto correlation function (ACF) of the process. (5M) 2π Sol. The ACF of X(t) R τ = 1 S(ω) e jωτ dω = 1 b a ω 2π a ejωτ dω a The integral on the RHS can be splitted into real and imaginary parts as R τ = 1 a a b 2π a a ω cos ωτ dω + j 1 b a ω sin ωτ dω a 2π a a By applying the concept of even and odd functions the second integral will become zero. a R τ = 1.2 b 2π 0 a a a ω cos ωτ dω The integral on the RHS is simplified as b πa { a ω sin ωτ the imits 0 and a. By substituting the limits the ACF is given by b R τ = (1 cos aτ) πaτ2 τ cos ωτ τ 2 } between (b) Write short notes on (i) Thermal noise (ii) Filters (5M) Sol. (i) Thermal Noise : is the noise because of the random motion of electrons in conducting media such as a resistor. Thermal noise generated in resistors and semiconductors is assumed to be a Zero mean, stationary Gaussian random process {N(t)}with a PSD S NN (ɷ) that is flat over range of frequencies. Therefore Thermal noise is also called as White noise.psd S NN ω = N 0 2 (ii) Filters : Filters are used in electrical systems to reject undesirable signals and noise and to select the desired signal. Filtering actually means selecting carefully the transfer function H(ɷ) in a stable, linear, time-invariant system, so as to modify the spectral components of the input signal. The system function H(ɷ) is referred to as filter. The 4 types of filters are low-pass, high-pass, band-pass and band-stop filters. 17. Consider a white Gaussian noise of zero mean and power spectral density N 0 /2 applied to low-pass RC filter whose transfer function is H(f) = of the output random process. (10M) 1 1+j 2π f RC. Find the auto correlation Sol. Given a low-pass RC circuit with transfer function H(f). This is a liner time-invariant system. If X(t) and Y(t) are the input & output random process of the RC filter with PSDs S xx (ɷ) and S yy (ɷ) respectively.
9 The PSDs are defined by the following relation. S yy (ɷ)= H(ɷ) 2 S xx (ɷ) (1) For the given problem the transfer function is given in terms of frequency. Hence (1) can be written as S yy (f) = H(f) 2 S xx (f) (2) Given the applied input is having a PSD S xx (f) = N 0 /2, (2) can be written as the following S yy f = 1 N 0 1+4π 2 f 2 R 2 C 2 2 The autocorrelation function of the output random process Y(t) is given by R yy τ = S yy f e j2πfτ from 3 & 4 R yy τ = N 0 = (3) df(4) ( Where dɷ = 2π df) e j 2πτf 2 N 0 e j 2πτ f df 8π 2 R 2 C 2 1 ( 2πRC )2 + f 2 e jmx a 2 +x 2 1+4π 2 f 2 R 2 C 2 df By comparing the integral on the RHS of (6) with dx, which can be evaluated by contuour integration technique which results in the following. (5) (6) e jmx a 2 +x 2 dx = π a e m a (7) Using (7) in (6) with m = 2πτ and a = 1 2πRC R yy τ = 2πτ N 0 π 2π RC 8π 2 R 2 e 2πRC (8) C 2 Therefore the ACF of the output random process R yy τ = N 0 2 e τ /RC
for valid PSD. PART B (Answer all five units, 5 X 10 = 50 Marks) UNIT I
Code: 15A04304 R15 B.Tech II Year I Semester (R15) Regular Examinations November/December 016 PROBABILITY THEY & STOCHASTIC PROCESSES (Electronics and Communication Engineering) Time: 3 hours Max. Marks:
More informationStochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno
Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function.
More informationELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random
More information2. (a) What is gaussian random variable? Develop an equation for guassian distribution
Code No: R059210401 Set No. 1 II B.Tech I Semester Supplementary Examinations, February 2007 PROBABILITY THEORY AND STOCHASTIC PROCESS ( Common to Electronics & Communication Engineering, Electronics &
More informationEAS 305 Random Processes Viewgraph 1 of 10. Random Processes
EAS 305 Random Processes Viewgraph 1 of 10 Definitions: Random Processes A random process is a family of random variables indexed by a parameter t T, where T is called the index set λ i Experiment outcome
More information16.584: Random (Stochastic) Processes
1 16.584: Random (Stochastic) Processes X(t): X : RV : Continuous function of the independent variable t (time, space etc.) Random process : Collection of X(t, ζ) : Indexed on another independent variable
More informationFundamentals of Digital Commun. Ch. 4: Random Variables and Random Processes
Fundamentals of Digital Commun. Ch. 4: Random Variables and Random Processes Klaus Witrisal witrisal@tugraz.at Signal Processing and Speech Communication Laboratory www.spsc.tugraz.at Graz University of
More informationP 1.5 X 4.5 / X 2 and (iii) The smallest value of n for
DHANALAKSHMI COLLEGE OF ENEINEERING, CHENNAI DEPARTMENT OF ELECTRONICS AND COMMUNICATION ENGINEERING MA645 PROBABILITY AND RANDOM PROCESS UNIT I : RANDOM VARIABLES PART B (6 MARKS). A random variable X
More information3F1 Random Processes Examples Paper (for all 6 lectures)
3F Random Processes Examples Paper (for all 6 lectures). Three factories make the same electrical component. Factory A supplies half of the total number of components to the central depot, while factories
More informationCommunication Systems Lecture 21, 22. Dong In Kim School of Information & Comm. Eng. Sungkyunkwan University
Communication Systems Lecture 1, Dong In Kim School of Information & Comm. Eng. Sungkyunkwan University 1 Outline Linear Systems with WSS Inputs Noise White noise, Gaussian noise, White Gaussian noise
More informationChapter 5 Random Variables and Processes
Chapter 5 Random Variables and Processes Wireless Information Transmission System Lab. Institute of Communications Engineering National Sun Yat-sen University Table of Contents 5.1 Introduction 5. Probability
More informationE X A M. Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours. Number of pages incl.
E X A M Course code: Course name: Number of pages incl. front page: 6 MA430-G Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours Resources allowed: Notes: Pocket calculator,
More informationECE-340, Spring 2015 Review Questions
ECE-340, Spring 2015 Review Questions 1. Suppose that there are two categories of eggs: large eggs and small eggs, occurring with probabilities 0.7 and 0.3, respectively. For a large egg, the probabilities
More informationSRI VIDYA COLLEGE OF ENGINEERING AND TECHNOLOGY UNIT 3 RANDOM PROCESS TWO MARK QUESTIONS
UNIT 3 RANDOM PROCESS TWO MARK QUESTIONS 1. Define random process? The sample space composed of functions of time is called a random process. 2. Define Stationary process? If a random process is divided
More informationStochastic Processes
Elements of Lecture II Hamid R. Rabiee with thanks to Ali Jalali Overview Reading Assignment Chapter 9 of textbook Further Resources MIT Open Course Ware S. Karlin and H. M. Taylor, A First Course in Stochastic
More informationSpectral Analysis of Random Processes
Spectral Analysis of Random Processes Spectral Analysis of Random Processes Generally, all properties of a random process should be defined by averaging over the ensemble of realizations. Generally, all
More informationECE 450 Homework #3. 1. Given the joint density function f XY (x,y) = 0.5 1<x<2, 2<y< <x<4, 2<y<3 0 else
ECE 450 Homework #3 0. Consider the random variables X and Y, whose values are a function of the number showing when a single die is tossed, as show below: Exp. Outcome 1 3 4 5 6 X 3 3 4 4 Y 0 1 3 4 5
More informationProblem Sheet 1 Examples of Random Processes
RANDOM'PROCESSES'AND'TIME'SERIES'ANALYSIS.'PART'II:'RANDOM'PROCESSES' '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''Problem'Sheets' Problem Sheet 1 Examples of Random Processes 1. Give
More information7 The Waveform Channel
7 The Waveform Channel The waveform transmitted by the digital demodulator will be corrupted by the channel before it reaches the digital demodulator in the receiver. One important part of the channel
More informationMA6451 PROBABILITY AND RANDOM PROCESSES
MA6451 PROBABILITY AND RANDOM PROCESSES UNIT I RANDOM VARIABLES 1.1 Discrete and continuous random variables 1. Show that the function is a probability density function of a random variable X. (Apr/May
More informationName of the Student: Problems on Discrete & Continuous R.Vs
Engineering Mathematics 05 SUBJECT NAME : Probability & Random Process SUBJECT CODE : MA6 MATERIAL NAME : University Questions MATERIAL CODE : JM08AM004 REGULATION : R008 UPDATED ON : Nov-Dec 04 (Scan
More informationProblems on Discrete & Continuous R.Vs
013 SUBJECT NAME SUBJECT CODE MATERIAL NAME MATERIAL CODE : Probability & Random Process : MA 61 : University Questions : SKMA1004 Name of the Student: Branch: Unit I (Random Variables) Problems on Discrete
More informationFundamentals of Noise
Fundamentals of Noise V.Vasudevan, Department of Electrical Engineering, Indian Institute of Technology Madras Noise in resistors Random voltage fluctuations across a resistor Mean square value in a frequency
More informationECE Homework Set 3
ECE 450 1 Homework Set 3 0. Consider the random variables X and Y, whose values are a function of the number showing when a single die is tossed, as show below: Exp. Outcome 1 3 4 5 6 X 3 3 4 4 Y 0 1 3
More informationDefinition of a Stochastic Process
Definition of a Stochastic Process Balu Santhanam Dept. of E.C.E., University of New Mexico Fax: 505 277 8298 bsanthan@unm.edu August 26, 2018 Balu Santhanam (UNM) August 26, 2018 1 / 20 Overview 1 Stochastic
More information2A1H Time-Frequency Analysis II Bugs/queries to HT 2011 For hints and answers visit dwm/courses/2tf
Time-Frequency Analysis II (HT 20) 2AH 2AH Time-Frequency Analysis II Bugs/queries to david.murray@eng.ox.ac.uk HT 20 For hints and answers visit www.robots.ox.ac.uk/ dwm/courses/2tf David Murray. A periodic
More informationProbability and Statistics for Final Year Engineering Students
Probability and Statistics for Final Year Engineering Students By Yoni Nazarathy, Last Updated: May 24, 2011. Lecture 6p: Spectral Density, Passing Random Processes through LTI Systems, Filtering Terms
More informationName of the Student: Problems on Discrete & Continuous R.Vs
Engineering Mathematics 08 SUBJECT NAME : Probability & Random Processes SUBJECT CODE : MA645 MATERIAL NAME : University Questions REGULATION : R03 UPDATED ON : November 07 (Upto N/D 07 Q.P) (Scan the
More informationChapter 2. Random Variable. Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance.
Chapter 2 Random Variable CLO2 Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance. 1 1. Introduction In Chapter 1, we introduced the concept
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More informationUCSD ECE250 Handout #27 Prof. Young-Han Kim Friday, June 8, Practice Final Examination (Winter 2017)
UCSD ECE250 Handout #27 Prof. Young-Han Kim Friday, June 8, 208 Practice Final Examination (Winter 207) There are 6 problems, each problem with multiple parts. Your answer should be as clear and readable
More information2A1H Time-Frequency Analysis II
2AH Time-Frequency Analysis II Bugs/queries to david.murray@eng.ox.ac.uk HT 209 For any corrections see the course page DW Murray at www.robots.ox.ac.uk/ dwm/courses/2tf. (a) A signal g(t) with period
More informationEEM 409. Random Signals. Problem Set-2: (Power Spectral Density, LTI Systems with Random Inputs) Problem 1: Problem 2:
EEM 409 Random Signals Problem Set-2: (Power Spectral Density, LTI Systems with Random Inputs) Problem 1: Consider a random process of the form = + Problem 2: X(t) = b cos(2π t + ), where b is a constant,
More informationUCSD ECE250 Handout #24 Prof. Young-Han Kim Wednesday, June 6, Solutions to Exercise Set #7
UCSD ECE50 Handout #4 Prof Young-Han Kim Wednesday, June 6, 08 Solutions to Exercise Set #7 Polya s urn An urn initially has one red ball and one white ball Let X denote the name of the first ball drawn
More informationSignal Processing Signal and System Classifications. Chapter 13
Chapter 3 Signal Processing 3.. Signal and System Classifications In general, electrical signals can represent either current or voltage, and may be classified into two main categories: energy signals
More informationPart IA Probability. Theorems. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015
Part IA Probability Theorems Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationEE 4372 Tomography. Carlos E. Davila, Dept. of Electrical Engineering Southern Methodist University
EE 4372 Tomography Carlos E. Davila, Dept. of Electrical Engineering Southern Methodist University EE 4372, SMU Department of Electrical Engineering 86 Tomography: Background 1-D Fourier Transform: F(
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationLecture Notes 7 Stationary Random Processes. Strict-Sense and Wide-Sense Stationarity. Autocorrelation Function of a Stationary Process
Lecture Notes 7 Stationary Random Processes Strict-Sense and Wide-Sense Stationarity Autocorrelation Function of a Stationary Process Power Spectral Density Continuity and Integration of Random Processes
More informationName of the Student: Problems on Discrete & Continuous R.Vs
SUBJECT NAME : Probability & Random Processes SUBJECT CODE : MA645 MATERIAL NAME : Additional Problems MATERIAL CODE : JM08AM004 REGULATION : R03 UPDATED ON : March 05 (Scan the above QR code for the direct
More informationStochastic Processes. Chapter Definitions
Chapter 4 Stochastic Processes Clearly data assimilation schemes such as Optimal Interpolation are crucially dependent on the estimates of background and observation error statistics. Yet, we don t know
More informationFinal. Fall 2016 (Dec 16, 2016) Please copy and write the following statement:
ECE 30: Probabilistic Methods in Electrical and Computer Engineering Fall 06 Instructor: Prof. Stanley H. Chan Final Fall 06 (Dec 6, 06) Name: PUID: Please copy and write the following statement: I certify
More information13.42 READING 6: SPECTRUM OF A RANDOM PROCESS 1. STATIONARY AND ERGODIC RANDOM PROCESSES
13.42 READING 6: SPECTRUM OF A RANDOM PROCESS SPRING 24 c A. H. TECHET & M.S. TRIANTAFYLLOU 1. STATIONARY AND ERGODIC RANDOM PROCESSES Given the random process y(ζ, t) we assume that the expected value
More informationBasics on Probability. Jingrui He 09/11/2007
Basics on Probability Jingrui He 09/11/2007 Coin Flips You flip a coin Head with probability 0.5 You flip 100 coins How many heads would you expect Coin Flips cont. You flip a coin Head with probability
More informationECE 650 Lecture #10 (was Part 1 & 2) D. van Alphen. D. van Alphen 1
ECE 650 Lecture #10 (was Part 1 & 2) D. van Alphen D. van Alphen 1 Lecture 10 Overview Part 1 Review of Lecture 9 Continuing: Systems with Random Inputs More about Poisson RV s Intro. to Poisson Processes
More informationDeep Learning for Computer Vision
Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair
More information5.9 Power Spectral Density Gaussian Process 5.10 Noise 5.11 Narrowband Noise
Chapter 5 Random Variables and Processes Wireless Information Transmission System Lab. Institute of Communications Engineering g National Sun Yat-sen University Table of Contents 5.1 Introduction 5. Probability
More informationECE 636: Systems identification
ECE 636: Systems identification Lectures 3 4 Random variables/signals (continued) Random/stochastic vectors Random signals and linear systems Random signals in the frequency domain υ ε x S z + y Experimental
More informationIntroduction to Probability and Stochastic Processes I
Introduction to Probability and Stochastic Processes I Lecture 3 Henrik Vie Christensen vie@control.auc.dk Department of Control Engineering Institute of Electronic Systems Aalborg University Denmark Slides
More informationRandom Signals and Systems. Chapter 3. Jitendra K Tugnait. Department of Electrical & Computer Engineering. Auburn University.
Random Signals and Systems Chapter 3 Jitendra K Tugnait Professor Department of Electrical & Computer Engineering Auburn University Two Random Variables Previously, we only dealt with one random variable
More informationReview: mostly probability and some statistics
Review: mostly probability and some statistics C2 1 Content robability (should know already) Axioms and properties Conditional probability and independence Law of Total probability and Bayes theorem Random
More informationName of the Student: Problems on Discrete & Continuous R.Vs
Engineering Mathematics 03 SUBJECT NAME : Probability & Random Process SUBJECT CODE : MA 6 MATERIAL NAME : Problem Material MATERIAL CODE : JM08AM008 (Scan the above QR code for the direct download of
More information13. Power Spectrum. For a deterministic signal x(t), the spectrum is well defined: If represents its Fourier transform, i.e., if.
For a deterministic signal x(t), the spectrum is well defined: If represents its Fourier transform, i.e., if jt X ( ) = xte ( ) dt, (3-) then X ( ) represents its energy spectrum. his follows from Parseval
More informationFig 1: Stationary and Non Stationary Time Series
Module 23 Independence and Stationarity Objective: To introduce the concepts of Statistical Independence, Stationarity and its types w.r.to random processes. This module also presents the concept of Ergodicity.
More informationEE4601 Communication Systems
EE4601 Communication Systems Week 2 Review of Probability, Important Distributions 0 c 2011, Georgia Institute of Technology (lect2 1) Conditional Probability Consider a sample space that consists of two
More informationECE6604 PERSONAL & MOBILE COMMUNICATIONS. Week 3. Flat Fading Channels Envelope Distribution Autocorrelation of a Random Process
1 ECE6604 PERSONAL & MOBILE COMMUNICATIONS Week 3 Flat Fading Channels Envelope Distribution Autocorrelation of a Random Process 2 Multipath-Fading Mechanism local scatterers mobile subscriber base station
More informationSummary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016
8. For any two events E and F, P (E) = P (E F ) + P (E F c ). Summary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016 Sample space. A sample space consists of a underlying
More informationA6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2011
A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2011 Reading Chapter 5 (continued) Lecture 8 Key points in probability CLT CLT examples Prior vs Likelihood Box & Tiao
More informationFINAL EXAM: 3:30-5:30pm
ECE 30: Probabilistic Methods in Electrical and Computer Engineering Spring 016 Instructor: Prof. A. R. Reibman FINAL EXAM: 3:30-5:30pm Spring 016, MWF 1:30-1:0pm (May 6, 016) This is a closed book exam.
More informationContinuous Random Variables
1 / 24 Continuous Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay February 27, 2013 2 / 24 Continuous Random Variables
More informationWhy study probability? Set theory. ECE 6010 Lecture 1 Introduction; Review of Random Variables
ECE 6010 Lecture 1 Introduction; Review of Random Variables Readings from G&S: Chapter 1. Section 2.1, Section 2.3, Section 2.4, Section 3.1, Section 3.2, Section 3.5, Section 4.1, Section 4.2, Section
More informationQuestion Paper Code : AEC11T03
Hall Ticket No Question Paper Code : AEC11T03 VARDHAMAN COLLEGE OF ENGINEERING (AUTONOMOUS) Affiliated to JNTUH, Hyderabad Four Year B Tech III Semester Tutorial Question Bank 2013-14 (Regulations: VCE-R11)
More informationVALLIAMMAI ENGINEERING COLLEGE SRM Nagar, Kattankulathur 603 203. DEPARTMENT OF ELECTRONICS & COMMUNICATION ENGINEERING SUBJECT QUESTION BANK : MA6451 PROBABILITY AND RANDOM PROCESSES SEM / YEAR:IV / II
More informationEE4601 Communication Systems
EE4601 Communication Systems Week 4 Ergodic Random Processes, Power Spectrum Linear Systems 0 c 2011, Georgia Institute of Technology (lect4 1) Ergodic Random Processes An ergodic random process is one
More informationUCSD ECE 153 Handout #46 Prof. Young-Han Kim Thursday, June 5, Solutions to Homework Set #8 (Prepared by TA Fatemeh Arbabjolfaei)
UCSD ECE 53 Handout #46 Prof. Young-Han Kim Thursday, June 5, 04 Solutions to Homework Set #8 (Prepared by TA Fatemeh Arbabjolfaei). Discrete-time Wiener process. Let Z n, n 0 be a discrete time white
More informationRandom signals II. ÚPGM FIT VUT Brno,
Random signals II. Jan Černocký ÚPGM FIT VUT Brno, cernocky@fit.vutbr.cz 1 Temporal estimate of autocorrelation coefficients for ergodic discrete-time random process. ˆR[k] = 1 N N 1 n=0 x[n]x[n + k],
More informationChapter 6. Random Processes
Chapter 6 Random Processes Random Process A random process is a time-varying function that assigns the outcome of a random experiment to each time instant: X(t). For a fixed (sample path): a random process
More informationChapter 2 Random Processes
Chapter 2 Random Processes 21 Introduction We saw in Section 111 on page 10 that many systems are best studied using the concept of random variables where the outcome of a random experiment was associated
More informationELEMENTS OF PROBABILITY THEORY
ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable
More informationIntroduction to Information Entropy Adapted from Papoulis (1991)
Introduction to Information Entropy Adapted from Papoulis (1991) Federico Lombardo Papoulis, A., Probability, Random Variables and Stochastic Processes, 3rd edition, McGraw ill, 1991. 1 1. INTRODUCTION
More informationLQR, Kalman Filter, and LQG. Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin
LQR, Kalman Filter, and LQG Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin May 2015 Linear Quadratic Regulator (LQR) Consider a linear system
More informationRandom Variables. P(x) = P[X(e)] = P(e). (1)
Random Variables Random variable (discrete or continuous) is used to derive the output statistical properties of a system whose input is a random variable or random in nature. Definition Consider an experiment
More information7.7 The Schottky Formula for Shot Noise
110CHAPTER 7. THE WIENER-KHINCHIN THEOREM AND APPLICATIONS 7.7 The Schottky Formula for Shot Noise On p. 51, we found that if one averages τ seconds of steady electron flow of constant current then the
More informationChapter 2. Probability
2-1 Chapter 2 Probability 2-2 Section 2.1: Basic Ideas Definition: An experiment is a process that results in an outcome that cannot be predicted in advance with certainty. Examples: rolling a die tossing
More informationwhere r n = dn+1 x(t)
Random Variables Overview Probability Random variables Transforms of pdfs Moments and cumulants Useful distributions Random vectors Linear transformations of random vectors The multivariate normal distribution
More informationStochastic Process II Dr.-Ing. Sudchai Boonto
Dr-Ing Sudchai Boonto Department of Control System and Instrumentation Engineering King Mongkuts Unniversity of Technology Thonburi Thailand Random process Consider a random experiment specified by the
More informationChapter 3: Random Variables 1
Chapter 3: Random Variables 1 Yunghsiang S. Han Graduate Institute of Communication Engineering, National Taipei University Taiwan E-mail: yshan@mail.ntpu.edu.tw 1 Modified from the lecture notes by Prof.
More informationGaussian Basics Random Processes Filtering of Random Processes Signal Space Concepts
White Gaussian Noise I Definition: A (real-valued) random process X t is called white Gaussian Noise if I X t is Gaussian for each time instance t I Mean: m X (t) =0 for all t I Autocorrelation function:
More informationA Probability Primer. A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes.
A Probability Primer A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes. Are you holding all the cards?? Random Events A random event, E,
More informationSignals and Spectra - Review
Signals and Spectra - Review SIGNALS DETERMINISTIC No uncertainty w.r.t. the value of a signal at any time Modeled by mathematical epressions RANDOM some degree of uncertainty before the signal occurs
More information2. A die is rolled 3 times, the probability of getting a number larger than the previous number each time is
. If P(A) = x, P = 2x, P(A B) = 2, P ( A B) = 2 3, then the value of x is (A) 5 8 5 36 6 36 36 2. A die is rolled 3 times, the probability of getting a number larger than the previous number each time
More informationAppendix A PROBABILITY AND RANDOM SIGNALS. A.1 Probability
Appendi A PROBABILITY AND RANDOM SIGNALS Deterministic waveforms are waveforms which can be epressed, at least in principle, as an eplicit function of time. At any time t = t, there is no uncertainty about
More informationENSC327 Communications Systems 19: Random Processes. Jie Liang School of Engineering Science Simon Fraser University
ENSC327 Communications Systems 19: Random Processes Jie Liang School of Engineering Science Simon Fraser University 1 Outline Random processes Stationary random processes Autocorrelation of random processes
More informationELEG 3143 Probability & Stochastic Process Ch. 4 Multiple Random Variables
Department o Electrical Engineering University o Arkansas ELEG 3143 Probability & Stochastic Process Ch. 4 Multiple Random Variables Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Two discrete random variables
More informationChapter 3, 4 Random Variables ENCS Probability and Stochastic Processes. Concordia University
Chapter 3, 4 Random Variables ENCS6161 - Probability and Stochastic Processes Concordia University ENCS6161 p.1/47 The Notion of a Random Variable A random variable X is a function that assigns a real
More informationA Probability Review
A Probability Review Outline: A probability review Shorthand notation: RV stands for random variable EE 527, Detection and Estimation Theory, # 0b 1 A Probability Review Reading: Go over handouts 2 5 in
More informationRandom Variables. Random variables. A numerically valued map X of an outcome ω from a sample space Ω to the real line R
In probabilistic models, a random variable is a variable whose possible values are numerical outcomes of a random phenomenon. As a function or a map, it maps from an element (or an outcome) of a sample
More informationIntroduction to Probability and Stocastic Processes - Part I
Introduction to Probability and Stocastic Processes - Part I Lecture 1 Henrik Vie Christensen vie@control.auc.dk Department of Control Engineering Institute of Electronic Systems Aalborg University Denmark
More informationLecture Notes 3 Multiple Random Variables. Joint, Marginal, and Conditional pmfs. Bayes Rule and Independence for pmfs
Lecture Notes 3 Multiple Random Variables Joint, Marginal, and Conditional pmfs Bayes Rule and Independence for pmfs Joint, Marginal, and Conditional pdfs Bayes Rule and Independence for pdfs Functions
More informationLecture 7 Random Signal Analysis
Lecture 7 Random Signal Analysis 7. Introduction to Probability 7. Amplitude Distributions 7.3 Uniform, Gaussian, and Other Distributions 7.4 Power and Power Density Spectra 7.5 Properties of the Power
More information= 4. e t/a dt (2) = 4ae t/a. = 4a a = 1 4. (4) + a 2 e +j2πft 2
ECE 341: Probability and Random Processes for Engineers, Spring 2012 Homework 13 - Last homework Name: Assigned: 04.18.2012 Due: 04.25.2012 Problem 1. Let X(t) be the input to a linear time-invariant filter.
More informationFACULTY OF ENGINEERING AND ARCHITECTURE. MATH 256 Probability and Random Processes. 04 Multiple Random Variables
OKAN UNIVERSITY FACULTY OF ENGINEERING AND ARCHITECTURE MATH 256 Probability and Random Processes 04 Multiple Random Variables Fall 2012 Yrd. Doç. Dr. Didem Kivanc Tureli didem@ieee.org didem.ivanc@oan.edu.tr
More informationReview of Probabilities and Basic Statistics
Alex Smola Barnabas Poczos TA: Ina Fiterau 4 th year PhD student MLD Review of Probabilities and Basic Statistics 10-701 Recitations 1/25/2013 Recitation 1: Statistics Intro 1 Overview Introduction to
More informationModule 4. Signal Representation and Baseband Processing. Version 2 ECE IIT, Kharagpur
Module Signal Representation and Baseband Processing Version ECE II, Kharagpur Lesson 8 Response of Linear System to Random Processes Version ECE II, Kharagpur After reading this lesson, you will learn
More informationGATE EE Topic wise Questions SIGNALS & SYSTEMS
www.gatehelp.com GATE EE Topic wise Questions YEAR 010 ONE MARK Question. 1 For the system /( s + 1), the approximate time taken for a step response to reach 98% of the final value is (A) 1 s (B) s (C)
More informationProf. Dr.-Ing. Armin Dekorsy Department of Communications Engineering. Stochastic Processes and Linear Algebra Recap Slides
Prof. Dr.-Ing. Armin Dekorsy Department of Communications Engineering Stochastic Processes and Linear Algebra Recap Slides Stochastic processes and variables XX tt 0 = XX xx nn (tt) xx 2 (tt) XX tt XX
More informationFourier Series. Spectral Analysis of Periodic Signals
Fourier Series. Spectral Analysis of Periodic Signals he response of continuous-time linear invariant systems to the complex exponential with unitary magnitude response of a continuous-time LI system at
More informationHomework 3 (Stochastic Processes)
In the name of GOD. Sharif University of Technology Stochastic Processes CE 695 Dr. H.R. Rabiee Homework 3 (Stochastic Processes). Explain why each of the following is NOT a valid autocorrrelation function:
More informationRandom Processes Handout IV
RP-IV.1 Random Processes Handout IV CALCULATION OF MEAN AND AUTOCORRELATION FUNCTIONS FOR WSS RPS IN LTI SYSTEMS In the last classes, we calculated R Y (τ) using an intermediate function f(τ) (h h)(τ)
More information