Lecture 7 Random Signal Analysis
|
|
- Myra Harmon
- 5 years ago
- Views:
Transcription
1 Lecture 7 Random Signal Analysis 7. Introduction to Probability 7. Amplitude Distributions 7.3 Uniform, Gaussian, and Other Distributions 7.4 Power and Power Density Spectra 7.5 Properties of the Power Spectrum 7.6 Power Spectral Estimation 7.7 Data Windows in Spectral Estimation 7.8 The Cross-Power Spectrum 7.9 Algorithms 7. Exercises Note: For this chapter, the material in the text book is not enough. Please refer to the chapter 3 of the reference [] or the attached chapter, from Kay, 6.
2 Random Signals In the first part of the course we discussed the deterministic signals, which are precisely determined by the signal models (functions). The future values of a deterministic signal can be predicted exactly from its past values. In practice, most measurements are random, evolving in an unpredictable manner. A signal is called random signal if its values cannot be predicted exactly from its past values. The study of random signals needs background in probability and statistics. X S ζ ζ ζ ζ ζ t X(t,ζ ) X(t,ζ ) X(t,ζ 3 ) X(t,ζ 4 ) t X(t,ζ 5 )
3 (a) Waveform of F-6 noise (b) Histogram and theoretical probability density function.
4 . Basics of Probability Probability: describe the uncertainty outcome of an event. Intuitively, probabilities are numbers assigned to events that indicate how likely it is that the event will occur when a random experiment is performed. For example: P (fever is brought by cold) =.6. A performance of the experiment is called an experiment (or a trial). The sample space S is the set corresponds to all possible outcomes of a trial. Particular subsets of S are called events. The probability law for a random experiment is the rule that assigns probabilities to the events in the trial.
5 Examples (from reference []) Two dice are cast and the total number of spots on the sides that are up are counted. The sample space is S={, 3, 4, 5, 6, 7, 8, 9,,, } and contains a finite number of outcomes. A fair coin is flipped successively at random until the first head is observed. If we let ζ denote the number of flips of the coin required, then the sample space is S = {,, 3,... }, which consists of an infinite, but countable, number of outcomes. In general, if an event A occurs N(A) times in N trials of an experiment, the relative frequency of the event is given by f N( A) N( A) Number of occurrence of event N = Total number of trivials A
6 . Probability axioms Probability axioms Given a finite sample space S and an event A in S. We define P( A) is the probability of A, then, a. P( A) for each event A in S. b. P( S ) =. c. P( A B) P( A) P( B) + = + if A and Bare mutually exclusive events in S.
7 . More properties on probability Joint probability : If A and B are random variables, then the joint probability function, ( ) P( ab, ) = P A= ab, = b Conditional probability : the probability of A conditioned onb is defined as, PAB ( ) = P( AB, ) P( B) Product rule: from the definition of conditional probability, the product rule is (, ) = ( ) ( ) = ( ) ( ) P A B P A B P B P B A P A Chain rule: the chain rule is an extension of the product rule which we can write down in more generic form as: (,,, ) = (,, ) (,, ) ( ) ( ) P a a a P a a a P a a a P a a P a n n 3 n n n n
8 .3 Bayes Rule Bayes rule is an alternative method to calculate the conditional probability if the joint probability P( AB, ) is unknown. Bayes rule is, ( ) P A B ( ) ( ) P BA P A = P B ( )
9 .4 Cumulative Distribution Function In probability and statistics, a random variable is, a variable whose value results from a measurement. A random variable can be defined by its cumulative distribution function F ( ) is the probability that a realization of x be smaller than or equal to x: FX ( x) = P( X x) a or, FX ( a) = P( x a) = px ( x) dx As a consequence, if x is a real variable, it has, F X (+ ) =, F X (- ) =. X x, which
10 .5 Probability Density Function A random variable is fully defined by its probability density or probability distribution function (pdf). A random variable x has a probability density p (x) if the probability that a realization y of the random variable x lies in an interval [x, x+dx] is equal to p(x) dx. The probability density is the derivative of the cumulative distribution function, a ( ) ( ) ( ) FX a = P x a = px x dx p X + ( x) = F X ( x) dx ( ) = p x dx
11 Probability Function p(x) and Distribution Function F(x) Discrete Random Variable F X (x).6.4 P X (x) x x Continuous Random Variable 8 x -4 6 p(x) x
12 . Statistical Properties of Signals Two kinds of properties describe: How a signal s amplitude is distributed. How a signal s spectral content is distributed. All signals can be described in terms of statistical properties. Random signals can be described only in terms of statistical propertied. Any signal is stationary if its statistical properties (amplitude and frequency distribution) do not change with time.
13 Continuous and Discrete Amplitude Distributions x k and x(t) T=; Integer samples k Continuous: p( x); p( x) dx= P = Pr x= n ; P = Discrete: { } n n= n
14 fn #samples equal to n = P N Frequency Function n Frequency distribution of [ x n ] on previous slide: x=[-3,,,,3,,-,-,3,5,4,3,3,,-3,-,,-,-4,-,,,-3,-3,-,-, -,-,-4,-,,,-,,,-,-3,-,-3,-5,-4,-,,,-,-5,-3,,,, -,-,-3,,,,-,-3,-,,,3,,,,-,-5,-3,,,-5,-,5,5,-, -,,,,,-,,4,4,,,,,,,4,3,-,-,,,-,-3,,3,]. Amplitude distribution of x; N= f(x) x
15 Functions Used to Display f n = #samples equal to N n stem(-5:5,f) was used to make the plot in the previous slide. hist(y,x) plots a histogram of y with bins centered over x. bar(x,f) plots a bar chart of f with bars centered over x. hist example. bar example # occurrences of y 5 5 f(x) x x
16 Mean, Variance, and Standard Deviation Mean value of any function of x, including x itself: Continuous: E[ y] = y( x) p( x) dx; [ ] ( ) = = Discrete: E[ y] = y( x ) P ; μ E[ x] n= Variance of x: = E ( x ) = E x σ μ μ x x x n n μ x E x xp x dx = = x P x n n n= The standard deviation, σ x, is the standard measure of the average deviation of x from its mean value, μ. Properties of μ and σ : μ ax + b = aμ x + b σ a σ ax+ b = x x
17 Properties of a Uniform Random Function p(x) Continuous P n Discrete /(b-a) /N a b x a b n b+ a μx = b a σ x = ( )
18 Properties of a Normal Random Function p(x) Continuous. P n Discrete.4/σ./σ. μ-σ μμ+σ x n px ( ) = N( μσ, ) = e σ π ( x μ ) σ Matlab function erf computes x y erf ( x) = e dy π
19 Gaussian Probability Computation It is usually easier to use function erfx: y=erfx(mu,sigma,x) erfx is the probability that a normally distributed random variate with mean mu and standard deviation sigma lies in the range {mu,mu+x}. Amplitude distribution -bit A-D converter: Pr=erfx(,6,5)= x -4 6 p(x) x
20 Matlab Vectors with Random Elements Vector length = N; Mean = ; Standard deviation = s. Uniform: x=s*sqrt()*(rand(,n)-.5); Normal: x=s*randn(,n) Examples; N =,; μ =.8 Uniform; σ=4.33. Gaussian; σ=..6.5 f n f n n n
21 More Examples of Amplitude Distributions 5 x=7.5sin4πt Grey-scale image x(t) -5 t..5 f n. f n n n
22 3. Power and Power Density Suppose x is the sample vector of a long stationary waveform. The average power in x is where X is the DFT of x. E x = x = X N N n n m N n= N m= The relationship the periodogram, N N xn = Xm is known as Parseval s theorem. It proves that n= N m= Pxx( m) X N m =, is a measure of the power density of x.
23 Periodogram of a Periodic Signal x = Pxx( m) =.93 N N N n n= N m= in this example. x(t), x n Time index (n) P m Frequency index (m)
24 Power Density Spectrum P(ν) Frequency ν (Hz-s).5 P( ν). Average power = dν =.93.5 If power density is plotted versus Hz instead of Hz-s, then the frequency axis is scaled by /T, and so P must be scaled by T in order to preserve the correct average power (integral). Similar changes with other frequency measures.
25 Scales change depending on units. Power Density Spectrum (Cont.) Power per Hz-s x -6 Power per Hz P(ν) Frequency ν (Hz-s) P(f) Frequency f (Hz) 5 x 5 Total power in both plots:.5 f / s P( ν) dν = P( f) df = f / If power density is plotted versus Hz instead of Hz-s, then the frequency axis is scaled by /T, and so P must be scaled by T in order to preserve the correct average power (integral). Similar changes are necessary with other frequency measures. s
26 Properties of the Power Spectrum The periodogram is the DFT of the autocorrelation function. Given a sample vector, x, { } DFT ϕ ( k) = P ( m); m =,,..., N xx xx Thus, the autocorrelation function and the power spectrum convey the same information about a signal in different forms. The amplitude distribution conveys a different kind of information about the signal.
27 Examples of Autocorrelation Functions and Power Spectra Sinusoidal waveform White Gaussian waveform x(t) x(t) x -3 t - 5. t φ xx (k) φ xx (k) P(ν) P(ν) k ν
28 Estimating the Power Spectrum Suppose xt () is a stationary random signal, x is a sample vector of length N, and P xx is the periodogram of x. Since xx N independent components, increasing N increases the detail in the estimated power spectrum but does not decrease the variance of the estimate. P has / The next slide illustrates how the variance of the estimated power spectrum may be reduced by averaging periodograms of different segments of xt ()
29 White Gaussian Signal Avg. Power = v /Hz-s Single periodograms are useless, but the avg. of 8 disjoint periodograms (blue plot) is quite accurate. P(ν); N= 6 P(ν); N= 9 Avg. P(ν) 5 5 Power density (v /Hz-s) ν (Hz-s)
30 (red) Complete sampled waveform; N = 4. (blue) Partitioned into two disjoint segments; N = 5. (green) Partitioned into five overlapping segments; N = 5. x k x k x k x k x k x 3k x 4k x 5k k
31 Rules for Estimating Power Spectra. Decide on the largest acceptable frequency resolution, Δ f Hz.. The corresponding segment length, N = / Δ ft = / Δ ν, should be << the overall length of the signal sample vector. 3. Use overlapping segments in the periodogram average. The more overlap, the better the estimate. You may use function [P,nsgmts,v]=pds(x,N,windo,overlap) to implement periodogram averaging with overlapping segments. Enter help pds to see how to use the function. An example illustrating the use of pds is shown next
32 Examples of the Use of Overlapping Segments White Gaussian noise x = N(,) Bandpass filter y 4 samples of signal y are generated by passing a white Gaussian random signal through a bandpass filter. Thus, theoretically, the power spectrum of y is P = H j, ( ) ( ) y ν πν where H( j πν ) is the amplitude gain of the bandpass filter. On the next slide, the theoretical spectrum is the blue plot. The segment size is constant at n = 64.
33 Examples of the Use of Overlapping Segments Overlap=%; Ns=6.6 Overlap=5%; Ns=3 Overlap=95%; Ns= Power density, P y (ν) ν (Hz-s).5 ν (Hz-s).5 ν (Hz-s)
34 Increasing the Accuracy of the Estimate by Decreasing the Segment Size (N) (Signal length K = 4; Overlap = 95%) N=64 N=3 N=6 Power density, P y (ν).5.5 Power density, P y (ν).5.5 Power density, P y (ν) ν (Hz-s).5 ν (Hz-s).5 ν (Hz-s)
35 Using Data Windows to Improve Spectral Estimates These data windows are available when in pds and pds:.5 Boxcar 3.5 Tapered 3 w k.5 Hanning 3 w k.5 Hamming 3.5 Blackman 3.5 Tent 3
36 Examples of the Use of Data Windows ( K = 496 ; N = 64, 95% overlap) Rectangular window Hanning window Blackman window Power density, P y (ν) ν (Hz-s).5 ν (Hz-s).5 ν (Hz-s)
37 The Cross-Power Spectrum The cross-power spectrum of two signals is similar to the power spectrum. It is given in terms of the cross-periodogram, Pxy ( m) = X ;,,..., mym m N N = As before, P xy is the DFT of the correlation vector, that is, DFT { xy} ϕ = P xy Furthermore, just as ϕ () = E x is the avg. power in x, xx k is the average cross-power in x and y. N ϕxy () = Pxy ( m) N m=
38 The Cross-Power Spectrum (Cont.) Sometimes the real part of P xy provides the distribution of physical power, as when x is voltage and y is current, or when x is force and y is speed. For example, when x and y are sinusoidal and in phase, like Asinω t and Bsinω t, P xy is real and represents real physical power. When x and y are sinusoidal and out of phase, like Asinω t and Bcosω t, P xy is imaginary. The cross-power spectrum is also useful in the coherence function, which we examine next.
39 Magnitude-Squared Coherence (Msc) The MSC function is a normalized version of xy P : P ( ) xy ν Γ xy ( ν ) = P ( ν ) P ( ν ) Sometimes it is uses to decide whether detectors are receiving the same signal ( ) s, as in the following situation: xx yy noise (n ) source (s) H (v) + x H (v) + y noise (n )
40 Magnitude-Squared Coherence (Cont.) If n and n are independent, an MSC value, Γ xy ( ν ), close to indicates signal power from the same source arriving at detectors x and y at frequency ν. Furthermore, if the MSC is close to at all frequencies, then the cross-power spectrum magnitude, P xy, may be used as a scaled measure of source power density. An example is given on the next slide (text p. 93) in which H ( z ) = and ( ) d H z = z, that is, the source is simply delayed on one channel relative to the other. The signal-to-noise ratio (SNR) in the example is souce power SNR = =.3 noise power
41 Power Spectra Based On 5 Samples 35 P ss (ν) 35 P xx (ν) 35 P yy (ν) 35 P xy (ν) Power density ν (Hz-s).5 ν (Hz-s).5 ν (Hz-s).5 ν (Hz-s)
42 Matlab Functions [f, xmin, xmax] = freq(x) computes the amplitude distribution of an integer vector or array (x). [P,nsgmts,v]=pds(x,N,windo,overlap) computes the power density spectrum of x in v = [,.5]. N is the segment size, windo designates the data window, and overlap is in the range (,). [P, nsgmnts,v] = pds(x, y, N, windo, overlap) computes the cross-pds of x and y in v = [,.5]. N, windo, and overlap are as above. hist(x,b) plots a histogram of x with bins centered at elements of b. stem(x,y) is like plot(x,y), with vertical stems. bar(v, P, color) same as Matlab function bar, except the bars touch each other, as on the previous slide.
43 Exercises
Basics on Probability. Jingrui He 09/11/2007
Basics on Probability Jingrui He 09/11/2007 Coin Flips You flip a coin Head with probability 0.5 You flip 100 coins How many heads would you expect Coin Flips cont. You flip a coin Head with probability
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationPreliminary statistics
1 Preliminary statistics The solution of a geophysical inverse problem can be obtained by a combination of information from observed data, the theoretical relation between data and earth parameters (models),
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More information1 Probability and Random Variables
1 Probability and Random Variables The models that you have seen thus far are deterministic models. For any time t, there is a unique solution X(t). On the other hand, stochastic models will result in
More informationOrigins of Probability Theory
1 16.584: INTRODUCTION Theory and Tools of Probability required to analyze and design systems subject to uncertain outcomes/unpredictability/randomness. Such systems more generally referred to as Experiments.
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More informationL2: Review of probability and statistics
Probability L2: Review of probability and statistics Definition of probability Axioms and properties Conditional probability Bayes theorem Random variables Definition of a random variable Cumulative distribution
More informationChapter 2. Probability
2-1 Chapter 2 Probability 2-2 Section 2.1: Basic Ideas Definition: An experiment is a process that results in an outcome that cannot be predicted in advance with certainty. Examples: rolling a die tossing
More information1 Random variables and distributions
Random variables and distributions In this chapter we consider real valued functions, called random variables, defined on the sample space. X : S R X The set of possible values of X is denoted by the set
More informationWhy study probability? Set theory. ECE 6010 Lecture 1 Introduction; Review of Random Variables
ECE 6010 Lecture 1 Introduction; Review of Random Variables Readings from G&S: Chapter 1. Section 2.1, Section 2.3, Section 2.4, Section 3.1, Section 3.2, Section 3.5, Section 4.1, Section 4.2, Section
More informationSingle Maths B: Introduction to Probability
Single Maths B: Introduction to Probability Overview Lecturer Email Office Homework Webpage Dr Jonathan Cumming j.a.cumming@durham.ac.uk CM233 None! http://maths.dur.ac.uk/stats/people/jac/singleb/ 1 Introduction
More information1 Random Variable: Topics
Note: Handouts DO NOT replace the book. In most cases, they only provide a guideline on topics and an intuitive feel. 1 Random Variable: Topics Chap 2, 2.1-2.4 and Chap 3, 3.1-3.3 What is a random variable?
More informationCS 361: Probability & Statistics
February 12, 2018 CS 361: Probability & Statistics Random Variables Monty hall problem Recall the setup, there are 3 doors, behind two of them are indistinguishable goats, behind one is a car. You pick
More informationDiscrete Random Variables
CPSC 53 Systems Modeling and Simulation Discrete Random Variables Dr. Anirban Mahanti Department of Computer Science University of Calgary mahanti@cpsc.ucalgary.ca Random Variables A random variable is
More informationProbability theory for Networks (Part 1) CS 249B: Science of Networks Week 02: Monday, 02/04/08 Daniel Bilar Wellesley College Spring 2008
Probability theory for Networks (Part 1) CS 249B: Science of Networks Week 02: Monday, 02/04/08 Daniel Bilar Wellesley College Spring 2008 1 Review We saw some basic metrics that helped us characterize
More informationG.PULLAIAH COLLEGE OF ENGINEERING & TECHNOLOGY DEPARTMENT OF ELECTRONICS & COMMUNICATION ENGINEERING PROBABILITY THEORY & STOCHASTIC PROCESSES
G.PULLAIAH COLLEGE OF ENGINEERING & TECHNOLOGY DEPARTMENT OF ELECTRONICS & COMMUNICATION ENGINEERING PROBABILITY THEORY & STOCHASTIC PROCESSES LECTURE NOTES ON PTSP (15A04304) B.TECH ECE II YEAR I SEMESTER
More informationDept. of Linguistics, Indiana University Fall 2015
L645 Dept. of Linguistics, Indiana University Fall 2015 1 / 34 To start out the course, we need to know something about statistics and This is only an introduction; for a fuller understanding, you would
More informationwhere r n = dn+1 x(t)
Random Variables Overview Probability Random variables Transforms of pdfs Moments and cumulants Useful distributions Random vectors Linear transformations of random vectors The multivariate normal distribution
More informationCentre for Mathematical Sciences HT 2017 Mathematical Statistics
Lund University Stationary stochastic processes Centre for Mathematical Sciences HT 2017 Mathematical Statistics Computer exercise 3 in Stationary stochastic processes, HT 17. The purpose of this exercise
More informationAlgorithms for Uncertainty Quantification
Algorithms for Uncertainty Quantification Tobias Neckel, Ionuț-Gabriel Farcaș Lehrstuhl Informatik V Summer Semester 2017 Lecture 2: Repetition of probability theory and statistics Example: coin flip Example
More informationfor valid PSD. PART B (Answer all five units, 5 X 10 = 50 Marks) UNIT I
Code: 15A04304 R15 B.Tech II Year I Semester (R15) Regular Examinations November/December 016 PROBABILITY THEY & STOCHASTIC PROCESSES (Electronics and Communication Engineering) Time: 3 hours Max. Marks:
More information3.0 PROBABILITY, RANDOM VARIABLES AND RANDOM PROCESSES
3.0 PROBABILITY, RANDOM VARIABLES AND RANDOM PROCESSES 3.1 Introduction In this chapter we will review the concepts of probabilit, rom variables rom processes. We begin b reviewing some of the definitions
More informationENSC327 Communications Systems 19: Random Processes. Jie Liang School of Engineering Science Simon Fraser University
ENSC327 Communications Systems 19: Random Processes Jie Liang School of Engineering Science Simon Fraser University 1 Outline Random processes Stationary random processes Autocorrelation of random processes
More informationReview (probability, linear algebra) CE-717 : Machine Learning Sharif University of Technology
Review (probability, linear algebra) CE-717 : Machine Learning Sharif University of Technology M. Soleymani Fall 2012 Some slides have been adopted from Prof. H.R. Rabiee s and also Prof. R. Gutierrez-Osuna
More informationE X A M. Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours. Number of pages incl.
E X A M Course code: Course name: Number of pages incl. front page: 6 MA430-G Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours Resources allowed: Notes: Pocket calculator,
More informationData Analysis and Monte Carlo Methods
Lecturer: Allen Caldwell, Max Planck Institute for Physics & TUM Recitation Instructor: Oleksander (Alex) Volynets, MPP & TUM General Information: - Lectures will be held in English, Mondays 16-18:00 -
More informationReview of Probability Theory
Review of Probability Theory Arian Maleki and Tom Do Stanford University Probability theory is the study of uncertainty Through this class, we will be relying on concepts from probability theory for deriving
More informationLecture 2: Repetition of probability theory and statistics
Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:
More informationLECTURE 1. 1 Introduction. 1.1 Sample spaces and events
LECTURE 1 1 Introduction The first part of our adventure is a highly selective review of probability theory, focusing especially on things that are most useful in statistics. 1.1 Sample spaces and events
More informationProbability theory. References:
Reasoning Under Uncertainty References: Probability theory Mathematical methods in artificial intelligence, Bender, Chapter 7. Expert systems: Principles and programming, g, Giarratano and Riley, pag.
More informationChapter 1 Statistical Reasoning Why statistics? Section 1.1 Basics of Probability Theory
Chapter 1 Statistical Reasoning Why statistics? Uncertainty of nature (weather, earth movement, etc. ) Uncertainty in observation/sampling/measurement Variability of human operation/error imperfection
More informationPROBABILITY THEORY. Prof. S. J. Soni. Assistant Professor Computer Engg. Department SPCE, Visnagar
PROBABILITY THEORY By Prof. S. J. Soni Assistant Professor Computer Engg. Department SPCE, Visnagar Introduction Signals whose values at any instant t are determined by their analytical or graphical description
More informationBivariate distributions
Bivariate distributions 3 th October 017 lecture based on Hogg Tanis Zimmerman: Probability and Statistical Inference (9th ed.) Bivariate Distributions of the Discrete Type The Correlation Coefficient
More informationProbability Theory. Introduction to Probability Theory. Principles of Counting Examples. Principles of Counting. Probability spaces.
Probability Theory To start out the course, we need to know something about statistics and probability Introduction to Probability Theory L645 Advanced NLP Autumn 2009 This is only an introduction; for
More informationProbability Review. Chao Lan
Probability Review Chao Lan Let s start with a single random variable Random Experiment A random experiment has three elements 1. sample space Ω: set of all possible outcomes e.g.,ω={1,2,3,4,5,6} 2. event
More informationProbability Theory for Machine Learning. Chris Cremer September 2015
Probability Theory for Machine Learning Chris Cremer September 2015 Outline Motivation Probability Definitions and Rules Probability Distributions MLE for Gaussian Parameter Estimation MLE and Least Squares
More informationRandomized Algorithms
Randomized Algorithms Prof. Tapio Elomaa tapio.elomaa@tut.fi Course Basics A new 4 credit unit course Part of Theoretical Computer Science courses at the Department of Mathematics There will be 4 hours
More information02 Background Minimum background on probability. Random process
0 Background 0.03 Minimum background on probability Random processes Probability Conditional probability Bayes theorem Random variables Sampling and estimation Variance, covariance and correlation Probability
More informationSUMMARY OF PROBABILITY CONCEPTS SO FAR (SUPPLEMENT FOR MA416)
SUMMARY OF PROBABILITY CONCEPTS SO FAR (SUPPLEMENT FOR MA416) D. ARAPURA This is a summary of the essential material covered so far. The final will be cumulative. I ve also included some review problems
More informationDeep Learning for Computer Vision
Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair
More informationExercises with solutions (Set D)
Exercises with solutions Set D. A fair die is rolled at the same time as a fair coin is tossed. Let A be the number on the upper surface of the die and let B describe the outcome of the coin toss, where
More informationECE Homework Set 3
ECE 450 1 Homework Set 3 0. Consider the random variables X and Y, whose values are a function of the number showing when a single die is tossed, as show below: Exp. Outcome 1 3 4 5 6 X 3 3 4 4 Y 0 1 3
More informationChapter 3: Random Variables 1
Chapter 3: Random Variables 1 Yunghsiang S. Han Graduate Institute of Communication Engineering, National Taipei University Taiwan E-mail: yshan@mail.ntpu.edu.tw 1 Modified from the lecture notes by Prof.
More informationPHYS 114 Exam 1 Answer Key NAME:
PHYS 4 Exam Answer Key AME: Please answer all of the questions below. Each part of each question is worth points, except question 5, which is worth 0 points.. Explain what the following MatLAB commands
More informationReview of probability. Nuno Vasconcelos UCSD
Review of probability Nuno Vasconcelos UCSD robability probability is the language to deal with processes that are non-deterministic examples: if I flip a coin 00 times how many can I expect to see heads?
More informationIntroduction to Stochastic Processes
Stat251/551 (Spring 2017) Stochastic Processes Lecture: 1 Introduction to Stochastic Processes Lecturer: Sahand Negahban Scribe: Sahand Negahban 1 Organization Issues We will use canvas as the course webpage.
More informationECE 636: Systems identification
ECE 636: Systems identification Lectures 3 4 Random variables/signals (continued) Random/stochastic vectors Random signals and linear systems Random signals in the frequency domain υ ε x S z + y Experimental
More informationA6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2011
A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2011 Reading Chapter 5 of Gregory (Frequentist Statistical Inference) Lecture 7 Examples of FT applications Simulating
More informationPreliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com
1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com Gujarati D. Basic Econometrics, Appendix
More informationBrief Review of Probability
Brief Review of Probability Nuno Vasconcelos (Ken Kreutz-Delgado) ECE Department, UCSD Probability Probability theory is a mathematical language to deal with processes or experiments that are non-deterministic
More informationP 1.5 X 4.5 / X 2 and (iii) The smallest value of n for
DHANALAKSHMI COLLEGE OF ENEINEERING, CHENNAI DEPARTMENT OF ELECTRONICS AND COMMUNICATION ENGINEERING MA645 PROBABILITY AND RANDOM PROCESS UNIT I : RANDOM VARIABLES PART B (6 MARKS). A random variable X
More informationSample Spaces, Random Variables
Sample Spaces, Random Variables Moulinath Banerjee University of Michigan August 3, 22 Probabilities In talking about probabilities, the fundamental object is Ω, the sample space. (elements) in Ω are denoted
More informationStatistics for Economists Lectures 6 & 7. Asrat Temesgen Stockholm University
Statistics for Economists Lectures 6 & 7 Asrat Temesgen Stockholm University 1 Chapter 4- Bivariate Distributions 41 Distributions of two random variables Definition 41-1: Let X and Y be two random variables
More informationIntroduction to Probability and Statistics (Continued)
Introduction to Probability and Statistics (Continued) Prof. icholas Zabaras Center for Informatics and Computational Science https://cics.nd.edu/ University of otre Dame otre Dame, Indiana, USA Email:
More informationCommunication Theory II
Communication Theory II Lecture 5: Review on Probability Theory Ahmed Elnakib, PhD Assistant Professor, Mansoura University, Egypt Febraury 22 th, 2015 1 Lecture Outlines o Review on probability theory
More informationCME 106: Review Probability theory
: Probability theory Sven Schmit April 3, 2015 1 Overview In the first half of the course, we covered topics from probability theory. The difference between statistics and probability theory is the following:
More informationLecture 10: Probability distributions TUESDAY, FEBRUARY 19, 2019
Lecture 10: Probability distributions DANIEL WELLER TUESDAY, FEBRUARY 19, 2019 Agenda What is probability? (again) Describing probabilities (distributions) Understanding probabilities (expectation) Partial
More informationLecture - 30 Stationary Processes
Probability and Random Variables Prof. M. Chakraborty Department of Electronics and Electrical Communication Engineering Indian Institute of Technology, Kharagpur Lecture - 30 Stationary Processes So,
More informationStochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno
Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function.
More informationFrom Determinism to Stochasticity
From Determinism to Stochasticity Reading for this lecture: (These) Lecture Notes. Outline of next few lectures: Probability theory Stochastic processes Measurement theory You Are Here A B C... α γ β δ
More informationECE531: Principles of Detection and Estimation Course Introduction
ECE531: Principles of Detection and Estimation Course Introduction D. Richard Brown III WPI 22-January-2009 WPI D. Richard Brown III 22-January-2009 1 / 37 Lecture 1 Major Topics 1. Web page. 2. Syllabus
More informationProbability Review. Yutian Li. January 18, Stanford University. Yutian Li (Stanford University) Probability Review January 18, / 27
Probability Review Yutian Li Stanford University January 18, 2018 Yutian Li (Stanford University) Probability Review January 18, 2018 1 / 27 Outline 1 Elements of probability 2 Random variables 3 Multiple
More informationReview of Probabilities and Basic Statistics
Alex Smola Barnabas Poczos TA: Ina Fiterau 4 th year PhD student MLD Review of Probabilities and Basic Statistics 10-701 Recitations 1/25/2013 Recitation 1: Statistics Intro 1 Overview Introduction to
More informationGiven a experiment with outcomes in sample space: Ω Probability measure applied to subsets of Ω: P[A] 0 P[A B] = P[A] + P[B] P[AB] = P(AB)
1 16.584: Lecture 2 : REVIEW Given a experiment with outcomes in sample space: Ω Probability measure applied to subsets of Ω: P[A] 0 P[A B] = P[A] + P[B] if AB = P[A B] = P[A] + P[B] P[AB] P[A] = 1 P[A
More informationAppendix A : Introduction to Probability and stochastic processes
A-1 Mathematical methods in communication July 5th, 2009 Appendix A : Introduction to Probability and stochastic processes Lecturer: Haim Permuter Scribe: Shai Shapira and Uri Livnat The probability of
More informationLecture 16. Lectures 1-15 Review
18.440: Lecture 16 Lectures 1-15 Review Scott Sheffield MIT 1 Outline Counting tricks and basic principles of probability Discrete random variables 2 Outline Counting tricks and basic principles of probability
More informationNorthwestern University Department of Electrical Engineering and Computer Science
Northwestern University Department of Electrical Engineering and Computer Science EECS 454: Modeling and Analysis of Communication Networks Spring 2008 Probability Review As discussed in Lecture 1, probability
More informationIntroduction to Probability and Stocastic Processes - Part I
Introduction to Probability and Stocastic Processes - Part I Lecture 2 Henrik Vie Christensen vie@control.auc.dk Department of Control Engineering Institute of Electronic Systems Aalborg University Denmark
More informationClass of waveform coders can be represented in this manner
Digital Speech Processing Lecture 15 Speech Coding Methods Based on Speech Waveform Representations ti and Speech Models Uniform and Non- Uniform Coding Methods 1 Analog-to-Digital Conversion (Sampling
More informationIntroduction to Information Entropy Adapted from Papoulis (1991)
Introduction to Information Entropy Adapted from Papoulis (1991) Federico Lombardo Papoulis, A., Probability, Random Variables and Stochastic Processes, 3rd edition, McGraw ill, 1991. 1 1. INTRODUCTION
More informationReview: mostly probability and some statistics
Review: mostly probability and some statistics C2 1 Content robability (should know already) Axioms and properties Conditional probability and independence Law of Total probability and Bayes theorem Random
More informationSome Concepts of Probability (Review) Volker Tresp Summer 2018
Some Concepts of Probability (Review) Volker Tresp Summer 2018 1 Definition There are different way to define what a probability stands for Mathematically, the most rigorous definition is based on Kolmogorov
More informationLab 4: Quantization, Oversampling, and Noise Shaping
Lab 4: Quantization, Oversampling, and Noise Shaping Due Friday 04/21/17 Overview: This assignment should be completed with your assigned lab partner(s). Each group must turn in a report composed using
More informationPROBABILITY THEORY REVIEW
PROBABILITY THEORY REVIEW CMPUT 466/551 Martha White Fall, 2017 REMINDERS Assignment 1 is due on September 28 Thought questions 1 are due on September 21 Chapters 1-4, about 40 pages If you are printing,
More informationBIOE 198MI Biomedical Data Analysis. Spring Semester Lab 4: Introduction to Probability and Random Data
BIOE 98MI Biomedical Data Analysis. Spring Semester 209. Lab 4: Introduction to Probability and Random Data A. Random Variables Randomness is a component of all measurement data, either from acquisition
More informationPROBABILITY AND RANDOM PROCESSESS
PROBABILITY AND RANDOM PROCESSESS SOLUTIONS TO UNIVERSITY QUESTION PAPER YEAR : JUNE 2014 CODE NO : 6074 /M PREPARED BY: D.B.V.RAVISANKAR ASSOCIATE PROFESSOR IT DEPARTMENT MVSR ENGINEERING COLLEGE, NADERGUL
More informationME 597: AUTONOMOUS MOBILE ROBOTICS SECTION 2 PROBABILITY. Prof. Steven Waslander
ME 597: AUTONOMOUS MOBILE ROBOTICS SECTION 2 Prof. Steven Waslander p(a): Probability that A is true 0 pa ( ) 1 p( True) 1, p( False) 0 p( A B) p( A) p( B) p( A B) A A B B 2 Discrete Random Variable X
More informationProperties of Probability
Econ 325 Notes on Probability 1 By Hiro Kasahara Properties of Probability In statistics, we consider random experiments, experiments for which the outcome is random, i.e., cannot be predicted with certainty.
More informationRandom Variables. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay
1 / 13 Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay August 8, 2013 2 / 13 Random Variable Definition A real-valued
More informationDistortion Analysis T
EE 435 Lecture 32 Spectral Performance Windowing Spectral Performance of Data Converters - Time Quantization - Amplitude Quantization Quantization Noise . Review from last lecture. Distortion Analysis
More informationELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random
More informationProbability theory basics
Probability theory basics Michael Franke Basics of probability theory: axiomatic definition, interpretation, joint distributions, marginalization, conditional probability & Bayes rule. Random variables:
More informationRelationship between probability set function and random variable - 2 -
2.0 Random Variables A rat is selected at random from a cage and its sex is determined. The set of possible outcomes is female and male. Thus outcome space is S = {female, male} = {F, M}. If we let X be
More informationSTAT2201. Analysis of Engineering & Scientific Data. Unit 3
STAT2201 Analysis of Engineering & Scientific Data Unit 3 Slava Vaisman The University of Queensland School of Mathematics and Physics What we learned in Unit 2 (1) We defined a sample space of a random
More informationChapter 2: Random Variables
ECE54: Stochastic Signals and Systems Fall 28 Lecture 2 - September 3, 28 Dr. Salim El Rouayheb Scribe: Peiwen Tian, Lu Liu, Ghadir Ayache Chapter 2: Random Variables Example. Tossing a fair coin twice:
More informationLecture 1: Probability Fundamentals
Lecture 1: Probability Fundamentals IB Paper 7: Probability and Statistics Carl Edward Rasmussen Department of Engineering, University of Cambridge January 22nd, 2008 Rasmussen (CUED) Lecture 1: Probability
More informationRandom Variables and Their Distributions
Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital
More informationECE 450 Homework #3. 1. Given the joint density function f XY (x,y) = 0.5 1<x<2, 2<y< <x<4, 2<y<3 0 else
ECE 450 Homework #3 0. Consider the random variables X and Y, whose values are a function of the number showing when a single die is tossed, as show below: Exp. Outcome 1 3 4 5 6 X 3 3 4 4 Y 0 1 3 4 5
More information2. SPECTRAL ANALYSIS APPLIED TO STOCHASTIC PROCESSES
2. SPECTRAL ANALYSIS APPLIED TO STOCHASTIC PROCESSES 2.0 THEOREM OF WIENER- KHINTCHINE An important technique in the study of deterministic signals consists in using harmonic functions to gain the spectral
More informationSupratim Ray
Supratim Ray sray@cns.iisc.ernet.in Biophysics of Action Potentials Passive Properties neuron as an electrical circuit Passive Signaling cable theory Active properties generation of action potential Techniques
More informationSummary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016
8. For any two events E and F, P (E) = P (E F ) + P (E F c ). Summary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016 Sample space. A sample space consists of a underlying
More informationMassachusetts Institute of Technology Department of Electrical Engineering and Computer Science : Discrete-Time Signal Processing
Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.34: Discrete-Time Signal Processing OpenCourseWare 006 ecture 8 Periodogram Reading: Sections 0.6 and 0.7
More informationProbability and distributions. Francesco Corona
Probability Probability and distributions Francesco Corona Department of Computer Science Federal University of Ceará, Fortaleza Probability Many kinds of studies can be characterised as (repeated) experiments
More informationPerhaps the simplest way of modeling two (discrete) random variables is by means of a joint PMF, defined as follows.
Chapter 5 Two Random Variables In a practical engineering problem, there is almost always causal relationship between different events. Some relationships are determined by physical laws, e.g., voltage
More informationRandom Processes Why we Care
Random Processes Why we Care I Random processes describe signals that change randomly over time. I Compare: deterministic signals can be described by a mathematical expression that describes the signal
More informationEE4601 Communication Systems
EE4601 Communication Systems Week 2 Review of Probability, Important Distributions 0 c 2011, Georgia Institute of Technology (lect2 1) Conditional Probability Consider a sample space that consists of two
More informationProbability. Paul Schrimpf. January 23, Definitions 2. 2 Properties 3
Probability Paul Schrimpf January 23, 2018 Contents 1 Definitions 2 2 Properties 3 3 Random variables 4 3.1 Discrete........................................... 4 3.2 Continuous.........................................
More informationDefinition of a Stochastic Process
Definition of a Stochastic Process Balu Santhanam Dept. of E.C.E., University of New Mexico Fax: 505 277 8298 bsanthan@unm.edu August 26, 2018 Balu Santhanam (UNM) August 26, 2018 1 / 20 Overview 1 Stochastic
More informationProbability Models in Electrical and Computer Engineering Mathematical models as tools in analysis and design Deterministic models Probability models
Probability Models in Electrical and Computer Engineering Mathematical models as tools in analysis and design Deterministic models Probability models Statistical regularity Properties of relative frequency
More information