Analog Communication (10EC53)
|
|
- Priscilla Oliver
- 5 years ago
- Views:
Transcription
1 UNIT-1: RANDOM PROCESS: Random variables: Several random variables. Statistical averages: Function o Random variables, moments, Mean, Correlation and Covariance unction: Principles o autocorrelation unction, cross correlation unctions. Central limit theorem, Properties o Gaussian process. Introduction: Transmission o inormation or a message rom one point to another point is called communication. The two points that wants to interact is called transmitter and receiver points or can also be reerred to as source and destination. Channel or a medium links any two points that wants to communicate. The channel can be wired (guided) or wireless (unguided). The inormation or a message is represented in the orm o a signal on the channel depending on the nature o the channel. For eample i the medium is a twisted pair or coaial cable then the signal is electrical i the medium is optical then the signal is optical or light. The signal can be analog or digital. I the signal is analog it is continuous and i it is digital it uses discrete representation. This version can be achieved with the application o base band approach like amplitude (AM), requency (FM) and pulse (PM) modulation schemes or the analog signal representation. Digital signals use broad band approach like amplitude (ASK), requency (FSK) and phase (PSK) shiting techniques. These signals are derived rom sources that can also be classiied as analog sources and digital sources. Eamples o analog sources are microphone, TV cameras, and or digital source computer data is a best eample. An AM radio system transmits electromagnetic waves with requencies o around a ew hundred khz (MF band). The FM radio system must operate with requencies in the range o MHz (VHF band). The inormation transer can happen to a single point or to multiple points. I the signal transer happens on a single link to only one receiving system the communication mode is called unicast communication eg:telephone. I the signal transer happens on multiple links to several or all receivers on the network, the communication mode is then called multicast or broadcast communication eg: Radio, Television. The Basic communication system model is shown in igure 1: Poornima.G, Associate Proessor, BMSCE, B lore 1
2 The majors communication resources o concerns are transmitted power, channel bandwidth, noise. The average power o the transmitted signal is reerred to as the transmitted power. The Channel Bandwidth is the band o requencies allotted or transmission and noise is any unwanted signals that disturb transmission o message signal. Hence designing a communication system that makes use o the resources eiciently is important. Hence the channel can be divided as power limited and band limited. Telephone channels are band limited where as satellite or radio channels are power limited. Inormation Sources: The communication environment is dominated by inormation sources like Speech, Music, Pictures, and Computer Data. Source o inormation can be characterized in terms o signals that carry inormation. Signal is a single valued unction o time and an independent variable. The signal is single dimensional or speech, music and computer data. For pictures it s two dimensional and or video data it is three dimensional. For volume o data over time its our dimensional. The analog signal source produce continuous electrical signal with respect to time. The analog inormation source can be transormed into discrete source through the process o sampling and quantization. The discrete inormation source can be characterized as symbol rate, source alphabet, and source alphabet probabilities. Poornima.G, Associate Proessor, BMSCE, B lore 2
3 Communication Networks: The communication networks consist o a number o nodes or stations or processors that perorm the unction o orwarding the data rom one node/station to another node/station. The process o orwarding the data/message packets is called switching. There are three switching methods or data communication circuit switching, message switching, and packet switching. For circuit switching a dedicated path has to be provided. The link is ied and reserves the bandwidth. Packet switchinguses store and orward, the path or bandwidth is allocated on demand. Probability Theory: Statistics is branch o mathematics that deals with the collection o data. It also concerns with what can be learned rom data. Etension o statistical theory is Probability Theory. Probability deals with the result o an eperiment whose actual outcome is not known. It also deals with averages o mass phenomenon. The eperiment in which the Outcome cannot be predicted with certainty is called Random Eperiment. These eperiments can also be reerred to as a probabilistic eperiment in which more than one thing can happen. Eg: Tossing o a coin, throwing o a dice. Deterministic Model and Stochastic Model or Random Mathematical Mode can be used to describe a physical phenomenon. In Deterministic Model there is no uncertainty about its time dependent behavior. A sample point corresponds to the aggregate o all possible outcomes. Sample space or ensemble composed o unctions o time-random Process or stochastic Process. Poornima.G, Associate Proessor, BMSCE, B lore 3
4 1(t) is an outcome o eperiment 1 2(t) is the outcome o eperiment 2... n(t) is the outcome o eperiment n Each sample point in S is associated with a sample unction (t). X(t; s) is a random process is an ensemble o all time unctions together with a probability rule. X(t; sj) is a realization or sample unction o the random process.probability rules assign probability to any meaningul event associated with an observation An observation is a sample unction o the random process. {1(tk); 2(tk); :::; n(tk)g = X(tk; s1);x(tk; s2); :::;X(tk; sn)} X(t k ; s j ) constitutes a random variable. Outcome o an eperiment mapped to a real number. An oscillator with a requency ω0 with a tolerance o 1%.The oscillator can take values between ω0 (1±0.01). Each realization o the oscillator can take any value between (ω0) (0.99) to (ω0) (1.01). The requency o the oscillator can thus be characterized by a random variable. Statistical averages are important in the measurement o quantities that are obscured by random variations. As an eample consider the problem o measuring a voltage level with a noisy instrument. Suppose that the unknown voltage has value a and that the instrument has an uncertainty. The observed value may be y = a +. Suppose that n independent measurements are made under identical conditions, meaning that neither the unknown value o the voltage nor the statistics o the instrument noise change during the process. Let us call the n measurements y i, 1 i n. Under our model o the process, it must be the case that y i = a + i. Now orm the quantity ỹ(n) = 1/ n Σ y i where i=1 n This is the empirical average o the observed values. It is important to note that ỹ (n) is a random variable because it is a numerical value that is the outcome o a random eperiment. That means that it will not have a single certain value. We epect to obtain a dierent value i we repeat the Poornima.G, Associate Proessor, BMSCE, B lore 4
5 eperiment and obtain n new measurements. We also epect that the result depends upon the value o n, and have the sense that larger values o n should give better results. Types o Random Variable(RV): 1. Discrete Random Variable: An RV that can take on only a inite or countably ininite set o outcomes. 2. Continuous Random Variable: An RV that can take on any value along a continuum (but may be reported discretely ).Random Variables are denoted by upper case letters (Y).Individual outcomes or RV are denoted by lower case letters ( Discrete Random Variable: Discrete Random Variable are the ones that takes on a countable number o values this means you can sit down and list all possible outcomes without missing any, although it might take you an ininite amount o time. X = values on the roll o two dice: X has to be either 2, 3, 4,, or 12. Y = number o accidents on the UTA campus during a week: Y has to be 0, 1, 2, 3, 4, 5, 6, 7, 8, real big number Probability Distribution: Table, Graph, or Formula that describes values a random variable can take on, and its corresponding probability (discrete RV) or density (continuous RV). 1. Discrete Probability Distribution: Assigns probabilities (masses) to the individual outcomes 2. Continuous Probability Distribution: Assigns density at individual points, probability o ranges can be obtained by integrating density unction 3. Discrete Probabilities denoted by: p( = P(Y= 4. Continuous Densities denoted by: ( 5. Cumulative Distribution Function: F( = P(Y For a discrete random variable, we have a probability mass unction (pm).the pm looks like a bunch o spikes, and probabilities are represented by the heights o the spikes. For a continuous random Poornima.G, Associate Proessor, BMSCE, B lore 5
6 variable, we have a probability density unction (pd). The pd looks like a curve, and probabilities are represented by areas under the curve. Poornima.G, Associate Proessor, BMSCE, B lore 6
7 Continuous Random Variable: Continuous Random Variable is usually measurement data [time, weight, distance, etc] the one that takes on an uncountable number o values this means you can never list all possible outcomes even i you had an ininite amount o time. X = time it takes you to drive home rom class: X > 0, might be 30.1 minutes measured to the nearest tenth but in reality the actual time is minutes?) A continuous random variable has an ininite number o possible values & the probability o any one particular value is zero. Several Random Variables I two or more random variables are used to deine a process than it is called Several Random Variables and correspondingly the Joint distribution unction (JDF) can be deined. For eample i X and Y are two random variables then F, Y (, is the JDF and F Y Suppose JDF X also continuous X (, P( X, Y ) F X, Y y, (, is continuous everywhere then the partial derivative is FX, Y (, X, Y (, y F XY (, is monotone non-decreasing unction o both & y and is always non-negative The total volume under the graph o JPDF must be unity: y, (, ) dd 1 2 The PDF or single RV(X) can be obtained rom its JPDF with a second RV(Y): F (, y ) (, ) dd Poornima.G, Associate Proessor, BMSCE, B lore 7
8 Dierentiating both sides w.r.t : (, y ) (, ) d Thus PDF () may be obtained rom JPDF XY (, by integrating over all values o the undesired RV(Y).The PDF () & Y (Y) are called marginal density. Hence JPDF XY (, contains all possible inormation about JRV X&Y. The conditional PDF o Y given that X= is deined by: Provided that ()> 0, where () is the marginal density o X. The unction Y ( y X ) may be thought o as a unction o the variable y. According it satisies all the requirements o an ordinary probability density unction as shown by And, y (, Y ( y X ) ( ) Y ( y X ) 0 Y ( y X ) dy 1 I the random variables X&Y are statistically independent, the knowledge o the outcome o X can in no way eect the distribution o Y.The result is the condition probability Y ( y X density ) reduces to the marginal density Y ( as shown by: ( y X ) ( Y Y The JPDF o RV can be epressed as the product o their respective marginal densities: X, Y (, X ( ) Y ( This relation holds only when the RV X&Y are statistically independent. Statistical Averages Its important in the measurement o quantities that are obscured by random variations. The mean or epected value o a random variable X is commonly deined by: m E[ X ] ( ) Poornima.G, Associate Proessor, BMSCE, B lore 8
9 E - Epectation operator; m - locates the center o gravity o the area under the probability density curve o random variable X. The mean unction o X, denoted by g(x), is deined by: E[ g(( X )] g( ) ( ) For the special case o g(x)=x n, the nth movement o probability distribution o the RV X; that is n n E[ X ] ( ) d The most important moments o X are the irst two moments. when n=1 the mean o the RV is obtained and n=2 gives the mean-square value o X 2 2 E[ X ] ( ) d The moments o the dierence between a random variable X and its mean m. The nth central moment is E[( X m n n ) ] ( m) ( ) For n=1, the central moment is zero. For n=2 the second central moment is the variance o RV. Var[ X ] E[( X m d 2 2 ) ] ( m) ( ) The variance o the random variable X is commonly denote as. The square root o the variance is called the standard deviation o the 2 random variable X. The variance o the random variable X is in some sense a measure o the variables dispersion. By speciying variance we essentially constraints eective width o the PDF () o the RV X about the mean m.the characteristics unction (v) o the probability distribution o the RV X is another important statistical average. Its deined as the epectation o ep(jvx): ( v) E[ep( jvx)] ( )ep( jv d v and play analogous roles to the variables 2π and t o Fourier transorm, the ollowing inverse can be deduced. ( ) 21 ( v)ep( jv) Poornima.G, Associate Proessor, BMSCE, B lore 9 d ) dv 2
10 This relation may be used to evaluate the PDF () o the RV X. Random Process: A (one-dimensional) random process is a (scalar) unction y(t), where t is usually time, or which the uture evolution is not determined uniquely by any set o initial data or at least by any set that is knowable to you and me. In other words, \random process" is just a ancy phrase that means \unpredictable unction". Random processes y take on a continuum o values ranging over some interval, oten but not always - to +. The generalization to y's with discrete (e.g., integral) values is straightorward. Eamples o random processes are: (i ) the total energy E(t) in a cell o gas that is in contact with a heat bath; (ii ) the temperature T(t) at the corner o Main Street and Center Street in Logan, Utah; (iii ) the earth-longitude _(t) o a speciic oygen molecule in the earth's atmosphere. One can also deal with random processes that are vector or tensor unctions o time. Ensembles o random processes. Since the precise time evolution o a random process is not predictable, i one wishes to make predictions one can do so only probabilistically. The oundation or probabilistic predictions is an ensemble o random processes i.e., a collection o a huge number o random processes each o which behaves in its own, unpredictable way. The probability density unction describes the general distribution o the magnitude o the random process, but it gives no inormation on the time or requency content o the process. Ensemble averaging and Time averaging can be used to obtain the process properties Ensemble averaging : Properties o the process are obtained by averaging over a collection or ensemble o sample records using values at corresponding times Time averaging :Properties are obtained by averaging over a single record in time Poornima.G, Associate Proessor, BMSCE, B lore 10
11 Stationary random processes: A random process is said to be stationary i its statistical characterization is independent o the observation interval over which the process was initiated. Ensemble averages do not vary with time. An ensemble o random processes is said to be stationary i and only i its probability distributions p n depend only on time dierences, not on absolute time: p n (y n ; t n + τ ; : : : ; y 2 ; t 2 + τ ; y 1 ; t 1 + τ ) = p n (y n ; t n ; : : : ; y 2 ; t 2 ; y 1 ; t 1 ): I this property holds or the absolute probabilities p n. Most stationary random processes can be treated as ergodic. A random process is ergodic i every member o the process carries with it the complete statistics o the whole process. Then its ensemble averages will equal appropriate time averages. O necessity, an ergodic process must be stationary, but not all stationary processes are ergodic. Nonstationary random processes: Nonstationary random processes arise when one is studying a system whose evolution is inluenced by some sort o clock that cares about absolute time. For eample, the speeds v(t) o the oygen molecules in downtown Logan, Utah make up an ensemble o random processes regulated in part by the rotation o the earth and the orbital motion o the earth around the sun; and the inluence o these clocks makes v(t) be a nonstationary random process. By contrast, stationary random processes arise in the absence o any regulating clocks. An eample is the speeds v (t) o oygen molecules in a room kept at constant temperature. Ergodic Process: Stationary process in which averages rom a single record are the same as those obtained rom averaging over the ensemble. I every member o the process carries with it the complete statistics o the whole process then it is called ergodic process. Ensemble averages will equal appropriate time averages. But not all stationary processes are ergodic. Partial Description o random process The mean o the process is constant. Poornima.G, Associate Proessor, BMSCE, B lore 11
12 The autocorrelation unction o the process is independent o the shit o the time origin. The autocorrelation unction at a lag o zero is inite. Random process that is not strictly stationary but or which these conditions hold is said to be Wide Sense Stationary. Properties o Autocorrelation Even unction o the time lag R X ( ) R X ( ) Mean square valve equals the autocorrelation unction o the process or zero time lag R (0) [ X 2 X E ( t)] autocorrelation unction has maimum magnitude at zero time lag R X ( ) RX (0) Interdependence o two random variables obtained by observing a random process at time X (t) changes with time the more rapidly will autocorrelation unction decrease rom its maimum Properties o Gaussian Process 1. I a Gaussian process X(t) is applied to a stable linear ilter then the random process Y(t) developed at the output o the ilter is also Gaussian. 2. I Gaussian process is wide sense stationary then the process is also stationary in the strict sense. 3. Samples X(t1),X(t2), X(tn) o RV X(t) at t1,t2, tn.i X(t) is Gaussian then the set o RV are jointly Gaussian or any n I the set o RV X(t1),X(t2), X(tn) the Samples o RV X(t) at times t1,t2, tn. Are uncorrelated then the set o RV are statistically independent Central Limit Theorem X 1,X 2,X 3,.X n be a set o RV that satisies the ollowing requirements: X k with k=1, 2,..n are statistically independent. X k all have the same pd Mean and Variance eist or each X k Poornima.G, Associate Proessor, BMSCE, B lore 12
13 I RV Y is deined by Y n X k k 1 According to the Central limit theorem The standardized RV approaches a Gaussian RV with zero mean and variance as the number o RV X 1,X 2,X 3,.X n increases without limit. Y E[ Y ] Z Mean and Variance related to the moments are n E[ Y ] E[ X k ] and Var[ Y] Var[ k 1 Y Gives only limiting orm o distribution unction o standardized sum Z as n tends to ininity. n k 1 X k ] Poornima.G, Associate Proessor, BMSCE, B lore 13
TLT-5200/5206 COMMUNICATION THEORY, Exercise 3, Fall TLT-5200/5206 COMMUNICATION THEORY, Exercise 3, Fall Problem 1.
TLT-5/56 COMMUNICATION THEORY, Exercise 3, Fall Problem. The "random walk" was modelled as a random sequence [ n] where W[i] are binary i.i.d. random variables with P[W[i] = s] = p (orward step with probability
More informationMODULE 6 LECTURE NOTES 1 REVIEW OF PROBABILITY THEORY. Most water resources decision problems face the risk of uncertainty mainly because of the
MODULE 6 LECTURE NOTES REVIEW OF PROBABILITY THEORY INTRODUCTION Most water resources decision problems ace the risk o uncertainty mainly because o the randomness o the variables that inluence the perormance
More informationSignals and Spectra - Review
Signals and Spectra - Review SIGNALS DETERMINISTIC No uncertainty w.r.t. the value of a signal at any time Modeled by mathematical epressions RANDOM some degree of uncertainty before the signal occurs
More informationMixed Signal IC Design Notes set 6: Mathematics of Electrical Noise
ECE45C /8C notes, M. odwell, copyrighted 007 Mied Signal IC Design Notes set 6: Mathematics o Electrical Noise Mark odwell University o Caliornia, Santa Barbara rodwell@ece.ucsb.edu 805-893-344, 805-893-36
More informationSignals & Linear Systems Analysis Chapter 2&3, Part II
Signals & Linear Systems Analysis Chapter &3, Part II Dr. Yun Q. Shi Dept o Electrical & Computer Engr. New Jersey Institute o echnology Email: shi@njit.edu et used or the course:
More informationENSC327 Communications Systems 19: Random Processes. Jie Liang School of Engineering Science Simon Fraser University
ENSC327 Communications Systems 19: Random Processes Jie Liang School of Engineering Science Simon Fraser University 1 Outline Random processes Stationary random processes Autocorrelation of random processes
More information3. Several Random Variables
. Several Random Variables. Two Random Variables. Conditional Probabilit--Revisited. Statistical Independence.4 Correlation between Random Variables. Densit unction o the Sum o Two Random Variables. Probabilit
More informationProbability, Statistics, and Reliability for Engineers and Scientists MULTIPLE RANDOM VARIABLES
CHATER robability, Statistics, and Reliability or Engineers and Scientists MULTILE RANDOM VARIABLES Second Edition A. J. Clark School o Engineering Department o Civil and Environmental Engineering 6a robability
More informationCommunication Theory II
Communication Theory II Lecture 8: Stochastic Processes Ahmed Elnakib, PhD Assistant Professor, Mansoura University, Egypt March 5 th, 2015 1 o Stochastic processes What is a stochastic process? Types:
More informationPROBABILITY THEORY. Prof. S. J. Soni. Assistant Professor Computer Engg. Department SPCE, Visnagar
PROBABILITY THEORY By Prof. S. J. Soni Assistant Professor Computer Engg. Department SPCE, Visnagar Introduction Signals whose values at any instant t are determined by their analytical or graphical description
More informationChapter 6. Random Processes
Chapter 6 Random Processes Random Process A random process is a time-varying function that assigns the outcome of a random experiment to each time instant: X(t). For a fixed (sample path): a random process
More informationECE Lecture #10 Overview
ECE 450 - Lecture #0 Overview Introduction to Random Vectors CDF, PDF Mean Vector, Covariance Matrix Jointly Gaussian RV s: vector form of pdf Introduction to Random (or Stochastic) Processes Definitions
More informationELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random
More informationChapter 2. Random Variable. Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance.
Chapter 2 Random Variable CLO2 Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance. 1 1. Introduction In Chapter 1, we introduced the concept
More informationReferences Ideal Nyquist Channel and Raised Cosine Spectrum Chapter 4.5, 4.11, S. Haykin, Communication Systems, Wiley.
Baseand Data Transmission III Reerences Ideal yquist Channel and Raised Cosine Spectrum Chapter 4.5, 4., S. Haykin, Communication Systems, iley. Equalization Chapter 9., F. G. Stremler, Communication Systems,
More informationLecture Notes 2 Random Variables. Discrete Random Variables: Probability mass function (pmf)
Lecture Notes 2 Random Variables Definition Discrete Random Variables: Probability mass function (pmf) Continuous Random Variables: Probability density function (pdf) Mean and Variance Cumulative Distribution
More informationChapter 5 Random Variables and Processes
Chapter 5 Random Variables and Processes Wireless Information Transmission System Lab. Institute of Communications Engineering National Sun Yat-sen University Table of Contents 5.1 Introduction 5. Probability
More informationEx x xf xdx. Ex+ a = x+ a f x dx= xf x dx+ a f xdx= xˆ. E H x H x H x f x dx ˆ ( ) ( ) ( ) μ is actually the first moment of the random ( )
Fall 03 Analysis o Eperimental Measurements B Eisenstein/rev S Errede The Epectation Value o a Random Variable: The epectation value E[ ] o a random variable is the mean value o, ie ˆ (aa μ ) For discrete
More informationAppendix A PROBABILITY AND RANDOM SIGNALS. A.1 Probability
Appendi A PROBABILITY AND RANDOM SIGNALS Deterministic waveforms are waveforms which can be epressed, at least in principle, as an eplicit function of time. At any time t = t, there is no uncertainty about
More informationIntroduction to Analog And Digital Communications
Introduction to Analog And Digital Communications Second Edition Simon Haykin, Michael Moher Chapter Fourier Representation o Signals and Systems.1 The Fourier Transorm. Properties o the Fourier Transorm.3
More informationStochastic Processes. A stochastic process is a function of two variables:
Stochastic Processes Stochastic: from Greek stochastikos, proceeding by guesswork, literally, skillful in aiming. A stochastic process is simply a collection of random variables labelled by some parameter:
More informationELEG 3143 Probability & Stochastic Process Ch. 4 Multiple Random Variables
Department o Electrical Engineering University o Arkansas ELEG 3143 Probability & Stochastic Process Ch. 4 Multiple Random Variables Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Two discrete random variables
More informationSystem Identification
System Identification Arun K. Tangirala Department of Chemical Engineering IIT Madras July 27, 2013 Module 3 Lecture 1 Arun K. Tangirala System Identification July 27, 2013 1 Objectives of this Module
More informationName of the Student: Problems on Discrete & Continuous R.Vs
Engineering Mathematics 08 SUBJECT NAME : Probability & Random Processes SUBJECT CODE : MA645 MATERIAL NAME : University Questions REGULATION : R03 UPDATED ON : November 07 (Upto N/D 07 Q.P) (Scan the
More informationAnalog Computing Technique
Analog Computing Technique by obert Paz Chapter Programming Principles and Techniques. Analog Computers and Simulation An analog computer can be used to solve various types o problems. It solves them in
More informationTSKS01 Digital Communication Lecture 1
TSKS01 Digital Communication Lecture 1 Introduction, Repetition, and Noise Modeling Emil Björnson Department of Electrical Engineering (ISY) Division of Communication Systems Emil Björnson Course Director
More informationfor valid PSD. PART B (Answer all five units, 5 X 10 = 50 Marks) UNIT I
Code: 15A04304 R15 B.Tech II Year I Semester (R15) Regular Examinations November/December 016 PROBABILITY THEY & STOCHASTIC PROCESSES (Electronics and Communication Engineering) Time: 3 hours Max. Marks:
More informationName of the Student: Problems on Discrete & Continuous R.Vs
Engineering Mathematics 05 SUBJECT NAME : Probability & Random Process SUBJECT CODE : MA6 MATERIAL NAME : University Questions MATERIAL CODE : JM08AM004 REGULATION : R008 UPDATED ON : Nov-Dec 04 (Scan
More informationStochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno
Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function.
More informationStochastic Processes. Review of Elementary Probability Lecture I. Hamid R. Rabiee Ali Jalali
Stochastic Processes Review o Elementary Probability bili Lecture I Hamid R. Rabiee Ali Jalali Outline History/Philosophy Random Variables Density/Distribution Functions Joint/Conditional Distributions
More information10. Joint Moments and Joint Characteristic Functions
10. Joint Moments and Joint Characteristic Functions Following section 6, in this section we shall introduce various parameters to compactly represent the inormation contained in the joint p.d. o two r.vs.
More informationIV. Covariance Analysis
IV. Covariance Analysis Autocovariance Remember that when a stochastic process has time values that are interdependent, then we can characterize that interdependency by computing the autocovariance function.
More informationIn many diverse fields physical data is collected or analysed as Fourier components.
1. Fourier Methods In many diverse ields physical data is collected or analysed as Fourier components. In this section we briely discuss the mathematics o Fourier series and Fourier transorms. 1. Fourier
More informationThe concept of limit
Roberto s Notes on Dierential Calculus Chapter 1: Limits and continuity Section 1 The concept o limit What you need to know already: All basic concepts about unctions. What you can learn here: What limits
More informationChapter 2 Random Processes
Chapter 2 Random Processes 21 Introduction We saw in Section 111 on page 10 that many systems are best studied using the concept of random variables where the outcome of a random experiment was associated
More informationReview of Elementary Probability Lecture I Hamid R. Rabiee
Stochastic Processes Review o Elementar Probabilit Lecture I Hamid R. Rabiee Outline Histor/Philosoph Random Variables Densit/Distribution Functions Joint/Conditional Distributions Correlation Important
More informationSRI VIDYA COLLEGE OF ENGINEERING AND TECHNOLOGY UNIT 3 RANDOM PROCESS TWO MARK QUESTIONS
UNIT 3 RANDOM PROCESS TWO MARK QUESTIONS 1. Define random process? The sample space composed of functions of time is called a random process. 2. Define Stationary process? If a random process is divided
More informationEstimation and detection of a periodic signal
Estimation and detection o a periodic signal Daniel Aronsson, Erik Björnemo, Mathias Johansson Signals and Systems Group, Uppsala University, Sweden, e-mail: Daniel.Aronsson,Erik.Bjornemo,Mathias.Johansson}@Angstrom.uu.se
More informationIntroduction to Probability and Stochastic Processes I
Introduction to Probability and Stochastic Processes I Lecture 3 Henrik Vie Christensen vie@control.auc.dk Department of Control Engineering Institute of Electronic Systems Aalborg University Denmark Slides
More informationLecture 14. Joint Probability Distribution. Joint Probability Distribution. Generally we must deal with two or more random variable simulatneously.
ENM 07 Lecture 4 Joint Probability Distribution Joint Probability Distribution Generally we must deal with two or more random variable simulatneously. For example, we might select abricated vidget and
More informationENSC327 Communications Systems 2: Fourier Representations. School of Engineering Science Simon Fraser University
ENSC37 Communications Systems : Fourier Representations School o Engineering Science Simon Fraser University Outline Chap..5: Signal Classiications Fourier Transorm Dirac Delta Function Unit Impulse Fourier
More informationStochastic Processes
Elements of Lecture II Hamid R. Rabiee with thanks to Ali Jalali Overview Reading Assignment Chapter 9 of textbook Further Resources MIT Open Course Ware S. Karlin and H. M. Taylor, A First Course in Stochastic
More information2. SPECTRAL ANALYSIS APPLIED TO STOCHASTIC PROCESSES
2. SPECTRAL ANALYSIS APPLIED TO STOCHASTIC PROCESSES 2.0 THEOREM OF WIENER- KHINTCHINE An important technique in the study of deterministic signals consists in using harmonic functions to gain the spectral
More informationNumerical Methods - Lecture 2. Numerical Methods. Lecture 2. Analysis of errors in numerical methods
Numerical Methods - Lecture 1 Numerical Methods Lecture. Analysis o errors in numerical methods Numerical Methods - Lecture Why represent numbers in loating point ormat? Eample 1. How a number 56.78 can
More informationName of the Student: Problems on Discrete & Continuous R.Vs
SUBJECT NAME : Probability & Random Processes SUBJECT CODE : MA645 MATERIAL NAME : Additional Problems MATERIAL CODE : JM08AM004 REGULATION : R03 UPDATED ON : March 05 (Scan the above QR code for the direct
More informationLecture Notes 2 Random Variables. Random Variable
Lecture Notes 2 Random Variables Definition Discrete Random Variables: Probability mass function (pmf) Continuous Random Variables: Probability density function (pdf) Mean and Variance Cumulative Distribution
More informationFig 1: Stationary and Non Stationary Time Series
Module 23 Independence and Stationarity Objective: To introduce the concepts of Statistical Independence, Stationarity and its types w.r.to random processes. This module also presents the concept of Ergodicity.
More informationStatistical signal processing
Statistical signal processing Short overview of the fundamentals Outline Random variables Random processes Stationarity Ergodicity Spectral analysis Random variable and processes Intuition: A random variable
More informationQuadratic Functions. The graph of the function shifts right 3. The graph of the function shifts left 3.
Quadratic Functions The translation o a unction is simpl the shiting o a unction. In this section, or the most part, we will be graphing various unctions b means o shiting the parent unction. We will go
More informationObjectives. By the time the student is finished with this section of the workbook, he/she should be able
FUNCTIONS Quadratic Functions......8 Absolute Value Functions.....48 Translations o Functions..57 Radical Functions...61 Eponential Functions...7 Logarithmic Functions......8 Cubic Functions......91 Piece-Wise
More informationProbability, Random Processes and Inference
INSTITUTO POLITÉCNICO NACIONAL CENTRO DE INVESTIGACION EN COMPUTACION Laboratorio de Ciberseguridad Probability, Random Processes and Inference Dr. Ponciano Jorge Escamilla Ambrosio pescamilla@cic.ipn.mx
More informationFigure 3.1 Effect on frequency spectrum of increasing period T 0. Consider the amplitude spectrum of a periodic waveform as shown in Figure 3.2.
3. Fourier ransorm From Fourier Series to Fourier ransorm [, 2] In communication systems, we oten deal with non-periodic signals. An extension o the time-requency relationship to a non-periodic signal
More information7 The Waveform Channel
7 The Waveform Channel The waveform transmitted by the digital demodulator will be corrupted by the channel before it reaches the digital demodulator in the receiver. One important part of the channel
More informationRandom Processes Why we Care
Random Processes Why we Care I Random processes describe signals that change randomly over time. I Compare: deterministic signals can be described by a mathematical expression that describes the signal
More informationSPOC: An Innovative Beamforming Method
SPOC: An Innovative Beamorming Method Benjamin Shapo General Dynamics Ann Arbor, MI ben.shapo@gd-ais.com Roy Bethel The MITRE Corporation McLean, VA rbethel@mitre.org ABSTRACT The purpose o a radar or
More informationQuestion Paper Code : AEC11T03
Hall Ticket No Question Paper Code : AEC11T03 VARDHAMAN COLLEGE OF ENGINEERING (AUTONOMOUS) Affiliated to JNTUH, Hyderabad Four Year B Tech III Semester Tutorial Question Bank 2013-14 (Regulations: VCE-R11)
More informationMassachusetts Institute of Technology
Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.011: Introduction to Communication, Control and Signal Processing QUIZ, April 1, 010 QUESTION BOOKLET Your
More informationP 1.5 X 4.5 / X 2 and (iii) The smallest value of n for
DHANALAKSHMI COLLEGE OF ENEINEERING, CHENNAI DEPARTMENT OF ELECTRONICS AND COMMUNICATION ENGINEERING MA645 PROBABILITY AND RANDOM PROCESS UNIT I : RANDOM VARIABLES PART B (6 MARKS). A random variable X
More information2A1H Time-Frequency Analysis II
2AH Time-Frequency Analysis II Bugs/queries to david.murray@eng.ox.ac.uk HT 209 For any corrections see the course page DW Murray at www.robots.ox.ac.uk/ dwm/courses/2tf. (a) A signal g(t) with period
More informationSystems & Signals 315
1 / 15 Systems & Signals 315 Lecture 13: Signals and Linear Systems Dr. Herman A. Engelbrecht Stellenbosch University Dept. E & E Engineering 2 Maart 2009 Outline 2 / 15 1 Signal Transmission through a
More information1. SIGNALS AND INFORMATION AND CLASSIFICATION OF SIGNALS
1. SIGNALS AND INFORMATION AND CLASSIFICATION OF SIGNALS 1.0 TERMINOLOGY Some preliminary definitions are required in order to be able to tackle the theory that is related to signals. Signal and Information
More informationAn Ensemble Kalman Smoother for Nonlinear Dynamics
1852 MONTHLY WEATHER REVIEW VOLUME 128 An Ensemble Kalman Smoother or Nonlinear Dynamics GEIR EVENSEN Nansen Environmental and Remote Sensing Center, Bergen, Norway PETER JAN VAN LEEUWEN Institute or Marine
More informationRandom Variables. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay
1 / 13 Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay August 8, 2013 2 / 13 Random Variable Definition A real-valued
More informationChapter 2. Basic concepts of probability. Summary. 2.1 Axiomatic foundation of probability theory
Chapter Basic concepts o probability Demetris Koutsoyiannis Department o Water Resources and Environmental Engineering aculty o Civil Engineering, National Technical University o Athens, Greece Summary
More informationDiscrete Random Variable
Discrete Random Variable Outcome of a random experiment need not to be a number. We are generally interested in some measurement or numerical attribute of the outcome, rather than the outcome itself. n
More informationAdditional exercises in Stationary Stochastic Processes
Mathematical Statistics, Centre or Mathematical Sciences Lund University Additional exercises 8 * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *
More informationJoint ] X 5) P[ 6) P[ (, ) = y 2. x 1. , y. , ( x, y ) 2, (
Two-dimensional Random Vectors Joint Cumulative Distrib bution Functio n F, (, ) P[ and ] Properties: ) F, (, ) = ) F, 3) F, F 4), (, ) = F 5) P[ < 6) P[ < (, ) is a non-decreasing unction (, ) = F ( ),,,
More informationExpected value of r.v. s
10 Epected value of r.v. s CDF or PDF are complete (probabilistic) descriptions of the behavior of a random variable. Sometimes we are interested in less information; in a partial characterization. 8 i
More informationStochastic processes Lecture 1: Multiple Random Variables Ch. 5
Stochastic processes Lecture : Multiple Random Variables Ch. 5 Dr. Ir. Richard C. Hendriks 26/04/8 Delft University of Technology Challenge the future Organization Plenary Lectures Book: R.D. Yates and
More informationFundamentals of Noise
Fundamentals of Noise V.Vasudevan, Department of Electrical Engineering, Indian Institute of Technology Madras Noise in resistors Random voltage fluctuations across a resistor Mean square value in a frequency
More informationEE 302 Division 1. Homework 6 Solutions.
EE 3 Division. Homework 6 Solutions. Problem. A random variable X has probability density { C f X () e λ,,, otherwise, where λ is a positive real number. Find (a) The constant C. Solution. Because of the
More informationResearch Article. Spectral Properties of Chaotic Signals Generated by the Bernoulli Map
Jestr Journal o Engineering Science and Technology Review 8 () (05) -6 Special Issue on Synchronization and Control o Chaos: Theory, Methods and Applications Research Article JOURNAL OF Engineering Science
More informationReview of Probability
Review of robabilit robabilit Theor: Man techniques in speech processing require the manipulation of probabilities and statistics. The two principal application areas we will encounter are: Statistical
More informationCISE-301: Numerical Methods Topic 1:
CISE-3: Numerical Methods Topic : Introduction to Numerical Methods and Taylor Series Lectures -4: KFUPM Term 9 Section 8 CISE3_Topic KFUPM - T9 - Section 8 Lecture Introduction to Numerical Methods What
More informationFundamentals of Digital Commun. Ch. 4: Random Variables and Random Processes
Fundamentals of Digital Commun. Ch. 4: Random Variables and Random Processes Klaus Witrisal witrisal@tugraz.at Signal Processing and Speech Communication Laboratory www.spsc.tugraz.at Graz University of
More informationProbabilistic Model of Error in Fixed-Point Arithmetic Gaussian Pyramid
Probabilistic Model o Error in Fixed-Point Arithmetic Gaussian Pyramid Antoine Méler John A. Ruiz-Hernandez James L. Crowley INRIA Grenoble - Rhône-Alpes 655 avenue de l Europe 38 334 Saint Ismier Cedex
More informationBasic properties of limits
Roberto s Notes on Dierential Calculus Chapter : Limits and continuity Section Basic properties o its What you need to know already: The basic concepts, notation and terminology related to its. What you
More informationLeast-Squares Spectral Analysis Theory Summary
Least-Squares Spectral Analysis Theory Summary Reerence: Mtamakaya, J. D. (2012). Assessment o Atmospheric Pressure Loading on the International GNSS REPRO1 Solutions Periodic Signatures. Ph.D. dissertation,
More informationFigure 1: Bayesian network for problem 1. P (A = t) = 0.3 (1) P (C = t) = 0.6 (2) Table 1: CPTs for problem 1. (c) P (E B) C P (D = t) f 0.9 t 0.
Probabilistic Artiicial Intelligence Problem Set 3 Oct 27, 2017 1. Variable elimination In this exercise you will use variable elimination to perorm inerence on a bayesian network. Consider the network
More informationConference Article. Spectral Properties of Chaotic Signals Generated by the Bernoulli Map
Jestr Journal o Engineering Science and Technology Review 8 () (05) -6 Special Issue on Synchronization and Control o Chaos: Theory, Methods and Applications Conerence Article JOURNAL OF Engineering Science
More informationarxiv: v1 [gr-qc] 18 Feb 2009 Detecting the Cosmological Stochastic Background of Gravitational Waves with FastICA
1 arxiv:0902.3144v1 [gr-qc] 18 Feb 2009 Detecting the Cosmological Stochastic Background o Gravitational Waves with FastICA Luca Izzo 1,2,3, Salvatore Capozziello 1 and MariaFelicia De Laurentis 1 1 Dipartimento
More information7.1 Sampling and Reconstruction
Haberlesme Sistemlerine Giris (ELE 361) 6 Agustos 2017 TOBB Ekonomi ve Teknoloji Universitesi, Guz 2017-18 Dr. A. Melda Yuksel Turgut & Tolga Girici Lecture Notes Chapter 7 Analog to Digital Conversion
More information( x) f = where P and Q are polynomials.
9.8 Graphing Rational Functions Lets begin with a deinition. Deinition: Rational Function A rational unction is a unction o the orm ( ) ( ) ( ) P where P and Q are polynomials. Q An eample o a simple rational
More informationLecture 13: Applications of Fourier transforms (Recipes, Chapter 13)
Lecture 13: Applications o Fourier transorms (Recipes, Chapter 13 There are many applications o FT, some o which involve the convolution theorem (Recipes 13.1: The convolution o h(t and r(t is deined by
More informationRATIONAL FUNCTIONS. Finding Asymptotes..347 The Domain Finding Intercepts Graphing Rational Functions
RATIONAL FUNCTIONS Finding Asymptotes..347 The Domain....350 Finding Intercepts.....35 Graphing Rational Functions... 35 345 Objectives The ollowing is a list o objectives or this section o the workbook.
More informationIntroduction...2 Chapter Review on probability and random variables Random experiment, sample space and events
Introduction... Chapter...3 Review on probability and random variables...3. Random eperiment, sample space and events...3. Probability definition...7.3 Conditional Probability and Independence...7.4 heorem
More information16.584: Random (Stochastic) Processes
1 16.584: Random (Stochastic) Processes X(t): X : RV : Continuous function of the independent variable t (time, space etc.) Random process : Collection of X(t, ζ) : Indexed on another independent variable
More informationDiscrete Random Variables
CPSC 53 Systems Modeling and Simulation Discrete Random Variables Dr. Anirban Mahanti Department of Computer Science University of Calgary mahanti@cpsc.ucalgary.ca Random Variables A random variable is
More informationGaussian Process Regression Models for Predicting Stock Trends
Gaussian Process Regression Models or Predicting Stock Trends M. Todd Farrell Andrew Correa December 5, 7 Introduction Historical stock price data is a massive amount o time-series data with little-to-no
More informationComments on Problems. 3.1 This problem offers some practice in deriving utility functions from indifference curve specifications.
CHAPTER 3 PREFERENCES AND UTILITY These problems provide some practice in eamining utilit unctions b looking at indierence curve maps and at a ew unctional orms. The primar ocus is on illustrating the
More information18-660: Numerical Methods for Engineering Design and Optimization
8-66: Numerical Methods or Engineering Design and Optimization Xin Li Department o ECE Carnegie Mellon University Pittsburgh, PA 53 Slide Overview Linear Regression Ordinary least-squares regression Minima
More informationStochastic Processes. Monday, November 14, 11
Stochastic Processes 1 Definition and Classification X(, t): stochastic process: X : T! R (, t) X(, t) where is a sample space and T is time. {X(, t) is a family of r.v. defined on {, A, P and indexed
More informationTutorial for Lecture Course on Modelling and System Identification (MSI) Albert-Ludwigs-Universität Freiburg Winter Term
Tutorial for Lecture Course on Modelling and System Identification (MSI) Albert-Ludwigs-Universität Freiburg Winter Term 2016-2017 Tutorial 3: Emergency Guide to Statistics Prof. Dr. Moritz Diehl, Robin
More informationSyllabus Objective: 2.9 The student will sketch the graph of a polynomial, radical, or rational function.
Precalculus Notes: Unit Polynomial Functions Syllabus Objective:.9 The student will sketch the graph o a polynomial, radical, or rational unction. Polynomial Function: a unction that can be written in
More information4 Classical Coherence Theory
This chapter is based largely on Wolf, Introduction to the theory of coherence and polarization of light [? ]. Until now, we have not been concerned with the nature of the light field itself. Instead,
More informationCHAPTER 1: INTRODUCTION. 1.1 Inverse Theory: What It Is and What It Does
Geosciences 567: CHAPTER (RR/GZ) CHAPTER : INTRODUCTION Inverse Theory: What It Is and What It Does Inverse theory, at least as I choose to deine it, is the ine art o estimating model parameters rom data
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More information2. (a) What is gaussian random variable? Develop an equation for guassian distribution
Code No: R059210401 Set No. 1 II B.Tech I Semester Supplementary Examinations, February 2007 PROBABILITY THEORY AND STOCHASTIC PROCESS ( Common to Electronics & Communication Engineering, Electronics &
More informationReview: mostly probability and some statistics
Review: mostly probability and some statistics C2 1 Content robability (should know already) Axioms and properties Conditional probability and independence Law of Total probability and Bayes theorem Random
More informationEAS 305 Random Processes Viewgraph 1 of 10. Random Processes
EAS 305 Random Processes Viewgraph 1 of 10 Definitions: Random Processes A random process is a family of random variables indexed by a parameter t T, where T is called the index set λ i Experiment outcome
More information