Signal Detection and Estimation

Size: px
Start display at page:

Download "Signal Detection and Estimation"

Transcription

1 394 based on the criteria o the unbiased and minimum variance estimator but rather on minimizing the squared dierence between the given data and the assumed signal data. We concluded the chapter with a brie section on recursive leastsquare estimation. PROBLEMS 6.1 Let Y 1 Y Y be the observed random variables such that Y a bx Z 1 The constants 1 are nown while the constants a and b are x not nown. The random variables 1 are statisticall independent each with zero mean and variance estimate o (a b). Z nown. Obtain the ML 6. Let Y be a Gaussian random variable with mean zero and variance. (a) Obtain the ML estimates o and. (b) Are the estimates eicient? 6.3 Let Y 1 and Y be two statisticall independent Gaussian random variables such that E[ Y1 ] m E[ Y ] 3m and var[ Y 1] var[ Y ] 1; m is unnown. (a) Obtain the ML estimates o m. (b) I the estimator o m is o the orm a1y1 b1y determine a 1 and a so that the estimator is unbiased. 6.4 The observation sample o the envelope o a received signal is given b the ollowing exponential distribution 1 Y ( ) exp 1 is an unnown parameter and the observations are statisticall independent. (a) Obtain the ML estimate o. (b) Is the estimator unbiased? (c) Determine the lower bound on the estimator. (d) Is the estimator consistent?

2 Parameter Estimation Let the observation Y satis the binomial law such that the densit unction o Y is (a) Find an unbiased estimate or p. (b) Is the estimate consistent? Y n n ( ) p p (1 ) n 6.6 Obtain the ML estimates o the mean m and variance observations Y 1 Y Y such that 1 m Y ( ) exp 1 or the independent 6.7 Let x be an unnown deterministic parameter that can have an value in the interval [ 11]. Suppose we tae two observations o x with independent samples o zero-mean Gaussian noise and with variance each o the observations. (a) Obtain the ML estimate o x. (b) Is xˆ ml unbiased? superimposed on 6.8 LetY 1 Y Y be independent observed random variables each having a Poisson distribution given b Y ( ) e! 0 1. The parameter is unnown. (a) Obtain the ML estimate o. (b) Veri that the estimator is unbiased and determine the lower bound. 6.9 Let Y 1 Y Y be independent and identicall distributed observations. The observations are uniorml distributed between and where is an unnown parameter to be estimated. (a) Obtain the MLE o. (b) How is the estimator unbiased?

3 Let Y 1 Y Y be independent variables with P( Y 1) p and P( Y 0) 1 p where p 0 p 1 is unnown. (a) Obtain the ML estimate. (b) Determine the lower bound on the variance o the estimator assuming that the estimator is unbiased Find xˆ ms the minimum mean-square error and xˆ map the maximum a posteriori estimators o rom the observations Y N and N are random variables with densit unctions 1 ( x) [( x 1) ( x 1)] and N 1 x exp 6.1 The conditional densit unction o the observed random variable Y given a random parameter is given b Y xe ( x) 0 x 0 and 0 x 0 The a priori probabilit densit unction o is r ( x) ( r) 0 x r1 e x x 0 x 0 where is a parameter r is a positive integer and (r ) is the gamma unction. (a) Obtain the a priori mean and variance o. (b) For Y given 1. Obtain the minimum mean-square error estimate o.. What is the variance o this estimate? (c) Suppose we tae independent observations o Y 1 such that Y ( xe x) 0 x 0 and 0 x 0

4 Parameter Estimation Determine the minimum mean-square error estimate o.. What is the variance o this estimate? (d) Veri i the MAP estimate equals the MMSE estimate Consider the problem where the observation is given b Y ln N where is the parameter to be estimated. is uniorml distributed over the interval [ 01] and N has an exponential distribution given b N e 0 n n 0 Obtain (a) The mean-square estimate xˆ ms. (b) The MAP estimate xˆ map. (c) The MAVE estimate xˆ mave The observation Y is given b Y N where and N are two random variables. N is normal with mean one and variance and is uniorml distributed over the interval [0 ]. Determine the MAP estimate o the parameter Show that the mean-square estimation ˆ ms E[ ] commutes over a linear transormation Suppose that the joint densit unction o the observation Y and the parameter is Gaussian. The means m and m are assumed to be zero. can then be expressed as a linear orm o the data. Determine an expression or the conditional densit Y ( ) Consider the problem o estimating a parameter rom one observation Y. Then Y N where and the noise N are statisticall independent with and 0 N n 0 0 n Determine ˆ blue the best linear unbiased estimate o.

5 398 Reerences [1] Van Trees H. L. Detection Estimation and Modulation Theor Part I New Yor: John Wile and Sons 1968 p. 95. [] Vaseghi S. V. Advanced Digital Signal Processing and Noise Reduction New Yor: John Wile and Sons 000. [3] Sorenson H. W. Parameter Estimation: Principles and Problems New Yor: Marcel Deer Selected Bibliograph Dudewicz E. J. Introduction to Statistics and Probabilit New Yor: Holt Rinehart and Winston Gevers M. and L Vandendorpe Processus Statistiques Estimation et Prédiction Université Catholique de Louvain Hain S. Adaptive Filter Theor Englewood Clis NJ: Prentice Hall Helstrom C. W. Elements o Englewood Clis NJ: Prentice Hall a S. M. Fundamentals o Statistical Signal Processing: Estimation Theor Englewood Clis NJ: Prentice Hall Lewis T. O. and P. L. Odell Estimation in Linear Models Englewood Clis NJ: Prentice Hall Mohant N. Signal Processing: Signals Filtering and Detection New Yor: Van Nostrand Reinhold Sage A. P. and J. L. Melsa Estimation Theor with Applications to Communications and Control New Yor: McGraw-Hill Shanmugan. S. and A. M. Breipohl Random Signals: Detection Estimation and Data Analsis New Yor: John Wile and Sons Srinath M. D. and P.. Rajasearan An Introduction to Statistical Signal Processing with Applications New Yor: John Wile and Sons Star H. and J. W. Woods Probabilit Random Processes and Estimation Theor or Engineers Englewood Clis NJ: Prentice Hall 1986 Urowitz H. Signal Theor and Random Processes Dedham MA: Artech House Whalen A. D. Detection o Signals in Noise New Yor: Academic Press 1971.

1036: Probability & Statistics

1036: Probability & Statistics 1036: Probabilit & Statistics Lecture 4 Mathematical pectation Prob. & Stat. Lecture04 - mathematical epectation cwliu@twins.ee.nctu.edu.tw 4-1 Mean o a Random Variable Let be a random variable with probabilit

More information

Butterworth Filter Properties

Butterworth Filter Properties OpenStax-CNX module: m693 Butterworth Filter Properties C. Sidney Burrus This work is produced by OpenStax-CNX and licensed under the Creative Commons Attribution License 3. This section develops the properties

More information

A UNIFIED FRAMEWORK FOR MULTICHANNEL FAST QRD-LS ADAPTIVE FILTERS BASED ON BACKWARD PREDICTION ERRORS

A UNIFIED FRAMEWORK FOR MULTICHANNEL FAST QRD-LS ADAPTIVE FILTERS BASED ON BACKWARD PREDICTION ERRORS A UNIFIED FRAMEWORK FOR MULTICHANNEL FAST QRD-LS ADAPTIVE FILTERS BASED ON BACKWARD PREDICTION ERRORS César A Medina S,José A Apolinário Jr y, and Marcio G Siqueira IME Department o Electrical Engineering

More information

Treatment and analysis of data Applied statistics Lecture 6: Bayesian estimation

Treatment and analysis of data Applied statistics Lecture 6: Bayesian estimation Treatment and analysis o data Applied statistics Lecture 6: Bayesian estimation Topics covered: Bayes' Theorem again Relation to Likelihood Transormation o pd A trivial example Wiener ilter Malmquist bias

More information

VISION TRACKING PREDICTION

VISION TRACKING PREDICTION VISION RACKING PREDICION Eri Cuevas,2, Daniel Zaldivar,2, and Raul Rojas Institut für Informati, Freie Universität Berlin, ausstr 9, D-495 Berlin, German el 0049-30-83852485 2 División de Electrónica Computación,

More information

3. Several Random Variables

3. Several Random Variables . Several Random Variables. Two Random Variables. Conditional Probabilit--Revisited. Statistical Independence.4 Correlation between Random Variables. Densit unction o the Sum o Two Random Variables. Probabilit

More information

R Based Probability Distributions

R Based Probability Distributions General Comments R Based Probability Distributions When a parameter name is ollowed by an equal sign, the value given is the deault. Consider a random variable that has the range, a x b. The parameter,

More information

PARAMETER ESTIMATION AND ORDER SELECTION FOR LINEAR REGRESSION PROBLEMS. Yngve Selén and Erik G. Larsson

PARAMETER ESTIMATION AND ORDER SELECTION FOR LINEAR REGRESSION PROBLEMS. Yngve Selén and Erik G. Larsson PARAMETER ESTIMATION AND ORDER SELECTION FOR LINEAR REGRESSION PROBLEMS Yngve Selén and Eri G Larsson Dept of Information Technology Uppsala University, PO Box 337 SE-71 Uppsala, Sweden email: yngveselen@ituuse

More information

Review of Elementary Probability Lecture I Hamid R. Rabiee

Review of Elementary Probability Lecture I Hamid R. Rabiee Stochastic Processes Review o Elementar Probabilit Lecture I Hamid R. Rabiee Outline Histor/Philosoph Random Variables Densit/Distribution Functions Joint/Conditional Distributions Correlation Important

More information

EE-597 Notes Quantization

EE-597 Notes Quantization EE-597 Notes Quantization Phil Schniter June, 4 Quantization Given a continuous-time and continuous-amplitude signal (t, processing and storage by modern digital hardware requires discretization in both

More information

Computer Vision & Digital Image Processing

Computer Vision & Digital Image Processing Computer Vision & Digital Image Processing Image Restoration and Reconstruction I Dr. D. J. Jackson Lecture 11-1 Image restoration Restoration is an objective process that attempts to recover an image

More information

Estimation of the Vehicle Sideslip Angle by Means of the State Dependent Riccati Equation Technique

Estimation of the Vehicle Sideslip Angle by Means of the State Dependent Riccati Equation Technique Proceedings o the World Congress on Engineering 7 Vol II WCE 7, Jul 5-7, 7, London, U.K. Estimation o the Vehicle Sideslip Angle b Means o the State Dependent Riccati Equation Technique S. Strano, M. Terzo

More information

Basic concepts in estimation

Basic concepts in estimation Basic concepts in estimation Random and nonrandom parameters Definitions of estimates ML Maimum Lielihood MAP Maimum A Posteriori LS Least Squares MMS Minimum Mean square rror Measures of quality of estimates

More information

SIMON FRASER UNIVERSITY School of Engineering Science

SIMON FRASER UNIVERSITY School of Engineering Science SIMON FRASER UNIVERSITY School of Engineering Science Course Outline ENSC 810-3 Digital Signal Processing Calendar Description This course covers advanced digital signal processing techniques. The main

More information

CRAMÉR-RAO BOUNDS FOR RADAR ALTIMETER WAVEFORMS. Corinne Mailhes (1), Jean-Yves Tourneret (1), Jérôme Severini (1), and Pierre Thibaut (2)

CRAMÉR-RAO BOUNDS FOR RADAR ALTIMETER WAVEFORMS. Corinne Mailhes (1), Jean-Yves Tourneret (1), Jérôme Severini (1), and Pierre Thibaut (2) CRAMÉR-RAO BOUNDS FOR RADAR ALTIMETER WAVEFORMS Corinne Mailhes (1, Jean-Yves Tourneret (1, Jérôme Severini (1, and Pierre Thibaut ( (1 University of Toulouse, IRIT-ENSEEIHT-TéSA, Toulouse, France ( Collecte

More information

Inference about the Slope and Intercept

Inference about the Slope and Intercept Inference about the Slope and Intercept Recall, we have established that the least square estimates and 0 are linear combinations of the Y i s. Further, we have showed that the are unbiased and have the

More information

Estimation and Test Statistic in Bivariate Probit Model ( r c)

Estimation and Test Statistic in Bivariate Probit Model ( r c) J Basic Appl Sci Res, (3)78-88, 0 00, extroad Publication ISSN 090-44X Journal of Basic and Applied Scientific Research wwwtextroadcom Estimation and est Statistic in Bivariate Probit Model ( r c) Vita

More information

Cramér-Rao Bounds for Estimation of Linear System Noise Covariances

Cramér-Rao Bounds for Estimation of Linear System Noise Covariances Journal of Mechanical Engineering and Automation (): 6- DOI: 593/jjmea Cramér-Rao Bounds for Estimation of Linear System oise Covariances Peter Matiso * Vladimír Havlena Czech echnical University in Prague

More information

Particle Filters. Outline

Particle Filters. Outline Particle Filters M. Sami Fadali Professor of EE University of Nevada Outline Monte Carlo integration. Particle filter. Importance sampling. Degeneracy Resampling Example. 1 2 Monte Carlo Integration Numerical

More information

POLYNOMIAL EXPANSION OF THE PROBABILITY DENSITY FUNCTION ABOUT GAUSSIAN MIXTURES

POLYNOMIAL EXPANSION OF THE PROBABILITY DENSITY FUNCTION ABOUT GAUSSIAN MIXTURES POLYNOMIAL EXPANSION OF THE PROBABILITY DENSITY FUNCTION ABOUT GAUSSIAN MIXTURES Charles C. Cavalcante, J. C. M. Mota and J. M. T. Romano GTEL/DETI/CT/UFC C.P. 65, Campus do Pici, CEP: 6.455-76 Fortaleza-CE,

More information

Detection & Estimation Lecture 1

Detection & Estimation Lecture 1 Detection & Estimation Lecture 1 Intro, MVUE, CRLB Xiliang Luo General Course Information Textbooks & References Fundamentals of Statistical Signal Processing: Estimation Theory/Detection Theory, Steven

More information

Lessons in Estimation Theory for Signal Processing, Communications, and Control

Lessons in Estimation Theory for Signal Processing, Communications, and Control Lessons in Estimation Theory for Signal Processing, Communications, and Control Jerry M. Mendel Department of Electrical Engineering University of Southern California Los Angeles, California PRENTICE HALL

More information

6. Vector Random Variables

6. Vector Random Variables 6. Vector Random Variables In the previous chapter we presented methods for dealing with two random variables. In this chapter we etend these methods to the case of n random variables in the following

More information

Design of FIR Smoother Using Covariance Information for Estimating Signal at Start Time in Linear Continuous Systems

Design of FIR Smoother Using Covariance Information for Estimating Signal at Start Time in Linear Continuous Systems Systems Science and Applied Mathematics Vol. 1 No. 3 2016 pp. 29-37 http://www.aiscience.org/journal/ssam Design of FIR Smoother Using Covariance Information for Estimating Signal at Start Time in Linear

More information

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 2016 MODULE 1 : Probability distributions Time allowed: Three hours Candidates should answer FIVE questions. All questions carry equal marks.

More information

Detection & Estimation Lecture 1

Detection & Estimation Lecture 1 Detection & Estimation Lecture 1 Intro, MVUE, CRLB Xiliang Luo General Course Information Textbooks & References Fundamentals of Statistical Signal Processing: Estimation Theory/Detection Theory, Steven

More information

A HOMOTOPY CLASS OF SEMI-RECURSIVE CHAIN LADDER MODELS

A HOMOTOPY CLASS OF SEMI-RECURSIVE CHAIN LADDER MODELS A HOMOTOPY CLASS OF SEMI-RECURSIVE CHAIN LADDER MODELS Greg Taylor Taylor Fry Consulting Actuaries Level, 55 Clarence Street Sydney NSW 2000 Australia Professorial Associate Centre for Actuarial Studies

More information

3. Several Random Variables

3. Several Random Variables . Several Random Variables. To Random Variables. Conditional Probabilit--Revisited. Statistical Independence.4 Correlation beteen Random Variables Standardied (or ero mean normalied) random variables.5

More information

Variations. ECE 6540, Lecture 10 Maximum Likelihood Estimation

Variations. ECE 6540, Lecture 10 Maximum Likelihood Estimation Variations ECE 6540, Lecture 10 Last Time BLUE (Best Linear Unbiased Estimator) Formulation Advantages Disadvantages 2 The BLUE A simplification Assume the estimator is a linear system For a single parameter

More information

EDGES AND CONTOURS(1)

EDGES AND CONTOURS(1) KOM31 Image Processing in Industrial Sstems Dr Muharrem Mercimek 1 EDGES AND CONTOURS1) KOM31 Image Processing in Industrial Sstems Some o the contents are adopted rom R. C. Gonzalez, R. E. Woods, Digital

More information

Fault Detection and Diagnosis Using Information Measures

Fault Detection and Diagnosis Using Information Measures Fault Detection and Diagnosis Using Information Measures Rudolf Kulhavý Honewell Technolog Center & Institute of Information Theor and Automation Prague, Cech Republic Outline Probabilit-based inference

More information

2 Statistical Estimation: Basic Concepts

2 Statistical Estimation: Basic Concepts Technion Israel Institute of Technology, Department of Electrical Engineering Estimation and Identification in Dynamical Systems (048825) Lecture Notes, Fall 2009, Prof. N. Shimkin 2 Statistical Estimation:

More information

ADAPTIVE INVERSE CONTROL BASED ON NONLINEAR ADAPTIVE FILTERING. Information Systems Lab., EE Dep., Stanford University

ADAPTIVE INVERSE CONTROL BASED ON NONLINEAR ADAPTIVE FILTERING. Information Systems Lab., EE Dep., Stanford University ADAPTIVE INVERSE CONTROL BASED ON NONLINEAR ADAPTIVE FILTERING Bernard Widrow 1, Gregory Plett, Edson Ferreira 3 and Marcelo Lamego 4 Information Systems Lab., EE Dep., Stanford University Abstract: Many

More information

SPOC: An Innovative Beamforming Method

SPOC: An Innovative Beamforming Method SPOC: An Innovative Beamorming Method Benjamin Shapo General Dynamics Ann Arbor, MI ben.shapo@gd-ais.com Roy Bethel The MITRE Corporation McLean, VA rbethel@mitre.org ABSTRACT The purpose o a radar or

More information

A NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1

A NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1 A NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1 Jinglin Zhou Hong Wang, Donghua Zhou Department of Automation, Tsinghua University, Beijing 100084, P. R. China Control Systems Centre,

More information

Applied Probability and Stochastic Processes

Applied Probability and Stochastic Processes Applied Probability and Stochastic Processes In Engineering and Physical Sciences MICHEL K. OCHI University of Florida A Wiley-Interscience Publication JOHN WILEY & SONS New York - Chichester Brisbane

More information

ECE 3800 Probabilistic Methods of Signal and System Analysis

ECE 3800 Probabilistic Methods of Signal and System Analysis ECE 3800 Probabilistic Methods of Signal and System Analysis Dr. Bradley J. Bazuin Western Michigan University College of Engineering and Applied Sciences Department of Electrical and Computer Engineering

More information

ON INTERVENED NEGATIVE BINOMIAL DISTRIBUTION AND SOME OF ITS PROPERTIES

ON INTERVENED NEGATIVE BINOMIAL DISTRIBUTION AND SOME OF ITS PROPERTIES STATISTICA, anno LII, n. 4, 01 ON INTERVENED NEGATIVE BINOMIAL DISTRIBUTION AND SOME OF ITS PROPERTIES 1. INTRODUCTION Since 1985, intervened tpe distributions have received much attention in the literature.

More information

Reliability and Quality Mathematics

Reliability and Quality Mathematics Reliability and Quality Mathematics. Introduction Since mathematics has played a pivotal role in the development of quality and reliability fields, it is essential to have a clear understanding of the

More information

THE GAMMA FUNCTION THU NGỌC DƯƠNG

THE GAMMA FUNCTION THU NGỌC DƯƠNG THE GAMMA FUNCTION THU NGỌC DƯƠNG The Gamma unction was discovered during the search or a actorial analog deined on real numbers. This paper will explore the properties o the actorial unction and use them

More information

State estimation of linear dynamic system with unknown input and uncertain observation using dynamic programming

State estimation of linear dynamic system with unknown input and uncertain observation using dynamic programming Control and Cybernetics vol. 35 (2006) No. 4 State estimation of linear dynamic system with unknown input and uncertain observation using dynamic programming by Dariusz Janczak and Yuri Grishin Department

More information

A Matrix Theoretic Derivation of the Kalman Filter

A Matrix Theoretic Derivation of the Kalman Filter A Matrix Theoretic Derivation of the Kalman Filter 4 September 2008 Abstract This paper presents a matrix-theoretic derivation of the Kalman filter that is accessible to students with a strong grounding

More information

ELEG 3143 Probability & Stochastic Process Ch. 4 Multiple Random Variables

ELEG 3143 Probability & Stochastic Process Ch. 4 Multiple Random Variables Department o Electrical Engineering University o Arkansas ELEG 3143 Probability & Stochastic Process Ch. 4 Multiple Random Variables Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Two discrete random variables

More information

1. (Regular) Exponential Family

1. (Regular) Exponential Family 1. (Regular) Exponential Family The density function of a regular exponential family is: [ ] Example. Poisson(θ) [ ] Example. Normal. (both unknown). ) [ ] [ ] [ ] [ ] 2. Theorem (Exponential family &

More information

Random Error Analysis of Inertial Sensors output Based on Allan Variance Shaochen Li1, a, Xiaojing Du2,b and Junyi Zhai3,c

Random Error Analysis of Inertial Sensors output Based on Allan Variance Shaochen Li1, a, Xiaojing Du2,b and Junyi Zhai3,c International Conerence on Civil, Transportation and Environment (ICCTE 06) Random Error Analysis o Inertial Sensors output Based on Allan Variance Shaochen Li, a, Xiaojing Du, and Junyi Zhai3,c School

More information

10. Joint Moments and Joint Characteristic Functions

10. Joint Moments and Joint Characteristic Functions 10. Joint Moments and Joint Characteristic Functions Following section 6, in this section we shall introduce various parameters to compactly represent the inormation contained in the joint p.d. o two r.vs.

More information

Multiscale Principal Components Analysis for Image Local Orientation Estimation

Multiscale Principal Components Analysis for Image Local Orientation Estimation Multiscale Principal Components Analsis for Image Local Orientation Estimation XiaoGuang Feng Peman Milanfar Computer Engineering Electrical Engineering Universit of California, Santa Cruz Universit of

More information

The problem we are interest in this lecture is that of estimating the value of an n{

The problem we are interest in this lecture is that of estimating the value of an n{ Chapter 4 Introduction to Estimation Theory 4. Concepts of Probabilistic Estimation The problem we are interest in this lecture is that of estimating the value of an n{ dimensional vector of parameters

More information

Joint ] X 5) P[ 6) P[ (, ) = y 2. x 1. , y. , ( x, y ) 2, (

Joint ] X 5) P[ 6) P[ (, ) = y 2. x 1. , y. , ( x, y ) 2, ( Two-dimensional Random Vectors Joint Cumulative Distrib bution Functio n F, (, ) P[ and ] Properties: ) F, (, ) = ) F, 3) F, F 4), (, ) = F 5) P[ < 6) P[ < (, ) is a non-decreasing unction (, ) = F ( ),,,

More information

Implicit Second Derivative Hybrid Linear Multistep Method with Nested Predictors for Ordinary Differential Equations

Implicit Second Derivative Hybrid Linear Multistep Method with Nested Predictors for Ordinary Differential Equations American Scientiic Research Journal or Engineering, Technolog, and Sciences (ASRJETS) ISSN (Print) -44, ISSN (Online) -44 Global Societ o Scientiic Research and Researchers http://asretsournal.org/ Implicit

More information

PROBABILITY AND STOCHASTIC PROCESSES A Friendly Introduction for Electrical and Computer Engineers

PROBABILITY AND STOCHASTIC PROCESSES A Friendly Introduction for Electrical and Computer Engineers PROBABILITY AND STOCHASTIC PROCESSES A Friendly Introduction for Electrical and Computer Engineers Roy D. Yates Rutgers, The State University ofnew Jersey David J. Goodman Rutgers, The State University

More information

Continuous RVs. 1. Suppose a random variable X has the following probability density function: π, zero otherwise. f ( x ) = sin x, 0 < x < 2

Continuous RVs. 1. Suppose a random variable X has the following probability density function: π, zero otherwise. f ( x ) = sin x, 0 < x < 2 STAT 4 Exam I Continuous RVs Fall 7 Practice. Suppose a random variable X has the following probability density function: f ( x ) = sin x, < x < π, zero otherwise. a) Find P ( X < 4 π ). b) Find µ = E

More information

Review of Probability

Review of Probability Review of robabilit robabilit Theor: Man techniques in speech processing require the manipulation of probabilities and statistics. The two principal application areas we will encounter are: Statistical

More information

Outline. Random Variables. Examples. Random Variable

Outline. Random Variables. Examples. Random Variable Outline Random Variables M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno Random variables. CDF and pdf. Joint random variables. Correlated, independent, orthogonal. Correlation,

More information

1. Definition: Order Statistics of a sample.

1. Definition: Order Statistics of a sample. AMS570 Order Statistics 1. Deinition: Order Statistics o a sample. Let X1, X2,, be a random sample rom a population with p.d.. (x). Then, 2. p.d.. s or W.L.O.G.(W thout Loss o Ge er l ty), let s ssu e

More information

For final project discussion every afternoon Mark and I will be available

For final project discussion every afternoon Mark and I will be available Worshop report 1. Daniels report is on website 2. Don t expect to write it based on listening to one project (we had 6 only 2 was sufficient quality) 3. I suggest writing it on one presentation. 4. Include

More information

Mini-Course 07 Kalman Particle Filters. Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra

Mini-Course 07 Kalman Particle Filters. Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra Mini-Course 07 Kalman Particle Filters Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra Agenda State Estimation Problems & Kalman Filter Henrique Massard Steady State

More information

Low order continuous-time filters for approximation of the ISO human vibration sensitivity weightings

Low order continuous-time filters for approximation of the ISO human vibration sensitivity weightings Journal o Sound and Vibration 265 (23) 459 465 JOURNAL OF SOUND AND VIBRATION www.elsevier.com/locate/jsvi Letter to the Editor Low order continuous-time ilters or approximation o the ISO 263- human vibration

More information

A Note on the Scale Efficiency Test of Simar and Wilson

A Note on the Scale Efficiency Test of Simar and Wilson International Journal of Business Social Science Vol. No. 4 [Special Issue December 0] Abstract A Note on the Scale Efficiency Test of Simar Wilson Hédi Essid Institut Supérieur de Gestion Université de

More information

Module 2. Random Processes. Version 2, ECE IIT, Kharagpur

Module 2. Random Processes. Version 2, ECE IIT, Kharagpur Module Random Processes Version, ECE IIT, Kharagpur Lesson 9 Introduction to Statistical Signal Processing Version, ECE IIT, Kharagpur After reading this lesson, you will learn about Hypotheses testing

More information

Least-Squares Spectral Analysis Theory Summary

Least-Squares Spectral Analysis Theory Summary Least-Squares Spectral Analysis Theory Summary Reerence: Mtamakaya, J. D. (2012). Assessment o Atmospheric Pressure Loading on the International GNSS REPRO1 Solutions Periodic Signatures. Ph.D. dissertation,

More information

Envelope PDF in Multipath Fading Channels with Random Number of Paths and Nonuniform Phase Distributions

Envelope PDF in Multipath Fading Channels with Random Number of Paths and Nonuniform Phase Distributions Envelope PDF in Multipath Fading Channels with andom umber of Paths and onuniform Phase Distributions ALI ABDI AD MOSTAFA KAVEH DEPT. OF ELEC. AD COMP. EG., UIVESITY OF MIESOTA 4-74 EE/CSCI BLDG., UIO

More information

ECE 3800 Probabilistic Methods of Signal and System Analysis

ECE 3800 Probabilistic Methods of Signal and System Analysis ECE 3800 Probabilistic Methods of Signal and System Analysis Dr. Bradley J. Bazuin Western Michigan University College of Engineering and Applied Sciences Department of Electrical and Computer Engineering

More information

Calculating the Required Number of Bits in the Function of Confidence Level and Error Probability Estimation

Calculating the Required Number of Bits in the Function of Confidence Level and Error Probability Estimation SERBIA JOURAL OF ELECTRICAL EGIEERIG Vol. 9, o. 3, October 2012, 361-375 UDK: 621.391:004.7]:519.213 DOI: 10.2298/SJEE1203361M Calculating the Required umber of Bits in the Function of Confidence Level

More information

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA THE ROYAL STATISTICAL SOCIETY 4 EXAINATIONS SOLUTIONS GRADUATE DIPLOA PAPER I STATISTICAL THEORY & ETHODS The Societ provides these solutions to assist candidates preparing for the examinations in future

More information

Least Squares. Ken Kreutz-Delgado (Nuno Vasconcelos) ECE 175A Winter UCSD

Least Squares. Ken Kreutz-Delgado (Nuno Vasconcelos) ECE 175A Winter UCSD Least Squares Ken Kreutz-Delgado (Nuno Vasconcelos) ECE 75A Winter 0 - UCSD (Unweighted) Least Squares Assume linearity in the unnown, deterministic model parameters Scalar, additive noise model: y f (

More information

Parametric Inference Maximum Likelihood Inference Exponential Families Expectation Maximization (EM) Bayesian Inference Statistical Decison Theory

Parametric Inference Maximum Likelihood Inference Exponential Families Expectation Maximization (EM) Bayesian Inference Statistical Decison Theory Statistical Inference Parametric Inference Maximum Likelihood Inference Exponential Families Expectation Maximization (EM) Bayesian Inference Statistical Decison Theory IP, José Bioucas Dias, IST, 2007

More information

Square Estimation by Matrix Inverse Lemma 1

Square Estimation by Matrix Inverse Lemma 1 Proof of Two Conclusions Associated Linear Minimum Mean Square Estimation b Matri Inverse Lemma 1 Jianping Zheng State e Lab of IS, Xidian Universit, Xi an, 7171, P. R. China jpzheng@idian.edu.cn Ma 6,

More information

ON MÜNTZ RATIONAL APPROXIMATION IN MULTIVARIABLES

ON MÜNTZ RATIONAL APPROXIMATION IN MULTIVARIABLES C O L L O Q U I U M M A T H E M A T I C U M VOL. LXVIII 1995 FASC. 1 O MÜTZ RATIOAL APPROXIMATIO I MULTIVARIABLES BY S. P. Z H O U EDMOTO ALBERTA The present paper shows that or any s sequences o real

More information

The Kalman Filter. Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience. Sarah Dance

The Kalman Filter. Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience. Sarah Dance The Kalman Filter Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience Sarah Dance School of Mathematical and Physical Sciences, University of Reading s.l.dance@reading.ac.uk July

More information

MODULE 6 LECTURE NOTES 1 REVIEW OF PROBABILITY THEORY. Most water resources decision problems face the risk of uncertainty mainly because of the

MODULE 6 LECTURE NOTES 1 REVIEW OF PROBABILITY THEORY. Most water resources decision problems face the risk of uncertainty mainly because of the MODULE 6 LECTURE NOTES REVIEW OF PROBABILITY THEORY INTRODUCTION Most water resources decision problems ace the risk o uncertainty mainly because o the randomness o the variables that inluence the perormance

More information

The optimal filtering of a class of dynamic multiscale systems

The optimal filtering of a class of dynamic multiscale systems Science in China Ser. F Information Sciences 2004 Vol.47 No.4 50 57 50 he optimal filtering of a class of dynamic multiscale systems PAN Quan, ZHANG Lei, CUI Peiling & ZHANG Hongcai Department of Automatic

More information

Two-dimensional Random Vectors

Two-dimensional Random Vectors 1 Two-dimensional Random Vectors Joint Cumulative Distribution Function (joint cd) [ ] F, ( x, ) P xand Properties: 1) F, (, ) = 1 ),, F (, ) = F ( x, ) = 0 3) F, ( x, ) is a non-decreasing unction 4)

More information

Estimation, Detection, and Identification CMU 18752

Estimation, Detection, and Identification CMU 18752 Estimation, Detection, and Identification CMU 18752 Graduate Course on the CMU/Portugal ECE PhD Program Spring 2008/2009 Instructor: Prof. Paulo Jorge Oliveira pjcro @ isr.ist.utl.pt Phone: +351 21 8418053

More information

Deccan Education Society s FERGUSSON COLLEGE, PUNE (AUTONOMOUS) SYLLABUS UNDER AUTOMONY. SECOND YEAR B.Sc. SEMESTER - III

Deccan Education Society s FERGUSSON COLLEGE, PUNE (AUTONOMOUS) SYLLABUS UNDER AUTOMONY. SECOND YEAR B.Sc. SEMESTER - III Deccan Education Society s FERGUSSON COLLEGE, PUNE (AUTONOMOUS) SYLLABUS UNDER AUTOMONY SECOND YEAR B.Sc. SEMESTER - III SYLLABUS FOR S. Y. B. Sc. STATISTICS Academic Year 07-8 S.Y. B.Sc. (Statistics)

More information

Prediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother

Prediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother Prediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother Simo Särkkä, Aki Vehtari and Jouko Lampinen Helsinki University of Technology Department of Electrical and Communications

More information

Maximum Likelihood Diffusive Source Localization Based on Binary Observations

Maximum Likelihood Diffusive Source Localization Based on Binary Observations Maximum Lielihood Diffusive Source Localization Based on Binary Observations Yoav Levinboo and an F. Wong Wireless Information Networing Group, University of Florida Gainesville, Florida 32611-6130, USA

More information

Least-Squares Independence Test

Least-Squares Independence Test IEICE Transactions on Information and Sstems, vol.e94-d, no.6, pp.333-336,. Least-Squares Independence Test Masashi Sugiama Toko Institute of Technolog, Japan PRESTO, Japan Science and Technolog Agenc,

More information

Estimation techniques

Estimation techniques Estimation techniques March 2, 2006 Contents 1 Problem Statement 2 2 Bayesian Estimation Techniques 2 2.1 Minimum Mean Squared Error (MMSE) estimation........................ 2 2.1.1 General formulation......................................

More information

OBSERVER/KALMAN AND SUBSPACE IDENTIFICATION OF THE UBC BENCHMARK STRUCTURAL MODEL

OBSERVER/KALMAN AND SUBSPACE IDENTIFICATION OF THE UBC BENCHMARK STRUCTURAL MODEL OBSERVER/KALMAN AND SUBSPACE IDENTIFICATION OF THE UBC BENCHMARK STRUCTURAL MODEL Dionisio Bernal, Burcu Gunes Associate Proessor, Graduate Student Department o Civil and Environmental Engineering, 7 Snell

More information

Random Variables and Their Distributions

Random Variables and Their Distributions Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital

More information

Physics 5153 Classical Mechanics. Solution by Quadrature-1

Physics 5153 Classical Mechanics. Solution by Quadrature-1 October 14, 003 11:47:49 1 Introduction Physics 5153 Classical Mechanics Solution by Quadrature In the previous lectures, we have reduced the number o eective degrees o reedom that are needed to solve

More information

ESE 524 Detection and Estimation Theory

ESE 524 Detection and Estimation Theory ESE 524 Detection and Estimation heory Joseh A. O Sullivan Samuel C. Sachs Professor Electronic Systems and Signals Research Laboratory Electrical and Systems Engineering Washington University 2 Urbauer

More information

Figure 3.1 Effect on frequency spectrum of increasing period T 0. Consider the amplitude spectrum of a periodic waveform as shown in Figure 3.2.

Figure 3.1 Effect on frequency spectrum of increasing period T 0. Consider the amplitude spectrum of a periodic waveform as shown in Figure 3.2. 3. Fourier ransorm From Fourier Series to Fourier ransorm [, 2] In communication systems, we oten deal with non-periodic signals. An extension o the time-requency relationship to a non-periodic signal

More information

ω 0 = 2π/T 0 is called the fundamental angular frequency and ω 2 = 2ω 0 is called the

ω 0 = 2π/T 0 is called the fundamental angular frequency and ω 2 = 2ω 0 is called the he ime-frequency Concept []. Review of Fourier Series Consider the following set of time functions {3A sin t, A sin t}. We can represent these functions in different ways by plotting the amplitude versus

More information

Bayesian Approach 2. CSC412 Probabilistic Learning & Reasoning

Bayesian Approach 2. CSC412 Probabilistic Learning & Reasoning CSC412 Probabilistic Learning & Reasoning Lecture 12: Bayesian Parameter Estimation February 27, 2006 Sam Roweis Bayesian Approach 2 The Bayesian programme (after Rev. Thomas Bayes) treats all unnown quantities

More information

U- FUNCTION IN APPLICATIONS

U- FUNCTION IN APPLICATIONS Ushaov I. U-FUNKTION IN ALIATIONS RT&A # 0 6 Vol.7 0 September U- FUNTION IN ALIATIONS Igor Ushaov Sun Diego aliornia e-mail: igusha@gmail.com The ethod o Universal Generating Functions U-unctions was

More information

ECE 5615/4615 Computer Project

ECE 5615/4615 Computer Project Set #1p Due Friday March 17, 017 ECE 5615/4615 Computer Project The details of this first computer project are described below. This being a form of take-home exam means that each person is to do his/her

More information

EE 574 Detection and Estimation Theory Lecture Presentation 8

EE 574 Detection and Estimation Theory Lecture Presentation 8 Lecture Presentation 8 Aykut HOCANIN Dept. of Electrical and Electronic Engineering 1/14 Chapter 3: Representation of Random Processes 3.2 Deterministic Functions:Orthogonal Representations For a finite-energy

More information

The Unscented Particle Filter

The Unscented Particle Filter The Unscented Particle Filter Rudolph van der Merwe (OGI) Nando de Freitas (UC Bereley) Arnaud Doucet (Cambridge University) Eric Wan (OGI) Outline Optimal Estimation & Filtering Optimal Recursive Bayesian

More information

Density Estimation: ML, MAP, Bayesian estimation

Density Estimation: ML, MAP, Bayesian estimation Density Estimation: ML, MAP, Bayesian estimation CE-725: Statistical Pattern Recognition Sharif University of Technology Spring 2013 Soleymani Outline Introduction Maximum-Likelihood Estimation Maximum

More information

Topics in Probability Theory and Stochastic Processes Steven R. Dunbar. Stirling s Formula in Real and Complex Variables

Topics in Probability Theory and Stochastic Processes Steven R. Dunbar. Stirling s Formula in Real and Complex Variables Steven R. Dunbar Department of Mathematics 203 Aver Hall Universit of Nebraska-Lincoln Lincoln, NE 68588-0130 http://www.math.unl.edu Voice: 402-472-3731 Fax: 402-472-8466 Topics in Probabilit Theor and

More information

11. Generalized Linear Models: An Introduction

11. Generalized Linear Models: An Introduction Sociolog 740 John Fox Lecture Notes 11. Generalized Linear Models: An Introduction Generalized Linear Models: An Introduction 1 1. Introduction I A snthesis due to Nelder and Wedderburn, generalized linear

More information

Taylor series based nite dierence approximations of higher-degree derivatives

Taylor series based nite dierence approximations of higher-degree derivatives Journal of Computational and Applied Mathematics 54 (3) 5 4 www.elsevier.com/locate/cam Taylor series based nite dierence approximations of higher-degree derivatives Ishtiaq Rasool Khan a;b;, Ryoji Ohba

More information

SIO 211B, Rudnick. We start with a definition of the Fourier transform! ĝ f of a time series! ( )

SIO 211B, Rudnick. We start with a definition of the Fourier transform! ĝ f of a time series! ( ) SIO B, Rudnick! XVIII.Wavelets The goal o a wavelet transorm is a description o a time series that is both requency and time selective. The wavelet transorm can be contrasted with the well-known and very

More information

Information, Covariance and Square-Root Filtering in the Presence of Unknown Inputs 1

Information, Covariance and Square-Root Filtering in the Presence of Unknown Inputs 1 Katholiee Universiteit Leuven Departement Eletrotechnie ESAT-SISTA/TR 06-156 Information, Covariance and Square-Root Filtering in the Presence of Unnown Inputs 1 Steven Gillijns and Bart De Moor 2 October

More information

Parametric Techniques Lecture 3

Parametric Techniques Lecture 3 Parametric Techniques Lecture 3 Jason Corso SUNY at Buffalo 22 January 2009 J. Corso (SUNY at Buffalo) Parametric Techniques Lecture 3 22 January 2009 1 / 39 Introduction In Lecture 2, we learned how to

More information

SPRING 2007 EXAM C SOLUTIONS

SPRING 2007 EXAM C SOLUTIONS SPRING 007 EXAM C SOLUTIONS Question #1 The data are already shifted (have had the policy limit and the deductible of 50 applied). The two 350 payments are censored. Thus the likelihood function is L =

More information

t x 1 e t dt, and simplify the answer when possible (for example, when r is a positive even number). In particular, confirm that EX 4 = 3.

t x 1 e t dt, and simplify the answer when possible (for example, when r is a positive even number). In particular, confirm that EX 4 = 3. Mathematical Statistics: Homewor problems General guideline. While woring outside the classroom, use any help you want, including people, computer algebra systems, Internet, and solution manuals, but mae

More information

ROBUST CLOCK SYNCHRONIZATION IN WIRELESS SENSOR NETWORKS. A Thesis SAWIN SAIBUA

ROBUST CLOCK SYNCHRONIZATION IN WIRELESS SENSOR NETWORKS. A Thesis SAWIN SAIBUA ROBUST CLOCK SYNCHRONIZATION IN WIRELESS SENSOR NETWORKS A Thesis by SAWIN SAIBUA Submitted to the Office of Graduate Studies of Texas A&M University in partial fulfillment of the requirements for the

More information