Application of Digital Filters

Size: px
Start display at page:

Download "Application of Digital Filters"

Transcription

1 Applicatio of Digital Filters Geerally some filterig of a time series take place as a reslt of the iability of the recordig system to respod to high freqecies. I may cases systems are desiged specifically to respod oly to sigals withi a arrow freqecy bad. Recall a earlier discssio o the physical iterpretatio of the spectral eergy desity fctio. I sch cases the imm freqecy f preset i the recorded time series will be govered by the system respose. Filters of this type which limit the freqecy cotet of the time series i the recordig process are called prefilters. Frther filterig of the data after it is recorded may also be desirable. Optimm Filterig: Removal of o-statioaries The statistical aalysis techiqes discssed ths far are based o a assmptio of the "statioarity" of the radom process. There are several types of o-statioarity amely: that havig to do with the "short-term" mea - a time-domai o-statioarity o-statioarity of the ato-correlatio ad o-statioarity of the spectral eergy desity. Time-domai o-statioarity The discretely sampled versio of the series depicted i Figre IV.14 ( t ) wold have two ostatioarities of the first type becase of the tred ad the log period cycle. These are idetifiable o-statioarities becase as a geeral rle of thmb ay oscillatio with fewer tha 5 cycles over the observatio period T shold be cosidered to be as o-statioary. Ths it is desirable to remove both the tred ad oscillatio. Figre IV.14 A arbitrary oceaic time series (t) with a distict tred. 19 Febrary 2008 A2 Filterig Applicatios 8W. S. Brow 1

2 To remove the tred oe might cosider sig a liear regressio model or otherwise called the AVERAGE SLOPE METHOD or LEAST SQUARES METHOD. Cosider a times series of +1 vales ( = ); sampled at a iterval of t so that t = T - the Legth of Series or LOS Lets fit with a polyomial series û of degree K expressed as û k = û( t) = bk ( t ) K k=0 where e.g. K = 1 û = û( t) = b0 + b1( t) or e.g. K = 2 û t = t where...a liear tred = û( t) = b0 + b1 ( t) + b...a qadradic fit 2 ( t ) = ( t = T) For these polyomial fits the set of coefficiets b k are chose so that the followig expressio is miimized Q(b) = ( - û ) 2 = [ - K k=0 k bk ( t ) ] The coefficiets b k ca be fod by settig the K+1 partial derivatives Q(b) = 0 bk where k is the idex of the coefficiet of iterest eqal to zero. The geeral coditio for a Aproper@fit - the followig K + 1 eqatios 2. K k=0 b k ( t ) k+ l = where R = K. For K = 0 l ( t ) 0 b0 ( t ) = ( t ) where b o is the series sample mea 0 19 Febrary 2008 A2 Filterig Applicatios 8W. S. Brow 2

3 1 b = 0 For K = 1. l 1+ l l b0 ( t ) + b1 ( t ) = ( t ) ( l = 01) which leads to 2(2 +1) - 6 b0 = (-1) Ths ( ) b1 = t ( -1) ( +1) ca be calclated. (The OASP program REGRESS does this) With the first order fit (i.e. the tred) removed becomes accordig to = û( t) = b0 + b ( t) û 1 ad looks like Figre IV.15. = - û Figre IV.15. A time series from which the first order fit (liear tred pls mea) was removed. 19 Febrary 2008 A2 Filterig Applicatios 8W. S. Brow 3

4 Still there is a very low freqecy compoet i the series - like that i Figre IV.16 - that eeds to be removed. Oe approach is to solve for the free parameters (A f ad δ) of the best fit regressio model û^ (t) = A si (ft + δ ). Figre IV.16 A time series that has o-statioary statistics de to the cycle. Sbtractig the fitted sisoid " = - û ^ û ^ from reslts (see Figres IV.17) "(t) Figre IV.17 A statioary time series from which the o-statioarity has bee removed. 19 Febrary 2008 A2 Filterig Applicatios 8W. S. Brow 4

5 The resltig series "(t) appears to be "reasoably statioary". This process for removig ostatioarities is called optimm filterig. This type of filter (i.e. regressio) is called a "oe shot" filter becase it is applied to the etire time series at oe time. Ato-Correlatio o-statioarity Sometimes o-statioarity of the ato-covariace fctio might look like Figre IV.18 Figre IV.18 A sample cross covariace fctio of a o-statioary process. Geerally there is o way to correct for this type of o-statioarity so oe simply igores it. I other cases methods do exist for describig time varyig spectra of data with o-statioarities which are ot removable. (As we will ot be discssig them here see Bedat & Piersol). Sppose we have measred a statioary series t i which the eergy cotet was restricted to freqecies f # f ad the series was sampled at t 1 / 2f (i.e.1/(2 t) = f f ). The we ca compte the sample mea sample variace ad the sample ato-covariace as discssed i Chapter III. The ext estimator of iterest is spectral desity fctio. I priciple the ato-spectral desity fctio ca be compted by Forier trasformig the atocovariace fctio. However becase the fiite legth cotios ato-covariace fctio R ( τ ) (Eq. III.37) ad the discrete ato-covariace fctio ( τ ) (Eq. III.38) are ot defied 19 Febrary 2008 A2 Filterig Applicatios 8W. S. Brow 5 Rˆ

6 for τ > τ they mst be modified before their Forier Trasforms ca be calclated. The followig otlies some approaches. Dealig with Fiite Legth Series Effects Step 1. Costrct a Lag Widow The objective of this step is to costrct a lag widow h(τ) that is defied for all τ from -4 to 4 h(0) =1 ad h( τ ) = 0 for τ > τ (althogh mch of it is zero). Specifically a sitable eve fctio h(τ) is defied sch that (ote that for τ < τ h(τ) ca take o differet forms) Step 2. Form a Ifiite Cotios Ato-Covariace fctio "( τ ) by R "( ) = h( τ ). R τ ( τ ) R Step 3. Trasform "( τ ) to Prodce R S "(f) = H(f) *S i which H(f) is called a spectral widow. Ufortately it too is ot defied as f goes to ifiity. However we arge that by (f) (f) i (IV.29) is idetermiate becase S Step 4. Esemble Averagig which for ergodic processes is Eq. (IV.28) will become jst the weighted versio of the tre atocovariace fctio R (τ) accordig to ave[ ] = lim 1 T T/ 2 -T/ 2 [ ] dt Ths it follows that ave [S ave[r "(f)] = H(f)* S "( τ )] = h( τ ) R (f) tre atospectrm ( τ ) 19 Febrary 2008 A2 Filterig Applicatios 8W. S. Brow 6

7 or by ivokig the defiitio of covoltio is ave[s "(f)] = - S ( α) H(f-α) dα This form shows how H(f) has the effect of smearig eergy across freqecy bads. Ths the average calclated spectrm is eqal to the smoothed versio of the tre spectrm. Remember the previos discssio abot how g(t) [or h(t)] ca be covolved with a time series (t) i the time domai to prodce a smoothed (t) there. Here H(f) smooths the tre ato-spectrm throgh covoltio i the freqecy domai. Take-Home Message: With real fiite legth series we are limited i or ability to resolve freqecy cotet i the series. 19 Febrary 2008 A2 Filterig Applicatios 8W. S. Brow 7

8 Lets explore this poit a bit frther i terms of a lag widow that is defied like or rig mea filter (or boxcar) h( τ ) = 0 =1 for τ > τ for τ τ whose trasform is H(f) = 2τ si(2π f τ 2π f τ ) = 2τ sic(f τ ) The plot of H(f) (i.e. Eq IV.34) i Figre IV.19 shows how H(f) varies withi the fdametal freqecy bad of the spectral estimate betwee -1/2 < (f/ f = f τ ) <1/2 as well as otside of it at f τ > 1/2. ote the "side lobe" strctre icldig regios of positive ad egative vales. H(f) τ f τ (or f/ f) Figre IV.19 ormalized freqecy domai form (i.e. Forier trasform) of the "boxcar"or rectaglar lag widow f = 1/τ 19 Febrary 2008 A2 Filterig Applicatios 8W. S. Brow 8

9 Ths raw estimates of S "(f) are always smoothed versios of the tre spectral desities [i.e. covoltios of the tre spectrm S (f) ad the spectral widow H(f)]. This fact meas that there are two problems amely (1) Eergy Leakage There is leakage of the Atre eergy@ from the basic spectral bad to adjacet spectral bads throgh the effects of the Aside lobes@. (2) Itrodctio of egative Eergy. Oe way to sppress leakage is to modify the box car h(τ) i the time lag domai. However this actio ievitably broades the mai lobe of the lag widow trasform which i tr redces the freqecy resoltio of the process. Ths there are tradeoffs betwee freqecy resoltio ad leakage effects as demostrated i Figre IV.20 for the followig set of lag widows optios for which τ = M τ = M (with τ = 1); Bartlett Widow (triaglar) τ WB =1- for τ < τ (= M) τ = 0 τ > τ (= M) πτ WT ( τ ) =1/ 2 (1+ cos ) for τ < τ (= M) τ = 0 τ > τ (= M) Tkey Widow (cosie) SPECTRAL WIDOW LAG WIDOW 19 Febrary 2008 A2 Filterig Applicatios 8W. S. Brow 9

10 0 1/M 2/M 3/M... f 0 0.5M M Freqecy f ormalized Time (τ/τ ) Figre IV.20 (left) Forier trasforms of the rectaglar ( ) Bartlett ( ) Tkey ( _) ad Parze (----) lag widows (right) Time-domai distribtio of the lag widows with τ = M τ. ote that a decrease i freqecy resoltio is the cost for redcig side lobe eergy spreadig. 1. Power-Spectral Estimates from Ato-Covariace Fctio Estimates: Cosie Trasform For cotios series the tre spectrm is S (f) = - R ( τ ) cos 2π f τ dτ = 2 0 R ( τ ) cos 2π f τ dτ Ths for the fiite ato-covariace the spectrm is τ S "(f) = R ( τ ) -τ which ivolves a implicit lag widow ad problems cos 2π f τ dτ where τ = M τ Alterately. S "(f) = - h( τ ) R ( τ ) cos 2π f τ dτ where a lag widow is ivoked explicitly to deal with the fiite legth ato-covariace fctio. For examples see Figre IV Febrary 2008 A2 Filterig Applicatios 8W. S. Brow 10

11 Optioal Examples: DATA or LAG WIDOWS Optios Available I Specter Ipt Sigal Amplitde Spectrm Figre IV.21 A schematic of the (right) freqecy-domai Forier trasform of varios time-domai widow shapes. 19 Febrary 2008 A2 Filterig Applicatios 8W. S. Brow 11

The z Transform. The Discrete LTI System Response to a Complex Exponential

The z Transform. The Discrete LTI System Response to a Complex Exponential The Trasform The trasform geeralies the Discrete-time Forier Trasform for the etire complex plae. For the complex variable is sed the otatio: jω x+ j y r e ; x, y Ω arg r x + y {} The Discrete LTI System

More information

Introduction. Question: Why do we need new forms of parametric curves? Answer: Those parametric curves discussed are not very geometric.

Introduction. Question: Why do we need new forms of parametric curves? Answer: Those parametric curves discussed are not very geometric. Itrodctio Qestio: Why do we eed ew forms of parametric crves? Aswer: Those parametric crves discssed are ot very geometric. Itrodctio Give sch a parametric form, it is difficlt to kow the derlyig geometry

More information

THE CONSERVATIVE DIFFERENCE SCHEME FOR THE GENERALIZED ROSENAU-KDV EQUATION

THE CONSERVATIVE DIFFERENCE SCHEME FOR THE GENERALIZED ROSENAU-KDV EQUATION Zho, J., et al.: The Coservative Differece Scheme for the Geeralized THERMAL SCIENCE, Year 6, Vol., Sppl. 3, pp. S93-S9 S93 THE CONSERVATIVE DIFFERENCE SCHEME FOR THE GENERALIZED ROSENAU-KDV EQUATION by

More information

LECTURE 13 SPURIOUS REGRESSION, TESTING FOR UNIT ROOT = C (1) C (1) 0! ! uv! 2 v. t=1 X2 t

LECTURE 13 SPURIOUS REGRESSION, TESTING FOR UNIT ROOT = C (1) C (1) 0! ! uv! 2 v. t=1 X2 t APRIL 9, 7 Sprios regressio LECTURE 3 SPURIOUS REGRESSION, TESTING FOR UNIT ROOT I this sectio, we cosider the sitatio whe is oe it root process, say Y t is regressed agaist aother it root process, say

More information

Chapter 10 Advanced Topics in Random Processes

Chapter 10 Advanced Topics in Random Processes ery Stark ad Joh W. Woods, Probability, Statistics, ad Radom Variables for Egieers, 4th ed., Pearso Educatio Ic.,. ISBN 978--3-33-6 Chapter Advaced opics i Radom Processes Sectios. Mea-Square (m.s.) Calculus

More information

1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series.

1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series. .3 Covergece Theorems of Fourier Series I this sectio, we preset the covergece of Fourier series. A ifiite sum is, by defiitio, a limit of partial sums, that is, a cos( kx) b si( kx) lim a cos( kx) b si(

More information

PH 411/511 ECE B(k) Sin k (x) dk (1)

PH 411/511 ECE B(k) Sin k (x) dk (1) Fall-26 PH 4/5 ECE 598 A. La Rosa Homework-2 Due -3-26 The Homework is iteded to gai a uderstadig o the Heiseberg priciple, based o a compariso betwee the width of a pulse ad the width of its spectral

More information

Chapter 11 Output Analysis for a Single Model. Banks, Carson, Nelson & Nicol Discrete-Event System Simulation

Chapter 11 Output Analysis for a Single Model. Banks, Carson, Nelson & Nicol Discrete-Event System Simulation Chapter Output Aalysis for a Sigle Model Baks, Carso, Nelso & Nicol Discrete-Evet System Simulatio Error Estimatio If {,, } are ot statistically idepedet, the S / is a biased estimator of the true variace.

More information

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course Sigal-EE Postal Correspodece Course 1 SAMPLE STUDY MATERIAL Electrical Egieerig EE / EEE Postal Correspodece Course GATE, IES & PSUs Sigal System Sigal-EE Postal Correspodece Course CONTENTS 1. SIGNAL

More information

PH 411/511 ECE B(k) Sin k (x) dk (1)

PH 411/511 ECE B(k) Sin k (x) dk (1) Fall-27 PH 4/5 ECE 598 A. La Rosa Homework-3 Due -7-27 The Homework is iteded to gai a uderstadig o the Heiseberg priciple, based o a compariso betwee the width of a pulse ad the width of its spectral

More information

TIME-CORRELATION FUNCTIONS

TIME-CORRELATION FUNCTIONS p. 8 TIME-CORRELATION FUNCTIONS Time-correlatio fuctios are a effective way of represetig the dyamics of a system. They provide a statistical descriptio of the time-evolutio of a variable for a esemble

More information

and the sum of its first n terms be denoted by. Convergence: An infinite series is said to be convergent if, a definite unique number., finite.

and the sum of its first n terms be denoted by. Convergence: An infinite series is said to be convergent if, a definite unique number., finite. INFINITE SERIES Seqece: If a set of real mbers a seqece deoted by * + * Or * + * occr accordig to some defiite rle, the it is called + if is fiite + if is ifiite Series: is called a series ad is deoted

More information

Introduction to Signals and Systems, Part V: Lecture Summary

Introduction to Signals and Systems, Part V: Lecture Summary EEL33: Discrete-Time Sigals ad Systems Itroductio to Sigals ad Systems, Part V: Lecture Summary Itroductio to Sigals ad Systems, Part V: Lecture Summary So far we have oly looked at examples of o-recursive

More information

LINEARIZATION OF NONLINEAR EQUATIONS By Dominick Andrisani. dg x. ( ) ( ) dx

LINEARIZATION OF NONLINEAR EQUATIONS By Dominick Andrisani. dg x. ( ) ( ) dx LINEAIZATION OF NONLINEA EQUATIONS By Domiick Adrisai A. Liearizatio of Noliear Fctios A. Scalar fctios of oe variable. We are ive the oliear fctio (). We assme that () ca be represeted si a Taylor series

More information

Coordinate Systems. Things to think about:

Coordinate Systems. Things to think about: Coordiate Sstems There are 3 coordiate sstems that a compter graphics programmer is most cocered with: the Object Coordiate Sstem (OCS), the World Coordiate Sstem (WCS), ad the Camera Coordiate Sstem (CCS).

More information

MAT2400 Assignment 2 - Solutions

MAT2400 Assignment 2 - Solutions MAT24 Assigmet 2 - Soltios Notatio: For ay fctio f of oe real variable, f(a + ) deotes the limit of f() whe teds to a from above (if it eists); i.e., f(a + ) = lim t a + f(t). Similarly, f(a ) deotes the

More information

The z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j

The z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j The -Trasform 7. Itroductio Geeralie the complex siusoidal represetatio offered by DTFT to a represetatio of complex expoetial sigals. Obtai more geeral characteristics for discrete-time LTI systems. 7.

More information

Partial Differential Equations

Partial Differential Equations EE 84 Matematical Metods i Egieerig Partial Differetial Eqatios Followig are some classical partial differetial eqatios were is assmed to be a fctio of two or more variables t (time) ad y (spatial coordiates).

More information

6. Cox Regression Models. (Part I)

6. Cox Regression Models. (Part I) 6. Cox Regressio Models (Part I) The Proportioal Hazards Model A proportioal hazards model proposed by D.R. Cox (197) assmes that λ t z = λ 0 t e β 1z 1 + +β p z p = λ 0 t e zt β where z is a p 1 vector

More information

In this document, if A:

In this document, if A: m I this docmet, if A: is a m matrix, ref(a) is a row-eqivalet matrix i row-echelo form sig Gassia elimiatio with partial pivotig as described i class. Ier prodct ad orthogoality What is the largest possible

More information

FIR Filters. Lecture #7 Chapter 5. BME 310 Biomedical Computing - J.Schesser

FIR Filters. Lecture #7 Chapter 5. BME 310 Biomedical Computing - J.Schesser FIR Filters Lecture #7 Chapter 5 8 What Is this Course All About? To Gai a Appreciatio of the Various Types of Sigals ad Systems To Aalyze The Various Types of Systems To Lear the Skills ad Tools eeded

More information

FIR Filter Design: Part II

FIR Filter Design: Part II EEL335: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we cosider how we might go about desigig FIR filters with arbitrary frequecy resposes, through compositio of multiple sigle-peak

More information

Approximation of the Likelihood Ratio Statistics in Competing Risks Model Under Informative Random Censorship From Both Sides

Approximation of the Likelihood Ratio Statistics in Competing Risks Model Under Informative Random Censorship From Both Sides Approimatio of the Lielihood Ratio Statistics i Competig Riss Model Uder Iformative Radom Cesorship From Both Sides Abdrahim A. Abdshrov Natioal Uiversity of Uzbeista Departmet of Theory Probability ad

More information

Approximations and more PMFs and PDFs

Approximations and more PMFs and PDFs Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.

More information

too many conditions to check!!

too many conditions to check!! Vector Spaces Aioms of a Vector Space closre Defiitio : Let V be a o empty set of vectors with operatios : i. Vector additio :, v є V + v є V ii. Scalar mltiplicatio: li є V k є V where k is scalar. The,

More information

Chapter 7: The z-transform. Chih-Wei Liu

Chapter 7: The z-transform. Chih-Wei Liu Chapter 7: The -Trasform Chih-Wei Liu Outlie Itroductio The -Trasform Properties of the Regio of Covergece Properties of the -Trasform Iversio of the -Trasform The Trasfer Fuctio Causality ad Stability

More information

Spring 2014, EE123 Digital Signal Processing

Spring 2014, EE123 Digital Signal Processing Aoucemets EE3 Digital Sigal Processig Last time: FF oday: Frequecy aalysis with DF Widowig Effect of zero-paddig Lecture 9 based o slides by J.M. Kah Spectral Aalysis with the DF Spectral Aalysis with

More information

EXISTENCE OF CONCENTRATED WAVES FOR THE DIFFERENT TYPE OF NONLINEARITY. V. Eremenko and N. Manaenkova

EXISTENCE OF CONCENTRATED WAVES FOR THE DIFFERENT TYPE OF NONLINEARITY. V. Eremenko and N. Manaenkova EXISTENCE OF CONCENTRATED WAVES FOR THE DIFFERENT TYPE OF NONLINEARITY. V. Eremeko ad N. Maaekova Istitte of Terrestrial Magetism, Ioosphere ad Radio Wave Propagatio Rssia Academy of Sciece E-mail: at_ma@mail.r

More information

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3 MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special

More information

6.867 Machine learning, lecture 7 (Jaakkola) 1

6.867 Machine learning, lecture 7 (Jaakkola) 1 6.867 Machie learig, lecture 7 (Jaakkola) 1 Lecture topics: Kerel form of liear regressio Kerels, examples, costructio, properties Liear regressio ad kerels Cosider a slightly simpler model where we omit

More information

Describing Function: An Approximate Analysis Method

Describing Function: An Approximate Analysis Method Describig Fuctio: A Approximate Aalysis Method his chapter presets a method for approximately aalyzig oliear dyamical systems A closed-form aalytical solutio of a oliear dyamical system (eg, a oliear differetial

More information

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense, 3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [

More information

Discrete-Time Systems, LTI Systems, and Discrete-Time Convolution

Discrete-Time Systems, LTI Systems, and Discrete-Time Convolution EEL5: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we begi our mathematical treatmet of discrete-time s. As show i Figure, a discrete-time operates or trasforms some iput sequece x [

More information

Machine Learning for Data Science (CS 4786)

Machine Learning for Data Science (CS 4786) Machie Learig for Data Sciece CS 4786) Lecture & 3: Pricipal Compoet Aalysis The text i black outlies high level ideas. The text i blue provides simple mathematical details to derive or get to the algorithm

More information

Discrete Fourier Transform. Ajit Rajwade CS 663

Discrete Fourier Transform. Ajit Rajwade CS 663 Discrete orier Trasform Ajit Rajwade CS 663 orier Trasform Yo have so far stdied the orier trasform of a 1D or D cotios aalog fctio. The fctios we deal with i practical sigal or image processig are however

More information

Lesson 10: Limits and Continuity

Lesson 10: Limits and Continuity www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals

More information

Statistical Noise Models and Diagnostics

Statistical Noise Models and Diagnostics L. Yaroslavsky: Advaced Image Processig Lab: A Tutorial, EUSIPCO2 LECTURE 2 Statistical oise Models ad Diagostics 2. Statistical models of radom iterfereces: (i) Additive sigal idepedet oise model: r =

More information

A. Basics of Discrete Fourier Transform

A. Basics of Discrete Fourier Transform A. Basics of Discrete Fourier Trasform A.1. Defiitio of Discrete Fourier Trasform (8.5) A.2. Properties of Discrete Fourier Trasform (8.6) A.3. Spectral Aalysis of Cotiuous-Time Sigals Usig Discrete Fourier

More information

Control Charts. Introduction. Purpose and benefit: UCL (upper control limit) UWL (upper warning limit) Quality feature

Control Charts. Introduction. Purpose and benefit: UCL (upper control limit) UWL (upper warning limit) Quality feature Qality featre Cotrol Charts Itrodctio A Cotrol Chart shows the time corse of a process characteristic. For this prpose, data ca be take cotiosly or i periodic samples. The prereqisite is that the process

More information

Frequency Domain Filtering

Frequency Domain Filtering Frequecy Domai Filterig Raga Rodrigo October 19, 2010 Outlie Cotets 1 Itroductio 1 2 Fourier Represetatio of Fiite-Duratio Sequeces: The Discrete Fourier Trasform 1 3 The 2-D Discrete Fourier Trasform

More information

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. Comments:

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. Comments: Recall: STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Commets:. So far we have estimates of the parameters! 0 ad!, but have o idea how good these estimates are. Assumptio: E(Y x)! 0 +! x (liear coditioal

More information

Regression. Correlation vs. regression. The parameters of linear regression. Regression assumes... Random sample. Y = α + β X.

Regression. Correlation vs. regression. The parameters of linear regression. Regression assumes... Random sample. Y = α + β X. Regressio Correlatio vs. regressio Predicts Y from X Liear regressio assumes that the relatioship betwee X ad Y ca be described by a lie Regressio assumes... Radom sample Y is ormally distributed with

More information

Discrete-Time Signals and Systems. Signals and Systems. Digital Signals. Discrete-Time Signals. Operations on Sequences: Basic Operations

Discrete-Time Signals and Systems. Signals and Systems. Digital Signals. Discrete-Time Signals. Operations on Sequences: Basic Operations -6.3 Digital Sigal Processig ad Filterig..8 Discrete-ime Sigals ad Systems ime-domai Represetatios of Discrete-ime Sigals ad Systems ime-domai represetatio of a discrete-time sigal as a sequece of umbers

More information

Fig. 2. Block Diagram of a DCS

Fig. 2. Block Diagram of a DCS Iformatio source Optioal Essetial From other sources Spread code ge. Format A/D Source ecode Ecrypt Auth. Chael ecode Pulse modu. Multiplex Badpass modu. Spread spectrum modu. X M m i Digital iput Digital

More information

The Method of Least Squares. To understand least squares fitting of data.

The Method of Least Squares. To understand least squares fitting of data. The Method of Least Squares KEY WORDS Curve fittig, least square GOAL To uderstad least squares fittig of data To uderstad the least squares solutio of icosistet systems of liear equatios 1 Motivatio Curve

More information

Open problem in orthogonal polynomials

Open problem in orthogonal polynomials Ope problem i orthogoal polyomials Abdlaziz D. Alhaidari Sadi Ceter for Theoretical Physics, P.O. Box 374, Jeddah 438, Sadi Arabia E-mail: haidari@sctp.org.sa URL: http://www.sctp.org.sa/haidari Abstract:

More information

Outline. n Introduction. u Task analysis u Network Representations. n From Task Analysis to Network Representations

Outline. n Introduction. u Task analysis u Network Representations. n From Task Analysis to Network Representations Start Search me Move crsor toward me Doble click o chose optio Otlie Itrodctio Bildig Models from Task Aalysis Task aalysis Network Represetatios From Task Aalysis to Network Represetatios Costrctig a

More information

from definition we note that for sequences which are zero for n < 0, X[z] involves only negative powers of z.

from definition we note that for sequences which are zero for n < 0, X[z] involves only negative powers of z. We ote that for the past four examples we have expressed the -trasform both as a ratio of polyomials i ad as a ratio of polyomials i -. The questio is how does oe kow which oe to use? [] X ] from defiitio

More information

Spectral Analysis. This week in lab. Next classes: 3/26 and 3/28. Your next experiment Homework is to prepare

Spectral Analysis. This week in lab. Next classes: 3/26 and 3/28. Your next experiment Homework is to prepare Spectral Aalysis This week i lab Your ext experimet Homework is to prepare Next classes: 3/26 ad 3/28 Aero Testig, Fracture Toughess Testig Read the Experimets 5 ad 7 sectios of the course maual Spectral

More information

P-SERIES AND INTEGRAL TEST

P-SERIES AND INTEGRAL TEST P-SERIES AND INTEGRAL TEST Sectio 9.3 Calcls BC AP/Dal, Revised 08 viet.dag@hmbleisd.et /4/08 0:8 PM 9.3: p-series ad Itegral Test SUMMARY OF TESTS FOR SERIES Lookig at the first few terms of the seqece

More information

Histogram of a population

Histogram of a population Histogram of a poplatio Let X be a set of N data samples with qatized scalar vales i { 0, 1,, L 1 } (may be samples from a cotios fctio (t) :, ad X, for example, the height of N adlts, pixels with graylevels

More information

Mathematical Statistics - MS

Mathematical Statistics - MS Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios

More information

Apply change-of-basis formula to rewrite x as a linear combination of eigenvectors v j.

Apply change-of-basis formula to rewrite x as a linear combination of eigenvectors v j. Eigevalue-Eigevector Istructor: Nam Su Wag eigemcd Ay vector i real Euclidea space of dimesio ca be uiquely epressed as a liear combiatio of liearly idepedet vectors (ie, basis) g j, j,,, α g α g α g α

More information

Numerical Methods for Finding Multiple Solutions of a Superlinear Problem

Numerical Methods for Finding Multiple Solutions of a Superlinear Problem ISSN 1746-7659, Eglad, UK Joral of Iformatio ad Comptig Sciece Vol 2, No 1, 27, pp 27- Nmerical Methods for Fidig Mltiple Soltios of a Sperliear Problem G A Afrozi +, S Mahdavi, Z Naghizadeh Departmet

More information

32 estimating the cumulative distribution function

32 estimating the cumulative distribution function 32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio

More information

Circle the single best answer for each multiple choice question. Your choice should be made clearly.

Circle the single best answer for each multiple choice question. Your choice should be made clearly. TEST #1 STA 4853 March 6, 2017 Name: Please read the followig directios. DO NOT TURN THE PAGE UNTIL INSTRUCTED TO DO SO Directios This exam is closed book ad closed otes. There are 32 multiple choice questios.

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Statistics 910, #19 1. Spectral Estimation. 1. Representation of the discrete Fourier transform

Statistics 910, #19 1. Spectral Estimation. 1. Representation of the discrete Fourier transform Statistics 910, #19 1 Overview Spectral Estimatio 1. Represetatio of the discrete Fourier trasform 2. Periodogram 3. Leakage ad taperig 4. Cosistet estimators 5. Multi-taper estimators Discrete Fourier

More information

Chapter 4 : Laplace Transform

Chapter 4 : Laplace Transform 4. Itroductio Laplace trasform is a alterative to solve the differetial equatio by the complex frequecy domai ( s = σ + jω), istead of the usual time domai. The DE ca be easily trasformed ito a algebraic

More information

Linear Regression Demystified

Linear Regression Demystified Liear Regressio Demystified Liear regressio is a importat subject i statistics. I elemetary statistics courses, formulae related to liear regressio are ofte stated without derivatio. This ote iteds to

More information

Signals & Systems Chapter3

Signals & Systems Chapter3 Sigals & Systems Chapter3 1.2 Discrete-Time (D-T) Sigals Electroic systems do most of the processig of a sigal usig a computer. A computer ca t directly process a C-T sigal but istead eeds a stream of

More information

Signal Processing in Mechatronics

Signal Processing in Mechatronics Sigal Processig i Mechatroics Zhu K.P. AIS, UM. Lecture, Brief itroductio to Sigals ad Systems, Review of Liear Algebra ad Sigal Processig Related Mathematics . Brief Itroductio to Sigals What is sigal

More information

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet

More information

Chapter 7 z-transform

Chapter 7 z-transform Chapter 7 -Trasform Itroductio Trasform Uilateral Trasform Properties Uilateral Trasform Iversio of Uilateral Trasform Determiig the Frequecy Respose from Poles ad Zeros Itroductio Role i Discrete-Time

More information

Appendix: The Laplace Transform

Appendix: The Laplace Transform Appedix: The Laplace Trasform The Laplace trasform is a powerful method that ca be used to solve differetial equatio, ad other mathematical problems. Its stregth lies i the fact that it allows the trasformatio

More information

Bivariate Sample Statistics Geog 210C Introduction to Spatial Data Analysis. Chris Funk. Lecture 7

Bivariate Sample Statistics Geog 210C Introduction to Spatial Data Analysis. Chris Funk. Lecture 7 Bivariate Sample Statistics Geog 210C Itroductio to Spatial Data Aalysis Chris Fuk Lecture 7 Overview Real statistical applicatio: Remote moitorig of east Africa log rais Lead up to Lab 5-6 Review of bivariate/multivariate

More information

Gaussian Processes, Multivariate Probability Density Function, Transforms

Gaussian Processes, Multivariate Probability Density Function, Transforms Gassia Processes, Mltivariate Probabilit Desit Fctio, rasfors A realvaled rado process Xt is called a Gassia process, if all of its thorder joit probabilit desit fctios are variate Gassia pdfs. he thorder

More information

The Maximum-Likelihood Decoding Performance of Error-Correcting Codes

The Maximum-Likelihood Decoding Performance of Error-Correcting Codes The Maximum-Lielihood Decodig Performace of Error-Correctig Codes Hery D. Pfister ECE Departmet Texas A&M Uiversity August 27th, 2007 (rev. 0) November 2st, 203 (rev. ) Performace of Codes. Notatio X,

More information

Linear time invariant systems

Linear time invariant systems Liear time ivariat systems Alejadro Ribeiro Dept. of Electrical ad Systems Egieerig Uiversity of Pesylvaia aribeiro@seas.upe.edu http://www.seas.upe.edu/users/~aribeiro/ February 25, 2016 Sigal ad Iformatio

More information

Lecture 11 Simple Linear Regression

Lecture 11 Simple Linear Regression Lecture 11 Simple Liear Regressio Fall 2013 Prof. Yao Xie, yao.xie@isye.gatech.edu H. Milto Stewart School of Idustrial Systems & Egieerig Georgia Tech Midterm 2 mea: 91.2 media: 93.75 std: 6.5 2 Meddicorp

More information

2D DSP Basics: 2D Systems

2D DSP Basics: 2D Systems - Digital Image Processig ad Compressio D DSP Basics: D Systems D Systems T[ ] y = T [ ] Liearity Additivity: If T y = T [ ] The + T y = y + y Homogeeity: If The T y = T [ ] a T y = ay = at [ ] Liearity

More information

Jacob Hays Amit Pillay James DeFelice 4.1, 4.2, 4.3

Jacob Hays Amit Pillay James DeFelice 4.1, 4.2, 4.3 No-Parametric Techiques Jacob Hays Amit Pillay James DeFelice 4.1, 4.2, 4.3 Parametric vs. No-Parametric Parametric Based o Fuctios (e.g Normal Distributio) Uimodal Oly oe peak Ulikely real data cofies

More information

Calculus 2 Quiz 1 Review / Fall 2011

Calculus 2 Quiz 1 Review / Fall 2011 Calcls Qiz Review / Fall 0 () The fctio is f a the iterval is [, ]. Here are two formlas yo may ee. ( ) ( ) ( ) 6 (a.) Use a left-e, right-e, a mipoit sm of "" rectagles to approimate. The withs of all

More information

On Arithmetic Means of Sequences Generated by a Periodic Function

On Arithmetic Means of Sequences Generated by a Periodic Function Caad Math Bll Vol 4 () 1999 pp 184 189 O Arithmetic Meas of Seqeces Geerated by a Periodic Fctio Giovai Fiorito Abstract I this paper we prove the covergece of arithmetic meas of seqeces geerated by a

More information

The Growth of Functions. Theoretical Supplement

The Growth of Functions. Theoretical Supplement The Growth of Fuctios Theoretical Supplemet The Triagle Iequality The triagle iequality is a algebraic tool that is ofte useful i maipulatig absolute values of fuctios. The triagle iequality says that

More information

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic

More information

Chapter 10: Power Series

Chapter 10: Power Series Chapter : Power Series 57 Chapter Overview: Power Series The reaso series are part of a Calculus course is that there are fuctios which caot be itegrated. All power series, though, ca be itegrated because

More information

Worksheet 23 ( ) Introduction to Simple Linear Regression (continued)

Worksheet 23 ( ) Introduction to Simple Linear Regression (continued) Worksheet 3 ( 11.5-11.8) Itroductio to Simple Liear Regressio (cotiued) This worksheet is a cotiuatio of Discussio Sheet 3; please complete that discussio sheet first if you have ot already doe so. This

More information

Sequences. Notation. Convergence of a Sequence

Sequences. Notation. Convergence of a Sequence Sequeces A sequece is essetially just a list. Defiitio (Sequece of Real Numbers). A sequece of real umbers is a fuctio Z (, ) R for some real umber. Do t let the descriptio of the domai cofuse you; it

More information

Estimation of the Mean and the ACVF

Estimation of the Mean and the ACVF Chapter 5 Estimatio of the Mea ad the ACVF A statioary process {X t } is characterized by its mea ad its autocovariace fuctio γ ), ad so by the autocorrelatio fuctio ρ ) I this chapter we preset the estimators

More information

Trading Friction Noise 1

Trading Friction Noise 1 Ecoomics 883 Sprig 205 Tauche Tradig Frictio Noise Setup Let Y be the usual cotiuous semi-martigale Y t = t 0 cs dw s We will cosider jump discotiuities later. The usual setup for modelig tradig frictio

More information

MAT1026 Calculus II Basic Convergence Tests for Series

MAT1026 Calculus II Basic Convergence Tests for Series MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

Orthogonal Gaussian Filters for Signal Processing

Orthogonal Gaussian Filters for Signal Processing Orthogoal Gaussia Filters for Sigal Processig Mark Mackezie ad Kiet Tieu Mechaical Egieerig Uiversity of Wollogog.S.W. Australia Abstract A Gaussia filter usig the Hermite orthoormal series of fuctios

More information

ACO Comprehensive Exam 9 October 2007 Student code A. 1. Graph Theory

ACO Comprehensive Exam 9 October 2007 Student code A. 1. Graph Theory 1. Graph Theory Prove that there exist o simple plaar triagulatio T ad two distict adjacet vertices x, y V (T ) such that x ad y are the oly vertices of T of odd degree. Do ot use the Four-Color Theorem.

More information

Run-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE

Run-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE Geeral e Image Coder Structure Motio Video (s 1,s 2,t) or (s 1,s 2 ) Natural Image Samplig A form of data compressio; usually lossless, but ca be lossy Redudacy Removal Lossless compressio: predictive

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

More information

Sequences, Series, and All That

Sequences, Series, and All That Chapter Te Sequeces, Series, ad All That. Itroductio Suppose we wat to compute a approximatio of the umber e by usig the Taylor polyomial p for f ( x) = e x at a =. This polyomial is easily see to be 3

More information

Distribution of Random Samples & Limit theorems

Distribution of Random Samples & Limit theorems STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to

More information

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

PHYC - 505: Statistical Mechanics Homework Assignment 4 Solutions

PHYC - 505: Statistical Mechanics Homework Assignment 4 Solutions PHYC - 55: Statistical Mechaics Homewor Assigmet 4 Solutios Due February 5, 14 1. Cosider a ifiite classical chai of idetical masses coupled by earest eighbor sprigs with idetical sprig costats. a Write

More information

S Y Y = ΣY 2 n. Using the above expressions, the correlation coefficient is. r = SXX S Y Y

S Y Y = ΣY 2 n. Using the above expressions, the correlation coefficient is. r = SXX S Y Y 1 Sociology 405/805 Revised February 4, 004 Summary of Formulae for Bivariate Regressio ad Correlatio Let X be a idepedet variable ad Y a depedet variable, with observatios for each of the values of these

More information

II. Descriptive Statistics D. Linear Correlation and Regression. 1. Linear Correlation

II. Descriptive Statistics D. Linear Correlation and Regression. 1. Linear Correlation II. Descriptive Statistics D. Liear Correlatio ad Regressio I this sectio Liear Correlatio Cause ad Effect Liear Regressio 1. Liear Correlatio Quatifyig Liear Correlatio The Pearso product-momet correlatio

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

Math 113 Exam 3 Practice

Math 113 Exam 3 Practice Math Exam Practice Exam 4 will cover.-., 0. ad 0.. Note that eve though. was tested i exam, questios from that sectios may also be o this exam. For practice problems o., refer to the last review. This

More information

Ch3 Discrete Time Fourier Transform

Ch3 Discrete Time Fourier Transform Ch3 Discrete Time Fourier Trasform 3. Show that the DTFT of [] is give by ( k). e k 3. Determie the DTFT of the two sided sigal y [ ],. 3.3 Determie the DTFT of the causal sequece x[ ] A cos( 0 ) [ ],

More information

Random Signals and Noise Winter Semester 2017 Problem Set 12 Wiener Filter Continuation

Random Signals and Noise Winter Semester 2017 Problem Set 12 Wiener Filter Continuation Radom Sigals ad Noise Witer Semester 7 Problem Set Wieer Filter Cotiuatio Problem (Sprig, Exam A) Give is the sigal W t, which is a Gaussia white oise with expectatio zero ad power spectral desity fuctio

More information

Basics of Probability Theory (for Theory of Computation courses)

Basics of Probability Theory (for Theory of Computation courses) Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.

More information

ST 305: Exam 3 ( ) = P(A)P(B A) ( ) = P(A) + P(B) ( ) = 1 P( A) ( ) = P(A) P(B) σ X 2 = σ a+bx. σ ˆp. σ X +Y. σ X Y. σ X. σ Y. σ n.

ST 305: Exam 3 ( ) = P(A)P(B A) ( ) = P(A) + P(B) ( ) = 1 P( A) ( ) = P(A) P(B) σ X 2 = σ a+bx. σ ˆp. σ X +Y. σ X Y. σ X. σ Y. σ n. ST 305: Exam 3 By hadig i this completed exam, I state that I have either give or received assistace from aother perso durig the exam period. I have used o resources other tha the exam itself ad the basic

More information