Bioengineering 280A Principles of Biomedical Imaging. Fall Quarter 2004 Lecture 2 Linear Systems. Topics

Size: px
Start display at page:

Download "Bioengineering 280A Principles of Biomedical Imaging. Fall Quarter 2004 Lecture 2 Linear Systems. Topics"

Transcription

1 Bioegieerig 280A Priciples of Biomedical Imagig Fall Quarter 2004 Lecture 2 Liear Systems Topics 1. Liearity 2. Impulse Respose ad Delta fuctios 3. Superpositio Itegral 4. Shift Ivariace 5. 1D ad 2D covolutio 6. Examples. 1

2 Sigals ad Images Discrete-time/space sigal/image: cotiuous valued fuctio with a discrete time/space idex, deoted as s[] for 1D, s[m,] for 2D, etc. Cotiuous-time/space sigal/image: cotiuous valued fuctio with a cotiuous time/space idex, deoted as s(t) or s(x) for 1D, s(x,y) for 2D, etc. m t y x x Liearity (Additio) I 1 (x,y) R(I) K 1 (x,y) I 2 (x,y) R(I) K 2 (x,y) I 1 (x,y)+ I 2 (x,y) R(I) K 1 (x,y) +K 2 (x,y) 2

3 Liearity (Scalig) I 1 (x,y) R(I) K 1 (x,y) a 1 I 1 (x,y) R(I) a 1 K 1 (x,y) Liearity A system R is liear if for two iputs I 1 (x,y) ad I 2 (x,y) with outputs R(I 1 (x,y))=k 1 (x,y) ad R(I 2 (x,y))=k 2 (x,y) the respose to the weighted sum of iputs is the weighted sum of outputs: R(a 1 I 1 (x,y)+ a 2 I 2 (x,y))=a 1 K 1 (x,y)+ a 2 K 2 (x,y) 3

4 Example Are these liear systems? g(x,y) + g(x,y)+10 g(x,y) X 10g(x,y) g(x,y) Move up By 1 Move right By 1 g(x-1,y-1) Rectagle Fuctio Π(x) = 0 x >1/2 1 1 x 1/2-1/2 1/2 x Also called rect(x) y 1/2 Π(x, y) = Π(x)Π(y) -1/2 1/2-1/2 x 4

5 Kroecker Delta Fuctio δ[] = 1 for = 0 0 otherwise δ[] 0 0 δ[-2] Kroecker Delta Fuctio 1 for m = 0, = 0 δ[m,] = 0 otherwise δ[m,] δ[m-2,] δ[m,-2] δ[m-2,-2] 5

6 Discrete Sigal Expasio g[] = g[k]δ[ k] g[m,] = g[] k= k= l= g[k,l]δ[m k, l] δ[] 0 -δ[-1] 0 1.5δ[-2] 0 Dirac Delta Fuctio Notatio : δ(x) - 1D Dirac Delta Fuctio δ(x, y) or 2 δ(x, y) - 2D Dirac Delta Fuctio δ(x, y,z) or 3 δ(x, y,z) - 3D Dirac Delta Fuctio δ( r ) - N Dimesioal Dirac Delta Fuctio 6

7 1D Dirac Delta Fuctio δ(x) = 0 whe x 0 ad δ(x)dx =1 Ca iterpret the itegral as a limit of the itegral of a ordiary fuctio that is shrikig i width ad growig i height, while maitaiig a costat area. For example, we ca use a shrikig rectagle fuctio such that δ(x)dx = lim τ 1 Π(x /τ)dx. τ 0 1 τ 0-1/2 1/2 x 2D Dirac Delta Fuctio δ(x, y) = 0 whe x 2 + y 2 0 ad δ(x,y)dxdy =1 where we ca cosider the limit of the itegral of a ordiary 2D fuctio that is shrikig i width but icreasig i height while maitaiig costat area. δ(x, y)dxdy = lim τ 2 Π x /τ,y /τ τ 0 ( )dxdy. Useful fact : δ(x, y) = δ(x)δ(y) τ 0 7

8 Geeralized Fuctios Dirac delta fuctios are ot ordiary fuctios that are defied by their value at each poit. Istead, they are geeralized fuctios that are defied by what they do udereath a itegral. The most importat property of the Dirac delta is the siftig property δ(x x 0 )g(x)dx = g(x 0 ) where g(x) is a smooth fuctio. This siftig property ca be uderstood by cosiderig the limitig case lim τ 1 Π x /τ τ 0 ( )g(x)dx = g(x 0 ) g(x) Area = (height)(width)= (g(x 0 )/ τ) τ = g(x 0 ) x 0 Workig with Dirac Delta Fuctios What is δ(ax - b)? What is dδ(x)/dx? How do we defie geeralized fuctios? There are two mai approaches : 1) Look at the limit of a itegral with sequeces. 2) Cosider the behavior of the fuctio whe itegrated with a ice test fuctio. Two geeralized fuctios δ 1 (t) ad δ 2 (t) are equivalet i the distributioal sese whe δ 1 (t)φ(t)dt = δ 2 (t)φ(t)dt - - Example : δ(ax) =?? 8

9 Represetatio of 1D Fuctio From the siftig property, we ca write a 1D fuctio as g(x) = g(ξ)δ(x ξ)dξ. To gai ituitio, cosider the approximatio g(x) = g(δx) 1 Δx Π x Δx Δx. Δx g(x) Represetatio of 2D Fuctio Similarly, we ca write a 2D fuctio as g(x, y) = g(ξ,η)δ(x ξ,y η)dξdη. To gai ituitio, cosider the approximatio g(x, y) g(δx,mδy) 1 Δx Π x Δx 1 = Δx Δy Π y mδy ΔxΔy. m= Δy 9

10 Impulse Respose Ituitio: the impulse respose is the respose of a system to a iput of ifiitesimal width ad uit area. Origial Image Blurred Image Sice ay iput ca be thought of as the weighted sum of impulses, a liear system is characterized by its impulse respose(s). Impulse Respose The impulse respose characterizes the respose of a system over all space to a Dirac delta impulse fuctio at a certai locatio. h(x 2 ;ξ) = L[ δ( x 1 ξ) ] 1D Impulse Respose [ ( )] 2D Impulse Respose h(x 2, y 2 ;ξ,η) = L δ x 1 ξ, y 1 η y 1 Impulse at ξ,η y 2 h(x2 ;ξ,η) x 1 x 2 10

11 Superpositio Itegral What is the respose to a arbitrary fuctio g(x 1,y 1 )? Write g(x 1,y 1 ) = g(ξ,η)δ(x 1 ξ, y 1 η)dξdη. - - The respose is give by [ ] I(x 2 ) = L g 1 (x 1,y 1 ) [ - - ] = L g(ξ,η)δ(x 1 ξ,y 1 η)dξdη [ ] = g(ξ,η)l δ(x 1 ξ, y 1 η) dξdη - - = g(ξ,η)h(x 2 ;ξ,η) dξdη - - Pihole Magificatio Example - b a η η a b I this example, a impulse at ξ,η ( ) where M = b /a. ( ) = L δ( x 1 ξ,y 1 η) at Mξ, Mη Thus, h x 2, y 2 ;ξ,η ( ) will yield a impulse [ ] = δ(x 2 Mξ, y 2 Mη). 11

12 Pihole Magificatio Example I(x 2 ) = - - g(ξ,η)h(x 2, y 2 ;ξ,η) dξdη = C g(ξ,η)δ(x 2 Mξ, y 2 Mη) dξdη - - I(x 2, y 2 ) g(x 1, y 1 ) Space Ivariace If a system is space ivariat, the impulse respose depeds oly o the differece betwee the output coordiates ad the positio of ( ) the impulse ad is give by h(x 2, y 2 ;ξ,η) = h x 2 ξ η 12

13 Pihole Magificatio Example - b a η η a b h( x 2 ;ξ,η) = Cδ(x 2 Mξ Mη). Is this system space ivariat? Pihole Magificatio Example, the pihole system space ivariat. 13

14 I(x 2 ) = 2D Covolutio For a space ivariat liear system, the superpositio itegral becomes a covolutio itegral. - - g(ξ,η)h(x 2 ;ξ,η) dξdη = g(ξ,η)h(x 2 ξ, y 2 η) dξdη - - = g(x 2 ) **h(x 2 ) where ** deotes 2D covolutio. This will sometimes be abbreviated as *, e.g. I(x 2, y 2 )= g(x 2, y 2 )*h(x 2, y 2 ). I(x) = 1D Covolutio For completeess, here is the 1D versio. - g(ξ)h(x;ξ)dξ = g(ξ)h(x ξ) dξ = g(x) h(x) Useful fact: - g(x) δ(x Δ) = - g(ξ)δ(x Δ ξ) dξ = g(x Δ) 14

15 1D Covolutio Review g(x) h(x) = - g(ξ)h(x ξ)dξ Basic Rule: Flip oe fuctio, slide it past the other fuctio, ad itegrate as you go. g(x)=rect(x) h(x)=rect(x-1/2) -1/2 1/2 1 1D Covolutio Review h(-1/2-ξ) g(ξ) I(x) h(-ξ) h(1/2-ξ) -1/2 1/2 3/2 h(3/2-ξ) 15

16 2D Covolutio Example g(x)= δ(x+1/2,y) + δ(x,y) y h(x)=rect(x,y) y x -1/2 12 x I(x,y)=g(x)**h(x,y) x 2D Covolutio Example 16

17 Summary 1. The respose to a liear system ca be characterized by a spatially varyig impulse respose ad the applicatio of the superpositio itegral. 2. A shift ivariat liear system ca be characterized by its impulse respose ad the applicatio of a covolutio itegral. 3. Dirac delta fuctios are geeralized fuctios. Pihole Magificatio Example I(x 2 ) = - - g(ξ,η)h(x 2 ;ξ,η) dξdη = g(ξ,η)δ(x 2 Mξ Mη) dξdη - - after substitutig ξ = Mξ ad η = Mη, we obtai = 1 g( ξ / M, M η / M)δ(x ξ,y η ) d ξ d η = 1 M g(x 2 2 / M / M) δ ( x 2 ) = 1 M 2 g(x 2 / M / M) 17

Kronecker Delta Function # 1 for m = 0,n = 0. Kronecker Delta Function

Kronecker Delta Function # 1 for m = 0,n = 0. Kronecker Delta Function Bioegieerig 280A Priciples of Biomedical Imagig Fall Quarter 202 Sigals ad Fourier Trasforms Sigals ad Images Discrete-time/space sigałimage: cotiuous valued fuctio with a discrete time/space ide, deoted

More information

Representation of 1D Function

Representation of 1D Function Bioengineering 280A Principles of Biomedical Imaging Fall Quarter 2005 Linear Systems Lecture 2 Representation of 1D Function From the sifting property, we can write a 1D function as g(x) = g(ξ)δ(x ξ)dξ.

More information

Spin-Warp Pulse Sequence

Spin-Warp Pulse Sequence Bioengineering 28A Principles of Biomedical Imaging Fall Quarter 25 Linear Systems Lecture Spin-Warp Pulse Sequence RF G x (t G y (t k y k x K-space trajectories EPI Spiral k y k y k x k x Credit: Larry

More information

Bioengineering 280A Principles of Biomedical Imaging. Fall Quarter 2006 X-Rays Lecture 3. Topics

Bioengineering 280A Principles of Biomedical Imaging. Fall Quarter 2006 X-Rays Lecture 3. Topics Bioengineering 280A Principles of Biomedical Imaging Fall Quarter 2006 X-Rays Lecture 3 Topics Address questions from last lecture Review image equation Linearity Delta Functions Superposition Convolution

More information

2D DSP Basics: 2D Systems

2D DSP Basics: 2D Systems - Digital Image Processig ad Compressio D DSP Basics: D Systems D Systems T[ ] y = T [ ] Liearity Additivity: If T y = T [ ] The + T y = y + y Homogeeity: If The T y = T [ ] a T y = ay = at [ ] Liearity

More information

Olli Simula T / Chapter 1 3. Olli Simula T / Chapter 1 5

Olli Simula T / Chapter 1 3. Olli Simula T / Chapter 1 5 Sigals ad Systems Sigals ad Systems Sigals are variables that carry iformatio Systemstake sigals as iputs ad produce sigals as outputs The course deals with the passage of sigals through systems T-6.4

More information

Signals and Systems. Problem Set: From Continuous-Time to Discrete-Time

Signals and Systems. Problem Set: From Continuous-Time to Discrete-Time Sigals ad Systems Problem Set: From Cotiuous-Time to Discrete-Time Updated: October 5, 2017 Problem Set Problem 1 - Liearity ad Time-Ivariace Cosider the followig systems ad determie whether liearity ad

More information

Computing the output response of LTI Systems.

Computing the output response of LTI Systems. Computig the output respose of LTI Systems. By breaig or decomposig ad represetig the iput sigal to the LTI system ito terms of a liear combiatio of a set of basic sigals. Usig the superpositio property

More information

ELEG 4603/5173L Digital Signal Processing Ch. 1 Discrete-Time Signals and Systems

ELEG 4603/5173L Digital Signal Processing Ch. 1 Discrete-Time Signals and Systems Departmet of Electrical Egieerig Uiversity of Arasas ELEG 4603/5173L Digital Sigal Processig Ch. 1 Discrete-Time Sigals ad Systems Dr. Jigxia Wu wuj@uar.edu OUTLINE 2 Classificatios of discrete-time sigals

More information

Discrete-Time Signals and Systems. Discrete-Time Signals and Systems. Signal Symmetry. Elementary Discrete-Time Signals.

Discrete-Time Signals and Systems. Discrete-Time Signals and Systems. Signal Symmetry. Elementary Discrete-Time Signals. Discrete-ime Sigals ad Systems Discrete-ime Sigals ad Systems Dr. Deepa Kudur Uiversity of oroto Referece: Sectios. -.5 of Joh G. Proakis ad Dimitris G. Maolakis, Digital Sigal Processig: Priciples, Algorithms,

More information

FIR Filters. Lecture #7 Chapter 5. BME 310 Biomedical Computing - J.Schesser

FIR Filters. Lecture #7 Chapter 5. BME 310 Biomedical Computing - J.Schesser FIR Filters Lecture #7 Chapter 5 8 What Is this Course All About? To Gai a Appreciatio of the Various Types of Sigals ad Systems To Aalyze The Various Types of Systems To Lear the Skills ad Tools eeded

More information

Time-Domain Representations of LTI Systems

Time-Domain Representations of LTI Systems 2.1 Itroductio Objectives: 1. Impulse resposes of LTI systems 2. Liear costat-coefficiets differetial or differece equatios of LTI systems 3. Bloc diagram represetatios of LTI systems 4. State-variable

More information

DIGITAL SIGNAL PROCESSING LECTURE 3

DIGITAL SIGNAL PROCESSING LECTURE 3 DIGITAL SIGNAL PROCESSING LECTURE 3 Fall 2 2K8-5 th Semester Tahir Muhammad tmuhammad_7@yahoo.com Cotet ad Figures are from Discrete-Time Sigal Processig, 2e by Oppeheim, Shafer, ad Buc, 999-2 Pretice

More information

ECE4270 Fundamentals of DSP. Lecture 2 Discrete-Time Signals and Systems & Difference Equations. Overview of Lecture 2. More Discrete-Time Systems

ECE4270 Fundamentals of DSP. Lecture 2 Discrete-Time Signals and Systems & Difference Equations. Overview of Lecture 2. More Discrete-Time Systems ECE4270 Fudametals of DSP Lecture 2 Discrete-Time Sigals ad Systems & Differece Equatios School of ECE Ceter for Sigal ad Iformatio Processig Georgia Istitute of Techology Overview of Lecture 2 Aoucemet

More information

Discrete-Time Systems, LTI Systems, and Discrete-Time Convolution

Discrete-Time Systems, LTI Systems, and Discrete-Time Convolution EEL5: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we begi our mathematical treatmet of discrete-time s. As show i Figure, a discrete-time operates or trasforms some iput sequece x [

More information

ECE 308 Discrete-Time Signals and Systems

ECE 308 Discrete-Time Signals and Systems ECE 38-5 ECE 38 Discrete-Time Sigals ad Systems Z. Aliyazicioglu Electrical ad Computer Egieerig Departmet Cal Poly Pomoa ECE 38-5 1 Additio, Multiplicatio, ad Scalig of Sequeces Amplitude Scalig: (A Costat

More information

Discrete-Time Signals and Systems. Signals and Systems. Digital Signals. Discrete-Time Signals. Operations on Sequences: Basic Operations

Discrete-Time Signals and Systems. Signals and Systems. Digital Signals. Discrete-Time Signals. Operations on Sequences: Basic Operations -6.3 Digital Sigal Processig ad Filterig..8 Discrete-ime Sigals ad Systems ime-domai Represetatios of Discrete-ime Sigals ad Systems ime-domai represetatio of a discrete-time sigal as a sequece of umbers

More information

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course Sigal-EE Postal Correspodece Course 1 SAMPLE STUDY MATERIAL Electrical Egieerig EE / EEE Postal Correspodece Course GATE, IES & PSUs Sigal System Sigal-EE Postal Correspodece Course CONTENTS 1. SIGNAL

More information

Signal Processing. Lecture 02: Discrete Time Signals and Systems. Ahmet Taha Koru, Ph. D. Yildiz Technical University.

Signal Processing. Lecture 02: Discrete Time Signals and Systems. Ahmet Taha Koru, Ph. D. Yildiz Technical University. Sigal Processig Lecture 02: Discrete Time Sigals ad Systems Ahmet Taha Koru, Ph. D. Yildiz Techical Uiversity 2017-2018 Fall ATK (YTU) Sigal Processig 2017-2018 Fall 1 / 51 Discrete Time Sigals Discrete

More information

ADVANCED DIGITAL SIGNAL PROCESSING

ADVANCED DIGITAL SIGNAL PROCESSING ADVANCED DIGITAL SIGNAL PROCESSING PROF. S. C. CHAN (email : sccha@eee.hku.hk, Rm. CYC-702) DISCRETE-TIME SIGNALS AND SYSTEMS MULTI-DIMENSIONAL SIGNALS AND SYSTEMS RANDOM PROCESSES AND APPLICATIONS ADAPTIVE

More information

Chapter 4 : Laplace Transform

Chapter 4 : Laplace Transform 4. Itroductio Laplace trasform is a alterative to solve the differetial equatio by the complex frequecy domai ( s = σ + jω), istead of the usual time domai. The DE ca be easily trasformed ito a algebraic

More information

Mathematical Description of Discrete-Time Signals. 9/10/16 M. J. Roberts - All Rights Reserved 1

Mathematical Description of Discrete-Time Signals. 9/10/16 M. J. Roberts - All Rights Reserved 1 Mathematical Descriptio of Discrete-Time Sigals 9/10/16 M. J. Roberts - All Rights Reserved 1 Samplig ad Discrete Time Samplig is the acquisitio of the values of a cotiuous-time sigal at discrete poits

More information

Signals & Systems Chapter3

Signals & Systems Chapter3 Sigals & Systems Chapter3 1.2 Discrete-Time (D-T) Sigals Electroic systems do most of the processig of a sigal usig a computer. A computer ca t directly process a C-T sigal but istead eeds a stream of

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

} is said to be a Cauchy sequence provided the following condition is true.

} is said to be a Cauchy sequence provided the following condition is true. Math 4200, Fial Exam Review I. Itroductio to Proofs 1. Prove the Pythagorea theorem. 2. Show that 43 is a irratioal umber. II. Itroductio to Logic 1. Costruct a truth table for the statemet ( p ad ~ r

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

Linear time invariant systems

Linear time invariant systems Liear time ivariat systems Alejadro Ribeiro Dept. of Electrical ad Systems Egieerig Uiversity of Pesylvaia aribeiro@seas.upe.edu http://www.seas.upe.edu/users/~aribeiro/ February 25, 2016 Sigal ad Iformatio

More information

The z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j

The z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j The -Trasform 7. Itroductio Geeralie the complex siusoidal represetatio offered by DTFT to a represetatio of complex expoetial sigals. Obtai more geeral characteristics for discrete-time LTI systems. 7.

More information

Exponential Moving Average Pieter P

Exponential Moving Average Pieter P Expoetial Movig Average Pieter P Differece equatio The Differece equatio of a expoetial movig average lter is very simple: y[] x[] + (1 )y[ 1] I this equatio, y[] is the curret output, y[ 1] is the previous

More information

Lecture 8: Convergence of transformations and law of large numbers

Lecture 8: Convergence of transformations and law of large numbers Lecture 8: Covergece of trasformatios ad law of large umbers Trasformatio ad covergece Trasformatio is a importat tool i statistics. If X coverges to X i some sese, we ofte eed to check whether g(x ) coverges

More information

Signal Processing in Mechatronics. Lecture 3, Convolution, Fourier Series and Fourier Transform

Signal Processing in Mechatronics. Lecture 3, Convolution, Fourier Series and Fourier Transform Sigal Processig i Mechatroics Summer semester, 1 Lecture 3, Covolutio, Fourier Series ad Fourier rasform Dr. Zhu K.P. AIS, UM 1 1. Covolutio Covolutio Descriptio of LI Systems he mai premise is that the

More information

Representation of 1D Function

Representation of 1D Function Bioengineering 280A Principles of Biomedical Imaging Fall Quarter 2005 Linear Systems Lecture 2 Representation of 1D Function From the sifting property, we can write a 1D function as g( = g(ξδ( ξdξ. To

More information

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4. 4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad

More information

ECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations

ECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations ECE-S352 Itroductio to Digital Sigal Processig Lecture 3A Direct Solutio of Differece Equatios Discrete Time Systems Described by Differece Equatios Uit impulse (sample) respose h() of a DT system allows

More information

Frequency Response of FIR Filters

Frequency Response of FIR Filters EEL335: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we itroduce the idea of the frequecy respose of LTI systems, ad focus specifically o the frequecy respose of FIR filters.. Steady-state

More information

Solution of Linear Constant-Coefficient Difference Equations

Solution of Linear Constant-Coefficient Difference Equations ECE 38-9 Solutio of Liear Costat-Coefficiet Differece Equatios Z. Aliyazicioglu Electrical ad Computer Egieerig Departmet Cal Poly Pomoa Solutio of Liear Costat-Coefficiet Differece Equatios Example: Determie

More information

GEORGIA INSTITUTE OF TECHNOLOGY SCHOOL OF ELECTRICAL AND COMPUTER ENGINEERING

GEORGIA INSTITUTE OF TECHNOLOGY SCHOOL OF ELECTRICAL AND COMPUTER ENGINEERING GEORGIA INSTITUTE OF TECHNOLOGY SCHOOL OF ELECTRICAL AND COMPUTER ENGINEERING ECE 06 Summer 07 Problem Set #5 Assiged: Jue 3, 07 Due Date: Jue 30, 07 Readig: Chapter 5 o FIR Filters. PROBLEM 5..* (The

More information

Describing Function: An Approximate Analysis Method

Describing Function: An Approximate Analysis Method Describig Fuctio: A Approximate Aalysis Method his chapter presets a method for approximately aalyzig oliear dyamical systems A closed-form aalytical solutio of a oliear dyamical system (eg, a oliear differetial

More information

MAS111 Convergence and Continuity

MAS111 Convergence and Continuity MAS Covergece ad Cotiuity Key Objectives At the ed of the course, studets should kow the followig topics ad be able to apply the basic priciples ad theorems therei to solvig various problems cocerig covergece

More information

Web Appendix O - Derivations of the Properties of the z Transform

Web Appendix O - Derivations of the Properties of the z Transform M. J. Roberts - 2/18/07 Web Appedix O - Derivatios of the Properties of the z Trasform O.1 Liearity Let z = x + y where ad are costats. The ( z)= ( x + y )z = x z + y z ad the liearity property is O.2

More information

EECE 301 Signals & Systems

EECE 301 Signals & Systems EECE 301 Sigals & Systems Prof. Mark Fowler Note Set #8 D-T Covolutio: The Tool for Fidig the Zero-State Respose Readig Assigmet: Sectio 2.1-2.2 of Kame ad Heck 1/14 Course Flow Diagram The arrows here

More information

FUNDAMENTALS OF REAL ANALYSIS by. V.1. Product measures

FUNDAMENTALS OF REAL ANALYSIS by. V.1. Product measures FUNDAMENTALS OF REAL ANALSIS by Doğa Çömez V. PRODUCT MEASURE SPACES V.1. Product measures Let (, A, µ) ad (, B, ν) be two measure spaces. I this sectio we will costruct a product measure µ ν o that coicides

More information

Chapter 7: The z-transform. Chih-Wei Liu

Chapter 7: The z-transform. Chih-Wei Liu Chapter 7: The -Trasform Chih-Wei Liu Outlie Itroductio The -Trasform Properties of the Regio of Covergece Properties of the -Trasform Iversio of the -Trasform The Trasfer Fuctio Causality ad Stability

More information

Z - Transform. It offers the techniques for digital filter design and frequency analysis of digital signals.

Z - Transform. It offers the techniques for digital filter design and frequency analysis of digital signals. Z - Trasform The -trasform is a very importat tool i describig ad aalyig digital systems. It offers the techiques for digital filter desig ad frequecy aalysis of digital sigals. Defiitio of -trasform:

More information

Machine Learning Brett Bernstein

Machine Learning Brett Bernstein Machie Learig Brett Berstei Week 2 Lecture: Cocept Check Exercises Starred problems are optioal. Excess Risk Decompositio 1. Let X = Y = {1, 2,..., 10}, A = {1,..., 10, 11} ad suppose the data distributio

More information

x[0] x[1] x[2] Figure 2.1 Graphical representation of a discrete-time signal.

x[0] x[1] x[2] Figure 2.1 Graphical representation of a discrete-time signal. x[ ] x[ ] x[] x[] x[] x[] 9 8 7 6 5 4 3 3 4 5 6 7 8 9 Figure. Graphical represetatio of a discrete-time sigal. From Discrete-Time Sigal Processig, e by Oppeheim, Schafer, ad Buck 999- Pretice Hall, Ic.

More information

Section 13.3 Area and the Definite Integral

Section 13.3 Area and the Definite Integral Sectio 3.3 Area ad the Defiite Itegral We ca easily fid areas of certai geometric figures usig well-kow formulas: However, it is t easy to fid the area of a regio with curved sides: METHOD: To evaluate

More information

Fall 2013 MTH431/531 Real analysis Section Notes

Fall 2013 MTH431/531 Real analysis Section Notes Fall 013 MTH431/531 Real aalysis Sectio 8.1-8. Notes Yi Su 013.11.1 1. Defiitio of uiform covergece. We look at a sequece of fuctios f (x) ad study the coverget property. Notice we have two parameters

More information

Chapter 7 z-transform

Chapter 7 z-transform Chapter 7 -Trasform Itroductio Trasform Uilateral Trasform Properties Uilateral Trasform Iversio of Uilateral Trasform Determiig the Frequecy Respose from Poles ad Zeros Itroductio Role i Discrete-Time

More information

Appendix: The Laplace Transform

Appendix: The Laplace Transform Appedix: The Laplace Trasform The Laplace trasform is a powerful method that ca be used to solve differetial equatio, ad other mathematical problems. Its stregth lies i the fact that it allows the trasformatio

More information

Lecture 3 : Random variables and their distributions

Lecture 3 : Random variables and their distributions Lecture 3 : Radom variables ad their distributios 3.1 Radom variables Let (Ω, F) ad (S, S) be two measurable spaces. A map X : Ω S is measurable or a radom variable (deoted r.v.) if X 1 (A) {ω : X(ω) A}

More information

Analog and Digital Signals. Introduction to Digital Signal Processing. Discrete-time Sinusoids. Analog and Digital Signals

Analog and Digital Signals. Introduction to Digital Signal Processing. Discrete-time Sinusoids. Analog and Digital Signals Itroductio to Digital Sigal Processig Chapter : Itroductio Aalog ad Digital Sigals aalog = cotiuous-time cotiuous amplitude digital = discrete-time discrete amplitude cotiuous amplitude discrete amplitude

More information

Discrete-Time System Properties. Discrete-Time System Properties. Terminology: Implication. Terminology: Equivalence. Reference: Section 2.

Discrete-Time System Properties. Discrete-Time System Properties. Terminology: Implication. Terminology: Equivalence. Reference: Section 2. Professor Deepa Kudur Uiversity of oroto Referece: Sectio 2.2 Joh G. Proakis ad Dimitris G. Maolakis, Digital Sigal Processig: Priciples, Algorithms, ad Applicatios, 4th editio, 2007. Professor Deepa Kudur

More information

ELEC1200: A System View of Communications: from Signals to Packets Lecture 3

ELEC1200: A System View of Communications: from Signals to Packets Lecture 3 ELEC2: A System View of Commuicatios: from Sigals to Packets Lecture 3 Commuicatio chaels Discrete time Chael Modelig the chael Liear Time Ivariat Systems Step Respose Respose to sigle bit Respose to geeral

More information

MAT1026 Calculus II Basic Convergence Tests for Series

MAT1026 Calculus II Basic Convergence Tests for Series MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real

More information

Measure and Measurable Functions

Measure and Measurable Functions 3 Measure ad Measurable Fuctios 3.1 Measure o a Arbitrary σ-algebra Recall from Chapter 2 that the set M of all Lebesgue measurable sets has the followig properties: R M, E M implies E c M, E M for N implies

More information

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet

More information

Definition of z-transform.

Definition of z-transform. - Trasforms Frequecy domai represetatios of discretetime sigals ad LTI discrete-time systems are made possible with the use of DTFT. However ot all discrete-time sigals e.g. uit step sequece are guarateed

More information

Discrete-time signals and systems See Oppenheim and Schafer, Second Edition pages 8 93, or First Edition pages 8 79.

Discrete-time signals and systems See Oppenheim and Schafer, Second Edition pages 8 93, or First Edition pages 8 79. Discrete-time sigals ad systems See Oppeheim ad Schafer, Secod Editio pages 93, or First Editio pages 79. Discrete-time sigals A discrete-time sigal is represeted as a sequece of umbers: x D fxœg; <

More information

Digital Signal Processing, Fall 2006

Digital Signal Processing, Fall 2006 Digital Sigal Processig, Fall 26 Lecture 1: Itroductio, Discrete-time sigals ad systems Zheg-Hua Ta Departmet of Electroic Systems Aalborg Uiversity, Demark zt@kom.aau.dk 1 Part I: Itroductio Itroductio

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science. BACKGROUND EXAM September 30, 2004.

MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science. BACKGROUND EXAM September 30, 2004. MASSACHUSETTS INSTITUTE OF TECHNOLOGY Departmet of Electrical Egieerig ad Computer Sciece 6.34 Discrete Time Sigal Processig Fall 24 BACKGROUND EXAM September 3, 24. Full Name: Note: This exam is closed

More information

Lecture 13. Graphical representation of the frequency response. Luca Ferrarini - Basic Automatic Control 1

Lecture 13. Graphical representation of the frequency response. Luca Ferrarini - Basic Automatic Control 1 Lecture 3 Graphical represetatio of the frequecy respose Luca Ferrarii - Basic Automatic Cotrol Graphical represetatio of the frequecy respose Polar plot G Bode plot ( j), G Im 3 Re of the magitude G (

More information

Lecture #20. n ( x p i )1/p = max

Lecture #20. n ( x p i )1/p = max COMPSCI 632: Approximatio Algorithms November 8, 2017 Lecturer: Debmalya Paigrahi Lecture #20 Scribe: Yua Deg 1 Overview Today, we cotiue to discuss about metric embeddigs techique. Specifically, we apply

More information

The Wasserstein distances

The Wasserstein distances The Wasserstei distaces March 20, 2011 This documet presets the proof of the mai results we proved o Wasserstei distaces themselves (ad ot o curves i the Wasserstei space). I particular, triagle iequality

More information

Lecture 2 Linear and Time Invariant Systems

Lecture 2 Linear and Time Invariant Systems EE3054 Sigals ad Systems Lecture 2 Liear ad Time Ivariat Systems Yao Wag Polytechic Uiversity Most of the slides icluded are extracted from lecture presetatios prepared by McClella ad Schafer Licese Ifo

More information

Solution of EECS 315 Final Examination F09

Solution of EECS 315 Final Examination F09 Solutio of EECS 315 Fial Examiatio F9 1. Fid the umerical value of δ ( t + 4ramp( tdt. δ ( t + 4ramp( tdt. Fid the umerical sigal eergy of x E x = x[ ] = δ 3 = 11 = ( = ramp( ( 4 = ramp( 8 = 8 [ ] = (

More information

Chapter 2 Systems and Signals

Chapter 2 Systems and Signals Chapter 2 Systems ad Sigals 1 Itroductio Discrete-Time Sigals: Sequeces Discrete-Time Systems Properties of Liear Time-Ivariat Systems Liear Costat-Coefficiet Differece Equatios Frequecy-Domai Represetatio

More information

Ma 530 Infinite Series I

Ma 530 Infinite Series I Ma 50 Ifiite Series I Please ote that i additio to the material below this lecture icorporated material from the Visual Calculus web site. The material o sequeces is at Visual Sequeces. (To use this li

More information

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense, 3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [

More information

Frequency Domain Filtering

Frequency Domain Filtering Frequecy Domai Filterig Raga Rodrigo October 19, 2010 Outlie Cotets 1 Itroductio 1 2 Fourier Represetatio of Fiite-Duratio Sequeces: The Discrete Fourier Trasform 1 3 The 2-D Discrete Fourier Trasform

More information

The z-transform can be used to obtain compact transform-domain representations of signals and systems. It

The z-transform can be used to obtain compact transform-domain representations of signals and systems. It 3 4 5 6 7 8 9 10 CHAPTER 3 11 THE Z-TRANSFORM 31 INTRODUCTION The z-trasform ca be used to obtai compact trasform-domai represetatios of sigals ad systems It provides ituitio particularly i LTI system

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

Areas and Distances. We can easily find areas of certain geometric figures using well-known formulas:

Areas and Distances. We can easily find areas of certain geometric figures using well-known formulas: Areas ad Distaces We ca easily fid areas of certai geometric figures usig well-kow formulas: However, it is t easy to fid the area of a regio with curved sides: METHOD: To evaluate the area of the regio

More information

Partial match queries: a limit process

Partial match queries: a limit process Partial match queries: a limit process Nicolas Brouti Ralph Neiiger Heig Sulzbach Partial match queries: a limit process 1 / 17 Searchig geometric data ad quadtrees 1 Partial match queries: a limit process

More information

The Z-Transform. (t-t 0 ) Figure 1: Simplified graph of an impulse function. For an impulse, it can be shown that (1)

The Z-Transform. (t-t 0 ) Figure 1: Simplified graph of an impulse function. For an impulse, it can be shown that (1) The Z-Trasform Sampled Data The geeralied fuctio (t) (also kow as the impulse fuctio) is useful i the defiitio ad aalysis of sampled-data sigals. Figure below shows a simplified graph of a impulse. (t-t

More information

Notes 20 largely plagiarized by %khc

Notes 20 largely plagiarized by %khc 1 Notes 20 largely plagiarized by %khc 1 Warig This set of otes covers discrete time. However, i probably wo t be able to talk about everythig here; istead i will highlight importat properties or give

More information

Review Problems 1. ICME and MS&E Refresher Course September 19, 2011 B = C = AB = A = A 2 = A 3... C 2 = C 3 = =

Review Problems 1. ICME and MS&E Refresher Course September 19, 2011 B = C = AB = A = A 2 = A 3... C 2 = C 3 = = Review Problems ICME ad MS&E Refresher Course September 9, 0 Warm-up problems. For the followig matrices A = 0 B = C = AB = 0 fid all powers A,A 3,(which is A times A),... ad B,B 3,... ad C,C 3,... Solutio:

More information

1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series.

1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series. .3 Covergece Theorems of Fourier Series I this sectio, we preset the covergece of Fourier series. A ifiite sum is, by defiitio, a limit of partial sums, that is, a cos( kx) b si( kx) lim a cos( kx) b si(

More information

Lecture 3 The Lebesgue Integral

Lecture 3 The Lebesgue Integral Lecture 3: The Lebesgue Itegral 1 of 14 Course: Theory of Probability I Term: Fall 2013 Istructor: Gorda Zitkovic Lecture 3 The Lebesgue Itegral The costructio of the itegral Uless expressly specified

More information

Entropy and Ergodic Theory Lecture 5: Joint typicality and conditional AEP

Entropy and Ergodic Theory Lecture 5: Joint typicality and conditional AEP Etropy ad Ergodic Theory Lecture 5: Joit typicality ad coditioal AEP 1 Notatio: from RVs back to distributios Let (Ω, F, P) be a probability space, ad let X ad Y be A- ad B-valued discrete RVs, respectively.

More information

Lecture 10: Bounded Linear Operators and Orthogonality in Hilbert Spaces

Lecture 10: Bounded Linear Operators and Orthogonality in Hilbert Spaces Lecture : Bouded Liear Operators ad Orthogoality i Hilbert Spaces 34 Bouded Liear Operator Let ( X, ), ( Y, ) i i be ored liear vector spaces ad { } X Y The, T is said to be bouded if a real uber c such

More information

Appendix K. The three-point correlation function (bispectrum) of density peaks

Appendix K. The three-point correlation function (bispectrum) of density peaks Appedix K The three-poit correlatio fuctio (bispectrum) of desity peaks Cosider the smoothed desity field, ρ (x) ρ [ δ (x)], with a geeral smoothig kerel W (x) δ (x) d yw (x y)δ(y). (K.) We defie the peaks

More information

An Introduction to Asymptotic Theory

An Introduction to Asymptotic Theory A Itroductio to Asymptotic Theory Pig Yu School of Ecoomics ad Fiace The Uiversity of Hog Kog Pig Yu (HKU) Asymptotic Theory 1 / 20 Five Weapos i Asymptotic Theory Five Weapos i Asymptotic Theory Pig Yu

More information

4.1 Sigma Notation and Riemann Sums

4.1 Sigma Notation and Riemann Sums 0 the itegral. Sigma Notatio ad Riema Sums Oe strategy for calculatig the area of a regio is to cut the regio ito simple shapes, calculate the area of each simple shape, ad the add these smaller areas

More information

Derivation of the Fourier Inversion Formula, Bochner s Theorem, and Herglotz s Theorem

Derivation of the Fourier Inversion Formula, Bochner s Theorem, and Herglotz s Theorem 1 Derivatio of the Fourier Iversio Formula, Bocher s Theorem, ad Herglotz s Theorem Joh A. Guber Departmet of Electrical ad Computer Egieerig Uiversity of Wiscosi Madiso Cotets 1 Respose of Liear Time-Ivariat

More information

Class Meeting # 16: The Fourier Transform on R n

Class Meeting # 16: The Fourier Transform on R n MATH 18.152 COUSE NOTES - CLASS MEETING # 16 18.152 Itroductio to PDEs, Fall 2011 Professor: Jared Speck Class Meetig # 16: The Fourier Trasform o 1. Itroductio to the Fourier Trasform Earlier i the course,

More information

MDIV. Multiple divisor functions

MDIV. Multiple divisor functions MDIV. Multiple divisor fuctios The fuctios τ k For k, defie τ k ( to be the umber of (ordered factorisatios of ito k factors, i other words, the umber of ordered k-tuples (j, j 2,..., j k with j j 2...

More information

Filter banks. Separately, the lowpass and highpass filters are not invertible. removes the highest frequency 1/ 2and

Filter banks. Separately, the lowpass and highpass filters are not invertible. removes the highest frequency 1/ 2and Filter bas Separately, the lowpass ad highpass filters are ot ivertible T removes the highest frequecy / ad removes the lowest frequecy Together these filters separate the sigal ito low-frequecy ad high-frequecy

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

ELEG3503 Introduction to Digital Signal Processing

ELEG3503 Introduction to Digital Signal Processing ELEG3503 Itroductio to Digital Sigal Processig 1 Itroductio 2 Basics of Sigals ad Systems 3 Fourier aalysis 4 Samplig 5 Liear time-ivariat (LTI) systems 6 z-trasform 7 System Aalysis 8 System Realizatio

More information

Topic 1 2: Sequences and Series. A sequence is an ordered list of numbers, e.g. 1, 2, 4, 8, 16, or

Topic 1 2: Sequences and Series. A sequence is an ordered list of numbers, e.g. 1, 2, 4, 8, 16, or Topic : Sequeces ad Series A sequece is a ordered list of umbers, e.g.,,, 8, 6, or,,,.... A series is a sum of the terms of a sequece, e.g. + + + 8 + 6 + or... Sigma Notatio b The otatio f ( k) is shorthad

More information

LECTURE 8: ASYMPTOTICS I

LECTURE 8: ASYMPTOTICS I LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece

More information

Lecture Chapter 6: Convergence of Random Sequences

Lecture Chapter 6: Convergence of Random Sequences ECE5: Aalysis of Radom Sigals Fall 6 Lecture Chapter 6: Covergece of Radom Sequeces Dr Salim El Rouayheb Scribe: Abhay Ashutosh Doel, Qibo Zhag, Peiwe Tia, Pegzhe Wag, Lu Liu Radom sequece Defiitio A ifiite

More information

Prof. Dr. I. Nasser Phys 571, T131 5-Nov-13 Green function.doc. 2 ρ(r)

Prof. Dr. I. Nasser Phys 571, T131 5-Nov-13 Green function.doc. 2 ρ(r) Gree fuctio.doc Solutio of ihomogeeous ordiary differetial equatios usig Gree's fuctios G(, ') (9.7, 10.5) Historical Itroductio: Gree's fuctios are auiliary fuctios i the solutio of liear partial differetial

More information

: Transforms and Partial Differential Equations

: Transforms and Partial Differential Equations Trasforms ad Partial Differetial Equatios 018 SUBJECT NAME : Trasforms ad Partial Differetial Equatios SUBJECT CODE : MA 6351 MATERIAL NAME : Part A questios REGULATION : R013 WEBSITE : wwwharigaeshcom

More information

Chapter 2 The Monte Carlo Method

Chapter 2 The Monte Carlo Method Chapter 2 The Mote Carlo Method The Mote Carlo Method stads for a broad class of computatioal algorithms that rely o radom sampligs. It is ofte used i physical ad mathematical problems ad is most useful

More information

RANDOM WALKS ON THE TORUS WITH SEVERAL GENERATORS

RANDOM WALKS ON THE TORUS WITH SEVERAL GENERATORS RANDOM WALKS ON THE TORUS WITH SEVERAL GENERATORS TIMOTHY PRESCOTT AND FRANCIS EDWARD SU Abstract. Give vectors { α i } [0, 1)d, cosider a radom walk o the d- dimesioal torus T d = R d /Z d geerated by

More information

Difference Equation Construction (1) ENGG 1203 Tutorial. Difference Equation Construction (2) Grow, baby, grow (1)

Difference Equation Construction (1) ENGG 1203 Tutorial. Difference Equation Construction (2) Grow, baby, grow (1) ENGG 03 Tutorial Differece Equatio Costructio () Systems ad Cotrol April Learig Objectives Differece Equatios Z-trasform Poles Ack.: MIT OCW 6.0, 6.003 Newto s law of coolig states that: The chage i a

More information

Morphological Image Processing

Morphological Image Processing Morphological Image Processig Biary dilatio ad erosio Set-theoretic iterpretatio Opeig, closig, morphological edge detectors Hit-miss filter Morphological filters for gray-level images Cascadig dilatios

More information

Chimica Inorganica 3

Chimica Inorganica 3 himica Iorgaica Irreducible Represetatios ad haracter Tables Rather tha usig geometrical operatios, it is ofte much more coveiet to employ a ew set of group elemets which are matrices ad to make the rule

More information