System Identification & Parameter Estimation
|
|
- Eustace Russell
- 5 years ago
- Views:
Transcription
1 System Identification & Parameter Estimation Wb3: SIPE lecture Correlation functions in time & frequency domain Alfred C. Schouten, Dept. of Biomechanical Engineering (BMechE), Fac. 3mE // Delft University of Technology
2 Contents Correlation functions in time domain Autocorrelations (Lecture ) Cross-correlations General properties of estimators Bias / variance / consistency Estimators for correlation functions Fourier transform Correlation functions in frequency domain Auto-spectral density Cross-spectral density Estimators for spectral densities
3 Lecture : (auto)correlation functions Autocorrelation function [ τ ] Φ ( τ) = E ( t ) ( t) Autocovariance function ( )( ) C ( τ ) = ( τ ) μ ( ) μ =Φ ( τ ) E t t μ Autocorrelation coefficient r ( τ ) t ( τ ) μ μ t ( ) Φ( τ) μ C( τ) = E = = σ σ σ C( ) 3
4 Lecture : autocovariance function Autocovariance function: ( )( ) [ ( τ ) ( )] [ ( τ) μ ] [ μ ( )] μ C ( τ) = E t ( τ) μ t ( ) μ = E t t E t + E t E =Φ ( τ) μ μ + μ =Φ ( τ) μ If μ =, then autocovariance and autocorrelation functions are identical At zero lag: ( ) C( ) = E ( t) μ = σ 4
5 white Eample autocovariances signal 5 Matlab demo: Lec_eample_Cuu.m C uu low-pass sinusoid sin. + noise time [s] tau [s] 5
6 D Probability density function f y { < ( t; ζ ) + d y < y( t + τ ; y dy} (, y; τ ) ddy = Pr ζ ) + 6
7 D Probability density function Probability for certain values of y(t) given certain values of (t) Co-variance of y(t) with (t): y(t) is related with (t) o co-variance between y(t) and (t): D probability density function is circular Covariance between y(t) and (t): D probability density function is ellipsoidal o co-variance between y(t) and (t): y(t) and (t) are independent no relation eist transfer function is zero! 7
8 Cross-correlation functions Measure for common structure in two signals: Cross-correlation [ τ ] Φ y ( τ) = E ( t ) y( t) Cross-covariance ( )( ) C ( τ ) = τ μ μ ( ) ( ) = Φ ( τ ) y E t y t y y μμy Cross-correlation coefficient r y ( τ ) t ( τ) μ yt () μ y C ( τ) y = E = σ σ y C( ) Cyy ( ) 8
9 Eample: Estimation of a Time Delay Consider the system: yt () = α t ( τ ) + vt () Additive noise v(t) is stochastic and uncorrelated to (t), Cross-covariance of the measured input and output in case: input (t) is white noise (stochastic) 9
10 Eample: Estimation of a Time Delay 5 Matlab demo: Lec_eample_Cuy_delay.m u(t) u time [s] u 5 y(t) time [s] C uy (τ) τ [s]
11 Effects of oise on Autocorrelations Often, correlation functions must be estimated from measurements. Consider (t ) and y (t ), corrupted with noise n (t ) and v (t ) resp.: wt () = t () + nt () zt () = yt () + vt () oises have zero mean and are independent of the signals and of each other. Autocorrelation: ( )( ) Φ zz( τ) = E y( t τ) + v( t τ) y() t + v() t = Φ ( τ ) +Φ ( τ) +Φ ( τ) +Φ ( τ) yy yv vy vv = Φ ( τ ) +Φ ( τ ) yy vv Additive noise will bias autocorrelation functions!
12 Effects of oise on Cross-correlations Cross-correlation: ( )( ) Φ wz( τ) = E ( t τ) + n( t τ) y( t) + v( t) =Φ ( τ ) +Φ ( τ) +Φ ( τ) +Φ ( τ) =Φ y v ny nv ( τ ) Additive noise will not bias cross-correlation functions! y
13 oise Reduction Longer recordings More information, same amount of noise Repeat the eperiment oise cancels out by averaging from eactly the same inputs Improve Signal-to-oise Ratio Concentrate power at specified frequencies, assuming the noise power remains the same 3
14 Properties of Estimators Formula given (autocovariances / spectral densities) are estimators for the true relations. What are the properties of these estimators? bias / variance / consistency Bias: structural error Variance: random error Consistent: A consistent estimator is an estimator that converges, in probability, to the quantity being estimated as the sample size grows. 4
15 Eample: estimator for mean value and variance of a signal Signal k, with k= Estimator for the signal mean: Estimator for the signal variance: ˆ μ = ˆ σ = k= ( ˆ k μ ) k= k What are the epected values of both estimators? Epectation operator: E{.} 5
16 6 Estimator for the mean value { } { } { } { } { } k k k k k k k k E E E E E E μ μ μ μ μ μ = = = = = = = = = = = ˆ ˆ ˆ
17 Estimator for the variance ˆ σ ( ˆ = k μ) = k l k= k= l= = + k kl lk k= l= l= k= E E E E k= l= l= k= { ˆ σ } = { k } { k l} + { l k} E{ ˆ σ } = K kl K kl σ + μ σ μ + σ + μ k= l= l= k = E{ ˆ σ} = σ + = σ = σ Estimator is biased and consistent 7
18 8 Estimator for the variance biased estimator: unbiased estimator: (default!) ( ) { } ˆ ˆ ˆ k k E σ σ σ μ σ = = = = ( ) { } ˆ ˆ ˆ k k E σ σ μ σ = = =
19 Estimates of Correlation Functions Cross-correlation: Let (t ) and y(t ) are finite time realizations of ergodic processes. Then: T Practically, signals are finite time and sampled every Δt. Signal (t) is sampled at t=, Δt,, (-)Δt giving (i) with i=,,,. Then: with i =,,, Φ ˆ ( ) lim ( ) ( ) y τ = t τ ytdt T T T Φ ˆ ( τ ) = τ ( ) ( ) y i yi τ i = τ [ τ ] Φ y ( τ) = E ( t ) y( t) 9
20 Estimates of Correlation Functions Unbiased estimator: Φ ˆ ( τ ) = τ ( ) ( ) y i yi τ i = τ Variance of the estimator increases with lag! To avoid this, divide by (biased estimator): Use large to minimize bias! I.e. ˆ Φ y ( τ) = i ( τ) yi ( ) Similar estimators can be derived for the covariance and correlation coefficient functions i = τ τ
21 Additional demo s Calculation of cross-covariance: Lec_calculation_Cuy.m ˆ Φ y ( τ) = i ( τ) yi ( ) i = τ
22 Cross-covariance of some basic systems Eample systems (Matlab Demo: Lec_eample_systems.m): Time delay st order nd order Input signals: White noise (W) Low pass filtered noise (LP: /(.5s+) )
23 time delay. st order system.5 nd order system C uy (W) C uy (LP) impulse time [s] -5 5 time [s] time [s] 3
24 Intermezzo: Fourier Transform Fourier Transform: Mapping between time-domain and frequency-domain One-to-one mapping Unique: inverse Fourier Transform eists Linear technique Inverse Fourier Transform: () ( ) j () π ft X( f) =I t = t e dt () j πtf t X f X f e df ( ( )) ( ) =I = 5
25 Fourier transformation y(t) is an arbitrary signal jπ ft Y( f) y( t) e dt = Euler formula: symmetric part: cos(z) anti-symmetric part: sin(z) ( ) sin ( ) jz e = cos z + j z jπ ft jπ ft jπ ft e = re e + im e = π ft j π ft ( ) ( ) cos( ) *sin( ) 6
26 Eample Fourier Transformation jπ ft Y ( f) = y( te ) dt y( t) = sin (.5Hz) sin( Hz) Y(.5Hz): 5 Hz signal will be averaged out
27 Eample Fourier Transformation.5 y(t) = sin(.5t) 5 Y(ω) = δ(ω-.5)
28 Frequency Domain Epressions Discrete Fourier Transform: =I ( ) = t = j Uf () ut () ute () π ft where f takes values,,, - multiples of Δ f = Δ t Inverse Fourier Transform: ut () =I ( Uf ()) = Ufe () f = ft j π 9
29 Fourier transform of signals Discrete Fourier Transform (DFT) u ( k) ; k [,,, ] U( r) = DFT U( r); k= { u( k) } = u( k) r e jπrk / [,,, ] DFT maps real values in time domain to comple values in frequency domain Double information? DFT is symmetric U(-r)=U(r)* Information for / comple values r,,, 3
30 Power spectrum or auto-spectral density auto-spectral density S is Fourier Transform of autocorrelation ( ) jωτ S ( ω) =I Φ ( τ) = Φ ( τ) e dτ ( ) π jfτ S ( f) =I Φ ( τ ) = Φ ( τ) e dτ properties: Real values (no imaginary part) Symmetry: S (f)=s (-f) => only positive frequencies are analyzed C () = S (f) df = σ Area under S (f) is equal to variance of signal (Parseval s theorem) 3
31 Cross-spectrum or Cross-spectral density cross-spectral density S y : ( ) j π fτ S ( f ) =I Φ ( τ ) = Φ ( τ) e dτ y y y properties: Comple values S y* (f)=s y (-f) => only positive frequencies are analyzed S y (f) describes the interdependency of signals (t) and y(t) in frequency domain (gain and phase) if Θ y (τ) =, then S y (f) = for all frequencies 3
32 Estimators for the power spectrum Fourier transform of the autocorrelation function, the power spectrum: using the time average estimate: and multiplication with gives: e Sˆ () f = Φˆ () τ e uu ( i π i) f j τ = ˆ Suu() f = u( i τ ) e u() i e τ= i = τ uu fτ j π ˆ Φ uu( τ) = ui ( τ) ui ( ) = e = i = τ ( i τ ) f if jπ jπ Indirect approach and direct approach give equal result! = U * ( nδf) U( nδf) * : comple conjugate: U * ( nδ f) = U( nδf) 33
33 Estimator for the cross-spectrum Fourier transform of the cross-correlation function is called the cross-spectrum: Sˆ () = Φ ˆ uy f uy () τ e τ = fτ j π * Sˆ uy ( f) = U ( nδf) Y( nδf) 34
34 Time-domain vs. Frequency-domain Time Domain Fourier Transformation Frequency Domain input, output (t), y(t) X(f), Y(f) input, output cross-correlation function Φ y (τ) S y (f) cross-spectral density cross-covariance function C y (τ) correlation coefficient r y (τ) Γ y (f) coherence 35
35 Discrete and Continuous Signals Reconstruction DA conversion Distortion: Hold Circuits Sampling AD conversion Distortion: "Dirac Comb" Continuous system: Plant Digital Controller: Plant performance enhancement 36
36 Sampling, Dirac s Comb 37
37 Models of Linear Systems System: u(t) yt () = ut ( ()) y(t) Linear systems obey both scaling and superposition property! ky() t = ku ( ()) t ky() t = ku ( ()) t ky() t + ky () t = ku ( () t + ku()) t 38
38 Time domain models Assume input is a pulse with: Δt for t < d( t, Δ t) = Δt otherwise Response of linear system to pulse: ( (, Δ )) = (, Δ ) d t t h t t Assume u(t) is weighted sum of pulses: = k Δ Δ k = () (, ) u t u d t k t t 39
39 Time domain models The output is: y() t = ( u()) t k = k = ( (, )) = u d t kδtδt k (, ) = uht kδtδt k Limit case: unit-area pulse d(t,δt) is an impulse: Δ t ( Δ ) = δ ( ) lim d t, t t Then h(t) is the impulse response function (IRF) and the output the convolution integral ( ) ( ) y() t = h τ u t τ dτ 4
40 Time domain models Causal system: h(t)= for t< Finite memory: h(t)= for t>t T ( ) ( ) y() t = h τ u t τ dτ o Discrete T τ = ( ) ( ) yt () = hτ ut τ Δτ 4
41 Frequency domain models Time-domain: convolution integral Fourier transform: Yf () =I ( yt ()) =I h( τ ) ut ( τ) dτ = ( ) ( ) jπft h τ u t τ dτ e dt πft τ τ τ ( ) ( ) = h u t e dtd πτ f Uf h e d Yf () = HfUf () () ( τ) ( ) ( ) yt () = hτ ut τ dτ Convolution in time = domain () is multiplication τ in frequency domain (and vice-versa) 4
42 Estimators in time domain Cross-covariance When analyzing the dynamics of a dynamical system interested in variations of the signals around it mean (and not average value). Assuming signals with zero-mean yt () = ( h u)() t = ht (') ut ( t') dt' C ( ) { ( ) ( )} uy τ = E u t τ y t = E h( t') u( t τ) u( t t') dt' 43
43 Basic identification with crosscovariance ( ) = ( ) + ( ') ( ) y t n t h t u t-t' dt' ( ) () ( ) () ( ) ( ) multiply with ut ( τ): u t τ y t = u t τ n t + h t' u( t τ) u t-t' dt' ( ) = ( τ) + ( ) ( τ ') C τ C h t' C t dt' uy un uu ( ) uu ( ) ( ) = ( τ) + ( τ) white noise: C τ = for τ ; C = uu uy n(t)? u(t) y(t) un C τ C h Other 'tricks' needed when u(t) is not white 44
44 Basic identification with spectral densities ( ) = ( ) + ( ') ( ) yt nt ht ut-t'dt' ( ) ( ) ( ) ( ) ( ) ( ) multiply with ut ( τ): u t τ y t = u t τ n t + h t' u( t τ) u t-t' dt' Fourier transform: n(t)? u(t) y(t) ( ) = ( τ) + ( ) ( τ ') ( ) = ( ) + ( ) ( ) C τ C h t' C t dt' uy un uu S f S f H f S f uy un uu ( ) ( ) if S f = : H f = un S S uy uu ( f ) ( f ) 45
45 Identification: time-domain vs. frequency-domain n(t) u(t)? y(t) Time domain Unknown system: impulse response function (IRF) of h(t ) over limited time Mostly: direct model parameterization (fit of physics model) Frequency domain Unknown system: frequency response function (FRF) H(f) for number of frequencies 46
46 Eample IRF & FRF of typical systems Time delay First order system Second order system Unstable system (try Matlab!) 47
47 Book: Westwick & Kearney Lecture : signals Chapter, all Chapter, sec...3. Lecture : Correlation functions in time & frequency domain Chapter, sec Chapter 3, sec Lecture 3: Estimators for impulse & frequency response functions Chapter 5, sec
48 et week: lecture 3 Lecture 3: Estimation of IRF and FRF Estimator for coherence Open loop and closed loop system identification 49
Review of Fourier Transform
Review of Fourier Transform Fourier series works for periodic signals only. What s about aperiodic signals? This is very large & important class of signals Aperiodic signal can be considered as periodic
More informationENSC327 Communications Systems 2: Fourier Representations. Jie Liang School of Engineering Science Simon Fraser University
ENSC327 Communications Systems 2: Fourier Representations Jie Liang School of Engineering Science Simon Fraser University 1 Outline Chap 2.1 2.5: Signal Classifications Fourier Transform Dirac Delta Function
More information2.1 Basic Concepts Basic operations on signals Classication of signals
Haberle³me Sistemlerine Giri³ (ELE 361) 9 Eylül 2017 TOBB Ekonomi ve Teknoloji Üniversitesi, Güz 2017-18 Dr. A. Melda Yüksel Turgut & Tolga Girici Lecture Notes Chapter 2 Signals and Linear Systems 2.1
More informationE2.5 Signals & Linear Systems. Tutorial Sheet 1 Introduction to Signals & Systems (Lectures 1 & 2)
E.5 Signals & Linear Systems Tutorial Sheet 1 Introduction to Signals & Systems (Lectures 1 & ) 1. Sketch each of the following continuous-time signals, specify if the signal is periodic/non-periodic,
More informationELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random
More informationDESIGN OF CMOS ANALOG INTEGRATED CIRCUITS
DESIGN OF CMOS ANALOG INEGRAED CIRCUIS Franco Maloberti Integrated Microsistems Laboratory University of Pavia Discrete ime Signal Processing F. Maloberti: Design of CMOS Analog Integrated Circuits Discrete
More information16.584: Random (Stochastic) Processes
1 16.584: Random (Stochastic) Processes X(t): X : RV : Continuous function of the independent variable t (time, space etc.) Random process : Collection of X(t, ζ) : Indexed on another independent variable
More informationLINEAR SYSTEMS. J. Elder PSYC 6256 Principles of Neural Coding
LINEAR SYSTEMS Linear Systems 2 Neural coding and cognitive neuroscience in general concerns input-output relationships. Inputs Light intensity Pre-synaptic action potentials Number of items in display
More informationMechanical Vibrations Chapter 13
Mechanical Vibrations Chapter 3 Peter Avitabile Mechanical Engineering Department University of Massachusetts Lowell Dr. Peter Avitabile Random Vibrations Up until now, everything analyzed was deterministic.
More informationTSKS01 Digital Communication Lecture 1
TSKS01 Digital Communication Lecture 1 Introduction, Repetition, and Noise Modeling Emil Björnson Department of Electrical Engineering (ISY) Division of Communication Systems Emil Björnson Course Director
More informationVIII. Coherence and Transfer Function Applications A. Coherence Function Estimates
VIII. Coherence and Transfer Function Applications A. Coherence Function Estimates Consider the application of these ideas to the specific problem of atmospheric turbulence measurements outlined in Figure
More informationLTI Systems (Continuous & Discrete) - Basics
LTI Systems (Continuous & Discrete) - Basics 1. A system with an input x(t) and output y(t) is described by the relation: y(t) = t. x(t). This system is (a) linear and time-invariant (b) linear and time-varying
More informationIV. Covariance Analysis
IV. Covariance Analysis Autocovariance Remember that when a stochastic process has time values that are interdependent, then we can characterize that interdependency by computing the autocovariance function.
More informationFourier Analysis Linear transformations and lters. 3. Fourier Analysis. Alex Sheremet. April 11, 2007
Stochastic processes review 3. Data Analysis Techniques in Oceanography OCP668 April, 27 Stochastic processes review Denition Fixed ζ = ζ : Function X (t) = X (t, ζ). Fixed t = t: Random Variable X (ζ)
More informationEAS 305 Random Processes Viewgraph 1 of 10. Random Processes
EAS 305 Random Processes Viewgraph 1 of 10 Definitions: Random Processes A random process is a family of random variables indexed by a parameter t T, where T is called the index set λ i Experiment outcome
More information8: Correlation. E1.10 Fourier Series and Transforms ( ) Fourier Transform - Correlation: 8 1 / 11. 8: Correlation
E. Fourier Series and Transforms (25-5585) - Correlation: 8 / The cross-correlation between two signals u(t) and v(t) is w(t) = u(t) v(t) u (τ)v(τ +t)dτ = u (τ t)v(τ)dτ [sub: τ τ t] The complex conjugate,
More informationECE 636: Systems identification
ECE 636: Systems identification Lectures 3 4 Random variables/signals (continued) Random/stochastic vectors Random signals and linear systems Random signals in the frequency domain υ ε x S z + y Experimental
More information2A1H Time-Frequency Analysis II Bugs/queries to HT 2011 For hints and answers visit dwm/courses/2tf
Time-Frequency Analysis II (HT 20) 2AH 2AH Time-Frequency Analysis II Bugs/queries to david.murray@eng.ox.ac.uk HT 20 For hints and answers visit www.robots.ox.ac.uk/ dwm/courses/2tf David Murray. A periodic
More informationSolutions to Problems in Chapter 4
Solutions to Problems in Chapter 4 Problems with Solutions Problem 4. Fourier Series of the Output Voltage of an Ideal Full-Wave Diode Bridge Rectifier he nonlinear circuit in Figure 4. is a full-wave
More informationECE 636: Systems identification
ECE 636: Systems identification Lectures 7 8 onparametric identification (continued) Important distributions: chi square, t distribution, F distribution Sampling distributions ib i Sample mean If the variance
More informationStochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno
Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function.
More informationGATE EE Topic wise Questions SIGNALS & SYSTEMS
www.gatehelp.com GATE EE Topic wise Questions YEAR 010 ONE MARK Question. 1 For the system /( s + 1), the approximate time taken for a step response to reach 98% of the final value is (A) 1 s (B) s (C)
More informationModule 4. Signal Representation and Baseband Processing. Version 2 ECE IIT, Kharagpur
Module Signal Representation and Baseband Processing Version ECE II, Kharagpur Lesson 8 Response of Linear System to Random Processes Version ECE II, Kharagpur After reading this lesson, you will learn
More information06/12/ rws/jMc- modif SuFY10 (MPF) - Textbook Section IX 1
IV. Continuous-Time Signals & LTI Systems [p. 3] Analog signal definition [p. 4] Periodic signal [p. 5] One-sided signal [p. 6] Finite length signal [p. 7] Impulse function [p. 9] Sampling property [p.11]
More informationStochastic Processes
Elements of Lecture II Hamid R. Rabiee with thanks to Ali Jalali Overview Reading Assignment Chapter 9 of textbook Further Resources MIT Open Course Ware S. Karlin and H. M. Taylor, A First Course in Stochastic
More informationLOPE3202: Communication Systems 10/18/2017 2
By Lecturer Ahmed Wael Academic Year 2017-2018 LOPE3202: Communication Systems 10/18/2017 We need tools to build any communication system. Mathematics is our premium tool to do work with signals and systems.
More informationEE 3054: Signals, Systems, and Transforms Summer It is observed of some continuous-time LTI system that the input signal.
EE 34: Signals, Systems, and Transforms Summer 7 Test No notes, closed book. Show your work. Simplify your answers. 3. It is observed of some continuous-time LTI system that the input signal = 3 u(t) produces
More informationEE 224 Signals and Systems I Review 1/10
EE 224 Signals and Systems I Review 1/10 Class Contents Signals and Systems Continuous-Time and Discrete-Time Time-Domain and Frequency Domain (all these dimensions are tightly coupled) SIGNALS SYSTEMS
More informationSignals and Spectra - Review
Signals and Spectra - Review SIGNALS DETERMINISTIC No uncertainty w.r.t. the value of a signal at any time Modeled by mathematical epressions RANDOM some degree of uncertainty before the signal occurs
More information2A1H Time-Frequency Analysis II
2AH Time-Frequency Analysis II Bugs/queries to david.murray@eng.ox.ac.uk HT 209 For any corrections see the course page DW Murray at www.robots.ox.ac.uk/ dwm/courses/2tf. (a) A signal g(t) with period
More informationContinuous Time Signal Analysis: the Fourier Transform. Lathi Chapter 4
Continuous Time Signal Analysis: the Fourier Transform Lathi Chapter 4 Topics Aperiodic signal representation by the Fourier integral (CTFT) Continuous-time Fourier transform Transforms of some useful
More informationProperties of LTI Systems
Properties of LTI Systems Properties of Continuous Time LTI Systems Systems with or without memory: A system is memory less if its output at any time depends only on the value of the input at that same
More information2.161 Signal Processing: Continuous and Discrete Fall 2008
MIT OpenCourseWare http://ocw.mit.edu 2.161 Signal Processing: Continuous and Discrete Fall 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. Massachusetts
More informationENSC327 Communications Systems 2: Fourier Representations. School of Engineering Science Simon Fraser University
ENSC37 Communications Systems : Fourier Representations School o Engineering Science Simon Fraser University Outline Chap..5: Signal Classiications Fourier Transorm Dirac Delta Function Unit Impulse Fourier
More informationFigure 1 A linear, time-invariant circuit. It s important to us that the circuit is both linear and time-invariant. To see why, let s us the notation
Convolution In this section we consider the problem of determining the response of a linear, time-invariant circuit to an arbitrary input, x(t). This situation is illustrated in Figure 1 where x(t) is
More informationFourier Series and Transforms. Revision Lecture
E. (5-6) : / 3 Periodic signals can be written as a sum of sine and cosine waves: u(t) u(t) = a + n= (a ncosπnft+b n sinπnft) T = + T/3 T/ T +.65sin(πFt) -.6sin(πFt) +.6sin(πFt) + -.3cos(πFt) + T/ Fundamental
More informationNon-parametric identification
Non-parametric Non-parametric Transient Step-response using Spectral Transient Correlation Frequency function estimate Spectral System Identification, SSY230 Non-parametric 1 Non-parametric Transient Step-response
More informationSystem Identification & Parameter Estimation
System Identiication & Parameter Estimation Wb30: SIPE Lecture 9: Physical Modeling, Model and Parameter Accuracy Erwin de Vlugt, Dept. o Biomechanical Engineering BMechE, Fac. 3mE April 6 00 Delt University
More information7 The Waveform Channel
7 The Waveform Channel The waveform transmitted by the digital demodulator will be corrupted by the channel before it reaches the digital demodulator in the receiver. One important part of the channel
More informationThe Hilbert Transform
The Hilbert Transform David Hilbert 1 ABSTRACT: In this presentation, the basic theoretical background of the Hilbert Transform is introduced. Using this transform, normal real-valued time domain functions
More informationLECTURE 12 Sections Introduction to the Fourier series of periodic signals
Signals and Systems I Wednesday, February 11, 29 LECURE 12 Sections 3.1-3.3 Introduction to the Fourier series of periodic signals Chapter 3: Fourier Series of periodic signals 3. Introduction 3.1 Historical
More informationECEN 420 LINEAR CONTROL SYSTEMS. Lecture 2 Laplace Transform I 1/52
1/52 ECEN 420 LINEAR CONTROL SYSTEMS Lecture 2 Laplace Transform I Linear Time Invariant Systems A general LTI system may be described by the linear constant coefficient differential equation: a n d n
More information6: Fourier Transform
6: Fourier Transform and 6: E. Fourier Series and Transforms (4-5559) : 6 / 6: and Fourier Series: u(t) = n= U ne iπnft The harmonic frequencies are nf n and are spaced F = T apart. As T gets larger, the
More information13. Power Spectrum. For a deterministic signal x(t), the spectrum is well defined: If represents its Fourier transform, i.e., if.
For a deterministic signal x(t), the spectrum is well defined: If represents its Fourier transform, i.e., if jt X ( ) = xte ( ) dt, (3-) then X ( ) represents its energy spectrum. his follows from Parseval
More information4.1. If the input of the system consists of the superposition of M functions, M
4. The Zero-State Response: The system state refers to all information required at a point in time in order that a unique solution for the future output can be compute from the input. In the case of LTIC
More informationVer 3808 E1.10 Fourier Series and Transforms (2014) E1.10 Fourier Series and Transforms. Problem Sheet 1 (Lecture 1)
Ver 88 E. Fourier Series and Transforms 4 Key: [A] easy... [E]hard Questions from RBH textbook: 4., 4.8. E. Fourier Series and Transforms Problem Sheet Lecture. [B] Using the geometric progression formula,
More informationLaplace Transforms and use in Automatic Control
Laplace Transforms and use in Automatic Control P.S. Gandhi Mechanical Engineering IIT Bombay Acknowledgements: P.Santosh Krishna, SYSCON Recap Fourier series Fourier transform: aperiodic Convolution integral
More informatione st f (t) dt = e st tf(t) dt = L {t f(t)} s
Additional operational properties How to find the Laplace transform of a function f (t) that is multiplied by a monomial t n, the transform of a special type of integral, and the transform of a periodic
More informationLesson 1. Optimal signalbehandling LTH. September Statistical Digital Signal Processing and Modeling, Hayes, M:
Lesson 1 Optimal Signal Processing Optimal signalbehandling LTH September 2013 Statistical Digital Signal Processing and Modeling, Hayes, M: John Wiley & Sons, 1996. ISBN 0471594318 Nedelko Grbic Mtrl
More informationCommunication Systems Lecture 21, 22. Dong In Kim School of Information & Comm. Eng. Sungkyunkwan University
Communication Systems Lecture 1, Dong In Kim School of Information & Comm. Eng. Sungkyunkwan University 1 Outline Linear Systems with WSS Inputs Noise White noise, Gaussian noise, White Gaussian noise
More informationDEPARTMENT OF ELECTRICAL AND ELECTRONIC ENGINEERING EXAMINATIONS 2010
[E2.5] IMPERIAL COLLEGE LONDON DEPARTMENT OF ELECTRICAL AND ELECTRONIC ENGINEERING EXAMINATIONS 2010 EEE/ISE PART II MEng. BEng and ACGI SIGNALS AND LINEAR SYSTEMS Time allowed: 2:00 hours There are FOUR
More informationCorrelation, discrete Fourier transforms and the power spectral density
Correlation, discrete Fourier transforms and the power spectral density visuals to accompany lectures, notes and m-files by Tak Igusa tigusa@jhu.edu Department of Civil Engineering Johns Hopkins University
More informationThe (Fast) Fourier Transform
The (Fast) Fourier Transform The Fourier transform (FT) is the analog, for non-periodic functions, of the Fourier series for periodic functions can be considered as a Fourier series in the limit that the
More informationFourier Analysis and Power Spectral Density
Chapter 4 Fourier Analysis and Power Spectral Density 4. Fourier Series and ransforms Recall Fourier series for periodic functions for x(t + ) = x(t), where x(t) = 2 a + a = 2 a n = 2 b n = 2 n= a n cos
More informationModule 4. Related web links and videos. 1. FT and ZT
Module 4 Laplace transforms, ROC, rational systems, Z transform, properties of LT and ZT, rational functions, system properties from ROC, inverse transforms Related web links and videos Sl no Web link
More informationMassachusetts Institute of Technology
Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.011: Introduction to Communication, Control and Signal Processing QUIZ, April 1, 010 QUESTION BOOKLET Your
More informationFourier Methods in Digital Signal Processing Final Exam ME 579, Spring 2015 NAME
Fourier Methods in Digital Signal Processing Final Exam ME 579, Instructions for this CLOSED BOOK EXAM 2 hours long. Monday, May 8th, 8-10am in ME1051 Answer FIVE Questions, at LEAST ONE from each section.
More informationEE538 Final Exam Fall :20 pm -5:20 pm PHYS 223 Dec. 17, Cover Sheet
EE538 Final Exam Fall 005 3:0 pm -5:0 pm PHYS 3 Dec. 17, 005 Cover Sheet Test Duration: 10 minutes. Open Book but Closed Notes. Calculators ARE allowed!! This test contains five problems. Each of the five
More informationFigure 3.1 Effect on frequency spectrum of increasing period T 0. Consider the amplitude spectrum of a periodic waveform as shown in Figure 3.2.
3. Fourier ransorm From Fourier Series to Fourier ransorm [, 2] In communication systems, we oten deal with non-periodic signals. An extension o the time-requency relationship to a non-periodic signal
More informationSignal Design for Band-Limited Channels
Wireless Information Transmission System Lab. Signal Design for Band-Limited Channels Institute of Communications Engineering National Sun Yat-sen University Introduction We consider the problem of signal
More informationAppendix A PROBABILITY AND RANDOM SIGNALS. A.1 Probability
Appendi A PROBABILITY AND RANDOM SIGNALS Deterministic waveforms are waveforms which can be epressed, at least in principle, as an eplicit function of time. At any time t = t, there is no uncertainty about
More informationSinc Functions. Continuous-Time Rectangular Pulse
Sinc Functions The Cooper Union Department of Electrical Engineering ECE114 Digital Signal Processing Lecture Notes: Sinc Functions and Sampling Theory October 7, 2011 A rectangular pulse in time/frequency
More information14 - Gaussian Stochastic Processes
14-1 Gaussian Stochastic Processes S. Lall, Stanford 211.2.24.1 14 - Gaussian Stochastic Processes Linear systems driven by IID noise Evolution of mean and covariance Example: mass-spring system Steady-state
More informationMixed Signal IC Design Notes set 6: Mathematics of Electrical Noise
ECE45C /8C notes, M. odwell, copyrighted 007 Mied Signal IC Design Notes set 6: Mathematics o Electrical Noise Mark odwell University o Caliornia, Santa Barbara rodwell@ece.ucsb.edu 805-893-344, 805-893-36
More informationFundamentals of the Discrete Fourier Transform
Seminar presentation at the Politecnico di Milano, Como, November 12, 2012 Fundamentals of the Discrete Fourier Transform Michael G. Sideris sideris@ucalgary.ca Department of Geomatics Engineering University
More informationRandom signals II. ÚPGM FIT VUT Brno,
Random signals II. Jan Černocký ÚPGM FIT VUT Brno, cernocky@fit.vutbr.cz 1 Temporal estimate of autocorrelation coefficients for ergodic discrete-time random process. ˆR[k] = 1 N N 1 n=0 x[n]x[n + k],
More information4 The Continuous Time Fourier Transform
96 4 The Continuous Time ourier Transform ourier (or frequency domain) analysis turns out to be a tool of even greater usefulness Extension of ourier series representation to aperiodic signals oundation
More informationLecture 8 ELE 301: Signals and Systems
Lecture 8 ELE 30: Signals and Systems Prof. Paul Cuff Princeton University Fall 20-2 Cuff (Lecture 7) ELE 30: Signals and Systems Fall 20-2 / 37 Properties of the Fourier Transform Properties of the Fourier
More informationLecture 6: Time-Domain Analysis of Continuous-Time Systems Dr.-Ing. Sudchai Boonto
Lecture 6: Time-Domain Analysis of Continuous-Time Systems Dr-Ing Sudchai Boonto Department of Control System and Instrumentation Engineering King Mongkut s Unniversity of Technology Thonburi Thailand
More informationLecture 1: Pragmatic Introduction to Stochastic Differential Equations
Lecture 1: Pragmatic Introduction to Stochastic Differential Equations Simo Särkkä Aalto University, Finland (visiting at Oxford University, UK) November 13, 2013 Simo Särkkä (Aalto) Lecture 1: Pragmatic
More informationFourier Transform 2D
Image Processing - Lesson 8 Fourier Transform 2D Discrete Fourier Transform - 2D Continues Fourier Transform - 2D Fourier Properties Convolution Theorem Eamples = + + + The 2D Discrete Fourier Transform
More informationA6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2013
A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2013 Lecture 26 Localization/Matched Filtering (continued) Prewhitening Lectures next week: Reading Bases, principal
More informationChapter 5 Random Variables and Processes
Chapter 5 Random Variables and Processes Wireless Information Transmission System Lab. Institute of Communications Engineering National Sun Yat-sen University Table of Contents 5.1 Introduction 5. Probability
More informationA system that is both linear and time-invariant is called linear time-invariant (LTI).
The Cooper Union Department of Electrical Engineering ECE111 Signal Processing & Systems Analysis Lecture Notes: Time, Frequency & Transform Domains February 28, 2012 Signals & Systems Signals are mapped
More informationGEORGIA INSTITUTE OF TECHNOLOGY SCHOOL of ELECTRICAL & COMPUTER ENGINEERING FINAL EXAM. COURSE: ECE 3084A (Prof. Michaels)
GEORGIA INSTITUTE OF TECHNOLOGY SCHOOL of ELECTRICAL & COMPUTER ENGINEERING FINAL EXAM DATE: 30-Apr-14 COURSE: ECE 3084A (Prof. Michaels) NAME: STUDENT #: LAST, FIRST Write your name on the front page
More informationThis examination consists of 10 pages. Please check that you have a complete copy. Time: 2.5 hrs INSTRUCTIONS
THE UNIVERSITY OF BRITISH COLUMBIA Department of Electrical and Computer Engineering EECE 564 Detection and Estimation of Signals in Noise Final Examination 08 December 2009 This examination consists of
More informationDigital Filters Ying Sun
Digital Filters Ying Sun Digital filters Finite impulse response (FIR filter: h[n] has a finite numbers of terms. Infinite impulse response (IIR filter: h[n] has infinite numbers of terms. Causal filter:
More informationEmpirical Mean and Variance!
Global Image Properties! Global image properties refer to an image as a whole rather than components. Computation of global image properties is often required for image enhancement, preceding image analysis.!
More informationQuestion Paper Code : AEC11T02
Hall Ticket No Question Paper Code : AEC11T02 VARDHAMAN COLLEGE OF ENGINEERING (AUTONOMOUS) Affiliated to JNTUH, Hyderabad Four Year B. Tech III Semester Tutorial Question Bank 2013-14 (Regulations: VCE-R11)
More informationFourier transform representation of CT aperiodic signals Section 4.1
Fourier transform representation of CT aperiodic signals Section 4. A large class of aperiodic CT signals can be represented by the CT Fourier transform (CTFT). The (CT) Fourier transform (or spectrum)
More information2.161 Signal Processing: Continuous and Discrete Fall 2008
MIT OpenCourseWare http://ocw.mit.edu 2.161 Signal Processing: Continuous and Discrete Fall 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. Massachusetts
More informationUniversity Question Paper Solution
Unit 1: Introduction University Question Paper Solution 1. Determine whether the following systems are: i) Memoryless, ii) Stable iii) Causal iv) Linear and v) Time-invariant. i) y(n)= nx(n) ii) y(t)=
More information6.435, System Identification
System Identification 6.435 SET 3 Nonparametric Identification Munther A. Dahleh 1 Nonparametric Methods for System ID Time domain methods Impulse response Step response Correlation analysis / time Frequency
More informationSystem Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang
System Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang 1-1 Course Description Emphases Delivering concepts and Practice Programming Identification Methods using Matlab Class
More information1 Signals and systems
978--52-5688-4 - Introduction to Orthogonal Transforms: With Applications in Data Processing and Analysis Signals and systems In the first two chapters we will consider some basic concepts and ideas as
More informationLecture 1: Introduction to System Modeling and Control. Introduction Basic Definitions Different Model Types System Identification
Lecture 1: Introduction to System Modeling and Control Introduction Basic Definitions Different Model Types System Identification What is Mathematical Model? A set of mathematical equations (e.g., differential
More informationSound & Vibration Magazine March, Fundamentals of the Discrete Fourier Transform
Fundamentals of the Discrete Fourier Transform Mark H. Richardson Hewlett Packard Corporation Santa Clara, California The Fourier transform is a mathematical procedure that was discovered by a French mathematician
More informationENGIN 211, Engineering Math. Laplace Transforms
ENGIN 211, Engineering Math Laplace Transforms 1 Why Laplace Transform? Laplace transform converts a function in the time domain to its frequency domain. It is a powerful, systematic method in solving
More informationSquare Root Raised Cosine Filter
Wireless Information Transmission System Lab. Square Root Raised Cosine Filter Institute of Communications Engineering National Sun Yat-sen University Introduction We consider the problem of signal design
More informationLab 4: Quantization, Oversampling, and Noise Shaping
Lab 4: Quantization, Oversampling, and Noise Shaping Due Friday 04/21/17 Overview: This assignment should be completed with your assigned lab partner(s). Each group must turn in a report composed using
More informationEL1820 Modeling of Dynamical Systems
EL1820 Modeling of Dynamical Systems Lecture 10 - System identification as a model building tool Experiment design Examination and prefiltering of data Model structure selection Model validation Lecture
More informationECE-314 Fall 2012 Review Questions for Midterm Examination II
ECE-314 Fall 2012 Review Questions for Midterm Examination II First, make sure you study all the problems and their solutions from homework sets 4-7. Then work on the following additional problems. Problem
More informationHomework 4. May An LTI system has an input, x(t) and output y(t) related through the equation y(t) = t e (t t ) x(t 2)dt
Homework 4 May 2017 1. An LTI system has an input, x(t) and output y(t) related through the equation y(t) = t e (t t ) x(t 2)dt Determine the impulse response of the system. Rewriting as y(t) = t e (t
More informationDr. Ian R. Manchester
Dr Ian R. Manchester Week Content Notes 1 Introduction 2 Frequency Domain Modelling 3 Transient Performance and the s-plane 4 Block Diagrams 5 Feedback System Characteristics Assign 1 Due 6 Root Locus
More informationReview of Discrete-Time System
Review of Discrete-Time System Electrical & Computer Engineering University of Maryland, College Park Acknowledgment: ENEE630 slides were based on class notes developed by Profs. K.J. Ray Liu and Min Wu.
More informationRepresentation of Signals & Systems
Representation of Signals & Systems Reference: Chapter 2,Communication Systems, Simon Haykin. Hilbert Transform Fourier transform frequency content of a signal (frequency selectivity designing frequency-selective
More information3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE
3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE 3.0 INTRODUCTION The purpose of this chapter is to introduce estimators shortly. More elaborated courses on System Identification, which are given
More informationMathematical Foundations of Signal Processing
Mathematical Foundations of Signal Processing Module 4: Continuous-Time Systems and Signals Benjamín Béjar Haro Mihailo Kolundžija Reza Parhizkar Adam Scholefield October 24, 2016 Continuous Time Signals
More informationRaktim Bhattacharya. . AERO 422: Active Controls for Aerospace Vehicles. Frequency Response-Design Method
.. AERO 422: Active Controls for Aerospace Vehicles Frequency Response- Method Raktim Bhattacharya Laboratory For Uncertainty Quantification Aerospace Engineering, Texas A&M University. ... Response to
More informationA3. Frequency Representation of Continuous Time and Discrete Time Signals
A3. Frequency Representation of Continuous Time and Discrete Time Signals Objectives Define the magnitude and phase plots of continuous time sinusoidal signals Extend the magnitude and phase plots to discrete
More information