Non-parametric identification
|
|
- Griffin Stevenson
- 5 years ago
- Views:
Transcription
1 Non-parametric Non-parametric Transient Step-response using Spectral Transient Correlation Frequency function estimate Spectral System Identification, SSY230 Non-parametric 1
2 Non-parametric Transient Step-response using Spectral Consider the system described by or, equivalently, y(t) = y(t) =G 0 (q)u(t)+v(t) g 0 (k)u(t k)+v(t) k=1 Question: Can we determine G 0 (q) or {g 0 (k)} without parameterizing in θ? System Identification, SSY230 Non-parametric 2
3 Transient Non-parametric Transient Step-response using Spectral Applying the input gives the output u(t) = { k, t =0 0, t 0 y(t) =k g 0 (t)+v(t) which motivates the impulse response estimate ĝ(t) = y(t) k System Identification, SSY230 Non-parametric 3
4 Step-response Non-parametric Transient Step-response using Spectral Step input: u(t) = gives the output y(t) =k so that ĝ(t) = { k, t 0 0, t < 0 t g 0 (k)+v(t) k=1 y(t) y(t 1) k Problems with transient techniques: excitation disturbances nonlinearities System Identification, SSY230 Non-parametric 4
5 Some times one is not allowed to do anything else than small step changes. : For a tank with ideal mixing: V dc dt = Q(c i c) V :tankvolume,q: flow,c, c i : tank and flow concentration. Apply an impulsive concentration input: Stewart-Hamilton s equation: c i (t) =δ(t) c(t) = Q V e Q V t = h(t) 0 t h(t)dt = V Q Application: Blood volume measurement System Identification, SSY230 Non-parametric 5
6 using Non-parametric Transient Step-response using Spectral Assume that u is quasi-stationary and u and v are uncorrelated: Φ yu (ω) =G 0 (e iω )Φ u (ω) or R yu (τ) = g 0 (k)r u (τ k) k=1 Truncate the sum and solve the resulting system of equations for ĝ(k): M ˆR yu(τ) N = ĝ(k) ˆR u N (τ k) k=1 where estimates of the covariance function are formed as ˆR N u (τ) = 1 N N u(t)u(t τ) t=1 System Identification, SSY230 Non-parametric 6
7 Non-parametric Transient Step-response using Spectral Note: when u( ) is white noise the estimate becomes ĝ(k) = ˆR N yu(k) σ 2 u System Identification, SSY230 Non-parametric 7
8 Non-parametric Transient Step-response using Spectral So far we have estimated g 0 (k) what about estimating G 0 (e iω )? α cos ωt Measure amplitude and phase using : I c (N) = 1 N α y(t)cosωt N 2 G 0(e iω ) cos φ I s (N) = 1 N α y(t)sinωt N 2 G 0(e iω ) sin φ G α G cos(ωt + φ)+v(t) System Identification, SSY230 Non-parametric 8
9 Non-parametric Transient Step-response using Spectral implying I c (N) i I s (N) α 2 G 0(e iω ) (cos φ + i sin φ) so that Ĝ N = 2 α (I c(n) i I s (N)) System Identification, SSY230 Non-parametric 9
10 Interpretation of frequency response by the method: Recall that Y N (ω) = 1 N N t=1 y(t)e iωt = N(I c (N) i I s (N)) so that Ĝ N = 2 α (I c(n) i I s (N)) = 2 α N Y N(ω) = Y N(ω) U N (ω) where the last equality holds for ω = 2π N k. Hence, the estimate obtained using frequency by the method is simply the ratio between the DFT of the output and the input. This can be generalized... System Identification, SSY230 Non-parametric 10
11 Non-parametric Transient Step-response using Spectral Consider the open-loop system y(t) = G o (q)u(t)+v(t) Y N (ω) = G o (e iω )U N (ω)+v N (ω)+r N (ω) where R N (ω) 1/ N (or =0if u is periodic). function estimate () is: Ĝ(e iω )= Y N(ω) U N (ω), ω = k 2π N System Identification, SSY230 Non-parametric 11
12 Non-parametric Transient Step-response using Spectral Properties: u periodic number of ω fixed unbiased variance 1/N EĜ N (e iω ) = G 0 (e iω )+ R N (ω) U N (ω) VarĜ N (e iω Φ v (ω) ) U N (ω) 2 u stochastic process number of ω increases asymptotically unbiased variance (SNR) 1 as. uncorrelated System Identification, SSY230 Non-parametric 12
13 Spectral The is comprised of uncorrelated estimates at different ω but we know that the frequency response is smooth in reality! Idea: (1) Compute Ĝ(eiω ) as a weighted sum of the Ĝ around ω = ω 0 : Ĝ(e iω 0 )= k2 k=k 1 α k Ĝ(e iω k) k2 k=k 1 α k (1) where 2πk 1 /N = ω 0 Δ and 2πk 2 /N = ω 0 +Δ (2) Now choose {α k } inversely proportional to the variance of Ĝ(e iω k): Ĝ(e iω 0 )= UN (ω k ) 2 Φ v (ω k ) Ĝ(e iω k) UN (ω k ) 2 Φ v (ω k ) ω0 +Δ U N (ω) 2 ω 0 Δ Φ v (ω) ω0 +Δ U N (ω) 2 ω 0 Δ Φ v (ω) Ĝ(e iω )dω dω System Identification, SSY230 Non-parametric 13
14 (3) Put weight according to distance from ω 0 : Ĝ(e iω 0 )= π π W γ(ω ω 0 ) U N (ω) 2 Φ v (ω) Ĝ(e iω )dω π π π π W γ(ω ω 0 ) U W γ(ω ω 0 ) U N (ω) 2 Ĝ(e iω )dω N (ω) 2 π Φ v (ω) dω π W γ(ω ω 0 ) U N (ω) 2 dω π π = W γ(ω ω 0 )Y N (ω)u N (ω)dω π π W γ(ω ω 0 ) U N (ω) 2 = ˆΦ yu (ω 0 ) (2) dω ˆΦ u (ω 0 ) This is the estimate obtained by spectral according to Blackman-Tukey. The estimate is obtained by a natural replacement of the spectra in Φ yu (ω) =G 0 (e iω )Φ u (ω) (3) by the corresponding smoothed periodograms. System Identification, SSY230 Non-parametric 14
15 Non-parametric Transient Step-response using Spectral Consider the spectral estimate ˆΦ u (ω) = π π W γ (ω ω 0 ) U N (ω) 2 dω where the frequency window, W γ, is narrow for large γ. System Identification, SSY230 Non-parametric 15
16 Non-parametric Transient Step-response using Spectral The convolution above is transformed into multiplication in the time domain, so that where w γ (τ) = 1 2π ˆR u (τ) = 1 2π ˆΦ u (ω) = π π π π w γ (τ) ˆR u (τ)e iωτ W γ (ω)e iωτ dω U N (ω) 2 e iωτ dω = 1 N N u(t)u(t τ) Note: The time (lag) window w γ (τ) is wide when the frequency window W γ (ω) is narrow, and vice versa. System Identification, SSY230 Non-parametric 16
17 Non-parametric Transient Step-response using Spectral When γ increases (narrow frequency window), the bias decreases but the variance increases. This can be expressed in terms of the functions M(γ) = W (γ) =2π π π π π when γ.also, W (γ) γ. ω 2 W γ (ω)dω 0 (4) W 2 γ (ω)dω (5) System Identification, SSY230 Non-parametric 17
18 Non-parametric Transient Step-response using Spectral Theorem: Assume that y(t) =G 0 (q)u(t)+v(t) (6) where v( ) is a stochastic process, independent of u( ), whichis quasi-stationary. Then the following asymptotic results hold when γ,n,γ/n 0: [ ] 1 EĜN (e iω ) G 0 (e iω ) M(γ) 2 G 0 + G 0 Φ u Φ u E ĜN EĜN 2 1 N W γ Φv Φ u ReĜN, ImĜN are as. uncorrelated Estimates at different ω are as. uncorrelated System Identification, SSY230 Non-parametric 18
Chapter 6: Nonparametric Time- and Frequency-Domain Methods. Problems presented by Uwe
System Identification written by L. Ljung, Prentice Hall PTR, 1999 Chapter 6: Nonparametric Time- and Frequency-Domain Methods Problems presented by Uwe System Identification Problems Chapter 6 p. 1/33
More information6.435, System Identification
System Identification 6.435 SET 3 Nonparametric Identification Munther A. Dahleh 1 Nonparametric Methods for System ID Time domain methods Impulse response Step response Correlation analysis / time Frequency
More informationEE531 (Semester II, 2010) 6. Spectral analysis. power spectral density. periodogram analysis. window functions 6-1
6. Spectral analysis EE531 (Semester II, 2010) power spectral density periodogram analysis window functions 6-1 Wiener-Khinchin theorem: Power Spectral density if a process is wide-sense stationary, the
More informationIdentification, Model Validation and Control. Lennart Ljung, Linköping
Identification, Model Validation and Control Lennart Ljung, Linköping Acknowledgment: Useful discussions with U Forssell and H Hjalmarsson 1 Outline 1. Introduction 2. System Identification (in closed
More informationTime Series Analysis. Solutions to problems in Chapter 7 IMM
Time Series Analysis Solutions to problems in Chapter 7 I Solution 7.1 Question 1. As we get by subtraction kx t = 1 + B + B +...B k 1 )ǫ t θb) = 1 + B +... + B k 1 ), and BθB) = B + B +... + B k ), 1
More information13.42 READING 6: SPECTRUM OF A RANDOM PROCESS 1. STATIONARY AND ERGODIC RANDOM PROCESSES
13.42 READING 6: SPECTRUM OF A RANDOM PROCESS SPRING 24 c A. H. TECHET & M.S. TRIANTAFYLLOU 1. STATIONARY AND ERGODIC RANDOM PROCESSES Given the random process y(ζ, t) we assume that the expected value
More informationSystem Identification & Parameter Estimation
System Identification & Parameter Estimation Wb3: SIPE lecture Correlation functions in time & frequency domain Alfred C. Schouten, Dept. of Biomechanical Engineering (BMechE), Fac. 3mE // Delft University
More informationECE 636: Systems identification
ECE 636: Systems identification Lectures 7 8 onparametric identification (continued) Important distributions: chi square, t distribution, F distribution Sampling distributions ib i Sample mean If the variance
More informationEL1820 Modeling of Dynamical Systems
EL1820 Modeling of Dynamical Systems Lecture 10 - System identification as a model building tool Experiment design Examination and prefiltering of data Model structure selection Model validation Lecture
More informationStochastic Process II Dr.-Ing. Sudchai Boonto
Dr-Ing Sudchai Boonto Department of Control System and Instrumentation Engineering King Mongkuts Unniversity of Technology Thonburi Thailand Random process Consider a random experiment specified by the
More informationEL1820 Modeling of Dynamical Systems
EL1820 Modeling of Dynamical Systems Lecture 9 - Parameter estimation in linear models Model structures Parameter estimation via prediction error minimization Properties of the estimate: bias and variance
More informationMassachusetts Institute of Technology Department of Electrical Engineering and Computer Science : Discrete-Time Signal Processing
Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.34: Discrete-Time Signal Processing OpenCourseWare 006 ecture 8 Periodogram Reading: Sections 0.6 and 0.7
More informationLINEAR RESPONSE THEORY
MIT Department of Chemistry 5.74, Spring 5: Introductory Quantum Mechanics II Instructor: Professor Andrei Tokmakoff p. 8 LINEAR RESPONSE THEORY We have statistically described the time-dependent behavior
More informationReview of Frequency Domain Fourier Series: Continuous periodic frequency components
Today we will review: Review of Frequency Domain Fourier series why we use it trig form & exponential form how to get coefficients for each form Eigenfunctions what they are how they relate to LTI systems
More informationX random; interested in impact of X on Y. Time series analogue of regression.
Multiple time series Given: two series Y and X. Relationship between series? Possible approaches: X deterministic: regress Y on X via generalized least squares: arima.mle in SPlus or arima in R. We have
More informationD.S.G. POLLOCK: BRIEF NOTES
BIVARIATE SPECTRAL ANALYSIS Let x(t) and y(t) be two stationary stochastic processes with E{x(t)} = E{y(t)} =. These processes have the following spectral representations: (1) x(t) = y(t) = {cos(ωt)da
More informationSystem Identification and Parameter Estimation
Faculty of Engineering Technology Mechanical Automation and Mechatronics System Identification and Parameter Estimation 1 1 Frequency response 1 Amplitude 1 1 1 2 1 3 1 2 1 3 Phase (deg) 1 2 3 4 5 6 7
More informationSignals and Spectra (1A) Young Won Lim 11/26/12
Signals and Spectra (A) Copyright (c) 202 Young W. Lim. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version.2 or any later
More information2A1H Time-Frequency Analysis II
2AH Time-Frequency Analysis II Bugs/queries to david.murray@eng.ox.ac.uk HT 209 For any corrections see the course page DW Murray at www.robots.ox.ac.uk/ dwm/courses/2tf. (a) A signal g(t) with period
More informationSystems Analysis and Control
Systems Analysis and Control Matthew M. Peet Illinois Institute of Technology Lecture 2: Drawing Bode Plots, Part 2 Overview In this Lecture, you will learn: Simple Plots Real Zeros Real Poles Complex
More informationFundamentals of the Discrete Fourier Transform
Seminar presentation at the Politecnico di Milano, Como, November 12, 2012 Fundamentals of the Discrete Fourier Transform Michael G. Sideris sideris@ucalgary.ca Department of Geomatics Engineering University
More informationPractical Spectral Estimation
Digital Signal Processing/F.G. Meyer Lecture 4 Copyright 2015 François G. Meyer. All Rights Reserved. Practical Spectral Estimation 1 Introduction The goal of spectral estimation is to estimate how the
More information3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE
3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE 3.0 INTRODUCTION The purpose of this chapter is to introduce estimators shortly. More elaborated courses on System Identification, which are given
More informationSystem Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang
System Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang 1-1 Course Description Emphases Delivering concepts and Practice Programming Identification Methods using Matlab Class
More informationENSC327 Communications Systems 2: Fourier Representations. School of Engineering Science Simon Fraser University
ENSC37 Communications Systems : Fourier Representations School o Engineering Science Simon Fraser University Outline Chap..5: Signal Classiications Fourier Transorm Dirac Delta Function Unit Impulse Fourier
More informationSpectral Analysis of Random Processes
Spectral Analysis of Random Processes Spectral Analysis of Random Processes Generally, all properties of a random process should be defined by averaging over the ensemble of realizations. Generally, all
More informationSystem Identification
System Identification Lecture 4: Transfer function averaging and smoothing Roy Smith 28-- 4. Averaging Multiple estimates Multiple experiments: u r pk, y r pk, r,..., R, and k,..., K. Multiple estimates
More informationLinear Approximations of Nonlinear FIR Systems for Separable Input Processes
Linear Approximations of Nonlinear FIR Systems for Separable Input Processes Martin Enqvist, Lennart Ljung Division of Automatic Control Department of Electrical Engineering Linköpings universitet, SE-581
More informationLinear and Nonlinear Oscillators (Lecture 2)
Linear and Nonlinear Oscillators (Lecture 2) January 25, 2016 7/441 Lecture outline A simple model of a linear oscillator lies in the foundation of many physical phenomena in accelerator dynamics. A typical
More informationTime series models in the Frequency domain. The power spectrum, Spectral analysis
ime series models in the Frequency domain he power spectrum, Spectral analysis Relationship between the periodogram and the autocorrelations = + = ( ) ( ˆ α ˆ ) β I Yt cos t + Yt sin t t= t= ( ( ) ) cosλ
More informationIDENTIFICATION FOR CONTROL
IDENTIFICATION FOR CONTROL Raymond A. de Callafon, University of California San Diego, USA Paul M.J. Van den Hof, Delft University of Technology, the Netherlands Keywords: Controller, Closed loop model,
More informationf-domain expression for the limit model Combine: 5.12 Approximate Modelling What can be said about H(q, θ) G(q, θ ) H(q, θ ) with
5.2 Approximate Modelling What can be said about if S / M, and even G / G? G(q, ) H(q, ) f-domain expression for the limit model Combine: with ε(t, ) =H(q, ) [y(t) G(q, )u(t)] y(t) =G (q)u(t) v(t) We know
More informationENSC327 Communications Systems 2: Fourier Representations. Jie Liang School of Engineering Science Simon Fraser University
ENSC327 Communications Systems 2: Fourier Representations Jie Liang School of Engineering Science Simon Fraser University 1 Outline Chap 2.1 2.5: Signal Classifications Fourier Transform Dirac Delta Function
More informationContinuous-Time Frequency Response (II) Lecture 28: EECS 20 N April 2, Laurent El Ghaoui
EECS 20 N April 2, 2001 Lecture 28: Continuous-Time Frequency Response (II) Laurent El Ghaoui 1 annoucements homework due on Wednesday 4/4 at 11 AM midterm: Friday, 4/6 includes all chapters until chapter
More information2A1H Time-Frequency Analysis II Bugs/queries to HT 2011 For hints and answers visit dwm/courses/2tf
Time-Frequency Analysis II (HT 20) 2AH 2AH Time-Frequency Analysis II Bugs/queries to david.murray@eng.ox.ac.uk HT 20 For hints and answers visit www.robots.ox.ac.uk/ dwm/courses/2tf David Murray. A periodic
More informationELEC2400 Signals & Systems
ELEC2400 Signals & Systems Chapter 7. Z-Transforms Brett Ninnes brett@newcastle.edu.au. School of Electrical Engineering and Computer Science The University of Newcastle Slides by Juan I. Yu (jiyue@ee.newcastle.edu.au
More informatione iωt dt and explained why δ(ω) = 0 for ω 0 but δ(0) =. A crucial property of the delta function, however, is that
Phys 53 Fourier Transforms In this handout, I will go through the derivations of some of the results I gave in class (Lecture 4, /). I won t reintroduce the concepts though, so if you haven t seen the
More informationEEM 409. Random Signals. Problem Set-2: (Power Spectral Density, LTI Systems with Random Inputs) Problem 1: Problem 2:
EEM 409 Random Signals Problem Set-2: (Power Spectral Density, LTI Systems with Random Inputs) Problem 1: Consider a random process of the form = + Problem 2: X(t) = b cos(2π t + ), where b is a constant,
More informatione iωt dt and explained why δ(ω) = 0 for ω 0 but δ(0) =. A crucial property of the delta function, however, is that
Phys 531 Fourier Transforms In this handout, I will go through the derivations of some of the results I gave in class (Lecture 14, 1/11). I won t reintroduce the concepts though, so you ll want to refer
More informationTHE FOURIER TRANSFORM (Fourier series for a function whose period is very, very long) Reading: Main 11.3
THE FOURIER TRANSFORM (Fourier series for a function whose period is very, very long) Reading: Main 11.3 Any periodic function f(t) can be written as a Fourier Series a 0 2 + a n cos( nωt) + b n sin n
More informationLecture 11: Spectral Analysis
Lecture 11: Spectral Analysis Methods For Estimating The Spectrum Walid Sharabati Purdue University Latest Update October 27, 2016 Professor Sharabati (Purdue University) Time Series Analysis October 27,
More informationEE538 Final Exam Fall :20 pm -5:20 pm PHYS 223 Dec. 17, Cover Sheet
EE538 Final Exam Fall 005 3:0 pm -5:0 pm PHYS 3 Dec. 17, 005 Cover Sheet Test Duration: 10 minutes. Open Book but Closed Notes. Calculators ARE allowed!! This test contains five problems. Each of the five
More informationThe Discrete Fourier Transform (DFT) Properties of the DFT DFT-Specic Properties Power spectrum estimate. Alex Sheremet.
4. April 2, 27 -order sequences Measurements produce sequences of numbers Measurement purpose: characterize a stochastic process. Example: Process: water surface elevation as a function of time Parameters:
More informationSPECTRUM. Deterministic Signals with Finite Energy (l 2 ) Deterministic Signals with Infinite Energy N 1. n=0. N N X N(f) 2
SPECTRUM Deterministic Signals with Finite Energy (l 2 ) Energy Spectrum: S xx (f) = X(f) 2 = 2 x(n)e j2πfn n= Deterministic Signals with Infinite Energy DTFT of truncated signal: X N (f) = N x(n)e j2πfn
More informationA summary of Modeling and Simulation
A summary of Modeling and Simulation Text-book: Modeling of dynamic systems Lennart Ljung and Torkel Glad Content What re Models for systems and signals? Basic concepts Types of models How to build a model
More informationIntroduction to system identification
Introduction to system identification Jan Swevers July 2006 0-0 Introduction to system identification 1 Contents of this lecture What is system identification Time vs. frequency domain identification Discrete
More informationSolutions to Problems in Chapter 4
Solutions to Problems in Chapter 4 Problems with Solutions Problem 4. Fourier Series of the Output Voltage of an Ideal Full-Wave Diode Bridge Rectifier he nonlinear circuit in Figure 4. is a full-wave
More informationEAS 305 Random Processes Viewgraph 1 of 10. Random Processes
EAS 305 Random Processes Viewgraph 1 of 10 Definitions: Random Processes A random process is a family of random variables indexed by a parameter t T, where T is called the index set λ i Experiment outcome
More informationCentre for Mathematical Sciences HT 2017 Mathematical Statistics
Lund University Stationary stochastic processes Centre for Mathematical Sciences HT 2017 Mathematical Statistics Computer exercise 3 in Stationary stochastic processes, HT 17. The purpose of this exercise
More informationFourier Methods in Digital Signal Processing Final Exam ME 579, Spring 2015 NAME
Fourier Methods in Digital Signal Processing Final Exam ME 579, Instructions for this CLOSED BOOK EXAM 2 hours long. Monday, May 8th, 8-10am in ME1051 Answer FIVE Questions, at LEAST ONE from each section.
More informationROBUST FREQUENCY DOMAIN ARMA MODELLING. Jonas Gillberg Fredrik Gustafsson Rik Pintelon
ROBUST FREQUENCY DOMAIN ARMA MODELLING Jonas Gillerg Fredrik Gustafsson Rik Pintelon Department of Electrical Engineering, Linköping University SE-581 83 Linköping, Sweden Email: gillerg@isy.liu.se, fredrik@isy.liu.se
More informationEE 3054: Signals, Systems, and Transforms Summer It is observed of some continuous-time LTI system that the input signal.
EE 34: Signals, Systems, and Transforms Summer 7 Test No notes, closed book. Show your work. Simplify your answers. 3. It is observed of some continuous-time LTI system that the input signal = 3 u(t) produces
More informationHomework 3 (Stochastic Processes)
In the name of GOD. Sharif University of Technology Stochastic Processes CE 695 Dr. H.R. Rabiee Homework 3 (Stochastic Processes). Explain why each of the following is NOT a valid autocorrrelation function:
More informationComputing inverse Laplace Transforms.
Review Exam 3. Sections 4.-4.5 in Lecture Notes. 60 minutes. 7 problems. 70 grade attempts. (0 attempts per problem. No partial grading. (Exceptions allowed, ask you TA. Integration table included. Complete
More informationLTI Systems (Continuous & Discrete) - Basics
LTI Systems (Continuous & Discrete) - Basics 1. A system with an input x(t) and output y(t) is described by the relation: y(t) = t. x(t). This system is (a) linear and time-invariant (b) linear and time-varying
More informationApproximation Approach for Timing Jitter Characterization in Circuit Simulators
Approximation Approach for iming Jitter Characterization in Circuit Simulators MM.Gourary,S.G.Rusakov,S.L.Ulyanov,M.M.Zharov IPPM, Russian Academy of Sciences, Moscow, Russia K.K. Gullapalli, B. J. Mulvaney
More informationStatistics of Stochastic Processes
Prof. Dr. J. Franke All of Statistics 4.1 Statistics of Stochastic Processes discrete time: sequence of r.v...., X 1, X 0, X 1, X 2,... X t R d in general. Here: d = 1. continuous time: random function
More informationFrequency-Domain C/S of LTI Systems
Frequency-Domain C/S of LTI Systems x(n) LTI y(n) LTI: Linear Time-Invariant system h(n), the impulse response of an LTI systems describes the time domain c/s. H(ω), the frequency response describes the
More informationProblem Sheet 1 Examples of Random Processes
RANDOM'PROCESSES'AND'TIME'SERIES'ANALYSIS.'PART'II:'RANDOM'PROCESSES' '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''Problem'Sheets' Problem Sheet 1 Examples of Random Processes 1. Give
More informationIV. Covariance Analysis
IV. Covariance Analysis Autocovariance Remember that when a stochastic process has time values that are interdependent, then we can characterize that interdependency by computing the autocovariance function.
More informationImaging with Ambient Noise II
Imaging with Ambient Noise II George Papanicolaou Stanford University Michigan State University, Department of Mathematics Richard E. Phillips Lecture Series April 21, 2009 With J. Garnier, University
More information8. Filter Bank Methods Filter bank methods assume that the true spectrum φ(ω) is constant (or nearly so) over the band [ω βπ, ω + βπ], for some β 1.
8. Filter Bank Methods Filter bank methods assume that the true spectrum φ(ω) is constant (or nearly so) over the band [ω βπ, ω + βπ], for some β 1. Usefull if it is not known that spectrum has special
More informationNon-parametric estimate of the system function of a time-varying system
Non-parametric estimate of the system function of a time-varying system John Lataire a, Rik Pintelon a, Ebrahim Louarroudi a a Vrije Universiteit Brussel, Pleinlaan 2, 1050 Elsene Abstract The task of
More informationLecture 9 Infinite Impulse Response Filters
Lecture 9 Infinite Impulse Response Filters Outline 9 Infinite Impulse Response Filters 9 First-Order Low-Pass Filter 93 IIR Filter Design 5 93 CT Butterworth filter design 5 93 Bilinear transform 7 9
More informationStochastic Processes. Chapter Definitions
Chapter 4 Stochastic Processes Clearly data assimilation schemes such as Optimal Interpolation are crucially dependent on the estimates of background and observation error statistics. Yet, we don t know
More informationFourier transform representation of CT aperiodic signals Section 4.1
Fourier transform representation of CT aperiodic signals Section 4. A large class of aperiodic CT signals can be represented by the CT Fourier transform (CTFT). The (CT) Fourier transform (or spectrum)
More informationPASSIVE SENSOR IMAGING USING CROSS CORRELATIONS OF NOISY SIGNALS IN A SCATTERING MEDIUM
PASSIVE SENSOR IMAGING USING CROSS CORRELATIONS OF NOISY SIGNALS IN A SCATTERING MEDIUM JOSSELIN GARNIER AND GEORGE PAPANICOLAOU Abstract. It is well known that the travel time or even the full Green s
More informationIntro to Stochastic Systems (Spring 16) Lecture 6
6 Noise 6.1 Shot noise Without getting too much into the underlying device physics, shot noise refers to random current fluctuations in electronic devices due to discreteness of charge carriers. The first
More informationDigital Image Processing Lectures 13 & 14
Lectures 13 & 14, Professor Department of Electrical and Computer Engineering Colorado State University Spring 2013 Properties of KL Transform The KL transform has many desirable properties which makes
More informationComputational Methods for Astrophysics: Fourier Transforms
Computational Methods for Astrophysics: Fourier Transforms John T. Whelan (filling in for Joshua Faber) April 27, 2011 John T. Whelan April 27, 2011 Fourier Transforms 1/13 Fourier Analysis Outline: Fourier
More informationGATE EE Topic wise Questions SIGNALS & SYSTEMS
www.gatehelp.com GATE EE Topic wise Questions YEAR 010 ONE MARK Question. 1 For the system /( s + 1), the approximate time taken for a step response to reach 98% of the final value is (A) 1 s (B) s (C)
More informationAtmospheric Flight Dynamics Example Exam 1 Solutions
Atmospheric Flight Dynamics Example Exam 1 Solutions 1 Question Figure 1: Product function Rūū (τ) In figure 1 the product function Rūū (τ) of the stationary stochastic process ū is given. What can be
More informationFrequency estimation by DFT interpolation: A comparison of methods
Frequency estimation by DFT interpolation: A comparison of methods Bernd Bischl, Uwe Ligges, Claus Weihs March 5, 009 Abstract This article comments on a frequency estimator which was proposed by [6] and
More informationAspects of Continuous- and Discrete-Time Signals and Systems
Aspects of Continuous- and Discrete-Time Signals and Systems C.S. Ramalingam Department of Electrical Engineering IIT Madras C.S. Ramalingam (EE Dept., IIT Madras) Networks and Systems 1 / 45 Scaling the
More informationThe Spectral Density Estimation of Stationary Time Series with Missing Data
The Spectral Density Estimation of Stationary Time Series with Missing Data Jian Huang and Finbarr O Sullivan Department of Statistics University College Cork Ireland Abstract The spectral estimation of
More informationFourier Analysis of Stationary and Non-Stationary Time Series
Fourier Analysis of Stationary and Non-Stationary Time Series September 6, 2012 A time series is a stochastic process indexed at discrete points in time i.e X t for t = 0, 1, 2, 3,... The mean is defined
More informationAssessing Structural VAR s
... Assessing Structural VAR s by Lawrence J. Christiano, Martin Eichenbaum and Robert Vigfusson Background Structural Vector Autoregressions Can be Used to Address the Following Type of Question: How
More informationResponse to Periodic and Non-periodic Loadings. Giacomo Boffi. March 25, 2014
Periodic and Non-periodic Dipartimento di Ingegneria Civile e Ambientale, Politecnico di Milano March 25, 2014 Outline Introduction Fourier Series Representation Fourier Series of the Response Introduction
More informationESTIMATION OF DSGE MODELS WHEN THE DATA ARE PERSISTENT
ESTIMATION OF DSGE MODELS WHEN THE DATA ARE PERSISTENT Yuriy Gorodnichenko 1 Serena Ng 2 1 U.C. Berkeley 2 Columbia University May 2008 Outline Introduction Stochastic Growth Model Estimates Robust Estimators
More informationLINEAR SYSTEMS. J. Elder PSYC 6256 Principles of Neural Coding
LINEAR SYSTEMS Linear Systems 2 Neural coding and cognitive neuroscience in general concerns input-output relationships. Inputs Light intensity Pre-synaptic action potentials Number of items in display
More informationLecture 1: Introduction to System Modeling and Control. Introduction Basic Definitions Different Model Types System Identification
Lecture 1: Introduction to System Modeling and Control Introduction Basic Definitions Different Model Types System Identification What is Mathematical Model? A set of mathematical equations (e.g., differential
More informationSlepian Functions Why, What, How?
Slepian Functions Why, What, How? Lecture 1: Basics of Fourier and Fourier-Legendre Transforms Lecture : Spatiospectral Concentration Problem Cartesian & Spherical Cases Lecture 3: Slepian Functions and
More informationGhost Imaging. Josselin Garnier (Université Paris Diderot)
Grenoble December, 014 Ghost Imaging Josselin Garnier Université Paris Diderot http:/www.josselin-garnier.org General topic: correlation-based imaging with noise sources. Particular application: Ghost
More informationA New Approach for Computation of Timing Jitter in Phase Locked Loops
A New Approach for Computation of Timing Jitter in Phase ocked oops M M. Gourary (1), S. G. Rusakov (1), S.. Ulyanov (1), M.M. Zharov (1),.. Gullapalli (2), and B. J. Mulvaney (2) (1) IPPM, Russian Academy
More informationSpatial Statistics with Image Analysis. Lecture L08. Computer exercise 3. Lecture 8. Johan Lindström. November 25, 2016
C3 Repetition Creating Q Spectral Non-grid Spatial Statistics with Image Analysis Lecture 8 Johan Lindström November 25, 216 Johan Lindström - johanl@maths.lth.se FMSN2/MASM25L8 1/39 Lecture L8 C3 Repetition
More informationLinear Filters. L[e iωt ] = 2π ĥ(ω)eiωt. Proof: Let L[e iωt ] = ẽ ω (t). Because L is time-invariant, we have that. L[e iω(t a) ] = ẽ ω (t a).
Linear Filters 1. Convolutions and filters. A filter is a black box that takes an input signal, processes it, and then returns an output signal that in some way modifies the input. For example, if the
More information5 Analog carrier modulation with noise
5 Analog carrier modulation with noise 5. Noisy receiver model Assume that the modulated signal x(t) is passed through an additive White Gaussian noise channel. A noisy receiver model is illustrated in
More informationFourier Analysis and Power Spectral Density
Chapter 4 Fourier Analysis and Power Spectral Density 4. Fourier Series and ransforms Recall Fourier series for periodic functions for x(t + ) = x(t), where x(t) = 2 a + a = 2 a n = 2 b n = 2 n= a n cos
More informationIntroduction to Biomedical Engineering
Introduction to Biomedical Engineering Biosignal processing Kung-Bin Sung 6/11/2007 1 Outline Chapter 10: Biosignal processing Characteristics of biosignals Frequency domain representation and analysis
More informationB2.III Revision notes: quantum physics
B.III Revision notes: quantum physics Dr D.M.Lucas, TT 0 These notes give a summary of most of the Quantum part of this course, to complement Prof. Ewart s notes on Atomic Structure, and Prof. Hooker s
More informationcovariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of
Index* The Statistical Analysis of Time Series by T. W. Anderson Copyright 1971 John Wiley & Sons, Inc. Aliasing, 387-388 Autoregressive {continued) Amplitude, 4, 94 case of first-order, 174 Associated
More informationUnstable Oscillations!
Unstable Oscillations X( t ) = [ A 0 + A( t ) ] sin( ω t + Φ 0 + Φ( t ) ) Amplitude modulation: A( t ) Phase modulation: Φ( t ) S(ω) S(ω) Special case: C(ω) Unstable oscillation has a broader periodogram
More informationReview of Fourier Transform
Review of Fourier Transform Fourier series works for periodic signals only. What s about aperiodic signals? This is very large & important class of signals Aperiodic signal can be considered as periodic
More informationSTAD57 Time Series Analysis. Lecture 23
STAD57 Time Series Analysis Lecture 23 1 Spectral Representation Spectral representation of stationary {X t } is: 12 i2t Xt e du 12 1/2 1/2 for U( ) a stochastic process with independent increments du(ω)=
More information14 - Gaussian Stochastic Processes
14-1 Gaussian Stochastic Processes S. Lall, Stanford 211.2.24.1 14 - Gaussian Stochastic Processes Linear systems driven by IID noise Evolution of mean and covariance Example: mass-spring system Steady-state
More information5. THE CLASSES OF FOURIER TRANSFORMS
5. THE CLASSES OF FOURIER TRANSFORMS There are four classes of Fourier transform, which are represented in the following table. So far, we have concentrated on the discrete Fourier transform. Table 1.
More informationFrequency Domain and Filtering
3 Frequency Domain and Filtering This is page i Printer: Opaque this 3. Introduction Comovement and volatility are key concepts in macroeconomics. Therefore, it is important to have statistics that describe
More informationReview of Linear Time-Invariant Network Analysis
D1 APPENDIX D Review of Linear Time-Invariant Network Analysis Consider a network with input x(t) and output y(t) as shown in Figure D-1. If an input x 1 (t) produces an output y 1 (t), and an input x
More informationarxiv: v4 [gr-qc] 15 Jul 2010
Calibrating spectral estimation for the LISA Technology Package with multichannel synthetic noise generation Luigi Ferraioli, Mauro Hueller, and Stefano Vitale University of Trento and INFN, via Sommarive
More information13. Power Spectrum. For a deterministic signal x(t), the spectrum is well defined: If represents its Fourier transform, i.e., if.
For a deterministic signal x(t), the spectrum is well defined: If represents its Fourier transform, i.e., if jt X ( ) = xte ( ) dt, (3-) then X ( ) represents its energy spectrum. his follows from Parseval
More information