Non-parametric identification

Size: px
Start display at page:

Download "Non-parametric identification"

Transcription

1 Non-parametric Non-parametric Transient Step-response using Spectral Transient Correlation Frequency function estimate Spectral System Identification, SSY230 Non-parametric 1

2 Non-parametric Transient Step-response using Spectral Consider the system described by or, equivalently, y(t) = y(t) =G 0 (q)u(t)+v(t) g 0 (k)u(t k)+v(t) k=1 Question: Can we determine G 0 (q) or {g 0 (k)} without parameterizing in θ? System Identification, SSY230 Non-parametric 2

3 Transient Non-parametric Transient Step-response using Spectral Applying the input gives the output u(t) = { k, t =0 0, t 0 y(t) =k g 0 (t)+v(t) which motivates the impulse response estimate ĝ(t) = y(t) k System Identification, SSY230 Non-parametric 3

4 Step-response Non-parametric Transient Step-response using Spectral Step input: u(t) = gives the output y(t) =k so that ĝ(t) = { k, t 0 0, t < 0 t g 0 (k)+v(t) k=1 y(t) y(t 1) k Problems with transient techniques: excitation disturbances nonlinearities System Identification, SSY230 Non-parametric 4

5 Some times one is not allowed to do anything else than small step changes. : For a tank with ideal mixing: V dc dt = Q(c i c) V :tankvolume,q: flow,c, c i : tank and flow concentration. Apply an impulsive concentration input: Stewart-Hamilton s equation: c i (t) =δ(t) c(t) = Q V e Q V t = h(t) 0 t h(t)dt = V Q Application: Blood volume measurement System Identification, SSY230 Non-parametric 5

6 using Non-parametric Transient Step-response using Spectral Assume that u is quasi-stationary and u and v are uncorrelated: Φ yu (ω) =G 0 (e iω )Φ u (ω) or R yu (τ) = g 0 (k)r u (τ k) k=1 Truncate the sum and solve the resulting system of equations for ĝ(k): M ˆR yu(τ) N = ĝ(k) ˆR u N (τ k) k=1 where estimates of the covariance function are formed as ˆR N u (τ) = 1 N N u(t)u(t τ) t=1 System Identification, SSY230 Non-parametric 6

7 Non-parametric Transient Step-response using Spectral Note: when u( ) is white noise the estimate becomes ĝ(k) = ˆR N yu(k) σ 2 u System Identification, SSY230 Non-parametric 7

8 Non-parametric Transient Step-response using Spectral So far we have estimated g 0 (k) what about estimating G 0 (e iω )? α cos ωt Measure amplitude and phase using : I c (N) = 1 N α y(t)cosωt N 2 G 0(e iω ) cos φ I s (N) = 1 N α y(t)sinωt N 2 G 0(e iω ) sin φ G α G cos(ωt + φ)+v(t) System Identification, SSY230 Non-parametric 8

9 Non-parametric Transient Step-response using Spectral implying I c (N) i I s (N) α 2 G 0(e iω ) (cos φ + i sin φ) so that Ĝ N = 2 α (I c(n) i I s (N)) System Identification, SSY230 Non-parametric 9

10 Interpretation of frequency response by the method: Recall that Y N (ω) = 1 N N t=1 y(t)e iωt = N(I c (N) i I s (N)) so that Ĝ N = 2 α (I c(n) i I s (N)) = 2 α N Y N(ω) = Y N(ω) U N (ω) where the last equality holds for ω = 2π N k. Hence, the estimate obtained using frequency by the method is simply the ratio between the DFT of the output and the input. This can be generalized... System Identification, SSY230 Non-parametric 10

11 Non-parametric Transient Step-response using Spectral Consider the open-loop system y(t) = G o (q)u(t)+v(t) Y N (ω) = G o (e iω )U N (ω)+v N (ω)+r N (ω) where R N (ω) 1/ N (or =0if u is periodic). function estimate () is: Ĝ(e iω )= Y N(ω) U N (ω), ω = k 2π N System Identification, SSY230 Non-parametric 11

12 Non-parametric Transient Step-response using Spectral Properties: u periodic number of ω fixed unbiased variance 1/N EĜ N (e iω ) = G 0 (e iω )+ R N (ω) U N (ω) VarĜ N (e iω Φ v (ω) ) U N (ω) 2 u stochastic process number of ω increases asymptotically unbiased variance (SNR) 1 as. uncorrelated System Identification, SSY230 Non-parametric 12

13 Spectral The is comprised of uncorrelated estimates at different ω but we know that the frequency response is smooth in reality! Idea: (1) Compute Ĝ(eiω ) as a weighted sum of the Ĝ around ω = ω 0 : Ĝ(e iω 0 )= k2 k=k 1 α k Ĝ(e iω k) k2 k=k 1 α k (1) where 2πk 1 /N = ω 0 Δ and 2πk 2 /N = ω 0 +Δ (2) Now choose {α k } inversely proportional to the variance of Ĝ(e iω k): Ĝ(e iω 0 )= UN (ω k ) 2 Φ v (ω k ) Ĝ(e iω k) UN (ω k ) 2 Φ v (ω k ) ω0 +Δ U N (ω) 2 ω 0 Δ Φ v (ω) ω0 +Δ U N (ω) 2 ω 0 Δ Φ v (ω) Ĝ(e iω )dω dω System Identification, SSY230 Non-parametric 13

14 (3) Put weight according to distance from ω 0 : Ĝ(e iω 0 )= π π W γ(ω ω 0 ) U N (ω) 2 Φ v (ω) Ĝ(e iω )dω π π π π W γ(ω ω 0 ) U W γ(ω ω 0 ) U N (ω) 2 Ĝ(e iω )dω N (ω) 2 π Φ v (ω) dω π W γ(ω ω 0 ) U N (ω) 2 dω π π = W γ(ω ω 0 )Y N (ω)u N (ω)dω π π W γ(ω ω 0 ) U N (ω) 2 = ˆΦ yu (ω 0 ) (2) dω ˆΦ u (ω 0 ) This is the estimate obtained by spectral according to Blackman-Tukey. The estimate is obtained by a natural replacement of the spectra in Φ yu (ω) =G 0 (e iω )Φ u (ω) (3) by the corresponding smoothed periodograms. System Identification, SSY230 Non-parametric 14

15 Non-parametric Transient Step-response using Spectral Consider the spectral estimate ˆΦ u (ω) = π π W γ (ω ω 0 ) U N (ω) 2 dω where the frequency window, W γ, is narrow for large γ. System Identification, SSY230 Non-parametric 15

16 Non-parametric Transient Step-response using Spectral The convolution above is transformed into multiplication in the time domain, so that where w γ (τ) = 1 2π ˆR u (τ) = 1 2π ˆΦ u (ω) = π π π π w γ (τ) ˆR u (τ)e iωτ W γ (ω)e iωτ dω U N (ω) 2 e iωτ dω = 1 N N u(t)u(t τ) Note: The time (lag) window w γ (τ) is wide when the frequency window W γ (ω) is narrow, and vice versa. System Identification, SSY230 Non-parametric 16

17 Non-parametric Transient Step-response using Spectral When γ increases (narrow frequency window), the bias decreases but the variance increases. This can be expressed in terms of the functions M(γ) = W (γ) =2π π π π π when γ.also, W (γ) γ. ω 2 W γ (ω)dω 0 (4) W 2 γ (ω)dω (5) System Identification, SSY230 Non-parametric 17

18 Non-parametric Transient Step-response using Spectral Theorem: Assume that y(t) =G 0 (q)u(t)+v(t) (6) where v( ) is a stochastic process, independent of u( ), whichis quasi-stationary. Then the following asymptotic results hold when γ,n,γ/n 0: [ ] 1 EĜN (e iω ) G 0 (e iω ) M(γ) 2 G 0 + G 0 Φ u Φ u E ĜN EĜN 2 1 N W γ Φv Φ u ReĜN, ImĜN are as. uncorrelated Estimates at different ω are as. uncorrelated System Identification, SSY230 Non-parametric 18

Chapter 6: Nonparametric Time- and Frequency-Domain Methods. Problems presented by Uwe

Chapter 6: Nonparametric Time- and Frequency-Domain Methods. Problems presented by Uwe System Identification written by L. Ljung, Prentice Hall PTR, 1999 Chapter 6: Nonparametric Time- and Frequency-Domain Methods Problems presented by Uwe System Identification Problems Chapter 6 p. 1/33

More information

6.435, System Identification

6.435, System Identification System Identification 6.435 SET 3 Nonparametric Identification Munther A. Dahleh 1 Nonparametric Methods for System ID Time domain methods Impulse response Step response Correlation analysis / time Frequency

More information

EE531 (Semester II, 2010) 6. Spectral analysis. power spectral density. periodogram analysis. window functions 6-1

EE531 (Semester II, 2010) 6. Spectral analysis. power spectral density. periodogram analysis. window functions 6-1 6. Spectral analysis EE531 (Semester II, 2010) power spectral density periodogram analysis window functions 6-1 Wiener-Khinchin theorem: Power Spectral density if a process is wide-sense stationary, the

More information

Identification, Model Validation and Control. Lennart Ljung, Linköping

Identification, Model Validation and Control. Lennart Ljung, Linköping Identification, Model Validation and Control Lennart Ljung, Linköping Acknowledgment: Useful discussions with U Forssell and H Hjalmarsson 1 Outline 1. Introduction 2. System Identification (in closed

More information

Time Series Analysis. Solutions to problems in Chapter 7 IMM

Time Series Analysis. Solutions to problems in Chapter 7 IMM Time Series Analysis Solutions to problems in Chapter 7 I Solution 7.1 Question 1. As we get by subtraction kx t = 1 + B + B +...B k 1 )ǫ t θb) = 1 + B +... + B k 1 ), and BθB) = B + B +... + B k ), 1

More information

13.42 READING 6: SPECTRUM OF A RANDOM PROCESS 1. STATIONARY AND ERGODIC RANDOM PROCESSES

13.42 READING 6: SPECTRUM OF A RANDOM PROCESS 1. STATIONARY AND ERGODIC RANDOM PROCESSES 13.42 READING 6: SPECTRUM OF A RANDOM PROCESS SPRING 24 c A. H. TECHET & M.S. TRIANTAFYLLOU 1. STATIONARY AND ERGODIC RANDOM PROCESSES Given the random process y(ζ, t) we assume that the expected value

More information

System Identification & Parameter Estimation

System Identification & Parameter Estimation System Identification & Parameter Estimation Wb3: SIPE lecture Correlation functions in time & frequency domain Alfred C. Schouten, Dept. of Biomechanical Engineering (BMechE), Fac. 3mE // Delft University

More information

ECE 636: Systems identification

ECE 636: Systems identification ECE 636: Systems identification Lectures 7 8 onparametric identification (continued) Important distributions: chi square, t distribution, F distribution Sampling distributions ib i Sample mean If the variance

More information

EL1820 Modeling of Dynamical Systems

EL1820 Modeling of Dynamical Systems EL1820 Modeling of Dynamical Systems Lecture 10 - System identification as a model building tool Experiment design Examination and prefiltering of data Model structure selection Model validation Lecture

More information

Stochastic Process II Dr.-Ing. Sudchai Boonto

Stochastic Process II Dr.-Ing. Sudchai Boonto Dr-Ing Sudchai Boonto Department of Control System and Instrumentation Engineering King Mongkuts Unniversity of Technology Thonburi Thailand Random process Consider a random experiment specified by the

More information

EL1820 Modeling of Dynamical Systems

EL1820 Modeling of Dynamical Systems EL1820 Modeling of Dynamical Systems Lecture 9 - Parameter estimation in linear models Model structures Parameter estimation via prediction error minimization Properties of the estimate: bias and variance

More information

Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science : Discrete-Time Signal Processing

Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science : Discrete-Time Signal Processing Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.34: Discrete-Time Signal Processing OpenCourseWare 006 ecture 8 Periodogram Reading: Sections 0.6 and 0.7

More information

LINEAR RESPONSE THEORY

LINEAR RESPONSE THEORY MIT Department of Chemistry 5.74, Spring 5: Introductory Quantum Mechanics II Instructor: Professor Andrei Tokmakoff p. 8 LINEAR RESPONSE THEORY We have statistically described the time-dependent behavior

More information

Review of Frequency Domain Fourier Series: Continuous periodic frequency components

Review of Frequency Domain Fourier Series: Continuous periodic frequency components Today we will review: Review of Frequency Domain Fourier series why we use it trig form & exponential form how to get coefficients for each form Eigenfunctions what they are how they relate to LTI systems

More information

X random; interested in impact of X on Y. Time series analogue of regression.

X random; interested in impact of X on Y. Time series analogue of regression. Multiple time series Given: two series Y and X. Relationship between series? Possible approaches: X deterministic: regress Y on X via generalized least squares: arima.mle in SPlus or arima in R. We have

More information

D.S.G. POLLOCK: BRIEF NOTES

D.S.G. POLLOCK: BRIEF NOTES BIVARIATE SPECTRAL ANALYSIS Let x(t) and y(t) be two stationary stochastic processes with E{x(t)} = E{y(t)} =. These processes have the following spectral representations: (1) x(t) = y(t) = {cos(ωt)da

More information

System Identification and Parameter Estimation

System Identification and Parameter Estimation Faculty of Engineering Technology Mechanical Automation and Mechatronics System Identification and Parameter Estimation 1 1 Frequency response 1 Amplitude 1 1 1 2 1 3 1 2 1 3 Phase (deg) 1 2 3 4 5 6 7

More information

Signals and Spectra (1A) Young Won Lim 11/26/12

Signals and Spectra (1A) Young Won Lim 11/26/12 Signals and Spectra (A) Copyright (c) 202 Young W. Lim. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version.2 or any later

More information

2A1H Time-Frequency Analysis II

2A1H Time-Frequency Analysis II 2AH Time-Frequency Analysis II Bugs/queries to david.murray@eng.ox.ac.uk HT 209 For any corrections see the course page DW Murray at www.robots.ox.ac.uk/ dwm/courses/2tf. (a) A signal g(t) with period

More information

Systems Analysis and Control

Systems Analysis and Control Systems Analysis and Control Matthew M. Peet Illinois Institute of Technology Lecture 2: Drawing Bode Plots, Part 2 Overview In this Lecture, you will learn: Simple Plots Real Zeros Real Poles Complex

More information

Fundamentals of the Discrete Fourier Transform

Fundamentals of the Discrete Fourier Transform Seminar presentation at the Politecnico di Milano, Como, November 12, 2012 Fundamentals of the Discrete Fourier Transform Michael G. Sideris sideris@ucalgary.ca Department of Geomatics Engineering University

More information

Practical Spectral Estimation

Practical Spectral Estimation Digital Signal Processing/F.G. Meyer Lecture 4 Copyright 2015 François G. Meyer. All Rights Reserved. Practical Spectral Estimation 1 Introduction The goal of spectral estimation is to estimate how the

More information

3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE

3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE 3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE 3.0 INTRODUCTION The purpose of this chapter is to introduce estimators shortly. More elaborated courses on System Identification, which are given

More information

System Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang

System Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang System Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang 1-1 Course Description Emphases Delivering concepts and Practice Programming Identification Methods using Matlab Class

More information

ENSC327 Communications Systems 2: Fourier Representations. School of Engineering Science Simon Fraser University

ENSC327 Communications Systems 2: Fourier Representations. School of Engineering Science Simon Fraser University ENSC37 Communications Systems : Fourier Representations School o Engineering Science Simon Fraser University Outline Chap..5: Signal Classiications Fourier Transorm Dirac Delta Function Unit Impulse Fourier

More information

Spectral Analysis of Random Processes

Spectral Analysis of Random Processes Spectral Analysis of Random Processes Spectral Analysis of Random Processes Generally, all properties of a random process should be defined by averaging over the ensemble of realizations. Generally, all

More information

System Identification

System Identification System Identification Lecture 4: Transfer function averaging and smoothing Roy Smith 28-- 4. Averaging Multiple estimates Multiple experiments: u r pk, y r pk, r,..., R, and k,..., K. Multiple estimates

More information

Linear Approximations of Nonlinear FIR Systems for Separable Input Processes

Linear Approximations of Nonlinear FIR Systems for Separable Input Processes Linear Approximations of Nonlinear FIR Systems for Separable Input Processes Martin Enqvist, Lennart Ljung Division of Automatic Control Department of Electrical Engineering Linköpings universitet, SE-581

More information

Linear and Nonlinear Oscillators (Lecture 2)

Linear and Nonlinear Oscillators (Lecture 2) Linear and Nonlinear Oscillators (Lecture 2) January 25, 2016 7/441 Lecture outline A simple model of a linear oscillator lies in the foundation of many physical phenomena in accelerator dynamics. A typical

More information

Time series models in the Frequency domain. The power spectrum, Spectral analysis

Time series models in the Frequency domain. The power spectrum, Spectral analysis ime series models in the Frequency domain he power spectrum, Spectral analysis Relationship between the periodogram and the autocorrelations = + = ( ) ( ˆ α ˆ ) β I Yt cos t + Yt sin t t= t= ( ( ) ) cosλ

More information

IDENTIFICATION FOR CONTROL

IDENTIFICATION FOR CONTROL IDENTIFICATION FOR CONTROL Raymond A. de Callafon, University of California San Diego, USA Paul M.J. Van den Hof, Delft University of Technology, the Netherlands Keywords: Controller, Closed loop model,

More information

f-domain expression for the limit model Combine: 5.12 Approximate Modelling What can be said about H(q, θ) G(q, θ ) H(q, θ ) with

f-domain expression for the limit model Combine: 5.12 Approximate Modelling What can be said about H(q, θ) G(q, θ ) H(q, θ ) with 5.2 Approximate Modelling What can be said about if S / M, and even G / G? G(q, ) H(q, ) f-domain expression for the limit model Combine: with ε(t, ) =H(q, ) [y(t) G(q, )u(t)] y(t) =G (q)u(t) v(t) We know

More information

ENSC327 Communications Systems 2: Fourier Representations. Jie Liang School of Engineering Science Simon Fraser University

ENSC327 Communications Systems 2: Fourier Representations. Jie Liang School of Engineering Science Simon Fraser University ENSC327 Communications Systems 2: Fourier Representations Jie Liang School of Engineering Science Simon Fraser University 1 Outline Chap 2.1 2.5: Signal Classifications Fourier Transform Dirac Delta Function

More information

Continuous-Time Frequency Response (II) Lecture 28: EECS 20 N April 2, Laurent El Ghaoui

Continuous-Time Frequency Response (II) Lecture 28: EECS 20 N April 2, Laurent El Ghaoui EECS 20 N April 2, 2001 Lecture 28: Continuous-Time Frequency Response (II) Laurent El Ghaoui 1 annoucements homework due on Wednesday 4/4 at 11 AM midterm: Friday, 4/6 includes all chapters until chapter

More information

2A1H Time-Frequency Analysis II Bugs/queries to HT 2011 For hints and answers visit dwm/courses/2tf

2A1H Time-Frequency Analysis II Bugs/queries to HT 2011 For hints and answers visit   dwm/courses/2tf Time-Frequency Analysis II (HT 20) 2AH 2AH Time-Frequency Analysis II Bugs/queries to david.murray@eng.ox.ac.uk HT 20 For hints and answers visit www.robots.ox.ac.uk/ dwm/courses/2tf David Murray. A periodic

More information

ELEC2400 Signals & Systems

ELEC2400 Signals & Systems ELEC2400 Signals & Systems Chapter 7. Z-Transforms Brett Ninnes brett@newcastle.edu.au. School of Electrical Engineering and Computer Science The University of Newcastle Slides by Juan I. Yu (jiyue@ee.newcastle.edu.au

More information

e iωt dt and explained why δ(ω) = 0 for ω 0 but δ(0) =. A crucial property of the delta function, however, is that

e iωt dt and explained why δ(ω) = 0 for ω 0 but δ(0) =. A crucial property of the delta function, however, is that Phys 53 Fourier Transforms In this handout, I will go through the derivations of some of the results I gave in class (Lecture 4, /). I won t reintroduce the concepts though, so if you haven t seen the

More information

EEM 409. Random Signals. Problem Set-2: (Power Spectral Density, LTI Systems with Random Inputs) Problem 1: Problem 2:

EEM 409. Random Signals. Problem Set-2: (Power Spectral Density, LTI Systems with Random Inputs) Problem 1: Problem 2: EEM 409 Random Signals Problem Set-2: (Power Spectral Density, LTI Systems with Random Inputs) Problem 1: Consider a random process of the form = + Problem 2: X(t) = b cos(2π t + ), where b is a constant,

More information

e iωt dt and explained why δ(ω) = 0 for ω 0 but δ(0) =. A crucial property of the delta function, however, is that

e iωt dt and explained why δ(ω) = 0 for ω 0 but δ(0) =. A crucial property of the delta function, however, is that Phys 531 Fourier Transforms In this handout, I will go through the derivations of some of the results I gave in class (Lecture 14, 1/11). I won t reintroduce the concepts though, so you ll want to refer

More information

THE FOURIER TRANSFORM (Fourier series for a function whose period is very, very long) Reading: Main 11.3

THE FOURIER TRANSFORM (Fourier series for a function whose period is very, very long) Reading: Main 11.3 THE FOURIER TRANSFORM (Fourier series for a function whose period is very, very long) Reading: Main 11.3 Any periodic function f(t) can be written as a Fourier Series a 0 2 + a n cos( nωt) + b n sin n

More information

Lecture 11: Spectral Analysis

Lecture 11: Spectral Analysis Lecture 11: Spectral Analysis Methods For Estimating The Spectrum Walid Sharabati Purdue University Latest Update October 27, 2016 Professor Sharabati (Purdue University) Time Series Analysis October 27,

More information

EE538 Final Exam Fall :20 pm -5:20 pm PHYS 223 Dec. 17, Cover Sheet

EE538 Final Exam Fall :20 pm -5:20 pm PHYS 223 Dec. 17, Cover Sheet EE538 Final Exam Fall 005 3:0 pm -5:0 pm PHYS 3 Dec. 17, 005 Cover Sheet Test Duration: 10 minutes. Open Book but Closed Notes. Calculators ARE allowed!! This test contains five problems. Each of the five

More information

The Discrete Fourier Transform (DFT) Properties of the DFT DFT-Specic Properties Power spectrum estimate. Alex Sheremet.

The Discrete Fourier Transform (DFT) Properties of the DFT DFT-Specic Properties Power spectrum estimate. Alex Sheremet. 4. April 2, 27 -order sequences Measurements produce sequences of numbers Measurement purpose: characterize a stochastic process. Example: Process: water surface elevation as a function of time Parameters:

More information

SPECTRUM. Deterministic Signals with Finite Energy (l 2 ) Deterministic Signals with Infinite Energy N 1. n=0. N N X N(f) 2

SPECTRUM. Deterministic Signals with Finite Energy (l 2 ) Deterministic Signals with Infinite Energy N 1. n=0. N N X N(f) 2 SPECTRUM Deterministic Signals with Finite Energy (l 2 ) Energy Spectrum: S xx (f) = X(f) 2 = 2 x(n)e j2πfn n= Deterministic Signals with Infinite Energy DTFT of truncated signal: X N (f) = N x(n)e j2πfn

More information

A summary of Modeling and Simulation

A summary of Modeling and Simulation A summary of Modeling and Simulation Text-book: Modeling of dynamic systems Lennart Ljung and Torkel Glad Content What re Models for systems and signals? Basic concepts Types of models How to build a model

More information

Introduction to system identification

Introduction to system identification Introduction to system identification Jan Swevers July 2006 0-0 Introduction to system identification 1 Contents of this lecture What is system identification Time vs. frequency domain identification Discrete

More information

Solutions to Problems in Chapter 4

Solutions to Problems in Chapter 4 Solutions to Problems in Chapter 4 Problems with Solutions Problem 4. Fourier Series of the Output Voltage of an Ideal Full-Wave Diode Bridge Rectifier he nonlinear circuit in Figure 4. is a full-wave

More information

EAS 305 Random Processes Viewgraph 1 of 10. Random Processes

EAS 305 Random Processes Viewgraph 1 of 10. Random Processes EAS 305 Random Processes Viewgraph 1 of 10 Definitions: Random Processes A random process is a family of random variables indexed by a parameter t T, where T is called the index set λ i Experiment outcome

More information

Centre for Mathematical Sciences HT 2017 Mathematical Statistics

Centre for Mathematical Sciences HT 2017 Mathematical Statistics Lund University Stationary stochastic processes Centre for Mathematical Sciences HT 2017 Mathematical Statistics Computer exercise 3 in Stationary stochastic processes, HT 17. The purpose of this exercise

More information

Fourier Methods in Digital Signal Processing Final Exam ME 579, Spring 2015 NAME

Fourier Methods in Digital Signal Processing Final Exam ME 579, Spring 2015 NAME Fourier Methods in Digital Signal Processing Final Exam ME 579, Instructions for this CLOSED BOOK EXAM 2 hours long. Monday, May 8th, 8-10am in ME1051 Answer FIVE Questions, at LEAST ONE from each section.

More information

ROBUST FREQUENCY DOMAIN ARMA MODELLING. Jonas Gillberg Fredrik Gustafsson Rik Pintelon

ROBUST FREQUENCY DOMAIN ARMA MODELLING. Jonas Gillberg Fredrik Gustafsson Rik Pintelon ROBUST FREQUENCY DOMAIN ARMA MODELLING Jonas Gillerg Fredrik Gustafsson Rik Pintelon Department of Electrical Engineering, Linköping University SE-581 83 Linköping, Sweden Email: gillerg@isy.liu.se, fredrik@isy.liu.se

More information

EE 3054: Signals, Systems, and Transforms Summer It is observed of some continuous-time LTI system that the input signal.

EE 3054: Signals, Systems, and Transforms Summer It is observed of some continuous-time LTI system that the input signal. EE 34: Signals, Systems, and Transforms Summer 7 Test No notes, closed book. Show your work. Simplify your answers. 3. It is observed of some continuous-time LTI system that the input signal = 3 u(t) produces

More information

Homework 3 (Stochastic Processes)

Homework 3 (Stochastic Processes) In the name of GOD. Sharif University of Technology Stochastic Processes CE 695 Dr. H.R. Rabiee Homework 3 (Stochastic Processes). Explain why each of the following is NOT a valid autocorrrelation function:

More information

Computing inverse Laplace Transforms.

Computing inverse Laplace Transforms. Review Exam 3. Sections 4.-4.5 in Lecture Notes. 60 minutes. 7 problems. 70 grade attempts. (0 attempts per problem. No partial grading. (Exceptions allowed, ask you TA. Integration table included. Complete

More information

LTI Systems (Continuous & Discrete) - Basics

LTI Systems (Continuous & Discrete) - Basics LTI Systems (Continuous & Discrete) - Basics 1. A system with an input x(t) and output y(t) is described by the relation: y(t) = t. x(t). This system is (a) linear and time-invariant (b) linear and time-varying

More information

Approximation Approach for Timing Jitter Characterization in Circuit Simulators

Approximation Approach for Timing Jitter Characterization in Circuit Simulators Approximation Approach for iming Jitter Characterization in Circuit Simulators MM.Gourary,S.G.Rusakov,S.L.Ulyanov,M.M.Zharov IPPM, Russian Academy of Sciences, Moscow, Russia K.K. Gullapalli, B. J. Mulvaney

More information

Statistics of Stochastic Processes

Statistics of Stochastic Processes Prof. Dr. J. Franke All of Statistics 4.1 Statistics of Stochastic Processes discrete time: sequence of r.v...., X 1, X 0, X 1, X 2,... X t R d in general. Here: d = 1. continuous time: random function

More information

Frequency-Domain C/S of LTI Systems

Frequency-Domain C/S of LTI Systems Frequency-Domain C/S of LTI Systems x(n) LTI y(n) LTI: Linear Time-Invariant system h(n), the impulse response of an LTI systems describes the time domain c/s. H(ω), the frequency response describes the

More information

Problem Sheet 1 Examples of Random Processes

Problem Sheet 1 Examples of Random Processes RANDOM'PROCESSES'AND'TIME'SERIES'ANALYSIS.'PART'II:'RANDOM'PROCESSES' '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''Problem'Sheets' Problem Sheet 1 Examples of Random Processes 1. Give

More information

IV. Covariance Analysis

IV. Covariance Analysis IV. Covariance Analysis Autocovariance Remember that when a stochastic process has time values that are interdependent, then we can characterize that interdependency by computing the autocovariance function.

More information

Imaging with Ambient Noise II

Imaging with Ambient Noise II Imaging with Ambient Noise II George Papanicolaou Stanford University Michigan State University, Department of Mathematics Richard E. Phillips Lecture Series April 21, 2009 With J. Garnier, University

More information

8. Filter Bank Methods Filter bank methods assume that the true spectrum φ(ω) is constant (or nearly so) over the band [ω βπ, ω + βπ], for some β 1.

8. Filter Bank Methods Filter bank methods assume that the true spectrum φ(ω) is constant (or nearly so) over the band [ω βπ, ω + βπ], for some β 1. 8. Filter Bank Methods Filter bank methods assume that the true spectrum φ(ω) is constant (or nearly so) over the band [ω βπ, ω + βπ], for some β 1. Usefull if it is not known that spectrum has special

More information

Non-parametric estimate of the system function of a time-varying system

Non-parametric estimate of the system function of a time-varying system Non-parametric estimate of the system function of a time-varying system John Lataire a, Rik Pintelon a, Ebrahim Louarroudi a a Vrije Universiteit Brussel, Pleinlaan 2, 1050 Elsene Abstract The task of

More information

Lecture 9 Infinite Impulse Response Filters

Lecture 9 Infinite Impulse Response Filters Lecture 9 Infinite Impulse Response Filters Outline 9 Infinite Impulse Response Filters 9 First-Order Low-Pass Filter 93 IIR Filter Design 5 93 CT Butterworth filter design 5 93 Bilinear transform 7 9

More information

Stochastic Processes. Chapter Definitions

Stochastic Processes. Chapter Definitions Chapter 4 Stochastic Processes Clearly data assimilation schemes such as Optimal Interpolation are crucially dependent on the estimates of background and observation error statistics. Yet, we don t know

More information

Fourier transform representation of CT aperiodic signals Section 4.1

Fourier transform representation of CT aperiodic signals Section 4.1 Fourier transform representation of CT aperiodic signals Section 4. A large class of aperiodic CT signals can be represented by the CT Fourier transform (CTFT). The (CT) Fourier transform (or spectrum)

More information

PASSIVE SENSOR IMAGING USING CROSS CORRELATIONS OF NOISY SIGNALS IN A SCATTERING MEDIUM

PASSIVE SENSOR IMAGING USING CROSS CORRELATIONS OF NOISY SIGNALS IN A SCATTERING MEDIUM PASSIVE SENSOR IMAGING USING CROSS CORRELATIONS OF NOISY SIGNALS IN A SCATTERING MEDIUM JOSSELIN GARNIER AND GEORGE PAPANICOLAOU Abstract. It is well known that the travel time or even the full Green s

More information

Intro to Stochastic Systems (Spring 16) Lecture 6

Intro to Stochastic Systems (Spring 16) Lecture 6 6 Noise 6.1 Shot noise Without getting too much into the underlying device physics, shot noise refers to random current fluctuations in electronic devices due to discreteness of charge carriers. The first

More information

Digital Image Processing Lectures 13 & 14

Digital Image Processing Lectures 13 & 14 Lectures 13 & 14, Professor Department of Electrical and Computer Engineering Colorado State University Spring 2013 Properties of KL Transform The KL transform has many desirable properties which makes

More information

Computational Methods for Astrophysics: Fourier Transforms

Computational Methods for Astrophysics: Fourier Transforms Computational Methods for Astrophysics: Fourier Transforms John T. Whelan (filling in for Joshua Faber) April 27, 2011 John T. Whelan April 27, 2011 Fourier Transforms 1/13 Fourier Analysis Outline: Fourier

More information

GATE EE Topic wise Questions SIGNALS & SYSTEMS

GATE EE Topic wise Questions SIGNALS & SYSTEMS www.gatehelp.com GATE EE Topic wise Questions YEAR 010 ONE MARK Question. 1 For the system /( s + 1), the approximate time taken for a step response to reach 98% of the final value is (A) 1 s (B) s (C)

More information

Atmospheric Flight Dynamics Example Exam 1 Solutions

Atmospheric Flight Dynamics Example Exam 1 Solutions Atmospheric Flight Dynamics Example Exam 1 Solutions 1 Question Figure 1: Product function Rūū (τ) In figure 1 the product function Rūū (τ) of the stationary stochastic process ū is given. What can be

More information

Frequency estimation by DFT interpolation: A comparison of methods

Frequency estimation by DFT interpolation: A comparison of methods Frequency estimation by DFT interpolation: A comparison of methods Bernd Bischl, Uwe Ligges, Claus Weihs March 5, 009 Abstract This article comments on a frequency estimator which was proposed by [6] and

More information

Aspects of Continuous- and Discrete-Time Signals and Systems

Aspects of Continuous- and Discrete-Time Signals and Systems Aspects of Continuous- and Discrete-Time Signals and Systems C.S. Ramalingam Department of Electrical Engineering IIT Madras C.S. Ramalingam (EE Dept., IIT Madras) Networks and Systems 1 / 45 Scaling the

More information

The Spectral Density Estimation of Stationary Time Series with Missing Data

The Spectral Density Estimation of Stationary Time Series with Missing Data The Spectral Density Estimation of Stationary Time Series with Missing Data Jian Huang and Finbarr O Sullivan Department of Statistics University College Cork Ireland Abstract The spectral estimation of

More information

Fourier Analysis of Stationary and Non-Stationary Time Series

Fourier Analysis of Stationary and Non-Stationary Time Series Fourier Analysis of Stationary and Non-Stationary Time Series September 6, 2012 A time series is a stochastic process indexed at discrete points in time i.e X t for t = 0, 1, 2, 3,... The mean is defined

More information

Assessing Structural VAR s

Assessing Structural VAR s ... Assessing Structural VAR s by Lawrence J. Christiano, Martin Eichenbaum and Robert Vigfusson Background Structural Vector Autoregressions Can be Used to Address the Following Type of Question: How

More information

Response to Periodic and Non-periodic Loadings. Giacomo Boffi. March 25, 2014

Response to Periodic and Non-periodic Loadings. Giacomo Boffi. March 25, 2014 Periodic and Non-periodic Dipartimento di Ingegneria Civile e Ambientale, Politecnico di Milano March 25, 2014 Outline Introduction Fourier Series Representation Fourier Series of the Response Introduction

More information

ESTIMATION OF DSGE MODELS WHEN THE DATA ARE PERSISTENT

ESTIMATION OF DSGE MODELS WHEN THE DATA ARE PERSISTENT ESTIMATION OF DSGE MODELS WHEN THE DATA ARE PERSISTENT Yuriy Gorodnichenko 1 Serena Ng 2 1 U.C. Berkeley 2 Columbia University May 2008 Outline Introduction Stochastic Growth Model Estimates Robust Estimators

More information

LINEAR SYSTEMS. J. Elder PSYC 6256 Principles of Neural Coding

LINEAR SYSTEMS. J. Elder PSYC 6256 Principles of Neural Coding LINEAR SYSTEMS Linear Systems 2 Neural coding and cognitive neuroscience in general concerns input-output relationships. Inputs Light intensity Pre-synaptic action potentials Number of items in display

More information

Lecture 1: Introduction to System Modeling and Control. Introduction Basic Definitions Different Model Types System Identification

Lecture 1: Introduction to System Modeling and Control. Introduction Basic Definitions Different Model Types System Identification Lecture 1: Introduction to System Modeling and Control Introduction Basic Definitions Different Model Types System Identification What is Mathematical Model? A set of mathematical equations (e.g., differential

More information

Slepian Functions Why, What, How?

Slepian Functions Why, What, How? Slepian Functions Why, What, How? Lecture 1: Basics of Fourier and Fourier-Legendre Transforms Lecture : Spatiospectral Concentration Problem Cartesian & Spherical Cases Lecture 3: Slepian Functions and

More information

Ghost Imaging. Josselin Garnier (Université Paris Diderot)

Ghost Imaging. Josselin Garnier (Université Paris Diderot) Grenoble December, 014 Ghost Imaging Josselin Garnier Université Paris Diderot http:/www.josselin-garnier.org General topic: correlation-based imaging with noise sources. Particular application: Ghost

More information

A New Approach for Computation of Timing Jitter in Phase Locked Loops

A New Approach for Computation of Timing Jitter in Phase Locked Loops A New Approach for Computation of Timing Jitter in Phase ocked oops M M. Gourary (1), S. G. Rusakov (1), S.. Ulyanov (1), M.M. Zharov (1),.. Gullapalli (2), and B. J. Mulvaney (2) (1) IPPM, Russian Academy

More information

Spatial Statistics with Image Analysis. Lecture L08. Computer exercise 3. Lecture 8. Johan Lindström. November 25, 2016

Spatial Statistics with Image Analysis. Lecture L08. Computer exercise 3. Lecture 8. Johan Lindström. November 25, 2016 C3 Repetition Creating Q Spectral Non-grid Spatial Statistics with Image Analysis Lecture 8 Johan Lindström November 25, 216 Johan Lindström - johanl@maths.lth.se FMSN2/MASM25L8 1/39 Lecture L8 C3 Repetition

More information

Linear Filters. L[e iωt ] = 2π ĥ(ω)eiωt. Proof: Let L[e iωt ] = ẽ ω (t). Because L is time-invariant, we have that. L[e iω(t a) ] = ẽ ω (t a).

Linear Filters. L[e iωt ] = 2π ĥ(ω)eiωt. Proof: Let L[e iωt ] = ẽ ω (t). Because L is time-invariant, we have that. L[e iω(t a) ] = ẽ ω (t a). Linear Filters 1. Convolutions and filters. A filter is a black box that takes an input signal, processes it, and then returns an output signal that in some way modifies the input. For example, if the

More information

5 Analog carrier modulation with noise

5 Analog carrier modulation with noise 5 Analog carrier modulation with noise 5. Noisy receiver model Assume that the modulated signal x(t) is passed through an additive White Gaussian noise channel. A noisy receiver model is illustrated in

More information

Fourier Analysis and Power Spectral Density

Fourier Analysis and Power Spectral Density Chapter 4 Fourier Analysis and Power Spectral Density 4. Fourier Series and ransforms Recall Fourier series for periodic functions for x(t + ) = x(t), where x(t) = 2 a + a = 2 a n = 2 b n = 2 n= a n cos

More information

Introduction to Biomedical Engineering

Introduction to Biomedical Engineering Introduction to Biomedical Engineering Biosignal processing Kung-Bin Sung 6/11/2007 1 Outline Chapter 10: Biosignal processing Characteristics of biosignals Frequency domain representation and analysis

More information

B2.III Revision notes: quantum physics

B2.III Revision notes: quantum physics B.III Revision notes: quantum physics Dr D.M.Lucas, TT 0 These notes give a summary of most of the Quantum part of this course, to complement Prof. Ewart s notes on Atomic Structure, and Prof. Hooker s

More information

covariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of

covariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of Index* The Statistical Analysis of Time Series by T. W. Anderson Copyright 1971 John Wiley & Sons, Inc. Aliasing, 387-388 Autoregressive {continued) Amplitude, 4, 94 case of first-order, 174 Associated

More information

Unstable Oscillations!

Unstable Oscillations! Unstable Oscillations X( t ) = [ A 0 + A( t ) ] sin( ω t + Φ 0 + Φ( t ) ) Amplitude modulation: A( t ) Phase modulation: Φ( t ) S(ω) S(ω) Special case: C(ω) Unstable oscillation has a broader periodogram

More information

Review of Fourier Transform

Review of Fourier Transform Review of Fourier Transform Fourier series works for periodic signals only. What s about aperiodic signals? This is very large & important class of signals Aperiodic signal can be considered as periodic

More information

STAD57 Time Series Analysis. Lecture 23

STAD57 Time Series Analysis. Lecture 23 STAD57 Time Series Analysis Lecture 23 1 Spectral Representation Spectral representation of stationary {X t } is: 12 i2t Xt e du 12 1/2 1/2 for U( ) a stochastic process with independent increments du(ω)=

More information

14 - Gaussian Stochastic Processes

14 - Gaussian Stochastic Processes 14-1 Gaussian Stochastic Processes S. Lall, Stanford 211.2.24.1 14 - Gaussian Stochastic Processes Linear systems driven by IID noise Evolution of mean and covariance Example: mass-spring system Steady-state

More information

5. THE CLASSES OF FOURIER TRANSFORMS

5. THE CLASSES OF FOURIER TRANSFORMS 5. THE CLASSES OF FOURIER TRANSFORMS There are four classes of Fourier transform, which are represented in the following table. So far, we have concentrated on the discrete Fourier transform. Table 1.

More information

Frequency Domain and Filtering

Frequency Domain and Filtering 3 Frequency Domain and Filtering This is page i Printer: Opaque this 3. Introduction Comovement and volatility are key concepts in macroeconomics. Therefore, it is important to have statistics that describe

More information

Review of Linear Time-Invariant Network Analysis

Review of Linear Time-Invariant Network Analysis D1 APPENDIX D Review of Linear Time-Invariant Network Analysis Consider a network with input x(t) and output y(t) as shown in Figure D-1. If an input x 1 (t) produces an output y 1 (t), and an input x

More information

arxiv: v4 [gr-qc] 15 Jul 2010

arxiv: v4 [gr-qc] 15 Jul 2010 Calibrating spectral estimation for the LISA Technology Package with multichannel synthetic noise generation Luigi Ferraioli, Mauro Hueller, and Stefano Vitale University of Trento and INFN, via Sommarive

More information

13. Power Spectrum. For a deterministic signal x(t), the spectrum is well defined: If represents its Fourier transform, i.e., if.

13. Power Spectrum. For a deterministic signal x(t), the spectrum is well defined: If represents its Fourier transform, i.e., if. For a deterministic signal x(t), the spectrum is well defined: If represents its Fourier transform, i.e., if jt X ( ) = xte ( ) dt, (3-) then X ( ) represents its energy spectrum. his follows from Parseval

More information