Stationary Graph Processes: Nonparametric Spectral Estimation
|
|
- Letitia Powers
- 5 years ago
- Views:
Transcription
1 Stationary Graph Processes: Nonparametric Spectral Estimation Santiago Segarra, Antonio G. Marques, Geert Leus, and Alejandro Ribeiro Dept. of Signal Theory and Communications King Juan Carlos University - Madrid (SPAIN) antonio.garcia.marques@urjc.es ACK: Spanish MINECO TEC R and USA NSF CCF IEEE SAM Workshop, Rio de Janeiro, July 11, 2016 Antonio G. Marques Stationary Graph Processes: Nonparametric Spectral Estimation 1 / 19
2 Motivation and context We frequently encounter stochastic processes Statistical signal processing Developed tools for their understanding Stationarity facilitates the analysis of random signals in time Statistical properties are time-invariant We seek to extend the concept of stationarity to graph processes Network data and irregular domains motivate this Lack of regularity lead to potentially multiple generalizations Classical SSP concepts and tools can be generalized: spectral estimation, average periodograms,... Better understanding and estimation of graph processes Related works: [Girault 15], [Perraudin 16] Antonio G. Marques Stationary Graph Processes: Nonparametric Spectral Estimation 2 / 19
3 Prelims 1: GSP Fundamentals Graph G(V, E) with N = V nodes A and L = D A Graph signals mappings x : V R, represented as vectors x R N As.: Signal properties related to topology of G To understand GS Graph-shift operator S R N N Local S ij = 0 for i j and (i, j) / E Exs.: A or L Spectrum of S = VΛV H (assume normality) Graph Fourier Transform (GFT) for signals: x = V H x Graph filters H : R N R N are maps between graph signals Polynomial in S with coefficients h R L+1 H := L l=0 h ls l Diag. by V Freq. resp.: H = Vdiag( h)v H Local linear operators (good for modeling net dynamics) Antonio G. Marques Stationary Graph Processes: Nonparametric Spectral Estimation 3 / 19
4 Prelims 2: Weakly stationarity in time (1) Correlation of stationary discrete time signals is invariant to shifts [ C x := E xx H] ] = E [x H (n l) N x(n l) N = E [S l x(s l x) H] (2) Signal is the output of a LTI filter H excited with white noise w x = Hw, with E [ ww H] = I (3) The covariance matrix C x is diagonalized by the Fourier matrix C x = Fdiag(p)F H The process has a power spectral density p := diag ( F H C x F ) Each of these definitions can be generalized to graph signals Antonio G. Marques Stationary Graph Processes: Nonparametric Spectral Estimation 4 / 19
5 Stationary graph processes: Shifts Definition (shift invariance) Process x is weakly stationary with respect to S if and only if (b > c) (S E[ a x )( (S H ) b x ) ] [ H (S = E a+c x )( (S H ) b c x ) ] H Use a and b shifts as reference. Shift by c forward and backward Signal is stationary if these shifts do not alter its covariance It reduces to E [ xx H] = E [ S l x(s l x) H] when S is a directed cycle Time shift is orthogonal, S H = S 1 (a = 0, b = N and c = l) Need reference shifts because S can change energy of the signal Antonio G. Marques Stationary Graph Processes: Nonparametric Spectral Estimation 5 / 19
6 Stationary graph processes: Filtering Definition (filtering of white noise) Process x is weakly stationary with respect to S if it can be written as the output of linear shift invariant filter H with white input w x = Hw, with E [ ww H] = I The filter H is linear shift invariant if H(Sx) = S(Hx) L Equivalently, H polynomial on the shift operator H = h l S l Filter H determines color C x = E [ (Hw)(Hw) H] = HH H l=0 Antonio G. Marques Stationary Graph Processes: Nonparametric Spectral Estimation 6 / 19
7 Stationary graph processes: Diagonalization Definition (Simultaneous diagonalization) Process x is weakly stationary with respect to S if the covariance C x and the shift S are simultaneously diagonalizable S = V Λ V H = C x = V diag(p) V H Equivalent to time definition because F diagonalizes cycle graph The process has a power spectral density p := diag ( V H C x V ) Antonio G. Marques Stationary Graph Processes: Nonparametric Spectral Estimation 7 / 19
8 Equivalence of definitions and PSD Have introduced three equally valid definitions of weak stationarity They are different but, pleasingly, equivalent Theorem Process x has shift invariant correlation matrix it is the output of a linear shift invariant filter Covariance jointly diagonalizable with shift Shift and Filtering How stationary signals look like (local invariance) Simultaneous Diagonalization A PSD exists p := diag ( V H C x V ) The PSD collects the eigenvalues of C x. The PSD is nonnegative because C x is positive semidefinite Antonio G. Marques Stationary Graph Processes: Nonparametric Spectral Estimation 8 / 19
9 Weak stationary graph processes examples Example (White noise) White noise w is stationary in any graph shift S = VΛV H Covariance C w = σ 2 I simultaneously diagonalizable with all S Example (Covariance matrix graphs and Precision matrices) Every process is stationary in the graph defined by its covariance matrix If S = C x, shift S and covariance C x diagonalized by same basis Process is also stationary on precision matrix S = C 1 x Example (Heat diffusion processes and ARMA processes) Heat diffusion process in a graph x = α 0 (I αl) 1 w Stationary in L since α 0 (I αl) 1 is a polynomial on L Any autoregressive moving average (ARMA) process on a graph Antonio G. Marques Stationary Graph Processes: Nonparametric Spectral Estimation 9 / 19
10 Power spectral density examples Example (White noise) Power spectral density p = diag ( V H (σ 2 I)V ) = σ 2 1 Example (Covariance matrix graphs and Precision matrices) Power spectral density p = diag ( V H (VΛV H )V ) = diag(λ) Example (Heat diffusion processes and ARMA processes) Power spectral density p = diag [α 0 2 (I αλ) 2] Antonio G. Marques Stationary Graph Processes: Nonparametric Spectral Estimation 10 / 19
11 PSD estimation with correlogram & periodogram Given a process x, the covariance of x = V H x is given by C x := E [ x x H] = E [ (V H x)(v H x) H] = diag(p) Periodogram Given samples x r, average GFTs of samples ˆp pg := 1 R R x r 2 = 1 R r=1 R V H x r 2 r=1 Correlogram Replace C x in PSD definition by sample covariance ˆp cg ( ) := diag V H Ĉ x V [ [ 1 := diag V H R R x r x H r r=1 ] ] V Periodogram and correlogram lead to identical estimates ˆp pg = ˆp cg Antonio G. Marques Stationary Graph Processes: Nonparametric Spectral Estimation 11 / 19
12 Accuracy of periodogram estimator Theorem If the process x is Gaussian, periodogram estimates have bias and variance Bias b pg := E [ˆp pg ] p = 0 Variance Σ pg := E [ (ˆp pg p)(ˆp pg p) H] = 2 R diag2 (p) The periodogram is unbiased but the variance is not too good Quadratic in p. Same as time processes Bias - Variance tradeoff Windows and Filterbanks Antonio G. Marques Stationary Graph Processes: Nonparametric Spectral Estimation 12 / 19
13 Windowed average periodogram Generalize Bartlett and Welch window methods to graphs Consider windowed versions of a signal as separate realizations Given one realization x and bank of M windows W = {w m } M m=1 Obtain the windowed average periodogram ˆp W := 1 M M V H x m 2 1 M = V H diag(w m )x 2 M m=1 m=1 Similar to periodogram but windowed signals x m are not independent Introduces bias but reduces variance compared to single observation Antonio G. Marques Stationary Graph Processes: Nonparametric Spectral Estimation 13 / 19
14 Accuracy of windowed periodogram Window PSD W m := V H diag(w m )V and spectrum mixing matrices W mm := W m W m Theorem For window bank W = {w m } M m=1, the mean and variance of the windowed average periodogram ˆp W are Mean E [ˆp W ] = 1 M W mm p M m=1 Variance Tr[Σ W ] = 2 M 2 M m=1,m =1 [ ( Tr Wmm p )( Wmm p ) ] H If windows are localized there is no (or minimal) spectrum mixing Antonio G. Marques Stationary Graph Processes: Nonparametric Spectral Estimation 14 / 19
15 Normalized MSE Average periodogram MSE of periodogram as a function of the nr. of observations R Baseline ER random graph (N = 100 and p = 0.05) and S = A Observe filtered white Gaussian noise and estimate PSD 2 1 Baseline ER Smaller ER Larger PSD Small-world Number of observations Normalized MSE evolves as 2/R as expected Invariant to size, topology, and PSD Same behavior observed in non-gaussian processes (theory not valid) Antonio G. Marques Stationary Graph Processes: Nonparametric Spectral Estimation 15 / 19
16 Windowed average periodogram Performance of local windows and random windows Block stochastic graph (N = 100, 10 communities) and small world Process filters white noise with different number of taps Normalized MSE Bias squared Variance Theoretical error Empirical error Normalized MSE Local window (L=10) Local window (L=2) Random window (L=10) Random window (L=2) 0 Single window Ten local wind. Ten random wind Number of windows The use of windows introduces bias but reduces total error (MSE) Local windows work better than random windows Advantage of local windows is larger for local processes Antonio G. Marques Stationary Graph Processes: Nonparametric Spectral Estimation 16 / 19
17 Source identification error Opinion source identification Opinion diffusion in Zachary s karate club network (N = 34) Observed opinion x obtained by diffusing sparse white rumor w Given {x r } R r=1 generated from unknown {w r } R r=1 Diffused through filter of unknown nonnegative coefficients β Goal Identify the support of each rumor w r First Estimate β from Moving Average PSD estimation Second Solve R sparse linear regressions to recover supp(w r ) < = 0 < = 0.10 < = 0.15 < = Number of observations Antonio G. Marques Stationary Graph Processes: Nonparametric Spectral Estimation 17 / 19
18 Frequency index Normalized MSE PSD of face images PSD estimation for spectral signatures of faces of different people 100 grayscale face images {x i } 100 i=1 R10304 (10 images 10 people) Consider x i as realization graph process that is Stationary on Ĉ x Construct Ĉ(j) x = V (j) Λ (j) c V H(j) based on images of person j 5 10 # Individual 1 Individual 2 Individual Frequency index Number of windows Process of person j approximately stationary in Ĉx (left) Use windowed average periodogram to estimate PSD of new face Antonio G. Marques Stationary Graph Processes: Nonparametric Spectral Estimation 18 / 19
19 Conclusion Extended the notion of weak stationarity for graph processes Three definitions inspired in stationary time processes Shown all of them to be equivalent Defined power spectral density and studied its estimation Generalized classical non-parametric estimation methods Periodogram and correlogram where shown to be equivalent Windowed average periodogram leads to better estimate Extensions not described here Other non-parametric schemes: filter banks Parametric estimation: AR, MA, ARMA Space-time variation Thanks! Antonio G. Marques Stationary Graph Processes: Nonparametric Spectral Estimation 19 / 19
Stationary Graph Processes and Spectral Estimation
Stationary Graph Processes and Spectral Estimation Antonio G. Marques, Santiago Segarra, Geert Leus, and Alejandro Ribeiro arxiv:63.667v [cs.sy] 5 Aug 7 Abstract Stationarity is a cornerstone property
More informationIEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 65, NO. 22, NOVEMBER 15,
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 65, NO. 22, NOVEMBER 15, 2017 5911 Stationary Graph Processes and Spectral Estimation Antonio G. Marques, Senior Member, IEEE, Santiago Segarra, Member, IEEE,
More informationGraph Signal Processing: Fundamentals and Applications to Diffusion Processes
Graph Signal Processing: Fundamentals and Applications to Diffusion Processes Antonio G. Marques, Santiago Segarra, Alejandro Ribeiro King Juan Carlos University Massachusetts Institute of Technology University
More informationNetwork Topology Inference from Non-stationary Graph Signals
Network Topology Inference from Non-stationary Graph Signals Rasoul Shafipour Dept. of Electrical and Computer Engineering University of Rochester rshafipo@ece.rochester.edu http://www.ece.rochester.edu/~rshafipo/
More informationGraph Signal Processing: Fundamentals and Applications to Diffusion Processes
Graph Signal Processing: Fundamentals and Applications to Diffusion Processes Antonio G. Marques, Alejandro Ribeiro, Santiago Segarra King Juan Carlos University University of Pennsylvania Massachusetts
More informationINTERPOLATION OF GRAPH SIGNALS USING SHIFT-INVARIANT GRAPH FILTERS
INTERPOLATION OF GRAPH SIGNALS USING SHIFT-INVARIANT GRAPH FILTERS Santiago Segarra, Antonio G. Marques, Geert Leus, Alejandro Ribeiro University of Pennsylvania, Dept. of Electrical and Systems Eng.,
More informationErgodicity in Stationary Graph Processes: A Weak Law of Large Numbers
IEEE TRASACTIOS O SIGAL PROCESSIG (SUBMITTED) Ergodicity in Stationary Graph Processes: A Weak Law of Large umbers Fernando Gama and Alejandro Ribeiro arxiv:803.04550v [eess.sp] Mar 08 Abstract For stationary
More informationGraph Signal Processing in Distributed Network Processing
Graph Signal Processing in Distributed Network Processing Antonio G. Marques King Juan Carlos University - Madrid (SPAIN) antonio.garcia.marques@urjc.es http://www.tsc.urjc.es/~amarques/ Thanks: S. Segarra,
More informationBlind Identification of Invertible Graph Filters with Multiple Sparse Inputs 1
Blind Identification of Invertible Graph Filters with Multiple Sparse Inputs Chang Ye Dept. of ECE and Goergen Institute for Data Science University of Rochester cye7@ur.rochester.edu http://www.ece.rochester.edu/~cye7/
More information6.435, System Identification
System Identification 6.435 SET 3 Nonparametric Identification Munther A. Dahleh 1 Nonparametric Methods for System ID Time domain methods Impulse response Step response Correlation analysis / time Frequency
More informationReconstruction of graph signals: percolation from a single seeding node
Reconstruction of graph signals: percolation from a single seeding node Santiago Segarra, Antonio G. Marques, Geert Leus, and Alejandro Ribeiro Abstract Schemes to reconstruct signals defined in the nodes
More informationOptimal Graph-Filter Design and Applications to Distributed Linear Network Operators
IEEE TRANSACTIONS ON SIGNAL PROCESSING (ACCEPTED) Optimal Graph-Filter Design and Applications to Distributed Linear Network Operators Santiago Segarra, Member, IEEE, Antonio G. Marques, Senior Member,
More informationRethinking Sketching as Sampling: Linear Transforms of Graph Signals
Rethinking Sketching as Sampling: Linear Transforms of Graph Signals Fernando Gama, Antonio G. Marques, Gonzalo Mateos and Alejandro Ribeiro Abstract Sampling of bandlimited graph signals has welldocumented
More informationStatistical and Adaptive Signal Processing
r Statistical and Adaptive Signal Processing Spectral Estimation, Signal Modeling, Adaptive Filtering and Array Processing Dimitris G. Manolakis Massachusetts Institute of Technology Lincoln Laboratory
More informationAdvanced Digital Signal Processing -Introduction
Advanced Digital Signal Processing -Introduction LECTURE-2 1 AP9211- ADVANCED DIGITAL SIGNAL PROCESSING UNIT I DISCRETE RANDOM SIGNAL PROCESSING Discrete Random Processes- Ensemble Averages, Stationary
More informationCONTENTS NOTATIONAL CONVENTIONS GLOSSARY OF KEY SYMBOLS 1 INTRODUCTION 1
DIGITAL SPECTRAL ANALYSIS WITH APPLICATIONS S.LAWRENCE MARPLE, JR. SUMMARY This new book provides a broad perspective of spectral estimation techniques and their implementation. It concerned with spectral
More informationTime Series: Theory and Methods
Peter J. Brockwell Richard A. Davis Time Series: Theory and Methods Second Edition With 124 Illustrations Springer Contents Preface to the Second Edition Preface to the First Edition vn ix CHAPTER 1 Stationary
More informationCollaborative Filtering via Graph Signal Processing
Collaborative Filtering via Graph Signal Processing Weiyu Huang, Antonio G. Marques, and Alejandro Ribeiro Abstract This paper develops new designs for recommender systems inspired by recent advances in
More informationParametric Method Based PSD Estimation using Gaussian Window
International Journal of Engineering Trends and Technology (IJETT) Volume 29 Number 1 - November 215 Parametric Method Based PSD Estimation using Gaussian Window Pragati Sheel 1, Dr. Rajesh Mehra 2, Preeti
More informationcovariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of
Index* The Statistical Analysis of Time Series by T. W. Anderson Copyright 1971 John Wiley & Sons, Inc. Aliasing, 387-388 Autoregressive {continued) Amplitude, 4, 94 case of first-order, 174 Associated
More informationAdaptive Filtering. Squares. Alexander D. Poularikas. Fundamentals of. Least Mean. with MATLABR. University of Alabama, Huntsville, AL.
Adaptive Filtering Fundamentals of Least Mean Squares with MATLABR Alexander D. Poularikas University of Alabama, Huntsville, AL CRC Press Taylor & Francis Croup Boca Raton London New York CRC Press is
More informationROBUST NETWORK TOPOLOGY INFERENCE
ROBUST NETWORK TOPOLOGY INFERENCE Santiago Segarra, Antonio G. Marques, Gonzalo Mateos and Alejandro Ribeiro Institute for Data, Systems, and Society, Massachusetts Institute of Technology, Cambridge,
More informationLINEAR NETWORK OPERATORS USING NODE-VARIANT GRAPH FILTERS
LINEAR NETWORK OPERATORS USING NODE-VARIANT GRAPH FILTERS Santiago Segarra, Antonio G. Marques, and Alejandro Ribeiro Dept. of Electrical and Systems Engineering, University of Pennsylvania, Philadelphia,
More informationReconstruction of Graph Signals through Percolation from Seeding Nodes
Reconstruction of Graph Signals through Percolation from Seeding Nodes Santiago Segarra, Antonio G. Marques, Geert Leus, and Alejandro Ribeiro Abstract New schemes to recover signals defined in the nodes
More informationReconstruction of Graph Signals through Percolation from Seeding Nodes
Reconstruction of Graph Signals through Percolation from Seeding Nodes Santiago Segarra, Antonio G. Marques, Geert Leus, and Alejandro Ribeiro arxiv:507.08364v [cs.si] 30 Jul 05 Abstract New schemes to
More informationSampling of graph signals with successive local aggregations
Sampling of graph signals with successive local aggregations Antonio G. Marques, Santiago Segarra, Geert Leus, and Alejandro Ribeiro Abstract A new scheme to sample signals defined in the nodes of a graph
More informationEEM 409. Random Signals. Problem Set-2: (Power Spectral Density, LTI Systems with Random Inputs) Problem 1: Problem 2:
EEM 409 Random Signals Problem Set-2: (Power Spectral Density, LTI Systems with Random Inputs) Problem 1: Consider a random process of the form = + Problem 2: X(t) = b cos(2π t + ), where b is a constant,
More informationStatistics 910, #5 1. Regression Methods
Statistics 910, #5 1 Overview Regression Methods 1. Idea: effects of dependence 2. Examples of estimation (in R) 3. Review of regression 4. Comparisons and relative efficiencies Idea Decomposition Well-known
More informationRethinking Sketching as Sampling: A Graph Signal Processing Approach
IEEE TRANSACTIONS ON SIGNAL PROCESSING (SUBMITTED) 1 Rethinking Sketching as Sampling: A Graph Signal Processing Approach Fernando Gama, Antonio G. Marques, Gonzalo Mateos, and Alejandro Ribeiro arxiv:1611.00119v1
More informationCONTROL OF GRAPH SIGNALS OVER RANDOM TIME-VARYING GRAPHS
CONTROL OF GRAPH SIGNALS OVER RANDOM TIME-VARYING GRAPHS Fernando Gama, Elvin Isufi, Geert Leus and Alejandro Ribeiro Department of Electrical and Systems Engineering, University of Pennsylvania, Philadelphia,
More informationHeteroskedasticity and Autocorrelation Consistent Standard Errors
NBER Summer Institute Minicourse What s New in Econometrics: ime Series Lecture 9 July 6, 008 Heteroskedasticity and Autocorrelation Consistent Standard Errors Lecture 9, July, 008 Outline. What are HAC
More informationPart III Spectrum Estimation
ECE79-4 Part III Part III Spectrum Estimation 3. Parametric Methods for Spectral Estimation Electrical & Computer Engineering North Carolina State University Acnowledgment: ECE79-4 slides were adapted
More informationChapter 3 - Temporal processes
STK4150 - Intro 1 Chapter 3 - Temporal processes Odd Kolbjørnsen and Geir Storvik January 23 2017 STK4150 - Intro 2 Temporal processes Data collected over time Past, present, future, change Temporal aspect
More informationDigraph Fourier Transform via Spectral Dispersion Minimization
Digraph Fourier Transform via Spectral Dispersion Minimization Gonzalo Mateos Dept. of Electrical and Computer Engineering University of Rochester gmateosb@ece.rochester.edu http://www.ece.rochester.edu/~gmateosb/
More informationHW2 - Due 01/30. Each answer must be mathematically justified. Don t forget your name.
HW2 - Due 0/30 Each answer must be mathematically justified. Don t forget your name. Problem. Use the row reduction algorithm to find the inverse of the matrix 0 0, 2 3 5 if it exists. Double check your
More informationStochastic Processes
Stochastic Processes Stochastic Process Non Formal Definition: Non formal: A stochastic process (random process) is the opposite of a deterministic process such as one defined by a differential equation.
More informationFundamentals of Matrices
Maschinelles Lernen II Fundamentals of Matrices Christoph Sawade/Niels Landwehr/Blaine Nelson Tobias Scheffer Matrix Examples Recap: Data Linear Model: f i x = w i T x Let X = x x n be the data matrix
More informationDEMIXING AND BLIND DECONVOLUTION OF GRAPH-DIFFUSED SPARSE SIGNALS
DEMIXING AND BLIND DECONVOLUTION OF GRAPH-DIFFUSED SPARSE SIGNALS Fernando J. Iglesias, Santiago Segarra, Samuel Rey-Escudero, Antonio G. Marques, and David Ramírez, Dept. of Signal Theory and Comms.,
More informationPeter Haggett Professor of Urban and Regional Geography, University of Bristol
Locational Analysis in Human Geography 2008 AGI-Information Management Consultants May be used for personal purporses only or by libraries associated to dandelon.com network. Second Edition Peter Haggett
More informationIDENTIFICATION OF ARMA MODELS
IDENTIFICATION OF ARMA MODELS A stationary stochastic process can be characterised, equivalently, by its autocovariance function or its partial autocovariance function. It can also be characterised by
More informationClassic Time Series Analysis
Classic Time Series Analysis Concepts and Definitions Let Y be a random number with PDF f Y t ~f,t Define t =E[Y t ] m(t) is known as the trend Define the autocovariance t, s =COV [Y t,y s ] =E[ Y t t
More informationAutomatic Autocorrelation and Spectral Analysis
Piet M.T. Broersen Automatic Autocorrelation and Spectral Analysis With 104 Figures Sprin ger 1 Introduction 1 1.1 Time Series Problems 1 2 Basic Concepts 11 2.1 Random Variables 11 2.2 Normal Distribution
More informationCOMMUNITY DETECTION FROM LOW-RANK EXCITATIONS OF A GRAPH FILTER
COMMUNITY DETECTION FROM LOW-RANK EXCITATIONS OF A GRAPH FILTER Hoi-To Wai, Santiago Segarra, Asuman E. Ozdaglar, Anna Scaglione, Ali Jadbabaie School of ECEE, Arizona State University, Tempe, AZ, USA.
More informationEEG- Signal Processing
Fatemeh Hadaeghi EEG- Signal Processing Lecture Notes for BSP, Chapter 5 Master Program Data Engineering 1 5 Introduction The complex patterns of neural activity, both in presence and absence of external
More informationIntroduction to Spectral and Time-Spectral Analysis with some Applications
Introduction to Spectral and Time-Spectral Analysis with some Applications A.INTRODUCTION Consider the following process X t = U cos[(=3)t] + V sin[(=3)t] Where *E[U] = E[V ] = 0 *E[UV ] = 0 *V ar(u) =
More informationSF2943: TIME SERIES ANALYSIS COMMENTS ON SPECTRAL DENSITIES
SF2943: TIME SERIES ANALYSIS COMMENTS ON SPECTRAL DENSITIES This document is meant as a complement to Chapter 4 in the textbook, the aim being to get a basic understanding of spectral densities through
More informationParametric Signal Modeling and Linear Prediction Theory 1. Discrete-time Stochastic Processes
Parametric Signal Modeling and Linear Prediction Theory 1. Discrete-time Stochastic Processes Electrical & Computer Engineering North Carolina State University Acknowledgment: ECE792-41 slides were adapted
More informationMassachusetts Institute of Technology Department of Electrical Engineering and Computer Science : Discrete-Time Signal Processing
Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.34: Discrete-Time Signal Processing OpenCourseWare 006 ecture 8 Periodogram Reading: Sections 0.6 and 0.7
More informationDistributed Implementation of Linear Network Operators using Graph Filters
Distributed Implementation of Linear Network Operators using Graph Filters Santiago Segarra, Antonio G. Marques, and Alejandro Ribeiro Abstract A signal in a network (graph) can be defined as a vector
More informationGraph Sampling for Covariance Estimation
1 Graph Sampling for Covariance Estimation Sundeep Prabhakar Chepuri, Member, IEEE, Geert Leus, Fellow, IEEE arxiv:174.7661v1 [cs.it] 25 Apr 217 Abstract In this paper the focus is on subsampling as well
More informationElements of Multivariate Time Series Analysis
Gregory C. Reinsel Elements of Multivariate Time Series Analysis Second Edition With 14 Figures Springer Contents Preface to the Second Edition Preface to the First Edition vii ix 1. Vector Time Series
More informationModeling and testing long memory in random fields
Modeling and testing long memory in random fields Frédéric Lavancier lavancier@math.univ-lille1.fr Université Lille 1 LS-CREST Paris 24 janvier 6 1 Introduction Long memory random fields Motivations Previous
More informationEstimating network degree distributions from sampled networks: An inverse problem
Estimating network degree distributions from sampled networks: An inverse problem Eric D. Kolaczyk Dept of Mathematics and Statistics, Boston University kolaczyk@bu.edu Introduction: Networks and Degree
More informationECE 636: Systems identification
ECE 636: Systems identification Lectures 3 4 Random variables/signals (continued) Random/stochastic vectors Random signals and linear systems Random signals in the frequency domain υ ε x S z + y Experimental
More informationSPECTRUM. Deterministic Signals with Finite Energy (l 2 ) Deterministic Signals with Infinite Energy N 1. n=0. N N X N(f) 2
SPECTRUM Deterministic Signals with Finite Energy (l 2 ) Energy Spectrum: S xx (f) = X(f) 2 = 2 x(n)e j2πfn n= Deterministic Signals with Infinite Energy DTFT of truncated signal: X N (f) = N x(n)e j2πfn
More informationADSP ADSP ADSP ADSP. Advanced Digital Signal Processing (18-792) Spring Fall Semester, Department of Electrical and Computer Engineering
Advanced Digital Signal rocessing (18-792) Spring Fall Semester, 201 2012 Department of Electrical and Computer Engineering ROBLEM SET 8 Issued: 10/26/18 Due: 11/2/18 Note: This problem set is due Friday,
More informationEconometría 2: Análisis de series de Tiempo
Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 II. Basic definitions A time series is a set of observations X t, each
More informationSTAD57 Time Series Analysis. Lecture 23
STAD57 Time Series Analysis Lecture 23 1 Spectral Representation Spectral representation of stationary {X t } is: 12 i2t Xt e du 12 1/2 1/2 for U( ) a stochastic process with independent increments du(ω)=
More informationState-space Model. Eduardo Rossi University of Pavia. November Rossi State-space Model Fin. Econometrics / 53
State-space Model Eduardo Rossi University of Pavia November 2014 Rossi State-space Model Fin. Econometrics - 2014 1 / 53 Outline 1 Motivation 2 Introduction 3 The Kalman filter 4 Forecast errors 5 State
More informationStatistical Signal Processing Detection, Estimation, and Time Series Analysis
Statistical Signal Processing Detection, Estimation, and Time Series Analysis Louis L. Scharf University of Colorado at Boulder with Cedric Demeure collaborating on Chapters 10 and 11 A TT ADDISON-WESLEY
More informationMGR-815. Notes for the MGR-815 course. 12 June School of Superior Technology. Professor Zbigniew Dziong
Modeling, Estimation and Control, for Telecommunication Networks Notes for the MGR-815 course 12 June 2010 School of Superior Technology Professor Zbigniew Dziong 1 Table of Contents Preface 5 1. Example
More informationStatistical signal processing
Statistical signal processing Short overview of the fundamentals Outline Random variables Random processes Stationarity Ergodicity Spectral analysis Random variable and processes Intuition: A random variable
More informationPractical Spectral Estimation
Digital Signal Processing/F.G. Meyer Lecture 4 Copyright 2015 François G. Meyer. All Rights Reserved. Practical Spectral Estimation 1 Introduction The goal of spectral estimation is to estimate how the
More informationNew Introduction to Multiple Time Series Analysis
Helmut Lütkepohl New Introduction to Multiple Time Series Analysis With 49 Figures and 36 Tables Springer Contents 1 Introduction 1 1.1 Objectives of Analyzing Multiple Time Series 1 1.2 Some Basics 2
More informationApproximate Principal Components Analysis of Large Data Sets
Approximate Principal Components Analysis of Large Data Sets Daniel J. McDonald Department of Statistics Indiana University mypage.iu.edu/ dajmcdon April 27, 2016 Approximation-Regularization for Analysis
More informationIf we want to analyze experimental or simulated data we might encounter the following tasks:
Chapter 1 Introduction If we want to analyze experimental or simulated data we might encounter the following tasks: Characterization of the source of the signal and diagnosis Studying dependencies Prediction
More informationIEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, VOL. 3, NO. 3, SEPTEMBER
IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, VOL. 3, NO. 3, SEPTEMBER 2017 467 Network Topology Inference from Spectral Templates Santiago Segarra, Member, IEEE, Antonio G. Marques,
More informationE 4101/5101 Lecture 6: Spectral analysis
E 4101/5101 Lecture 6: Spectral analysis Ragnar Nymoen 3 March 2011 References to this lecture Hamilton Ch 6 Lecture note (on web page) For stationary variables/processes there is a close correspondence
More informationModelling Non-linear and Non-stationary Time Series
Modelling Non-linear and Non-stationary Time Series Chapter 2: Non-parametric methods Henrik Madsen Advanced Time Series Analysis September 206 Henrik Madsen (02427 Adv. TS Analysis) Lecture Notes September
More information3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE
3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE 3.0 INTRODUCTION The purpose of this chapter is to introduce estimators shortly. More elaborated courses on System Identification, which are given
More informationSRI VIDYA COLLEGE OF ENGINEERING AND TECHNOLOGY UNIT 3 RANDOM PROCESS TWO MARK QUESTIONS
UNIT 3 RANDOM PROCESS TWO MARK QUESTIONS 1. Define random process? The sample space composed of functions of time is called a random process. 2. Define Stationary process? If a random process is divided
More informationTime Series Analysis -- An Introduction -- AMS 586
Time Series Analysis -- An Introduction -- AMS 586 1 Objectives of time series analysis Data description Data interpretation Modeling Control Prediction & Forecasting 2 Time-Series Data Numerical data
More informationGraph Signal Processing
Graph Signal Processing Rahul Singh Data Science Reading Group Iowa State University March, 07 Outline Graph Signal Processing Background Graph Signal Processing Frameworks Laplacian Based Discrete Signal
More informationIrregularity-Aware Graph Fourier Transforms
1 Irregularity-Aware Graph Fourier Transforms Benjamin Girault, Antonio Ortega Fellow, IEEE and Shrikanth S. Narayanan Fellow, IEEE arxiv:18.1v1 [eess.sp] 8 Feb 18 Abstract In this paper, we present a
More informationTime Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY
Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY & Contents PREFACE xiii 1 1.1. 1.2. Difference Equations First-Order Difference Equations 1 /?th-order Difference
More informationExercises - Time series analysis
Descriptive analysis of a time series (1) Estimate the trend of the series of gasoline consumption in Spain using a straight line in the period from 1945 to 1995 and generate forecasts for 24 months. Compare
More informationLinear models. Chapter Overview. Linear process: A process {X n } is a linear process if it has the representation.
Chapter 2 Linear models 2.1 Overview Linear process: A process {X n } is a linear process if it has the representation X n = b j ɛ n j j=0 for all n, where ɛ n N(0, σ 2 ) (Gaussian distributed with zero
More informationAN IDENTIFICATION ALGORITHM FOR ARMAX SYSTEMS
AN IDENTIFICATION ALGORITHM FOR ARMAX SYSTEMS First the X, then the AR, finally the MA Jan C. Willems, K.U. Leuven Workshop on Observation and Estimation Ben Gurion University, July 3, 2004 p./2 Joint
More informationDATA defined on network-like structures are encountered
Graph Fourier Transform based on Directed Laplacian Rahul Singh, Abhishek Chakraborty, Graduate Student Member, IEEE, and B. S. Manoj, Senior Member, IEEE arxiv:6.v [cs.it] Jan 6 Abstract In this paper,
More informationRandom Sampling of Bandlimited Signals on Graphs
Random Sampling of Bandlimited Signals on Graphs Pierre Vandergheynst École Polytechnique Fédérale de Lausanne (EPFL) School of Engineering & School of Computer and Communication Sciences Joint work with
More informationProbability Space. J. McNames Portland State University ECE 538/638 Stochastic Signals Ver
Stochastic Signals Overview Definitions Second order statistics Stationarity and ergodicity Random signal variability Power spectral density Linear systems with stationary inputs Random signal memory Correlation
More informationStatistics of Stochastic Processes
Prof. Dr. J. Franke All of Statistics 4.1 Statistics of Stochastic Processes discrete time: sequence of r.v...., X 1, X 0, X 1, X 2,... X t R d in general. Here: d = 1. continuous time: random function
More informationII. Nonparametric Spectrum Estimation for Stationary Random Signals - Non-parametric Methods -
II. onparametric Spectrum Estimation for Stationary Random Signals - on-parametric Methods - - [p. 3] Periodogram - [p. 12] Periodogram properties - [p. 23] Modified periodogram - [p. 25] Bartlett s method
More informationLECTURES 2-3 : Stochastic Processes, Autocorrelation function. Stationarity.
LECTURES 2-3 : Stochastic Processes, Autocorrelation function. Stationarity. Important points of Lecture 1: A time series {X t } is a series of observations taken sequentially over time: x t is an observation
More information9. Multivariate Linear Time Series (II). MA6622, Ernesto Mordecki, CityU, HK, 2006.
9. Multivariate Linear Time Series (II). MA6622, Ernesto Mordecki, CityU, HK, 2006. References for this Lecture: Introduction to Time Series and Forecasting. P.J. Brockwell and R. A. Davis, Springer Texts
More informationPure Random process Pure Random Process or White Noise Process: is a random process {X t, t 0} which has: { σ 2 if k = 0 0 if k 0
MODULE 9: STATIONARY PROCESSES 7 Lecture 2 Autoregressive Processes 1 Moving Average Process Pure Random process Pure Random Process or White Noise Process: is a random process X t, t 0} which has: E[X
More informationTIME SERIES ANALYSIS. Forecasting and Control. Wiley. Fifth Edition GWILYM M. JENKINS GEORGE E. P. BOX GREGORY C. REINSEL GRETA M.
TIME SERIES ANALYSIS Forecasting and Control Fifth Edition GEORGE E. P. BOX GWILYM M. JENKINS GREGORY C. REINSEL GRETA M. LJUNG Wiley CONTENTS PREFACE TO THE FIFTH EDITION PREFACE TO THE FOURTH EDITION
More information1 Linear Difference Equations
ARMA Handout Jialin Yu 1 Linear Difference Equations First order systems Let {ε t } t=1 denote an input sequence and {y t} t=1 sequence generated by denote an output y t = φy t 1 + ε t t = 1, 2,... with
More informationAdaptive Filter Theory
0 Adaptive Filter heory Sung Ho Cho Hanyang University Seoul, Korea (Office) +8--0-0390 (Mobile) +8-10-541-5178 dragon@hanyang.ac.kr able of Contents 1 Wiener Filters Gradient Search by Steepest Descent
More informationBasics on 2-D 2 D Random Signal
Basics on -D D Random Signal Spring 06 Instructor: K. J. Ray Liu ECE Department, Univ. of Maryland, College Park Overview Last Time: Fourier Analysis for -D signals Image enhancement via spatial filtering
More informationReview of spectral analysis methods applied to sea level anomaly signals
Review of spectral analysis methods applied to sea level anomaly signals C. Mailhes 1, D. Bonacci 1, O. Besson 1, A. Guillot 2, S. Le Gac 2, N. Steunou 2, C. Cheymol 2, N. Picot 2 1. Telecommunications
More informationStatistícal Methods for Spatial Data Analysis
Texts in Statistícal Science Statistícal Methods for Spatial Data Analysis V- Oliver Schabenberger Carol A. Gotway PCT CHAPMAN & K Contents Preface xv 1 Introduction 1 1.1 The Need for Spatial Analysis
More informationChapter 2 Wiener Filtering
Chapter 2 Wiener Filtering Abstract Before moving to the actual adaptive filtering problem, we need to solve the optimum linear filtering problem (particularly, in the mean-square-error sense). We start
More informationIrregularity-Aware Graph Fourier Transforms
1 Irregularity-Aware Graph Fourier Transforms Benjamin Girault, Antonio Ortega Fellow, IEEE and Shrikanth S. Narayanan Fellow, IEEE Abstract In this paper, we present a novel generalization of the graph
More informationTropical Graph Signal Processing
Tropical Graph Signal Processing Vincent Gripon To cite this version: Vincent Gripon. Tropical Graph Signal Processing. 2017. HAL Id: hal-01527695 https://hal.archives-ouvertes.fr/hal-01527695v2
More information26. Filtering. ECE 830, Spring 2014
26. Filtering ECE 830, Spring 2014 1 / 26 Wiener Filtering Wiener filtering is the application of LMMSE estimation to recovery of a signal in additive noise under wide sense sationarity assumptions. Problem
More informationQuantitative Trendspotting. Rex Yuxing Du and Wagner A. Kamakura. Web Appendix A Inferring and Projecting the Latent Dynamic Factors
1 Quantitative Trendspotting Rex Yuxing Du and Wagner A. Kamakura Web Appendix A Inferring and Projecting the Latent Dynamic Factors The procedure for inferring the latent state variables (i.e., [ ] ),
More informationExpressions for the covariance matrix of covariance data
Expressions for the covariance matrix of covariance data Torsten Söderström Division of Systems and Control, Department of Information Technology, Uppsala University, P O Box 337, SE-7505 Uppsala, Sweden
More informationExploring Granger Causality for Time series via Wald Test on Estimated Models with Guaranteed Stability
Exploring Granger Causality for Time series via Wald Test on Estimated Models with Guaranteed Stability Nuntanut Raksasri Jitkomut Songsiri Department of Electrical Engineering, Faculty of Engineering,
More informationINTRODUCTION Noise is present in many situations of daily life for ex: Microphones will record noise and speech. Goal: Reconstruct original signal Wie
WIENER FILTERING Presented by N.Srikanth(Y8104060), M.Manikanta PhaniKumar(Y8104031). INDIAN INSTITUTE OF TECHNOLOGY KANPUR Electrical Engineering dept. INTRODUCTION Noise is present in many situations
More information