A Radon Transform Based Method to Determine the Numerical Spread as a Measure of Non-Stationarity

Size: px
Start display at page:

Download "A Radon Transform Based Method to Determine the Numerical Spread as a Measure of Non-Stationarity"

Transcription

1 A Radon Transform Based Method to Determine the Numerical Spread as a Measure of Non-Stationarity ROBERT A. HEDGES and BRUCE W. SUTER Air Force Research Laboratory IFGC 525 Brooks Rd. Rome, NY U.S.A. Abstract: Establishing measures for local stationarity is an open problem in the field of time-frequency analysis. One promising theoretical measure, known as the spread, provides a means for quantizing potential correlation between signal elements. In this paper we undertake the issue of generalizing techniques developed by the Authors to better estimate the spread of a signal. Existing techniques estimate the spread as the rectangular region of support of the associated expected ambiguity function oriented parallel to the axes. By applying Radon Transform techniques we can produce a parameterized model which describes the orientation of the region of support providing tighter estimates of the signal spread. Examples are provided that illustrate the enhancement of the new method. Keywords: Non-Stationarity, Radon Transform 1 Introduction In a recent publication, Donoho, Mallat, and von Sachs [1] pose an open problem of devising a measure of local stationarity by measuring the departure from pure stationarity. They provide a list of ideal properties for a measure of local stationarity as follows: Quantitative The measure of local stationarity should reduce to a nonnegative dimensionless constant, where zero means no departure from stationarity and large values mean large departures from stationarity. Measurable The measure should be directly computable from the covariance, and should not involve complex implicit functionals of the covariance, such as the eigenfunctions of the best onestep-ahead predictor. Robust The measure should work well for processes which are not homogeneously stationary, i.e., which on a small subset of their domain are changing rapidly. Analytically Powerful The measure should have direct implications for many derived quantities about which one would like to have information. They then note that the notion of spread, as introduced by W. Kozek [2, 3] comes close to satisfying these requirements ::: we think spread is a major conceptual advance, which points the way towards important future developments. However, they go on to point out, the spread is not robust. [1] In [4] the investigation the issues of implementation arising from finite, discrete, data was addressed through direct implementation of existing theory. This work will demonstrate shortcomings in this theory and address them using Radon transform techniques. 2 Theoretical Spread To establish a context for our work we first summarize the theoretical framework for spread of a random process x(t) defined for continuous t [2,3,5]. The (generalized) Ambiguity Function (AF) [5]ofa deterministic signal x(t) is given by A () x = (;) x(t +( 1 2,))x (t,( 1 2 +))e,{2t dt:

2 The expected (generalized) ambiguity function EAF EA () x (t; ) of a nonstationary random process x(t) is the expectation of the AF EA () (;) x = E = x(t +( 1 2,))x (t,( 1 2 +))e,{2t dt R x (t +( 1 2,);t, (1 2 + ))e,{2t dt: Let R () x (t; ) R x (t +( 2 1,);t, (1 2 +)),then EA () x (;) = R () x (t; )e,{2t dt: (1) If the EAF is zero about a given TF lag point (12;12), then any two TF points (t1;f1)and (t2;f2) with t1, t2 = 12 and f1, f2 = 12 are uncorrelated. The EAF indicates the potential correlation between Time-Frequency points separated by the time lag and the frequency lag [3]. Let [, ; ][, ; ]be the smallest rectangle (centered at the origin of the (;) plane) which contains the effective support of the EAF, i.e., jea () x (;)j for jj > or jj >. Define the spread of x as the area of this rectangle: =4 : (2) From these definitions we can view the spread as a product of temporal correlation,, and spectral correlation. In [2] the classification of a signal as underspread if 1 and overspread otherwise. 3 Numerical Spread In [4] we addressed the issues of implementing the above measures of discrete signals. To define numerical spread we can simply rewrite equation (1) in terms of discrete variables. NEA () x [ m; k ]= and N,1 X tn= r () x [t n; m ]e,{2tn k=n r () x [t n; m ]=r x [t n +(, 1 2 ) m;t n,(+ 1 2 ) m] (3) In order to implement such a scheme on discrete data we first must determine a value for. Itwasshownthat the EAFs obtained for different choices of are equal up to a phase factor [3], EA ( 1) x (;) =e {2( 1, 2 ) EA ( 1) x (;) jea ( 1) x (;)j = jea ( 1) x (;)j: Thus, with respect to the calculation of spread for continuous variables, the factor is arbitrary. For our work, we chose = 1=2 since it fits the above criterion and has the added benefit that the EAF becomes the Fast Fourier transform along the diagonals of the correlation matrix. We can now define the Numerical Expected Ambiguity Function, NEAF, as N,1 X NEA x [ m ; k ]= r (1=2) x [t n ; m ]e,{2tn k=n tn= N,1 X = ~r x [t n ;t n, m ]e,{2tn k=n tn= (4) where the ~r x is the extended autocorrelation as defined in [4]. In order to facilitate the calculation of the region of support we project the signal onto the and axes and determine the support of these projections. Define = j^j : = j^j : E(;)d E(;)d <;for > ^ <;for >^ ; (5) : (6) where delta is a pre-determined threshold. Thenumerical spread is defined as the effective support of the NEAF =4 : 4 Radon Transform Approach One shortcoming of the previous approaches is that of orientation. The spread (theoretical or numerical) is calculated from and as estimates of support in the direction and direction. Thus the rectangle of support is always oriented parallel to the axis, this may lead to over-approximation of the spread and ignores any information concerning correlation between and. Matzet al. refine the definition of underspread to strictly underspread if the minimal rectangle of support is oriented parallel to the and axis [5]. However, there is no mention as to how to determine this

3 contour plot of E(,) contour plot of E(,) contour plot of E(,) Projection of E(,) onto Axis Projection of E(,) onto Axis 8 Projection of E(,) onto Axis 8 Projection of E(,) onto Axis Figure 1: Three Expected Ambiguity Functions, from left to right, corresponding to r = ;r =,:6 and r = :99 with 1 = 2;2 = 3 in equation (7). Each function has identical and projections, thus existing methods would calculate the spread to be equal for all three cases, which is obviously incorrect. orientation. In Figure 1 we see three examples of expected ambiguity functions of the form inspired by an example in [6]: p 1 E(;) = 212(1, r 2 ) 1 2 exp, 2(1, r 2 ) 2 1, 2r : (7) The values of spread components and from equation (5) and (6) are independent of the parameter r, thus the resulting spread is the same for each example. This result is unsatisfactory since upon examination we can see that the area of support is not a constant. What we are observing is that the orientation of the rectangle we use to estimate the support is important. We can extend the idea of projection onto any arbitrary axis and estimate the support from this projection using the Radon transform. Definition 4..1 Assume E(;) satisfies the following properties: 1. E(;) is defined on R 2 2. E(;) is absolutely convergent i.e., je(;)jdd < 1; then the Radon Transform [7] of E, is defined as E(; ) = ; E(;)( cos + sin, )dd: (8) Observe that the delta function is one dimensional and thus the integral over the plane reduces to an integral along the line given by = cos + sin. Note that E(; ) is not defined on a (circular) polar coordinate system. This is best demonstrated by the fact that E(;) is not constant and thus 1 6= 2 may imply that E(;1) 6= E(;2) making the origin in circular polar coordinates multiply defined. The appropriate space for E(; ) is the surface of the unit cylinder R S 1. The cylinder need only be a half cylinder since E(; ) = E(,; + ): For purposes of illustration, the cylinder will be opened up with on one axis and on the other. We can utilize the Radon transform of the ambiguity function to determine the coordinates of the maximum intensity in Radon space (;). This point in turn corresponds to the line of maximum intensity in ambiguity space ( = cos + sin ). Utilizing this correspondence between ambiguity space and Radon space, we will assume the features in ambiguity space are concentrated about this line. We then align one of

4 (; ) Ambiguity Space Radon Space Figure 2: Correspondence between the line o = x cos + y sin in ambiguity space and the point (;)in Radon space. Figure 3: Orientation of spread components. the axis with this line and denote as. The other axis, denoted, is orthogonal to with their intersection a distance from the origin as shown in Figure 2. We can now define spread with respect to our new axis. Let [, ; ][, ; ]be the smallest rectangle (centered at the origin of the ( ; ) plane) which contains the effective support of the EAF, i.e., jea () x ( ; )j for j j > or j j > : Define the spread of x as the area of this rectangle: =4 : (9) We can now write a general equation for spread with respect to the angles of orientation o and? o. Thus we calculate and as follows: = j^j : E(; ) n = j^j : E(; o? ) <;for >^ <;for > ^ : (1) : (11) This is consistent with equations (5) and (6) with = and? = =2. See Figure 3 for an illustration comparing the two regions of support. 5 Application of New Techniques to Examples. In Figure 4 we have applied the Radon transform technique to the same data sets in Figure 1. By properly orienting our support region we may differentiate between cases. The first case (row one) was oriented so that = and thus the projections remain unchanged. In example two (row two) we see that be reorienting the axis along the angles = 1:8 radians and? = 1:8 + =2 radians, the new projections, and thus the signal spread had changed. Example three (row three) demonstrates a dramatic change in the spread by reorienting the axes by = 2:1642 radians and? = 2: =2 radians and calculating and. 6 Summary and Conclusions We have introduced the use of Radon Transform techniques to the calculation of signal spread. Through these techniques we are able to produce a two parameter model of the and orientation of the support of an expected ambiguity function. The use of the Radon Transform as a tool to investigate signal spread shows great promise beyond its use here. An immediate extension would be to construct a four parameter model to describe orientation and location of the support. Another area of intrest is the issue of robustness, which known to be a problem [1], we believe that the Radon transform in conjunction with multiresolution techniques can be used to determine regions of local stationarity and increase robustness. The combination of Radon and multiresolution techniques is similar to Candès and Donoho s work on ridgelets [8]. Further research utilizing these techniques to aid in the calculation of signal representation on local regions of support will provide both an enhanced framework for our future work in the area of adaptive signal representations, including the adaptation of novel multirate and wavelet signal processing techniques [9, 1].

5 1 contour plot of E(,) Contour plot of Radon Transform of E(,) 1 φ=φ φ=φ 8 Projections onto and axes φ= φ=pi/ φ contour plot of E(,) Contour plot of Radon Transform of E(,) 15 1 φ=φ φ=φ Projections onto and axes φ= φ=pi/ φ contour plot of E(,) Contour plot of Radon Transform of E(,) 1 φ=φ φ=φ 8 Projections onto and axes φ= φ=pi/ φ 2 2 Figure 4: The three expected ambiguity functions from Figure 1 are plotted in the first column along with the contour plots of there Radon transforms in the second column. On the Radon transform plots the lines corresponding to the traditional projections = and = =2 are presented along side the lines corresponding to the calculated projections along and, corresponding to = and?, respectively. In the final column the and projections are shown. These projection clearly demonstrate the variation in spread between the three ambiguity functions which was not detected using existing methods.

6 References [1] D.L. Donoho, S. Mallat, and R. von Sachs, Estimating covariances of locally stationary processes: Rates of convergences of best basis methods, Tech. Rep., Stanford University, February [2] W. Kozek, On the underspread/overspread classification of random processes, eitschrift Für angewandte Mathematik und Mechanik, vol. 76, no. 3, [3] W. Kozek, F. Hlawatsch, H. Kirchauer, and U. Trautwein, Correlative time-frequency analysis and classification of nonstationary random processes, in Proceedings of the IEEE-SP International Symposium on Time-Frequency and Time-Scale Analysis, 1994, pp [4] R. A. Hedges and B. W. Suter, The introduction of numerical spread as a measure of nonstationarity, in 32nd Symposium on the Interface of Computing Science and Statistics, 2, vol. 33. [5] G. Matz, F. Hlawatsch, and W. Kozek, Generalized evolutionary spectral analysis and the weyl spectrum of nonstationary random processes, IEEE Transactions on Signal Processing, vol. 45, no. 6, pp , June [6] L. Cohen, Time-Frequency Analysis, Prentice Hall Signal Processing Series. Prentice Hall PTR, [7] S.R.Deans, The Radon Transform and Some of Its Applications, John Wiley & Sons, [8] E. J. Candès and D. L. Donoho, Ridgelets: A key to higher-dimensional intermittency?, in Wavelets: the Key to Intermittent Information, London, February 1999, The Royal Society of London. [9] B. W. Suter, Multirate and Wavelet Signal Processing, vol. 8 of Wavelets and its Applications, Academic Press, [1] R. A. Hedges, Hybrid Wavelet Packet Analysis: Theory and Implementations, Ph.D. thesis, Arizona State University, 1999.

IEEE Trans. Information Theory, vol. 52, no. 3, Mar. 2006, pp , Copyright IEEE 2006

IEEE Trans. Information Theory, vol. 52, no. 3, Mar. 2006, pp , Copyright IEEE 2006 IEEE Trans. Information Theory, vol. 52, no. 3, Mar. 2006, pp. 1067 1086, Copyright IEEE 2006 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 52, NO. 3, MARCH 2006 1067 Nonstationary Spectral Analysis Based

More information

THIS paper treats estimation of the Wigner-Ville spectrum

THIS paper treats estimation of the Wigner-Ville spectrum IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 55, NO. 1, JANUARY 2007 73 Kernels Multiple Windows for Estimation of the Wigner-Ville Spectrum of Gaussian Locally Stationary Processes Patrik Wahlberg Maria

More information

TIME-FREQUENCY ANALYSIS: TUTORIAL. Werner Kozek & Götz Pfander

TIME-FREQUENCY ANALYSIS: TUTORIAL. Werner Kozek & Götz Pfander TIME-FREQUENCY ANALYSIS: TUTORIAL Werner Kozek & Götz Pfander Overview TF-Analysis: Spectral Visualization of nonstationary signals (speech, audio,...) Spectrogram (time-varying spectrum estimation) TF-methods

More information

1 Introduction Spectral analysis of (wide-sense) stationary random processes by means of the power spectral density (PSD) is a useful concept. owever,

1 Introduction Spectral analysis of (wide-sense) stationary random processes by means of the power spectral density (PSD) is a useful concept. owever, IEEE Trans. Signal Proc., vol. 45, no. 6, pp. 150{1534, June 1997. Generalized Evolutionary Spectral Analysis and the Weyl Spectrum of Nonstationary andom Processes SP-865, nal version Gerald Matz y, Franz

More information

IV. Covariance Analysis

IV. Covariance Analysis IV. Covariance Analysis Autocovariance Remember that when a stochastic process has time values that are interdependent, then we can characterize that interdependency by computing the autocovariance function.

More information

Rigid Geometric Transformations

Rigid Geometric Transformations Rigid Geometric Transformations Carlo Tomasi This note is a quick refresher of the geometry of rigid transformations in three-dimensional space, expressed in Cartesian coordinates. 1 Cartesian Coordinates

More information

Stochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno

Stochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function.

More information

Scattered Data Interpolation with Wavelet Trees

Scattered Data Interpolation with Wavelet Trees Scattered Data Interpolation with Wavelet Trees Christophe P. Bernard, Stéphane G. Mallat and Jean-Jacques Slotine Abstract. This paper describes a new result on a wavelet scheme for scattered data interpolation

More information

arxiv:gr-qc/ v1 24 Dec 2004

arxiv:gr-qc/ v1 24 Dec 2004 LIGO-P15133 Multiresolution techniques for the detection of gravitational-wave bursts arxiv:gr-qc/412119v1 24 Dec 24 S Chatterji, L Blackburn, G Martin and E Katsavounidis MIT LIGO Laboratory, NW17-161,

More information

Lecture 1: Brief Review on Stochastic Processes

Lecture 1: Brief Review on Stochastic Processes Lecture 1: Brief Review on Stochastic Processes A stochastic process is a collection of random variables {X t (s) : t T, s S}, where T is some index set and S is the common sample space of the random variables.

More information

COMPLEX SIGNALS are used in various areas of signal

COMPLEX SIGNALS are used in various areas of signal IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 45, NO. 2, FEBRUARY 1997 411 Second-Order Statistics of Complex Signals Bernard Picinbono, Fellow, IEEE, and Pascal Bondon, Member, IEEE Abstract The second-order

More information

Statistics 992 Continuous-time Markov Chains Spring 2004

Statistics 992 Continuous-time Markov Chains Spring 2004 Summary Continuous-time finite-state-space Markov chains are stochastic processes that are widely used to model the process of nucleotide substitution. This chapter aims to present much of the mathematics

More information

Non-Gaussian Maximum Entropy Processes

Non-Gaussian Maximum Entropy Processes Non-Gaussian Maximum Entropy Processes Georgi N. Boshnakov & Bisher Iqelan First version: 3 April 2007 Research Report No. 3, 2007, Probability and Statistics Group School of Mathematics, The University

More information

A Multi-window Fractional Evolutionary Spectral Analysis

A Multi-window Fractional Evolutionary Spectral Analysis A Multi-window Fractional Evolutionary Spectral Analysis YALÇIN ÇEKİÇ, AYDIN AKAN, and MAHMUT ÖZTÜRK University of Bahcesehir, Department of Electrical and Electronics Engineering Bahcesehir, 49, Istanbul,

More information

On the Space-Varying Filtering

On the Space-Varying Filtering On the Space-Varying Filtering LJubiša Stanković, Srdjan Stanković, Igor Djurović 2 Abstract Filtering of two-dimensional noisy signals is considered in the paper. Concept of nonstationary space-varying

More information

Statistics 910, #5 1. Regression Methods

Statistics 910, #5 1. Regression Methods Statistics 910, #5 1 Overview Regression Methods 1. Idea: effects of dependence 2. Examples of estimation (in R) 3. Review of regression 4. Comparisons and relative efficiencies Idea Decomposition Well-known

More information

ELEMENTS OF PROBABILITY THEORY

ELEMENTS OF PROBABILITY THEORY ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable

More information

AHAMADA IBRAHIM GREQAM, universit?de la méditerranée and CERESUR, universit?de La Réunion. Abstract

AHAMADA IBRAHIM GREQAM, universit?de la méditerranée and CERESUR, universit?de La Réunion. Abstract Non stationarity characteristics of the S\returns:An approach based on the evolutionary spectral density. AHAMADA IBRAHIM GREQAM, universit?de la méditerranée and CERESUR, universit?de La Réunion Abstract

More information

1. Fundamental concepts

1. Fundamental concepts . Fundamental concepts A time series is a sequence of data points, measured typically at successive times spaced at uniform intervals. Time series are used in such fields as statistics, signal processing

More information

Sparsity in Underdetermined Systems

Sparsity in Underdetermined Systems Sparsity in Underdetermined Systems Department of Statistics Stanford University August 19, 2005 Classical Linear Regression Problem X n y p n 1 > Given predictors and response, y Xβ ε = + ε N( 0, σ 2

More information

Waveform-Based Coding: Outline

Waveform-Based Coding: Outline Waveform-Based Coding: Transform and Predictive Coding Yao Wang Polytechnic University, Brooklyn, NY11201 http://eeweb.poly.edu/~yao Based on: Y. Wang, J. Ostermann, and Y.-Q. Zhang, Video Processing and

More information

Covariant Time-Frequency Representations. Through Unitary Equivalence. Richard G. Baraniuk. Member, IEEE. Rice University

Covariant Time-Frequency Representations. Through Unitary Equivalence. Richard G. Baraniuk. Member, IEEE. Rice University Covariant Time-Frequency Representations Through Unitary Equivalence Richard G. Baraniuk Member, IEEE Department of Electrical and Computer Engineering Rice University P.O. Box 1892, Houston, TX 77251{1892,

More information

ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process

ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random

More information

Myoelectrical signal classification based on S transform and two-directional 2DPCA

Myoelectrical signal classification based on S transform and two-directional 2DPCA Myoelectrical signal classification based on S transform and two-directional 2DPCA Hong-Bo Xie1 * and Hui Liu2 1 ARC Centre of Excellence for Mathematical and Statistical Frontiers Queensland University

More information

New Multiscale Methods for 2D and 3D Astronomical Data Set

New Multiscale Methods for 2D and 3D Astronomical Data Set New Multiscale Methods for 2D and 3D Astronomical Data Set Jean Luc Starck Dapnia/SEDI SAP, CEA Saclay, France. jstarck@cea.fr http://jstarck.free.fr Collaborators: D.L. Donoho, O. Levi, Department of

More information

Pattern Recognition 2

Pattern Recognition 2 Pattern Recognition 2 KNN,, Dr. Terence Sim School of Computing National University of Singapore Outline 1 2 3 4 5 Outline 1 2 3 4 5 The Bayes Classifier is theoretically optimum. That is, prob. of error

More information

On non-stationary convolution and inverse convolution

On non-stationary convolution and inverse convolution Stanford Exploration Project, Report 102, October 25, 1999, pages 1 137 On non-stationary convolution and inverse convolution James Rickett 1 keywords: helix, linear filtering, non-stationary deconvolution

More information

Digital Image Processing

Digital Image Processing Digital Image Processing 2D SYSTEMS & PRELIMINARIES Hamid R. Rabiee Fall 2015 Outline 2 Two Dimensional Fourier & Z-transform Toeplitz & Circulant Matrices Orthogonal & Unitary Matrices Block Matrices

More information

A SIMPLE CLOUD SIMULATOR FOR INVESTIGATING THE CORRELATION SCALING COEFFICIENT USED IN THE WAVELET VARIABILITY MODEL (WVM)

A SIMPLE CLOUD SIMULATOR FOR INVESTIGATING THE CORRELATION SCALING COEFFICIENT USED IN THE WAVELET VARIABILITY MODEL (WVM) A SIMPLE CLOUD SIMULATOR FOR INVESTIGATING THE CORRELATION SCALING COEFFICIENT USED IN THE WAVELET VARIABILITY MODEL (WVM) Matthew Lave Jan Kleissl University of California, San Diego 9 Gilman Dr. #11

More information

Identification and Classification of High Impedance Faults using Wavelet Multiresolution Analysis

Identification and Classification of High Impedance Faults using Wavelet Multiresolution Analysis 92 NATIONAL POWER SYSTEMS CONFERENCE, NPSC 2002 Identification Classification of High Impedance Faults using Wavelet Multiresolution Analysis D. Cha N. K. Kishore A. K. Sinha Abstract: This paper presents

More information

2018 Fall 2210Q Section 013 Midterm Exam I Solution

2018 Fall 2210Q Section 013 Midterm Exam I Solution 8 Fall Q Section 3 Midterm Exam I Solution True or False questions ( points = points) () An example of a linear combination of vectors v, v is the vector v. True. We can write v as v + v. () If two matrices

More information

which arises when we compute the orthogonal projection of a vector y in a subspace with an orthogonal basis. Hence assume that P y = A ij = x j, x i

which arises when we compute the orthogonal projection of a vector y in a subspace with an orthogonal basis. Hence assume that P y = A ij = x j, x i MODULE 6 Topics: Gram-Schmidt orthogonalization process We begin by observing that if the vectors {x j } N are mutually orthogonal in an inner product space V then they are necessarily linearly independent.

More information

LINEAR ALGEBRA SUMMARY SHEET.

LINEAR ALGEBRA SUMMARY SHEET. LINEAR ALGEBRA SUMMARY SHEET RADON ROSBOROUGH https://intuitiveexplanationscom/linear-algebra-summary-sheet/ This document is a concise collection of many of the important theorems of linear algebra, organized

More information

Quadrature Prefilters for the Discrete Wavelet Transform. Bruce R. Johnson. James L. Kinsey. Abstract

Quadrature Prefilters for the Discrete Wavelet Transform. Bruce R. Johnson. James L. Kinsey. Abstract Quadrature Prefilters for the Discrete Wavelet Transform Bruce R. Johnson James L. Kinsey Abstract Discrepancies between the Discrete Wavelet Transform and the coefficients of the Wavelet Series are known

More information

Stochastic Processes. A stochastic process is a function of two variables:

Stochastic Processes. A stochastic process is a function of two variables: Stochastic Processes Stochastic: from Greek stochastikos, proceeding by guesswork, literally, skillful in aiming. A stochastic process is simply a collection of random variables labelled by some parameter:

More information

Lecture 3 Kernel properties and design in Cohen s class time-frequency distributions

Lecture 3 Kernel properties and design in Cohen s class time-frequency distributions Lecture 3 Kernel properties and design in Cohen s class time-frequency distributions Time-frequency analysis, adaptive filtering and source separation José Biurrun Manresa 22.02.2011 Time-Frequency representations

More information

Partial Eigenvalue Assignment in Linear Systems: Existence, Uniqueness and Numerical Solution

Partial Eigenvalue Assignment in Linear Systems: Existence, Uniqueness and Numerical Solution Partial Eigenvalue Assignment in Linear Systems: Existence, Uniqueness and Numerical Solution Biswa N. Datta, IEEE Fellow Department of Mathematics Northern Illinois University DeKalb, IL, 60115 USA e-mail:

More information

Statistical signal processing

Statistical signal processing Statistical signal processing Short overview of the fundamentals Outline Random variables Random processes Stationarity Ergodicity Spectral analysis Random variable and processes Intuition: A random variable

More information

L29: Fourier analysis

L29: Fourier analysis L29: Fourier analysis Introduction The discrete Fourier Transform (DFT) The DFT matrix The Fast Fourier Transform (FFT) The Short-time Fourier Transform (STFT) Fourier Descriptors CSCE 666 Pattern Analysis

More information

Nontechnical introduction to wavelets Continuous wavelet transforms Fourier versus wavelets - examples

Nontechnical introduction to wavelets Continuous wavelet transforms Fourier versus wavelets - examples Nontechnical introduction to wavelets Continuous wavelet transforms Fourier versus wavelets - examples A major part of economic time series analysis is done in the time or frequency domain separately.

More information

Image Processing by the Curvelet Transform

Image Processing by the Curvelet Transform Image Processing by the Curvelet Transform Jean Luc Starck Dapnia/SEDI SAP, CEA Saclay, France. jstarck@cea.fr http://jstarck.free.fr Collaborators: D.L. Donoho, Department of Statistics, Stanford E. Candès,

More information

Performance Bounds for Polynomial Phase Parameter Estimation with Nonuniform and Random Sampling Schemes

Performance Bounds for Polynomial Phase Parameter Estimation with Nonuniform and Random Sampling Schemes IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 48, NO. 2, FEBRUARY 2000 331 Performance Bounds for Polynomial Phase Parameter Estimation with Nonuniform Rom Sampling Schemes Jonathan A. Legg, Member, IEEE,

More information

Econometría 2: Análisis de series de Tiempo

Econometría 2: Análisis de series de Tiempo Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 IX. Vector Time Series Models VARMA Models A. 1. Motivation: The vector

More information

Strengthened Sobolev inequalities for a random subspace of functions

Strengthened Sobolev inequalities for a random subspace of functions Strengthened Sobolev inequalities for a random subspace of functions Rachel Ward University of Texas at Austin April 2013 2 Discrete Sobolev inequalities Proposition (Sobolev inequality for discrete images)

More information

8. Diagonalization.

8. Diagonalization. 8. Diagonalization 8.1. Matrix Representations of Linear Transformations Matrix of A Linear Operator with Respect to A Basis We know that every linear transformation T: R n R m has an associated standard

More information

DS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.

DS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra. DS-GA 1002 Lecture notes 0 Fall 2016 Linear Algebra These notes provide a review of basic concepts in linear algebra. 1 Vector spaces You are no doubt familiar with vectors in R 2 or R 3, i.e. [ ] 1.1

More information

Lecture Notes 5: Multiresolution Analysis

Lecture Notes 5: Multiresolution Analysis Optimization-based data analysis Fall 2017 Lecture Notes 5: Multiresolution Analysis 1 Frames A frame is a generalization of an orthonormal basis. The inner products between the vectors in a frame and

More information

Two-Dimensional Orthogonal Filter Banks with Directional Vanishing Moments

Two-Dimensional Orthogonal Filter Banks with Directional Vanishing Moments Two-imensional Orthogonal Filter Banks with irectional Vanishing Moments Jianping Zhou and Minh N. o epartment of Electrical and Computer Engineering University of Illinois at Urbana-Champaign, Urbana,

More information

Keywords: Kinematics; Principal planes; Special orthogonal matrices; Trajectory optimization

Keywords: Kinematics; Principal planes; Special orthogonal matrices; Trajectory optimization Editorial Manager(tm) for Nonlinear Dynamics Manuscript Draft Manuscript Number: Title: Minimum Distance and Optimal Transformations on SO(N) Article Type: Original research Section/Category: Keywords:

More information

A NOVEL METHOD TO DERIVE EXPLICIT KLT KERNEL FOR AR(1) PROCESS. Mustafa U. Torun and Ali N. Akansu

A NOVEL METHOD TO DERIVE EXPLICIT KLT KERNEL FOR AR(1) PROCESS. Mustafa U. Torun and Ali N. Akansu A NOVEL METHOD TO DERIVE EXPLICIT KLT KERNEL FOR AR() PROCESS Mustafa U. Torun and Ali N. Akansu Department of Electrical and Computer Engineering New Jersey Institute of Technology University Heights,

More information

Course Summary Math 211

Course Summary Math 211 Course Summary Math 211 table of contents I. Functions of several variables. II. R n. III. Derivatives. IV. Taylor s Theorem. V. Differential Geometry. VI. Applications. 1. Best affine approximations.

More information

Applied Time. Series Analysis. Wayne A. Woodward. Henry L. Gray. Alan C. Elliott. Dallas, Texas, USA

Applied Time. Series Analysis. Wayne A. Woodward. Henry L. Gray. Alan C. Elliott. Dallas, Texas, USA Applied Time Series Analysis Wayne A. Woodward Southern Methodist University Dallas, Texas, USA Henry L. Gray Southern Methodist University Dallas, Texas, USA Alan C. Elliott University of Texas Southwestern

More information

Digital Image Processing

Digital Image Processing Digital Image Processing Wavelets and Multiresolution Processing (Wavelet Transforms) Christophoros Nikou cnikou@cs.uoi.gr University of Ioannina - Department of Computer Science 2 Contents Image pyramids

More information

Multiresolution Models of Time Series

Multiresolution Models of Time Series Multiresolution Models of Time Series Andrea Tamoni (Bocconi University ) 2011 Tamoni Multiresolution Models of Time Series 1/ 16 General Framework Time-scale decomposition General Framework Begin with

More information

Visualization of Traveling Vortices in the Boundary Layer on a Rotating Disk under Orbital Motion

Visualization of Traveling Vortices in the Boundary Layer on a Rotating Disk under Orbital Motion Open Journal of Fluid Dynamics, 2015, 5, 17-25 Published Online March 2015 in SciRes. http://www.scirp.org/journal/ojfd http://dx.doi.org/10.4236/ojfd.2015.51003 Visualization of Traveling Vortices in

More information

Biomedical Signal Processing and Signal Modeling

Biomedical Signal Processing and Signal Modeling Biomedical Signal Processing and Signal Modeling Eugene N. Bruce University of Kentucky A Wiley-lnterscience Publication JOHN WILEY & SONS, INC. New York Chichester Weinheim Brisbane Singapore Toronto

More information

SAMPLE CHAPTERS UNESCO EOLSS STATIONARY PROCESSES. E ξ t (1) K.Grill Institut für Statistik und Wahrscheinlichkeitstheorie, TU Wien, Austria

SAMPLE CHAPTERS UNESCO EOLSS STATIONARY PROCESSES. E ξ t (1) K.Grill Institut für Statistik und Wahrscheinlichkeitstheorie, TU Wien, Austria STATIONARY PROCESSES K.Grill Institut für Statistik und Wahrscheinlichkeitstheorie, TU Wien, Austria Keywords: Stationary process, weak sense stationary process, strict sense stationary process, correlation

More information

Dynamic Time Series Regression: A Panacea for Spurious Correlations

Dynamic Time Series Regression: A Panacea for Spurious Correlations International Journal of Scientific and Research Publications, Volume 6, Issue 10, October 2016 337 Dynamic Time Series Regression: A Panacea for Spurious Correlations Emmanuel Alphonsus Akpan *, Imoh

More information

Wavelet-Based Numerical Homogenization for Scaled Solutions of Linear Matrix Equations

Wavelet-Based Numerical Homogenization for Scaled Solutions of Linear Matrix Equations International Journal of Discrete Mathematics 2017; 2(1: 10-16 http://www.sciencepublishinggroup.com/j/dmath doi: 10.11648/j.dmath.20170201.13 Wavelet-Based Numerical Homogenization for Scaled Solutions

More information

Rigid Geometric Transformations

Rigid Geometric Transformations Rigid Geometric Transformations Carlo Tomasi This note is a quick refresher of the geometry of rigid transformations in three-dimensional space, expressed in Cartesian coordinates. 1 Cartesian Coordinates

More information

EXTENDING THE SCOPE OF WAVELET REGRESSION METHODS BY COEFFICIENT-DEPENDENT THRESHOLDING

EXTENDING THE SCOPE OF WAVELET REGRESSION METHODS BY COEFFICIENT-DEPENDENT THRESHOLDING EXTENDING THE SCOPE OF WAVELET REGRESSION METHODS BY COEFFICIENT-DEPENDENT THRESHOLDING ARNE KOVAC, BERNARD W. SILVERMAN ABSTRACT. Various aspects of the wavelet approach to nonparametric regression are

More information

Compressed Sensing Using Reed- Solomon and Q-Ary LDPC Codes

Compressed Sensing Using Reed- Solomon and Q-Ary LDPC Codes Compressed Sensing Using Reed- Solomon and Q-Ary LDPC Codes Item Type text; Proceedings Authors Jagiello, Kristin M. Publisher International Foundation for Telemetering Journal International Telemetering

More information

Linear Algebra March 16, 2019

Linear Algebra March 16, 2019 Linear Algebra March 16, 2019 2 Contents 0.1 Notation................................ 4 1 Systems of linear equations, and matrices 5 1.1 Systems of linear equations..................... 5 1.2 Augmented

More information

Unitary Dynamics and Quantum Circuits

Unitary Dynamics and Quantum Circuits qitd323 Unitary Dynamics and Quantum Circuits Robert B. Griffiths Version of 20 January 2014 Contents 1 Unitary Dynamics 1 1.1 Time development operator T.................................... 1 1.2 Particular

More information

An Evolutionary Programming Based Algorithm for HMM training

An Evolutionary Programming Based Algorithm for HMM training An Evolutionary Programming Based Algorithm for HMM training Ewa Figielska,Wlodzimierz Kasprzak Institute of Control and Computation Engineering, Warsaw University of Technology ul. Nowowiejska 15/19,

More information

THIS work addresses a class of inverse problems that are

THIS work addresses a class of inverse problems that are 494 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 50, NO. 3, MARCH 2004 Stochastic Deconvolution Over Groups Birsen Yazici, Member, IEEE Abstract In this paper, we address a class of inverse problems that

More information

A note on multivariate Gauss-Hermite quadrature

A note on multivariate Gauss-Hermite quadrature A note on multivariate Gauss-Hermite quadrature Peter Jäckel 1th May 5 1 Introduction Gaussian quadratures are an ingenious way to approximate the integral of an unknown function f(x) over a specified

More information

3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE

3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE 3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE 3.0 INTRODUCTION The purpose of this chapter is to introduce estimators shortly. More elaborated courses on System Identification, which are given

More information

Edge preserved denoising and singularity extraction from angles gathers

Edge preserved denoising and singularity extraction from angles gathers Edge preserved denoising and singularity extraction from angles gathers Felix Herrmann, EOS-UBC Martijn de Hoop, CSM Joint work Geophysical inversion theory using fractional spline wavelets: ffl Jonathan

More information

Study of nonlinear phenomena in a tokamak plasma using a novel Hilbert transform technique

Study of nonlinear phenomena in a tokamak plasma using a novel Hilbert transform technique Study of nonlinear phenomena in a tokamak plasma using a novel Hilbert transform technique Daniel Raju, R. Jha and A. Sen Institute for Plasma Research, Bhat, Gandhinagar-382428, INDIA Abstract. A new

More information

A Cross-Associative Neural Network for SVD of Nonsquared Data Matrix in Signal Processing

A Cross-Associative Neural Network for SVD of Nonsquared Data Matrix in Signal Processing IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 12, NO. 5, SEPTEMBER 2001 1215 A Cross-Associative Neural Network for SVD of Nonsquared Data Matrix in Signal Processing Da-Zheng Feng, Zheng Bao, Xian-Da Zhang

More information

A Proposed Warped Choi Williams Time Frequency Distribution Applied to Doppler Blood Flow Measurement

A Proposed Warped Choi Williams Time Frequency Distribution Applied to Doppler Blood Flow Measurement 9 Int'l Conf. Bioinformatics and Computational Biology BIOCOMP'6 A Proposed Warped Choi Williams Time Frequency Distribution Applied to Doppler Blood Flow Measurement F. García-Nocetti, J. Solano, F. and

More information

A Subspace Approach to Estimation of. Measurements 1. Carlos E. Davila. Electrical Engineering Department, Southern Methodist University

A Subspace Approach to Estimation of. Measurements 1. Carlos E. Davila. Electrical Engineering Department, Southern Methodist University EDICS category SP 1 A Subspace Approach to Estimation of Autoregressive Parameters From Noisy Measurements 1 Carlos E Davila Electrical Engineering Department, Southern Methodist University Dallas, Texas

More information

Lecture - 30 Stationary Processes

Lecture - 30 Stationary Processes Probability and Random Variables Prof. M. Chakraborty Department of Electronics and Electrical Communication Engineering Indian Institute of Technology, Kharagpur Lecture - 30 Stationary Processes So,

More information

Empirical Mode Decomposition of Financial Data

Empirical Mode Decomposition of Financial Data International Mathematical Forum, 3, 28, no. 25, 1191-122 Empirical Mode Decomposition of Financial Data Konstantinos Drakakis 1 UCD CASL 2 University College Dublin Abstract We propose a novel method

More information

Stochastic Optimization with Inequality Constraints Using Simultaneous Perturbations and Penalty Functions

Stochastic Optimization with Inequality Constraints Using Simultaneous Perturbations and Penalty Functions International Journal of Control Vol. 00, No. 00, January 2007, 1 10 Stochastic Optimization with Inequality Constraints Using Simultaneous Perturbations and Penalty Functions I-JENG WANG and JAMES C.

More information

PRINCIPAL COMPONENTS ANALYSIS

PRINCIPAL COMPONENTS ANALYSIS 121 CHAPTER 11 PRINCIPAL COMPONENTS ANALYSIS We now have the tools necessary to discuss one of the most important concepts in mathematical statistics: Principal Components Analysis (PCA). PCA involves

More information

Modeling nonlinear systems using multiple piecewise linear equations

Modeling nonlinear systems using multiple piecewise linear equations Nonlinear Analysis: Modelling and Control, 2010, Vol. 15, No. 4, 451 458 Modeling nonlinear systems using multiple piecewise linear equations G.K. Lowe, M.A. Zohdy Department of Electrical and Computer

More information

Gaussian Process for Internal Model Control

Gaussian Process for Internal Model Control Gaussian Process for Internal Model Control Gregor Gregorčič and Gordon Lightbody Department of Electrical Engineering University College Cork IRELAND E mail: gregorg@rennesuccie Abstract To improve transparency

More information

arxiv: v1 [cs.oh] 3 Oct 2014

arxiv: v1 [cs.oh] 3 Oct 2014 M. Prisheltsev (Voronezh) mikhail.prisheltsev@gmail.com ADAPTIVE TWO-DIMENSIONAL WAVELET TRANSFORMATION BASED ON THE HAAR SYSTEM 1 Introduction arxiv:1410.0705v1 [cs.oh] Oct 2014 The purpose is to study

More information

e 2 e 1 (a) (b) (d) (c)

e 2 e 1 (a) (b) (d) (c) 2.13 Rotated principal component analysis [Book, Sect. 2.2] Fig.: PCA applied to a dataset composed of (a) 1 cluster, (b) 2 clusters, (c) and (d) 4 clusters. In (c), an orthonormal rotation and (d) an

More information

Summary of Fourier Transform Properties

Summary of Fourier Transform Properties Summary of Fourier ransform Properties Frank R. Kschischang he Edward S. Rogers Sr. Department of Electrical and Computer Engineering University of oronto January 7, 207 Definition and Some echnicalities

More information

Wigner function for nonparaxial wave fields

Wigner function for nonparaxial wave fields 486 J. Opt. Soc. Am. A/ Vol. 18, No. 10/ October 001 C. J. R. Sheppard and K. G. Larin Wigner function for nonparaxial wave fields Colin J. R. Sheppard* and Kieran G. Larin Department of Physical Optics,

More information

Wavelet Methods for Time Series Analysis

Wavelet Methods for Time Series Analysis Wavelet Methods for Time Series Analysis Donald B. Percival UNIVERSITY OF WASHINGTON, SEATTLE Andrew T. Walden IMPERIAL COLLEGE OF SCIENCE, TECHNOLOGY AND MEDICINE, LONDON CAMBRIDGE UNIVERSITY PRESS Contents

More information

Two-Dimensional Sparse Arrays with Hole-Free Coarray and Reduced Mutual Coupling

Two-Dimensional Sparse Arrays with Hole-Free Coarray and Reduced Mutual Coupling Two-Dimensional Sparse Arrays with Hole-Free Coarray and Reduced Mutual Coupling Chun-Lin Liu and P. P. Vaidyanathan Dept. of Electrical Engineering, 136-93 California Institute of Technology, Pasadena,

More information

Comments on \Wavelets in Statistics: A Review" by. A. Antoniadis. Jianqing Fan. University of North Carolina, Chapel Hill

Comments on \Wavelets in Statistics: A Review by. A. Antoniadis. Jianqing Fan. University of North Carolina, Chapel Hill Comments on \Wavelets in Statistics: A Review" by A. Antoniadis Jianqing Fan University of North Carolina, Chapel Hill and University of California, Los Angeles I would like to congratulate Professor Antoniadis

More information

A Lower Bound Theorem. Lin Hu.

A Lower Bound Theorem. Lin Hu. American J. of Mathematics and Sciences Vol. 3, No -1,(January 014) Copyright Mind Reader Publications ISSN No: 50-310 A Lower Bound Theorem Department of Applied Mathematics, Beijing University of Technology,

More information

The Application of Legendre Multiwavelet Functions in Image Compression

The Application of Legendre Multiwavelet Functions in Image Compression Journal of Modern Applied Statistical Methods Volume 5 Issue 2 Article 3 --206 The Application of Legendre Multiwavelet Functions in Image Compression Elham Hashemizadeh Department of Mathematics, Karaj

More information

Lecture 10. Lecturer: Aleksander Mądry Scribes: Mani Bastani Parizi and Christos Kalaitzis

Lecture 10. Lecturer: Aleksander Mądry Scribes: Mani Bastani Parizi and Christos Kalaitzis CS-621 Theory Gems October 18, 2012 Lecture 10 Lecturer: Aleksander Mądry Scribes: Mani Bastani Parizi and Christos Kalaitzis 1 Introduction In this lecture, we will see how one can use random walks to

More information

Unsupervised Learning Methods

Unsupervised Learning Methods Structural Health Monitoring Using Statistical Pattern Recognition Unsupervised Learning Methods Keith Worden and Graeme Manson Presented by Keith Worden The Structural Health Monitoring Process 1. Operational

More information

Multiscale Geometric Analysis: Thoughts and Applications (a summary)

Multiscale Geometric Analysis: Thoughts and Applications (a summary) Multiscale Geometric Analysis: Thoughts and Applications (a summary) Anestis Antoniadis, University Joseph Fourier Assimage 2005,Chamrousse, February 2005 Classical Multiscale Analysis Wavelets: Enormous

More information

ECE 636: Systems identification

ECE 636: Systems identification ECE 636: Systems identification Lectures 3 4 Random variables/signals (continued) Random/stochastic vectors Random signals and linear systems Random signals in the frequency domain υ ε x S z + y Experimental

More information

TWO-STAGE ISOLATION FOR HARMONIC BASE EXCITATION Revision A. By Tom Irvine February 25, 2008

TWO-STAGE ISOLATION FOR HARMONIC BASE EXCITATION Revision A. By Tom Irvine   February 25, 2008 TWO-STAGE ISOLATION FOR HARMONIC BASE EXCITATION Revision A By Tom Irvine Email: tomirvine@aol.com February 5, 008 Introduction Consider a base plate mass m and an avionics mass m modeled as two-degree-of-freedom.

More information

Math 118, Fall 2014 Final Exam

Math 118, Fall 2014 Final Exam Math 8, Fall 4 Final Exam True or false Please circle your choice; no explanation is necessary True There is a linear transformation T such that T e ) = e and T e ) = e Solution Since T is linear, if T

More information

Gaussian Quiz. Preamble to The Humble Gaussian Distribution. David MacKay 1

Gaussian Quiz. Preamble to The Humble Gaussian Distribution. David MacKay 1 Preamble to The Humble Gaussian Distribution. David MacKay Gaussian Quiz H y y y 3. Assuming that the variables y, y, y 3 in this belief network have a joint Gaussian distribution, which of the following

More information

CONTROL SYSTEMS, ROBOTICS, AND AUTOMATION - Vol. V - Prediction Error Methods - Torsten Söderström

CONTROL SYSTEMS, ROBOTICS, AND AUTOMATION - Vol. V - Prediction Error Methods - Torsten Söderström PREDICTIO ERROR METHODS Torsten Söderström Department of Systems and Control, Information Technology, Uppsala University, Uppsala, Sweden Keywords: prediction error method, optimal prediction, identifiability,

More information

Feature selection and classifier performance in computer-aided diagnosis: The effect of finite sample size

Feature selection and classifier performance in computer-aided diagnosis: The effect of finite sample size Feature selection and classifier performance in computer-aided diagnosis: The effect of finite sample size Berkman Sahiner, a) Heang-Ping Chan, Nicholas Petrick, Robert F. Wagner, b) and Lubomir Hadjiiski

More information

ESS Finite Impulse Response Filters and the Z-transform

ESS Finite Impulse Response Filters and the Z-transform 9. Finite Impulse Response Filters and the Z-transform We are going to have two lectures on filters you can find much more material in Bob Crosson s notes. In the first lecture we will focus on some of

More information

Groundwater permeability

Groundwater permeability Groundwater permeability Easy to solve the forward problem: flow of groundwater given permeability of aquifer Inverse problem: determine permeability from flow (usually of tracers With some models enough

More information

covariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of

covariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of Index* The Statistical Analysis of Time Series by T. W. Anderson Copyright 1971 John Wiley & Sons, Inc. Aliasing, 387-388 Autoregressive {continued) Amplitude, 4, 94 case of first-order, 174 Associated

More information