A Radon Transform Based Method to Determine the Numerical Spread as a Measure of Non-Stationarity
|
|
- Ursula Patrick
- 5 years ago
- Views:
Transcription
1 A Radon Transform Based Method to Determine the Numerical Spread as a Measure of Non-Stationarity ROBERT A. HEDGES and BRUCE W. SUTER Air Force Research Laboratory IFGC 525 Brooks Rd. Rome, NY U.S.A. Abstract: Establishing measures for local stationarity is an open problem in the field of time-frequency analysis. One promising theoretical measure, known as the spread, provides a means for quantizing potential correlation between signal elements. In this paper we undertake the issue of generalizing techniques developed by the Authors to better estimate the spread of a signal. Existing techniques estimate the spread as the rectangular region of support of the associated expected ambiguity function oriented parallel to the axes. By applying Radon Transform techniques we can produce a parameterized model which describes the orientation of the region of support providing tighter estimates of the signal spread. Examples are provided that illustrate the enhancement of the new method. Keywords: Non-Stationarity, Radon Transform 1 Introduction In a recent publication, Donoho, Mallat, and von Sachs [1] pose an open problem of devising a measure of local stationarity by measuring the departure from pure stationarity. They provide a list of ideal properties for a measure of local stationarity as follows: Quantitative The measure of local stationarity should reduce to a nonnegative dimensionless constant, where zero means no departure from stationarity and large values mean large departures from stationarity. Measurable The measure should be directly computable from the covariance, and should not involve complex implicit functionals of the covariance, such as the eigenfunctions of the best onestep-ahead predictor. Robust The measure should work well for processes which are not homogeneously stationary, i.e., which on a small subset of their domain are changing rapidly. Analytically Powerful The measure should have direct implications for many derived quantities about which one would like to have information. They then note that the notion of spread, as introduced by W. Kozek [2, 3] comes close to satisfying these requirements ::: we think spread is a major conceptual advance, which points the way towards important future developments. However, they go on to point out, the spread is not robust. [1] In [4] the investigation the issues of implementation arising from finite, discrete, data was addressed through direct implementation of existing theory. This work will demonstrate shortcomings in this theory and address them using Radon transform techniques. 2 Theoretical Spread To establish a context for our work we first summarize the theoretical framework for spread of a random process x(t) defined for continuous t [2,3,5]. The (generalized) Ambiguity Function (AF) [5]ofa deterministic signal x(t) is given by A () x = (;) x(t +( 1 2,))x (t,( 1 2 +))e,{2t dt:
2 The expected (generalized) ambiguity function EAF EA () x (t; ) of a nonstationary random process x(t) is the expectation of the AF EA () (;) x = E = x(t +( 1 2,))x (t,( 1 2 +))e,{2t dt R x (t +( 1 2,);t, (1 2 + ))e,{2t dt: Let R () x (t; ) R x (t +( 2 1,);t, (1 2 +)),then EA () x (;) = R () x (t; )e,{2t dt: (1) If the EAF is zero about a given TF lag point (12;12), then any two TF points (t1;f1)and (t2;f2) with t1, t2 = 12 and f1, f2 = 12 are uncorrelated. The EAF indicates the potential correlation between Time-Frequency points separated by the time lag and the frequency lag [3]. Let [, ; ][, ; ]be the smallest rectangle (centered at the origin of the (;) plane) which contains the effective support of the EAF, i.e., jea () x (;)j for jj > or jj >. Define the spread of x as the area of this rectangle: =4 : (2) From these definitions we can view the spread as a product of temporal correlation,, and spectral correlation. In [2] the classification of a signal as underspread if 1 and overspread otherwise. 3 Numerical Spread In [4] we addressed the issues of implementing the above measures of discrete signals. To define numerical spread we can simply rewrite equation (1) in terms of discrete variables. NEA () x [ m; k ]= and N,1 X tn= r () x [t n; m ]e,{2tn k=n r () x [t n; m ]=r x [t n +(, 1 2 ) m;t n,(+ 1 2 ) m] (3) In order to implement such a scheme on discrete data we first must determine a value for. Itwasshownthat the EAFs obtained for different choices of are equal up to a phase factor [3], EA ( 1) x (;) =e {2( 1, 2 ) EA ( 1) x (;) jea ( 1) x (;)j = jea ( 1) x (;)j: Thus, with respect to the calculation of spread for continuous variables, the factor is arbitrary. For our work, we chose = 1=2 since it fits the above criterion and has the added benefit that the EAF becomes the Fast Fourier transform along the diagonals of the correlation matrix. We can now define the Numerical Expected Ambiguity Function, NEAF, as N,1 X NEA x [ m ; k ]= r (1=2) x [t n ; m ]e,{2tn k=n tn= N,1 X = ~r x [t n ;t n, m ]e,{2tn k=n tn= (4) where the ~r x is the extended autocorrelation as defined in [4]. In order to facilitate the calculation of the region of support we project the signal onto the and axes and determine the support of these projections. Define = j^j : = j^j : E(;)d E(;)d <;for > ^ <;for >^ ; (5) : (6) where delta is a pre-determined threshold. Thenumerical spread is defined as the effective support of the NEAF =4 : 4 Radon Transform Approach One shortcoming of the previous approaches is that of orientation. The spread (theoretical or numerical) is calculated from and as estimates of support in the direction and direction. Thus the rectangle of support is always oriented parallel to the axis, this may lead to over-approximation of the spread and ignores any information concerning correlation between and. Matzet al. refine the definition of underspread to strictly underspread if the minimal rectangle of support is oriented parallel to the and axis [5]. However, there is no mention as to how to determine this
3 contour plot of E(,) contour plot of E(,) contour plot of E(,) Projection of E(,) onto Axis Projection of E(,) onto Axis 8 Projection of E(,) onto Axis 8 Projection of E(,) onto Axis Figure 1: Three Expected Ambiguity Functions, from left to right, corresponding to r = ;r =,:6 and r = :99 with 1 = 2;2 = 3 in equation (7). Each function has identical and projections, thus existing methods would calculate the spread to be equal for all three cases, which is obviously incorrect. orientation. In Figure 1 we see three examples of expected ambiguity functions of the form inspired by an example in [6]: p 1 E(;) = 212(1, r 2 ) 1 2 exp, 2(1, r 2 ) 2 1, 2r : (7) The values of spread components and from equation (5) and (6) are independent of the parameter r, thus the resulting spread is the same for each example. This result is unsatisfactory since upon examination we can see that the area of support is not a constant. What we are observing is that the orientation of the rectangle we use to estimate the support is important. We can extend the idea of projection onto any arbitrary axis and estimate the support from this projection using the Radon transform. Definition 4..1 Assume E(;) satisfies the following properties: 1. E(;) is defined on R 2 2. E(;) is absolutely convergent i.e., je(;)jdd < 1; then the Radon Transform [7] of E, is defined as E(; ) = ; E(;)( cos + sin, )dd: (8) Observe that the delta function is one dimensional and thus the integral over the plane reduces to an integral along the line given by = cos + sin. Note that E(; ) is not defined on a (circular) polar coordinate system. This is best demonstrated by the fact that E(;) is not constant and thus 1 6= 2 may imply that E(;1) 6= E(;2) making the origin in circular polar coordinates multiply defined. The appropriate space for E(; ) is the surface of the unit cylinder R S 1. The cylinder need only be a half cylinder since E(; ) = E(,; + ): For purposes of illustration, the cylinder will be opened up with on one axis and on the other. We can utilize the Radon transform of the ambiguity function to determine the coordinates of the maximum intensity in Radon space (;). This point in turn corresponds to the line of maximum intensity in ambiguity space ( = cos + sin ). Utilizing this correspondence between ambiguity space and Radon space, we will assume the features in ambiguity space are concentrated about this line. We then align one of
4 (; ) Ambiguity Space Radon Space Figure 2: Correspondence between the line o = x cos + y sin in ambiguity space and the point (;)in Radon space. Figure 3: Orientation of spread components. the axis with this line and denote as. The other axis, denoted, is orthogonal to with their intersection a distance from the origin as shown in Figure 2. We can now define spread with respect to our new axis. Let [, ; ][, ; ]be the smallest rectangle (centered at the origin of the ( ; ) plane) which contains the effective support of the EAF, i.e., jea () x ( ; )j for j j > or j j > : Define the spread of x as the area of this rectangle: =4 : (9) We can now write a general equation for spread with respect to the angles of orientation o and? o. Thus we calculate and as follows: = j^j : E(; ) n = j^j : E(; o? ) <;for >^ <;for > ^ : (1) : (11) This is consistent with equations (5) and (6) with = and? = =2. See Figure 3 for an illustration comparing the two regions of support. 5 Application of New Techniques to Examples. In Figure 4 we have applied the Radon transform technique to the same data sets in Figure 1. By properly orienting our support region we may differentiate between cases. The first case (row one) was oriented so that = and thus the projections remain unchanged. In example two (row two) we see that be reorienting the axis along the angles = 1:8 radians and? = 1:8 + =2 radians, the new projections, and thus the signal spread had changed. Example three (row three) demonstrates a dramatic change in the spread by reorienting the axes by = 2:1642 radians and? = 2: =2 radians and calculating and. 6 Summary and Conclusions We have introduced the use of Radon Transform techniques to the calculation of signal spread. Through these techniques we are able to produce a two parameter model of the and orientation of the support of an expected ambiguity function. The use of the Radon Transform as a tool to investigate signal spread shows great promise beyond its use here. An immediate extension would be to construct a four parameter model to describe orientation and location of the support. Another area of intrest is the issue of robustness, which known to be a problem [1], we believe that the Radon transform in conjunction with multiresolution techniques can be used to determine regions of local stationarity and increase robustness. The combination of Radon and multiresolution techniques is similar to Candès and Donoho s work on ridgelets [8]. Further research utilizing these techniques to aid in the calculation of signal representation on local regions of support will provide both an enhanced framework for our future work in the area of adaptive signal representations, including the adaptation of novel multirate and wavelet signal processing techniques [9, 1].
5 1 contour plot of E(,) Contour plot of Radon Transform of E(,) 1 φ=φ φ=φ 8 Projections onto and axes φ= φ=pi/ φ contour plot of E(,) Contour plot of Radon Transform of E(,) 15 1 φ=φ φ=φ Projections onto and axes φ= φ=pi/ φ contour plot of E(,) Contour plot of Radon Transform of E(,) 1 φ=φ φ=φ 8 Projections onto and axes φ= φ=pi/ φ 2 2 Figure 4: The three expected ambiguity functions from Figure 1 are plotted in the first column along with the contour plots of there Radon transforms in the second column. On the Radon transform plots the lines corresponding to the traditional projections = and = =2 are presented along side the lines corresponding to the calculated projections along and, corresponding to = and?, respectively. In the final column the and projections are shown. These projection clearly demonstrate the variation in spread between the three ambiguity functions which was not detected using existing methods.
6 References [1] D.L. Donoho, S. Mallat, and R. von Sachs, Estimating covariances of locally stationary processes: Rates of convergences of best basis methods, Tech. Rep., Stanford University, February [2] W. Kozek, On the underspread/overspread classification of random processes, eitschrift Für angewandte Mathematik und Mechanik, vol. 76, no. 3, [3] W. Kozek, F. Hlawatsch, H. Kirchauer, and U. Trautwein, Correlative time-frequency analysis and classification of nonstationary random processes, in Proceedings of the IEEE-SP International Symposium on Time-Frequency and Time-Scale Analysis, 1994, pp [4] R. A. Hedges and B. W. Suter, The introduction of numerical spread as a measure of nonstationarity, in 32nd Symposium on the Interface of Computing Science and Statistics, 2, vol. 33. [5] G. Matz, F. Hlawatsch, and W. Kozek, Generalized evolutionary spectral analysis and the weyl spectrum of nonstationary random processes, IEEE Transactions on Signal Processing, vol. 45, no. 6, pp , June [6] L. Cohen, Time-Frequency Analysis, Prentice Hall Signal Processing Series. Prentice Hall PTR, [7] S.R.Deans, The Radon Transform and Some of Its Applications, John Wiley & Sons, [8] E. J. Candès and D. L. Donoho, Ridgelets: A key to higher-dimensional intermittency?, in Wavelets: the Key to Intermittent Information, London, February 1999, The Royal Society of London. [9] B. W. Suter, Multirate and Wavelet Signal Processing, vol. 8 of Wavelets and its Applications, Academic Press, [1] R. A. Hedges, Hybrid Wavelet Packet Analysis: Theory and Implementations, Ph.D. thesis, Arizona State University, 1999.
IEEE Trans. Information Theory, vol. 52, no. 3, Mar. 2006, pp , Copyright IEEE 2006
IEEE Trans. Information Theory, vol. 52, no. 3, Mar. 2006, pp. 1067 1086, Copyright IEEE 2006 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 52, NO. 3, MARCH 2006 1067 Nonstationary Spectral Analysis Based
More informationTHIS paper treats estimation of the Wigner-Ville spectrum
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 55, NO. 1, JANUARY 2007 73 Kernels Multiple Windows for Estimation of the Wigner-Ville Spectrum of Gaussian Locally Stationary Processes Patrik Wahlberg Maria
More informationTIME-FREQUENCY ANALYSIS: TUTORIAL. Werner Kozek & Götz Pfander
TIME-FREQUENCY ANALYSIS: TUTORIAL Werner Kozek & Götz Pfander Overview TF-Analysis: Spectral Visualization of nonstationary signals (speech, audio,...) Spectrogram (time-varying spectrum estimation) TF-methods
More information1 Introduction Spectral analysis of (wide-sense) stationary random processes by means of the power spectral density (PSD) is a useful concept. owever,
IEEE Trans. Signal Proc., vol. 45, no. 6, pp. 150{1534, June 1997. Generalized Evolutionary Spectral Analysis and the Weyl Spectrum of Nonstationary andom Processes SP-865, nal version Gerald Matz y, Franz
More informationIV. Covariance Analysis
IV. Covariance Analysis Autocovariance Remember that when a stochastic process has time values that are interdependent, then we can characterize that interdependency by computing the autocovariance function.
More informationRigid Geometric Transformations
Rigid Geometric Transformations Carlo Tomasi This note is a quick refresher of the geometry of rigid transformations in three-dimensional space, expressed in Cartesian coordinates. 1 Cartesian Coordinates
More informationStochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno
Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function.
More informationScattered Data Interpolation with Wavelet Trees
Scattered Data Interpolation with Wavelet Trees Christophe P. Bernard, Stéphane G. Mallat and Jean-Jacques Slotine Abstract. This paper describes a new result on a wavelet scheme for scattered data interpolation
More informationarxiv:gr-qc/ v1 24 Dec 2004
LIGO-P15133 Multiresolution techniques for the detection of gravitational-wave bursts arxiv:gr-qc/412119v1 24 Dec 24 S Chatterji, L Blackburn, G Martin and E Katsavounidis MIT LIGO Laboratory, NW17-161,
More informationLecture 1: Brief Review on Stochastic Processes
Lecture 1: Brief Review on Stochastic Processes A stochastic process is a collection of random variables {X t (s) : t T, s S}, where T is some index set and S is the common sample space of the random variables.
More informationCOMPLEX SIGNALS are used in various areas of signal
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 45, NO. 2, FEBRUARY 1997 411 Second-Order Statistics of Complex Signals Bernard Picinbono, Fellow, IEEE, and Pascal Bondon, Member, IEEE Abstract The second-order
More informationStatistics 992 Continuous-time Markov Chains Spring 2004
Summary Continuous-time finite-state-space Markov chains are stochastic processes that are widely used to model the process of nucleotide substitution. This chapter aims to present much of the mathematics
More informationNon-Gaussian Maximum Entropy Processes
Non-Gaussian Maximum Entropy Processes Georgi N. Boshnakov & Bisher Iqelan First version: 3 April 2007 Research Report No. 3, 2007, Probability and Statistics Group School of Mathematics, The University
More informationA Multi-window Fractional Evolutionary Spectral Analysis
A Multi-window Fractional Evolutionary Spectral Analysis YALÇIN ÇEKİÇ, AYDIN AKAN, and MAHMUT ÖZTÜRK University of Bahcesehir, Department of Electrical and Electronics Engineering Bahcesehir, 49, Istanbul,
More informationOn the Space-Varying Filtering
On the Space-Varying Filtering LJubiša Stanković, Srdjan Stanković, Igor Djurović 2 Abstract Filtering of two-dimensional noisy signals is considered in the paper. Concept of nonstationary space-varying
More informationStatistics 910, #5 1. Regression Methods
Statistics 910, #5 1 Overview Regression Methods 1. Idea: effects of dependence 2. Examples of estimation (in R) 3. Review of regression 4. Comparisons and relative efficiencies Idea Decomposition Well-known
More informationELEMENTS OF PROBABILITY THEORY
ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable
More informationAHAMADA IBRAHIM GREQAM, universit?de la méditerranée and CERESUR, universit?de La Réunion. Abstract
Non stationarity characteristics of the S\returns:An approach based on the evolutionary spectral density. AHAMADA IBRAHIM GREQAM, universit?de la méditerranée and CERESUR, universit?de La Réunion Abstract
More information1. Fundamental concepts
. Fundamental concepts A time series is a sequence of data points, measured typically at successive times spaced at uniform intervals. Time series are used in such fields as statistics, signal processing
More informationSparsity in Underdetermined Systems
Sparsity in Underdetermined Systems Department of Statistics Stanford University August 19, 2005 Classical Linear Regression Problem X n y p n 1 > Given predictors and response, y Xβ ε = + ε N( 0, σ 2
More informationWaveform-Based Coding: Outline
Waveform-Based Coding: Transform and Predictive Coding Yao Wang Polytechnic University, Brooklyn, NY11201 http://eeweb.poly.edu/~yao Based on: Y. Wang, J. Ostermann, and Y.-Q. Zhang, Video Processing and
More informationCovariant Time-Frequency Representations. Through Unitary Equivalence. Richard G. Baraniuk. Member, IEEE. Rice University
Covariant Time-Frequency Representations Through Unitary Equivalence Richard G. Baraniuk Member, IEEE Department of Electrical and Computer Engineering Rice University P.O. Box 1892, Houston, TX 77251{1892,
More informationELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random
More informationMyoelectrical signal classification based on S transform and two-directional 2DPCA
Myoelectrical signal classification based on S transform and two-directional 2DPCA Hong-Bo Xie1 * and Hui Liu2 1 ARC Centre of Excellence for Mathematical and Statistical Frontiers Queensland University
More informationNew Multiscale Methods for 2D and 3D Astronomical Data Set
New Multiscale Methods for 2D and 3D Astronomical Data Set Jean Luc Starck Dapnia/SEDI SAP, CEA Saclay, France. jstarck@cea.fr http://jstarck.free.fr Collaborators: D.L. Donoho, O. Levi, Department of
More informationPattern Recognition 2
Pattern Recognition 2 KNN,, Dr. Terence Sim School of Computing National University of Singapore Outline 1 2 3 4 5 Outline 1 2 3 4 5 The Bayes Classifier is theoretically optimum. That is, prob. of error
More informationOn non-stationary convolution and inverse convolution
Stanford Exploration Project, Report 102, October 25, 1999, pages 1 137 On non-stationary convolution and inverse convolution James Rickett 1 keywords: helix, linear filtering, non-stationary deconvolution
More informationDigital Image Processing
Digital Image Processing 2D SYSTEMS & PRELIMINARIES Hamid R. Rabiee Fall 2015 Outline 2 Two Dimensional Fourier & Z-transform Toeplitz & Circulant Matrices Orthogonal & Unitary Matrices Block Matrices
More informationA SIMPLE CLOUD SIMULATOR FOR INVESTIGATING THE CORRELATION SCALING COEFFICIENT USED IN THE WAVELET VARIABILITY MODEL (WVM)
A SIMPLE CLOUD SIMULATOR FOR INVESTIGATING THE CORRELATION SCALING COEFFICIENT USED IN THE WAVELET VARIABILITY MODEL (WVM) Matthew Lave Jan Kleissl University of California, San Diego 9 Gilman Dr. #11
More informationIdentification and Classification of High Impedance Faults using Wavelet Multiresolution Analysis
92 NATIONAL POWER SYSTEMS CONFERENCE, NPSC 2002 Identification Classification of High Impedance Faults using Wavelet Multiresolution Analysis D. Cha N. K. Kishore A. K. Sinha Abstract: This paper presents
More information2018 Fall 2210Q Section 013 Midterm Exam I Solution
8 Fall Q Section 3 Midterm Exam I Solution True or False questions ( points = points) () An example of a linear combination of vectors v, v is the vector v. True. We can write v as v + v. () If two matrices
More informationwhich arises when we compute the orthogonal projection of a vector y in a subspace with an orthogonal basis. Hence assume that P y = A ij = x j, x i
MODULE 6 Topics: Gram-Schmidt orthogonalization process We begin by observing that if the vectors {x j } N are mutually orthogonal in an inner product space V then they are necessarily linearly independent.
More informationLINEAR ALGEBRA SUMMARY SHEET.
LINEAR ALGEBRA SUMMARY SHEET RADON ROSBOROUGH https://intuitiveexplanationscom/linear-algebra-summary-sheet/ This document is a concise collection of many of the important theorems of linear algebra, organized
More informationQuadrature Prefilters for the Discrete Wavelet Transform. Bruce R. Johnson. James L. Kinsey. Abstract
Quadrature Prefilters for the Discrete Wavelet Transform Bruce R. Johnson James L. Kinsey Abstract Discrepancies between the Discrete Wavelet Transform and the coefficients of the Wavelet Series are known
More informationStochastic Processes. A stochastic process is a function of two variables:
Stochastic Processes Stochastic: from Greek stochastikos, proceeding by guesswork, literally, skillful in aiming. A stochastic process is simply a collection of random variables labelled by some parameter:
More informationLecture 3 Kernel properties and design in Cohen s class time-frequency distributions
Lecture 3 Kernel properties and design in Cohen s class time-frequency distributions Time-frequency analysis, adaptive filtering and source separation José Biurrun Manresa 22.02.2011 Time-Frequency representations
More informationPartial Eigenvalue Assignment in Linear Systems: Existence, Uniqueness and Numerical Solution
Partial Eigenvalue Assignment in Linear Systems: Existence, Uniqueness and Numerical Solution Biswa N. Datta, IEEE Fellow Department of Mathematics Northern Illinois University DeKalb, IL, 60115 USA e-mail:
More informationStatistical signal processing
Statistical signal processing Short overview of the fundamentals Outline Random variables Random processes Stationarity Ergodicity Spectral analysis Random variable and processes Intuition: A random variable
More informationL29: Fourier analysis
L29: Fourier analysis Introduction The discrete Fourier Transform (DFT) The DFT matrix The Fast Fourier Transform (FFT) The Short-time Fourier Transform (STFT) Fourier Descriptors CSCE 666 Pattern Analysis
More informationNontechnical introduction to wavelets Continuous wavelet transforms Fourier versus wavelets - examples
Nontechnical introduction to wavelets Continuous wavelet transforms Fourier versus wavelets - examples A major part of economic time series analysis is done in the time or frequency domain separately.
More informationImage Processing by the Curvelet Transform
Image Processing by the Curvelet Transform Jean Luc Starck Dapnia/SEDI SAP, CEA Saclay, France. jstarck@cea.fr http://jstarck.free.fr Collaborators: D.L. Donoho, Department of Statistics, Stanford E. Candès,
More informationPerformance Bounds for Polynomial Phase Parameter Estimation with Nonuniform and Random Sampling Schemes
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 48, NO. 2, FEBRUARY 2000 331 Performance Bounds for Polynomial Phase Parameter Estimation with Nonuniform Rom Sampling Schemes Jonathan A. Legg, Member, IEEE,
More informationEconometría 2: Análisis de series de Tiempo
Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 IX. Vector Time Series Models VARMA Models A. 1. Motivation: The vector
More informationStrengthened Sobolev inequalities for a random subspace of functions
Strengthened Sobolev inequalities for a random subspace of functions Rachel Ward University of Texas at Austin April 2013 2 Discrete Sobolev inequalities Proposition (Sobolev inequality for discrete images)
More information8. Diagonalization.
8. Diagonalization 8.1. Matrix Representations of Linear Transformations Matrix of A Linear Operator with Respect to A Basis We know that every linear transformation T: R n R m has an associated standard
More informationDS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.
DS-GA 1002 Lecture notes 0 Fall 2016 Linear Algebra These notes provide a review of basic concepts in linear algebra. 1 Vector spaces You are no doubt familiar with vectors in R 2 or R 3, i.e. [ ] 1.1
More informationLecture Notes 5: Multiresolution Analysis
Optimization-based data analysis Fall 2017 Lecture Notes 5: Multiresolution Analysis 1 Frames A frame is a generalization of an orthonormal basis. The inner products between the vectors in a frame and
More informationTwo-Dimensional Orthogonal Filter Banks with Directional Vanishing Moments
Two-imensional Orthogonal Filter Banks with irectional Vanishing Moments Jianping Zhou and Minh N. o epartment of Electrical and Computer Engineering University of Illinois at Urbana-Champaign, Urbana,
More informationKeywords: Kinematics; Principal planes; Special orthogonal matrices; Trajectory optimization
Editorial Manager(tm) for Nonlinear Dynamics Manuscript Draft Manuscript Number: Title: Minimum Distance and Optimal Transformations on SO(N) Article Type: Original research Section/Category: Keywords:
More informationA NOVEL METHOD TO DERIVE EXPLICIT KLT KERNEL FOR AR(1) PROCESS. Mustafa U. Torun and Ali N. Akansu
A NOVEL METHOD TO DERIVE EXPLICIT KLT KERNEL FOR AR() PROCESS Mustafa U. Torun and Ali N. Akansu Department of Electrical and Computer Engineering New Jersey Institute of Technology University Heights,
More informationCourse Summary Math 211
Course Summary Math 211 table of contents I. Functions of several variables. II. R n. III. Derivatives. IV. Taylor s Theorem. V. Differential Geometry. VI. Applications. 1. Best affine approximations.
More informationApplied Time. Series Analysis. Wayne A. Woodward. Henry L. Gray. Alan C. Elliott. Dallas, Texas, USA
Applied Time Series Analysis Wayne A. Woodward Southern Methodist University Dallas, Texas, USA Henry L. Gray Southern Methodist University Dallas, Texas, USA Alan C. Elliott University of Texas Southwestern
More informationDigital Image Processing
Digital Image Processing Wavelets and Multiresolution Processing (Wavelet Transforms) Christophoros Nikou cnikou@cs.uoi.gr University of Ioannina - Department of Computer Science 2 Contents Image pyramids
More informationMultiresolution Models of Time Series
Multiresolution Models of Time Series Andrea Tamoni (Bocconi University ) 2011 Tamoni Multiresolution Models of Time Series 1/ 16 General Framework Time-scale decomposition General Framework Begin with
More informationVisualization of Traveling Vortices in the Boundary Layer on a Rotating Disk under Orbital Motion
Open Journal of Fluid Dynamics, 2015, 5, 17-25 Published Online March 2015 in SciRes. http://www.scirp.org/journal/ojfd http://dx.doi.org/10.4236/ojfd.2015.51003 Visualization of Traveling Vortices in
More informationBiomedical Signal Processing and Signal Modeling
Biomedical Signal Processing and Signal Modeling Eugene N. Bruce University of Kentucky A Wiley-lnterscience Publication JOHN WILEY & SONS, INC. New York Chichester Weinheim Brisbane Singapore Toronto
More informationSAMPLE CHAPTERS UNESCO EOLSS STATIONARY PROCESSES. E ξ t (1) K.Grill Institut für Statistik und Wahrscheinlichkeitstheorie, TU Wien, Austria
STATIONARY PROCESSES K.Grill Institut für Statistik und Wahrscheinlichkeitstheorie, TU Wien, Austria Keywords: Stationary process, weak sense stationary process, strict sense stationary process, correlation
More informationDynamic Time Series Regression: A Panacea for Spurious Correlations
International Journal of Scientific and Research Publications, Volume 6, Issue 10, October 2016 337 Dynamic Time Series Regression: A Panacea for Spurious Correlations Emmanuel Alphonsus Akpan *, Imoh
More informationWavelet-Based Numerical Homogenization for Scaled Solutions of Linear Matrix Equations
International Journal of Discrete Mathematics 2017; 2(1: 10-16 http://www.sciencepublishinggroup.com/j/dmath doi: 10.11648/j.dmath.20170201.13 Wavelet-Based Numerical Homogenization for Scaled Solutions
More informationRigid Geometric Transformations
Rigid Geometric Transformations Carlo Tomasi This note is a quick refresher of the geometry of rigid transformations in three-dimensional space, expressed in Cartesian coordinates. 1 Cartesian Coordinates
More informationEXTENDING THE SCOPE OF WAVELET REGRESSION METHODS BY COEFFICIENT-DEPENDENT THRESHOLDING
EXTENDING THE SCOPE OF WAVELET REGRESSION METHODS BY COEFFICIENT-DEPENDENT THRESHOLDING ARNE KOVAC, BERNARD W. SILVERMAN ABSTRACT. Various aspects of the wavelet approach to nonparametric regression are
More informationCompressed Sensing Using Reed- Solomon and Q-Ary LDPC Codes
Compressed Sensing Using Reed- Solomon and Q-Ary LDPC Codes Item Type text; Proceedings Authors Jagiello, Kristin M. Publisher International Foundation for Telemetering Journal International Telemetering
More informationLinear Algebra March 16, 2019
Linear Algebra March 16, 2019 2 Contents 0.1 Notation................................ 4 1 Systems of linear equations, and matrices 5 1.1 Systems of linear equations..................... 5 1.2 Augmented
More informationUnitary Dynamics and Quantum Circuits
qitd323 Unitary Dynamics and Quantum Circuits Robert B. Griffiths Version of 20 January 2014 Contents 1 Unitary Dynamics 1 1.1 Time development operator T.................................... 1 1.2 Particular
More informationAn Evolutionary Programming Based Algorithm for HMM training
An Evolutionary Programming Based Algorithm for HMM training Ewa Figielska,Wlodzimierz Kasprzak Institute of Control and Computation Engineering, Warsaw University of Technology ul. Nowowiejska 15/19,
More informationTHIS work addresses a class of inverse problems that are
494 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 50, NO. 3, MARCH 2004 Stochastic Deconvolution Over Groups Birsen Yazici, Member, IEEE Abstract In this paper, we address a class of inverse problems that
More informationA note on multivariate Gauss-Hermite quadrature
A note on multivariate Gauss-Hermite quadrature Peter Jäckel 1th May 5 1 Introduction Gaussian quadratures are an ingenious way to approximate the integral of an unknown function f(x) over a specified
More information3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE
3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE 3.0 INTRODUCTION The purpose of this chapter is to introduce estimators shortly. More elaborated courses on System Identification, which are given
More informationEdge preserved denoising and singularity extraction from angles gathers
Edge preserved denoising and singularity extraction from angles gathers Felix Herrmann, EOS-UBC Martijn de Hoop, CSM Joint work Geophysical inversion theory using fractional spline wavelets: ffl Jonathan
More informationStudy of nonlinear phenomena in a tokamak plasma using a novel Hilbert transform technique
Study of nonlinear phenomena in a tokamak plasma using a novel Hilbert transform technique Daniel Raju, R. Jha and A. Sen Institute for Plasma Research, Bhat, Gandhinagar-382428, INDIA Abstract. A new
More informationA Cross-Associative Neural Network for SVD of Nonsquared Data Matrix in Signal Processing
IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 12, NO. 5, SEPTEMBER 2001 1215 A Cross-Associative Neural Network for SVD of Nonsquared Data Matrix in Signal Processing Da-Zheng Feng, Zheng Bao, Xian-Da Zhang
More informationA Proposed Warped Choi Williams Time Frequency Distribution Applied to Doppler Blood Flow Measurement
9 Int'l Conf. Bioinformatics and Computational Biology BIOCOMP'6 A Proposed Warped Choi Williams Time Frequency Distribution Applied to Doppler Blood Flow Measurement F. García-Nocetti, J. Solano, F. and
More informationA Subspace Approach to Estimation of. Measurements 1. Carlos E. Davila. Electrical Engineering Department, Southern Methodist University
EDICS category SP 1 A Subspace Approach to Estimation of Autoregressive Parameters From Noisy Measurements 1 Carlos E Davila Electrical Engineering Department, Southern Methodist University Dallas, Texas
More informationLecture - 30 Stationary Processes
Probability and Random Variables Prof. M. Chakraborty Department of Electronics and Electrical Communication Engineering Indian Institute of Technology, Kharagpur Lecture - 30 Stationary Processes So,
More informationEmpirical Mode Decomposition of Financial Data
International Mathematical Forum, 3, 28, no. 25, 1191-122 Empirical Mode Decomposition of Financial Data Konstantinos Drakakis 1 UCD CASL 2 University College Dublin Abstract We propose a novel method
More informationStochastic Optimization with Inequality Constraints Using Simultaneous Perturbations and Penalty Functions
International Journal of Control Vol. 00, No. 00, January 2007, 1 10 Stochastic Optimization with Inequality Constraints Using Simultaneous Perturbations and Penalty Functions I-JENG WANG and JAMES C.
More informationPRINCIPAL COMPONENTS ANALYSIS
121 CHAPTER 11 PRINCIPAL COMPONENTS ANALYSIS We now have the tools necessary to discuss one of the most important concepts in mathematical statistics: Principal Components Analysis (PCA). PCA involves
More informationModeling nonlinear systems using multiple piecewise linear equations
Nonlinear Analysis: Modelling and Control, 2010, Vol. 15, No. 4, 451 458 Modeling nonlinear systems using multiple piecewise linear equations G.K. Lowe, M.A. Zohdy Department of Electrical and Computer
More informationGaussian Process for Internal Model Control
Gaussian Process for Internal Model Control Gregor Gregorčič and Gordon Lightbody Department of Electrical Engineering University College Cork IRELAND E mail: gregorg@rennesuccie Abstract To improve transparency
More informationarxiv: v1 [cs.oh] 3 Oct 2014
M. Prisheltsev (Voronezh) mikhail.prisheltsev@gmail.com ADAPTIVE TWO-DIMENSIONAL WAVELET TRANSFORMATION BASED ON THE HAAR SYSTEM 1 Introduction arxiv:1410.0705v1 [cs.oh] Oct 2014 The purpose is to study
More informatione 2 e 1 (a) (b) (d) (c)
2.13 Rotated principal component analysis [Book, Sect. 2.2] Fig.: PCA applied to a dataset composed of (a) 1 cluster, (b) 2 clusters, (c) and (d) 4 clusters. In (c), an orthonormal rotation and (d) an
More informationSummary of Fourier Transform Properties
Summary of Fourier ransform Properties Frank R. Kschischang he Edward S. Rogers Sr. Department of Electrical and Computer Engineering University of oronto January 7, 207 Definition and Some echnicalities
More informationWigner function for nonparaxial wave fields
486 J. Opt. Soc. Am. A/ Vol. 18, No. 10/ October 001 C. J. R. Sheppard and K. G. Larin Wigner function for nonparaxial wave fields Colin J. R. Sheppard* and Kieran G. Larin Department of Physical Optics,
More informationWavelet Methods for Time Series Analysis
Wavelet Methods for Time Series Analysis Donald B. Percival UNIVERSITY OF WASHINGTON, SEATTLE Andrew T. Walden IMPERIAL COLLEGE OF SCIENCE, TECHNOLOGY AND MEDICINE, LONDON CAMBRIDGE UNIVERSITY PRESS Contents
More informationTwo-Dimensional Sparse Arrays with Hole-Free Coarray and Reduced Mutual Coupling
Two-Dimensional Sparse Arrays with Hole-Free Coarray and Reduced Mutual Coupling Chun-Lin Liu and P. P. Vaidyanathan Dept. of Electrical Engineering, 136-93 California Institute of Technology, Pasadena,
More informationComments on \Wavelets in Statistics: A Review" by. A. Antoniadis. Jianqing Fan. University of North Carolina, Chapel Hill
Comments on \Wavelets in Statistics: A Review" by A. Antoniadis Jianqing Fan University of North Carolina, Chapel Hill and University of California, Los Angeles I would like to congratulate Professor Antoniadis
More informationA Lower Bound Theorem. Lin Hu.
American J. of Mathematics and Sciences Vol. 3, No -1,(January 014) Copyright Mind Reader Publications ISSN No: 50-310 A Lower Bound Theorem Department of Applied Mathematics, Beijing University of Technology,
More informationThe Application of Legendre Multiwavelet Functions in Image Compression
Journal of Modern Applied Statistical Methods Volume 5 Issue 2 Article 3 --206 The Application of Legendre Multiwavelet Functions in Image Compression Elham Hashemizadeh Department of Mathematics, Karaj
More informationLecture 10. Lecturer: Aleksander Mądry Scribes: Mani Bastani Parizi and Christos Kalaitzis
CS-621 Theory Gems October 18, 2012 Lecture 10 Lecturer: Aleksander Mądry Scribes: Mani Bastani Parizi and Christos Kalaitzis 1 Introduction In this lecture, we will see how one can use random walks to
More informationUnsupervised Learning Methods
Structural Health Monitoring Using Statistical Pattern Recognition Unsupervised Learning Methods Keith Worden and Graeme Manson Presented by Keith Worden The Structural Health Monitoring Process 1. Operational
More informationMultiscale Geometric Analysis: Thoughts and Applications (a summary)
Multiscale Geometric Analysis: Thoughts and Applications (a summary) Anestis Antoniadis, University Joseph Fourier Assimage 2005,Chamrousse, February 2005 Classical Multiscale Analysis Wavelets: Enormous
More informationECE 636: Systems identification
ECE 636: Systems identification Lectures 3 4 Random variables/signals (continued) Random/stochastic vectors Random signals and linear systems Random signals in the frequency domain υ ε x S z + y Experimental
More informationTWO-STAGE ISOLATION FOR HARMONIC BASE EXCITATION Revision A. By Tom Irvine February 25, 2008
TWO-STAGE ISOLATION FOR HARMONIC BASE EXCITATION Revision A By Tom Irvine Email: tomirvine@aol.com February 5, 008 Introduction Consider a base plate mass m and an avionics mass m modeled as two-degree-of-freedom.
More informationMath 118, Fall 2014 Final Exam
Math 8, Fall 4 Final Exam True or false Please circle your choice; no explanation is necessary True There is a linear transformation T such that T e ) = e and T e ) = e Solution Since T is linear, if T
More informationGaussian Quiz. Preamble to The Humble Gaussian Distribution. David MacKay 1
Preamble to The Humble Gaussian Distribution. David MacKay Gaussian Quiz H y y y 3. Assuming that the variables y, y, y 3 in this belief network have a joint Gaussian distribution, which of the following
More informationCONTROL SYSTEMS, ROBOTICS, AND AUTOMATION - Vol. V - Prediction Error Methods - Torsten Söderström
PREDICTIO ERROR METHODS Torsten Söderström Department of Systems and Control, Information Technology, Uppsala University, Uppsala, Sweden Keywords: prediction error method, optimal prediction, identifiability,
More informationFeature selection and classifier performance in computer-aided diagnosis: The effect of finite sample size
Feature selection and classifier performance in computer-aided diagnosis: The effect of finite sample size Berkman Sahiner, a) Heang-Ping Chan, Nicholas Petrick, Robert F. Wagner, b) and Lubomir Hadjiiski
More informationESS Finite Impulse Response Filters and the Z-transform
9. Finite Impulse Response Filters and the Z-transform We are going to have two lectures on filters you can find much more material in Bob Crosson s notes. In the first lecture we will focus on some of
More informationGroundwater permeability
Groundwater permeability Easy to solve the forward problem: flow of groundwater given permeability of aquifer Inverse problem: determine permeability from flow (usually of tracers With some models enough
More informationcovariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of
Index* The Statistical Analysis of Time Series by T. W. Anderson Copyright 1971 John Wiley & Sons, Inc. Aliasing, 387-388 Autoregressive {continued) Amplitude, 4, 94 case of first-order, 174 Associated
More information