Sum of Coherent Systems Decomposition by SVD. University of California at Berkeley. Berkeley, CA September 21, 1995.

Size: px
Start display at page:

Download "Sum of Coherent Systems Decomposition by SVD. University of California at Berkeley. Berkeley, CA September 21, 1995."

Transcription

1 Sum of Coherent Systems Decomposition by SVD Nick Cobb Department of Electrical Engineering and Computer Science University of California at Berkeley Berkeley, CA9 September 1, 199 Abstract The Hopkins partially coherent imaging equation is expanded by eigenfunctions into a sum of coherent systems (SOCS) The result is a bank of linear systems whose outputs are squared, scaled and summed This technique is useful because of the partial linearity of the resulting system approximation The eigenfunction expansion can be accomplished by computer using the SVD algorithm To solve this problem, the Hopkins transmission cross coecients (TCCs) are rst obtained as a matrix, then SVD is used on the matrix Then the system is truncated at some low order (th or th) to obtain an optimal approximation to Hopkins In eect, the numerical implementation of this using SPLAT TCCs amounts to a direct approximation to SPLAT 1 Linear Systems Approximation The goal in this section is to compute the value of a single intensity point centered in a nite square mask region of size L x L x m, as depicted in Figure 1 First, we consider the 1-D case By periodicizing a the length L x mask, and taking its Fourier series expansion ~ G(n), as done by Flanner [] we obtain the following expression for the Fourier series of the resulting periodic intensity, ~ I(): ~I(n) = X n ~ T(n + n ;n ) ~ G(n + n )G (n ) (1) Suppose that the transmission cross coecient function ~ T (n ;n ) can be approximated by: ~T (n ;n ) k k (n ) k(n ) () for some functions k ();k =1:::N a We call this an N a th order approximation Then substitute equation into equation 1 to yield ~I(n) = X n k k (n + n) k (n ) ~ G(n + n )G (n ) 1

2 L x rect 1 L x rect (,) rect Figure 1: Compute intensity at (,) for a small mask X = X n Na k k (n + n) ~ G(n + n ) k(n ) ~ G (n ) = k ( k ~ G)? (k ~ G) (n) () where? is the convolution operator This is observed to be sum of convolutions in the frequency domain The convolutions are autocorrelations of the Fourier coecients By convolution-multiplication duality,theinverse Fourier series of this expression can be written in the spatial domain as I(x) = k j( k?g)(x)j () In two dimensions, this is extended straightforwardly to yield the Fourier series expansion of the image intensity and the image intensity: ~I(m; n) = I(x; y) = k ( k ~ G)? (k ~ G) (m; n) () k j( k?g)(x; y)j () where? is now -D convolution Thus, the intensityistheweighted summed squared outputs of N a linear systems, which we call a SOCS as shown in Figure Decomposing Hopkin's Imaging Equation To this point, the development of the SOCS intensity calculation technique has assumed that the original approximation in equation is valid In this section, this claim is validated and a technique for nding the -D convolution kernels, k (), is elaborated We start by deriving

3 φ 1 λ 1 [ ] mask φ λ [ ] Σ intensity φ N [ ] λ N Optics system kernels Figure : Sum of coherent systems (SOCS) approximation to Hopkin's imaging the decomposition in the 1-D case for simplicity and then extend it naturally to -D The determination of the -D convolution kernels requires some special techniques described in section 1 1-D Decomposition The following two facts from Flanner[] are useful in the subsequent development Fact 1 ~ T(; ) is nonzero for only nitely many points and therefore can be represented bya matrix of values of size M M Fact ~ T(n ;n )= ~ T (n ;n ) and therefore it is Hermitian symmetric Based on this, we make the following claim: Claim 1 ~ T(n ;n ) can be written as ~T(n ;n ) = MX k k (n ) k(n ) Proof: Putting Facts 1 and together allow us to write ~ T(n ;n ) as the Hermitian matrix [ ~ T] i;j = ~T(i; j) The dyadic expansion of T in terms of it's eigenvectors is ~T = MX k k k ; which is equivalent to the claim With this we have a sum-of-coherent systems decomposition similar to that proposed by Pati and Kaillath[] which describes the action of the partially coherent optical system

4 By truncating the summation at N a,we get a reduced order approximation to the partially coherent system resulting in intensity: ~T(n ;n ) k k (n ) k(n ) () Since the singular values k rapidly decay in magnitude, the truncation will be a good approximation Theoretical error bounds on the approximation are analyzed in the paper by Pati and Kailath[], in which itisshown that very good low-order approximations are achieved The decomposition can be performed by Singular Value Decomposition (SVD) if we have the computed TCC values, T ~ With these results, the approximation of equation and the subsequent development are fully justied -D Kernel Determination In the -D case, we can also use SVD to obtain the -D convolution kernels in the decomposition In the -D case, the discrete TCCs can be thought of as a linear mapping from the space of M M matrices, R M M, to itself So, given a matrix X R M M, the function ~T(i; j; k; l) can dene a linear mapping T whose action is described by: [T (X)] (i;j) = MX MX l=1 ~T (i; j; k; l)x k;l This linear operation can be \unwound" to be represented as a matrix, T, operating on a column vector from R N The unwinding is performed by stacking the columns of the vector and then writing the operation out as a matrix-vector multiply The column stacking function S : R N N,! R N is dened by: S(X i;j )=X jn +i For example, let X be a matrix of size M M: X = x 11 x 1 ::: x 1M x 1 x ::: x M x n1 x M ::: x MM The column stacking operation is performed on X, yielding X = S(X) = h i = x 1 x ::: x M x 1 x x M

5 The operator T dened before can be represented as a matrix, T, operating on the stacked X vector, T = ~T (1; 1; 1; 1) ~ T (1; 1; ; 1) ::: ~ T (1; 1; N;1) ~ T (1; 1; 1; ) ~ T (1; 1; ; ) ::: ~ T (1; 1; N;N) ~T (; 1; 1; 1) ~T (N; 1; 1; 1) ~T (1; ; 1; 1) ~T (; ; 1; 1) ~T (N; ; 1; 1) ~T (N; N; 1; 1) ::: ~ T (N; N; N; N) The contour plot in gure shows the an example of the matrix T Singular value decomposition applied to this matrix yields the decomposition: T = NX k V k V k ; (8) Then, the inverse column stacking operation yields the desired functions, k, in equation and then it it possible to make the approximation therein: ~T(n ;n ) k = S,1 (V k ) k k (n ) k (n ) The spatial domain convolution kernels are the Inverse Fourier Series' (IFS) of the k 's Using the -D Inverse Fast Fourier Transform (IFFT) to obtain the k 's yields: I(x; y) = k j( k?g)(x; y)j (9) Using the IFFT instead of IFS introduces a small amount of destructive aliasing, but this is necessary in order to limit the time domain convolution kernels to have nite support A plot of the singular values in gure shows why a reduced order approximation can be very accurate, since the singular values quickly approach zero The magnitudes plots of the rst two convolution kernels obtained after the IFFT are shown in gure References [1] N Cobb, \Fast mask optimization for optical lithography," Master's thesis, University of California at Berkeley, 199

6 [] P D Flanner, \Two-dimensional optical imaging for photolithography simulation," Tech Rep Memorandum No UCB/ERL M8/, Electronics Research Laboratory, University of California at Berkeley, Jul 198 [] Y C Pati and T Kailath, \Phase-shifting masks for microlithography: Automated design and mask requirements," Journal of the Optical Society of America A-Optics Image Science and Vision, vol 11 No 9, pp 8{, Figure : Contour plot of TCCs in -D matrix form 1 Singular values σ k k Figure : Singular values, k obtained indecomposition

7 x 1 - x (a) (b) Figure : (a) 1 (x; y) (b) (x; y)

1. The Polar Decomposition

1. The Polar Decomposition A PERSONAL INTERVIEW WITH THE SINGULAR VALUE DECOMPOSITION MATAN GAVISH Part. Theory. The Polar Decomposition In what follows, F denotes either R or C. The vector space F n is an inner product space with

More information

APPENDIX A. Background Mathematics. A.1 Linear Algebra. Vector algebra. Let x denote the n-dimensional column vector with components x 1 x 2.

APPENDIX A. Background Mathematics. A.1 Linear Algebra. Vector algebra. Let x denote the n-dimensional column vector with components x 1 x 2. APPENDIX A Background Mathematics A. Linear Algebra A.. Vector algebra Let x denote the n-dimensional column vector with components 0 x x 2 B C @. A x n Definition 6 (scalar product). The scalar product

More information

Boxlets: a Fast Convolution Algorithm for. Signal Processing and Neural Networks. Patrice Y. Simard, Leon Bottou, Patrick Haner and Yann LeCun

Boxlets: a Fast Convolution Algorithm for. Signal Processing and Neural Networks. Patrice Y. Simard, Leon Bottou, Patrick Haner and Yann LeCun Boxlets: a Fast Convolution Algorithm for Signal Processing and Neural Networks Patrice Y. Simard, Leon Bottou, Patrick Haner and Yann LeCun AT&T Labs-Research 100 Schultz Drive, Red Bank, NJ 07701-7033

More information

Spectral transforms. Contents. ARPEGE-Climat Version 5.1. September Introduction 2

Spectral transforms. Contents. ARPEGE-Climat Version 5.1. September Introduction 2 Spectral transforms ARPEGE-Climat Version 5.1 September 2008 Contents 1 Introduction 2 2 Spectral representation 2 2.1 Spherical harmonics....................... 2 2.2 Collocation grid.........................

More information

[4] T. I. Seidman, \\First Come First Serve" is Unstable!," tech. rep., University of Maryland Baltimore County, 1993.

[4] T. I. Seidman, \\First Come First Serve is Unstable!, tech. rep., University of Maryland Baltimore County, 1993. [2] C. J. Chase and P. J. Ramadge, \On real-time scheduling policies for exible manufacturing systems," IEEE Trans. Automat. Control, vol. AC-37, pp. 491{496, April 1992. [3] S. H. Lu and P. R. Kumar,

More information

Digital Signal Processing, Homework 1, Spring 2013, Prof. C.D. Chung

Digital Signal Processing, Homework 1, Spring 2013, Prof. C.D. Chung Digital Signal Processing, Homework, Spring 203, Prof. C.D. Chung. (0.5%) Page 99, Problem 2.2 (a) The impulse response h [n] of an LTI system is known to be zero, except in the interval N 0 n N. The input

More information

Mathematical Institute, University of Utrecht. The problem of estimating the mean of an observed Gaussian innite-dimensional vector

Mathematical Institute, University of Utrecht. The problem of estimating the mean of an observed Gaussian innite-dimensional vector On Minimax Filtering over Ellipsoids Eduard N. Belitser and Boris Y. Levit Mathematical Institute, University of Utrecht Budapestlaan 6, 3584 CD Utrecht, The Netherlands The problem of estimating the mean

More information

October 7, :8 WSPC/WS-IJWMIP paper. Polynomial functions are renable

October 7, :8 WSPC/WS-IJWMIP paper. Polynomial functions are renable International Journal of Wavelets, Multiresolution and Information Processing c World Scientic Publishing Company Polynomial functions are renable Henning Thielemann Institut für Informatik Martin-Luther-Universität

More information

then kaxk 1 = j a ij x j j ja ij jjx j j: Changing the order of summation, we can separate the summands, kaxk 1 ja ij jjx j j: let then c = max 1jn ja

then kaxk 1 = j a ij x j j ja ij jjx j j: Changing the order of summation, we can separate the summands, kaxk 1 ja ij jjx j j: let then c = max 1jn ja Homework Haimanot Kassa, Jeremy Morris & Isaac Ben Jeppsen October 7, 004 Exercise 1 : We can say that kxk = kx y + yk And likewise So we get kxk kx yk + kyk kxk kyk kx yk kyk = ky x + xk kyk ky xk + kxk

More information

ELEMENTARY LINEAR ALGEBRA WITH APPLICATIONS. 1. Linear Equations and Matrices

ELEMENTARY LINEAR ALGEBRA WITH APPLICATIONS. 1. Linear Equations and Matrices ELEMENTARY LINEAR ALGEBRA WITH APPLICATIONS KOLMAN & HILL NOTES BY OTTO MUTZBAUER 11 Systems of Linear Equations 1 Linear Equations and Matrices Numbers in our context are either real numbers or complex

More information

linearly indepedent eigenvectors as the multiplicity of the root, but in general there may be no more than one. For further discussion, assume matrice

linearly indepedent eigenvectors as the multiplicity of the root, but in general there may be no more than one. For further discussion, assume matrice 3. Eigenvalues and Eigenvectors, Spectral Representation 3.. Eigenvalues and Eigenvectors A vector ' is eigenvector of a matrix K, if K' is parallel to ' and ' 6, i.e., K' k' k is the eigenvalue. If is

More information

Calculus and linear algebra for biomedical engineering Week 3: Matrices, linear systems of equations, and the Gauss algorithm

Calculus and linear algebra for biomedical engineering Week 3: Matrices, linear systems of equations, and the Gauss algorithm Calculus and linear algebra for biomedical engineering Week 3: Matrices, linear systems of equations, and the Gauss algorithm Hartmut Führ fuehr@matha.rwth-aachen.de Lehrstuhl A für Mathematik, RWTH Aachen

More information

Automatic algorithms

Automatic algorithms Automatic algorithms Function approximation using its series decomposition in a basis Lluís Antoni Jiménez Rugama May 30, 2013 Index 1 Introduction Environment Linking H in Example and H out 2 Our algorithms

More information

Review of similarity transformation and Singular Value Decomposition

Review of similarity transformation and Singular Value Decomposition Review of similarity transformation and Singular Value Decomposition Nasser M Abbasi Applied Mathematics Department, California State University, Fullerton July 8 7 page compiled on June 9, 5 at 9:5pm

More information

The Discrete Fourier Transform (DFT) Properties of the DFT DFT-Specic Properties Power spectrum estimate. Alex Sheremet.

The Discrete Fourier Transform (DFT) Properties of the DFT DFT-Specic Properties Power spectrum estimate. Alex Sheremet. 4. April 2, 27 -order sequences Measurements produce sequences of numbers Measurement purpose: characterize a stochastic process. Example: Process: water surface elevation as a function of time Parameters:

More information

Computational Methods CMSC/AMSC/MAPL 460. EigenValue decomposition Singular Value Decomposition. Ramani Duraiswami, Dept. of Computer Science

Computational Methods CMSC/AMSC/MAPL 460. EigenValue decomposition Singular Value Decomposition. Ramani Duraiswami, Dept. of Computer Science Computational Methods CMSC/AMSC/MAPL 460 EigenValue decomposition Singular Value Decomposition Ramani Duraiswami, Dept. of Computer Science Hermitian Matrices A square matrix for which A = A H is said

More information

Functional Analysis Review

Functional Analysis Review Functional Analysis Review Lorenzo Rosasco slides courtesy of Andre Wibisono 9.520: Statistical Learning Theory and Applications September 9, 2013 1 2 3 4 Vector Space A vector space is a set V with binary

More information

8 Singular Integral Operators and L p -Regularity Theory

8 Singular Integral Operators and L p -Regularity Theory 8 Singular Integral Operators and L p -Regularity Theory 8. Motivation See hand-written notes! 8.2 Mikhlin Multiplier Theorem Recall that the Fourier transformation F and the inverse Fourier transformation

More information

MATH 583A REVIEW SESSION #1

MATH 583A REVIEW SESSION #1 MATH 583A REVIEW SESSION #1 BOJAN DURICKOVIC 1. Vector Spaces Very quick review of the basic linear algebra concepts (see any linear algebra textbook): (finite dimensional) vector space (or linear space),

More information

Contents. 6 Systems of First-Order Linear Dierential Equations. 6.1 General Theory of (First-Order) Linear Systems

Contents. 6 Systems of First-Order Linear Dierential Equations. 6.1 General Theory of (First-Order) Linear Systems Dierential Equations (part 3): Systems of First-Order Dierential Equations (by Evan Dummit, 26, v 2) Contents 6 Systems of First-Order Linear Dierential Equations 6 General Theory of (First-Order) Linear

More information

Formula for the inverse matrix. Cramer s rule. Review: 3 3 determinants can be computed expanding by any row or column

Formula for the inverse matrix. Cramer s rule. Review: 3 3 determinants can be computed expanding by any row or column Math 20F Linear Algebra Lecture 18 1 Determinants, n n Review: The 3 3 case Slide 1 Determinants n n (Expansions by rows and columns Relation with Gauss elimination matrices: Properties) Formula for the

More information

Elec4621 Advanced Digital Signal Processing Chapter 11: Time-Frequency Analysis

Elec4621 Advanced Digital Signal Processing Chapter 11: Time-Frequency Analysis Elec461 Advanced Digital Signal Processing Chapter 11: Time-Frequency Analysis Dr. D. S. Taubman May 3, 011 In this last chapter of your notes, we are interested in the problem of nding the instantaneous

More information

Linear Algebra, 4th day, Thursday 7/1/04 REU Info:

Linear Algebra, 4th day, Thursday 7/1/04 REU Info: Linear Algebra, 4th day, Thursday 7/1/04 REU 004. Info http//people.cs.uchicago.edu/laci/reu04. Instructor Laszlo Babai Scribe Nick Gurski 1 Linear maps We shall study the notion of maps between vector

More information

Tensor SVD and distributed control

Tensor SVD and distributed control Tensor SVD and distributed control Ram V. Iyer Department of Mathematics and Statistics, Texas Tech University, Lubbock, TX 79409-1042. ABSTRACT The (approximate) diagonalization of symmetric matrices

More information

1 Parametric Bessel Equation and Bessel-Fourier Series

1 Parametric Bessel Equation and Bessel-Fourier Series 1 Parametric Bessel Equation an Bessel-Fourier Series Recall the parametric Bessel equation of orer n: x 2 y + xy + (a 2 x 2 n 2 )y = (1.1) The general solution is given by y = J n (ax) +Y n (ax). If we

More information

524 Jan-Olov Stromberg practice, this imposes strong restrictions both on N and on d. The current state of approximation theory is essentially useless

524 Jan-Olov Stromberg practice, this imposes strong restrictions both on N and on d. The current state of approximation theory is essentially useless Doc. Math. J. DMV 523 Computation with Wavelets in Higher Dimensions Jan-Olov Stromberg 1 Abstract. In dimension d, a lattice grid of size N has N d points. The representation of a function by, for instance,

More information

Linear Algebra (Review) Volker Tresp 2018

Linear Algebra (Review) Volker Tresp 2018 Linear Algebra (Review) Volker Tresp 2018 1 Vectors k, M, N are scalars A one-dimensional array c is a column vector. Thus in two dimensions, ( ) c1 c = c 2 c i is the i-th component of c c T = (c 1, c

More information

Multi-Linear Mappings, SVD, HOSVD, and the Numerical Solution of Ill-Conditioned Tensor Least Squares Problems

Multi-Linear Mappings, SVD, HOSVD, and the Numerical Solution of Ill-Conditioned Tensor Least Squares Problems Multi-Linear Mappings, SVD, HOSVD, and the Numerical Solution of Ill-Conditioned Tensor Least Squares Problems Lars Eldén Department of Mathematics, Linköping University 1 April 2005 ERCIM April 2005 Multi-Linear

More information

Eigenvalue problems and optimization

Eigenvalue problems and optimization Notes for 2016-04-27 Seeking structure For the past three weeks, we have discussed rather general-purpose optimization methods for nonlinear equation solving and optimization. In practice, of course, we

More information

Introduction to Mathematical Physics

Introduction to Mathematical Physics Introduction to Mathematical Physics Methods and Concepts Second Edition Chun Wa Wong Department of Physics and Astronomy University of California Los Angeles OXFORD UNIVERSITY PRESS Contents 1 Vectors

More information

Lecture 5 Singular value decomposition

Lecture 5 Singular value decomposition Lecture 5 Singular value decomposition Weinan E 1,2 and Tiejun Li 2 1 Department of Mathematics, Princeton University, weinan@princeton.edu 2 School of Mathematical Sciences, Peking University, tieli@pku.edu.cn

More information

Denition 1 Suppose V is a nonempty set and F is a eld, and that operations of vector addition and scalar multiplication are dened in the following way

Denition 1 Suppose V is a nonempty set and F is a eld, and that operations of vector addition and scalar multiplication are dened in the following way EE0A - MAE 0A - Fall 00 Review of some elements of linear algebra Prof Fernando Paganini September, 00 1 Linear spaces and mappings In this section we will introduce some of the basic ideas in linear algebra

More information

System theory and system identification of compartmental systems Hof, Jacoba Marchiena van den

System theory and system identification of compartmental systems Hof, Jacoba Marchiena van den University of Groningen System theory and system identification of compartmental systems Hof, Jacoba Marchiena van den IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF)

More information

Filtering in the Frequency Domain

Filtering in the Frequency Domain Filtering in the Frequency Domain Dr. Praveen Sankaran Department of ECE NIT Calicut January 11, 2013 Outline 1 Preliminary Concepts 2 Signal A measurable phenomenon that changes over time or throughout

More information

Constrained Leja points and the numerical solution of the constrained energy problem

Constrained Leja points and the numerical solution of the constrained energy problem Journal of Computational and Applied Mathematics 131 (2001) 427 444 www.elsevier.nl/locate/cam Constrained Leja points and the numerical solution of the constrained energy problem Dan I. Coroian, Peter

More information

= a. a = Let us now study what is a? c ( a A a )

= a. a = Let us now study what is a? c ( a A a ) 7636S ADVANCED QUANTUM MECHANICS Solutions 1 Spring 010 1 Warm up a Show that the eigenvalues of a Hermitian operator A are real and that the eigenkets of A corresponding to dierent eigenvalues are orthogonal

More information

1 Vectors. Notes for Bindel, Spring 2017 Numerical Analysis (CS 4220)

1 Vectors. Notes for Bindel, Spring 2017 Numerical Analysis (CS 4220) Notes for 2017-01-30 Most of mathematics is best learned by doing. Linear algebra is no exception. You have had a previous class in which you learned the basics of linear algebra, and you will have plenty

More information

2800 Lyngby, Denmark, Abstract

2800 Lyngby, Denmark,    Abstract Comparison of three lters in the solution of the Navier-Stokes equation in registration C. Gramkow 1;3 and M. Bro-Nielsen 1;2;3 1 IMM - Department of Mathematical Modelling, Technical University of Denmark,

More information

1. Introduction Let the least value of an objective function F (x), x2r n, be required, where F (x) can be calculated for any vector of variables x2r

1. Introduction Let the least value of an objective function F (x), x2r n, be required, where F (x) can be calculated for any vector of variables x2r DAMTP 2002/NA08 Least Frobenius norm updating of quadratic models that satisfy interpolation conditions 1 M.J.D. Powell Abstract: Quadratic models of objective functions are highly useful in many optimization

More information

MODELLING OF FLEXIBLE MECHANICAL SYSTEMS THROUGH APPROXIMATED EIGENFUNCTIONS L. Menini A. Tornambe L. Zaccarian Dip. Informatica, Sistemi e Produzione

MODELLING OF FLEXIBLE MECHANICAL SYSTEMS THROUGH APPROXIMATED EIGENFUNCTIONS L. Menini A. Tornambe L. Zaccarian Dip. Informatica, Sistemi e Produzione MODELLING OF FLEXIBLE MECHANICAL SYSTEMS THROUGH APPROXIMATED EIGENFUNCTIONS L. Menini A. Tornambe L. Zaccarian Dip. Informatica, Sistemi e Produzione, Univ. di Roma Tor Vergata, via di Tor Vergata 11,

More information

Chapter 13 Partially Coherent Imaging, continued

Chapter 13 Partially Coherent Imaging, continued Chapter 3 Partially Coherent Imaging, continued As an example, a common illuminator design is one in which the source is imaged onto the object. This is known as critical illumination source - source has

More information

STABILITY OF INVARIANT SUBSPACES OF COMMUTING MATRICES We obtain some further results for pairs of commuting matrices. We show that a pair of commutin

STABILITY OF INVARIANT SUBSPACES OF COMMUTING MATRICES We obtain some further results for pairs of commuting matrices. We show that a pair of commutin On the stability of invariant subspaces of commuting matrices Tomaz Kosir and Bor Plestenjak September 18, 001 Abstract We study the stability of (joint) invariant subspaces of a nite set of commuting

More information

4.1 Eigenvalues, Eigenvectors, and The Characteristic Polynomial

4.1 Eigenvalues, Eigenvectors, and The Characteristic Polynomial Linear Algebra (part 4): Eigenvalues, Diagonalization, and the Jordan Form (by Evan Dummit, 27, v ) Contents 4 Eigenvalues, Diagonalization, and the Jordan Canonical Form 4 Eigenvalues, Eigenvectors, and

More information

Discrete-Time Fourier Transform (DTFT)

Discrete-Time Fourier Transform (DTFT) Connexions module: m047 Discrete-Time Fourier Transorm DTFT) Don Johnson This work is produced by The Connexions Project and licensed under the Creative Commons Attribution License Abstract Discussion

More information

Probability density of nonlinear phase noise

Probability density of nonlinear phase noise Keang-Po Ho Vol. 0, o. 9/September 003/J. Opt. Soc. Am. B 875 Probability density of nonlinear phase noise Keang-Po Ho StrataLight Communications, Campbell, California 95008, and Graduate Institute of

More information

Hadamard speckle contrast reduction

Hadamard speckle contrast reduction Published in OPTICS LETTERS 29, -3 (2004) Hadamard speckle contrast reduction Jahja I. Trisnadi Silicon Light Machines, 385 Moffett Park Drive, Sunnyvale, California 94089 The conditon for a diffuser to

More information

Linear Algebra using Dirac Notation: Pt. 2

Linear Algebra using Dirac Notation: Pt. 2 Linear Algebra using Dirac Notation: Pt. 2 PHYS 476Q - Southern Illinois University February 6, 2018 PHYS 476Q - Southern Illinois University Linear Algebra using Dirac Notation: Pt. 2 February 6, 2018

More information

Lemma 8: Suppose the N by N matrix A has the following block upper triangular form:

Lemma 8: Suppose the N by N matrix A has the following block upper triangular form: 17 4 Determinants and the Inverse of a Square Matrix In this section, we are going to use our knowledge of determinants and their properties to derive an explicit formula for the inverse of a square matrix

More information

Sparse Solutions of an Undetermined Linear System

Sparse Solutions of an Undetermined Linear System 1 Sparse Solutions of an Undetermined Linear System Maddullah Almerdasy New York University Tandon School of Engineering arxiv:1702.07096v1 [math.oc] 23 Feb 2017 Abstract This work proposes a research

More information

Linear Regression and Its Applications

Linear Regression and Its Applications Linear Regression and Its Applications Predrag Radivojac October 13, 2014 Given a data set D = {(x i, y i )} n the objective is to learn the relationship between features and the target. We usually start

More information

Example Linear Algebra Competency Test

Example Linear Algebra Competency Test Example Linear Algebra Competency Test The 4 questions below are a combination of True or False, multiple choice, fill in the blank, and computations involving matrices and vectors. In the latter case,

More information

Numerical solution of the eigenvalue problem for Hermitian Toeplitz-like matrices

Numerical solution of the eigenvalue problem for Hermitian Toeplitz-like matrices TR-CS-9-1 Numerical solution of the eigenvalue problem for Hermitian Toeplitz-like matrices Michael K Ng and William F Trench July 199 Joint Computer Science Technical Report Series Department of Computer

More information

For example, if our Poisson's equation is ex?y (y) dy + sin(x) ; (6) then since L(exp(x)) = 1=(s? 1) and L(sin(x)) = 1=(s 2 + 1),! L?1 1 (s 2 + 1)(1?

For example, if our Poisson's equation is ex?y (y) dy + sin(x) ; (6) then since L(exp(x)) = 1=(s? 1) and L(sin(x)) = 1=(s 2 + 1),! L?1 1 (s 2 + 1)(1? AM55a PDE Solution of Linear Integral Equations Robert M. Corless November 25, 1998 References The main references used for this are [2], [6] and [7]. A. Tadesse used [4, 5, 3] for supplementary material

More information

Segmentation of Dynamic Scenes from the Multibody Fundamental Matrix

Segmentation of Dynamic Scenes from the Multibody Fundamental Matrix ECCV Workshop on Vision and Modeling of Dynamic Scenes, Copenhagen, Denmark, May 2002 Segmentation of Dynamic Scenes from the Multibody Fundamental Matrix René Vidal Dept of EECS, UC Berkeley Berkeley,

More information

COMP 558 lecture 18 Nov. 15, 2010

COMP 558 lecture 18 Nov. 15, 2010 Least squares We have seen several least squares problems thus far, and we will see more in the upcoming lectures. For this reason it is good to have a more general picture of these problems and how to

More information

Singular value decomposition. If only the first p singular values are nonzero we write. U T o U p =0

Singular value decomposition. If only the first p singular values are nonzero we write. U T o U p =0 Singular value decomposition If only the first p singular values are nonzero we write G =[U p U o ] " Sp 0 0 0 # [V p V o ] T U p represents the first p columns of U U o represents the last N-p columns

More information

22 APPENDIX 1: MATH FACTS

22 APPENDIX 1: MATH FACTS 22 APPENDIX : MATH FACTS 22. Vectors 22.. Definition A vector has a dual definition: It is a segment of a a line with direction, or it consists of its projection on a reference system xyz, usually orthogonal

More information

Chapter 8 The Discrete Fourier Transform

Chapter 8 The Discrete Fourier Transform Chapter 8 The Discrete Fourier Transform Introduction Representation of periodic sequences: the discrete Fourier series Properties of the DFS The Fourier transform of periodic signals Sampling the Fourier

More information

Numerical Linear Algebra Homework Assignment - Week 2

Numerical Linear Algebra Homework Assignment - Week 2 Numerical Linear Algebra Homework Assignment - Week 2 Đoàn Trần Nguyên Tùng Student ID: 1411352 8th October 2016 Exercise 2.1: Show that if a matrix A is both triangular and unitary, then it is diagonal.

More information

2 Tikhonov Regularization and ERM

2 Tikhonov Regularization and ERM Introduction Here we discusses how a class of regularization methods originally designed to solve ill-posed inverse problems give rise to regularized learning algorithms. These algorithms are kernel methods

More information

Principal Component Analysis

Principal Component Analysis Principal Component Analysis CS5240 Theoretical Foundations in Multimedia Leow Wee Kheng Department of Computer Science School of Computing National University of Singapore Leow Wee Kheng (NUS) Principal

More information

IMC 2015, Blagoevgrad, Bulgaria

IMC 2015, Blagoevgrad, Bulgaria IMC 05, Blagoevgrad, Bulgaria Day, July 9, 05 Problem. For any integer n and two n n matrices with real entries, B that satisfy the equation + B ( + B prove that det( det(b. Does the same conclusion follow

More information

18.06 Problem Set 10 - Solutions Due Thursday, 29 November 2007 at 4 pm in

18.06 Problem Set 10 - Solutions Due Thursday, 29 November 2007 at 4 pm in 86 Problem Set - Solutions Due Thursday, 29 November 27 at 4 pm in 2-6 Problem : (5=5+5+5) Take any matrix A of the form A = B H CB, where B has full column rank and C is Hermitian and positive-definite

More information

Hexagonal QMF Banks and Wavelets. A chapter within Time-Frequency and Wavelet Transforms in Biomedical Engineering,

Hexagonal QMF Banks and Wavelets. A chapter within Time-Frequency and Wavelet Transforms in Biomedical Engineering, Hexagonal QMF Banks and Wavelets A chapter within Time-Frequency and Wavelet Transforms in Biomedical Engineering, M. Akay (Editor), New York, NY: IEEE Press, 99. Sergio Schuler and Andrew Laine Computer

More information

1 A complete Fourier series solution

1 A complete Fourier series solution Math 128 Notes 13 In this last set of notes I will try to tie up some loose ends. 1 A complete Fourier series solution First here is an example of the full solution of a pde by Fourier series. Consider

More information

Contents. Acknowledgments

Contents. Acknowledgments Table of Preface Acknowledgments Notation page xii xx xxi 1 Signals and systems 1 1.1 Continuous and discrete signals 1 1.2 Unit step and nascent delta functions 4 1.3 Relationship between complex exponentials

More information

Vision 3D articielle Session 2: Essential and fundamental matrices, their computation, RANSAC algorithm

Vision 3D articielle Session 2: Essential and fundamental matrices, their computation, RANSAC algorithm Vision 3D articielle Session 2: Essential and fundamental matrices, their computation, RANSAC algorithm Pascal Monasse monasse@imagine.enpc.fr IMAGINE, École des Ponts ParisTech Contents Some useful rules

More information

Combinations. April 12, 2006

Combinations. April 12, 2006 Combinations April 12, 2006 Combinations, April 12, 2006 Binomial Coecients Denition. The number of distinct subsets with j elements that can be chosen from a set with n elements is denoted by ( n j).

More information

Automatica, 33(9): , September 1997.

Automatica, 33(9): , September 1997. A Parallel Algorithm for Principal nth Roots of Matrices C. K. Koc and M. _ Inceoglu Abstract An iterative algorithm for computing the principal nth root of a positive denite matrix is presented. The algorithm

More information

2 and bound the error in the ith eigenvector in terms of the relative gap, min j6=i j i? jj j i j j 1=2 : In general, this theory usually restricts H

2 and bound the error in the ith eigenvector in terms of the relative gap, min j6=i j i? jj j i j j 1=2 : In general, this theory usually restricts H Optimal Perturbation Bounds for the Hermitian Eigenvalue Problem Jesse L. Barlow Department of Computer Science and Engineering The Pennsylvania State University University Park, PA 1682-616 e-mail: barlow@cse.psu.edu

More information

which the theoretical results were obtained. Image Signals The geometry of visual scenes under perspective projection generally yields complex image s

which the theoretical results were obtained. Image Signals The geometry of visual scenes under perspective projection generally yields complex image s NonFourier Motion in The Fourier Spectrum Steven S. Beauchemin GRASP Laboratory Department of Computer and Information Science University of Pennsylvania Philadelphia PA 191048 Abstract Typically, image

More information

Problem structure in semidefinite programs arising in control and signal processing

Problem structure in semidefinite programs arising in control and signal processing Problem structure in semidefinite programs arising in control and signal processing Lieven Vandenberghe Electrical Engineering Department, UCLA Joint work with: Mehrdad Nouralishahi, Tae Roh Semidefinite

More information

Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) 1.1 The Formal Denition of a Vector Space

Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) 1.1 The Formal Denition of a Vector Space Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) Contents 1 Vector Spaces 1 1.1 The Formal Denition of a Vector Space.................................. 1 1.2 Subspaces...................................................

More information

Positive definite preserving linear transformations on symmetric matrix spaces

Positive definite preserving linear transformations on symmetric matrix spaces Positive definite preserving linear transformations on symmetric matrix spaces arxiv:1008.1347v1 [math.ra] 7 Aug 2010 Huynh Dinh Tuan-Tran Thi Nha Trang-Doan The Hieu Hue Geometry Group College of Education,

More information

1 One-dimensional lattice

1 One-dimensional lattice 1 One-dimensional lattice 1.1 Gap formation in the nearly free electron model Periodic potential Bloch function x = n e iπn/ax 1 n= ψ k x = e ika u k x u k x = c nk e iπn/ax 3 n= Schrödinger equation [

More information

Some Interesting Problems in Pattern Recognition and Image Processing

Some Interesting Problems in Pattern Recognition and Image Processing Some Interesting Problems in Pattern Recognition and Image Processing JEN-MEI CHANG Department of Mathematics and Statistics California State University, Long Beach jchang9@csulb.edu University of Southern

More information

Linear Algebra: Characteristic Value Problem

Linear Algebra: Characteristic Value Problem Linear Algebra: Characteristic Value Problem . The Characteristic Value Problem Let < be the set of real numbers and { be the set of complex numbers. Given an n n real matrix A; does there exist a number

More information

Computational Methods CMSC/AMSC/MAPL 460. Eigenvalues and Eigenvectors. Ramani Duraiswami, Dept. of Computer Science

Computational Methods CMSC/AMSC/MAPL 460. Eigenvalues and Eigenvectors. Ramani Duraiswami, Dept. of Computer Science Computational Methods CMSC/AMSC/MAPL 460 Eigenvalues and Eigenvectors Ramani Duraiswami, Dept. of Computer Science Eigen Values of a Matrix Recap: A N N matrix A has an eigenvector x (non-zero) with corresponding

More information

Fast Multipole Methods: Fundamentals & Applications. Ramani Duraiswami Nail A. Gumerov

Fast Multipole Methods: Fundamentals & Applications. Ramani Duraiswami Nail A. Gumerov Fast Multipole Methods: Fundamentals & Applications Ramani Duraiswami Nail A. Gumerov Week 1. Introduction. What are multipole methods and what is this course about. Problems from physics, mathematics,

More information

Properties of Matrices and Operations on Matrices

Properties of Matrices and Operations on Matrices Properties of Matrices and Operations on Matrices A common data structure for statistical analysis is a rectangular array or matris. Rows represent individual observational units, or just observations,

More information

Solution: a) Let us consider the matrix form of the system, focusing on the augmented matrix: 0 k k + 1. k 2 1 = 0. k = 1

Solution: a) Let us consider the matrix form of the system, focusing on the augmented matrix: 0 k k + 1. k 2 1 = 0. k = 1 Exercise. Given the system of equations 8 < : x + y + z x + y + z k x + k y + z k where k R. a) Study the system in terms of the values of k. b) Find the solutions when k, using the reduced row echelon

More information

Homework 6 Solutions. Solution. Note {e t, te t, t 2 e t, e 2t } is linearly independent. If β = {e t, te t, t 2 e t, e 2t }, then

Homework 6 Solutions. Solution. Note {e t, te t, t 2 e t, e 2t } is linearly independent. If β = {e t, te t, t 2 e t, e 2t }, then Homework 6 Solutions 1 Let V be the real vector space spanned by the functions e t, te t, t 2 e t, e 2t Find a Jordan canonical basis and a Jordan canonical form of T on V dened by T (f) = f Solution Note

More information

Therefore the new Fourier coefficients are. Module 2 : Signals in Frequency Domain Problem Set 2. Problem 1

Therefore the new Fourier coefficients are. Module 2 : Signals in Frequency Domain Problem Set 2. Problem 1 Module 2 : Signals in Frequency Domain Problem Set 2 Problem 1 Let be a periodic signal with fundamental period T and Fourier series coefficients. Derive the Fourier series coefficients of each of the

More information

Examples. 2-input, 1-output discrete-time systems: 1-input, 1-output discrete-time systems:

Examples. 2-input, 1-output discrete-time systems: 1-input, 1-output discrete-time systems: Discrete-Time s - I Time-Domain Representation CHAPTER 4 These lecture slides are based on "Digital Signal Processing: A Computer-Based Approach, 4th ed." textbook by S.K. Mitra and its instructor materials.

More information

Simultaneous Robust Design and Tolerancing of Compressor Blades

Simultaneous Robust Design and Tolerancing of Compressor Blades Simultaneous Robust Design and Tolerancing of Compressor Blades Eric Dow Aerospace Computational Design Laboratory Department of Aeronautics and Astronautics Massachusetts Institute of Technology GTL Seminar

More information

Maths for Signals and Systems Linear Algebra in Engineering

Maths for Signals and Systems Linear Algebra in Engineering Maths for Signals and Systems Linear Algebra in Engineering Lectures 13 15, Tuesday 8 th and Friday 11 th November 016 DR TANIA STATHAKI READER (ASSOCIATE PROFFESOR) IN SIGNAL PROCESSING IMPERIAL COLLEGE

More information

Elementary 2-Group Character Codes. Abstract. In this correspondence we describe a class of codes over GF (q),

Elementary 2-Group Character Codes. Abstract. In this correspondence we describe a class of codes over GF (q), Elementary 2-Group Character Codes Cunsheng Ding 1, David Kohel 2, and San Ling Abstract In this correspondence we describe a class of codes over GF (q), where q is a power of an odd prime. These codes

More information

DYNAMIC WEIGHT FUNCTIONS FOR A MOVING CRACK II. SHEAR LOADING. University of Bath. Bath BA2 7AY, U.K. University of Cambridge

DYNAMIC WEIGHT FUNCTIONS FOR A MOVING CRACK II. SHEAR LOADING. University of Bath. Bath BA2 7AY, U.K. University of Cambridge DYNAMIC WEIGHT FUNCTIONS FOR A MOVING CRACK II. SHEAR LOADING A.B. Movchan and J.R. Willis 2 School of Mathematical Sciences University of Bath Bath BA2 7AY, U.K. 2 University of Cambridge Department of

More information

The Best Circulant Preconditioners for Hermitian Toeplitz Systems II: The Multiple-Zero Case Raymond H. Chan Michael K. Ng y Andy M. Yip z Abstract In

The Best Circulant Preconditioners for Hermitian Toeplitz Systems II: The Multiple-Zero Case Raymond H. Chan Michael K. Ng y Andy M. Yip z Abstract In The Best Circulant Preconditioners for Hermitian Toeplitz Systems II: The Multiple-ero Case Raymond H. Chan Michael K. Ng y Andy M. Yip z Abstract In [0, 4], circulant-type preconditioners have been proposed

More information

Signatures of GL n Multiplicity Spaces

Signatures of GL n Multiplicity Spaces Signatures of GL n Multiplicity Spaces UROP+ Final Paper, Summer 2016 Mrudul Thatte Mentor: Siddharth Venkatesh Project suggested by Pavel Etingof September 1, 2016 Abstract A stable sequence of GL n representations

More information

MATH 205 HOMEWORK #3 OFFICIAL SOLUTION. Problem 1: Find all eigenvalues and eigenvectors of the following linear transformations. (a) F = R, V = R 3,

MATH 205 HOMEWORK #3 OFFICIAL SOLUTION. Problem 1: Find all eigenvalues and eigenvectors of the following linear transformations. (a) F = R, V = R 3, MATH 205 HOMEWORK #3 OFFICIAL SOLUTION Problem 1: Find all eigenvalues and eigenvectors of the following linear transformations. a F = R, V = R 3, b F = R or C, V = F 2, T = T = 9 4 4 8 3 4 16 8 7 0 1

More information

a11 a A = : a 21 a 22

a11 a A = : a 21 a 22 Matrices The study of linear systems is facilitated by introducing matrices. Matrix theory provides a convenient language and notation to express many of the ideas concisely, and complicated formulas are

More information

Manning & Schuetze, FSNLP (c) 1999,2000

Manning & Schuetze, FSNLP (c) 1999,2000 558 15 Topics in Information Retrieval (15.10) y 4 3 2 1 0 0 1 2 3 4 5 6 7 8 Figure 15.7 An example of linear regression. The line y = 0.25x + 1 is the best least-squares fit for the four points (1,1),

More information

Model Reduction, Centering, and the Karhunen-Loeve Expansion

Model Reduction, Centering, and the Karhunen-Loeve Expansion Model Reduction, Centering, and the Karhunen-Loeve Expansion Sonja Glavaški, Jerrold E. Marsden, and Richard M. Murray 1 Control and Dynamical Systems, 17-81 California Institute of Technology Pasadena,

More information

arxiv: v1 [quant-ph] 8 Sep 2010

arxiv: v1 [quant-ph] 8 Sep 2010 Few-Body Systems, (8) Few- Body Systems c by Springer-Verlag 8 Printed in Austria arxiv:9.48v [quant-ph] 8 Sep Two-boson Correlations in Various One-dimensional Traps A. Okopińska, P. Kościk Institute

More information

Inverses. Stephen Boyd. EE103 Stanford University. October 28, 2017

Inverses. Stephen Boyd. EE103 Stanford University. October 28, 2017 Inverses Stephen Boyd EE103 Stanford University October 28, 2017 Outline Left and right inverses Inverse Solving linear equations Examples Pseudo-inverse Left and right inverses 2 Left inverses a number

More information

Deep Learning Book Notes Chapter 2: Linear Algebra

Deep Learning Book Notes Chapter 2: Linear Algebra Deep Learning Book Notes Chapter 2: Linear Algebra Compiled By: Abhinaba Bala, Dakshit Agrawal, Mohit Jain Section 2.1: Scalars, Vectors, Matrices and Tensors Scalar Single Number Lowercase names in italic

More information

I = i 0,

I = i 0, Special Types of Matrices Certain matrices, such as the identity matrix 0 0 0 0 0 0 I = 0 0 0, 0 0 0 have a special shape, which endows the matrix with helpful properties The identity matrix is an example

More information

On the Speed of Quantum Computers with Finite Size Clocks

On the Speed of Quantum Computers with Finite Size Clocks On the Speed of Quantum Computers with Finite Size Clocks Tino Gramss SFI WORKING PAPER: 1995-1-8 SFI Working Papers contain accounts of scientific work of the author(s) and do not necessarily represent

More information

Review Smoothing Spatial Filters Sharpening Spatial Filters. Spatial Filtering. Dr. Praveen Sankaran. Department of ECE NIT Calicut.

Review Smoothing Spatial Filters Sharpening Spatial Filters. Spatial Filtering. Dr. Praveen Sankaran. Department of ECE NIT Calicut. Spatial Filtering Dr. Praveen Sankaran Department of ECE NIT Calicut January 7, 203 Outline 2 Linear Nonlinear 3 Spatial Domain Refers to the image plane itself. Direct manipulation of image pixels. Figure:

More information