arxiv: v1 [math.pr] 26 Jan 2019
|
|
- Holly Reynolds
- 5 years ago
- Views:
Transcription
1 Uniqueness of the Gaussian Orthogonal Ensemble José Ángel Sánchez Gómez, Victor Amaya Carvajal. December, 017. arxiv: v1 [math.pr] 6 Jan 019 Abstract It is not hard to prove that, given a random Wigner matrix X that belongs to the Gaussian Orthogonal Ensemble (GOE), then X is invariant under orthogonal conjugations. Our aim is to prove that if X is a random symmetric matrix that is invariant under orthogonal transformations then such matrix X belongs to the GOE. We will to this using nothing more than the characteristic function. 1 Introduction We will proof of the characterization of the matrices that belong to the Gaussian Orthogonal Ensemble. This work was done as a project for the course of Random Matrices at the Centro de Investigación en Matemáticas, A.C. (CIMAT). Notation We will denote by M n m (F), the set of matrices of size n m over the field F. The matrix I d d will denote the identity matrix of the set M d d (F). We will denote by O(d) the set of orthogonal matrices of M d d (F). This means, if O O(n) then O O = OO = I n n. A symmetric matrix X is a square matrix such that X = X. 3 Background We define the characteristic function of a random variable R to be a function ϕ R : R C given by, ϕ R (t) = E [ e itr], t R. In particular, given a random variable R N(µ,σ ), its characteristic function is given by: ϕ R (t) = E[e itr ] = e iµt 1 σ t. Another important thing to remember is that if two random variables R 1,R are such that their characteristic function coincide in every point, then their distributions are the same. In other words, if ϕ X (t) = ϕ Y (t), for every t R, then X Y. Given a symmetric random matrix X S d its characteristic function is defined by: C X : S d C C X (M) = E[exp{iTr(X M)}], M S d. Recall that the trace is invariant under cyclic permutations. From this, if A M d d (R) and for all M S d. jose.sanchez@cimat.mx victor.amaya@cimat.mx C X (A MA) = E[exp{iTr(X A MA)}] = E[exp{iTr(A X AM)}] = E[exp{iTr([A X A] M)}] = C A XA(M). 1
2 Notice that, if A,B S d, Tr(A B) = Furthermore, if A,B S d, (A B) jj = Tr(A B) = (A ) jk B kj = j,k=1 A jj B jj + j,k=1 A jk B jk. From this, note that C X (M) = E[exp{iTr(X M)}] = E exp i M jj X jj +i A kj B kj. M kj X kj. Furthermore, if the entries of the matrix X are independent, we get a concise formula of the characteristic function in terms of the characteristic functions of each entry: C X (M) = d E[exp{iM jj X jj }] E[exp{iM kj X kj }]. It will be useful to keep this formula in mind when computing the value of the characteristic function on particular symmetric matrices. 4 The problem Our aim is to prove the following theorem using nothing more than the characteristic function of a random matrix. Theorem 1. Let X be a random symmetric d d matrix such that it is invariant under orthogonal transformations. Suppose that all the entries of X are independent with finite variance. Then, there exist a matrix belonging to the Gaussian Orthogonal Ensemble Y, and real numbers µ R, σ 0 such that X = µi d d +σ Y. We will divided our prove into three steps: Show that the elements inside the diagonal share the same distribution, and that all the elements outside the main diagonal share the same distribution. Show that is enough to prove the result for square matrices. We will prove that the characteristic functions of the elements of the matrix X correspond to normally distributed random variables. Proof: Lets proof every step. First step: Let us define the matrix A t (k,j) as the matrix that has the value t in the positions (k,j) and (j,k) and zeros everywhere else, for 1 k < j d and t R. If we calculate the the characteristic function of A t (k,j) we obtain: [ { }] C X (A (k,j) (t)) = E exp itr((a t (k,j) ) X) = E[exp{itX kj }] = φ Xkj (t). Now, let k j and l g. There exists a permutation matrix P O(d) such that for all t R, P A t (k,j) P = At (l,g). From the in-variance of X with respect to orthogonal conjugations:
3 ϕ Xkj (t) = C X (A t (k,j) ) = C X(P A t (k,j) P) = C X(A t (l,g) ) = ϕ X lg (t), t R. It follows that X kj X lg. It means that all entries outside the main diagonal have the same distribution. In an analogous way, by conjugating we can prove that if 1 j < k d, X kj X kj. This implies the distribution of the entries outside of the diagonal are symmetric. This is because all entries of the matrix have finite second moment, E(X kj ) = 0. Now, let A t i = diag(t e j), i.e. a matrix that has as only non-zero entry t in the position (j,j), for 1 j d and t R. From this, C X (A t j) = E [ exp { itr((a t j) X) }] = E[exp{itX jj }] = ϕ Xjj (t), for all 1 j d and t R. Now, given j k, there exists a permutation matrix Q O(d) such that Q A t j Q = At k.from this, ϕ Xjj (t) = C X (A t j ) = C X(Q A t j Q) = C X(A t k ) = ϕ X kk (t) t R. Thus X jj X kk for all j k. Then, all entries in the diagonal have the same distribution. Second step: In the last step, we have just proved that all entries in the diagonal have the same distribution, and the entries outside the diagonal also have the same distribution. From this, it is possible to find the distribution of all entries of the matrix X by finding the distribution of the entries of the sub-matrix, X11 X X = 1. X 1 X It can be proved that X is invariant with respect to rotations in R. For this, let θ R and, Q Mθ 0 θ = M 0 I d d (R), (d ) (d ) where, Q θ = cos(θ) sin(θ) M sin(θ) cos(θ). (R). The matrix Q θ is an orthogonal matrix which rotates the first two coordinates and fixes the rest. Let M S, where, a b M = S b d. We can embed M into S d by filling all entries outside the first sub-matrix with zeros: M M 0 = S 0 0 d. We observe that, C X (M ) = E[exp{iTr(M X)}] = E[exp{i(aX 11 +bx 1 +dx )}] = C X (M). By evaluating the characteristic function of X on M and using the orthogonal in-variance, and considering that all entries outside the matrix in M are zero, C X (M) = C X (M ) = C X ((Q θ ) M Q θ ) = C X (Q θ MQ θ). 3
4 Third part: Since we have reduced the problem to the case of matrices of, we will keep M and Q θ to be the matrices defined in the previous step. We take M θ = Q θ MQ θ, a symmetric matrix. Name the entries of M θ as follow A B M θ =, B D we can compute explicitly the values of A,B,D in function the entries of M. We get the following: A = a+d B = a d D = a+d + a d cos(θ) bsin(θ), sin(θ)+bcos(θ), a d cos(θ)+bsin(θ). These expressions are valid for everyθ R.If we calculate the derivatives of the last expressions with respect to θ, what we get is the following: da dθ = B, db dθ = A D, Now, since X is invariant under rotations, we have that: C X (M θ ) = C X (M). dd dθ = B (1) Computing the characteristic function on both matrices we obtain that, ϕ 1 (a)ϕ (b)ϕ 1 (d) = ϕ 1 (A)ϕ (B)ϕ 1 (D), () where ϕ 1 represents the characteristic function of the random variable X 11 (which is the same of X since the have the same distribution). And ϕ is the characteristic function of X 1. Since entries of X have finite variance ϕ 1 and ϕ are at least two times derivable at zero and φ j (0) = ie(x 1j) for j = 1,. We can derive equation (1) with respect to θ, we get: 0 = ϕ 1(A)ϕ (B)ϕ 1 (D) da dθ +ϕ 1(A)ϕ (B)ϕ 1 (D) db dθ +ϕ 1(A)ϕ (B)ϕ 1(D) dd (3) dθ Note that since ϕ 1 (0) = ϕ (0) = 1, and the are continuous at zero, there exist an open set around zero where these functions are not zero. So, we can rewrite equation (3) in the following way: 0 = ϕ 1 (A) ϕ 1 (A) ϕ 1(A)ϕ (B)ϕ 1 (D) da dθ + ϕ (B) ϕ (B) ϕ 1(A)ϕ (B)ϕ 1 (D) db dθ + + ϕ 1(D) ϕ 1 (D) ϕ 1(A)ϕ (B)ϕ 1 (D) dd dθ. Now, replacing the values we found in (1) and dividing by B(A D) (for those values B 0,A D), we get that 1 ϕ [ ] (B) B ϕ (B) = 1 ϕ 1 (A) A D ϕ 1 (A) ϕ 1(D) (4) ϕ 1 (D) We observed that the left hand side of (4) only depends on B, whereas the right hand side depends in both A and D. By this observation by can conclude that (4) is a constant. Then, there exists k R such that: 1 ϕ (B) B ϕ (B) = k, Observe that, since ϕ is the characteristic function of a symmetric random variable, the codomain of ϕ is contained in R. This implies k R. Now, lets take x = B. We have that ϕ (x) = xk ϕ(x). This is an easy real-valued ODE whose solution is given by ϕ (x) = B 0 e kx, 4
5 for some B 0 R. Now, as ϕ is a characteristic function it is true that ϕ (0) = 1. This give us as a result that B 0 = 1 so we have. ϕ (x) = e k At first, we have this in a neighborhood of 0 R, but we can extend this solution to be for all R. Observe that if k < 0 then ϕ (t) when t. This leads to a contradiction since characteristic functions have bounded image. Then, if k > 0 and ϕ is the characteristic function of a normal random variable with parameters N(0,k/). Given k = 0, ϕ is the characteristic function of a singular distribution at 0. On the other hand, taking D = 0 in equation (4), it follows that 1 A x. [ ϕ 1 (A) ϕ 1 (A) ϕ 1 (0) ϕ 1 (0) We know that ϕ 1 (0) = 1 and that ϕ (0) = iµ, where µ = E(X 11 ). So, ϕ 1 (A) ϕ(a) = Ak +iµ ϕ 1 (A) = ( Ak +iµ)ϕ 1(A). The solution to this ODE is ϕ 1 (x) = e iµx kx. which is nothing more than the characteristic function of a random variable with distribution N(µ,k). Since k is non-negative we can write it as k = σ. So we can write that characteristic functions in the following way: ]. ϕ 1 (x) = e iµx σ x, ϕ (x) = e σ x. which means that X 11 N(µ,σ ) and X 1 N(0,σ ). With this, we proved that X jj N(µ,σ ) and X kj N(0,σ ). Now, if the take a GOE matrix Y, i.e., Y ii N(0,) and Y jk N(0,1), for every j k, we conclude that: X σ Y +µi d. We see that X is clearly invariant under orthogonal conjugations. 5 Conclusions There are important remarks that are worth stressing about this proof. First, we find interesting that it unfolded by using just elementary knowledge of basic properties of characteristic functions, differential equations and linear algebra. It is a basic proof for this result. Second, it states a generalization of the standard result. This result is proved usually for matrices that have zero-mean entries. This proof allow us to study general matrices that are invariant with respect to orthogonal conjugations. The independence of the entries is key for this proof. One example of a distribution that is invariant under orthogonal conjugation is the Haar distribution on O(d). This distribution does not hold the entry-wise independence since orthogonal matrices satisfy relations between them. In terms of this work, it is key to write the characteristic function of the matrix in terms of the product of the characteristic function of each entry. One possible extension of this project is to find the distribution of Wishart matrices by applying the same characteristic-function approach. References [1] Yi-Kai Liu. Mathematics Junior Seminar, Spring 001. Princeton University. [] Measure Theory and Probability Theory. Krishna B. Athreya and Soumendra N. Lahiri. Springer Text in Statistics. 5
Fundamentals of Unconstrained Optimization
dalmau@cimat.mx Centro de Investigación en Matemáticas CIMAT A.C. Mexico Enero 2016 Outline Introduction 1 Introduction 2 3 4 Optimization Problem min f (x) x Ω where f (x) is a real-valued function The
More informationEigenvalue PDFs. Peter Forrester, M&S, University of Melbourne
Outline Eigenvalue PDFs Peter Forrester, M&S, University of Melbourne Hermitian matrices with real, complex or real quaternion elements Circular ensembles and classical groups Products of random matrices
More informationBasic Concepts in Matrix Algebra
Basic Concepts in Matrix Algebra An column array of p elements is called a vector of dimension p and is written as x p 1 = x 1 x 2. x p. The transpose of the column vector x p 1 is row vector x = [x 1
More informationMAC Module 1 Systems of Linear Equations and Matrices I
MAC 2103 Module 1 Systems of Linear Equations and Matrices I 1 Learning Objectives Upon completing this module, you should be able to: 1. Represent a system of linear equations as an augmented matrix.
More informationChapter 1: Systems of linear equations and matrices. Section 1.1: Introduction to systems of linear equations
Chapter 1: Systems of linear equations and matrices Section 1.1: Introduction to systems of linear equations Definition: A linear equation in n variables can be expressed in the form a 1 x 1 + a 2 x 2
More informationGaussian Models (9/9/13)
STA561: Probabilistic machine learning Gaussian Models (9/9/13) Lecturer: Barbara Engelhardt Scribes: Xi He, Jiangwei Pan, Ali Razeen, Animesh Srivastava 1 Multivariate Normal Distribution The multivariate
More informationRandom Matrix Theory Lecture 3 Free Probability Theory. Symeon Chatzinotas March 4, 2013 Luxembourg
Random Matrix Theory Lecture 3 Free Probability Theory Symeon Chatzinotas March 4, 2013 Luxembourg Outline 1. Free Probability Theory 1. Definitions 2. Asymptotically free matrices 3. R-transform 4. Additive
More informationGaussian vectors and central limit theorem
Gaussian vectors and central limit theorem Samy Tindel Purdue University Probability Theory 2 - MA 539 Samy T. Gaussian vectors & CLT Probability Theory 1 / 86 Outline 1 Real Gaussian random variables
More informationFoundations of Matrix Analysis
1 Foundations of Matrix Analysis In this chapter we recall the basic elements of linear algebra which will be employed in the remainder of the text For most of the proofs as well as for the details, the
More informationRANDOM MATRIX THEORY AND TOEPLITZ DETERMINANTS
RANDOM MATRIX THEORY AND TOEPLITZ DETERMINANTS David García-García May 13, 2016 Faculdade de Ciências da Universidade de Lisboa OVERVIEW Random Matrix Theory Introduction Matrix ensembles A sample computation:
More information4 Group representations
Physics 9b Lecture 6 Caltech, /4/9 4 Group representations 4. Examples Example : D represented as real matrices. ( ( D(e =, D(c = ( ( D(b =, D(b =, D(c = Example : Circle group as rotation of D real vector
More informationDirect Methods for Solving Linear Systems. Simon Fraser University Surrey Campus MACM 316 Spring 2005 Instructor: Ha Le
Direct Methods for Solving Linear Systems Simon Fraser University Surrey Campus MACM 316 Spring 2005 Instructor: Ha Le 1 Overview General Linear Systems Gaussian Elimination Triangular Systems The LU Factorization
More informationA b r i l l i a n t young chemist, T h u r e Wagelius of N e w Y o r k, ac. himself with eth
6 6 0 x J 8 0 J 0 z (0 8 z x x J x 6 000 X j x "" "" " " x " " " x " " " J " " " " " " " " x : 0 z j ; J K 0 J K q 8 K K J x 0 j " " > J x J j z ; j J q J 0 0 8 K J 60 : K 6 x 8 K J :? 0 J J K 0 6% 8 0
More informationMath 416, Spring 2010 More on Algebraic and Geometric Properties January 21, 2010 MORE ON ALGEBRAIC AND GEOMETRIC PROPERTIES
Math 46, Spring 2 More on Algebraic and Geometric Properties January 2, 2 MORE ON ALGEBRAIC AND GEOMETRIC PROPERTIES Algebraic properties Algebraic properties of matrix/vector multiplication Last time
More informationA CLASS OF SCHUR MULTIPLIERS ON SOME QUASI-BANACH SPACES OF INFINITE MATRICES
A CLASS OF SCHUR MULTIPLIERS ON SOME QUASI-BANACH SPACES OF INFINITE MATRICES NICOLAE POPA Abstract In this paper we characterize the Schur multipliers of scalar type (see definition below) acting on scattered
More informationLinear Algebra and Matrix Inversion
Jim Lambers MAT 46/56 Spring Semester 29- Lecture 2 Notes These notes correspond to Section 63 in the text Linear Algebra and Matrix Inversion Vector Spaces and Linear Transformations Matrices are much
More informationMODULE 7. where A is an m n real (or complex) matrix. 2) Let K(t, s) be a function of two variables which is continuous on the square [0, 1] [0, 1].
Topics: Linear operators MODULE 7 We are going to discuss functions = mappings = transformations = operators from one vector space V 1 into another vector space V 2. However, we shall restrict our sights
More informationSecond Order Freeness and Random Orthogonal Matrices
Second Order Freeness and Random Orthogonal Matrices Jamie Mingo (Queen s University) (joint work with Mihai Popa and Emily Redelmeier) AMS San Diego Meeting, January 11, 2013 1 / 15 Random Matrices X
More informationMATH 431: FIRST MIDTERM. Thursday, October 3, 2013.
MATH 431: FIRST MIDTERM Thursday, October 3, 213. (1) An inner product on the space of matrices. Let V be the vector space of 2 2 real matrices (that is, the algebra Mat 2 (R), but without the mulitiplicative
More information1 Tridiagonal matrices
Lecture Notes: β-ensembles Bálint Virág Notes with Diane Holcomb 1 Tridiagonal matrices Definition 1. Suppose you have a symmetric matrix A, we can define its spectral measure (at the first coordinate
More informationChapter Two Elements of Linear Algebra
Chapter Two Elements of Linear Algebra Previously, in chapter one, we have considered single first order differential equations involving a single unknown function. In the next chapter we will begin to
More informationBasic Linear Algebra in MATLAB
Basic Linear Algebra in MATLAB 9.29 Optional Lecture 2 In the last optional lecture we learned the the basic type in MATLAB is a matrix of double precision floating point numbers. You learned a number
More informationMatrix Lie groups. and their Lie algebras. Mahmood Alaghmandan. A project in fulfillment of the requirement for the Lie algebra course
Matrix Lie groups and their Lie algebras Mahmood Alaghmandan A project in fulfillment of the requirement for the Lie algebra course Department of Mathematics and Statistics University of Saskatchewan March
More informationPractice Algebra Qualifying Exam Solutions
Practice Algebra Qualifying Exam Solutions 1. Let A be an n n matrix with complex coefficients. Define tr A to be the sum of the diagonal elements. Show that tr A is invariant under conjugation, i.e.,
More informationSpan and Linear Independence
Span and Linear Independence It is common to confuse span and linear independence, because although they are different concepts, they are related. To see their relationship, let s revisit the previous
More informationMANIFOLD STRUCTURES IN ALGEBRA
MANIFOLD STRUCTURES IN ALGEBRA MATTHEW GARCIA 1. Definitions Our aim is to describe the manifold structure on classical linear groups and from there deduce a number of results. Before we begin we make
More informationTopics in Representation Theory: SU(n), Weyl Chambers and the Diagram of a Group
Topics in Representation Theory: SU(n), Weyl hambers and the Diagram of a Group 1 Another Example: G = SU(n) Last time we began analyzing how the maximal torus T of G acts on the adjoint representation,
More informationMATH 221: SOLUTIONS TO SELECTED HOMEWORK PROBLEMS
MATH 221: SOLUTIONS TO SELECTED HOMEWORK PROBLEMS 1. HW 1: Due September 4 1.1.21. Suppose v, w R n and c is a scalar. Prove that Span(v + cw, w) = Span(v, w). We must prove two things: that every element
More informationConvergence of Square Root Ensemble Kalman Filters in the Large Ensemble Limit
Convergence of Square Root Ensemble Kalman Filters in the Large Ensemble Limit Evan Kwiatkowski, Jan Mandel University of Colorado Denver December 11, 2014 OUTLINE 2 Data Assimilation Bayesian Estimation
More information1 4 (1 cos(4θ))dθ = θ 4 sin(4θ)
M48M Final Exam Solutions, December 9, 5 ) A polar curve Let C be the portion of the cloverleaf curve r = sin(θ) that lies in the first quadrant a) Draw a rough sketch of C This looks like one quarter
More informationNotes on Linear Algebra and Matrix Theory
Massimo Franceschet featuring Enrico Bozzo Scalar product The scalar product (a.k.a. dot product or inner product) of two real vectors x = (x 1,..., x n ) and y = (y 1,..., y n ) is not a vector but a
More informationx + 2y + 3z = 8 x + 3y = 7 x + 2z = 3
Chapter 2: Solving Linear Equations 23 Elimination Using Matrices As we saw in the presentation, we can use elimination to make a system of linear equations into an upper triangular system that is easy
More informationMath 370 Spring 2016 Sample Midterm with Solutions
Math 370 Spring 2016 Sample Midterm with Solutions Contents 1 Problems 2 2 Solutions 5 1 1 Problems (1) Let A be a 3 3 matrix whose entries are real numbers such that A 2 = 0. Show that I 3 + A is invertible.
More informationQueens College, CUNY, Department of Computer Science Numerical Methods CSCI 361 / 761 Spring 2018 Instructor: Dr. Sateesh Mane.
Queens College, CUNY, Department of Computer Science Numerical Methods CSCI 361 / 761 Spring 2018 Instructor: Dr. Sateesh Mane c Sateesh R. Mane 2018 8 Lecture 8 8.1 Matrices July 22, 2018 We shall study
More informationLectures 6 7 : Marchenko-Pastur Law
Fall 2009 MATH 833 Random Matrices B. Valkó Lectures 6 7 : Marchenko-Pastur Law Notes prepared by: A. Ganguly We will now turn our attention to rectangular matrices. Let X = (X 1, X 2,..., X n ) R p n
More informationSAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear Algebra
1.1. Introduction SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear algebra is a specific branch of mathematics dealing with the study of vectors, vector spaces with functions that
More informationSAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear Algebra
SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to 1.1. Introduction Linear algebra is a specific branch of mathematics dealing with the study of vectors, vector spaces with functions that
More informationPhysics 110. Electricity and Magnetism. Professor Dine. Spring, Handout: Vectors and Tensors: Everything You Need to Know
Physics 110. Electricity and Magnetism. Professor Dine Spring, 2008. Handout: Vectors and Tensors: Everything You Need to Know What makes E&M hard, more than anything else, is the problem that the electric
More informationNotes on Random Vectors and Multivariate Normal
MATH 590 Spring 06 Notes on Random Vectors and Multivariate Normal Properties of Random Vectors If X,, X n are random variables, then X = X,, X n ) is a random vector, with the cumulative distribution
More informationLinear Algebra March 16, 2019
Linear Algebra March 16, 2019 2 Contents 0.1 Notation................................ 4 1 Systems of linear equations, and matrices 5 1.1 Systems of linear equations..................... 5 1.2 Augmented
More informationCLASSIFICATION OF COMPLETELY POSITIVE MAPS 1. INTRODUCTION
CLASSIFICATION OF COMPLETELY POSITIVE MAPS STEPHAN HOYER ABSTRACT. We define a completely positive map and classify all completely positive linear maps. We further classify all such maps that are trace-preserving
More informationA Primer on Three Vectors
Michael Dine Department of Physics University of California, Santa Cruz September 2010 What makes E&M hard, more than anything else, is the problem that the electric and magnetic fields are vectors, and
More informationUC Berkeley Department of Electrical Engineering and Computer Sciences. EECS 126: Probability and Random Processes
UC Berkeley Department of Electrical Engineering and Computer Sciences EECS 6: Probability and Random Processes Problem Set 3 Spring 9 Self-Graded Scores Due: February 8, 9 Submit your self-graded scores
More informationMATRIX ALGEBRA. or x = (x 1,..., x n ) R n. y 1 y 2. x 2. x m. y m. y = cos θ 1 = x 1 L x. sin θ 1 = x 2. cos θ 2 = y 1 L y.
as Basics Vectors MATRIX ALGEBRA An array of n real numbers x, x,, x n is called a vector and it is written x = x x n or x = x,, x n R n prime operation=transposing a column to a row Basic vector operations
More informationPURE MATHEMATICS AM 27
AM Syllabus (014): Pure Mathematics AM SYLLABUS (014) PURE MATHEMATICS AM 7 SYLLABUS 1 AM Syllabus (014): Pure Mathematics Pure Mathematics AM 7 Syllabus (Available in September) Paper I(3hrs)+Paper II(3hrs)
More informationELEMENTARY LINEAR ALGEBRA
ELEMENTARY LINEAR ALGEBRA K. R. MATTHEWS DEPARTMENT OF MATHEMATICS UNIVERSITY OF QUEENSLAND Corrected Version, 7th April 013 Comments to the author at keithmatt@gmail.com Chapter 1 LINEAR EQUATIONS 1.1
More informationWigner s semicircle law
CHAPTER 2 Wigner s semicircle law 1. Wigner matrices Definition 12. A Wigner matrix is a random matrix X =(X i, j ) i, j n where (1) X i, j, i < j are i.i.d (real or complex valued). (2) X i,i, i n are
More informationGaussian Elimination and Back Substitution
Jim Lambers MAT 610 Summer Session 2009-10 Lecture 4 Notes These notes correspond to Sections 31 and 32 in the text Gaussian Elimination and Back Substitution The basic idea behind methods for solving
More informationReview problems for MA 54, Fall 2004.
Review problems for MA 54, Fall 2004. Below are the review problems for the final. They are mostly homework problems, or very similar. If you are comfortable doing these problems, you should be fine on
More informationChapter 2 Notes, Linear Algebra 5e Lay
Contents.1 Operations with Matrices..................................1.1 Addition and Subtraction.............................1. Multiplication by a scalar............................ 3.1.3 Multiplication
More informationVolume in n Dimensions
Volume in n Dimensions MA 305 Kurt Bryan Introduction You ve seen that if we have two vectors v and w in two dimensions then the area spanned by these vectors can be computed as v w = v 1 w 2 v 2 w 1 (where
More informationRandom Fermionic Systems
Random Fermionic Systems Fabio Cunden Anna Maltsev Francesco Mezzadri University of Bristol December 9, 2016 Maltsev (University of Bristol) Random Fermionic Systems December 9, 2016 1 / 27 Background
More informationPH1105 Lecture Notes on Linear Algebra.
PH05 Lecture Notes on Linear Algebra Joe Ó hógáin E-mail: johog@mathstcdie Main Text: Calculus for the Life Sciences by Bittenger, Brand and Quintanilla Other Text: Linear Algebra by Anton and Rorres Matrices
More informationSQUARE ROOTS OF 2x2 MATRICES 1. Sam Northshield SUNY-Plattsburgh
SQUARE ROOTS OF x MATRICES Sam Northshield SUNY-Plattsburgh INTRODUCTION A B What is the square root of a matrix such as? It is not, in general, A B C D C D This is easy to see since the upper left entry
More informationforms Christopher Engström November 14, 2014 MAA704: Matrix factorization and canonical forms Matrix properties Matrix factorization Canonical forms
Christopher Engström November 14, 2014 Hermitian LU QR echelon Contents of todays lecture Some interesting / useful / important of matrices Hermitian LU QR echelon Rewriting a as a product of several matrices.
More informationAnalysis-3 lecture schemes
Analysis-3 lecture schemes (with Homeworks) 1 Csörgő István November, 2015 1 A jegyzet az ELTE Informatikai Kar 2015. évi Jegyzetpályázatának támogatásával készült Contents 1. Lesson 1 4 1.1. The Space
More informationMathematics. EC / EE / IN / ME / CE. for
Mathematics for EC / EE / IN / ME / CE By www.thegateacademy.com Syllabus Syllabus for Mathematics Linear Algebra: Matrix Algebra, Systems of Linear Equations, Eigenvalues and Eigenvectors. Probability
More information. =. a i1 x 1 + a i2 x 2 + a in x n = b i. a 11 a 12 a 1n a 21 a 22 a 1n. i1 a i2 a in
Vectors and Matrices Continued Remember that our goal is to write a system of algebraic equations as a matrix equation. Suppose we have the n linear algebraic equations a x + a 2 x 2 + a n x n = b a 2
More information5 Operations on Multiple Random Variables
EE360 Random Signal analysis Chapter 5: Operations on Multiple Random Variables 5 Operations on Multiple Random Variables Expected value of a function of r.v. s Two r.v. s: ḡ = E[g(X, Y )] = g(x, y)f X,Y
More informationA Generalization of Wigner s Law
A Generalization of Wigner s Law Inna Zakharevich June 2, 2005 Abstract We present a generalization of Wigner s semicircle law: we consider a sequence of probability distributions (p, p 2,... ), with mean
More informationThe University of Texas at Austin Department of Electrical and Computer Engineering. EE381V: Large Scale Learning Spring 2013.
The University of Texas at Austin Department of Electrical and Computer Engineering EE381V: Large Scale Learning Spring 2013 Assignment Two Caramanis/Sanghavi Due: Tuesday, Feb. 19, 2013. Computational
More informationRadial Basis Functions I
Radial Basis Functions I Tom Lyche Centre of Mathematics for Applications, Department of Informatics, University of Oslo November 14, 2008 Today Reformulation of natural cubic spline interpolation Scattered
More information( ) = ( ) ( ) = ( ) = + = = = ( ) Therefore: , where t. Note: If we start with the condition BM = tab, we will have BM = ( x + 2, y + 3, z 5)
Chapter Exercise a) AB OB OA ( xb xa, yb ya, zb za),,, 0, b) AB OB OA ( xb xa, yb ya, zb za) ( ), ( ),, 0, c) AB OB OA x x, y y, z z (, ( ), ) (,, ) ( ) B A B A B A ( ) d) AB OB OA ( xb xa, yb ya, zb za)
More informationSystems of Linear Equations and Matrices
Chapter 1 Systems of Linear Equations and Matrices System of linear algebraic equations and their solution constitute one of the major topics studied in the course known as linear algebra. In the first
More informationOn Expected Gaussian Random Determinants
On Expected Gaussian Random Determinants Moo K. Chung 1 Department of Statistics University of Wisconsin-Madison 1210 West Dayton St. Madison, WI 53706 Abstract The expectation of random determinants whose
More information. a m1 a mn. a 1 a 2 a = a n
Biostat 140655, 2008: Matrix Algebra Review 1 Definition: An m n matrix, A m n, is a rectangular array of real numbers with m rows and n columns Element in the i th row and the j th column is denoted by
More informationMatrices and Determinants
Chapter1 Matrices and Determinants 11 INTRODUCTION Matrix means an arrangement or array Matrices (plural of matrix) were introduced by Cayley in 1860 A matrix A is rectangular array of m n numbers (or
More informationLattices and Hermite normal form
Integer Points in Polyhedra Lattices and Hermite normal form Gennady Shmonin February 17, 2009 1 Lattices Let B = { } b 1,b 2,...,b k be a set of linearly independent vectors in n-dimensional Euclidean
More informationSystems of Linear Equations and Matrices
Chapter 1 Systems of Linear Equations and Matrices System of linear algebraic equations and their solution constitute one of the major topics studied in the course known as linear algebra. In the first
More informationThe Solution of Linear Systems AX = B
Chapter 2 The Solution of Linear Systems AX = B 21 Upper-triangular Linear Systems We will now develop the back-substitution algorithm, which is useful for solving a linear system of equations that has
More information1 Intro to RMT (Gene)
M705 Spring 2013 Summary for Week 2 1 Intro to RMT (Gene) (Also see the Anderson - Guionnet - Zeitouni book, pp.6-11(?) ) We start with two independent families of R.V.s, {Z i,j } 1 i
More informationSemidefinite and Second Order Cone Programming Seminar Fall 2001 Lecture 2
Semidefinite and Second Order Cone Programming Seminar Fall 2001 Lecture 2 Instructor: Farid Alizadeh Scribe: Xuan Li 9/17/2001 1 Overview We survey the basic notions of cones and cone-lp and give several
More informationMath 577 Assignment 7
Math 577 Assignment 7 Thanks for Yu Cao 1. Solution. The linear system being solved is Ax = 0, where A is a (n 1 (n 1 matrix such that 2 1 1 2 1 A =......... 1 2 1 1 2 and x = (U 1, U 2,, U n 1. By the
More informationELEMENTARY LINEAR ALGEBRA
ELEMENTARY LINEAR ALGEBRA K R MATTHEWS DEPARTMENT OF MATHEMATICS UNIVERSITY OF QUEENSLAND First Printing, 99 Chapter LINEAR EQUATIONS Introduction to linear equations A linear equation in n unknowns x,
More informationLinear Algebra Review (Course Notes for Math 308H - Spring 2016)
Linear Algebra Review (Course Notes for Math 308H - Spring 2016) Dr. Michael S. Pilant February 12, 2016 1 Background: We begin with one of the most fundamental notions in R 2, distance. Letting (x 1,
More informationSTAT215: Solutions for Homework 2
STAT25: Solutions for Homework 2 Due: Wednesday, Feb 4. (0 pt) Suppose we take one observation, X, from the discrete distribution, x 2 0 2 Pr(X x θ) ( θ)/4 θ/2 /2 (3 θ)/2 θ/4, 0 θ Find an unbiased estimator
More information= a. a = Let us now study what is a? c ( a A a )
7636S ADVANCED QUANTUM MECHANICS Solutions 1 Spring 010 1 Warm up a Show that the eigenvalues of a Hermitian operator A are real and that the eigenkets of A corresponding to dierent eigenvalues are orthogonal
More informationMath Linear Algebra Final Exam Review Sheet
Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of
More informationLinear algebra. S. Richard
Linear algebra S. Richard Fall Semester 2014 and Spring Semester 2015 2 Contents Introduction 5 0.1 Motivation.................................. 5 1 Geometric setting 7 1.1 The Euclidean space R n..........................
More informationAMS 209, Fall 2015 Final Project Type A Numerical Linear Algebra: Gaussian Elimination with Pivoting for Solving Linear Systems
AMS 209, Fall 205 Final Project Type A Numerical Linear Algebra: Gaussian Elimination with Pivoting for Solving Linear Systems. Overview We are interested in solving a well-defined linear system given
More informationMath Camp II. Basic Linear Algebra. Yiqing Xu. Aug 26, 2014 MIT
Math Camp II Basic Linear Algebra Yiqing Xu MIT Aug 26, 2014 1 Solving Systems of Linear Equations 2 Vectors and Vector Spaces 3 Matrices 4 Least Squares Systems of Linear Equations Definition A linear
More information1 g 1,gg 2 xg 1. 2 g 1,...,gg n xg 1. n g 1 } = {gxg 1,gg 1 x(gg 1 ) 1,gg 2 x(gg 2 ) 1,...,gg n x(gg n ) 1 } = {x,g 1 xg 1. 2,...
Physics 5 Solution Set Spring 7. A finite group G can be decomposed into conjugacy classes C k. (a) Construct the set C k gc kg, which is obtained by replacing each element x C k by gxg. Prove that C k
More informationMath 5630: Iterative Methods for Systems of Equations Hung Phan, UMass Lowell March 22, 2018
1 Linear Systems Math 5630: Iterative Methods for Systems of Equations Hung Phan, UMass Lowell March, 018 Consider the system 4x y + z = 7 4x 8y + z = 1 x + y + 5z = 15. We then obtain x = 1 4 (7 + y z)
More information1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i )
Direct Methods for Linear Systems Chapter Direct Methods for Solving Linear Systems Per-Olof Persson persson@berkeleyedu Department of Mathematics University of California, Berkeley Math 18A Numerical
More information9 Radon-Nikodym theorem and conditioning
Tel Aviv University, 2015 Functions of real variables 93 9 Radon-Nikodym theorem and conditioning 9a Borel-Kolmogorov paradox............. 93 9b Radon-Nikodym theorem.............. 94 9c Conditioning.....................
More informationCS412: Lecture #17. Mridul Aanjaneya. March 19, 2015
CS: Lecture #7 Mridul Aanjaneya March 9, 5 Solving linear systems of equations Consider a lower triangular matrix L: l l l L = l 3 l 3 l 33 l n l nn A procedure similar to that for upper triangular systems
More informationLeast-Squares Rigid Motion Using SVD
Least-Squares igid Motion Using SVD Olga Sorkine Abstract his note summarizes the steps to computing the rigid transformation that aligns two sets of points Key words: Shape matching, rigid alignment,
More informationLecture 10 - Eigenvalues problem
Lecture 10 - Eigenvalues problem Department of Computer Science University of Houston February 28, 2008 1 Lecture 10 - Eigenvalues problem Introduction Eigenvalue problems form an important class of problems
More informationComputationally, diagonal matrices are the easiest to work with. With this idea in mind, we introduce similarity:
Diagonalization We have seen that diagonal and triangular matrices are much easier to work with than are most matrices For example, determinants and eigenvalues are easy to compute, and multiplication
More informationVersal deformations in generalized flag manifolds
Versal deformations in generalized flag manifolds X. Puerta Departament de Matemàtica Aplicada I Escola Tècnica Superior d Enginyers Industrials de Barcelona, UPC Av. Diagonal, 647 08028 Barcelona, Spain
More informationMATH 106 LINEAR ALGEBRA LECTURE NOTES
MATH 6 LINEAR ALGEBRA LECTURE NOTES FALL - These Lecture Notes are not in a final form being still subject of improvement Contents Systems of linear equations and matrices 5 Introduction to systems of
More informationFree Probability Theory and Random Matrices. Roland Speicher Queen s University Kingston, Canada
Free Probability Theory and Random Matrices Roland Speicher Queen s University Kingston, Canada We are interested in the limiting eigenvalue distribution of N N random matrices for N. Usually, large N
More informationYale University Department of Mathematics Math 350 Introduction to Abstract Algebra Fall Midterm Exam Review Solutions
Yale University Department of Mathematics Math 350 Introduction to Abstract Algebra Fall 2015 Midterm Exam Review Solutions Practice exam questions: 1. Let V 1 R 2 be the subset of all vectors whose slope
More informationDifferential Topology Final Exam With Solutions
Differential Topology Final Exam With Solutions Instructor: W. D. Gillam Date: Friday, May 20, 2016, 13:00 (1) Let X be a subset of R n, Y a subset of R m. Give the definitions of... (a) smooth function
More informationQuantum Computing Lecture 2. Review of Linear Algebra
Quantum Computing Lecture 2 Review of Linear Algebra Maris Ozols Linear algebra States of a quantum system form a vector space and their transformations are described by linear operators Vector spaces
More informationMathematical Methods wk 2: Linear Operators
John Magorrian, magog@thphysoxacuk These are work-in-progress notes for the second-year course on mathematical methods The most up-to-date version is available from http://www-thphysphysicsoxacuk/people/johnmagorrian/mm
More informationEE126: Problem Set # 7: Solutions
EE26: Problem Set # 7: Solutions Instructor: Jean Walrand TA: S. Mubaraq Mishra Assigned: October 7, 23 Due: October 24, 23 Problem. Let X, Y, Z, V be independent N(, ) random variables. Find the p.d.f.
More informationNotes, March 4, 2013, R. Dudley Maximum likelihood estimation: actual or supposed
18.466 Notes, March 4, 2013, R. Dudley Maximum likelihood estimation: actual or supposed 1. MLEs in exponential families Let f(x,θ) for x X and θ Θ be a likelihood function, that is, for present purposes,
More informationNext tool is Partial ACF; mathematical tools first. The Multivariate Normal Distribution. e z2 /2. f Z (z) = 1 2π. e z2 i /2
Next tool is Partial ACF; mathematical tools first. The Multivariate Normal Distribution Defn: Z R 1 N(0,1) iff f Z (z) = 1 2π e z2 /2 Defn: Z R p MV N p (0, I) if and only if Z = (Z 1,..., Z p ) (a column
More informationAlgebra C Numerical Linear Algebra Sample Exam Problems
Algebra C Numerical Linear Algebra Sample Exam Problems Notation. Denote by V a finite-dimensional Hilbert space with inner product (, ) and corresponding norm. The abbreviation SPD is used for symmetric
More information