arxiv: v1 [math.pr] 26 Jan 2019

Size: px
Start display at page:

Download "arxiv: v1 [math.pr] 26 Jan 2019"

Transcription

1 Uniqueness of the Gaussian Orthogonal Ensemble José Ángel Sánchez Gómez, Victor Amaya Carvajal. December, 017. arxiv: v1 [math.pr] 6 Jan 019 Abstract It is not hard to prove that, given a random Wigner matrix X that belongs to the Gaussian Orthogonal Ensemble (GOE), then X is invariant under orthogonal conjugations. Our aim is to prove that if X is a random symmetric matrix that is invariant under orthogonal transformations then such matrix X belongs to the GOE. We will to this using nothing more than the characteristic function. 1 Introduction We will proof of the characterization of the matrices that belong to the Gaussian Orthogonal Ensemble. This work was done as a project for the course of Random Matrices at the Centro de Investigación en Matemáticas, A.C. (CIMAT). Notation We will denote by M n m (F), the set of matrices of size n m over the field F. The matrix I d d will denote the identity matrix of the set M d d (F). We will denote by O(d) the set of orthogonal matrices of M d d (F). This means, if O O(n) then O O = OO = I n n. A symmetric matrix X is a square matrix such that X = X. 3 Background We define the characteristic function of a random variable R to be a function ϕ R : R C given by, ϕ R (t) = E [ e itr], t R. In particular, given a random variable R N(µ,σ ), its characteristic function is given by: ϕ R (t) = E[e itr ] = e iµt 1 σ t. Another important thing to remember is that if two random variables R 1,R are such that their characteristic function coincide in every point, then their distributions are the same. In other words, if ϕ X (t) = ϕ Y (t), for every t R, then X Y. Given a symmetric random matrix X S d its characteristic function is defined by: C X : S d C C X (M) = E[exp{iTr(X M)}], M S d. Recall that the trace is invariant under cyclic permutations. From this, if A M d d (R) and for all M S d. jose.sanchez@cimat.mx victor.amaya@cimat.mx C X (A MA) = E[exp{iTr(X A MA)}] = E[exp{iTr(A X AM)}] = E[exp{iTr([A X A] M)}] = C A XA(M). 1

2 Notice that, if A,B S d, Tr(A B) = Furthermore, if A,B S d, (A B) jj = Tr(A B) = (A ) jk B kj = j,k=1 A jj B jj + j,k=1 A jk B jk. From this, note that C X (M) = E[exp{iTr(X M)}] = E exp i M jj X jj +i A kj B kj. M kj X kj. Furthermore, if the entries of the matrix X are independent, we get a concise formula of the characteristic function in terms of the characteristic functions of each entry: C X (M) = d E[exp{iM jj X jj }] E[exp{iM kj X kj }]. It will be useful to keep this formula in mind when computing the value of the characteristic function on particular symmetric matrices. 4 The problem Our aim is to prove the following theorem using nothing more than the characteristic function of a random matrix. Theorem 1. Let X be a random symmetric d d matrix such that it is invariant under orthogonal transformations. Suppose that all the entries of X are independent with finite variance. Then, there exist a matrix belonging to the Gaussian Orthogonal Ensemble Y, and real numbers µ R, σ 0 such that X = µi d d +σ Y. We will divided our prove into three steps: Show that the elements inside the diagonal share the same distribution, and that all the elements outside the main diagonal share the same distribution. Show that is enough to prove the result for square matrices. We will prove that the characteristic functions of the elements of the matrix X correspond to normally distributed random variables. Proof: Lets proof every step. First step: Let us define the matrix A t (k,j) as the matrix that has the value t in the positions (k,j) and (j,k) and zeros everywhere else, for 1 k < j d and t R. If we calculate the the characteristic function of A t (k,j) we obtain: [ { }] C X (A (k,j) (t)) = E exp itr((a t (k,j) ) X) = E[exp{itX kj }] = φ Xkj (t). Now, let k j and l g. There exists a permutation matrix P O(d) such that for all t R, P A t (k,j) P = At (l,g). From the in-variance of X with respect to orthogonal conjugations:

3 ϕ Xkj (t) = C X (A t (k,j) ) = C X(P A t (k,j) P) = C X(A t (l,g) ) = ϕ X lg (t), t R. It follows that X kj X lg. It means that all entries outside the main diagonal have the same distribution. In an analogous way, by conjugating we can prove that if 1 j < k d, X kj X kj. This implies the distribution of the entries outside of the diagonal are symmetric. This is because all entries of the matrix have finite second moment, E(X kj ) = 0. Now, let A t i = diag(t e j), i.e. a matrix that has as only non-zero entry t in the position (j,j), for 1 j d and t R. From this, C X (A t j) = E [ exp { itr((a t j) X) }] = E[exp{itX jj }] = ϕ Xjj (t), for all 1 j d and t R. Now, given j k, there exists a permutation matrix Q O(d) such that Q A t j Q = At k.from this, ϕ Xjj (t) = C X (A t j ) = C X(Q A t j Q) = C X(A t k ) = ϕ X kk (t) t R. Thus X jj X kk for all j k. Then, all entries in the diagonal have the same distribution. Second step: In the last step, we have just proved that all entries in the diagonal have the same distribution, and the entries outside the diagonal also have the same distribution. From this, it is possible to find the distribution of all entries of the matrix X by finding the distribution of the entries of the sub-matrix, X11 X X = 1. X 1 X It can be proved that X is invariant with respect to rotations in R. For this, let θ R and, Q Mθ 0 θ = M 0 I d d (R), (d ) (d ) where, Q θ = cos(θ) sin(θ) M sin(θ) cos(θ). (R). The matrix Q θ is an orthogonal matrix which rotates the first two coordinates and fixes the rest. Let M S, where, a b M = S b d. We can embed M into S d by filling all entries outside the first sub-matrix with zeros: M M 0 = S 0 0 d. We observe that, C X (M ) = E[exp{iTr(M X)}] = E[exp{i(aX 11 +bx 1 +dx )}] = C X (M). By evaluating the characteristic function of X on M and using the orthogonal in-variance, and considering that all entries outside the matrix in M are zero, C X (M) = C X (M ) = C X ((Q θ ) M Q θ ) = C X (Q θ MQ θ). 3

4 Third part: Since we have reduced the problem to the case of matrices of, we will keep M and Q θ to be the matrices defined in the previous step. We take M θ = Q θ MQ θ, a symmetric matrix. Name the entries of M θ as follow A B M θ =, B D we can compute explicitly the values of A,B,D in function the entries of M. We get the following: A = a+d B = a d D = a+d + a d cos(θ) bsin(θ), sin(θ)+bcos(θ), a d cos(θ)+bsin(θ). These expressions are valid for everyθ R.If we calculate the derivatives of the last expressions with respect to θ, what we get is the following: da dθ = B, db dθ = A D, Now, since X is invariant under rotations, we have that: C X (M θ ) = C X (M). dd dθ = B (1) Computing the characteristic function on both matrices we obtain that, ϕ 1 (a)ϕ (b)ϕ 1 (d) = ϕ 1 (A)ϕ (B)ϕ 1 (D), () where ϕ 1 represents the characteristic function of the random variable X 11 (which is the same of X since the have the same distribution). And ϕ is the characteristic function of X 1. Since entries of X have finite variance ϕ 1 and ϕ are at least two times derivable at zero and φ j (0) = ie(x 1j) for j = 1,. We can derive equation (1) with respect to θ, we get: 0 = ϕ 1(A)ϕ (B)ϕ 1 (D) da dθ +ϕ 1(A)ϕ (B)ϕ 1 (D) db dθ +ϕ 1(A)ϕ (B)ϕ 1(D) dd (3) dθ Note that since ϕ 1 (0) = ϕ (0) = 1, and the are continuous at zero, there exist an open set around zero where these functions are not zero. So, we can rewrite equation (3) in the following way: 0 = ϕ 1 (A) ϕ 1 (A) ϕ 1(A)ϕ (B)ϕ 1 (D) da dθ + ϕ (B) ϕ (B) ϕ 1(A)ϕ (B)ϕ 1 (D) db dθ + + ϕ 1(D) ϕ 1 (D) ϕ 1(A)ϕ (B)ϕ 1 (D) dd dθ. Now, replacing the values we found in (1) and dividing by B(A D) (for those values B 0,A D), we get that 1 ϕ [ ] (B) B ϕ (B) = 1 ϕ 1 (A) A D ϕ 1 (A) ϕ 1(D) (4) ϕ 1 (D) We observed that the left hand side of (4) only depends on B, whereas the right hand side depends in both A and D. By this observation by can conclude that (4) is a constant. Then, there exists k R such that: 1 ϕ (B) B ϕ (B) = k, Observe that, since ϕ is the characteristic function of a symmetric random variable, the codomain of ϕ is contained in R. This implies k R. Now, lets take x = B. We have that ϕ (x) = xk ϕ(x). This is an easy real-valued ODE whose solution is given by ϕ (x) = B 0 e kx, 4

5 for some B 0 R. Now, as ϕ is a characteristic function it is true that ϕ (0) = 1. This give us as a result that B 0 = 1 so we have. ϕ (x) = e k At first, we have this in a neighborhood of 0 R, but we can extend this solution to be for all R. Observe that if k < 0 then ϕ (t) when t. This leads to a contradiction since characteristic functions have bounded image. Then, if k > 0 and ϕ is the characteristic function of a normal random variable with parameters N(0,k/). Given k = 0, ϕ is the characteristic function of a singular distribution at 0. On the other hand, taking D = 0 in equation (4), it follows that 1 A x. [ ϕ 1 (A) ϕ 1 (A) ϕ 1 (0) ϕ 1 (0) We know that ϕ 1 (0) = 1 and that ϕ (0) = iµ, where µ = E(X 11 ). So, ϕ 1 (A) ϕ(a) = Ak +iµ ϕ 1 (A) = ( Ak +iµ)ϕ 1(A). The solution to this ODE is ϕ 1 (x) = e iµx kx. which is nothing more than the characteristic function of a random variable with distribution N(µ,k). Since k is non-negative we can write it as k = σ. So we can write that characteristic functions in the following way: ]. ϕ 1 (x) = e iµx σ x, ϕ (x) = e σ x. which means that X 11 N(µ,σ ) and X 1 N(0,σ ). With this, we proved that X jj N(µ,σ ) and X kj N(0,σ ). Now, if the take a GOE matrix Y, i.e., Y ii N(0,) and Y jk N(0,1), for every j k, we conclude that: X σ Y +µi d. We see that X is clearly invariant under orthogonal conjugations. 5 Conclusions There are important remarks that are worth stressing about this proof. First, we find interesting that it unfolded by using just elementary knowledge of basic properties of characteristic functions, differential equations and linear algebra. It is a basic proof for this result. Second, it states a generalization of the standard result. This result is proved usually for matrices that have zero-mean entries. This proof allow us to study general matrices that are invariant with respect to orthogonal conjugations. The independence of the entries is key for this proof. One example of a distribution that is invariant under orthogonal conjugation is the Haar distribution on O(d). This distribution does not hold the entry-wise independence since orthogonal matrices satisfy relations between them. In terms of this work, it is key to write the characteristic function of the matrix in terms of the product of the characteristic function of each entry. One possible extension of this project is to find the distribution of Wishart matrices by applying the same characteristic-function approach. References [1] Yi-Kai Liu. Mathematics Junior Seminar, Spring 001. Princeton University. [] Measure Theory and Probability Theory. Krishna B. Athreya and Soumendra N. Lahiri. Springer Text in Statistics. 5

Fundamentals of Unconstrained Optimization

Fundamentals of Unconstrained Optimization dalmau@cimat.mx Centro de Investigación en Matemáticas CIMAT A.C. Mexico Enero 2016 Outline Introduction 1 Introduction 2 3 4 Optimization Problem min f (x) x Ω where f (x) is a real-valued function The

More information

Eigenvalue PDFs. Peter Forrester, M&S, University of Melbourne

Eigenvalue PDFs. Peter Forrester, M&S, University of Melbourne Outline Eigenvalue PDFs Peter Forrester, M&S, University of Melbourne Hermitian matrices with real, complex or real quaternion elements Circular ensembles and classical groups Products of random matrices

More information

Basic Concepts in Matrix Algebra

Basic Concepts in Matrix Algebra Basic Concepts in Matrix Algebra An column array of p elements is called a vector of dimension p and is written as x p 1 = x 1 x 2. x p. The transpose of the column vector x p 1 is row vector x = [x 1

More information

MAC Module 1 Systems of Linear Equations and Matrices I

MAC Module 1 Systems of Linear Equations and Matrices I MAC 2103 Module 1 Systems of Linear Equations and Matrices I 1 Learning Objectives Upon completing this module, you should be able to: 1. Represent a system of linear equations as an augmented matrix.

More information

Chapter 1: Systems of linear equations and matrices. Section 1.1: Introduction to systems of linear equations

Chapter 1: Systems of linear equations and matrices. Section 1.1: Introduction to systems of linear equations Chapter 1: Systems of linear equations and matrices Section 1.1: Introduction to systems of linear equations Definition: A linear equation in n variables can be expressed in the form a 1 x 1 + a 2 x 2

More information

Gaussian Models (9/9/13)

Gaussian Models (9/9/13) STA561: Probabilistic machine learning Gaussian Models (9/9/13) Lecturer: Barbara Engelhardt Scribes: Xi He, Jiangwei Pan, Ali Razeen, Animesh Srivastava 1 Multivariate Normal Distribution The multivariate

More information

Random Matrix Theory Lecture 3 Free Probability Theory. Symeon Chatzinotas March 4, 2013 Luxembourg

Random Matrix Theory Lecture 3 Free Probability Theory. Symeon Chatzinotas March 4, 2013 Luxembourg Random Matrix Theory Lecture 3 Free Probability Theory Symeon Chatzinotas March 4, 2013 Luxembourg Outline 1. Free Probability Theory 1. Definitions 2. Asymptotically free matrices 3. R-transform 4. Additive

More information

Gaussian vectors and central limit theorem

Gaussian vectors and central limit theorem Gaussian vectors and central limit theorem Samy Tindel Purdue University Probability Theory 2 - MA 539 Samy T. Gaussian vectors & CLT Probability Theory 1 / 86 Outline 1 Real Gaussian random variables

More information

Foundations of Matrix Analysis

Foundations of Matrix Analysis 1 Foundations of Matrix Analysis In this chapter we recall the basic elements of linear algebra which will be employed in the remainder of the text For most of the proofs as well as for the details, the

More information

RANDOM MATRIX THEORY AND TOEPLITZ DETERMINANTS

RANDOM MATRIX THEORY AND TOEPLITZ DETERMINANTS RANDOM MATRIX THEORY AND TOEPLITZ DETERMINANTS David García-García May 13, 2016 Faculdade de Ciências da Universidade de Lisboa OVERVIEW Random Matrix Theory Introduction Matrix ensembles A sample computation:

More information

4 Group representations

4 Group representations Physics 9b Lecture 6 Caltech, /4/9 4 Group representations 4. Examples Example : D represented as real matrices. ( ( D(e =, D(c = ( ( D(b =, D(b =, D(c = Example : Circle group as rotation of D real vector

More information

Direct Methods for Solving Linear Systems. Simon Fraser University Surrey Campus MACM 316 Spring 2005 Instructor: Ha Le

Direct Methods for Solving Linear Systems. Simon Fraser University Surrey Campus MACM 316 Spring 2005 Instructor: Ha Le Direct Methods for Solving Linear Systems Simon Fraser University Surrey Campus MACM 316 Spring 2005 Instructor: Ha Le 1 Overview General Linear Systems Gaussian Elimination Triangular Systems The LU Factorization

More information

A b r i l l i a n t young chemist, T h u r e Wagelius of N e w Y o r k, ac. himself with eth

A b r i l l i a n t young chemist, T h u r e Wagelius of N e w Y o r k, ac. himself with eth 6 6 0 x J 8 0 J 0 z (0 8 z x x J x 6 000 X j x "" "" " " x " " " x " " " J " " " " " " " " x : 0 z j ; J K 0 J K q 8 K K J x 0 j " " > J x J j z ; j J q J 0 0 8 K J 60 : K 6 x 8 K J :? 0 J J K 0 6% 8 0

More information

Math 416, Spring 2010 More on Algebraic and Geometric Properties January 21, 2010 MORE ON ALGEBRAIC AND GEOMETRIC PROPERTIES

Math 416, Spring 2010 More on Algebraic and Geometric Properties January 21, 2010 MORE ON ALGEBRAIC AND GEOMETRIC PROPERTIES Math 46, Spring 2 More on Algebraic and Geometric Properties January 2, 2 MORE ON ALGEBRAIC AND GEOMETRIC PROPERTIES Algebraic properties Algebraic properties of matrix/vector multiplication Last time

More information

A CLASS OF SCHUR MULTIPLIERS ON SOME QUASI-BANACH SPACES OF INFINITE MATRICES

A CLASS OF SCHUR MULTIPLIERS ON SOME QUASI-BANACH SPACES OF INFINITE MATRICES A CLASS OF SCHUR MULTIPLIERS ON SOME QUASI-BANACH SPACES OF INFINITE MATRICES NICOLAE POPA Abstract In this paper we characterize the Schur multipliers of scalar type (see definition below) acting on scattered

More information

Linear Algebra and Matrix Inversion

Linear Algebra and Matrix Inversion Jim Lambers MAT 46/56 Spring Semester 29- Lecture 2 Notes These notes correspond to Section 63 in the text Linear Algebra and Matrix Inversion Vector Spaces and Linear Transformations Matrices are much

More information

MODULE 7. where A is an m n real (or complex) matrix. 2) Let K(t, s) be a function of two variables which is continuous on the square [0, 1] [0, 1].

MODULE 7. where A is an m n real (or complex) matrix. 2) Let K(t, s) be a function of two variables which is continuous on the square [0, 1] [0, 1]. Topics: Linear operators MODULE 7 We are going to discuss functions = mappings = transformations = operators from one vector space V 1 into another vector space V 2. However, we shall restrict our sights

More information

Second Order Freeness and Random Orthogonal Matrices

Second Order Freeness and Random Orthogonal Matrices Second Order Freeness and Random Orthogonal Matrices Jamie Mingo (Queen s University) (joint work with Mihai Popa and Emily Redelmeier) AMS San Diego Meeting, January 11, 2013 1 / 15 Random Matrices X

More information

MATH 431: FIRST MIDTERM. Thursday, October 3, 2013.

MATH 431: FIRST MIDTERM. Thursday, October 3, 2013. MATH 431: FIRST MIDTERM Thursday, October 3, 213. (1) An inner product on the space of matrices. Let V be the vector space of 2 2 real matrices (that is, the algebra Mat 2 (R), but without the mulitiplicative

More information

1 Tridiagonal matrices

1 Tridiagonal matrices Lecture Notes: β-ensembles Bálint Virág Notes with Diane Holcomb 1 Tridiagonal matrices Definition 1. Suppose you have a symmetric matrix A, we can define its spectral measure (at the first coordinate

More information

Chapter Two Elements of Linear Algebra

Chapter Two Elements of Linear Algebra Chapter Two Elements of Linear Algebra Previously, in chapter one, we have considered single first order differential equations involving a single unknown function. In the next chapter we will begin to

More information

Basic Linear Algebra in MATLAB

Basic Linear Algebra in MATLAB Basic Linear Algebra in MATLAB 9.29 Optional Lecture 2 In the last optional lecture we learned the the basic type in MATLAB is a matrix of double precision floating point numbers. You learned a number

More information

Matrix Lie groups. and their Lie algebras. Mahmood Alaghmandan. A project in fulfillment of the requirement for the Lie algebra course

Matrix Lie groups. and their Lie algebras. Mahmood Alaghmandan. A project in fulfillment of the requirement for the Lie algebra course Matrix Lie groups and their Lie algebras Mahmood Alaghmandan A project in fulfillment of the requirement for the Lie algebra course Department of Mathematics and Statistics University of Saskatchewan March

More information

Practice Algebra Qualifying Exam Solutions

Practice Algebra Qualifying Exam Solutions Practice Algebra Qualifying Exam Solutions 1. Let A be an n n matrix with complex coefficients. Define tr A to be the sum of the diagonal elements. Show that tr A is invariant under conjugation, i.e.,

More information

Span and Linear Independence

Span and Linear Independence Span and Linear Independence It is common to confuse span and linear independence, because although they are different concepts, they are related. To see their relationship, let s revisit the previous

More information

MANIFOLD STRUCTURES IN ALGEBRA

MANIFOLD STRUCTURES IN ALGEBRA MANIFOLD STRUCTURES IN ALGEBRA MATTHEW GARCIA 1. Definitions Our aim is to describe the manifold structure on classical linear groups and from there deduce a number of results. Before we begin we make

More information

Topics in Representation Theory: SU(n), Weyl Chambers and the Diagram of a Group

Topics in Representation Theory: SU(n), Weyl Chambers and the Diagram of a Group Topics in Representation Theory: SU(n), Weyl hambers and the Diagram of a Group 1 Another Example: G = SU(n) Last time we began analyzing how the maximal torus T of G acts on the adjoint representation,

More information

MATH 221: SOLUTIONS TO SELECTED HOMEWORK PROBLEMS

MATH 221: SOLUTIONS TO SELECTED HOMEWORK PROBLEMS MATH 221: SOLUTIONS TO SELECTED HOMEWORK PROBLEMS 1. HW 1: Due September 4 1.1.21. Suppose v, w R n and c is a scalar. Prove that Span(v + cw, w) = Span(v, w). We must prove two things: that every element

More information

Convergence of Square Root Ensemble Kalman Filters in the Large Ensemble Limit

Convergence of Square Root Ensemble Kalman Filters in the Large Ensemble Limit Convergence of Square Root Ensemble Kalman Filters in the Large Ensemble Limit Evan Kwiatkowski, Jan Mandel University of Colorado Denver December 11, 2014 OUTLINE 2 Data Assimilation Bayesian Estimation

More information

1 4 (1 cos(4θ))dθ = θ 4 sin(4θ)

1 4 (1 cos(4θ))dθ = θ 4 sin(4θ) M48M Final Exam Solutions, December 9, 5 ) A polar curve Let C be the portion of the cloverleaf curve r = sin(θ) that lies in the first quadrant a) Draw a rough sketch of C This looks like one quarter

More information

Notes on Linear Algebra and Matrix Theory

Notes on Linear Algebra and Matrix Theory Massimo Franceschet featuring Enrico Bozzo Scalar product The scalar product (a.k.a. dot product or inner product) of two real vectors x = (x 1,..., x n ) and y = (y 1,..., y n ) is not a vector but a

More information

x + 2y + 3z = 8 x + 3y = 7 x + 2z = 3

x + 2y + 3z = 8 x + 3y = 7 x + 2z = 3 Chapter 2: Solving Linear Equations 23 Elimination Using Matrices As we saw in the presentation, we can use elimination to make a system of linear equations into an upper triangular system that is easy

More information

Math 370 Spring 2016 Sample Midterm with Solutions

Math 370 Spring 2016 Sample Midterm with Solutions Math 370 Spring 2016 Sample Midterm with Solutions Contents 1 Problems 2 2 Solutions 5 1 1 Problems (1) Let A be a 3 3 matrix whose entries are real numbers such that A 2 = 0. Show that I 3 + A is invertible.

More information

Queens College, CUNY, Department of Computer Science Numerical Methods CSCI 361 / 761 Spring 2018 Instructor: Dr. Sateesh Mane.

Queens College, CUNY, Department of Computer Science Numerical Methods CSCI 361 / 761 Spring 2018 Instructor: Dr. Sateesh Mane. Queens College, CUNY, Department of Computer Science Numerical Methods CSCI 361 / 761 Spring 2018 Instructor: Dr. Sateesh Mane c Sateesh R. Mane 2018 8 Lecture 8 8.1 Matrices July 22, 2018 We shall study

More information

Lectures 6 7 : Marchenko-Pastur Law

Lectures 6 7 : Marchenko-Pastur Law Fall 2009 MATH 833 Random Matrices B. Valkó Lectures 6 7 : Marchenko-Pastur Law Notes prepared by: A. Ganguly We will now turn our attention to rectangular matrices. Let X = (X 1, X 2,..., X n ) R p n

More information

SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear Algebra

SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear Algebra 1.1. Introduction SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear algebra is a specific branch of mathematics dealing with the study of vectors, vector spaces with functions that

More information

SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear Algebra

SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear Algebra SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to 1.1. Introduction Linear algebra is a specific branch of mathematics dealing with the study of vectors, vector spaces with functions that

More information

Physics 110. Electricity and Magnetism. Professor Dine. Spring, Handout: Vectors and Tensors: Everything You Need to Know

Physics 110. Electricity and Magnetism. Professor Dine. Spring, Handout: Vectors and Tensors: Everything You Need to Know Physics 110. Electricity and Magnetism. Professor Dine Spring, 2008. Handout: Vectors and Tensors: Everything You Need to Know What makes E&M hard, more than anything else, is the problem that the electric

More information

Notes on Random Vectors and Multivariate Normal

Notes on Random Vectors and Multivariate Normal MATH 590 Spring 06 Notes on Random Vectors and Multivariate Normal Properties of Random Vectors If X,, X n are random variables, then X = X,, X n ) is a random vector, with the cumulative distribution

More information

Linear Algebra March 16, 2019

Linear Algebra March 16, 2019 Linear Algebra March 16, 2019 2 Contents 0.1 Notation................................ 4 1 Systems of linear equations, and matrices 5 1.1 Systems of linear equations..................... 5 1.2 Augmented

More information

CLASSIFICATION OF COMPLETELY POSITIVE MAPS 1. INTRODUCTION

CLASSIFICATION OF COMPLETELY POSITIVE MAPS 1. INTRODUCTION CLASSIFICATION OF COMPLETELY POSITIVE MAPS STEPHAN HOYER ABSTRACT. We define a completely positive map and classify all completely positive linear maps. We further classify all such maps that are trace-preserving

More information

A Primer on Three Vectors

A Primer on Three Vectors Michael Dine Department of Physics University of California, Santa Cruz September 2010 What makes E&M hard, more than anything else, is the problem that the electric and magnetic fields are vectors, and

More information

UC Berkeley Department of Electrical Engineering and Computer Sciences. EECS 126: Probability and Random Processes

UC Berkeley Department of Electrical Engineering and Computer Sciences. EECS 126: Probability and Random Processes UC Berkeley Department of Electrical Engineering and Computer Sciences EECS 6: Probability and Random Processes Problem Set 3 Spring 9 Self-Graded Scores Due: February 8, 9 Submit your self-graded scores

More information

MATRIX ALGEBRA. or x = (x 1,..., x n ) R n. y 1 y 2. x 2. x m. y m. y = cos θ 1 = x 1 L x. sin θ 1 = x 2. cos θ 2 = y 1 L y.

MATRIX ALGEBRA. or x = (x 1,..., x n ) R n. y 1 y 2. x 2. x m. y m. y = cos θ 1 = x 1 L x. sin θ 1 = x 2. cos θ 2 = y 1 L y. as Basics Vectors MATRIX ALGEBRA An array of n real numbers x, x,, x n is called a vector and it is written x = x x n or x = x,, x n R n prime operation=transposing a column to a row Basic vector operations

More information

PURE MATHEMATICS AM 27

PURE MATHEMATICS AM 27 AM Syllabus (014): Pure Mathematics AM SYLLABUS (014) PURE MATHEMATICS AM 7 SYLLABUS 1 AM Syllabus (014): Pure Mathematics Pure Mathematics AM 7 Syllabus (Available in September) Paper I(3hrs)+Paper II(3hrs)

More information

ELEMENTARY LINEAR ALGEBRA

ELEMENTARY LINEAR ALGEBRA ELEMENTARY LINEAR ALGEBRA K. R. MATTHEWS DEPARTMENT OF MATHEMATICS UNIVERSITY OF QUEENSLAND Corrected Version, 7th April 013 Comments to the author at keithmatt@gmail.com Chapter 1 LINEAR EQUATIONS 1.1

More information

Wigner s semicircle law

Wigner s semicircle law CHAPTER 2 Wigner s semicircle law 1. Wigner matrices Definition 12. A Wigner matrix is a random matrix X =(X i, j ) i, j n where (1) X i, j, i < j are i.i.d (real or complex valued). (2) X i,i, i n are

More information

Gaussian Elimination and Back Substitution

Gaussian Elimination and Back Substitution Jim Lambers MAT 610 Summer Session 2009-10 Lecture 4 Notes These notes correspond to Sections 31 and 32 in the text Gaussian Elimination and Back Substitution The basic idea behind methods for solving

More information

Review problems for MA 54, Fall 2004.

Review problems for MA 54, Fall 2004. Review problems for MA 54, Fall 2004. Below are the review problems for the final. They are mostly homework problems, or very similar. If you are comfortable doing these problems, you should be fine on

More information

Chapter 2 Notes, Linear Algebra 5e Lay

Chapter 2 Notes, Linear Algebra 5e Lay Contents.1 Operations with Matrices..................................1.1 Addition and Subtraction.............................1. Multiplication by a scalar............................ 3.1.3 Multiplication

More information

Volume in n Dimensions

Volume in n Dimensions Volume in n Dimensions MA 305 Kurt Bryan Introduction You ve seen that if we have two vectors v and w in two dimensions then the area spanned by these vectors can be computed as v w = v 1 w 2 v 2 w 1 (where

More information

Random Fermionic Systems

Random Fermionic Systems Random Fermionic Systems Fabio Cunden Anna Maltsev Francesco Mezzadri University of Bristol December 9, 2016 Maltsev (University of Bristol) Random Fermionic Systems December 9, 2016 1 / 27 Background

More information

PH1105 Lecture Notes on Linear Algebra.

PH1105 Lecture Notes on Linear Algebra. PH05 Lecture Notes on Linear Algebra Joe Ó hógáin E-mail: johog@mathstcdie Main Text: Calculus for the Life Sciences by Bittenger, Brand and Quintanilla Other Text: Linear Algebra by Anton and Rorres Matrices

More information

SQUARE ROOTS OF 2x2 MATRICES 1. Sam Northshield SUNY-Plattsburgh

SQUARE ROOTS OF 2x2 MATRICES 1. Sam Northshield SUNY-Plattsburgh SQUARE ROOTS OF x MATRICES Sam Northshield SUNY-Plattsburgh INTRODUCTION A B What is the square root of a matrix such as? It is not, in general, A B C D C D This is easy to see since the upper left entry

More information

forms Christopher Engström November 14, 2014 MAA704: Matrix factorization and canonical forms Matrix properties Matrix factorization Canonical forms

forms Christopher Engström November 14, 2014 MAA704: Matrix factorization and canonical forms Matrix properties Matrix factorization Canonical forms Christopher Engström November 14, 2014 Hermitian LU QR echelon Contents of todays lecture Some interesting / useful / important of matrices Hermitian LU QR echelon Rewriting a as a product of several matrices.

More information

Analysis-3 lecture schemes

Analysis-3 lecture schemes Analysis-3 lecture schemes (with Homeworks) 1 Csörgő István November, 2015 1 A jegyzet az ELTE Informatikai Kar 2015. évi Jegyzetpályázatának támogatásával készült Contents 1. Lesson 1 4 1.1. The Space

More information

Mathematics. EC / EE / IN / ME / CE. for

Mathematics.   EC / EE / IN / ME / CE. for Mathematics for EC / EE / IN / ME / CE By www.thegateacademy.com Syllabus Syllabus for Mathematics Linear Algebra: Matrix Algebra, Systems of Linear Equations, Eigenvalues and Eigenvectors. Probability

More information

. =. a i1 x 1 + a i2 x 2 + a in x n = b i. a 11 a 12 a 1n a 21 a 22 a 1n. i1 a i2 a in

. =. a i1 x 1 + a i2 x 2 + a in x n = b i. a 11 a 12 a 1n a 21 a 22 a 1n. i1 a i2 a in Vectors and Matrices Continued Remember that our goal is to write a system of algebraic equations as a matrix equation. Suppose we have the n linear algebraic equations a x + a 2 x 2 + a n x n = b a 2

More information

5 Operations on Multiple Random Variables

5 Operations on Multiple Random Variables EE360 Random Signal analysis Chapter 5: Operations on Multiple Random Variables 5 Operations on Multiple Random Variables Expected value of a function of r.v. s Two r.v. s: ḡ = E[g(X, Y )] = g(x, y)f X,Y

More information

A Generalization of Wigner s Law

A Generalization of Wigner s Law A Generalization of Wigner s Law Inna Zakharevich June 2, 2005 Abstract We present a generalization of Wigner s semicircle law: we consider a sequence of probability distributions (p, p 2,... ), with mean

More information

The University of Texas at Austin Department of Electrical and Computer Engineering. EE381V: Large Scale Learning Spring 2013.

The University of Texas at Austin Department of Electrical and Computer Engineering. EE381V: Large Scale Learning Spring 2013. The University of Texas at Austin Department of Electrical and Computer Engineering EE381V: Large Scale Learning Spring 2013 Assignment Two Caramanis/Sanghavi Due: Tuesday, Feb. 19, 2013. Computational

More information

Radial Basis Functions I

Radial Basis Functions I Radial Basis Functions I Tom Lyche Centre of Mathematics for Applications, Department of Informatics, University of Oslo November 14, 2008 Today Reformulation of natural cubic spline interpolation Scattered

More information

( ) = ( ) ( ) = ( ) = + = = = ( ) Therefore: , where t. Note: If we start with the condition BM = tab, we will have BM = ( x + 2, y + 3, z 5)

( ) = ( ) ( ) = ( ) = + = = = ( ) Therefore: , where t. Note: If we start with the condition BM = tab, we will have BM = ( x + 2, y + 3, z 5) Chapter Exercise a) AB OB OA ( xb xa, yb ya, zb za),,, 0, b) AB OB OA ( xb xa, yb ya, zb za) ( ), ( ),, 0, c) AB OB OA x x, y y, z z (, ( ), ) (,, ) ( ) B A B A B A ( ) d) AB OB OA ( xb xa, yb ya, zb za)

More information

Systems of Linear Equations and Matrices

Systems of Linear Equations and Matrices Chapter 1 Systems of Linear Equations and Matrices System of linear algebraic equations and their solution constitute one of the major topics studied in the course known as linear algebra. In the first

More information

On Expected Gaussian Random Determinants

On Expected Gaussian Random Determinants On Expected Gaussian Random Determinants Moo K. Chung 1 Department of Statistics University of Wisconsin-Madison 1210 West Dayton St. Madison, WI 53706 Abstract The expectation of random determinants whose

More information

. a m1 a mn. a 1 a 2 a = a n

. a m1 a mn. a 1 a 2 a = a n Biostat 140655, 2008: Matrix Algebra Review 1 Definition: An m n matrix, A m n, is a rectangular array of real numbers with m rows and n columns Element in the i th row and the j th column is denoted by

More information

Matrices and Determinants

Matrices and Determinants Chapter1 Matrices and Determinants 11 INTRODUCTION Matrix means an arrangement or array Matrices (plural of matrix) were introduced by Cayley in 1860 A matrix A is rectangular array of m n numbers (or

More information

Lattices and Hermite normal form

Lattices and Hermite normal form Integer Points in Polyhedra Lattices and Hermite normal form Gennady Shmonin February 17, 2009 1 Lattices Let B = { } b 1,b 2,...,b k be a set of linearly independent vectors in n-dimensional Euclidean

More information

Systems of Linear Equations and Matrices

Systems of Linear Equations and Matrices Chapter 1 Systems of Linear Equations and Matrices System of linear algebraic equations and their solution constitute one of the major topics studied in the course known as linear algebra. In the first

More information

The Solution of Linear Systems AX = B

The Solution of Linear Systems AX = B Chapter 2 The Solution of Linear Systems AX = B 21 Upper-triangular Linear Systems We will now develop the back-substitution algorithm, which is useful for solving a linear system of equations that has

More information

1 Intro to RMT (Gene)

1 Intro to RMT (Gene) M705 Spring 2013 Summary for Week 2 1 Intro to RMT (Gene) (Also see the Anderson - Guionnet - Zeitouni book, pp.6-11(?) ) We start with two independent families of R.V.s, {Z i,j } 1 i

More information

Semidefinite and Second Order Cone Programming Seminar Fall 2001 Lecture 2

Semidefinite and Second Order Cone Programming Seminar Fall 2001 Lecture 2 Semidefinite and Second Order Cone Programming Seminar Fall 2001 Lecture 2 Instructor: Farid Alizadeh Scribe: Xuan Li 9/17/2001 1 Overview We survey the basic notions of cones and cone-lp and give several

More information

Math 577 Assignment 7

Math 577 Assignment 7 Math 577 Assignment 7 Thanks for Yu Cao 1. Solution. The linear system being solved is Ax = 0, where A is a (n 1 (n 1 matrix such that 2 1 1 2 1 A =......... 1 2 1 1 2 and x = (U 1, U 2,, U n 1. By the

More information

ELEMENTARY LINEAR ALGEBRA

ELEMENTARY LINEAR ALGEBRA ELEMENTARY LINEAR ALGEBRA K R MATTHEWS DEPARTMENT OF MATHEMATICS UNIVERSITY OF QUEENSLAND First Printing, 99 Chapter LINEAR EQUATIONS Introduction to linear equations A linear equation in n unknowns x,

More information

Linear Algebra Review (Course Notes for Math 308H - Spring 2016)

Linear Algebra Review (Course Notes for Math 308H - Spring 2016) Linear Algebra Review (Course Notes for Math 308H - Spring 2016) Dr. Michael S. Pilant February 12, 2016 1 Background: We begin with one of the most fundamental notions in R 2, distance. Letting (x 1,

More information

STAT215: Solutions for Homework 2

STAT215: Solutions for Homework 2 STAT25: Solutions for Homework 2 Due: Wednesday, Feb 4. (0 pt) Suppose we take one observation, X, from the discrete distribution, x 2 0 2 Pr(X x θ) ( θ)/4 θ/2 /2 (3 θ)/2 θ/4, 0 θ Find an unbiased estimator

More information

= a. a = Let us now study what is a? c ( a A a )

= a. a = Let us now study what is a? c ( a A a ) 7636S ADVANCED QUANTUM MECHANICS Solutions 1 Spring 010 1 Warm up a Show that the eigenvalues of a Hermitian operator A are real and that the eigenkets of A corresponding to dierent eigenvalues are orthogonal

More information

Math Linear Algebra Final Exam Review Sheet

Math Linear Algebra Final Exam Review Sheet Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of

More information

Linear algebra. S. Richard

Linear algebra. S. Richard Linear algebra S. Richard Fall Semester 2014 and Spring Semester 2015 2 Contents Introduction 5 0.1 Motivation.................................. 5 1 Geometric setting 7 1.1 The Euclidean space R n..........................

More information

AMS 209, Fall 2015 Final Project Type A Numerical Linear Algebra: Gaussian Elimination with Pivoting for Solving Linear Systems

AMS 209, Fall 2015 Final Project Type A Numerical Linear Algebra: Gaussian Elimination with Pivoting for Solving Linear Systems AMS 209, Fall 205 Final Project Type A Numerical Linear Algebra: Gaussian Elimination with Pivoting for Solving Linear Systems. Overview We are interested in solving a well-defined linear system given

More information

Math Camp II. Basic Linear Algebra. Yiqing Xu. Aug 26, 2014 MIT

Math Camp II. Basic Linear Algebra. Yiqing Xu. Aug 26, 2014 MIT Math Camp II Basic Linear Algebra Yiqing Xu MIT Aug 26, 2014 1 Solving Systems of Linear Equations 2 Vectors and Vector Spaces 3 Matrices 4 Least Squares Systems of Linear Equations Definition A linear

More information

1 g 1,gg 2 xg 1. 2 g 1,...,gg n xg 1. n g 1 } = {gxg 1,gg 1 x(gg 1 ) 1,gg 2 x(gg 2 ) 1,...,gg n x(gg n ) 1 } = {x,g 1 xg 1. 2,...

1 g 1,gg 2 xg 1. 2 g 1,...,gg n xg 1. n g 1 } = {gxg 1,gg 1 x(gg 1 ) 1,gg 2 x(gg 2 ) 1,...,gg n x(gg n ) 1 } = {x,g 1 xg 1. 2,... Physics 5 Solution Set Spring 7. A finite group G can be decomposed into conjugacy classes C k. (a) Construct the set C k gc kg, which is obtained by replacing each element x C k by gxg. Prove that C k

More information

Math 5630: Iterative Methods for Systems of Equations Hung Phan, UMass Lowell March 22, 2018

Math 5630: Iterative Methods for Systems of Equations Hung Phan, UMass Lowell March 22, 2018 1 Linear Systems Math 5630: Iterative Methods for Systems of Equations Hung Phan, UMass Lowell March, 018 Consider the system 4x y + z = 7 4x 8y + z = 1 x + y + 5z = 15. We then obtain x = 1 4 (7 + y z)

More information

1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i )

1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i ) Direct Methods for Linear Systems Chapter Direct Methods for Solving Linear Systems Per-Olof Persson persson@berkeleyedu Department of Mathematics University of California, Berkeley Math 18A Numerical

More information

9 Radon-Nikodym theorem and conditioning

9 Radon-Nikodym theorem and conditioning Tel Aviv University, 2015 Functions of real variables 93 9 Radon-Nikodym theorem and conditioning 9a Borel-Kolmogorov paradox............. 93 9b Radon-Nikodym theorem.............. 94 9c Conditioning.....................

More information

CS412: Lecture #17. Mridul Aanjaneya. March 19, 2015

CS412: Lecture #17. Mridul Aanjaneya. March 19, 2015 CS: Lecture #7 Mridul Aanjaneya March 9, 5 Solving linear systems of equations Consider a lower triangular matrix L: l l l L = l 3 l 3 l 33 l n l nn A procedure similar to that for upper triangular systems

More information

Least-Squares Rigid Motion Using SVD

Least-Squares Rigid Motion Using SVD Least-Squares igid Motion Using SVD Olga Sorkine Abstract his note summarizes the steps to computing the rigid transformation that aligns two sets of points Key words: Shape matching, rigid alignment,

More information

Lecture 10 - Eigenvalues problem

Lecture 10 - Eigenvalues problem Lecture 10 - Eigenvalues problem Department of Computer Science University of Houston February 28, 2008 1 Lecture 10 - Eigenvalues problem Introduction Eigenvalue problems form an important class of problems

More information

Computationally, diagonal matrices are the easiest to work with. With this idea in mind, we introduce similarity:

Computationally, diagonal matrices are the easiest to work with. With this idea in mind, we introduce similarity: Diagonalization We have seen that diagonal and triangular matrices are much easier to work with than are most matrices For example, determinants and eigenvalues are easy to compute, and multiplication

More information

Versal deformations in generalized flag manifolds

Versal deformations in generalized flag manifolds Versal deformations in generalized flag manifolds X. Puerta Departament de Matemàtica Aplicada I Escola Tècnica Superior d Enginyers Industrials de Barcelona, UPC Av. Diagonal, 647 08028 Barcelona, Spain

More information

MATH 106 LINEAR ALGEBRA LECTURE NOTES

MATH 106 LINEAR ALGEBRA LECTURE NOTES MATH 6 LINEAR ALGEBRA LECTURE NOTES FALL - These Lecture Notes are not in a final form being still subject of improvement Contents Systems of linear equations and matrices 5 Introduction to systems of

More information

Free Probability Theory and Random Matrices. Roland Speicher Queen s University Kingston, Canada

Free Probability Theory and Random Matrices. Roland Speicher Queen s University Kingston, Canada Free Probability Theory and Random Matrices Roland Speicher Queen s University Kingston, Canada We are interested in the limiting eigenvalue distribution of N N random matrices for N. Usually, large N

More information

Yale University Department of Mathematics Math 350 Introduction to Abstract Algebra Fall Midterm Exam Review Solutions

Yale University Department of Mathematics Math 350 Introduction to Abstract Algebra Fall Midterm Exam Review Solutions Yale University Department of Mathematics Math 350 Introduction to Abstract Algebra Fall 2015 Midterm Exam Review Solutions Practice exam questions: 1. Let V 1 R 2 be the subset of all vectors whose slope

More information

Differential Topology Final Exam With Solutions

Differential Topology Final Exam With Solutions Differential Topology Final Exam With Solutions Instructor: W. D. Gillam Date: Friday, May 20, 2016, 13:00 (1) Let X be a subset of R n, Y a subset of R m. Give the definitions of... (a) smooth function

More information

Quantum Computing Lecture 2. Review of Linear Algebra

Quantum Computing Lecture 2. Review of Linear Algebra Quantum Computing Lecture 2 Review of Linear Algebra Maris Ozols Linear algebra States of a quantum system form a vector space and their transformations are described by linear operators Vector spaces

More information

Mathematical Methods wk 2: Linear Operators

Mathematical Methods wk 2: Linear Operators John Magorrian, magog@thphysoxacuk These are work-in-progress notes for the second-year course on mathematical methods The most up-to-date version is available from http://www-thphysphysicsoxacuk/people/johnmagorrian/mm

More information

EE126: Problem Set # 7: Solutions

EE126: Problem Set # 7: Solutions EE26: Problem Set # 7: Solutions Instructor: Jean Walrand TA: S. Mubaraq Mishra Assigned: October 7, 23 Due: October 24, 23 Problem. Let X, Y, Z, V be independent N(, ) random variables. Find the p.d.f.

More information

Notes, March 4, 2013, R. Dudley Maximum likelihood estimation: actual or supposed

Notes, March 4, 2013, R. Dudley Maximum likelihood estimation: actual or supposed 18.466 Notes, March 4, 2013, R. Dudley Maximum likelihood estimation: actual or supposed 1. MLEs in exponential families Let f(x,θ) for x X and θ Θ be a likelihood function, that is, for present purposes,

More information

Next tool is Partial ACF; mathematical tools first. The Multivariate Normal Distribution. e z2 /2. f Z (z) = 1 2π. e z2 i /2

Next tool is Partial ACF; mathematical tools first. The Multivariate Normal Distribution. e z2 /2. f Z (z) = 1 2π. e z2 i /2 Next tool is Partial ACF; mathematical tools first. The Multivariate Normal Distribution Defn: Z R 1 N(0,1) iff f Z (z) = 1 2π e z2 /2 Defn: Z R p MV N p (0, I) if and only if Z = (Z 1,..., Z p ) (a column

More information

Algebra C Numerical Linear Algebra Sample Exam Problems

Algebra C Numerical Linear Algebra Sample Exam Problems Algebra C Numerical Linear Algebra Sample Exam Problems Notation. Denote by V a finite-dimensional Hilbert space with inner product (, ) and corresponding norm. The abbreviation SPD is used for symmetric

More information