Linear Algebra in Actuarial Science: Slides to the lecture
|
|
- Deirdre Hill
- 6 years ago
- Views:
Transcription
1 Linear Algebra in Actuarial Science: Slides to the lecture Fall Semester 2010/2011
2 Linear Algebra is a Tool-Box Linear Equation Systems Discretization of differential equations: solving linear equations systems 1 α α 1 α α 1 α α 1 Existence of solution? Uniqueness of solution? Stability of solution? = V (0) 0. 0 V (n)
3 Linear Algebra is a Tool-Box Minimization Problem Given data vector b and parameter matrix A. Find x such that Ax b gets minimal. Idea: Suitable transform of parameters and data Solution: Decomposition of matrices
4 Linear Algebra is a Tool-Box Bonus-Malus-Systems Car insurance with two different premium-levels a < c. Claim in the last year or in the year before: premium c No claims in the last two years: premium a. P(Claim in one year) = p = 1 q, P = p q 0 p 0 q p 0 q Question: What is right choice for a and c? Markov Chains with stationary distributions: What is lim n P n?
5 Linear Algebra is a Tool-Box Construction of index-linked products with n underlyings Classical models use normal distribution assumptions for assets Basket leads to multivariate normal distribution What is the square root of a matrix? How can simulations be done on covariance matrices? Idea: Transform the matrix Solution: Decomposition of matrices
6 Linear Algebra Syllabus Linear Equation Systems: Gauss Algorithm, Existence and Uniqueness of Solutions, Inverse, Determinants Vector Spaces: Linear (In-)Dependence, Basis, Inner Products, Gram-Schmidt Algorithm Eigenvalues and Eigenvectors: Determination, Diagonalisation, Singular Values Decompositions of Matrices: LU, SVD, QR, Cholesky
7 Field Axioms Definition A field is a set F with two operations, called addition and multiplication, which satisfy the following so-called "field axioms" (A), (M) and (D): (A) Axioms for addition (A1) If x F and y F, then x + y F. (A2) Addition is commutative: x + y = y + x for all x, y F. (A3) Addition is associative: (x + y) + z = x + (y + z) for all x, y, z F. (A4) F contains an element 0 such that 0 + x = x for all x F. (A5) To every x F corresponds an element x F such that x + ( x) = 0.
8 Field Axioms Definition Field definition continued: (M) Axioms for multiplication (M1) If x F and y F, then xy F. (M2) Multiplication is commutative: xy = yx for all x, y F. (M3) Multiplication is associative: (xy)z = x(yz) for all x, y, z F. (M4) F contains an element 1 0 such that 1x = x for all x F. (M5) If x F and x 0 then exists an element 1/x F such that x (1/x) = 1. (D) The distributive law x(y + z) = xy + xz holds for all x, y, z F.
9 Addition of Matrices (A1) A = B a ij = b ij, 1 i m, 1 j n. (A2) A M(m n), B M(m n) A + B := (a ij + b ij ). (A3) Addition is commutative: A + B = B + A. (A4) Addition is associative: (A + B) + C = A + (B + C) (A5) Identity element: A = (A6) Negative element: A = (a ij ).
10 Multiplication of Matrices (M1) A M(m n), B M(n r) C = A B = (c ik ) M(m r), c ik = a i1 b 1k a in b nk = n a ij b jk. j=1 (M2) Multiplication of matrices is in general not commutative! (M3) Multiplication of matrices is associative (M4) Identity matrix: I = I n =..... M(n n) (M5) A I = I A, but A B = A C does not imply in general B = C!
11 Transpose, Inverse, Multiplication with scalars (M) Transpose and Inverse (T) Transpose of A: A T, with (A T ) T = A, (A + B) T = A T + B T and (A B) T = B T A T. (I) Given A M(n n) and X M(n n). If A X = X A = I, then X = A 1 is the inverse of A. (Ms) Multiplication with scalars (Ms1) λ K, A M(m n) λa := (λa ij ). (Ms2) Multiplication with scalars is commutative and associative. (Ms3) The distributive law holds: (λ + µ)a = λa + µa.
12 The inverse of a matrix Theorem If A 1 exists, it is unique. Definition A M(n n) is called singular, if A 1 does not exist. Otherwise it is called non-singular. Theorem Given A, B M(n n) non-singular. Then it follows A B non-singular and (A B) 1 = B 1 A 1. A 1 non-singular and (A 1 ) 1 = A. A T non-singular and (A T ) 1 = (A 1 ) T.
13 Gauss-Algorithm Example Gauss-Algorithm 2u + v + w = 1 4u + v = 2 2u + 2v + w = 7 2u + v + w = 1 1v 2w = 4 4w = 4
14 Theorems: Solutions under Gauss-Algorithm Theorem Given a matrix A M(m n) 1. The Gauss-Algorithm transforms in a finite number of steps A into an upper triangular matrix A. 2. rank(a) = rank(a ). 3. Given the augmented matrix (A, b) and the upper triangular matrix (A, b ). Then x is a solution of Ax = b x is a solution of A x = b.
15 Theorems: Solutions under Gauss-Algorithm Theorem Given A M(m n), b = b 1. b m R m, x = The linear equation system Ax = b has a solution, if rank(a)=rank(a, b). The linear equation system has a unique solution, if rank(a)=rank(a, b)=n. x 1. x n R n.
16 Theorems: Solutions under Gauss-Algorithm Theorem Given x 0 a particulate solution of Ax = b. Then the solutions x of Ax = b have the form x = x 0 + h, where h is the general solution of the homogeneous equation system. Corollary 1. Ax = b has an unique solution { Ax = b has a solution. Ax = 0, has only the solution x = A M(n n): Ax = b has an unique solution rank(a) = n A is non-singular Ax = 0 has only the solution x = 0. The solution of Ax = b is given as x = A 1 b. 3. rank(a) = n A 1 exists.
17 Determination of Determinants A M(2 2, R) ( ) a11 a A = 12 det(a) = a a 21 a 11 a 22 a 12 a A M(3 3, R): Rule of Sarrus A = a 11 a 12 a 13 a 21 a 22 a 23 a 31 a 32 a 33 a 11 a 12 a 13 a 21 a 22 a 23 a 31 a 32 a 33 a 11 a 12 a 21 a 22 a 31 a 32 det(a) = a 11 a 22 a 33 + a 12 a 23 a 31 + a 13 a 21 a 32 a 13 a 22 a 31 a 11 a 23 a 32 a 12 a 21 a 33
18 Determination of Determinants A M(n n, R) Definition Given a matrix A = (a ij ) M(n n). The minor A ij is the determinant of the matrix M(n 1 n 1) obtained by removing the i-th row and the j-th column of A. The associated cofactor C ij = ( 1) i+j A ij. Definition The determinant of a matrix A = (a ij ) M(n n) is defined by n det(a) = ( 1) 1+j a 1j A 1j = j=1 n a 1j C 1j, j=1 i.e. Laplace expansion with first row.
19 Determinants: Properties 1. det(a T ) = det(a) 2. i : a i = (0,..., 0) det(a) = 0 3. det(λa) = λ n det(a), if A M(n n) 4. i, j : i j and a i = a j det(a) = 0 5. (1) det(a B) = deta detb (2) det(a + B) det(a) + det(b) 6. A A through changing of n rows det(a ) = ( 1) n det(a) 7. A A through multiplication of i-th row with λ det(a ) = λdet(a) 8. A A through adding the λ-fold of i-th row to the j-th row det(a ) = det(a) 9. A is non-singular rank(a) = n det(a) 0 det(a 1 ) = 1 det(a) 10. If A = diag(a 11,..., a nn ) det(a) = n k=1 a kk
20 General vector spaces Definition Given K some field. A non-empty set V is called a K-vector space, if for all a, b V a + b V. for all λ K and a V λ a V. The field is closed with respect to addition and multiplication with scalars. Definition Given V a K-vector space. A non-empty subset U V is called a linear subspace of V if for all λ K and a, b U a + b U, λ a U.
21 Linear combination and span(u) Definition Given scalars λ 1,..., λ m K and vectors a 1,..., a m V. A vector a = λ 1 a λ m a m is called a linear combination of a 1,..., a m. The linear combination is called trivial, if λ 1 =... = λ m = 0, otherwise it is called non-trivial. Definition Given U V a non-empty subset. The set of all linear combinations of vectors in U { span(u) = a = } λ i a i, λ i K, a i U is called span(u).
22 Linear independency Definition The vectors a 1,..., a m V are called linearly dependent (l.d.), if there exists a non-trivial linear combination, such that λ 1 a λ m a m = 0, i : λ i 0. The vectors a 1,..., a m V are called linearly independent (l.i.), if they are not linearly dependent. Theorem Given vectors a 1,..., a m V. The following is equivalent: 1. The vectors a 1,..., a m are linearly dependent. 2. At least one vector a i is a linear combination of the other, i.e. i {1,..., m} : a i = j i λ j a j.
23 Linear independency and basis Definition The non-empty vector subset U V is called linearly independent, if every finite set of vectors in U is linearly independent. Definition Given V a K-vector space. A subset U V of linearly independent vectors in called a basis of V, if span(u) = V. A vector space has finite dimension, if it exists a finite basis. Theorem In a vector space with finite dimension every basis has the same number of vectors. This is called the dimension of V, dimv.
24 Algorithms Determination of Basis Given {v 1,..., v m } vectors in K n. Step 1: Write the n vectors as rows in a matrix. Step 2: Apply Gauss algorithm to get a triangular matrix. Step 3: The non-zero rows form a basis of the subset of K n. Extension of Basis Given m l.i. vectors {v 1,..., v m } vectors in K n, with m < n. Step 1: Use a basis of K n, e.g. the unit vectors {e 1,..., e n }. Step 2: Write the vectors v j and e i in a matrix. Step 3: Apply Gauss algorithm to get a triangular matrix. Step 4: The n m non-zero unit vectors complete the m l.i. vectors to a basis of K n.
25 Unitary vector spaces: Scalar product Definition Given V a K-vector space. A mapping, : V V K (v, w) v, w is called scalar product in V, if for all v, w, u V and for all λ K (S1) v, v > 0, if v 0. (S2) v, w = w, v, if v, w K = R. (S3) λv, w = λ v, w. (S4) u + v, w = u, w + v, w. Definition A vector space with a scalar product is called a unitary vector space.
26 Unitary vector spaces: Norm Definition Given V a K-vector space. A mapping : V K is called a norm, if (N1) v 0, v V and v = 0 v = 0. (N2) λv = λ v, v V and λ K. (N3) v + w v + w, v, w V (triangular inequality). Definition Given V a unitary vector space. The mapping : V K v v := v, v is the norm of V. A vector v V is called unit vector if v = 1.
27 Orthogonal and orthonormal vectors Definition Given V an unitary vector space. Two vectors u, v V are called orthogonal, if u, v = 0. A non-empty subset U V is called orthonormal, if all vectors in U are pairwise orthogonal and have norm equal to 1. Definition Given {v 1,..., v n } V linearly independent vectors. The vectors {v 1,..., v n } form an orthogonal basis of V, if dimv = n and v i, v j = { 1, i = j 0, i j.
28 Gram-Schmidt Orthogonalisation Given V an unitary vector space with norm and {v 1,..., v n } a linearly independent subset of V. The set {w 1,..., w n } is orthonormal (i.e. orthogonal and unit norm), with w 1 = w i = 1 v 1 v 1 1 u i u i, i = 2,..., n with i 1 u i = v i v i, w k w k, i = 2,..., n k=1
29 Eigenvalues and Eigenvectors Tacoma Bridge: 4 months after opening it crashed The oscillations of the bridge were caused by the frequency of wind being to close to the natural frequency of the bridge. The natural frequency is the eigenvalue of smallest magnitude of a system that models the bridge.
30 Eigenvalues and Eigenvectors Transformation, such that the central vertical axis does not change direction. The blue vector changes direction and hence is not an eigenvector. The red vector is an eigenvector of the transformation, with eigenvalue 1, since it is neither stretched nor compressed.
31 Eigenvalues and Eigenvectors Definition Given A M(n n), with a ij R. λ is call eigenvalue if v C n : Av = λv. The vector v 0 is called eigenvector corresponding to λ. Determination Av = λv Av λiv = 0 (A λi )v = 0 The homogenous linear equation system has a non-trivial solution det(a λi ) = 0.
32 Eigenvalues and Eigenvectors Multiplicities If λ j is a zero of order r of the characteristic polynomial P(λ), the algebraic multiplicity is r = µ(p, λ j ). Given an eigenvalue λ, the geometric multiplicity of λ is defined as the dimension of the eigenspace E λ. Theorem A matrix A M(n n) has n linearly independent eigenvectors dime λ = µ(p, λ). Theorem A matrix A M(n n) can be diagonalised A has n linearly independent eigenvectors
33 Eigenvalues and Eigenvectors Theorem Given A M(n n) symmetric (i.e A T = A) and with real entries all eigenvalues are real. Theorem Given λ 1 and λ 2 distinct eigenvalues of a real and symmetric matrix, with corresponding eigenvectors v 1 and v 2 v 1 and v 2 are orthogonal. Theorem A real and symmetric matrix A M(n n) has always n orthonormal eigenvectors. Theorem Given a matrix A M(n n). It exists always a non-singular matrix C, such that C 1 AC = J, where J is a Jordan matrix.
34 Eigenvalues and Eigenvectors Diagonalisation of a matrix C 1 AC = D: dime λ = µ(p, λ) D = diag(λ 1,..., λ n ), where λ i are the eigenvalues of A and C = (v 1,, v n ), where v i are the linearly independent eigenvectors of A. Orthogonal diagonalisation of a matrix Q T AQ = D: dime λ = µ(p, λ) Given a real and symmetric matrix A. D = diag(λ 1,..., λ n ), where λ i are the real eigenvalues of A and Q = (v 1,, v n ), where v i are the orthonormal eigenvectors of A. Jordan form C 1 AC = J: dime λ < µ(p, λ) J = diag(b 1 (λ 1 ),..., B r (λ r )), where B i (λ i ) is the Jordan block-matrix corresponding to λ i and C = (v 1,, v n ), where v i are the linearly independent eigenvectors of A.
35 Singular Value Decomposition Singular Value Decomposition For a matrix A M(m n) it always exists a decomposition A = UΣV T, where U M(m m) and V M(n ( n) ) are orthonormal matrices D 0 and Σ M(m n), where Σ = and D is a diagonal 0 0 matrix diag(σ 1,..., σ r ). σ 1... σ r and σ r+1 =... = σ n = 0 are the singular values of A, i.e. the square roots of the eigenvalues of A T A.
36 Singular Value Decomposition Determination Step 1: Determine the eigenvalues and eigenvectors of A T A. Step 2: Determine the orthonormal eigenvectors {v 1,..., v n } (Gram-Schmidt). The orthonormal eigenvectors are the columns of V. Step 3.1: Calculate u i = 1 σ i Av i, i = 1,..., r. Step 3.2: If r < m: Complete the vectors {u 1,..., u r } to an orthonormal basis {u 1,..., u m }. The orthonormal vectors u i are the columns of U.
37 Singular Value Decomposition Application Determination of the rank: Given σ 1,..., σ r the non-zero singular values of A rank(a) = r. Determination of the Moore-Penrose inverse: Given A M(m n) with linearly dependent columns, the Moore-Penrose inverse can be determined by A # = V Σ # U T, where Σ # M(n m) and Σ # = D 1 = diag( 1 σ 1,..., 1 σ r ). ( D ), with
38 Decomposition of matrices Cholesky Decomposition Given A M(n n) a positive definite matrix (symmetric and all eigenvalues positive). Then it exists a lower triangular matrix L, such that A = LL T. Advantages Fast column wise algorithm, starting with first column. Formulas for the calculation of the l ij s easy to get. The Cholesky decomposition determines A. Applications in finance and actuarial science, e.g. estimation of the covariance matrix of several asset classes.
39 Decomposition of matrices LU Decomposition Given A M(n n) a non-singular matrix. Then it exists a lower triangular matrix L, an upper triangular matrix U and a permutation matrix P, such that PA = LU or equivalently A = P T LU. Definitions U is the resulting matrix when applying Gauss on A. L contains 1 on the diagonal and the l ij s with i > j are the ( 1)factors used in Gauss to reduce the corresponding a ij s to 0. If rows in A are changed the corresponding factors l ij in L have to change as well.
40 Decomposition of matrices LU decomposition cont d: Definitions P is the identity matrix with permutated rows i and j if the Gauss algorithm permutates the rows i and j in A. Advantages If the equation system Ax = b has to be solved for different vectors b, the decomposition has to be done only once. In this case the LU decomposition is faster than Gauss. The equation system can be solved via solving Ly = b first and then Ux = y.
41 Decomposition of matrices QR Decomposition Given A M(m n). Then it exists an orthogonal matrix Q M(m n) (containing the orthonormalized columns of A), an upper triangular matrix R M(n n), such that A = QR. Definitions Q = (q 1,..., q n ) is obtained by applying Gram-Schmidt to the columns of A = (a 1,..., a n ). q 1, a 1 q 1, a 2 q 1, a n R = Q T 0 q 2, a 2 q 2, a n A = q n, a n
42 Decomposition of matrices QR decomposition cont d: Advantages Solving Ax = b is equivalent to solving Q T Ax = Q T b = b. Therefore it is sufficient to solve Rx = b. This decomposition can ce applied to every matrix A M(m n). Problems with numerical stability of Gram-Schmidt more efficient and stable algorithms available.
43 Norms of Matrices Norms of matrices The norm A of a matrix A = (a ij ) M(n n) can be defined by n A := max a ij, i = 1,..., n j=1 This the maximum of the row s sums. Alternatively the norm can be defined by the maximum of the column s sums and also other definitions are available in literature.
44 Norms of Matrices cont d Properties The following list is valid for all different definitions of norms of matrices. A 0 αa = α A A + B A + B A B A B A A 1 = I = 1
45 Norms of Matrices cont d Condition numbers The condition number conda of a non-singular matrix A is defined by conda := A A 1. Due to the properties of the norm of A it follows conda 1. Definition A matrix A is not sensitive to the changing of entries, if the condition number is close to 1. If the condition number of a matrix A is 1, then a small changing in A or b can have a huge impact on the solution x of Ax = b.
Lecture Summaries for Linear Algebra M51A
These lecture summaries may also be viewed online by clicking the L icon at the top right of any lecture screen. Lecture Summaries for Linear Algebra M51A refers to the section in the textbook. Lecture
More informationIr O D = D = ( ) Section 2.6 Example 1. (Bottom of page 119) dim(v ) = dim(l(v, W )) = dim(v ) dim(f ) = dim(v )
Section 3.2 Theorem 3.6. Let A be an m n matrix of rank r. Then r m, r n, and, by means of a finite number of elementary row and column operations, A can be transformed into the matrix ( ) Ir O D = 1 O
More informationMath 102, Winter Final Exam Review. Chapter 1. Matrices and Gaussian Elimination
Math 0, Winter 07 Final Exam Review Chapter. Matrices and Gaussian Elimination { x + x =,. Different forms of a system of linear equations. Example: The x + 4x = 4. [ ] [ ] [ ] vector form (or the column
More informationMATH 240 Spring, Chapter 1: Linear Equations and Matrices
MATH 240 Spring, 2006 Chapter Summaries for Kolman / Hill, Elementary Linear Algebra, 8th Ed. Sections 1.1 1.6, 2.1 2.2, 3.2 3.8, 4.3 4.5, 5.1 5.3, 5.5, 6.1 6.5, 7.1 7.2, 7.4 DEFINITIONS Chapter 1: Linear
More information235 Final exam review questions
5 Final exam review questions Paul Hacking December 4, 0 () Let A be an n n matrix and T : R n R n, T (x) = Ax the linear transformation with matrix A. What does it mean to say that a vector v R n is an
More informationIMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET
IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET This is a (not quite comprehensive) list of definitions and theorems given in Math 1553. Pay particular attention to the ones in red. Study Tip For each
More informationMATH 423 Linear Algebra II Lecture 33: Diagonalization of normal operators.
MATH 423 Linear Algebra II Lecture 33: Diagonalization of normal operators. Adjoint operator and adjoint matrix Given a linear operator L on an inner product space V, the adjoint of L is a transformation
More informationMatrix decompositions
Matrix decompositions Zdeněk Dvořák May 19, 2015 Lemma 1 (Schur decomposition). If A is a symmetric real matrix, then there exists an orthogonal matrix Q and a diagonal matrix D such that A = QDQ T. The
More informationAlgebra C Numerical Linear Algebra Sample Exam Problems
Algebra C Numerical Linear Algebra Sample Exam Problems Notation. Denote by V a finite-dimensional Hilbert space with inner product (, ) and corresponding norm. The abbreviation SPD is used for symmetric
More informationMath Linear Algebra Final Exam Review Sheet
Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of
More informationCS 143 Linear Algebra Review
CS 143 Linear Algebra Review Stefan Roth September 29, 2003 Introductory Remarks This review does not aim at mathematical rigor very much, but instead at ease of understanding and conciseness. Please see
More informationLinear Algebra M1 - FIB. Contents: 5. Matrices, systems of linear equations and determinants 6. Vector space 7. Linear maps 8.
Linear Algebra M1 - FIB Contents: 5 Matrices, systems of linear equations and determinants 6 Vector space 7 Linear maps 8 Diagonalization Anna de Mier Montserrat Maureso Dept Matemàtica Aplicada II Translation:
More informationMATH 304 Linear Algebra Lecture 34: Review for Test 2.
MATH 304 Linear Algebra Lecture 34: Review for Test 2. Topics for Test 2 Linear transformations (Leon 4.1 4.3) Matrix transformations Matrix of a linear mapping Similar matrices Orthogonality (Leon 5.1
More information1. General Vector Spaces
1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule
More informationIMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET
IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET This is a (not quite comprehensive) list of definitions and theorems given in Math 1553. Pay particular attention to the ones in red. Study Tip For each
More information1 Last time: least-squares problems
MATH Linear algebra (Fall 07) Lecture Last time: least-squares problems Definition. If A is an m n matrix and b R m, then a least-squares solution to the linear system Ax = b is a vector x R n such that
More informationLecture notes: Applied linear algebra Part 1. Version 2
Lecture notes: Applied linear algebra Part 1. Version 2 Michael Karow Berlin University of Technology karow@math.tu-berlin.de October 2, 2008 1 Notation, basic notions and facts 1.1 Subspaces, range and
More informationUNIT 6: The singular value decomposition.
UNIT 6: The singular value decomposition. María Barbero Liñán Universidad Carlos III de Madrid Bachelor in Statistics and Business Mathematical methods II 2011-2012 A square matrix is symmetric if A T
More informationMatrices and Linear Algebra
Contents Quantitative methods for Economics and Business University of Ferrara Academic year 2017-2018 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2
More informationSUMMARY OF MATH 1600
SUMMARY OF MATH 1600 Note: The following list is intended as a study guide for the final exam. It is a continuation of the study guide for the midterm. It does not claim to be a comprehensive list. You
More informationSYLLABUS. 1 Linear maps and matrices
Dr. K. Bellová Mathematics 2 (10-PHY-BIPMA2) SYLLABUS 1 Linear maps and matrices Operations with linear maps. Prop 1.1.1: 1) sum, scalar multiple, composition of linear maps are linear maps; 2) L(U, V
More informationQuantum Computing Lecture 2. Review of Linear Algebra
Quantum Computing Lecture 2 Review of Linear Algebra Maris Ozols Linear algebra States of a quantum system form a vector space and their transformations are described by linear operators Vector spaces
More informationReview problems for MA 54, Fall 2004.
Review problems for MA 54, Fall 2004. Below are the review problems for the final. They are mostly homework problems, or very similar. If you are comfortable doing these problems, you should be fine on
More informationLinear algebra II Tutorial solutions #1 A = x 1
Linear algebra II Tutorial solutions #. Find the eigenvalues and the eigenvectors of the matrix [ ] 5 2 A =. 4 3 Since tra = 8 and deta = 5 8 = 7, the characteristic polynomial is f(λ) = λ 2 (tra)λ+deta
More informationNumerical Methods - Numerical Linear Algebra
Numerical Methods - Numerical Linear Algebra Y. K. Goh Universiti Tunku Abdul Rahman 2013 Y. K. Goh (UTAR) Numerical Methods - Numerical Linear Algebra I 2013 1 / 62 Outline 1 Motivation 2 Solving Linear
More informationA Review of Linear Algebra
A Review of Linear Algebra Mohammad Emtiyaz Khan CS,UBC A Review of Linear Algebra p.1/13 Basics Column vector x R n, Row vector x T, Matrix A R m n. Matrix Multiplication, (m n)(n k) m k, AB BA. Transpose
More informationforms Christopher Engström November 14, 2014 MAA704: Matrix factorization and canonical forms Matrix properties Matrix factorization Canonical forms
Christopher Engström November 14, 2014 Hermitian LU QR echelon Contents of todays lecture Some interesting / useful / important of matrices Hermitian LU QR echelon Rewriting a as a product of several matrices.
More informationDefinitions for Quizzes
Definitions for Quizzes Italicized text (or something close to it) will be given to you. Plain text is (an example of) what you should write as a definition. [Bracketed text will not be given, nor does
More informationEE/ACM Applications of Convex Optimization in Signal Processing and Communications Lecture 2
EE/ACM 150 - Applications of Convex Optimization in Signal Processing and Communications Lecture 2 Andre Tkacenko Signal Processing Research Group Jet Propulsion Laboratory April 5, 2012 Andre Tkacenko
More informationPreliminary/Qualifying Exam in Numerical Analysis (Math 502a) Spring 2012
Instructions Preliminary/Qualifying Exam in Numerical Analysis (Math 502a) Spring 2012 The exam consists of four problems, each having multiple parts. You should attempt to solve all four problems. 1.
More informationConceptual Questions for Review
Conceptual Questions for Review Chapter 1 1.1 Which vectors are linear combinations of v = (3, 1) and w = (4, 3)? 1.2 Compare the dot product of v = (3, 1) and w = (4, 3) to the product of their lengths.
More informationLinear Algebra, part 3 QR and SVD
Linear Algebra, part 3 QR and SVD Anna-Karin Tornberg Mathematical Models, Analysis and Simulation Fall semester, 2012 Going back to least squares (Section 1.4 from Strang, now also see section 5.2). We
More informationLinear Algebra, part 3. Going back to least squares. Mathematical Models, Analysis and Simulation = 0. a T 1 e. a T n e. Anna-Karin Tornberg
Linear Algebra, part 3 Anna-Karin Tornberg Mathematical Models, Analysis and Simulation Fall semester, 2010 Going back to least squares (Sections 1.7 and 2.3 from Strang). We know from before: The vector
More information(a) If A is a 3 by 4 matrix, what does this tell us about its nullspace? Solution: dim N(A) 1, since rank(a) 3. Ax =
. (5 points) (a) If A is a 3 by 4 matrix, what does this tell us about its nullspace? dim N(A), since rank(a) 3. (b) If we also know that Ax = has no solution, what do we know about the rank of A? C(A)
More informationLinear Algebra Practice Problems
Linear Algebra Practice Problems Page of 7 Linear Algebra Practice Problems These problems cover Chapters 4, 5, 6, and 7 of Elementary Linear Algebra, 6th ed, by Ron Larson and David Falvo (ISBN-3 = 978--68-78376-2,
More information5.6. PSEUDOINVERSES 101. A H w.
5.6. PSEUDOINVERSES 0 Corollary 5.6.4. If A is a matrix such that A H A is invertible, then the least-squares solution to Av = w is v = A H A ) A H w. The matrix A H A ) A H is the left inverse of A and
More informationCheat Sheet for MATH461
Cheat Sheet for MATH46 Here is the stuff you really need to remember for the exams Linear systems Ax = b Problem: We consider a linear system of m equations for n unknowns x,,x n : For a given matrix A
More informationReview of Some Concepts from Linear Algebra: Part 2
Review of Some Concepts from Linear Algebra: Part 2 Department of Mathematics Boise State University January 16, 2019 Math 566 Linear Algebra Review: Part 2 January 16, 2019 1 / 22 Vector spaces A set
More informationLinear Algebra Highlights
Linear Algebra Highlights Chapter 1 A linear equation in n variables is of the form a 1 x 1 + a 2 x 2 + + a n x n. We can have m equations in n variables, a system of linear equations, which we want to
More informationCalculating determinants for larger matrices
Day 26 Calculating determinants for larger matrices We now proceed to define det A for n n matrices A As before, we are looking for a function of A that satisfies the product formula det(ab) = det A det
More information1. Linear systems of equations. Chapters 7-8: Linear Algebra. Solution(s) of a linear system of equations (continued)
1 A linear system of equations of the form Sections 75, 78 & 81 a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2 a m1 x 1 + a m2 x 2 + + a mn x n = b m can be written in matrix
More informationELE/MCE 503 Linear Algebra Facts Fall 2018
ELE/MCE 503 Linear Algebra Facts Fall 2018 Fact N.1 A set of vectors is linearly independent if and only if none of the vectors in the set can be written as a linear combination of the others. Fact N.2
More informationc c c c c c c c c c a 3x3 matrix C= has a determinant determined by
Linear Algebra Determinants and Eigenvalues Introduction: Many important geometric and algebraic properties of square matrices are associated with a single real number revealed by what s known as the determinant.
More information33AH, WINTER 2018: STUDY GUIDE FOR FINAL EXAM
33AH, WINTER 2018: STUDY GUIDE FOR FINAL EXAM (UPDATED MARCH 17, 2018) The final exam will be cumulative, with a bit more weight on more recent material. This outline covers the what we ve done since the
More informationGlossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB
Glossary of Linear Algebra Terms Basis (for a subspace) A linearly independent set of vectors that spans the space Basic Variable A variable in a linear system that corresponds to a pivot column in the
More informationLinear Algebra Review. Vectors
Linear Algebra Review 9/4/7 Linear Algebra Review By Tim K. Marks UCSD Borrows heavily from: Jana Kosecka http://cs.gmu.edu/~kosecka/cs682.html Virginia de Sa (UCSD) Cogsci 8F Linear Algebra review Vectors
More informationELEMENTARY LINEAR ALGEBRA WITH APPLICATIONS. 1. Linear Equations and Matrices
ELEMENTARY LINEAR ALGEBRA WITH APPLICATIONS KOLMAN & HILL NOTES BY OTTO MUTZBAUER 11 Systems of Linear Equations 1 Linear Equations and Matrices Numbers in our context are either real numbers or complex
More informationMath 102 Final Exam - Dec 14 - PCYNH pm Fall Name Student No. Section A0
Math 12 Final Exam - Dec 14 - PCYNH 122-6pm Fall 212 Name Student No. Section A No aids allowed. Answer all questions on test paper. Total Marks: 4 8 questions (plus a 9th bonus question), 5 points per
More informationChapter 3 Transformations
Chapter 3 Transformations An Introduction to Optimization Spring, 2014 Wei-Ta Chu 1 Linear Transformations A function is called a linear transformation if 1. for every and 2. for every If we fix the bases
More informationEXAM. Exam 1. Math 5316, Fall December 2, 2012
EXAM Exam Math 536, Fall 22 December 2, 22 Write all of your answers on separate sheets of paper. You can keep the exam questions. This is a takehome exam, to be worked individually. You can use your notes.
More informationFundamentals of Engineering Analysis (650163)
Philadelphia University Faculty of Engineering Communications and Electronics Engineering Fundamentals of Engineering Analysis (6563) Part Dr. Omar R Daoud Matrices: Introduction DEFINITION A matrix is
More informationElementary linear algebra
Chapter 1 Elementary linear algebra 1.1 Vector spaces Vector spaces owe their importance to the fact that so many models arising in the solutions of specific problems turn out to be vector spaces. The
More informationLinear Algebra Primer
Linear Algebra Primer David Doria daviddoria@gmail.com Wednesday 3 rd December, 2008 Contents Why is it called Linear Algebra? 4 2 What is a Matrix? 4 2. Input and Output.....................................
More informationKnowledge Discovery and Data Mining 1 (VO) ( )
Knowledge Discovery and Data Mining 1 (VO) (707.003) Review of Linear Algebra Denis Helic KTI, TU Graz Oct 9, 2014 Denis Helic (KTI, TU Graz) KDDM1 Oct 9, 2014 1 / 74 Big picture: KDDM Probability Theory
More informationLINEAR ALGEBRA 1, 2012-I PARTIAL EXAM 3 SOLUTIONS TO PRACTICE PROBLEMS
LINEAR ALGEBRA, -I PARTIAL EXAM SOLUTIONS TO PRACTICE PROBLEMS Problem (a) For each of the two matrices below, (i) determine whether it is diagonalizable, (ii) determine whether it is orthogonally diagonalizable,
More informationProblem # Max points possible Actual score Total 120
FINAL EXAMINATION - MATH 2121, FALL 2017. Name: ID#: Email: Lecture & Tutorial: Problem # Max points possible Actual score 1 15 2 15 3 10 4 15 5 15 6 15 7 10 8 10 9 15 Total 120 You have 180 minutes to
More informationMATH 304 Linear Algebra Lecture 23: Diagonalization. Review for Test 2.
MATH 304 Linear Algebra Lecture 23: Diagonalization. Review for Test 2. Diagonalization Let L be a linear operator on a finite-dimensional vector space V. Then the following conditions are equivalent:
More information3 (Maths) Linear Algebra
3 (Maths) Linear Algebra References: Simon and Blume, chapters 6 to 11, 16 and 23; Pemberton and Rau, chapters 11 to 13 and 25; Sundaram, sections 1.3 and 1.5. The methods and concepts of linear algebra
More informationMath 4A Notes. Written by Victoria Kala Last updated June 11, 2017
Math 4A Notes Written by Victoria Kala vtkala@math.ucsb.edu Last updated June 11, 2017 Systems of Linear Equations A linear equation is an equation that can be written in the form a 1 x 1 + a 2 x 2 +...
More informationPRACTICE PROBLEMS FOR THE FINAL
PRACTICE PROBLEMS FOR THE FINAL Here are a slew of practice problems for the final culled from old exams:. Let P be the vector space of polynomials of degree at most. Let B = {, (t ), t + t }. (a) Show
More informationLinGloss. A glossary of linear algebra
LinGloss A glossary of linear algebra Contents: Decompositions Types of Matrices Theorems Other objects? Quasi-triangular A matrix A is quasi-triangular iff it is a triangular matrix except its diagonal
More informationEE731 Lecture Notes: Matrix Computations for Signal Processing
EE731 Lecture Notes: Matrix Computations for Signal Processing James P. Reilly c Department of Electrical and Computer Engineering McMaster University September 22, 2005 0 Preface This collection of ten
More informationSTA141C: Big Data & High Performance Statistical Computing
STA141C: Big Data & High Performance Statistical Computing Lecture 5: Numerical Linear Algebra Cho-Jui Hsieh UC Davis April 20, 2017 Linear Algebra Background Vectors A vector has a direction and a magnitude
More informationLINEAR ALGEBRA SUMMARY SHEET.
LINEAR ALGEBRA SUMMARY SHEET RADON ROSBOROUGH https://intuitiveexplanationscom/linear-algebra-summary-sheet/ This document is a concise collection of many of the important theorems of linear algebra, organized
More informationLecture 7: Positive Semidefinite Matrices
Lecture 7: Positive Semidefinite Matrices Rajat Mittal IIT Kanpur The main aim of this lecture note is to prepare your background for semidefinite programming. We have already seen some linear algebra.
More informationOHSx XM511 Linear Algebra: Solutions to Online True/False Exercises
This document gives the solutions to all of the online exercises for OHSx XM511. The section ( ) numbers refer to the textbook. TYPE I are True/False. Answers are in square brackets [. Lecture 02 ( 1.1)
More informationMA 265 FINAL EXAM Fall 2012
MA 265 FINAL EXAM Fall 22 NAME: INSTRUCTOR S NAME:. There are a total of 25 problems. You should show work on the exam sheet, and pencil in the correct answer on the scantron. 2. No books, notes, or calculators
More informationMAT Linear Algebra Collection of sample exams
MAT 342 - Linear Algebra Collection of sample exams A-x. (0 pts Give the precise definition of the row echelon form. 2. ( 0 pts After performing row reductions on the augmented matrix for a certain system
More informationTBP MATH33A Review Sheet. November 24, 2018
TBP MATH33A Review Sheet November 24, 2018 General Transformation Matrices: Function Scaling by k Orthogonal projection onto line L Implementation If we want to scale I 2 by k, we use the following: [
More informationANSWERS. E k E 2 E 1 A = B
MATH 7- Final Exam Spring ANSWERS Essay Questions points Define an Elementary Matrix Display the fundamental matrix multiply equation which summarizes a sequence of swap, combination and multiply operations,
More informationNotes on Linear Algebra
1 Notes on Linear Algebra Jean Walrand August 2005 I INTRODUCTION Linear Algebra is the theory of linear transformations Applications abound in estimation control and Markov chains You should be familiar
More information1 9/5 Matrices, vectors, and their applications
1 9/5 Matrices, vectors, and their applications Algebra: study of objects and operations on them. Linear algebra: object: matrices and vectors. operations: addition, multiplication etc. Algorithms/Geometric
More informationFall TMA4145 Linear Methods. Exercise set Given the matrix 1 2
Norwegian University of Science and Technology Department of Mathematical Sciences TMA445 Linear Methods Fall 07 Exercise set Please justify your answers! The most important part is how you arrive at an
More informationLinear Algebra problems
Linear Algebra problems 1. Show that the set F = ({1, 0}, +,.) is a field where + and. are defined as 1+1=0, 0+0=0, 0+1=1+0=1, 0.0=0.1=1.0=0, 1.1=1.. Let X be a non-empty set and F be any field. Let X
More informationOnline Exercises for Linear Algebra XM511
This document lists the online exercises for XM511. The section ( ) numbers refer to the textbook. TYPE I are True/False. Lecture 02 ( 1.1) Online Exercises for Linear Algebra XM511 1) The matrix [3 2
More informationEcon Slides from Lecture 7
Econ 205 Sobel Econ 205 - Slides from Lecture 7 Joel Sobel August 31, 2010 Linear Algebra: Main Theory A linear combination of a collection of vectors {x 1,..., x k } is a vector of the form k λ ix i for
More informationMath Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88
Math Camp 2010 Lecture 4: Linear Algebra Xiao Yu Wang MIT Aug 2010 Xiao Yu Wang (MIT) Math Camp 2010 08/10 1 / 88 Linear Algebra Game Plan Vector Spaces Linear Transformations and Matrices Determinant
More informationEquality: Two matrices A and B are equal, i.e., A = B if A and B have the same order and the entries of A and B are the same.
Introduction Matrix Operations Matrix: An m n matrix A is an m-by-n array of scalars from a field (for example real numbers) of the form a a a n a a a n A a m a m a mn The order (or size) of A is m n (read
More informationA Brief Outline of Math 355
A Brief Outline of Math 355 Lecture 1 The geometry of linear equations; elimination with matrices A system of m linear equations with n unknowns can be thought of geometrically as m hyperplanes intersecting
More informationDS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.
DS-GA 1002 Lecture notes 0 Fall 2016 Linear Algebra These notes provide a review of basic concepts in linear algebra. 1 Vector spaces You are no doubt familiar with vectors in R 2 or R 3, i.e. [ ] 1.1
More informationThere are six more problems on the next two pages
Math 435 bg & bu: Topics in linear algebra Summer 25 Final exam Wed., 8/3/5. Justify all your work to receive full credit. Name:. Let A 3 2 5 Find a permutation matrix P, a lower triangular matrix L with
More informationMATH 23a, FALL 2002 THEORETICAL LINEAR ALGEBRA AND MULTIVARIABLE CALCULUS Solutions to Final Exam (in-class portion) January 22, 2003
MATH 23a, FALL 2002 THEORETICAL LINEAR ALGEBRA AND MULTIVARIABLE CALCULUS Solutions to Final Exam (in-class portion) January 22, 2003 1. True or False (28 points, 2 each) T or F If V is a vector space
More informationMTH 464: Computational Linear Algebra
MTH 464: Computational Linear Algebra Lecture Outlines Exam 2 Material Prof. M. Beauregard Department of Mathematics & Statistics Stephen F. Austin State University March 2, 2018 Linear Algebra (MTH 464)
More information(f + g)(s) = f(s) + g(s) for f, g V, s S (cf)(s) = cf(s) for c F, f V, s S
1 Vector spaces 1.1 Definition (Vector space) Let V be a set with a binary operation +, F a field, and (c, v) cv be a mapping from F V into V. Then V is called a vector space over F (or a linear space
More informationNOTES on LINEAR ALGEBRA 1
School of Economics, Management and Statistics University of Bologna Academic Year 207/8 NOTES on LINEAR ALGEBRA for the students of Stats and Maths This is a modified version of the notes by Prof Laura
More informationMatrix Factorization and Analysis
Chapter 7 Matrix Factorization and Analysis Matrix factorizations are an important part of the practice and analysis of signal processing. They are at the heart of many signal-processing algorithms. Their
More informationMATH 31 - ADDITIONAL PRACTICE PROBLEMS FOR FINAL
MATH 3 - ADDITIONAL PRACTICE PROBLEMS FOR FINAL MAIN TOPICS FOR THE FINAL EXAM:. Vectors. Dot product. Cross product. Geometric applications. 2. Row reduction. Null space, column space, row space, left
More informationLecture 1: Review of linear algebra
Lecture 1: Review of linear algebra Linear functions and linearization Inverse matrix, least-squares and least-norm solutions Subspaces, basis, and dimension Change of basis and similarity transformations
More informationMATRICES ARE SIMILAR TO TRIANGULAR MATRICES
MATRICES ARE SIMILAR TO TRIANGULAR MATRICES 1 Complex matrices Recall that the complex numbers are given by a + ib where a and b are real and i is the imaginary unity, ie, i 2 = 1 In what we describe below,
More informationSTA141C: Big Data & High Performance Statistical Computing
STA141C: Big Data & High Performance Statistical Computing Numerical Linear Algebra Background Cho-Jui Hsieh UC Davis May 15, 2018 Linear Algebra Background Vectors A vector has a direction and a magnitude
More information2. Every linear system with the same number of equations as unknowns has a unique solution.
1. For matrices A, B, C, A + B = A + C if and only if A = B. 2. Every linear system with the same number of equations as unknowns has a unique solution. 3. Every linear system with the same number of equations
More information6 Inner Product Spaces
Lectures 16,17,18 6 Inner Product Spaces 6.1 Basic Definition Parallelogram law, the ability to measure angle between two vectors and in particular, the concept of perpendicularity make the euclidean space
More informationHOMEWORK 9 solutions
Math 4377/6308 Advanced Linear Algebra I Dr. Vaughn Climenhaga, PGH 651A Fall 2013 HOMEWORK 9 solutions Due 4pm Wednesday, November 13. You will be graded not only on the correctness of your answers but
More informationBasic Elements of Linear Algebra
A Basic Review of Linear Algebra Nick West nickwest@stanfordedu September 16, 2010 Part I Basic Elements of Linear Algebra Although the subject of linear algebra is much broader than just vectors and matrices,
More informationlinearly indepedent eigenvectors as the multiplicity of the root, but in general there may be no more than one. For further discussion, assume matrice
3. Eigenvalues and Eigenvectors, Spectral Representation 3.. Eigenvalues and Eigenvectors A vector ' is eigenvector of a matrix K, if K' is parallel to ' and ' 6, i.e., K' k' k is the eigenvalue. If is
More informationMathematical Methods wk 2: Linear Operators
John Magorrian, magog@thphysoxacuk These are work-in-progress notes for the second-year course on mathematical methods The most up-to-date version is available from http://www-thphysphysicsoxacuk/people/johnmagorrian/mm
More informationChapter 7: Symmetric Matrices and Quadratic Forms
Chapter 7: Symmetric Matrices and Quadratic Forms (Last Updated: December, 06) These notes are derived primarily from Linear Algebra and its applications by David Lay (4ed). A few theorems have been moved
More informationMultivariate Statistical Analysis
Multivariate Statistical Analysis Fall 2011 C. L. Williams, Ph.D. Lecture 4 for Applied Multivariate Analysis Outline 1 Eigen values and eigen vectors Characteristic equation Some properties of eigendecompositions
More information1. In this problem, if the statement is always true, circle T; otherwise, circle F.
Math 1553, Extra Practice for Midterm 3 (sections 45-65) Solutions 1 In this problem, if the statement is always true, circle T; otherwise, circle F a) T F If A is a square matrix and the homogeneous equation
More informationLinear Algebra Lecture Notes-II
Linear Algebra Lecture Notes-II Vikas Bist Department of Mathematics Panjab University, Chandigarh-64 email: bistvikas@gmail.com Last revised on March 5, 8 This text is based on the lectures delivered
More information