Basic Concepts in Linear Algebra

Size: px
Start display at page:

Download "Basic Concepts in Linear Algebra"

Transcription

1 Basic Concepts in Linear Algebra Grady B Wright Department of Mathematics Boise State University February 2, 2015 Grady B Wright Linear Algebra Basics February 2, / 39

2 Numerical Linear Algebra Linear systems of equations occur in almost every area of the applied science, engineering, and mathematics Hence, numerical linear algebra is one of the pillars of computational mathematics Grady B Wright Linear Algebra Basics February 2, / 39

3 Linear systems of equations A linear system of m equations and n unknowns can be expressed in the following general form: a 11 x 1 + a 12 x 2 + a 13 x a 1n x n = b 1, a 21 x 1 + a 22 x 2 + a 23 x a 2n x n = b 2, a 31 x 1 + a 32 x 2 + a 33 x a 3n x n = b 3, a m1 x 1 + a m2 x 2 + a m3 x a mn x n = b m (1) Here a ij are the coefficients of the systems, b i are the right hand sides (RHS), and x j are the unknown values that must be determined a ij and b i will be given by the problem Grady B Wright Linear Algebra Basics February 2, / 39

4 Linear systems of equations Linear systems can be classified into the following three types: 1 Square linear system: If the number of equations equals the number of unknowns (ie m = n) 2 Overdetermined system: If the number of equations is greater than the number of unknowns (ie m > n) 3 Underdetermined system: If the number equations is less than the number of unknowns (ie m < n) Grady B Wright Linear Algebra Basics February 2, / 39

5 Matrices and vectors A convenient notation to describe a linear system of equations is in terms of matrices and vectors Grady B Wright Linear Algebra Basics February 2, / 39

6 Matrices A matrix is just a table of numbers containing m rows and n columns and can be expressed as: a 11 a 12 a 13 a 1n a 21 a 22 a 23 a 2n A = a 31 a 32 a 33 a 3n a m1 a m2 a m3 a mn We typically use capital letters to denote matrices We write A R m n to denote a matrix with m rows and n columns A common shorthand notation for a matrix is A = { a ij }, where the values for i and j are understood from the problem Grady B Wright Linear Algebra Basics February 2, / 39

7 Matrices A matrix is just a table of numbers containing m rows and n columns and can be expressed as: a 11 a 12 a 13 a 1n a 21 a 22 a 23 a 2n A = a 31 a 32 a 33 a 3n a m1 a m2 a m3 a mn We typically use capital letters to denote matrices We write A R m n to denote a matrix with m rows and n columns A common shorthand notation for a matrix is A = { a ij }, where the values for i and j are understood from the problem Grady B Wright Linear Algebra Basics February 2, / 39

8 Matrices A matrix is just a table of numbers containing m rows and n columns and can be expressed as: a 11 a 12 a 13 a 1n a 21 a 22 a 23 a 2n A = a 31 a 32 a 33 a 3n a m1 a m2 a m3 a mn We typically use capital letters to denote matrices We write A R m n to denote a matrix with m rows and n columns A common shorthand notation for a matrix is A = { a ij }, where the values for i and j are understood from the problem Grady B Wright Linear Algebra Basics February 2, / 39

9 Matrices A matrix is just a table of numbers containing m rows and n columns and can be expressed as: a 11 a 12 a 13 a 1n a 21 a 22 a 23 a 2n A = a 31 a 32 a 33 a 3n a m1 a m2 a m3 a mn We typically use capital letters to denote matrices We write A R m n to denote a matrix with m rows and n columns A common shorthand notation for a matrix is A = { a ij }, where the values for i and j are understood from the problem Grady B Wright Linear Algebra Basics February 2, / 39

10 Vectors If the matrix only has one row or column then it is called a vector A column vector with n entries can be expressed as x 1 x 2 x = x 3 x n A row vector and can be expressed as x = [ x 1 x 2 x 3 x n ] We typically use bold lower-case letters to denote vectors A column vector with n real entries is denoted by x R n, while a row vector is denoted by x R 1 n Grady B Wright Linear Algebra Basics February 2, / 39

11 Vectors If the matrix only has one row or column then it is called a vector A column vector with n entries can be expressed as x 1 x 2 x = x 3 x n A row vector and can be expressed as x = [ x 1 x 2 x 3 x n ] We typically use bold lower-case letters to denote vectors A column vector with n real entries is denoted by x R n, while a row vector is denoted by x R 1 n Grady B Wright Linear Algebra Basics February 2, / 39

12 Vectors If the matrix only has one row or column then it is called a vector A column vector with n entries can be expressed as x 1 x 2 x = x 3 x n A row vector and can be expressed as x = [ x 1 x 2 x 3 x n ] We typically use bold lower-case letters to denote vectors A column vector with n real entries is denoted by x R n, while a row vector is denoted by x R 1 n Grady B Wright Linear Algebra Basics February 2, / 39

13 Vectors If the matrix only has one row or column then it is called a vector A column vector with n entries can be expressed as x 1 x 2 x = x 3 x n A row vector and can be expressed as x = [ x 1 x 2 x 3 x n ] We typically use bold lower-case letters to denote vectors A column vector with n real entries is denoted by x R n, while a row vector is denoted by x R 1 n Grady B Wright Linear Algebra Basics February 2, / 39

14 Vectors If the matrix only has one row or column then it is called a vector A column vector with n entries can be expressed as x 1 x 2 x = x 3 x n A row vector and can be expressed as x = [ x 1 x 2 x 3 x n ] We typically use bold lower-case letters to denote vectors A column vector with n real entries is denoted by x R n, while a row vector is denoted by x R 1 n Grady B Wright Linear Algebra Basics February 2, / 39

15 Matrix & vector operations Grady B Wright Linear Algebra Basics February 2, / 39

16 Matrix & vector operations Grady B Wright Linear Algebra Basics February 2, / 39

17 Matrix & vector operations: Transpose Let A R m n with entries a 11 a 12 a 13 a 1n a 21 a 22 a 23 a 2n A = a 31 a 32 a 33 a 3n, a m1 a m2 a m3 a mn then the transpose of A switches the columns of A with the rows, ie a 11 a 21 a 31 a m1 a 12 a 22 a 32 a m2 A T = a 13 a 23 a 33 a m3 a 1n a 2n a 3n a mn Note that A T R n m and that (A T ) T = A Grady B Wright Linear Algebra Basics February 2, / 39

18 Matrix & vector operations: Transpose The transpose can also be applied to vectors In this case if x is a (column) vector then x T is a row vector: x 1 x 2 if x = x 3 x n then x T = [ x 1 x 2 x 3 x n ] Similarly if x is row vector then x T is a column vector Grady B Wright Linear Algebra Basics February 2, / 39

19 Matrix & vector operations: Matrix addition Let A R m n and B R m n then the sum of A and B is given by } A + B = {a ij + b ij This is just the sum of the corresponding entries of the elements of A and B For this sum to make sense A and B must be the same size Grady B Wright Linear Algebra Basics February 2, / 39

20 Matrix & vector operations: scalar multiplication Let α be a real number and A R m n then the product of α and A is given by } αa = {α a ij Note that this is just α times each entry of A Grady B Wright Linear Algebra Basics February 2, / 39

21 Matrix & vector operations: Vector-vector products There are two types of vector-vector products that arise quite frequently These can be derived from the definition for matrix-matrix products (discussed later), but it is worth stating them separately Let x, y R n then the inner product or dot product of x and y is y 1 x T y = [ ] y 2 x 1 x 2 x n = x 1y 1 + x 2 y x n y n = y n n x j y j Note that the inner product is a single number The inner product is sometimes denoted by x y j=1 Grady B Wright Linear Algebra Basics February 2, / 39

22 Matrix & vector operations: Vector-vector products There are two types of vector-vector products that arise quite frequently These can be derived from the definition for matrix-matrix products (discussed later), but it is worth stating them separately Let x R m and y R n then the outer product of x with y is x 1 x 1 y 1 x 1 y 2 x 1 y n xy T x 2 [ ] x 2 y 1 x 2 y 2 x 2 y n = y1 y 2 y n = x m x m y 1 x m y 2 x m y n Note that the outer product is a matrix of size m-by-m Grady B Wright Linear Algebra Basics February 2, / 39

23 Matrix & vector operations: Matrix-vector products Let A R m n and x R n then the product of A and x is given by Ax =x 1 a 11 a 21 a 31 + x 2 a 12 a 22 a 32 + x 3 a 13 a 23 a x n a 1n a 2n a 3n a m1 a m2 a m3 a mn (2) Thus, the product Ax is a linear combination of the columns of A Grady B Wright Linear Algebra Basics February 2, / 39

24 Matrix & vector operations: Matrix-vector products Important observations regarding the matrix-vector product Ax: The only way for this product to make sense is if A has the same number of columns as x does rows Ax R m, ie the product is a column vector containing m entries If we let b = Ax then we can alternatively express the ith entry of b as b i = n a ij x j, i = 1,, m j=1 This illustrates that b i is just the inner product of the ith row of A with the vector x In general, computing Ax using the above formulas requires mn multiplications and m(n 1) additions Grady B Wright Linear Algebra Basics February 2, / 39

25 Matrix & vector operations: Matrix-matrix products Let A R m n and B R n p, and let B have columns B = b 1 b 2 b n The matrix-matrix product C = AB is given as C = Ab 1 Ab 2 Ab n This shows the kth column of the product AB is a linear combination of the columns of A with the coefficients in the linear combinations being determined by entries in the kth column of B Grady B Wright Linear Algebra Basics February 2, / 39

26 Matrix & vector operations: Matrix-matrix products Important observations regarding the matrix-matrix product AB, A R m n, B R n p : Number rows of A must equal number columns B AB R m p, ie the product is a matrix containing m rows and p columns In general, AB BA, ie the product does not commute Grady B Wright Linear Algebra Basics February 2, / 39

27 Matrix & vector operations: Matrix-matrix products Important observations regarding the matrix-matrix product AB, A R m n, B R n p : We can express each entry of C as c ik = n a ij b jk, i = 1,, m, k = 1,, p j=1 So c ik is just the inner product of the ith row of A with the kth column of B Computing AB using the above formulas requires mnp multiplications and m(n 1)p additions The transpose of the product AB satisfies: (AB) T = B T A T Grady B Wright Linear Algebra Basics February 2, / 39

28 Linear systems in matrix-vector notation Recall that we can express a linear system of equations with m equations and n unknowns as a 11 x 1 + a 12 x 2 + a 13 x a 1n x n = b 1, a 21 x 1 + a 22 x 2 + a 23 x a 2n x n = b 2, a 31 x 1 + a 32 x 2 + a 33 x a 3n x n = b 3, a m1 x 1 + a m2 x 2 + a m3 x a mn x n = b m (3) We can express this linear system in matrix-vector notation using the previous definitions Grady B Wright Linear Algebra Basics February 2, / 39

29 Linear systems in matrix-vector notation Let x R n, b R m, and A R m n, then the linear system is given as Ax = b, or a 11 a 12 a 13 a 1n x 1 b 1 a 21 a 22 a 23 a 2n x 2 b 2 a 31 a 32 a 33 a 3n x 3 = b 3 a m1 a m2 a m3 a mn x n b m }{{}}{{}}{{} A x b Grady B Wright Linear Algebra Basics February 2, / 39

30 Linear systems: solvability Recall that Ax is a linear combination of the columns of A: Ax =x 1 a 11 a 21 a 31 a m1 + x 2 a 12 a 22 a 32 a m2 + x 3 a 13 a 23 a 33 a m3 + + x n a 1n a 2n a 3n a mn Thus, the only way there will be a solution to Ax = b is if b can be written as a linear combination of the columns of A Grady B Wright Linear Algebra Basics February 2, / 39

31 Linear systems: solvability There are three possibilities for the linear system Ax = b: 1 There are an infinite number of solutions that satisfy Ax = b An infinite number of ways to linearly combine the columns of A to equal b 2 There is one unique solution to the linear system Only one way to linearly combine the columns of A to equal b 3 There is no solution to the linear system There is no way to linearly combine the columns of A to equal b Grady B Wright Linear Algebra Basics February 2, / 39

32 Special types of matrices: Diagonal matrix A diagonal matrix is an n-by-n square matrix with zeros on in every entry except possibly the main diagonal: d d D = 0 0 d 3 0, d n where d j, j = 1,, n are some real numbers Grady B Wright Linear Algebra Basics February 2, / 39

33 Special types of matrices: Identity matrix The identity matrix is a diagonal matrix with every diagonal entry equal to 1: I = It has the property that for any matrix A R n n, IA = AI = A Grady B Wright Linear Algebra Basics February 2, / 39

34 Special types of matrices: Lower triangular matrix A matrix L R m n is lower triangular if all the entries above its main diagonal are zero Square n-by-n lower triangular matrices take the form l l 21 l L = l 31 l 32 l 33 0, l n1 l n2 l n3 l nn where l i,j, i = 1,, n, j = i,, n are some real numbers Grady B Wright Linear Algebra Basics February 2, / 39

35 Special types of matrices: Upper triangular matrix A matrix U R m n is upper triangular if all the entries below its main diagonal are zero Square n-by-n upper triangular matrices take the form u 11 u 12 u 13 u 1n 0 u 22 u 23 u 2n U = 0 0 u 33 u 3n, u nn where u i,j, i = 1,, n, j = i,, n are some real numbers Grady B Wright Linear Algebra Basics February 2, / 39

36 Special types of matrices: Symmetric matrix A matrix A is symmetric if A = A T Note that only square matrices can be symmetric Grady B Wright Linear Algebra Basics February 2, / 39

37 Inverse of a matrix Let A be an n-by-n square matrix (ie A R n n ) If there exists a square matrix B R n n such that BA = AB = I, where I is the n-by-n identity matrix, then B is called the inverse of A The inverse of A is denoted by A 1 If A 1 exists then A is called nonsingular, otherwise it is singular Grady B Wright Linear Algebra Basics February 2, / 39

38 Matrix inverses and linear systems If A is a square, nonsingular matrix, then the solution to the linear system Ax = b is given formally as x = A 1 b Important: When solving a linear system, one should never first compute A 1 and then compute the product A 1 b There are much better ways to solve the system (for example using Gaussian elimination when n is not too large) Grady B Wright Linear Algebra Basics February 2, / 39

39 Properties of matrix inverses Suppose A is nonsingular then the following statements are true A 1 is unique A 1 is nonsingular and its inverse is A A T is nonsingular If B R n n is nonsingular then AB is nonsingular and (AB) 1 = B 1 A 1 The linear system Ax = b has a unique solution Grady B Wright Linear Algebra Basics February 2, / 39

40 Vector norms A vector norm is a scalar quantity that reflects the size of a vector x The norm of a vector x is denoted as x There are many ways to define the size of a vector If x R n, the three most popular are one-norm : x 1 = n x k, k=1 two-norm : x 2 = n x k 2, -norm : k=1 x = max 1 k n x k Grady B Wright Linear Algebra Basics February 2, / 39

41 Vector norms However, a vector norm is defined, it must satisfy the following three properties to be called a norm: 1 x 0 and x = 0 if and only if x = 0 (ie x contains all zeros as its entries) 2 αx = α x, for any constant α 3 x + y x + y, where y R n This is called the triangle inequality Grady B Wright Linear Algebra Basics February 2, / 39

42 Unit vectors A vector x is called a unit vector if its norm is one, ie x = 1 Unit vectors will be different depending on the norm applied Below are several unit vectors in the one, two, and norms for x R 2 1 Unit vectors with respect to the one norm 1 Unit vectors with respect to the two norm 1 Unit vectors with respect to the norm x 2 0 x 2 0 x x x x 1 (a) One-norm (b) Two-norm (c) -norm Grady B Wright Linear Algebra Basics February 2, / 39

43 Matrix norms A matrix norm is a scalar quantity that reflects the size of a matrix A R m n The norm of A is denoted as A Any matrix norm must satisfy the following four properties: 1 A 0 and A = 0 if and only if A = 0 (ie A contains all zeros as its entries) 2 αa = α A, for any constant α 3 A + B A + B, where B R m n 4 AB A B, where B R n p This is called the submultiplicative inequality Grady B Wright Linear Algebra Basics February 2, / 39

44 Matrix norms Each vector norm induces a matrix norm according to the following definition: Ax p A p = max x p 0 x p where x R n and p = 1, 2, = max Ax p, x p=1 Induced norms describe how the matrix stretches unit vectors with respect to that norm Grady B Wright Linear Algebra Basics February 2, / 39

45 Induced matrix norms Two popular and easy to define induced matrix norms are One-norm : -norm : A 1 = max 1 k n A = max m a jk, j=1 1 j m k=1 n a jk The one-norm corresponds to the maximum of the one norm of every column The -norm corresponds to the maximum of the one norm of every row The two-norm of A is defined as the largest eigenvalue of the matrix A T A This is computationally expensive to compute Grady B Wright Linear Algebra Basics February 2, / 39

46 Non-induced matrix norms The most popular matrix norm that is not an induced norm is the Frobenius norm: m n A F = a jk 2 j=1 k=1 Grady B Wright Linear Algebra Basics February 2, / 39

47 Important results on matrix norms The following are some useful inequalities involving matrix norms Here A R m n : Ax A x 1 m A 1 A 2 n A 1 1 n A A 2 m A A 2 A 1 A Grady B Wright Linear Algebra Basics February 2, / 39

Review of Basic Concepts in Linear Algebra

Review of Basic Concepts in Linear Algebra Review of Basic Concepts in Linear Algebra Grady B Wright Department of Mathematics Boise State University September 7, 2017 Math 565 Linear Algebra Review September 7, 2017 1 / 40 Numerical Linear Algebra

More information

CS 246 Review of Linear Algebra 01/17/19

CS 246 Review of Linear Algebra 01/17/19 1 Linear algebra In this section we will discuss vectors and matrices. We denote the (i, j)th entry of a matrix A as A ij, and the ith entry of a vector as v i. 1.1 Vectors and vector operations A vector

More information

POLI270 - Linear Algebra

POLI270 - Linear Algebra POLI7 - Linear Algebra Septemer 8th Basics a x + a x +... + a n x n b () is the linear form where a, b are parameters and x n are variables. For a given equation such as x +x you only need a variable and

More information

Elementary maths for GMT

Elementary maths for GMT Elementary maths for GMT Linear Algebra Part 2: Matrices, Elimination and Determinant m n matrices The system of m linear equations in n variables x 1, x 2,, x n a 11 x 1 + a 12 x 2 + + a 1n x n = b 1

More information

Review of Some Concepts from Linear Algebra: Part 2

Review of Some Concepts from Linear Algebra: Part 2 Review of Some Concepts from Linear Algebra: Part 2 Department of Mathematics Boise State University January 16, 2019 Math 566 Linear Algebra Review: Part 2 January 16, 2019 1 / 22 Vector spaces A set

More information

Linear Algebra and Matrix Inversion

Linear Algebra and Matrix Inversion Jim Lambers MAT 46/56 Spring Semester 29- Lecture 2 Notes These notes correspond to Section 63 in the text Linear Algebra and Matrix Inversion Vector Spaces and Linear Transformations Matrices are much

More information

Section 9.2: Matrices. Definition: A matrix A consists of a rectangular array of numbers, or elements, arranged in m rows and n columns.

Section 9.2: Matrices. Definition: A matrix A consists of a rectangular array of numbers, or elements, arranged in m rows and n columns. Section 9.2: Matrices Definition: A matrix A consists of a rectangular array of numbers, or elements, arranged in m rows and n columns. That is, a 11 a 12 a 1n a 21 a 22 a 2n A =...... a m1 a m2 a mn A

More information

Section 9.2: Matrices.. a m1 a m2 a mn

Section 9.2: Matrices.. a m1 a m2 a mn Section 9.2: Matrices Definition: A matrix is a rectangular array of numbers: a 11 a 12 a 1n a 21 a 22 a 2n A =...... a m1 a m2 a mn In general, a ij denotes the (i, j) entry of A. That is, the entry in

More information

2. Linear algebra. matrices and vectors. linear equations. range and nullspace of matrices. function of vectors, gradient and Hessian

2. Linear algebra. matrices and vectors. linear equations. range and nullspace of matrices. function of vectors, gradient and Hessian FE661 - Statistical Methods for Financial Engineering 2. Linear algebra Jitkomut Songsiri matrices and vectors linear equations range and nullspace of matrices function of vectors, gradient and Hessian

More information

Chapter 1 Matrices and Systems of Equations

Chapter 1 Matrices and Systems of Equations Chapter 1 Matrices and Systems of Equations System of Linear Equations 1. A linear equation in n unknowns is an equation of the form n i=1 a i x i = b where a 1,..., a n, b R and x 1,..., x n are variables.

More information

10. Linear Systems of ODEs, Matrix multiplication, superposition principle (parts of sections )

10. Linear Systems of ODEs, Matrix multiplication, superposition principle (parts of sections ) c Dr. Igor Zelenko, Fall 2017 1 10. Linear Systems of ODEs, Matrix multiplication, superposition principle (parts of sections 7.2-7.4) 1. When each of the functions F 1, F 2,..., F n in right-hand side

More information

ANALYTICAL MATHEMATICS FOR APPLICATIONS 2018 LECTURE NOTES 3

ANALYTICAL MATHEMATICS FOR APPLICATIONS 2018 LECTURE NOTES 3 ANALYTICAL MATHEMATICS FOR APPLICATIONS 2018 LECTURE NOTES 3 ISSUED 24 FEBRUARY 2018 1 Gaussian elimination Let A be an (m n)-matrix Consider the following row operations on A (1) Swap the positions any

More information

Elementary Row Operations on Matrices

Elementary Row Operations on Matrices King Saud University September 17, 018 Table of contents 1 Definition A real matrix is a rectangular array whose entries are real numbers. These numbers are organized on rows and columns. An m n matrix

More information

Linear Algebra (Review) Volker Tresp 2018

Linear Algebra (Review) Volker Tresp 2018 Linear Algebra (Review) Volker Tresp 2018 1 Vectors k, M, N are scalars A one-dimensional array c is a column vector. Thus in two dimensions, ( ) c1 c = c 2 c i is the i-th component of c c T = (c 1, c

More information

Knowledge Discovery and Data Mining 1 (VO) ( )

Knowledge Discovery and Data Mining 1 (VO) ( ) Knowledge Discovery and Data Mining 1 (VO) (707.003) Review of Linear Algebra Denis Helic KTI, TU Graz Oct 9, 2014 Denis Helic (KTI, TU Graz) KDDM1 Oct 9, 2014 1 / 74 Big picture: KDDM Probability Theory

More information

Linear Algebra V = T = ( 4 3 ).

Linear Algebra V = T = ( 4 3 ). Linear Algebra Vectors A column vector is a list of numbers stored vertically The dimension of a column vector is the number of values in the vector W is a -dimensional column vector and V is a 5-dimensional

More information

Linear Algebra. The analysis of many models in the social sciences reduces to the study of systems of equations.

Linear Algebra. The analysis of many models in the social sciences reduces to the study of systems of equations. POLI 7 - Mathematical and Statistical Foundations Prof S Saiegh Fall Lecture Notes - Class 4 October 4, Linear Algebra The analysis of many models in the social sciences reduces to the study of systems

More information

Finite Mathematics Chapter 2. where a, b, c, d, h, and k are real numbers and neither a and b nor c and d are both zero.

Finite Mathematics Chapter 2. where a, b, c, d, h, and k are real numbers and neither a and b nor c and d are both zero. Finite Mathematics Chapter 2 Section 2.1 Systems of Linear Equations: An Introduction Systems of Equations Recall that a system of two linear equations in two variables may be written in the general form

More information

Jim Lambers MAT 610 Summer Session Lecture 1 Notes

Jim Lambers MAT 610 Summer Session Lecture 1 Notes Jim Lambers MAT 60 Summer Session 2009-0 Lecture Notes Introduction This course is about numerical linear algebra, which is the study of the approximate solution of fundamental problems from linear algebra

More information

Chapter 4 - MATRIX ALGEBRA. ... a 2j... a 2n. a i1 a i2... a ij... a in

Chapter 4 - MATRIX ALGEBRA. ... a 2j... a 2n. a i1 a i2... a ij... a in Chapter 4 - MATRIX ALGEBRA 4.1. Matrix Operations A a 11 a 12... a 1j... a 1n a 21. a 22.... a 2j... a 2n. a i1 a i2... a ij... a in... a m1 a m2... a mj... a mn The entry in the ith row and the jth column

More information

MATRICES. a m,1 a m,n A =

MATRICES. a m,1 a m,n A = MATRICES Matrices are rectangular arrays of real or complex numbers With them, we define arithmetic operations that are generalizations of those for real and complex numbers The general form a matrix of

More information

Scientific Computing: Dense Linear Systems

Scientific Computing: Dense Linear Systems Scientific Computing: Dense Linear Systems Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course MATH-GA.2043 or CSCI-GA.2112, Spring 2012 February 9th, 2012 A. Donev (Courant Institute)

More information

Chapter 3. Linear and Nonlinear Systems

Chapter 3. Linear and Nonlinear Systems 59 An expert is someone who knows some of the worst mistakes that can be made in his subject, and how to avoid them Werner Heisenberg (1901-1976) Chapter 3 Linear and Nonlinear Systems In this chapter

More information

Matrix & Linear Algebra

Matrix & Linear Algebra Matrix & Linear Algebra Jamie Monogan University of Georgia For more information: http://monogan.myweb.uga.edu/teaching/mm/ Jamie Monogan (UGA) Matrix & Linear Algebra 1 / 84 Vectors Vectors Vector: A

More information

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2 MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS SYSTEMS OF EQUATIONS AND MATRICES Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a

More information

ELE/MCE 503 Linear Algebra Facts Fall 2018

ELE/MCE 503 Linear Algebra Facts Fall 2018 ELE/MCE 503 Linear Algebra Facts Fall 2018 Fact N.1 A set of vectors is linearly independent if and only if none of the vectors in the set can be written as a linear combination of the others. Fact N.2

More information

ICS 6N Computational Linear Algebra Matrix Algebra

ICS 6N Computational Linear Algebra Matrix Algebra ICS 6N Computational Linear Algebra Matrix Algebra Xiaohui Xie University of California, Irvine xhx@uci.edu February 2, 2017 Xiaohui Xie (UCI) ICS 6N February 2, 2017 1 / 24 Matrix Consider an m n matrix

More information

Quantum Computing Lecture 2. Review of Linear Algebra

Quantum Computing Lecture 2. Review of Linear Algebra Quantum Computing Lecture 2 Review of Linear Algebra Maris Ozols Linear algebra States of a quantum system form a vector space and their transformations are described by linear operators Vector spaces

More information

A matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and

A matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and Section 5.5. Matrices and Vectors A matrix is a rectangular array of objects arranged in rows and columns. The objects are called the entries. A matrix with m rows and n columns is called an m n matrix.

More information

a11 a A = : a 21 a 22

a11 a A = : a 21 a 22 Matrices The study of linear systems is facilitated by introducing matrices. Matrix theory provides a convenient language and notation to express many of the ideas concisely, and complicated formulas are

More information

A matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and

A matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and Section 5.5. Matrices and Vectors A matrix is a rectangular array of objects arranged in rows and columns. The objects are called the entries. A matrix with m rows and n columns is called an m n matrix.

More information

(1) for all (2) for all and all

(1) for all (2) for all and all 8. Linear mappings and matrices A mapping f from IR n to IR m is called linear if it fulfills the following two properties: (1) for all (2) for all and all Mappings of this sort appear frequently in the

More information

A Review of Matrix Analysis

A Review of Matrix Analysis Matrix Notation Part Matrix Operations Matrices are simply rectangular arrays of quantities Each quantity in the array is called an element of the matrix and an element can be either a numerical value

More information

Math 360 Linear Algebra Fall Class Notes. a a a a a a. a a a

Math 360 Linear Algebra Fall Class Notes. a a a a a a. a a a Math 360 Linear Algebra Fall 2008 9-10-08 Class Notes Matrices As we have already seen, a matrix is a rectangular array of numbers. If a matrix A has m columns and n rows, we say that its dimensions are

More information

MATH.2720 Introduction to Programming with MATLAB Vector and Matrix Algebra

MATH.2720 Introduction to Programming with MATLAB Vector and Matrix Algebra MATH.2720 Introduction to Programming with MATLAB Vector and Matrix Algebra A. Vectors A vector is a quantity that has both magnitude and direction, like velocity. The location of a vector is irrelevant;

More information

Chapter 2. Matrix Arithmetic. Chapter 2

Chapter 2. Matrix Arithmetic. Chapter 2 Matrix Arithmetic Matrix Addition and Subtraction Addition and subtraction act element-wise on matrices. In order for the addition/subtraction (A B) to be possible, the two matrices A and B must have the

More information

Matrix Operations. Linear Combination Vector Algebra Angle Between Vectors Projections and Reflections Equality of matrices, Augmented Matrix

Matrix Operations. Linear Combination Vector Algebra Angle Between Vectors Projections and Reflections Equality of matrices, Augmented Matrix Linear Combination Vector Algebra Angle Between Vectors Projections and Reflections Equality of matrices, Augmented Matrix Matrix Operations Matrix Addition and Matrix Scalar Multiply Matrix Multiply Matrix

More information

Section 12.4 Algebra of Matrices

Section 12.4 Algebra of Matrices 244 Section 2.4 Algebra of Matrices Before we can discuss Matrix Algebra, we need to have a clear idea what it means to say that two matrices are equal. Let's start a definition. Equal Matrices Two matrices

More information

3. Vector spaces 3.1 Linear dependence and independence 3.2 Basis and dimension. 5. Extreme points and basic feasible solutions

3. Vector spaces 3.1 Linear dependence and independence 3.2 Basis and dimension. 5. Extreme points and basic feasible solutions A. LINEAR ALGEBRA. CONVEX SETS 1. Matrices and vectors 1.1 Matrix operations 1.2 The rank of a matrix 2. Systems of linear equations 2.1 Basic solutions 3. Vector spaces 3.1 Linear dependence and independence

More information

Prepared by: M. S. KumarSwamy, TGT(Maths) Page

Prepared by: M. S. KumarSwamy, TGT(Maths) Page Prepared by: M. S. KumarSwamy, TGT(Maths) Page - 50 - CHAPTER 3: MATRICES QUICK REVISION (Important Concepts & Formulae) MARKS WEIGHTAGE 03 marks Matrix A matrix is an ordered rectangular array of numbers

More information

Review of linear algebra

Review of linear algebra Review of linear algebra 1 Vectors and matrices We will just touch very briefly on certain aspects of linear algebra, most of which should be familiar. Recall that we deal with vectors, i.e. elements of

More information

Matrices and Linear Algebra

Matrices and Linear Algebra Contents Quantitative methods for Economics and Business University of Ferrara Academic year 2017-2018 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2

More information

Matrices BUSINESS MATHEMATICS

Matrices BUSINESS MATHEMATICS Matrices BUSINESS MATHEMATICS 1 CONTENTS Matrices Special matrices Operations with matrices Matrix multipication More operations with matrices Matrix transposition Symmetric matrices Old exam question

More information

Introduction to Matrices

Introduction to Matrices POLS 704 Introduction to Matrices Introduction to Matrices. The Cast of Characters A matrix is a rectangular array (i.e., a table) of numbers. For example, 2 3 X 4 5 6 (4 3) 7 8 9 0 0 0 Thismatrix,with4rowsand3columns,isoforder

More information

Matrix Algebra: Summary

Matrix Algebra: Summary May, 27 Appendix E Matrix Algebra: Summary ontents E. Vectors and Matrtices.......................... 2 E.. Notation.................................. 2 E..2 Special Types of Vectors.........................

More information

Introduction. Vectors and Matrices. Vectors [1] Vectors [2]

Introduction. Vectors and Matrices. Vectors [1] Vectors [2] Introduction Vectors and Matrices Dr. TGI Fernando 1 2 Data is frequently arranged in arrays, that is, sets whose elements are indexed by one or more subscripts. Vector - one dimensional array Matrix -

More information

Linear Algebra Highlights

Linear Algebra Highlights Linear Algebra Highlights Chapter 1 A linear equation in n variables is of the form a 1 x 1 + a 2 x 2 + + a n x n. We can have m equations in n variables, a system of linear equations, which we want to

More information

MAT 610: Numerical Linear Algebra. James V. Lambers

MAT 610: Numerical Linear Algebra. James V. Lambers MAT 610: Numerical Linear Algebra James V Lambers January 16, 2017 2 Contents 1 Matrix Multiplication Problems 7 11 Introduction 7 111 Systems of Linear Equations 7 112 The Eigenvalue Problem 8 12 Basic

More information

Basic Linear Algebra in MATLAB

Basic Linear Algebra in MATLAB Basic Linear Algebra in MATLAB 9.29 Optional Lecture 2 In the last optional lecture we learned the the basic type in MATLAB is a matrix of double precision floating point numbers. You learned a number

More information

Numerical Linear Algebra

Numerical Linear Algebra Numerical Linear Algebra The two principal problems in linear algebra are: Linear system Given an n n matrix A and an n-vector b, determine x IR n such that A x = b Eigenvalue problem Given an n n matrix

More information

Chapter 5. Linear Algebra. A linear (algebraic) equation in. unknowns, x 1, x 2,..., x n, is. an equation of the form

Chapter 5. Linear Algebra. A linear (algebraic) equation in. unknowns, x 1, x 2,..., x n, is. an equation of the form Chapter 5. Linear Algebra A linear (algebraic) equation in n unknowns, x 1, x 2,..., x n, is an equation of the form a 1 x 1 + a 2 x 2 + + a n x n = b where a 1, a 2,..., a n and b are real numbers. 1

More information

3 (Maths) Linear Algebra

3 (Maths) Linear Algebra 3 (Maths) Linear Algebra References: Simon and Blume, chapters 6 to 11, 16 and 23; Pemberton and Rau, chapters 11 to 13 and 25; Sundaram, sections 1.3 and 1.5. The methods and concepts of linear algebra

More information

Inner products and Norms. Inner product of 2 vectors. Inner product of 2 vectors x and y in R n : x 1 y 1 + x 2 y x n y n in R n

Inner products and Norms. Inner product of 2 vectors. Inner product of 2 vectors x and y in R n : x 1 y 1 + x 2 y x n y n in R n Inner products and Norms Inner product of 2 vectors Inner product of 2 vectors x and y in R n : x 1 y 1 + x 2 y 2 + + x n y n in R n Notation: (x, y) or y T x For complex vectors (x, y) = x 1 ȳ 1 + x 2

More information

Topics. Vectors (column matrices): Vector addition and scalar multiplication The matrix of a linear function y Ax The elements of a matrix A : A ij

Topics. Vectors (column matrices): Vector addition and scalar multiplication The matrix of a linear function y Ax The elements of a matrix A : A ij Topics Vectors (column matrices): Vector addition and scalar multiplication The matrix of a linear function y Ax The elements of a matrix A : A ij or a ij lives in row i and column j Definition of a matrix

More information

Calculation in the special cases n = 2 and n = 3:

Calculation in the special cases n = 2 and n = 3: 9. The determinant The determinant is a function (with real numbers as values) which is defined for quadratic matrices. It allows to make conclusions about the rank and appears in diverse theorems and

More information

Chapter 1: Systems of linear equations and matrices. Section 1.1: Introduction to systems of linear equations

Chapter 1: Systems of linear equations and matrices. Section 1.1: Introduction to systems of linear equations Chapter 1: Systems of linear equations and matrices Section 1.1: Introduction to systems of linear equations Definition: A linear equation in n variables can be expressed in the form a 1 x 1 + a 2 x 2

More information

Phys 201. Matrices and Determinants

Phys 201. Matrices and Determinants Phys 201 Matrices and Determinants 1 1.1 Matrices 1.2 Operations of matrices 1.3 Types of matrices 1.4 Properties of matrices 1.5 Determinants 1.6 Inverse of a 3 3 matrix 2 1.1 Matrices A 2 3 7 =! " 1

More information

MATH 320, WEEK 7: Matrices, Matrix Operations

MATH 320, WEEK 7: Matrices, Matrix Operations MATH 320, WEEK 7: Matrices, Matrix Operations 1 Matrices We have introduced ourselves to the notion of the grid-like coefficient matrix as a short-hand coefficient place-keeper for performing Gaussian

More information

Algebra C Numerical Linear Algebra Sample Exam Problems

Algebra C Numerical Linear Algebra Sample Exam Problems Algebra C Numerical Linear Algebra Sample Exam Problems Notation. Denote by V a finite-dimensional Hilbert space with inner product (, ) and corresponding norm. The abbreviation SPD is used for symmetric

More information

Math Linear Algebra Final Exam Review Sheet

Math Linear Algebra Final Exam Review Sheet Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of

More information

Matrices and Vectors. Definition of Matrix. An MxN matrix A is a two-dimensional array of numbers A =

Matrices and Vectors. Definition of Matrix. An MxN matrix A is a two-dimensional array of numbers A = 30 MATHEMATICS REVIEW G A.1.1 Matrices and Vectors Definition of Matrix. An MxN matrix A is a two-dimensional array of numbers A = a 11 a 12... a 1N a 21 a 22... a 2N...... a M1 a M2... a MN A matrix can

More information

MATH 315 Linear Algebra Homework #1 Assigned: August 20, 2018

MATH 315 Linear Algebra Homework #1 Assigned: August 20, 2018 Homework #1 Assigned: August 20, 2018 Review the following subjects involving systems of equations and matrices from Calculus II. Linear systems of equations Converting systems to matrix form Pivot entry

More information

Glossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB

Glossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB Glossary of Linear Algebra Terms Basis (for a subspace) A linearly independent set of vectors that spans the space Basic Variable A variable in a linear system that corresponds to a pivot column in the

More information

Matrices: 2.1 Operations with Matrices

Matrices: 2.1 Operations with Matrices Goals In this chapter and section we study matrix operations: Define matrix addition Define multiplication of matrix by a scalar, to be called scalar multiplication. Define multiplication of two matrices,

More information

B553 Lecture 5: Matrix Algebra Review

B553 Lecture 5: Matrix Algebra Review B553 Lecture 5: Matrix Algebra Review Kris Hauser January 19, 2012 We have seen in prior lectures how vectors represent points in R n and gradients of functions. Matrices represent linear transformations

More information

Linear Algebra March 16, 2019

Linear Algebra March 16, 2019 Linear Algebra March 16, 2019 2 Contents 0.1 Notation................................ 4 1 Systems of linear equations, and matrices 5 1.1 Systems of linear equations..................... 5 1.2 Augmented

More information

Matrix Algebra. Matrix Algebra. Chapter 8 - S&B

Matrix Algebra. Matrix Algebra. Chapter 8 - S&B Chapter 8 - S&B Algebraic operations Matrix: The size of a matrix is indicated by the number of its rows and the number of its columns. A matrix with k rows and n columns is called a k n matrix. The number

More information

A Review of Linear Algebra

A Review of Linear Algebra A Review of Linear Algebra Gerald Recktenwald Portland State University Mechanical Engineering Department gerry@me.pdx.edu These slides are a supplement to the book Numerical Methods with Matlab: Implementations

More information

Numerical Linear Algebra

Numerical Linear Algebra Numerical Linear Algebra R. J. Renka Department of Computer Science & Engineering University of North Texas 02/03/2015 Notation and Terminology R n is the Euclidean n-dimensional linear space over the

More information

Math Camp Notes: Linear Algebra I

Math Camp Notes: Linear Algebra I Math Camp Notes: Linear Algebra I Basic Matrix Operations and Properties Consider two n m matrices: a a m A = a n a nm Then the basic matrix operations are as follows: a + b a m + b m A + B = a n + b n

More information

Chapter 3 Transformations

Chapter 3 Transformations Chapter 3 Transformations An Introduction to Optimization Spring, 2014 Wei-Ta Chu 1 Linear Transformations A function is called a linear transformation if 1. for every and 2. for every If we fix the bases

More information

MA 138 Calculus 2 with Life Science Applications Matrices (Section 9.2)

MA 138 Calculus 2 with Life Science Applications Matrices (Section 9.2) MA 38 Calculus 2 with Life Science Applications Matrices (Section 92) Alberto Corso albertocorso@ukyedu Department of Mathematics University of Kentucky Friday, March 3, 207 Identity Matrix and Inverse

More information

MATH 3511 Lecture 1. Solving Linear Systems 1

MATH 3511 Lecture 1. Solving Linear Systems 1 MATH 3511 Lecture 1 Solving Linear Systems 1 Dmitriy Leykekhman Spring 2012 Goals Review of basic linear algebra Solution of simple linear systems Gaussian elimination D Leykekhman - MATH 3511 Introduction

More information

PH1105 Lecture Notes on Linear Algebra.

PH1105 Lecture Notes on Linear Algebra. PH05 Lecture Notes on Linear Algebra Joe Ó hógáin E-mail: johog@mathstcdie Main Text: Calculus for the Life Sciences by Bittenger, Brand and Quintanilla Other Text: Linear Algebra by Anton and Rorres Matrices

More information

LS.1 Review of Linear Algebra

LS.1 Review of Linear Algebra LS. LINEAR SYSTEMS LS.1 Review of Linear Algebra In these notes, we will investigate a way of handling a linear system of ODE s directly, instead of using elimination to reduce it to a single higher-order

More information

is a 3 4 matrix. It has 3 rows and 4 columns. The first row is the horizontal row [ ]

is a 3 4 matrix. It has 3 rows and 4 columns. The first row is the horizontal row [ ] Matrices: Definition: An m n matrix, A m n is a rectangular array of numbers with m rows and n columns: a, a, a,n a, a, a,n A m,n =...... a m, a m, a m,n Each a i,j is the entry at the i th row, j th column.

More information

7.6 The Inverse of a Square Matrix

7.6 The Inverse of a Square Matrix 7.6 The Inverse of a Square Matrix Copyright Cengage Learning. All rights reserved. What You Should Learn Verify that two matrices are inverses of each other. Use Gauss-Jordan elimination to find inverses

More information

Review of Linear Algebra

Review of Linear Algebra Review of Linear Algebra Definitions An m n (read "m by n") matrix, is a rectangular array of entries, where m is the number of rows and n the number of columns. 2 Definitions (Con t) A is square if m=

More information

Linear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0.

Linear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0. Matrices Operations Linear Algebra Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0 The rectangular array 1 2 1 4 3 4 2 6 1 3 2 1 in which the

More information

Section 3.9. Matrix Norm

Section 3.9. Matrix Norm 3.9. Matrix Norm 1 Section 3.9. Matrix Norm Note. We define several matrix norms, some similar to vector norms and some reflecting how multiplication by a matrix affects the norm of a vector. We use matrix

More information

Fundamentals of Engineering Analysis (650163)

Fundamentals of Engineering Analysis (650163) Philadelphia University Faculty of Engineering Communications and Electronics Engineering Fundamentals of Engineering Analysis (6563) Part Dr. Omar R Daoud Matrices: Introduction DEFINITION A matrix is

More information

Lecture 3: Matrix and Matrix Operations

Lecture 3: Matrix and Matrix Operations Lecture 3: Matrix and Matrix Operations Representation, row vector, column vector, element of a matrix. Examples of matrix representations Tables and spreadsheets Scalar-Matrix operation: Scaling a matrix

More information

Lecture 1: Review of linear algebra

Lecture 1: Review of linear algebra Lecture 1: Review of linear algebra Linear functions and linearization Inverse matrix, least-squares and least-norm solutions Subspaces, basis, and dimension Change of basis and similarity transformations

More information

Two matrices of the same size are added by adding their corresponding entries =.

Two matrices of the same size are added by adding their corresponding entries =. 2 Matrix algebra 2.1 Addition and scalar multiplication Two matrices of the same size are added by adding their corresponding entries. For instance, 1 2 3 2 5 6 3 7 9 +. 4 0 9 4 1 3 0 1 6 Addition of two

More information

Computational Methods. Systems of Linear Equations

Computational Methods. Systems of Linear Equations Computational Methods Systems of Linear Equations Manfred Huber 2010 1 Systems of Equations Often a system model contains multiple variables (parameters) and contains multiple equations Multiple equations

More information

Chapter 7. Linear Algebra: Matrices, Vectors,

Chapter 7. Linear Algebra: Matrices, Vectors, Chapter 7. Linear Algebra: Matrices, Vectors, Determinants. Linear Systems Linear algebra includes the theory and application of linear systems of equations, linear transformations, and eigenvalue problems.

More information

Designing Information Devices and Systems I Fall 2017 Official Lecture Notes Note 2

Designing Information Devices and Systems I Fall 2017 Official Lecture Notes Note 2 EECS 6A Designing Information Devices and Systems I Fall 07 Official Lecture Notes Note Introduction Previously, we introduced vectors and matrices as a way of writing systems of linear equations more

More information

AMS526: Numerical Analysis I (Numerical Linear Algebra for Computational and Data Sciences)

AMS526: Numerical Analysis I (Numerical Linear Algebra for Computational and Data Sciences) AMS526: Numerical Analysis I (Numerical Linear Algebra for Computational and Data Sciences) Lecture 1: Course Overview; Matrix Multiplication Xiangmin Jiao Stony Brook University Xiangmin Jiao Numerical

More information

Matrix Algebra: Definitions and Basic Operations

Matrix Algebra: Definitions and Basic Operations Section 4 Matrix Algebra: Definitions and Basic Operations Definitions Analyzing economic models often involve working with large sets of linear equations. Matrix algebra provides a set of tools for dealing

More information

Linear Equations and Matrix

Linear Equations and Matrix 1/60 Chia-Ping Chen Professor Department of Computer Science and Engineering National Sun Yat-sen University Linear Algebra Gaussian Elimination 2/60 Alpha Go Linear algebra begins with a system of linear

More information

Matrix operations Linear Algebra with Computer Science Application

Matrix operations Linear Algebra with Computer Science Application Linear Algebra with Computer Science Application February 14, 2018 1 Matrix operations 11 Matrix operations If A is an m n matrix that is, a matrix with m rows and n columns then the scalar entry in the

More information

EE731 Lecture Notes: Matrix Computations for Signal Processing

EE731 Lecture Notes: Matrix Computations for Signal Processing EE731 Lecture Notes: Matrix Computations for Signal Processing James P. Reilly c Department of Electrical and Computer Engineering McMaster University September 22, 2005 0 Preface This collection of ten

More information

Gaussian Elimination -(3.1) b 1. b 2., b. b n

Gaussian Elimination -(3.1) b 1. b 2., b. b n Gaussian Elimination -() Consider solving a given system of n linear equations in n unknowns: (*) a x a x a n x n b where a ij and b i are constants and x i are unknowns Let a n x a n x a nn x n a a a

More information

Designing Information Devices and Systems I Spring 2019 Lecture Notes Note 2

Designing Information Devices and Systems I Spring 2019 Lecture Notes Note 2 EECS 6A Designing Information Devices and Systems I Spring 9 Lecture Notes Note Vectors and Matrices In the previous note, we introduced vectors and matrices as a way of writing systems of linear equations

More information

Lecture 5. Ch. 5, Norms for vectors and matrices. Norms for vectors and matrices Why?

Lecture 5. Ch. 5, Norms for vectors and matrices. Norms for vectors and matrices Why? KTH ROYAL INSTITUTE OF TECHNOLOGY Norms for vectors and matrices Why? Lecture 5 Ch. 5, Norms for vectors and matrices Emil Björnson/Magnus Jansson/Mats Bengtsson April 27, 2016 Problem: Measure size of

More information

Linear Algebra Review. Vectors

Linear Algebra Review. Vectors Linear Algebra Review 9/4/7 Linear Algebra Review By Tim K. Marks UCSD Borrows heavily from: Jana Kosecka http://cs.gmu.edu/~kosecka/cs682.html Virginia de Sa (UCSD) Cogsci 8F Linear Algebra review Vectors

More information

Matrices and Vectors

Matrices and Vectors Matrices and Vectors James K. Peterson Department of Biological Sciences and Department of Mathematical Sciences Clemson University November 11, 2013 Outline 1 Matrices and Vectors 2 Vector Details 3 Matrix

More information

j=1 [We will show that the triangle inequality holds for each p-norm in Chapter 3 Section 6.] The 1-norm is A F = tr(a H A).

j=1 [We will show that the triangle inequality holds for each p-norm in Chapter 3 Section 6.] The 1-norm is A F = tr(a H A). Math 344 Lecture #19 3.5 Normed Linear Spaces Definition 3.5.1. A seminorm on a vector space V over F is a map : V R that for all x, y V and for all α F satisfies (i) x 0 (positivity), (ii) αx = α x (scale

More information

Math 60. Rumbos Spring Solutions to Assignment #17

Math 60. Rumbos Spring Solutions to Assignment #17 Math 60. Rumbos Spring 2009 1 Solutions to Assignment #17 a b 1. Prove that if ad bc 0 then the matrix A = is invertible and c d compute A 1. a b Solution: Let A = and assume that ad bc 0. c d First consider

More information

CHAPTER 8: Matrices and Determinants

CHAPTER 8: Matrices and Determinants (Exercises for Chapter 8: Matrices and Determinants) E.8.1 CHAPTER 8: Matrices and Determinants (A) means refer to Part A, (B) means refer to Part B, etc. Most of these exercises can be done without a

More information