L. Vandenberghe EE133A (Spring 2017) 3. Matrices. notation and terminology. matrix operations. linear and affine functions.
|
|
- Chastity Chase
- 6 years ago
- Views:
Transcription
1 L Vandenberghe EE133A (Spring 2017) 3 Matrices notation and terminology matrix operations linear and affine functions complexity 3-1
2 Matrix a rectangular array of numbers, for example A = numbers in array are the elements (entries, coefficients, components) A ij is the i, j element of A; i is its row index, j the column index size (dimensions) of the matrix is specified as (#rows) (#columns) for example, A is a 3 4 matrix set of m n matrices with real elements is written R m n set of m n matrices with complex elements is written C m n Matrices 3-2
3 Other conventions many authors use parentheses as delimiters: A = often a ij is used to denote the i, j element of A Matrices 3-3
4 Matrix shapes Scalar: we don t distinguish between a 1 1 matrix and a scalar Vector: we don t distinguish between an n 1 matrix and an n-vector Row and column vectors a 1 n matrix is called a row vector an n 1 matrix is called a column vector (or just vector) Tall, wide, square matrices: an m n matrix is tall if m > n wide if m < n square if m = n Matrices 3-4
5 Block matrix a block matrix is a rectangular array of matrices elements in the array are the blocks or submatrices of the block matrix Example A = [ B C D E ] is a 2 2 block matrix; if the blocks are B = [ 2 1 ], C = [ ], D = [ 1 ], E = [ ] then A = Note: dimensions of the blocks must be compatible! Matrices 3-5
6 Rows and columns a matrix can be viewed as a block matrix with row/column vector blocks m n matrix A as 1 n block matrix A = [ a 1 a 2 a n ] each a j is an m-vector (the jth column of A) m n matrix A as m 1 block matrix A = b 1 b 2 b m each b i is a 1 n row vector (the ith row of A) Matrices 3-6
7 Special matrices Zero matrix matrix with A ij = 0 for all i, j notation: 0 (usually) or 0 m n (if dimension is not clear from context) Identity matrix square matrix with A ij = 1 if i = j and A ij = 0 if i j notation: I (usually) or I n (if dimension is not clear from context) columns of I n are unit vectors e 1, e 2,, e n ; for example, I 3 = = [ e 1 e 2 e 3 ] Matrices 3-7
8 Symmetric and Hermitian matrices Symmetric matrix: square with A ij = A ji , 4 + 3j 3 2j 0 3 2j j 2j 0 2j 3 Hermitian matrix: square with A ij = Āji (complex conjugate of A ij ) 4 3 2j 1 + j 3 + 2j 1 2j 1 j 2j 3 note: diagonal elements are real (since A ii = Āii) Matrices 3-8
9 Structured matrices matrices with special patterns or structure arise in many applications diagonal matrix: square with A ij = 0 for i j , lower triangular matrix: square with A ij = 0 for i < j , upper triangular matrix: square with A ij = 0 for i > j Matrices 3-9
10 Sparse matrices a matrix is sparse if most (almost all) of its elements are zero sparse matrix storage formats and algorithms exploit sparsity efficiency depends on number of nonzeros and their positions positions of nonzeros are visualized in a spy plot Example 2,987,012 rows and columns 26,621,983 nonzeros (Freescale/FullChip matrix from Univ of Florida Sparse Matrix Collection) Matrices 3-10
11 Outline notation and terminology matrix operations linear and affine functions complexity
12 Scalar-matrix multiplication and addition Scalar-matrix multiplication: scalar-matrix product of m n matrix A with scalar β βa = β A 11 β A 12 β A 1n β A 21 β A 22 β A 2n β A m1 β A m2 β A mn A and β can be real or complex Addition: sum of two m n matrices A and B (real or complex) A + B = A 11 + B 11 A 12 + B 12 A 1n + B 1n A 21 + B 21 A 22 + B 22 A 2n + B 2n A m1 + B m1 A m2 + B m2 A mn + B mn Matrices 3-11
13 Transpose the transpose of an m n matrix A is the n m matrix A T = A 11 A 21 A m1 A 12 A 22 A m2 A 1n A 2n A mn (A T ) T = A a symmetric matrix satisfies A = A T A may be complex, but transpose of complex matrices is rarely needed transpose of matrix-scalar product and matrix sum (βa) T = βa T, (A + B) T = A T + B T Matrices 3-12
14 Conjugate transpose the conjugate transpose of an m n matrix A is the n m matrix A H = Ā 11 Ā 21 Ā m1 Ā 12 Ā 22 Ā m2 Ā 1n Ā 2n Ā mn (Āij is complex conjugate of A ij ) A H = A T if A is a real matrix a Hermitian matrix satisfies A = A H conjugate transpose of matrix-scalar product and matrix sum (βa) H = βa H, (A + B) H = A H + B H Matrices 3-13
15 Matrix-matrix product product of m n matrix A and n p matrix B (A, B are real or complex) C = AB is the m p matrix with i, j element C ij = A i1 B 1j + A i2 B 2j + + A in B nj dimensions must be compatible: #columns in A = #rows in B Matrices 3-14
16 Exercise: paths in directed graph directed graph with n = 5 vertices A = matrix representation A ij = 1 indicates an edge j i Question: give a graph interpretation of A 2 = AA, A 3 = AAA, A 2 = , A3 = , Matrices 3-15
17 Properties of matrix-matrix product associative: (AB)C = A(BC) so we write ABC associative with scalar-matrix multiplication: (γa)b = γ(ab) = γab distributes with sum: A(B + C) = AB + AC, (A + B)C = AC + BC transpose and conjugate transpose of product: (AB) T = B T A T, (AB) H = B H A H not commutative: AB BA in general; for example, [ ] [ ] [ ] [ ] there are exceptions, eg, AI = IA for square A Matrices 3-16
18 Notation for vector inner product inner product of a, b R n (see page 1-17): b T a = b 1 a 1 + b 2 a b n a n = b 1 b 2 b n T a 1 a 2 a n product of the transpose of the column vector b and the column vector a inner product of a, b C n (see page 1-24): b H a = b 1 a 1 + b 2 a b n a n = b 1 b 2 b n H a 1 a 2 a n product of conjugate transpose of the column vector b and the column vector a Matrices 3-17
19 Matrix-matrix product and block matrices block-matrices can be multiplied as regular matrices Example: product of two 2 2 block matrices [ ] [ ] [ A B W Y AW + BX AY + BZ = C D X Z CW + DX CY + DZ ] if the dimensions of the blocks are compatible Matrices 3-18
20 Outline notation and terminology matrix operations linear and affine functions complexity
21 Matrix-vector product product of m n matrix A with n-vector (or n 1 matrix) x Ax = A 11 x 1 + A 12 x A 1n x n A 21 x 1 + A 22 x A 2n x n A m1 x 1 + A m2 x A mn x n dimensions must be compatible: number of columns of A equals the size of x Ax is a linear combination of the columns of A: Ax = [ ] a 1 a 2 a n x 1 x 2 x n each a i is an m-vector (ith column of A) = x 1a 1 + x 2 a x n a n Matrices 3-19
22 Linear function a function f : R n R m is linear if superposition holds: for all n-vectors x, y and all scalars α, β f(αx + βy) = αf(x) + βf(y) Extension: if f is linear, superposition holds for any linear combination: f(α 1 u 1 + α 2 u α p u p ) = α 1 f(u 1 ) + α 2 f(u 2 ) + + α p f(u p ) for all scalars, α 1,, α p and all n-vectors u 1,, u p Matrices 3-20
23 Matrix-vector product function for fixed A R m n, define a function f : R n R m as f(x) = Ax any function of this type is linear: A(αx + βy) = α(ax) + β(ay) every linear function can be written as a matrix-vector product function: f(x) = f(x 1 e 1 + x 2 e x n e n ) = x 1 f(e 1 ) + x 2 f(e 2 ) + + x n f(e n ) = [ f(e 1 ) f(e n ) ] x 1 x n hence, f(x) = Ax with A = [ f(e 1 ) f(e 2 ) f(e n ) ] Matrices 3-21
24 Input-output (operator) interpretation think of a function f : R n R m in terms of its effect on x x A y = f(x) = Ax signal processing/control interpretation: n inputs x i, m outputs y i f is linear if we can represent its action on x as a product f(x) = Ax Matrices 3-22
25 Examples (f : R 3 R 3 ) f reverses the order of the components of x a linear function: f(x) = Ax with A = f sorts the components of x in decreasing order: not linear f scales x 1 by a given number d 1, x 2 by d 2, x 3 by d 3 a linear function: f(x) = Ax with A = d d d 3 f replaces each x i by its absolute value x i : not linear Matrices 3-23
26 Operator interpretation of matrix-matrix product explains why in general AB BA x B A y = ABx x A B y = BAx Example A = [ ], B = [ ] f(x) = ABx reverses order of elements; then changes sign of first element f(x) = BAx changes sign of 1st element; then reverses order Matrices 3-24
27 Reverser and circular shift Reverser matrix A = , Ax = x n x n 1 x 2 x 1 Circular shift matrix A = , Ax = x n x 1 x 2 x n 1 Matrices 3-25
28 Permutation Permutation matrix a square 0-1 matrix with one element 1 per row and one element 1 per column equivalently, an identity matrix with columns reordered equivalently, an identity matrix with rows reordered Ax is a permutation of the elements of x Example A = , Ax = x 2 x 4 x 1 x 3 Matrices 3-26
29 Rotation in a plane A = [ cos θ sin θ sin θ cos θ ] Ax is x rotated counterclockwise over an angle θ Ax θ x Matrices 3-27
30 Projection on line and reflection x a y z projection on line through a (see page 2-12): y = at x 1 a 2a = Ax with A = a 2aaT reflection with respect to line through a z = x + 2(y x) = Bx, with B = 2 a 2aaT I Matrices 3-28
31 Node-arc incidence matrix directed graph (network) with m vertices, n arcs (directed edges) incidence matrix is m n matrix A with A ij = 1 if arc j enters node i 1 if arc j leaves node i 0 otherwise A = Matrices 3-29
32 Kirchhoff s current law n-vector x = (x 1, x 2,, x n ) with x j the current through arc j (Ax) i = arc j enters node i x j arc j leaves node i x j = total current arriving at node i x x 1 x 4 x 5 Ax = x 1 x 2 + x 4 x 1 x 3 x 3 x 4 x 5 x 2 + x 5 1 x 2 4 Matrices 3-30
33 Kirchhoff s voltage law m-vector y = (y 1, y 2,, y m ) with y i the potential at node i (A T y) j = y k y l if edge j goes from node l to k = negative of voltage across arc j y 2 3 y y y 4 A T y = y 2 y 1 y 4 y 1 y 3 y 2 y 1 y 3 y 4 y 3 Matrices 3-31
34 Convolution the convolution of an n-vector a and an m-vector b is the (n + m 1)-vector c notation: c = a b Example: n = 4, m = 3 c k = all i and j with i + j = k + 1 a i b j c 1 = a 1 b 1 c 2 = a 1 b 2 + a 2 b 1 c 3 = a 1 b 3 + a 2 b 2 + a 3 b 1 c 4 = a 2 b 3 + a 3 b 2 + a 4 b 1 c 5 = a 3 b 3 + a 4 b 2 c 6 = a 4 b 3 Matrices 3-32
35 Properties Interpretation: if a and b are the coefficients of polynomials p(x) = a 1 + a 2 x + + a n x n 1, q(x) = b 1 + b 2 x + + b m x m 1 then c = a b gives the coefficients of the product polynomial p(x)q(x) = c 1 + c 2 x + c 3 x c n+m 1 x n+m 2 Properties symmetric: a b = b a associative: (a b) c = a (b c) if a b = 0 then a = 0 or b = 0 these properties follow directly from the polynomial product interpretation Matrices 3-33
36 Example: moving average of a time series n-vector x represents a time series the 3-period moving average of the time series is the time series y k = 1 3 (x k + x k 1 + x k 2 ), k = 1, 2,, n + 2 (with x k interpreted as zero for k < 1 and k > n) this can be expressed as a convolution y = a x with a = (1/3, 1/3, 1/3) 3 3 xk 2 1 (a x)k k k Matrices 3-34
37 Convolution and Toeplitz matrices c = a b is a linear function of b if we fix a c = a b is a linear function of a if we fix b Example: convolution c = a b of a 4-vector a and a 3-vector b c 1 c 2 c 3 c 4 c 5 c 6 = a a 2 a 1 0 a 3 a 2 a 1 a 4 a 3 a 2 0 a 4 a a 4 b 1 b 2 b 3 = b b 2 b b 3 b 2 b b 3 b 2 b b 3 b b 3 a 1 a 2 a 3 a 4 the matrices in these matrix-vector products are called Toeplitz matrices Matrices 3-35
38 Vandermonde matrix polynomial of degree n 1 or less with coefficients x 1, x 2,, x n : p(t) = x 1 + x 2 t + x 3 t x n t n 1 values of p(t) at m points t 1,, t m : p(t 1 ) p(t 2 ) p(t m ) = = Ax 1 t 1 t1 n 1 1 t 2 t2 n 1 1 t m tm n 1 x 1 x 2 x n the matrix A is called a Vandermonde matrix f(x) = Ax maps coefficients of polynomial to function values Matrices 3-36
39 Discrete Fourier transform the DFT maps a complex n-vector (x 1, x 2,, x n ) to the complex n-vector y 1 y 2 y 3 y n = ω 1 ω 2 ω (n 1) 1 ω 2 ω 4 ω 2(n 1) 1 ω (n 1) ω 2(n 1) ω (n 1)(n 1) x 1 x 2 x 3 x n = W x where ω = e 2πj/n (and j = 1) DFT matrix W C n n has k, l element W kl = ω (k 1)(l 1) a Vandermonde matrix with m = n and t 1 = 1, t 2 = ω 1, t 3 = ω 2,, t n = ω (n 1) Matrices 3-37
40 Affine function a function f : R n R m is affine if it satisfies f(αx + βy) = αf(x) + βf(y) for all n-vectors x, y and all scalars α, β with α + β = 1 Extension: if f is affine, then f(α 1 u 1 + α 2 u α m u m ) = α 1 f(u 1 ) + α 2 f(u 2 ) + + α m f(u m ) for all n-vectors u 1,, u m and all scalars α 1,, α m with α 1 + α α m = 1 Matrices 3-38
41 Affine functions and matrix-vector product for fixed A R m n, b R m, define a function f : R n R m by f(x) = Ax + b ie, a matrix-vector product plus a constant any function of this type is affine: if α + β = 1 then A(αx + βy) + b = α(ax + b) + β(ax + b) every affine function can be written as f(x) = Ax + b with: and b = f(0) A = [ f(e 1 ) f(0) f(e 2 ) f(0) f(e n ) f(0) ] Matrices 3-39
42 Affine approximation first-order Taylor approximation of differentiable f : R n R m around z: f i (x) = f i (z) + f i x 1 (z)(x 1 z 1 ) + + f i x n (z)(x n z n ), i = 1,, m in matrix-vector notation: f(x) = f(z) + Df(z)(x z) where Df(z) = f 1 x 1 (z) f 2 x 1 (z) f m x 1 (z) f 1 x 2 (z) f 2 x 2 (z) f m x 2 (z) f 1 x n (z) f 2 x n (z) f m x n (z) = f 1 (z) T f 2 (z) T f m (z) T Df(z) is called the derivative matrix or Jacobian matrix of f at z f is a local affine approximation of f around z Matrices 3-40
43 Example f(x) = [ f1 (x) f 2 (x) ] = [ ] e 2x 1 +x 2 x 1 x 2 1 x 2 derivative matrix [ 2e 2x 1 +x 2 1 e 2x 1+x 2 ] Df(x) = 2x 1 1 first order approximation of f around z = 0: f(x) = [ f1 (x) f 2 (x) ] = [ 1 0 ] + [ ] [ x1 x 2 ] Matrices 3-41
44 Outline notation and terminology matrix operations linear and affine functions complexity
45 Matrix-vector product matrix-vector multiplication of m n matrix A and n-vector x: y = Ax requires (2n 1)m flops m elements in y; each element requires an inner product of length n approximately 2mn for large n Special cases: flop count is lower for structured matrices A diagonal: n flops A lower triangular: n 2 flops A sparse: #flops 2mn Matrices 3-42
46 Matrix-matrix product product of m n matrix A and n p matrix B: C = AB requires mp(2n 1) flops mp elements in C; each element requires an inner product of length n approximately 2mnp for large n Matrices 3-43
47 Exercises 1 evaluate y = ABx two ways (A and B are n n, x is a vector) y = (AB)x (first make product C = AB, then multiply C with x) y = A(Bx) (first make product y = Bx, then multiply A with y) both methods give the same answer, but which method is faster? 2 evaluate y = (I + uv T )x where u, v, x are n-vectors A = I + uv T followed by y = Ax in MATLAB: y = (eye(n) + u*v ) * x w = (v T x)u followed by y = x + w in MATLAB: y = x + (v *x) * u Matrices 3-44
A primer on matrices
A primer on matrices Stephen Boyd August 4, 2007 These notes describe the notation of matrices, the mechanics of matrix manipulation, and how to use matrices to formulate and solve sets of simultaneous
More information5. Orthogonal matrices
L Vandenberghe EE133A (Spring 2017) 5 Orthogonal matrices matrices with orthonormal columns orthogonal matrices tall matrices with orthonormal columns complex matrices with orthonormal columns 5-1 Orthonormal
More informationMatrix Arithmetic. a 11 a. A + B = + a m1 a mn. + b. a 11 + b 11 a 1n + b 1n = a m1. b m1 b mn. and scalar multiplication for matrices via.
Matrix Arithmetic There is an arithmetic for matrices that can be viewed as extending the arithmetic we have developed for vectors to the more general setting of rectangular arrays: if A and B are m n
More informationNotes on vectors and matrices
Notes on vectors and matrices EE103 Winter Quarter 2001-02 L Vandenberghe 1 Terminology and notation Matrices, vectors, and scalars A matrix is a rectangular array of numbers (also called scalars), written
More informationMatrix Algebra 2.1 MATRIX OPERATIONS Pearson Education, Inc.
2 Matrix Algebra 2.1 MATRIX OPERATIONS MATRIX OPERATIONS m n If A is an matrixthat is, a matrix with m rows and n columnsthen the scalar entry in the ith row and jth column of A is denoted by a ij and
More information1. Vectors. notation. examples. vector operations. linear functions. complex vectors. complexity of vector computations
L. Vandenberghe ECE133A (Winter 2018) 1. Vectors notation examples vector operations linear functions complex vectors complexity of vector computations 1-1 Vector a vector is an ordered finite list of
More informationMatrices. Chapter What is a Matrix? We review the basic matrix operations. An array of numbers a a 1n A = a m1...
Chapter Matrices We review the basic matrix operations What is a Matrix? An array of numbers a a n A = a m a mn with m rows and n columns is a m n matrix Element a ij in located in position (i, j The elements
More information4. Matrix inverses. left and right inverse. linear independence. nonsingular matrices. matrices with linearly independent columns
L. Vandenberghe ECE133A (Winter 2018) 4. Matrix inverses left and right inverse linear independence nonsingular matrices matrices with linearly independent columns matrices with linearly independent rows
More informationICS 6N Computational Linear Algebra Matrix Algebra
ICS 6N Computational Linear Algebra Matrix Algebra Xiaohui Xie University of California, Irvine xhx@uci.edu February 2, 2017 Xiaohui Xie (UCI) ICS 6N February 2, 2017 1 / 24 Matrix Consider an m n matrix
More information9. Numerical linear algebra background
Convex Optimization Boyd & Vandenberghe 9. Numerical linear algebra background matrix structure and algorithm complexity solving linear equations with factored matrices LU, Cholesky, LDL T factorization
More informationLinear Algebra and Matrix Inversion
Jim Lambers MAT 46/56 Spring Semester 29- Lecture 2 Notes These notes correspond to Section 63 in the text Linear Algebra and Matrix Inversion Vector Spaces and Linear Transformations Matrices are much
More informationSection 9.2: Matrices. Definition: A matrix A consists of a rectangular array of numbers, or elements, arranged in m rows and n columns.
Section 9.2: Matrices Definition: A matrix A consists of a rectangular array of numbers, or elements, arranged in m rows and n columns. That is, a 11 a 12 a 1n a 21 a 22 a 2n A =...... a m1 a m2 a mn A
More informationMATH2210 Notebook 2 Spring 2018
MATH2210 Notebook 2 Spring 2018 prepared by Professor Jenny Baglivo c Copyright 2009 2018 by Jenny A. Baglivo. All Rights Reserved. 2 MATH2210 Notebook 2 3 2.1 Matrices and Their Operations................................
More information9. Numerical linear algebra background
Convex Optimization Boyd & Vandenberghe 9. Numerical linear algebra background matrix structure and algorithm complexity solving linear equations with factored matrices LU, Cholesky, LDL T factorization
More informationWe could express the left side as a sum of vectors and obtain the Vector Form of a Linear System: a 12 a x n. a m2
Week 22 Equations, Matrices and Transformations Coefficient Matrix and Vector Forms of a Linear System Suppose we have a system of m linear equations in n unknowns a 11 x 1 + a 12 x 2 + + a 1n x n b 1
More information12. Cholesky factorization
L. Vandenberghe ECE133A (Winter 2018) 12. Cholesky factorization positive definite matrices examples Cholesky factorization complex positive definite matrices kernel methods 12-1 Definitions a symmetric
More informationLinear Equations in Linear Algebra
1 Linear Equations in Linear Algebra 1.7 LINEAR INDEPENDENCE LINEAR INDEPENDENCE Definition: An indexed set of vectors {v 1,, v p } in n is said to be linearly independent if the vector equation x x x
More informationMAT 2037 LINEAR ALGEBRA I web:
MAT 237 LINEAR ALGEBRA I 2625 Dokuz Eylül University, Faculty of Science, Department of Mathematics web: Instructor: Engin Mermut http://kisideuedutr/enginmermut/ HOMEWORK 2 MATRIX ALGEBRA Textbook: Linear
More informationFoundations of Matrix Analysis
1 Foundations of Matrix Analysis In this chapter we recall the basic elements of linear algebra which will be employed in the remainder of the text For most of the proofs as well as for the details, the
More informationA primer on matrices
A primer on matrices Stephen Boyd August 4, 2007 These notes describe the notation of matrices, the mechanics of matrix manipulation, and how to use matrices to formulate and solve sets of simultaneous
More informationFundamentals of Linear Algebra. Marcel B. Finan Arkansas Tech University c All Rights Reserved
Fundamentals of Linear Algebra Marcel B. Finan Arkansas Tech University c All Rights Reserved 2 PREFACE Linear algebra has evolved as a branch of mathematics with wide range of applications to the natural
More informationA = 3 B = A 1 1 matrix is the same as a number or scalar, 3 = [3].
Appendix : A Very Brief Linear ALgebra Review Introduction Linear Algebra, also known as matrix theory, is an important element of all branches of mathematics Very often in this course we study the shapes
More informationMatrices BUSINESS MATHEMATICS
Matrices BUSINESS MATHEMATICS 1 CONTENTS Matrices Special matrices Operations with matrices Matrix multipication More operations with matrices Matrix transposition Symmetric matrices Old exam question
More informationA VERY BRIEF LINEAR ALGEBRA REVIEW for MAP 5485 Introduction to Mathematical Biophysics Fall 2010
A VERY BRIEF LINEAR ALGEBRA REVIEW for MAP 5485 Introduction to Mathematical Biophysics Fall 00 Introduction Linear Algebra, also known as matrix theory, is an important element of all branches of mathematics
More informationLU Factorization. Marco Chiarandini. DM559 Linear and Integer Programming. Department of Mathematics & Computer Science University of Southern Denmark
DM559 Linear and Integer Programming LU Factorization Marco Chiarandini Department of Mathematics & Computer Science University of Southern Denmark [Based on slides by Lieven Vandenberghe, UCLA] Outline
More informationEE364a Review Session 7
EE364a Review Session 7 EE364a Review session outline: derivatives and chain rule (Appendix A.4) numerical linear algebra (Appendix C) factor and solve method exploiting structure and sparsity 1 Derivative
More informationLecture 3: Matrix and Matrix Operations
Lecture 3: Matrix and Matrix Operations Representation, row vector, column vector, element of a matrix. Examples of matrix representations Tables and spreadsheets Scalar-Matrix operation: Scaling a matrix
More informationMath 489AB Exercises for Chapter 2 Fall Section 2.3
Math 489AB Exercises for Chapter 2 Fall 2008 Section 2.3 2.3.3. Let A M n (R). Then the eigenvalues of A are the roots of the characteristic polynomial p A (t). Since A is real, p A (t) is a polynomial
More informationChapter 4 - MATRIX ALGEBRA. ... a 2j... a 2n. a i1 a i2... a ij... a in
Chapter 4 - MATRIX ALGEBRA 4.1. Matrix Operations A a 11 a 12... a 1j... a 1n a 21. a 22.... a 2j... a 2n. a i1 a i2... a ij... a in... a m1 a m2... a mj... a mn The entry in the ith row and the jth column
More information10. Linear Systems of ODEs, Matrix multiplication, superposition principle (parts of sections )
c Dr. Igor Zelenko, Fall 2017 1 10. Linear Systems of ODEs, Matrix multiplication, superposition principle (parts of sections 7.2-7.4) 1. When each of the functions F 1, F 2,..., F n in right-hand side
More informationMatrix Operations. Linear Combination Vector Algebra Angle Between Vectors Projections and Reflections Equality of matrices, Augmented Matrix
Linear Combination Vector Algebra Angle Between Vectors Projections and Reflections Equality of matrices, Augmented Matrix Matrix Operations Matrix Addition and Matrix Scalar Multiply Matrix Multiply Matrix
More informationA matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and
Section 5.5. Matrices and Vectors A matrix is a rectangular array of objects arranged in rows and columns. The objects are called the entries. A matrix with m rows and n columns is called an m n matrix.
More informationPhys 201. Matrices and Determinants
Phys 201 Matrices and Determinants 1 1.1 Matrices 1.2 Operations of matrices 1.3 Types of matrices 1.4 Properties of matrices 1.5 Determinants 1.6 Inverse of a 3 3 matrix 2 1.1 Matrices A 2 3 7 =! " 1
More informationA matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and
Section 5.5. Matrices and Vectors A matrix is a rectangular array of objects arranged in rows and columns. The objects are called the entries. A matrix with m rows and n columns is called an m n matrix.
More informationElementary Row Operations on Matrices
King Saud University September 17, 018 Table of contents 1 Definition A real matrix is a rectangular array whose entries are real numbers. These numbers are organized on rows and columns. An m n matrix
More informationCS100: DISCRETE STRUCTURES. Lecture 3 Matrices Ch 3 Pages:
CS100: DISCRETE STRUCTURES Lecture 3 Matrices Ch 3 Pages: 246-262 Matrices 2 Introduction DEFINITION 1: A matrix is a rectangular array of numbers. A matrix with m rows and n columns is called an m x n
More informationCLASS 12 ALGEBRA OF MATRICES
CLASS 12 ALGEBRA OF MATRICES Deepak Sir 9811291604 SHRI SAI MASTERS TUITION CENTER CLASS 12 A matrix is an ordered rectangular array of numbers or functions. The numbers or functions are called the elements
More informationMatrix Algebra Determinant, Inverse matrix. Matrices. A. Fabretti. Mathematics 2 A.Y. 2015/2016. A. Fabretti Matrices
Matrices A. Fabretti Mathematics 2 A.Y. 2015/2016 Table of contents Matrix Algebra Determinant Inverse Matrix Introduction A matrix is a rectangular array of numbers. The size of a matrix is indicated
More informationPrepared by: M. S. KumarSwamy, TGT(Maths) Page
Prepared by: M. S. KumarSwamy, TGT(Maths) Page - 50 - CHAPTER 3: MATRICES QUICK REVISION (Important Concepts & Formulae) MARKS WEIGHTAGE 03 marks Matrix A matrix is an ordered rectangular array of numbers
More informationMatrices and Linear Algebra
Contents Quantitative methods for Economics and Business University of Ferrara Academic year 2017-2018 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2
More information1 Matrices and matrix algebra
1 Matrices and matrix algebra 1.1 Examples of matrices A matrix is a rectangular array of numbers and/or variables. For instance 4 2 0 3 1 A = 5 1.2 0.7 x 3 π 3 4 6 27 is a matrix with 3 rows and 5 columns
More informationIntroduction - Motivation. Many phenomena (physical, chemical, biological, etc.) are model by differential equations. f f(x + h) f(x) (x) = lim
Introduction - Motivation Many phenomena (physical, chemical, biological, etc.) are model by differential equations. Recall the definition of the derivative of f(x) f f(x + h) f(x) (x) = lim. h 0 h Its
More informationMatrix operations Linear Algebra with Computer Science Application
Linear Algebra with Computer Science Application February 14, 2018 1 Matrix operations 11 Matrix operations If A is an m n matrix that is, a matrix with m rows and n columns then the scalar entry in the
More informationMatrix Algebra. Matrix Algebra. Chapter 8 - S&B
Chapter 8 - S&B Algebraic operations Matrix: The size of a matrix is indicated by the number of its rows and the number of its columns. A matrix with k rows and n columns is called a k n matrix. The number
More informationSection 9.2: Matrices.. a m1 a m2 a mn
Section 9.2: Matrices Definition: A matrix is a rectangular array of numbers: a 11 a 12 a 1n a 21 a 22 a 2n A =...... a m1 a m2 a mn In general, a ij denotes the (i, j) entry of A. That is, the entry in
More information[ Here 21 is the dot product of (3, 1, 2, 5) with (2, 3, 1, 2), and 31 is the dot product of
. Matrices A matrix is any rectangular array of numbers. For example 3 5 6 4 8 3 3 is 3 4 matrix, i.e. a rectangular array of numbers with three rows four columns. We usually use capital letters for matrices,
More informationFinite Mathematics Chapter 2. where a, b, c, d, h, and k are real numbers and neither a and b nor c and d are both zero.
Finite Mathematics Chapter 2 Section 2.1 Systems of Linear Equations: An Introduction Systems of Equations Recall that a system of two linear equations in two variables may be written in the general form
More informationChapter 1: Systems of linear equations and matrices. Section 1.1: Introduction to systems of linear equations
Chapter 1: Systems of linear equations and matrices Section 1.1: Introduction to systems of linear equations Definition: A linear equation in n variables can be expressed in the form a 1 x 1 + a 2 x 2
More informationChapter 5. Linear Algebra. A linear (algebraic) equation in. unknowns, x 1, x 2,..., x n, is. an equation of the form
Chapter 5. Linear Algebra A linear (algebraic) equation in n unknowns, x 1, x 2,..., x n, is an equation of the form a 1 x 1 + a 2 x 2 + + a n x n = b where a 1, a 2,..., a n and b are real numbers. 1
More informationIntroduction to Matrix Algebra
Introduction to Matrix Algebra August 18, 2010 1 Vectors 1.1 Notations A p-dimensional vector is p numbers put together. Written as x 1 x =. x p. When p = 1, this represents a point in the line. When p
More informationLinear Algebra review Powers of a diagonalizable matrix Spectral decomposition
Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2018 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing
More informationMatrices: 2.1 Operations with Matrices
Goals In this chapter and section we study matrix operations: Define matrix addition Define multiplication of matrix by a scalar, to be called scalar multiplication. Define multiplication of two matrices,
More informationMATRICES. a m,1 a m,n A =
MATRICES Matrices are rectangular arrays of real or complex numbers With them, we define arithmetic operations that are generalizations of those for real and complex numbers The general form a matrix of
More informationReview of some mathematical tools
MATHEMATICAL FOUNDATIONS OF SIGNAL PROCESSING Fall 2016 Benjamín Béjar Haro, Mihailo Kolundžija, Reza Parhizkar, Adam Scholefield Teaching assistants: Golnoosh Elhami, Hanjie Pan Review of some mathematical
More informationAppendix C Vector and matrix algebra
Appendix C Vector and matrix algebra Concepts Scalars Vectors, rows and columns, matrices Adding and subtracting vectors and matrices Multiplying them by scalars Products of vectors and matrices, scalar
More informationMatrix & Linear Algebra
Matrix & Linear Algebra Jamie Monogan University of Georgia For more information: http://monogan.myweb.uga.edu/teaching/mm/ Jamie Monogan (UGA) Matrix & Linear Algebra 1 / 84 Vectors Vectors Vector: A
More informationLinear Algebra March 16, 2019
Linear Algebra March 16, 2019 2 Contents 0.1 Notation................................ 4 1 Systems of linear equations, and matrices 5 1.1 Systems of linear equations..................... 5 1.2 Augmented
More informationChapter 2: Matrices and Linear Systems
Chapter 2: Matrices and Linear Systems Paul Pearson Outline Matrices Linear systems Row operations Inverses Determinants Matrices Definition An m n matrix A = (a ij ) is a rectangular array of real numbers
More informationA Brief Outline of Math 355
A Brief Outline of Math 355 Lecture 1 The geometry of linear equations; elimination with matrices A system of m linear equations with n unknowns can be thought of geometrically as m hyperplanes intersecting
More informationMathematics 13: Lecture 10
Mathematics 13: Lecture 10 Matrices Dan Sloughter Furman University January 25, 2008 Dan Sloughter (Furman University) Mathematics 13: Lecture 10 January 25, 2008 1 / 19 Matrices Recall: A matrix is a
More informationMath 4377/6308 Advanced Linear Algebra
2.3 Composition Math 4377/6308 Advanced Linear Algebra 2.3 Composition of Linear Transformations Jiwen He Department of Mathematics, University of Houston jiwenhe@math.uh.edu math.uh.edu/ jiwenhe/math4377
More informationLinear Systems and Matrices
Department of Mathematics The Chinese University of Hong Kong 1 System of m linear equations in n unknowns (linear system) a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2.......
More information7.2. Matrix Multiplication. Introduction. Prerequisites. Learning Outcomes
Matrix Multiplication 7.2 Introduction When we wish to multiply matrices together we have to ensure that the operation is possible - and this is not always so. Also, unlike number arithmetic and algebra,
More informationMath 360 Linear Algebra Fall Class Notes. a a a a a a. a a a
Math 360 Linear Algebra Fall 2008 9-10-08 Class Notes Matrices As we have already seen, a matrix is a rectangular array of numbers. If a matrix A has m columns and n rows, we say that its dimensions are
More informationMatrices and Vectors
Matrices and Vectors James K. Peterson Department of Biological Sciences and Department of Mathematical Sciences Clemson University November 11, 2013 Outline 1 Matrices and Vectors 2 Vector Details 3 Matrix
More informationScientific Computing: Dense Linear Systems
Scientific Computing: Dense Linear Systems Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course MATH-GA.2043 or CSCI-GA.2112, Spring 2012 February 9th, 2012 A. Donev (Courant Institute)
More informationInverses. Stephen Boyd. EE103 Stanford University. October 28, 2017
Inverses Stephen Boyd EE103 Stanford University October 28, 2017 Outline Left and right inverses Inverse Solving linear equations Examples Pseudo-inverse Left and right inverses 2 Left inverses a number
More informationMath113: Linear Algebra. Beifang Chen
Math3: Linear Algebra Beifang Chen Spring 26 Contents Systems of Linear Equations 3 Systems of Linear Equations 3 Linear Systems 3 2 Geometric Interpretation 3 3 Matrices of Linear Systems 4 4 Elementary
More informationIntroduction. Vectors and Matrices. Vectors [1] Vectors [2]
Introduction Vectors and Matrices Dr. TGI Fernando 1 2 Data is frequently arranged in arrays, that is, sets whose elements are indexed by one or more subscripts. Vector - one dimensional array Matrix -
More information3. Vector spaces 3.1 Linear dependence and independence 3.2 Basis and dimension. 5. Extreme points and basic feasible solutions
A. LINEAR ALGEBRA. CONVEX SETS 1. Matrices and vectors 1.1 Matrix operations 1.2 The rank of a matrix 2. Systems of linear equations 2.1 Basic solutions 3. Vector spaces 3.1 Linear dependence and independence
More informationMath 3108: Linear Algebra
Math 3108: Linear Algebra Instructor: Jason Murphy Department of Mathematics and Statistics Missouri University of Science and Technology 1 / 323 Contents. Chapter 1. Slides 3 70 Chapter 2. Slides 71 118
More informationA FIRST COURSE IN LINEAR ALGEBRA. An Open Text by Ken Kuttler. Matrix Arithmetic
A FIRST COURSE IN LINEAR ALGEBRA An Open Text by Ken Kuttler Matrix Arithmetic Lecture Notes by Karen Seyffarth Adapted by LYRYX SERVICE COURSE SOLUTION Attribution-NonCommercial-ShareAlike (CC BY-NC-SA)
More informationDETERMINANTS. , x 2 = a 11b 2 a 21 b 1
DETERMINANTS 1 Solving linear equations The simplest type of equations are linear The equation (1) ax = b is a linear equation, in the sense that the function f(x) = ax is linear 1 and it is equated to
More informationLinear Algebra Homework and Study Guide
Linear Algebra Homework and Study Guide Phil R. Smith, Ph.D. February 28, 20 Homework Problem Sets Organized by Learning Outcomes Test I: Systems of Linear Equations; Matrices Lesson. Give examples of
More informationMatrices. Math 240 Calculus III. Wednesday, July 10, Summer 2013, Session II. Matrices. Math 240. Definitions and Notation.
function Matrices Calculus III Summer 2013, Session II Wednesday, July 10, 2013 Agenda function 1. 2. function function Definition An m n matrix is a rectangular array of numbers arranged in m horizontal
More informationMath 3191 Applied Linear Algebra
Math 191 Applied Linear Algebra Lecture 8: Inverse of a Matrix Stephen Billups University of Colorado at Denver Math 191Applied Linear Algebra p.1/0 Announcements We will not make it to section. tonight,
More informationWhat is the Matrix? Linear control of finite-dimensional spaces. November 28, 2010
What is the Matrix? Linear control of finite-dimensional spaces. November 28, 2010 Scott Strong sstrong@mines.edu Colorado School of Mines What is the Matrix? p. 1/20 Overview/Keywords/References Advanced
More informationGraduate Mathematical Economics Lecture 1
Graduate Mathematical Economics Lecture 1 Yu Ren WISE, Xiamen University September 23, 2012 Outline 1 2 Course Outline ematical techniques used in graduate level economics courses Mathematics for Economists
More informationMatrix Arithmetic. j=1
An m n matrix is an array A = Matrix Arithmetic a 11 a 12 a 1n a 21 a 22 a 2n a m1 a m2 a mn of real numbers a ij An m n matrix has m rows and n columns a ij is the entry in the i-th row and j-th column
More informationLecture 3 Linear Algebra Background
Lecture 3 Linear Algebra Background Dan Sheldon September 17, 2012 Motivation Preview of next class: y (1) w 0 + w 1 x (1) 1 + w 2 x (1) 2 +... + w d x (1) d y (2) w 0 + w 1 x (2) 1 + w 2 x (2) 2 +...
More informationMath Linear Algebra Final Exam Review Sheet
Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of
More informationJim Lambers MAT 610 Summer Session Lecture 1 Notes
Jim Lambers MAT 60 Summer Session 2009-0 Lecture Notes Introduction This course is about numerical linear algebra, which is the study of the approximate solution of fundamental problems from linear algebra
More informationMath 314/814 Topics for first exam
Chapter 2: Systems of linear equations Math 314/814 Topics for first exam Some examples Systems of linear equations: 2x 3y z = 6 3x + 2y + z = 7 Goal: find simultaneous solutions: all x, y, z satisfying
More information1 The theoretical constructions
Linear Transformations and Matrix Representations Samuel R Buss - Spring 003 Revision (Corrections appreciated!) These notes review the topics I lectured on while covering sections 4, 4, and 5 of the textbook
More informationLinear Algebra Review
Chapter 1 Linear Algebra Review It is assumed that you have had a course in linear algebra, and are familiar with matrix multiplication, eigenvectors, etc. I will review some of these terms here, but quite
More informationMatrix Multiplication
3.2 Matrix Algebra Matrix Multiplication Example Foxboro Stadium has three main concession stands, located behind the south, north and west stands. The top-selling items are peanuts, hot dogs and soda.
More informationLinear Algebra V = T = ( 4 3 ).
Linear Algebra Vectors A column vector is a list of numbers stored vertically The dimension of a column vector is the number of values in the vector W is a -dimensional column vector and V is a 5-dimensional
More informationChapter 2. Ma 322 Fall Ma 322. Sept 23-27
Chapter 2 Ma 322 Fall 2013 Ma 322 Sept 23-27 Summary ˆ Matrices and their Operations. ˆ Special matrices: Zero, Square, Identity. ˆ Elementary Matrices, Permutation Matrices. ˆ Voodoo Principle. What is
More information* is a row matrix * An mxn matrix is a square matrix if and only if m=n * A= is a diagonal matrix if = 0 i
CET MATRICES *A matrix is an order rectangular array of numbers * A matrix having m rows and n columns is called mxn matrix of order * is a column matrix * is a row matrix * An mxn matrix is a square matrix
More informationn n matrices The system of m linear equations in n variables x 1, x 2,..., x n can be written as a matrix equation by Ax = b, or in full
n n matrices Matrices Definitions Diagonal, Identity, and zero matrices Addition Multiplication Transpose and inverse The system of m linear equations in n variables x 1, x 2,..., x n a 11 x 1 + a 12 x
More informationMATRICES AND MATRIX OPERATIONS
SIZE OF THE MATRIX is defined by number of rows and columns in the matrix. For the matrix that have m rows and n columns we say the size of the matrix is m x n. If matrix have the same number of rows (n)
More informationMatrices. Chapter Definitions and Notations
Chapter 3 Matrices 3. Definitions and Notations Matrices are yet another mathematical object. Learning about matrices means learning what they are, how they are represented, the types of operations which
More informationIntroduction to Matrices and Linear Systems Ch. 3
Introduction to Matrices and Linear Systems Ch. 3 Doreen De Leon Department of Mathematics, California State University, Fresno June, 5 Basic Matrix Concepts and Operations Section 3.4. Basic Matrix Concepts
More informationSolutions for Chapter 3
Solutions for Chapter Solutions for exercises in section 0 a X b x, y 6, and z 0 a Neither b Sew symmetric c Symmetric d Neither The zero matrix trivially satisfies all conditions, and it is the only possible
More informationLinear Algebra. Linear Equations and Matrices. Copyright 2005, W.R. Winfrey
Copyright 2005, W.R. Winfrey Topics Preliminaries Systems of Linear Equations Matrices Algebraic Properties of Matrix Operations Special Types of Matrices and Partitioned Matrices Matrix Transformations
More informationFundamentals of Engineering Analysis (650163)
Philadelphia University Faculty of Engineering Communications and Electronics Engineering Fundamentals of Engineering Analysis (6563) Part Dr. Omar R Daoud Matrices: Introduction DEFINITION A matrix is
More informationExercise Set Suppose that A, B, C, D, and E are matrices with the following sizes: A B C D E
Determine the size of a given matrix. Identify the row vectors and column vectors of a given matrix. Perform the arithmetic operations of matrix addition, subtraction, scalar multiplication, and multiplication.
More informationLinear Algebra review Powers of a diagonalizable matrix Spectral decomposition
Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2016 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing
More informationCS 246 Review of Linear Algebra 01/17/19
1 Linear algebra In this section we will discuss vectors and matrices. We denote the (i, j)th entry of a matrix A as A ij, and the ith entry of a vector as v i. 1.1 Vectors and vector operations A vector
More informationCalculus II - Basic Matrix Operations
Calculus II - Basic Matrix Operations Ryan C Daileda Terminology A matrix is a rectangular array of numbers, for example 7,, 7 7 9, or / / /4 / / /4 / / /4 / /6 The numbers in any matrix are called its
More information