x n -2.5 Definition A list is a list of objects, where multiplicity is allowed, and order matters. For example, as lists

Size: px
Start display at page:

Download "x n -2.5 Definition A list is a list of objects, where multiplicity is allowed, and order matters. For example, as lists"

Transcription

1 Vectors, Linear Combinations, and Matrix-Vector Mulitiplication In this section, we introduce vectors, linear combinations, and matrix-vector multiplication The rest of the class will involve vectors, and they are objects that appear consistently in more advanced mathematics, physics, differential equations, engineering, and more Taking linear combinations of lists of vectors is a natural and important thing we do and will lead to matrix-vector multiplication Matrix-vector multiplication will be instrumental in this class as it gives rise to linear maps Definition A (column) vector is a list of real numbers arranged in a column We write vectors with arrows over them, as in x x =, where x,,, are real numbers called the components of x An n-vector is a vectors with n components We think of vectors geometrically as arrows starting at the origin, where the jth-component records the amount the arrow goes along the j-th coordinate axis, as the following example illustrates - x To describe -dimensional space, we take three directions for our coordinate axes, say forward, right, and up Then, three dimensional space is all of the points, or vectors, that can be reached by going some amount forward, some amount right, then some amount up, including negative amounts So, in terms of vectors, -dimensional space is the set of all -vectors It works similarly for other dimensions, though it is harder to visualize geometrically Definition The set of all n-vectors is n-dimensional Euclidean space, denoted R n Definition A set is a collection of objects, where multiplicity is not allowed, and order does not matter We use { } to denote sets For example, {,, } is a set, {,, } is NOT a set, and {,, } = {,, } Definition 4 A list is a list of objects, where multiplicity is allowed, and order matters For example, as lists (,, ), (,, ) are lists, and (,, ) (,, ) Since we will be using lists and sets a lot in this class, we introduce some essential concepts and notation Such concepts and notation are ubiquitous in more advanced mathematics and science because sets are a convenient way to store information In addition, we introduce new notation for

2 describing sets, called set notation, which will make it much easier to describe and specify certain sets in the future Definition We use x A, read as x is in A, to mean x is an element of A, and we say x / A, read as x is not in A, otherwise We use A B, read as A is contained in B or A is a subset of B if every element of A is also an element of B, and we say A B otherwise For example, {,, 4}, / {,, 4}, {,, 4} {,,, 4, 7}, {,, 4} {,, } But what if we wanted to specify more interesting set, like to set S of all positive integers Then, we could write S = {,,, 4, } and assume the reader will intuit what means here Or, we can write S = {x x is a positive integer} Here, the left side of the bar indicates the objects in the set, and the right side of bar indicates the properties these objects need to have in order to be in the set So, S is the set of all positive integers Now, suppose we wanted to specify the set S of all -vectors whose components sum to 0 If we just list elements of S, S = 0 0, 0, 0,, π,, 0 0 π it is not clear what vectors are in S and which are not Instead, we write S = x () x + + x = 0 This means S is the set of all x satisfying x + + x = 0 So, for example, x x S, since + 4 = 0, 4 / S, since + + = 6 0 But R n, the set of all n-vectors, is not just a static object In this class, we will be concerned with the operations of addition and scalar multiplication on R n We will define them exactly as one would expect These operations have many of the same properties that ordinary addition and multiplication do One vector that will show up over and over again is the vector of all zeros, which we call the zero vector Definition 6 Let 0 denote the zero vector, whose components are all zeros: 0 0 =, 0

3 where the number of components is in context For example, if 0 R, then 0 = numbers x,,, y,, y n, c, define x y x + y + y = + y, y n + y n x cx c = c, c 0 0 For any real In terms of arrows, we add vectors tip to tail, and we scale vectors by scaling arrows as follows Note that scaling by reverses the direction of the arrow x + y y c v x v v Proposition 7 For any x, y, z R n and scalars c, d, (a) x + y = y + x (b) ( x + y) + z = x + ( y + z) (c) (c(d x)) = (cd) x (d) (c + d) x = c x + d x (e) c( x + y) = c x + c y (f) x + 0 = x (g) x x = 0 (h) 0 x = 0 Proof Problem Suppose we have some vectors a,, a n in R m and we are allowed to use the operations of addition and scalar multiplication What are all the vectors we can get? These vectors are called the linear combinations of ( a,, a n ) Linear combinations of lists of vectors will appear constantly in this class Definition 8 Let ( a,, a n ) be a list of vectors in R m A linear combination of ( a,, a n ) is a vector of the form c a + c a + + c n a n for some scalars c, c,, c n For example, the following are linear combinations of ( a, a ): (a) a + a, (b) 7 a π a,

4 4 (c) a = a + 0 a, (d) a = 0 a + a, (e) 0 = 0 a + 0 a Geometrically, the linear combinations of ( a,, a n ) are all of the vectors that can be obtained from ( a,, a n ) using addition and scalar multiplication Below are all the linear combinations of ( a, a ) using coefficients in {,, 0,, }: a a Example 9 (a) Find 4 4 (b) Express as a linear combination of 7 (c) Express Solution: (a) (b) We solve (, ( w as a linear combination of, w 4 = This becomes x x 4 + = x 7 x = ) ) = = 7 x 4 = x = x =4 x + =7 Writing in augmented matrix form and performing EROs, we get 4 0 4/ = x 7 0 / = 4, = ( ) 4 Therefore, is the following linear combination of, : = 4 +

5 (c) We solve w = x w + x = x w = x + w = w w as a linear system in x, Solving this linear system by EROs gives w 0 w + w w 0 w + w = x = w + w, = w + w Therefore, w is a linear combination of w 4 7 = and as follows: ( w + ( ) w + w + w ) One can also solve the linear system in Example 9(c) using a multi-augmented matrix as follows For multi-augmented matrices, each augmented column represents the coefficients of variables just like the non-augmented columns do To write the linear system in Example 9(c) as a multi-augmented matrix, we add two augmented columns to keep track of the coefficients of w, w on the right hand side, which gives 0 0 We can solve this linear system with EROs as usual Note that EROs work no differently for multi-augmented matrices Thus, R 0 R 0 R 0 R +R 0 Interpreting these equations gives x = w + w, = w + w as in Example 9(c) Thus, in order to express a vector as a linear combination of a set of vectors, we had to solve a linear system Going in the other direction, any linear system can be written as expressing one vector as a linear combination of a list of vectors We will see this by example as it would add very little insight but much more notation to prove this fact in full generality The interested reader can try to prove this in general in Problelm 7 Example 0 Rewrite the linear system () x + + x + 4x 4 =, 6x x + 9x 4 = 8, x 4 + x x 4 = 6 as expressing one vector as a linear combination of some list of vectors Solution: Turning both sides into vectors, x + + x + 4x 4 6x x + 9x 4 = () 8 x 4 + x x 4 6 Next, we employ an algebraic technique that will be used over and over again in this class Split the vector on the left hand side of () into a linear combination of constant vectors with each variable

6 6 as a coefficient The entries of the vectors simply become the coefficients of each variable in the corresponding component So, () becomes x x 8 + x = (4) Next, we will define matrix-vector multiplication so that the left hand side of (4) becomes 4 x = 8 6 Notice that one can obtain this matrix from () by simply removing the variables and putting the coefficients into a rectangular array One can also obtain the vector on the right hand side by turning the right side of the equals signs into a vector Given an m n matrix A, we view its n columns, which we often call a,, a n, as vectors in R m For example, A = = a 4 6 a a, where a = R 4, a = R, a = R 6 Definition For an m n matrix A = a a n, and x R n, define x A x = a a n x 4 = x a + + a n Since a,, a n R m, A x R m as well If the number of columns of A does not equal the number of components of x, then A x is not defined Example Perform the following matrix-vector multiplications, if possible (a), (b) (c) (d) 4 6,, Solution: (a) = = 6

7 7 (b) = = 6 (c) 4 6 is not defined since the number of columns of the matrix is not the same as the number of components of the vector (d) 4 = = Alternatively, one can compute the i-th entry of A x by multiplying the i-th row of A by x Again, we will see this by example as it would add very little insight but much more notation to prove this fact in full generality The interested reader can try to prove this in general, Problem 8 For example, in Example (c), notice that the first component of 4 is 6 7 = + ( ) + =, You may have seen this notion before as the dot product Thus, matrix-vector multiplication reduces to the dot product when the matrix has one row Let us look at another set of examples so that we notice some remarkable properties Example Let Find A x, A y, A( x + y) and A( x) Solution: () A x = + = 4 7 () A y = + = 4 () A( x + y) = = (4) A( x) = A = 4 = 4, x =, y = = = 4 Notice that A( x + y) = A x + A y, A( x) = A x This is not a coincidence, as we prove in the following Theorem Theorem 4 Let A be a m n matrix, x, y R n, and c a scalar Then, (a) A( x + y) = A x + A y

8 8 (b) A(c x) = c(a x) Proof We begin by setting Then, we find x A = a a n, x = A( x + y) = x + y a a n + y n, y = y y n = (x + y ) a + + ( + y n ) a n = (x a + + a n ) + (y a + + y n a n ) = A x + A y A(c x) = cx a a n c = (cx ) a + + (c ) a n = c(x a + + a n ) = c(a x) These properties of distributing over addition and scalar multiplication are the properties of linearity, which we will use for the rest of this class Exercises: Express as a linear combination of (, if possible or demonstrate it is not possible 7) Can you do it in multiple ways? If so, how? ( ) 4 Express as a linear combination of,, if possible, or demonstrate it is not possible 6 8 Can you do it in multiple ways? If so, how? ( 4 Express as a linear combination of,, if possible, or demonstrate it is not possible 6) Can you do it in multiple ways? If so, how? 4 Express as a linear combination of 0,, 4, if possible, or demonstrate it is 0 0 not possible Can you do it in multiple ways? If so, how? Compute using both methods of matrix multiplication Check that your answers agree 6 Write the following vectors as linear combinations of constant vectors (vectors without variables)

9 x + x (a) x 4 (b) x + 0 (c) x + x + x + x (d) x x + x 4x 4 + x x + 7x 4 ( w 7 When is a linear combination of? Your answer should be some relation(s) between w ) w and w 8 When is w w a linear combination of 4, 6? Your answer should be some relation(s) w 7 among w, w, w 9 When is w w a linear combination of,, 0? Your answer should be some relation(s) w 0 among w, w, w 0 When is w w a linear combination of 4? Your answer should be some relation(s) among w 7 w, w, w Problems: () Prove Proposition 7 () Show that A 0 = 0 for any matrix A () Show that 0, a,, a n are all linear combinations of ( a,, a n ) for any a,, a n R m 4 () Show that if x is a linear combination of ( a,, a n ), then x is a linear combination of any rearrangement of ( a,, a n ) 9 (+) Show that 0 0 x x 0 0 = Suppose A is an m n matrix, v, w R n, and c is a scalar (a) () Show that there exists x R n so that A x = c(a v) (b) () Show that there exists y R n so that A y = A v + A w

10 0 7 () Show that every linear system in the variables with m equations variables x,, can be written as A x = b, where A is an m n matrix, x = x and b R m 8 (+) Let r, r, r m be row vectors of size n, and let x R n Show that r r x r x = r x r m x r m 9 Suppose a,, a n R m, and c is a scalar For each of the following claims, prove it or give a counterexample (a) () Every linear combination of ( a + a, a, a, a n ) is a linear combination of ( a,, a n ) (b) () Every linear combination of ( a,, a n ) is a linear combination of ( a + a, a, a n ) (c) () Every linear combination of ( a,, a n ) is a linear combination of ( a + a, a, a, a n ) (d) () Every linear combination of (c a, a, a n ) is a linear combination of ( a,, a n ) (e) () Every linear combination of ( a, a, a n ) is a linear combination of (c a, a,, a n ) 0 Suppose x, y R n (a) () Show that every vector u R n whose endpoint lies on the line through the endpoints of x and y is of the form u = t x + ( t) y for some scalar t (b) () Show that every vector u R n whose endpoint lies on the line segment between the endpoints of x and y is of the form u = t x + ( t) y for some scalar t, 0 t () Show that if A is an m n matrix, v,, v k R n, and c,, c k are scalars, then A(c v + + c k v k ) = c (A v ) + + c k (A v k ) () Suppose A, B are m n matrices, and x R n with x 0 Prove or give a counterexample: If A x = B x, then A = B () Suppose A is an m n matrix with at least one nonzero entry, and x, y R n Prove or give a counterexample: If A x = A y, then x = y x () Show that every x = 0 Rn is a linear combination of,,, 0 0 0

11 x () Show that every x = 0 Rn is a linear combination of,,, () Suppose A is an m n matrix, b R n and x, y R n satisfies A y = b and A x = b Show that A( x y) = 0 A 7 (+) If A is an m n matrix and B is a k n matrix, let denote the (m + k) n matrix B obtained by stacking A on top of B Show that for all m n matrices A, k n matrices B, and x R n, A A x x = B B x 8 (+) If A is an m n matrix and B is a m k matrix, let A B denote the m (n + k) matrix obtained by placing B to the right of A Show that for all m n matrices A, m k matrices B, x R m, and y R k, x A B = A x + B y y 9 () Suppose A is an m n matrix, v,, v k R n, and y is a linear combination of (A v,, A v k ) Show that there exists x R n so that A x = y 0 () Suppose v is a linear combination of ( a,, a n ) but is not a linear combination of ( a,, a n ) Show that a n is a linear combination of ( a,, a n, v)

MTH 464: Computational Linear Algebra

MTH 464: Computational Linear Algebra MTH 464: Computational Linear Algebra Lecture Outlines Exam 1 Material Dr. M. Beauregard Department of Mathematics & Statistics Stephen F. Austin State University January 9, 2018 Linear Algebra (MTH 464)

More information

Linear Equations in Linear Algebra

Linear Equations in Linear Algebra 1 Linear Equations in Linear Algebra 1.3 VECTOR EQUATIONS VECTOR EQUATIONS Vectors in 2 A matrix with only one column is called a column vector, or simply a vector. An example of a vector with two entries

More information

First of all, the notion of linearity does not depend on which coordinates are used. Recall that a map T : R n R m is linear if

First of all, the notion of linearity does not depend on which coordinates are used. Recall that a map T : R n R m is linear if 5 Matrices in Different Coordinates In this section we discuss finding matrices of linear maps in different coordinates Earlier in the class was the matrix that multiplied by x to give ( x) in standard

More information

Abstract & Applied Linear Algebra (Chapters 1-2) James A. Bernhard University of Puget Sound

Abstract & Applied Linear Algebra (Chapters 1-2) James A. Bernhard University of Puget Sound Abstract & Applied Linear Algebra (Chapters 1-2) James A. Bernhard University of Puget Sound Copyright 2018 by James A. Bernhard Contents 1 Vector spaces 3 1.1 Definitions and basic properties.................

More information

[ Here 21 is the dot product of (3, 1, 2, 5) with (2, 3, 1, 2), and 31 is the dot product of

[ Here 21 is the dot product of (3, 1, 2, 5) with (2, 3, 1, 2), and 31 is the dot product of . Matrices A matrix is any rectangular array of numbers. For example 3 5 6 4 8 3 3 is 3 4 matrix, i.e. a rectangular array of numbers with three rows four columns. We usually use capital letters for matrices,

More information

The Matrix Vector Product and the Matrix Product

The Matrix Vector Product and the Matrix Product The Matrix Vector Product and the Matrix Product As we have seen a matrix is just a rectangular array of scalars (real numbers) The size of a matrix indicates its number of rows and columns A matrix with

More information

Chapter 1: Linear Equations

Chapter 1: Linear Equations Chapter : Linear Equations (Last Updated: September, 7) The material for these notes is derived primarily from Linear Algebra and its applications by David Lay (4ed).. Systems of Linear Equations Before

More information

Matrix Basic Concepts

Matrix Basic Concepts Matrix Basic Concepts Topics: What is a matrix? Matrix terminology Elements or entries Diagonal entries Address/location of entries Rows and columns Size of a matrix A column matrix; vectors Special types

More information

An overview of key ideas

An overview of key ideas An overview of key ideas This is an overview of linear algebra given at the start of a course on the mathematics of engineering. Linear algebra progresses from vectors to matrices to subspaces. Vectors

More information

Linear Equations in Linear Algebra

Linear Equations in Linear Algebra 1 Linear Equations in Linear Algebra 1.1 SYSTEMS OF LINEAR EQUATIONS LINEAR EQUATION,, 1 n A linear equation in the variables equation that can be written in the form a a a b 1 1 2 2 n n a a is an where

More information

22m:033 Notes: 1.3 Vector Equations

22m:033 Notes: 1.3 Vector Equations m:0 Notes: Vector Equations Dennis Roseman University of Iowa Iowa City, IA http://wwwmathuiowaedu/ roseman January 7, 00 Algebra and Geometry We think of geometric things as subsets of the plane or of

More information

y 2 . = x 1y 1 + x 2 y x + + x n y n 2 7 = 1(2) + 3(7) 5(4) = 3. x x = x x x2 n.

y 2 . = x 1y 1 + x 2 y x + + x n y n 2 7 = 1(2) + 3(7) 5(4) = 3. x x = x x x2 n. 6.. Length, Angle, and Orthogonality In this section, we discuss the defintion of length and angle for vectors and define what it means for two vectors to be orthogonal. Then, we see that linear systems

More information

Lecture 2 Systems of Linear Equations and Matrices, Continued

Lecture 2 Systems of Linear Equations and Matrices, Continued Lecture 2 Systems of Linear Equations and Matrices, Continued Math 19620 Outline of Lecture Algorithm for putting a matrix in row reduced echelon form - i.e. Gauss-Jordan Elimination Number of Solutions

More information

Chapter 1: Linear Equations

Chapter 1: Linear Equations Chapter : Linear Equations (Last Updated: September, 6) The material for these notes is derived primarily from Linear Algebra and its applications by David Lay (4ed).. Systems of Linear Equations Before

More information

Linear Algebra March 16, 2019

Linear Algebra March 16, 2019 Linear Algebra March 16, 2019 2 Contents 0.1 Notation................................ 4 1 Systems of linear equations, and matrices 5 1.1 Systems of linear equations..................... 5 1.2 Augmented

More information

7.5 Operations with Matrices. Copyright Cengage Learning. All rights reserved.

7.5 Operations with Matrices. Copyright Cengage Learning. All rights reserved. 7.5 Operations with Matrices Copyright Cengage Learning. All rights reserved. What You Should Learn Decide whether two matrices are equal. Add and subtract matrices and multiply matrices by scalars. Multiply

More information

Vector, Matrix, and Tensor Derivatives

Vector, Matrix, and Tensor Derivatives Vector, Matrix, and Tensor Derivatives Erik Learned-Miller The purpose of this document is to help you learn to take derivatives of vectors, matrices, and higher order tensors (arrays with three dimensions

More information

Math 1314 Week #14 Notes

Math 1314 Week #14 Notes Math 3 Week # Notes Section 5.: A system of equations consists of two or more equations. A solution to a system of equations is a point that satisfies all the equations in the system. In this chapter,

More information

We could express the left side as a sum of vectors and obtain the Vector Form of a Linear System: a 12 a x n. a m2

We could express the left side as a sum of vectors and obtain the Vector Form of a Linear System: a 12 a x n. a m2 Week 22 Equations, Matrices and Transformations Coefficient Matrix and Vector Forms of a Linear System Suppose we have a system of m linear equations in n unknowns a 11 x 1 + a 12 x 2 + + a 1n x n b 1

More information

Linear Equations in Linear Algebra

Linear Equations in Linear Algebra 1 Linear Equations in Linear Algebra 1.1 SYSTEMS OF LINEAR EQUATIONS LINEAR EQUATION x 1,, x n A linear equation in the variables equation that can be written in the form a 1 x 1 + a 2 x 2 + + a n x n

More information

Calculus II - Basic Matrix Operations

Calculus II - Basic Matrix Operations Calculus II - Basic Matrix Operations Ryan C Daileda Terminology A matrix is a rectangular array of numbers, for example 7,, 7 7 9, or / / /4 / / /4 / / /4 / /6 The numbers in any matrix are called its

More information

DS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.

DS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra. DS-GA 1002 Lecture notes 0 Fall 2016 Linear Algebra These notes provide a review of basic concepts in linear algebra. 1 Vector spaces You are no doubt familiar with vectors in R 2 or R 3, i.e. [ ] 1.1

More information

MATH 2331 Linear Algebra. Section 1.1 Systems of Linear Equations. Finding the solution to a set of two equations in two variables: Example 1: Solve:

MATH 2331 Linear Algebra. Section 1.1 Systems of Linear Equations. Finding the solution to a set of two equations in two variables: Example 1: Solve: MATH 2331 Linear Algebra Section 1.1 Systems of Linear Equations Finding the solution to a set of two equations in two variables: Example 1: Solve: x x = 3 1 2 2x + 4x = 12 1 2 Geometric meaning: Do these

More information

Linear Algebra I. Ronald van Luijk, 2015

Linear Algebra I. Ronald van Luijk, 2015 Linear Algebra I Ronald van Luijk, 2015 With many parts from Linear Algebra I by Michael Stoll, 2007 Contents Dependencies among sections 3 Chapter 1. Euclidean space: lines and hyperplanes 5 1.1. Definition

More information

CS123 INTRODUCTION TO COMPUTER GRAPHICS. Linear Algebra 1/33

CS123 INTRODUCTION TO COMPUTER GRAPHICS. Linear Algebra 1/33 Linear Algebra 1/33 Vectors A vector is a magnitude and a direction Magnitude = v Direction Also known as norm, length Represented by unit vectors (vectors with a length of 1 that point along distinct

More information

Linear Algebra V = T = ( 4 3 ).

Linear Algebra V = T = ( 4 3 ). Linear Algebra Vectors A column vector is a list of numbers stored vertically The dimension of a column vector is the number of values in the vector W is a -dimensional column vector and V is a 5-dimensional

More information

Announcements August 31

Announcements August 31 Announcements August 31 Homeworks 1.1 and 1.2 are due Friday. The first quiz is on Friday, during recitation. Quizzes mostly test your understanding of the homework. There will generally be a quiz every

More information

Math Linear Algebra

Math Linear Algebra Math 39 - Linear Algebra A simple description of the subject of (finite dimensional Linear Algebra might be the study of matrices and vectors Matrices are arrays that are (usually filled with real or complex

More information

System of Linear Equations

System of Linear Equations Math 20F Linear Algebra Lecture 2 1 System of Linear Equations Slide 1 Definition 1 Fix a set of numbers a ij, b i, where i = 1,, m and j = 1,, n A system of m linear equations in n variables x j, is given

More information

Exam 1 - Definitions and Basic Theorems

Exam 1 - Definitions and Basic Theorems Exam 1 - Definitions and Basic Theorems One of the difficuliies in preparing for an exam where there will be a lot of proof problems is knowing what you re allowed to cite and what you actually have to

More information

And, even if it is square, we may not be able to use EROs to get to the identity matrix. Consider

And, even if it is square, we may not be able to use EROs to get to the identity matrix. Consider .2. Echelon Form and Reduced Row Echelon Form In this section, we address what we are trying to achieve by doing EROs. We are trying to turn any linear system into a simpler one. But what does simpler

More information

ICS 6N Computational Linear Algebra Vector Equations

ICS 6N Computational Linear Algebra Vector Equations ICS 6N Computational Linear Algebra Vector Equations Xiaohui Xie University of California, Irvine xhx@uci.edu January 17, 2017 Xiaohui Xie (UCI) ICS 6N January 17, 2017 1 / 18 Vectors in R 2 An example

More information

Vectors. 1 Basic Definitions. Liming Pang

Vectors. 1 Basic Definitions. Liming Pang Vectors Liming Pang 1 Basic Definitions Definition 1. A vector in a line/plane/space is a quantity which has both magnitude and direction. The magnitude is a nonnegative real number and the direction is

More information

A Note on the Eigenvalues and Eigenvectors of Leslie matrices. Ralph Howard Department of Mathematics University of South Carolina

A Note on the Eigenvalues and Eigenvectors of Leslie matrices. Ralph Howard Department of Mathematics University of South Carolina A Note on the Eigenvalues and Eigenvectors of Leslie matrices Ralph Howard Department of Mathematics University of South Carolina Vectors and Matrices A size n vector, v, is a list of n numbers put in

More information

Chapter 4. Vector Space Examples. 4.1 Diffusion Welding and Heat States

Chapter 4. Vector Space Examples. 4.1 Diffusion Welding and Heat States Chapter 4 Vector Space Examples 4.1 Diffusion Welding and Heat States In this section, we begin a deeper look into the mathematics for diffusion welding application discussed in Chapter 1. Recall that

More information

Linear Equation: a 1 x 1 + a 2 x a n x n = b. x 1, x 2,..., x n : variables or unknowns

Linear Equation: a 1 x 1 + a 2 x a n x n = b. x 1, x 2,..., x n : variables or unknowns Linear Equation: a x + a 2 x 2 +... + a n x n = b. x, x 2,..., x n : variables or unknowns a, a 2,..., a n : coefficients b: constant term Examples: x + 4 2 y + (2 5)z = is linear. x 2 + y + yz = 2 is

More information

CS123 INTRODUCTION TO COMPUTER GRAPHICS. Linear Algebra /34

CS123 INTRODUCTION TO COMPUTER GRAPHICS. Linear Algebra /34 Linear Algebra /34 Vectors A vector is a magnitude and a direction Magnitude = v Direction Also known as norm, length Represented by unit vectors (vectors with a length of 1 that point along distinct axes)

More information

1 Matrices and Systems of Linear Equations. a 1n a 2n

1 Matrices and Systems of Linear Equations. a 1n a 2n March 31, 2013 16-1 16. Systems of Linear Equations 1 Matrices and Systems of Linear Equations An m n matrix is an array A = (a ij ) of the form a 11 a 21 a m1 a 1n a 2n... a mn where each a ij is a real

More information

Linear Algebra I Lecture 8

Linear Algebra I Lecture 8 Linear Algebra I Lecture 8 Xi Chen 1 1 University of Alberta January 25, 2019 Outline 1 2 Gauss-Jordan Elimination Given a system of linear equations f 1 (x 1, x 2,..., x n ) = 0 f 2 (x 1, x 2,..., x n

More information

A primer on matrices

A primer on matrices A primer on matrices Stephen Boyd August 4, 2007 These notes describe the notation of matrices, the mechanics of matrix manipulation, and how to use matrices to formulate and solve sets of simultaneous

More information

1. Vectors.

1. Vectors. 1. Vectors 1.1 Vectors and Matrices Linear algebra is concerned with two basic kinds of quantities: vectors and matrices. 1.1 Vectors and Matrices Scalars and Vectors - Scalar: a numerical value denoted

More information

Contents. 2.1 Vectors in R n. Linear Algebra (part 2) : Vector Spaces (by Evan Dummit, 2017, v. 2.50) 2 Vector Spaces

Contents. 2.1 Vectors in R n. Linear Algebra (part 2) : Vector Spaces (by Evan Dummit, 2017, v. 2.50) 2 Vector Spaces Linear Algebra (part 2) : Vector Spaces (by Evan Dummit, 2017, v 250) Contents 2 Vector Spaces 1 21 Vectors in R n 1 22 The Formal Denition of a Vector Space 4 23 Subspaces 6 24 Linear Combinations and

More information

Math Studio College Algebra

Math Studio College Algebra Math 100 - Studio College Algebra Rekha Natarajan Kansas State University November 19, 2014 Systems of Equations Systems of Equations A system of equations consists of Systems of Equations A system of

More information

Solutions of Linear system, vector and matrix equation

Solutions of Linear system, vector and matrix equation Goals: Solutions of Linear system, vector and matrix equation Solutions of linear system. Vectors, vector equation. Matrix equation. Math 112, Week 2 Suggested Textbook Readings: Sections 1.3, 1.4, 1.5

More information

Review of Linear Algebra

Review of Linear Algebra Review of Linear Algebra Definitions An m n (read "m by n") matrix, is a rectangular array of entries, where m is the number of rows and n the number of columns. 2 Definitions (Con t) A is square if m=

More information

1 Last time: inverses

1 Last time: inverses MATH Linear algebra (Fall 8) Lecture 8 Last time: inverses The following all mean the same thing for a function f : X Y : f is invertible f is one-to-one and onto 3 For each b Y there is exactly one a

More information

3. Replace any row by the sum of that row and a constant multiple of any other row.

3. Replace any row by the sum of that row and a constant multiple of any other row. Section. Solution of Linear Systems by Gauss-Jordan Method A matrix is an ordered rectangular array of numbers, letters, symbols or algebraic expressions. A matrix with m rows and n columns has size or

More information

(, ) : R n R n R. 1. It is bilinear, meaning it s linear in each argument: that is

(, ) : R n R n R. 1. It is bilinear, meaning it s linear in each argument: that is 17 Inner products Up until now, we have only examined the properties of vectors and matrices in R n. But normally, when we think of R n, we re really thinking of n-dimensional Euclidean space - that is,

More information

Finite Mathematics Chapter 2. where a, b, c, d, h, and k are real numbers and neither a and b nor c and d are both zero.

Finite Mathematics Chapter 2. where a, b, c, d, h, and k are real numbers and neither a and b nor c and d are both zero. Finite Mathematics Chapter 2 Section 2.1 Systems of Linear Equations: An Introduction Systems of Equations Recall that a system of two linear equations in two variables may be written in the general form

More information

Some Notes on Linear Algebra

Some Notes on Linear Algebra Some Notes on Linear Algebra prepared for a first course in differential equations Thomas L Scofield Department of Mathematics and Statistics Calvin College 1998 1 The purpose of these notes is to present

More information

System of Linear Equations. Slide for MA1203 Business Mathematics II Week 1 & 2

System of Linear Equations. Slide for MA1203 Business Mathematics II Week 1 & 2 System of Linear Equations Slide for MA1203 Business Mathematics II Week 1 & 2 Function A manufacturer would like to know how his company s profit is related to its production level. How does one quantity

More information

Relationships Between Planes

Relationships Between Planes Relationships Between Planes Definition: consistent (system of equations) A system of equations is consistent if there exists one (or more than one) solution that satisfies the system. System 1: {, System

More information

LS.1 Review of Linear Algebra

LS.1 Review of Linear Algebra LS. LINEAR SYSTEMS LS.1 Review of Linear Algebra In these notes, we will investigate a way of handling a linear system of ODE s directly, instead of using elimination to reduce it to a single higher-order

More information

Vector Algebra August 2013

Vector Algebra August 2013 Vector Algebra 12.1 12.2 28 August 2013 What is a Vector? A vector (denoted or v) is a mathematical object possessing both: direction and magnitude also called length (denoted ). Vectors are often represented

More information

Linear equations in linear algebra

Linear equations in linear algebra Linear equations in linear algebra Samy Tindel Purdue University Differential equations and linear algebra - MA 262 Taken from Differential equations and linear algebra Pearson Collections Samy T. Linear

More information

LECTURES 4/5: SYSTEMS OF LINEAR EQUATIONS

LECTURES 4/5: SYSTEMS OF LINEAR EQUATIONS LECTURES 4/5: SYSTEMS OF LINEAR EQUATIONS MA1111: LINEAR ALGEBRA I, MICHAELMAS 2016 1 Linear equations We now switch gears to discuss the topic of solving linear equations, and more interestingly, systems

More information

Two matrices of the same size are added by adding their corresponding entries =.

Two matrices of the same size are added by adding their corresponding entries =. 2 Matrix algebra 2.1 Addition and scalar multiplication Two matrices of the same size are added by adding their corresponding entries. For instance, 1 2 3 2 5 6 3 7 9 +. 4 0 9 4 1 3 0 1 6 Addition of two

More information

This appendix provides a very basic introduction to linear algebra concepts.

This appendix provides a very basic introduction to linear algebra concepts. APPENDIX Basic Linear Algebra Concepts This appendix provides a very basic introduction to linear algebra concepts. Some of these concepts are intentionally presented here in a somewhat simplified (not

More information

We know how to identify the location of a point by means of coordinates: (x, y) for a point in R 2, or (x, y,z) for a point in R 3.

We know how to identify the location of a point by means of coordinates: (x, y) for a point in R 2, or (x, y,z) for a point in R 3. Vectors We know how to identify the location of a point by means of coordinates: (x, y) for a point in R 2, or (x, y,z) for a point in R 3. More generally, n-dimensional real Euclidean space R n is the

More information

chapter 12 MORE MATRIX ALGEBRA 12.1 Systems of Linear Equations GOALS

chapter 12 MORE MATRIX ALGEBRA 12.1 Systems of Linear Equations GOALS chapter MORE MATRIX ALGEBRA GOALS In Chapter we studied matrix operations and the algebra of sets and logic. We also made note of the strong resemblance of matrix algebra to elementary algebra. The reader

More information

1 - Systems of Linear Equations

1 - Systems of Linear Equations 1 - Systems of Linear Equations 1.1 Introduction to Systems of Linear Equations Almost every problem in linear algebra will involve solving a system of equations. ü LINEAR EQUATIONS IN n VARIABLES We are

More information

Linear Algebra, Summer 2011, pt. 2

Linear Algebra, Summer 2011, pt. 2 Linear Algebra, Summer 2, pt. 2 June 8, 2 Contents Inverses. 2 Vector Spaces. 3 2. Examples of vector spaces..................... 3 2.2 The column space......................... 6 2.3 The null space...........................

More information

x + 2y + 3z = 8 x + 3y = 7 x + 2z = 3

x + 2y + 3z = 8 x + 3y = 7 x + 2z = 3 Chapter 2: Solving Linear Equations 23 Elimination Using Matrices As we saw in the presentation, we can use elimination to make a system of linear equations into an upper triangular system that is easy

More information

Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) 1.1 The Formal Denition of a Vector Space

Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) 1.1 The Formal Denition of a Vector Space Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) Contents 1 Vector Spaces 1 1.1 The Formal Denition of a Vector Space.................................. 1 1.2 Subspaces...................................................

More information

3. Vector spaces 3.1 Linear dependence and independence 3.2 Basis and dimension. 5. Extreme points and basic feasible solutions

3. Vector spaces 3.1 Linear dependence and independence 3.2 Basis and dimension. 5. Extreme points and basic feasible solutions A. LINEAR ALGEBRA. CONVEX SETS 1. Matrices and vectors 1.1 Matrix operations 1.2 The rank of a matrix 2. Systems of linear equations 2.1 Basic solutions 3. Vector spaces 3.1 Linear dependence and independence

More information

7 Matrix Operations. 7.0 Matrix Multiplication + 3 = 3 = 4

7 Matrix Operations. 7.0 Matrix Multiplication + 3 = 3 = 4 7 Matrix Operations Copyright 017, Gregory G. Smith 9 October 017 The product of two matrices is a sophisticated operations with a wide range of applications. In this chapter, we defined this binary operation,

More information

Section 29: What s an Inverse?

Section 29: What s an Inverse? Section 29: What s an Inverse? Our investigations in the last section showed that all of the matrix operations had an identity element. The identity element for addition is, for obvious reasons, called

More information

1 What is the area model for multiplication?

1 What is the area model for multiplication? for multiplication represents a lovely way to view the distribution property the real number exhibit. This property is the link between addition and multiplication. 1 1 What is the area model for multiplication?

More information

Math 54 HW 4 solutions

Math 54 HW 4 solutions Math 54 HW 4 solutions 2.2. Section 2.2 (a) False: Recall that performing a series of elementary row operations A is equivalent to multiplying A by a series of elementary matrices. Suppose that E,...,

More information

22m:033 Notes: 6.1 Inner Product, Length and Orthogonality

22m:033 Notes: 6.1 Inner Product, Length and Orthogonality m:033 Notes: 6. Inner Product, Length and Orthogonality Dennis Roseman University of Iowa Iowa City, IA http://www.math.uiowa.edu/ roseman April, 00 The inner product Arithmetic is based on addition and

More information

Math Week 1 notes

Math Week 1 notes Math 2270-004 Week notes We will not necessarily finish the material from a given day's notes on that day. Or on an amazing day we may get farther than I've predicted. We may also add or subtract some

More information

Introduction to Linear Algebra

Introduction to Linear Algebra Introduction to Linear Algebra Linear algebra is the algebra of vectors. In a course on linear algebra you will also learn about the machinery (matrices and reduction of matrices) for solving systems of

More information

Systems of Linear Equations

Systems of Linear Equations LECTURE 6 Systems of Linear Equations You may recall that in Math 303, matrices were first introduced as a means of encapsulating the essential data underlying a system of linear equations; that is to

More information

MATH 221: SOLUTIONS TO SELECTED HOMEWORK PROBLEMS

MATH 221: SOLUTIONS TO SELECTED HOMEWORK PROBLEMS MATH 221: SOLUTIONS TO SELECTED HOMEWORK PROBLEMS 1. HW 1: Due September 4 1.1.21. Suppose v, w R n and c is a scalar. Prove that Span(v + cw, w) = Span(v, w). We must prove two things: that every element

More information

Review for Exam Find all a for which the following linear system has no solutions, one solution, and infinitely many solutions.

Review for Exam Find all a for which the following linear system has no solutions, one solution, and infinitely many solutions. Review for Exam. Find all a for which the following linear system has no solutions, one solution, and infinitely many solutions. x + y z = 2 x + 2y + z = 3 x + y + (a 2 5)z = a 2 The augmented matrix for

More information

MATH 12 CLASS 2 NOTES, SEP Contents. 2. Dot product: determining the angle between two vectors 2

MATH 12 CLASS 2 NOTES, SEP Contents. 2. Dot product: determining the angle between two vectors 2 MATH 12 CLASS 2 NOTES, SEP 23 2011 Contents 1. Dot product: definition, basic properties 1 2. Dot product: determining the angle between two vectors 2 Quick links to definitions/theorems Dot product definition

More information

A FIRST COURSE IN LINEAR ALGEBRA. An Open Text by Ken Kuttler. Lecture Notes by Karen Seyffarth Adapted by LYRYX SERVICE COURSE SOLUTION

A FIRST COURSE IN LINEAR ALGEBRA. An Open Text by Ken Kuttler. Lecture Notes by Karen Seyffarth Adapted by LYRYX SERVICE COURSE SOLUTION A FIRST COURSE IN LINEAR ALGEBRA An Open Text by Ken Kuttler R n : Vectors Lecture Notes by Karen Seyffarth Adapted by LYRYX SERVICE COURSE SOLUTION Attribution-NonCommercial-ShareAlike (CC BY-NC-SA) This

More information

Linear Algebra. Min Yan

Linear Algebra. Min Yan Linear Algebra Min Yan January 2, 2018 2 Contents 1 Vector Space 7 1.1 Definition................................. 7 1.1.1 Axioms of Vector Space..................... 7 1.1.2 Consequence of Axiom......................

More information

Contents. 1 Vectors, Lines and Planes 1. 2 Gaussian Elimination Matrices Vector Spaces and Subspaces 124

Contents. 1 Vectors, Lines and Planes 1. 2 Gaussian Elimination Matrices Vector Spaces and Subspaces 124 Matrices Math 220 Copyright 2016 Pinaki Das This document is freely redistributable under the terms of the GNU Free Documentation License For more information, visit http://wwwgnuorg/copyleft/fdlhtml Contents

More information

Matrix operations Linear Algebra with Computer Science Application

Matrix operations Linear Algebra with Computer Science Application Linear Algebra with Computer Science Application February 14, 2018 1 Matrix operations 11 Matrix operations If A is an m n matrix that is, a matrix with m rows and n columns then the scalar entry in the

More information

Lecture Notes in Linear Algebra

Lecture Notes in Linear Algebra Lecture Notes in Linear Algebra Dr. Abdullah Al-Azemi Mathematics Department Kuwait University February 4, 2017 Contents 1 Linear Equations and Matrices 1 1.2 Matrices............................................

More information

LINEAR SYSTEMS, MATRICES, AND VECTORS

LINEAR SYSTEMS, MATRICES, AND VECTORS ELEMENTARY LINEAR ALGEBRA WORKBOOK CREATED BY SHANNON MARTIN MYERS LINEAR SYSTEMS, MATRICES, AND VECTORS Now that I ve been teaching Linear Algebra for a few years, I thought it would be great to integrate

More information

x y = 1, 2x y + z = 2, and 3w + x + y + 2z = 0

x y = 1, 2x y + z = 2, and 3w + x + y + 2z = 0 Section. Systems of Linear Equations The equations x + 3 y =, x y + z =, and 3w + x + y + z = 0 have a common feature: each describes a geometric shape that is linear. Upon rewriting the first equation

More information

642:550, Summer 2004, Supplement 6 The Perron-Frobenius Theorem. Summer 2004

642:550, Summer 2004, Supplement 6 The Perron-Frobenius Theorem. Summer 2004 642:550, Summer 2004, Supplement 6 The Perron-Frobenius Theorem. Summer 2004 Introduction Square matrices whose entries are all nonnegative have special properties. This was mentioned briefly in Section

More information

The Integers. Peter J. Kahn

The Integers. Peter J. Kahn Math 3040: Spring 2009 The Integers Peter J. Kahn Contents 1. The Basic Construction 1 2. Adding integers 6 3. Ordering integers 16 4. Multiplying integers 18 Before we begin the mathematics of this section,

More information

Lecture 03. Math 22 Summer 2017 Section 2 June 26, 2017

Lecture 03. Math 22 Summer 2017 Section 2 June 26, 2017 Lecture 03 Math 22 Summer 2017 Section 2 June 26, 2017 Just for today (10 minutes) Review row reduction algorithm (40 minutes) 1.3 (15 minutes) Classwork Review row reduction algorithm Review row reduction

More information

Examples: u = is a vector in 2. is a vector in 5.

Examples: u = is a vector in 2. is a vector in 5. 3 Vectors and vector equations We'll carefully define vectors, algebraic operations on vectors and geometric interpretations of these operations, in terms of displacements These ideas will eventually give

More information

Elementary maths for GMT

Elementary maths for GMT Elementary maths for GMT Linear Algebra Part 2: Matrices, Elimination and Determinant m n matrices The system of m linear equations in n variables x 1, x 2,, x n a 11 x 1 + a 12 x 2 + + a 1n x n = b 1

More information

Linear Algebra. The analysis of many models in the social sciences reduces to the study of systems of equations.

Linear Algebra. The analysis of many models in the social sciences reduces to the study of systems of equations. POLI 7 - Mathematical and Statistical Foundations Prof S Saiegh Fall Lecture Notes - Class 4 October 4, Linear Algebra The analysis of many models in the social sciences reduces to the study of systems

More information

MATRICES. a m,1 a m,n A =

MATRICES. a m,1 a m,n A = MATRICES Matrices are rectangular arrays of real or complex numbers With them, we define arithmetic operations that are generalizations of those for real and complex numbers The general form a matrix of

More information

Math Camp II. Basic Linear Algebra. Yiqing Xu. Aug 26, 2014 MIT

Math Camp II. Basic Linear Algebra. Yiqing Xu. Aug 26, 2014 MIT Math Camp II Basic Linear Algebra Yiqing Xu MIT Aug 26, 2014 1 Solving Systems of Linear Equations 2 Vectors and Vector Spaces 3 Matrices 4 Least Squares Systems of Linear Equations Definition A linear

More information

a11 a A = : a 21 a 22

a11 a A = : a 21 a 22 Matrices The study of linear systems is facilitated by introducing matrices. Matrix theory provides a convenient language and notation to express many of the ideas concisely, and complicated formulas are

More information

Introduction to Vector Spaces Linear Algebra, Fall 2008

Introduction to Vector Spaces Linear Algebra, Fall 2008 Introduction to Vector Spaces Linear Algebra, Fall 2008 1 Echoes Consider the set P of polynomials with real coefficients, which includes elements such as 7x 3 4 3 x + π and 3x4 2x 3. Now we can add, subtract,

More information

This last statement about dimension is only one part of a more fundamental fact.

This last statement about dimension is only one part of a more fundamental fact. Chapter 4 Isomorphism and Coordinates Recall that a vector space isomorphism is a linear map that is both one-to-one and onto. Such a map preserves every aspect of the vector space structure. In other

More information

Linear Algebra Practice Problems

Linear Algebra Practice Problems Math 7, Professor Ramras Linear Algebra Practice Problems () Consider the following system of linear equations in the variables x, y, and z, in which the constants a and b are real numbers. x y + z = a

More information

Lecture 3 Linear Algebra Background

Lecture 3 Linear Algebra Background Lecture 3 Linear Algebra Background Dan Sheldon September 17, 2012 Motivation Preview of next class: y (1) w 0 + w 1 x (1) 1 + w 2 x (1) 2 +... + w d x (1) d y (2) w 0 + w 1 x (2) 1 + w 2 x (2) 2 +...

More information

VECTORS. Given two vectors! and! we can express the law of vector addition geometrically. + = Fig. 1 Geometrical definition of vector addition

VECTORS. Given two vectors! and! we can express the law of vector addition geometrically. + = Fig. 1 Geometrical definition of vector addition VECTORS Vectors in 2- D and 3- D in Euclidean space or flatland are easy compared to vectors in non- Euclidean space. In Cartesian coordinates we write a component of a vector as where the index i stands

More information

1 Last time: multiplying vectors matrices

1 Last time: multiplying vectors matrices MATH Linear algebra (Fall 7) Lecture Last time: multiplying vectors matrices Given a matrix A = a a a n a a a n and a vector v = a m a m a mn Av = v a a + v a a v v + + Rn we define a n a n a m a m a mn

More information

2. Every linear system with the same number of equations as unknowns has a unique solution.

2. Every linear system with the same number of equations as unknowns has a unique solution. 1. For matrices A, B, C, A + B = A + C if and only if A = B. 2. Every linear system with the same number of equations as unknowns has a unique solution. 3. Every linear system with the same number of equations

More information

A primer on matrices

A primer on matrices A primer on matrices Stephen Boyd August 4, 2007 These notes describe the notation of matrices, the mechanics of matrix manipulation, and how to use matrices to formulate and solve sets of simultaneous

More information