Chapter 3. Systems of Linear Equations: Geometry

Similar documents
Announcements Wednesday, September 06

Announcements Wednesday, September 05

Announcements Wednesday, September 06. WeBWorK due today at 11:59pm. The quiz on Friday covers through Section 1.2 (last weeks material)

Announcements August 31

The Dot Product

1 :: Mathematical notation

1 Introduction. Control 2:

Math 20C. Lecture Examples.

Section 1.7. Linear Independence

Math 20C. Lecture Examples.

Logistic Regression. Machine Learning Fall 2018

Minimize Cost of Materials

Math 425 Lecture 1: Vectors in R 3, R n

3 - Vector Spaces Definition vector space linear space u, v,

Geometry review, part I

Math 144 Activity #9 Introduction to Vectors

Bloom Filters and Locality-Sensitive Hashing

Ch. 2 Math Preliminaries for Lossless Compression. Section 2.4 Coding

CS123 INTRODUCTION TO COMPUTER GRAPHICS. Linear Algebra /34

Lecture 3a: The Origin of Variational Bayes

CS123 INTRODUCTION TO COMPUTER GRAPHICS. Linear Algebra 1/33

Consider this problem. A person s utility function depends on consumption and leisure. Of his market time (the complement to leisure), h t

Algebra II Solutions

Scalar multiplication and algebraic direction of a vector

Math 1553 Introduction to Linear Algebra. School of Mathematics Georgia Institute of Technology

Translate from words to mathematical expressions.

Blue and purple vectors have same magnitude and direction so they are equal. Blue and green vectors have same direction but different magnitude.

Econ 201: Problem Set 3 Answers

LECTURE 1: INTRODUCTION, VECTORS, AND DOT PRODUCTS

Introduction To Resonant. Circuits. Resonance in series & parallel RLC circuits

Mon Apr dot product, length, orthogonality, projection onto the span of a single vector. Announcements: Warm-up Exercise:

Linear Equations in Linear Algebra

Math 4377/6308 Advanced Linear Algebra

Review of Matrices and Vectors 1/45

Linear models: the perceptron and closest centroid algorithms. D = {(x i,y i )} n i=1. x i 2 R d 9/3/13. Preliminaries. Chapter 1, 7.

7.5 Operations with Matrices. Copyright Cengage Learning. All rights reserved.

MTH 464: Computational Linear Algebra

different formulas, depending on whether or not the vector is in two dimensions or three dimensions.

We know how to identify the location of a point by means of coordinates: (x, y) for a point in R 2, or (x, y,z) for a point in R 3.

Vectors in R n. P. Danziger

Linear Equations in Linear Algebra

On the approximation of real powers of sparse, infinite, bounded and Hermitian matrices

Section 3.3. Matrix Equations

Polynomial and Rational Functions

Vectors Picturing vectors Properties of vectors Linear combination Span. Vectors. Math 4A Scharlemann. 9 January /31

Exercise 1a: Determine the dot product of each of the following pairs of vectors.

Polynomial and Rational Functions

Complex Numbers and the Complex Exponential

Théorie Analytique des Probabilités

A Modified ν-sv Method For Simplified Regression A. Shilton M. Palaniswami

CHAPTER 3 THE COMMON FACTOR MODEL IN THE POPULATION. From Exploratory Factor Analysis Ledyard R Tucker and Robert C. MacCallum

A Generalization of a result of Catlin: 2-factors in line graphs

Lecture 03. Math 22 Summer 2017 Section 2 June 26, 2017

Stat 8112 Lecture Notes Weak Convergence in Metric Spaces Charles J. Geyer January 23, Metric Spaces

M. Matrices and Linear Algebra

Why do Golf Balls have Dimples on Their Surfaces?

LECTURE 2: CROSS PRODUCTS, MULTILINEARITY, AND AREAS OF PARALLELOGRAMS

Logic Effort Revisited

Ch. 7.3, 7.4: Vectors and Complex Numbers

8.0 Definition and the concept of a vector:

Topic 14 Notes Jeremy Orloff

UC Berkeley Department of Electrical Engineering and Computer Sciences. EECS 126: Probability and Random Processes

Lecture 2: Vector-Vector Operations

Artificial Neural Networks. Part 2

VECTORS [PARTS OF 1.3] 5-1

Electromagnetics I Exam No. 3 December 1, 2003 Solution

Outline of lectures 3-6

Roberto s Notes on Linear Algebra Chapter 1: Geometric vectors Section 8. The dot product

Chapter 2. Matrix Arithmetic. Chapter 2

MMSE Equalizer Design

Math 314H EXAM I. 1. (28 points) The row reduced echelon form of the augmented matrix for the system. is the matrix

344 A. Davoodi / IJIM Vol. 1, No. 4 (2009)

STATC141 Spring 2005 The materials are from Pairwise Sequence Alignment by Robert Giegerich and David Wheeler

Math 249B. Geometric Bruhat decomposition

GRADIENT DESCENT. CSE 559A: Computer Vision GRADIENT DESCENT GRADIENT DESCENT [0, 1] Pr(y = 1) w T x. 1 f (x; θ) = 1 f (x; θ) = exp( w T x)

Part I consists of 14 multiple choice questions (worth 5 points each) and 5 true/false question (worth 1 point each), for a total of 75 points.

Chapter 1E - Complex Numbers

x n -2.5 Definition A list is a list of objects, where multiplicity is allowed, and order matters. For example, as lists

Business Cycles: The Classical Approach

Final Review Sheet. B = (1, 1 + 3x, 1 + x 2 ) then 2 + 3x + 6x 2

Usually, when we first formulate a problem in mathematics, we use the most familiar

ECE380 Digital Logic. Synchronous sequential circuits

1 Last time: multiplying vectors matrices

Linear Algebra Basics

CHAPTER 3 : VECTORS. Definition 3.1 A vector is a quantity that has both magnitude and direction.

(1) Sensitivity = 10 0 g x. (2) m Size = Frequency = s (4) Slenderness = 10w (5)

Chapter 1: Linear Equations

and sinθ = cosb =, and we know a and b are acute angles, find cos( a+ b) Trigonometry Topics Accuplacer Review revised July 2016 sin.

Announcements Monday, September 18

Estimation of Efficiency with the Stochastic Frontier Cost. Function and Heteroscedasticity: A Monte Carlo Study

Linear Regression Linear Regression with Shrinkage

Linear Algebra V = T = ( 4 3 ).

Exploiting Source Redundancy to Improve the Rate of Polar Codes

y(x) = x w + ε(x), (1)

Chapter 1: Linear Equations

Modèles stochastiques II

Row Reduction

Linear Algebra Math 221

The Probability of Pathogenicity in Clinical Genetic Testing: A Solution for the Variant of Uncertain Significance

Motion in Three Dimensions

Transcription:

Chapter 3 Systems of Linear Equations: Geometry

Motiation We ant to think about the algebra in linear algebra (systems of equations and their solution sets) in terms of geometry (points, lines, planes, etc). x 3y = 3 2x + y = 8 This ill gie us better insight into the properties of systems of equations and their solution sets. Remember: I expect you to be able to dra pictures!

Section 3.1 Vectors

Points and Vectors We hae been draing elements of R n as points in the line, plane, space, etc. We can also dra them as arros. Definition A point is an element of R n, dran as a point (a dot). the point (1, 3) A ector is an element of R n, dran as an arro. When e think of an element of R n as a ector, e ll usually rite it ectically, like a matrix ith one column: ( ) 1 =. 3 [interactie] the ector ( 1) 3 The difference is purely psychological: points and ectors are just lists of numbers.

Points and Vectors So hy make the distinction? A ector need not start at the origin: it can be located anyhere! In other ords, an arro is determined by its length and its direction, not by its location. These arros all represent the ector ( 1 2). Hoeer, unless otherise specified, e ll assume a ector starts at the origin.

Vector Algebra Definition We can add to ectors together: a x a + x b + y = b + y. c z c + z We can multiply, or scale, a ector by a real number c: x c x c y = c y. z c z We call c a scalar to distinguish it from a ector. If is a ector and c is a scalar, c is called a scalar multiple of. (And likeise for ectors of length n.) For instance, 1 4 5 1 2 2 + 5 = 7 and 2 2 = 4. 3 6 9 3 6

Vector Addition and Subtraction: Geometry 5 = 2 + 3 = 3 + 2 + The parallelogram la for ector addition Geometrically, the sum of to ectors, is obtained as follos: place the tail of at the head of. Then + is the ector hose tail is the tail of and hose head is the head of. Doing this both ays creates a parallelogram. For example, ( 1 3) + ( 4 2) = ( 5 5). 5 = 1 + 4 = 4 + 1 Why? The idth of + is the sum of the idths, and likeise ith the heights. [interactie] Vector subtraction Geometrically, the difference of to ectors, is obtained as follos: place the tail of and at the same point. Then is the ector from the head of to the head of. For example, ( 1 4) ( 4 2) = ( 3 2 ). Why? If you add to, you get. [interactie] This orks in higher dimensions too!

Scalar Multiplication: Geometry Scalar multiples of a ector These hae the same direction but a different length. Some multiples of. 2 1 2 0 ( ) 1 = 2 ( ) 2 2 = 4 1 ( ) 1 2 = 2 1 ( ) 0 0 = 0 All multiples of. [interactie] So the scalar multiples of form a line.

Linear Combinations We can add and scalar multiply in the same equation: = c 1 1 + c 2 2 + + c p p here c 1, c 2,..., c p are scalars, 1, 2,..., p are ectors in R n, and is a ector in R n. Definition We call a linear combination of the ectors 1, 2,..., p. The scalars c 1, c 2,..., c p are called the eights or coefficients. Example ( ( 1 1 Let = and =. 2) 0) What are some linear combinations of and? + 2 + 0 2 [interactie: 2 ectors] [interactie: 3 ectors]

Poll Poll Is there any ector in R 2 combination of and? that is not a linear No: in fact, eery ector in R 2 is a combination of and. (The purple lines are to help measure ho much of and you need to get to a gien point.)

More Examples ( 2 What are some linear combinations of =? 1) 3 2 1 2... What are all linear combinations of? All ectors c for c a real number. I.e., all scalar multiples of. These form a line. Question What are all linear combinations of ( ( ) 2 1 = and =? 2) 1 Anser: The line hich contains both ectors. What s different about this example and the one on the poll? [interactie]

Section 3.2 Vector Equations and Spans

Systems of Linear Equations Question 8 1 1 Is 16 a linear combination of 2 and 2? 3 6 1 This means: can e sole the equation 1 1 8 x 2 + y 2 = 16 6 1 3 here x and y are the unknons (the coefficients)? Rerite: x y 8 x y 8 2x + 2y = 16 or 2x 2y = 16. 6x y 3 6x y 3 This is just a system of linear equations: x y = 8 2x 2y = 16 6x y = 3.

Systems of Linear Equations Continued Conclusion: x y = 8 2x 2y = 16 6x y = 3 matrix form ro reduce solution 1 1 8 2 9 2 = 16 6 1 3 [interactie] (this is the picture of a consistent linear system) 1 1 8 2 2 16 6 1 3 1 0 1 0 1 9 0 0 0 x = 1 y = 9 What is the relationship beteen the original ectors and the matrix form of the linear equation? They hae the same columns! Shortcut: You can make the augmented matrix ithout riting don the system of linear equations first.

Vector Equations and Linear Equations Summary The ector equation x 1 1 + x 2 2 + + x p p = b, here 1, 2,..., p, b are ectors in R n and x 1, x 2,..., x p are scalars, has the same solution set as the linear system ith augmented matrix 1 2 p b, here the i s and b are the columns of the matrix. So e no hae (at least) to equialent ays of thinking about linear systems of equations: 1. Augmented matrices. 2. Linear combinations of ectors (ector equations). The last one is more geometric in nature.

Span It is important to kno hat are all linear combinations of a set of ectors 1, 2,..., p in R n : it s exactly the collection of all b in R n such that the ector equation (in the unknons x 1, x 2,..., x p) has a solution (i.e., is consistent). x 1 1 + x 2 2 + + x p p = b the set of such that Definition Let 1, 2,..., p be ectors in R n. The span of 1, 2,..., p is the collection of all linear combinations of 1, 2,..., p, and is denoted Span{ 1, 2,..., p}. In symbols: Span{ 1, 2,..., p} = { x 1 1 + x 2 2 + + x p p x 1, x 2,..., x p in R }. Synonyms: Span{ 1, 2,..., p} is the subset spanned by or generated by 1, 2,..., p. This is the first of seeral definitions in this class that you simply must learn. I ill gie you other ays to think about Span, and ays to dra pictures, but this is the definition. Haing a ague idea hat Span means ill not help you sole any exam problems!

Span Continued No e hae seeral equialent ays of making the same statement: 1. A ector b is in the span of 1, 2,..., p. 2. The ector equation has a solution. x 1 1 + x 2 2 + + x p p = b 3. The linear system ith augmented matrix 1 2 p b is consistent. [interactie example] (this is the picture of an inconsistent linear system) Note: equialent means that, for any gien list of ectors 1, 2,..., p, b, either all three statements are true, or all three statements are false.

Pictures of Span Draing a picture of Span{ 1, 2,..., p} is the same as draing a picture of all linear combinations of 1, 2,..., p. Span{} Span{, } Span{, } [interactie: span of to ectors in R 2 ]

Pictures of Span In R 3 Span{} Span{, } Span{u,, } Span{u,, } u u [interactie: span of to ectors in R 3 ] [interactie: span of three ectors in R 3 ]

Obseration about spans 0 Ho many ectors are in Span 0? 0 A. Zero B. One C. Infinity In general, it appears that Span{ 1, 2,..., p} is the smallest linear space (line, plane, etc.) containing the origin and all of the ectors 1, 2,..., p. We ill make this precise later.

Summary The hole lecture as about draing pictures of systems of linear equations. Points and ectors are to ays of draing elements of R n. Vectors are dran as arros. Vector addition, subtraction, and scalar multiplication hae geometric interpretations. A linear combination is a sum of scalar multiples of ectors. This is also a geometric construction, hich leads to lots of pretty pictures. The span of a set of ectors is the set of all linear combinations of those ectors. It is also fun to dra. A system of linear equations is equialent to a ector equation, here the unknons are the coefficients of a linear combination.