In this document, if A:
|
|
- Jessie Walsh
- 5 years ago
- Views:
Transcription
1 m I this docmet, if A: is a m matrix, ref(a) is a row-eqivalet matrix i row-echelo form sig Gassia elimiatio with partial pivotig as described i class.
2 Ier prodct ad orthogoality What is the largest possible magitde of 1,? By Cachy-Byakovsky-Schwarz ieqality, 1, 1. If 1 ad are orthogoal, fid. 1 By the properties of the -orm ad orthogoal vectors, , 1,,, 0,, 1 so. 1 1 Defie a agle betwee two vectors 1 ad. If, cos, the 1 1 cos, 1 1, so fid the iverse cosie of the give ratio. Two vectors 3 are colliear if 0 0 or 180 ad two vectors are orthogoal if 90 or 70. A collectio of vectors, 1, are ot mtally orthogoal ad ot ormalized. Apply the Gram-Schmidt algorithm. See the text book, bt i essece: 1. or i from 1 to do a. Set vi i ; b. Sbtract off the projectio of v i oto v ˆ j for each of the previos i 1 ormalized vectors: or j from 1 to i 1 do, v v vˆ, v v ˆ i i j i j c. Normalize the i th vector assmig that vi 0: i Set vˆ i v v i. If the vectors, 1, are liearly idepedet, this will prodce orthoormal vectors.
3 Liear idepedece Give a collectio of vectors v,..., 1 v i m, determie if they are liearly idepedet. Create the matrix V v1 v ad fid the row-eqivalet matrix ref(a) i row-echelo form. If the rak of V eqals, the vectors are liearly idepedet; otherwise, they are liearly depedet. Corollary If > m, the vectors mst be liearly depedet, for the maximm rak of V is m. The spa of a set of vectors v,..., 1 v V icldes all liear combiatios of these vectors, so all vectors of the form v v 1 1 where,, 1. Is this a sbspace of V? Yes. The sm of two liear combiatios of vectors mst still be a liear combiatio of these vectors, ad mltiplyig a liear combiatio of a set of vectors is still a liear combiatio of these vectors. Give a collectio of vectors v,..., 1 v i m, fid the dimesio of ad a basis for the spa. Create the matrix V v1 v ad fid the row-eqivalet matrix ref(a) i row-echelo form. The dimesio of the spa is the rak of A. A basis for the spa are those colms of A that correspod to colms i ref(a) that have leadig o-zero etries. Whe is a set of vectors a basis for their spa? A set of vectors forms a basis their spa if ad oly if the vectors are liearly idepedet. Give a set of liearly idepedet vectors,, 1, sppose we apply Gram-Schmidt. Is the spa of the orthoormal set idetical to the spa of the origial set? Yes.
4 Liear operators U V A A A, what properties mst A have for A to be described as liear? 1 1 for all vectors 1, U ad A A for all vectors U. That is, if a vector-space operatio is performed first i U after which A is applied is the same as if A is applied ad the vector-space operatio is the performed i V. U V is a liear mappig, which is the domai, the co-domai ad the rage of A? The domai of A is U ad the co-domai of A is V. The rage of A is the collectio of all images A of vectors U. U V is a liear mappig, is the rage a sbspace of V? If v1, v V that are i the rage of A, there mst exist 1, U sch that A1 v 1 ad A v. By the liear properties of A, A A A 1 1 v v, ad becase U is a vector space, 1 U, ths, A v v is also i the rage of A. Ths, the rage is a sbspace of V. U V is a liear mappig, what is the image of 0 U? As 0 U = 0 for ay vector i U, A0 A0 0 A 0, so A How do we fid the matrices associated with each of the row operatios? Apply the row operatio i qestio to the idetity matrix: U V 0 0. U V Row operatio Addig a mltiple of oe row oto aother Swap two rows Mltiplyig a row by a o-zero scalar Physical iterpretatio shear reflectio scalig Descriptio Represetatio Effect Iverse Addig times Row i oto Row j ;i j Swappig Rows i ad j Ri j Mltiplyig Row i by R rji, R ;i j r r i, i j, j r r i, j j, i 0 1 Ri j R ;i rii, 1 ;i R
5 Nll space ad rage of fiite-dimesioal liear mappigs m, fid the dimesio of ad a basis for the rage. Give A, fid the row-eqivalet matrix ref(a) i row-echelo form. The dimesio of the rage is the rak of A. A basis for the rage are those colms of A that correspod to colms i ref(a) that have leadig o-zero etries. m, fid the dimesio ad a basis for the ll space. Give A, fid the row-eqivalet matrix ref(a) i row-echelo form. The mber of free variables eqals the dimesio of the ll space, ad to fid a basis for the ll space, solve A 0, which is eqivalet to solvig ref m A 0, which ca be solved sig backward sbstittio. Give A: U V, if A v ad A 0 V 0, the A By the properties of liearity, v. 0 A A A A A v 0 v 0 v. m V V m Give A:, arge that the dimesio of the ll space pls the dimesio of the rage always eqals. Give A, fid the row-eqivalet matrix ref(a) that is i echelo form. Every colm i ref(a) that has a leadig o-zero etry adds oe dimesio to the rage, ad every colm i ref(a) that does ot have a leadig o-zero etry adds aother free variable, ad ths adds oe dimesio to the ll space.
6 Oe-to-oe ad oto Whe is a liear mappig oe-to-oe? Whe every vector i the rage has a iqe pre-image. Whe is a liear mappig oto? Whe every vector i the co-domai has at least oe pre-image. Whe is a liear mappig oe-to-oe ad oto? Whe every vector i the co-domai has a iqe pre-image. m, what are tests for either oe-to-oe oto oto? If ref(a) has o free variables, A is oe-to-oe. If there is oe or more free variables, A is ot oe-to-oe, it is mayto-oe. If rak(a) = m, the mappig is oto. If rak(a) < m, the image of U is a sbspace of V ot eqal to V. m, are there cases whe A is ot oe-to-oe or oto? If > m, A ca ever be oe-to-oe, bt it may be oto if rak(a) = m. If = m, A is either oe-to-oe ad oto, or either. It caot be oe bt ot the other. If < m, A ca ever be oto, bt it may be oe-to-oe if rak(a) =.
7 Matrices What are the diagoal etries of a m matrix? The diagoal etries of a matrix A are all etries a i,i where i = 1,, mi{m, }. Whe is a matrix pper triaglar? Whe is it lower triaglar? Whe is it diagoal? A matrix is pper triaglar is all etries below the diagoal are zero. A matrix is lower triaglar if all etries to the right of the diagoal are zero. A matrix is diagoal if all the etries off of the diagoal are zero. Diagoal matrices are the oly matrices that are simltaeosly both lower ad pper triaglar. is a permtatio matrix, describe its properties. A matrix is a permtatio matrix if ad oly if every row has exactly oe 1 ad each colm has exactly oe 1 ad all other etries are 0. is a permtatio matrix, what is the reslt of A for? If a i,j = 1, this moves the j th etry of to the i th etry. is a permtatio matrix, what is the iverse. The iverse of a permtatio matrix is its traspose.
8 vector m v. m ad yo have the PLU decompositio of A with A = PLU, how do yo solve A = v for a give target A = PLU, so we are solvig PLU = v. Mltiply both sides by the iverse (traspose) of P to get P T PLU = Id m LU = LU = P T v. Now, (LU) = L(U), so this is eqivalet to solvig L(U) = P T v. As is kow, so is U, so let s represet the kow U by y; that is, y = U. Ths, we have the system of liear eqatios represeted by Ly = P T v. The agmeted matrix of this system of liear eqatios is L T P v, ad as L is lower triaglar, we may se forward sbstittio to solve for y. Now that we have y, we ow are solvig the system of liear eqatios represeted by y = U, so the agmeted matrix of this system of liear eqatios is U y. As U is pper triaglar, we may se backward sbstittio to fid.
9 The determiat, the trace ad the iverse Give AB, :, arge that det(ba) = det(b) det(a). Give a regio R with a fiite ad o-zero volme vol(r), AR is the regio comprised of the image of each vector i R, ad by defiitio, vol(a(r)) = det(a) vol(r). Next, if B AR is the regio comprised of the images of each vector i AR, vol(b(a(r))) = det(b) vol(a(r)) = det(b) det(a) vol(r). Bt B AR BAR, ad therefore det(ba) = det(b) det(a). Give A: where A is either pper triaglar, lower triaglar or diagoal, fid the determiat of A. Mltiply the diagoal etries of A., fid the determiat of A. If = or 3, we may se the short-cts we leared i class. Otherwise, for > 3, give A, fid the PLUdecompositio of A. Record the mber P of row swaps that were reqired to prodce P ad mltiply the determiat of U by 1 P. Give A: tr A., fid the trace of A deoted The trace of A is the sm of the diagoal etries of A., approximate det Id A. or sfficietly small, det Id A 1 tr A.
10 id ad approximate the determiats of A ad B det A ; ad , so det A det B 1.13 ; ad B , so det B Show that Id Id 1. IdId Id, so Id Id 1. Show that if A is ivertible, the 1 1 A A AA Id By the properties of operator compositio ad iverses, A A A A A AA, ad therefore AA Id 1. BA A B. Show that if A ad B are ivertible, the A B BA A B B A A IdA A A Id Usig the properties of the iverse ad matrix compositio, ad therefore 1 BA A 1 B 1. 1 Show that if A are ivertible, the A 1 A A 1 A AA Id Id, ad therefore A A 1.,
11 Adjoits of liear mappigs Recall that the adjoit of a liear mappig A: U V is that mappig A : V U sch that A, v, A v for all U ad all v V. or A: R is the cojgate traspose. m R, the adjoit is the traspose, deoted T A. or A: C m C, the adjoit U V, show that A By the properties of the adjoit, A. A A A, v, v, v, ad therefore A A If A1, A : U V., show that A A A A. 1 1 By the properties of the adjoit ad compositio of liear mappigs,, A A v A A, v A A, v A, v A, v , A v, A v, A v A v, A A v Ths U A A A A. 1 1 V, show that A A. By the properties of the adjoit ad compositio of liear mappigs, A A A A A A A A, v, v, v, v, v, v, v. A. Ths
12 U V ad B : V W, show that BA AB. By the properties of the adjoit ad compositio of liear mappigs, Ths BA U BA BA BA A B A B A B, w, w, w, w, w, w. A B. 1 1 U ad A is ivertible, show that A A. By the properties of the adjoit ad compositio of liear mappigs,, Id, AA, A A, A, A, A A, bt as this is tre for all 1 ad, ths 1 A A Id 1, so A A 1. or A: U V, a vector v is orthogoal to all vectors i the rage of A if ad oly if v is i the ll space of A. v is orthogoal to all vectors i the rage of A A, v for all U, A v for all U v is i the ll space of A id the liear combiatio of vectors,..., m that best approximates a vector m 1 v. If U 1 is sch that rak U rak U based o whether ref U has zero or more tha zero free variables, respectively. v, there is either a iqe soltio or ifiitely may soltios Otherwise, if rak U rak U v, we mst fid the least-sqares soltio by solvig U U U v. There is either a iqe soltio or ifiitely may soltios based o whether ref UU has zero or more tha zero free variables, respectively.
13 Self adjoit ad skew adjoit liear operators A liear operator A: U U is self-adjoit if A we say that A is cojgate symmetric. A liear operator A: U U is skew-adjoit if A: C C, we say that A is cojgate skew-symmetric. Give a liear operator A: U U, show that By the properties of the adjoit ad operator additio, A. R R, we say that A is symmetric. C C, A A A. R A is self-adjoit. R, we say that A is skew-symmetric. If A A A A A A A A A A,,,,,,, ad therefore, A, A, A A, A A A A A A , so it is self-adjoit. Give a liear operator A: U U, show that By the properties of the adjoit ad operator additio, A A is skew-adjoit. A A A A A A A A A A,,,,,,, ad therefore A A A A Give a liear operator A: U, A, A, A A, A A , so it is skew-adjoit. U, show that By the properties of the adjoit ad operator additio, ad therefore AA AA is self-adjoit. AA AA A A,,, A, A, A A, A A, AA AA, so it is self-adjoit
14 Show that if A is self adjoit, the A is self adjoit if ad oly if is real. A A A A A A, v, v, v, v, v, v ad A A if ad oly if which is tre if ad oly if is real. Show that if A is skew adjoit, the A is skew adjoit if ad oly if is real. A A A A A A, v, v, v, v, v, v ad A A if ad oly if which is tre if ad oly if is real. U U, show that A is the sm of a self-adjoit ad a skew-adjoit liear mappig. Becase A A A A A A A A A A A A A, ad A A 1 ad A A is skew adjoit. is self adjoit
15 Isometric liear operators Recall that a liear operator A: U R C U is isometric if ad oly if A for all vectors U. R, the A is a matrix with colms that form a orthoormal set, ad the matrix is called orthogoal. C, the A is a matrix with colms that form a orthoormal set, ad the matrix is called itary. Show that every isometric liear operator is ivertible. V V is isometric, the Av v for all vectors, bt if A is ot ivertible, there exists a o-zero v sch that Av 0. If this was tre, Av 0 0 v, as v was assmed to be o-zero. Ths, the matrix is ivertible. Show that A: U U is isometric if ad oly if 1 A A. By the properties of isometric liear operators ad the adjoit, A is isometric A A A, A,, AA, A A A Id 1 A V U U is isometric, show that A is isometric if ad oly if 1. Becase A is isometric, A ad ths, bt by the properties of the orm, A A A A if ad oly if 1. Corollary If the field associated with U is the reals, A is isometric if ad oly if A is isometric. is isometric, show that the rows of A also form a orthoormal set., As AA A A Id, the secod says that the colms of A form a orthoormal set, bt the first says that the cojgates of the rows of A form a orthoormal set, ad if the cojgates of the rows of A form a orthormal set, the so do the rows themselves.
16 Arge that a permtatio matrix is isometric. A T A = Id if A is iterpreted as a real matrix, ad if A is iterpreted as a complex matrix, as all the etries are real, A A = Id, so i either case, the iverse is the adjoit, i which case, it is isometric (orthogoal for real matrices ad itary for complex matrices).
17 Eigevales ad eigevectors, fid the dimesio ad a basis for the eigespace correspodig to a give ad kow eigevale. Give A ad, fid the row-eqivalet matrix ref Id A. The mber of free variables eqals the dimesio of the eigespace, ad to fid a basis for the eigespace, solve Id A 0, which is eqivalet to solvig ref Id A 0, which ca be solved sig backward sbstittio. Give a matrix, fid the eigevales. If a matrix is A: eigevales. is pper triaglar, lower triaglar or diagoal, the diagoal etries of the matrix are the If A is oe of these, there is a algorithm beyod the scope of this corse, the QR algorithm, that will fid eigevales i a merically stable maer. or two ad three dimesios, det Id A is always a polyomial i with a leadig term, ad ths is of degree. Sch a polyomial mst have complex roots, ad these roots are the eigevales. Show that if A A has a eigevale, that eigevale is real. Sppose AA for a o-zero vector. I this case,,,, A A, A A A, A A, ad therefore A ad as both orms are real, so mst. Show that if A is isometric ad has a eigevale, 1. Sppose A for a o-zero vector. By the properties of a orm ad isometric liear operators, A, ad therefore 1.
18 A liear operator A: is ot ivertible (that is, it is siglar) if ad oly if 0 is a eigevale of A. A is ot ivertible if ad oly if it is ot oe-to-oe, if ad oly if the ll space is ot jst {0 }, if ad oly if there is a o-zero vector sch that A 0 0, Give if ad oly if 0 is a eigevale of A. 1 1 A, show that A has o real eigevectors. 1 1 If A, Therefore, The agmeted matrix correspodig to this system of liear eqatios is ~ ~ Becase 1, it is always tre that the oly soltio to this is. Ths, the oly vector that 0 is a scalar mltiple of itself der mltiplicatio by A is the zero vector, ad ths A has o eigevales ad o eigevectors. Give 3 A, show that A has oly oe eigevector correspodig to the eigevale As 3 Id A 0, there is oe free variable v 1, so the dimesio of the eigespace is 1, ad a basis for this eigespace is fod by solvig this, amely, = 0 so eigevector correspodig to the eigevale , so 1 0 v is the sigle
19 A liear operator A: ca der certai circmstaces be writte as composed of the eigevectors of A. Describe how A VDV 1 operates? A VDV 1 where V is a matrix If the matrix A has liearly idepedet eigevectors, those eigevectors form a basis of. Coseqetly, we may write ay vector = Va. To fid A, we may either solve this system of liear eqatios, or we ca fid the iverse of V to get V 1 = a. The etry a k is the coefficiet of the k th eigevector v k. Mltiplyig Da mltiplies the k th etry by k, so the k th etry of DV 1 is a k k. Mltiplyig this vector by the matrix V calclates the liear combiatio of eigevectors k 1 a v, which is the reslt of mltiplyig A. k k k Uder which circmstaces ca we write A VDV 1 as A VDV? A symmetric matrix A: R R has real eigevales ad orthogoal eigevectors. We ca therefore ormalize these eigevectors ad prodce a orthogoal matrix V, so orthogoally diagoalizable, as V is a orthogoal matrix. A ormal matrix A: C A VDV T. We say that a symmetric matrix is C has complex eigevales ad orthogoal eigevectors. We ca therefore ormalize these eigevectors ad prodce a itary matrix V, so A VDV. We say that a ormal matrix is itarily diagoalizable, as V is a itary matrix. If we ca write A VDV, how ca we easily calclate 1000 A? By the properties of isometric liear operators (sqare matrices) ad operator compositio (matrix-matrix mltiplicatio), we have A As D is a diagoal matrix with etries 1000 VDV VDV VDV VDV VDV VDV times V D V V D V V DV V DIdDIdDV V DDD VD 999 times V times performed o a compter with a sigle fctio call. 999 times VDId DV D DV VD V V DV k, D 1000 is a diagoal matrix with etries 1000 k, a operatio that ca be
20 R calclate R is ot symmetric bt still diagoalizable, why may we have isses whe sig a similar techiqe to A VD V? If we are calclatig the iverse, withot more iformatio, this operatio may be merically stable.
too many conditions to check!!
Vector Spaces Aioms of a Vector Space closre Defiitio : Let V be a o empty set of vectors with operatios : i. Vector additio :, v є V + v є V ii. Scalar mltiplicatio: li є V k є V where k is scalar. The,
More informationSymmetric Matrices and Quadratic Forms
7 Symmetric Matrices ad Quadratic Forms 7.1 DIAGONALIZAION OF SYMMERIC MARICES SYMMERIC MARIX A symmetric matrix is a matrix A such that. A = A Such a matrix is ecessarily square. Its mai diagoal etries
More informationa for a 1 1 matrix. a b a b 2 2 matrix: We define det ad bc 3 3 matrix: We define a a a a a a a a a a a a a a a a a a
Math E-2b Lecture #8 Notes This week is all about determiats. We ll discuss how to defie them, how to calculate them, lear the allimportat property kow as multiliearity, ad show that a square matrix A
More informationMatrix Algebra from a Statistician s Perspective BIOS 524/ Scalar multiple: ka
Matrix Algebra from a Statisticia s Perspective BIOS 524/546. Matrices... Basic Termiology a a A = ( aij ) deotes a m matrix of values. Whe =, this is a am a m colum vector. Whe m= this is a row vector..2.
More informationInverse Matrix. A meaning that matrix B is an inverse of matrix A.
Iverse Matrix Two square matrices A ad B of dimesios are called iverses to oe aother if the followig holds, AB BA I (11) The otio is dual but we ofte write 1 B A meaig that matrix B is a iverse of matrix
More informationa for a 1 1 matrix. a b a b 2 2 matrix: We define det ad bc 3 3 matrix: We define a a a a a a a a a a a a a a a a a a
Math S-b Lecture # Notes This wee is all about determiats We ll discuss how to defie them, how to calculate them, lear the allimportat property ow as multiliearity, ad show that a square matrix A is ivertible
More informationElementary Linear Algebra
Elemetary Liear Algebra Ato & Rorres th Editio Lectre Set Chapter : Eclidea Vector Spaces Chapter Cotet Vectors i -Space -Space ad -Space Norm Distace i R ad Dot Prodct Orthogoality Geometry of Liear Systems
More information(3) If you replace row i of A by its sum with a multiple of another row, then the determinant is unchanged! Expand across the i th row:
Math 5-4 Tue Feb 4 Cotiue with sectio 36 Determiats The effective way to compute determiats for larger-sized matrices without lots of zeroes is to ot use the defiitio, but rather to use the followig facts,
More informationEigenvalues and Eigenvectors
5 Eigevalues ad Eigevectors 5.3 DIAGONALIZATION DIAGONALIZATION Example 1: Let. Fid a formula for A k, give that P 1 1 = 1 2 ad, where Solutio: The stadard formula for the iverse of a 2 2 matrix yields
More informationApply change-of-basis formula to rewrite x as a linear combination of eigenvectors v j.
Eigevalue-Eigevector Istructor: Nam Su Wag eigemcd Ay vector i real Euclidea space of dimesio ca be uiquely epressed as a liear combiatio of liearly idepedet vectors (ie, basis) g j, j,,, α g α g α g α
More information(3) If you replace row i of A by its sum with a multiple of another row, then the determinant is unchanged! Expand across the i th row:
Math 50-004 Tue Feb 4 Cotiue with sectio 36 Determiats The effective way to compute determiats for larger-sized matrices without lots of zeroes is to ot use the defiitio, but rather to use the followig
More information1 Last time: similar and diagonalizable matrices
Last time: similar ad diagoalizable matrices Let be a positive iteger Suppose A is a matrix, v R, ad λ R Recall that v a eigevector for A with eigevalue λ if v ad Av λv, or equivaletly if v is a ozero
More informationMAT2400 Assignment 2 - Solutions
MAT24 Assigmet 2 - Soltios Notatio: For ay fctio f of oe real variable, f(a + ) deotes the limit of f() whe teds to a from above (if it eists); i.e., f(a + ) = lim t a + f(t). Similarly, f(a ) deotes the
More informationMatrix Algebra 2.2 THE INVERSE OF A MATRIX Pearson Education, Inc.
2 Matrix Algebra 2.2 THE INVERSE OF A MATRIX MATRIX OPERATIONS A matrix A is said to be ivertible if there is a matrix C such that CA = I ad AC = I where, the idetity matrix. I = I I this case, C is a
More information, then cv V. Differential Equations Elements of Lineaer Algebra Name: Consider the differential equation. and y2 cos( kx)
Cosider the differetial equatio y '' k y 0 has particular solutios y1 si( kx) ad y cos( kx) I geeral, ay liear combiatio of y1 ad y, cy 1 1 cy where c1, c is also a solutio to the equatio above The reaso
More informationLECTURE 8: ORTHOGONALITY (CHAPTER 5 IN THE BOOK)
LECTURE 8: ORTHOGONALITY (CHAPTER 5 IN THE BOOK) Everythig marked by is ot required by the course syllabus I this lecture, all vector spaces is over the real umber R. All vectors i R is viewed as a colum
More informationCHAPTER 5. Theory and Solution Using Matrix Techniques
A SERIES OF CLASS NOTES FOR 2005-2006 TO INTRODUCE LINEAR AND NONLINEAR PROBLEMS TO ENGINEERS, SCIENTISTS, AND APPLIED MATHEMATICIANS DE CLASS NOTES 3 A COLLECTION OF HANDOUTS ON SYSTEMS OF ORDINARY DIFFERENTIAL
More informationExample 1.1 Use an augmented matrix to mimic the elimination method for solving the following linear system of equations.
MTH 261 Mr Simods class Example 11 Use a augmeted matrix to mimic the elimiatio method for solvig the followig liear system of equatios 2x1 3x2 8 6x1 x2 36 Example 12 Use the method of Gaussia elimiatio
More informationReal Numbers R ) - LUB(B) may or may not belong to B. (Ex; B= { y: y = 1 x, - Note that A B LUB( A) LUB( B)
Real Numbers The least upper boud - Let B be ay subset of R B is bouded above if there is a k R such that x k for all x B - A real umber, k R is a uique least upper boud of B, ie k = LUB(B), if () k is
More informationMATH10212 Linear Algebra B Proof Problems
MATH22 Liear Algebra Proof Problems 5 Jue 26 Each problem requests a proof of a simple statemet Problems placed lower i the list may use the results of previous oes Matrices ermiats If a b R the matrix
More informationPART 2: DETERMINANTS, GENERAL VECTOR SPACES, AND MATRIX REPRESENTATIONS OF LINEAR TRANSFORMATIONS
PART 2: DETERMINANTS, GENERAL VECTOR SPACES, AND MATRIX REPRESENTATIONS OF LINEAR TRANSFORMATIONS 3.1: THE DETERMINANT OF A MATRIX Learig Objectives 1. Fid the determiat of a 2 x 2 matrix 2. Fid the miors
More informationLinear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d
Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y
More informationLecture 8: October 20, Applications of SVD: least squares approximation
Mathematical Toolkit Autum 2016 Lecturer: Madhur Tulsiai Lecture 8: October 20, 2016 1 Applicatios of SVD: least squares approximatio We discuss aother applicatio of sigular value decompositio (SVD) of
More informationdenote the set of all polynomials of the form p=ax 2 +bx+c. For example, . Given any two polynomials p= ax 2 +bx+c and q= a'x 2 +b'x+c',
Chapter Geeral Vector Spaces Real Vector Spaces Example () Let u ad v be vectors i R ad k a scalar ( a real umber), the we ca defie additio: u+v, scalar multiplicatio: ku, kv () Let P deote the set of
More informationCOLLIN COUNTY COMMUNITY COLLEGE COURSE SYLLABUS CREDIT HOURS: 3 LECTURE HOURS: 3 LAB HOURS: 0
COLLIN COUNTY COMMUNITY COLLEGE COURSE SYLLABUS Revised Fall 2017 COURSE NUMBER: MATH 2318 COURSE TITLE: Liear Algebra CREDIT HOURS: 3 LECTURE HOURS: 3 LAB HOURS: 0 ASSESSMENTS: Noe PREREQUISITE: MATH
More informationThe Jordan Normal Form: A General Approach to Solving Homogeneous Linear Systems. Mike Raugh. March 20, 2005
The Jorda Normal Form: A Geeral Approach to Solvig Homogeeous Liear Sstems Mike Raugh March 2, 25 What are we doig here? I this ote, we describe the Jorda ormal form of a matrix ad show how it ma be used
More informationB = B is a 3 4 matrix; b 32 = 3 and b 2 4 = 3. Scalar Multiplication
MATH 37 Matrices Dr. Neal, WKU A m matrix A = (a i j ) is a array of m umbers arraged ito m rows ad colums, where a i j is the etry i the ith row, jth colum. The values m are called the dimesios (or size)
More information(VII.A) Review of Orthogonality
VII.A Review of Orthogoality At the begiig of our study of liear trasformatios i we briefly discussed projectios, rotatios ad projectios. I III.A, projectios were treated i the abstract ad without regard
More informationM 340L CS Homew ork Set 6 Solutions
1. Suppose P is ivertible ad M 34L CS Homew ork Set 6 Solutios A PBP 1. Solve for B i terms of P ad A. Sice A PBP 1, w e have 1 1 1 B P PBP P P AP ( ).. Suppose ( B C) D, w here B ad C are m matrices ad
More informationM 340L CS Homew ork Set 6 Solutions
. Suppose P is ivertible ad M 4L CS Homew ork Set 6 Solutios A PBP. Solve for B i terms of P ad A. Sice A PBP, w e have B P PBP P P AP ( ).. Suppose ( B C) D, w here B ad C are m matrices ad D is ivertible.
More informationAH Checklist (Unit 3) AH Checklist (Unit 3) Matrices
AH Checklist (Uit 3) AH Checklist (Uit 3) Matrices Skill Achieved? Kow that a matrix is a rectagular array of umbers (aka etries or elemets) i paretheses, each etry beig i a particular row ad colum Kow
More informationStochastic Matrices in a Finite Field
Stochastic Matrices i a Fiite Field Abstract: I this project we will explore the properties of stochastic matrices i both the real ad the fiite fields. We first explore what properties 2 2 stochastic matrices
More informationLINEAR ALGEBRA. Paul Dawkins
LINEAR ALGEBRA Paul Dawkis Table of Cotets Preface... ii Outlie... iii Systems of Equatios ad Matrices... Itroductio... Systems of Equatios... Solvig Systems of Equatios... 5 Matrices... 7 Matrix Arithmetic
More informationFor a 3 3 diagonal matrix we find. Thus e 1 is a eigenvector corresponding to eigenvalue λ = a 11. Thus matrix A has eigenvalues 2 and 3.
Closed Leotief Model Chapter 6 Eigevalues I a closed Leotief iput-output-model cosumptio ad productio coicide, i.e. V x = x = x Is this possible for the give techology matrix V? This is a special case
More information) is a square matrix with the property that for any m n matrix A, the product AI equals A. The identity matrix has a ii
square atrix is oe that has the sae uber of rows as colus; that is, a atrix. he idetity atrix (deoted by I, I, or [] I ) is a square atrix with the property that for ay atrix, the product I equals. he
More information( ) ( ) ( ) notation: [ ]
Liear Algebra Vectors ad Matrices Fudametal Operatios with Vectors Vector: a directed lie segmets that has both magitude ad directio =,,,..., =,,,..., = where 1, 2,, are the otatio: [ ] 1 2 3 1 2 3 compoets
More informationA brief introduction to linear algebra
CHAPTER 6 A brief itroductio to liear algebra 1. Vector spaces ad liear maps I what follows, fix K 2{Q, R, C}. More geerally, K ca be ay field. 1.1. Vector spaces. Motivated by our ituitio of addig ad
More information5.1 Review of Singular Value Decomposition (SVD)
MGMT 69000: Topics i High-dimesioal Data Aalysis Falll 06 Lecture 5: Spectral Clusterig: Overview (cotd) ad Aalysis Lecturer: Jiamig Xu Scribe: Adarsh Barik, Taotao He, September 3, 06 Outlie Review of
More informationLinearly Independent Sets, Bases. Review. Remarks. A set of vectors,,, in a vector space is said to be linearly independent if the vector equation
Liearly Idepedet Sets Bases p p c c p Review { v v vp} A set of vectors i a vector space is said to be liearly idepedet if the vector equatio cv + c v + + c has oly the trivial solutio = = { v v vp} The
More informationAfter the completion of this section the student should recall
Chapter III Liear Algebra September 6, 7 6 CHAPTER III LINEAR ALGEBRA Objectives: After the completio of this sectio the studet should recall - the cocept of vector spaces - the operatios with vectors
More informationLinear Transformations
Liear rasformatios 6. Itroductio to Liear rasformatios 6. he Kerel ad Rage of a Liear rasformatio 6. Matrices for Liear rasformatios 6.4 rasitio Matrices ad Similarity 6.5 Applicatios of Liear rasformatios
More informationGeometry of LS. LECTURE 3 GEOMETRY OF LS, PROPERTIES OF σ 2, PARTITIONED REGRESSION, GOODNESS OF FIT
OCTOBER 7, 2016 LECTURE 3 GEOMETRY OF LS, PROPERTIES OF σ 2, PARTITIONED REGRESSION, GOODNESS OF FIT Geometry of LS We ca thik of y ad the colums of X as members of the -dimesioal Euclidea space R Oe ca
More informationLINEARIZATION OF NONLINEAR EQUATIONS By Dominick Andrisani. dg x. ( ) ( ) dx
LINEAIZATION OF NONLINEA EQUATIONS By Domiick Adrisai A. Liearizatio of Noliear Fctios A. Scalar fctios of oe variable. We are ive the oliear fctio (). We assme that () ca be represeted si a Taylor series
More informationTHE CONSERVATIVE DIFFERENCE SCHEME FOR THE GENERALIZED ROSENAU-KDV EQUATION
Zho, J., et al.: The Coservative Differece Scheme for the Geeralized THERMAL SCIENCE, Year 6, Vol., Sppl. 3, pp. S93-S9 S93 THE CONSERVATIVE DIFFERENCE SCHEME FOR THE GENERALIZED ROSENAU-KDV EQUATION by
More informationSingular value decomposition. Mathématiques appliquées (MATH0504-1) B. Dewals, Ch. Geuzaine
Lecture 11 Sigular value decompositio Mathématiques appliquées (MATH0504-1) B. Dewals, Ch. Geuzaie V1.2 07/12/2018 1 Sigular value decompositio (SVD) at a glace Motivatio: the image of the uit sphere S
More informationDiagonalization of Quadratic Forms. Recall in days past when you were given an equation which looked like
Diagoalizatio of Qadratic Forms Recall i das past whe o were gie a eqatio which looked like ad o were asked to sketch the set of poits which satisf this eqatio. It was ecessar to complete the sqare so
More informationPartial Differential Equations
EE 84 Matematical Metods i Egieerig Partial Differetial Eqatios Followig are some classical partial differetial eqatios were is assmed to be a fctio of two or more variables t (time) ad y (spatial coordiates).
More informationReview Problems 1. ICME and MS&E Refresher Course September 19, 2011 B = C = AB = A = A 2 = A 3... C 2 = C 3 = =
Review Problems ICME ad MS&E Refresher Course September 9, 0 Warm-up problems. For the followig matrices A = 0 B = C = AB = 0 fid all powers A,A 3,(which is A times A),... ad B,B 3,... ad C,C 3,... Solutio:
More informationHWA CHONG INSTITUTION JC1 PROMOTIONAL EXAMINATION Wednesday 1 October hours. List of Formula (MF15)
HWA CHONG INSTITUTION JC PROMOTIONAL EXAMINATION 4 MATHEMATICS Higher 974/ Paper Wedesda October 4 hors Additioal materials: Aswer paper List of Formla (MF5) READ THESE INSTRUCTIONS FIRST Write or ame
More informationTheorem: Let A n n. In this case that A does reduce to I, we search for A 1 as the solution matrix X to the matrix equation A X = I i.e.
Theorem: Let A be a square matrix The A has a iverse matrix if ad oly if its reduced row echelo form is the idetity I this case the algorithm illustrated o the previous page will always yield the iverse
More informationTHE KATONA THEOREM FOR VECTOR SPACES
THE KATONA THEOREM FOR ECTOR SPACES PETER FRANKL AND NORIHIDE TOKUSHIGE Dedicated to Gyla O H Katoa o his 70th birthday Abstract e preset a vector space versio of Katoa s t-itersectio theorem 12 Let be
More informationWhy learn matrix algebra? Vectors & Matrices with statistical applications. Brief history of linear algebra
R Vectors & Matrices with statistical applicatios x RXX RXY y RYX RYY Why lear matrix algebra? Simple way to express liear combiatios of variables ad geeral solutios of equatios. Liear statistical models
More informationChapter Unary Matrix Operations
Chapter 04.04 Uary atrix Operatios After readig this chapter, you should be able to:. kow what uary operatios meas, 2. fid the traspose of a square matrix ad it s relatioship to symmetric matrices,. fid
More informationIntroduction to Optimization Techniques
Itroductio to Optimizatio Techiques Basic Cocepts of Aalysis - Real Aalysis, Fuctioal Aalysis 1 Basic Cocepts of Aalysis Liear Vector Spaces Defiitio: A vector space X is a set of elemets called vectors
More informationChapter 3 Inner Product Spaces. Hilbert Spaces
Chapter 3 Ier Product Spaces. Hilbert Spaces 3. Ier Product Spaces. Hilbert Spaces 3.- Defiitio. A ier product space is a vector space X with a ier product defied o X. A Hilbert space is a complete ier
More informationIntroduction. Question: Why do we need new forms of parametric curves? Answer: Those parametric curves discussed are not very geometric.
Itrodctio Qestio: Why do we eed ew forms of parametric crves? Aswer: Those parametric crves discssed are ot very geometric. Itrodctio Give sch a parametric form, it is difficlt to kow the derlyig geometry
More informationPAPER : IIT-JAM 2010
MATHEMATICS-MA (CODE A) Q.-Q.5: Oly oe optio is correct for each questio. Each questio carries (+6) marks for correct aswer ad ( ) marks for icorrect aswer.. Which of the followig coditios does NOT esure
More informationMatrices and vectors
Oe Matrices ad vectors This book takes for grated that readers have some previous kowledge of the calculus of real fuctios of oe real variable It would be helpful to also have some kowledge of liear algebra
More informationNumerical Methods for Finding Multiple Solutions of a Superlinear Problem
ISSN 1746-7659, Eglad, UK Joral of Iformatio ad Comptig Sciece Vol 2, No 1, 27, pp 27- Nmerical Methods for Fidig Mltiple Soltios of a Sperliear Problem G A Afrozi +, S Mahdavi, Z Naghizadeh Departmet
More informationR is a scalar defined as follows:
Math 8. Notes o Dot Product, Cross Product, Plaes, Area, ad Volumes This lecture focuses primarily o the dot product ad its may applicatios, especially i the measuremet of agles ad scalar projectio ad
More informationDefinition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.
4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad
More informationU8L1: Sec Equations of Lines in R 2
MCVU U8L: Sec. 8.9. Equatios of Lies i R Review of Equatios of a Straight Lie (-D) Cosider the lie passig through A (-,) with slope, as show i the diagram below. I poit slope form, the equatio of the lie
More informationCHAPTER I: Vector Spaces
CHAPTER I: Vector Spaces Sectio 1: Itroductio ad Examples This first chapter is largely a review of topics you probably saw i your liear algebra course. So why cover it? (1) Not everyoe remembers everythig
More information24 MATH 101B: ALGEBRA II, PART D: REPRESENTATIONS OF GROUPS
24 MATH 101B: ALGEBRA II, PART D: REPRESENTATIONS OF GROUPS Corollary 2.30. Suppose that the semisimple decompositio of the G- module V is V = i S i. The i = χ V,χ i Proof. Sice χ V W = χ V + χ W, we have:
More informationChapter Vectors
Chapter 4. Vectors fter readig this chapter you should be able to:. defie a vector. add ad subtract vectors. fid liear combiatios of vectors ad their relatioship to a set of equatios 4. explai what it
More informationMATH : Matrices & Linear Algebra Spring Final Review
MATH 3330-00: Matrices & Liear Algebra Sprig 009 Fial Review Hua Sha Gauss-Jorda Eliiatio [.] Reduced row-echelo for (rref Rak [.3] rak(a = uber of leadig s i rref(a di(i A = rak( A Liear Trasforatio i
More informationCHAPTER 3. GOE and GUE
CHAPTER 3 GOE ad GUE We quicly recall that a GUE matrix ca be defied i the followig three equivalet ways. We leave it to the reader to mae the three aalogous statemets for GOE. I the previous chapters,
More informationChimica Inorganica 3
himica Iorgaica Irreducible Represetatios ad haracter Tables Rather tha usig geometrical operatios, it is ofte much more coveiet to employ a ew set of group elemets which are matrices ad to make the rule
More informationSeveral variables and partial derivatives
Chapter 8 Several variables ad partial derivatives 8.1 Vector spaces, liear mappigs, ad covexity Note:??? lectures 8.1.1 Vector spaces The euclidea space R has already made a appearace i the metric space
More informationAbstract Vector Spaces. Abstract Vector Spaces
Astract Vector Spaces The process of astractio is critical i egieerig! Physical Device Data Storage Vector Space MRI machie Optical receiver 0 0 1 0 1 0 0 1 Icreasig astractio 6.1 Astract Vector Spaces
More informationMon Feb matrix inverses. Announcements: Warm-up Exercise:
Math 225-4 Week 6 otes We will ot ecessarily fiish the material from a give day's otes o that day We may also add or subtract some material as the week progresses, but these otes represet a i-depth outlie
More informationThe z Transform. The Discrete LTI System Response to a Complex Exponential
The Trasform The trasform geeralies the Discrete-time Forier Trasform for the etire complex plae. For the complex variable is sed the otatio: jω x+ j y r e ; x, y Ω arg r x + y {} The Discrete LTI System
More information(I.C) Matrix algebra
(IC) Matrix algebra Before formalizig Gauss-Jorda i terms of a fixed procedure for row-reducig A, we briefly review some properties of matrix multiplicatio Let m{ [A ij ], { [B jk ] p, p{ [C kl ] q be
More informationHILBERT-SCHMIDT AND TRACE CLASS OPERATORS. 1. Introduction
HILBERT-SCHMIDT AND TRACE CLASS OPERATORS MICHAEL WALTER Let H 0 be a Hilbert space. We deote by BpHq ad KpHq the algebra of bouded respective compact operators o H ad by B fi phq the subspace of operator
More information4. Determinants. det : { square matrices } F less important in mordern & practical applications but in theory
4 Determiats det : { square matrices } F less importat i morder & practical applicatios but i theory ew formula for solvig LES ew formula for iverse of a matrix test if a matrix is regular calculate area
More informationBasic Iterative Methods. Basic Iterative Methods
Abel s heorem: he roots of a polyomial with degree greater tha or equal to 5 ad arbitrary coefficiets caot be foud with a fiite umber of operatios usig additio, subtractio, multiplicatio, divisio, ad extractio
More informationREVISION SHEET FP1 (MEI) ALGEBRA. Identities In mathematics, an identity is a statement which is true for all values of the variables it contains.
The mai ideas are: Idetities REVISION SHEET FP (MEI) ALGEBRA Before the exam you should kow: If a expressio is a idetity the it is true for all values of the variable it cotais The relatioships betwee
More informationand the sum of its first n terms be denoted by. Convergence: An infinite series is said to be convergent if, a definite unique number., finite.
INFINITE SERIES Seqece: If a set of real mbers a seqece deoted by * + * Or * + * occr accordig to some defiite rle, the it is called + if is fiite + if is ifiite Series: is called a series ad is deoted
More informationMachine Learning for Data Science (CS 4786)
Machie Learig for Data Sciece CS 4786) Lecture & 3: Pricipal Compoet Aalysis The text i black outlies high level ideas. The text i blue provides simple mathematical details to derive or get to the algorithm
More information6. Cox Regression Models. (Part I)
6. Cox Regressio Models (Part I) The Proportioal Hazards Model A proportioal hazards model proposed by D.R. Cox (197) assmes that λ t z = λ 0 t e β 1z 1 + +β p z p = λ 0 t e zt β where z is a p 1 vector
More informationRandom Matrices with Blocks of Intermediate Scale Strongly Correlated Band Matrices
Radom Matrices with Blocks of Itermediate Scale Strogly Correlated Bad Matrices Jiayi Tog Advisor: Dr. Todd Kemp May 30, 07 Departmet of Mathematics Uiversity of Califoria, Sa Diego Cotets Itroductio Notatio
More informationMatrix Theory, Math6304 Lecture Notes from October 25, 2012 taken by Manisha Bhardwaj
Matrix Theory, Math6304 Lecture Notes from October 25, 2012 take by Maisha Bhardwaj Last Time (10/23/12) Example for low-rak perturbatio, re-examied Relatig eigevalues of matrices ad pricipal submatrices
More informationM A T H F A L L CORRECTION. Algebra I 1 4 / 1 0 / U N I V E R S I T Y O F T O R O N T O
M A T H 2 4 0 F A L L 2 0 1 4 HOMEWORK ASSIGNMENT #4 CORRECTION Algebra I 1 4 / 1 0 / 2 0 1 4 U N I V E R S I T Y O F T O R O N T O P r o f e s s o r : D r o r B a r - N a t a Correctio Homework Assigmet
More informationPhysics 324, Fall Dirac Notation. These notes were produced by David Kaplan for Phys. 324 in Autumn 2001.
Physics 324, Fall 2002 Dirac Notatio These otes were produced by David Kapla for Phys. 324 i Autum 2001. 1 Vectors 1.1 Ier product Recall from liear algebra: we ca represet a vector V as a colum vector;
More informationMatrix Algebra 2.3 CHARACTERIZATIONS OF INVERTIBLE MATRICES Pearson Education, Inc.
2 Matrix Algebra 2.3 CHARACTERIZATIONS OF INVERTIBLE MATRICES 2012 Pearso Educatio, Ic. Theorem 8: Let A be a square matrix. The the followig statemets are equivalet. That is, for a give A, the statemets
More informationMachine Learning Theory Tübingen University, WS 2016/2017 Lecture 11
Machie Learig Theory Tübige Uiversity, WS 06/07 Lecture Tolstikhi Ilya Abstract We will itroduce the otio of reproducig kerels ad associated Reproducig Kerel Hilbert Spaces (RKHS). We will cosider couple
More informationFluids Lecture 17 Notes
Flids Lectre 7 Notes. Obliqe Waves Readig: Aderso 9., 9. Obliqe Waves ach waves Small distrbaces created by a sleder body i a sersoic flow will roagate diagoally away as ach waves. These cosist of small
More informationOrthogonal transformations
Orthogoal trasformatios October 12, 2014 1 Defiig property The squared legth of a vector is give by takig the dot product of a vector with itself, v 2 v v g ij v i v j A orthogoal trasformatio is a liear
More informationDeterminants of order 2 and 3 were defined in Chapter 2 by the formulae (5.1)
5. Determiats 5.. Itroductio 5.2. Motivatio for the Choice of Axioms for a Determiat Fuctios 5.3. A Set of Axioms for a Determiat Fuctio 5.4. The Determiat of a Diagoal Matrix 5.5. The Determiat of a Upper
More informationAlgebra of Least Squares
October 19, 2018 Algebra of Least Squares Geometry of Least Squares Recall that out data is like a table [Y X] where Y collects observatios o the depedet variable Y ad X collects observatios o the k-dimesioal
More informationMath Solutions to homework 6
Math 175 - Solutios to homework 6 Cédric De Groote November 16, 2017 Problem 1 (8.11 i the book): Let K be a compact Hermitia operator o a Hilbert space H ad let the kerel of K be {0}. Show that there
More informationREVISION SHEET FP1 (MEI) ALGEBRA. Identities In mathematics, an identity is a statement which is true for all values of the variables it contains.
the Further Mathematics etwork wwwfmetworkorguk V 07 The mai ideas are: Idetities REVISION SHEET FP (MEI) ALGEBRA Before the exam you should kow: If a expressio is a idetity the it is true for all values
More informationNBHM QUESTION 2007 Section 1 : Algebra Q1. Let G be a group of order n. Which of the following conditions imply that G is abelian?
NBHM QUESTION 7 NBHM QUESTION 7 NBHM QUESTION 7 Sectio : Algebra Q Let G be a group of order Which of the followig coditios imply that G is abelia? 5 36 Q Which of the followig subgroups are ecesarily
More informationTEACHER CERTIFICATION STUDY GUIDE
COMPETENCY 1. ALGEBRA SKILL 1.1 1.1a. ALGEBRAIC STRUCTURES Kow why the real ad complex umbers are each a field, ad that particular rigs are ot fields (e.g., itegers, polyomial rigs, matrix rigs) Algebra
More informationA widely used display of protein shapes is based on the coordinates of the alpha carbons - - C α
Nice plottig of proteis: I A widely used display of protei shapes is based o the coordiates of the alpha carbos - - C α -s. The coordiates of the C α -s are coected by a cotiuous curve that roughly follows
More informationThe Discrete Fourier Transform
The Discrete Fourier Trasform Complex Fourier Series Represetatio Recall that a Fourier series has the form a 0 + a k cos(kt) + k=1 b k si(kt) This represetatio seems a bit awkward, sice it ivolves two
More informationSignal Processing in Mechatronics
Sigal Processig i Mechatroics Zhu K.P. AIS, UM. Lecture, Brief itroductio to Sigals ad Systems, Review of Liear Algebra ad Sigal Processig Related Mathematics . Brief Itroductio to Sigals What is sigal
More informationU8L1: Sec Equations of Lines in R 2
MCVU Thursda Ma, Review of Equatios of a Straight Lie (-D) U8L Sec. 8.9. Equatios of Lies i R Cosider the lie passig through A (-,) with slope, as show i the diagram below. I poit slope form, the equatio
More information8. Applications To Linear Differential Equations
8. Applicatios To Liear Differetial Equatios 8.. Itroductio 8.. Review Of Results Cocerig Liear Differetial Equatios Of First Ad Secod Orders 8.3. Eercises 8.4. Liear Differetial Equatios Of Order N 8.5.
More information5.1. The Rayleigh s quotient. Definition 49. Let A = A be a self-adjoint matrix. quotient is the function. R(x) = x,ax, for x = 0.
40 RODICA D. COSTIN 5. The Rayleigh s priciple ad the i priciple for the eigevalues of a self-adjoit matrix Eigevalues of self-adjoit matrices are easy to calculate. This sectio shows how this is doe usig
More information