Machine Learning for Signal Processing Fundamentals of Linear Algebra
|
|
- Austen Stevenson
- 5 years ago
- Views:
Transcription
1 Mchine Lerning for Signl Processing Fundmentls of Liner Alger Clss 6 Sep 6 Instructor: Bhiksh Rj -755/8-797
2 Overview Vectors nd mtrices Bsic vector/mtrix opertions Vrious mtrix types Projections -755/8-797
3 Book Fundmentls of Liner Alger, Gilert Strng Importnt to e very comfortle with liner lger Appers repetedly in the form of Eigen nlysis, SVD, Fctor nlysis Appers through vrious properties of mtrices tht re used in mchine lerning Often used in the processing of dt of vrious kinds Will use sound nd imges s exmples Tody s lecture: Definitions Very smll suset of ll tht s used Importnt suset, intended to help you recollect -755/
4 Incentive to use liner lger Simplified nottion! x T Ay Esier intuition Relly convenient geometric interprettions Esy code trnsltion! j y j i x i ij for i=:n for j=:m c(i)=c(i)+y(j)*x(i)*(i,j) end end C=x*A*y -755/
5 And other things you cn do From Bch s Fugue in Gm Frequency Rottion + Projection + Scling + Perspective Time Decomposition (NMF) Mnipulte Dt Extrct informtion from dt Represent dt Etc -755/
6 Sclrs, vectors, mtrices, A sclr is numer =, = 34, = -, etc A vector is liner rrngement of collection of sclrs 3, 34 3 A mtrix A is rectngulr rrngement of collection of sclrs A /
7 Vectors in the strct Ordered collection of numers Exmples: [3 4 5], [ c d], [3 4 5]!= [4 3 5] Order is importnt Typiclly viewed s identifying (the pth from origin to) loction in n N-dimensionl spce (3,4,5) 5 (4,3,5) z 3 y 4 x -755/
8 Vectors usully hold sets of numericl ttriutes Vectors in relity X, Y, Z coordintes [,, ] [height(cm) weight(kg)] [75 7] A loction in Mnhttn [3v 33st] A series of dily tempertures Smples in n udio signl Etc [-5v 6st] [v 4st] [v 8st] -755/
9 Vector norm Mesure of how long vector is: Represented s x Length = sqrt( ) (3,4,5) 5 Geometriclly the shortest distnce to trvel from the origin to the destintion As the crow flies Assuming Eucliden Geometry 3 [-v 7st] [-6v st] -755/
10 Vector Opertions: Multipliction y sclr (75,, 5) (3,4,5) Multipliction y sclr stretches the vector Vector multipliction y sclr: ech component multiplied y sclr 5 x (3,4,5) = (75,, 5) Note: s result, vector norm is lso multiplied y the sclr 5 x (3,4,5) = 5x (3, 4, 5) 3-755/8-797
11 Vector Opertions: Addition (3,4,5) 3 5 (3,-,-3) (6,,) Vector ddition: individul components dd (3,4,5) + (3,-,-3) = (6,,) 3 Only pplicle if oth vectors re the sme size -755/8-797
12 An introduction to spces Conventionl notion of spce : geometric construct of certin numer of dimensions Eg the 3-D spce tht this room nd every oject in it lives in -755/8-797
13 A vector spce A vector spce is n infinitely lrge set of vectors the following properties The set includes the zero vector (of ll zeros) The set is closed under ddition If X nd Y re in the set, X + Y is lso in the set for ny two sclrs nd For every X in the set, the set lso includes the dditive inverse Y = -X, such tht X + Y = -755/
14 Additionl Properties Additionl requirements: Sclr multiplictive identity element exists: X = X Addition is ssocitive: X + Y = Y + X Addition is commuttive: (X+Y)+Z = X+(Y+Z) Sclr multipliction is commuttive: (X) = () X Sclr multipliction is distriutive: (+)X = X + X (X+Y) = X + Y -755/
15 Exmple of vector spce Set of ll three-component column vectors Note we used the term three-component, rther thn threedimensionl The set includes the zero vector For every X in the set α R, every X is in the set For every X, Y in the set, X + Y is in the set -X is in the set Etc -755/
16 Exmple: function spce -755/
17 Dimension of spce Every element in the spce cn e composed of liner comintions of some other elements in the spce For ny X in S we cn write X = Y + Y + cy 3 for some other Y, Y, Y 3 in S Trivil to prove -755/
18 Dimension of spce Wht is the smllest suset of elements tht cn compose the entire set? There my e multiple such sets The elements in this set re clled ses The set is sis set The numer of elements in the set is the dimensionlity of the spce -755/
19 Dimensions: Exmple Wht is the dimensionlity of this vector spce -755/
20 Dimensions: Exmple Wht is the dimensionlity of this vector spce? First confirm this is proper vector spce Note: ll elements in Z re lso in S (slide 9) Z is suspce of S -755/8-797
21 Dimensions: Exmple Wht is the dimensionlity of this spce? -755/8-797
22 Moving on -755/8-797
23 Interpreting Mtrices Two interprettions of mtrix As trnsform tht modifies vectors nd vector spces As continer for dt (vectors) In the next two clsses we ll focus on the first view But we will mostly consider the second view for ML lgorithms in the our discussions of signl representtions -755/ d c o n m l k j i h g f e d c
24 Interpreting Mtrices s collections of vectors A mtrix cn e verticl stcking of row vectors R d e c f The spce of ll vectors tht cn e composed from the rows of the mtrix is the row spce of the mtrix Or horizontl rrngement of column vectors R d e c f The spce of ll vectors tht cn e composed from the columns of the mtrix is the column spce of the mtrix -755/
25 Dimensions of mtrix The mtrix size is specified y the numer of rows nd columns c = 3x mtrix: 3 rows nd column r = x3 mtrix: row nd 3 columns S = x mtrix R = x 3 mtrix Pcmn = 3 x 399 mtrix -755/ c c r c, f e d c d c R S,
26 Representing n imge s mtrix Y X v 5 6 Vlues only; X nd Y re implicit 3 pcmen A 3 x 399 mtrix Row nd Column = position A 3 x 879 mtrix Triples of x,y nd vlue A x 879 vector Unrveling the mtrix Note: All of these cn e recst s the mtrix tht forms the imge Representtions nd 4 re equivlent The position is not represented -755/
27 Bsic rithmetic opertions Addition nd sutrction (vectors nd mtrices) Element-wise opertions A B -755/
28 Vector/Mtrix Trnsposition A trnsposed row vector ecomes column (nd vice vers) A trnsposed mtrix gets ll its row (or column) vectors trnsposed in order x X c d e f, XT, x T c c c d e f y c, y T M, M T c -755/
29 Vector multipliction Multipliction y sclr d d c d d dc d d c cd Dot product, or inner product Vectors must hve the sme numer of elements Row vector times column vector = sclr d c e d e c f f Outer product or vector direct product Column vector times row vector = mtrix d e f c d e f d e f c d c e c f -755/
30 Vector dot product Exmple: Coordintes re yrds, not ve/st = [ 6], = [77 3] [yd 6yd] norm 6 The dot product of the two vectors reltes to the length of projection How much of the first vector hve we covered y following the second one? Must normlize y the length of the trget vector T yd 6 norm 393yd [77yd 3yd] norm /
31 Sqrt(energy) Vector dot product C E C frequency frequency Vectors re spectr Energy t discrete set of frequencies Actully x 496 X xis is the index of the numer in the vector Represents frequency Y xis is the vlue of the numer in the vector Represents mgnitude frequency /
32 Sqrt(energy) Vector dot product C E C frequency frequency How much of C is lso in E How much cn you fke C y plying n E CE / C E = Not very much How much of C is in C? CC / C / C = 5 Not d, you cn fke it To do this, C, E, nd C must e the sme size frequency /
33 Vector outer product The column vector is the spectrum The row vector is n mplitude modultion The outer product is spectrogrm Shows how the energy in ech frequency vries with time The pttern in ech column is scled version of the spectrum Ech row is scled version of the modultion -755/
34 Multiplying mtrix y sclr Multiplying mtrix y sclr multiplies every element of the mtrix A Note: A = A -755/
35 Multiplying vector y mtrix Multiplying vector y mtrix trnsforms the vector A B Dimensions must mtch!! No of columns of mtrix = size of vector Result inherits the numer of rows from the mtrix -755/
36 Multiplying vector y mtrix Generliztion of vector scling Left multipliction: Dot product of ech vector pir Dimensions must mtch!! No of columns of mtrix = size of vector Result inherits the numer of rows from the mtrix -755/ B A cd d d d c
37 Multiplying vector y mtrix Generliztion of vector multipliction Right multipliction: Dot product of ech vector pir A B d c d d dc Dimensions must mtch!! No of columns of mtrix = size of vector Result inherits the numer of rows from the mtrix -755/
38 Mtrix Multipliction: Column spce Right multipliction y mtrix trnsform row spce vector to column spce vector It mixes the column vectors of the mtrix using the numers in the vector The column spce of the Mtrix is the complete set of ll vectors tht cn e formed y mixing its columns -755/ f c z e y d x z y x f e d c
39 Mtrix Multipliction: Row spce d x y x c yd e f e c f Left multipliction mixes the row vectors of the mtrix Converts vector in the column spce to one in the row spce The row spce of the Mtrix is the complete set of ll vectors tht cn e formed y mixing its rows -755/
40 Multipliction of vector spce y mtrix Y Row spce Column spce The mtrix rottes nd scles the spce Including its own vectors -755/
41 Multipliction of vector spce y mtrix 3 Y The normls to the row vectors in the mtrix ecome the new xes X xis = norml to the second row vector Scled y the inverse of the length of the first row vector -755/
42 Mtrix Multipliction The k-th xis corresponds to the norml to the hyperplne represented y the k-,k+n-th row vectors in the mtrix Any set of K- vectors represent hyperplne of dimension K- or less The distnce long the new xis equls the length of the projection on the k-th row vector Expressed in inverse-lengths of the vector c d e f g h i -755/
43 Mtrix multipliction: Mixing vectors A physicl exmple The three column vectors of the mtrix X re the spectr of three notes The multiplying column vector Y is just mixing vector The result is sound tht is the mixture of the three notes -755/ X Y 7 =
44 Mtrix multipliction: Mixing vectors x x x 4 x 5 75 x 4 x Mixing two imges The imges re rrnged s columns position vlue not included The result of the multipliction is rerrnged s n imge -755/
45 Multiplying mtrices Simple vector multipliction: Vector outer product -755/
46 Multiplying mtrices Generliztion of vector multipliction Outer product of dot products!! Dimensions must mtch!! A B Columns of first mtrix = rows of second Result inherits the numer of rows from the first mtrix nd the numer of columns from the second mtrix -755/
47 Multiplying mtrices: Another view Simple vector multipliction: Vector inner product -755/
48 Mtrix multipliction: nother view -755/ NK N MN N K M K M NK N NK MN M N N The outer product of the first column of A nd the first row of B + outer product of the second column of A nd the second row of B + Sum of outer products B A
49 Why is tht useful? Y X Sounds: Three notes modulted independently -755/
50 Mtrix multipliction: Mixing modulted spectr Y X Sounds: Three notes modulted independently -755/
51 Mtrix multipliction: Mixing modulted spectr Y X Sounds: Three notes modulted independently -755/
52 Mtrix multipliction: Mixing modulted spectr X Sounds: Three notes modulted independently -755/
53 Mtrix multipliction: Mixing modulted spectr X 5 Sounds: Three notes modulted independently /
54 Mtrix multipliction: Mixing modulted spectr Sounds: Three notes modulted independently -755/
55 Mtrix multipliction: Imge trnsition i i j j Imge fdes out linerly Imge fdes in linerly /
56 Mtrix multipliction: Imge trnsition i i j j i i i N 9 9i 3 4 8i Ech column is one imge The columns represent sequence of imges of decresing intensity Imge fdes out linerly 8 9i 9i N 7 6 8i 8i N /
57 Mtrix multipliction: Imge trnsition i i j j Imge fdes in linerly -755/
58 Mtrix multipliction: Imge trnsition i i j j Imge fdes out linerly Imge fdes in linerly -755/
59 Mtrix Opertions: Properties A+B = B+A Actul interprettion: for ny vector x (A+B)x = (B+A)x (column vector x of the right size) x(a+b) = x(b+a) (row vector x of the pproprite size) A + (B + C) = (A + B) + C AB!= BA -755/
60 The Spce of Mtrices The set of ll mtrices of given size (eg ll 3x4 mtrices) is spce! Addition is closed Sclr multipliction is closed Zero mtrix exists Mtrices hve dditive inverses Associtivity nd commuttivity rules pply! -755/
61 The Identity Mtrix Y An identity mtrix is squre mtrix where All digonl elements re All off-digonl elements re Multipliction y n identity mtrix does not chnge vectors -755/
62 Digonl Mtrix Y All off-digonl elements re zero Digonl elements re non-zero Scles the xes My flip xes -755/
63 Digonl mtrix to trnsform imges How? -755/
64 Stretching 6 5 Loction-sed representtion Scling mtrix only scles the X xis The Y xis nd pixel vlue re scled y identity Not good wy of scling -755/
65 Stretching D = A 5 Newpic DA Better wy Interpolte ( NxN) N is the width of the originl imge -755/
66 Modifying color Scle only Green P Newpic B G R P -755/
67 Permuttion Mtrix A permuttion mtrix simply rerrnges the xes The row entries re xis vectors in different order The result is comintion of rottions nd reflections The permuttion mtrix effectively permutes the rrngement of the elements in vector -755/ x z y z y x (3,4,5) X Y Z X (old Y) Y (old Z) Z (old X)
68 Permuttion Mtrix Reflections nd 9 degree rottions of imges nd ojects -755/ P P 6 5
69 Permuttion Mtrix Reflections nd 9 degree rottions of imges nd ojects Oject represented s mtrix of 3-Dimensionl position vectors Positions identify ech point on the surfce -755/ P P N N N z z z y y y x x x
70 Rottion Mtrix Y x' y' x cosq xsinq y sinq y cosq (x,y) R q cosq sinq sinq cosq x X y x' X new y' y y Y R q X q X new (x,y ) (x,y) X X x x A rottion mtrix rottes the vector y some ngle q Alterntely viewed, it rottes the xes The new xes re t n ngle q to the old one -755/
71 Rotting picture Note the representtion: 3-row mtrix Rottion only pplies on the coordinte rows The vlue does not chnge Why is pcmn griny? -755/ cos45 sin 45 sin 45 cos45 R
72 3-D Rottion Xnew Ynew Z Y Znew q X degrees of freedom seprte ngles Wht will the rottion mtrix e? -755/
73 Projections Wht would we see if the cone to the left were trnsprent if we looked t it from ove the plne shown y the grid? Norml to the plne Answer: the figure to the right How do we get this? Projection -755/
74 Projections 9degrees projection Actul prolem: for ech vector Wht is the corresponding vector on the plne tht is closest pproximtion to it? Wht is the trnsform tht converts the vector to its pproximtion on the plne? -755/
75 Projections error 9degrees Arithmeticlly: Find the mtrix P such tht For every vector X, PX lies on the plne The plne is the column spce of P X PX is the smllest possile projection -755/
76 Projection Mtrix 9degrees W W projection Consider ny set of independent vectors W, W on the plne Arrnged s mtrix [W W ] The plne is the column spce of the mtrix Any vector cn e projected onto this plne The mtrix P tht rottes nd scles the vector so tht it ecomes its projection is projection mtrix -755/
77 Projection Mtrix 9degrees W W projection Given set of vectors W, W which form mtrix W = [W W ] The projection mtrix to trnsform vector X to its projection on the plne is P = W (W T W) - W T We will visit mtrix inversion shortly Mgic ny set of independent vectors from the sme plne tht re expressed s mtrix will give you the sme projection mtrix P = V (V T V) - V T -755/
78 Projections HOW? -755/
79 Projections Drw ny two vectors W nd W W tht lie on the plne ANY two so long s they hve different ngles Compose mtrix W = [W W ] Compose the projection mtrix P = W (W T W) - W T Multiply every point on the cone y P to get its projection -755/
80 Projections The projection ctully projects it onto the plne, ut you re still seeing the plne in 3D The result of the projection is 3-D vector P = W (W T W) - W T = 3x3, PX = 3x The imge must e rotted till the plne is in the plne of the pper The Z xis in this cse will lwys e zero nd cn e ignored How will you rotte it? (rememer you know W nd W ) -755/
81 Projection mtrix properties The projection of ny vector tht is lredy on the plne is the vector itself PX = X if X is on the plne If the oject is lredy on the plne, there is no further projection to e performed The projection of projection is the projection P(PX) = PX Projection mtrices re idempotent P = P -755/
82 Projections: A more physicl mening Let W, W W k e ses We wnt to explin our dt in terms of these ses We often cnnot do so But we cn explin significnt portion of it The portion of the dt tht cn e expressed in terms of our vectors W, W, W k, is the projection of the dt on the W W k (hyper) plne In our previous exmple, the dt were ll the points on cone, nd the ses were vectors on the plne -755/
83 Projection : n exmple with sounds The spectrogrm (mtrix) of piece of music How much of the ove music ws composed of the ove notes Ie how much cn it e explined y the notes -755/
84 Projection: one note M = The spectrogrm (mtrix) of piece of music W = M = spectrogrm; W = note P = W (W T W) - W T Projected Spectrogrm = P * M -755/
85 Projection: one note clened up M = The spectrogrm (mtrix) of piece of music W = Floored ll mtrix vlues elow threshold to zero -755/
86 Projection: multiple notes M = The spectrogrm (mtrix) of piece of music W = P = W (W T W) - W T Projected Spectrogrm = P * M -755/
87 Projection: multiple notes, clened up M = The spectrogrm (mtrix) of piece of music W = P = W (W T W) - W T Projected Spectrogrm = P * M -755/
88 note note note3 Projection nd Lest Squres Projection ctully computes lest squred error estimte For ech vector V in the music spectrogrm mtrix Approximtion: V pprox = *note + *note + c*note3 V pprox c Error vector E = V V pprox Squred error energy for V e(v) = norm(e) Totl error = sum over ll V { e(v) } = S V e(v) Projection computes V pprox for ll vectors such tht Totl error is minimized It does not give you,, c Though Tht needs different opertion the inverse / pseudo inverse -755/
11-755/ Machine Learning for Signal Processing. Algebra. Class Sep Instructor: Bhiksha Raj
-755/8-797 Mchine Lerning for Signl Processing Fundmentls of Liner Alger Clss -3 Sep Instructor: Bhiksh Rj Sep -755/8-797 Administrivi Registrtion: Anyone on witlist still? Homework : Will e hnded out
More information11-755/ Machine Learning for Signal Processing. Algebra. Class August Instructor: Bhiksha Raj
-755/8-797 Mchine Lerning for Signl Processing Fundmentls of Liner Alger Clss 6 August 9 Instructor: Bhiksh Rj 6 Aug -755/8-797 Administrivi Registrtion: Anyone on witlist still? Our TA is here Sourish
More informationFundamentals of Linear Algebra
-7/8-797 Mchine Lerning for Signl rocessing Fundmentls of Liner Alger Administrivi Registrtion: Anone on witlist still? Homework : Will e hnded out with clss Liner lger Clss - Sep Instructor: Bhiksh Rj
More informationFundamentals of Linear Algebra
-7/8-797 Mchine Lerning for Signl Processing Fundmentls of Liner Alger Administrivi Registrtion: Anone on witlist still? Homewor : Will pper over weeend Liner lger Clss Aug Instructor: Bhish Rj -7/8-797
More informationThings to Memorize: A Partial List. January 27, 2017
Things to Memorize: A Prtil List Jnury 27, 2017 Chpter 2 Vectors - Bsic Fcts A vector hs mgnitude (lso clled size/length/norm) nd direction. It does not hve fixed position, so the sme vector cn e moved
More informationAnalytically, vectors will be represented by lowercase bold-face Latin letters, e.g. a, r, q.
1.1 Vector Alger 1.1.1 Sclrs A physicl quntity which is completely descried y single rel numer is clled sclr. Physiclly, it is something which hs mgnitude, nd is completely descried y this mgnitude. Exmples
More informationReview of Gaussian Quadrature method
Review of Gussin Qudrture method Nsser M. Asi Spring 006 compiled on Sundy Decemer 1, 017 t 09:1 PM 1 The prolem To find numericl vlue for the integrl of rel vlued function of rel vrile over specific rnge
More informationIntroduction To Matrices MCV 4UI Assignment #1
Introduction To Mtrices MCV UI Assignment # INTRODUCTION: A mtrix plurl: mtrices) is rectngulr rry of numbers rrnged in rows nd columns Exmples: ) b) c) [ ] d) Ech number ppering in the rry is sid to be
More informationMatrix Algebra. Matrix Addition, Scalar Multiplication and Transposition. Linear Algebra I 24
Mtrix lger Mtrix ddition, Sclr Multipliction nd rnsposition Mtrix lger Section.. Mtrix ddition, Sclr Multipliction nd rnsposition rectngulr rry of numers is clled mtrix ( the plurl is mtrices ) nd the
More informationset is not closed under matrix [ multiplication, ] and does not form a group.
Prolem 2.3: Which of the following collections of 2 2 mtrices with rel entries form groups under [ mtrix ] multipliction? i) Those of the form for which c d 2 Answer: The set of such mtrices is not closed
More informationLecture 3. In this lecture, we will discuss algorithms for solving systems of linear equations.
Lecture 3 3 Solving liner equtions In this lecture we will discuss lgorithms for solving systems of liner equtions Multiplictive identity Let us restrict ourselves to considering squre mtrices since one
More informationSeptember 13 Homework Solutions
College of Engineering nd Computer Science Mechnicl Engineering Deprtment Mechnicl Engineering 5A Seminr in Engineering Anlysis Fll Ticket: 5966 Instructor: Lrry Cretto Septemer Homework Solutions. Are
More information4 VECTORS. 4.0 Introduction. Objectives. Activity 1
4 VECTRS Chpter 4 Vectors jectives fter studying this chpter you should understnd the difference etween vectors nd sclrs; e le to find the mgnitude nd direction of vector; e le to dd vectors, nd multiply
More informationHow do we solve these things, especially when they get complicated? How do we know when a system has a solution, and when is it unique?
XII. LINEAR ALGEBRA: SOLVING SYSTEMS OF EQUATIONS Tody we re going to tlk out solving systems of liner equtions. These re prolems tht give couple of equtions with couple of unknowns, like: 6= x + x 7=
More informationMATRIX DEFINITION A matrix is any doubly subscripted array of elements arranged in rows and columns.
4.5 THEORETICL SOIL MECHNICS Vector nd Mtrix lger Review MTRIX DEFINITION mtrix is ny douly suscripted rry of elements rrnged in rows nd columns. m - Column Revised /0 n -Row m,,,,,, n n mn ij nd Order
More information7.1 Integral as Net Change and 7.2 Areas in the Plane Calculus
7.1 Integrl s Net Chnge nd 7. Ares in the Plne Clculus 7.1 INTEGRAL AS NET CHANGE Notecrds from 7.1: Displcement vs Totl Distnce, Integrl s Net Chnge We hve lredy seen how the position of n oject cn e
More informationINTRODUCTION TO LINEAR ALGEBRA
ME Applied Mthemtics for Mechnicl Engineers INTRODUCTION TO INEAR AGEBRA Mtrices nd Vectors Prof. Dr. Bülent E. Pltin Spring Sections & / ME Applied Mthemtics for Mechnicl Engineers INTRODUCTION TO INEAR
More information308K. 1 Section 3.2. Zelaya Eufemia. 1. Example 1: Multiplication of Matrices: X Y Z R S R S X Y Z. By associativity we have to choices:
8K Zely Eufemi Section 2 Exmple : Multipliction of Mtrices: X Y Z T c e d f 2 R S X Y Z 2 c e d f 2 R S 2 By ssocitivity we hve to choices: OR: X Y Z R S cr ds er fs X cy ez X dy fz 2 R S 2 Suggestion
More informationMath 520 Final Exam Topic Outline Sections 1 3 (Xiao/Dumas/Liaw) Spring 2008
Mth 520 Finl Exm Topic Outline Sections 1 3 (Xio/Dums/Liw) Spring 2008 The finl exm will be held on Tuesdy, My 13, 2-5pm in 117 McMilln Wht will be covered The finl exm will cover the mteril from ll of
More informationSection 6: Area, Volume, and Average Value
Chpter The Integrl Applied Clculus Section 6: Are, Volume, nd Averge Vlue Are We hve lredy used integrls to find the re etween the grph of function nd the horizontl xis. Integrls cn lso e used to find
More informationTo Do. Vectors. Motivation and Outline. Vector Addition. Cartesian Coordinates. Foundations of Computer Graphics (Spring 2010) x y
Foundtions of Computer Grphics (Spring 2010) CS 184, Lecture 2: Review of Bsic Mth http://inst.eecs.erkeley.edu/~cs184 o Do Complete Assignment 0 Downlod nd compile skeleton for ssignment 1 Red instructions
More information2. VECTORS AND MATRICES IN 3 DIMENSIONS
2 VECTORS AND MATRICES IN 3 DIMENSIONS 21 Extending the Theory of 2-dimensionl Vectors x A point in 3-dimensionl spce cn e represented y column vector of the form y z z-xis y-xis z x y x-xis Most of the
More informationVectors , (0,0). 5. A vector is commonly denoted by putting an arrow above its symbol, as in the picture above. Here are some 3-dimensional vectors:
Vectors 1-23-2018 I ll look t vectors from n lgeric point of view nd geometric point of view. Algericlly, vector is n ordered list of (usully) rel numers. Here re some 2-dimensionl vectors: (2, 3), ( )
More information1.2 What is a vector? (Section 2.2) Two properties (attributes) of a vector are and.
Homework 1. Chpters 2. Bsis independent vectors nd their properties Show work except for fill-in-lnks-prolems (print.pdf from www.motiongenesis.com Textooks Resources). 1.1 Solving prolems wht engineers
More informationGeometric Sequences. Geometric Sequence a sequence whose consecutive terms have a common ratio.
Geometric Sequences Geometric Sequence sequence whose consecutive terms hve common rtio. Geometric Sequence A sequence is geometric if the rtios of consecutive terms re the sme. 2 3 4... 2 3 The number
More informationMatrices. Elementary Matrix Theory. Definition of a Matrix. Matrix Elements:
Mtrices Elementry Mtrix Theory It is often desirble to use mtrix nottion to simplify complex mthemticl expressions. The simplifying mtrix nottion usully mkes the equtions much esier to hndle nd mnipulte.
More informationLecture 2e Orthogonal Complement (pages )
Lecture 2e Orthogonl Complement (pges -) We hve now seen tht n orthonorml sis is nice wy to descrie suspce, ut knowing tht we wnt n orthonorml sis doesn t mke one fll into our lp. In theory, the process
More information8. Complex Numbers. We can combine the real numbers with this new imaginary number to form the complex numbers.
8. Complex Numers The rel numer system is dequte for solving mny mthemticl prolems. But it is necessry to extend the rel numer system to solve numer of importnt prolems. Complex numers do not chnge the
More informationBases for Vector Spaces
Bses for Vector Spces 2-26-25 A set is independent if, roughly speking, there is no redundncy in the set: You cn t uild ny vector in the set s liner comintion of the others A set spns if you cn uild everything
More informationMATH1131 Mathematics 1A Algebra
MATH1131 Mthemtics 1A Alger UNSW Sydney Semester 1, 017 Mike Mssierer Mike is pronounced like Mich mike@unsweduu Plese emil me if you hve ny questions or comments Office hours TBA (week ), or emil me to
More informationUses of transformations. 3D transformations. Review of vectors. Vectors in 3D. Points vs. vectors. Homogeneous coordinates S S [ H [ S \ H \ S ] H ]
Uses of trnsformtions 3D trnsformtions Modeling: position nd resize prts of complex model; Viewing: define nd position the virtul cmer Animtion: define how objects move/chnge with time y y Sclr (dot) product
More informationHere we study square linear systems and properties of their coefficient matrices as they relate to the solution set of the linear system.
Section 24 Nonsingulr Liner Systems Here we study squre liner systems nd properties of their coefficient mtrices s they relte to the solution set of the liner system Let A be n n Then we know from previous
More information1 ELEMENTARY ALGEBRA and GEOMETRY READINESS DIAGNOSTIC TEST PRACTICE
ELEMENTARY ALGEBRA nd GEOMETRY READINESS DIAGNOSTIC TEST PRACTICE Directions: Study the exmples, work the prolems, then check your nswers t the end of ech topic. If you don t get the nswer given, check
More informationPartial Derivatives. Limits. For a single variable function f (x), the limit lim
Limits Prtil Derivtives For single vrible function f (x), the limit lim x f (x) exists only if the right-hnd side limit equls to the left-hnd side limit, i.e., lim f (x) = lim f (x). x x + For two vribles
More informationHW3, Math 307. CSUF. Spring 2007.
HW, Mth 7. CSUF. Spring 7. Nsser M. Abbsi Spring 7 Compiled on November 5, 8 t 8:8m public Contents Section.6, problem Section.6, problem Section.6, problem 5 Section.6, problem 7 6 5 Section.6, problem
More informationDEFINITION OF ASSOCIATIVE OR DIRECT PRODUCT AND ROTATION OF VECTORS
3 DEFINITION OF ASSOCIATIVE OR DIRECT PRODUCT AND ROTATION OF VECTORS This chpter summrizes few properties of Cli ord Algebr nd describe its usefulness in e ecting vector rottions. 3.1 De nition of Associtive
More informationMATRICES AND VECTORS SPACE
MATRICES AND VECTORS SPACE MATRICES AND MATRIX OPERATIONS SYSTEM OF LINEAR EQUATIONS DETERMINANTS VECTORS IN -SPACE AND -SPACE GENERAL VECTOR SPACES INNER PRODUCT SPACES EIGENVALUES, EIGENVECTORS LINEAR
More informationChapter 14. Matrix Representations of Linear Transformations
Chpter 4 Mtrix Representtions of Liner Trnsformtions When considering the Het Stte Evolution, we found tht we could describe this process using multipliction by mtrix. This ws nice becuse computers cn
More informationI1 = I2 I1 = I2 + I3 I1 + I2 = I3 + I4 I 3
2 The Prllel Circuit Electric Circuits: Figure 2- elow show ttery nd multiple resistors rrnged in prllel. Ech resistor receives portion of the current from the ttery sed on its resistnce. The split is
More informationComputer Graphics (CS 4731) Lecture 7: Linear Algebra for Graphics (Points, Scalars, Vectors)
Computer Grphics (CS 4731) Lecture 7: Liner Alger for Grphics (Points, Sclrs, Vectors) Prof Emmnuel Agu Computer Science Dept. Worcester Poltechnic Institute (WPI) Annoncements Project 1 due net Tuesd,
More informationOn the diagram below the displacement is represented by the directed line segment OA.
Vectors Sclrs nd Vectors A vector is quntity tht hs mgnitude nd direction. One exmple of vector is velocity. The velocity of n oject is determined y the mgnitude(speed) nd direction of trvel. Other exmples
More informationMatrices and Determinants
Nme Chpter 8 Mtrices nd Determinnts Section 8.1 Mtrices nd Systems of Equtions Objective: In this lesson you lerned how to use mtrices, Gussin elimintion, nd Guss-Jordn elimintion to solve systems of liner
More informationThe Algebra (al-jabr) of Matrices
Section : Mtri lgebr nd Clculus Wshkewicz College of Engineering he lgebr (l-jbr) of Mtrices lgebr s brnch of mthemtics is much broder thn elementry lgebr ll of us studied in our high school dys. In sense
More informationChapter 3 MATRIX. In this chapter: 3.1 MATRIX NOTATION AND TERMINOLOGY
Chpter 3 MTRIX In this chpter: Definition nd terms Specil Mtrices Mtrix Opertion: Trnspose, Equlity, Sum, Difference, Sclr Multipliction, Mtrix Multipliction, Determinnt, Inverse ppliction of Mtrix in
More informationChapter 4 Contravariance, Covariance, and Spacetime Diagrams
Chpter 4 Contrvrince, Covrince, nd Spcetime Digrms 4. The Components of Vector in Skewed Coordintes We hve seen in Chpter 3; figure 3.9, tht in order to show inertil motion tht is consistent with the Lorentz
More informationChapter 2. Vectors. 2.1 Vectors Scalars and Vectors
Chpter 2 Vectors 2.1 Vectors 2.1.1 Sclrs nd Vectors A vector is quntity hving both mgnitude nd direction. Emples of vector quntities re velocity, force nd position. One cn represent vector in n-dimensionl
More informationWeek 10: Line Integrals
Week 10: Line Integrls Introduction In this finl week we return to prmetrised curves nd consider integrtion long such curves. We lredy sw this in Week 2 when we integrted long curve to find its length.
More informationCoalgebra, Lecture 15: Equations for Deterministic Automata
Colger, Lecture 15: Equtions for Deterministic Automt Julin Slmnc (nd Jurrin Rot) Decemer 19, 2016 In this lecture, we will study the concept of equtions for deterministic utomt. The notes re self contined
More information7.1 Integral as Net Change Calculus. What is the total distance traveled? What is the total displacement?
7.1 Integrl s Net Chnge Clculus 7.1 INTEGRAL AS NET CHANGE Distnce versus Displcement We hve lredy seen how the position of n oject cn e found y finding the integrl of the velocity function. The chnge
More informationQuadratic Forms. Quadratic Forms
Qudrtic Forms Recll the Simon & Blume excerpt from n erlier lecture which sid tht the min tsk of clculus is to pproximte nonliner functions with liner functions. It s ctully more ccurte to sy tht we pproximte
More information1 Linear Least Squares
Lest Squres Pge 1 1 Liner Lest Squres I will try to be consistent in nottion, with n being the number of dt points, nd m < n being the number of prmeters in model function. We re interested in solving
More informationECON 331 Lecture Notes: Ch 4 and Ch 5
Mtrix Algebr ECON 33 Lecture Notes: Ch 4 nd Ch 5. Gives us shorthnd wy of writing lrge system of equtions.. Allows us to test for the existnce of solutions to simultneous systems. 3. Allows us to solve
More informationHow do we solve these things, especially when they get complicated? How do we know when a system has a solution, and when is it unique?
XII. LINEAR ALGEBRA: SOLVING SYSTEMS OF EQUATIONS Tody we re going to tlk bout solving systems of liner equtions. These re problems tht give couple of equtions with couple of unknowns, like: 6 2 3 7 4
More informationLecture Solution of a System of Linear Equation
ChE Lecture Notes, Dept. of Chemicl Engineering, Univ. of TN, Knoville - D. Keffer, 5/9/98 (updted /) Lecture 8- - Solution of System of Liner Eqution 8. Why is it importnt to e le to solve system of liner
More informationTHREE-DIMENSIONAL KINEMATICS OF RIGID BODIES
THREE-DIMENSIONAL KINEMATICS OF RIGID BODIES 1. TRANSLATION Figure shows rigid body trnslting in three-dimensionl spce. Any two points in the body, such s A nd B, will move long prllel stright lines if
More informationNumerical Linear Algebra Assignment 008
Numericl Liner Algebr Assignment 008 Nguyen Qun B Hong Students t Fculty of Mth nd Computer Science, Ho Chi Minh University of Science, Vietnm emil. nguyenqunbhong@gmil.com blog. http://hongnguyenqunb.wordpress.com
More informationS56 (5.3) Vectors.notebook January 29, 2016
Dily Prctice 15.1.16 Q1. The roots of the eqution (x 1)(x + k) = 4 re equl. Find the vlues of k. Q2. Find the rte of chnge of 剹 x when x = 1 / 8 Tody we will e lerning out vectors. Q3. Find the eqution
More informationUNIT 5 QUADRATIC FUNCTIONS Lesson 3: Creating Quadratic Equations in Two or More Variables Instruction
Lesson 3: Creting Qudrtic Equtions in Two or More Vriles Prerequisite Skills This lesson requires the use of the following skill: solving equtions with degree of Introduction 1 The formul for finding the
More information1 ELEMENTARY ALGEBRA and GEOMETRY READINESS DIAGNOSTIC TEST PRACTICE
ELEMENTARY ALGEBRA nd GEOMETRY READINESS DIAGNOSTIC TEST PRACTICE Directions: Study the exmples, work the prolems, then check your nswers t the end of ech topic. If you don t get the nswer given, check
More informationVectors. Introduction. Definition. The Two Components of a Vector. Vectors
Vectors Introduction This pper covers generl description of vectors first (s cn e found in mthemtics ooks) nd will stry into the more prcticl res of grphics nd nimtion. Anyone working in grphics sujects
More informationMinimal DFA. minimal DFA for L starting from any other
Miniml DFA Among the mny DFAs ccepting the sme regulr lnguge L, there is exctly one (up to renming of sttes) which hs the smllest possile numer of sttes. Moreover, it is possile to otin tht miniml DFA
More informationA matrix is a set of numbers or symbols arranged in a square or rectangular array of m rows and n columns as
RMI University ENDIX MRIX GEBR INRDUCIN Mtrix lgebr is powerful mthemticl tool, which is extremely useful in modern computtionl techniques pplicble to sptil informtion science. It is neither new nor difficult,
More informationVECTORS, TENSORS, AND MATRICES. 2 + Az. A vector A can be defined by its length A and the direction of a unit
GG33 Lecture 7 5/17/6 1 VECTORS, TENSORS, ND MTRICES I Min Topics C Vector length nd direction Vector Products Tensor nottion vs. mtrix nottion II Vector Products Vector length: x 2 + y 2 + z 2 vector
More informationCHAPTER 1 PROGRAM OF MATRICES
CHPTER PROGRM OF MTRICES -- INTRODUCTION definition of engineering is the science y which the properties of mtter nd sources of energy in nture re mde useful to mn. Thus n engineer will hve to study the
More informationLecture 19: Continuous Least Squares Approximation
Lecture 19: Continuous Lest Squres Approximtion 33 Continuous lest squres pproximtion We begn 31 with the problem of pproximting some f C[, b] with polynomil p P n t the discrete points x, x 1,, x m for
More informationBest Approximation in the 2-norm
Jim Lmbers MAT 77 Fll Semester 1-11 Lecture 1 Notes These notes correspond to Sections 9. nd 9.3 in the text. Best Approximtion in the -norm Suppose tht we wish to obtin function f n (x) tht is liner combintion
More informationSCHOOL OF ENGINEERING & BUILT ENVIRONMENT. Mathematics
SCHOOL OF ENGINEERING & BUIL ENVIRONMEN Mthemtics An Introduction to Mtrices Definition of Mtri Size of Mtri Rows nd Columns of Mtri Mtri Addition Sclr Multipliction of Mtri Mtri Multipliction 7 rnspose
More informationDEFINITION The inner product of two functions f 1 and f 2 on an interval [a, b] is the number. ( f 1, f 2 ) b DEFINITION 11.1.
398 CHAPTER 11 ORTHOGONAL FUNCTIONS AND FOURIER SERIES 11.1 ORTHOGONAL FUNCTIONS REVIEW MATERIAL The notions of generlized vectors nd vector spces cn e found in ny liner lger text. INTRODUCTION The concepts
More informationdx dt dy = G(t, x, y), dt where the functions are defined on I Ω, and are locally Lipschitz w.r.t. variable (x, y) Ω.
Chpter 8 Stility theory We discuss properties of solutions of first order two dimensionl system, nd stility theory for specil clss of liner systems. We denote the independent vrile y t in plce of x, nd
More informationContinuous Random Variables Class 5, Jeremy Orloff and Jonathan Bloom
Lerning Gols Continuous Rndom Vriles Clss 5, 8.05 Jeremy Orloff nd Jonthn Bloom. Know the definition of continuous rndom vrile. 2. Know the definition of the proility density function (pdf) nd cumultive
More informationSCHOOL OF ENGINEERING & BUILT ENVIRONMENT
SCHOOL OF ENGINEERING & BUIL ENVIRONMEN MARICES FOR ENGINEERING Dr Clum Mcdonld Contents Introduction Definitions Wht is mtri? Rows nd columns of mtri Order of mtri Element of mtri Equlity of mtrices Opertions
More informationTHE DISCRIMINANT & ITS APPLICATIONS
THE DISCRIMINANT & ITS APPLICATIONS The discriminnt ( Δ ) is the epression tht is locted under the squre root sign in the qudrtic formul i.e. Δ b c. For emple: Given +, Δ () ( )() The discriminnt is used
More information13: Diffusion in 2 Energy Groups
3: Diffusion in Energy Groups B. Rouben McMster University Course EP 4D3/6D3 Nucler Rector Anlysis (Rector Physics) 5 Sept.-Dec. 5 September Contents We study the diffusion eqution in two energy groups
More informationLecture Note 9: Orthogonal Reduction
MATH : Computtionl Methods of Liner Algebr 1 The Row Echelon Form Lecture Note 9: Orthogonl Reduction Our trget is to solve the norml eution: Xinyi Zeng Deprtment of Mthemticl Sciences, UTEP A t Ax = A
More informationDesigning finite automata II
Designing finite utomt II Prolem: Design DFA A such tht L(A) consists of ll strings of nd which re of length 3n, for n = 0, 1, 2, (1) Determine wht to rememer out the input string Assign stte to ech of
More information1B40 Practical Skills
B40 Prcticl Skills Comining uncertinties from severl quntities error propgtion We usully encounter situtions where the result of n experiment is given in terms of two (or more) quntities. We then need
More informationMatrix Eigenvalues and Eigenvectors September 13, 2017
Mtri Eigenvlues nd Eigenvectors September, 7 Mtri Eigenvlues nd Eigenvectors Lrry Cretto Mechnicl Engineering 5A Seminr in Engineering Anlysis September, 7 Outline Review lst lecture Definition of eigenvlues
More informationThe Regulated and Riemann Integrals
Chpter 1 The Regulted nd Riemnn Integrls 1.1 Introduction We will consider severl different pproches to defining the definite integrl f(x) dx of function f(x). These definitions will ll ssign the sme vlue
More informationExploring parametric representation with the TI-84 Plus CE graphing calculator
Exploring prmetric representtion with the TI-84 Plus CE grphing clcultor Richrd Prr Executive Director Rice University School Mthemtics Project rprr@rice.edu Alice Fisher Director of Director of Technology
More informationMatrix Solution to Linear Equations and Markov Chains
Trding Systems nd Methods, Fifth Edition By Perry J. Kufmn Copyright 2005, 2013 by Perry J. Kufmn APPENDIX 2 Mtrix Solution to Liner Equtions nd Mrkov Chins DIRECT SOLUTION AND CONVERGENCE METHOD Before
More information5: The Definite Integral
5: The Definite Integrl 5.: Estimting with Finite Sums Consider moving oject its velocity (meters per second) t ny time (seconds) is given y v t = t+. Cn we use this informtion to determine the distnce
More informationPrerequisites CHAPTER P
CHAPTER P Prerequisites P. Rel Numers P.2 Crtesin Coordinte System P.3 Liner Equtions nd Inequlities P.4 Lines in the Plne P.5 Solving Equtions Grphiclly, Numericlly, nd Algericlly P.6 Comple Numers P.7
More informationRudimentary Matrix Algebra
Rudimentry Mtrix Alger Mrk Sullivn Decemer 4, 217 i Contents 1 Preliminries 1 1.1 Why does this document exist?.................... 1 1.2 Why does nyone cre out mtrices?................ 1 1.3 Wht is mtrix?...........................
More informationOperations with Polynomials
38 Chpter P Prerequisites P.4 Opertions with Polynomils Wht you should lern: How to identify the leding coefficients nd degrees of polynomils How to dd nd subtrct polynomils How to multiply polynomils
More informationNumerical Methods I Orthogonal Polynomials
Numericl Methods I Orthogonl Polynomils Aleksndr Donev Cournt Institute, NYU 1 donev@cournt.nyu.edu 1 MATH-GA 2011.003 / CSCI-GA 2945.003, Fll 2014 Nov 6th, 2014 A. Donev (Cournt Institute) Lecture IX
More informationList all of the possible rational roots of each equation. Then find all solutions (both real and imaginary) of the equation. 1.
Mth Anlysis CP WS 4.X- Section 4.-4.4 Review Complete ech question without the use of grphing clcultor.. Compre the mening of the words: roots, zeros nd fctors.. Determine whether - is root of 0. Show
More informationHQPD - ALGEBRA I TEST Record your answers on the answer sheet.
HQPD - ALGEBRA I TEST Record your nswers on the nswer sheet. Choose the best nswer for ech. 1. If 7(2d ) = 5, then 14d 21 = 5 is justified by which property? A. ssocitive property B. commuttive property
More informationBridging the gap: GCSE AS Level
Bridging the gp: GCSE AS Level CONTENTS Chpter Removing rckets pge Chpter Liner equtions Chpter Simultneous equtions 8 Chpter Fctors 0 Chpter Chnge the suject of the formul Chpter 6 Solving qudrtic equtions
More informationElementary Linear Algebra
Elementry Liner Algebr Anton & Rorres, 1 th Edition Lecture Set 5 Chpter 4: Prt II Generl Vector Spces 163 คณ ตศาสตร ว ศวกรรม 3 สาขาว ชาว ศวกรรมคอมพ วเตอร ป การศ กษา 1/2555 163 คณตศาสตรวศวกรรม 3 สาขาวชาวศวกรรมคอมพวเตอร
More information2.4 Linear Inequalities and Interval Notation
.4 Liner Inequlities nd Intervl Nottion We wnt to solve equtions tht hve n inequlity symol insted of n equl sign. There re four inequlity symols tht we will look t: Less thn , Less thn or
More informationChapters Five Notes SN AA U1C5
Chpters Five Notes SN AA U1C5 Nme Period Section 5-: Fctoring Qudrtic Epressions When you took lger, you lerned tht the first thing involved in fctoring is to mke sure to fctor out ny numers or vriles
More informationIntroduction to Group Theory
Introduction to Group Theory Let G be n rbitrry set of elements, typiclly denoted s, b, c,, tht is, let G = {, b, c, }. A binry opertion in G is rule tht ssocites with ech ordered pir (,b) of elements
More informationModule 6: LINEAR TRANSFORMATIONS
Module 6: LINEAR TRANSFORMATIONS. Trnsformtions nd mtrices Trnsformtions re generliztions of functions. A vector x in some set S n is mpped into m nother vector y T( x). A trnsformtion is liner if, for
More informationSTRAND J: TRANSFORMATIONS, VECTORS and MATRICES
Mthemtics SKE: STRN J STRN J: TRNSFORMTIONS, VETORS nd MTRIES J3 Vectors Text ontents Section J3.1 Vectors nd Sclrs * J3. Vectors nd Geometry Mthemtics SKE: STRN J J3 Vectors J3.1 Vectors nd Sclrs Vectors
More informationBest Approximation. Chapter The General Case
Chpter 4 Best Approximtion 4.1 The Generl Cse In the previous chpter, we hve seen how n interpolting polynomil cn be used s n pproximtion to given function. We now wnt to find the best pproximtion to given
More informationSection 14.3 Arc Length and Curvature
Section 4.3 Arc Length nd Curvture Clculus on Curves in Spce In this section, we ly the foundtions for describing the movement of n object in spce.. Vector Function Bsics In Clc, formul for rc length in
More informationu( t) + K 2 ( ) = 1 t > 0 Analyzing Damped Oscillations Problem (Meador, example 2-18, pp 44-48): Determine the equation of the following graph.
nlyzing Dmped Oscilltions Prolem (Medor, exmple 2-18, pp 44-48): Determine the eqution of the following grph. The eqution is ssumed to e of the following form f ( t) = K 1 u( t) + K 2 e!"t sin (#t + $
More informationVector differentiation. Chapters 6, 7
Chpter 2 Vectors Courtesy NASA/JPL-Cltech Summry (see exmples in Hw 1, 2, 3) Circ 1900 A.D., J. Willird Gis invented useful comintion of mgnitude nd direction clled vectors nd their higher-dimensionl counterprts
More informationLecture V. Introduction to Space Groups Charles H. Lake
Lecture V. Introduction to Spce Groups 2003. Chrles H. Lke Outline:. Introduction B. Trnsltionl symmetry C. Nomenclture nd symols used with spce groups D. The spce groups E. Derivtion nd discussion of
More informationTheoretical foundations of Gaussian quadrature
Theoreticl foundtions of Gussin qudrture 1 Inner product vector spce Definition 1. A vector spce (or liner spce) is set V = {u, v, w,...} in which the following two opertions re defined: (A) Addition of
More information