11-755/ Machine Learning for Signal Processing. Algebra. Class August Instructor: Bhiksha Raj
|
|
- Samantha Heath
- 5 years ago
- Views:
Transcription
1 -755/8-797 Mchine Lerning for Signl Processing Fundmentls of Liner Alger Clss 6 August 9 Instructor: Bhiksh Rj 6 Aug -755/8-797
2 Administrivi Registrtion: Anyone on witlist still? Our TA is here Sourish Chudhuri Homework: Aginst clss3 on course wesite Liner lger Use the discussion lists on lckordndrewcmuedu Blckord if you re not registered on lckord plese register 6 Aug -755/8-797
3 Overview Vectors nd mtrices Bsic vector/mtrix t opertions Vector products Mtrix products Vrious mtrix types Mtrix inversion Mtrix interprettion Eigennlysis Singulr vlue decomposition 6 Aug -755/
4 Book Fundmentls of Liner Alger, Gilert Strng Importnt to e very comfortle with liner lger Appers repetedly in the form of Eigen nlysis, SVD, Fctor nlysis Appers through vrious properties of mtrices tht re used in mchine lerning, prticulrly when pplied to imges nd sound Tody s lecture: Definitions iti Very smll suset of ll tht s used Importnt suset, intended to help you recollect 6 Aug -755/
5 Incentive to use liner lger Pretty nottion! x T A y j y j i x i ij Esier intuition Relly convenient geometric interprettions Opertions esy to descrie verlly Esy code trnsltion! for i=:n for j=:m c(i)=c(i)+y(j)*x(i)*(i,j) end end C=x*A*y 6 Aug -755/
6 And other things you cn do From Bch s Fugue in Gm Fre equency Rottion + Projection + Scling Time Decomposition (NMF) Mnipulte Imges Mnipulte Sounds 6 Aug -755/
7 Sclrs, vectors, mtrices, A sclr is numer =, = 34, = -, etc A vector is liner rrngement of collection of sclrs 3, 34 3 A mtrix A is rectngulr rrngement of collection of vectors 3 A MATLAB syntx: =[ 3], A=[ ;3 4] 6 Aug -755/
8 Vector/Mtrix types nd shpes Vectors re either column or row vectors c, r c c, s A sound cn e vector, series of dily tempertures cn e vector, etc Mtrices cn e squre or rectngulr S c d, R c d e, M f Imges cn e mtrix, collections of sounds cn e mtrix, etc 6 Aug -755/
9 Dimensions of mtrix The mtrix size is specified y the numer of rows nd columns c c r c, c = 3x mtrix: 3 rows nd column r = x3 mtrix: row nd 3 columns f e d c d c S R, S = x mtrix R = x 3 mtrix Pcmn = 3 x 399 mtrix -755/8-797 Pcmn = 3 x 399 mtrix 6 Aug 9
10 Representing n imge s mtrix 3 pcmen A 3x399 mtrix Row nd Column = position A 3x879 mtrix Triples of x,y nd vlue A x879 vector Y X v 5 6 Vlues only; X nd Y re implicit Unrveling the mtrix Note: All of these cn e recst s the mtrix tht forms the imge Representtions nd 4 re equivlent The position is not represented 6 Aug -755/8-797
11 Exmple of vector Vectors usully hold sets of numericl ttriutes X, Y, vlue [,, ] Ernings, losses, suicides [$ $ 3] Etc Consider reltive Mnhttn vector Provides reltive position y giving numer of venues nd streets to cross, eg [3v 33st] [-5v 6st] [v 4st] [v 8st] 6 Aug -755/8-797
12 Vectors Ordered collection of numers Exmples: [3 4 5], [ c d], [3 4 5]!= [4 3 5] Order is importnt Typiclly viewed s identifying (the pth from origin to) loction in n N-dimensionl spce (3,4,5) 5 (4,3,5) z 3 y 4 x 6 Aug -755/8-797
13 Vectors vs Mtrices (3,4,5) A vector is geometric nottion for how to get from (,) ) to some loction in the spce A mtrix is simply collection of destintions! Properties of mtrices re verge properties of the trveller s pth to these destintions 6 Aug -755/
14 Bsic rithmetic opertions Addition nd sutrction Element-wise opertions A B MATLAB syntx: + nd - 6 Aug -755/
15 Vector Opertions (3,4,5) 3 5 (3,-,-3) (6,,) 3 Opertions tell us how to get from ({}) to the result of the vector opertions (345)+(3 (3,4,5) (3,-,-3) 3)=(6) (6,,) 6 Aug -755/
16 Opertions exmple Rndom(3,columns(M)) 6 5 Adding rndom vlues to different representtions of the imge -755/8-797 representtions of the imge 6 Aug 6
17 Vector norm Mesure of how ig vector is: Notted s x In Mnhttn vectors mesure of distnce MATLAB syntx: norm(x) [-v 7st] [-6v st] 6 Aug -755/
18 Vector Norm Length = sqrt( ) (3,4,5) Geometriclly the shortest distnce to trvel from the origin to the destintion As the crow flies Assuming Eucliden Geometry 6 Aug -755/
19 Trnsposition A trnsposed row vector ecomes column (nd vice vers) x, x T c c T T y c, y T c A trnsposed mtrix gets ll its row (or column) vectors trnsposed in order X c d e f, X T c MATLAB syntx: d e f M, M T 6 Aug -755/
20 Vector multipliction Multipliction is not element-wise! Dot product, or inner product Vectors must hve the sme numer of elements Row vector times column vector = sclr d c e d e c f f Cross product, outer product or vector direct product Column vector times row vector = mtrix d e f d e f d e f c c d ce c f MATLAB syntx: * 6 Aug -755/8-797
21 dot product s Projection Multiplying the yrd vectors Insted of venue/street we ll use yrds = [ 6], = [77 3] The dot product of the two vectors reltes to the length of projection How much of the first vector hve we covered y following the second one? The nswer comes ck s unit of the first vector so we divide y its length T yd 6 [yd 6yd] norm 6 norm 393yd [77yd 3yd] norm 86 6 Aug -755/8-797
22 Vector dot product D S D Sqrt(ene ergy) frequency Vectors re spectr frequency frequency Energy t discrete set of frequencies Actully x496 X xis is the index of the numer in the vector Represents frequency Y xis is the vlue of the numer in the vector Represents mgnitude 6 Aug -755/8-797
23 Vector dot product D S D Sqrt(ene ergy) frequency frequency frequency How much of D is lso in S How much cn you fke D y plying n S DS / D S = Not very much How much of D is in D? DD / D / D = 5 Not d, you cn fke it To do this, D, S, nd D must e the sme size 6 Aug -755/
24 Vector cross product The column vector is the spectrum The row vector is n mplitude modultion The crossproduct is spectrogrm Shows how the energy in ech frequency vries with time The pttern in ech column is scled version of the spectrum Ech row is scled version of the modultion 6 Aug -755/
25 Mtrix multipliction Generliztion of vector multipliction Dot product of ech vector pir A B Dimensions i must mtch!! Columns of first mtrix = rows of second Result inherits the numer of rows from the first mtrix nd the numer of columns from the second mtrix MATLAB syntx: * 6 Aug -755/
26 Multiplying Vector y Mtrix Y (,:) 9 Y (,:) 8 9 YX Y X 6 Multipliction li of vector X y mtrix Y expresses the vector X in terms of projections of X on the row vectors of the mtrix Y It scles nd rottes the vector Alterntely t l viewed, it scles nd rottes t the spce the underlying plne 6 Aug -755/
27 Mtrix Multipliction Y The mtrix rottes nd scles the spce Including its own vectors 6 Aug -755/
28 Mtrix Multipliction The normls to the row vectors in the mtrix ecome the new xes X xis = norml to the second row vector Scled y the inverse of the length of the first row vector 6 Aug -755/
29 Mtrix Multipliction is projection The k-th xis corresponds to the norml to the hyperplne represented y the k-,k+n-th row vectors in the mtrix Any set of K- vectors represent hyperplne of dimension K- or less The distnce long the new xis equls the length of the projection on the k-th row vector Expressed in inverse-lengths of the vector 6 Aug -755/
30 Mtrix Multipliction: Column spce c z y x y x c So much for spces wht does multiplying f e y d z y f e d So much for spces wht does multiplying mtrix y vector relly do? It mixes the column vectors of the mtrix It mixes the column vectors of the mtrix using the numers in the vector The column spce of the Mtrix is the The column spce of the Mtrix is the complete set of ll vectors tht cn e formed y mixing its columns -755/8-797 y mixing its columns 6 Aug 3
31 Mtrix Multipliction: Row spce d c f x y x c y d e f e Left multipliction mixes the row vectors of the mtrix The row spce of the Mtrix is the complete set of ll vectors tht cn e formed y mixing its rows 6 Aug -755/
32 Mtrix multipliction: Mixing vectors X Y = 7 A physicl exmple The three column vectors of the mtrix X re the spectr of three notes The multiplying column vector Y is just mixing vector The result is sound tht is the mixture of the three notes 6 Aug -755/
33 Mtrix multipliction: Mixing vectors x x x 5 75 x 4 x 4 x Mixing two imges The imges re rrnged s columns position vlue not included The result of the multipliction is rerrnged s n imge 6 Aug -755/
34 Mtrix multipliction: nother view k kk k k k k NK N N B A Wht does this men? k kk Mk k k Mk NK N MN M Wht does this men? N N NK N MN K M K M NK N NK MN M N MN M M MN M The outer product of the first column of A nd the first fb+ t d t fth d l fa d -755/8-797 row of B + outer product of the second column of A nd the second row of B + 6 Aug 34
35 Why is tht useful? Y X Sounds: Three notes modulted independently 6 Aug -755/
36 Mtrix multipliction: Mixing modulted spectr Y X Sounds: Three notes modulted independently 6 Aug -755/
37 Mtrix multipliction: Mixing modulted spectr Y X Sounds: Three notes modulted independently 6 Aug -755/
38 Mtrix multipliction: Mixing modulted spectr X Sounds: Three notes modulted independently 6 Aug -755/
39 Mtrix multipliction: Mixing modulted spectr X Sounds: Three notes modulted independently 6 Aug -755/
40 Mtrix multipliction: Mixing modulted spectr Sounds: Three notes modulted independently 6 Aug -755/
41 Mtrix multipliction: Imge trnsition i j i j Imge fdes out linerly Imge fdes in linerly 6 Aug -755/
42 Mtrix multipliction: Imge trnsition i j i j Ech column is one imge i 9 i 8 i i 9 9 i 8 8 i in 9 in 8 in The columns represent sequence of imges of decresing intensity Imge fdes out linerly 6 Aug -755/
43 Mtrix multipliction: Imge trnsition i j i j Imge fdes in linerly 6 Aug -755/
44 Mtrix multipliction: Imge trnsition i j i j Imge fdes out linerly Imge fdes in linerly 6 Aug -755/
45 The Identity Mtrix Y An identity mtrix is squre mtrix where All digonl elements re All off-digonl elements re Multipliction y n identity mtrix does not chnge vectors 6 Aug -755/
46 Digonl Mtrix Y All off-digonl elements re zero Digonl elements re non-zero Scles the xes My flip xes 6 Aug -755/
47 Digonl mtrix to trnsform imges How? 6 Aug -755/
48 Stretching 5 6 Loction-sed representtion Scling mtrix only scles the X xis The Y xis nd pixel vlue re scled y identity Not good wy of scling 6 Aug -755/
49 Stretching D = A 5 5 Newpic 5 5 EA ( NxN) Better wy 6 Aug -755/
50 Modifying color B G R P P Newpic Scle only Green -755/8-797 y 6 Aug 5
51 Permuttion Mtrix x y 5 y z Y Z z x 4 (3,4,5) Z(oldX) Y (old Z) X 3 X (old Y) A permuttion mtrix simply rerrnges the xes The row entries re xis vectors in different order The result is comintion of rottions nd reflections The permuttion mtrix effectively permutes the rrngement of the elements in vector 6 Aug -755/
52 Permuttion Mtrix P P 6 5 Reflections nd 9 degree rottions of imges nd ojects -755/8-797 imges nd ojects 6 Aug 5
53 Permuttion Mtrix P P P P N x x x Reflections nd 9 degree rottions of imges nd ojects N N z z z y y y Reflections nd 9 degree rottions of imges nd ojects Oject represented s mtrix of 3-Dimensionl position vectors Positions identify ech point on the surfce -755/8-797 Positions identify ech point on the surfce 6 Aug 53
54 Rottion Mtrix Y x' y' x cos xsin y sin y cos (x,y) R cos sin sin cos x X y x' X new y' y y Y R X X new (x,y ) (x,y) X X x x A rottion mtrix rottes the vector y some ngle Alterntely viewed, it rottes the xes The new xes re t n ngle to the old one 6 Aug -755/
55 Rotting picture 45 cos 45 sin 45 sin 45 cos R Note the representtion: 3-row mtrix Note the representtion: 3 row mtrix Rottion only pplies on the coordinte rows The vlue does not chnge Why is pcmn griny? -755/8-797 Why is pcmn griny? 6 Aug 55
56 3-D Rottion Xnew Ynew Z Y Znew X degrees of freedom seprte ngles Wht will the rottion mtrix e? 6 Aug -755/
11-755/ Machine Learning for Signal Processing. Algebra. Class Sep Instructor: Bhiksha Raj
-755/8-797 Mchine Lerning for Signl Processing Fundmentls of Liner Alger Clss -3 Sep Instructor: Bhiksh Rj Sep -755/8-797 Administrivi Registrtion: Anyone on witlist still? Homework : Will e hnded out
More informationFundamentals of Linear Algebra
-7/8-797 Mchine Lerning for Signl rocessing Fundmentls of Liner Alger Administrivi Registrtion: Anone on witlist still? Homework : Will e hnded out with clss Liner lger Clss - Sep Instructor: Bhiksh Rj
More informationMachine Learning for Signal Processing Fundamentals of Linear Algebra
Mchine Lerning for Signl Processing Fundmentls of Liner Alger Clss 6 Sep 6 Instructor: Bhiksh Rj -755/8-797 Overview Vectors nd mtrices Bsic vector/mtrix opertions Vrious mtrix types Projections -755/8-797
More informationFundamentals of Linear Algebra
-7/8-797 Mchine Lerning for Signl Processing Fundmentls of Liner Alger Administrivi Registrtion: Anone on witlist still? Homewor : Will pper over weeend Liner lger Clss Aug Instructor: Bhish Rj -7/8-797
More informationThings to Memorize: A Partial List. January 27, 2017
Things to Memorize: A Prtil List Jnury 27, 2017 Chpter 2 Vectors - Bsic Fcts A vector hs mgnitude (lso clled size/length/norm) nd direction. It does not hve fixed position, so the sme vector cn e moved
More informationAnalytically, vectors will be represented by lowercase bold-face Latin letters, e.g. a, r, q.
1.1 Vector Alger 1.1.1 Sclrs A physicl quntity which is completely descried y single rel numer is clled sclr. Physiclly, it is something which hs mgnitude, nd is completely descried y this mgnitude. Exmples
More informationMatrix Algebra. Matrix Addition, Scalar Multiplication and Transposition. Linear Algebra I 24
Mtrix lger Mtrix ddition, Sclr Multipliction nd rnsposition Mtrix lger Section.. Mtrix ddition, Sclr Multipliction nd rnsposition rectngulr rry of numers is clled mtrix ( the plurl is mtrices ) nd the
More informationMatrices. Elementary Matrix Theory. Definition of a Matrix. Matrix Elements:
Mtrices Elementry Mtrix Theory It is often desirble to use mtrix nottion to simplify complex mthemticl expressions. The simplifying mtrix nottion usully mkes the equtions much esier to hndle nd mnipulte.
More informationHow do we solve these things, especially when they get complicated? How do we know when a system has a solution, and when is it unique?
XII. LINEAR ALGEBRA: SOLVING SYSTEMS OF EQUATIONS Tody we re going to tlk out solving systems of liner equtions. These re prolems tht give couple of equtions with couple of unknowns, like: 6= x + x 7=
More informationUses of transformations. 3D transformations. Review of vectors. Vectors in 3D. Points vs. vectors. Homogeneous coordinates S S [ H [ S \ H \ S ] H ]
Uses of trnsformtions 3D trnsformtions Modeling: position nd resize prts of complex model; Viewing: define nd position the virtul cmer Animtion: define how objects move/chnge with time y y Sclr (dot) product
More informationChapter 3 MATRIX. In this chapter: 3.1 MATRIX NOTATION AND TERMINOLOGY
Chpter 3 MTRIX In this chpter: Definition nd terms Specil Mtrices Mtrix Opertion: Trnspose, Equlity, Sum, Difference, Sclr Multipliction, Mtrix Multipliction, Determinnt, Inverse ppliction of Mtrix in
More informationMATRICES AND VECTORS SPACE
MATRICES AND VECTORS SPACE MATRICES AND MATRIX OPERATIONS SYSTEM OF LINEAR EQUATIONS DETERMINANTS VECTORS IN -SPACE AND -SPACE GENERAL VECTOR SPACES INNER PRODUCT SPACES EIGENVALUES, EIGENVECTORS LINEAR
More informationGeometric Sequences. Geometric Sequence a sequence whose consecutive terms have a common ratio.
Geometric Sequences Geometric Sequence sequence whose consecutive terms hve common rtio. Geometric Sequence A sequence is geometric if the rtios of consecutive terms re the sme. 2 3 4... 2 3 The number
More informationHow do we solve these things, especially when they get complicated? How do we know when a system has a solution, and when is it unique?
XII. LINEAR ALGEBRA: SOLVING SYSTEMS OF EQUATIONS Tody we re going to tlk bout solving systems of liner equtions. These re problems tht give couple of equtions with couple of unknowns, like: 6 2 3 7 4
More informationIntroduction To Matrices MCV 4UI Assignment #1
Introduction To Mtrices MCV UI Assignment # INTRODUCTION: A mtrix plurl: mtrices) is rectngulr rry of numbers rrnged in rows nd columns Exmples: ) b) c) [ ] d) Ech number ppering in the rry is sid to be
More informationReview of Gaussian Quadrature method
Review of Gussin Qudrture method Nsser M. Asi Spring 006 compiled on Sundy Decemer 1, 017 t 09:1 PM 1 The prolem To find numericl vlue for the integrl of rel vlued function of rel vrile over specific rnge
More informationMATRIX DEFINITION A matrix is any doubly subscripted array of elements arranged in rows and columns.
4.5 THEORETICL SOIL MECHNICS Vector nd Mtrix lger Review MTRIX DEFINITION mtrix is ny douly suscripted rry of elements rrnged in rows nd columns. m - Column Revised /0 n -Row m,,,,,, n n mn ij nd Order
More informationTo Do. Vectors. Motivation and Outline. Vector Addition. Cartesian Coordinates. Foundations of Computer Graphics (Spring 2010) x y
Foundtions of Computer Grphics (Spring 2010) CS 184, Lecture 2: Review of Bsic Mth http://inst.eecs.erkeley.edu/~cs184 o Do Complete Assignment 0 Downlod nd compile skeleton for ssignment 1 Red instructions
More informationLecture 8 Wrap-up Part1, Matlab
Lecture 8 Wrp-up Prt1, Mtlb Homework Polic Plese stple our homework (ou will lose 10% credit if not stpled or secured) Submit ll problems in order. This mens to plce ever item relting to problem 3 (our
More informationHere we study square linear systems and properties of their coefficient matrices as they relate to the solution set of the linear system.
Section 24 Nonsingulr Liner Systems Here we study squre liner systems nd properties of their coefficient mtrices s they relte to the solution set of the liner system Let A be n n Then we know from previous
More informationChapter 14. Matrix Representations of Linear Transformations
Chpter 4 Mtrix Representtions of Liner Trnsformtions When considering the Het Stte Evolution, we found tht we could describe this process using multipliction by mtrix. This ws nice becuse computers cn
More informationHW3, Math 307. CSUF. Spring 2007.
HW, Mth 7. CSUF. Spring 7. Nsser M. Abbsi Spring 7 Compiled on November 5, 8 t 8:8m public Contents Section.6, problem Section.6, problem Section.6, problem 5 Section.6, problem 7 6 5 Section.6, problem
More informationLecture 3. In this lecture, we will discuss algorithms for solving systems of linear equations.
Lecture 3 3 Solving liner equtions In this lecture we will discuss lgorithms for solving systems of liner equtions Multiplictive identity Let us restrict ourselves to considering squre mtrices since one
More informationMATH1131 Mathematics 1A Algebra
MATH1131 Mthemtics 1A Alger UNSW Sydney Semester 1, 017 Mike Mssierer Mike is pronounced like Mich mike@unsweduu Plese emil me if you hve ny questions or comments Office hours TBA (week ), or emil me to
More informationOn the diagram below the displacement is represented by the directed line segment OA.
Vectors Sclrs nd Vectors A vector is quntity tht hs mgnitude nd direction. One exmple of vector is velocity. The velocity of n oject is determined y the mgnitude(speed) nd direction of trvel. Other exmples
More informationChapter 2. Vectors. 2.1 Vectors Scalars and Vectors
Chpter 2 Vectors 2.1 Vectors 2.1.1 Sclrs nd Vectors A vector is quntity hving both mgnitude nd direction. Emples of vector quntities re velocity, force nd position. One cn represent vector in n-dimensionl
More informationMath 520 Final Exam Topic Outline Sections 1 3 (Xiao/Dumas/Liaw) Spring 2008
Mth 520 Finl Exm Topic Outline Sections 1 3 (Xio/Dums/Liw) Spring 2008 The finl exm will be held on Tuesdy, My 13, 2-5pm in 117 McMilln Wht will be covered The finl exm will cover the mteril from ll of
More informationNumerical Linear Algebra Assignment 008
Numericl Liner Algebr Assignment 008 Nguyen Qun B Hong Students t Fculty of Mth nd Computer Science, Ho Chi Minh University of Science, Vietnm emil. nguyenqunbhong@gmil.com blog. http://hongnguyenqunb.wordpress.com
More informationComputer Graphics (CS 4731) Lecture 7: Linear Algebra for Graphics (Points, Scalars, Vectors)
Computer Grphics (CS 4731) Lecture 7: Liner Alger for Grphics (Points, Sclrs, Vectors) Prof Emmnuel Agu Computer Science Dept. Worcester Poltechnic Institute (WPI) Annoncements Project 1 due net Tuesd,
More informationPartial Derivatives. Limits. For a single variable function f (x), the limit lim
Limits Prtil Derivtives For single vrible function f (x), the limit lim x f (x) exists only if the right-hnd side limit equls to the left-hnd side limit, i.e., lim f (x) = lim f (x). x x + For two vribles
More informationLecture 0. MATH REVIEW for ECE : LINEAR CIRCUIT ANALYSIS II
Lecture 0 MATH REVIEW for ECE 000 : LINEAR CIRCUIT ANALYSIS II Aung Kyi Sn Grdute Lecturer School of Electricl nd Computer Engineering Purdue University Summer 014 Lecture 0 : Mth Review Lecture 0 is intended
More informationINTRODUCTION TO LINEAR ALGEBRA
ME Applied Mthemtics for Mechnicl Engineers INTRODUCTION TO INEAR AGEBRA Mtrices nd Vectors Prof. Dr. Bülent E. Pltin Spring Sections & / ME Applied Mthemtics for Mechnicl Engineers INTRODUCTION TO INEAR
More informationS56 (5.3) Vectors.notebook January 29, 2016
Dily Prctice 15.1.16 Q1. The roots of the eqution (x 1)(x + k) = 4 re equl. Find the vlues of k. Q2. Find the rte of chnge of 剹 x when x = 1 / 8 Tody we will e lerning out vectors. Q3. Find the eqution
More informationLecture 2e Orthogonal Complement (pages )
Lecture 2e Orthogonl Complement (pges -) We hve now seen tht n orthonorml sis is nice wy to descrie suspce, ut knowing tht we wnt n orthonorml sis doesn t mke one fll into our lp. In theory, the process
More information1.2 What is a vector? (Section 2.2) Two properties (attributes) of a vector are and.
Homework 1. Chpters 2. Bsis independent vectors nd their properties Show work except for fill-in-lnks-prolems (print.pdf from www.motiongenesis.com Textooks Resources). 1.1 Solving prolems wht engineers
More informationBasics of space and vectors. Points and distance. Vectors
Bsics of spce nd vectors Points nd distnce One wy to describe our position in three dimensionl spce is using Crtesin coordintes x, y, z) where we hve fixed three orthogonl directions nd we move x units
More informationOverview of Today s Lecture:
CPS 4 Computer Orgniztion nd Progrmming Lecture : Boolen Alger & gtes. Roert Wgner CPS4 BA. RW Fll 2 Overview of Tody s Lecture: Truth tles, Boolen functions, Gtes nd Circuits Krnugh mps for simplifying
More informationQuadratic Forms. Quadratic Forms
Qudrtic Forms Recll the Simon & Blume excerpt from n erlier lecture which sid tht the min tsk of clculus is to pproximte nonliner functions with liner functions. It s ctully more ccurte to sy tht we pproximte
More informationset is not closed under matrix [ multiplication, ] and does not form a group.
Prolem 2.3: Which of the following collections of 2 2 mtrices with rel entries form groups under [ mtrix ] multipliction? i) Those of the form for which c d 2 Answer: The set of such mtrices is not closed
More informationChapter 4 Contravariance, Covariance, and Spacetime Diagrams
Chpter 4 Contrvrince, Covrince, nd Spcetime Digrms 4. The Components of Vector in Skewed Coordintes We hve seen in Chpter 3; figure 3.9, tht in order to show inertil motion tht is consistent with the Lorentz
More informationLecture Solution of a System of Linear Equation
ChE Lecture Notes, Dept. of Chemicl Engineering, Univ. of TN, Knoville - D. Keffer, 5/9/98 (updted /) Lecture 8- - Solution of System of Liner Eqution 8. Why is it importnt to e le to solve system of liner
More informationSection 6: Area, Volume, and Average Value
Chpter The Integrl Applied Clculus Section 6: Are, Volume, nd Averge Vlue Are We hve lredy used integrls to find the re etween the grph of function nd the horizontl xis. Integrls cn lso e used to find
More information4 VECTORS. 4.0 Introduction. Objectives. Activity 1
4 VECTRS Chpter 4 Vectors jectives fter studying this chpter you should understnd the difference etween vectors nd sclrs; e le to find the mgnitude nd direction of vector; e le to dd vectors, nd multiply
More information308K. 1 Section 3.2. Zelaya Eufemia. 1. Example 1: Multiplication of Matrices: X Y Z R S R S X Y Z. By associativity we have to choices:
8K Zely Eufemi Section 2 Exmple : Multipliction of Mtrices: X Y Z T c e d f 2 R S X Y Z 2 c e d f 2 R S 2 By ssocitivity we hve to choices: OR: X Y Z R S cr ds er fs X cy ez X dy fz 2 R S 2 Suggestion
More information7.1 Integral as Net Change and 7.2 Areas in the Plane Calculus
7.1 Integrl s Net Chnge nd 7. Ares in the Plne Clculus 7.1 INTEGRAL AS NET CHANGE Notecrds from 7.1: Displcement vs Totl Distnce, Integrl s Net Chnge We hve lredy seen how the position of n oject cn e
More informationCHAPTER 1 PROGRAM OF MATRICES
CHPTER PROGRM OF MTRICES -- INTRODUCTION definition of engineering is the science y which the properties of mtter nd sources of energy in nture re mde useful to mn. Thus n engineer will hve to study the
More information2. VECTORS AND MATRICES IN 3 DIMENSIONS
2 VECTORS AND MATRICES IN 3 DIMENSIONS 21 Extending the Theory of 2-dimensionl Vectors x A point in 3-dimensionl spce cn e represented y column vector of the form y z z-xis y-xis z x y x-xis Most of the
More informationSeptember 13 Homework Solutions
College of Engineering nd Computer Science Mechnicl Engineering Deprtment Mechnicl Engineering 5A Seminr in Engineering Anlysis Fll Ticket: 5966 Instructor: Lrry Cretto Septemer Homework Solutions. Are
More informationTABLE OF CONTENTS 3 CHAPTER 1
TABLE OF CONTENTS 3 CHAPTER 1 Set Lnguge & Nottion 3 CHAPTER 2 Functions 3 CHAPTER 3 Qudrtic Functions 4 CHAPTER 4 Indices & Surds 4 CHAPTER 5 Fctors of Polynomils 4 CHAPTER 6 Simultneous Equtions 4 CHAPTER
More informationVectors. Introduction. Definition. The Two Components of a Vector. Vectors
Vectors Introduction This pper covers generl description of vectors first (s cn e found in mthemtics ooks) nd will stry into the more prcticl res of grphics nd nimtion. Anyone working in grphics sujects
More informationdx dt dy = G(t, x, y), dt where the functions are defined on I Ω, and are locally Lipschitz w.r.t. variable (x, y) Ω.
Chpter 8 Stility theory We discuss properties of solutions of first order two dimensionl system, nd stility theory for specil clss of liner systems. We denote the independent vrile y t in plce of x, nd
More informationAnalytical Methods for Materials
Anlyticl Methods for Mterils Lesson 7 Crystl Geometry nd Crystllogrphy, Prt 1 Suggested Reding Chpters 2 nd 6 in Wsed et l. 169 Slt crystls N Cl http://helthfreedoms.org/2009/05/24/tble-slt-vs-unrefined-se-slt--primer/
More informationMatrix Solution to Linear Equations and Markov Chains
Trding Systems nd Methods, Fifth Edition By Perry J. Kufmn Copyright 2005, 2013 by Perry J. Kufmn APPENDIX 2 Mtrix Solution to Liner Equtions nd Mrkov Chins DIRECT SOLUTION AND CONVERGENCE METHOD Before
More informationBest Approximation in the 2-norm
Jim Lmbers MAT 77 Fll Semester 1-11 Lecture 1 Notes These notes correspond to Sections 9. nd 9.3 in the text. Best Approximtion in the -norm Suppose tht we wish to obtin function f n (x) tht is liner combintion
More informationOperations with Matrices
Section. Equlit of Mtrices Opertions with Mtrices There re three ws to represent mtri.. A mtri cn be denoted b n uppercse letter, such s A, B, or C.. A mtri cn be denoted b representtive element enclosed
More information1 Linear Least Squares
Lest Squres Pge 1 1 Liner Lest Squres I will try to be consistent in nottion, with n being the number of dt points, nd m < n being the number of prmeters in model function. We re interested in solving
More informationLecture 19: Continuous Least Squares Approximation
Lecture 19: Continuous Lest Squres Approximtion 33 Continuous lest squres pproximtion We begn 31 with the problem of pproximting some f C[, b] with polynomil p P n t the discrete points x, x 1,, x m for
More informationThe Algebra (al-jabr) of Matrices
Section : Mtri lgebr nd Clculus Wshkewicz College of Engineering he lgebr (l-jbr) of Mtrices lgebr s brnch of mthemtics is much broder thn elementry lgebr ll of us studied in our high school dys. In sense
More informationTHE DISCRIMINANT & ITS APPLICATIONS
THE DISCRIMINANT & ITS APPLICATIONS The discriminnt ( Δ ) is the epression tht is locted under the squre root sign in the qudrtic formul i.e. Δ b c. For emple: Given +, Δ () ( )() The discriminnt is used
More informationWeek 10: Line Integrals
Week 10: Line Integrls Introduction In this finl week we return to prmetrised curves nd consider integrtion long such curves. We lredy sw this in Week 2 when we integrted long curve to find its length.
More informationHigher Checklist (Unit 3) Higher Checklist (Unit 3) Vectors
Vectors Skill Achieved? Know tht sclr is quntity tht hs only size (no direction) Identify rel-life exmples of sclrs such s, temperture, mss, distnce, time, speed, energy nd electric chrge Know tht vector
More informationExploring parametric representation with the TI-84 Plus CE graphing calculator
Exploring prmetric representtion with the TI-84 Plus CE grphing clcultor Richrd Prr Executive Director Rice University School Mthemtics Project rprr@rice.edu Alice Fisher Director of Director of Technology
More informationLecture 6. Notes. Notes. Notes. Representations Z A B and A B R. BTE Electronics Fundamentals August Bern University of Applied Sciences
Lecture 6 epresenttions epresenttions TE52 - Electronics Fundmentls ugust 24 ern University of pplied ciences ev. c2d5c88 6. Integers () sign-nd-mgnitude representtion The set of integers contins the Nturl
More informationThe practical version
Roerto s Notes on Integrl Clculus Chpter 4: Definite integrls nd the FTC Section 7 The Fundmentl Theorem of Clculus: The prcticl version Wht you need to know lredy: The theoreticl version of the FTC. Wht
More informationSection 17.2 Line Integrals
Section 7. Line Integrls Integrting Vector Fields nd Functions long urve In this section we consider the problem of integrting functions, both sclr nd vector (vector fields) long curve in the plne. We
More informationMatrices and Determinants
Nme Chpter 8 Mtrices nd Determinnts Section 8.1 Mtrices nd Systems of Equtions Objective: In this lesson you lerned how to use mtrices, Gussin elimintion, nd Guss-Jordn elimintion to solve systems of liner
More informationTHREE-DIMENSIONAL KINEMATICS OF RIGID BODIES
THREE-DIMENSIONAL KINEMATICS OF RIGID BODIES 1. TRANSLATION Figure shows rigid body trnslting in three-dimensionl spce. Any two points in the body, such s A nd B, will move long prllel stright lines if
More informationLecture Note 9: Orthogonal Reduction
MATH : Computtionl Methods of Liner Algebr 1 The Row Echelon Form Lecture Note 9: Orthogonl Reduction Our trget is to solve the norml eution: Xinyi Zeng Deprtment of Mthemticl Sciences, UTEP A t Ax = A
More informationSOLUTIONS FOR ADMISSIONS TEST IN MATHEMATICS, COMPUTER SCIENCE AND JOINT SCHOOLS WEDNESDAY 5 NOVEMBER 2014
SOLUTIONS FOR ADMISSIONS TEST IN MATHEMATICS, COMPUTER SCIENCE AND JOINT SCHOOLS WEDNESDAY 5 NOVEMBER 014 Mrk Scheme: Ech prt of Question 1 is worth four mrks which re wrded solely for the correct nswer.
More informationDEFINITION OF ASSOCIATIVE OR DIRECT PRODUCT AND ROTATION OF VECTORS
3 DEFINITION OF ASSOCIATIVE OR DIRECT PRODUCT AND ROTATION OF VECTORS This chpter summrizes few properties of Cli ord Algebr nd describe its usefulness in e ecting vector rottions. 3.1 De nition of Associtive
More informationVectors , (0,0). 5. A vector is commonly denoted by putting an arrow above its symbol, as in the picture above. Here are some 3-dimensional vectors:
Vectors 1-23-2018 I ll look t vectors from n lgeric point of view nd geometric point of view. Algericlly, vector is n ordered list of (usully) rel numers. Here re some 2-dimensionl vectors: (2, 3), ( )
More informationMath 113 Fall Final Exam Review. 2. Applications of Integration Chapter 6 including sections and section 6.8
Mth 3 Fll 0 The scope of the finl exm will include: Finl Exm Review. Integrls Chpter 5 including sections 5. 5.7, 5.0. Applictions of Integrtion Chpter 6 including sections 6. 6.5 nd section 6.8 3. Infinite
More informationCoordinate geometry and vectors
MST124 Essentil mthemtics 1 Unit 5 Coordinte geometry nd vectors Contents Contents Introduction 4 1 Distnce 5 1.1 The distnce etween two points in the plne 5 1.2 Midpoints nd perpendiculr isectors 7 2
More informationFirst midterm topics Second midterm topics End of quarter topics. Math 3B Review. Steve. 18 March 2009
Mth 3B Review Steve 18 Mrch 2009 About the finl Fridy Mrch 20, 3pm-6pm, Lkretz 110 No notes, no book, no clcultor Ten questions Five review questions (Chpters 6,7,8) Five new questions (Chpters 9,10) No
More information7.1 Integral as Net Change Calculus. What is the total distance traveled? What is the total displacement?
7.1 Integrl s Net Chnge Clculus 7.1 INTEGRAL AS NET CHANGE Distnce versus Displcement We hve lredy seen how the position of n oject cn e found y finding the integrl of the velocity function. The chnge
More informationCHAPTER 2d. MATRICES
CHPTER d. MTRICES University of Bhrin Deprtment of Civil nd rch. Engineering CEG -Numericl Methods in Civil Engineering Deprtment of Civil Engineering University of Bhrin Every squre mtrix hs ssocited
More informationJim Lambers MAT 169 Fall Semester Lecture 4 Notes
Jim Lmbers MAT 169 Fll Semester 2009-10 Lecture 4 Notes These notes correspond to Section 8.2 in the text. Series Wht is Series? An infinte series, usully referred to simply s series, is n sum of ll of
More informationMatrix Eigenvalues and Eigenvectors September 13, 2017
Mtri Eigenvlues nd Eigenvectors September, 7 Mtri Eigenvlues nd Eigenvectors Lrry Cretto Mechnicl Engineering 5A Seminr in Engineering Anlysis September, 7 Outline Review lst lecture Definition of eigenvlues
More informationAT100 - Introductory Algebra. Section 2.7: Inequalities. x a. x a. x < a
Section 2.7: Inequlities In this section, we will Determine if given vlue is solution to n inequlity Solve given inequlity or compound inequlity; give the solution in intervl nottion nd the solution 2.7
More informationA matrix is a set of numbers or symbols arranged in a square or rectangular array of m rows and n columns as
RMI University ENDIX MRIX GEBR INRDUCIN Mtrix lgebr is powerful mthemticl tool, which is extremely useful in modern computtionl techniques pplicble to sptil informtion science. It is neither new nor difficult,
More informationEngineering Analysis ENG 3420 Fall Dan C. Marinescu Office: HEC 439 B Office hours: Tu-Th 11:00-12:00
Engineering Anlysis ENG 3420 Fll 2009 Dn C. Mrinescu Office: HEC 439 B Office hours: Tu-Th 11:00-12:00 Lecture 13 Lst time: Problem solving in preprtion for the quiz Liner Algebr Concepts Vector Spces,
More informationMultiple Integrals. Review of Single Integrals. Planar Area. Volume of Solid of Revolution
Multiple Integrls eview of Single Integrls eding Trim 7.1 eview Appliction of Integrls: Are 7. eview Appliction of Integrls: Volumes 7.3 eview Appliction of Integrls: Lengths of Curves Assignment web pge
More informationKINEMATICS OF RIGID BODIES
KINEMTICS OF RIGID ODIES Introduction In rigid body kinemtics, e use the reltionships governing the displcement, velocity nd ccelertion, but must lso ccount for the rottionl motion of the body. Description
More informationLesson Notes: Week 40-Vectors
Lesson Notes: Week 40-Vectors Vectors nd Sclrs vector is quntity tht hs size (mgnitude) nd direction. Exmples of vectors re displcement nd velocity. sclr is quntity tht hs size but no direction. Exmples
More informationECON 331 Lecture Notes: Ch 4 and Ch 5
Mtrix Algebr ECON 33 Lecture Notes: Ch 4 nd Ch 5. Gives us shorthnd wy of writing lrge system of equtions.. Allows us to test for the existnce of solutions to simultneous systems. 3. Allows us to solve
More information13: Diffusion in 2 Energy Groups
3: Diffusion in Energy Groups B. Rouben McMster University Course EP 4D3/6D3 Nucler Rector Anlysis (Rector Physics) 5 Sept.-Dec. 5 September Contents We study the diffusion eqution in two energy groups
More informationODE: Existence and Uniqueness of a Solution
Mth 22 Fll 213 Jerry Kzdn ODE: Existence nd Uniqueness of Solution The Fundmentl Theorem of Clculus tells us how to solve the ordinry differentil eqution (ODE) du = f(t) dt with initil condition u() =
More informationMATH 13 FINAL STUDY GUIDE, WINTER 2012
MATH 13 FINAL TUY GUI, WINTR 2012 This is ment to be quick reference guide for the topics you might wnt to know for the finl. It probbly isn t comprehensive, but should cover most of wht we studied in
More informationMatrices 13: determinant properties and rules continued
Mtrices : determinnt properties nd rules continued nthony Rossiter http://controleduction.group.shef.c.uk/indexwebbook.html http://www.shef.c.uk/cse Deprtment of utomtic Control nd Systems Engineering
More informationSCHOOL OF ENGINEERING & BUILT ENVIRONMENT
SCHOOL OF ENGINEERING & BUIL ENVIRONMEN MARICES FOR ENGINEERING Dr Clum Mcdonld Contents Introduction Definitions Wht is mtri? Rows nd columns of mtri Order of mtri Element of mtri Equlity of mtrices Opertions
More informationDifferential Geometry: Conformal Maps
Differentil Geometry: Conforml Mps Liner Trnsformtions Definition: We sy tht liner trnsformtion M:R n R n preserves ngles if M(v) 0 for ll v 0 nd: Mv, Mw v, w Mv Mw v w for ll v nd w in R n. Liner Trnsformtions
More informationA Matrix Algebra Primer
A Mtrix Algebr Primer Mtrices, Vectors nd Sclr Multipliction he mtrix, D, represents dt orgnized into rows nd columns where the rows represent one vrible, e.g. time, nd the columns represent second vrible,
More informationBases for Vector Spaces
Bses for Vector Spces 2-26-25 A set is independent if, roughly speking, there is no redundncy in the set: You cn t uild ny vector in the set s liner comintion of the others A set spns if you cn uild everything
More informationMath 33A Discussion Example Austin Christian October 23, Example 1. Consider tiling the plane by equilateral triangles, as below.
Mth 33A Discussion Exmple Austin Christin October 3 6 Exmple Consider tiling the plne by equilterl tringles s below Let v nd w be the ornge nd green vectors in this figure respectively nd let {v w} be
More informationMath 8 Winter 2015 Applications of Integration
Mth 8 Winter 205 Applictions of Integrtion Here re few importnt pplictions of integrtion. The pplictions you my see on n exm in this course include only the Net Chnge Theorem (which is relly just the Fundmentl
More informationLine and Surface Integrals: An Intuitive Understanding
Line nd Surfce Integrls: An Intuitive Understnding Joseph Breen Introduction Multivrible clculus is ll bout bstrcting the ides of differentition nd integrtion from the fmilir single vrible cse to tht of
More information8. Complex Numbers. We can combine the real numbers with this new imaginary number to form the complex numbers.
8. Complex Numers The rel numer system is dequte for solving mny mthemticl prolems. But it is necessry to extend the rel numer system to solve numer of importnt prolems. Complex numers do not chnge the
More informationCS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 2
CS434/54: Pttern Recognition Prof. Olg Veksler Lecture Outline Review of Liner Algebr vectors nd mtrices products nd norms vector spces nd liner trnsformtions eigenvlues nd eigenvectors Introduction to
More informationModule 6: LINEAR TRANSFORMATIONS
Module 6: LINEAR TRANSFORMATIONS. Trnsformtions nd mtrices Trnsformtions re generliztions of functions. A vector x in some set S n is mpped into m nother vector y T( x). A trnsformtion is liner if, for
More informationLecture 3: Equivalence Relations
Mthcmp Crsh Course Instructor: Pdric Brtlett Lecture 3: Equivlence Reltions Week 1 Mthcmp 2014 In our lst three tlks of this clss, we shift the focus of our tlks from proof techniques to proof concepts
More information