Principal Component Analysis. Nuno Vasconcelos ECE Department, UCSD
|
|
- Beatrix Boone
- 5 years ago
- Views:
Transcription
1 Priipal Compoet Aalysis Nuo Vasoelos ECE Departmet, UCSD
2 Curse of dimesioality typial observatio i Bayes deisio theory: error ireases whe umber of features is large problem: eve for simple models (e.g. Gaussia) we eed large # of eamples to have good estimates Q: what does large mea? his depeds o the dimesio of the spae the best way to see this is to thik of a histogram suppose you have 00 poits ad you eed at least 0 bis per ais i order to get a reasoable quatizatio for uiform data you get, o average, deet id, bad i 2D, terrible i 3D (9 out of eah0 bis empty) dimesio 2 3 poits/bi
3 Curse of dimesioality this is the urse of dimesioality for a give lassifier umber of eamples required to maitai lassifiatio auray ireases epoetially with the dimesio of the spae i higher dimesios the lassifier has more parameters higher ompleity, harder to lear 3
4 Dimesioality redutio what do we do about this? we avoid ueessary dimesios ueessary a be measured i two ways:.features are ot disrimiat 2.features are ot idepedet o-disrimiat meas that they do ot separate the lasses well disrimiat o-disrimiat 4
5 Dimesioality redutio Q: how do we detet the presee of feature orrelatios? A: the data lives i a low dimesioal subspae (up to some amouts of oise). E.g. ew feature y salary o o o o o o o o o oo o o o ar loa projetio oto D subspae: y a salary o o o o o o o o ar loa i the eample above we have a 3D hyper-plae i 5D if we a fid this hyper-plae we a projet the data oto it get rid of half of the dimesios without itroduig sigifiat error 5
6 Priipal ompoet aalysis basi idea: if the data lives i a subspae, it is goig to look very flat whe viewed from the full spae, e.g. D subspae i 2D 2D subspae i 3D this meas that if we fit a Gaussia to the data the iso-probability otours are goig to be highly skewed ellipsoids 6
7 Priipal ompoet aalysis how do we fid these ellipsoids? whe we talked about metris we said that the Mahalaobis distae measures the atural uits for the problem beause it is adapted to the ovariae of the data we also kow that what is speial about it is that it uses Σ - hee, the iformatio must be i Σ d(, y) ( y) Σ ( y) 7
8 Gaussia review the equiprobability otours of a Gaussia are the poits suh that let s osider the hage of variable z -µ, whih oly moves the origi by µ. he equatio is the equatio of a ellipse. this is easy to see whe Σ is diagoal: 8
9 Gaussia review this is the equatio of a ellipse with priipal legths σ i e.g. whe d 2 is the ellipse z 2 σ 2 σ z itrodue the trasformatio y Φ Τ z 9
10 Gaussia review itrodue the trasformatio y Φ Τ z the y has ovariae if Φ is orthoormal this is just a rotatio ad we have y 2 z 2 φ 2 λ2 λ φ y y Φ Τ z σ 2 σ z we obtai a rotated ellipse with priipal ompoets φ ad φ 2 whih are the olums of Φ ote that is the eige-deompositio of Σ y 0
11 Priipal ompoet aalysis If y is Gaussia with ovariae Σ, the equiprobability otours are the ellipses whose priipal ompoets φ i are the eigevetors of Σ priipal legths λ i are the eigevalues of Σ φ 2 y 2 λ2 λ φ y by omputig the eigevalues we kow if the data is flat λ >> λ 2 : flat λ λ 2 : ot flat y 2 y 2 λ 2 λ λ 2 y λ y
12 Priipal ompoet aalysis (learig) 2
13 Priipal ompoet aalysis 3
14 Priipal ompoet aalysis how do I determie the umber of eigevetors to keep? oe possibility is to plot eigevalue magitudes this is a sree plot usually there is a fast derease i the eigevalue magitude followed by a flat area oe good hoie is the kee of this urve 4
15 Priipal ompoet aalysis aother possibility is the peretage of eplaied variae remember that eigevalues are a measure of variae y 2 z 2 φ 2 λ2 λ φ y y Φ Τ z σ 2 σ z ratio r k measures % of total variae otaied i the top k eigevalues measure of the fratio of data variability alog the assoiated eigevetors r k k 2 λi i i λ 2 i 5
16 Priipal ompoet aalysis a atural measure is to pik the eigevetors that eplai p % of the data variability a be doe by plottig the ratio r k as a futio of k r k k 2 λi i i λ 2 i e.g. we eed 3 eigevetors to over 70% of the variability of this dataset 6
17 Priipal ompoet aalysis there is a alterative maer to ompute the priipal ompoets, based o sigular value deompositio SVD: ay real m matri (>m) a be deomposed as A ΜΠΝ where M is a m olum orthoormal matri of left sigular vetors (olums of M) Π a m m diagoal matri of sigular values N a m m row orthoormal matri of right sigular vetors (olums of N) Μ Μ I Ν Ν I 7
18 8 PCA by SVD to relate this to PCA, we osider the data matri the sample mea is K i i M K µ
19 9 PCA by SVD ad we a eter the data by subtratig the mea to eah olum of this is the etered data matri I µ µ µ K K
20 20 PCA by SVD the sample ovariae is where i is the i th olum of this a be writte as ( )( ) ( ) Σ i i i i i i µ µ Σ M K
21 2 PCA by SVD the matri is real d. Assumig > d it has SVD deompositio ad M ΜΠΝ I I Ν Ν Μ Μ Ν ΝΠ ΜΠΝ ΝΠΜ Σ 2
22 PCA by SVD Σ Ν Π Ν otig that N is d d ad orthoormal, ad Π 2 diagoal, shows that this is just the eigevalue deompositio of Σ it follows that the eigevetors of Σ are the olums of N the eigevalues of Σ are 2 λ i π i this gives a alterative algorithm for PCA 22
23 PCA by SVD omputatio of PCA by SVD give with oe eample per olum ) reate the etered data-matri 2) ompute its SVD I ΜΠΝ 3) priipal ompoets are olums of N, eigevalues are λ i π i 23
24 Priipal ompoet aalysis priipal ompoets are usually quite iformative about the struture of the data eample the priipal ompoets for the spae of images of faes the figure oly show the first 6 eigevetors ote lightig, struture, et 24
25 Priipal ompoets aalysis PCA has bee applied to virtually all learig problems e.g. eigeshapes for fae morphig morphed faes 25
26 Priipal ompoet aalysis soud average soud images Eigeobjets orrespodig to the three highest eigevalues 26
27 Priipal ompoet aalysis turbulee flames eigeflames 27
28 Priipal ompoet aalysis video eigerigs reostrutio 28
29 Priipal ompoet aalysis tet: latet semati ideig represet eah doumet by a word histogram perform SVD o the doumet word matri terms oepts terms oepts doumets doumets priipal ompoets as the diretios of semati oepts 29
30 Latet semati aalysis appliatios: doumet lassifiatio, iformatio goal: solve two fudametal problems i laguage syoymy: differet writers use differet words to desribe the same idea. polysemy, the same word a have multiple meaigs reasos: origial term-doumet matri is too large for the omputig resoures origial term-doumet matri is oisy: for istae, aedotal istaes of terms are to be elimiated. origial term-doumet matri overly sparse relative to "true" term-doumet matri. E.g. lists oly words atually i eah doumet, whereas we might be iterested i all words related to eah doumet-- muh larger set due to syoymy 30
31 Latet semati aalysis after PCA some dimesios get "merged": {(ar), (truk), (flower)} --> {(.3452 * ar * truk), (flower)} this mitigates syoymy, merges the dimesios assoiated with terms that have similar meaigs. ad mitigates polysemy, ompoets of polysemous words that poit i the "right" diretio are added to the ompoets of words that share this sese. oversely, ompoets that poit i other diretios ted to either simply ael out, or, at worst, to be smaller tha ompoets i the diretios orrespodig to the iteded sese. 3
32 Etesios i a few letures we will talk about kerels turs out that ay algorithm whih depeds o the data through dot-produts oly, i.e. the matri of elemets a be kerelized i this is usually beefiial, we will see why later for ow we look at the questio of whether PCA a be writte i the form above reall the data matri is j K 32
33 33 Etesios the etered-data matri ad the ovariae the eigevetor φ i of eigevalue λ i is hee, the eigevetor matri is I Σ i i i i i i i φ α α λ φ λ φ, Γ Γ Φ, d d d λ α λ α K
34 34 Etesios we et ote that, from the eigevetor deompositio ad i.e. ΣΦ Λ Φ Σ ΦΛΦ ( )( )Γ Γ Γ Λ Γ ( )( ) ΓΛΓ
35 Etesios i summary, we have this meas that we a obtai PCA by ) assemblig - ( )( ) 2) omputig its eige-deompositio (Λ,Γ) PCA Σ ΦΛΦ Φ the priipal ompoets are the give by Γ the eigevalues are give by Λ Γ ( )( ) ΓΛΓ 35
36 36 Etesios the matri is the matri of dot-produts of the etered data-poits it is symmetri ( ) M K K M K M K
37 37 Etesios hee whih, usig ( )( ) K K ( ) i k k k k k k K K M K
38 Etesios is just the ovariae of the olums of the matri K K ( ) K i.e., the dot-produt matri for the data M M 38
39 Etesios i summary, to get PCA ) ompute the dot-produt matri K 2) ompute its eige-deompositio (Λ,Γ) PCA the priipal ompoets are the give by Φ Γ the eigevalues are give by Λ the projetio of the data-poits o the priipal ompoets is give by Φ Γ K Γ this allows the omputatio of the eigevalues ad PCA oeffiiets whe we oly have aess to the dot-produt matri K 39
40 40
Principal Component Analysis
Priipal Compoet Aalysis Nuo Vasoelos (Ke Kreutz-Delgado) UCSD Curse of dimesioality Typial observatio i Bayes deisio theory: Error ireases whe umber of features is large Eve for simple models (e.g. Gaussia)
More informationSx [ ] = x must yield a
Math -b Leture #5 Notes This wee we start with a remider about oordiates of a vetor relative to a basis for a subspae ad the importat speial ase where the subspae is all of R. This freedom to desribe vetors
More informationFluids Lecture 2 Notes
Fluids Leture Notes. Airfoil orte Sheet Models. Thi-Airfoil Aalysis Problem Readig: Aderso.,.7 Airfoil orte Sheet Models Surfae orte Sheet Model A aurate meas of represetig the flow about a airfoil i a
More informationBasic Probability/Statistical Theory I
Basi Probability/Statistial Theory I Epetatio The epetatio or epeted values of a disrete radom variable X is the arithmeti mea of the radom variable s distributio. E[ X ] p( X ) all Epetatio by oditioig
More informationObserver Design with Reduced Measurement Information
Observer Desig with Redued Measuremet Iformatio I pratie all the states aot be measured so that SVF aot be used Istead oly a redued set of measuremets give by y = x + Du p is available where y( R We assume
More informationε > 0 N N n N a n < ε. Now notice that a n = a n.
4 Sequees.5. Null sequees..5.. Defiitio. A ull sequee is a sequee (a ) N that overges to 0. Hee, by defiitio of (a ) N overges to 0, a sequee (a ) N is a ull sequee if ad oly if ( ) ε > 0 N N N a < ε..5..
More informationMachine Learning for Data Science (CS 4786)
Machie Learig for Data Sciece CS 4786) Lecture & 3: Pricipal Compoet Aalysis The text i black outlies high level ideas. The text i blue provides simple mathematical details to derive or get to the algorithm
More informationBernoulli Numbers. n(n+1) = n(n+1)(2n+1) = n(n 1) 2
Beroulli Numbers Beroulli umbers are amed after the great Swiss mathematiia Jaob Beroulli5-705 who used these umbers i the power-sum problem. The power-sum problem is to fid a formula for the sum of the
More informationChapter 8 Hypothesis Testing
Chapter 8 for BST 695: Speial Topis i Statistial Theory Kui Zhag, Chapter 8 Hypothesis Testig Setio 8 Itrodutio Defiitio 8 A hypothesis is a statemet about a populatio parameter Defiitio 8 The two omplemetary
More informationApply change-of-basis formula to rewrite x as a linear combination of eigenvectors v j.
Eigevalue-Eigevector Istructor: Nam Su Wag eigemcd Ay vector i real Euclidea space of dimesio ca be uiquely epressed as a liear combiatio of liearly idepedet vectors (ie, basis) g j, j,,, α g α g α g α
More informationMachine Learning for Data Science (CS 4786)
Machie Learig for Data Sciece CS 4786) Lecture 9: Pricipal Compoet Aalysis The text i black outlies mai ideas to retai from the lecture. The text i blue give a deeper uderstadig of how we derive or get
More informationAfter the completion of this section the student. V.4.2. Power Series Solution. V.4.3. The Method of Frobenius. V.4.4. Taylor Series Solution
Chapter V ODE V.4 Power Series Solutio Otober, 8 385 V.4 Power Series Solutio Objetives: After the ompletio of this setio the studet - should reall the power series solutio of a liear ODE with variable
More informationMath E-21b Spring 2018 Homework #2
Math E- Sprig 08 Homework # Prolems due Thursday, Feruary 8: Sectio : y = + 7 8 Fid the iverse of the liear trasformatio [That is, solve for, i terms of y, y ] y = + 0 Cosider the circular face i the accompayig
More informationA widely used display of protein shapes is based on the coordinates of the alpha carbons - - C α
Nice plottig of proteis: I A widely used display of protei shapes is based o the coordiates of the alpha carbos - - C α -s. The coordiates of the C α -s are coected by a cotiuous curve that roughly follows
More informationSYNTHESIS OF SIGNAL USING THE EXPONENTIAL FOURIER SERIES
SYNTHESIS OF SIGNAL USING THE EXPONENTIAL FOURIER SERIES Sadro Adriao Fasolo ad Luiao Leoel Medes Abstrat I 748, i Itrodutio i Aalysi Ifiitorum, Leohard Euler (707-783) stated the formula exp( jω = os(
More informationANOTHER PROOF FOR FERMAT S LAST THEOREM 1. INTRODUCTION
ANOTHER PROOF FOR FERMAT S LAST THEOREM Mugur B. RĂUŢ Correspodig author: Mugur B. RĂUŢ, E-mail: m_b_raut@yahoo.om Abstrat I this paper we propose aother proof for Fermat s Last Theorem (FLT). We foud
More informationInverse Matrix. A meaning that matrix B is an inverse of matrix A.
Iverse Matrix Two square matrices A ad B of dimesios are called iverses to oe aother if the followig holds, AB BA I (11) The otio is dual but we ofte write 1 B A meaig that matrix B is a iverse of matrix
More informationSummation Method for Some Special Series Exactly
The Iteratioal Joural of Mathematis, Siee, Tehology ad Maagemet (ISSN : 39-85) Vol. Issue Summatio Method for Some Speial Series Eatly D.A.Gismalla Deptt. Of Mathematis & omputer Studies Faulty of Siee
More informationChimica Inorganica 3
himica Iorgaica Irreducible Represetatios ad haracter Tables Rather tha usig geometrical operatios, it is ofte much more coveiet to employ a ew set of group elemets which are matrices ad to make the rule
More informationClass #25 Wednesday, April 19, 2018
Cla # Wedesday, April 9, 8 PDE: More Heat Equatio with Derivative Boudary Coditios Let s do aother heat equatio problem similar to the previous oe. For this oe, I ll use a square plate (N = ), but I m
More informationLecture 8. Dirac and Weierstrass
Leture 8. Dira ad Weierstrass Audrey Terras May 5, 9 A New Kid of Produt of Futios You are familiar with the poitwise produt of futios de ed by f g(x) f(x) g(x): You just tae the produt of the real umbers
More informationBertrand s Postulate
Bertrad s Postulate Lola Thompso Ross Program July 3, 2009 Lola Thompso (Ross Program Bertrad s Postulate July 3, 2009 1 / 33 Bertrad s Postulate I ve said it oce ad I ll say it agai: There s always a
More informationSolutions 3.2-Page 215
Solutios.-Page Problem Fid the geeral solutios i powers of of the differetial equatios. State the reurree relatios ad the guarateed radius of overgee i eah ase. ) Substitutig,, ad ito the differetial equatio
More informationFor a 3 3 diagonal matrix we find. Thus e 1 is a eigenvector corresponding to eigenvalue λ = a 11. Thus matrix A has eigenvalues 2 and 3.
Closed Leotief Model Chapter 6 Eigevalues I a closed Leotief iput-output-model cosumptio ad productio coicide, i.e. V x = x = x Is this possible for the give techology matrix V? This is a special case
More information(8) 1f = f. can be viewed as a real vector space where addition is defined by ( a1+ bi
Geeral Liear Spaes (Vetor Spaes) ad Solutios o ODEs Deiitio: A vetor spae V is a set, with additio ad salig o elemet deied or all elemets o the set, that is losed uder additio ad salig, otais a zero elemet
More informationCOMP26120: Introducing Complexity Analysis (2018/19) Lucas Cordeiro
COMP60: Itroduig Complexity Aalysis (08/9) Luas Cordeiro luas.ordeiro@mahester.a.uk Itroduig Complexity Aalysis Textbook: Algorithm Desig ad Appliatios, Goodrih, Mihael T. ad Roberto Tamassia (hapter )
More informationLecture 8: October 20, Applications of SVD: least squares approximation
Mathematical Toolkit Autum 2016 Lecturer: Madhur Tulsiai Lecture 8: October 20, 2016 1 Applicatios of SVD: least squares approximatio We discuss aother applicatio of sigular value decompositio (SVD) of
More informationU8L1: Sec Equations of Lines in R 2
MCVU U8L: Sec. 8.9. Equatios of Lies i R Review of Equatios of a Straight Lie (-D) Cosider the lie passig through A (-,) with slope, as show i the diagram below. I poit slope form, the equatio of the lie
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More informationProbability & Statistics Chapter 8
I. Estimatig with Large Samples Probability & Statistis Poit Estimate of a parameter is a estimate of a populatio parameter give by a sigle umber. Use x (the sample mea) as a poit estimate for (the populatio
More information4.3 Growth Rates of Solutions to Recurrences
4.3. GROWTH RATES OF SOLUTIONS TO RECURRENCES 81 4.3 Growth Rates of Solutios to Recurreces 4.3.1 Divide ad Coquer Algorithms Oe of the most basic ad powerful algorithmic techiques is divide ad coquer.
More informationChapter 12 EM algorithms The Expectation-Maximization (EM) algorithm is a maximum likelihood method for models that have hidden variables eg. Gaussian
Chapter 2 EM algorithms The Expectatio-Maximizatio (EM) algorithm is a maximum likelihood method for models that have hidde variables eg. Gaussia Mixture Models (GMMs), Liear Dyamic Systems (LDSs) ad Hidde
More informationLecture 24 Floods and flood frequency
Lecture 4 Floods ad flood frequecy Oe of the thigs we wat to kow most about rivers is what s the probability that a flood of size will happe this year? I 100 years? There are two ways to do this empirically,
More informationAxis Aligned Ellipsoid
Machie Learig for Data Sciece CS 4786) Lecture 6,7 & 8: Ellipsoidal Clusterig, Gaussia Mixture Models ad Geeral Mixture Models The text i black outlies high level ideas. The text i blue provides simple
More informationChapter 18 Summary Sampling Distribution Models
Uit 5 Itroductio to Iferece Chapter 18 Summary Samplig Distributio Models What have we leared? Sample proportios ad meas will vary from sample to sample that s samplig error (samplig variability). Samplig
More informationTHE MEASUREMENT OF THE SPEED OF THE LIGHT
THE MEASUREMENT OF THE SPEED OF THE LIGHT Nyamjav, Dorjderem Abstrat The oe of the physis fudametal issues is a ature of the light. I this experimet we measured the speed of the light usig MihelsoÕs lassial
More informationx c the remainder is Pc ().
Algebra, Polyomial ad Ratioal Fuctios Page 1 K.Paulk Notes Chapter 3, Sectio 3.1 to 3.4 Summary Sectio Theorem Notes 3.1 Zeros of a Fuctio Set the fuctio to zero ad solve for x. The fuctio is zero at these
More information11 Correlation and Regression
11 Correlatio Regressio 11.1 Multivariate Data Ofte we look at data where several variables are recorded for the same idividuals or samplig uits. For example, at a coastal weather statio, we might record
More informationa is some real number (called the coefficient) other
Precalculus Notes for Sectio.1 Liear/Quadratic Fuctios ad Modelig http://www.schooltube.com/video/77e0a939a3344194bb4f Defiitios: A moomial is a term of the form tha zero ad is a oegative iteger. a where
More informationThe Stokes Theorem. (Sect. 16.7) The curl of a vector field in space
The tokes Theorem. (ect. 6.7) The curl of a vector field i space. The curl of coservative fields. tokes Theorem i space. Idea of the proof of tokes Theorem. The curl of a vector field i space Defiitio
More informationMixtures of Gaussians and the EM Algorithm
Mixtures of Gaussias ad the EM Algorithm CSE 6363 Machie Learig Vassilis Athitsos Computer Sciece ad Egieerig Departmet Uiversity of Texas at Arligto 1 Gaussias A popular way to estimate probability desity
More information6.003 Homework #3 Solutions
6.00 Homework # Solutios Problems. Complex umbers a. Evaluate the real ad imagiary parts of j j. π/ Real part = Imagiary part = 0 e Euler s formula says that j = e jπ/, so jπ/ j π/ j j = e = e. Thus the
More informationMachine Learning for Data Science (CS4786) Lecture 4
Machie Learig for Data Sciece (CS4786) Lecture 4 Caoical Correlatio Aalysis (CCA) Course Webpage : http://www.cs.corell.edu/courses/cs4786/2016fa/ Aoucemet We are gradig HW0 ad you will be added to cms
More informationFactor Analysis. Lecture 10: Factor Analysis and Principal Component Analysis. Sam Roweis
Lecture 10: Factor Aalysis ad Pricipal Compoet Aalysis Sam Roweis February 9, 2004 Whe we assume that the subspace is liear ad that the uderlyig latet variable has a Gaussia distributio we get a model
More informationCov(aX, cy ) Var(X) Var(Y ) It is completely invariant to affine transformations: for any a, b, c, d R, ρ(ax + b, cy + d) = a.s. X i. as n.
CS 189 Itroductio to Machie Learig Sprig 218 Note 11 1 Caoical Correlatio Aalysis The Pearso Correlatio Coefficiet ρ(x, Y ) is a way to measure how liearly related (i other words, how well a liear model
More informationDefinitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients.
Defiitios ad Theorems Remember the scalar form of the liear programmig problem, Miimize, Subject to, f(x) = c i x i a 1i x i = b 1 a mi x i = b m x i 0 i = 1,2,, where x are the decisio variables. c, b,
More informationImage Spaces. What might an image space be
Image Spaces What might a image space be Map each image to a poit i a space Defie a distace betwee two poits i that space Mabe also a shortest path (morph) We have alread see a simple versio of this, i
More informationLecture 7: Density Estimation: k-nearest Neighbor and Basis Approach
STAT 425: Itroductio to Noparametric Statistics Witer 28 Lecture 7: Desity Estimatio: k-nearest Neighbor ad Basis Approach Istructor: Ye-Chi Che Referece: Sectio 8.4 of All of Noparametric Statistics.
More informationProduction Test of Rotary Compressors Using Wavelet Analysis
Purdue Uiversity Purdue e-pubs Iteratioal Compressor Egieerig Coferee Shool of Mehaial Egieerig 2006 Produtio Test of Rotary Compressors Usig Wavelet Aalysis Haishui Ji Shaghai Hitahi Eletrial Appliatio
More informationChapter 23: Inferences About Means
Chapter 23: Ifereces About Meas Eough Proportios! We ve spet the last two uits workig with proportios (or qualitative variables, at least) ow it s time to tur our attetios to quatitative variables. For
More informationECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015
ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],
More informationExponents. Learning Objectives. Pre-Activity
Sectio. Pre-Activity Preparatio Epoets A Chai Letter Chai letters are geerated every day. If you sed a chai letter to three frieds ad they each sed it o to three frieds, who each sed it o to three frieds,
More informationTMA4205 Numerical Linear Algebra. The Poisson problem in R 2 : diagonalization methods
TMA4205 Numerical Liear Algebra The Poisso problem i R 2 : diagoalizatio methods September 3, 2007 c Eiar M Røquist Departmet of Mathematical Scieces NTNU, N-749 Trodheim, Norway All rights reserved A
More informationOrthogonal transformations
Orthogoal trasformatios October 12, 2014 1 Defiig property The squared legth of a vector is give by takig the dot product of a vector with itself, v 2 v v g ij v i v j A orthogoal trasformatio is a liear
More informationConstruction of Control Chart for Random Queue Length for (M / M / c): ( / FCFS) Queueing Model Using Skewness
Iteratioal Joural of Sietifi ad Researh Publiatios, Volume, Issue, Deember ISSN 5-5 Costrutio of Cotrol Chart for Radom Queue Legth for (M / M / ): ( / FCFS) Queueig Model Usig Skewess Dr.(Mrs.) A.R. Sudamai
More information, then cv V. Differential Equations Elements of Lineaer Algebra Name: Consider the differential equation. and y2 cos( kx)
Cosider the differetial equatio y '' k y 0 has particular solutios y1 si( kx) ad y cos( kx) I geeral, ay liear combiatio of y1 ad y, cy 1 1 cy where c1, c is also a solutio to the equatio above The reaso
More informationCALCULUS BASIC SUMMER REVIEW
CALCULUS BASIC SUMMER REVIEW NAME rise y y y Slope of a o vertical lie: m ru Poit Slope Equatio: y y m( ) The slope is m ad a poit o your lie is, ). ( y Slope-Itercept Equatio: y m b slope= m y-itercept=
More informationPhysics 3 (PHYF144) Chap 8: The Nature of Light and the Laws of Geometric Optics - 1
Physis 3 (PHYF44) Chap 8: The Nature of Light ad the Laws of Geometri Optis - 8. The ature of light Before 0 th etury, there were two theories light was osidered to be a stream of partiles emitted by a
More informationSingular value decomposition. Mathématiques appliquées (MATH0504-1) B. Dewals, Ch. Geuzaine
Lecture 11 Sigular value decompositio Mathématiques appliquées (MATH0504-1) B. Dewals, Ch. Geuzaie V1.2 07/12/2018 1 Sigular value decompositio (SVD) at a glace Motivatio: the image of the uit sphere S
More informationTopics in Eigen-analysis
Topics i Eige-aalysis Li Zajiag 28 July 2014 Cotets 1 Termiology... 2 2 Some Basic Properties ad Results... 2 3 Eige-properties of Hermitia Matrices... 5 3.1 Basic Theorems... 5 3.2 Quadratic Forms & Noegative
More informationWhat is a Hypothesis? Hypothesis is a statement about a population parameter developed for the purpose of testing.
What is a ypothesis? ypothesis is a statemet about a populatio parameter developed for the purpose of testig. What is ypothesis Testig? ypothesis testig is a proedure, based o sample evidee ad probability
More informationGoodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)
Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................
More informationChapter 4: Angle Modulation
57 Chapter 4: Agle Modulatio 4.1 Itrodutio to Agle Modulatio This hapter desribes frequey odulatio (FM) ad phase odulatio (PM), whih are both fors of agle odulatio. Agle odulatio has several advatages
More information24 MATH 101B: ALGEBRA II, PART D: REPRESENTATIONS OF GROUPS
24 MATH 101B: ALGEBRA II, PART D: REPRESENTATIONS OF GROUPS Corollary 2.30. Suppose that the semisimple decompositio of the G- module V is V = i S i. The i = χ V,χ i Proof. Sice χ V W = χ V + χ W, we have:
More informationThe Relationship of the Cotangent Function to Special Relativity Theory, Silver Means, p-cycles, and Chaos Theory
Origial Paper Forma, 8, 49 6, 003 The Relatioship of the Cotaget Futio to Speial Relativity Theory, Silver Meas, p-yles, ad Chaos Theory Jay KAPPRAFF * ad Gary W ADAMSON New Jersey Istitute of Tehology,
More informationPAPER : IIT-JAM 2010
MATHEMATICS-MA (CODE A) Q.-Q.5: Oly oe optio is correct for each questio. Each questio carries (+6) marks for correct aswer ad ( ) marks for icorrect aswer.. Which of the followig coditios does NOT esure
More informationCHAPTER 8 SYSTEMS OF PARTICLES
CHAPTER 8 SYSTES OF PARTICLES CHAPTER 8 COLLISIONS 45 8. CENTER OF ASS The ceter of mass of a system of particles or a rigid body is the poit at which all of the mass are cosidered to be cocetrated there
More informationSolving the ZF Receiver Equation for MIMO Systems Under Variable Channel Conditions Using the Block Fourier Algorithm
006 IEEE ith Iteratioal Symposium o Spread Spetrum Tehiques ad Appliatios Solvig the ZF Reeiver Equatio for MIMO Systems Uder Variable hael oditios Usig the Blok Fourier Algorithm João arlos Silva, Rui
More informationSOME NOTES ON INEQUALITIES
SOME NOTES ON INEQUALITIES Rihard Hoshio Here are four theorems that might really be useful whe you re workig o a Olympiad problem that ivolves iequalities There are a buh of obsure oes Chebyheff, Holder,
More informationU8L1: Sec Equations of Lines in R 2
MCVU Thursda Ma, Review of Equatios of a Straight Lie (-D) U8L Sec. 8.9. Equatios of Lies i R Cosider the lie passig through A (-,) with slope, as show i the diagram below. I poit slope form, the equatio
More informationAlgorithms. Elementary Sorting. Dong Kyue Kim Hanyang University
Algorithms Elemetary Sortig Dog Kyue Kim Hayag Uiversity dqkim@hayag.a.kr Cotets Sortig problem Elemetary sortig algorithms Isertio sort Merge sort Seletio sort Bubble sort Sortig problem Iput A sequee
More information1 Last time: similar and diagonalizable matrices
Last time: similar ad diagoalizable matrices Let be a positive iteger Suppose A is a matrix, v R, ad λ R Recall that v a eigevector for A with eigevalue λ if v ad Av λv, or equivaletly if v is a ozero
More information6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer.
6 Itegers Modulo I Example 2.3(e), we have defied the cogruece of two itegers a,b with respect to a modulus. Let us recall that a b (mod ) meas a b. We have proved that cogruece is a equivalece relatio
More informationExplicit and closed formed solution of a differential equation. Closed form: since finite algebraic combination of. converges for x x0
Chapter 4 Series Solutios Epliit ad losed formed solutio of a differetial equatio y' y ; y() 3 ( ) ( 5 e ) y Closed form: sie fiite algebrai ombiatio of elemetary futios Series solutio: givig y ( ) as
More informationSeries III. Chapter Alternating Series
Chapter 9 Series III With the exceptio of the Null Sequece Test, all the tests for series covergece ad divergece that we have cosidered so far have dealt oly with series of oegative terms. Series with
More informationNBHM QUESTION 2007 Section 1 : Algebra Q1. Let G be a group of order n. Which of the following conditions imply that G is abelian?
NBHM QUESTION 7 NBHM QUESTION 7 NBHM QUESTION 7 Sectio : Algebra Q Let G be a group of order Which of the followig coditios imply that G is abelia? 5 36 Q Which of the followig subgroups are ecesarily
More informationa. For each block, draw a free body diagram. Identify the source of each force in each free body diagram.
Pre-Lab 4 Tesio & Newto s Third Law Refereces This lab cocers the properties of forces eerted by strigs or cables, called tesio forces, ad the use of Newto s third law to aalyze forces. Physics 2: Tipler
More informationCS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5
CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio
More informationPractical Spectral Anaysis (continue) (from Boaz Porat s book) Frequency Measurement
Practical Spectral Aaysis (cotiue) (from Boaz Porat s book) Frequecy Measuremet Oe of the most importat applicatios of the DFT is the measuremet of frequecies of periodic sigals (eg., siusoidal sigals),
More information10-701/ Machine Learning Mid-term Exam Solution
0-70/5-78 Machie Learig Mid-term Exam Solutio Your Name: Your Adrew ID: True or False (Give oe setece explaatio) (20%). (F) For a cotiuous radom variable x ad its probability distributio fuctio p(x), it
More informationThe axial dispersion model for tubular reactors at steady state can be described by the following equations: dc dz R n cn = 0 (1) (2) 1 d 2 c.
5.4 Applicatio of Perturbatio Methods to the Dispersio Model for Tubular Reactors The axial dispersio model for tubular reactors at steady state ca be described by the followig equatios: d c Pe dz z =
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More informationa for a 1 1 matrix. a b a b 2 2 matrix: We define det ad bc 3 3 matrix: We define a a a a a a a a a a a a a a a a a a
Math E-2b Lecture #8 Notes This week is all about determiats. We ll discuss how to defie them, how to calculate them, lear the allimportat property kow as multiliearity, ad show that a square matrix A
More informationSome examples of vector spaces
Roberto s Notes o Liear Algebra Chapter 11: Vector spaces Sectio 2 Some examples of vector spaces What you eed to kow already: The te axioms eeded to idetify a vector space. What you ca lear here: Some
More informationMon Apr Second derivative test, and maybe another conic diagonalization example. Announcements: Warm-up Exercise:
Math 2270-004 Week 15 otes We will ot ecessarily iish the material rom a give day's otes o that day We may also add or subtract some material as the week progresses, but these otes represet a i-depth outlie
More informationMathematics Extension 1
016 Bored of Studies Trial Eamiatios Mathematics Etesio 1 3 rd ctober 016 Geeral Istructios Total Marks 70 Readig time 5 miutes Workig time hours Write usig black or blue pe Black pe is preferred Board-approved
More informationAlgebra II Notes Unit Seven: Powers, Roots, and Radicals
Syllabus Objectives: 7. The studets will use properties of ratioal epoets to simplify ad evaluate epressios. 7.8 The studet will solve equatios cotaiig radicals or ratioal epoets. b a, the b is the radical.
More informationThe beta density, Bayes, Laplace, and Pólya
The beta desity, Bayes, Laplae, ad Pólya Saad Meimeh The beta desity as a ojugate form Suppose that is a biomial radom variable with idex ad parameter p, i.e. ( ) P ( p) p ( p) Applyig Bayes s rule, we
More informationMath 155 (Lecture 3)
Math 55 (Lecture 3) September 8, I this lecture, we ll cosider the aswer to oe of the most basic coutig problems i combiatorics Questio How may ways are there to choose a -elemet subset of the set {,,,
More information2 f(x) dx = 1, 0. 2f(x 1) dx d) 1 4t t6 t. t 2 dt i)
Math PracTest Be sure to review Lab (ad all labs) There are lots of good questios o it a) State the Mea Value Theorem ad draw a graph that illustrates b) Name a importat theorem where the Mea Value Theorem
More informationλ = 0.4 c 2nf max = n = 3orɛ R = 9
CHAPTER 14 14.1. A parallel-plate waveguide is kow to have a utoff wavelegth for the m 1 TE ad TM modes of λ 1 0.4 m. The guide is operated at wavelegth λ 1 mm. How may modes propagate? The utoff wavelegth
More informationFall 2013 MTH431/531 Real analysis Section Notes
Fall 013 MTH431/531 Real aalysis Sectio 8.1-8. Notes Yi Su 013.11.1 1. Defiitio of uiform covergece. We look at a sequece of fuctios f (x) ad study the coverget property. Notice we have two parameters
More informationMATH10212 Linear Algebra B Proof Problems
MATH22 Liear Algebra Proof Problems 5 Jue 26 Each problem requests a proof of a simple statemet Problems placed lower i the list may use the results of previous oes Matrices ermiats If a b R the matrix
More informationSymmetric Matrices and Quadratic Forms
7 Symmetric Matrices ad Quadratic Forms 7.1 DIAGONALIZAION OF SYMMERIC MARICES SYMMERIC MARIX A symmetric matrix is a matrix A such that. A = A Such a matrix is ecessarily square. Its mai diagoal etries
More informationChapter Vectors
Chapter 4. Vectors fter readig this chapter you should be able to:. defie a vector. add ad subtract vectors. fid liear combiatios of vectors ad their relatioship to a set of equatios 4. explai what it
More information( ) ( ) ( ) notation: [ ]
Liear Algebra Vectors ad Matrices Fudametal Operatios with Vectors Vector: a directed lie segmets that has both magitude ad directio =,,,..., =,,,..., = where 1, 2,, are the otatio: [ ] 1 2 3 1 2 3 compoets
More information(VII.A) Review of Orthogonality
VII.A Review of Orthogoality At the begiig of our study of liear trasformatios i we briefly discussed projectios, rotatios ad projectios. I III.A, projectios were treated i the abstract ad without regard
More informationState Space Representation
Optimal Cotrol, Guidace ad Estimatio Lecture 2 Overview of SS Approach ad Matrix heory Prof. Radhakat Padhi Dept. of Aerospace Egieerig Idia Istitute of Sciece - Bagalore State Space Represetatio Prof.
More informationProbability, Expectation Value and Uncertainty
Chapter 1 Probability, Expectatio Value ad Ucertaity We have see that the physically observable properties of a quatum system are represeted by Hermitea operators (also referred to as observables ) such
More informationEmpirical Process Theory and Oracle Inequalities
Stat 928: Statistical Learig Theory Lecture: 10 Empirical Process Theory ad Oracle Iequalities Istructor: Sham Kakade 1 Risk vs Risk See Lecture 0 for a discussio o termiology. 2 The Uio Boud / Boferoi
More information