TMA4205 Numerical Linear Algebra. The Poisson problem in R 2 : diagonalization methods
|
|
- Geraldine Casey
- 5 years ago
- Views:
Transcription
1 TMA4205 Numerical Liear Algebra The Poisso problem i R 2 : diagoalizatio methods September 3, 2007 c Eiar M Røquist Departmet of Mathematical Scieces NTNU, N-749 Trodheim, Norway All rights reserved
2 A direct method based o diagoalizatio We cosider here the umerical solutio of the Poisso problem based o fiite differeces I particular, we focus o a particular method for solvig the liear system of equatios i oe ad two space dimesios The method is based o diagoalizatio, ad we first explai the basic approach i the cotext of the oedimesioal Poisso problem: u xx = f i Ω = (0, ), u(0) = u() = 0 Assume that we use a uiform fiite differece grid give by: x i = x 0 + ih, i = 0,,, The correspodig system of algebraic equatios ca be writte as: h u u 2 u = f f 2 f, where u i is a approximatio to u(x i ) = u(ih), i =,,, f i = f(x i ), ad u 0 = u = 0 due to the specified boudary coditios Let us write this system as where h 2 T u = f 2 2 T = 2, u = 2 u u, f = f f, ad h is the grid size or mesh size Sice T is symmetric positive defiite, it ca be diagoalized (Recall that a real, symmetric matrix is a ormal matrix) 2
3 Diagoalizatio of T Diagoalizatio of T meas that we wish to fid the eigevalues λ j ad the eigevectors q j of T, where T q j = λ j q j, j =,,, λ j > 0 q T k q j = δ jk (positive eigevalues), (orthoormal eigevectors) The We collect all the eigevectors q j ito the (orthoormal) matrix Q, Q = [q, q 2,, q ] T Q = Q Λ where λ Λ = diag(λ,, λ ) = λ Sice Q T Q = I = Q T = Q, ad T = Q Λ Q T () or Q T T Q = Λ (diagoal) 3
4 The fiite differece approximatio ca thus be computed as follows: g h 2 f g : O() operatios T u = g Q Λ Q T u = g Λ Q T u }{{} eu = Q T g }{{} eg g : O( 2 ) operatios Λũ = g ũ = Λ g Q T u = ũ u = Q ũ ũ : O() operatios u : O( 2 ) operatios Note that the trasformatios g = Q T g ad u = Q ũ are matrix-vector products operatios I summary, we ca compute u i O() + O( 2 ) + O() + O( 2 ) O( 2 ) floatig-poit operatios Hece, we ca solve our fiite differece system i ( ) ukows i O( 2 ) operatios This is ot competitive with a direct solutio algorithm based upo LU-factorizatio (Gaussia elimiatio) of a tridiagoal matrix, which ca be doe i O() operatios (sice the badwidth is equal to oe) Let us also compare the memory requiremet: O( 2 ) for the diagoalizatio approach (we eed to store Q); O() for a tridiagoal direct solver Agai, the diagoalizatio approach is ot competitive So, why bother? The aswer is that the diagoalizatio approach becomes more iterestig i R 2 I additio, it turs out that it is possible to use the Fast Fourier Trasform (FFT) to lower the computatioal complexity 4
5 2 The Poisso problem i R 2 The two-dimesioal Poisso problem o the uit square is give by 2 u = f i Ω = (0, ) (0, ), u = 0 o Ω, (2) where 2 u = 2 u x u y 2 (x, y ) (x 0,y 0 ) h h Figure : A uiform fiite differece grid Agai, usig the otatio u i,j u(x i, y j ) = u(ih, jh) ad f i,j = f(x i, y j ), ad discretizig (2) usig the 5-poit stecil (see Figure ), the discrete equatios read: (u i+,j 2u i,j + u i,j ) h 2 (u i,j+ 2u i,j + u i,j ) h 2 = f i,j i, j (3) 2 Diagoalizatio Let u, u, U = u, u, 5
6 ad The, T = (T U) ij = 2u i,j u i+,j, i =, (T U) ij = u i,j + 2u i,j u i+,j, 2 i 2, (T U) ij = u i,j + 2u i,j, i = ad thus, Similarly, ( 2 h (T U) u 2 ij x 2 ( 2 h (U T ) u 2 ij y 2 ) ) (4) i,j (5) i,j Our fiite differece system (3) ca thus be expressed as or h 2 (T U + U T ) ij = f i,j for i, j, where T U + U T = G (6) f, f, G = h 2 f, f, 6
7 Combiig () ad (6) we get Q Λ Q T U + U Q Λ Q T = G (7) Multiplyig (7) from the right with Q ad from the left with Q T, ad usig the fact that Q T Q = I, we get: Λ Q T U Q }{{} e U + Q T U QΛ = Q T G Q }{{}}{{} e U Hece, (6) may be solved i three steps: e G Step ): Compute Step 2): Solve G = Q T G Q matrix-matrix products Λ Ũ + Ũ Λ = G or λ i ũ i,j + ũ i,j λ j = g i,j, i, j (λ i + λ j ) ũ i,j = g i,j, i, j ũ i,j = g i,j λ i + λ j i, j Step 3): Compute Here, U = Q Ũ QT matrix-matrix products U, Ũ, G, Q, Q T R ( ) ( ) 7
8 2 Computatioal cost The umber of degrees-of-freedom (or ukows), N, is N = ( ) 2 O( 2 ) ( ) Step ) Step 2) G = O( 3 ) {}}{ Q T G Q }{{} O( 3 ) O( 3 ) operatios Step 3) ũ i,j = g i,j λ i + λ j O( 2 ) operatios U = O( 3 ) {}}{ Q Ũ QT }{{} O( 3 ) O( 3 ) operatios I summary, we ca compute the discrete solutio, U, i O( 3 ) = O(N 3/2 ) operatios Note: this method is a example of a direct method 22 Compariso with other direct methods Computatioal cost Method Operatios (N op ) Memory requiremet (M) Diagoalizatio O(N 3/2 ) = O( 3 ) O(N) = O( 2 ) Baded LU O(Nb 2 ) = O( 4 ) O(Nb) = O( 3 ) Full LU O(N 3 ) = O( 6 ) O(N 2 ) = O( 4 ) Table : Computatioal cost ad memory requiremet for direct methods baded solver, we have used a badwidth b O() For the We coclude that the diagoalizatio method is much more attractive i R 2 tha i R The umber of floatig-poit operatios per degree-of-freedom is O(), while the memory requiremet is close to optimal (ie, scalable) 8
9 23 The matrices Q ad Λ The computatioal cost associated with the diagoalizatio approach tacitly assumes that we kow the eigevector matrix Q ad the correspodig eigevalues Let us therefore derive explicit expressios for these To this ed, cosider first the cotiuous eigevalue problem with solutios u xx = λu i Ω = (0, ), u(0) = u() = 0, u j(x) = si(jπx), λ j = j 2 π 2, j =, 2,, Cosider ow the discrete eigevalue problem T q j = λ j q j Try eigevector solutios which correspod to the cotiuous eigefuctios u j(x) sampled at the grid poits x i, i =,,, ie, ( q j ) i = u j(x i ) = si(jπx i ) = si(jπ(ih)), ( ) ijπ = si ( h = ) Operatig o q j with T gives ( ( )) ( ) jπ ijπ (T q j ) i = 2 cos si }{{}}{{} λ j (eq j ) i Hece, our try was successful: operatig o q j with T gives a multiple of q j 9
10 I order to proceed, set q j = α q j, ad choose α such that q j is ormalized: q T j q j =, ( ) 2 ijπ (q j ) i = si, i, j, ( ( )) jπ λ j = 2 cos For j, we observe that Sice h =, we have ( ( λ j 2 )) j 2 π 2 + j2 π λ j h 2 j 2 π 2 = h 2 λ j for j Sice the approximatio of the oe-dimesioal Laplace operator o our fiite differece grid is equal to h 2 T (ad ot T ), this is the same as sayig that the first, lowest eigevalues (ad eigevectors) for the cotiuous case are well approximated by our fiite differece formulatio Note that i this case ad that ideed Q ij = (q j ) i = Q T = Q 2 si ( ijπ ), i, j, From the compariso of computatioal cost show earlier (see Table ), the diagoalizatio approach to solvig the discrete Poisso problem appears promisig 0
11 Questios: Is the memory requiremet optimal? 2 Ca the matrix-matrix multiplicatios be doe fast? 3 Ca we do better? 4 Ca the diagoalizatio method be exteded to three space dimesios? 5 Ca the diagoalizatio method be used o geeral domais? The aswer to the first questio is yes: we eed to store O( 2 ) floatig poit umbers for O( 2 ) ukows Note that we store the ukows as a multidimesioal array istead of as a log vector Also ote that we ever form the global system matrix i the two-dimesioal case The aswer to the secod questio is yes Matrix-matrix multiplicatio is oe of the fastest floatig-poit tasks o moder microprocessors The best performace is ormally achieved usig the appropriate BLAS (Basic Liear Algebra Subrouties) library fuctio sice this library is optimized for each particular microprocessor Matrix-matrix multiplicatio is oe of the operatios which comes closest to maximum theoretical performace (ie, the maximum umber of floatig poit operatios per secod) The reaso for this is that the umber of operatios per memory referece is high: O( 3 ) floatig poit operatios ad O( 2 ) memory refereces Note that brigig data to ad from memory is ofte the bottleeck whe it comes to performace The aswer to the third questio is yes The matrix-vector multiplicatio w = Q v (or w = Q T v ca alteratively be doe via the Discrete Sie Trasform (DST) This is, of course, related to the fact that the colums of Q represet the cotiuous eigefuctios u j(x) = si(jπx), j =,,, sampled at the iteral grid poits However, the DST is agai related to the Discrete Fourier Trasform (DFT), which ca be performed most efficietly usig the Fast Fourier Trasform (FFT) Hece, istead of obtaiig w = Q v via matrix-vector multiplicatio i O( 2 ) operatios, we ca alteratively obtai w from v via FFT i O( log ) operatios The solutio of the Poisso problem i two space dimesios (ie, O( 2 ) ukows), ca therefore be reduced from O( 3 ) operatios to O( 2 log ) operatios This is close to a optimal solver: O(log ) operatios per ukow ad O() storage requiremet per ukow The aswer to the fourth questio is yes, assumig that the domai is a udeformed box ad we use a simple, structured grid This is also related to the fifth questio: the fast solutio method preseted here is oly applicable o simple domais However, the approach is also attractive as a precoditioer for problems which do ot fall ito this category (more o this later) The solver preseted here is a example of a class of solvers called tesor-product solvers
Math 257: Finite difference methods
Math 257: Fiite differece methods 1 Fiite Differeces Remember the defiitio of a derivative f f(x + ) f(x) (x) = lim 0 Also recall Taylor s formula: (1) f(x + ) = f(x) + f (x) + 2 f (x) + 3 f (3) (x) +...
More informationFFTs in Graphics and Vision. The Fast Fourier Transform
FFTs i Graphics ad Visio The Fast Fourier Trasform 1 Outlie The FFT Algorithm Applicatios i 1D Multi-Dimesioal FFTs More Applicatios Real FFTs 2 Computatioal Complexity To compute the movig dot-product
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationPhysics 324, Fall Dirac Notation. These notes were produced by David Kaplan for Phys. 324 in Autumn 2001.
Physics 324, Fall 2002 Dirac Notatio These otes were produced by David Kapla for Phys. 324 i Autum 2001. 1 Vectors 1.1 Ier product Recall from liear algebra: we ca represet a vector V as a colum vector;
More informationCHAPTER I: Vector Spaces
CHAPTER I: Vector Spaces Sectio 1: Itroductio ad Examples This first chapter is largely a review of topics you probably saw i your liear algebra course. So why cover it? (1) Not everyoe remembers everythig
More information3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,
3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [
More informationInverse Matrix. A meaning that matrix B is an inverse of matrix A.
Iverse Matrix Two square matrices A ad B of dimesios are called iverses to oe aother if the followig holds, AB BA I (11) The otio is dual but we ofte write 1 B A meaig that matrix B is a iverse of matrix
More information1 Approximating Integrals using Taylor Polynomials
Seughee Ye Ma 8: Week 7 Nov Week 7 Summary This week, we will lear how we ca approximate itegrals usig Taylor series ad umerical methods. Topics Page Approximatig Itegrals usig Taylor Polyomials. Defiitios................................................
More informationSession 5. (1) Principal component analysis and Karhunen-Loève transformation
200 Autum semester Patter Iformatio Processig Topic 2 Image compressio by orthogoal trasformatio Sessio 5 () Pricipal compoet aalysis ad Karhue-Loève trasformatio Topic 2 of this course explais the image
More informationChapter 4. Fourier Series
Chapter 4. Fourier Series At this poit we are ready to ow cosider the caoical equatios. Cosider, for eample the heat equatio u t = u, < (4.) subject to u(, ) = si, u(, t) = u(, t) =. (4.) Here,
More informationPAijpam.eu ON TENSOR PRODUCT DECOMPOSITION
Iteratioal Joural of Pure ad Applied Mathematics Volume 103 No 3 2015, 537-545 ISSN: 1311-8080 (prited versio); ISSN: 1314-3395 (o-lie versio) url: http://wwwijpameu doi: http://dxdoiorg/1012732/ijpamv103i314
More informationChapter Vectors
Chapter 4. Vectors fter readig this chapter you should be able to:. defie a vector. add ad subtract vectors. fid liear combiatios of vectors ad their relatioship to a set of equatios 4. explai what it
More informationA widely used display of protein shapes is based on the coordinates of the alpha carbons - - C α
Nice plottig of proteis: I A widely used display of protei shapes is based o the coordiates of the alpha carbos - - C α -s. The coordiates of the C α -s are coected by a cotiuous curve that roughly follows
More informationChimica Inorganica 3
himica Iorgaica Irreducible Represetatios ad haracter Tables Rather tha usig geometrical operatios, it is ofte much more coveiet to employ a ew set of group elemets which are matrices ad to make the rule
More informationLecture 8: Solving the Heat, Laplace and Wave equations using finite difference methods
Itroductory lecture otes o Partial Differetial Equatios - c Athoy Peirce. Not to be copied, used, or revised without explicit writte permissio from the copyright ower. 1 Lecture 8: Solvig the Heat, Laplace
More information6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer.
6 Itegers Modulo I Example 2.3(e), we have defied the cogruece of two itegers a,b with respect to a modulus. Let us recall that a b (mod ) meas a b. We have proved that cogruece is a equivalece relatio
More informationMachine Learning for Data Science (CS 4786)
Machie Learig for Data Sciece CS 4786) Lecture & 3: Pricipal Compoet Aalysis The text i black outlies high level ideas. The text i blue provides simple mathematical details to derive or get to the algorithm
More informationMath 132, Fall 2009 Exam 2: Solutions
Math 3, Fall 009 Exam : Solutios () a) ( poits) Determie for which positive real umbers p, is the followig improper itegral coverget, ad for which it is diverget. Evaluate the itegral for each value of
More informationMATH 10550, EXAM 3 SOLUTIONS
MATH 155, EXAM 3 SOLUTIONS 1. I fidig a approximate solutio to the equatio x 3 +x 4 = usig Newto s method with iitial approximatio x 1 = 1, what is x? Solutio. Recall that x +1 = x f(x ) f (x ). Hece,
More informationEigenvalues and Eigenvectors
5 Eigevalues ad Eigevectors 5.3 DIAGONALIZATION DIAGONALIZATION Example 1: Let. Fid a formula for A k, give that P 1 1 = 1 2 ad, where Solutio: The stadard formula for the iverse of a 2 2 matrix yields
More informationThe Method of Least Squares. To understand least squares fitting of data.
The Method of Least Squares KEY WORDS Curve fittig, least square GOAL To uderstad least squares fittig of data To uderstad the least squares solutio of icosistet systems of liear equatios 1 Motivatio Curve
More informationCHAPTER 5. Theory and Solution Using Matrix Techniques
A SERIES OF CLASS NOTES FOR 2005-2006 TO INTRODUCE LINEAR AND NONLINEAR PROBLEMS TO ENGINEERS, SCIENTISTS, AND APPLIED MATHEMATICIANS DE CLASS NOTES 3 A COLLECTION OF HANDOUTS ON SYSTEMS OF ORDINARY DIFFERENTIAL
More informationAlgebra of Least Squares
October 19, 2018 Algebra of Least Squares Geometry of Least Squares Recall that out data is like a table [Y X] where Y collects observatios o the depedet variable Y ad X collects observatios o the k-dimesioal
More information5.1. The Rayleigh s quotient. Definition 49. Let A = A be a self-adjoint matrix. quotient is the function. R(x) = x,ax, for x = 0.
40 RODICA D. COSTIN 5. The Rayleigh s priciple ad the i priciple for the eigevalues of a self-adjoit matrix Eigevalues of self-adjoit matrices are easy to calculate. This sectio shows how this is doe usig
More information6. Kalman filter implementation for linear algebraic equations. Karhunen-Loeve decomposition
6. Kalma filter implemetatio for liear algebraic equatios. Karhue-Loeve decompositio 6.1. Solvable liear algebraic systems. Probabilistic iterpretatio. Let A be a quadratic matrix (ot obligatory osigular.
More informationLecture 8: October 20, Applications of SVD: least squares approximation
Mathematical Toolkit Autum 2016 Lecturer: Madhur Tulsiai Lecture 8: October 20, 2016 1 Applicatios of SVD: least squares approximatio We discuss aother applicatio of sigular value decompositio (SVD) of
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationLøsningsførslag i 4M
Norges tekisk aturviteskapelige uiversitet Istitutt for matematiske fag Side 1 av 6 Løsigsførslag i 4M Oppgave 1 a) A sketch of the graph of the give f o the iterval [ 3, 3) is as follows: The Fourier
More informationRecurrence Relations
Recurrece Relatios Aalysis of recursive algorithms, such as: it factorial (it ) { if (==0) retur ; else retur ( * factorial(-)); } Let t be the umber of multiplicatios eeded to calculate factorial(). The
More informationMachine Learning for Data Science (CS 4786)
Machie Learig for Data Sciece CS 4786) Lecture 9: Pricipal Compoet Aalysis The text i black outlies mai ideas to retai from the lecture. The text i blue give a deeper uderstadig of how we derive or get
More informationQuestion 1: The magnetic case
September 6, 018 Corell Uiversity, Departmet of Physics PHYS 337, Advace E&M, HW # 4, due: 9/19/018, 11:15 AM Questio 1: The magetic case I class, we skipped over some details, so here you are asked to
More informationThe Jordan Normal Form: A General Approach to Solving Homogeneous Linear Systems. Mike Raugh. March 20, 2005
The Jorda Normal Form: A Geeral Approach to Solvig Homogeeous Liear Sstems Mike Raugh March 2, 25 What are we doig here? I this ote, we describe the Jorda ormal form of a matrix ad show how it ma be used
More informationCS276A Practice Problem Set 1 Solutions
CS76A Practice Problem Set Solutios Problem. (i) (ii) 8 (iii) 6 Compute the gamma-codes for the followig itegers: (i) (ii) 8 (iii) 6 Problem. For this problem, we will be dealig with a collectio of millio
More information6.3. Poisson's Equation
Iterative Methods for Liear Systems 267 6.3. Poisso's Equatio 6.3.1. Poisso's Equatio i Oe Dimesio We begi with a oe-dimesioal versio of Poisso's equatio, where f(x) is a give fuctio ad v(x) is the ukow
More informationECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations
ECE-S352 Itroductio to Digital Sigal Processig Lecture 3A Direct Solutio of Differece Equatios Discrete Time Systems Described by Differece Equatios Uit impulse (sample) respose h() of a DT system allows
More informationThe Random Walk For Dummies
The Radom Walk For Dummies Richard A Mote Abstract We look at the priciples goverig the oe-dimesioal discrete radom walk First we review five basic cocepts of probability theory The we cosider the Beroulli
More informationContinuous Functions
Cotiuous Fuctios Q What does it mea for a fuctio to be cotiuous at a poit? Aswer- I mathematics, we have a defiitio that cosists of three cocepts that are liked i a special way Cosider the followig defiitio
More information4.3 Growth Rates of Solutions to Recurrences
4.3. GROWTH RATES OF SOLUTIONS TO RECURRENCES 81 4.3 Growth Rates of Solutios to Recurreces 4.3.1 Divide ad Coquer Algorithms Oe of the most basic ad powerful algorithmic techiques is divide ad coquer.
More informationLecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting
Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would
More informationMath 113, Calculus II Winter 2007 Final Exam Solutions
Math, Calculus II Witer 7 Fial Exam Solutios (5 poits) Use the limit defiitio of the defiite itegral ad the sum formulas to compute x x + dx The check your aswer usig the Evaluatio Theorem Solutio: I this
More informationLesson 10: Limits and Continuity
www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals
More informationCMSE 820: Math. Foundations of Data Sci.
Lecture 17 8.4 Weighted path graphs Take from [10, Lecture 3] As alluded to at the ed of the previous sectio, we ow aalyze weighted path graphs. To that ed, we prove the followig: Theorem 6 (Fiedler).
More informationHOMEWORK I: PREREQUISITES FROM MATH 727
HOMEWORK I: PREREQUISITES FROM MATH 727 Questio. Let X, X 2,... be idepedet expoetial radom variables with mea µ. (a) Show that for Z +, we have EX µ!. (b) Show that almost surely, X + + X (c) Fid the
More informationFor a 3 3 diagonal matrix we find. Thus e 1 is a eigenvector corresponding to eigenvalue λ = a 11. Thus matrix A has eigenvalues 2 and 3.
Closed Leotief Model Chapter 6 Eigevalues I a closed Leotief iput-output-model cosumptio ad productio coicide, i.e. V x = x = x Is this possible for the give techology matrix V? This is a special case
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationBernoulli, Ramanujan, Toeplitz e le matrici triangolari
Due Giori di Algebra Lieare Numerica www.dima.uige.it/ dibeede/gg/home.html Geova, 6 7 Febbraio Beroulli, Ramauja, Toeplitz e le matrici triagolari Carmie Di Fiore, Fracesco Tudisco, Paolo Zellii Speaker:
More informationLecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting
Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would
More informationPAPER : IIT-JAM 2010
MATHEMATICS-MA (CODE A) Q.-Q.5: Oly oe optio is correct for each questio. Each questio carries (+6) marks for correct aswer ad ( ) marks for icorrect aswer.. Which of the followig coditios does NOT esure
More informationTHE KALMAN FILTER RAUL ROJAS
THE KALMAN FILTER RAUL ROJAS Abstract. This paper provides a getle itroductio to the Kalma filter, a umerical method that ca be used for sesor fusio or for calculatio of trajectories. First, we cosider
More informationAssignment Number 3 Solutions
Math 4354, Assigmet Number 3 Solutios 1. u t (x, t) = u xx (x, t), < x (1) u(, t) =, u(, t) = u(x, ) = x ( 1) +1 u(x, t) = e t si(x). () =1 Solutio: Look for simple solutios i the form u(x, t) =
More informationAssignment 2 Solutions SOLUTION. ϕ 1 Â = 3 ϕ 1 4i ϕ 2. The other case can be dealt with in a similar way. { ϕ 2 Â} χ = { 4i ϕ 1 3 ϕ 2 } χ.
PHYSICS 34 QUANTUM PHYSICS II (25) Assigmet 2 Solutios 1. With respect to a pair of orthoormal vectors ϕ 1 ad ϕ 2 that spa the Hilbert space H of a certai system, the operator  is defied by its actio
More informationImplicit function theorem
Jovo Jaric Implicit fuctio theorem The reader kows that the equatio of a curve i the x - plae ca be expressed F x, =., this does ot ecessaril represet a fuctio. Take, for example F x, = 2x x =. (1 either
More informationMath Solutions to homework 6
Math 175 - Solutios to homework 6 Cédric De Groote November 16, 2017 Problem 1 (8.11 i the book): Let K be a compact Hermitia operator o a Hilbert space H ad let the kerel of K be {0}. Show that there
More information1 Adiabatic and diabatic representations
1 Adiabatic ad diabatic represetatios 1.1 Bor-Oppeheimer approximatio The time-idepedet Schrödiger equatio for both electroic ad uclear degrees of freedom is Ĥ Ψ(r, R) = E Ψ(r, R), (1) where the full molecular
More informationTheorem: Let A n n. In this case that A does reduce to I, we search for A 1 as the solution matrix X to the matrix equation A X = I i.e.
Theorem: Let A be a square matrix The A has a iverse matrix if ad oly if its reduced row echelo form is the idetity I this case the algorithm illustrated o the previous page will always yield the iverse
More informationHW #4 Solutions: M697J Fall 2006
HW #4 Solutios: M697J Fall 2006. (4.2 BHM) Eigevalue calculatios i two dimesios. Cosider the weighted Jacobi method applied to the model Poisso equatio i two dimesios o the uit square. Assume a uiform
More informationGeometry of LS. LECTURE 3 GEOMETRY OF LS, PROPERTIES OF σ 2, PARTITIONED REGRESSION, GOODNESS OF FIT
OCTOBER 7, 2016 LECTURE 3 GEOMETRY OF LS, PROPERTIES OF σ 2, PARTITIONED REGRESSION, GOODNESS OF FIT Geometry of LS We ca thik of y ad the colums of X as members of the -dimesioal Euclidea space R Oe ca
More informationA) is empty. B) is a finite set. C) can be a countably infinite set. D) can be an uncountable set.
M.A./M.Sc. (Mathematics) Etrace Examiatio 016-17 Max Time: hours Max Marks: 150 Istructios: There are 50 questios. Every questio has four choices of which exactly oe is correct. For correct aswer, 3 marks
More informationThe z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j
The -Trasform 7. Itroductio Geeralie the complex siusoidal represetatio offered by DTFT to a represetatio of complex expoetial sigals. Obtai more geeral characteristics for discrete-time LTI systems. 7.
More informationFrequency Domain Filtering
Frequecy Domai Filterig Raga Rodrigo October 19, 2010 Outlie Cotets 1 Itroductio 1 2 Fourier Represetatio of Fiite-Duratio Sequeces: The Discrete Fourier Trasform 1 3 The 2-D Discrete Fourier Trasform
More informationMATH 304: MIDTERM EXAM SOLUTIONS
MATH 304: MIDTERM EXAM SOLUTIONS [The problems are each worth five poits, except for problem 8, which is worth 8 poits. Thus there are 43 possible poits.] 1. Use the Euclidea algorithm to fid the greatest
More information1 Last time: similar and diagonalizable matrices
Last time: similar ad diagoalizable matrices Let be a positive iteger Suppose A is a matrix, v R, ad λ R Recall that v a eigevector for A with eigevalue λ if v ad Av λv, or equivaletly if v is a ozero
More informationPolynomial Multiplication and Fast Fourier Transform
Polyomial Multiplicatio ad Fast Fourier Trasform Com S 477/577 Notes Ya-Bi Jia Sep 19, 2017 I this lecture we will describe the famous algorithm of fast Fourier trasform FFT, which has revolutioized digital
More informationPlease do NOT write in this box. Multiple Choice. Total
Istructor: Math 0560, Worksheet Alteratig Series Jauary, 3000 For realistic exam practice solve these problems without lookig at your book ad without usig a calculator. Multiple choice questios should
More informationAlgorithms and Data Structures 2014 Exercises and Solutions Week 13
Algorithms ad Data Structures 204 Exercises ad Solutios Week 3 Toom-Cook (cotiued) Durig the last lecture, two polyomials A(x) a 0 + a x ad B(x) b 0 + b x both of degree were multiplied, first by evaluatig
More informationFall 2011, EE123 Digital Signal Processing
Lecture 5 Miki Lustig, UCB September 14, 211 Miki Lustig, UCB Motivatios for Discrete Fourier Trasform Sampled represetatio i time ad frequecy umerical Fourier aalysis requires a Fourier represetatio that
More informationAPPENDIX F Complex Numbers
APPENDIX F Complex Numbers Operatios with Complex Numbers Complex Solutios of Quadratic Equatios Polar Form of a Complex Number Powers ad Roots of Complex Numbers Operatios with Complex Numbers Some equatios
More informationWe are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n
Review of Power Series, Power Series Solutios A power series i x - a is a ifiite series of the form c (x a) =c +c (x a)+(x a) +... We also call this a power series cetered at a. Ex. (x+) is cetered at
More informationZ ß cos x + si x R du We start with the substitutio u = si(x), so du = cos(x). The itegral becomes but +u we should chage the limits to go with the ew
Problem ( poits) Evaluate the itegrals Z p x 9 x We ca draw a right triagle labeled this way x p x 9 From this we ca read off x = sec, so = sec ta, ad p x 9 = R ta. Puttig those pieces ito the itegralrwe
More informationWhere do eigenvalues/eigenvectors/eigenfunctions come from, and why are they important anyway?
Where do eigevalues/eigevectors/eigeuctios come rom, ad why are they importat ayway? I. Bacgroud (rom Ordiary Dieretial Equatios} Cosider the simplest example o a harmoic oscillator (thi o a vibratig strig)
More informationSince X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain
Assigmet 9 Exercise 5.5 Let X biomial, p, where p 0, 1 is ukow. Obtai cofidece itervals for p i two differet ways: a Sice X / p d N0, p1 p], the variace of the limitig distributio depeds oly o p. Use the
More informationFIR Filter Design: Part II
EEL335: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we cosider how we might go about desigig FIR filters with arbitrary frequecy resposes, through compositio of multiple sigle-peak
More informationSeunghee Ye Ma 8: Week 5 Oct 28
Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value
More information, then cv V. Differential Equations Elements of Lineaer Algebra Name: Consider the differential equation. and y2 cos( kx)
Cosider the differetial equatio y '' k y 0 has particular solutios y1 si( kx) ad y cos( kx) I geeral, ay liear combiatio of y1 ad y, cy 1 1 cy where c1, c is also a solutio to the equatio above The reaso
More informationBasic Iterative Methods. Basic Iterative Methods
Abel s heorem: he roots of a polyomial with degree greater tha or equal to 5 ad arbitrary coefficiets caot be foud with a fiite umber of operatios usig additio, subtractio, multiplicatio, divisio, ad extractio
More informationLINEAR ALGEBRA. Paul Dawkins
LINEAR ALGEBRA Paul Dawkis Table of Cotets Preface... ii Outlie... iii Systems of Equatios ad Matrices... Itroductio... Systems of Equatios... Solvig Systems of Equatios... 5 Matrices... 7 Matrix Arithmetic
More informationlim za n n = z lim a n n.
Lecture 6 Sequeces ad Series Defiitio 1 By a sequece i a set A, we mea a mappig f : N A. It is customary to deote a sequece f by {s } where, s := f(). A sequece {z } of (complex) umbers is said to be coverget
More informationCSE 1400 Applied Discrete Mathematics Number Theory and Proofs
CSE 1400 Applied Discrete Mathematics Number Theory ad Proofs Departmet of Computer Scieces College of Egieerig Florida Tech Sprig 01 Problems for Number Theory Backgroud Number theory is the brach of
More information2 Geometric interpretation of complex numbers
2 Geometric iterpretatio of complex umbers 2.1 Defiitio I will start fially with a precise defiitio, assumig that such mathematical object as vector space R 2 is well familiar to the studets. Recall that
More informationApply change-of-basis formula to rewrite x as a linear combination of eigenvectors v j.
Eigevalue-Eigevector Istructor: Nam Su Wag eigemcd Ay vector i real Euclidea space of dimesio ca be uiquely epressed as a liear combiatio of liearly idepedet vectors (ie, basis) g j, j,,, α g α g α g α
More informationA Hadamard-type lower bound for symmetric diagonally dominant positive matrices
A Hadamard-type lower boud for symmetric diagoally domiat positive matrices Christopher J. Hillar, Adre Wibisoo Uiversity of Califoria, Berkeley Jauary 7, 205 Abstract We prove a ew lower-boud form of
More information(b) What is the probability that a particle reaches the upper boundary n before the lower boundary m?
MATH 529 The Boudary Problem The drukard s walk (or boudary problem) is oe of the most famous problems i the theory of radom walks. Oe versio of the problem is described as follows: Suppose a particle
More informationA NEW CLASS OF 2-STEP RATIONAL MULTISTEP METHODS
Jural Karya Asli Loreka Ahli Matematik Vol. No. (010) page 6-9. Jural Karya Asli Loreka Ahli Matematik A NEW CLASS OF -STEP RATIONAL MULTISTEP METHODS 1 Nazeeruddi Yaacob Teh Yua Yig Norma Alias 1 Departmet
More informationMon Feb matrix inverses. Announcements: Warm-up Exercise:
Math 225-4 Week 6 otes We will ot ecessarily fiish the material from a give day's otes o that day We may also add or subtract some material as the week progresses, but these otes represet a i-depth outlie
More informationStatistical Pattern Recognition
Statistical Patter Recogitio Classificatio: No-Parametric Modelig Hamid R. Rabiee Jafar Muhammadi Sprig 2014 http://ce.sharif.edu/courses/92-93/2/ce725-2/ Ageda Parametric Modelig No-Parametric Modelig
More informationSection 11.8: Power Series
Sectio 11.8: Power Series 1. Power Series I this sectio, we cosider geeralizig the cocept of a series. Recall that a series is a ifiite sum of umbers a. We ca talk about whether or ot it coverges ad i
More informationTridiagonal reduction redux
Week 15: Moday, Nov 27 Wedesday, Nov 29 Tridiagoal reductio redux Cosider the problem of computig eigevalues of a symmetric matrix A that is large ad sparse Usig the grail code i LAPACK, we ca compute
More information[ 11 ] z of degree 2 as both degree 2 each. The degree of a polynomial in n variables is the maximum of the degrees of its terms.
[ 11 ] 1 1.1 Polyomial Fuctios 1 Algebra Ay fuctio f ( x) ax a1x... a1x a0 is a polyomial fuctio if ai ( i 0,1,,,..., ) is a costat which belogs to the set of real umbers ad the idices,, 1,...,1 are atural
More informationMath 155 (Lecture 3)
Math 55 (Lecture 3) September 8, I this lecture, we ll cosider the aswer to oe of the most basic coutig problems i combiatorics Questio How may ways are there to choose a -elemet subset of the set {,,,
More informationSeptember 2012 C1 Note. C1 Notes (Edexcel) Copyright - For AS, A2 notes and IGCSE / GCSE worksheets 1
September 0 s (Edecel) Copyright www.pgmaths.co.uk - For AS, A otes ad IGCSE / GCSE worksheets September 0 Copyright www.pgmaths.co.uk - For AS, A otes ad IGCSE / GCSE worksheets September 0 Copyright
More informationNumerical Method for Blasius Equation on an infinite Interval
Numerical Method for Blasius Equatio o a ifiite Iterval Alexader I. Zadori Omsk departmet of Sobolev Mathematics Istitute of Siberia Brach of Russia Academy of Scieces, Russia zadori@iitam.omsk.et.ru 1
More informationChapter 6: Determinants and the Inverse Matrix 1
Chapter 6: Determiats ad the Iverse Matrix SECTION E pplicatios of Determiat By the ed of this sectio you will e ale to apply Cramer s rule to solve liear equatios ermie the umer of solutios of a give
More information7 Sequences of real numbers
40 7 Sequeces of real umbers 7. Defiitios ad examples Defiitio 7... A sequece of real umbers is a real fuctio whose domai is the set N of atural umbers. Let s : N R be a sequece. The the values of s are
More informationMath 113 Exam 3 Practice
Math Exam Practice Exam will cover.-.9. This sheet has three sectios. The first sectio will remid you about techiques ad formulas that you should kow. The secod gives a umber of practice questios for you
More information1 lim. f(x) sin(nx)dx = 0. n sin(nx)dx
Problem A. Calculate ta(.) to 4 decimal places. Solutio: The power series for si(x)/ cos(x) is x + x 3 /3 + (2/5)x 5 +. Puttig x =. gives ta(.) =.3. Problem 2A. Let f : R R be a cotiuous fuctio. Show that
More informationMath 113 Exam 3 Practice
Math Exam Practice Exam 4 will cover.-., 0. ad 0.. Note that eve though. was tested i exam, questios from that sectios may also be o this exam. For practice problems o., refer to the last review. This
More information1 1 2 = show that: over variables x and y. [2 marks] Write down necessary conditions involving first and second-order partial derivatives for ( x0, y
Questio (a) A square matrix A= A is called positive defiite if the quadratic form waw > 0 for every o-zero vector w [Note: Here (.) deotes the traspose of a matrix or a vector]. Let 0 A = 0 = show that:
More information1. Linearization of a nonlinear system given in the form of a system of ordinary differential equations
. Liearizatio of a oliear system give i the form of a system of ordiary differetial equatios We ow show how to determie a liear model which approximates the behavior of a time-ivariat oliear system i a
More informationChapter 9: Numerical Differentiation
178 Chapter 9: Numerical Differetiatio Numerical Differetiatio Formulatio of equatios for physical problems ofte ivolve derivatives (rate-of-chage quatities, such as velocity ad acceleratio). Numerical
More informationSequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet
More information