Equation to Be Solved. Grid i,j Notation. A Small Grid (N = 6, M = 5) Solving the Equations. General Equation in a Matrix
|
|
- Buck Tucker
- 5 years ago
- Views:
Transcription
1 Iteraton olutons arch 7, umercal olutons of nte Volume quatons arry aretto echancal ngneerng 9 omputatonal lud ynamcs arch 7, quaton to e olved W W Q J - j W -j Have a set of smultaneous lnear equaton to be solved algebracally coeffcents dfferent for u, v, p, but all equatons seen here lnk central () node to nearest neghbors parse matrx system, look at teratve methods for soluton mall Grd (, ) j j oundary j nodes j j j omputatonal olecule Grd,j otaton or system typcally use ths notaton n combnaton wth compass ponts otaton pont s general coeffcent refers to a partcular node ont (orth), (outh), (ast), W(est) refers to neghborng nodes by drecton General equaton shown below W j j W W j b olvng the quatons Typcally have large number of equatons formng sparse matrx or Δx Δy. have 99 equatons so matrx has 9x potental coeffcents Only 89 (.%) are nonzero Want data structure and algorthm for handlng sparse matrces Gauss elmnaton uses storage for banded matrces Iteratve methods used for solutons General quaton n a atrx ook at separaton between coeffcents coeffcents that are zero ot present n frst rows W ot present n frst equaton and zero n equaton and every equatons thereafter coeffcents that are zero ot present n last rows Zero n equaton and every equatons thereafter. ot present n last equaton 9 omputatonal lud ynamcs
2 Iteraton olutons arch 7, parse atrx tructure equatons can have coeffcents Here each equaton has no more than fve coeffcents ( possble) oundares gve another ( - ) zero coeffcents (8 n ths example) Thus, we have 8 nonzero coeffcents and 8 8 zeros n matrx early 8% of coeffcents are zero racton ncreases for larger grds 7 How parse s the atrx? The by grd has ( )( ) nodes wth equatons gvng ( ) ( ) possble coeffcents Wthout boundares we have only ( )( ) nonzero coeffcents oundares gve ( ) ( ) ( ) addtonal zero coeffcents onzero ( )( ) ( ) ( ) racton ( ) ( ) 8 ( )( ) ( )( ) ( ) ( ) What akes parseness? ach node s connected only to a small number of nearest neghbors roblem here has four neghbors Hgher order schemes and fntevolume equaton can have more neghbors an have complex coeffcents so long as number of neghbors s lmted onvecton-dffuson coeffcents wth uneven grd spacng are an example of complex coeffcents n a sparse matrx 9 Iteratve olutons mplest examples are Jacob, Gauss- edel, and uccessve Over Relaxaton ove from teraton n to teraton n Iteraton s ntal guess (often all zero) traghtforward approach: solve equaton for and use ths as bass for teraton W b j j ' ' W ' ' ' b j j Iteratve olutons II Use superscrpt (n) for teraton number Jacob teraton uses all old values ) ' ' W ' ' ' b j j Gauss edel uses most-recent values ) ' ' ) W ' ) ' ' b j j Relaxaton bass: Gauss edel provdes a correcton that can be adjusted ) ( n ), G ω ) [ ] xample roblem ook at smple system of equatons ould solve exactly to fnd x, y Use to llustrate teraton 8 y x y 8 x Orgnal system x y x y Jacob general form and frst steps ) 8 y () 8 y x () x x () ) x y () x y y Iteraton orm Relaxaton actor () () 8 9 omputatonal lud ynamcs
3 Iteraton olutons arch 7, Jacob xample ontnued () 8 y x () x y () () 8 ( 8 ) 8 () () 8 y 8 8 x 8 () () x ( 8 ) y What s next teraton? How do we know we re fnshed? oncludng Iteratons In general, do not know correct answers Two common measures Resdual: r Σ j a x j b fference n one teraton x (n) x (n) an use relatve or absolute measure eed vector norm such as maxmum absolute value or root mean square ook at summary of teratons for Jacob n Jacob Iteraton Hstory x n y n x resdual y resdual x change y change y x ) ) 8 y ( n x Gauss-edel Iteraton pply Gauss-edel Iteraton to same set of equatons 8 y x y 8 x Orgnal Iteraton system x y x orm y Gauss-edel general teraton form and frst step (uses most recent values) ) x y () () y () () () 8 y 8 x () x 8 y Gauss-edel Iteraton II () () () 8 y 8 8 x 8 () x ( 8 8) 79 9 () () 8 y x.8... () () x ( 8 ) y aster convergence n Gauss-edel 7 Relaxaton ethods Relaxaton factor, ω, greater than or less than s over- or underrelaxaton Underrelaxaton procures stablty n problems that wll not converge Overrelaxaton procures speed n wellbehaved problems ) ω, G ) ' ) ω, G ) [ ] ( ) ( ω ) ω[ W ' ) j ' j b ' ω ] ' 8 9 omputatonal lud ynamcs
4 Iteraton olutons arch 7, Relaxaton ode (f s ) do ter, maxiter maxresd do, do j, old f(,j) f(,j) (omega ) * f(,j) One set of teratons (omtted on next page) omega * ( (,j) * f(,j) (,j) * f(,j) (,j) * f(,j-) W(,j) * f(-,j) - b(,j) ) resd abs( ( f(,j) old ) / f(,j) ) f ( resd > maxresd ) then maxresd resd; end f 9 Relaxaton ode II do ter, maxiter maxresd ; do, - do j, -!compute new f(,j) and maxresd end do end do f ( maxresd < errtol ) ext end do f ( maxresd > errtol ) then prnt *, ot converged else call dooutput( f,, ) end f onvergng Iteratons Have three dfferent solutons orrect soluton to dfferental equaton xact soluton to fnte-dfference equatons urrent and prevous teraton values Iteratons should approach correct soluton to fnte-dfference equatons nce nether correct soluton s known, we use norm of error estmates Resdual n fnte-dfference equatons hange n teraton value onvergng Iteratons II t each grd node we can compute a relatve change or a resdual oth are zero at convergence Relatve hange [ Resdual] W ' ) j ) ' j ) ) ' ) ' ' b onvergng Iteratons III eed some overall measure of convergence error onsder error (relatve change or resdual) at each pont as one component of a vector Use vector norm for overall error axmum absolute value (zero norm) Root mean squared error (two norm) ε node all nodes εoverall nodes mple umercal xample ook at smple, two-dmensonal case wth dffuson only (veloctes are zero) rchlet (fxed ) boundary condtons Use fnte-volume equaton from orgnal work on dffuson wth a source term et source term to zero and use constant grd szes and Γ olve fnte-volume equaton for ths case (v, Δx, Δy fxed, constant Γ) 9 omputatonal lud ynamcs
5 Iteraton olutons arch 7, Γ Γ v, Δx, Δy, Γ constant ( ) e ( ) w Δ y Γ x x W Δ y Γ x xw vde by ΓΔy/Δx Δx Δy ( ) n ( ) s Δ x y y Δ x y y ( ) ( ) W Δx Δy W -j v, Δx, Δy, Γ constant II Δy Δx Δx Δy - j W ( ) ( ) Δx Δy Δx Δy efne β Δx/Δy and rearrange terms ( ) ( β ) ( ) ( β ) W β j j β nte-dfference quaton nte-volume form typcal of twodmensonal aplace equaton If β Δx/Δy, s the average of ts four nearest neghbors j j onsder rchlet boundary condtons known at all boundary nodes eed to fnd ( )( ) unknown values of on grd 7 mall Grd (, ) j j oundary j nodes j j j omputatonal olecule 8 Grd quatons (β ) and gves ( )( ) equatons only eght shown agonal structure ncorrect here 9 xecuton Tmes and rrors xamne square regon wth zero boundary condtons at x, x x max, and y ; two cases for y y max ase : constant value of (x) ase : (x) sn(πx) rst case has dscontnuty for y y max at x and x x max Use overrelaxaton (OR) wth varable relaxaton factors 9 omputatonal lud ynamcs
6 Iteraton olutons arch 7, xecuton Tmes and rrors II Iterate untl maxmum teraton dfference n s about machne error ase : constant value of (x) ase : (x) sn(πx) rst case has dscontnuty for y y max at x and x x max ompare solutons to exact soluton of dfferental equaton and exact soluton of fnte dfference equatons xecuton Tme (seconds) ffect of Relaxaton actor on xecuton Tme quare ( H ) by Grd Zero boundary on left, rght and bottom Top boundary has (x,h) sn(πx/) "Other" s dfferent code wth (x,h). x grd x grd x grd 8x8 grd Other code Relaxaton actor ffect of Iteratons on rrors ompare three error measures usng the maxmum value on the grd True teraton error: dfference between the current value and the value found by an exact soluton of the dfference equatons fference n between two teratons Resdual j -j - xact error s dfference between teraton value and exact soluton of dfferental equaton rrors ffects of Iteratons on aplace quaton rrors fference.-7 Resdual.-8 Iteraton error.-9 quare ( H ) xact rror.- by Grd Zero boundary on left,.- rght and bottom.- Top boundary has.- u(x,h) sn(πx/) Iteratons Wll Iteratons onverge? How do we ensure that an teratve process converges? ook at general example of solvng a system of smultaneous equatons by teraton Wrte equaton n matrx form b evelop general teraton algorthm n matrx form ook at crteron for error to decrease atrx quaton orm dvanced soluton technques treat matrx for fnte-dfference equatons eads to dmensonal confuson tart wth grd (x and y ndces) Treat as matrx equaton where unknowns form a column vector (one-dmensonal) The coeffcents n the matrx form a twodmensonal dsplay xamne small grd example Take W, - 9 omputatonal lud ynamcs
7 Iteraton olutons arch 7, General atrx tructure onfuson about two twodmensonal representatons Grd has two space dmensons wth ( )( ) unknown nodes forms a one dmensonal column matrx of unknowns (at rght) oeffcent matrx has fve dagonals Rght-hand sde has boundary values W b j j 7 revous oluton atrx W omplex coeffcents have same structure but dfferent values lements occur on dagonals, s prncpal dagonal General oluton atrx, ke the one on the prevous chart Has more rows for more grd ponts oeffcents may not be the same Wll be generally sparse Has regular structure for smple grds Unstructured grds do not gve smple structure, but keep a sparse matrx We want to solve b where s a vector of all the unknowns on the grd General Iteraton pproaches We want to solve b by teraton s the soluton to the fnte-dfference equatons, has truncaton error even wth perfect teraton soluton efne teraton error as ε (n) (n) efne resdual, r (n) b (n) ombne equatons: r (n) b (n) (n) ( (n) ) ε (n) r (n) ε (n) relates computable r (n) to ε (n) that we want to control but can t compute 9 General Iteraton pproaches II One teraton step takes the old values, (n), to the new values, (n) General teraton: (n) (n) b ethods select and to accelerate convergence of teratons t convergence, (n) (n), so that (n) (n) b s ( ) b We are solvng b, so we must have xample of and atrces Heat conducton wth constant propertes and no source term wth x y ystem of equatons wth nne unknowns oundary values known olve b 9 omputatonal lud ynamcs 7
8 Iteraton olutons arch 7, xample of and atrces II Iterate Gauss edel from lower left to upper rght usng newest values ) ) ) j j When solvng for we wll have current teraton values for b and (n) (n) b ) ) ) and j j b b G matrx G matrx atrx for OR ) ω ω ω ω ω ω ω ω ω ω ω ω ) ) ) ( ω ω ω ω ω j j n) ( ) d atrx for OR ω ω d ω ω d ω d ω ω d ω ω d ω d ω d ω d d ω ω ( ω ) ) ) ) ω ω ω ω j j ext teps ook at general teraton equaton: (n) (n) b Get equaton for evoluton of error vector, ε (n), representng error n each unknown at step n How does error at new step, ε (n) depend on error at old step, ε (n) How can we guarantee that error does not grow at each step? onvergence tart wth (n) (n) b ubtract (n) from each sde Result s ( (n) (n) )b ( ) (n) ut we sad that, so result s ( (n) (n) )b ( ) (n) b (n) We defned b (n) r (n) ε (n), so ( (n) (n) )b (n) r (n) ε (n) omputatonal lud ynamcs 8
9 Iteraton olutons arch 7, onvergence II rom last chart: ( (n) (n) ) r (n) ε (n) efne update δ (n) (n) (n) ( (n) (n) )δ (n) r (n) ε (n) Have two computable measures of error, ε (n) ; these are δ (n) and r (n) What makes error decrease? oes the rror ecrease? Iteraton equaton: (n) (n) b t convergence, (n) (n), so that b ubtract b from (n) (n) b gvng ( (n) ) ( (n) ), whch gves ε (n) ε (n) ew error gven by ε (n) - ε (n) oes the error go to zero as we take more teratons? 9 atrx genvalues: x λx Used to determne convergence If a matrx,, multples a vector x and produces a constant λ tmes x x s an egenvector of λ s the egenvalue assocated wth x n n by n matrx can have up to n lnearly ndependent egenvalues If the n egenvectors are lnearly ndependent we can expand any n component vector n terms of the egenvectors ε ε rror ecrease epends on - () () ssume that - has a complete set of egenvalues, x (k) so we can expand the ntal error vector n terms of these egenvectors ε () Σ k a k x (k) Iteraton process gves followng results where λ k s egenvalue ( - x (k) λ k x (k) ) ε ε () () akx( k ) k akλkx( k ) k a x k k a λ x k k k a λ x ( k ) k k ( k ) k ( k ) akλkx( k ) k General rror quaton Reasonng by nducton from the last two equatons gves ε (n) as follows ε k a λ x k n k ( k ) or error to become small as teratons ncrease, we must have all λ k < argest λ k λ, called spectral radus, wll domnate sum for large n ε (n) a λ n x () General rror quaton II To control error n ε (n) a λ n x () requre factor a λ n ln δ or λ n δ/a n Take logs of both sdes and ln solve for n Recall that ln( x) x for small x When λ s close to, ln λ wll be a small number and n wll be large eek teraton matrces wth small λ δ a λ Want ths to reach desred error, δ 9 omputatonal lud ynamcs 9
10 Iteraton olutons arch 7, OR pectral Radus Use T to compute the spectral radus, λ maxmum λ for OR nd optmum ω (mnmum λ ) by tral and error ω..7.8 λ ω λ ω λ agonal omnance The real requrement s that the largest egenvalue be less than one n absolute value Ths s guaranteed n the soluton matrx s dagonally domnant Ths means that the dagonal coeffcent (n absolute value) s greater than or equal to the sum of the absolute values of all other coeffcents n the equaton agonal omnance II If the coeffcents n the matrx are a km, the rules for dagonal domnance n an x matrx are a kk > Σ m a km for k a kk > Σ m a km for at least one value of k General fnte-dfference equatons satsfy the > condton and boundary condtons satsfy the > condton Upwnd dfference dagonally domnant dvanced ethods ee text for greater dscusson ethods use dfferent teraton matrces to get faster convergence lternatng recton Implct (I) tone s ethod onjugate Gradent ultgrd ultgrd generally consdered fastest method for calculatons 7 8 ultgrd ethod olve equatons on a set of dfferent grds nalyss of error shows that convergence rate depends on grd sze Gettng a soluton to a coarse grd then usng those results for the fne grd gves soluton faster Use prolongaton and restrcton to get results between fne and coarse grde ultgrd ethod II fferent patterns used; example below tart wth fne grd fter partal convergence on fnd grd use coarser grd and do teratons to get more convergence on that grd ontnue to coarsest grd and get convergence there rolong soluton to fner grds and get converged soluton on each grd nally get converged soluton on fnest grd 9 9 omputatonal lud ynamcs
11 Iteraton olutons arch 7, 9 omputatonal lud ynamcs Thomas lgorthm Used for smple soluton of onedmensonal problems an be extended to mproved teraton approach for two- or three-dmensonal problems asc problem: a W W a a b Generalzed one-dmensonal problem k f k- k f k k f k k ook at matrx form Thomas lgorthm II General format for trdagonal equatons O Thomas lgorthm III The matrx s called a trdagonal matrx Has prncpal dagonal, one dagonal above prncpal dagonal, and one dagonal below prncpal dagonal an apply tradtonal Gauss elmnaton for soluton of smultaneous lnear equatons to get smple upper trangular form mple equatons to obtan ths Thomas lgorthm IV O Gauss elmnaton upper trangular form Thomas lgorthm V orward computatons Intal: / / or, -: x ack substtute: x x Get last x value frst Thomas xample ( ) ( ) ( ) ontnue to fnd,,, and
12 Iteraton olutons arch 7, ack substtuton (shows and results) Orgnal equaton set shows results are correct Thomas xample II 7 9 ( ) Thomas for Two mensons Two dmensonal equaton: a a - a j a a W -j b ook at one-dmensonal approach n x drecton: a j a a W -j b a a - Use Thomas algorthm n x-drecton a ) W j a a b a a ) ) j ) ) ) j j ext apply algorthm n y drecton 8 Thomas for Two mensons II y-drecton form a ) a a b a a ) ) j ) ) ) W j Ths approach nvolves more calculatons per teraton, but t can reduce error more quckly by gettng smultaneous solutons of results along one coordnate drecton an be extended to three dmensons Unstructured Grds o not have k ndexng system that regular grds have odes numbered sequentally wth sngle ndex ust store nformaton on numbers of nearest neghbors for each node quaton matrx s stll sparse, but not so well structured o not have all coeffcents on or 7 dagonals 9 7 onlnear roblems equatons are nonlnear system of dfference equatons Have terms lke u and uu Have to solve for u, v, w, T, p, etc. Typcally lnearze problem by wrtng terms lke u as u (n) (n) to solve for (n) Once teraton n s complete, update lnearzed terms Usually requres underrelaxaton 7 9 omputatonal lud ynamcs
ME 501A Seminar in Engineering Analysis Page 1
umercal Solutons of oundary-value Problems n Os ovember 7, 7 umercal Solutons of oundary- Value Problems n Os Larry aretto Mechancal ngneerng 5 Semnar n ngneerng nalyss ovember 7, 7 Outlne Revew stff equaton
More informationChapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems
Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons
More informationRelaxation Methods for Iterative Solution to Linear Systems of Equations
Relaxaton Methods for Iteratve Soluton to Lnear Systems of Equatons Gerald Recktenwald Portland State Unversty Mechancal Engneerng Department gerry@pdx.edu Overvew Techncal topcs Basc Concepts Statonary
More informationLectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix
Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could
More informationVector Norms. Chapter 7 Iterative Techniques in Matrix Algebra. Cauchy-Bunyakovsky-Schwarz Inequality for Sums. Distances. Convergence.
Vector Norms Chapter 7 Iteratve Technques n Matrx Algebra Per-Olof Persson persson@berkeley.edu Department of Mathematcs Unversty of Calforna, Berkeley Math 128B Numercal Analyss Defnton A vector norm
More information1 GSW Iterative Techniques for y = Ax
1 for y = A I m gong to cheat here. here are a lot of teratve technques that can be used to solve the general case of a set of smultaneous equatons (wrtten n the matr form as y = A), but ths chapter sn
More informationErrors for Linear Systems
Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch
More informationCME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 13
CME 30: NUMERICAL LINEAR ALGEBRA FALL 005/06 LECTURE 13 GENE H GOLUB 1 Iteratve Methods Very large problems (naturally sparse, from applcatons): teratve methods Structured matrces (even sometmes dense,
More informationSTAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 16
STAT 39: MATHEMATICAL COMPUTATIONS I FALL 218 LECTURE 16 1 why teratve methods f we have a lnear system Ax = b where A s very, very large but s ether sparse or structured (eg, banded, Toepltz, banded plus
More information2.3 Nilpotent endomorphisms
s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms
More informationLecture 21: Numerical methods for pricing American type derivatives
Lecture 21: Numercal methods for prcng Amercan type dervatves Xaoguang Wang STAT 598W Aprl 10th, 2014 (STAT 598W) Lecture 21 1 / 26 Outlne 1 Fnte Dfference Method Explct Method Penalty Method (STAT 598W)
More informationChapter 12. Ordinary Differential Equation Boundary Value (BV) Problems
Chapter. Ordnar Dfferental Equaton Boundar Value (BV) Problems In ths chapter we wll learn how to solve ODE boundar value problem. BV ODE s usuall gven wth x beng the ndependent space varable. p( x) q(
More informationLecture 12: Discrete Laplacian
Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationρ some λ THE INVERSE POWER METHOD (or INVERSE ITERATION) , for , or (more usually) to
THE INVERSE POWER METHOD (or INVERSE ITERATION) -- applcaton of the Power method to A some fxed constant ρ (whch s called a shft), x λ ρ If the egenpars of A are { ( λ, x ) } ( ), or (more usually) to,
More informationn α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0
MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector
More informationSolution of Linear System of Equations and Matrix Inversion Gauss Seidel Iteration Method
Soluton of Lnear System of Equatons and Matr Inverson Gauss Sedel Iteraton Method It s another well-known teratve method for solvng a system of lnear equatons of the form a + a22 + + ann = b a2 + a222
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have
More informationCHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE
CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng
More informationReport on Image warping
Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.
More informationMultigrid Methods and Applications in CFD
Multgrd Metods and Applcatons n CFD Mcael Wurst 0 May 009 Contents Introducton Typcal desgn of CFD solvers 3 Basc metods and ter propertes for solvng lnear systems of equatons 4 Geometrc Multgrd 3 5 Algebrac
More informationU.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017
U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that
More informationConsistency & Convergence
/9/007 CHE 374 Computatonal Methods n Engneerng Ordnary Dfferental Equatons Consstency, Convergence, Stablty, Stffness and Adaptve and Implct Methods ODE s n MATLAB, etc Consstency & Convergence Consstency
More information36.1 Why is it important to be able to find roots to systems of equations? Up to this point, we have discussed how to find the solution to
ChE Lecture Notes - D. Keer, 5/9/98 Lecture 6,7,8 - Rootndng n systems o equatons (A) Theory (B) Problems (C) MATLAB Applcatons Tet: Supplementary notes rom Instructor 6. Why s t mportant to be able to
More informationSome Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS)
Some Comments on Acceleratng Convergence of Iteratve Sequences Usng Drect Inverson of the Iteratve Subspace (DIIS) C. Davd Sherrll School of Chemstry and Bochemstry Georga Insttute of Technology May 1998
More informationHongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)
ISSN 1749-3889 (prnt), 1749-3897 (onlne) Internatonal Journal of Nonlnear Scence Vol.17(2014) No.2,pp.188-192 Modfed Block Jacob-Davdson Method for Solvng Large Sparse Egenproblems Hongy Mao, College of
More informationChapter Newton s Method
Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve
More informationSingular Value Decomposition: Theory and Applications
Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real
More information2.29 Numerical Fluid Mechanics Fall 2011 Lecture 12
REVIEW Lecture 11: 2.29 Numercal Flud Mechancs Fall 2011 Lecture 12 End of (Lnear) Algebrac Systems Gradent Methods Krylov Subspace Methods Precondtonng of Ax=b FINITE DIFFERENCES Classfcaton of Partal
More informationLecture Notes on Linear Regression
Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume
More informationOPTIMISATION. Introduction Single Variable Unconstrained Optimisation Multivariable Unconstrained Optimisation Linear Programming
OPTIMIATION Introducton ngle Varable Unconstraned Optmsaton Multvarable Unconstraned Optmsaton Lnear Programmng Chapter Optmsaton /. Introducton In an engneerng analss, sometmes etremtes, ether mnmum or
More informationNorms, Condition Numbers, Eigenvalues and Eigenvectors
Norms, Condton Numbers, Egenvalues and Egenvectors 1 Norms A norm s a measure of the sze of a matrx or a vector For vectors the common norms are: N a 2 = ( x 2 1/2 the Eucldean Norm (1a b 1 = =1 N x (1b
More informationEEE 241: Linear Systems
EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they
More informationPolynomial Regression Models
LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance
More informationFTCS Solution to the Heat Equation
FTCS Soluton to the Heat Equaton ME 448/548 Notes Gerald Recktenwald Portland State Unversty Department of Mechancal Engneerng gerry@pdx.edu ME 448/548: FTCS Soluton to the Heat Equaton Overvew 1. Use
More informationPART 8. Partial Differential Equations PDEs
he Islamc Unverst of Gaza Facult of Engneerng Cvl Engneerng Department Numercal Analss ECIV 3306 PAR 8 Partal Dfferental Equatons PDEs Chapter 9; Fnte Dfference: Ellptc Equatons Assocate Prof. Mazen Abualtaef
More informationA New Refinement of Jacobi Method for Solution of Linear System Equations AX=b
Int J Contemp Math Scences, Vol 3, 28, no 17, 819-827 A New Refnement of Jacob Method for Soluton of Lnear System Equatons AX=b F Naem Dafchah Department of Mathematcs, Faculty of Scences Unversty of Gulan,
More information4DVAR, according to the name, is a four-dimensional variational method.
4D-Varatonal Data Assmlaton (4D-Var) 4DVAR, accordng to the name, s a four-dmensonal varatonal method. 4D-Var s actually a drect generalzaton of 3D-Var to handle observatons that are dstrbuted n tme. The
More information8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS
SECTION 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS 493 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS All the vector spaces you have studed thus far n the text are real vector spaces because the scalars
More informationInner Product. Euclidean Space. Orthonormal Basis. Orthogonal
Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,
More informationThe Exact Formulation of the Inverse of the Tridiagonal Matrix for Solving the 1D Poisson Equation with the Finite Difference Method
Journal of Electromagnetc Analyss and Applcatons, 04, 6, 0-08 Publshed Onlne September 04 n ScRes. http://www.scrp.org/journal/jemaa http://dx.do.org/0.46/jemaa.04.6000 The Exact Formulaton of the Inverse
More informationAPPENDIX A Some Linear Algebra
APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,
More informationAdditional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty
Addtonal Codes usng Fnte Dfference Method Benamn Moll 1 HJB Equaton for Consumpton-Savng Problem Wthout Uncertanty Before consderng the case wth stochastc ncome n http://www.prnceton.edu/~moll/ HACTproect/HACT_Numercal_Appendx.pdf,
More informationThe equation of motion of a dynamical system is given by a set of differential equations. That is (1)
Dynamcal Systems Many engneerng and natural systems are dynamcal systems. For example a pendulum s a dynamcal system. State l The state of the dynamcal system specfes t condtons. For a pendulum n the absence
More informationComputational Astrophysics
Computatonal Astrophyscs Solvng for Gravty Alexander Knebe, Unversdad Autonoma de Madrd Computatonal Astrophyscs Solvng for Gravty the equatons full set of equatons collsonless matter (e.g. dark matter
More informationProf. Dr. I. Nasser Phys 630, T Aug-15 One_dimensional_Ising_Model
EXACT OE-DIMESIOAL ISIG MODEL The one-dmensonal Isng model conssts of a chan of spns, each spn nteractng only wth ts two nearest neghbors. The smple Isng problem n one dmenson can be solved drectly n several
More informationDifference Equations
Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1
More information1 Matrix representations of canonical matrices
1 Matrx representatons of canoncal matrces 2-d rotaton around the orgn: ( ) cos θ sn θ R 0 = sn θ cos θ 3-d rotaton around the x-axs: R x = 1 0 0 0 cos θ sn θ 0 sn θ cos θ 3-d rotaton around the y-axs:
More informationYong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )
Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often
More information= = = (a) Use the MATLAB command rref to solve the system. (b) Let A be the coefficient matrix and B be the right-hand side of the system.
Chapter Matlab Exercses Chapter Matlab Exercses. Consder the lnear system of Example n Secton.. x x x y z y y z (a) Use the MATLAB command rref to solve the system. (b) Let A be the coeffcent matrx and
More informationMMA and GCMMA two methods for nonlinear optimization
MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons
More informationSalmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2
Salmon: Lectures on partal dfferental equatons 5. Classfcaton of second-order equatons There are general methods for classfyng hgher-order partal dfferental equatons. One s very general (applyng even to
More informationDynamic Programming. Preview. Dynamic Programming. Dynamic Programming. Dynamic Programming (Example: Fibonacci Sequence)
/24/27 Prevew Fbonacc Sequence Longest Common Subsequence Dynamc programmng s a method for solvng complex problems by breakng them down nto smpler sub-problems. It s applcable to problems exhbtng the propertes
More informationC4B Machine Learning Answers II. = σ(z) (1 σ(z)) 1 1 e z. e z = σ(1 σ) (1 + e z )
C4B Machne Learnng Answers II.(a) Show that for the logstc sgmod functon dσ(z) dz = σ(z) ( σ(z)) A. Zsserman, Hlary Term 20 Start from the defnton of σ(z) Note that Then σ(z) = σ = dσ(z) dz = + e z e z
More informationNew Method for Solving Poisson Equation. on Irregular Domains
Appled Mathematcal Scences Vol. 6 01 no. 8 369 380 New Method for Solvng Posson Equaton on Irregular Domans J. Izadan and N. Karamooz Department of Mathematcs Facult of Scences Mashhad BranchIslamc Azad
More informationMore metrics on cartesian products
More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of
More informationFinite Element Modelling of truss/cable structures
Pet Schreurs Endhoven Unversty of echnology Department of Mechancal Engneerng Materals echnology November 3, 214 Fnte Element Modellng of truss/cable structures 1 Fnte Element Analyss of prestressed structures
More informationTransfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system
Transfer Functons Convenent representaton of a lnear, dynamc model. A transfer functon (TF) relates one nput and one output: x t X s y t system Y s The followng termnology s used: x y nput output forcng
More informationLecture 10 Support Vector Machines II
Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed
More informationLECTURE 9 CANONICAL CORRELATION ANALYSIS
LECURE 9 CANONICAL CORRELAION ANALYSIS Introducton he concept of canoncal correlaton arses when we want to quantfy the assocatons between two sets of varables. For example, suppose that the frst set of
More informationGeneralized Linear Methods
Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set
More informationMin Cut, Fast Cut, Polynomial Identities
Randomzed Algorthms, Summer 016 Mn Cut, Fast Cut, Polynomal Identtes Instructor: Thomas Kesselhem and Kurt Mehlhorn 1 Mn Cuts n Graphs Lecture (5 pages) Throughout ths secton, G = (V, E) s a mult-graph.
More informationInductance Calculation for Conductors of Arbitrary Shape
CRYO/02/028 Aprl 5, 2002 Inductance Calculaton for Conductors of Arbtrary Shape L. Bottura Dstrbuton: Internal Summary In ths note we descrbe a method for the numercal calculaton of nductances among conductors
More informationLimited Dependent Variables
Lmted Dependent Varables. What f the left-hand sde varable s not a contnuous thng spread from mnus nfnty to plus nfnty? That s, gven a model = f (, β, ε, where a. s bounded below at zero, such as wages
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More information2.29 Numerical Fluid Mechanics
REVIEW Lecture 10: Sprng 2015 Lecture 11 Classfcaton of Partal Dfferental Equatons PDEs) and eamples wth fnte dfference dscretzatons Parabolc PDEs Ellptc PDEs Hyperbolc PDEs Error Types and Dscretzaton
More informationGlobal Sensitivity. Tuesday 20 th February, 2018
Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values
More informationBezier curves. Michael S. Floater. August 25, These notes provide an introduction to Bezier curves. i=0
Bezer curves Mchael S. Floater August 25, 211 These notes provde an ntroducton to Bezer curves. 1 Bernsten polynomals Recall that a real polynomal of a real varable x R, wth degree n, s a functon of the
More informationNUMERICAL DIFFERENTIATION
NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the
More informationIntroduction to Vapor/Liquid Equilibrium, part 2. Raoult s Law:
CE304, Sprng 2004 Lecture 4 Introducton to Vapor/Lqud Equlbrum, part 2 Raoult s Law: The smplest model that allows us do VLE calculatons s obtaned when we assume that the vapor phase s an deal gas, and
More informationCIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M
CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute
More informationProblem Set 9 Solutions
Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem
More informationGrid Generation around a Cylinder by Complex Potential Functions
Research Journal of Appled Scences, Engneerng and Technolog 4(): 53-535, 0 ISSN: 040-7467 Mawell Scentfc Organzaton, 0 Submtted: December 0, 0 Accepted: Januar, 0 Publshed: June 0, 0 Grd Generaton around
More informationSolutions to exam in SF1811 Optimization, Jan 14, 2015
Solutons to exam n SF8 Optmzaton, Jan 4, 25 3 3 O------O -4 \ / \ / The network: \/ where all lnks go from left to rght. /\ / \ / \ 6 O------O -5 2 4.(a) Let x = ( x 3, x 4, x 23, x 24 ) T, where the varable
More informationExample: (13320, 22140) =? Solution #1: The divisors of are 1, 2, 3, 4, 5, 6, 9, 10, 12, 15, 18, 20, 27, 30, 36, 41,
The greatest common dvsor of two ntegers a and b (not both zero) s the largest nteger whch s a common factor of both a and b. We denote ths number by gcd(a, b), or smply (a, b) when there s no confuson
More informationLecture 13 APPROXIMATION OF SECOMD ORDER DERIVATIVES
COMPUTATIONAL FLUID DYNAMICS: FDM: Appromaton of Second Order Dervatves Lecture APPROXIMATION OF SECOMD ORDER DERIVATIVES. APPROXIMATION OF SECOND ORDER DERIVATIVES Second order dervatves appear n dffusve
More informationSUMMARY OF STOICHIOMETRIC RELATIONS AND MEASURE OF REACTIONS' PROGRESS AND COMPOSITION FOR MULTIPLE REACTIONS
UMMAY OF TOICHIOMETIC ELATION AND MEAUE OF EACTION' POGE AND COMPOITION FO MULTIPLE EACTION UPDATED 0/4/03 - AW APPENDIX A. In case of multple reactons t s mportant to fnd the number of ndependent reactons.
More informationChapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the
More informationDynamic Systems on Graphs
Prepared by F.L. Lews Updated: Saturday, February 06, 200 Dynamc Systems on Graphs Control Graphs and Consensus A network s a set of nodes that collaborates to acheve what each cannot acheve alone. A network,
More informationCommon loop optimizations. Example to improve locality. Why Dependence Analysis. Data Dependence in Loops. Goal is to find best schedule:
15-745 Lecture 6 Data Dependence n Loops Copyrght Seth Goldsten, 2008 Based on sldes from Allen&Kennedy Lecture 6 15-745 2005-8 1 Common loop optmzatons Hostng of loop-nvarant computatons pre-compute before
More informationLeast Squares Fitting of Data
Least Squares Fttng of Data Davd Eberly Geoetrc Tools, LLC http://www.geoetrctools.co/ Copyrght c 1998-2014. All Rghts Reserved. Created: July 15, 1999 Last Modfed: February 9, 2008 Contents 1 Lnear Fttng
More informationThe Geometry of Logit and Probit
The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.
More information[7] R.S. Varga, Matrix Iterative Analysis, Prentice-Hall, Englewood Clis, New Jersey, (1962).
[7] R.S. Varga, Matrx Iteratve Analyss, Prentce-Hall, Englewood ls, New Jersey, (962). [8] J. Zhang, Multgrd soluton of the convecton-duson equaton wth large Reynolds number, n Prelmnary Proceedngs of
More informationKernel Methods and SVMs Extension
Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More informationChapter 3 Differentiation and Integration
MEE07 Computer Modelng Technques n Engneerng Chapter Derentaton and Integraton Reerence: An Introducton to Numercal Computatons, nd edton, S. yakowtz and F. zdarovsky, Mawell/Macmllan, 990. Derentaton
More informationCSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography
CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve
More informationFinite Difference Method
7/0/07 Instructor r. Ramond Rump (9) 747 698 rcrump@utep.edu EE 337 Computatonal Electromagnetcs (CEM) Lecture #0 Fnte erence Method Lecture 0 These notes ma contan coprghted materal obtaned under ar use
More informationLinear Feature Engineering 11
Lnear Feature Engneerng 11 2 Least-Squares 2.1 Smple least-squares Consder the followng dataset. We have a bunch of nputs x and correspondng outputs y. The partcular values n ths dataset are x y 0.23 0.19
More informationStructure and Drive Paul A. Jensen Copyright July 20, 2003
Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.
More informationDiscretization. Consistency. Exact Solution Convergence x, t --> 0. Figure 5.1: Relation between consistency, stability, and convergence.
Chapter 5 Theory The numercal smulaton of PDE s requres careful consderatons of propertes of the approxmate soluton. A necessary condton for the scheme used to model a physcal problem s the consstency
More informationLecture 2 Solution of Nonlinear Equations ( Root Finding Problems )
Lecture Soluton o Nonlnear Equatons Root Fndng Problems Dentons Classcaton o Methods Analytcal Solutons Graphcal Methods Numercal Methods Bracketng Methods Open Methods Convergence Notatons Root Fndng
More informationAppendix B. The Finite Difference Scheme
140 APPENDIXES Appendx B. The Fnte Dfference Scheme In ths appendx we present numercal technques whch are used to approxmate solutons of system 3.1 3.3. A comprehensve treatment of theoretcal and mplementaton
More informationfor Linear Systems With Strictly Diagonally Dominant Matrix
MATHEMATICS OF COMPUTATION, VOLUME 35, NUMBER 152 OCTOBER 1980, PAGES 1269-1273 On an Accelerated Overrelaxaton Iteratve Method for Lnear Systems Wth Strctly Dagonally Domnant Matrx By M. Madalena Martns*
More informationInexact Newton Methods for Inverse Eigenvalue Problems
Inexact Newton Methods for Inverse Egenvalue Problems Zheng-jan Ba Abstract In ths paper, we survey some of the latest development n usng nexact Newton-lke methods for solvng nverse egenvalue problems.
More informationHowever, since P is a symmetric idempotent matrix, of P are either 0 or 1 [Eigen-values
Fall 007 Soluton to Mdterm Examnaton STAT 7 Dr. Goel. [0 ponts] For the general lnear model = X + ε, wth uncorrelated errors havng mean zero and varance σ, suppose that the desgn matrx X s not necessarly
More informationMAE140 - Linear Circuits - Fall 10 Midterm, October 28
M140 - Lnear rcuts - Fall 10 Mdterm, October 28 nstructons () Ths exam s open book. You may use whatever wrtten materals you choose, ncludng your class notes and textbook. You may use a hand calculator
More informationSolution of the Navier-Stokes Equations
Numercal Flud Mechancs Fall 2011 Lecture 25 REVIEW Lecture 24: Soluton of the Naver-Stokes Equatons Dscretzaton of the convectve and vscous terms Dscretzaton of the pressure term Conservaton prncples Momentum
More informationAnouncements. Multigrid Solvers. Multigrid Solvers. Multigrid Solvers. Multigrid Solvers. Multigrid Solvers
Anouncements ultgrd Solvers The readng semnar starts ths week: o Usuall t wll e held n NEB 37 o Ths week t wll e n arland 3 chael Kazhdan (6657 ultgrd Solvers Recall: To compute the soluton to the osson
More informatione i is a random error
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown
More information