Domain decomposition methods

Size: px
Start display at page:

Download "Domain decomposition methods"

Transcription

1 Doman decomposton methods Inspred by Martn J. Gander Laurence Halpern 13 mars Block matrces 1.1 Generaltes Remember frst that two matrces A and B can be multpled f and only f the number of columns of A s equal to the number of rows of B : A s m n and B s n p. Splt A n 4 submatrces as a 11 a 1J a 1J+1 a 1n.... a I1 a IJ a IJ+1 a In A a I+11 a I+1J a I+1J+1 a I+1n.... a m1 a nj a nj+1 a mn The matrx A 11 I,J A 1 I,n J A 1 m I,J a 11 a 1J.. a I1 a IJ a 1J+1 a 1n.. a IJ+1 a In a I+11 a I+1J.. a m1 a mj a I+1J+1 a I+1n A 1 n I,n J.. a mj+1 a mn Consder a matrx B splt as has dmensoni, J, has dmensoni,n J, has dmensonn I, J, B has dmensonm I,n J. B 11 J,K BJ,p K 1 Bn J,K 1 Bn J,p K then the product AB can be done n a natural way as for matrces : A 11 I,J A 1 I,n J, A 1 m I,J A m I,n J Secton de Mathématques. Unversté de Genève. -4 rue du Lèvre, CP 64, CH-111 Genève. SUISSE LAGA et CNRS UMR7539. Unversté Pars 13. Avenue J.B. Clément, Vlletaneuse. FRANCE 1

2 AB A 11 I,J A 1 I,n J A 1 m I,J A m I,n J B 11 J,K B 1 J,p K B 1 n J,K B n J,p K A 11 B 11 +A 1 B 1 A 11 B 1 +A 1 B A 1 B 11 +A B 1 A 1 B 1 +A B To make the product of a matrx A of sze m n by a vector of sze n, t can be useful to decompose A nto I J blocks, and X nto J blocks : A 11 A 1J X 1 A.., X. 1.1 A I1 A IJ X J Block dagonal and trangular matrces have the form D T D 0 0 T 0 0 D T D JJ T JJ The product of lower resp. upper block-trangular matrces s lower resp. upper block trangular matrx. Same for the nverse. An example of block-trdagonal matrx s the equdstant fnte dfferences n D, consttuted of N blocks, each block of sze M M, B C 0 M 0 M A 1 C B C.... h M 0M.... C B C 0 M 0 M C B C I M, B Block relaxaton For a system AX b, splt as n 1.1, t s possble to wrte the same algorthms as before wth A D E F, D beng block-dagonal, E lower block-trangular and F upper block trangular. A A 0 0 A D E A JJ A J1 A JJ 0 For example the Jacob method for a block matrx s A 11 0 X 1 m+1 0 A 1 X 1 0 A X A 1 0 X m b 1 + b

3 and the Gauss-Sedel method s A 11 0 X 1 A 1 A X m+1 0 A X 1 X m b 1 + b They can be rewrtten as systems of two matrx equatons Jacob { A 11 X 1 m+1 A 1 X m +b 1 A X m+1 A 1 X 1 m +b Gauss-Sedel { A 11 X 1 m+1 A 1 X m +b 1 A 1 X 1 m+1 + A X m+1 b Each resoluton needs to nvert the matrces A whch are much smaller matrces!. Schwarz methods We explan n the 1d-case the hstorcal methods of H.A. Schwarz alternate method n [7]. and P.L. Lons parallel method n [6]. Then we dscretze these algorthms, and nterpret those dscrete algorthms as relaxatons algorthms. Then we present the dscrete algorthm, n partcular the addtve Schwarz method of M. Dryja et O. Wdlund [, 3], whch are a major nventon. In the next paragraph, we nterpret the latter as a precondtonng for a lnear system. Ths system nvolves ether the nternal unknowns, or the nterface unknowns. Then we study the condtonng of the precondtoned problem..1 Alternate and parallel Schwarz The problem s u +ηu f n 0,1, u0 g g, u1 g d..1 Ω [0,1] s dvded nto two overlappng subdomans Ω 1 [0,β] and Ω [α,1]. The boundary of Ω 1 n Ω s Γ 1 {β}, and symmetrcally Γ {α}.the overlap s δ β α. In the alternate Schwarz method, a sequence u n 1,un for n 0 s buld by solvng alternatvely the same equaton as n.1, n Ω 1 and Ω, defnng the values on the border by the prevously computed values n the othersubdoman : d u n+1 1 dx +ηu n+1 1 f dans Ω 1, d u n+1 u n g g, u n+1 u n+1 1 β u n dx +ηu n+1 f dans Ω, 1 g d, β, un+1 α u n+1 1 α. The algorthm s ntalzed by g R, wth the conventon u 0 β g, whch means that u1 1 s computed wth u 1 1 β g. In the parallel Schwarz method [5], the computatons n Ω 1 et Ω are made n parallel :. d ũ n+1 1 dx +ηũ n+1 1 f dans Ω 1, d ũ n+1 ũ n g g, ũ n+1 ũ n+1 1 β ũ n β, ũn+1 dx +ηũ n+1 f dans Ω, 1 g d, α ũ n 1 α..3 Then two values g 1 et g are necessary for the ntalzaton. Fgure.1 shows the soluton of.1 n a model case : the dstrbuton of temperature n a bar of length 1, subjected to a source of heat on a part of ts length, wth a fxed temperature at each end. On Fgure. are represented the terates of the two algorthms. 3

4 Theorem.1 For any η 0, the algorthms of alternate and paralllel Schwarz for problem.1 are convergent. Proof By lnearty, the errors e n u n u are soluton of the same equatons n the subdomans wth f 0 g g 0 and g d 0. They can be solved wth snhx e x e x / for η > 0, modulo a multplcatve constant a n : for η > 0, e n 1 an 1 snh ηx, e n an snh η1 x, for η 0, e n 1 an 1 x, en an 1 x. At frst teraton, a 1 1 s determned by the condton u1 1 β g, thus e1 1 β g uβ : { for η > 0, a 1 1 snh η β g uβ, for η 0, a 1 1 β g uβ. The transmsson condtons e n+1 1 β e n β and en+1 α e n+1 1 α thereafter gve a recurson relaton to determne the coeffcents a n : { for η > 0, a n+1 1 snh η β a n snh η1 β, a n+1 snh η1 α a n+1 1 snh η α, Let for η 0, a n+1 1 β a n 1 β, an+1 1 α a n+1 1 α. ρ 1 snh η1 β snh, ρ η β snh ηα snh η1 α..4 These formulas hold also for η 0 by passng to the lmt. Rewrte the recurson relaton as a n+1 1 ρ 1 a n, a n+1 ρ a n+1 1, or a n+1 ρ 1 ρ a n. The sequences a n 1 and an are geometrc sequences wth rato ρ ρ 1ρ, whch s also called convergence factor of the method. The functon snh s ncreasng, and snce α < β, we have snh η α < snh η β and snh η1 β < snh η1 α. Thus ρ s postve and strctly smaller than 1. The coeffcents a n are now gven by The functons u n satsfy Ω : a n+1 1 ρ n a 1 1, a n+1 ρ ρ n a u n+1 x ux ρu n x ux ρn u 1 x ux. In the doman Ω, the sequence u n converge unformly to u, wth a lnear convergence In the parallel case, there s an smlar relaton between coeffcents ã n de ũ n : ã n+1 1 ρ 1 ã n, ãn+1 ρ ã n 1, or ãn+1 ρã n, and ã n+1 ρ n ã 1. The even and odd terates of ũn converge lnearly wth the same convergence factor ρ. Remark.1 Defnng g g 1, yelds ũ1 n u n 1, then ũn u n. Therefore performng two steps of the parallel algorthm s equvalent to performng one step of the alternate algorthm, as shown n.. Remark. The smaller ρ, the faster the convergence. Ths s realzed for large η, or large overlap δ. 4

5 . Dscretzed alternate et parallel Schwarz The nterval [0,1] s dvded nto J + 1 subntervals wth length h. The dscretzaton ponts are x j jh for 0 j J + 1. The fnte dfferences schemes assocated to.1 computes u j ux j, wth f j fx j, as follows u j+1 u j +u j h +ηu j f j, 1 j J. These J equatons are complemented wth u 0 g g and u J+1 g d, to obtan the lnear system wth unknowns u u 1,,u J T, n matrx form Au f, A h +η 1 h 1 h h +η h 1 h h +η, f f h g g f. f J f J + 1 h g d The matrx A s wrtten n sparse format sparse n Matlab usng the scrpt spdags : functon AA1deta,a,b,J % A1D one dmensonal fnte dfference approxmaton % AA1deta,a,b,J computes a sparse fnte dfference approxmaton % of the one dmensonal operator eta-delta on the doman % Omegaa,b usng J nteror ponts hb-a/j+1; eonesj,1; Aspdags[-e/h^ eta+/h^*e -e/h^],[-1 0 1],J,J;..6 The scrpt below gves the detals of resoluton n Matlab of the dscrete problem wth non homogeneous boundary condtons The lnear system s solved wth the scrpt "\" of Matlab, based on the Gauss method, optmzed for sparse matrces. Snce A s symmetrc defnte postve, the conjugate gradent wth precondtonng defned n the frst chapter could be used as well. functon usolve1df,eta,a,b,gg,gd % SOLVE1D solves eta-delta n 1d usng fnte dfferences % usolve1df,eta,a,b,gg,gd solves the one dmensonal equaton % eta-deltauf on the doman Omegaa,b wth Drchlet boundary % condtons ugg at xa and ugd at xb usng a fnte % dfference approxmaton wth lengthf nteror grd ponts Jlengthf; AA1deta,a,b,J; hb-a/j+1; f1f1+gg/h^; fendfend+gd/h^; ua\f; u[gg;u;gd]; % construct 1d fnte dfference operator % add boundary condtons nto rhs % add boundary values to soluton In the example, the length of the bar s 1, the source s constant equal to 5 on [ ], vanshes elsewhere. The temperature s fxed at both ends. The Matlab scrpt below Bar.m calls the resoluton scrpt Solve1d for these data, and produces fgure.1. %eta0;j0; x0:1/j+1:1; fzerosj,1; % J number of nteror mesh ponts % fnte dfference mesh, ncludng boundary % source term zero, except for a 5

6 fx>0.4 & x<0.75; % heater n ths poston gg0.1; gd0; % put warm wall on the left, cold on the rght usolve1df,eta,0,1,gg,gd; fgure plotx,u, - ; xlabel x ; ylabel soluton ; soluton Fgure.1 Example of resoluton of equaton.1 by fnte dfferences In order to dscretze the alternate Schwarz algorthm, the pont α s descrbed by α lh and β mh wth m l+d. d represents the overlap, δ dh. The ponts x 1,,x J are nteror to Ω, the ponts x 1,,x b are nteror to Ω 1, twhle ponts x a+1,,x J are nteror to Ω. The dscretzaton of alternate Schwarz algorthm. s un+1 1 j+1 u n+1 1 j +u n+1 1 j h +ηu n+1 1 j f j, 1 j b, u n+1 1 b u n b, un+1 j+1 u n+1 j +u n+1 j h +ηu n+1 j f j, a+1 j J, u n+1 a u n+1 1 a,.7 wth exteror boundary condton u n g g and u n J+1 g d. The scrpt below realzes the algorthm.7 the frst lne Bar;, executes the commands of the above example, whch are mperatvely n the fle Bar.m : eta0;j0; Bar; % to nclude problem parameters ueu;afloorj/; d4; % subdoman decomposton f1f1:a+d-1; ffa+1:j; % subdoman source terms u1[gg; zerosa+d,1]; % zero ntal guess, except boundary value u[zerosj-a+1,1; gd]; x1x1:a+d+1; xxa+1:end; h1/j+1; % fnte dfference meshes fgure1 lne[a,a]*h,[mnue,maxue ], Color, r lne[a,a]+d*h,[mnue,maxue ], Color, r hold on plotx,ue, m ; hold on; pause for 1:00 % Alternatng Schwarz teraton u1solve1df1,eta,x11,x1end,gg,ud+1; usolve1df,eta,x1,xend,u1end-d,gd; x 6

7 plotx1,u1, -,x,u, - ; xlabel x ; ylabel Alternatng Schwarz terates ; hold on; pause end hold off Run n Matlab, t produces the sequence of curves n Fgure.a Alternatng Schwarz terates Parallel Schwarz terates x a Algorthme alternate x b Algorthme parallel Fgure. Example of resoluton of equaton.1 by the Schwarz algorthm dscretzed par fnte dfferences To obtan the parallel Schwarz algorthm, and the results n fgure.b, the loop above has to be modfed nto u1oldu1; u1solve1df1,eta,x11,x1end,gg,ud+1; usolve1df,eta,x1,xend,u1oldend-d,gd; plotx1,u1, -,x,u, - ; xlabel x ; ylabel Parallel Schwarz terates ; Algebrac nterpretaton Algorthm.7 wll now be wrtten as an algebrac algorthm for the vectors u n 1 un 1 1,,u n 1 b T and u n un a+1,,u n J T. The matrx A s splt nto blocs as h +η 1 h 1 h h +η h 1 h h +η 1 h A 1 h h +η 1 h 1 h h +η h 1 h h +η 7..8

8 Introduce two such decompostons : A1 B A 1 C 1 D 1 D C B A,.9 The sze of A 1 s m m, and that of D s l l, et therefore A has a sze J l J l. The matrces A 1 et D concde when m l+1, that s d 1. The geometrc overlap s n ths case mnmal, and the algebrac overlap s empty. The matrces A 1 et A are the matrces of the operator η over Ω 1 and Ω, dscretzed by fnte dfferences,wth homogeneous Drchlet data on the endponts, they are therefore nvertble. Complete now the matrces B wth zero entres n B 1 [0 m,d B 1 ], B [B 0 J l,d ]. Thus B 1 has sze m 1 J l. To a vector defned on Ω, t assocates a vector defned on Ω 1, extended by 0 outsde Ω. Accordngly, B has sze J l m. To a vector defned on Ω 1 t assocates a vector defned on Ω extended by 0 outsde Ω 1. Wth these notatons, the alternate algorthm.7 takes the form A 1 u n+1 1 f 1 B 1 u n, A u n+1 f B u n+1 1,.10 whch s nothng else but block Gauss-Sedel n+1 A1 0 u1 B A u 0 B1 0 0 u1 u n + f1 f.11 for the augmented system Ãũ f : A1 B1 u1 B A u f1 f..1 When the overlap s mnmal, the augmented matrx concdes wth the matrx A. The dscretzed parallel Schwarz algorthm can also be wrtten n algebrac form A 1 u n+1 1 f 1 B 1 u n, A u n+1 f B u n 1,.13 whch s now a block Jacob method for the augmented system.1,.e. n+1 A1 0 u1 0 A u 0 B1 B 0 u1 u n + f1 f..14 Note that, even though the matrx A s symmetrc, the augmented matrx s not, snce the matrces B T et B 1 are dfferent, except for mnmal overlap.e. d 1 t can be seen as follows : the only non-zero term n B 1 s B 1 b,d, and B T b,d B d,b 0 s d 1. Ths forbdds to use the conjugate gradent for the system A 1 0 A1 B1 u1 0 A B A u A A f1 f,.15 However, Krylov algorthm have been desgned for non symmetrc matrces. Other doman decomposton algothms have been desgn to provde symmetrc augmented matrces, as descrbed n the next paragraph. 8

9 .3 Dscrete Schwarz methods : AS, MS et RAS To understand addtve Schwarz AS, go back to.14. In the case d 1, B B, and the teraton s dentcal to n+1 n u1 u1 A n u1 u u 0 A f A..16 u In ths form, t appears that parallel Schwarz dscretzed wth fnte dfferences.14 s an teratve method for the precondtoned system A 1 0 A1 B 1 u1 0 A B A u A A f1 If the matrx A s symmetrc defnte postve, then so s the precondtoner can be solved by conjugate gradent. Introduce now the restrcton matrces f..17 A 1 0 and.17 0 A R 1 [I b 0 b,j b+1 ], R [0 J a,a I J a ]..18 The precondtoner can be wrtten wth these restrcton matrces as : A A 1 R T A R. Snce n ths case u 1,u u, we deduce a new form of the parallel Schwarz algorthm dscretzed by fnte dfferences wth mnmal overlap, d 1,.e..16 : u n+1 u n + 1 R T A R f Au n..19 Ths algorthm can stll be wrtten for the general overlpa, but t s not so useful, as proved by the followng counter-example. Theorem. If d > 1, algorthm.19 appled to the fnte dfference matrx.6 s not convergent : there exsts an ntal guess u 0 such that the algorthm oscllates betweeen u 0 and u 0. Proof Splt A as n.9. For each teraton, the vector u n s splt nto u n 11,un 1 accordng to the frst decomposton de A, and n u n 1,un accordng to the second decomposton. The rght-hand sde f s decomposed accordngly. Therefore Compute now R 1 Au n [A 1 B 1 ]u n A 1 u n 11 +B 1 u n 1, R Au n [B A ]u n B u n 1 +A u n. R1 TA 1 R 1Au n R1 Tun 11 +RT 1 A 1 B 1u n 1, R TA R Au n R Tun +RT A B u n 1. The equaton.19 can be wrtten as u n+1 u n u n 11 0 A 0 u n 1 B 1u n A B u n 1 A + 1 f A f. To study convergence of the algorthm, choose f 0 nul, and for an ndex j strctly between a et a + d, an ntal guess u 0 e j, the j vector of the canoncal bass n R J. The only non-vanshng 9

10 terms n the rght-hand sde of the prevous equaton are the three frst, and they have the same value u 0, thusu 1 u 0. Itaratng the argument, t appears that the terates oscllate between u 0 and u 0. The scrpt Matlab below BarAS.m realzes the terates of Addtve Schwarz.19 for the same example as before. The terates are drawn fgure.3. The lack of convergence n the overlap appears clearly. eta0;j0; Bar; % to nclude problem parameters ueu;afloorj/; d4; % subdoman decomposton h1/j+1; f1f1+gg/h^; fendfend+gd/h^; % add boundary condtons nto rhs AA1deta,0,1,J; % construct fnte dfference operator R1[speyea+d-1 sparsea+d-1,j-a-d+1]; R[sparseJ-a,a speyej-a]; A1R1*A*R1 ; AR*A*R ; fgure4 lne[a,a]*h,[mnue,maxue ], Color, r lne[a,a]+d*h,[mnue,maxue ], Color, r hold on plotx,ue, b ; hold on; pause uzerosj,1; for 1:0 rf-a*u; uu+r1 *A1\R1*r+R *A\R*r; plotx,[gg;u;gd], -k ; xlabel x ; ylabel Addtve Schwarz statonnary terates ; hold on; pause rnormr; end hold off % keep resdual for plottng later Addtve Schwarz statonnary terates Fgure.3 Attempt to solve.6 by Addtve Schwarz.19 The true addtve Schwarz method or AS s based on the teraton.19, seen as a precondtonneur. It conssts n solvng the lmt sprecondtoned system M AS Au : 1 x R T A R Au 10 1 R T A R f..0

11 If A est symmetrc, M AS RT A R est symmetrc, and the conjugate gradent can be used. The multplcatve Schwarz method or MS see [1] s the sequental verson of addtve Schwarz. For our example, t takes the form u n+1 u n +R1 TA 1 R 1f Au n, u n+1 u n+1 +R TA R f Au n+1..1 For Matlab mplementaton, replace n the loop of the prevous scrpt the computaton of r and u by rf-a*u; uu+r1 *A1\R1*r; rf-a*u; uu+r *A\R*r; whch produces the teratons n Fgure Multplcatve Schwarz terates Fgure.4 Example of multplcatve Schwarz algorthm There s no oscllatng mode n the overlap, the teratve algorthm s convergent. It s n many cases equvalent to dscretzed alternate Schwarz [4]. Snce the precondtoner s not symmetrc, the use of conjugate gradent s however prohbted. Références [1] T. F. Chan and T. P. Mathew, Doman decomposton algorthms, n Acta Numerca 1994, Cambrdge Unversty Press, 1994, pp [] M. Dryja, A capactance matrx method for Drchlet problem on polygon regon, Numer. Math., , pp [3] M. Dryja and O. B. Wdlund, An addtve varant of the Schwarz alternatng method for the case of many subregons, Tech. Rep. 339, also Ultracomputer Note 131, Department of Computer Scence, Courant Insttute, [4] M. J. Gander, Schwarz methods over the course of tme, Electron. Trans. Numer. Anal, , pp [5] P.-L. Lons, On the Schwarz alternatng method I, n Frst Internatonal Symposum on Doman Decomposton Methods for Partal Dfferental Equatons, R. Glownsk, G. H. Golub, G. A. Meurant, and J. Péraux, eds., Phladelpha, PA, 1988, SIAM, pp [6], On the Schwarz alternatng method II : Stochastc nterpretaton and orders propertes, n Doman Decomposton Methods, T. Chan, R. Glownsk, J. Péraux, and O. Wdlund, eds., Phladelpha, PA, 1989, SIAM, pp x

12 [7] H. A. Schwarz, Über enen Grenzübergang durch alternerendes Verfahren, Verteljahrsschrft der Naturforschenden Gesellschaft n Zürch, , pp

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 16

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 16 STAT 39: MATHEMATICAL COMPUTATIONS I FALL 218 LECTURE 16 1 why teratve methods f we have a lnear system Ax = b where A s very, very large but s ether sparse or structured (eg, banded, Toepltz, banded plus

More information

Deriving the X-Z Identity from Auxiliary Space Method

Deriving the X-Z Identity from Auxiliary Space Method Dervng the X-Z Identty from Auxlary Space Method Long Chen Department of Mathematcs, Unversty of Calforna at Irvne, Irvne, CA 92697 chenlong@math.uc.edu 1 Iteratve Methods In ths paper we dscuss teratve

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 13

CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 13 CME 30: NUMERICAL LINEAR ALGEBRA FALL 005/06 LECTURE 13 GENE H GOLUB 1 Iteratve Methods Very large problems (naturally sparse, from applcatons): teratve methods Structured matrces (even sometmes dense,

More information

Chapter 12. Ordinary Differential Equation Boundary Value (BV) Problems

Chapter 12. Ordinary Differential Equation Boundary Value (BV) Problems Chapter. Ordnar Dfferental Equaton Boundar Value (BV) Problems In ths chapter we wll learn how to solve ODE boundar value problem. BV ODE s usuall gven wth x beng the ndependent space varable. p( x) q(

More information

Non shape regular domain decompositions: an analysis using a stable decomposition in H 1 0

Non shape regular domain decompositions: an analysis using a stable decomposition in H 1 0 Non shape regular doman decompostons: an analyss usng a stable decomposton n H 1 0 Martn Gander 1, Laurence Halpern, and Kévn Santugn Repquet 3 Abstract In ths paper, we establsh the exstence of a stable

More information

Relaxation Methods for Iterative Solution to Linear Systems of Equations

Relaxation Methods for Iterative Solution to Linear Systems of Equations Relaxaton Methods for Iteratve Soluton to Lnear Systems of Equatons Gerald Recktenwald Portland State Unversty Mechancal Engneerng Department gerry@pdx.edu Overvew Techncal topcs Basc Concepts Statonary

More information

Vector Norms. Chapter 7 Iterative Techniques in Matrix Algebra. Cauchy-Bunyakovsky-Schwarz Inequality for Sums. Distances. Convergence.

Vector Norms. Chapter 7 Iterative Techniques in Matrix Algebra. Cauchy-Bunyakovsky-Schwarz Inequality for Sums. Distances. Convergence. Vector Norms Chapter 7 Iteratve Technques n Matrx Algebra Per-Olof Persson persson@berkeley.edu Department of Mathematcs Unversty of Calforna, Berkeley Math 128B Numercal Analyss Defnton A vector norm

More information

1 GSW Iterative Techniques for y = Ax

1 GSW Iterative Techniques for y = Ax 1 for y = A I m gong to cheat here. here are a lot of teratve technques that can be used to solve the general case of a set of smultaneous equatons (wrtten n the matr form as y = A), but ths chapter sn

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

Non shape regular domain decompositions: an analysis using a stable decomposition in H 1 0

Non shape regular domain decompositions: an analysis using a stable decomposition in H 1 0 on shape regular doman decompostons: an analyss usng a stable decomposton n 1 0 Martn J. Gander 1, Laurence alpern, and Kévn Santugn Repquet 3 1 Unversté de Genève, Secton de Mathématques, Martn.Gander@unge.ch

More information

2.3 Nilpotent endomorphisms

2.3 Nilpotent endomorphisms s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms

More information

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b Int J Contemp Math Scences, Vol 3, 28, no 17, 819-827 A New Refnement of Jacob Method for Soluton of Lnear System Equatons AX=b F Naem Dafchah Department of Mathematcs, Faculty of Scences Unversty of Gulan,

More information

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 ) Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,

More information

Bézier curves. Michael S. Floater. September 10, These notes provide an introduction to Bézier curves. i=0

Bézier curves. Michael S. Floater. September 10, These notes provide an introduction to Bézier curves. i=0 Bézer curves Mchael S. Floater September 1, 215 These notes provde an ntroducton to Bézer curves. 1 Bernsten polynomals Recall that a real polynomal of a real varable x R, wth degree n, s a functon of

More information

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k) ISSN 1749-3889 (prnt), 1749-3897 (onlne) Internatonal Journal of Nonlnear Scence Vol.17(2014) No.2,pp.188-192 Modfed Block Jacob-Davdson Method for Solvng Large Sparse Egenproblems Hongy Mao, College of

More information

MATH 5630: Discrete Time-Space Model Hung Phan, UMass Lowell March 1, 2018

MATH 5630: Discrete Time-Space Model Hung Phan, UMass Lowell March 1, 2018 MATH 5630: Dscrete Tme-Space Model Hung Phan, UMass Lowell March, 08 Newton s Law of Coolng Consder the coolng of a well strred coffee so that the temperature does not depend on space Newton s law of collng

More information

Convexity preserving interpolation by splines of arbitrary degree

Convexity preserving interpolation by splines of arbitrary degree Computer Scence Journal of Moldova, vol.18, no.1(52), 2010 Convexty preservng nterpolaton by splnes of arbtrary degree Igor Verlan Abstract In the present paper an algorthm of C 2 nterpolaton of dscrete

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

Additive Schwarz Method for DG Discretization of Anisotropic Elliptic Problems

Additive Schwarz Method for DG Discretization of Anisotropic Elliptic Problems Addtve Schwarz Method for DG Dscretzaton of Ansotropc Ellptc Problems Maksymlan Dryja 1, Potr Krzyżanowsk 1, and Marcus Sarks 2 1 Introducton In the paper we consder a second order ellptc problem wth dscontnuous

More information

Lecture 21: Numerical methods for pricing American type derivatives

Lecture 21: Numerical methods for pricing American type derivatives Lecture 21: Numercal methods for prcng Amercan type dervatves Xaoguang Wang STAT 598W Aprl 10th, 2014 (STAT 598W) Lecture 21 1 / 26 Outlne 1 Fnte Dfference Method Explct Method Penalty Method (STAT 598W)

More information

Solution of Linear System of Equations and Matrix Inversion Gauss Seidel Iteration Method

Solution of Linear System of Equations and Matrix Inversion Gauss Seidel Iteration Method Soluton of Lnear System of Equatons and Matr Inverson Gauss Sedel Iteraton Method It s another well-known teratve method for solvng a system of lnear equatons of the form a + a22 + + ann = b a2 + a222

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

APPENDIX A Some Linear Algebra

APPENDIX A Some Linear Algebra APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,

More information

7. Products and matrix elements

7. Products and matrix elements 7. Products and matrx elements 1 7. Products and matrx elements Based on the propertes of group representatons, a number of useful results can be derved. Consder a vector space V wth an nner product ψ

More information

Appendix B. The Finite Difference Scheme

Appendix B. The Finite Difference Scheme 140 APPENDIXES Appendx B. The Fnte Dfference Scheme In ths appendx we present numercal technques whch are used to approxmate solutons of system 3.1 3.3. A comprehensve treatment of theoretcal and mplementaton

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

Norms, Condition Numbers, Eigenvalues and Eigenvectors

Norms, Condition Numbers, Eigenvalues and Eigenvectors Norms, Condton Numbers, Egenvalues and Egenvectors 1 Norms A norm s a measure of the sze of a matrx or a vector For vectors the common norms are: N a 2 = ( x 2 1/2 the Eucldean Norm (1a b 1 = =1 N x (1b

More information

Robust Norm Equivalencies and Preconditioning

Robust Norm Equivalencies and Preconditioning Robust Norm Equvalences and Precondtonng Karl Scherer Insttut für Angewandte Mathematk, Unversty of Bonn, Wegelerstr. 6, 53115 Bonn, Germany Summary. In ths contrbuton we report on work done n contnuaton

More information

Bezier curves. Michael S. Floater. August 25, These notes provide an introduction to Bezier curves. i=0

Bezier curves. Michael S. Floater. August 25, These notes provide an introduction to Bezier curves. i=0 Bezer curves Mchael S. Floater August 25, 211 These notes provde an ntroducton to Bezer curves. 1 Bernsten polynomals Recall that a real polynomal of a real varable x R, wth degree n, s a functon of the

More information

Perron Vectors of an Irreducible Nonnegative Interval Matrix

Perron Vectors of an Irreducible Nonnegative Interval Matrix Perron Vectors of an Irreducble Nonnegatve Interval Matrx Jr Rohn August 4 2005 Abstract As s well known an rreducble nonnegatve matrx possesses a unquely determned Perron vector. As the man result of

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

1 Matrix representations of canonical matrices

1 Matrix representations of canonical matrices 1 Matrx representatons of canoncal matrces 2-d rotaton around the orgn: ( ) cos θ sn θ R 0 = sn θ cos θ 3-d rotaton around the x-axs: R x = 1 0 0 0 cos θ sn θ 0 sn θ cos θ 3-d rotaton around the y-axs:

More information

Report on Image warping

Report on Image warping Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.

More information

The Exact Formulation of the Inverse of the Tridiagonal Matrix for Solving the 1D Poisson Equation with the Finite Difference Method

The Exact Formulation of the Inverse of the Tridiagonal Matrix for Solving the 1D Poisson Equation with the Finite Difference Method Journal of Electromagnetc Analyss and Applcatons, 04, 6, 0-08 Publshed Onlne September 04 n ScRes. http://www.scrp.org/journal/jemaa http://dx.do.org/0.46/jemaa.04.6000 The Exact Formulaton of the Inverse

More information

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty Addtonal Codes usng Fnte Dfference Method Benamn Moll 1 HJB Equaton for Consumpton-Savng Problem Wthout Uncertanty Before consderng the case wth stochastc ncome n http://www.prnceton.edu/~moll/ HACTproect/HACT_Numercal_Appendx.pdf,

More information

2 Finite difference basics

2 Finite difference basics Numersche Methoden 1, WS 11/12 B.J.P. Kaus 2 Fnte dfference bascs Consder the one- The bascs of the fnte dfference method are best understood wth an example. dmensonal transent heat conducton equaton T

More information

c 2006 Society for Industrial and Applied Mathematics

c 2006 Society for Industrial and Applied Mathematics SIAM J. MARIX ANAL. APPL. Vol. 29, No. 1, pp. 98 116 c 2006 Socety for Industral and Appled Mathematcs SCHWARZ IERAIONS FOR SYMMERIC POSIIVE SEMIDEFINIE PROBLEMS REINHARD NABBEN AND DANIEL B. SZYLD Abstract.

More information

Nonlinear Overlapping Domain Decomposition Methods

Nonlinear Overlapping Domain Decomposition Methods Nonlnear Overlappng Doman Decomposton Methods Xao-Chuan Ca 1 Department of Computer Scence, Unversty of Colorado at Boulder, Boulder, CO 80309, ca@cs.colorado.edu Summary. We dscuss some overlappng doman

More information

partial dierential equations by iteratively solving subproblems dened on and localized treatment of complex and irregular geometries, singularities

partial dierential equations by iteratively solving subproblems dened on and localized treatment of complex and irregular geometries, singularities Acta Numerca (1994), pp. 61{143 Doman decomposton algorthms Tony F. Chan Department of Mathematcs, Unversty of Calforna at Los Angeles, Los Angeles, CA 90024, USA Emal: chan@math.ucla.edu. Tarek P. Mathew

More information

Homework Notes Week 7

Homework Notes Week 7 Homework Notes Week 7 Math 4 Sprng 4 #4 (a Complete the proof n example 5 that s an nner product (the Frobenus nner product on M n n (F In the example propertes (a and (d have already been verfed so we

More information

A linear imaging system with white additive Gaussian noise on the observed data is modeled as follows:

A linear imaging system with white additive Gaussian noise on the observed data is modeled as follows: Supplementary Note Mathematcal bacground A lnear magng system wth whte addtve Gaussan nose on the observed data s modeled as follows: X = R ϕ V + G, () where X R are the expermental, two-dmensonal proecton

More information

One-sided finite-difference approximations suitable for use with Richardson extrapolation

One-sided finite-difference approximations suitable for use with Richardson extrapolation Journal of Computatonal Physcs 219 (2006) 13 20 Short note One-sded fnte-dfference approxmatons sutable for use wth Rchardson extrapolaton Kumar Rahul, S.N. Bhattacharyya * Department of Mechancal Engneerng,

More information

First day August 1, Problems and Solutions

First day August 1, Problems and Solutions FOURTH INTERNATIONAL COMPETITION FOR UNIVERSITY STUDENTS IN MATHEMATICS July 30 August 4, 997, Plovdv, BULGARIA Frst day August, 997 Problems and Solutons Problem. Let {ε n } n= be a sequence of postve

More information

Workshop: Approximating energies and wave functions Quantum aspects of physical chemistry

Workshop: Approximating energies and wave functions Quantum aspects of physical chemistry Workshop: Approxmatng energes and wave functons Quantum aspects of physcal chemstry http://quantum.bu.edu/pltl/6/6.pdf Last updated Thursday, November 7, 25 7:9:5-5: Copyrght 25 Dan Dll (dan@bu.edu) Department

More information

PART 8. Partial Differential Equations PDEs

PART 8. Partial Differential Equations PDEs he Islamc Unverst of Gaza Facult of Engneerng Cvl Engneerng Department Numercal Analss ECIV 3306 PAR 8 Partal Dfferental Equatons PDEs Chapter 9; Fnte Dfference: Ellptc Equatons Assocate Prof. Mazen Abualtaef

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

Ballot Paths Avoiding Depth Zero Patterns

Ballot Paths Avoiding Depth Zero Patterns Ballot Paths Avodng Depth Zero Patterns Henrch Nederhausen and Shaun Sullvan Florda Atlantc Unversty, Boca Raton, Florda nederha@fauedu, ssull21@fauedu 1 Introducton In a paper by Sapounaks, Tasoulas,

More information

More metrics on cartesian products

More metrics on cartesian products More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of

More information

Singular Value Decomposition: Theory and Applications

Singular Value Decomposition: Theory and Applications Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real

More information

On a direct solver for linear least squares problems

On a direct solver for linear least squares problems ISSN 2066-6594 Ann. Acad. Rom. Sc. Ser. Math. Appl. Vol. 8, No. 2/2016 On a drect solver for lnear least squares problems Constantn Popa Abstract The Null Space (NS) algorthm s a drect solver for lnear

More information

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0 MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Number of cases Number of factors Number of covariates Number of levels of factor i. Value of the dependent variable for case k

Number of cases Number of factors Number of covariates Number of levels of factor i. Value of the dependent variable for case k ANOVA Model and Matrx Computatons Notaton The followng notaton s used throughout ths chapter unless otherwse stated: N F CN Y Z j w W Number of cases Number of factors Number of covarates Number of levels

More information

Time-Varying Systems and Computations Lecture 6

Time-Varying Systems and Computations Lecture 6 Tme-Varyng Systems and Computatons Lecture 6 Klaus Depold 14. Januar 2014 The Kalman Flter The Kalman estmaton flter attempts to estmate the actual state of an unknown dscrete dynamcal system, gven nosy

More information

= = = (a) Use the MATLAB command rref to solve the system. (b) Let A be the coefficient matrix and B be the right-hand side of the system.

= = = (a) Use the MATLAB command rref to solve the system. (b) Let A be the coefficient matrix and B be the right-hand side of the system. Chapter Matlab Exercses Chapter Matlab Exercses. Consder the lnear system of Example n Secton.. x x x y z y y z (a) Use the MATLAB command rref to solve the system. (b) Let A be the coeffcent matrx and

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 17. a ij x (k) b i. a ij x (k+1) (D + L)x (k+1) = b Ux (k)

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 17. a ij x (k) b i. a ij x (k+1) (D + L)x (k+1) = b Ux (k) STAT 309: MATHEMATICAL COMPUTATIONS I FALL 08 LECTURE 7. sor method remnder: n coordnatewse form, Jacob method s = [ b a x (k) a and Gauss Sedel method s = [ b a = = remnder: n matrx form, Jacob method

More information

EFFICIENT DOMAIN DECOMPOSITION METHOD FOR ACOUSTIC SCATTERING IN MULTI-LAYERED MEDIA

EFFICIENT DOMAIN DECOMPOSITION METHOD FOR ACOUSTIC SCATTERING IN MULTI-LAYERED MEDIA European Conference on Computatonal Flud Dynamcs ECCOMAS CFD 2006 P. Wesselng, E. Oñate and J. Péraux (Eds) c TU Delft, The Netherlands, 2006 EFFICIENT DOMAIN DECOMPOSITION METHOD FOR ACOUSTIC SCATTERING

More information

APPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14

APPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14 APPROXIMAE PRICES OF BASKE AND ASIAN OPIONS DUPON OLIVIER Prema 14 Contents Introducton 1 1. Framewor 1 1.1. Baset optons 1.. Asan optons. Computng the prce 3. Lower bound 3.1. Closed formula for the prce

More information

SL n (F ) Equals its Own Derived Group

SL n (F ) Equals its Own Derived Group Internatonal Journal of Algebra, Vol. 2, 2008, no. 12, 585-594 SL n (F ) Equals ts Own Derved Group Jorge Macel BMCC-The Cty Unversty of New York, CUNY 199 Chambers street, New York, NY 10007, USA macel@cms.nyu.edu

More information

Developing an Improved Shift-and-Invert Arnoldi Method

Developing an Improved Shift-and-Invert Arnoldi Method Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 93-9466 Vol. 5, Issue (June 00) pp. 67-80 (Prevously, Vol. 5, No. ) Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) Developng an

More information

Dynamic Systems on Graphs

Dynamic Systems on Graphs Prepared by F.L. Lews Updated: Saturday, February 06, 200 Dynamc Systems on Graphs Control Graphs and Consensus A network s a set of nodes that collaborates to acheve what each cannot acheve alone. A network,

More information

MATH 241B FUNCTIONAL ANALYSIS - NOTES EXAMPLES OF C ALGEBRAS

MATH 241B FUNCTIONAL ANALYSIS - NOTES EXAMPLES OF C ALGEBRAS MATH 241B FUNCTIONAL ANALYSIS - NOTES EXAMPLES OF C ALGEBRAS These are nformal notes whch cover some of the materal whch s not n the course book. The man purpose s to gve a number of nontrval examples

More information

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2 Salmon: Lectures on partal dfferental equatons 5. Classfcaton of second-order equatons There are general methods for classfyng hgher-order partal dfferental equatons. One s very general (applyng even to

More information

Solutions to exam in SF1811 Optimization, Jan 14, 2015

Solutions to exam in SF1811 Optimization, Jan 14, 2015 Solutons to exam n SF8 Optmzaton, Jan 4, 25 3 3 O------O -4 \ / \ / The network: \/ where all lnks go from left to rght. /\ / \ / \ 6 O------O -5 2 4.(a) Let x = ( x 3, x 4, x 23, x 24 ) T, where the varable

More information

FTCS Solution to the Heat Equation

FTCS Solution to the Heat Equation FTCS Soluton to the Heat Equaton ME 448/548 Notes Gerald Recktenwald Portland State Unversty Department of Mechancal Engneerng gerry@pdx.edu ME 448/548: FTCS Soluton to the Heat Equaton Overvew 1. Use

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

COMPLEX NUMBERS AND QUADRATIC EQUATIONS

COMPLEX NUMBERS AND QUADRATIC EQUATIONS COMPLEX NUMBERS AND QUADRATIC EQUATIONS INTRODUCTION We know that x 0 for all x R e the square of a real number (whether postve, negatve or ero) s non-negatve Hence the equatons x, x, x + 7 0 etc are not

More information

New Method for Solving Poisson Equation. on Irregular Domains

New Method for Solving Poisson Equation. on Irregular Domains Appled Mathematcal Scences Vol. 6 01 no. 8 369 380 New Method for Solvng Posson Equaton on Irregular Domans J. Izadan and N. Karamooz Department of Mathematcs Facult of Scences Mashhad BranchIslamc Azad

More information

An efficient algorithm for multivariate Maclaurin Newton transformation

An efficient algorithm for multivariate Maclaurin Newton transformation Annales UMCS Informatca AI VIII, 2 2008) 5 14 DOI: 10.2478/v10065-008-0020-6 An effcent algorthm for multvarate Maclaurn Newton transformaton Joanna Kapusta Insttute of Mathematcs and Computer Scence,

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

DIFFERENTIAL FORMS BRIAN OSSERMAN

DIFFERENTIAL FORMS BRIAN OSSERMAN DIFFERENTIAL FORMS BRIAN OSSERMAN Dfferentals are an mportant topc n algebrac geometry, allowng the use of some classcal geometrc arguments n the context of varetes over any feld. We wll use them to defne

More information

The Expectation-Maximization Algorithm

The Expectation-Maximization Algorithm The Expectaton-Maxmaton Algorthm Charles Elan elan@cs.ucsd.edu November 16, 2007 Ths chapter explans the EM algorthm at multple levels of generalty. Secton 1 gves the standard hgh-level verson of the algorthm.

More information

High resolution entropy stable scheme for shallow water equations

High resolution entropy stable scheme for shallow water equations Internatonal Symposum on Computers & Informatcs (ISCI 05) Hgh resoluton entropy stable scheme for shallow water equatons Xaohan Cheng,a, Yufeng Ne,b, Department of Appled Mathematcs, Northwestern Polytechncal

More information

RESTRICTED ADDITIVE SCHWARZ METHOD WITH HARMONIC OVERLAP

RESTRICTED ADDITIVE SCHWARZ METHOD WITH HARMONIC OVERLAP RESTRICTED ADDITIVE SCHWARZ METHOD WITH HARMONIC OVERLAP XIAO-CHUAN CAI, MAKSYMILIAN DRYJA, AND MARCUS SARKIS Abstract. In ths paper, we ntroduce a new Schwarz precondtoner and wth a new coarse space.

More information

Acceleration of Gas Bubble-Free Surface Interaction Computation Using Basis Preconditioners

Acceleration of Gas Bubble-Free Surface Interaction Computation Using Basis Preconditioners Acceleraton of Gas Bubble-Free Surface Interacton Computaton Usng Bass Precondtoners K. L. Tan, B. C. Khoo and J. K. Whte ABSTRACT The computaton of gas bubble-free surface nteracton entals a tme-steppng

More information

5 The Rational Canonical Form

5 The Rational Canonical Form 5 The Ratonal Canoncal Form Here p s a monc rreducble factor of the mnmum polynomal m T and s not necessarly of degree one Let F p denote the feld constructed earler n the course, consstng of all matrces

More information

[7] R.S. Varga, Matrix Iterative Analysis, Prentice-Hall, Englewood Clis, New Jersey, (1962).

[7] R.S. Varga, Matrix Iterative Analysis, Prentice-Hall, Englewood Clis, New Jersey, (1962). [7] R.S. Varga, Matrx Iteratve Analyss, Prentce-Hall, Englewood ls, New Jersey, (962). [8] J. Zhang, Multgrd soluton of the convecton-duson equaton wth large Reynolds number, n Prelmnary Proceedngs of

More information

Normally, in one phase reservoir simulation we would deal with one of the following fluid systems:

Normally, in one phase reservoir simulation we would deal with one of the following fluid systems: TPG4160 Reservor Smulaton 2017 page 1 of 9 ONE-DIMENSIONAL, ONE-PHASE RESERVOIR SIMULATION Flud systems The term sngle phase apples to any system wth only one phase present n the reservor In some cases

More information

Learning Theory: Lecture Notes

Learning Theory: Lecture Notes Learnng Theory: Lecture Notes Lecturer: Kamalka Chaudhur Scrbe: Qush Wang October 27, 2012 1 The Agnostc PAC Model Recall that one of the constrants of the PAC model s that the data dstrbuton has to be

More information

Overlapping additive and multiplicative Schwarz iterations for H -matrices

Overlapping additive and multiplicative Schwarz iterations for H -matrices Lnear Algebra and ts Applcatons 393 (2004) 91 105 www.elsever.com/locate/laa Overlappng addtve and multplcatve Schwarz teratons for H -matrces Rafael Bru a,1, Francsco Pedroche a, Danel B. Szyld b,,2 a

More information

9 Characteristic classes

9 Characteristic classes THEODORE VORONOV DIFFERENTIAL GEOMETRY. Sprng 2009 [under constructon] 9 Characterstc classes 9.1 The frst Chern class of a lne bundle Consder a complex vector bundle E B of rank p. We shall construct

More information

Outline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique

Outline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique Outlne and Readng Dynamc Programmng The General Technque ( 5.3.2) -1 Knapsac Problem ( 5.3.3) Matrx Chan-Product ( 5.3.1) Dynamc Programmng verson 1.4 1 Dynamc Programmng verson 1.4 2 Dynamc Programmng

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

Supplement: Proofs and Technical Details for The Solution Path of the Generalized Lasso

Supplement: Proofs and Technical Details for The Solution Path of the Generalized Lasso Supplement: Proofs and Techncal Detals for The Soluton Path of the Generalzed Lasso Ryan J. Tbshran Jonathan Taylor In ths document we gve supplementary detals to the paper The Soluton Path of the Generalzed

More information

Linear Regression Analysis: Terminology and Notation

Linear Regression Analysis: Terminology and Notation ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented

More information

Formulas for the Determinant

Formulas for the Determinant page 224 224 CHAPTER 3 Determnants e t te t e 2t 38 A = e t 2te t e 2t e t te t 2e 2t 39 If 123 A = 345, 456 compute the matrx product A adj(a) What can you conclude about det(a)? For Problems 40 43, use

More information

Review of Taylor Series. Read Section 1.2

Review of Taylor Series. Read Section 1.2 Revew of Taylor Seres Read Secton 1.2 1 Power Seres A power seres about c s an nfnte seres of the form k = 0 k a ( x c) = a + a ( x c) + a ( x c) + a ( x c) k 2 3 0 1 2 3 + In many cases, c = 0, and the

More information

BOUNDEDNESS OF THE RIESZ TRANSFORM WITH MATRIX A 2 WEIGHTS

BOUNDEDNESS OF THE RIESZ TRANSFORM WITH MATRIX A 2 WEIGHTS BOUNDEDNESS OF THE IESZ TANSFOM WITH MATIX A WEIGHTS Introducton Let L = L ( n, be the functon space wth norm (ˆ f L = f(x C dx d < For a d d matrx valued functon W : wth W (x postve sem-defnte for all

More information

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS SECTION 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS 493 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS All the vector spaces you have studed thus far n the text are real vector spaces because the scalars

More information

The Finite Element Method: A Short Introduction

The Finite Element Method: A Short Introduction Te Fnte Element Metod: A Sort ntroducton Wat s FEM? Te Fnte Element Metod (FEM) ntroduced by engneers n late 50 s and 60 s s a numercal tecnque for solvng problems wc are descrbed by Ordnary Dfferental

More information

Min Cut, Fast Cut, Polynomial Identities

Min Cut, Fast Cut, Polynomial Identities Randomzed Algorthms, Summer 016 Mn Cut, Fast Cut, Polynomal Identtes Instructor: Thomas Kesselhem and Kurt Mehlhorn 1 Mn Cuts n Graphs Lecture (5 pages) Throughout ths secton, G = (V, E) s a mult-graph.

More information

Linear, affine, and convex sets and hulls In the sequel, unless otherwise specified, X will denote a real vector space.

Linear, affine, and convex sets and hulls In the sequel, unless otherwise specified, X will denote a real vector space. Lnear, affne, and convex sets and hulls In the sequel, unless otherwse specfed, X wll denote a real vector space. Lnes and segments. Gven two ponts x, y X, we defne xy = {x + t(y x) : t R} = {(1 t)x +

More information

CSCE 790S Background Results

CSCE 790S Background Results CSCE 790S Background Results Stephen A. Fenner September 8, 011 Abstract These results are background to the course CSCE 790S/CSCE 790B, Quantum Computaton and Informaton (Sprng 007 and Fall 011). Each

More information

MEM 255 Introduction to Control Systems Review: Basics of Linear Algebra

MEM 255 Introduction to Control Systems Review: Basics of Linear Algebra MEM 255 Introducton to Control Systems Revew: Bascs of Lnear Algebra Harry G. Kwatny Department of Mechancal Engneerng & Mechancs Drexel Unversty Outlne Vectors Matrces MATLAB Advanced Topcs Vectors A

More information

Lecture 3. Ax x i a i. i i

Lecture 3. Ax x i a i. i i 18.409 The Behavor of Algorthms n Practce 2/14/2 Lecturer: Dan Spelman Lecture 3 Scrbe: Arvnd Sankar 1 Largest sngular value In order to bound the condton number, we need an upper bound on the largest

More information