Introduction to the Multigrid Method

Size: px
Start display at page:

Download "Introduction to the Multigrid Method"

Transcription

1 Semiar: Te Iterplay betwee Matematical Modellig ad Numerical Simulatio Itroductio to te Multigrid Metod Bogojeska Jasmia JASS, 005 Abstract Te metods for solvig liear systems of equatios ca be divided ito two categories: direct ad iterative metods. Te first oes ca determie te exact solutios, but are rater slow ad are restricted to a certai small set of problems for wic tey sow good performace. Te iterative metods ca be applied to a broader rage of problems, but caot damp te smoot compoets of te error ad because of tat i some cases sow a very slow covergece. Te multigrid metods ave developed from te mai idea tat te amout of computatioal work sould be proportioal to te amout of real pysical cages i te computed system. I fully developped multigrid processes te amout of computatios sould be determied oly by te amout of real pysical iformatio

2 . Model Problems Te boudary value problems give a simple testig groud for providig a basic itroductio to te multigrid metods. Altoug most of tese problems ca be adled aalytically, te umerical metods will be preseted ad tey will serve as model problems i order to preset te multigrid metod i a atural way. Te oe-dimesioal boudary value problem describig te steady-state temperature distributio i a log uiform rod is give by: u''( x) + σ u( x) = f( x) 0< x < u(0) = u() = 0 σ 0 Wit te grid poits x j = j, j = 0,,..., were =, te domai of te problem is divided ito subitervals. Te grid for tis problem sow o Figure will be deoted wit Ω. x x 0 x Figure Accordig to te fiite differece metod i te iterior grid poits te origial differetial equatios ca be replaced by a secod-order fiite differece approximatio: were v j is a approximatio to te exact solutio ( j ) j =,,, v + v v v = v = 0 j j j+ ( f x,, f x ) u x ad j K. Defiig f = ( ) K ( ) ad = ( v ) A v = f of te system above is: 0 + σ v = f j =,,..., j j,, v f is ( j ) f x for v K te matrix form + v f σ v σ f = σ v f were A is a ( ) ( ) symmetric, positive, defiite matrix. Te two-dimesioal boudary value problem as te form: u u + σ u = f( x, y), 0< x<, 0< y<, σ > 0 xx yy were u = 0 o te boudary of te uit square. Te grid sowed o Figure, is defied wit te poits ( xi, yj) = ( i x, j y), were i =,..., m, j =,..., m, x = ad y =. m

3 Figure I te same way as for te oe-dimesioal boudary value problem, replacig te derivatives by te secod-order fiite differeces leads to te system of liear equatios: vi, j + vij vi+, j vi, j + vij vi, j+ + + σ v ij = fij x y v = v = 0, i =,,..., m, j =,,..., i0 i were ij u xi, y j ad fij = f( xi, yj ). By usig T lexicograpical orderig by lies oe ca defie vi = ( vi,..., vi, ) ad T fi=( fi,..., fi, ) for i =,..., m. Accordig to tis otatio te block-tridiagoal matrix form of te system is A v = f i.e.: v is a approximatio of te exact solutio ( ) A a I v f a I A a I v f..... =..... a I A a I v f a I A v f were a =, I is a ( ) ( ) idetity matrix ad A i is a ( ) ( ) tri-diagoal y matrix give wit: + σ x + y x + σ x x + y x Ai = σ x x + y

4 . Basic Iterative Scemes Te ext step is to cosider ow te model problems tat are defied i te previous sectio ca be solved usig some basic iterative or relaxatio scemes. Te problems will be give i teir matrix form Au = f, were u is te exact solutio ad v is te correspodig approximatio. Te vector orms will be used as a measure for te error tat is defied wit e= u v. Te residual equatio is Ae = r, were te residual is defied as r = f A v. Te equatio u= v+ e is te residual correctio. We usig te equatio u v= A rad ( old ) ( ) v v, u v ew ( ) ( ) ( ), a iteratio v ew = v old + B r old ca be formed were B is a approximatio to A. Te equatio for te iteratio ca take sligtly differet form ( ew ) ( old ) ( old ) v = R v + B f = R v +g, were R = I B A. Usig tis form te exact solutio will be fixed poit i.e. u= R u + g. Te error will be give by e ( ew) = R e ( old ), or = ( m) m (0) e R e if m iteratios are performed ad it ca be bouded wit ( m) m (0) e R e, were some proper vector ad matrix orms are used. From tis iequality it follows tat te error will ted to zero i te relaxatio process if R <. Defiitio Assymptotic covergece factor is te spectral radius defied as ρ R = max λ,..., λ. ( ) { } Lemma R m 0 as m if ad oly if ρ ( ) < R. (0) Usig te lemma defied above ad takig ito cosideratio tat for ay iitial vector v, ( m ) 0 ρ R <, it ca be cocluded tat te covergece of te e as m if ad oly if ( ) iteratio is give by te coditio ρ ( R ) <. 3. Jacobi Relaxatio Oe of te basic relaxatio scemes is te Jacobi Relaxatio Sceme. For simplicity te oedimesioal boudary value problem will be cosidered wit σ =0 i.e.: u + u u = f, j =,,...,, u = u = 0 j j j+ j 0 Te Jacobi relaxatio for tis problem is give by te followig system of equatios: ( ew) ( old ) ( old ) vj = ( vj + vj+ + f j), j =,..., Te correspodig matrix form is ( ew) = ( old ) + v R v D f, were = ( + ) A = D L U. Te weigted or damped Jacobi relaxatio is defied wit: J R D L U ad ( ew) ( old ) ( old ) ( old ) vj = ( ) vj + ( vj + vj+ + f j), j =,..., ( ew) ( old ) or wit te equivalet matrix form v = R v + D f, were R = I+ R ad is a weigtig factor tat is properly cose. ( ) J J

5 3. Gauss-Seidel Relaxatio Te Gauss-Seidel relaxatio is similar to te Jacobi relaxatio ad for te simplified oedimesioal model problem wit =0 σ is defied as follows: ( ew) ( ew) ( old ) vj = ( vj + vj+ + f j), j =,..., ( ) ( ) or usig a matrix form v ew = R v old + ( D L) f, were ( ) G R = D L U ad A = D L U. Te differece from te Jacobi relaxatio is tat Gauss-Seidel uses te compoets of te ew approximatio as soo as tey are calculated, wic reduces te storage requiremets for te approximatio vector v to locatios, because tere is o eed for keepig te values of tis vector for te old ad te ew iteratio. 3.3 Fourier Modes For simplicity we will cosider te omogeeous liear system Au = 0. We immediately ca see tat te exact solutio to tis system is u= 0 ad te error is e= u v = v. j k p Defiitio Te vectors vj = si, 0 j, k, were k is frequecy or waveumber idicatig te umber of alf-sie waves tat costitute v o te domai are called Fourier modes (Figure 3). G Figure 3 Defiitio 3 Te waveumbers i rage k are called smoot or low-frequecy modes, ad tose i rage k are called oscillatory or ig-frequecy modes. If we take te Fourier modes give i Figure 3 as iitial iteratio ad we perform 00 sweeps of te weigted Jacobi iteratio, we will get te results for te error sow i Figure 4. As we ca see o te figure te error decreases wit eac iteratio, but te iger wave umbers sow muc larger rate of decrease.

6 Figure 4 I order to see a more realistic case we take a iitial guess tat does ot cotai oly sigle mode, but a combiatio of a low-frequecy, medium-frequecy ad ig-frequecy wave, j π 6 j π 3 j π i.e.: v j = si si si As we ca see o Figure 5 te error decreases very fast oly i te first five iteratios. After tat te decrease of te error becomes very slow. Figure 5 Te quick elimiatio of te ig-frequecy modes of te error gives te fast iitial decrease. Te presece of te low-frequecy modes results i a very slow error decrease as we cotiue wit te iteratios ad sigificatly degrades te performace of te stadard iteratio metods. Te iteratios would coverge fast oly if te error cotais ig-frequecy modes, wic are damped very fast. I order to see wy tis appeed we must examie te problem a bit more formally. At first it sould be poited out tat te weigted Jacobi metod preserves modes, i.e. performig te relaxatios oly te amplitude of te modes is caged. Havig te fact tat R = I A λ( R) = λ( A ), we get tat R ad A ave te same eigevectors:

7 j k π wk,j = si, k. Te eigevalues of A are give wit: k π λk ( A ) = 4si, k ad te eigevalues of R are: k π λk ( R ) = si, k. Havig te eigevectors of A, we ca expad te error vector e (0) i te form: e (0) c k k= = w. Usig te formula for te error after m iteratios ad te fact tat te k eigevectors of m m m m R ad A are te same we get: = ck k = ck λk ( ) k k= k= e R w R w. I te last formula we ca clearly see tat te kt mode of te error after m iteratios is reduced m m by a factor of λ k ( R ). If 0< te λ k ( R ) < ad we will ave a coverget Jacobi iteratio. But for all, 0 < we get tat: π π π λ = si = si. Accordig to tis formula te eigevalue tat correspods to te smootest mode will always be close to oe for ay coice of ad terefore te smoot compoets of te error coverge very slowly. If we wat to improve te accuracy of te solutio by takig smaller grid spacig te λ will be eve more close to. No value of ca reduce te smoot compoets of te error. We ca oly fid te value of tat provides us wit te best λ R = λ R for dampig of te oscillatory modes of te error. Solvig te equatio ( ) ( ) te weigted Jacobi metod leads to = ad λk, for k, wic tells us tat 3 3 te oscillatory compoets of te error will be reduced at least by a factor of tree i eac iteratio sweep. Tis brigs us to a importat caracteristic of eac stadard relaxatio sceme. Defiitio 4 Te largest absolute value amog te eigevalues i te upper alf of te spectrum (te oscillatory modes) of te iteratio matrix is called smootig factor. 3. Te Multigrid Metod 4. Coarse Grids Providig a good iitial guess ca improve te performace of a relaxatio sceme i te iitial iteratio sweeps. A good way for gettig a better iitial guess is takig a coarse grid ad performig a certai umber of iteratios. O Figure 6 a smoot wave (waveumber 4) is sow o a grid wit poits ad o a coarse grid wit 6 poits. We see tat te smoot wave o te fie grid looks more oscillatory we pojected o te coarse grid i.e. te smootig property we usig coarse grids becomes a advatage. Moreover, te relaxatio o a coarse grid is less expesive because tere are less poits tat sould be kept i memory ad te coarse grid as a margially improved covergece rate te covergece factor is Ο. ( ) /

8 Figure 6 Let us see te projectio of te smoot wave o te coarse grid ito more detail. Te kt mode o Ω becomes kt mode o Ω for k < i.e. : j k j k wk, j si π si π w = = = k, j. Because of aliasig, for k > te kt mode / o Ω becomes ( k)t mode o Ω ad te oscillatory modes will be misiterpreted as relatively smoot: w ( ) ( ) π j k π j π k j k = si = si = si = w / k, j k, j Te cocept of coarse grid ad its mai property of makig smoot modes to look more oscillatory, gives te idea to move to coarser grid we te relaxatio begis to stall because te relaxatio will be more effective i dampig te oscillatory compoets of te error. 4. Nested Iteratio Te ested iteratio is based o te idea of performig a certai umber of prelimiary iteratios i order to get a better iitial guess for te fie-grid iteratio. It ca be described as follows: Relax o Au = fo a very coarse grid to obtai a iitial guess for te ext fier grid... 4 Relax o Au = fo Ω to obtai a iitial guess for Ω Relax o A u= f o Ω to obtai a iitial guess for Ω Relax o Au = fo Ω to obtai a fial approximatio to te solutio.

9 4.3 Correctio Sceme Te correctio sceme uses te idea tat we ca relax directly o te error by usig te residual equatio: Ae = r= f Av wit iitial guess e= 0. Additioally tis previously described relaxatio is equivalet to a relaxatio o te equatio Au = fwit a arbitrary iitial guess v. Te correctio sceme ca be described wit: Relax o Au = fo Ω to obtai a approximatio v Compute te residual r = f A v Relax o te residual equatio Ae = ro Ω to obtai a approximatio to te error e Correct te approximatio obtaied o Ω wit te error estimate obtaied o Ω : v v + e Te mai idea ere is tat at first we relax o te fie grid. We te covergece becomes slow we relax o te residual equatio o a coarser grid were we obtai a approximatio to te error. Te we retur back to te fie grid usig te obtaied approximatio to te error. 4.4 Iterpolatio Operator I te previous two subsectios we gave two scemes tat ca potetially improve te performace of te relaxatio metods. But some of te steps, like ow do we trasfer a vector from te coarse grid to te fie grid ad vice versa, still eed to be specified ito more details. We sould also poit out tat we will cosider oly te case were te coarse grid as twice as less poits compared to te precedig fie grid. Tis is doe because of simplicity ad also because we will get te same coclusios usig differet grid spacigs. Te iterpolatio operator is based o a commo procedure i umerical aalysis called iterpolatio or prologatio ad provides us wit te ecessary tecique for trasferrig te error approximatio e from te coarse grid Ω to te fie grid Ω. Practise as sow tat for most multigrid implemetatios te liear iterpolatio gives very good results, so we will also use it ere. Te iterpolatio operator I is a liear operator from to, wit a full rak ad a trivial ull-space. It ca be see as a mappig I : Ω Ω, tat trasforms coarse-grid vectors ito fie-grid vectors usig te formula I v = v, were v j = vj, v j+ = ( vj + vj+ ), 0 j. Tis procedure is illustrated o Figure 7. Figure 7 It is importat to see ow tis operator works we we ave smoot ad we we ave oscillatory vector o te fie grid. Te iterpolatio process we te real vector is smoot is illustrated o Figure 8.

10 Figure 8 From te picture above we ca see tat if te error o Ω is smoot te iterpolat will also be smoot, i.e. a iterpolat of te coarse-grid error gives a good iterpretatio of te real error. We te real error is oscillatory, Figure 9 sows tat te iterpolat is smoot, i.e. i tis case a iterpolat of te coarse-grid error may give a poor iterpretatio of te real error. Figure 9 Beig efficiet we te error is smoot, te iterpolatio operator provides a complemet to te relaxatio process. Te iterpolatio process is a part of te ested iteratio ad correctio sceme, so tey also sow best performace for smoot errors. 4.5 Restrictio Operator Te restrictio operators are used for trasferrig vectors from a fie grid to a coarse grid. Tey are liear operators from to deoted as I, are wit a full rak ad ave a ullspace of dimesio. Te restrictio operators ca be see as mappigs I : Ω Ω tat usig te formula I v = v take fie-grid vectors ad produce coarse-grid vectors. Te simplest oe is ijectio, defied wit vj = v j, were te correspodig value of te fie-grid poit is simply take as a value of te coarse-grid poit. Aoter restrictio operator is full weigtig, defied wit vj = ( v j + v j + v j+ ), j -, were we take 4 weigted averages of values at eigbourig fie-grid poits i order to get te values of te coarse-grid poits. Tis process is illustrated i Figure 0. Figure 0

11 4.6 Two-Grid Correctio Sceme Havig te detailed defiitios of te iterpolatio ad te restrictio operator we ca ow give te procedure tat describes te two-grid correctio sceme. v MG( v, f ) Relax ν times o A u = f o Ω wit iitial guess v Compute te fie-grid residual r = f A v it to te coarse grid by r Solve A e = r o Ω = I r Iterpolate te coarse-grid error to te fie-grid by e ad restrict = I e ad correct te fie-grid approxiamtio by v v + e Relax ν times o A u = f o Ω wit iitial guess v A ice illustratio is give i Figure. Figure As we ca see o te picture above, at te begiig we relax usually to 3 times o te fiegrid. After we calculate te residual of te approximatio tat we got we trasfer it by te restrictio operator to te coarse grid. Te te residual equatio is solved (or approximate solutio is foud) o te coarse grid. Te last step is trasferrig te error (or te approximated error) wit te iterpolatio operator back to te fie-grid ad correctig te fie-grid approximatio. Tis is also followed by a few iteratio sweeps. Te importat tig tat sould be oted ere is tat wit te relaxatio we elimiate te oscillatory compoets of te error, ad assumig tat we ca get a accurate solutio to te residual equatio, te iterpolatio operator will get a relatively smoot error. As we kow from before te iterpolatio operator is most effective o smoot errors, so we are supposed to get a good correctio of te fie grid approximatio. 4.7 V-Cycle Sceme Tere is oe problem i te procedure described i te previous subsectio ad tat is te solutio of te residual equatio A e = r o te coarse grid. If we ca otice tat tis

12 problem is ot muc differet ta te origial problem we ca solve it recursively. Namely we ca apply te two-grid correctio procedure to te residual equatio o Ω ad te 4 move to a coarser grid i.e. Ω i order to obtai te correctio. We repeat te process util we reac a grid were we ca fid a exact solutio of te residual equatio (we ca eve reac to grids wit oe poit if it is ecessary). After tat we go up to te fier grids usig te correspodig iterpolatio operators. A otatio modificatio is eeded i order to be able to describe tis recursive procedure algoritmically. Te rigt ad-side of te residual equatio will be deoted as f, u will replace te solutio of te residual equatio e ad fially v will deote te approximatios to u. Tese cages are appropriate because solvig te residual equatio is adled te same way as te origial equatios ad we get simplified otatio for describig te wole procedure. It sould also be poited out tat as a iitial guess for te first visit to Ω we will coose v = 0, because tere o iformatio available for te solutio u. Te process described above is sow i Figure. Figure Takig ito accout tat v ad f must be stored at eac level ad tat for d dimesios te coarser grid as -d te umber of poits as te fier grid, for te storage costs of te V- d d d d Md Cycle we ave ( ) <. Te computatioal costs of a V-Cycle d wit oe pre-coarse-grid correctio relaxatio sweep ad oe post-coarse-grid relaxatio d d d Md sweep are give wit (... ) <, were te cost of oe relaxatio sweep o te fie grid is oe workig uit (WU). 4.8 Full Multigrid V-Cycle Te full multigrid V-Cycle combies te ested iteratio ad te V-Cycle. Te basic idea ere is tat a better iitial guess for te first fie-grid iteratio of te V-Cycle ca improve its performace. I te cotext of multigridig a good cadidate is te ested iteratio, wic suggests performig prelimiary iteratios o te coarse grid Ω. Now we also eed a iitial guess for te Ω problem. Te ested iteratio uses recursio for solvig tis problem. 4 Agai we move te problem to te coarser grid Ω, ad we cotiue tis process util we reac te coarsest grid were we ca solve te problem explicitly. After tat we move up to te fier grids usig te iterpolatio operator. 3 d Te full multigrid V-Cycle, were te coarse-grid rigt-sides are iitialized by trasferrig from te fie grid, ca be described wit te followig procedure: f

13 v FMG ( f ) giitialize f I f, f I f, gsolve or relax o coarsest grid giterpolate iitial guess v g I 4 4 ( ) Perform V-cycle v MV v, f ν 0 times giterpolate iitial guess v g I ( ) Perform V-cycle v MV v, f ν 0 times v v Te parameter tat specifies te umber of V-Cycles performed at eac level ν 0 is determied experimetally ad usually as te value oe. As we ca see i te described procedure eac V-Cycle is preceded by a V-Cycle performed o a coarser grid i order to provide a good iitial guess. Figure 3 bellow gives a ice scematic represetatio. Figure 3 Te recursive procedure for te full multigrid is as follows: ( f ). Iitialize f I f, f I f, If Ω coarsest grid, set v 0, te go to 3. Else f v v FMG I FMG ( f ) ( f ) 3. Correct v I v 4. v MV ( v, f ) ν 0 times

14 Takig ito accout tat te size of te workig uit for te coarse grid j is jd times of te size of te workig uit o te fie grid, te costs of full multigrid for ν 0 = ν =... = are less d d ta (... d ) =. d 4.9 Buildig A ( ) e u v, i.e. te error lies i te rage of te iterpolatio. From tis it follows tat tere exists a vector u Ω, suc tat e = I u ad for te residual equatio we get A I u = r. Figure 4 sows ow Rage. At te begiig for simplicity we assume tat for te error olds = R( I ) A acts o ( I ) Figure 4 Te values A I u are zero at te odd grid poits of Ω, so te odd rows of A I are zero ad te eve rows are actually te coarse-grid poits of Ω. Accordig to tis if we leave out te odd rows i te residual equatio we get its coarse-grid form. Tis ca be doe by applyig te restrictio operator I ad we get I I I A u = r. From ere we ca defie te coarse-grid operator as A = I A I. Te same result ca be obtaied we usig te secod-order fiite differeces we te origial problem is discretized o Ω. Te argumet tat e Rage( I ) does ot old i te geeral case, because if it olds we ca immediately solve exactly te residual equatio o Ω. However, it gives a uderstadable defiitio of A ad te two very importat variatioal properties: Galerki Coditio: A I A I T I c I, c = ( ) = tat is eoug for basic uderstadig ad a itroductio to te multigrid metod. 4.0 Spectral Aalysis Te spectral aalysis of te restrictio ad iterpolatio operator aswers te questio of ow tese two operators act o te modes of A. Te modes of A for te oe-dimesioal model problem, as we defied tem i oe of te previous sectios, are give wit j k π wk,j = si, k,0 j. We te restrictio operator acts upo te modes of A we get:

15 g g kπ w = w k kπ w( k) = w k < smoot modes: I k cos k, oscillatory modes: I si k, Accordig to tis we ca coclude tat usig te restrictio operator te oscillatory modes o Ω caot be represeted o Ω. Tis operator trasforms tis modes ito relatively smoot modes o Ω. Te kt ad (-k)t modes o Ω, bot represet te kt mode o Ω. Defiitio 5 Te pair of fie grid modes { k, k} olds tat ( ) j + w = w. k, j k, j w w is called complemetary modes. It also Deotig {, Wk = spa wk w k}, it ca be stated tat I : { Wk spa wk }. Te same aalysis, but ow performed o te iterpolatio operator I gives: kπ kπ I wk = cos wk si w k, k <, so we ca coclude tat iterpolatio of smoot modes o Ω creates oscillatory modes o Ω. For te two-grid correctio sceme (TG) we ave: ( ) ( ) ( ) ν I I ( C( )) ν ( ) I TG ν v R v + C f + A f A R v + f e I I A A R e e As we kow from before, te error ca be expressed as a liear combiatio of te modes of A. We are ow iterested i fidig out ow TG acts o te modes of A. If we cosider TG wit o iteratios ( ν = 0 ) ad te made spectral aalysis of te operators, we ave: TGw = s w + s w k k k k k TGw k = ckwk + ckw k, k. From te equatios above it ca be see tat TG witout relaxatios elimiates te smoot modes of te error ad leaves te oscillatory modes udamped. If we iclude te relaxatios, we ave: ν ν TGwk = λkskwk + λkskw k ν ν TGw k = λ kckwk + λ kckw k, k were λ k is te eigevalue of te relaxatio metod correspodig to w k. Observig te equatios above, te fact tat te relaxatios sow te best efficiecy o te oscillatory modes ad TG aloe acts o te smoot modes, we ca coclude tat tis combiatio will elimiate bot te oscillatory ad te smoot modes of te error. 4. Algebraic Aalysis From te properties of te iterpolatio ad restrictio operator, ad te ortogoality T ( ) relatiosips betwee te subspaces of a liear operator, we get: ( I ) ( I N Rage ).

16 Te secod variatioal property te gives us: N ( I ) Rage( I ) ortogoality is used it ca be obtaied tat: N ( I A ) Rage( I A ) decompose te space Ω i te followig way: Rage( I ) ( I N ) e Ω, ca ow be represeted i te form: e = s + t, were Rage( I ) N( I ) be sow tat TG is te idetity we it acts o N( I A ) Rage( I ).. If also te otio of A-. Tis allows us to Ω = A. Eac vector s ad t A. Takig ito accout tis decompositio ad te variatioal properties, it ca, ad its ull space is exactly Overall, we got a spectral decompositio Ω = L H, were L cotais te low-frequecy modes ad H cotais te ig-frequecy modes, ad a algebraic decompositio I Ω = Rage N I A of Ω. ( ) ( ) 4. How it works? Now we are ready to see wat appes beid te curtos ad ow te multigrid metod maages to elimiate te error i a very efficiet maer. Te Figure 5 gives a very good illustratio of te process. Figure 5 Te axes i te figure correspod to te two previously described decompositios. Te vector e Ω, ca ave projectios o te four axes ad tose projectios ca be furter projected. Aalysig te pictures i Figure 5 i te directio left to rigt, bottom to top, we ca see ow te error is efficietly damped. First te relaxatio sweeps elimiate te ig-frequecy compoets of te error ( e is projected oto te L-axis), te te two-grid correctio sceme

17 elimiates te compoet of e is projected oto te N( I ) ( e alog te ( ) Rage I axis, sice tat is te ull space of TG A -axis). Te o-zero compoet of te error alog te H- axis is because TG excites oscillatory modes. Repeatig tis process efficietly elimiates te error. 4. Is everytig really tat simple? Altoug te applicatio of te multigrid metod ca be very atural ad gives very good results o some basic problems, tat is ot always te case i reality. Tere are may problems tat itroduce very difficult ad ot trivial problems i coosig specifyig te grid, coosig te operators ad so o. Some of tose problems are give i te list bellow, but it is above te scope of tis itroductio to te multigrid metod to try to solve or describe tem ito more details. Aisotropic operators ad grids Discotiuous or aisotropic coefficiets Noliear problems No-scalar PDE systems Hig order discretizatio Algebraic Turbulece models Cemicaly reactig flows Socks Small-scale sigularities Refereces William L. Briggs, Va Emde Heso, ad Steve F. McCormik. A Multigrid Tutorial. SIAM, 000 A. Bradt. Multigrid Teciques: 984 Guide wit Applicatios to Fluid Dyamics. Te Weizma Istitute of Applied Sciece, Reovot, Israel, 984

Introduction to Multigrid Method

Introduction to Multigrid Method Introduction to Multigrid Metod Presented by: Bogojeska Jasmina /08/005 JASS, 005, St. Petersburg 1 Te ultimate upsot of MLAT Te amount of computational work sould be proportional to te amount of real

More information

x x x 2x x N ( ) p NUMERICAL METHODS UNIT-I-SOLUTION OF EQUATIONS AND EIGENVALUE PROBLEMS By Newton-Raphson formula

x x x 2x x N ( ) p NUMERICAL METHODS UNIT-I-SOLUTION OF EQUATIONS AND EIGENVALUE PROBLEMS By Newton-Raphson formula NUMERICAL METHODS UNIT-I-SOLUTION OF EQUATIONS AND EIGENVALUE PROBLEMS. If g( is cotiuous i [a,b], te uder wat coditio te iterative (or iteratio metod = g( as a uique solutio i [a,b]? '( i [a,b].. Wat

More information

TMA4205 Numerical Linear Algebra. The Poisson problem in R 2 : diagonalization methods

TMA4205 Numerical Linear Algebra. The Poisson problem in R 2 : diagonalization methods TMA4205 Numerical Liear Algebra The Poisso problem i R 2 : diagoalizatio methods September 3, 2007 c Eiar M Røquist Departmet of Mathematical Scieces NTNU, N-749 Trodheim, Norway All rights reserved A

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

ME 501A Seminar in Engineering Analysis Page 1

ME 501A Seminar in Engineering Analysis Page 1 Accurac, Stabilit ad Sstems of Equatios November 0, 07 Numerical Solutios of Ordiar Differetial Equatios Accurac, Stabilit ad Sstems of Equatios Larr Caretto Mecaical Egieerig 0AB Semiar i Egieerig Aalsis

More information

The Random Walk For Dummies

The Random Walk For Dummies The Radom Walk For Dummies Richard A Mote Abstract We look at the priciples goverig the oe-dimesioal discrete radom walk First we review five basic cocepts of probability theory The we cosider the Beroulli

More information

Chapter 4. Fourier Series

Chapter 4. Fourier Series Chapter 4. Fourier Series At this poit we are ready to ow cosider the caoical equatios. Cosider, for eample the heat equatio u t = u, < (4.) subject to u(, ) = si, u(, t) = u(, t) =. (4.) Here,

More information

ALLOCATING SAMPLE TO STRATA PROPORTIONAL TO AGGREGATE MEASURE OF SIZE WITH BOTH UPPER AND LOWER BOUNDS ON THE NUMBER OF UNITS IN EACH STRATUM

ALLOCATING SAMPLE TO STRATA PROPORTIONAL TO AGGREGATE MEASURE OF SIZE WITH BOTH UPPER AND LOWER BOUNDS ON THE NUMBER OF UNITS IN EACH STRATUM ALLOCATING SAPLE TO STRATA PROPORTIONAL TO AGGREGATE EASURE OF SIZE WIT BOT UPPER AND LOWER BOUNDS ON TE NUBER OF UNITS IN EAC STRATU Lawrece R. Erst ad Cristoper J. Guciardo Erst_L@bls.gov, Guciardo_C@bls.gov

More information

Differentiation Techniques 1: Power, Constant Multiple, Sum and Difference Rules

Differentiation Techniques 1: Power, Constant Multiple, Sum and Difference Rules Differetiatio Teciques : Power, Costat Multiple, Sum ad Differece Rules 97 Differetiatio Teciques : Power, Costat Multiple, Sum ad Differece Rules Model : Fidig te Equatio of f '() from a Grap of f ()

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

Stability analysis of numerical methods for stochastic systems with additive noise

Stability analysis of numerical methods for stochastic systems with additive noise Stability aalysis of umerical metods for stoctic systems wit additive oise Yosiiro SAITO Abstract Stoctic differetial equatios (SDEs) represet pysical peomea domiated by stoctic processes As for determiistic

More information

4.3 Growth Rates of Solutions to Recurrences

4.3 Growth Rates of Solutions to Recurrences 4.3. GROWTH RATES OF SOLUTIONS TO RECURRENCES 81 4.3 Growth Rates of Solutios to Recurreces 4.3.1 Divide ad Coquer Algorithms Oe of the most basic ad powerful algorithmic techiques is divide ad coquer.

More information

Recursive Algorithms. Recurrences. Recursive Algorithms Analysis

Recursive Algorithms. Recurrences. Recursive Algorithms Analysis Recursive Algorithms Recurreces Computer Sciece & Egieerig 35: Discrete Mathematics Christopher M Bourke cbourke@cseuledu A recursive algorithm is oe i which objects are defied i terms of other objects

More information

The Advection-Diffusion equation!

The Advection-Diffusion equation! ttp://www.d.edu/~gtryggva/cf-course/! Te Advectio-iffusio equatio! Grétar Tryggvaso! Sprig 3! Navier-Stokes equatios! Summary! u t + u u x + v u y = P ρ x + µ u + u ρ y Hyperbolic part! u x + v y = Elliptic

More information

Taylor expansion: Show that the TE of f(x)= sin(x) around. sin(x) = x - + 3! 5! L 7 & 8: MHD/ZAH

Taylor expansion: Show that the TE of f(x)= sin(x) around. sin(x) = x - + 3! 5! L 7 & 8: MHD/ZAH Taylor epasio: Let ƒ() be a ifiitely differetiable real fuctio. A ay poit i the eighbourhood of 0, the fuctio ƒ() ca be represeted by a power series of the followig form: X 0 f(a) f() f() ( ) f( ) ( )

More information

The picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled

The picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled 1 Lecture : Area Area ad distace traveled Approximatig area by rectagles Summatio The area uder a parabola 1.1 Area ad distace Suppose we have the followig iformatio about the velocity of a particle, how

More information

CHAPTER 10 INFINITE SEQUENCES AND SERIES

CHAPTER 10 INFINITE SEQUENCES AND SERIES CHAPTER 10 INFINITE SEQUENCES AND SERIES 10.1 Sequeces 10.2 Ifiite Series 10.3 The Itegral Tests 10.4 Compariso Tests 10.5 The Ratio ad Root Tests 10.6 Alteratig Series: Absolute ad Coditioal Covergece

More information

Chapter 7: The z-transform. Chih-Wei Liu

Chapter 7: The z-transform. Chih-Wei Liu Chapter 7: The -Trasform Chih-Wei Liu Outlie Itroductio The -Trasform Properties of the Regio of Covergece Properties of the -Trasform Iversio of the -Trasform The Trasfer Fuctio Causality ad Stability

More information

The z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j

The z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j The -Trasform 7. Itroductio Geeralie the complex siusoidal represetatio offered by DTFT to a represetatio of complex expoetial sigals. Obtai more geeral characteristics for discrete-time LTI systems. 7.

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

A Pseudo Spline Methods for Solving an Initial Value Problem of Ordinary Differential Equation

A Pseudo Spline Methods for Solving an Initial Value Problem of Ordinary Differential Equation Joural of Matematics ad Statistics 4 (: 7-, 008 ISSN 549-3644 008 Sciece Publicatios A Pseudo Splie Metods for Solvig a Iitial Value Problem of Ordiary Differetial Equatio B.S. Ogudare ad G.E. Okeca Departmet

More information

On Exact Finite-Difference Scheme for Numerical Solution of Initial Value Problems in Ordinary Differential Equations.

On Exact Finite-Difference Scheme for Numerical Solution of Initial Value Problems in Ordinary Differential Equations. O Exact Fiite-Differece Sceme for Numerical Solutio of Iitial Value Problems i Ordiar Differetial Equatios. Josua Suda, M.Sc. Departmet of Matematical Scieces, Adamawa State Uiversit, Mubi, Nigeria. E-mail:

More information

Numerical Method for Blasius Equation on an infinite Interval

Numerical Method for Blasius Equation on an infinite Interval Numerical Method for Blasius Equatio o a ifiite Iterval Alexader I. Zadori Omsk departmet of Sobolev Mathematics Istitute of Siberia Brach of Russia Academy of Scieces, Russia zadori@iitam.omsk.et.ru 1

More information

Partial Differential Equations

Partial Differential Equations EE 84 Matematical Metods i Egieerig Partial Differetial Eqatios Followig are some classical partial differetial eqatios were is assmed to be a fctio of two or more variables t (time) ad y (spatial coordiates).

More information

On the convergence, consistence and stability of a standard finite difference scheme

On the convergence, consistence and stability of a standard finite difference scheme AMERICAN JOURNAL OF SCIENTIFIC AND INDUSTRIAL RESEARCH 2, Sciece Huβ, ttp://www.sciub.org/ajsir ISSN: 253-649X, doi:.525/ajsir.2.2.2.74.78 O te covergece, cosistece ad stabilit of a stadard fiite differece

More information

CALCULATION OF FIBONACCI VECTORS

CALCULATION OF FIBONACCI VECTORS CALCULATION OF FIBONACCI VECTORS Stuart D. Aderso Departmet of Physics, Ithaca College 953 Daby Road, Ithaca NY 14850, USA email: saderso@ithaca.edu ad Dai Novak Departmet of Mathematics, Ithaca College

More information

Apply change-of-basis formula to rewrite x as a linear combination of eigenvectors v j.

Apply change-of-basis formula to rewrite x as a linear combination of eigenvectors v j. Eigevalue-Eigevector Istructor: Nam Su Wag eigemcd Ay vector i real Euclidea space of dimesio ca be uiquely epressed as a liear combiatio of liearly idepedet vectors (ie, basis) g j, j,,, α g α g α g α

More information

b i u x i U a i j u x i u x j

b i u x i U a i j u x i u x j M ath 5 2 7 Fall 2 0 0 9 L ecture 1 9 N ov. 1 6, 2 0 0 9 ) S ecod- Order Elliptic Equatios: Weak S olutios 1. Defiitios. I this ad the followig two lectures we will study the boudary value problem Here

More information

Machine Learning for Data Science (CS 4786)

Machine Learning for Data Science (CS 4786) Machie Learig for Data Sciece CS 4786) Lecture & 3: Pricipal Compoet Aalysis The text i black outlies high level ideas. The text i blue provides simple mathematical details to derive or get to the algorithm

More information

Scientific Research of the Institute of Mathematics and Computer Science

Scientific Research of the Institute of Mathematics and Computer Science Scietific Researc of te Istitute of Matematics ad Computer Sciece ON THE TOLERANCE AVERAGING FOR DIFFERENTIAL OPERATORS WITH PERIODIC COEFFICIENTS Jolata Borowska, Łukasz Łaciński 2, Jowita Ryclewska,

More information

Beurling Integers: Part 2

Beurling Integers: Part 2 Beurlig Itegers: Part 2 Isomorphisms Devi Platt July 11, 2015 1 Prime Factorizatio Sequeces I the last article we itroduced the Beurlig geeralized itegers, which ca be represeted as a sequece of real umbers

More information

THE ENERGY BALANCE ERROR FOR CIRCUIT TRANSIENT ANALYSIS

THE ENERGY BALANCE ERROR FOR CIRCUIT TRANSIENT ANALYSIS THE ENERGY BALANCE ERROR FOR CIRCUIT TRANSIENT ANALYSIS FLORIN CONSTANTINESCU, ALEXANDRU GABRIEL GHEORGHE, MIRUNA NIŢESCU Key words: Trasiet aalysis, Eergy balace error, Time step coice. Two algoritms

More information

Linear Regression Demystified

Linear Regression Demystified Liear Regressio Demystified Liear regressio is a importat subject i statistics. I elemetary statistics courses, formulae related to liear regressio are ofte stated without derivatio. This ote iteds to

More information

The Method of Least Squares. To understand least squares fitting of data.

The Method of Least Squares. To understand least squares fitting of data. The Method of Least Squares KEY WORDS Curve fittig, least square GOAL To uderstad least squares fittig of data To uderstad the least squares solutio of icosistet systems of liear equatios 1 Motivatio Curve

More information

Inverse Matrix. A meaning that matrix B is an inverse of matrix A.

Inverse Matrix. A meaning that matrix B is an inverse of matrix A. Iverse Matrix Two square matrices A ad B of dimesios are called iverses to oe aother if the followig holds, AB BA I (11) The otio is dual but we ofte write 1 B A meaig that matrix B is a iverse of matrix

More information

A NEW CLASS OF 2-STEP RATIONAL MULTISTEP METHODS

A NEW CLASS OF 2-STEP RATIONAL MULTISTEP METHODS Jural Karya Asli Loreka Ahli Matematik Vol. No. (010) page 6-9. Jural Karya Asli Loreka Ahli Matematik A NEW CLASS OF -STEP RATIONAL MULTISTEP METHODS 1 Nazeeruddi Yaacob Teh Yua Yig Norma Alias 1 Departmet

More information

PAPER : IIT-JAM 2010

PAPER : IIT-JAM 2010 MATHEMATICS-MA (CODE A) Q.-Q.5: Oly oe optio is correct for each questio. Each questio carries (+6) marks for correct aswer ad ( ) marks for icorrect aswer.. Which of the followig coditios does NOT esure

More information

Chapter 10: Power Series

Chapter 10: Power Series Chapter : Power Series 57 Chapter Overview: Power Series The reaso series are part of a Calculus course is that there are fuctios which caot be itegrated. All power series, though, ca be itegrated because

More information

Optimally Sparse SVMs

Optimally Sparse SVMs A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but

More information

More Elementary Aspects of Numerical Solutions of PDEs!

More Elementary Aspects of Numerical Solutions of PDEs! ttp://www.d.edu/~gtryggva/cfd-course/ Outlie More Elemetary Aspects o Numerical Solutios o PDEs I tis lecture we cotiue to examie te elemetary aspects o umerical solutios o partial dieretial equatios.

More information

A New Hybrid in the Nonlinear Part of Adomian Decomposition Method for Initial Value Problem of Ordinary Differential Equation

A New Hybrid in the Nonlinear Part of Adomian Decomposition Method for Initial Value Problem of Ordinary Differential Equation Joural of Matematics Researc; Vol No ; ISSN - E-ISSN - Publised b Caadia Ceter of Sciece ad Educatio A New Hbrid i te Noliear Part of Adomia Decompositio Metod for Iitial Value Problem of Ordiar Differetial

More information

Introduction to Optimization Techniques. How to Solve Equations

Introduction to Optimization Techniques. How to Solve Equations Itroductio to Optimizatio Techiques How to Solve Equatios Iterative Methods of Optimizatio Iterative methods of optimizatio Solutio of the oliear equatios resultig form a optimizatio problem is usually

More information

IP Reference guide for integer programming formulations.

IP Reference guide for integer programming formulations. IP Referece guide for iteger programmig formulatios. by James B. Orli for 15.053 ad 15.058 This documet is iteded as a compact (or relatively compact) guide to the formulatio of iteger programs. For more

More information

DEGENERACY AND ALL THAT

DEGENERACY AND ALL THAT DEGENERACY AND ALL THAT Te Nature of Termodyamics, Statistical Mecaics ad Classical Mecaics Termodyamics Te study of te equilibrium bulk properties of matter witi te cotext of four laws or facts of experiece

More information

NICK DUFRESNE. 1 1 p(x). To determine some formulas for the generating function of the Schröder numbers, r(x) = a(x) =

NICK DUFRESNE. 1 1 p(x). To determine some formulas for the generating function of the Schröder numbers, r(x) = a(x) = AN INTRODUCTION TO SCHRÖDER AND UNKNOWN NUMBERS NICK DUFRESNE Abstract. I this article we will itroduce two types of lattice paths, Schröder paths ad Ukow paths. We will examie differet properties of each,

More information

Fourier Series and the Wave Equation

Fourier Series and the Wave Equation Fourier Series ad the Wave Equatio We start with the oe-dimesioal wave equatio u u =, x u(, t) = u(, t) =, ux (,) = f( x), u ( x,) = This represets a vibratig strig, where u is the displacemet of the strig

More information

Lecture 8: October 20, Applications of SVD: least squares approximation

Lecture 8: October 20, Applications of SVD: least squares approximation Mathematical Toolkit Autum 2016 Lecturer: Madhur Tulsiai Lecture 8: October 20, 2016 1 Applicatios of SVD: least squares approximatio We discuss aother applicatio of sigular value decompositio (SVD) of

More information

A widely used display of protein shapes is based on the coordinates of the alpha carbons - - C α

A widely used display of protein shapes is based on the coordinates of the alpha carbons - - C α Nice plottig of proteis: I A widely used display of protei shapes is based o the coordiates of the alpha carbos - - C α -s. The coordiates of the C α -s are coected by a cotiuous curve that roughly follows

More information

TEACHER CERTIFICATION STUDY GUIDE

TEACHER CERTIFICATION STUDY GUIDE COMPETENCY 1. ALGEBRA SKILL 1.1 1.1a. ALGEBRAIC STRUCTURES Kow why the real ad complex umbers are each a field, ad that particular rigs are ot fields (e.g., itegers, polyomial rigs, matrix rigs) Algebra

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

Lecture 7 Testing Nonlinear Inequality Restrictions 1

Lecture 7 Testing Nonlinear Inequality Restrictions 1 Eco 75 Lecture 7 Testig Noliear Iequality Restrictios I Lecture 6, we discussed te testig problems were te ull ypotesis is de ed by oliear equality restrictios: H : ( ) = versus H : ( ) 6= : () We sowed

More information

Singular Continuous Measures by Michael Pejic 5/14/10

Singular Continuous Measures by Michael Pejic 5/14/10 Sigular Cotiuous Measures by Michael Peic 5/4/0 Prelimiaries Give a set X, a σ-algebra o X is a collectio of subsets of X that cotais X ad ad is closed uder complemetatio ad coutable uios hece, coutable

More information

Machine Learning for Data Science (CS 4786)

Machine Learning for Data Science (CS 4786) Machie Learig for Data Sciece CS 4786) Lecture 9: Pricipal Compoet Aalysis The text i black outlies mai ideas to retai from the lecture. The text i blue give a deeper uderstadig of how we derive or get

More information

7 Sequences of real numbers

7 Sequences of real numbers 40 7 Sequeces of real umbers 7. Defiitios ad examples Defiitio 7... A sequece of real umbers is a real fuctio whose domai is the set N of atural umbers. Let s : N R be a sequece. The the values of s are

More information

ECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations

ECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations ECE-S352 Itroductio to Digital Sigal Processig Lecture 3A Direct Solutio of Differece Equatios Discrete Time Systems Described by Differece Equatios Uit impulse (sample) respose h() of a DT system allows

More information

Polynomial Functions and Their Graphs

Polynomial Functions and Their Graphs Polyomial Fuctios ad Their Graphs I this sectio we begi the study of fuctios defied by polyomial expressios. Polyomial ad ratioal fuctios are the most commo fuctios used to model data, ad are used extesively

More information

Spectral Partitioning in the Planted Partition Model

Spectral Partitioning in the Planted Partition Model Spectral Graph Theory Lecture 21 Spectral Partitioig i the Plated Partitio Model Daiel A. Spielma November 11, 2009 21.1 Itroductio I this lecture, we will perform a crude aalysis of the performace of

More information

Numerical Conformal Mapping via a Fredholm Integral Equation using Fourier Method ABSTRACT INTRODUCTION

Numerical Conformal Mapping via a Fredholm Integral Equation using Fourier Method ABSTRACT INTRODUCTION alaysia Joural of athematical Scieces 3(1): 83-93 (9) umerical Coformal appig via a Fredholm Itegral Equatio usig Fourier ethod 1 Ali Hassa ohamed urid ad Teh Yua Yig 1, Departmet of athematics, Faculty

More information

U8L1: Sec Equations of Lines in R 2

U8L1: Sec Equations of Lines in R 2 MCVU U8L: Sec. 8.9. Equatios of Lies i R Review of Equatios of a Straight Lie (-D) Cosider the lie passig through A (-,) with slope, as show i the diagram below. I poit slope form, the equatio of the lie

More information

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense, 3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [

More information

Principle Of Superposition

Principle Of Superposition ecture 5: PREIMINRY CONCEP O RUCUR NYI Priciple Of uperpositio Mathematically, the priciple of superpositio is stated as ( a ) G( a ) G( ) G a a or for a liear structural system, the respose at a give

More information

A collocation method for singular integral equations with cosecant kernel via Semi-trigonometric interpolation

A collocation method for singular integral equations with cosecant kernel via Semi-trigonometric interpolation Iteratioal Joural of Mathematics Research. ISSN 0976-5840 Volume 9 Number 1 (017) pp. 45-51 Iteratioal Research Publicatio House http://www.irphouse.com A collocatio method for sigular itegral equatios

More information

Problem Cosider the curve give parametrically as x = si t ad y = + cos t for» t» ß: (a) Describe the path this traverses: Where does it start (whe t =

Problem Cosider the curve give parametrically as x = si t ad y = + cos t for» t» ß: (a) Describe the path this traverses: Where does it start (whe t = Mathematics Summer Wilso Fial Exam August 8, ANSWERS Problem 1 (a) Fid the solutio to y +x y = e x x that satisfies y() = 5 : This is already i the form we used for a first order liear differetial equatio,

More information

Estimating the Population Mean using Stratified Double Ranked Set Sample

Estimating the Population Mean using Stratified Double Ranked Set Sample Estimatig te Populatio Mea usig Stratified Double Raked Set Sample Mamoud Syam * Kamarulzama Ibraim Amer Ibraim Al-Omari Qatar Uiversity Foudatio Program Departmet of Mat ad Computer P.O.Box (7) Doa State

More information

THE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS

THE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS THE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS DEMETRES CHRISTOFIDES Abstract. Cosider a ivertible matrix over some field. The Gauss-Jorda elimiatio reduces this matrix to the idetity

More information

Sequences, Mathematical Induction, and Recursion. CSE 2353 Discrete Computational Structures Spring 2018

Sequences, Mathematical Induction, and Recursion. CSE 2353 Discrete Computational Structures Spring 2018 CSE 353 Discrete Computatioal Structures Sprig 08 Sequeces, Mathematical Iductio, ad Recursio (Chapter 5, Epp) Note: some course slides adopted from publisher-provided material Overview May mathematical

More information

MA131 - Analysis 1. Workbook 3 Sequences II

MA131 - Analysis 1. Workbook 3 Sequences II MA3 - Aalysis Workbook 3 Sequeces II Autum 2004 Cotets 2.8 Coverget Sequeces........................ 2.9 Algebra of Limits......................... 2 2.0 Further Useful Results........................

More information

ENGI Series Page 6-01

ENGI Series Page 6-01 ENGI 3425 6 Series Page 6-01 6. Series Cotets: 6.01 Sequeces; geeral term, limits, covergece 6.02 Series; summatio otatio, covergece, divergece test 6.03 Stadard Series; telescopig series, geometric series,

More information

Finite Difference Method for the Estimation of a Heat Source Dependent on Time Variable ABSTRACT

Finite Difference Method for the Estimation of a Heat Source Dependent on Time Variable ABSTRACT Malaysia Joural of Matematical Scieces 6(S): 39-5 () Special Editio of Iteratioal Worsop o Matematical Aalysis (IWOMA) Fiite Differece Metod for te Estimatio of a Heat Source Depedet o Time Variable, Allabere

More information

Recurrence Relations

Recurrence Relations Recurrece Relatios Aalysis of recursive algorithms, such as: it factorial (it ) { if (==0) retur ; else retur ( * factorial(-)); } Let t be the umber of multiplicatios eeded to calculate factorial(). The

More information

Fall 2013 MTH431/531 Real analysis Section Notes

Fall 2013 MTH431/531 Real analysis Section Notes Fall 013 MTH431/531 Real aalysis Sectio 8.1-8. Notes Yi Su 013.11.1 1. Defiitio of uiform covergece. We look at a sequece of fuctios f (x) ad study the coverget property. Notice we have two parameters

More information

1 1 2 = show that: over variables x and y. [2 marks] Write down necessary conditions involving first and second-order partial derivatives for ( x0, y

1 1 2 = show that: over variables x and y. [2 marks] Write down necessary conditions involving first and second-order partial derivatives for ( x0, y Questio (a) A square matrix A= A is called positive defiite if the quadratic form waw > 0 for every o-zero vector w [Note: Here (.) deotes the traspose of a matrix or a vector]. Let 0 A = 0 = show that:

More information

(3) If you replace row i of A by its sum with a multiple of another row, then the determinant is unchanged! Expand across the i th row:

(3) If you replace row i of A by its sum with a multiple of another row, then the determinant is unchanged! Expand across the i th row: Math 5-4 Tue Feb 4 Cotiue with sectio 36 Determiats The effective way to compute determiats for larger-sized matrices without lots of zeroes is to ot use the defiitio, but rather to use the followig facts,

More information

We are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n

We are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n Review of Power Series, Power Series Solutios A power series i x - a is a ifiite series of the form c (x a) =c +c (x a)+(x a) +... We also call this a power series cetered at a. Ex. (x+) is cetered at

More information

Riesz-Fischer Sequences and Lower Frame Bounds

Riesz-Fischer Sequences and Lower Frame Bounds Zeitschrift für Aalysis ud ihre Aweduge Joural for Aalysis ad its Applicatios Volume 1 (00), No., 305 314 Riesz-Fischer Sequeces ad Lower Frame Bouds P. Casazza, O. Christese, S. Li ad A. Lider Abstract.

More information

Notes for Lecture 11

Notes for Lecture 11 U.C. Berkeley CS78: Computatioal Complexity Hadout N Professor Luca Trevisa 3/4/008 Notes for Lecture Eigevalues, Expasio, ad Radom Walks As usual by ow, let G = (V, E) be a udirected d-regular graph with

More information

L 5 & 6: RelHydro/Basel. f(x)= ( ) f( ) ( ) ( ) ( ) n! 1! 2! 3! If the TE of f(x)= sin(x) around x 0 is: sin(x) = x - 3! 5!

L 5 & 6: RelHydro/Basel. f(x)= ( ) f( ) ( ) ( ) ( ) n! 1! 2! 3! If the TE of f(x)= sin(x) around x 0 is: sin(x) = x - 3! 5! aylor epasio: Let ƒ() be a ifiitely differetiable real fuctio. At ay poit i the eighbourhood of =0, the fuctio ca be represeted as a power series of the followig form: X 0 f(a) f() ƒ() f()= ( ) f( ) (

More information

Solutions to home assignments (sketches)

Solutions to home assignments (sketches) Matematiska Istitutioe Peter Kumli 26th May 2004 TMA401 Fuctioal Aalysis MAN670 Applied Fuctioal Aalysis 4th quarter 2003/2004 All documet cocerig the course ca be foud o the course home page: http://www.math.chalmers.se/math/grudutb/cth/tma401/

More information

MA131 - Analysis 1. Workbook 2 Sequences I

MA131 - Analysis 1. Workbook 2 Sequences I MA3 - Aalysis Workbook 2 Sequeces I Autum 203 Cotets 2 Sequeces I 2. Itroductio.............................. 2.2 Icreasig ad Decreasig Sequeces................ 2 2.3 Bouded Sequeces..........................

More information

Lecture 8: Solving the Heat, Laplace and Wave equations using finite difference methods

Lecture 8: Solving the Heat, Laplace and Wave equations using finite difference methods Itroductory lecture otes o Partial Differetial Equatios - c Athoy Peirce. Not to be copied, used, or revised without explicit writte permissio from the copyright ower. 1 Lecture 8: Solvig the Heat, Laplace

More information

Chapter 9 - CD companion 1. A Generic Implementation; The Common-Merge Amplifier. 1 τ is. ω ch. τ io

Chapter 9 - CD companion 1. A Generic Implementation; The Common-Merge Amplifier. 1 τ is. ω ch. τ io Chapter 9 - CD compaio CHAPTER NINE CD-9.2 CD-9.2. Stages With Voltage ad Curret Gai A Geeric Implemetatio; The Commo-Merge Amplifier The advaced method preseted i the text for approximatig cutoff frequecies

More information

Physics 324, Fall Dirac Notation. These notes were produced by David Kaplan for Phys. 324 in Autumn 2001.

Physics 324, Fall Dirac Notation. These notes were produced by David Kaplan for Phys. 324 in Autumn 2001. Physics 324, Fall 2002 Dirac Notatio These otes were produced by David Kapla for Phys. 324 i Autum 2001. 1 Vectors 1.1 Ier product Recall from liear algebra: we ca represet a vector V as a colum vector;

More information

THE SOLUTION OF NONLINEAR EQUATIONS f( x ) = 0.

THE SOLUTION OF NONLINEAR EQUATIONS f( x ) = 0. THE SOLUTION OF NONLINEAR EQUATIONS f( ) = 0. Noliear Equatio Solvers Bracketig. Graphical. Aalytical Ope Methods Bisectio False Positio (Regula-Falsi) Fied poit iteratio Newto Raphso Secat The root of

More information

Sequence A sequence is a function whose domain of definition is the set of natural numbers.

Sequence A sequence is a function whose domain of definition is the set of natural numbers. Chapter Sequeces Course Title: Real Aalysis Course Code: MTH3 Course istructor: Dr Atiq ur Rehma Class: MSc-I Course URL: wwwmathcityorg/atiq/fa8-mth3 Sequeces form a importat compoet of Mathematical Aalysis

More information

Ma 4121: Introduction to Lebesgue Integration Solutions to Homework Assignment 5

Ma 4121: Introduction to Lebesgue Integration Solutions to Homework Assignment 5 Ma 42: Itroductio to Lebesgue Itegratio Solutios to Homework Assigmet 5 Prof. Wickerhauser Due Thursday, April th, 23 Please retur your solutios to the istructor by the ed of class o the due date. You

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

MIDTERM 3 CALCULUS 2. Monday, December 3, :15 PM to 6:45 PM. Name PRACTICE EXAM SOLUTIONS

MIDTERM 3 CALCULUS 2. Monday, December 3, :15 PM to 6:45 PM. Name PRACTICE EXAM SOLUTIONS MIDTERM 3 CALCULUS MATH 300 FALL 08 Moday, December 3, 08 5:5 PM to 6:45 PM Name PRACTICE EXAM S Please aswer all of the questios, ad show your work. You must explai your aswers to get credit. You will

More information

CALCULATING FIBONACCI VECTORS

CALCULATING FIBONACCI VECTORS THE GENERALIZED BINET FORMULA FOR CALCULATING FIBONACCI VECTORS Stuart D Aderso Departmet of Physics, Ithaca College 953 Daby Road, Ithaca NY 14850, USA email: saderso@ithacaedu ad Dai Novak Departmet

More information

University of Washington Department of Chemistry Chemistry 453 Winter Quarter 2015

University of Washington Department of Chemistry Chemistry 453 Winter Quarter 2015 Uiversity of Wasigto Departmet of Cemistry Cemistry 453 Witer Quarter 15 Lecture 14. /11/15 Recommeded Text Readig: Atkis DePaula: 9.1, 9., 9.3 A. Te Equipartitio Priciple & Eergy Quatizatio Te Equipartio

More information

Zeros of Polynomials

Zeros of Polynomials Math 160 www.timetodare.com 4.5 4.6 Zeros of Polyomials I these sectios we will study polyomials algebraically. Most of our work will be cocered with fidig the solutios of polyomial equatios of ay degree

More information

Math 113 Exam 3 Practice

Math 113 Exam 3 Practice Math Exam Practice Exam will cover.-.9. This sheet has three sectios. The first sectio will remid you about techiques ad formulas that you should kow. The secod gives a umber of practice questios for you

More information

Proof of Fermat s Last Theorem by Algebra Identities and Linear Algebra

Proof of Fermat s Last Theorem by Algebra Identities and Linear Algebra Proof of Fermat s Last Theorem by Algebra Idetities ad Liear Algebra Javad Babaee Ragai Youg Researchers ad Elite Club, Qaemshahr Brach, Islamic Azad Uiversity, Qaemshahr, Ira Departmet of Civil Egieerig,

More information

SNAP Centre Workshop. Basic Algebraic Manipulation

SNAP Centre Workshop. Basic Algebraic Manipulation SNAP Cetre Workshop Basic Algebraic Maipulatio 8 Simplifyig Algebraic Expressios Whe a expressio is writte i the most compact maer possible, it is cosidered to be simplified. Not Simplified: x(x + 4x)

More information

Statistics 511 Additional Materials

Statistics 511 Additional Materials Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability

More information

The Discrete Fourier Transform

The Discrete Fourier Transform The Discrete Fourier Trasform Complex Fourier Series Represetatio Recall that a Fourier series has the form a 0 + a k cos(kt) + k=1 b k si(kt) This represetatio seems a bit awkward, sice it ivolves two

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

MAT1026 Calculus II Basic Convergence Tests for Series

MAT1026 Calculus II Basic Convergence Tests for Series MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real

More information

Lecture 4 Conformal Mapping and Green s Theorem. 1. Let s try to solve the following problem by separation of variables

Lecture 4 Conformal Mapping and Green s Theorem. 1. Let s try to solve the following problem by separation of variables Lecture 4 Coformal Mappig ad Gree s Theorem Today s topics. Solvig electrostatic problems cotiued. Why separatio of variables does t always work 3. Coformal mappig 4. Gree s theorem The failure of separatio

More information

(VII.A) Review of Orthogonality

(VII.A) Review of Orthogonality VII.A Review of Orthogoality At the begiig of our study of liear trasformatios i we briefly discussed projectios, rotatios ad projectios. I III.A, projectios were treated i the abstract ad without regard

More information

Analytic Continuation

Analytic Continuation Aalytic Cotiuatio The stadard example of this is give by Example Let h (z) = 1 + z + z 2 + z 3 +... kow to coverge oly for z < 1. I fact h (z) = 1/ (1 z) for such z. Yet H (z) = 1/ (1 z) is defied for

More information