Discretization. Consistency. Exact Solution Convergence x, t --> 0. Figure 5.1: Relation between consistency, stability, and convergence.

Size: px
Start display at page:

Download "Discretization. Consistency. Exact Solution Convergence x, t --> 0. Figure 5.1: Relation between consistency, stability, and convergence."

Transcription

1 Chapter 5 Theory The numercal smulaton of PDE s requres careful consderatons of propertes of the approxmate soluton. A necessary condton for the scheme used to model a physcal problem s the consstency of the employed scheme wth the actual set of dfferental equatons. Consstency requres that the error for algebrac equatons s small such that to sgnfcant order the algebrac equatons are a far representaton of the actual PDE s. In other words the the actual set of PDE s can be recovered from the set of algebrac equatons. A second mportant property of the algebrac equatons s stablty. It has already been ndcated that a numercal scheme s not necessarly stable. Numercal stablty s absolutely necessary for the numercal method. Thrd the approxmate soluton s requred to actually converge to the exact soluton n the lmt of x 0 and t 0. However, ths convergence s not obvous. In the followng t wll be demonstrated that for some cases consstency and stablty are necessary for the convergence of the approxmate soluton to the actual soluton. The relaton between consstency, stablty, and convergence s llustrated further n Fgure (5.1). PDE s Dscretzaton Consstency System of algebrac equatons Stablty Exact Soluton Convergence x, t --> 0 Approxmate Soluton Fgure 5.1: Relaton between consstency, stablty, and convergence. Two other mportant consderatons for the numercal soluton method are accuracy and effcency. If at all possble means to acheve a partcular accuracy are hghly desrable and mportant. For 63

2 CHAPTER 5. THEORY 64 the choce of the actual approxmaton method effcency s also mportant. The followng secton address these basc concepts of numercal modelng and smulaton. 5.1 Convergence A soluton of a set of algebrac equatons s convergent f the approxmate soluton approaches the exact soluton of the set of PDE s for each value of the ndependent varable as the grd spacng and tme step goes to 0. lm T n = T exact (x, t n ) (5.1) x, t 0 Ths mples for the error at x and t n e n = T exact (x, t n ) T n 0 for x, t 0 (5.2) The proof for ths s n general dffcult, however, for a specal case the followng theorem apples. Lax Equvalence Theorem: Gven a properly posed lnear ntal value problem and a fnte dfference approxmaton to t that satsfes the consstency condton, stablty s the necessary and suffcent condton for convergence Notes: the theorem s applcable to any dscretzaton real flud dynamcs s usually nonlnear typcal problem are usually boundary value or mxed ntal and boundary value problems In concluson: For most problems the Lax Equvalence Theorem s only a necessary but not necessarly suffcent condton Numercal convergence In cases where an analytc soluton s known t can be used to verfy convergence for a numercal soluton. In the case of the dffuson equaton the error for dfferent grd resoluton s gven n Table 5.1 for a dffuson coeffcent α = Table 5.1: Soluton error for sm1.f for dfferent values of s and x. s = α t/ x 2 x =

3 CHAPTER 5. THEORY 65 The result demonstrates that the error decreases wth x 2 ndcatng that the numercal soluton ndeed converges to the exact soluton. Fgure (5.2) provdes a graphc representaton of the error as a functon of x. Note that the convergence of sm1.f for s = 1/6 s a specal case and of order x FTCS Error s=1/2 s=1/4 s=1/10 s=1/ x Fgure 5.2: Error for the dffuson equaton approxmated by the FTCS scheme as a functon of x. In cases where where an analytc soluton s not know one can test convergence usng the dfference of two approxmate solutons,.e., e x = T ( x, t) n T ( x/2, t/2)2n 2 (5.3) for the lmt x, t Consstency Consstency requres that the orgnal equatons can be recovered from the algebrac equatons. Obvously ths s a mnmum requrement for any dscretzaton. n the followng we wll llustrate how ths can be done n terms of a Taylor expanson of the dscretzed equatons. FTCS scheme The FTCS scheme used for sm1.f uses the approxmaton T n+1 = T n + s ( T 1 n + T +1 n 2T ) n A Taylor expanson of the ndvdual terms n ths equaton yelds

4 CHAPTER 5. THEORY 66 whch yelds [ ] n [ [ T T n+1 = T n + t + t2 2 T + t3 3 T + O ( t 4) t 2 t 2 6 t 3 [ ] n [ ] T T+1 n = T n + x + x2 2 n [ ] T + x3 3 n [ T + x4 4 T x 2 x 2 6 x 3 24 x 4 [ ] + x5 5 n [ ] T + x6 6 n T + O ( x 7) 120 x x 6 [ ] n [ ] T T 1 n = T n x + x2 2 n [ ] T x3 3 n [ T + x4 4 T x 2 x 2 6 x 3 24 x 4 [ ] x5 5 n [ ] T + x6 6 n T + O ( x 7) 120 x x 6 T t + t 2 T tt + t2 6 T ttt = (T s x2 xx + x2 t 12 T xxxx + O ( x 4) ) wth s = α t/ x 2 and T tt = α 2 T xxxx and some rearrangng one obtans T t + αt xx + α x2 2 Thus the error for ths scheme s ] n ] n ( s 1 ) T xxxx + O ( x 4, t 2) = 0 (5.4) 6 ] n ] n E n = α x2 2 ( s 1 ) [ ] 4 n T + O ( x 4, t 2) (5.5) 6 x 4 Ths result also explans the pror note on 4th order accuracy of the FTCS scheme for s = 1/6. In ths case the second order error terms are zero such that the lowest order error becomes 4th order. It s also worth notng that a refnement of x mples an actually smaller tme step because the ntegraton parameter s s such that the temporal ntegraton step for some fxed value of s s t = s x 2 /α. In other words wth a fxed value of s a smaller grd spacng mples a smaller tme step. Fully mplct scheme. A fully mplct scheme can be expressed as st n (1 + 2s)T n+1 st n+1 +1 = T n (5.6) Usually a faster way to recover the orgnal equatons s acheved by castng the algebrac equatons nto a form that s more sutable to apply the Taylor expanson. Here ths s

5 CHAPTER 5. THEORY 67 T n+1 t T n Let us frst substtute the expanson n x. T n+1 t T n = α T 1 n+1 In the next step we apply the expanson n tme. n+1 2T + T+1 n+1 (5.7) x 2 { } α T xx n+1 + x2 12 T xxxx n+1 + x4 360 T xxxxxx n+1... = 0 T t + t 2 T tt + t2 6 T ttt +... α {T xx + tt xxt + t2 2 T xxtt x2 12 [T xxxx + tt xxxxt +...] + x4 360 T xxxxxx +... } = 0 Substtutng t = s x 2 /α and T tt = α 2 T xxxx yelds T t + s x2 2 αt xxxx + s 2 x4 6 αt xxxxxx +... α {T xx + s x 2 T xxxx + s 2 x4 2 T xxxxxx x2 12 [ Txxxx + s x 2 T xxxxxx +... ] + x4 360 T xxxxxx } = 0 Re-orderng terms wth all terms retaned up the 4th order n x gves T t αt xx α x2 2 whch shows an error of ( s + 1 ) ( T xxxx α x4 s 2 + s ) T xxxxxx = 0 (5.8) 120 E n = α x2 2 ( s + 1 ) ( n α x4 T xxxx s 2 + s ) T xxxxxx n O ( x 6). (5.9) Smlar to the FTCS scheme one recovers a second order accuracy. However n order to acheve a fourth order scheme one would requre s = 1/6 correspondng to a negatve tme step n the ntegraton such that t s not possble to construct a fourth order scheme n ths case.

6 CHAPTER 5. THEORY Temperature Tme = Nx = 21 Dt = s = RMS E = x Fgure 5.3: Grd oscllatons ncreasng wth tme are typcal for numercal nstabltes. 5.3 Stablty For any numercal model small perturbatons (such as truncaton errors) should decay n tme. However, for nstance the FTCS scheme for the dffuson equaton (sm1.f) wll generate ncreasng errors for s = 0.55 as llustrated n Fgure 5.3. The cause for the nstablty s an amplfcaton of errors whch occur and accumulate durng a smulaton. Round-off errors occur at any stage n a computaton such that the computatonal soluton s not actually T n but T n,.e., a value whch contans some newly generated round-off errors and the entre accumulaton of pror errors. The error between the computed soluton and the expected soluton to the algebrac equaton can be expressed as ξ n = T n T n (5.10) Smlar to T n, the soluton T n whch ncludes the errors also satsfes the algebrac equatons. For nstance for the FTCS scheme appled to the dffuson equaton T n+1 = (1 2s) T n ( + s T n 1 + T ) +1 n If the algebrac equatons are homogeneous and lnear the error also satsfes the same equaton whch can be demonstrated by subtractng the equaton for T n from the one for T n. ξ n+1 = ξ n + s ( ξ 1 n + ξn +1 ) 2ξn (5.11) For gven ntal condtons all ntal errors ξ 0 are zero for all grd ponts. Smlarly Drchlet boundary condtons mply that the error at the boundary ponts ξ1 n and ξn n x are zero for all tmes t n. The two most common methods to analyze stablty are the matrx method and the von Neumann method.

7 CHAPTER 5. THEORY Matrx method FTCS scheme Consder the FTCS scheme for the dffuson equaton wth Drchlet boundary condtons,.e., ξ1 n = 0 and ξn n x = 0. The equatons for the soluton are Thus the soluton equatons can be wrtten as ξ2 n+1 = (1 2s) ξ2 n + sξn 3 ξ3 n+1 = sξ1 n + (1 2s) ξn 2 + sξn 3 ξ n+1 = sξ 1 n + (1 2s) ξ n + sξ+1 n ξ n+1 N x = sξn n + (1 2s) x 1 ξn N x wth ξ n+1 = A ξ n (5.12) ξ = ξ n 2. ξ n ị. ξ n N x 1, A = (1 2s) s 0 s (1 2s) s 0 s (1 2s) s s (1 2s) (5.13) It can be shown that all errors are bounded f all Egenvalues are dstnct and the absolute values are smaller than 1. If the Egenvectors are gven by ξ k = T 1 η k (5.14) where η k s the unt vector n the kth drecton the equaton can be re-wrtten as η n+1 = ( T A T 1) η n (5.15) where the matrx à = T A T 1 s a dagonal matrx wth the Egenvalues on the dagonal. Thus for all Egenvectors η n+1 < η n f all Egenvalue are 1. The Egenvalues of a trdagonal (N x 2) (N x 2) matrx

8 CHAPTER 5. THEORY 70 are gven by b c 0 0 a b c 0 0 a b c..... a b c 0 a b λ k = b + 2 (ac) 1/2 cos kπ N x 1 (5.16) for k = 2,..., N x 2. Thus the Egenvalues of the FTCS algorthm are λ k = 1 2s + 2s cos kπ kπ = 1 4s sn2 N x 1 2 (N x 1) (5.17) Thus the condton for stablty s 1 1 4s sn 2 kπ 2 (N x 1) 1 (5.18) or s 1/2. Therefore convergence of the approxmate soluton requres s 1/2 and n ths case all perturbatons decrease n ampltude over tme. General two level scheme For the dffuson equaton ths scheme s gven by T n+1 t T n where the operator L xx s defned by αβl xx T n+1 α (1 β) L xx T n = 0 (5.19) L xx T n = 1 x 2 (T 1 2T + T +1 ) (5.20) Substtutng ths operator and usng the defnton s = α t/ x 2 leads to the error equaton sβξ 1 n+1 +(1 + 2sβ) ξn+1 sβξ+1 n+1 = s (1 β) ξn 1+[1 2s (1 β)] ξ n +s (1 β) ξ+1 n (5.21) such that the set of equatons (for Drchlet condtons) can be wrtten as

9 CHAPTER 5. THEORY 71 A ξ n+1 = B ξ n (5.22) wth and A = (1 + 2sβ) sβ 0 sβ (1 + 2sβ) sβ 0 sβ (1 + 2sβ) sβ (1 + 2sβ) (5.23) B = 1 2s (1 β) s (1 β) 0 s (1 β) 1 2s (1 β) s (1 β) 0 s (1 β) 1 2s (1 β) s s (1 β) 1 2s (1 β) (5.24) Clearly ths algorthm s stable f the absolute value of all egenvalues of A 1 B are smaller than unty. In ths case the magntude of the egenvalues s For the above matrces the Egenvalues are (λ B ) (λ A ) 1 (5.25) kπ kπ λ A = 1 + 2s 2sβ cos = 1 + 4sβ sn2 (5.26) N x 1 2 (N x 1) kπ kπ λ B = 1 + 2s (1 β) 2s (1 β) cos = 1 4s (1 β) sn2 N x 1 2 (N x 1) (5.27) and for the stablty requrement a) for sn 2 kπ 2(N x 1) = 0 wth λ k = 1 b) for sn 2 kπ 2(N x 1) 1 4s (1 β) sn 2 kπ 2(N λ k = x 1) 1 + 4sβ sn 2 kπ 1 (5.28) 2(N x 1) = 1 one obtans two condtons:. 1 4s (1 β) 1 + 4sβ whch s always satsfed.. 1 4s (1 β) 1 4sβ whch mples 2 4s (1 β) or s 0.5/ (1 2β) for β < 1/2.

10 CHAPTER 5. THEORY 72 Dervatve boundary condtons Assumng Neumann boundary condtons of the form whch can be mplemented by T t = δ, at x = 0 or T 0 = T 2 2δ x. Substtuton nto the equaton for T 2 T 2 T 0 2 x = δ (1 + 2sβ) ξ n+1 1 2sβξ n+1 2 = [1 2s (1 β)] ξ n 1 + 2s (1 β) ξn 2 2sδ x (5.29) Thus compared to the case of Drchlet condtons the frst equaton (or terms n the matrces) are altered and an nhomogenety s ntroduced nto the equatons,.e., or A ξ n+1 = B ξ n + C (5.30) ξ n+1 = A 1 B ξ n + A 1 C Solutons to the egenvectors can be found through teraton of X n+1 = D X n (5.31) wth D = A 1 B. The teraton s repeated untl X n+1 concdes wth X n. The modfcaton of the Egenvalues by Neumann boundary condtons s usually relatvely small Von Neumann method The von Neumann method s usually easy to apply, straghtforward, and dependable. However, smlar to the matrx method the von Neumann method s applcable strctly only to lnear equatons wth constant coeffcents (whch s already assumed n the defnton for ξ). Nonlnear equatons can be lnearzed to attempt to apply the method. However, n cases of larger sets of equatons also the von Neumann methods can be challengng. The basc dea s the followng: Assume that the error can be expanded n a Fourer seres N x ξj 0 = a l exp (Θ l j) (5.32) l=1

11 CHAPTER 5. THEORY 73 wth Θ l = lπ x. Consderng an ntal error from one partcular mode wth ampltude 1 one can express ξ n j = g n exp (Θ l j) (5.33) where g s an amplfcaton factor for ths mode. Stablty requres g 1. Equvalent and maybe more ntutve we can assume that an error s gven by a ξ n j = ξ 0 exp [ (kx j + qt n )], (5.34).e., a Fourer mode wth ampltude ξ 0, wave number k, and frequency q. ξ n+1 j = ξ 0 exp [ (kx j + qt n ) + q t] (Agan a general error s expanded by an approprate superposton of all modes as n (5.32)). The amplfcaton (or dampng) of ths mode s ξ n+1 j ξ n j = exp [q t] = g (5.35) Smlarly we can express ξ n j+1 = ξ 0 exp [ (kx j + qt n ) + k x] and ξ n j+1 ξ n j = exp [k x] (5.36) The task now becomes to derve g for all modes from the dscretzed equatons and to nsure that g 1 for all modes (all values of k). FTCS scheme The basc equaton for the FTCS scheme s ξ n+1 = (1 2s) ξ n + s ( ) ξ 1 n + ξ+1 n By substtutng the sngle Fourer mode and dvson by ξ n j we obtan exp [q t] = (1 2s) + s [exp (k x) + exp ( k x)] Substtutng the amplfcaton factor g and applyng the defnton for the cosne functon yelds

12 CHAPTER 5. THEORY 74 g = 1 2s + 2s cos (k x) = 1 4s sn 2 (k x/2) (5.37) where 1 cos (x) = 2 sn 2 (x/2) has been used. Thus the stablty condton reads 1 1 4s sn 2 (k x/2) 1 (5.38) Note that stablty requres that the above condton s satsfed for all possble wave numbers k. The condton on the rght s always satsfed and the left nequalty requres s 1 2 (5.39) General two-level scheme The general two level scheme can be expressed by ξ n+1 ξ n t αβl xx ξ n+1 α (1 β) L xx ξ n = 0 wth the second dervatve operator L xx ξ = (ξ 1 + ξ +1 2ξ ) / x 2. Substtuton of s = α t/ x 2 leads to the equaton Wth ξ n+1 ξ n sβ x 2 L xx ξ n+1 s (1 β) x 2 L xx ξ n = 0 (5.40) we obtan x 2 L ξ n xx ξ n = exp (k x) + exp ( k x) 2 = 2 cos (k x) 2 = 4 sn 2 (k x/2) or g 1 + 4gsβ sn 2 (k x/2) + 4s (1 β) sn 2 (k x/2) = 0 (5.41) g = 1 4s (1 β) sn2 (k x/2) 1 + 4sβ sn 2 (k x/2) (5.42) The condton for stablty s g 1 such that

13 CHAPTER 5. THEORY 75 a) The nequalty on the rght yelds 1 1 4s (1 β) sn2 (k x/2) 1 + 4sβ sn 2 (k x/2) 1 (5.43) 1 4s sn 2 (k x/2) 1 whch s always satsfed. b) The condton on the left yelds or 1 4sβ sn 2 (k x/2) 1 4s (1 β) sn 2 (k x/2). For β 1/2 ths s always satsfed.. For β < 1/2 4s(1 2β) sn 2 (k x/2) 2 s 1 2(1 2β) sn 2 (k x/2) Ths condton must be satsfed for all values of k or equvalently all values of sn 2 (k x/2). The rght sde mnmzes for sn 2 (k x/2) = 1 mplyng s 1 2(1 2β) (5.44) In concluson the general two level scheme s uncondtonally stable (.e., there s no stablty lmt for s) for β 1/2 and has the stablty lmt s 0.5/(1 2β) for β < 1/2. The pror examples demonstrate the stablty analyss of numercal approxmatons for a sngle equaton (dependent varable) and cases where only two tme levels are nvolved n the analyss. In cases wth more tme levels the equaton for g becomes a hgher order polynomal whch wll have several solutons for g. Each of the roots of the polynomal must satsfy g 1 for stablty. The solutons n ths case are n general complex solutons such that the amplfcaton s best measured by g 2 = g g where g s the complex conjugate of g and the condton for stablty becomes g g 1. It may be necessary to dentfy the solutons numercally for a range of parameters such as s and β. In cases of systems of equatons the amplfcaton factor becomes a vector where each component has to satsfy the stablty condton. Strctly the demonstrated approach s vald only for lnear equatons. In a general nonlnear case t may be a rather complex task to dentfy the amplfcaton factor. The frst step n such cases s the lnearzaton of the underlyng equatons. A second complcaton n a more general case s the occurrence of physcal nstabltes whch have naturally growng solutons. In that case t s allowed that the magntude of the amplfcaton factor s g 1 + O( t).

14 CHAPTER 5. THEORY Soluton accuracy In cases where both consstency and stablty are satsfed t can usually be expected that the soluton error wll be approxmately the truncaton error. Ths s partcularly the case f the grd spacng and tme step are suffcently small, boundary condtons are wthout dscontnutes, and the soluton s analytc,.e., nvolve on fnte order dervatves. Even though the numercal soluton may converge to the accurate soluton t s usually not necessary to approxmate the exact soluton wth arbtrary accurateness. In many cases t expected to derve qualtatve or quanttatve results wth suffcent accurateness for the partcular purpose of the model. To obtan confdence n more complex nonlnear models where analytc soluton are n general not avalable a varety of confdence buldng measure can be appled. For many applcatons t s not only helpful but necessary to test smplfed related problems frst. In fact ndustral/commercal applcatons of numercal models have usually a long hstory of varous applcatons. In terms of smplfed problems there s usually a varety of smplfcatons whch yeld analytc solutons such as equlbrum confguratons, steady state systems, and lnear modes (waves). In addton consstency test should use refnng the spatal grd and/or the tme step, establsh that gradents are resolved by the grd scale, and test conservaton law such as mass, momentum, energy, and magnetc flux conservaton. The followng presents a rather specfc example on how grd refnement can be used to ncrease accuracy

15 CHAPTER 5. THEORY 77 Rchardson extrapolaton Consder two soluton T a and T b wth dfferent resoluton x a and x b of the dffuson equaton obtaned wth the FTCS scheme sm1.f. The goal here s to combne the solutons T c = at a + bt b (5.45) where a and b are constants such that the combned errors of the solutons partally cancel each other wth a net soluton of hgher accuracy. wth T t n α 2 T x 2 n + a E a n + b E b n = 0 (5.46) E a n = α x2 a 2 E b n = α x2 b 2 For x b = x a /2 one obtans the condton ( s 1 ) [ 4 T 6 x 4 ( s 1 ) [ 4 T 6 x 4 ] n ] n + O ( x 4) + O ( x 4) wth the soluton a b = 0 a + b = 1 a = 1 3, b = 4 3 (5.47) Ths lnear combnaton of two solutons reduces the Error to O ( 4 ) but requres two computatons of solutons. The tme to reach a partcular soluton s proportonal to 1/ x and 1/ t (or N x N t ). Thus we can wrte the computer tme need for a partcular result wth fxed t max c t = K x t = αk (5.48) s x 3 where K s a constant. For s = 1/2 the computer tmes needed for the two runs (wth x and 2 x) are

16 CHAPTER 5. THEORY 78 Table 5.2: RMS error obtaned by regular FTCS, Rchardson Extrapolaton, and s = 1/6 for the dffuson equaton. Scheme x = 0.1 x = 0.05 x = ftcs, s = 1/ ftcs, s = 1/2, RE ftcs, s = 1/ c t, x = 2αK, c x 3 t,2 x = 0.25αK x 3 such that the combned tme for the Rchardson extrapolaton s In comparson the tme needed for the specal case s = 1/6 s c t, x,re = 2.25αK x 3 (5.49) c t, x,s=1/6 = 6αK x 3 (5.50) In concluson the Rchardson extrapolaton s by more than a factor of 2 faster to acheve the same order of accuracy. Note, however, that the fourth order error has a term O ( (2 x) 4) n the Rchardson extrapolaton such that the accuracy s n factor a factor of about 16 less than n the correspondng specal case wth s = 1/ Effcency Computatonal effcency s a concept that s not entrely well defned. However n general a method has large effcency f t produces results wth small errors ɛ (or large accuracy) n a short perod of computer tme c t. So conceptual one can express computatonal effcency as CE = K ɛc t (5.51) Note, however, that ths s n a way subjectve and t s not alway clear what defnton should should be appled to the error ɛ. For nstance f ɛ were merely the truncaton error then the product of ɛc t mght converge to zero for ɛ 0 even though c t. Ths, however, s of no use because t would suggest to use nfnte computer tme because n ths lmt the effcency s largest. A better approach s to fx a requred qualty of the result and then to compare the executon tme for dfferent methods and realzatons ncludng aspects such as vectorzaton, parallelzaton, and the actual style of programmng n addton to the partcular method for the numercal approxmaton.

17 CHAPTER 5. THEORY 79 Operaton counts: Basc computatonal operatons have a typcal executon tme on any computer. The prncple categores of computer operatons are floatng pont operatons (fl) fxed pont operatons (fx) assgnments (=) logcal operatons, e.g., f, and, or (l) mathematcal lbrary functons, e.g., sn, exp, etc (m) To derve an estmate for the actual computaton tme t s necessary to derve tmes for each of the typcal operatons n a computer program. An overvew for the relatve executon tmes of varous typcal operatons s provded n Table 5.3. In the table the mcrocomputer s one of the earlest versons of an Intel based PC. The supermcro represents an early SUN workstaton. Table 5.3: Relatve executon tmes for basc operatons. Operaton Mcrocomputer Supermcro Manframe NEC-APC IV SUN Sparc St1 IBM-3090 add (fl) subtr (fl) multpl (fl) dv (fl) assgn (=) f (l) add (fx) subtr (fx) multpl (fx) dv (fx) power sqrt sn exp Inspectng the table one can conclude a number of ground rules for programmng fast code. If possble one should avod dvsons n partcular on RISC (reduced nstructon set) processors. Also lbrary calls to mathematcal functons are usually expansve and should be carefully chosen or avoded. An example program to evaluate executon tmes for dfferent operatons s provde on the web page. It should be noted that ths evaluaton s not always unque for present computer generatons.

18 CHAPTER 5. THEORY 80 Frst complers typcally optmze computer programs and ths optmzaton can be sophstcated. For nstance f the operatons wthn a loop are dentcal t s not necessary to execute the loop n tmes and some complers detect ths and cut the loop short by executng the requred commands only once. Other optmzatons exst of whch we may not be aware for any partcular part of a program. Also modern computer processors are usually 64 bt wde allowng more than a sngle operaton per processor cycle. Thus the tme for a partcular operaton can depend n part on the program context. As an example for an operaton count consder the FTCS equaton T n+1 = (1 2s)T n + s ( ) T 1 n + T+1 n whch comprses 3 multplcatons, two addtons, one subtracton, and nteger add, and an assgnment or n total: 6 fl, 1fx, and 1 =. Ths provdes us wth the means to carry out an operaton count for the mportant (most frequently used) subroutnes of a program. A last remark: It s of large mportance to determne always estmates on the executon tme for a smulaton/modelng program. For real applcatons Ths s helpful not only to determne possble neffcences due to neffcent programmng but also for plannng of larger sze programs and to gan an understandng of the potental for a program,.e., whether t can be scaled up to treat a compellng applcaton.

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system Transfer Functons Convenent representaton of a lnear, dynamc model. A transfer functon (TF) relates one nput and one output: x t X s y t system Y s The followng termnology s used: x y nput output forcng

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

NON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS

NON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS IJRRAS 8 (3 September 011 www.arpapress.com/volumes/vol8issue3/ijrras_8_3_08.pdf NON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS H.O. Bakodah Dept. of Mathematc

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

2.29 Numerical Fluid Mechanics Fall 2011 Lecture 12

2.29 Numerical Fluid Mechanics Fall 2011 Lecture 12 REVIEW Lecture 11: 2.29 Numercal Flud Mechancs Fall 2011 Lecture 12 End of (Lnear) Algebrac Systems Gradent Methods Krylov Subspace Methods Precondtonng of Ax=b FINITE DIFFERENCES Classfcaton of Partal

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

One-sided finite-difference approximations suitable for use with Richardson extrapolation

One-sided finite-difference approximations suitable for use with Richardson extrapolation Journal of Computatonal Physcs 219 (2006) 13 20 Short note One-sded fnte-dfference approxmatons sutable for use wth Rchardson extrapolaton Kumar Rahul, S.N. Bhattacharyya * Department of Mechancal Engneerng,

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 13

CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 13 CME 30: NUMERICAL LINEAR ALGEBRA FALL 005/06 LECTURE 13 GENE H GOLUB 1 Iteratve Methods Very large problems (naturally sparse, from applcatons): teratve methods Structured matrces (even sometmes dense,

More information

Formal solvers of the RT equation

Formal solvers of the RT equation Formal solvers of the RT equaton Formal RT solvers Runge- Kutta (reference solver) Pskunov N.: 979, Master Thess Long characterstcs (Feautrer scheme) Cannon C.J.: 970, ApJ 6, 55 Short characterstcs (Hermtan

More information

2 Finite difference basics

2 Finite difference basics Numersche Methoden 1, WS 11/12 B.J.P. Kaus 2 Fnte dfference bascs Consder the one- The bascs of the fnte dfference method are best understood wth an example. dmensonal transent heat conducton equaton T

More information

4DVAR, according to the name, is a four-dimensional variational method.

4DVAR, according to the name, is a four-dimensional variational method. 4D-Varatonal Data Assmlaton (4D-Var) 4DVAR, accordng to the name, s a four-dmensonal varatonal method. 4D-Var s actually a drect generalzaton of 3D-Var to handle observatons that are dstrbuted n tme. The

More information

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0 MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector

More information

Inductance Calculation for Conductors of Arbitrary Shape

Inductance Calculation for Conductors of Arbitrary Shape CRYO/02/028 Aprl 5, 2002 Inductance Calculaton for Conductors of Arbtrary Shape L. Bottura Dstrbuton: Internal Summary In ths note we descrbe a method for the numercal calculaton of nductances among conductors

More information

Appendix B. The Finite Difference Scheme

Appendix B. The Finite Difference Scheme 140 APPENDIXES Appendx B. The Fnte Dfference Scheme In ths appendx we present numercal technques whch are used to approxmate solutons of system 3.1 3.3. A comprehensve treatment of theoretcal and mplementaton

More information

FTCS Solution to the Heat Equation

FTCS Solution to the Heat Equation FTCS Soluton to the Heat Equaton ME 448/548 Notes Gerald Recktenwald Portland State Unversty Department of Mechancal Engneerng gerry@pdx.edu ME 448/548: FTCS Soluton to the Heat Equaton Overvew 1. Use

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

2.29 Numerical Fluid Mechanics

2.29 Numerical Fluid Mechanics REVIEW Lecture 10: Sprng 2015 Lecture 11 Classfcaton of Partal Dfferental Equatons PDEs) and eamples wth fnte dfference dscretzatons Parabolc PDEs Ellptc PDEs Hyperbolc PDEs Error Types and Dscretzaton

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

The equation of motion of a dynamical system is given by a set of differential equations. That is (1)

The equation of motion of a dynamical system is given by a set of differential equations. That is (1) Dynamcal Systems Many engneerng and natural systems are dynamcal systems. For example a pendulum s a dynamcal system. State l The state of the dynamcal system specfes t condtons. For a pendulum n the absence

More information

Lecture 21: Numerical methods for pricing American type derivatives

Lecture 21: Numerical methods for pricing American type derivatives Lecture 21: Numercal methods for prcng Amercan type dervatves Xaoguang Wang STAT 598W Aprl 10th, 2014 (STAT 598W) Lecture 21 1 / 26 Outlne 1 Fnte Dfference Method Explct Method Penalty Method (STAT 598W)

More information

Chapter 12. Ordinary Differential Equation Boundary Value (BV) Problems

Chapter 12. Ordinary Differential Equation Boundary Value (BV) Problems Chapter. Ordnar Dfferental Equaton Boundar Value (BV) Problems In ths chapter we wll learn how to solve ODE boundar value problem. BV ODE s usuall gven wth x beng the ndependent space varable. p( x) q(

More information

Numerical Solution of Ordinary Differential Equations

Numerical Solution of Ordinary Differential Equations Numercal Methods (CENG 00) CHAPTER-VI Numercal Soluton of Ordnar Dfferental Equatons 6 Introducton Dfferental equatons are equatons composed of an unknown functon and ts dervatves The followng are examples

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

Note 10. Modeling and Simulation of Dynamic Systems

Note 10. Modeling and Simulation of Dynamic Systems Lecture Notes of ME 475: Introducton to Mechatroncs Note 0 Modelng and Smulaton of Dynamc Systems Department of Mechancal Engneerng, Unversty Of Saskatchewan, 57 Campus Drve, Saskatoon, SK S7N 5A9, Canada

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

1 Derivation of Point-to-Plane Minimization

1 Derivation of Point-to-Plane Minimization 1 Dervaton of Pont-to-Plane Mnmzaton Consder the Chen-Medon (pont-to-plane) framework for ICP. Assume we have a collecton of ponts (p, q ) wth normals n. We want to determne the optmal rotaton and translaton

More information

1 GSW Iterative Techniques for y = Ax

1 GSW Iterative Techniques for y = Ax 1 for y = A I m gong to cheat here. here are a lot of teratve technques that can be used to solve the general case of a set of smultaneous equatons (wrtten n the matr form as y = A), but ths chapter sn

More information

Open Systems: Chemical Potential and Partial Molar Quantities Chemical Potential

Open Systems: Chemical Potential and Partial Molar Quantities Chemical Potential Open Systems: Chemcal Potental and Partal Molar Quanttes Chemcal Potental For closed systems, we have derved the followng relatonshps: du = TdS pdv dh = TdS + Vdp da = SdT pdv dg = VdP SdT For open systems,

More information

APPENDIX A Some Linear Algebra

APPENDIX A Some Linear Algebra APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,

More information

Finite Element Modelling of truss/cable structures

Finite Element Modelling of truss/cable structures Pet Schreurs Endhoven Unversty of echnology Department of Mechancal Engneerng Materals echnology November 3, 214 Fnte Element Modellng of truss/cable structures 1 Fnte Element Analyss of prestressed structures

More information

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS)

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS) Some Comments on Acceleratng Convergence of Iteratve Sequences Usng Drect Inverson of the Iteratve Subspace (DIIS) C. Davd Sherrll School of Chemstry and Bochemstry Georga Insttute of Technology May 1998

More information

PHYS 705: Classical Mechanics. Calculus of Variations II

PHYS 705: Classical Mechanics. Calculus of Variations II 1 PHYS 705: Classcal Mechancs Calculus of Varatons II 2 Calculus of Varatons: Generalzaton (no constrant yet) Suppose now that F depends on several dependent varables : We need to fnd such that has a statonary

More information

More metrics on cartesian products

More metrics on cartesian products More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of

More information

Vector Norms. Chapter 7 Iterative Techniques in Matrix Algebra. Cauchy-Bunyakovsky-Schwarz Inequality for Sums. Distances. Convergence.

Vector Norms. Chapter 7 Iterative Techniques in Matrix Algebra. Cauchy-Bunyakovsky-Schwarz Inequality for Sums. Distances. Convergence. Vector Norms Chapter 7 Iteratve Technques n Matrx Algebra Per-Olof Persson persson@berkeley.edu Department of Mathematcs Unversty of Calforna, Berkeley Math 128B Numercal Analyss Defnton A vector norm

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

The Finite Element Method

The Finite Element Method The Fnte Element Method GENERAL INTRODUCTION Read: Chapters 1 and 2 CONTENTS Engneerng and analyss Smulaton of a physcal process Examples mathematcal model development Approxmate solutons and methods of

More information

Lecture 13 APPROXIMATION OF SECOMD ORDER DERIVATIVES

Lecture 13 APPROXIMATION OF SECOMD ORDER DERIVATIVES COMPUTATIONAL FLUID DYNAMICS: FDM: Appromaton of Second Order Dervatves Lecture APPROXIMATION OF SECOMD ORDER DERIVATIVES. APPROXIMATION OF SECOND ORDER DERIVATIVES Second order dervatves appear n dffusve

More information

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010 Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Numerical Simulation of One-Dimensional Wave Equation by Non-Polynomial Quintic Spline

Numerical Simulation of One-Dimensional Wave Equation by Non-Polynomial Quintic Spline IOSR Journal of Matematcs (IOSR-JM) e-issn: 78-578, p-issn: 319-765X. Volume 14, Issue 6 Ver. I (Nov - Dec 018), PP 6-30 www.osrournals.org Numercal Smulaton of One-Dmensonal Wave Equaton by Non-Polynomal

More information

Handout # 6 (MEEN 617) Numerical Integration to Find Time Response of SDOF mechanical system. and write EOM (1) as two first-order Eqs.

Handout # 6 (MEEN 617) Numerical Integration to Find Time Response of SDOF mechanical system. and write EOM (1) as two first-order Eqs. Handout # 6 (MEEN 67) Numercal Integraton to Fnd Tme Response of SDOF mechancal system State Space Method The EOM for a lnear system s M X + DX + K X = F() t () t = X = X X = X = V wth ntal condtons, at

More information

Foundations of Arithmetic

Foundations of Arithmetic Foundatons of Arthmetc Notaton We shall denote the sum and product of numbers n the usual notaton as a 2 + a 2 + a 3 + + a = a, a 1 a 2 a 3 a = a The notaton a b means a dvdes b,.e. ac = b where c s an

More information

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,

More information

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b Int J Contemp Math Scences, Vol 3, 28, no 17, 819-827 A New Refnement of Jacob Method for Soluton of Lnear System Equatons AX=b F Naem Dafchah Department of Mathematcs, Faculty of Scences Unversty of Gulan,

More information

The Exact Formulation of the Inverse of the Tridiagonal Matrix for Solving the 1D Poisson Equation with the Finite Difference Method

The Exact Formulation of the Inverse of the Tridiagonal Matrix for Solving the 1D Poisson Equation with the Finite Difference Method Journal of Electromagnetc Analyss and Applcatons, 04, 6, 0-08 Publshed Onlne September 04 n ScRes. http://www.scrp.org/journal/jemaa http://dx.do.org/0.46/jemaa.04.6000 The Exact Formulaton of the Inverse

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2 Salmon: Lectures on partal dfferental equatons 5. Classfcaton of second-order equatons There are general methods for classfyng hgher-order partal dfferental equatons. One s very general (applyng even to

More information

Formulas for the Determinant

Formulas for the Determinant page 224 224 CHAPTER 3 Determnants e t te t e 2t 38 A = e t 2te t e 2t e t te t 2e 2t 39 If 123 A = 345, 456 compute the matrx product A adj(a) What can you conclude about det(a)? For Problems 40 43, use

More information

Grover s Algorithm + Quantum Zeno Effect + Vaidman

Grover s Algorithm + Quantum Zeno Effect + Vaidman Grover s Algorthm + Quantum Zeno Effect + Vadman CS 294-2 Bomb 10/12/04 Fall 2004 Lecture 11 Grover s algorthm Recall that Grover s algorthm for searchng over a space of sze wors as follows: consder the

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

Linear Regression Analysis: Terminology and Notation

Linear Regression Analysis: Terminology and Notation ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented

More information

Workshop: Approximating energies and wave functions Quantum aspects of physical chemistry

Workshop: Approximating energies and wave functions Quantum aspects of physical chemistry Workshop: Approxmatng energes and wave functons Quantum aspects of physcal chemstry http://quantum.bu.edu/pltl/6/6.pdf Last updated Thursday, November 7, 25 7:9:5-5: Copyrght 25 Dan Dll (dan@bu.edu) Department

More information

AE/ME 339. K. M. Isaac. 8/31/2004 topic4: Implicit method, Stability, ADI method. Computational Fluid Dynamics (AE/ME 339) MAEEM Dept.

AE/ME 339. K. M. Isaac. 8/31/2004 topic4: Implicit method, Stability, ADI method. Computational Fluid Dynamics (AE/ME 339) MAEEM Dept. AE/ME 339 Comptatonal Fld Dynamcs (CFD) Comptatonal Fld Dynamcs (AE/ME 339) Implct form of dfference eqaton In the prevos explct method, the solton at tme level n,,n, depended only on the known vales of,

More information

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty Addtonal Codes usng Fnte Dfference Method Benamn Moll 1 HJB Equaton for Consumpton-Savng Problem Wthout Uncertanty Before consderng the case wth stochastc ncome n http://www.prnceton.edu/~moll/ HACTproect/HACT_Numercal_Appendx.pdf,

More information

MA 323 Geometric Modelling Course Notes: Day 13 Bezier Curves & Bernstein Polynomials

MA 323 Geometric Modelling Course Notes: Day 13 Bezier Curves & Bernstein Polynomials MA 323 Geometrc Modellng Course Notes: Day 13 Bezer Curves & Bernsten Polynomals Davd L. Fnn Over the past few days, we have looked at de Casteljau s algorthm for generatng a polynomal curve, and we have

More information

2.3 Nilpotent endomorphisms

2.3 Nilpotent endomorphisms s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms

More information

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011 Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected

More information

Chapter Newton s Method

Chapter Newton s Method Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve

More information

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016 U.C. Berkeley CS94: Spectral Methods and Expanders Handout 8 Luca Trevsan February 7, 06 Lecture 8: Spectral Algorthms Wrap-up In whch we talk about even more generalzatons of Cheeger s nequaltes, and

More information

Application of B-Spline to Numerical Solution of a System of Singularly Perturbed Problems

Application of B-Spline to Numerical Solution of a System of Singularly Perturbed Problems Mathematca Aeterna, Vol. 1, 011, no. 06, 405 415 Applcaton of B-Splne to Numercal Soluton of a System of Sngularly Perturbed Problems Yogesh Gupta Department of Mathematcs Unted College of Engneerng &

More information

C4B Machine Learning Answers II. = σ(z) (1 σ(z)) 1 1 e z. e z = σ(1 σ) (1 + e z )

C4B Machine Learning Answers II. = σ(z) (1 σ(z)) 1 1 e z. e z = σ(1 σ) (1 + e z ) C4B Machne Learnng Answers II.(a) Show that for the logstc sgmod functon dσ(z) dz = σ(z) ( σ(z)) A. Zsserman, Hlary Term 20 Start from the defnton of σ(z) Note that Then σ(z) = σ = dσ(z) dz = + e z e z

More information

Inexact Newton Methods for Inverse Eigenvalue Problems

Inexact Newton Methods for Inverse Eigenvalue Problems Inexact Newton Methods for Inverse Egenvalue Problems Zheng-jan Ba Abstract In ths paper, we survey some of the latest development n usng nexact Newton-lke methods for solvng nverse egenvalue problems.

More information

Solutions to exam in SF1811 Optimization, Jan 14, 2015

Solutions to exam in SF1811 Optimization, Jan 14, 2015 Solutons to exam n SF8 Optmzaton, Jan 4, 25 3 3 O------O -4 \ / \ / The network: \/ where all lnks go from left to rght. /\ / \ / \ 6 O------O -5 2 4.(a) Let x = ( x 3, x 4, x 23, x 24 ) T, where the varable

More information

ELASTIC WAVE PROPAGATION IN A CONTINUOUS MEDIUM

ELASTIC WAVE PROPAGATION IN A CONTINUOUS MEDIUM ELASTIC WAVE PROPAGATION IN A CONTINUOUS MEDIUM An elastc wave s a deformaton of the body that travels throughout the body n all drectons. We can examne the deformaton over a perod of tme by fxng our look

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens THE CHINESE REMAINDER THEOREM KEITH CONRAD We should thank the Chnese for ther wonderful remander theorem. Glenn Stevens 1. Introducton The Chnese remander theorem says we can unquely solve any par of

More information

Implicit Integration Henyey Method

Implicit Integration Henyey Method Implct Integraton Henyey Method In realstc stellar evoluton codes nstead of a drect ntegraton usng for example the Runge-Kutta method one employs an teratve mplct technque. Ths s because the structure

More information

Some modelling aspects for the Matlab implementation of MMA

Some modelling aspects for the Matlab implementation of MMA Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton

More information

is the calculated value of the dependent variable at point i. The best parameters have values that minimize the squares of the errors

is the calculated value of the dependent variable at point i. The best parameters have values that minimize the squares of the errors Multple Lnear and Polynomal Regresson wth Statstcal Analyss Gven a set of data of measured (or observed) values of a dependent varable: y versus n ndependent varables x 1, x, x n, multple lnear regresson

More information

Exercises. 18 Algorithms

Exercises. 18 Algorithms 18 Algorthms Exercses 0.1. In each of the followng stuatons, ndcate whether f = O(g), or f = Ω(g), or both (n whch case f = Θ(g)). f(n) g(n) (a) n 100 n 200 (b) n 1/2 n 2/3 (c) 100n + log n n + (log n)

More information

Speeding up Computation of Scalar Multiplication in Elliptic Curve Cryptosystem

Speeding up Computation of Scalar Multiplication in Elliptic Curve Cryptosystem H.K. Pathak et. al. / (IJCSE) Internatonal Journal on Computer Scence and Engneerng Speedng up Computaton of Scalar Multplcaton n Ellptc Curve Cryptosystem H. K. Pathak Manju Sangh S.o.S n Computer scence

More information

Lecture 2: Numerical Methods for Differentiations and Integrations

Lecture 2: Numerical Methods for Differentiations and Integrations Numercal Smulaton of Space Plasmas (I [AP-4036] Lecture 2 by Lng-Hsao Lyu March, 2018 Lecture 2: Numercal Methods for Dfferentatons and Integratons As we have dscussed n Lecture 1 that numercal smulaton

More information

Mathematical Preparations

Mathematical Preparations 1 Introducton Mathematcal Preparatons The theory of relatvty was developed to explan experments whch studed the propagaton of electromagnetc radaton n movng coordnate systems. Wthn expermental error the

More information

Convergence of random processes

Convergence of random processes DS-GA 12 Lecture notes 6 Fall 216 Convergence of random processes 1 Introducton In these notes we study convergence of dscrete random processes. Ths allows to characterze phenomena such as the law of large

More information

The Feynman path integral

The Feynman path integral The Feynman path ntegral Aprl 3, 205 Hesenberg and Schrödnger pctures The Schrödnger wave functon places the tme dependence of a physcal system n the state, ψ, t, where the state s a vector n Hlbert space

More information

Hidden Markov Models & The Multivariate Gaussian (10/26/04)

Hidden Markov Models & The Multivariate Gaussian (10/26/04) CS281A/Stat241A: Statstcal Learnng Theory Hdden Markov Models & The Multvarate Gaussan (10/26/04) Lecturer: Mchael I. Jordan Scrbes: Jonathan W. Hu 1 Hdden Markov Models As a bref revew, hdden Markov models

More information

Research Article Green s Theorem for Sign Data

Research Article Green s Theorem for Sign Data Internatonal Scholarly Research Network ISRN Appled Mathematcs Volume 2012, Artcle ID 539359, 10 pages do:10.5402/2012/539359 Research Artcle Green s Theorem for Sgn Data Lous M. Houston The Unversty of

More information

Consistency & Convergence

Consistency & Convergence /9/007 CHE 374 Computatonal Methods n Engneerng Ordnary Dfferental Equatons Consstency, Convergence, Stablty, Stffness and Adaptve and Implct Methods ODE s n MATLAB, etc Consstency & Convergence Consstency

More information

Lecture 5.8 Flux Vector Splitting

Lecture 5.8 Flux Vector Splitting Lecture 5.8 Flux Vector Splttng 1 Flux Vector Splttng The vector E n (5.7.) can be rewrtten as E = AU (5.8.1) (wth A as gven n (5.7.4) or (5.7.6) ) whenever, the equaton of state s of the separable form

More information

= = = (a) Use the MATLAB command rref to solve the system. (b) Let A be the coefficient matrix and B be the right-hand side of the system.

= = = (a) Use the MATLAB command rref to solve the system. (b) Let A be the coefficient matrix and B be the right-hand side of the system. Chapter Matlab Exercses Chapter Matlab Exercses. Consder the lnear system of Example n Secton.. x x x y z y y z (a) Use the MATLAB command rref to solve the system. (b) Let A be the coeffcent matrx and

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

MAE140 - Linear Circuits - Winter 16 Final, March 16, 2016

MAE140 - Linear Circuits - Winter 16 Final, March 16, 2016 ME140 - Lnear rcuts - Wnter 16 Fnal, March 16, 2016 Instructons () The exam s open book. You may use your class notes and textbook. You may use a hand calculator wth no communcaton capabltes. () You have

More information

Thermal-Fluids I. Chapter 18 Transient heat conduction. Dr. Primal Fernando Ph: (850)

Thermal-Fluids I. Chapter 18 Transient heat conduction. Dr. Primal Fernando Ph: (850) hermal-fluds I Chapter 18 ransent heat conducton Dr. Prmal Fernando prmal@eng.fsu.edu Ph: (850) 410-6323 1 ransent heat conducton In general, he temperature of a body vares wth tme as well as poston. In

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

Lecture 14: Forces and Stresses

Lecture 14: Forces and Stresses The Nuts and Bolts of Frst-Prncples Smulaton Lecture 14: Forces and Stresses Durham, 6th-13th December 2001 CASTEP Developers Group wth support from the ESF ψ k Network Overvew of Lecture Why bother? Theoretcal

More information

Lecture Note 3. Eshelby s Inclusion II

Lecture Note 3. Eshelby s Inclusion II ME340B Elastcty of Mcroscopc Structures Stanford Unversty Wnter 004 Lecture Note 3. Eshelby s Incluson II Chrs Wenberger and We Ca c All rghts reserved January 6, 004 Contents 1 Incluson energy n an nfnte

More information