Chapter 4 Models for Stationary Time Series
|
|
- Dorcas Freeman
- 6 years ago
- Views:
Transcription
1 Chpter 4 Models for Sttionry Time Series This chpter discusses the bsic concepts of brod clss of prmetric time series models the utoregressive-moving verge models (ARMA. These models hve ssumed gret importnce in modeling rel-world processes. 4. Generl Liner Processes We will lwys let { } denote the observed time series. From here on we will lso let { t } represent n unobserved white noise series, tht is, sequence of identiclly distributed, zero-men, independent rndom vribles. For much of our work, the ssumption of independence could be replced by the weker ssumption tht the { t } re uncorrelted rndom vribles, but we will not pursue tht slight generlity. A generl liner process, { }, is one tht cn be represented s weighted liner combintion of present nd pst white noise terms: = + t ψ + t ψ + t (4.. If the right-hnd side of this expression is truly n infinite series, then certin conditions must be plced on the ψ-weights for the right-hnd side to be mthemticlly meningful. For our purposes, it suffices to ssume tht (4.. We should lso note tht since { t } is unobservble, there is no loss in the generlity of Eqution (4.. if we ssume tht the coefficient on is, effectively, ψ =. An importnt nontrivil exmple to which we will return often is the cse where the ψ s form n exponentilly decying sequence: ψ j = φ j where φ is number between nd +. Then For this exmple i = ψ i < = + t φ + t φ + t EZ ( t = E ( + t φ t φ t =
2 Chpter 4 Models for Sttionry Time Series so tht { } hs constnt men of zero. Also, Furthermore, Vr( = Vr( + t φ + t φ + t = Vr( t + φ Vr( t + φ 4 Vr( t + = σ ( + φ + φ 4 + σ = φ (by summing geometric series Cov, = Cov ( φ t t φ t, + t φ t φ t 3 = Cov( φ t, t + Cov( φ t, φ t + = φσ + φ 3 σ + φ 5 σ + = φσ ( + φ + φ + φσ = φ (gin summing geometric series Thus φσ φ Corr(, = = φ σ φ φ k σ In similr mnner we cn find Cov(, k = φ nd thus Corr(, k = φ k (4..3 It is importnt to note tht the process defined in this wy is sttionry the utocovrince structure depends only on lgged time nd not on bsolute time. For generl liner process, = + t ψ + t ψ + t, clcultions similr to those done bove yield the following results: EZ ( t = γ = k Cov(, k = σ ψ i ψ k i + k (4..4 i = with ψ =. A process with nonzero men µ my be obtined by dding µ to the right-hnd side of Eqution (4..4. Since the men does not ffect the covrince
3 4. Moving Averge Processes properties of process, we ssume zero men until we begin fitting models to dt. 4. Moving Averge Processes In the cse where only finite number of the ψ-weights re nonzero, we hve wht is clled moving verge process. In this cse we chnge nottion somewht nd write = t θ t θ t θ q t q (4.. We cll such series moving verge of order q nd bbrevite the nme to MA(q. The terminology moving verge rises from the fct tht is obtined by pplying the weights, θ, θ,..., θ q to the vribles t, t, t,.., t q nd then moving the weights nd pplying them to t+, t, t,.., t q+ to obtin + nd so on. Moving verge models were first considered by Slutsky (97 nd Wold (938. The First-Order Moving Averge Process We consider in detil the simple, but nevertheless importnt moving verge process of order, tht is, the MA( series. Rther thn specilize the formuls in Eqution (4..4, it is instructive to rederive the results. The model is = t θ t. Since only one θ is involved, we drop the redundnt subscript. Clerly EZ ( t = nd Vr ( = σ ( + θ. Now Cov, = Cov ( θ t t, t θ t = Cov( θ t, t = θσ nd Cov, = Cov ( θ t t, t θ t 3 = since there re no s with subscripts in common between nd. Similrly, Cov(, k = whenever k ; tht is, the process hs no correltion beyong lg. This fct will be importnt lter when we need to choose suitble models for rel dt. In summry: for n MA( model = t θ t, The reson for this chnge will become pprent lter on in Section XX. 3
4 Chpter 4 Models for Sttionry Time Series EZ ( t = γ = Vr( γ = θσ ρ = ( θ ( + θ (4.. γ k = ρ k = for k Some numericl vlues for ρ versus θ in Exhibit (4. help illustrte the possibilities. Note tht the ρ vlues for θ negtive cn be obtined by simply negting the vlue given for the corresponding positive θ-vlue. Exhibit 4. Lg Autocorreltion for n MA( Process θ. ρ = θ ( + θ A clculus rgument shows tht the lrgest vlue tht ρ cn ttin is.5 when θ is nd the smllest vlue is.5, which occurs when θ is +. (See Exercise (4.3 Exhibit (4. displys grph of the lg utocorreltion vlues for θ rnging from to +. 4
5 4. Moving Averge Processes Exhibit 4. Lg Autocorreltion of n MA( Process for Different θ.5.5 ρ θ Exercise (4.4 sks you to show tht when ny nonzero vlue of θ is replced by /θ, the sme vlue for ρ is obtined. For exmple, ρ is the sme for θ =.5 s for θ = /.5 =. If we knew tht n MA( process hd ρ =.4 we still could not tell the precise vlue of θ. We will return to this troublesome point when we discuss invertibility in Section 4.5 on pge 6. Exhibit (4.3 shows time plot of simulted MA( series with θ =.9 nd normlly distributed white noise. Recll from Exhibit (4. tht ρ =.497 for this model; thus there is modertely strong positive correltion t lg. This correltion is evident in the plot of the series since consecutive observtions tend to be closely relted. If n observtion is bove the men level of the series then the next observtion lso tends to be bove the men. (A horizontl line t the theoreticl men of zero hs been plced on the grph to help in this interprettion. The plot is reltively smooth over time with only occsionl lrge fluctutions. 5
6 Chpter 4 Models for Sttionry Time Series Exhibit 4.3 Time Plot of n MA( Process with θ = Z(t Time The lg utocorreltion is even more pprent in Exhibit (4.4 which plots versus. Note the modertely strong upwrd trend in this plot. Exhibit 4.4 Plot of Z(t versus Z(t- for MA( Series in Exhibit ( Z(t Z(t- The plot of versus in Exhibit (4.5 gives strong visuliztion of the zero utocorreltion t lg for this model. 6
7 4. Moving Averge Processes Exhibit 4.5 Plot of Z(t versus Z(t- for MA( Series in Exhibit ( Z(t Z(t- A somewht different series is shown in Exhibit (4.6. This is simulted MA( series with θ = +.9. Recll from Exhibit (4. tht ρ =.497 for this model; thus there is modertely strong negtive correltion t lg. This correltion cn be seen in the plot of the series since consecutive observtions tend to be on opposite sides of the zero men. If n observtion is bove the men level of the series then the next observtion tends to be below the men. The plot is quite jgged over time especilly when compred to the plot in Exhibit (4.3. Exhibit 4.6 Time Plot of n MA( Process with θ = Z(t Time 7
8 Chpter 4 Models for Sttionry Time Series The negtive lg utocorreltion is even more pprent in the lg plot of Exhibit (4.7. Exhibit 4.7 Plot of Z(t versus Z(t- for MA( Series in Exhibit ( Z(t Z(t- The plot of versus in Exhibit (4.8 displys the zero utocorreltion t lg for this model. Exhibit 4.8 Plot of Z(t versus Z(t- for MA( Series in Exhibit ( Z(t Z(t- MA( processes hve no utocorreltion beyond lg but by incresing the order of the process we cn obtin higher order correltions. The Second-Order Moving Averge Process Consider the moving verge process of order two: = t θ t θ t Here γ = Vr( = Vr( t θ t θ t = ( + θ + θ σ, 8
9 4. Moving Averge Processes γ = Cov (, Z Cov θ t = ( t t θ t, t θ t θ t 3 = Cov( θ t, t + Cov( θ t, θ t = [ θ + ( θ ( θ ]σ = ( θ + θ θ σ nd γ = Cov, = Cov ( θ t t θ t, t θ t 3 θ t 4 = Cov( θ t, t = θ σ Thus for n MA( process, θ + θ θ ρ = θ + θ ρ = θ θ + θ ρ k = for k = 3, 4,... (4..3 For the specific cse = t t +.6 t, we hve + ( (.6.6 ρ = ( + (.6 = = nd.6 ρ = = A time plot of simultion of this MA( process is shown in Exhibit (4.9. The series tends to move bck nd forth cross the men in one time unit. This reflects the firly strong negtive uotcorreltion t lg. Once more, horizontl reference line t the theoreticl process men of zero is shown. 9
10 Chpter 4 Models for Sttionry Time Series Exhibit 4.9 Time Plot of n MA( Process with θ = nd θ = Z(t Time 8 The plot in Exhibit (4. reflects tht negtive utocorreltion quite drmticlly. Exhibit 4. Plot of Z(t versus Z(t- for MA( Series in Exhibit ( Z(t Z(t The wek postive sutocorreltion t lg two is displyed in Exhibit (4..
11 4. Moving Averge Processes Exhibit 4. Plot of Z(t versus Z(t- for MA( Series in Exhibit ( Z(t Z(t Finlly, the lck of utocorreltion t lg three is pprent from the sctterplot in Exhibit (4.. Exhibit 4. Plot of Z(t versus Z(t-3 for MA( Series in Exhibit ( Z(t Z(t The Generl MA(q Process For the generl MA(q process, clcultions show tht nd = t θ t θ t θ q t q, similr γ = ( + θ + θ + + θ q σ θ k + θ θ k + + θ θ k θ q k θ q for k =,,..., q ρ k = + θ + θ + + θ q for k> q (4..4 (4..5
12 Chpter 4 Models for Sttionry Time Series where the numertor of ρ k is just θ q. The utocorreltion function cuts off fter lg q, tht is, it is zero. Its shpe cn be most nything for the erlier lgs. Another type of process, the utoregressive process, provides models for lternte utocorreltion ptterns. 4.3 Autoregressive Processes Autoregressive processes re s their nme suggests regressions on themselves. Specificly, pth-order utoregressive process { } stisfies the eqution = φ Z + t φ Z + t + φ p Z + t p t (4.3. The current vlue of the series is liner combintion of the p most recent pst vlues of itself plus n innovtion term t which incorportes everything new in the series t time t tht is not explined by the pst vlues. Thus for every t we ssume tht t is independent of,, 3,... Yule (97 crried out the originl work on utoregressive processes. The First-Order Autoregressive Process Agin, it is instructive to consider the first-order model, bbrevited AR(, in detil. Assume the series is sttionry nd stisfies = φ + t (4.3. where we hve dropped the subscript from the coeffient φ for simplicity. As usul, in these initil chpters we ssume tht the process men hs been subtrcted out so tht the the series men is zero. The conditions for sttionrity will be considered lter. We first tke vrinces of both sides of Eqution (4.3. nd obtin γ = φ γ + σ Solving for γ yields σ γ = (4.3.3 φ Notice the immedite impliction tht φ < or tht φ <. Now tke Eqution (4.3., multiply both sides by k (k =,,..., nd tke expected vlues. EZ ( t k Z t = φez ( t Z k t + E ( t k or γ k = φγ k + E ( t k Since the series is ssumed to be sttionry with zero men, nd since t is independent of k, we obtin E ( t Z E t k = ( EZ ( t t k =
13 4.3 Autoregressive Processes nd so γ k = φγ k for k =,, 3,... (4.3.4 Setting k =, we get γ = φγ = φσ ( φ. With k =, we obtin γ = φ σ ( φ. Now it is esy to see tht in generl γ k φ k σ = (4.3.5 φ nd thus γ k ρ k = ---- = φ k for k =,, 3,... (4.3.6 γ Since φ <, the mgnitude of the utocorreltion function decreses exponentilly s the number of lgs, k, increses. If < φ <, ll correltions re positive; if < φ <, the lg utocorreltion is negtive (ρ = φ nd the signs of successive utocorreltions lternte from positive to negtive with their mgnitudes decresing exponentilly. Portions of the grphs of severl utocorreltion functions re displyed in Exhibit (4.3 3
14 Chpter 4 Models for Sttionry Time Series Exhibit 4.3 Autocorreltion Functions for Severl AR( Models..8 φ =.9..8 φ = ρ k ρ k Lg Lg 8 9. φ =.7.5 ρ k Lg Notice tht for φ ner ±, the exponentil decy is quite slow (for exmple, (.9 6 =.53, but for smller φ the decy is quite rpid (for exmple, (.4 6 =.4. With φ ner ±, the strong correltion will extend over mny lgs nd produce reltively smooth series if φ is positive nd very jgged series if φ is negtive. Exhibit (4.4 displys the time plot of simulted AR( process with φ =.9. Notice how infrequently the series crosses its zero theoreticl men. There is lot of inerti in the series it hngs together remining on the sme side of the men for extended periods. An observer might clim tht the series hs severl trends. We know tht, in fct, the theoreticl men is zero for ll time points. The illusion of trends is due to the strong utocorreltion of neighboring vlues of the series. 4
15 4.3 Autoregressive Processes Exhibit 4.4 Time Plot of n AR( Series with φ = Z(t Time The smoothness of the series nd the strong utocorreltion t lg is depicted in the lg plot shown in Exhibit (4.5. Exhibit 4.5 Plot of Z(t versus Z(t- for AR( Series of Exhibit ( Z(t Z(t- This AR( model lso hs strong, positive utocorreltion t lg, nmely ρ = (.9 =.8. Exhibit (4.6 shows this quite well. 5
16 Chpter 4 Models for Sttionry Time Series Exhibit 4.6 Plot of Z(t versus Z(t- for AR( Series of Exhibit ( Z(t Z(t- Finlly, t lg three the utocorreltion is still quite high: ρ 3 = (.9 3 =.79. Exhibit (4.7 confirms this for this prticulr series. Exhibit 4.7 Plot of Z(t versus Z(t-3 for AR( Series of Exhibit ( Z(t Z(t-3 The Generl Liner Process Version of the AR( Model The recursive definition of the AR( process given in Eqution (4.3. is extremely useful for interprettion of the model. For other purposes it is convenient to express the AR( model s generl liner process s in Eqution (4... The recursive definition is vlid for ll t. If we use this eqution with t replced by t, we get = φ + t. Substituting this into the originl expression gives 6
17 4.3 Autoregressive Processes = φφz ( t + t + t = t + φ t + φ If we repet this substitution into the pst, sy k times, we get = t + φ t + φ t + + φ k t k+ + φ k k (4.3.7 Assuming φ < nd letting k increse without bound, it seems resonble (this is lmost rigorous proof tht we should obtin the infinite series representtion = + t φ + t φ + t φ 3 + t 3 (4.3.8 This is in the form of the generl liner process of Eqution (4.. with ψ j = φ j which we lredy investigted in Section 4. on pge. Note tht this representtion reemphsizes the need for the restriction φ <. Sttionrity of n AR( Process It cn be shown tht, subject to the restriction tht t be independent of,, 3,... nd tht σ >, the solution of AR( defining recursion = φ + t will be sttionry if, nd only if, φ <. The requirement φ < is usully clled the sttionrity condition for the AR( process [See Box, Jenkins, nd Reinsel (994, p. 54, Nelson, 973, p. 39, nd Wei (99, p. 3] even though more thn sttionrity is involved. See lso Exercises (4.6, (4.8, nd (4.5. At this point we should note tht the utocorreltion function for the AR( process hs been derived in two different wys. The first method used the generl liner process representtion leding up to Eqution (4..3. The second method used the defining recursion = φ + t nd the development of Equtions (4.3.4, (4.3.5, nd ( A third derivtion is obtined by multiplying both sides of Eqution (4.3.7 by k, tking expected vlues of both sides, nd using the fct tht t, t, t,..., t (k re independent of k. The second method should be especilly noted since it will generlize nicely to higher-order processes. The Second-Order Autoregressive Process Now consider the series stisfying = φ + φ + t (4.3.9 where, s usul, we ssume tht t is independent of,, 3,... To discuss sttionrity we introduce the AR chrcteristic polynomil φ( x = φ x φ x nd the corresponding AR chrcteristic eqution 7
18 Chpter 4 Models for Sttionry Time Series φ x φ x = We recll tht qudrtic eqution lwys hs two roots (possibly complex. Sttionrity of the AR( Process It my be shown tht, subject to the condition tht t is independent of,, 3,..., sttionry solution to Eqution (4.3.9 exists if, nd only if, the roots of the AR chrcteristic eqution exceed in bsolute vlue (modulus. We sometimes sy tht the roots should lie outside the unit circle in the complex plne. This sttement will generlize to the pth-order cse without chnge. In the second order cse the roots of the qudrtic chrcteristic eqution re esily found to be φ ± φ + 4φ (4.3. φ For sttionrity we require tht these roots exceed in bsolute vlue. In Appendix A we show tht this will be true if, nd only if, three conditions re stisfied: φ + φ <, φ φ <, nd φ < (4.3. As with the AR( model, we cll these the sttionrity conditions for the AR( model. This sttionrity region is displyed in Exhibit (4.8. It lso pplies in the first-order cse, where the AR chrcteristic eqution is just φx = with root /φ, which exceeds one in bsolute vlue if nd only if φ <. 8
19 4.3 Autoregressive Processes Exhibit 4.8 Sttionrity Region for AR( Process Prmeters rel roots φ + 4φ = φ complex roots φ The Autocorreltion Function for the AR( Process To derive the utocorreltion function for the AR( cse, we tke the defining recursive reltionship of Eqution (4.3.9, multiply both sides by k, nd tke expecttions. Assuming sttionrity, zero mens, nd tht t is independent of k, we get γ k = φ γ k + φ γ k for k =,, 3,... (4.3. or, dividing through by γ, ρ k = φ ρ k + φ ρ k for k =,, 3,... (4.3.3 Equtions (4.3. nd/or (4.3.3 re usully clled the Yule-Wlker equtions especilly the set of two equtions obtined for k = nd. Setting k = nd using ρ = nd ρ = ρ, we get ρ = φ + φ ρ nd so φ ρ = (4.3.4 φ Using the now known vlues for ρ (nd ρ, Eqution (4.3.3 cn be used with k = to obtin ρ = φ ρ + φ ρ φ (4.3.5 ( φ + φ = φ Successive vlues of ρ k my be esily clculted numericlly from the recursive reltionship of Eqution ( Although Eqution (4.3.3 is very efficient for clculting utocorreltion vlues numericlly from given vlues of φ nd φ, for other purposes it is desirble to hve more explicit formul for ρ k. The form of the explicit solution depends criticlly on the 9
20 Chpter 4 Models for Sttionry Time Series roots of the chrcteristic eqution φ x φ x =. Denoting the reciprocls of these roots by G nd G, it is shown in Appendix A tht For the cse φ φ + 4φ φ + φ + 4φ G = nd G = G G, it cn be shown tht we hve ( G Gk + ( G Gk + ρ k = for k =,,,... ( G G ( + G G (4.3.6 If the roots re complex, tht is, if φ + 4φ <, then ρ k my be rewritten s ρ k R k sin( Θk + Φ = for k =,,,... (4.3.7 sin( Φ where R = φ, nd Θ nd Φ re defined by cos( Θ = φ ( φ, nd tn( Φ = [( φ ( + φ ]. For completeness we note tht if the roots re equl, ( φ + 4φ =, then we hve + φ ρ k k φ k = for k =,,,... (4.3.8 φ A good discussion of the derivtions of these formuls cn be found in Fuller (9XX, Sections XX The specific detils of these formuls re of little importnce to us. We need only note tht the utocorreltion function cn ssume wide vriety of shpes. In ll cses, the mgnitude of ρ k dies out exponentilly fst s the lg k increses. In the cse of complex roots, ρ k displys dmped sine wve behvior with dmping fctor R, R <, frequency Θ, nd phse Φ. Illustrtions of the possible shpes re given in Exhibit (4.9.
21 4.3 Autoregressive Processes Exhibit 4.9 Autocorreltion Functions for Severl AR( Models. φ =.5, φ =.5. φ =., φ = ACF.5 ACF Lg Lg..75 φ =.5, φ = φ =., φ = ACF.5 ACF Lg Lg Exhibit (4. displys the time plot of simulted AR( series with φ =.5 nd φ =.75. The periodic behvior of ρ k shown in Exhibit (4.9 is clerly reflected in the nerly periodic behvior of the series with the sme period of 36/3 = time units.
22 Chpter 4 Models for Sttionry Time Series Exhibit 4. Time Plot of n AR( Series with φ =.5 nd φ =.75 5 Series Time The Vrince for the AR( Model The process vrince γ cn be expressed in terms of the model prmeters φ, φ, nd σ s follows: Tking the vrince of both sides of Eqution (4.3.9 yields γ = ( φ + φ γ + φ φ γ + σ (4.3.9 Setting k = in Eqution (4.3. gives second liner eqution γ nd γ, γ = φ γ + φ γ, which cn be solved simultneously with Eqution (4.3.9 to obtin ( φ σ γ = ( φ ( φ φ φ φ (4.3. φ σ = φ ( φ φ The ψ-coefficients for the AR( Model The ψ-coefficients in the generl liner process representtion for n AR( series re more complex thn for the AR( cse. However, we cn substitute the generl liner process representtion using Eqution (4.. for, for, nd for into
23 4.3 Autoregressive Processes = φ + φ + t. If we then equte coefficients of j we get the recursive reltionships ψ = ψ φ ψ = (4.3. ψ j φ ψ j φ ψ j = for j =, 3,... These my be solved recursively to obtin ψ =, ψ = φ, ψ = φ + φ, nd so on. These reltionships provide excellent numericl solutions for the ψ-coefficients for given numericl vlues of φ nd φ. One cn lso show tht for G G n explcit solution is Gj + ψ Gj + j = (4.3. G G where, s before, G nd G re the reciprocls of the roots of the AR chrcteristic eqution. If the roots re complex Eqution (4.3. my be rewritten s ψ j R j sin( ( j + Θ = , (4.3.3 sin( Θ dmped sine wve with the sme dmping fctor R nd frequency Θ, s in Eqution (4.3.7 for the utocorreltion function. For completeness, we note tht if the roots re equl then ψ j = ( + jφj (4.3.4 The Generl Autoregressive Process Consider now the pth-order utoregressive model = φ Z + t φ Z + t + φ p Z + t p t (4.3.5 with AR chrcteristic polynomil φ( x = φ x φ x φ p x p (4.3.6 nd corresponding AR chrcteristic eqution φ x φ x φ p x p = (4.3.7 As noted erlier, ssuming tht t is independent of,, 3,..., sttionry solution to Eqution (4.3.7 exists if, nd only if, the p roots of the AR chrcteristic eqution exceed in bsolute vlue (modulus. Numericlly finding the roots of pth degree polynomil is nontrivil tsk, but simple lgorithm bsed on Schur s Theorem cn be used to check on the sttionrity condition without ctully finding the roots. See Appendix XX. Other reltionships between polynomil roots nd coefficients my be used to show tht the following two inequlities re neccesry for sttionrity. Tht is, for the roots to be greter thn in modulus it must be true tht both: 3
24 Chpter 4 Models for Sttionry Time Series φ + φ + + φ p < nd φ p < (4.3.8 Assuming sttionrity nd zero mens we my multiply Eqution (4.3.5 by k, tke expecttions, nd obtin the importnt recursive reltionship ρ k = φ ρ k + φ ρ k + + φ p ρ k p for k (4.3.9 Putting k =,,..., p into Eqution (4.3.9 nd using ρ = nd ρ k = ρ k, we get the generl Yule-Wlker equtions ρ = φ + φ ρ + φ 3 ρ + + φ p ρ p ρ = φ ρ + φ ρ + φ 3 ρ φ p ρ p (4.3.3 ρ p = φ ρ p φ ρ p φ 3 ρ p 3 φ p Given numericl vlues for φ, φ,..., φ p, these liner equtions cn be solved to obtin numericl vlues for ρ, ρ,..., ρ p. Then Eqution (4.3.9 cn be used to obtin numericl vlues for ρ k t ny number of higher lgs. Noting tht E ( t = E [ t ( φ φ φ p p t ] = E ( t σ we my multiply Eqution (4.3.5 by, tke expecttions, nd find which, using ρ k = γ k /γ, cn be written s = γ = φ γ + φ γ + + φ p γ p + σ σ γ = φ ρ φ ρ φ p ρ p (4.3.3 nd express the process vrince γ in terms of the prmeters σ, φ, φ,..., φ p, nd the now-known vlues of ρ, ρ,..., ρ p. Of course, explicit solutions for ρ k re essentilly impossible in this generllity but we cn sy tht ρ k will be liner combintion of exponentilly decying terms (corresponding to the rel roots of the chrcteristic eqution nd dmped sine wve terms (corresponding to the complex roots of the chrcteristic eqution. Assuming sttionrity, the process cn lso be expressed in the generl liner process form of Eqution (4.., but the ψ-coefficients re complicted functions of the prmeters φ, φ,..., φ p. The coefficients cn be found numericlly: see XXXXX. 4
25 4.4 The Mixed Autoregressive-Moving Averge Model 4.4 The Mixed Autoregressive-Moving Averge Model If we ssume tht the series is prtly utoregressive nd prtly moving verge, we obtin quite generl time series model. In generl, if = φ Z + t φ Z + t + φ p Z + t p t θ t θ t (4.4. θ q t q we sy tht { } is mixed utoregressive-moving verge process of orders p nd q, respectively; we bbrevite the nme to ARMA(p,q. As usul, we discuss n importnt specil cse first. The ARMA(, Model The defining eqution cn be written = φ + t θ t To derive Yule-Wlker type equtions, we first note tht E ( t = E [ t ( φ + t θ t ] = σ nd E ( t = E [ t ( φ + t θ t ] = φσ θσ (4.4. = ( φ θσ If we multiply Eqution (4.4. by k nd tke expecttions, we hve γ = φγ + [ θφ ( θ ]σ γ = φγ θσ (4.4.3 γ k = φγ k for k Solving the first two equtions yields ( φθ + θ γ = σ (4.4.4 φ nd solving the simple recursion gives ( θφ ( φ θ ρ k = (4.4.5 θφ θ φ k for k + Note tht this utocorreltion function decys exponentilly s the lg k increses. The dmping fctor is φ, but the decy strts from initil vlue ρ, which lso depends on θ. This is in contrst to the AR( utocorreltion, which lso decys with dmping fctor is φ, but lwys from initil vlue ρ =. For exmple, if φ =.8 nd θ =.4, then 5
26 Chpter 4 Models for Sttionry Time Series ρ =.53, ρ =.48, ρ 3 =.335 nd so on. Severl shpes for ρ k re possible, depending on the sign of ρ nd the sign of φ. The generl liner process form of the model cn be obtined in the sme mnner tht led to Eqution ( We find tht is, = t + ( φ θ φ j t j, (4.4.6 j = ψ j = ( φ θφ j for j We should now mention the obvious sttionrity condition φ, or equivlently, the root of the AR chrcteristic eqution φx = must exceed unity in bsolute vlue. For the generl ARMA(p,q model, we stte the following fcts without proof: Subject to the condition tht t is independent of,, 3,..., sttionry solution to Eqution (4.4. exists, if, nd only if, ll the roots of the AR chrcteristic eqution φ(x = exceed unity in modulus. If the sttionrity conditions re stisfied, then the model cn lso be written s generl liner process with ψ-coefficients determined from ψ = ψ = θ + φ ψ = θ + φ + φ ψ ψ j = θ j + φ p ψ j p + φ p ψ j p+ + + φ ψ j where we tke ψ j = for j < nd θ j = for j > q. (4.4.7 Agin ssuming sttionrity, the utocorreltion function cn esily be shown to stisfy ρ k = φ ρ k + φ ρ k + + φ p ρ k p for k > q (4.4.8 Similr equtions cn be developed for k =,, 3,..., q tht involve θ, θ,..., θ q. An lgorithm suitble for numericl computtion of the complete utocorreltion function in given in Appendix XX. 4.5 Invertibility We hve seen tht for the MA( process we get excty the sme utocorreltion function if θ is replced by /θ. In the exercises we find similr problem with nonuniqueness for the MA( model. This lck of uniqueness of MA models given their utocorreltion functions must be ddressed before we try to infer the vlues of 6
27 4.5 Invertibility prmeters from observed time series. It turns out tht this nonuniqueness is relted to the seemingly unrelted question stted next. An utoregressive process cn lwys be reexpressed s generl liner process through the ψ-coefficients so tht n AR process my lso be thought of s n infinite-order moving verge process. However, for some purposes the utoregressive representtions re lso convenient. Cn moving verge model be reexpressed s n utoregression? To fix ides, consider n MA( model: = t θ t (4.5. First rewriting this s t = + θ t nd then replcing t by t nd substituting for t bove, we get t = + θ( + θ t = + θ + θ t If θ <, we my continue this substitution infinitely into the pst nd obtin the expression [compre with Equtions (4.3.7 nd (4.3.8.] t = Z + t θz + t θ Z + t or = ( θ θ θ t (4.5. If θ <, we see tht the MA( model cn be inverted into n infinite-order utoregressive model. We sy tht the MA( model is inverible if, nd only if, θ <. For generl MA(q or ARMA(p,q model, we define the MA chrcteristic polynomil s θ( x = θ x θ x θ 3 x 3 θ q x q (4.5.3 nd the corresponding MA chrcteristic eqution θ x θ x θ 3 x 3 θ q x q = (4.5.4 It cn be shown tht the MA(q model is invertible, tht is, there re coefficients π j such tht = π Z + t π Z + t π 3 Z + t 3 + t (4.5.5 if, nd only if, the roots of the MA chrcteristic eqution exceed in modulus. (Compre with sttionrity of n AR model. It my lso be shown tht there is only one set of prmeter vlues tht yield n invertible MA process with given utocorreltion function. For exmple, = t + t nd = t +(/ t both hve the sme utocorreltion function but only the second one with root is invertible. From here on we will resrict our ttention to the phsyiclly sensible clss of invertible models. For generl ARMA(p,q model we require both sttionrity nd invertibility. 7
28 Chpter 4 Models for Sttionry Time Series Chpter 4 Exercises 4. Find the utocorreltion function for the sttionry process defined by = 5 + t -- t t 4. Sketch the utocorreltion functions for the following MA( models with prmeters s specified: ( θ =.5 nd θ =.4 (b θ =. nd θ =.7 (c θ = nd θ = Verify tht for n MA( process mx ρ < θ< =.5 nd min ρ < θ< 4.4 Show tht when θ is replced by /θ the utocorreltion function for n MA( process does not chnge. 4.5 Clculte nd sketch the utocorreltion functions for ech of the following AR( models. Use sufficient lgs tht the utocorreltion function hs nerly died out. ( φ =.6 (b φ =.6 (c φ =.95 (Do out to lgs. (d φ = Suppose tht { } is n AR( process with < φ < +. ( Find the utocovrince function for W t = = in terms of φ nd σ. (b In prticulr, show tht Vr(W t = σ /(+φ Describe the importnt chrcteristics of the utocorreltion function for the following models: ( MA(, (b MA(, (c AR(, (d AR(, nd (e ARMA(,. 4.8 Let { } be n AR( process of the specil form = φ + t. Use first principles to find the rnge of vlues of φ for which the process is sttionry. = 8
29 4.5 Invertibility 4.9 Use the recursive formul of Eqution (4- to clculte nd then sketch the utocorreltion functions for the following AR( models with prmeters s specified. In ech cse specify whether the roots of the chrcteristic eqution re rel or complex. If complex, find the dmping fctor, R, nd frequency, Θ, for the corresponding utocorreltion function when expressed s in Eqution (4-4. ( φ =.6 nd φ =.3 (b φ =.4 nd φ =.5 (c φ =. nd φ =.7 (d φ = nd φ =.6 (e φ =.5 nd φ =.9 (f φ =.5 nd φ =.6 4. Sketch the utocorreltion functions for ech of the following ARMA models: ( ARMA(, with φ =.7 nd θ =.4. (b ARMA(, with φ =.7 nd θ = For the ARMA(, model =.8 + t +.7 t +.6 t show tht ( ρ k =.8ρ k for k >. (b ρ =.8ρ +.6 σ /γ. 4. Consider two MA( processes, one with θ = θ = /6 nd nother with θ = nd θ = 6. ( Show tht these processes hve the sme utocorreltion function. (b How do the roots of the corresponding chrcteristic polynomils compre? 4.3 Let { } be sttionry process with ρ k = for k >. Show tht we must hve ρ.5. (Hint: Consider Vr(Z n+ + Z n Z nd then Vr(Z n+ Z n + Z n...± Z. Use the fct tht both of these must be nonnegtive for ll n. 4.4 Suppose tht { } is zero men, sttionry process with ρ <.5 nd ρ k = for k >. Show tht { } must be representble s n MA( process. Tht is, show tht there is white noise sequence { t } such tht = t θ t where ρ is correct nd t is uncorrelted with k for k >. (Hint: Choose θ such tht θ < nd ρ = θ/(+θ ; then let t = θ j Z. If we ssume tht { } is norml j = t j process, t will lso be norml nd zero correltion is equivlent to independence. 4.5 Consider the AR( model = φ + t. Show tht if φ = the process cnnot be sttionry. (Hint: Tke vrinces of both sides. 9
30 Chpter 4 Models for Sttionry Time Series 4.6 Consider the nonsttionry AR( model = 3 + t. ( Show tht = -- stisfies the AR( eqution. 3 j j = t + j (b Show tht the process defined in prt ( is sttionry. (c In wht wy is this solution unstisfctory? 4.7 Consider process tht stisfies the AR( eqution =.5 + t. ( Show tht = (.5 t + t +.5 t + (.5 t + is solution of the AR( eqution. (b Is the solution given in prt ( sttionry? 4.8 Consider process tht stisfies the zero-men, sttionry AR( eqution = φ + t with <φ<+. Let c be ny non-zero constnt nd define Y t = + cφ t. ( Show tht E(Y t = cφ t so tht {Y t } is nonsttionry. (b Show tht {Y t } stisfies the sttionry AR( eqution Y t = φy t + t. (c Is {Y t } sttionry? 4.9 Consider n MA(6 model with θ =.5, θ =.5, θ 3 =.5, θ 4 =.65, θ 5 =.35, nd θ 6 =.565. Find much simpler model tht nerly the sme ψ weights. 4. Consider n MA(7 model with θ =, θ =.5, θ 3 =.5, θ 4 =.5, θ 5 =.65, θ 6 =.35, nd θ 7 =.565. Find much simpler model tht nerly the sme ψ weights. 4. Consider the model = t t +.5 t 3. ( Find the utocovrince function for this process. (b Show tht this certin ARMA(p,q process in disguise. Tht is, identify vlues for p nd q, nd for the θ s nd φ s such tht the ARMA(p,q process hs the sme sttisticl properties s { }. 4. Show tht the sttement The roots of φ x φ x φ p x p = re greter thn in bsolute vlue is equivlent to the sttement The roots of x p φ x p φ x p φ p = re less thn in bsolute vlue. (Hint: If G is root of one eqution, is /G root of the other? 4.3 Suppose tht { } is n AR( process with ρ = φ. Define the sequence {b t } s b t = φ+. ( Show tht Cov(b t,b t k = for ll t nd k. (b Show tht Cov(b t,+k = for ll t nd k >. 3
31 4.5 Invertibility 4.4 Let { t } be zero men, unit vrince white noise process. Consider process tht begins t time t = nd is defined recursively s follows. Let Z = c nd Z = c Z +. Then let = φ + φ + t for t > s in n AR( process. ( Show tht the process men is zero. (b For prticulr vlues of φ nd φ within the sttionrity region for n AR( model, show how to choose c nd c so tht both Vr(Z = Vr(Z nd the lg utocorreltion between Z nd Z mtches tht of sttionry AR( process with prmeters φ nd φ. (c Once the process { } is generted, show how to trnsform it to new process tht hs ny desired men nd vrince. (This exercise suggests convenient method for simulting sttionry AR( processes. 4.5 Consider n AR( process stisfying = φ + t where φ cn be ny number nd { t } is white noise process such tht t is independent of the pst {,, }. Let Z be rndom vrible with men µ nd vrince σ. ( Show tht for t > we cn write = t + φ t + φ t + φ 3 t φ t + φ t Z. (b Show tht for t > we hve E( = φ t µ. (c Show tht for t > Vr( = φ t φ σ + φ t σ for φ tσ + σ for φ = (d Suppose now tht µ =. Argue tht, if { } is sttionry, we must hve φ. (e Continuing to suppose tht µ =, show tht, if { } is sttionry, then Vr( = σ ( φ nd so we must hve φ <. Appendix A: The Sttionrity Region for n AR( Process In the second order cse the roots of the qudrtic chrcteristic polynomil re esily found to be φ ± φ + 4φ (4.A. φ For sttionrity we require tht these roots exceed in bsolute vlue. We now show tht this will be true if, nd only if, three conditions re stisfied: 3
32 Chpter 4 Models for Sttionry Time Series φ + φ <, φ φ <, nd φ < Proof: Let the reciprocls of the roots be denoted G nd G. Then (4.A. φ G = = φ φ + 4φ φ φ φ + 4φ φ + φ + 4φ φ + φ + 4φ = φ ( φ + φ + 4φ φ ( φ + 4φ = φ φ + 4φ φ + φ + 4φ Similrly, G = We now divide the proof into two cses corresponding to rel nd complex roots. The roots will be rel if, nd only if, φ + 4φ. I. Rel Roots: G i < for i = nd if, nd only if, or φ φ + 4φ φ + φ + 4φ < < < < φ φ + 4φ < φ + φ + 4φ <. Consider just the first inequlity. Now < φ φ + 4φ if, nd only if, φ + 4φ < φ + if, nd only if, φ + 4φ < φ + 4φ + 4, if, nd only if, φ < φ +, or φ φ <. The inequlity φ + φ + 4φ < is treted similrly nd leds to φ + φ <. These equtions together with φ + 4φ define the sttionrity region for the rel root cse shown in Exhibit (4.8. II. Complex Roots: Now φ + 4φ <. Here G nd G will be complex conjugtes nd G = G < if, nd only if, G <. But G = ( φ + ( φ 4φ 4 = φ so tht φ >. This together with the inequlity φ + 4φ < defines the prt of the sttionrity region for complex roots shown in Exhibit (4.8 nd estblishes Eqution (4.3.. This completes the proof. 3
How do we solve these things, especially when they get complicated? How do we know when a system has a solution, and when is it unique?
XII. LINEAR ALGEBRA: SOLVING SYSTEMS OF EQUATIONS Tody we re going to tlk bout solving systems of liner equtions. These re problems tht give couple of equtions with couple of unknowns, like: 6 2 3 7 4
More information20 MATHEMATICS POLYNOMIALS
0 MATHEMATICS POLYNOMIALS.1 Introduction In Clss IX, you hve studied polynomils in one vrible nd their degrees. Recll tht if p(x) is polynomil in x, the highest power of x in p(x) is clled the degree of
More informationChapter 2 Fundamental Concepts
Chpter 2 Fundmentl Concepts This chpter describes the fundmentl concepts in the theory of time series models In prticulr we introduce the concepts of stochstic process, men nd covrince function, sttionry
More informationARITHMETIC OPERATIONS. The real numbers have the following properties: a b c ab ac
REVIEW OF ALGEBRA Here we review the bsic rules nd procedures of lgebr tht you need to know in order to be successful in clculus. ARITHMETIC OPERATIONS The rel numbers hve the following properties: b b
More informationThe Regulated and Riemann Integrals
Chpter 1 The Regulted nd Riemnn Integrls 1.1 Introduction We will consider severl different pproches to defining the definite integrl f(x) dx of function f(x). These definitions will ll ssign the sme vlue
More informationMath 1B, lecture 4: Error bounds for numerical methods
Mth B, lecture 4: Error bounds for numericl methods Nthn Pflueger 4 September 0 Introduction The five numericl methods descried in the previous lecture ll operte by the sme principle: they pproximte the
More informationTHE EXISTENCE-UNIQUENESS THEOREM FOR FIRST-ORDER DIFFERENTIAL EQUATIONS.
THE EXISTENCE-UNIQUENESS THEOREM FOR FIRST-ORDER DIFFERENTIAL EQUATIONS RADON ROSBOROUGH https://intuitiveexplntionscom/picrd-lindelof-theorem/ This document is proof of the existence-uniqueness theorem
More informationPolynomial Approximations for the Natural Logarithm and Arctangent Functions. Math 230
Polynomil Approimtions for the Nturl Logrithm nd Arctngent Functions Mth 23 You recll from first semester clculus how one cn use the derivtive to find n eqution for the tngent line to function t given
More information7.2 The Definite Integral
7.2 The Definite Integrl the definite integrl In the previous section, it ws found tht if function f is continuous nd nonnegtive, then the re under the grph of f on [, b] is given by F (b) F (), where
More informationChapter 4 Contravariance, Covariance, and Spacetime Diagrams
Chpter 4 Contrvrince, Covrince, nd Spcetime Digrms 4. The Components of Vector in Skewed Coordintes We hve seen in Chpter 3; figure 3.9, tht in order to show inertil motion tht is consistent with the Lorentz
More informationSection 6.1 INTRO to LAPLACE TRANSFORMS
Section 6. INTRO to LAPLACE TRANSFORMS Key terms: Improper Integrl; diverge, converge A A f(t)dt lim f(t)dt Piecewise Continuous Function; jump discontinuity Function of Exponentil Order Lplce Trnsform
More informationp-adic Egyptian Fractions
p-adic Egyptin Frctions Contents 1 Introduction 1 2 Trditionl Egyptin Frctions nd Greedy Algorithm 2 3 Set-up 3 4 p-greedy Algorithm 5 5 p-egyptin Trditionl 10 6 Conclusion 1 Introduction An Egyptin frction
More informationUNIFORM CONVERGENCE. Contents 1. Uniform Convergence 1 2. Properties of uniform convergence 3
UNIFORM CONVERGENCE Contents 1. Uniform Convergence 1 2. Properties of uniform convergence 3 Suppose f n : Ω R or f n : Ω C is sequence of rel or complex functions, nd f n f s n in some sense. Furthermore,
More informationThe First Fundamental Theorem of Calculus. If f(x) is continuous on [a, b] and F (x) is any antiderivative. f(x) dx = F (b) F (a).
The Fundmentl Theorems of Clculus Mth 4, Section 0, Spring 009 We now know enough bout definite integrls to give precise formultions of the Fundmentl Theorems of Clculus. We will lso look t some bsic emples
More informationMath& 152 Section Integration by Parts
Mth& 5 Section 7. - Integrtion by Prts Integrtion by prts is rule tht trnsforms the integrl of the product of two functions into other (idelly simpler) integrls. Recll from Clculus I tht given two differentible
More informationW. We shall do so one by one, starting with I 1, and we shall do it greedily, trying
Vitli covers 1 Definition. A Vitli cover of set E R is set V of closed intervls with positive length so tht, for every δ > 0 nd every x E, there is some I V with λ(i ) < δ nd x I. 2 Lemm (Vitli covering)
More informationGoals: Determine how to calculate the area described by a function. Define the definite integral. Explore the relationship between the definite
Unit #8 : The Integrl Gols: Determine how to clculte the re described by function. Define the definite integrl. Eplore the reltionship between the definite integrl nd re. Eplore wys to estimte the definite
More informationHow do we solve these things, especially when they get complicated? How do we know when a system has a solution, and when is it unique?
XII. LINEAR ALGEBRA: SOLVING SYSTEMS OF EQUATIONS Tody we re going to tlk out solving systems of liner equtions. These re prolems tht give couple of equtions with couple of unknowns, like: 6= x + x 7=
More informationLecture 1. Functional series. Pointwise and uniform convergence.
1 Introduction. Lecture 1. Functionl series. Pointwise nd uniform convergence. In this course we study mongst other things Fourier series. The Fourier series for periodic function f(x) with period 2π is
More informationImproper Integrals, and Differential Equations
Improper Integrls, nd Differentil Equtions October 22, 204 5.3 Improper Integrls Previously, we discussed how integrls correspond to res. More specificlly, we sid tht for function f(x), the region creted
More informationAdvanced Calculus: MATH 410 Notes on Integrals and Integrability Professor David Levermore 17 October 2004
Advnced Clculus: MATH 410 Notes on Integrls nd Integrbility Professor Dvid Levermore 17 October 2004 1. Definite Integrls In this section we revisit the definite integrl tht you were introduced to when
More informationRecitation 3: More Applications of the Derivative
Mth 1c TA: Pdric Brtlett Recittion 3: More Applictions of the Derivtive Week 3 Cltech 2012 1 Rndom Question Question 1 A grph consists of the following: A set V of vertices. A set E of edges where ech
More informationf(x) dx, If one of these two conditions is not met, we call the integral improper. Our usual definition for the value for the definite integral
Improper Integrls Every time tht we hve evluted definite integrl such s f(x) dx, we hve mde two implicit ssumptions bout the integrl:. The intervl [, b] is finite, nd. f(x) is continuous on [, b]. If one
More informationImproper Integrals. Type I Improper Integrals How do we evaluate an integral such as
Improper Integrls Two different types of integrls cn qulify s improper. The first type of improper integrl (which we will refer to s Type I) involves evluting n integrl over n infinite region. In the grph
More informationReview of Calculus, cont d
Jim Lmbers MAT 460 Fll Semester 2009-10 Lecture 3 Notes These notes correspond to Section 1.1 in the text. Review of Clculus, cont d Riemnn Sums nd the Definite Integrl There re mny cses in which some
More informationNumerical Analysis: Trapezoidal and Simpson s Rule
nd Simpson s Mthemticl question we re interested in numericlly nswering How to we evlute I = f (x) dx? Clculus tells us tht if F(x) is the ntiderivtive of function f (x) on the intervl [, b], then I =
More informationPhysics 116C Solution of inhomogeneous ordinary differential equations using Green s functions
Physics 6C Solution of inhomogeneous ordinry differentil equtions using Green s functions Peter Young November 5, 29 Homogeneous Equtions We hve studied, especilly in long HW problem, second order liner
More informationModule 6: LINEAR TRANSFORMATIONS
Module 6: LINEAR TRANSFORMATIONS. Trnsformtions nd mtrices Trnsformtions re generliztions of functions. A vector x in some set S n is mpped into m nother vector y T( x). A trnsformtion is liner if, for
More informationMIXED MODELS (Sections ) I) In the unrestricted model, interactions are treated as in the random effects model:
1 2 MIXED MODELS (Sections 17.7 17.8) Exmple: Suppose tht in the fiber breking strength exmple, the four mchines used were the only ones of interest, but the interest ws over wide rnge of opertors, nd
More informationDuality # Second iteration for HW problem. Recall our LP example problem we have been working on, in equality form, is given below.
Dulity #. Second itertion for HW problem Recll our LP emple problem we hve been working on, in equlity form, is given below.,,,, 8 m F which, when written in slightly different form, is 8 F Recll tht we
More informationMath 113 Fall Final Exam Review. 2. Applications of Integration Chapter 6 including sections and section 6.8
Mth 3 Fll 0 The scope of the finl exm will include: Finl Exm Review. Integrls Chpter 5 including sections 5. 5.7, 5.0. Applictions of Integrtion Chpter 6 including sections 6. 6.5 nd section 6.8 3. Infinite
More informationProperties of Integrals, Indefinite Integrals. Goals: Definition of the Definite Integral Integral Calculations using Antiderivatives
Block #6: Properties of Integrls, Indefinite Integrls Gols: Definition of the Definite Integrl Integrl Clcultions using Antiderivtives Properties of Integrls The Indefinite Integrl 1 Riemnn Sums - 1 Riemnn
More informationJim Lambers MAT 169 Fall Semester Lecture 4 Notes
Jim Lmbers MAT 169 Fll Semester 2009-10 Lecture 4 Notes These notes correspond to Section 8.2 in the text. Series Wht is Series? An infinte series, usully referred to simply s series, is n sum of ll of
More informationUnit #9 : Definite Integral Properties; Fundamental Theorem of Calculus
Unit #9 : Definite Integrl Properties; Fundmentl Theorem of Clculus Gols: Identify properties of definite integrls Define odd nd even functions, nd reltionship to integrl vlues Introduce the Fundmentl
More information( dg. ) 2 dt. + dt. dt j + dh. + dt. r(t) dt. Comparing this equation with the one listed above for the length of see that
Arc Length of Curves in Three Dimensionl Spce If the vector function r(t) f(t) i + g(t) j + h(t) k trces out the curve C s t vries, we cn mesure distnces long C using formul nerly identicl to one tht we
More informationMORE FUNCTION GRAPHING; OPTIMIZATION. (Last edited October 28, 2013 at 11:09pm.)
MORE FUNCTION GRAPHING; OPTIMIZATION FRI, OCT 25, 203 (Lst edited October 28, 203 t :09pm.) Exercise. Let n be n rbitrry positive integer. Give n exmple of function with exctly n verticl symptotes. Give
More informationReview of basic calculus
Review of bsic clculus This brief review reclls some of the most importnt concepts, definitions, nd theorems from bsic clculus. It is not intended to tech bsic clculus from scrtch. If ny of the items below
More information1 1D heat and wave equations on a finite interval
1 1D het nd wve equtions on finite intervl In this section we consider generl method of seprtion of vribles nd its pplictions to solving het eqution nd wve eqution on finite intervl ( 1, 2. Since by trnsltion
More information13: Diffusion in 2 Energy Groups
3: Diffusion in Energy Groups B. Rouben McMster University Course EP 4D3/6D3 Nucler Rector Anlysis (Rector Physics) 5 Sept.-Dec. 5 September Contents We study the diffusion eqution in two energy groups
More informationIntroduction to Group Theory
Introduction to Group Theory Let G be n rbitrry set of elements, typiclly denoted s, b, c,, tht is, let G = {, b, c, }. A binry opertion in G is rule tht ssocites with ech ordered pir (,b) of elements
More informationTheoretical foundations of Gaussian quadrature
Theoreticl foundtions of Gussin qudrture 1 Inner product vector spce Definition 1. A vector spce (or liner spce) is set V = {u, v, w,...} in which the following two opertions re defined: (A) Addition of
More informationNUMERICAL INTEGRATION. The inverse process to differentiation in calculus is integration. Mathematically, integration is represented by.
NUMERICAL INTEGRATION 1 Introduction The inverse process to differentition in clculus is integrtion. Mthemticlly, integrtion is represented by f(x) dx which stnds for the integrl of the function f(x) with
More informationx = b a N. (13-1) The set of points used to subdivide the range [a, b] (see Fig. 13.1) is
Jnury 28, 2002 13. The Integrl The concept of integrtion, nd the motivtion for developing this concept, were described in the previous chpter. Now we must define the integrl, crefully nd completely. According
More informationODE: Existence and Uniqueness of a Solution
Mth 22 Fll 213 Jerry Kzdn ODE: Existence nd Uniqueness of Solution The Fundmentl Theorem of Clculus tells us how to solve the ordinry differentil eqution (ODE) du = f(t) dt with initil condition u() =
More information63. Representation of functions as power series Consider a power series. ( 1) n x 2n for all 1 < x < 1
3 9. SEQUENCES AND SERIES 63. Representtion of functions s power series Consider power series x 2 + x 4 x 6 + x 8 + = ( ) n x 2n It is geometric series with q = x 2 nd therefore it converges for ll q =
More informationMATH 144: Business Calculus Final Review
MATH 144: Business Clculus Finl Review 1 Skills 1. Clculte severl limits. 2. Find verticl nd horizontl symptotes for given rtionl function. 3. Clculte derivtive by definition. 4. Clculte severl derivtives
More informationWe know that if f is a continuous nonnegative function on the interval [a, b], then b
1 Ares Between Curves c 22 Donld Kreider nd Dwight Lhr We know tht if f is continuous nonnegtive function on the intervl [, b], then f(x) dx is the re under the grph of f nd bove the intervl. We re going
More informationIntegral points on the rational curve
Integrl points on the rtionl curve y x bx c x ;, b, c integers. Konstntine Zeltor Mthemtics University of Wisconsin - Mrinette 750 W. Byshore Street Mrinette, WI 5443-453 Also: Konstntine Zeltor P.O. Box
More informationEuler, Ioachimescu and the trapezium rule. G.J.O. Jameson (Math. Gazette 96 (2012), )
Euler, Iochimescu nd the trpezium rule G.J.O. Jmeson (Mth. Gzette 96 (0), 36 4) The following results were estblished in recent Gzette rticle [, Theorems, 3, 4]. Given > 0 nd 0 < s
More informationThe area under the graph of f and above the x-axis between a and b is denoted by. f(x) dx. π O
1 Section 5. The Definite Integrl Suppose tht function f is continuous nd positive over n intervl [, ]. y = f(x) x The re under the grph of f nd ove the x-xis etween nd is denoted y f(x) dx nd clled the
More informationTaylor Polynomial Inequalities
Tylor Polynomil Inequlities Ben Glin September 17, 24 Abstrct There re instnces where we my wish to pproximte the vlue of complicted function round given point by constructing simpler function such s polynomil
More informationSection 6.1 INTRO to LAPLACE TRANSFORMS
Section 6. INTRO to LAPLACE TRANSFORMS Key terms: Improper Integrl; diverge, converge A A f(t)dt lim f(t)dt Piecewise Continuous Function; jump discontinuity Function of Exponentil Order Lplce Trnsform
More informationHere we study square linear systems and properties of their coefficient matrices as they relate to the solution set of the linear system.
Section 24 Nonsingulr Liner Systems Here we study squre liner systems nd properties of their coefficient mtrices s they relte to the solution set of the liner system Let A be n n Then we know from previous
More informationQuadratic Forms. Quadratic Forms
Qudrtic Forms Recll the Simon & Blume excerpt from n erlier lecture which sid tht the min tsk of clculus is to pproximte nonliner functions with liner functions. It s ctully more ccurte to sy tht we pproximte
More informationNumerical Integration
Chpter 5 Numericl Integrtion Numericl integrtion is the study of how the numericl vlue of n integrl cn be found. Methods of function pproximtion discussed in Chpter??, i.e., function pproximtion vi the
More informationA REVIEW OF CALCULUS CONCEPTS FOR JDEP 384H. Thomas Shores Department of Mathematics University of Nebraska Spring 2007
A REVIEW OF CALCULUS CONCEPTS FOR JDEP 384H Thoms Shores Deprtment of Mthemtics University of Nebrsk Spring 2007 Contents Rtes of Chnge nd Derivtives 1 Dierentils 4 Are nd Integrls 5 Multivrite Clculus
More information1.9 C 2 inner variations
46 CHAPTER 1. INDIRECT METHODS 1.9 C 2 inner vritions So fr, we hve restricted ttention to liner vritions. These re vritions of the form vx; ǫ = ux + ǫφx where φ is in some liner perturbtion clss P, for
More informationP 3 (x) = f(0) + f (0)x + f (0) 2. x 2 + f (0) . In the problem set, you are asked to show, in general, the n th order term is a n = f (n) (0)
1 Tylor polynomils In Section 3.5, we discussed how to pproximte function f(x) round point in terms of its first derivtive f (x) evluted t, tht is using the liner pproximtion f() + f ()(x ). We clled this
More informationMA123, Chapter 10: Formulas for integrals: integrals, antiderivatives, and the Fundamental Theorem of Calculus (pp.
MA123, Chpter 1: Formuls for integrls: integrls, ntiderivtives, nd the Fundmentl Theorem of Clculus (pp. 27-233, Gootmn) Chpter Gols: Assignments: Understnd the sttement of the Fundmentl Theorem of Clculus.
More informationChapter 3 Polynomials
Dr M DRAIEF As described in the introduction of Chpter 1, pplictions of solving liner equtions rise in number of different settings In prticulr, we will in this chpter focus on the problem of modelling
More informationMAA 4212 Improper Integrals
Notes by Dvid Groisser, Copyright c 1995; revised 2002, 2009, 2014 MAA 4212 Improper Integrls The Riemnn integrl, while perfectly well-defined, is too restrictive for mny purposes; there re functions which
More information1 Probability Density Functions
Lis Yn CS 9 Continuous Distributions Lecture Notes #9 July 6, 28 Bsed on chpter by Chris Piech So fr, ll rndom vribles we hve seen hve been discrete. In ll the cses we hve seen in CS 9, this ment tht our
More informationAQA Further Pure 1. Complex Numbers. Section 1: Introduction to Complex Numbers. The number system
Complex Numbers Section 1: Introduction to Complex Numbers Notes nd Exmples These notes contin subsections on The number system Adding nd subtrcting complex numbers Multiplying complex numbers Complex
More informationExam 2, Mathematics 4701, Section ETY6 6:05 pm 7:40 pm, March 31, 2016, IH-1105 Instructor: Attila Máté 1
Exm, Mthemtics 471, Section ETY6 6:5 pm 7:4 pm, Mrch 1, 16, IH-115 Instructor: Attil Máté 1 17 copies 1. ) Stte the usul sufficient condition for the fixed-point itertion to converge when solving the eqution
More information2.4 Linear Inequalities and Interval Notation
.4 Liner Inequlities nd Intervl Nottion We wnt to solve equtions tht hve n inequlity symol insted of n equl sign. There re four inequlity symols tht we will look t: Less thn , Less thn or
More informationConservation Law. Chapter Goal. 5.2 Theory
Chpter 5 Conservtion Lw 5.1 Gol Our long term gol is to understnd how mny mthemticl models re derived. We study how certin quntity chnges with time in given region (sptil domin). We first derive the very
More informationand that at t = 0 the object is at position 5. Find the position of the object at t = 2.
7.2 The Fundmentl Theorem of Clculus 49 re mny, mny problems tht pper much different on the surfce but tht turn out to be the sme s these problems, in the sense tht when we try to pproimte solutions we
More informationECO 317 Economics of Uncertainty Fall Term 2007 Notes for lectures 4. Stochastic Dominance
Generl structure ECO 37 Economics of Uncertinty Fll Term 007 Notes for lectures 4. Stochstic Dominnce Here we suppose tht the consequences re welth mounts denoted by W, which cn tke on ny vlue between
More informationContinuous Random Variables
STAT/MATH 395 A - PROBABILITY II UW Winter Qurter 217 Néhémy Lim Continuous Rndom Vribles Nottion. The indictor function of set S is rel-vlued function defined by : { 1 if x S 1 S (x) if x S Suppose tht
More informationChapter 0. What is the Lebesgue integral about?
Chpter 0. Wht is the Lebesgue integrl bout? The pln is to hve tutoril sheet ech week, most often on Fridy, (to be done during the clss) where you will try to get used to the ides introduced in the previous
More informationHandout: Natural deduction for first order logic
MATH 457 Introduction to Mthemticl Logic Spring 2016 Dr Json Rute Hndout: Nturl deduction for first order logic We will extend our nturl deduction rules for sententil logic to first order logic These notes
More informationThe Wave Equation I. MA 436 Kurt Bryan
1 Introduction The Wve Eqution I MA 436 Kurt Bryn Consider string stretching long the x xis, of indeterminte (or even infinite!) length. We wnt to derive n eqution which models the motion of the string
More informationDiscrete Least-squares Approximations
Discrete Lest-squres Approximtions Given set of dt points (x, y ), (x, y ),, (x m, y m ), norml nd useful prctice in mny pplictions in sttistics, engineering nd other pplied sciences is to construct curve
More informationOrthogonal Polynomials and Least-Squares Approximations to Functions
Chpter Orthogonl Polynomils nd Lest-Squres Approximtions to Functions **4/5/3 ET. Discrete Lest-Squres Approximtions Given set of dt points (x,y ), (x,y ),..., (x m,y m ), norml nd useful prctice in mny
More information8 Laplace s Method and Local Limit Theorems
8 Lplce s Method nd Locl Limit Theorems 8. Fourier Anlysis in Higher DImensions Most of the theorems of Fourier nlysis tht we hve proved hve nturl generliztions to higher dimensions, nd these cn be proved
More informationSection 14.3 Arc Length and Curvature
Section 4.3 Arc Length nd Curvture Clculus on Curves in Spce In this section, we ly the foundtions for describing the movement of n object in spce.. Vector Function Bsics In Clc, formul for rc length in
More information5.7 Improper Integrals
458 pplictions of definite integrls 5.7 Improper Integrls In Section 5.4, we computed the work required to lift pylod of mss m from the surfce of moon of mss nd rdius R to height H bove the surfce of the
More informationHow can we approximate the area of a region in the plane? What is an interpretation of the area under the graph of a velocity function?
Mth 125 Summry Here re some thoughts I ws hving while considering wht to put on the first midterm. The core of your studying should be the ssigned homework problems: mke sure you relly understnd those
More informationSOLUTIONS FOR ADMISSIONS TEST IN MATHEMATICS, COMPUTER SCIENCE AND JOINT SCHOOLS WEDNESDAY 5 NOVEMBER 2014
SOLUTIONS FOR ADMISSIONS TEST IN MATHEMATICS, COMPUTER SCIENCE AND JOINT SCHOOLS WEDNESDAY 5 NOVEMBER 014 Mrk Scheme: Ech prt of Question 1 is worth four mrks which re wrded solely for the correct nswer.
More informationLecture 14: Quadrature
Lecture 14: Qudrture This lecture is concerned with the evlution of integrls fx)dx 1) over finite intervl [, b] The integrnd fx) is ssumed to be rel-vlues nd smooth The pproximtion of n integrl by numericl
More informationChapter 5 : Continuous Random Variables
STAT/MATH 395 A - PROBABILITY II UW Winter Qurter 216 Néhémy Lim Chpter 5 : Continuous Rndom Vribles Nottions. N {, 1, 2,...}, set of nturl numbers (i.e. ll nonnegtive integers); N {1, 2,...}, set of ll
More information1.2. Linear Variable Coefficient Equations. y + b "! = a y + b " Remark: The case b = 0 and a non-constant can be solved with the same idea as above.
1 12 Liner Vrible Coefficient Equtions Section Objective(s): Review: Constnt Coefficient Equtions Solving Vrible Coefficient Equtions The Integrting Fctor Method The Bernoulli Eqution 121 Review: Constnt
More informationThe Periodically Forced Harmonic Oscillator
The Periodiclly Forced Hrmonic Oscilltor S. F. Ellermeyer Kennesw Stte University July 15, 003 Abstrct We study the differentil eqution dt + pdy + qy = A cos (t θ) dt which models periodiclly forced hrmonic
More informationThe practical version
Roerto s Notes on Integrl Clculus Chpter 4: Definite integrls nd the FTC Section 7 The Fundmentl Theorem of Clculus: The prcticl version Wht you need to know lredy: The theoreticl version of the FTC. Wht
More informationName Solutions to Test 3 November 8, 2017
Nme Solutions to Test 3 November 8, 07 This test consists of three prts. Plese note tht in prts II nd III, you cn skip one question of those offered. Some possibly useful formuls cn be found below. Brrier
More information3.4 Numerical integration
3.4. Numericl integrtion 63 3.4 Numericl integrtion In mny economic pplictions it is necessry to compute the definite integrl of relvlued function f with respect to "weight" function w over n intervl [,
More information4.4 Areas, Integrals and Antiderivatives
. res, integrls nd ntiderivtives 333. Ares, Integrls nd Antiderivtives This section explores properties of functions defined s res nd exmines some connections mong res, integrls nd ntiderivtives. In order
More informationACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 1 MATH00030 SEMESTER /2019
ACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS MATH00030 SEMESTER 208/209 DR. ANTHONY BROWN 7.. Introduction to Integrtion. 7. Integrl Clculus As ws the cse with the chpter on differentil
More informationdifferent methods (left endpoint, right endpoint, midpoint, trapezoid, Simpson s).
Mth 1A with Professor Stnkov Worksheet, Discussion #41; Wednesdy, 12/6/217 GSI nme: Roy Zho Problems 1. Write the integrl 3 dx s limit of Riemnn sums. Write it using 2 intervls using the 1 x different
More informationRiemann is the Mann! (But Lebesgue may besgue to differ.)
Riemnn is the Mnn! (But Lebesgue my besgue to differ.) Leo Livshits My 2, 2008 1 For finite intervls in R We hve seen in clss tht every continuous function f : [, b] R hs the property tht for every ɛ >
More informationAn approximation to the arithmetic-geometric mean. G.J.O. Jameson, Math. Gazette 98 (2014), 85 95
An pproximtion to the rithmetic-geometric men G.J.O. Jmeson, Mth. Gzette 98 (4), 85 95 Given positive numbers > b, consider the itertion given by =, b = b nd n+ = ( n + b n ), b n+ = ( n b n ) /. At ech
More informationMath 8 Winter 2015 Applications of Integration
Mth 8 Winter 205 Applictions of Integrtion Here re few importnt pplictions of integrtion. The pplictions you my see on n exm in this course include only the Net Chnge Theorem (which is relly just the Fundmentl
More informationDiscrete Mathematics and Probability Theory Spring 2013 Anant Sahai Lecture 17
EECS 70 Discrete Mthemtics nd Proility Theory Spring 2013 Annt Shi Lecture 17 I.I.D. Rndom Vriles Estimting the is of coin Question: We wnt to estimte the proportion p of Democrts in the US popultion,
More informationCalculus. Min Yan Department of Mathematics Hong Kong University of Science and Technology
Clculus Min Yn Deprtment of Mthemtics Hong Kong University of Science nd Technology My, 7 Contents Limit 7 Limit of Sequence 7 Arithmetic Rule 9 Sndwich Rule 3 Some Bsic Limits 5 4 Order Rule 9 5 Subsequence
More informationSYDE 112, LECTURES 3 & 4: The Fundamental Theorem of Calculus
SYDE 112, LECTURES & 4: The Fundmentl Theorem of Clculus So fr we hve introduced two new concepts in this course: ntidifferentition nd Riemnn sums. It turns out tht these quntities re relted, but it is
More informationLesson 1: Quadratic Equations
Lesson 1: Qudrtic Equtions Qudrtic Eqution: The qudrtic eqution in form is. In this section, we will review 4 methods of qudrtic equtions, nd when it is most to use ech method. 1. 3.. 4. Method 1: Fctoring
More informationapproaches as n becomes larger and larger. Since e > 1, the graph of the natural exponential function is as below
. Eponentil nd rithmic functions.1 Eponentil Functions A function of the form f() =, > 0, 1 is clled n eponentil function. Its domin is the set of ll rel f ( 1) numbers. For n eponentil function f we hve.
More informationChapter 5. Numerical Integration
Chpter 5. Numericl Integrtion These re just summries of the lecture notes, nd few detils re included. Most of wht we include here is to be found in more detil in Anton. 5. Remrk. There re two topics with
More informationSTEP FUNCTIONS, DELTA FUNCTIONS, AND THE VARIATION OF PARAMETERS FORMULA. 0 if t < 0, 1 if t > 0.
STEP FUNCTIONS, DELTA FUNCTIONS, AND THE VARIATION OF PARAMETERS FORMULA STEPHEN SCHECTER. The unit step function nd piecewise continuous functions The Heviside unit step function u(t) is given by if t
More informationChapter 14. Matrix Representations of Linear Transformations
Chpter 4 Mtrix Representtions of Liner Trnsformtions When considering the Het Stte Evolution, we found tht we could describe this process using multipliction by mtrix. This ws nice becuse computers cn
More information