WHY YULE-WALKER SHOULD NOT BE USED FOR AUTOREGRESSIVE MODELLING

Size: px
Start display at page:

Download "WHY YULE-WALKER SHOULD NOT BE USED FOR AUTOREGRESSIVE MODELLING"

Transcription

1 WHY YULE-WALKER SHOULD NOT BE USED FOR AUTOREGRESSIVE MODELLING M.J.L. DE HOON, T.H.J.J. VAN DER HAGEN, H. SCHOONEWELLE, AND H. VAN DAM Inerfaculy Reacor Insiue, Delf Universiy of Technology Mekelweg 5, 2629 JB Delf, The Neherlands Absrac - Auoregressive modelling of noise daa is widely used for sysem idenificaion, surveillance, malfuncioning deecion and diagnosis. Several mehods are available o esimae an auoregressive model. Usually, he so-called Yule-Walker mehod is emloyed. The various esimaion mehods generally yield comarable arameer esimaes. In some secial cases however, involving nearly eriodic signals, he Yule-Walker aroach may lead o incorrec arameer esimaes. Burg s mehod offers he bes alernaive o Yule-Walker. In his aer a heoreical exlanaion of his henomenon is given, while he 994 IAEA Benchmark es is resened as a racical examle of Yule-Walker yielding oor arameer esimaes. I. INTRODUCTION Auoregressive modelling of noise daa was inroduced in nuclear engineering in he mid sevenies and gained oulariy during he decades hereafer. A hisorical survey of he gradual acceaion and he diversiy of is alicaions can be found in he so-called SMORN-roceedings (SMORN-III, SMORN-IV, SMORN-V). Nowadays, auoregressive modelling is a widely used means for erforming sysem idenificaion, surveillance, malfuncioning deecion and diagnosis. Is araciveness sems, among ohers, from he fac ha he numerical algorihms involved are raher simle. An auoregressive model deends on a limied number of arameers, which are esimaed from measured noise daa. Several mehods exis o esimae he auoregressive arameers, such as leassquares, Yule-Walker and Burg s mehod. I can be shown ha for large daa samles hese esimaion echniques should lead o aroximaely he same arameer esimaes. Mainly for hisorical reasons, mos eole use eiher he Yule-Walker or he leas-squares mehod. This aer will show, however, ha in some secial cases he Yule-Walker esimaion mehod leads o oor arameer esimaes, even for moderaely sized daa samles. Leas squares should no be used eiher, as i may lead o an unsable model. Burg s mehod is referable. In secion II, we will resen an overview of he basics of auoregressive modelling. The mahemaical circumsances causing oor arameer esimaes in case of he Yule-Walker echnique are described in secion III, while some simulaions of auoregressive rocesses are discussed ha suor our hyoheses. Finally, in secion IV, we will illuminae our findings wih he alicaion of auoregressive modelling for anomaly deecion in he 994 IAEA Benchmark noise daa (Journeau, 994).

2 II. THEORY OF AUTOREGRESSIVE MODELLING The successive samles y of an auoregressive rocess linearly deend on heir redecessors: y + ay - + a2 y a y - = h, () in which a i are he auoregressive arameers and he innovaions h are a saionary urely random rocess wih zero mean. I can be shown ha he auocovariance funcion R for delays o is relaed o he auoregressive arameers a i hrough he Yule-Walker equaion for he auoregressive rocess (Priesley, 994): Ê R R R R R R Ë R R R An esimaed auoregressive model of he same order can be wrien as ˆÊ a ˆ Ê R ˆ a2 R2 = -. (2) Ëa Ë R y + a y + a y + + a - - y- = 2 2 h, (3) in which â i are he auoregressive-arameer esimaes and ĥ are he esimaed innovaions. A clear disincion should be made beween he auoregressive rocess (Eq. ()) and he corresonding auoregressive model (Eq. (3)) (Broersen and Wensink, 993). Using Eq. (3), each daa samle can be rediced from is redecessors: y  = - a y -. (4) i i i= As he samles y canno be rediced exacly, a residue is inroduced, which is defined as he difference beween he measured value and he esimaed value: residue y - y = ĥ, (5) which means ha he residue is equal o he esimaed innovaion, as inroduced in Eq. (3). I is assumed in hese equaions ha he auoregressive model order is known. In racice, he model order has o be esimaed as well, which is usually done using Akaike s crierion (Priesley, 994). Suose ha he esimaion realisaion y consiss of N daa oins (an esimaion realisaion conains hose daa oins ha are used for arameer esimaion). Three mehods of auoregressive-arameer esimaion from hese daa samles shall be considered here, being he leas-squares aroach (LS), he Yule-Walker aroach (YW) and Burg s mehod (Burg): LS: The oal squared residue over he daa samles + o N is minimised, leading o a sysem of linear equaions: Ê c c2 c c2 c22 c2 Ëc c c ˆÊ a ˆ a 2 Ëa 2 Ê c ˆ c2 = -, (6) Ëc in which he marix elemens c N - y y ij -i - j = + N  (7) form an unbiased esimae of he auocovariance funcion for delay i - j. YW: The firs and las daa oins are also included in he summaion of Eq. (7), resuling in

3 Ê R R R R R R Ë R R R ˆÊ a ˆ Ê R ˆ a R 2 2 = -, (8) Ëa Ë R in which he marix elemens R consiue a biased esimae of he auocovariance funcion (Parzen, 96): R N  y y - N = +. (9) The Levinson-Durbin algorihm rovides a fas soluion of a sysem of linear equaions conaining a Toeliz-syle marix as in Eq. (8). Boh Eqs. (6) and (8) are in fac aroximaions o he Yule-Walker rocess equaion (Eq. (2)). Burg: The arameer esimaion aroach ha is nowadays regarded as he mos aroriae, is known as Burg s mehod. In conras o he leas-squares and Yule-Walker mehod, which esimae he auoregressive arameers direcly, Burg s mehod firs esimaes he reflecion coefficiens, which are defined as he las auoregressive-arameer esimae for each model order. From hese, he arameer esimaes are deermined using he Levinson-Durbin algorihm. The reflecion coefficiens consiue unbiased esimaes of he arial correlaion coefficiens. Usually, hese esimaion mehods lead o aroximaely he same resuls for he auoregressive arameers. Once hese have been esimaed from he ime series y, he auoregressive model can be alied o an indeenden redicion realisaion x of he same sochasic rocess. In erms of x, he auoregressive rocess (Eq. ()) can be wrien as x + ax - + a2x a x- = e, () in which he innovaion rocess e is saisically idenical o he innovaion rocess h. The corresonding auoregressive model can be wrien as in Eq. (3): x + a x + a x + + a - - x- = 2 2 e, () in which â i are he auoregressive arameers esimaed from realisaion y and e are he esimaed innovaions. As in Eq. (4), each daa samle can be esimaed from is redecessors: x  = - a x -. (2) i i i= The difference beween he measured value and he esimaed value is now defined as he redicion error: redicion error x - x = ê. (3) The redicion error is herefore equal o he esimaed innovaion, as inroduced in Eq. (). Each redicion error can be calculaed once he acual value of he daa oin is measured. A clear disincion should be made beween he residue and he redicion error and heir variances (Broersen and Wensink, 993). The residual variance var( h ) is a measure for he fi of he auoregressive model o hose daa ha have been used for he esimaion of he auoregressive arameers, and can be esimaed from he realisaion y, which is used for he arameer esimaion: vâr N 2 ( h ) = Â( y - y ) N - = +. (4) For he redicion of fuure daa, insead of he residual variance, he variance of he redicion error var ê is essenial. If he indeenden redicion realisaion x conains N daa samles, he redicion ( ) error variance can be esimaed from he samle variance:

4 ( e ) = Â( x - x ) vâr N 2 N '- = +. (5) The LS arameer esimaion is based on he minimisaion of he residual variance. Such a minimisaion however does no imly ha he variance of he redicion error is minimised as well. As usually he minimisaion of he redicion error variance is our goal, he LS esimaion of he auoregressive arameers is no necessarily suerior o YW or Burg s mehod. III. STABILITY, POLE LOCATION AND PARAMETER ESTIMATION For large daa samles, he difference beween he esimaes obained by he various mehods will be small (Priesley, 994). In some secial cases however, subsanial differences may arise beween hese aroaches even for daa samles of moderae size. In he resen aer i will be shown ha YW should always be avoided. The behaviour of he auoregressive rocess as described by is ole locaions is essenial in his resec. Using he backward shif oeraor z - -, which is defined as z x = x -, and defining a, a realisaion of an auoregressive rocess can be exressed in erms of he innovaions sequence e as: Ê x = z Âaiz Ë i= -i ˆ - e, (6) ignoring he so-called comlemenary funcion (Priesley, 994). The auoregressive oeraor - Ê ˆ -i z Âaiz obviously conains a -fold zero a z =, as well as oles deermined by he Ë i= characerisic equaion of he auoregressive rocess -i  a z =. (7) i= The roos of characerisic equaion should lie inside he uni circle o ensure he auoregressive rocess o be sable. If he roos lie on he uni circle, he auoregressive rocess will only be saionary in case of e being idenical o zero. In ha case a harmonic rocess will resul, consising of a sum of cosine funcions. One migh wonder wha will haen if he auoregressive rocess has oles in he neighbourhood of he uni circle. As oles on he uni circle reresen a harmonic rocess, an auoregressive rocess wih oles near he uni circle can be execed o demonsrae some kind of seudo-eriodic behaviour (Priesley, 994). In his case he auocovariance funcion can be described as a sum of weakly damed eriodic funcions. Furhermore, as he noise erms e are sill resen, he auoregressive rocess may exhibi a kind of almos non-saionary behaviour. Finally, he arial auocorrelaion coefficiens will be close o uniy in absolue value. In he conex of linear filering heory, his means ha he ransfer funcion relaing x o e will be close o insabiliy in he filering sense (Oenheim, 978). The ole locaions will also affec he reliabiliy of he various arameer esimaion echniques. I is claimed by Priesley (994) ha YW may lead o oor arameer esimaes, even for moderaely large daa samles, if he auoregressive oeraor has a ole near he uni circle. This is he more remarkable since LS and YW only differ in heir reamen of he firs and las daa oins. Since his limied number of daa oins is relaively small comared o he oal number of daa oins used for arameer esimaion, i would be execed ha LS and YW lead o almos he same resuls. In his aer, insead of he ole locaions, he oor condiion of he auocovariance marix in Eq. (2) is regarded as he cause of oor YW esimaes. Side-effecs of he oor auocovariance marix condiion are an almos non-saionary, seudo-eriodic behaviour of he auoregressive rocess as well as oles locaed closely o he uni circle and arial auocorrelaion coefficiens close o uniy. These feaures can be used o deec he ossibiliy of oor YW esimaes, bu should no be regarded as is cause. I should be noed i

5 ha auoregressive rocesses are ossible having oles near he uni circle while he auocovariance marix is well condiioned. In hose cases YW will sill rovide correc resuls for he auoregressive arameers. To inroduce he conce of marix condiioning, we consider a general sysem of linear equaions: Ax = B, (8) in which A is a marix of order and B is a vecor of dimension. A well-known resul from linear algebra saes ha Eq. (8) canno have one single soluion if he marix A is singular: de(a) =. (9) In cases in which marix A is almos singular, he soluion of Eq. (8) will be exremely sensiive o erurbaions in eiher marix A or vecor B. The sensiiviy o hese erurbaions can be measured wih he so-called condiion number, which is defined as - k( A) = A A, (2) where is some marix norm (Cybenko, 98). In our case he -norm will be considered: Ê ˆ A = max  Aij : j Œ {, 2,..., }, (2) Ë i= in which A ij denoe he marix elemens. The larger he condiion number, he more sensiive he soluion of Eq. (8) will be o erurbaions. Roughly seaking, if k( A) =, we may exec o lose abou significan figures in invering an aroximaion o A. I should be noed ha in order o calculae he auoregressive arameers from Eq. (2), an inversion of he marix on he lef hand side is required. A deailed reamen of marix comuaions, norms and condiion numbers is given by Sewar (973). The oor coefficien esimaes in case of YW can be exlained in erms of he condiion of he auocovariance marix in Eq. (2) (Cybenko, 98). If he auocovariance marix is oorly condiioned, he soluion of Eq. (2) will srongly deend on erurbaions in he coefficiens R. The bias in he YW auocovariance esimaes R is one of hese erurbaions. Alhough his bias is usually oo small o jeoardise he arameer esimaion, in case of a oorly condiioned auocovariance marix i will be magnified, as a resul of which he YW arameer esimaes will be useless. In case of a firs-order auoregressive rocess, he condiion number reduces o uniy for all ole locaions. Therefore, YW will always yield a Condiion number (I) (II) Disance o he uni circle Fig. Calculaed condiion number of he auocovariance marix in case of auoregressive rocesses (I) and (II). correc resul for he arameer esimae in case of a firs-order rocess. In case of second-order auoregressive rocesses, oor YW esimaes may occur deending on he exac ole locaions. Two second-order auoregressive rocesses are considered here, one having has is oles on he osiive real axis (I), while he second one (II) has is oles on he osiive imaginary axis. Simulaions were made using LS, YW and Burg for oles aroaching he uni circle. The condiion number of he auocovariance marix can be calculaed heoreically as a funcion of he disance o he uni circle, which is shown in Fig.. As he condiion number in case of auoregressive rocess (I) increases dramaically, i is execed ha YW will erform oorly if he oles are locaed near he uni circle. In case of auoregressive rocess (II), he condiion

6 Residual variance Predicion error variance YW YW LS, Burg LS, Burg Disance o he uni circle number equals uniy for all ole disances o he uni circle. Therefore, we exec YW o erform well in his case. Each simulaion consised of 24 daa oins, using a normally disribued urely random innovaion rocess having uni variance. To reven he occurrence of close o non-saionary behaviour, he recorded simulaions were receded wih 24 dummy simulaions. Each simulaion was carried ou 25 imes. In each simulaion, he residual and he redicion error variance as well as he firs and second auoregressive arameer were esimaed, which were hereuon averaged over he number of simulaions. The residual variance was esimaed from Eq. (4). The redicion error variance was esimaed using a second series of 24 daa samles. The firs series served as he esimaion realisaion, while he second series rovided a redicion realisaion in order o esimae he redicion error variance from Eq. (5). The simulaion resuls for he residual variance as well as he redicion error variance in case of auoregressive rocess (I) are shown in Fig. 2. While LS and Burg sill yield a residual variance close o he acual value (being uniy) as he oles aroach he uni circle, YW is no longer able o describe he auoregressive rocess correcly. Even for oles locaed a. from he uni circle, he residual variance in case of YW is almos weny imes as large as in case of LS. Furhermore, i was found ha he auoregressive-arameer esimaes were no accurae in case of YW. The firs and second auoregressivearameer esimaes and heir acual values for auoregressive rocess (I) are loed in Fig. 3. The Yule- Walker echnique acually esimaes a firs-order auoregressive model, since he second auoregressivearameer esimae aroaches zero, while he firs auoregressive-arameer is esimaed o be is value in a firs-order model. In case of auoregressive rocess (II), no such effecs were found. All of he esimaion echniques, including YW, rovided correc resuls for he residual and redicion error variance as well as for he esimaed arameers, due o he marix condiion remaining bounded. These resuls agree wih our execaions. We can conclude ha YW should no be used o esimae auoregressive arameers if he auocovariance marix is almos singular. LS should no be used eiher for reasons of sabiliy of he esimaed model. The sabiliy of an esimaed auoregressive model can be verified by subsiuing he esimaed auoregressive arameers ino Eq. (7). If here urns ou o be a roo lying ouside he uni circle, he esimaed auoregressive model becomes invalid as he heory of auoregressive modelling is alicable o saionary sochasic rocesses only. Forunaely, YW as well as Burg guaranees he esimaed model o be sable, in conrary o LS. I can furhermore be shown ha sligh deviaions in he - Disance o he uni circle Fig. 2 Simulaion resuls for he residual and he redicion error variance in case of auoregressive rocess (I), having oles on he osiive real axis, using he various esimaion echniques.

7 Firs auoregressive arameer YW Second auoregressive arameer Acual, LS, Burg Acual, LS, Burg Disance o he uni circle auoregressive-arameer esimaes can resul in large deviaions in he esimaed ole locaions if he oles of an auoregressive rocess are locaed near he uni circle (Treer, 976). Therefore, each sligh deviaion is he arameer esimaes can resul in an unsable auoregressive model if he LS aroach is emloyed. Burg is he only reliable auoregressive-arameer esimaion echnique, yielding accurae arameer esimaes as well as an auoregressive model guaraneed o be sable. We will now urn o an acual auoregressive analysis in which oor YW arameer esimaion occurred, having derimenal effecs on is conclusions..2 Disance o he uni circle Fig. 3 Simulaion resuls for he firs and second auoregressive-arameer esimae in case of auoregressive rocess (I), having oles on he osiive real axis, using he various esimaion echniques (Acual = he acual value of he auoregressive arameer). YW IV. AUTOREGRESSIVE ANALYSIS OF THE 994 IAEA BENCHMARK One of he alicaions of auoregressive modelling in nuclear reacor analysis is he deecion of anomalies during he reacor oeraion. The basic idea is o deermine an auoregressive model of measured signals in a nuclear reacor during normal oeraion. I is assumed ha he auoregressive model hus found will no longer be alicable in case of a disurbance of he reacor oeraion. This will lead o a large redicion error variance during he anomaly, which can hen be deeced. In his secion, we will discuss he auoregressive analysis of he 994 IAEA Benchmark es daa aimed a he deecion of anomalies. A deailed descriion of his Benchmark es is rovided by Journeau (994). Noise measuremens during normal reacor oeraion were available, as well as synhesised noise daa ha conained an anomaly during he reacor oeraion. As he samling inerval is no relevan for our discussion on he erformance of YW, we will use a discree ime axis. Hoogenboom and Schoonewelle emloyed auoregressive analysis as described reviously o deermine he onse of he anomaly (994a, 994b). The noise daa during normal oeraion were used for deermining he auoregressive model of he seady-sae rocess, while he synhesised noise daa were used for anomaly deecion by soing sudden increases in he redicion error variance. Hoogenboom and Schoonewelle (994b) concluded ha increases in he redicion error variance due o anomalies occurred only if he auoregressive arameers were esimaed using LS. Emloying YW, here is hardly any increase in he redicion error variance during he anomaly. These resuls are due o he naure of he noise daa used for arameer esimaion. Figure 4 shows, in arbirary unis, a secion of 3 consecuive daa oins of he noise signal during normal reacor oeraion

8 Noise daa samle (in arbirary unis) Time (in arbirary unis) Fig. 4 Secion of he noise signal during normal reacor oeraion conaining 3 consecuive noise daa oins in arbirary unis. Power secral densiy (in arbirary unis) Frequency ordinae Fig. 5 Esimaed secrum of he noise daa in arbirary unis as a funcion of he discree frequency ordinaes. o illusrae is almos eriodic behaviour. I shows ha a srong cyclical comonen is resen, having a eriod of abou 6 imes he samling inerval, as well as eriodic comonens a higher frequencies. The almos eriodic behaviour of he background noise can also be demonsraed by esimaing is ower secral densiy, which is shown semi-logarihmically in Fig. 5. Since he secrum conains large eaks a secific frequency ordinaes, i can be concluded ha srong harmonic comonens are resen. Finally, he seudo-eriodic behaviour of he noise daa is shown by he esimaed ole locaions (Fig. 6). Since he oles are all locaed closely o he uni circle, he auoregressive rocess will behave seudoeriodically. In his case, he seudo-eriodic behaviour of he noise daa leads o a oor condiion of he auocovariance marix. Because he auocovariance funcion is no available heoreically as in he revious chaer, he marix condiion can only be esimaed. The bes esimae can be calculaed from he LS auocovariance marix, because all of is esimaes are unbiased. This resuls in k = (22) This condiion number is exremely large. The marix condiion is exremely oor (comare o Fig. ), as a resul of which oor YW arameer esimaes can be execed. The auoregressive model was esimaed from he firs 248 daa oins alying LS, YW and Burg. Using Akaike s Informaion Crierion (AIC), model order = 32 was seleced. The auoregressive-arameer esimaes are given in he Aendix. LS and Burg lead o comarable arameer esimaes, while hose esimaed by YW deviae srongly. The oles of he esimaed models were always locaed inside he uni circle, hereby fulfilling he condiion for sabiliy. Imaginary axis Real axis Fig. 6 Poles of he esimaed auoregressive model (LS).

9 The residual variance var( ĥ ) was esimaed for each esimaion rocedure from he esimaion realisaion using Eq. (4), while he var ê was esimaed redicion error variance ( ) using Eq. (5) from a redicion realisaion conaining 248 daa oins. Table I shows he resuls. As he residual variance and he redicion error variance in case of YW are abou wice as large as he resecive figures for LS and Burg, i can be concluded ha YW does no yield a correc auoregressive model. Alying he auoregressive model o he anomaly noise daa, he anomaly can be deeced from he redicion error variance only if LS or Burg s arameer esimaes are emloyed. In case of YW, he anomaly canno be deeced from he redicion error variance due o he oor arameer esimaes. Fig. 7 shows he redicion error for he noise secion conaining he anomaly in each of he cases LS, YW and Burg. In case of LS and Burg, visual insecion of Fig. 7 enables us o locae he sar of he anomaly a he increase he redicion error variance, as indicaed by he arrow. No such conclusion can be made if he YW arameer esimaes are used, which means ha YW is unusable for anomaly deecion. Predicion error (LS) Time Table I Residual and redicion error variance in case of he various esimaion rocedures Residual variance Predicion error variance LS YW Burg Predicion error (YW) 5 Time Fig. 7 Predicion error for he anomaly noise daa using LS, YW and Burg resecively. Predicion error (Burg) 5 Time V. CONCLUSION The Yule-Walker mehod should no be used as a means of auoregressive-arameer esimaion if he auocovariance marix is oorly condiioned. In ha case he relaively small covariance esimae bias can lead o a large deviaion in he esimaed arameers, resuling in an invalid model. A oor auocovariance marix condiion also involves ole locaions near he uni circle, as a resul of which he auoregressive rocess exhibis a kind of almos non-saionary, seudo-eriodic behaviour. The variance of he sochasic rocess will be large due o he innovaion rocess no being idenically zero, which is he case for a harmonic rocess. The leas-squares aroach as well as Burg s mehod are sill able o esimae he auoregressive model correcly. Leas squares should be used wih cauion hough, as i does no guaranee he esimaed auoregressive model o be sable, as a resul of which a small deviaion in he arameer esimaes may cause he esimaed oles o move ouside he uni circle. In ha case he esimaed auoregressive model will be invalid. This leaves Burg s mehod as he mos reliable esimaion echnique, as i rovides reliable arameer esimaes as well as an esimaed model guaraneed o be sable. The receding conclusions were obained for univariae auoregressive analysis only. However, due o he mahemaical similariy beween univariae and mulivariae auoregressive analysis, we exec similar resuls for he mulivariae case.

10 ACKNOWLEDGEMENTS These sudies were made as a final reor of suden research work a he Dearmen of Reacor Physics, Inerfaculy Reacor Insiue, Delf Universiy of Technology. Secial hanks are due o dr. Pie Broersen (Delf Universiy of Technology, Faculy of Alied Physics), who inroduced me o he oic of auoregressive modelling and is ifalls. REFERENCES Broersen, P.M.T. and Wensink H.E. (993) IEEE Transacions on Signal Processing, 4, Cybenko, G. (98) Sociey for Indusrial and Alied Mahemaics, Journal on Scienific and Saisical Comuing,, 3, Hoogenboom, J.E. and Schoonewelle H. (994a) Inerfaculy Reacor Insiue Hoogenboom, J.E. and Schoonewelle H. (994b) Inerfaculy Reacor Insiue /. Journeau, C. (994) Inernaional Aomic Energy Agency IWGFR Exended Co-ordinaed Research Program on Acousic Signal Processing for he Deecion of Sodium Boiling or Sodium/Waer Reacion in LMFBR. Daa for 994 Benchmark Tes. Commissaria à l Energie Aomique, Cadarache, France. Oenheim, A.V. (978) Alicaions of Digial Signal Processing. Prenice-Hall, Englewood Cliffs. Parzen, E. (96) Technomerics, 3, Priesley, M.B. (994) Secral Analysis and Time Series. Academic Press, London. SMORN-III (982), Proc. of he Third Secialis Meeing on Reacor Noise, Tokyo, Jaan, 26-3 Ocober 98, Progress in Nuclear Energy, 9. SMORN-IV (985), Proc. of he Fourh Secialis Meeing on Reacor Noise, Dijon, France, 5-9 Ocober 984, Progress in Nuclear Energy, 5. SMORN-V (988), Proc. of he Fifh Secialis Meeing on Reacor Noise, Munich, F.R.G., 2-6 Ocober 987, Progress in Nuclear Energy, 2. Sewar, G. W. (973) Inroducion o Marix Comuaions. Academic Press, New York. Treer, S.A. (976) Inroducion o Discree Time-Signal Processing. Wiley, New York. APPENDIX: AUTOREGRESSIVE-PARAMETER ESTIMATES The following able conains he auoregressive-arameer esimaes for LS, YW and Burg. The arameers were esimaed using 248 daa samles from he 994 IAEA benchmark (secion IV). Auoregressive LS YW Burg Auoregressive LS YW Burg arameer arameer

PARAMETER ESTIMATION OF NEARLY NON- STATIONARY AUTOREGRESSIVE PROCESSES

PARAMETER ESTIMATION OF NEARLY NON- STATIONARY AUTOREGRESSIVE PROCESSES RF - 86 PARAMETER ESTIMATION OF NEARLY NON- STATIONARY AUTOREGRESSIVE PROCESSES Final reor of suden work by Michiel J. L. de Hoon January - June 995 Delf Universiy of Technology, Faculy of Alied Physics,

More information

- The whole joint distribution is independent of the date at which it is measured and depends only on the lag.

- The whole joint distribution is independent of the date at which it is measured and depends only on the lag. Saionary Processes Sricly saionary - The whole join disribuion is indeenden of he dae a which i is measured and deends only on he lag. - E y ) is a finie consan. ( - V y ) is a finie consan. ( ( y, y s

More information

FORECASTS GENERATING FOR ARCH-GARCH PROCESSES USING THE MATLAB PROCEDURES

FORECASTS GENERATING FOR ARCH-GARCH PROCESSES USING THE MATLAB PROCEDURES FORECASS GENERAING FOR ARCH-GARCH PROCESSES USING HE MALAB PROCEDURES Dušan Marček, Insiue of Comuer Science, Faculy of Philosohy and Science, he Silesian Universiy Oava he Faculy of Managemen Science

More information

BOX-JENKINS MODEL NOTATION. The Box-Jenkins ARMA(p,q) model is denoted by the equation. pwhile the moving average (MA) part of the model is θ1at

BOX-JENKINS MODEL NOTATION. The Box-Jenkins ARMA(p,q) model is denoted by the equation. pwhile the moving average (MA) part of the model is θ1at BOX-JENKINS MODEL NOAION he Box-Jenkins ARMA(,q) model is denoed b he equaion + + L+ + a θ a L θ a 0 q q. () he auoregressive (AR) ar of he model is + L+ while he moving average (MA) ar of he model is

More information

12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j =

12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j = 1: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME Moving Averages Recall ha a whie noise process is a series { } = having variance σ. The whie noise process has specral densiy f (λ) = of

More information

Testing for a Single Factor Model in the Multivariate State Space Framework

Testing for a Single Factor Model in the Multivariate State Space Framework esing for a Single Facor Model in he Mulivariae Sae Space Framework Chen C.-Y. M. Chiba and M. Kobayashi Inernaional Graduae School of Social Sciences Yokohama Naional Universiy Japan Faculy of Economics

More information

APPLIED ECONOMETRIC TIME SERIES (2nd edition)

APPLIED ECONOMETRIC TIME SERIES (2nd edition) INSTRUCTOR S RESOURCE GUIDE TO ACCOMPANY APPLIED ECONOMETRIC TIME SERIES (2nd ediion) Waler Enders Universiy of Alabama Preared by Pin Chung American Reinsurance Comany and Iowa Sae Universiy Waler Enders

More information

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t Exercise 7 C P = α + β R P + u C = αp + βr + v (a) (b) C R = α P R + β + w (c) Assumpions abou he disurbances u, v, w : Classical assumions on he disurbance of one of he equaions, eg. on (b): E(v v s P,

More information

Position predictive measurement method for time grating CNC rotary table

Position predictive measurement method for time grating CNC rotary table Posiion redicive measuremen mehod for ime graing CC roary able Liu Xiaokang a, Peng Donglin a, Yang Wei a and Fei Yeai b a Engineering Research Cener of Mechanical Tesing Technology and Equimen, Minisry

More information

Chickens vs. Eggs: Replicating Thurman and Fisher (1988) by Arianto A. Patunru Department of Economics, University of Indonesia 2004

Chickens vs. Eggs: Replicating Thurman and Fisher (1988) by Arianto A. Patunru Department of Economics, University of Indonesia 2004 Chicens vs. Eggs: Relicaing Thurman and Fisher (988) by Ariano A. Paunru Dearmen of Economics, Universiy of Indonesia 2004. Inroducion This exercise lays ou he rocedure for esing Granger Causaliy as discussed

More information

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8) I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression

More information

Description of the MS-Regress R package (Rmetrics)

Description of the MS-Regress R package (Rmetrics) Descriion of he MS-Regress R ackage (Rmerics) Auhor: Marcelo Perlin PhD Suden / ICMA Reading Universiy Email: marceloerlin@gmail.com / m.erlin@icmacenre.ac.uk The urose of his documen is o show he general

More information

A One Line Derivation of DCC: Application of a Vector Random Coefficient Moving Average Process*

A One Line Derivation of DCC: Application of a Vector Random Coefficient Moving Average Process* A One Line Derivaion of DCC: Alicaion of a Vecor Random Coefficien Moving Average Process* Chrisian M. Hafner Insiu de saisique, biosaisique e sciences acuarielles Universié caholique de Louvain Michael

More information

DEPARTMENT OF STATISTICS

DEPARTMENT OF STATISTICS A Tes for Mulivariae ARCH Effecs R. Sco Hacker and Abdulnasser Haemi-J 004: DEPARTMENT OF STATISTICS S-0 07 LUND SWEDEN A Tes for Mulivariae ARCH Effecs R. Sco Hacker Jönköping Inernaional Business School

More information

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance

More information

d 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3

d 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3 and d = c b - b c c d = c b - b c c This process is coninued unil he nh row has been compleed. The complee array of coefficiens is riangular. Noe ha in developing he array an enire row may be divided or

More information

On parametric detection of small targets in sea clutter

On parametric detection of small targets in sea clutter On arameric deecion of small arges in sea cluer H.E. Wensink Hollandse Signaalaaraen B.V. P.O. Box 4, 7550 GD Hengelo The Neherlands E-mail: wensink@signaal.nl hone: +3 74 48 368 Hollandse Signaalaaraen

More information

Dirac s hole theory and the Pauli principle: clearing up the confusion.

Dirac s hole theory and the Pauli principle: clearing up the confusion. Dirac s hole heory and he Pauli rincile: clearing u he conusion. Dan Solomon Rauland-Borg Cororaion 8 W. Cenral Road Moun Prosec IL 656 USA Email: dan.solomon@rauland.com Absrac. In Dirac s hole heory

More information

A Specification Test for Linear Dynamic Stochastic General Equilibrium Models

A Specification Test for Linear Dynamic Stochastic General Equilibrium Models Journal of Saisical and Economeric Mehods, vol.1, no.2, 2012, 65-70 ISSN: 2241-0384 (prin), 2241-0376 (online) Scienpress Ld, 2012 A Specificaion Tes for Linear Dynamic Sochasic General Equilibrium Models

More information

Chapter 3 Common Families of Distributions

Chapter 3 Common Families of Distributions Chaer 3 Common Families of Disribuions Secion 31 - Inroducion Purose of his Chaer: Caalog many of common saisical disribuions (families of disribuions ha are indeed by one or more arameers) Wha we should

More information

Exponential Weighted Moving Average (EWMA) Chart Under The Assumption of Moderateness And Its 3 Control Limits

Exponential Weighted Moving Average (EWMA) Chart Under The Assumption of Moderateness And Its 3 Control Limits DOI: 0.545/mjis.07.5009 Exponenial Weighed Moving Average (EWMA) Char Under The Assumpion of Moderaeness And Is 3 Conrol Limis KALPESH S TAILOR Assisan Professor, Deparmen of Saisics, M. K. Bhavnagar Universiy,

More information

ON DETERMINATION OF SOME CHARACTERISTICS OF SEMI-MARKOV PROCESS FOR DIFFERENT DISTRIBUTIONS OF TRANSIENT PROBABILITIES ABSTRACT

ON DETERMINATION OF SOME CHARACTERISTICS OF SEMI-MARKOV PROCESS FOR DIFFERENT DISTRIBUTIONS OF TRANSIENT PROBABILITIES ABSTRACT Zajac, Budny ON DETERMINATION O SOME CHARACTERISTICS O SEMI MARKOV PROCESS OR DIERENT DISTRIBUTIONS O R&RATA # 2(3 ar 2 (Vol. 2 29, June ON DETERMINATION O SOME CHARACTERISTICS O SEMI-MARKOV PROCESS OR

More information

Robust estimation based on the first- and third-moment restrictions of the power transformation model

Robust estimation based on the first- and third-moment restrictions of the power transformation model h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,

More information

Vector autoregression VAR. Case 1

Vector autoregression VAR. Case 1 Vecor auoregression VAR So far we have focused mosl on models where deends onl on as. More generall we migh wan o consider oin models ha involve more han one variable. There are wo reasons: Firs, we migh

More information

Solutions of Ecological models by Homotopy-Perturbation Method (HPM)

Solutions of Ecological models by Homotopy-Perturbation Method (HPM) Ques Journals Journal of Research in Alied Mahemaics Volume ~ Issue 0 (0) : 7- ISSN(Online) : 9-07 ISSN (Prin):9-075 www.quesjournals.org Research Paer Soluions of Ecological models by Homooy-Perurbaion

More information

Rise-Time Distortion of Signal without Carrying Signal

Rise-Time Distortion of Signal without Carrying Signal Journal of Physics: Conference Series PAPER OPEN ACCESS Rise-Time Disorion of Signal wihou Carrying Signal To cie his aricle: N S Bukhman 6 J. Phys.: Conf. Ser. 738 8 View he aricle online for udaes and

More information

Recursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems

Recursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems 8 Froniers in Signal Processing, Vol. 1, No. 1, July 217 hps://dx.doi.org/1.2266/fsp.217.112 Recursive Leas-Squares Fixed-Inerval Smooher Using Covariance Informaion based on Innovaion Approach in Linear

More information

Stopping Brownian Motion without Anticipation as Close as Possible to its Ultimate Maximum

Stopping Brownian Motion without Anticipation as Close as Possible to its Ultimate Maximum Theory Probab. Al. Vol. 45, No.,, (5-36) Research Reor No. 45, 999, De. Theore. Sais. Aarhus Soing Brownian Moion wihou Aniciaion as Close as Possible o is Ulimae Maximum S. E. GRAVERSEN 3, G. PESKIR 3,

More information

Forecasting optimally

Forecasting optimally I) ile: Forecas Evaluaion II) Conens: Evaluaing forecass, properies of opimal forecass, esing properies of opimal forecass, saisical comparison of forecas accuracy III) Documenaion: - Diebold, Francis

More information

Stability analysis of semiconductor manufacturing process with EWMA run-to-run controllers

Stability analysis of semiconductor manufacturing process with EWMA run-to-run controllers Sabiliy analysis of semiconducor manufacuring rocess wih EWMA run-o-run conrollers Bing Ai a, David Shan-Hill Wong b, Shi-Shang Jang b a Dearmen of Comuer Science, Universiy of exas a Ausin, exas, USA

More information

III. Module 3. Empirical and Theoretical Techniques

III. Module 3. Empirical and Theoretical Techniques III. Module 3. Empirical and Theoreical Techniques Applied Saisical Techniques 3. Auocorrelaion Correcions Persisence affecs sandard errors. The radiional response is o rea he auocorrelaion as a echnical

More information

14 Autoregressive Moving Average Models

14 Autoregressive Moving Average Models 14 Auoregressive Moving Average Models In his chaper an imporan parameric family of saionary ime series is inroduced, he family of he auoregressive moving average, or ARMA, processes. For a large class

More information

Lecture 2: Telegrapher Equations For Transmission Lines. Power Flow.

Lecture 2: Telegrapher Equations For Transmission Lines. Power Flow. Whies, EE 481/581 Lecure 2 Page 1 of 13 Lecure 2: Telegraher Equaions For Transmission Lines. Power Flow. Microsri is one mehod for making elecrical connecions in a microwae circui. I is consruced wih

More information

Notes on Kalman Filtering

Notes on Kalman Filtering Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren

More information

O.R. Theory and it s Application Multi-Component Commercial Bank Branch Progress and Regress: An Application of Data Envelopment Analysis

O.R. Theory and it s Application Multi-Component Commercial Bank Branch Progress and Regress: An Application of Data Envelopment Analysis Inernaional Mahemaical Forum, 1, 2006, no. 33, 1635-1644 O.R. Theory and i s Alicaion Muli-Comonen Commercial Bank Branch Progress and Regress: An Alicaion of Daa Envelomen Analysis A. Divandari Dearmen

More information

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number

More information

Methodology. -ratios are biased and that the appropriate critical values have to be increased by an amount. that depends on the sample size.

Methodology. -ratios are biased and that the appropriate critical values have to be increased by an amount. that depends on the sample size. Mehodology. Uni Roo Tess A ime series is inegraed when i has a mean revering propery and a finie variance. I is only emporarily ou of equilibrium and is called saionary in I(0). However a ime series ha

More information

Lecture 6 - Testing Restrictions on the Disturbance Process (References Sections 2.7 and 2.10, Hayashi)

Lecture 6 - Testing Restrictions on the Disturbance Process (References Sections 2.7 and 2.10, Hayashi) Lecure 6 - esing Resricions on he Disurbance Process (References Secions 2.7 an 2.0, Hayashi) We have eveloe sufficien coniions for he consisency an asymoic normaliy of he OLS esimaor ha allow for coniionally

More information

Comparing Means: t-tests for One Sample & Two Related Samples

Comparing Means: t-tests for One Sample & Two Related Samples Comparing Means: -Tess for One Sample & Two Relaed Samples Using he z-tes: Assumpions -Tess for One Sample & Two Relaed Samples The z-es (of a sample mean agains a populaion mean) is based on he assumpion

More information

Stability and Bifurcation in a Neural Network Model with Two Delays

Stability and Bifurcation in a Neural Network Model with Two Delays Inernaional Mahemaical Forum, Vol. 6, 11, no. 35, 175-1731 Sabiliy and Bifurcaion in a Neural Nework Model wih Two Delays GuangPing Hu and XiaoLing Li School of Mahemaics and Physics, Nanjing Universiy

More information

Institute for Mathematical Methods in Economics. University of Technology Vienna. Singapore, May Manfred Deistler

Institute for Mathematical Methods in Economics. University of Technology Vienna. Singapore, May Manfred Deistler MULTIVARIATE TIME SERIES ANALYSIS AND FORECASTING Manfred Deisler E O S Economerics and Sysems Theory Insiue for Mahemaical Mehods in Economics Universiy of Technology Vienna Singapore, May 2004 Inroducion

More information

Licenciatura de ADE y Licenciatura conjunta Derecho y ADE. Hoja de ejercicios 2 PARTE A

Licenciatura de ADE y Licenciatura conjunta Derecho y ADE. Hoja de ejercicios 2 PARTE A Licenciaura de ADE y Licenciaura conjuna Derecho y ADE Hoja de ejercicios PARTE A 1. Consider he following models Δy = 0.8 + ε (1 + 0.8L) Δ 1 y = ε where ε and ε are independen whie noise processes. In

More information

Econometric Methods for Modelling Systems with a Mixture of I(1) and I(0) Variables # Summary

Econometric Methods for Modelling Systems with a Mixture of I(1) and I(0) Variables # Summary Economeric Mehods for Modelling Sysems wih a Mixure of I() and I(0) Variables # Lance A. Fisher, Hyeon seung Huh, Adrian R. Pagan Summary This aer considers srucural models when boh I() and I(0) variables

More information

STATE-SPACE MODELLING. A mass balance across the tank gives:

STATE-SPACE MODELLING. A mass balance across the tank gives: B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing

More information

ATLAS searches for squarks and gluinos using leptons or multiple b-jets with 3.2 fb 1 of pp collisions at 13 TeV

ATLAS searches for squarks and gluinos using leptons or multiple b-jets with 3.2 fb 1 of pp collisions at 13 TeV ALAS searches for suarks and gluinos using leons or mulile b-jes wih. fb of collisions a e Ohmane Rifki, On behalf of he ALAS collaboraion Universiy of Oklahoma E-mail: ohmane.rifki@cern.ch AL-PHYS-PROC-6-47

More information

Module 2 F c i k c s la l w a s o s f dif di fusi s o i n

Module 2 F c i k c s la l w a s o s f dif di fusi s o i n Module Fick s laws of diffusion Fick s laws of diffusion and hin film soluion Adolf Fick (1855) proposed: d J α d d d J (mole/m s) flu (m /s) diffusion coefficien and (mole/m 3 ) concenraion of ions, aoms

More information

Nature Neuroscience: doi: /nn Supplementary Figure 1. Spike-count autocorrelations in time.

Nature Neuroscience: doi: /nn Supplementary Figure 1. Spike-count autocorrelations in time. Supplemenary Figure 1 Spike-coun auocorrelaions in ime. Normalized auocorrelaion marices are shown for each area in a daase. The marix shows he mean correlaion of he spike coun in each ime bin wih he spike

More information

Accurate RMS Calculations for Periodic Signals by. Trapezoidal Rule with the Least Data Amount

Accurate RMS Calculations for Periodic Signals by. Trapezoidal Rule with the Least Data Amount Adv. Sudies Theor. Phys., Vol. 7, 3, no., 3-33 HIKARI Ld, www.m-hikari.com hp://dx.doi.org/.988/asp.3.3999 Accurae RS Calculaions for Periodic Signals by Trapezoidal Rule wih he Leas Daa Amoun Sompop Poomjan,

More information

Stationary Time Series

Stationary Time Series 3-Jul-3 Time Series Analysis Assoc. Prof. Dr. Sevap Kesel July 03 Saionary Time Series Sricly saionary process: If he oin dis. of is he same as he oin dis. of ( X,... X n) ( X h,... X nh) Weakly Saionary

More information

Computing with diode model

Computing with diode model ECE 570 Session 5 C 752E Comuer Aided Engineering for negraed Circuis Comuing wih diode model Objecie: nroduce conces in numerical circui analsis Ouline: 1. Model of an examle circui wih a diode 2. Ouline

More information

Maximum Likelihood Estimation for α-stable AR and Allpass Processes

Maximum Likelihood Estimation for α-stable AR and Allpass Processes Maximum Likelihood Esimaion for α-sable AR and Allass Processes Beh Andrews Norhwesern Universiy Ma Calder PHZ Caial Parners Richard A. Davis Columbia Universiy (h://www.sa.columbia.edu/~rdavis) Blood!

More information

Testing the Random Walk Model. i.i.d. ( ) r

Testing the Random Walk Model. i.i.d. ( ) r he random walk heory saes: esing he Random Walk Model µ ε () np = + np + Momen Condiions where where ε ~ i.i.d he idea here is o es direcly he resricions imposed by momen condiions. lnp lnp µ ( lnp lnp

More information

Introduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate.

Introduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate. Inroducion Gordon Model (1962): D P = r g r = consan discoun rae, g = consan dividend growh rae. If raional expecaions of fuure discoun raes and dividend growh vary over ime, so should he D/P raio. Since

More information

1 birth rate γ (number of births per time interval) 2 death rate δ proportional to size of population

1 birth rate γ (number of births per time interval) 2 death rate δ proportional to size of population Scienific Comuing I Module : Poulaion Modelling Coninuous Models Michael Bader Par I ODE Models Lehrsuhl Informaik V Winer 7/ Discree vs. Coniuous Models d d = F,,...) ) =? discree model: coninuous model:

More information

A generalization of the Burg s algorithm to periodically correlated time series

A generalization of the Burg s algorithm to periodically correlated time series A generalizaion of he Burg s algorihm o periodically correlaed ime series Georgi N. Boshnakov Insiue of Mahemaics, Bulgarian Academy of Sciences ABSTRACT In his paper periodically correlaed processes are

More information

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)

More information

Vectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1

Vectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1 Vecorauoregressive Model and Coinegraion Analysis Par V Time Series Analysis Dr. Sevap Kesel 1 Vecorauoregression Vecor auoregression (VAR) is an economeric model used o capure he evoluion and he inerdependencies

More information

Our main purpose in this section is to undertake an examination of the stock

Our main purpose in this section is to undertake an examination of the stock 3. Caial gains ax and e sock rice volailiy Our main urose in is secion is o underake an examinaion of e sock rice volailiy by considering ow e raional seculaor s olding canges afer e ax rae on caial gains

More information

10. State Space Methods

10. State Space Methods . Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he

More information

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II Roland Siegwar Margaria Chli Paul Furgale Marco Huer Marin Rufli Davide Scaramuzza ETH Maser Course: 151-0854-00L Auonomous Mobile Robos Localizaion II ACT and SEE For all do, (predicion updae / ACT),

More information

Sliding Mode Controller for Unstable Systems

Sliding Mode Controller for Unstable Systems S. SIVARAMAKRISHNAN e al., Sliding Mode Conroller for Unsable Sysems, Chem. Biochem. Eng. Q. 22 (1) 41 47 (28) 41 Sliding Mode Conroller for Unsable Sysems S. Sivaramakrishnan, A. K. Tangirala, and M.

More information

References are appeared in the last slide. Last update: (1393/08/19)

References are appeared in the last slide. Last update: (1393/08/19) SYSEM IDEIFICAIO Ali Karimpour Associae Professor Ferdowsi Universi of Mashhad References are appeared in he las slide. Las updae: 0..204 393/08/9 Lecure 5 lecure 5 Parameer Esimaion Mehods opics o be

More information

DYNAMIC ECONOMETRIC MODELS vol NICHOLAS COPERNICUS UNIVERSITY - TORUŃ Józef Stawicki and Joanna Górka Nicholas Copernicus University

DYNAMIC ECONOMETRIC MODELS vol NICHOLAS COPERNICUS UNIVERSITY - TORUŃ Józef Stawicki and Joanna Górka Nicholas Copernicus University DYNAMIC ECONOMETRIC MODELS vol.. - NICHOLAS COPERNICUS UNIVERSITY - TORUŃ 996 Józef Sawicki and Joanna Górka Nicholas Copernicus Universiy ARMA represenaion for a sum of auoregressive processes In he ime

More information

ODEs II, Lecture 1: Homogeneous Linear Systems - I. Mike Raugh 1. March 8, 2004

ODEs II, Lecture 1: Homogeneous Linear Systems - I. Mike Raugh 1. March 8, 2004 ODEs II, Lecure : Homogeneous Linear Sysems - I Mike Raugh March 8, 4 Inroducion. In he firs lecure we discussed a sysem of linear ODEs for modeling he excreion of lead from he human body, saw how o ransform

More information

Vector autoregression VAR

Vector autoregression VAR Vecor auoregression VAR So far we have focused mosly on models where y deends on as y. More generally we migh wan o consider models for more han on variable. If we only care abou forecasing one series

More information

Time series Decomposition method

Time series Decomposition method Time series Decomposiion mehod A ime series is described using a mulifacor model such as = f (rend, cyclical, seasonal, error) = f (T, C, S, e) Long- Iner-mediaed Seasonal Irregular erm erm effec, effec,

More information

Smoothing. Backward smoother: At any give T, replace the observation yt by a combination of observations at & before T

Smoothing. Backward smoother: At any give T, replace the observation yt by a combination of observations at & before T Smoohing Consan process Separae signal & noise Smooh he daa: Backward smooher: A an give, replace he observaion b a combinaion of observaions a & before Simple smooher : replace he curren observaion wih

More information

OBJECTIVES OF TIME SERIES ANALYSIS

OBJECTIVES OF TIME SERIES ANALYSIS OBJECTIVES OF TIME SERIES ANALYSIS Undersanding he dynamic or imedependen srucure of he observaions of a single series (univariae analysis) Forecasing of fuure observaions Asceraining he leading, lagging

More information

How to Deal with Structural Breaks in Practical Cointegration Analysis

How to Deal with Structural Breaks in Practical Cointegration Analysis How o Deal wih Srucural Breaks in Pracical Coinegraion Analysis Roselyne Joyeux * School of Economic and Financial Sudies Macquarie Universiy December 00 ABSTRACT In his noe we consider he reamen of srucural

More information

Fault Tolerant Computing CS 530 Reliability Analysis. Yashwant K. Malaiya Colorado State University

Fault Tolerant Computing CS 530 Reliability Analysis. Yashwant K. Malaiya Colorado State University CS 53 eliabiliy Analysis Yashwan K. Malaiya Colorado Sae Universiy February 6, 27 eliabiliy Analysis: Ouline eliabiliy measures: eliabiliy, availabiliy, Transacion eliabiliy, MTTF and (, MTBF Basic Cases

More information

EXAMPLES OF EVALUATION OF RATE FORMS FROM KINETIC DATA IN BATCH SYSTEMS

EXAMPLES OF EVALUATION OF RATE FORMS FROM KINETIC DATA IN BATCH SYSTEMS HE 47 LETURE 5 EXMPLES OF EVLUTION OF RTE FORMS FROM INETI DT IN BTH SYSTEMS EXMPLE : Deermine he reacion order and he rae consan or a single reacion o he ye roducs based on he ollowing exerimenal inormaion

More information

ACE 562 Fall Lecture 8: The Simple Linear Regression Model: R 2, Reporting the Results and Prediction. by Professor Scott H.

ACE 562 Fall Lecture 8: The Simple Linear Regression Model: R 2, Reporting the Results and Prediction. by Professor Scott H. ACE 56 Fall 5 Lecure 8: The Simple Linear Regression Model: R, Reporing he Resuls and Predicion by Professor Sco H. Irwin Required Readings: Griffihs, Hill and Judge. "Explaining Variaion in he Dependen

More information

Vehicle Arrival Models : Headway

Vehicle Arrival Models : Headway Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where

More information

AN ACCURATE AND COMPUTATIONALLY EFFICIENT APPROXIMATION TO PSYCHROMETRIC CALCULATIONS

AN ACCURATE AND COMPUTATIONALLY EFFICIENT APPROXIMATION TO PSYCHROMETRIC CALCULATIONS Inernaional Journal of Laes Research in Science and Technology Volume 3, Issue 3: Page No. 15-4. May-June 014 h://www.mnkjournals.com/ijlrs.hm ISSN (Online):78-599 AN ACCURATE AND COMPUTATIONALLY EFFICIENT

More information

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé Bias in Condiional and Uncondiional Fixed Effecs Logi Esimaion: a Correcion * Tom Coupé Economics Educaion and Research Consorium, Naional Universiy of Kyiv Mohyla Academy Address: Vul Voloska 10, 04070

More information

STRUCTURAL CHANGE IN TIME SERIES OF THE EXCHANGE RATES BETWEEN YEN-DOLLAR AND YEN-EURO IN

STRUCTURAL CHANGE IN TIME SERIES OF THE EXCHANGE RATES BETWEEN YEN-DOLLAR AND YEN-EURO IN Inernaional Journal of Applied Economerics and Quaniaive Sudies. Vol.1-3(004) STRUCTURAL CHANGE IN TIME SERIES OF THE EXCHANGE RATES BETWEEN YEN-DOLLAR AND YEN-EURO IN 001-004 OBARA, Takashi * Absrac The

More information

On asymptotic behavior of composite integers n = pq Yasufumi Hashimoto

On asymptotic behavior of composite integers n = pq Yasufumi Hashimoto Journal of Mah-for-Indusry Vol1009A-6 45 49 On asymoic behavior of comosie inegers n = q Yasufumi Hashimoo Received on March 1 009 Absrac In his aer we sudy he asymoic behavior of he number of comosie

More information

Multi-scale 2D acoustic full waveform inversion with high frequency impulsive source

Multi-scale 2D acoustic full waveform inversion with high frequency impulsive source Muli-scale D acousic full waveform inversion wih high frequency impulsive source Vladimir N Zubov*, Universiy of Calgary, Calgary AB vzubov@ucalgaryca and Michael P Lamoureux, Universiy of Calgary, Calgary

More information

Regression with Time Series Data

Regression with Time Series Data Regression wih Time Series Daa y = β 0 + β 1 x 1 +...+ β k x k + u Serial Correlaion and Heeroskedasiciy Time Series - Serial Correlaion and Heeroskedasiciy 1 Serially Correlaed Errors: Consequences Wih

More information

Chapter 2. First Order Scalar Equations

Chapter 2. First Order Scalar Equations Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.

More information

Cointegration and Implications for Forecasting

Cointegration and Implications for Forecasting Coinegraion and Implicaions for Forecasing Two examples (A) Y Y 1 1 1 2 (B) Y 0.3 0.9 1 1 2 Example B: Coinegraion Y and coinegraed wih coinegraing vecor [1, 0.9] because Y 0.9 0.3 is a saionary process

More information

Expert Advice for Amateurs

Expert Advice for Amateurs Exper Advice for Amaeurs Ernes K. Lai Online Appendix - Exisence of Equilibria The analysis in his secion is performed under more general payoff funcions. Wihou aking an explici form, he payoffs of he

More information

COMPUTATION OF THE PERFORMANCE OF SHEWHART CONTROL CHARTS. Pieter Mulder, Julian Morris and Elaine B. Martin

COMPUTATION OF THE PERFORMANCE OF SHEWHART CONTROL CHARTS. Pieter Mulder, Julian Morris and Elaine B. Martin COMUTATION OF THE ERFORMANCE OF SHEWHART CONTROL CHARTS ieer Mulder, Julian Morris and Elaine B. Marin Cenre for rocess Analyics and Conrol Technology, School of Chemical Engineering and Advanced Maerials,

More information

MATH 128A, SUMMER 2009, FINAL EXAM SOLUTION

MATH 128A, SUMMER 2009, FINAL EXAM SOLUTION MATH 28A, SUMME 2009, FINAL EXAM SOLUTION BENJAMIN JOHNSON () (8 poins) [Lagrange Inerpolaion] (a) (4 poins) Le f be a funcion defined a some real numbers x 0,..., x n. Give a defining equaion for he Lagrange

More information

A note on diagonalization of integral quadratic forms modulo p m

A note on diagonalization of integral quadratic forms modulo p m NNTDM 7 ( 3-36 A noe on diagonalizaion of inegral quadraic fors odulo Ali H Hakai Dearen of Maheaics King Khalid Universiy POo 94 Abha Posal Code: 643 Saudi Arabia E-ail: aalhakai@kkuedusa Absrac: Le be

More information

( ) ( ) if t = t. It must satisfy the identity. So, bulkiness of the unit impulse (hyper)function is equal to 1. The defining characteristic is

( ) ( ) if t = t. It must satisfy the identity. So, bulkiness of the unit impulse (hyper)function is equal to 1. The defining characteristic is UNIT IMPULSE RESPONSE, UNIT STEP RESPONSE, STABILITY. Uni impulse funcion (Dirac dela funcion, dela funcion) rigorously defined is no sricly a funcion, bu disribuion (or measure), precise reamen requires

More information

Final Spring 2007

Final Spring 2007 .615 Final Spring 7 Overview The purpose of he final exam is o calculae he MHD β limi in a high-bea oroidal okamak agains he dangerous n = 1 exernal ballooning-kink mode. Effecively, his corresponds o

More information

Material Resistance and Friction in Cold Rolling

Material Resistance and Friction in Cold Rolling h World Congresses of Srucural and Mulidiscilinary Oimizaion Rio de Janeiro, 30 May - 03 June 200, Brazil Maerial Resisance and Fricion in Cold Rolling A.K. Tieu, C. You, H.T. Zhu, C. Lu, Z.Y. Jiang and

More information

A Markov Switching Model for UK Acquisition Levels

A Markov Switching Model for UK Acquisition Levels A Markov Swiching Model for UK Acquisiion Levels Sian Owen * School of Banking and Finance, Universiy of New Souh Wales January 2004 Working Paer Number 2004-01 School of Banking and Finance, The Universiy

More information

5 The fitting methods used in the normalization of DSD

5 The fitting methods used in the normalization of DSD The fiing mehods used in he normalizaion of DSD.1 Inroducion Sempere-Torres e al. 1994 presened a general formulaion for he DSD ha was able o reproduce and inerpre all previous sudies of DSD. The mehodology

More information

Properties of Autocorrelated Processes Economics 30331

Properties of Autocorrelated Processes Economics 30331 Properies of Auocorrelaed Processes Economics 3033 Bill Evans Fall 05 Suppose we have ime series daa series labeled as where =,,3, T (he final period) Some examples are he dail closing price of he S&500,

More information

Intermediate Macroeconomics: Mid-term exam May 30 th, 2016 Makoto Saito

Intermediate Macroeconomics: Mid-term exam May 30 th, 2016 Makoto Saito 1 Inermediae Macroeconomics: Mid-erm exam May 30 h, 2016 Makoo Saio Try he following hree roblems, and submi your answer in handwrien A4 aers. You are execed o dro your aers ino he mailbox assigned for

More information

Mathematical Theory and Modeling ISSN (Paper) ISSN (Online) Vol 3, No.3, 2013

Mathematical Theory and Modeling ISSN (Paper) ISSN (Online) Vol 3, No.3, 2013 Mahemaical Theory and Modeling ISSN -580 (Paper) ISSN 5-05 (Online) Vol, No., 0 www.iise.org The ffec of Inverse Transformaion on he Uni Mean and Consan Variance Assumpions of a Muliplicaive rror Model

More information

2 Univariate Stationary Processes

2 Univariate Stationary Processes Univariae Saionary Processes As menioned in he inroducion, he publicaion of he exbook by GEORGE E.P. BOX and GWILYM M. JENKINS in 97 opened a new road o he analysis of economic ime series. This chaper

More information

Lecture Notes 2. The Hilbert Space Approach to Time Series

Lecture Notes 2. The Hilbert Space Approach to Time Series Time Series Seven N. Durlauf Universiy of Wisconsin. Basic ideas Lecure Noes. The Hilber Space Approach o Time Series The Hilber space framework provides a very powerful language for discussing he relaionship

More information

Chapter 3, Part IV: The Box-Jenkins Approach to Model Building

Chapter 3, Part IV: The Box-Jenkins Approach to Model Building Chaper 3, Par IV: The Box-Jenkins Approach o Model Building The ARMA models have been found o be quie useful for describing saionary nonseasonal ime series. A parial explanaion for his fac is provided

More information

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin ACE 56 Fall 005 Lecure 4: Simple Linear Regression Model: Specificaion and Esimaion by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Simple Regression: Economic and Saisical Model

More information

( ) T = A New Approach to Identify Key Quality Characteristics in Multistage Manufacturing Process with Variation Transmission Model.

( ) T = A New Approach to Identify Key Quality Characteristics in Multistage Manufacturing Process with Variation Transmission Model. Send Orders for Rerins o rerins@benhamscience.ae 790 The Oen Cyberneics & Sysemics Journal, 04, 8, 790-794 Oen Access A New Aroach o Idenify Key Qualiy Characerisics in Mulisage Manufacuring Process wih

More information

Two Coupled Oscillators / Normal Modes

Two Coupled Oscillators / Normal Modes Lecure 3 Phys 3750 Two Coupled Oscillaors / Normal Modes Overview and Moivaion: Today we ake a small, bu significan, sep owards wave moion. We will no ye observe waves, bu his sep is imporan in is own

More information

SUPPLEMENTARY INFORMATION

SUPPLEMENTARY INFORMATION SUPPLEMENTARY INFORMATION DOI: 0.038/NCLIMATE893 Temporal resoluion and DICE * Supplemenal Informaion Alex L. Maren and Sephen C. Newbold Naional Cener for Environmenal Economics, US Environmenal Proecion

More information