Online Learning of Power Transmission Dynamics

Size: px
Start display at page:

Download "Online Learning of Power Transmission Dynamics"

Transcription

1 Online Learning of Power Transmission Dynamics ndrey Y. Lokhov, Marc Vuffray, Dmiry Shemeov, Deepjyoi Deka and Michael Cherkov Theoreical Division, Los lamos Naional Laboraory, Los lamos, NM Cener for Nonlinear Sudies, Los lamos Naional Laboraory, Los lamos, NM Complexiy Sciences Cener, Universiy of California a Davis, Davis, C Skolkovo Insiue of Science and Technology, Moscow, Russia arxiv: v1 [cs.sy] 27 Oc 2017 bsrac We consider he problem of reconsrucing he dynamic sae marix of ransmission power grids from imesamped PMU measuremens in he regime of ambien flucuaions. Using a maximum likelihood based approach, we consruc a family of convex esimaors ha adap o he srucure of he problem depending on he available prior informaion. The proposed mehod is fully daa-driven and does no assume any knowledge of sysem parameers. I can be implemened in near real-ime and requires a small amoun of daa. Our learning algorihms can be used for model validaion and calibraion, and can also be applied o relaed problems of sysem sabiliy, deecion of forced oscillaions, generaion re-dispach, as well as o he esimaion of he sysem sae. Index Terms Transmission grid dynamics, Swing equaions, Parameer learning, Phasor measuremen unis, Reconsrucion algorihm, Synchronous measuremens I. INTRODUCTION Ensuring sable, secure and reliable operaions of he power grid is a primary concern for sysem operaors [1]. Securiy assessmen and conrol acions heavily rely on he accuracy of he assumed power sysem model and is parameers and of he esimaed sae [2]. Thus, inaccuracies in sae esimaion daa or in he neworked dynamic model can impac he assessmen of he sysem sabiliy and he efficacy of he corresponding conrol measures. In his paper, we explore he possibiliy o leverage he proliferaion of Phasor Measuremen Unis (PMUs) ha collec ime synchronous daa in a disribued way, for validaing he assumed power sysem model and he curren sysem sae. In paricular, our goal is o develop a daa-efficien learning framework for performing an online reconsrucion of he dynamic model using he minimal number of assumpions and exclusively relying on he PMU measuremens. number of recen works showed promising resuls in aacking his problem [3], [4], [5], [6], [7], [8], [9]. Here, we propose o exend he scope of exising works o he problem of exracing he dynamic sae marix from PMU measuremens in a purely daa-driven way, wihou assuming any knowledge of model parameers. We ake advanage of he separaion of scales ha exiss in he regime of ambien flucuaions around he seady sae leading o power sysem dynamics excied by sochasic load variaions. Under quie The work was suppored by funding from he U.S. DOE/OE as par of he DOE Grid Modernizaion Iniiaive. general and widely acceped assumpions in his ambien regime, we develop a provably consisen maximum likelihood based mehod ha recovers he dynamic sae marix wih a low number of observaions. Imporanly, he proposed mehodology can be naurally exended o cases of unknown nework opology and parial observaions, and has a low compuaional complexiy which is conducive for real-ime esimaions. n accurae esimaion of he dynamic sae marix has a large number of applicaions ha have been well explored in he lieraure [10], [11], including model validaion and parameer calibraion [3], [4], probing he proximiy o insabiliy and helping in design of he corresponding emergency conrol acions [12], [13], opimizaion and resource allocaion [14], [15], as well as idenificaion and analysis of forced oscillaions in he sysem [16]. The poenial abiliy o use he learned dynamic parameers o simulaneously perform a purely measuremen-based sae esimaion of deviaions in power consumpion from nominal values represens anoher aracive feaure of our framework. validaed sae esimaion can improve resource allocaion for generaion re-dispach. The paper is organized as follows: in Secion II we formulae he model and he reconsrucion problem; in Secion III we sae our learning mehod and discuss he convergence properies of he proposed algorihm; in Secion IV we illusrae our approach on a es sysem, and provide an empirical assessmen of he performance of our algorihms; finally, in Secion V we discuss possible exensions of our mehod and sae some open problems. II. PROBLEM FORMULTION We model he power nework by a graph G = (V, E) wih a se of N nodes (buses) V and a se of edges (ransmission lines) E V V. We consider he regime of ambien oscillaions around he seady sae ha is governed by he dynamics of generaor angles. I is common o model ambien dynamics wih a classical equivalen model of aggregaed generaors [17] ha corresponds o a nework-reduced power sysem where passive loads are eliminaed via Kron reducion [18]. lhough his modeling choice is no necessary for our analysis, i faciliaes a uniform mahemaical descripion where we can assume ha every node i in V essenially corresponds o a generaor wih non-zero ineria M i and

2 damping D i coefficiens wih emporal evoluion governed by he swing equaions [1]: M i θi + D i ( θ i ω (0) ) = P (m) i P (e) i, (1) where ω (0) is he synchronous frequency (60 Hz in U.S..); θ i and θ i (= θ i / ) respecively correspond o he generaor roor angles and speeds; P (m) i is he ne power injecion (e.g. he generaor mechanical power inpu); and P (e) i is he elecrical power oupu. P (e) i can be furher expressed as a sum of power flows ou of node i: P (e) i = (ij) E P ij, wih P ij = V i V j (g ij cos(θ i θ j ) + b ij sin(θ i θ j )), (2) where conducance g ij > 0 and suscepance b ij > 0 correspond o he real and imaginary pars of he complex admiance y ij = g ij ĵb ij (ĵ 2 = ) associaed wih each line (i, j) E in he nework. In he viciniy of he synchronous sae, he difference of roor angles is ypically small, so ha θ i θ j is close o zero for every pair (i, j) E. Therefore, in he regime of moderae ambien flucuaions i is sandard [1] o linearize he expression (2) around he curren operaing poin using cos(θ i θ j ) 1 and sin(θ i θ j ) (θ i θ j ). Over he period of ime where he volage magniudes can be approximaely considered as consan, line admiances are characerized by effecive suscepances β ij = V i V j b ij and conducances γ ij = V i V j g ij, ha absorb consan volage magniudes by definiion. Given hese simplificaions due o DC linearizaion, we assume ha he following relaion is valid in expecaion in he seady sae regime: EP (m) i = EP (e) i = ( ) γ ij + β ij (θ (0) i θ (0) j ), (3) where θ (0) i (ij) E denoe he mean seady sae values of roor angles, and deviaions of phase from hese values δ i = θ i θ (0) i are small. Noe ha conducances g ij are ypically negligible for power ransmission lines and hence γ ij is usually omied in he expression (3) under he assumpion of purely inducive lines [1]. Finally, he resuling dynamic model ha we consider in his paper akes he following form: M i ω i + D i ω i = β ij (δ i δ j ) + δp i, (4) (i,j) E where δp i = P (m) i P (e) i represens he effec of exogenous power deviaions, and ω i = δ i denoes he relaive generaor roor speed measured wih respec o he reference synchronous frequency ω (0). From (4), equaions for he whole sysem can be wrien in he marix form as [ δ ω ] [ 0N N I = N N M L M D ] [ [ δ + ω] 0 M δp ], (5) where y = [y 1,..., y N ] T denoes a generic N-componen vecor and y can refer o θ, θ, ω, ω and δp ; 0 is a N- dimensional vecor; and 0 N N and I N N denoe N N zero and ideniy marices, respecively. L is he suscepanceweighed Laplacian marix defined as L ij = β ij for (ij) E; L ii = (ik) E β ik; and L ij = 0 oherwise. Finally, M and D respecively represen diagonal ineria and damping marices paramerized by M i D i. For compacness, le us rewrie he sysem (5) as Ẋ = d X + ξ, (6) where X is a shorhand noaion for he sysem sae vecor [δ, ω] a ime, and ξ is he δp dependen vecor. cycle (60Hz) Learning βij= Vi Vj bij Mi, Di minues 10xminues hours Figure 1. Separaion of scales in our esimaion problem in he seing of ambien flucuaions. Learning procedure should be sample-efficien and only use he amoun of daa observed during he ime period which is no longer han minues or ens of minues, he ypical scale over which d is sable. In his paper, our goal is o esimae he dynamic sae marix d from PMU daa providing ime series measuremens of dynamic variables X. In principle, d can be compued if all parameers enering (1) are known. s moivaed above, here we deliberaely pursue a purely daa-driven approach ha will provide a characerizaion of he sysem dynamic based on he soluion of he inverse problem using he observed ime series, and hence would allow o validae he assumed dynamic model. However, he dynamic sae marix can be assumed o be consan only a ime scales for which he parameers enering (5) remain unchanged. In he ambien flucuaions seing, here exiss a naural separaion of ime scales in parameer variaions, see Figure 1. The parameers of generaors, such as ineria M i or damping coefficiens D i can be regarded as sable on he scale of several hours, wih a poenial slow drif due o droop or local feedback conrol [2]. lhough infrequen changes in he sysem may provoke a change in V i, overall volage magniudes may be considered sable on he ime inerval of he order of ens of minues [1]. The same conclusion holds for he values b ij ha may flucuae due o variaions in emperaures ha rarely happen on shorer scales compared o ens of minues. On he oher hand, we assume ha ambien flucuaions hemselves are caused by flucuaions of loads Pi m and Pi e around base nominal values or generaor noise [9], and herefore occur a very shor scales of he order of he frequency cycle of 60 Hz. Because of his reason and due o he aggregaed naure of loads, he oal power deviaions δp i are commonly modeled as random Gaussian variaions [19]. Therefore, learning mus ake place using measuremens obained during he inerval of ime ha happens on he scale of minues, below he

3 scale on which volage magniudes migh change, and above he scale of load flucuaions δp i. We model δp i as a zero mean Gaussian noise erm wih sandard deviaion σ Pi ha incorporaes he aggregaed ambien flucuaions in power injecion and consumpion. PMU measuremens are discree in naure, and arrive as ime-separaed daa samples wih a ypical frequency of several cycles. Therefore, he observed daa poins approximaely follow he dynamics represening he discreizaion of (6) wih a cerain sep. Using he Euler-Maruyama discreizaion scheme, we ge o he firs order in : X +1 = X + Bξ, (7) wih = ( d + I 2N 2N ), ξ N (0, I 2N 2N ) is he sandard mulivariae normally disribued noise and B summarizes he resuling scale of flucuaions. I is reasonable o assume ha load flucuaions are spaially independen across nodes so ha B is diagonal; however, variance a individual buses can be differen, so ha B ii = M i σ Pi for i [N +1, 2N] has a meaning of he noise sandard deviaion a node i and B ii = 0 for i [1, N]. s we will see below, is an imporan parameer ha drives he reconsrucion procedure. Indeed, can no be smaller han he resoluion of he PMU daa, and should no be oo small so ha ξ could be convenienly inerpreed as uncorrelaed whie noise across ime. he same ime, can also no be oo large because in his case X would be essenially independen across ime, meaning ha he dynamic sae marix d could no be recovered in principle, and one could only hope o ge he esimaion of he seady sae covariance [20]. In order o faciliae he learning ask, i is advanageous o selec in such a way ha i saisfies he rade-off beween he amoun of observaions used and he accuracy achieved. In wha follows and unless saed oherwise, we will assume ha ξ is independen and idenically disribued for he purpose of reconsrucion of he dynamic sae marix d. III. ESTIMTORS. Maximum likelihood formulaion In his secion, we presen our esimaors for he dynamic sae marix from T discree observaions of he sysem {X },...,T. Consider he empirical cross-correlaion marices wih and wihou displacemen ha respecively read Σ 1 = 1 X +1 X, (8) Σ 0 = 1 T X X. (9) Based on Eq. (7) we inroduce he following esimaor for he marix which exiss whenever he cross-correlaion marix in Eq. (9) is inverible:  = Σ 1 Σ 0. (10) We refer o his esimaor as o he Maximum Likelihood (ML) esimaor for he. Noice ha he 2N 2N marices Σ 0 and Σ 1 are a mos of rank as expressions (8) and (8) are sums of rank one marices. This implies ha he marix Σ 0 is no inverible for T 2N. When T 2N +2, he marix is inverible wih probabiliy one since rank { XT,..., } { } X 1 = rank ξ T 2,..., ξ1, X1 2N and ξ are independen normally disribued vecors. Bounds on he expeced reconsrucion error for he ML esimaor are given by he following heorem. Theorem 1 (Reconsrucion error for discree dynamics): Le ɛ > 0 and T > 2N + 2. The ML esimaor (10) reconsrucs he marix wih probabiliy a leas 1 ɛ wihin a Frobenius norm error bounded by  F B 2 ɛ E [Tr(Σ 0 )] E [ Σ 0 F] 2. (11) Proof: The proof is given in ppendix. The bound in Theorem 1 is valid wihou any assumpions on he marix. For a sable sysem wih a seady sae dynamics one expecs ha Σ 0 concenraes o is expecaion as T. In his case Theorem 1 shows ha he error on he ML esimaor decreases as he inverse square-roo of he number of observaions and increases linearly wih he noise inensiy. The dynamic sae marix describing he coninuous dynamics in Eq. (6) is esimaed from he discree dynamic marix using he relaion  d =  I 2N 2N. (12) Guaranees on he reconsrucion error for he coninuous dynamic marix follow from Theorem 1. Corollary 2: Le ɛ > 0 and T > 2N + 2. The error on he reconsrucion of d is wih probabiliy a leas 1 ɛ upperbounded by σ 2 P i N Âd d F ɛ i=1 M 2 i () E [Tr(Σ 0 )] E [ Σ 0 2 F]. (13) Proof: I is a direc applicaion of Theorem 1 wih B saisfying B ii = M i σ Pi for i [N + 1, 2N]. The main implicaion of Corollary 2 is ha he error on d decreases wih respec o he produc T. This produc corresponds o he oal observaion ime of he sysem obs. Therefore, if he number of daa samples T is large enough for Σ 0 o concenrae o is average, he reconsrucion error only depends on obs = T hrough is inverse square roo. Noice ha for a fixed observaion ime, he error does no depend on he discreizaion, see [21] for an exended discussion on his propery. s menioned earlier, (10) can be inerpreed as he maximum likelihood esimaor for he dynamic marix. This means ha he esimaor  can be seen as he oucome of some minimizaion procedure. While obaining  hrough an opimizaion problem migh seem unnecessarily more complicaed, formulaing he esimaor as a minimizaion procedure renders possible he incorporaion of exra informaion in he

4 esimaion. This exra informaion can ake he form of a prior on he ineria, damping parameers or line suscepances in he sysem, or i can serve as a prior on he locaion of zero elemens in. s i is crucial o keep he learning ime below he ypical ime for which sysem parameers drif (see Figure 1), adding exra informaion in he reconsrucion help in accomplishing his ask by increasing he learning accuracy for a fixed observaion period. The precise minimizaion procedure is given by he following proposiion. Proposiion 3 (Maximum-Likelihood esimaor): Given T observaions {X },...,T resuling from he discree linear dynamics (7), he maximum likelihood esimaor of represens he soluion of he following leas-squares regression  = argmin X +1 X 2 2. (14) Moreover, for T 2N + 2, he minimum of he leas-square regression is achieved by  = Σ 1Σ 0. Proof: The proof is given in ppendix B. Noice ha he firs N rows of he dynamic sae marix d in Eq. (5) are [0 N N I N N ]. Even hough i seems naural o incorporae his informaion in he esimaion procedure, in fac i appears o be unnecessary as hese rows are no direcly affeced by noise (given ha B ii = 0 for i [1, N]) and are always reconsruced perfecly. However he siuaion is differen for he diagonal lower-righ block of, [ M D ] ha is subjec o noise. Thanks o he opimizaion formulaion in Eq. (14), we can resric he regression o marices ha have a diagonal lower-righ N N block o obain he following consrained esimaor,  = argmin X +1 X 2 2 s.. ij = 0 i, j [N + 1, 2N] and i j. (15) While he consrained esimaor (15) provides a more accurae reconsrucion han is unconsrained counerpar (10), i is compuaionally more expensive as i requires o solve an opimizaion problem. This rade-off beween compuaional power and accuracy can be crucial for pracical applicaions. B. Exensions Oher exensions of he ML esimaor can be considered based on prior informaion ha we can incorporae in he leas-squares regression (14). For insance, when he sysem parameers are expeced o drif slowly i is beneficial o incorporae a prior on he marix. This prior can ake he form of a Gaussian prior cenered around a previous reconsrucion. This ranslaes ino a leas-squared regression wih a Tikhonov regularizaion [22], i.e. ) ( T  = argmin X +1 X ν Âprev 2 2, (16) where ν is a parameer indicaing our degree of confidence ha he curren marix is close o is previous esimae Âprev. There exiss insances when he sysem parameers migh no have been previously esimaed, for example when he opology has been modified due o ouages, lines ripping or conroller changes [9], bu he opology of he observed grid is known o be sufficienly sparse. In his case i would be beneficial o promoe he sparsiy of he marix wih a Laplace prior P () e λ 1. This prior leads o he following LSSO esimaor  = argmin ( T ) X +1 X λ 1. (17) The LSSO esimaor proves o be much more efficien han he unconsrained leas-squares (14) when he marix is sparse, rendering he sample requiremen very weakly dependen of he size of he problem N [21]. Finally in cases where he sae of only a subse of buses is observed [20], i is sill possible o rerieve par of he dynamic sae marix corresponding o he visible par of he sysem. This can be done wih he so-called sparse plus lowrank heurisic producing  and L, he minimizers of X +1 ( + L)X λ 1 + η L, (18) where L summarizes he effecs of he unobserved measuremens and he nuclear norm penaly represens a convex surrogae for he low rank consrain, see [23] for more deails. IV. CSE STUDY We illusrae he performance of our learning algorihms on he IEEE 39-bus 10-generaor es sysem [24]; he opology of his sysem is shown in Figure 2 (). We assume ha PMUs are locaed a he generaor buses. Firs, we perform Kron reducion and eliminae passive loads, obaining he parameers of he sysem (5) obeyed by he generaors [9]. Given he esablished parameers of he reduced nework and hence he ground ruh d, we use he discreized represenaion (7) o simulae he dynamics and produce he ime series on δ i and ω i for each generaor i V using he smalles resoluion = 1/60 sec (1 cycle) for which our model (4) is sill valid; in Figure 2 (B), we show one example of such run wih he simulaed daa over 10 minues. In all simulaions, he load variaion is fixed a he level of σ Pi = 0.01 p.u. [9]. We use daa obained in his way in all reconsrucion experimens repored below. Noice ha PMUs migh have a lower ime resoluion, subsampling hese daa poins wih a differen ime sep, for insance once every k cycles (for many measuring devices, he maximum sampling rae corresponds o k = 2 or k = 3). Moreover, because of he daa processing reasons, one migh wish o deliberaely sample daa a a lower frequency for he reconsrucion purposes. Therefore, i is insrucive o check he sensiiviy of he algorihmic performance o he chosen subsampling sep. Bu prior o ha, we need o esablish he measure of performance for he wo esimaors inroduced in his paper: he Unconsrained Maximum Likelihood (UML)

5 1, 1 5, 5 8, 8 Gen 1 Gen 8 Gen 10 Gen 9 B Gen 2 Gen 3 Gen 5 Gen 4 Gen 7 3, 3 6, 6 9, 9 4, 4 7, 7 10, 10 Gen 6 Figure 2. () Topology of he IEEE 39-bus sysem wih 10 generaors [24]. (B) Synheic PMU-measured daa generaed using he parameers of he Kron-reduced sysem and sampled a 60 Hz frequency. 10 minues of daa is presened for every generaor excep generaor 2 ha serves as he reference slack bus. The ime couning he number of sample poins is expressed in erms of he number of cycles. Noe ha he ime series for he generaor 1 has a disinc appearance due o a significanly larger ineria coefficien M 1. esimaor (10) and he Consrained Maximum Likelihood (CML) esimaor (15), where he word consrained means ha he suppor paern of d has been explicily enforced. We use boh algorihms o produce an esimae Âd of he dynamic sae marix d. For a given ime separaion beween measuremen samples {X }, firs he discree marix  a he corresponding scale (7) is esimaed, and hen he dynamic sae marix is recovered using he linear approximaion (12). In order o accoun for he addiional sparsiy srucure presen in d, we supplemen he applicaion of (10) in he UML esimaor wih a pos-esimaion hresholding of marix elemens ha are known o be zero, in paricular in he block corresponding o he diagonal submarix M D in (5). We quanify he qualiy of he esimaion using he relaive Frobenius error ε, defined as ε = Âd d F d F, (19) where Âd is he recovered marix and d is he ground ruh dynamic sae marix used o produce daa (a finer discreizaion = 1/60 sec). The dependence on is shown in Figure 3 (). In his figure, he observaion window obs is fixed o 10 min, and herefore he number of samples T seen by he algorihms decreases wih as T = obs /. ccording o he Corollary 2, he reconsrucion error ε should say consan in T = obs. We see ha for boh algorihms we don see any clear plaeau in ε( ) dependence even for small. This is due o he increasing wih error in he firs-order approximaion (7) of he fine-grained dynamics and hence o he level of validiy of (12). Neverheless, we see ha for boh esimaors ε is growing slowly wih, and he error seen for = 3 cycles is very close o he one realized when he fines possible discreizaion = 1 is aken, alhough he algorihms use hree imes less samples in he former case. Moreover, given ha = 3 cycles represens a normal sampling rae for many measuremen devices, we use his sampling rae in he subsequen experimens. The final hing ha we observe is ha he algorihm CML ha explois he srucure of d sysemaically yields a lower error compared o UML even wih he added heurisic pos-reconsrucion hresholding; on he oher hand, i should be noed ha CML is slower as one needs o solve he opimizaion problem (15) insead of jus invering he marix (in he presen experimens, he opimizaion was carried ou using he Ipop solver). Sill, boh algorihms run in seconds for his es case, which represens a premise for an online real-ime implemenaion. B UML CML 2.5% [cycles] 2.5% 1.75% T Δ = obs [minues] UML CML Figure 3. Performance of he esimaors as a funcion of () ime discreizaion and (B) oal observaion ime obs = T. Each daa poin is averaged over 50 independen realizaions of he dynamics for reducing he noise due o saisics. In Figure 3 (B), we sudy he performance of our esimaor as a funcion of he number of samples T for a fixed sampling sep = 3 cycles (and hence for growing observaion ime

6 obs from 1 o 20 minues). We see ha he experimen confirms he conclusion of he Corollary 2: he esimaed dynamic sae marix Âd quickly converges o he ground ruh marix d, wih CML algorihm achieving he relaive error of 2.5% by obs = 10 min and 1.75% by obs = 20 min. This fac shows ha i is possible o esimae he dynamic sae marix o an impressive accuracy under he ime consrains oulined in Figure 1. Besides he accurae predicion of he dynamic sae marix d per se, a desirable feaure of he esimaors would consis in an accurae predicion of he properies of his marix, in paricular including he specral properies [9]. Indeed, he criical eigenvalue is known o serve as measures of proximiy o he insabiliy [10], [12], [13], while he associaed criical eigenvecor migh provide useful informaion on he sysem response and faciliae he design of conrol acions such as he generaion re-dispach [12], [16]. In Figure 4, we es he accuracy of he criical eigenvalues predicion using he samples obained wihin he obs = 10 min observaion inerval a he sampling rae = 3 cycles. Is is apparen ha he criical eigenvalues are prediced o a good accuracy, which shows ha our learning procedure can be used for he online monioring of he sysem sabiliy. Im( d ) rue d UML d CML d λ criical Re( d ) Figure 4. Qualiy of predicion of he criical eigenvalues of he dynamic sae marix d wih obs = 10 min and = 3 cycles. V. DISCUSSION ND CONCLUSIONS In his work, we explored he maximum likelihood based approach o he problem of esimaion of he dynamic sae marix from PMU measuremens. In paricular, we consruced and esed wo leas-squares esimaors, one based on a fas inversion of he empirical covariance marix, and anoher one based on he soluion of a convex quadraic regression aking full advanage of he problem srucure and leading o a more accurae reconsrucion, bu a an expense of a slighly higher compuaional ime. These wo esimaors realize a common rade-off in pracical applicaions beween he accuracy and he speed of compuaions. In his conribuion, we have verified he properies of our algorihms on synheic daa from sandard IEEE es case; in fuure sudies, i would be insrucive o es heir performance on daa colleced from real-world PMUs. s clarified in secion III, our framework is very broad and can naurally accommodae he regularized online learning by incorporaing he previously learned models as a prior hus poenially decreasing he compuaional ime even furher, as well as exensions o he case of sparse nework opologies and o realisic scenario of incomplee observaions due o a parial PMU coverage [20]. I would be useful o perform a heoreical finie-sample analysis of hese exensions in he fuure similarly o he analysis presened in his paper, as well as o provide an empirical assessmen of he algorihm performance in realisic problems. s we commened while moivaing he dynamic learning problem, esimaed parameers can be useful in a number of asks relaed o opimizaion, conrol and securiy of he ransmission grid. noher aracive feaure of our mehodology consiss in an abiliy o perform daa-driven sae esimaion of power flucuaions hrough esimaion of he marix B relaed o power flucuaions (7), as explained in he proof of he Proposiion 3 in ppendix B. I is imporan o quanify he poenial advanage of using he learning-based mehod in hese applicaions. Some of relevan open quesions ha we did no address in his work include he consrucion of opimal esimaors in he cases of more general noise disribuions han he Gaussian case (for example, he power-law disribued noise), as well as for noise correlaed in space and ime. We anicipae ha in he regime of weak spaial and emporal coupling he esimaors inroduced in his paper should be sufficienly robus and perform reasonably well, bu his saemen should be horoughly checked on realisic es cases. Finally, an ineresing and naural direcion for fuure exploraion consiss in exending our scheme o non-saionariy and o higher-order dynamic models. PPENDIX PROOF OF THEOREM 1 Firs muliply boh sides of Eq. (7) by X sum over o obain Σ 1 = Σ 0 + R, where R ij = 1 B ii ξ,i X,j. and perform a (.20) (.21) Since T 2N + 2, he cross-correlaion marix Σ 0 is inverible. Muliplying boh sides of Eq. (.20) by Σ 0 gives  = RΣ 0. In expecaion he difference in Frobenius norm beween he ML esimaor and he marix is upperbounded by he following expression [ ] E  F = E [ RΣ 0 F], (.22) E [ R F Σ 0 F], (.23) E [ R 2 F ] E [ Σ 0 F] 2, (.24)

7 where in wo las lines we have used Cauchy-Schwarz inequaliy for he Frobenius norm and for he expecaion, respecively. In order o compue he expeced Frobenius norm of R, we firs evaluae he expecaions of is elemens squared E [ ( ) Rij 2 ] 2 T Bii = = 1=1 2=1 E [ξ 1,iX 1,jξ 2,iX 2,j], (.25) ( ) 2 T Bii E [ X 2,j], (.26) where we used ha E [ ξ 2,i] = 1 and E [ξ1,ix 1,jξ 2,iX 2,j] = 0 if 1 2. I is now easy o compue he expeced Frobenius norm of he marix R, E [ R 2 ] B 2 F = 2 E [Tr (Σ 0)]. (.27) The final sep of he proof consiss in combining Eq. (.24), Eq. (.27) and Markov inequaliy. PPENDIX B PROOF OF PROPOSITION 3 The likelihood funcion is he probabiliy densiy funcion (PDF) of he observaion given he parameers, B ha define he model. Since ξ = B (X +1 X ) and he noise is idenically and independenly disribued, we can relaed he PDF of X = X 1,..., X T for a given, B o he PDF of a single ξ, i.e. ρ X (X) = ρ X 1 (X 1 ) de(b) T ρ ξ (B (X +1 X )). (B.28) The maximum likelihood esimaor is given by he argmax of he likelihood in Eq. (B.28) wih respec o, B. Equivalenly one can minimize he opposie of he logarihm of he likelihood o obain [ ] (Â, B) = argmin,b ln de B ln ρ ξ (B (X +1 X )) (B.29) fer replacing he normally disribued PDF for ξ, we arrive a he following opimizaion problem [ ] (Â, B) N = argmin ln B ii + (2B2 ii ) (X +1 X ) 2 i,b i=1 (B.30) Noice ha in Eq. (B.30), he opimizaion over is independen of he value of B and can be performed separaely, yielding he opimizaion problem (14) ha afer some algebra can be equivalenly represened as  = argmin Tr( Σ 0 2 Σ 1 ). (B.31) Whenever Σ 0 is inverible, he minimizaion in Eq. (B.31) can be done analyically and gives  = Σ 1Σ 0. The esimae B can hen be obained by solving (B.30). REFERENCES [1] P. Kundur, N. J. Balu, and M. G. Lauby, Power sysem sabiliy and conrol. McGraw-hill New York, 1994, vol. 7. [2] P. W. Sauer, M.. Pai, and J. H. Chow, Power Sysem Dynamics and Sabiliy: Wih Synchrophasor Measuremen and Power Sysem Toolbox. John Wiley & Sons, [3] Z. Huang, P. Du, D. Koserev, and B. Yang, pplicaion of exended kalman filer echniques for dynamic model parameer calibraion, in Power & Energy Sociey General Meeing, PES 09. IEEE. IEEE, 2009, pp [4] N. Zhou, S. Lu, R. Singh, and M.. Elizondo, Calibraion of reduced dynamic models of power sysems using phasor measuremen uni (pmu) daa, in Norh merican Power Symposium (NPS), IEEE, 2011, pp [5] S. Guo, S. Norris, and J. Bialek, dapive parameer esimaion of power sysem dynamic model using modal informaion, IEEE Transacions on Power Sysems, vol. 29, no. 6, pp , [6] N. Zhou, D. Meng, Z. Huang, and G. Welch, Dynamic sae esimaion of a synchronous machine using pmu daa: comparaive sudy, IEEE Transacions on Smar Grid, vol. 6, no. 1, pp , [7] Y. C. Chen, J. Wang,. D. Domínguez-García, and P. W. Sauer, Measuremen-based esimaion of he power flow jacobian marix, IEEE Transacions on Smar Grid, vol. 7, no. 5, pp , [8] G. Chavan, M. Weiss,. Chakrabory, S. Bhaacharya,. Salazar, and F. Habibi-shrafi, Idenificaion and predicive analysis of a muli-area wecc power sysem model using synchrophasors, IEEE Transacions on Smar Grid, [9] X. Wang, J. Bialek, and K. Turisyn, Pmu-based esimaion of dynamic sae jacobian marix and dynamic sysem sae marix in ambien condiions, IEEE Transacions on Power Sysems, [10] J. Machowski, J. Bialek, and J. R. Bumby, Power sysem dynamics and sabiliy. John Wiley & Sons, [11] H.-D. Chiang, Direc mehods for sabiliy analysis of elecric power sysems: heoreical foundaion, BCU mehodologies, and applicaions. John Wiley & Sons, [12] G. Ghanavai, P. D. Hines, and T. I. Lakoba, Idenifying useful saisical indicaors of proximiy o insabiliy in sochasic power sysems, IEEE Transacions on Power Sysems, vol. 31, no. 2, pp , [13] T. Van Cusem and C. Vournas, Volage sabiliy of elecric power sysems. Springer Science & Business Media, 1998, vol [14] B. K. Poolla, S. Bolognani, and F. Dorfler, Opimal placemen of virual ineria in power grids, IEEE Transacions on uomaic Conrol, [15] D. Deka, H. Nagarajan, and S. Backhaus, Opimal opology design for disurbance minimizaion in power grids, in merican Conrol Conference (CC), May 2017, pp [16] S. Mendoza-rmena and I. Dobson, pplying a formula for generaor redispach o damp inerarea oscillaions using synchrophasors, IEEE Transacions on Power Sysems, vol. 31, no. 4, pp , [17] J. H. Chow, Power sysem coherency and model reducion. Springer, [18] F. Dorfler and F. Bullo, Kron reducion of graphs wih applicaions o elecrical neworks, IEEE Transacions on Circuis and Sysems I: Regular Papers, vol. 60, no. 1, pp , [19] R. Singh, B. C. Pal, and R.. Jabr, Saisical represenaion of disribuion sysem loads using gaussian mixure model, IEEE Transacions on Power Sysems, vol. 25, no. 1, pp , [20] D. Deka,. Zare,. Lokhov, M. Jovanovic, and M. Cherkov, Sae and noise covariance esimaion in power grids using limied nodal pmus, in IEEE Global Conference on Signal and Informaion Processing, [21] J. Beno, M. Ibrahimi, and. Monanari, Learning neworks of sochasic differenial equaions, in dvances in Neural Informaion Processing Sysems, 2010, pp [22] M. Vauhkonen, D. Vadasz, P.. Karjalainen, E. Somersalo, and J. P. Kaipio, Tikhonov regularizaion and prior informaion in elecrical impedance omography, IEEE Transacions on Medical Imaging, vol. 17, no. 2, pp , pril [23]. Jalali and S. Sanghavi, Learning he dependence graph of ime series wih laen facors, in Proceedings of he 29h Inernaional Conference on Machine Learning (ICML), 2012, pp [24] P. Demeriou, M. sprou, J. Quiros-Toros, and E. Kyriakides, Dynamic ieee es sysems for ransien analysis, IEEE Sysems Journal, 2015.

Reconstructing the power grid dynamic model from sparse measurements

Reconstructing the power grid dynamic model from sparse measurements Reconsrucing he power grid dynamic model from sparse measuremens Andrey Lokhov wih Michael Cherkov, Deepjyoi Deka, Sidhan Misra, Marc Vuffray Los Alamos Naional Laboraory Banff, Canada Moivaion: learning

More information

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance

More information

STATE-SPACE MODELLING. A mass balance across the tank gives:

STATE-SPACE MODELLING. A mass balance across the tank gives: B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing

More information

References are appeared in the last slide. Last update: (1393/08/19)

References are appeared in the last slide. Last update: (1393/08/19) SYSEM IDEIFICAIO Ali Karimpour Associae Professor Ferdowsi Universi of Mashhad References are appeared in he las slide. Las updae: 0..204 393/08/9 Lecure 5 lecure 5 Parameer Esimaion Mehods opics o be

More information

Notes on Kalman Filtering

Notes on Kalman Filtering Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren

More information

An introduction to the theory of SDDP algorithm

An introduction to the theory of SDDP algorithm An inroducion o he heory of SDDP algorihm V. Leclère (ENPC) Augus 1, 2014 V. Leclère Inroducion o SDDP Augus 1, 2014 1 / 21 Inroducion Large scale sochasic problem are hard o solve. Two ways of aacking

More information

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H. ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple

More information

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model Modal idenificaion of srucures from roving inpu daa by means of maximum likelihood esimaion of he sae space model J. Cara, J. Juan, E. Alarcón Absrac The usual way o perform a forced vibraion es is o fix

More information

Multi-scale 2D acoustic full waveform inversion with high frequency impulsive source

Multi-scale 2D acoustic full waveform inversion with high frequency impulsive source Muli-scale D acousic full waveform inversion wih high frequency impulsive source Vladimir N Zubov*, Universiy of Calgary, Calgary AB vzubov@ucalgaryca and Michael P Lamoureux, Universiy of Calgary, Calgary

More information

20. Applications of the Genetic-Drift Model

20. Applications of the Genetic-Drift Model 0. Applicaions of he Geneic-Drif Model 1) Deermining he probabiliy of forming any paricular combinaion of genoypes in he nex generaion: Example: If he parenal allele frequencies are p 0 = 0.35 and q 0

More information

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)

More information

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II Roland Siegwar Margaria Chli Paul Furgale Marco Huer Marin Rufli Davide Scaramuzza ETH Maser Course: 151-0854-00L Auonomous Mobile Robos Localizaion II ACT and SEE For all do, (predicion updae / ACT),

More information

Vehicle Arrival Models : Headway

Vehicle Arrival Models : Headway Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where

More information

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number

More information

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when

More information

0.1 MAXIMUM LIKELIHOOD ESTIMATION EXPLAINED

0.1 MAXIMUM LIKELIHOOD ESTIMATION EXPLAINED 0.1 MAXIMUM LIKELIHOOD ESTIMATIO EXPLAIED Maximum likelihood esimaion is a bes-fi saisical mehod for he esimaion of he values of he parameers of a sysem, based on a se of observaions of a random variable

More information

Stability and Bifurcation in a Neural Network Model with Two Delays

Stability and Bifurcation in a Neural Network Model with Two Delays Inernaional Mahemaical Forum, Vol. 6, 11, no. 35, 175-1731 Sabiliy and Bifurcaion in a Neural Nework Model wih Two Delays GuangPing Hu and XiaoLing Li School of Mahemaics and Physics, Nanjing Universiy

More information

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017 Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =

More information

On Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature

On Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature On Measuring Pro-Poor Growh 1. On Various Ways of Measuring Pro-Poor Growh: A Shor eview of he Lieraure During he pas en years or so here have been various suggesions concerning he way one should check

More information

1 Review of Zero-Sum Games

1 Review of Zero-Sum Games COS 5: heoreical Machine Learning Lecurer: Rob Schapire Lecure #23 Scribe: Eugene Brevdo April 30, 2008 Review of Zero-Sum Games Las ime we inroduced a mahemaical model for wo player zero-sum games. Any

More information

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB Elecronic Companion EC.1. Proofs of Technical Lemmas and Theorems LEMMA 1. Le C(RB) be he oal cos incurred by he RB policy. Then we have, T L E[C(RB)] 3 E[Z RB ]. (EC.1) Proof of Lemma 1. Using he marginal

More information

23.2. Representing Periodic Functions by Fourier Series. Introduction. Prerequisites. Learning Outcomes

23.2. Representing Periodic Functions by Fourier Series. Introduction. Prerequisites. Learning Outcomes Represening Periodic Funcions by Fourier Series 3. Inroducion In his Secion we show how a periodic funcion can be expressed as a series of sines and cosines. We begin by obaining some sandard inegrals

More information

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé Bias in Condiional and Uncondiional Fixed Effecs Logi Esimaion: a Correcion * Tom Coupé Economics Educaion and Research Consorium, Naional Universiy of Kyiv Mohyla Academy Address: Vul Voloska 10, 04070

More information

Online Convex Optimization Example And Follow-The-Leader

Online Convex Optimization Example And Follow-The-Leader CSE599s, Spring 2014, Online Learning Lecure 2-04/03/2014 Online Convex Opimizaion Example And Follow-The-Leader Lecurer: Brendan McMahan Scribe: Sephen Joe Jonany 1 Review of Online Convex Opimizaion

More information

Linear Response Theory: The connection between QFT and experiments

Linear Response Theory: The connection between QFT and experiments Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and

More information

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD HAN XIAO 1. Penalized Leas Squares Lasso solves he following opimizaion problem, ˆβ lasso = arg max β R p+1 1 N y i β 0 N x ij β j β j (1.1) for some 0.

More information

Online Appendix to Solution Methods for Models with Rare Disasters

Online Appendix to Solution Methods for Models with Rare Disasters Online Appendix o Soluion Mehods for Models wih Rare Disasers Jesús Fernández-Villaverde and Oren Levinal In his Online Appendix, we presen he Euler condiions of he model, we develop he pricing Calvo block,

More information

di Bernardo, M. (1995). A purely adaptive controller to synchronize and control chaotic systems.

di Bernardo, M. (1995). A purely adaptive controller to synchronize and control chaotic systems. di ernardo, M. (995). A purely adapive conroller o synchronize and conrol chaoic sysems. hps://doi.org/.6/375-96(96)8-x Early version, also known as pre-prin Link o published version (if available):.6/375-96(96)8-x

More information

Object tracking: Using HMMs to estimate the geographical location of fish

Object tracking: Using HMMs to estimate the geographical location of fish Objec racking: Using HMMs o esimae he geographical locaion of fish 02433 - Hidden Markov Models Marin Wæver Pedersen, Henrik Madsen Course week 13 MWP, compiled June 8, 2011 Objecive: Locae fish from agging

More information

Robust estimation based on the first- and third-moment restrictions of the power transformation model

Robust estimation based on the first- and third-moment restrictions of the power transformation model h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,

More information

CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK

CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 175 CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 10.1 INTRODUCTION Amongs he research work performed, he bes resuls of experimenal work are validaed wih Arificial Neural Nework. From he

More information

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t Exercise 7 C P = α + β R P + u C = αp + βr + v (a) (b) C R = α P R + β + w (c) Assumpions abou he disurbances u, v, w : Classical assumions on he disurbance of one of he equaions, eg. on (b): E(v v s P,

More information

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,

More information

SUPPLEMENTARY INFORMATION

SUPPLEMENTARY INFORMATION SUPPLEMENTARY INFORMATION DOI: 0.038/NCLIMATE893 Temporal resoluion and DICE * Supplemenal Informaion Alex L. Maren and Sephen C. Newbold Naional Cener for Environmenal Economics, US Environmenal Proecion

More information

14 Autoregressive Moving Average Models

14 Autoregressive Moving Average Models 14 Auoregressive Moving Average Models In his chaper an imporan parameric family of saionary ime series is inroduced, he family of he auoregressive moving average, or ARMA, processes. For a large class

More information

GMM - Generalized Method of Moments

GMM - Generalized Method of Moments GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................

More information

Article from. Predictive Analytics and Futurism. July 2016 Issue 13

Article from. Predictive Analytics and Futurism. July 2016 Issue 13 Aricle from Predicive Analyics and Fuurism July 6 Issue An Inroducion o Incremenal Learning By Qiang Wu and Dave Snell Machine learning provides useful ools for predicive analyics The ypical machine learning

More information

Chapter 2. First Order Scalar Equations

Chapter 2. First Order Scalar Equations Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.

More information

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon 3..3 INRODUCION O DYNAMIC OPIMIZAION: DISCREE IME PROBLEMS A. he Hamilonian and Firs-Order Condiions in a Finie ime Horizon Define a new funcion, he Hamilonian funcion, H. H he change in he oal value of

More information

Lecture 20: Riccati Equations and Least Squares Feedback Control

Lecture 20: Riccati Equations and Least Squares Feedback Control 34-5 LINEAR SYSTEMS Lecure : Riccai Equaions and Leas Squares Feedback Conrol 5.6.4 Sae Feedback via Riccai Equaions A recursive approach in generaing he marix-valued funcion W ( ) equaion for i for he

More information

A Specification Test for Linear Dynamic Stochastic General Equilibrium Models

A Specification Test for Linear Dynamic Stochastic General Equilibrium Models Journal of Saisical and Economeric Mehods, vol.1, no.2, 2012, 65-70 ISSN: 2241-0384 (prin), 2241-0376 (online) Scienpress Ld, 2012 A Specificaion Tes for Linear Dynamic Sochasic General Equilibrium Models

More information

Unsteady Flow Problems

Unsteady Flow Problems School of Mechanical Aerospace and Civil Engineering Unseady Flow Problems T. J. Craf George Begg Building, C41 TPFE MSc CFD-1 Reading: J. Ferziger, M. Peric, Compuaional Mehods for Fluid Dynamics H.K.

More information

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8) I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression

More information

International Journal of Scientific & Engineering Research, Volume 4, Issue 10, October ISSN

International Journal of Scientific & Engineering Research, Volume 4, Issue 10, October ISSN Inernaional Journal of Scienific & Engineering Research, Volume 4, Issue 10, Ocober-2013 900 FUZZY MEAN RESIDUAL LIFE ORDERING OF FUZZY RANDOM VARIABLES J. EARNEST LAZARUS PIRIYAKUMAR 1, A. YAMUNA 2 1.

More information

ACE 562 Fall Lecture 8: The Simple Linear Regression Model: R 2, Reporting the Results and Prediction. by Professor Scott H.

ACE 562 Fall Lecture 8: The Simple Linear Regression Model: R 2, Reporting the Results and Prediction. by Professor Scott H. ACE 56 Fall 5 Lecure 8: The Simple Linear Regression Model: R, Reporing he Resuls and Predicion by Professor Sco H. Irwin Required Readings: Griffihs, Hill and Judge. "Explaining Variaion in he Dependen

More information

An recursive analytical technique to estimate time dependent physical parameters in the presence of noise processes

An recursive analytical technique to estimate time dependent physical parameters in the presence of noise processes WHAT IS A KALMAN FILTER An recursive analyical echnique o esimae ime dependen physical parameers in he presence of noise processes Example of a ime and frequency applicaion: Offse beween wo clocks PREDICTORS,

More information

Georey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract

Georey E. Hinton. University oftoronto.   Technical Report CRG-TR February 22, Abstract Parameer Esimaion for Linear Dynamical Sysems Zoubin Ghahramani Georey E. Hinon Deparmen of Compuer Science Universiy oftorono 6 King's College Road Torono, Canada M5S A4 Email: zoubin@cs.orono.edu Technical

More information

Testing for a Single Factor Model in the Multivariate State Space Framework

Testing for a Single Factor Model in the Multivariate State Space Framework esing for a Single Facor Model in he Mulivariae Sae Space Framework Chen C.-Y. M. Chiba and M. Kobayashi Inernaional Graduae School of Social Sciences Yokohama Naional Universiy Japan Faculy of Economics

More information

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation Course Noes for EE7C Spring 018: Convex Opimizaion and Approximaion Insrucor: Moriz Hard Email: hard+ee7c@berkeley.edu Graduae Insrucor: Max Simchowiz Email: msimchow+ee7c@berkeley.edu Ocober 15, 018 3

More information

( ) ( ) if t = t. It must satisfy the identity. So, bulkiness of the unit impulse (hyper)function is equal to 1. The defining characteristic is

( ) ( ) if t = t. It must satisfy the identity. So, bulkiness of the unit impulse (hyper)function is equal to 1. The defining characteristic is UNIT IMPULSE RESPONSE, UNIT STEP RESPONSE, STABILITY. Uni impulse funcion (Dirac dela funcion, dela funcion) rigorously defined is no sricly a funcion, bu disribuion (or measure), precise reamen requires

More information

Lecture Notes 2. The Hilbert Space Approach to Time Series

Lecture Notes 2. The Hilbert Space Approach to Time Series Time Series Seven N. Durlauf Universiy of Wisconsin. Basic ideas Lecure Noes. The Hilber Space Approach o Time Series The Hilber space framework provides a very powerful language for discussing he relaionship

More information

Simulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010

Simulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Simulaion-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Week Descripion Reading Maerial 2 Compuer Simulaion of Dynamic Models Finie Difference, coninuous saes, discree ime Simple Mehods Euler Trapezoid

More information

Mechanical Fatigue and Load-Induced Aging of Loudspeaker Suspension. Wolfgang Klippel,

Mechanical Fatigue and Load-Induced Aging of Loudspeaker Suspension. Wolfgang Klippel, Mechanical Faigue and Load-Induced Aging of Loudspeaker Suspension Wolfgang Klippel, Insiue of Acousics and Speech Communicaion Dresden Universiy of Technology presened a he ALMA Symposium 2012, Las Vegas

More information

10. State Space Methods

10. State Space Methods . Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he

More information

Two Coupled Oscillators / Normal Modes

Two Coupled Oscillators / Normal Modes Lecure 3 Phys 3750 Two Coupled Oscillaors / Normal Modes Overview and Moivaion: Today we ake a small, bu significan, sep owards wave moion. We will no ye observe waves, bu his sep is imporan in is own

More information

12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j =

12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j = 1: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME Moving Averages Recall ha a whie noise process is a series { } = having variance σ. The whie noise process has specral densiy f (λ) = of

More information

Block Diagram of a DCS in 411

Block Diagram of a DCS in 411 Informaion source Forma A/D From oher sources Pulse modu. Muliplex Bandpass modu. X M h: channel impulse response m i g i s i Digial inpu Digial oupu iming and synchronizaion Digial baseband/ bandpass

More information

DEPARTMENT OF STATISTICS

DEPARTMENT OF STATISTICS A Tes for Mulivariae ARCH Effecs R. Sco Hacker and Abdulnasser Haemi-J 004: DEPARTMENT OF STATISTICS S-0 07 LUND SWEDEN A Tes for Mulivariae ARCH Effecs R. Sco Hacker Jönköping Inernaional Business School

More information

Chapter 3 Boundary Value Problem

Chapter 3 Boundary Value Problem Chaper 3 Boundary Value Problem A boundary value problem (BVP) is a problem, ypically an ODE or a PDE, which has values assigned on he physical boundary of he domain in which he problem is specified. Le

More information

Distributed Dynamic State Estimator: Extension to Distribution Feeders

Distributed Dynamic State Estimator: Extension to Distribution Feeders Disribued Dynamic Sae Esimaor: Exension o Disribuion Feeders Sakis Meliopoulos Georgia Power Disinguished Professor School of Elecrical and Compuer Engineering Georgia Insiue of Technology Alana, Georgia

More information

Energy Storage Benchmark Problems

Energy Storage Benchmark Problems Energy Sorage Benchmark Problems Daniel F. Salas 1,3, Warren B. Powell 2,3 1 Deparmen of Chemical & Biological Engineering 2 Deparmen of Operaions Research & Financial Engineering 3 Princeon Laboraory

More information

Lecture 33: November 29

Lecture 33: November 29 36-705: Inermediae Saisics Fall 2017 Lecurer: Siva Balakrishnan Lecure 33: November 29 Today we will coninue discussing he boosrap, and hen ry o undersand why i works in a simple case. In he las lecure

More information

Ensamble methods: Bagging and Boosting

Ensamble methods: Bagging and Boosting Lecure 21 Ensamble mehods: Bagging and Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Ensemble mehods Mixure of expers Muliple base models (classifiers, regressors), each covers a differen par

More information

Recursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems

Recursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems 8 Froniers in Signal Processing, Vol. 1, No. 1, July 217 hps://dx.doi.org/1.2266/fsp.217.112 Recursive Leas-Squares Fixed-Inerval Smooher Using Covariance Informaion based on Innovaion Approach in Linear

More information

INTRODUCTION TO MACHINE LEARNING 3RD EDITION

INTRODUCTION TO MACHINE LEARNING 3RD EDITION ETHEM ALPAYDIN The MIT Press, 2014 Lecure Slides for INTRODUCTION TO MACHINE LEARNING 3RD EDITION alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/~ehem/i2ml3e CHAPTER 2: SUPERVISED LEARNING Learning a Class

More information

Licenciatura de ADE y Licenciatura conjunta Derecho y ADE. Hoja de ejercicios 2 PARTE A

Licenciatura de ADE y Licenciatura conjunta Derecho y ADE. Hoja de ejercicios 2 PARTE A Licenciaura de ADE y Licenciaura conjuna Derecho y ADE Hoja de ejercicios PARTE A 1. Consider he following models Δy = 0.8 + ε (1 + 0.8L) Δ 1 y = ε where ε and ε are independen whie noise processes. In

More information

Sub Module 2.6. Measurement of transient temperature

Sub Module 2.6. Measurement of transient temperature Mechanical Measuremens Prof. S.P.Venkaeshan Sub Module 2.6 Measuremen of ransien emperaure Many processes of engineering relevance involve variaions wih respec o ime. The sysem properies like emperaure,

More information

Computation of the Effect of Space Harmonics on Starting Process of Induction Motors Using TSFEM

Computation of the Effect of Space Harmonics on Starting Process of Induction Motors Using TSFEM Journal of elecrical sysems Special Issue N 01 : November 2009 pp: 48-52 Compuaion of he Effec of Space Harmonics on Saring Process of Inducion Moors Using TSFEM Youcef Ouazir USTHB Laboraoire des sysèmes

More information

Finish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details!

Finish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details! MAT 257, Handou 6: Ocober 7-2, 20. I. Assignmen. Finish reading Chaper 2 of Spiva, rereading earlier secions as necessary. handou and fill in some missing deails! II. Higher derivaives. Also, read his

More information

Introduction to Probability and Statistics Slides 4 Chapter 4

Introduction to Probability and Statistics Slides 4 Chapter 4 Inroducion o Probabiliy and Saisics Slides 4 Chaper 4 Ammar M. Sarhan, asarhan@mahsa.dal.ca Deparmen of Mahemaics and Saisics, Dalhousie Universiy Fall Semeser 8 Dr. Ammar Sarhan Chaper 4 Coninuous Random

More information

A Dynamic Model of Economic Fluctuations

A Dynamic Model of Economic Fluctuations CHAPTER 15 A Dynamic Model of Economic Flucuaions Modified for ECON 2204 by Bob Murphy 2016 Worh Publishers, all righs reserved IN THIS CHAPTER, OU WILL LEARN: how o incorporae dynamics ino he AD-AS model

More information

6.2 Transforms of Derivatives and Integrals.

6.2 Transforms of Derivatives and Integrals. SEC. 6.2 Transforms of Derivaives and Inegrals. ODEs 2 3 33 39 23. Change of scale. If l( f ()) F(s) and c is any 33 45 APPLICATION OF s-shifting posiive consan, show ha l( f (c)) F(s>c)>c (Hin: In Probs.

More information

Approximation Algorithms for Unique Games via Orthogonal Separators

Approximation Algorithms for Unique Games via Orthogonal Separators Approximaion Algorihms for Unique Games via Orhogonal Separaors Lecure noes by Konsanin Makarychev. Lecure noes are based on he papers [CMM06a, CMM06b, LM4]. Unique Games In hese lecure noes, we define

More information

Some Basic Information about M-S-D Systems

Some Basic Information about M-S-D Systems Some Basic Informaion abou M-S-D Sysems 1 Inroducion We wan o give some summary of he facs concerning unforced (homogeneous) and forced (non-homogeneous) models for linear oscillaors governed by second-order,

More information

Outline. lse-logo. Outline. Outline. 1 Wald Test. 2 The Likelihood Ratio Test. 3 Lagrange Multiplier Tests

Outline. lse-logo. Outline. Outline. 1 Wald Test. 2 The Likelihood Ratio Test. 3 Lagrange Multiplier Tests Ouline Ouline Hypohesis Tes wihin he Maximum Likelihood Framework There are hree main frequenis approaches o inference wihin he Maximum Likelihood framework: he Wald es, he Likelihood Raio es and he Lagrange

More information

Random Walk with Anti-Correlated Steps

Random Walk with Anti-Correlated Steps Random Walk wih Ani-Correlaed Seps John Noga Dirk Wagner 2 Absrac We conjecure he expeced value of random walks wih ani-correlaed seps o be exacly. We suppor his conjecure wih 2 plausibiliy argumens and

More information

2. Nonlinear Conservation Law Equations

2. Nonlinear Conservation Law Equations . Nonlinear Conservaion Law Equaions One of he clear lessons learned over recen years in sudying nonlinear parial differenial equaions is ha i is generally no wise o ry o aack a general class of nonlinear

More information

Institute for Mathematical Methods in Economics. University of Technology Vienna. Singapore, May Manfred Deistler

Institute for Mathematical Methods in Economics. University of Technology Vienna. Singapore, May Manfred Deistler MULTIVARIATE TIME SERIES ANALYSIS AND FORECASTING Manfred Deisler E O S Economerics and Sysems Theory Insiue for Mahemaical Mehods in Economics Universiy of Technology Vienna Singapore, May 2004 Inroducion

More information

IMPLICIT AND INVERSE FUNCTION THEOREMS PAUL SCHRIMPF 1 OCTOBER 25, 2013

IMPLICIT AND INVERSE FUNCTION THEOREMS PAUL SCHRIMPF 1 OCTOBER 25, 2013 IMPLICI AND INVERSE FUNCION HEOREMS PAUL SCHRIMPF 1 OCOBER 25, 213 UNIVERSIY OF BRIISH COLUMBIA ECONOMICS 526 We have exensively sudied how o solve sysems of linear equaions. We know how o check wheher

More information

Nature Neuroscience: doi: /nn Supplementary Figure 1. Spike-count autocorrelations in time.

Nature Neuroscience: doi: /nn Supplementary Figure 1. Spike-count autocorrelations in time. Supplemenary Figure 1 Spike-coun auocorrelaions in ime. Normalized auocorrelaion marices are shown for each area in a daase. The marix shows he mean correlaion of he spike coun in each ime bin wih he spike

More information

The electromagnetic interference in case of onboard navy ships computers - a new approach

The electromagnetic interference in case of onboard navy ships computers - a new approach The elecromagneic inerference in case of onboard navy ships compuers - a new approach Prof. dr. ing. Alexandru SOTIR Naval Academy Mircea cel Bărân, Fulgerului Sree, Consanţa, soiralexandru@yahoo.com Absrac.

More information

The field of mathematics has made tremendous impact on the study of

The field of mathematics has made tremendous impact on the study of A Populaion Firing Rae Model of Reverberaory Aciviy in Neuronal Neworks Zofia Koscielniak Carnegie Mellon Universiy Menor: Dr. G. Bard Ermenrou Universiy of Pisburgh Inroducion: The field of mahemaics

More information

Christos Papadimitriou & Luca Trevisan November 22, 2016

Christos Papadimitriou & Luca Trevisan November 22, 2016 U.C. Bereley CS170: Algorihms Handou LN-11-22 Chrisos Papadimiriou & Luca Trevisan November 22, 2016 Sreaming algorihms In his lecure and he nex one we sudy memory-efficien algorihms ha process a sream

More information

Problem Set 5. Graduate Macro II, Spring 2017 The University of Notre Dame Professor Sims

Problem Set 5. Graduate Macro II, Spring 2017 The University of Notre Dame Professor Sims Problem Se 5 Graduae Macro II, Spring 2017 The Universiy of Nore Dame Professor Sims Insrucions: You may consul wih oher members of he class, bu please make sure o urn in your own work. Where applicable,

More information

Technical Report Doc ID: TR March-2013 (Last revision: 23-February-2016) On formulating quadratic functions in optimization models.

Technical Report Doc ID: TR March-2013 (Last revision: 23-February-2016) On formulating quadratic functions in optimization models. Technical Repor Doc ID: TR--203 06-March-203 (Las revision: 23-Februar-206) On formulaing quadraic funcions in opimizaion models. Auhor: Erling D. Andersen Convex quadraic consrains quie frequenl appear

More information

5. Stochastic processes (1)

5. Stochastic processes (1) Lec05.pp S-38.45 - Inroducion o Teleraffic Theory Spring 2005 Conens Basic conceps Poisson process 2 Sochasic processes () Consider some quaniy in a eleraffic (or any) sysem I ypically evolves in ime randomly

More information

2.160 System Identification, Estimation, and Learning. Lecture Notes No. 8. March 6, 2006

2.160 System Identification, Estimation, and Learning. Lecture Notes No. 8. March 6, 2006 2.160 Sysem Idenificaion, Esimaion, and Learning Lecure Noes No. 8 March 6, 2006 4.9 Eended Kalman Filer In many pracical problems, he process dynamics are nonlinear. w Process Dynamics v y u Model (Linearized)

More information

Introduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate.

Introduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate. Inroducion Gordon Model (1962): D P = r g r = consan discoun rae, g = consan dividend growh rae. If raional expecaions of fuure discoun raes and dividend growh vary over ime, so should he D/P raio. Since

More information

A variational radial basis function approximation for diffusion processes.

A variational radial basis function approximation for diffusion processes. A variaional radial basis funcion approximaion for diffusion processes. Michail D. Vreas, Dan Cornford and Yuan Shen {vreasm, d.cornford, y.shen}@ason.ac.uk Ason Universiy, Birmingham, UK hp://www.ncrg.ason.ac.uk

More information

Notes for Lecture 17-18

Notes for Lecture 17-18 U.C. Berkeley CS278: Compuaional Complexiy Handou N7-8 Professor Luca Trevisan April 3-8, 2008 Noes for Lecure 7-8 In hese wo lecures we prove he firs half of he PCP Theorem, he Amplificaion Lemma, up

More information

Math 10B: Mock Mid II. April 13, 2016

Math 10B: Mock Mid II. April 13, 2016 Name: Soluions Mah 10B: Mock Mid II April 13, 016 1. ( poins) Sae, wih jusificaion, wheher he following saemens are rue or false. (a) If a 3 3 marix A saisfies A 3 A = 0, hen i canno be inverible. True.

More information

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t...

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t... Mah 228- Fri Mar 24 5.6 Marix exponenials and linear sysems: The analogy beween firs order sysems of linear differenial equaions (Chaper 5) and scalar linear differenial equaions (Chaper ) is much sronger

More information

Time series model fitting via Kalman smoothing and EM estimation in TimeModels.jl

Time series model fitting via Kalman smoothing and EM estimation in TimeModels.jl Time series model fiing via Kalman smoohing and EM esimaion in TimeModels.jl Gord Sephen Las updaed: January 206 Conens Inroducion 2. Moivaion and Acknowledgemens....................... 2.2 Noaion......................................

More information

Sequential Importance Resampling (SIR) Particle Filter

Sequential Importance Resampling (SIR) Particle Filter Paricle Filers++ Pieer Abbeel UC Berkeley EECS Many slides adaped from Thrun, Burgard and Fox, Probabilisic Roboics 1. Algorihm paricle_filer( S -1, u, z ): 2. Sequenial Imporance Resampling (SIR) Paricle

More information

Decentralized Stochastic Control with Partial History Sharing: A Common Information Approach

Decentralized Stochastic Control with Partial History Sharing: A Common Information Approach 1 Decenralized Sochasic Conrol wih Parial Hisory Sharing: A Common Informaion Approach Ashuosh Nayyar, Adiya Mahajan and Demoshenis Tenekezis arxiv:1209.1695v1 [cs.sy] 8 Sep 2012 Absrac A general model

More information

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still.

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still. Lecure - Kinemaics in One Dimension Displacemen, Velociy and Acceleraion Everyhing in he world is moving. Nohing says sill. Moion occurs a all scales of he universe, saring from he moion of elecrons in

More information

Mean-square Stability Control for Networked Systems with Stochastic Time Delay

Mean-square Stability Control for Networked Systems with Stochastic Time Delay JOURNAL OF SIMULAION VOL. 5 NO. May 7 Mean-square Sabiliy Conrol for Newored Sysems wih Sochasic ime Delay YAO Hejun YUAN Fushun School of Mahemaics and Saisics Anyang Normal Universiy Anyang Henan. 455

More information

Module 2 F c i k c s la l w a s o s f dif di fusi s o i n

Module 2 F c i k c s la l w a s o s f dif di fusi s o i n Module Fick s laws of diffusion Fick s laws of diffusion and hin film soluion Adolf Fick (1855) proposed: d J α d d d J (mole/m s) flu (m /s) diffusion coefficien and (mole/m 3 ) concenraion of ions, aoms

More information

The Potential Effectiveness of the Detection of Pulsed Signals in the Non-Uniform Sampling

The Potential Effectiveness of the Detection of Pulsed Signals in the Non-Uniform Sampling The Poenial Effeciveness of he Deecion of Pulsed Signals in he Non-Uniform Sampling Arhur Smirnov, Sanislav Vorobiev and Ajih Abraham 3, 4 Deparmen of Compuer Science, Universiy of Illinois a Chicago,

More information

Application of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing

Application of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing Applicaion of a Sochasic-Fuzzy Approach o Modeling Opimal Discree Time Dynamical Sysems by Using Large Scale Daa Processing AA WALASZE-BABISZEWSA Deparmen of Compuer Engineering Opole Universiy of Technology

More information