State Estimation. Ali Abur Northeastern University, USA. September 28, 2016 Fall 2016 CURENT Course Lecture Notes
|
|
- Dwain Hutchinson
- 5 years ago
- Views:
Transcription
1 State Estmaton Al Abur Northeastern Unversty, USA September 8, 06 Fall 06 CURENT Course Lecture Notes
2 Operatng States of a Power System Al Abur NORMAL STATE SECURE or INSECURE RESTORATIVE STATE EMERGENCY STATE PARTIAL OR TOTAL BLACKOUT OPERATIONAL LIMITS ARE VIOLATED
3 Energy Management System Applcatons SCADA / EMS Confguraton Al Abur Measurements State Estmaton Topology Processor Securty Montorng Load Forecastng External Equvalents Emergency Control Restoratve Control Contngency Analyss On-lne Power Flow Secure Y STOP N Securty Constraned OPF Preventve Acton
4 State Estmaton and Related Functons Weghted Least Squares (WLS) Estmator Al Abur Analog Measurements P, Q, P f, Q f, V, I, θ k, δ k Topology Processor State Estmator (WLS) V, θ Bad Data Processor Load Forecasts Generaton Schedules Network Observablty Analyss Pseudo Measurements [ njectons: P, Q ] Crcut Breaker Status Assumed or Montored
5 Power Flow and State Estmaton Comparson Al Abur Power Flow State Estmaton Termnaton crteron Bus P,Q msmatch ΔX State ncrement Formulaton Determnstc Stochastc Soluton Depends on choce of slack bus Independent of reference bus selecton Bus Types Important Irrelevant Loads Modeled Not used Generator Lmts Modeled Not used Transmsson System Modeled Modeled
6 Power System State Estmaton Problem Statement Al Abur [] : Measurements P-Q njectons P-Q flows V magntude, I magntude [x] : States V, θ, Taps (parameters) EXAMPLE: [] [ P; P3; P3; P; P; P3; V; Q; Q3; Q3; Q; Q; Q3 ] m 3 (no. of measurements) [x] [ V; V; V3; θ; θ3 ] n 5 (no. of states)
7 Network Model Bus/branch and bus/breaker Models Al Abur Bus/Breaker Bus/Branch Topology Processor
8 Measurements Bus/branch and bus/breaker Models Al Abur Bus/branch Bus/Breaker V
9 Measurement Model [ m ] [h([x])] + [e] Al Abur +e +e State Estmator 3 +e 3 : true measurement e : measurement error e e s + e r systematc random
10 Measurement Model Al Abur Assumptons e ~ N ( 0, σ ) olds true f: e s 0, e r ~ N ( 0, σ ) If e s 0, then E(e ) 0,.e. SE wll be based!
11 Maxmum Lkelhood Estmator (MLE) Lkelhood Functon Al Abur Consder the random varables X, X,, X n wth a p.d.f of f(x θ), where θ s unknown. The jont p.d.f of a set of random observatons x { x, x,, x n } wll be expressed as: f n ( x θ) f (x θ) f(x θ) f(x n θ ) Ths jont p.d.f s referred to as the Lkelhood Functon. The value of θ, whch wll maxme the functon fn( x θ) wll be called the Maxmum Lkelhood Estmator (MLE) of θ.
12 Maxmum Lkelhood Estmator (MLE) Maxmum Lkelhood Estmator Al Abur } ) ( exp{ ) ( σ µ πσ f ) ( ) ( ) ( ) ( m m m m m f f f f m m m m m f f L log log ) ( ) ( log ) ( log σ π σ µ Normal (Gaussan) Densty Functon, f() Lkelhood Functon, f m () Log-Lkelhood Functon, L
13 Maxmum Lkelhood Estmator (MLE) Weghted Least Squares (WLS) Estmator Al Abur Gven the set of observatons,,, n MLE wll be the soluton to the followng: Mnme Subject to m W h r Maxme OR Mnme ( x) + r f m m ( ) µ σ ( ) Defnng a new varable r, measurement resdual:,.., m W σ µ E( ) h ( x) The soluton of the above optmaton problem s called the weghted least squares (WLS) estmator for x.
14 Maxmum Lkelhood Estmator (MLE) Weghted Least Squares (WLS) Estmator Al Abur ] [ ] [ ] [ ] Subject to [ Mnme r x W r m + } { W dag W W σ Lnear case: Soluton s gven by: ] [ ] [ ] [ ] [ [x] W G T ] [ ] [ ] [ ] [ W G T
15 Measurement Model Al Abur Gven a set of measurements, [] and the correct network topology/parameters: [] [h ([x]) ] + [e] Measurements: Contan errors True System States: Unknown! Measurement Errors: Unknown!
16 Measurement Model Al Abur Followng the state estmaton, the estmated state wll be denoted by [ xˆ ]: [] [h ([ xˆ ]) ] + [r] Measurements: Contan errors Estmated System States Measurement Resduals: Computed
17 Smple Example 3 4 Z h θ + e Z.0 / 0.0 / θ 4 3 r r 3 r 4 SLOPEθ* r h h h 3 h 4 h : ESTIMATED MEASUREMENT : MEASURED VALUE r : MEASUREMENT RESIDUAL Z h θ* Al Abur
18 Weghted Least Squares (WLS) Estmaton Al Abur Mnme r + ωr + ω3r3 ω4r4 ω + What are weghts, w? ω.0 σ ow are they chosen? σ Assumed error varance of measurement.
19 Network Observablty Defntons Al Abur Fully observable network: A power system s sad to be fully observable f voltage phasors at all system buses can be unquely estmated usng the avalable measurements.
20 Network Observablty Necessary and Suffcent Condtons Al Abur n mn m n n m p Z θ θ θ 3 3 m n NECESSARY BUT NOT SUFFICIENT EXAMPLE: m, n, UNOBSERVABLE SYSTEM Rank() n SUFFICIENT [ 3 ] θ θ State Vector ] [ ] [ ] [ ] [ ˆ P T Z W G θ Sngular Matrx! Cannot be nverted.
21 Measurement Classfcaton Types of Measurements Al Abur. CRITICAL MEASUREMENTS If they are lost or temporarly unavalable, the system wll no longer be observable, thus state estmaton can not be executed If they have gross errors, they can not be detected Measurement resduals wll always be equal to ero,.e. crtcal measurements wll be perfectly satsfed by the estmated state. REDUNDANT MEASUREMENTS CAN BE REMOVED WITOUT AFFECTING NETWORK OBSERVABILITY
22 Network Observablty Defntons Al Abur Unobservable branch: If the system s found not to be observable, t wll mply that there are unobservable branches whose power flows can not be determned. Observable sland: Unobservable branches connect observable slands of an unobservable system. State of each observable sland can be estmated usng any one of the buses n that sland as the reference bus.
23 Network Observablty Defntons Al Abur Observable Islands RED LINES: Unobservable Branches
24 Mergng Observable Islands Pseudo-measurements Al Abur If the system s found unobservable, use pseudo-measurements n order to merge observable slands. Pseudo-measurements: Forecasted bus loads Scheduled generaton Select pseudo-measurements such that they are crtcal. Errors n crtcal measurements do not propagate to the resduals of the other (redundant) measurements.
25 Observable Islands Unobservable Branches Al Abur ISLAND ISLAND ISLAND 3
26 Robust (reslent) Estmaton Reslency: A Smart Grd Requrement Al Abur If an estmator remans nsenstve to a fnte number of errors n the measurements, then t s consdered to be robust. Example: Gven { 0.9, 0.95,.05,.07,.09 }, estmate usng the followng estmators:.. Xˆ Xˆ mean{ } 5 medan{ }, Soluton: Replace 5.09 by an nfntely large number 5. 5 The new estmate wll then be: ˆ 5 Ths estmator s NOT robust. Replace both 5 and 4 by nfnty. a b The new estmate wll then be: Ths s a more robust estmator than the one above. 5,...,5 X a X ˆ b.05 (fnte)
27 Robust Estmaton M-Estmators Al Abur M-Estmators (uber 964) Consder the problem: Mnme Subject to m ρ( r ) h( x) + r Where ρ( r ) s a chosen functon of the measurement resdual In the specal case of the WLS state estmaton: ρ ( r ) r σ
28 Robust Estmaton M-Estmators Al Abur Some Examples of M-Estmators otherwse ) ( a a r r r σ σ σ ρ otherwse ) ( a r a a r r r σ σ σ σ ρ Quadratc-Constant Quadratc-Lnear r r ) ρ( Least Absolute Value (LAV)
29 Robust Estmaton LAV Estmator Example Al Abur A Measurement Model: + A x + e,..., 5 x Measurements: Z A A LAV estmate for x and measurement resduals: x r T T [3.005; 4.00] [ 0.0; 0.05; 0.0; 0.0; 0.0] CANGE measurement 5 from 5.0 to 5.0 ( Smulated Bad Datum ): LAV estmate for x and measurement resduals: x r T T [3.0; 4.0] [ 0.0; 0.0; 0.045; 0.0; 9.98 ]
30 Robust Estmaton LAV Estmator Example Al Abur A Measurement Model: + A x + e,..., 5 x Measurements: Z A A LAV estmate for x and measurement resduals: x r T T [3.005; 4.00] [ 0.0; 0.05; 0.0; 0.0; 0.0] CANGE measurement 5 from 5.0 to 5.0 ( Smulated Bad Datum ): LAV estmate for x and measurement resduals: x r T T [3.0; 4.0] [ 0.0; 0.0; 0.045; 0.0; 9.98 ]
31 Bad Data Detecton Ch-squares χ Test Al Abur Consder X, X, X N, a set of N ndependent random varables where: X ~ N(0,) Then, a new random varable Y wll have a freedom,.e.: χ N X Y ~ χ N dstrbuton wth N degrees of
32 Bad Data Detecton Al Abur Now, consder the functon f ( x) and assumng: e m N R e N m ~ r ~ N e R (0,) m ( N e ) f(x) wll have a χ dstrbuton wth at most (m-n) degrees of freedom. In a power system, snce at least n measurements wll have to satsfy the power balance equatons, at most (m-n) of the measurement errors wll be lnearly ndependent.
33 Bad Data Detecton Detecton Algorthm χ --Test Al Abur Solve the WLS estmaton problem and compute the objectve functon: m ( h ( x)) Look up the value correspondng to p (e.g. 95 %) probablty and (m-n) degrees of freedom, from the Ch-squares dstrbuton table. Let ths value be J ( x) χ ( m n), p σ ere: p Pr{ J ( x) χ ( m n), p } Test f J ( x) χ( m n), p If yes, then bad data are detected. Else, the measurements are not suspected to contan bad data.
34 Bad Data Identfcaton Propertes of Measurement Resduals Al Abur Lnear measurement model: K s called the hat matrx. Now, the measurement resduals can be expressed as follows: where S s called the resdual senstvty matrx. ) (, ˆ ˆ R R K K x T T R R x T T ) ( ˆ Se e K I e x K I K I r + ] [Note that K ) ( ) )( ( ) ( ˆ
35 Bad Data Identfcaton Dstrbuton of Measurement Resduals Al Abur The resdual covarance matrx Ω can be wrtten as: E[ rr S T ] Ω S E[ e e ] S R S T S ence, the normaled value of the resdual for measurement wll be gven by: R N r r Ω The row/column of S correspondng to a crtcal measurement wll be ero. If there s a sngle error n the measurement set (provded that t s not a crtcal measurement) the largest normaled resdual wll correspond to that error. R r T S T
36 Bad Data Identfcaton Largest Normaled Resdual Test Al Abur. Compute the normaled resduals. Fnd k such that r N k s the largest among all r N,,,m.. 3. If r N k > c3.0, then the k-th measurement wll be suspected as bad data. Else, stop, no bad data wll be suspected. 4. Elmnate the k-th measurement from the measurement set and go to step.
37 Use of Synchrophasor Measurements Al Abur Gven enough phasor measurements, state estmaton problem wll become LINEAR, thus can be solved drectly wthout teratons teratve Non Z R R X e X Z Measurements Phasor Iteratve Z R R X e X h Z Measurements Conventonal T T + + ) ( ˆ ) ( ˆ ) (
38 Placng PMUs: Al Abur : Power Injecton : PMU : Power Flow : Voltage Magntude
39 Explotng ero njectons Al Abur : Power Injecton : PMU : Power Flow : Voltage Magntude
40 Use of Synchrophasor Measurements Al Abur Gven at least one phasor measurement, there wll be no need to use a reference bus n the problem formulaton Gven unlmted number of avalable channels per PMU, t s suffcent to place PMUs at roughly /3 rd of the system buses to make the entre system observable just by PMUs. Systems No. of ero njectons Number of PMUs Ignorng ero Injectons Usng ero njectons 4-bus bus bus 0 3 9
41 Performance Metrcs Al Abur State Estmaton Soluton Accuracy: Varance of State nverse of the gan matrx, [G] - E[ (x x*) (x x*) ] Convergence: Condton Number Rato of the largest to smallest egenvalue Large condton number mples an ll-condtoned problem.
42 Performance Metrcs Al Abur Measurement Desgn Crtcal Measurements: Number of crtcal measurements and ther types Local Redundancy Number of measurements ncdent to a gven bus (N-) Robustness Capablty of the measurement confguraton to render a fully observable system durng sngle measurement and branch losses
43 Summary Al Abur State Estmaton and ts related functons are revewed. Importance of measurement desgn s llustrated. Commonly used methods of dentfyng and elmnatng bad data are descrbed. Impact of ncorporatng phasor measurements on state estmaton s brefly revewed. Metrcs for state estmaton soluton and measurement desgn are suggested.
44 Power Educaton Toolbox (P.E.T) Power Flow and State Estmaton Functons Al Abur Free software to: Buld one-lne dagrams of power networks Run power flow studes Run state estmaton
45 References Al Abur F.C. Schweppe and J. Wldes, ``Power System Statc-State Estmaton, Part I: Exact Model'', IEEE Transactons on Power Apparatus and Systems, Vol.PAS-89, January 970, pp.0-5. F.C. Schweppe and D.B. Rom, ``Power System Statc-State Estmaton, Part II: Approxmate Model'', IEEE Transactons on Power Apparatus and Systems, Vol.PAS-89, January 970, pp F.C. Schweppe, ``Power System Statc-State Estmaton, Part III: Implementaton'', IEEE Transactons on Power Apparatus and Systems, Vol.PAS-89, January 970, pp A. Montcell and A. Garca, "Fast Decoupled State Estmators", IEEE Transactons on Power Systems, Vol.5, No., pp , May 990. A. Montcell and F.F. Wu, ``Network Observablty: Theory'', IEEE Transactons on PAS, Vol.PAS-04, No.5, May 985, pp
46 References Al Abur A. Montcell and F.F. Wu, ``Network Observablty: Identfcaton of Observable Islands and Measurement Placement'', IEEE Transactons on PAS, Vol.PAS-04, No.5, May 985, pp G.R. Krumphol, K.A. Clements and P.W. Davs, ``Power System Observablty: A Practcal Algorthm Usng Network Topology'', IEEE Trans. on Power Apparatus and Systems, Vol. PAS-99, No.4, July/Aug. 980, pp A. Garca, A. Montcell and P. Abreu, ``Fast Decoupled State Estmaton and Bad Data Processng'', IEEE Trans. on Power Apparatus and Systems, Vol. PAS-98, pp , September 979. Xu Be, Yeojun Yoon and A. Abur, Optmal Placement and Utlaton of Phasor Measurements for State Estmaton, 5th Power Systems Computaton Conference Lège (Belgum), August -6, 005.
Hierarchical State Estimation Using Phasor Measurement Units
Herarchcal State Estmaton Usng Phasor Measurement Unts Al Abur Northeastern Unversty Benny Zhao (CA-ISO) and Yeo-Jun Yoon (KPX) IEEE PES GM, Calgary, Canada State Estmaton Workng Group Meetng July 28,
More informationState Estimation. Ali Abur Northeastern University, USA. Nov. 01, 2017 Fall 2017 CURENT Course Lecture Notes
State Estmaton Al Abu Notheasten Unvesty, USA Nov. 0, 07 Fall 07 CURENT Couse Lectue Notes Opeatng States of a Powe System Al Abu NORMAL STATE SECURE o INSECURE RESTORATIVE STATE EMERGENCY STATE PARTIAL
More informationComposite Hypotheses testing
Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter
More informationMaximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models
ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Maxmum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models
More informationMaximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models
ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Mamum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models for
More informationChapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems
Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons
More informationErrors for Linear Systems
Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch
More informationLecture Notes on Linear Regression
Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume
More informationLectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix
Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could
More informationUsing T.O.M to Estimate Parameter of distributions that have not Single Exponential Family
IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationENG 8801/ Special Topics in Computer Engineering: Pattern Recognition. Memorial University of Newfoundland Pattern Recognition
EG 880/988 - Specal opcs n Computer Engneerng: Pattern Recognton Memoral Unversty of ewfoundland Pattern Recognton Lecture 7 May 3, 006 http://wwwengrmunca/~charlesr Offce Hours: uesdays hursdays 8:30-9:30
More informationRole of Synchronized Measurements In Operation of Smart Grids
Role of Synchronized Measurements In Operation of Smart Grids Ali Abur Electrical and Computer Engineering Department Northeastern University Boston, Massachusetts Boston University CISE Seminar November
More informationCIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M
CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute
More informationELE B7 Power Systems Engineering. Power Flow- Introduction
ELE B7 Power Systems Engneerng Power Flow- Introducton Introducton to Load Flow Analyss The power flow s the backbone of the power system operaton, analyss and desgn. It s necessary for plannng, operaton,
More informationNeuro-Adaptive Design - I:
Lecture 36 Neuro-Adaptve Desgn - I: A Robustfyng ool for Dynamc Inverson Desgn Dr. Radhakant Padh Asst. Professor Dept. of Aerospace Engneerng Indan Insttute of Scence - Bangalore Motvaton Perfect system
More informationMATH 829: Introduction to Data Mining and Analysis The EM algorithm (part 2)
1/16 MATH 829: Introducton to Data Mnng and Analyss The EM algorthm (part 2) Domnque Gullot Departments of Mathematcal Scences Unversty of Delaware Aprl 20, 2016 Recall 2/16 We are gven ndependent observatons
More informationStatistical pattern recognition
Statstcal pattern recognton Bayes theorem Problem: decdng f a patent has a partcular condton based on a partcular test However, the test s mperfect Someone wth the condton may go undetected (false negatve
More informationPredictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore
Sesson Outlne Introducton to classfcaton problems and dscrete choce models. Introducton to Logstcs Regresson. Logstc functon and Logt functon. Maxmum Lkelhood Estmator (MLE) for estmaton of LR parameters.
More information8/25/17. Data Modeling. Data Modeling. Data Modeling. Patrice Koehl Department of Biological Sciences National University of Singapore
8/5/17 Data Modelng Patrce Koehl Department of Bologcal Scences atonal Unversty of Sngapore http://www.cs.ucdavs.edu/~koehl/teachng/bl59 koehl@cs.ucdavs.edu Data Modelng Ø Data Modelng: least squares Ø
More informationFinite Mixture Models and Expectation Maximization. Most slides are from: Dr. Mario Figueiredo, Dr. Anil Jain and Dr. Rong Jin
Fnte Mxture Models and Expectaton Maxmzaton Most sldes are from: Dr. Maro Fgueredo, Dr. Anl Jan and Dr. Rong Jn Recall: The Supervsed Learnng Problem Gven a set of n samples X {(x, y )},,,n Chapter 3 of
More informationBasic Statistical Analysis and Yield Calculations
October 17, 007 Basc Statstcal Analyss and Yeld Calculatons Dr. José Ernesto Rayas Sánchez 1 Outlne Sources of desgn-performance uncertanty Desgn and development processes Desgn for manufacturablty A general
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models
More informationj) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1
Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons
More informationThe Geometry of Logit and Probit
The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More informationHowever, since P is a symmetric idempotent matrix, of P are either 0 or 1 [Eigen-values
Fall 007 Soluton to Mdterm Examnaton STAT 7 Dr. Goel. [0 ponts] For the general lnear model = X + ε, wth uncorrelated errors havng mean zero and varance σ, suppose that the desgn matrx X s not necessarly
More informationρ some λ THE INVERSE POWER METHOD (or INVERSE ITERATION) , for , or (more usually) to
THE INVERSE POWER METHOD (or INVERSE ITERATION) -- applcaton of the Power method to A some fxed constant ρ (whch s called a shft), x λ ρ If the egenpars of A are { ( λ, x ) } ( ), or (more usually) to,
More informationAppendix B: Resampling Algorithms
407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles
More informationLecture 12: Classification
Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna
More informationLimited Dependent Variables
Lmted Dependent Varables. What f the left-hand sde varable s not a contnuous thng spread from mnus nfnty to plus nfnty? That s, gven a model = f (, β, ε, where a. s bounded below at zero, such as wages
More informationEstimation: Part 2. Chapter GREG estimation
Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the
More informationPrimer on High-Order Moment Estimators
Prmer on Hgh-Order Moment Estmators Ton M. Whted July 2007 The Errors-n-Varables Model We wll start wth the classcal EIV for one msmeasured regressor. The general case s n Erckson and Whted Econometrc
More informationDigital Modems. Lecture 2
Dgtal Modems Lecture Revew We have shown that both Bayes and eyman/pearson crtera are based on the Lkelhood Rato Test (LRT) Λ ( r ) < > η Λ r s called observaton transformaton or suffcent statstc The crtera
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More informationParametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010
Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton
More informationAPPENDIX A Some Linear Algebra
APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,
More informationChapter 11: Simple Linear Regression and Correlation
Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests
More informationFeb 14: Spatial analysis of data fields
Feb 4: Spatal analyss of data felds Mappng rregularly sampled data onto a regular grd Many analyss technques for geophyscal data requre the data be located at regular ntervals n space and/or tme. hs s
More informationLecture 3: Probability Distributions
Lecture 3: Probablty Dstrbutons Random Varables Let us begn by defnng a sample space as a set of outcomes from an experment. We denote ths by S. A random varable s a functon whch maps outcomes nto the
More informationChapter - 2. Distribution System Power Flow Analysis
Chapter - 2 Dstrbuton System Power Flow Analyss CHAPTER - 2 Radal Dstrbuton System Load Flow 2.1 Introducton Load flow s an mportant tool [66] for analyzng electrcal power system network performance. Load
More information3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X
Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number
More informationANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)
Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of
More informationConvergence of random processes
DS-GA 12 Lecture notes 6 Fall 216 Convergence of random processes 1 Introducton In these notes we study convergence of dscrete random processes. Ths allows to characterze phenomena such as the law of large
More informationP R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering /
Theory and Applcatons of Pattern Recognton 003, Rob Polkar, Rowan Unversty, Glassboro, NJ Lecture 4 Bayes Classfcaton Rule Dept. of Electrcal and Computer Engneerng 0909.40.0 / 0909.504.04 Theory & Applcatons
More informationInexact Newton Methods for Inverse Eigenvalue Problems
Inexact Newton Methods for Inverse Egenvalue Problems Zheng-jan Ba Abstract In ths paper, we survey some of the latest development n usng nexact Newton-lke methods for solvng nverse egenvalue problems.
More informationLinear Regression Analysis: Terminology and Notation
ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented
More informationSystems of Equations (SUR, GMM, and 3SLS)
Lecture otes on Advanced Econometrcs Takash Yamano Fall Semester 4 Lecture 4: Sstems of Equatons (SUR, MM, and 3SLS) Seemngl Unrelated Regresson (SUR) Model Consder a set of lnear equatons: $ + ɛ $ + ɛ
More informationLecture 4 Hypothesis Testing
Lecture 4 Hypothess Testng We may wsh to test pror hypotheses about the coeffcents we estmate. We can use the estmates to test whether the data rejects our hypothess. An example mght be that we wsh to
More informationFirst Year Examination Department of Statistics, University of Florida
Frst Year Examnaton Department of Statstcs, Unversty of Florda May 7, 010, 8:00 am - 1:00 noon Instructons: 1. You have four hours to answer questons n ths examnaton.. You must show your work to receve
More informationn α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0
MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed
More informationGoodness of fit and Wilks theorem
DRAFT 0.0 Glen Cowan 3 June, 2013 Goodness of ft and Wlks theorem Suppose we model data y wth a lkelhood L(µ) that depends on a set of N parameters µ = (µ 1,...,µ N ). Defne the statstc t µ ln L(µ) L(ˆµ),
More informationU.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017
U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that
More informationLecture 21: Numerical methods for pricing American type derivatives
Lecture 21: Numercal methods for prcng Amercan type dervatves Xaoguang Wang STAT 598W Aprl 10th, 2014 (STAT 598W) Lecture 21 1 / 26 Outlne 1 Fnte Dfference Method Explct Method Penalty Method (STAT 598W)
More information10-801: Advanced Optimization and Randomized Methods Lecture 2: Convex functions (Jan 15, 2014)
0-80: Advanced Optmzaton and Randomzed Methods Lecture : Convex functons (Jan 5, 04) Lecturer: Suvrt Sra Addr: Carnege Mellon Unversty, Sprng 04 Scrbes: Avnava Dubey, Ahmed Hefny Dsclamer: These notes
More informationComparison of Regression Lines
STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence
More informationStanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011
Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected
More informationWinter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan
Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments
More information2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification
E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton
More informationLogistic Regression. CAP 5610: Machine Learning Instructor: Guo-Jun QI
Logstc Regresson CAP 561: achne Learnng Instructor: Guo-Jun QI Bayes Classfer: A Generatve model odel the posteror dstrbuton P(Y X) Estmate class-condtonal dstrbuton P(X Y) for each Y Estmate pror dstrbuton
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 31 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 6. Rdge regresson The OLSE s the best lnear unbased
More informationC4B Machine Learning Answers II. = σ(z) (1 σ(z)) 1 1 e z. e z = σ(1 σ) (1 + e z )
C4B Machne Learnng Answers II.(a) Show that for the logstc sgmod functon dσ(z) dz = σ(z) ( σ(z)) A. Zsserman, Hlary Term 20 Start from the defnton of σ(z) Note that Then σ(z) = σ = dσ(z) dz = + e z e z
More informationSee Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition)
Count Data Models See Book Chapter 11 2 nd Edton (Chapter 10 1 st Edton) Count data consst of non-negatve nteger values Examples: number of drver route changes per week, the number of trp departure changes
More informationPerron Vectors of an Irreducible Nonnegative Interval Matrix
Perron Vectors of an Irreducble Nonnegatve Interval Matrx Jr Rohn August 4 2005 Abstract As s well known an rreducble nonnegatve matrx possesses a unquely determned Perron vector. As the man result of
More informationT E C O L O T E R E S E A R C H, I N C.
T E C O L O T E R E S E A R C H, I N C. B rdg n g En g neern g a nd Econo mcs S nce 1973 THE MINIMUM-UNBIASED-PERCENTAGE ERROR (MUPE) METHOD IN CER DEVELOPMENT Thrd Jont Annual ISPA/SCEA Internatonal Conference
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Exerments-I MODULE II LECTURE - GENERAL LINEAR HYPOTHESIS AND ANALYSIS OF VARIANCE Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 3.
More informationLecture 3: Shannon s Theorem
CSE 533: Error-Correctng Codes (Autumn 006 Lecture 3: Shannon s Theorem October 9, 006 Lecturer: Venkatesan Guruswam Scrbe: Wdad Machmouch 1 Communcaton Model The communcaton model we are usng conssts
More informationHidden Markov Models
Hdden Markov Models Namrata Vaswan, Iowa State Unversty Aprl 24, 204 Hdden Markov Model Defntons and Examples Defntons:. A hdden Markov model (HMM) refers to a set of hdden states X 0, X,..., X t,...,
More informationReview: Fit a line to N data points
Revew: Ft a lne to data ponts Correlated parameters: L y = a x + b Orthogonal parameters: J y = a (x ˆ x + b For ntercept b, set a=0 and fnd b by optmal average: ˆ b = y, Var[ b ˆ ] = For slope a, set
More informationEcon Statistical Properties of the OLS estimator. Sanjaya DeSilva
Econ 39 - Statstcal Propertes of the OLS estmator Sanjaya DeSlva September, 008 1 Overvew Recall that the true regresson model s Y = β 0 + β 1 X + u (1) Applyng the OLS method to a sample of data, we estmate
More informationU-Pb Geochronology Practical: Background
U-Pb Geochronology Practcal: Background Basc Concepts: accuracy: measure of the dfference between an expermental measurement and the true value precson: measure of the reproducblty of the expermental result
More informationGeneralized Linear Methods
Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set
More informationChapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the
More information4DVAR, according to the name, is a four-dimensional variational method.
4D-Varatonal Data Assmlaton (4D-Var) 4DVAR, accordng to the name, s a four-dmensonal varatonal method. 4D-Var s actually a drect generalzaton of 3D-Var to handle observatons that are dstrbuted n tme. The
More informationFor now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.
Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson
More informationOn the Multicriteria Integer Network Flow Problem
BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of
More informationExperience with Automatic Generation Control (AGC) Dynamic Simulation in PSS E
Semens Industry, Inc. Power Technology Issue 113 Experence wth Automatc Generaton Control (AGC) Dynamc Smulaton n PSS E Lu Wang, Ph.D. Staff Software Engneer lu_wang@semens.com Dngguo Chen, Ph.D. Staff
More informationInner Product. Euclidean Space. Orthonormal Basis. Orthogonal
Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,
More informationOn a direct solver for linear least squares problems
ISSN 2066-6594 Ann. Acad. Rom. Sc. Ser. Math. Appl. Vol. 8, No. 2/2016 On a drect solver for lnear least squares problems Constantn Popa Abstract The Null Space (NS) algorthm s a drect solver for lnear
More informationVector Norms. Chapter 7 Iterative Techniques in Matrix Algebra. Cauchy-Bunyakovsky-Schwarz Inequality for Sums. Distances. Convergence.
Vector Norms Chapter 7 Iteratve Technques n Matrx Algebra Per-Olof Persson persson@berkeley.edu Department of Mathematcs Unversty of Calforna, Berkeley Math 128B Numercal Analyss Defnton A vector norm
More informationDigital Signal Processing
Dgtal Sgnal Processng Dscrete-tme System Analyss Manar Mohasen Offce: F8 Emal: manar.subh@ut.ac.r School of IT Engneerng Revew of Precedent Class Contnuous Sgnal The value of the sgnal s avalable over
More informationHydrological statistics. Hydrological statistics and extremes
5--0 Stochastc Hydrology Hydrologcal statstcs and extremes Marc F.P. Berkens Professor of Hydrology Faculty of Geoscences Hydrologcal statstcs Mostly concernes wth the statstcal analyss of hydrologcal
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experments- MODULE LECTURE - 6 EXPERMENTAL DESGN MODELS Dr. Shalabh Department of Mathematcs and Statstcs ndan nsttute of Technology Kanpur Two-way classfcaton wth nteractons
More informationEstimating the Fundamental Matrix by Transforming Image Points in Projective Space 1
Estmatng the Fundamental Matrx by Transformng Image Ponts n Projectve Space 1 Zhengyou Zhang and Charles Loop Mcrosoft Research, One Mcrosoft Way, Redmond, WA 98052, USA E-mal: fzhang,cloopg@mcrosoft.com
More informationLecture 4: Universal Hash Functions/Streaming Cont d
CSE 5: Desgn and Analyss of Algorthms I Sprng 06 Lecture 4: Unversal Hash Functons/Streamng Cont d Lecturer: Shayan Oves Gharan Aprl 6th Scrbe: Jacob Schreber Dsclamer: These notes have not been subjected
More informationβ0 + β1xi and want to estimate the unknown
SLR Models Estmaton Those OLS Estmates Estmators (e ante) v. estmates (e post) The Smple Lnear Regresson (SLR) Condtons -4 An Asde: The Populaton Regresson Functon B and B are Lnear Estmators (condtonal
More informationxp(x µ) = 0 p(x = 0 µ) + 1 p(x = 1 µ) = µ
CSE 455/555 Sprng 2013 Homework 7: Parametrc Technques Jason J. Corso Computer Scence and Engneerng SUY at Buffalo jcorso@buffalo.edu Solutons by Yngbo Zhou Ths assgnment does not need to be submtted and
More informationNumerical Heat and Mass Transfer
Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and
More informationThe conjugate prior to a Bernoulli is. A) Bernoulli B) Gaussian C) Beta D) none of the above
The conjugate pror to a Bernoull s A) Bernoull B) Gaussan C) Beta D) none of the above The conjugate pror to a Gaussan s A) Bernoull B) Gaussan C) Beta D) none of the above MAP estmates A) argmax θ p(θ
More information2 STATISTICALLY OPTIMAL TRAINING DATA 2.1 A CRITERION OF OPTIMALITY We revew the crteron of statstcally optmal tranng data (Fukumzu et al., 1994). We
Advances n Neural Informaton Processng Systems 8 Actve Learnng n Multlayer Perceptrons Kenj Fukumzu Informaton and Communcaton R&D Center, Rcoh Co., Ltd. 3-2-3, Shn-yokohama, Yokohama, 222 Japan E-mal:
More informationEffects of Ignoring Correlations When Computing Sample Chi-Square. John W. Fowler February 26, 2012
Effects of Ignorng Correlatons When Computng Sample Ch-Square John W. Fowler February 6, 0 It can happen that ch-square must be computed for a sample whose elements are correlated to an unknown extent.
More information4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA
4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected
More informationSTAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 16
STAT 39: MATHEMATICAL COMPUTATIONS I FALL 218 LECTURE 16 1 why teratve methods f we have a lnear system Ax = b where A s very, very large but s ether sparse or structured (eg, banded, Toepltz, banded plus
More informationOn an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1
On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool
More informationMLE and Bayesian Estimation. Jie Tang Department of Computer Science & Technology Tsinghua University 2012
MLE and Bayesan Estmaton Je Tang Department of Computer Scence & Technology Tsnghua Unversty 01 1 Lnear Regresson? As the frst step, we need to decde how we re gong to represent the functon f. One example:
More informationwhere I = (n x n) diagonal identity matrix with diagonal elements = 1 and off-diagonal elements = 0; and σ 2 e = variance of (Y X).
11.4.1 Estmaton of Multple Regresson Coeffcents In multple lnear regresson, we essentally solve n equatons for the p unnown parameters. hus n must e equal to or greater than p and n practce n should e
More informationThe Ordinary Least Squares (OLS) Estimator
The Ordnary Least Squares (OLS) Estmator 1 Regresson Analyss Regresson Analyss: a statstcal technque for nvestgatng and modelng the relatonshp between varables. Applcatons: Engneerng, the physcal and chemcal
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informatione i is a random error
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown
More information