A Robust State Estimator Based on Maximum Exponential Square (MES)

Size: px
Start display at page:

Download "A Robust State Estimator Based on Maximum Exponential Square (MES)"

Transcription

1 11 th Int. Workshop on EPCC, May -5, 011, Altea, Spain A Robust State Estimator Based on Maimum Eponential Square (MES) Wenchuan Wu Ye Guo Boming Zhang, et al Dept. of Electrical Eng. Tsinghua University Beijing, China

2 Introduction How to suppress bad data in SE? Largest normalized residual (LNR) approach Residual smearing problem? Robust estimator M-estimators (Such as WLAV, QC, QL, SHGM) leverage bad data? Calculation speed?

3 Introduction() The Proposed Maimum Eponential Square (MES) Estimator Differentiable objective function Avoid leverage point problem Strong ability to suppress bad data Similar implementation with WLS estimator Fast calculation speed (approaches the speed of FDSE+LNR)

4 Maimum Eponential Square (MES) Model For measurement equation z h() e A maimization problem with eponential square objective function m ma J ( ) wi ep( rsi ) i 1 r si = z i h( ) i

5 Mathematical Characteristics Larger residual has less impact on objective function 1. ep( r si ) BD 0. r si

6 Eplained by information theory Parzen window method with Gaussian kernel: The estimated pdf for random variable f e γ m 1 1 z ep i zi n (1) m i 1 σ: The width of Parzen window A nonparametric estimation method No prior knowledge about the random variables distribution type is needed, so gross errors can be treated in Parzen window method T

7 Eplained by information theory() If the information loss of the estimator is measured by Renyi s quadratic entropy as follows H f d e log e e e Maimizing (1), as done in MES method, is just to minimize (), the information loss of the estimator

8 MES vs WLS If no gross error eists, the MES estimator can be epanded into a Taylor series such as i. e. m m 4 i si i si si i 1 i 1 ma J ( ) w ep r w 1 r o r min m i 1 wr i si MES..WLS Which is similar with WLS estimator

9 Solution Method -Optimization condition: J i m 1 i T H W( )( z h( )) 0 f( ) 0 i ( ) wi ep( rsi ) Wii ( ) i ( ) / Hessian matri: J T ( ) H W( ) I diag{ z h } Q Newton Iteration: Q k -H T W( k )( z h( k )) f k 1 k k f f ( )

10 Leverage Point Problem The relationship between residual r and measurement error e r = Ke K: residual sensitivity matri For WLS estimator: WLS T -1-1 T -1 K = I - H H R H H R The K WLS is less relevant with measurement values K ii 0 for a leverage point

11 Leverage Point Problem() For MES estimator: The K WLS is relevant with measurement value For the bad measurement i with a large residual, ( ) w ep( r ) the corresponding MES -1 T K = I - HQ H W W ( ) ( ) / 0 ii i MES K ii 1 i i si MES estimator can successfully identify BD even at conventional leverage point.

12 Leverage Point Test Measurement 1 is a leverage point in WLS estimator (due to the small reactance of branch 1-) Gross error is added to measurement 1 MES estimator did not suffer leverage point problem =0.1 p.u. 5 =1.0 p.u. 1 3 V =1.0 p.u. V V

13 Global Optimal Point MES method is similar to Parzen window method. In the Parzen window method, the average value of pdf in the Parzen window is assumed as the value of pdf at the window s centre point. If is smaller, the assumption is correct. If is larger, optimal solution may deviate from true value. should be adjusted from larger to smaller so as for the MES estimator to reach the true optimal solution

14 Global Optimal Point() 1.05 (1.05) Bus1 Bus r+j=0.+j One BD J() P 1 +jq 1 =0.695+j ( j0.0684) (0.663+j0.0677) smaller J() P 1 +jq 1 = j ( j0.0715) (0.51-j0.071) larger

15 How to get global optimal point adjust σ step by step from a larger to a smaller. The converge domain of Newton method: Keep Hessian matri f negative definite at each adjust step f ( ) f k 1 f k f( ) J( ) 0 ˆ k 1 ˆ 0 1 k Converge interval of in Newton method ˆ 1

16 Numerical Results 9-bus system Conforming errors at 3 rd and 4 th TR#1 Bus1 BusA Bus Gen Gen1 1 BusB BusC TR# 3 4 TR#3 Bus3 Gen3

17 Numerical Results() Bad Data wrongly estimated Correctly estimated Measurement Number True value 1 Meas. value FDSE+LNR method Estimated Meas. 3 Meas. est. Error 1-3 Estimated Meas. 4 MES method Meas. est. error st nd rd ( ) 4 th LNR method fails to identify these conforming errors MES estimator estimates accurate results directly

18 Objective function ωi() for measurement i values Numerical Results(3) ( ) 1. 1st nd 3r d 4t h Good data Times of σ tunning i ( ) wi ep( rsi ) Bad data J() Times of σ tunning m J ( ) ( ) From down to 0 i 1 i

19 Numerical tests 118-bus system Totally 11 different bad data percentages ranging from 0% to 10% are generated For each bad data percentage, 30 different cases are randomly produced and calculated the averages of mean absolute estimation errors of bus voltages and angles under each bad data percentage are recorded

20 Numerical tests() (Average est. err.) Mean est. error of V, p.u. Mean est. error of θ, rad V θ FDSE+LNR MES Bad data percentage, % FDSE+LNR MES Bad data percentage,% FDSE+LNR MES FDSE+LNR MES

21 Practical Applications A provincial power system in Central-China 546 buses, 737 branches, daily peak load 8GW Measurement acceptance rate inde : n m 100% n : the number of measurements whose residual is less than a threshold. m : the number of whole measurements

22 Practical Application() η inde η (%) CPU t i me( s) FDSE+LNR MES Case ID CPU time FDSE+LNR MES Case I D MES(93-94%) FDSE+LNR (90-9%) MES(5 sec) FDSE+LNR(4 sec)

23 Practical Application(3) Residual distribution: MES estimator separates more residuals to a small region and to a significant large region. Number of measurements Clearly good MES FDSE+LNR MES Lacking clarity [0,1) [1,) [,3) [3,4) [4,5) [5,6) [6,7) [7, ) Weighted residual region Clearly bad

24 Thank You!

Believability Evaluation of a State Estimation Result

Believability Evaluation of a State Estimation Result 13 th Int. Workshop on EPCC, May 17-20, 2015, Bled, Slovenia Believability Evaluation of a State Estimation Result Boming Zhang Ph D, Prof. IEEE Fellow Dept. of Electrical Eng. Tsinghua University Beijing,

More information

A Fast Solution for the Lagrange Multiplier-Based Electric Power Network Parameter Error Identification Model

A Fast Solution for the Lagrange Multiplier-Based Electric Power Network Parameter Error Identification Model Energies 2014, 7, 1288-1299; doi:10.3390/en7031288 Article OPE ACCESS energies ISS 1996-1073 www.mdpi.com/journal/energies A Fast Solution for the Lagrange ultiplier-based Electric Power etwork Parameter

More information

Weighted Least Squares Topology Error Detection And Identification

Weighted Least Squares Topology Error Detection And Identification Weighted Least Squares Topology Error Detection And Identification A THESIS SUBMITTED TO THE FACULTY OF THE GRADUATE SCHOOL OF THE UNIVERSITY OF MINNESOTA BY Jason Glen Lindquist IN PARTIAL FULFILLMENT

More information

ECEN 615 Methods of Electric Power Systems Analysis Lecture 19: State Estimation

ECEN 615 Methods of Electric Power Systems Analysis Lecture 19: State Estimation ECEN 615 Methods of Electric Power Systems Analysis Lecture 19: State Estimation Prof. Tom Overbye Dept. of Electrical and Computer Engineering Texas A&M University overbye@tamu.edu Announcements Homework

More information

STATE ESTIMATION IN DISTRIBUTION SYSTEMS

STATE ESTIMATION IN DISTRIBUTION SYSTEMS SAE ESIMAION IN DISRIBUION SYSEMS 2015 CIGRE Grid of the Future Symposium Chicago (IL), October 13, 2015 L. Garcia-Garcia, D. Apostolopoulou Laura.GarciaGarcia@ComEd.com Dimitra.Apostolopoulou@ComEd.com

More information

State Estimation and Power Flow Analysis of Power Systems

State Estimation and Power Flow Analysis of Power Systems JOURNAL OF COMPUTERS, VOL. 7, NO. 3, MARCH 01 685 State Estimation and Power Flow Analysis of Power Systems Jiaxiong Chen University of Kentucky, Lexington, Kentucky 40508 U.S.A. Email: jch@g.uky.edu Yuan

More information

Beyond Newton s method Thomas P. Minka

Beyond Newton s method Thomas P. Minka Beyond Newton s method Thomas P. Minka 2000 (revised 7/21/2017) Abstract Newton s method for optimization is equivalent to iteratively maimizing a local quadratic approimation to the objective function.

More information

State Estimation Introduction 2.0 Exact Pseudo-measurments

State Estimation Introduction 2.0 Exact Pseudo-measurments State Estimation. Introduction In these notes, we eplore two very practical and related issues in regards to state estimation: - use of pseudo-measurements - network observability. Eact Pseudo-measurments

More information

18-660: Numerical Methods for Engineering Design and Optimization

18-660: Numerical Methods for Engineering Design and Optimization 8-66: Numerical Methods or Engineering Design and Optimization Xin Li Department o ECE Carnegie Mellon University Pittsburgh, PA 53 Slide Overview Linear Regression Ordinary least-squares regression Minima

More information

EE 581 Power Systems. Admittance Matrix: Development, Direct and Iterative solutions

EE 581 Power Systems. Admittance Matrix: Development, Direct and Iterative solutions EE 581 Power Systems Admittance Matrix: Development, Direct and Iterative solutions Overview and HW # 8 Chapter 2.4 Chapter 6.4 Chapter 6.1-6.3 Homework: Special Problem 1 and 2 (see handout) Overview

More information

STOCHASTIC INFORMATION GRADIENT ALGORITHM BASED ON MAXIMUM ENTROPY DENSITY ESTIMATION. Badong Chen, Yu Zhu, Jinchun Hu and Ming Zhang

STOCHASTIC INFORMATION GRADIENT ALGORITHM BASED ON MAXIMUM ENTROPY DENSITY ESTIMATION. Badong Chen, Yu Zhu, Jinchun Hu and Ming Zhang ICIC Express Letters ICIC International c 2009 ISSN 1881-803X Volume 3, Number 3, September 2009 pp. 1 6 STOCHASTIC INFORMATION GRADIENT ALGORITHM BASED ON MAXIMUM ENTROPY DENSITY ESTIMATION Badong Chen,

More information

Noise-Blind Image Deblurring Supplementary Material

Noise-Blind Image Deblurring Supplementary Material Noise-Blind Image Deblurring Supplementary Material Meiguang Jin University of Bern Switzerland Stefan Roth TU Darmstadt Germany Paolo Favaro University of Bern Switzerland A. Upper and Lower Bounds Our

More information

Mixed Integer Linear Programming and Nonlinear Programming for Optimal PMU Placement

Mixed Integer Linear Programming and Nonlinear Programming for Optimal PMU Placement Mied Integer Linear Programg and Nonlinear Programg for Optimal PMU Placement Anas Almunif Department of Electrical Engineering University of South Florida, Tampa, FL 33620, USA Majmaah University, Al

More information

CHAPTER 2 LOAD FLOW ANALYSIS FOR RADIAL DISTRIBUTION SYSTEM

CHAPTER 2 LOAD FLOW ANALYSIS FOR RADIAL DISTRIBUTION SYSTEM 16 CHAPTER 2 LOAD FLOW ANALYSIS FOR RADIAL DISTRIBUTION SYSTEM 2.1 INTRODUCTION Load flow analysis of power system network is used to determine the steady state solution for a given set of bus loading

More information

= V I = Bus Admittance Matrix. Chapter 6: Power Flow. Constructing Ybus. Example. Network Solution. Triangular factorization. Let

= V I = Bus Admittance Matrix. Chapter 6: Power Flow. Constructing Ybus. Example. Network Solution. Triangular factorization. Let Chapter 6: Power Flow Network Matrices Network Solutions Newton-Raphson Method Fast Decoupled Method Bus Admittance Matri Let I = vector of currents injected into nodes V = vector of node voltages Y bus

More information

Soft Sensor Modelling based on Just-in-Time Learning and Bagging-PLS for Fermentation Processes

Soft Sensor Modelling based on Just-in-Time Learning and Bagging-PLS for Fermentation Processes 1435 A publication of CHEMICAL ENGINEERING TRANSACTIONS VOL. 70, 2018 Guest Editors: Timothy G. Walmsley, Petar S. Varbanov, Rongin Su, Jiří J. Klemeš Copyright 2018, AIDIC Servizi S.r.l. ISBN 978-88-95608-67-9;

More information

6.867 Machine learning

6.867 Machine learning 6.867 Machine learning Mid-term eam October 8, 6 ( points) Your name and MIT ID: .5.5 y.5 y.5 a).5.5 b).5.5.5.5 y.5 y.5 c).5.5 d).5.5 Figure : Plots of linear regression results with different types of

More information

Curve Fitting Re-visited, Bishop1.2.5

Curve Fitting Re-visited, Bishop1.2.5 Curve Fitting Re-visited, Bishop1.2.5 Maximum Likelihood Bishop 1.2.5 Model Likelihood differentiation p(t x, w, β) = Maximum Likelihood N N ( t n y(x n, w), β 1). (1.61) n=1 As we did in the case of the

More information

Cyber Attacks, Detection and Protection in Smart Grid State Estimation

Cyber Attacks, Detection and Protection in Smart Grid State Estimation 1 Cyber Attacks, Detection and Protection in Smart Grid State Estimation Yi Zhou, Student Member, IEEE Zhixin Miao, Senior Member, IEEE Abstract This paper reviews the types of cyber attacks in state estimation

More information

OPTIMAL PLACEMENT AND UTILIZATION OF PHASOR MEASUREMENTS FOR STATE ESTIMATION

OPTIMAL PLACEMENT AND UTILIZATION OF PHASOR MEASUREMENTS FOR STATE ESTIMATION OPTIMAL PLACEMENT AND UTILIZATION OF PHASOR MEASUREMENTS FOR STATE ESTIMATION Xu Bei, Yeo Jun Yoon and Ali Abur Teas A&M University College Station, Teas, U.S.A. abur@ee.tamu.edu Abstract This paper presents

More information

Algebra of Random Variables: Optimal Average and Optimal Scaling Minimising

Algebra of Random Variables: Optimal Average and Optimal Scaling Minimising Review: Optimal Average/Scaling is equivalent to Minimise χ Two 1-parameter models: Estimating < > : Scaling a pattern: Two equivalent methods: Algebra of Random Variables: Optimal Average and Optimal

More information

Recursive Estimation

Recursive Estimation Recursive Estimation Raffaello D Andrea Spring 07 Problem Set 3: Etracting Estimates from Probability Distributions Last updated: April 5, 07 Notes: Notation: Unlessotherwisenoted,, y,andz denoterandomvariables,

More information

Inf2b Learning and Data

Inf2b Learning and Data Inf2b Learning and Data Lecture : Single layer Neural Networks () (Credit: Hiroshi Shimodaira Iain Murray and Steve Renals) Centre for Speech Technology Research (CSTR) School of Informatics University

More information

Power grid vulnerability analysis

Power grid vulnerability analysis Power grid vulnerability analysis Daniel Bienstock Columbia University Dimacs 2010 Daniel Bienstock (Columbia University) Power grid vulnerability analysis Dimacs 2010 1 Background: a power grid is three

More information

Role of Synchronized Measurements In Operation of Smart Grids

Role of Synchronized Measurements In Operation of Smart Grids Role of Synchronized Measurements In Operation of Smart Grids Ali Abur Electrical and Computer Engineering Department Northeastern University Boston, Massachusetts Boston University CISE Seminar November

More information

Calculus B Exam III (Page 1) May 11, 2012

Calculus B Exam III (Page 1) May 11, 2012 Calculus B Eam III (Page ) May, 0 Name: Instructions: Provide all steps necessary to solve the problem. Unless otherwise stated, your answer must be eact and reasonably simplified. Additionally, clearly

More information

Where now? Machine Learning and Bayesian Inference

Where now? Machine Learning and Bayesian Inference Machine Learning and Bayesian Inference Dr Sean Holden Computer Laboratory, Room FC6 Telephone etension 67 Email: sbh@clcamacuk wwwclcamacuk/ sbh/ Where now? There are some simple take-home messages from

More information

Introduction to State Estimation of Power Systems ECG 740

Introduction to State Estimation of Power Systems ECG 740 Introduction to State Estimation of Power Systems ECG 740 Introduction To help avoid major system failures, electric utilities have installed extensive supervisory control and data acquisition (SCADA)

More information

MACHINE LEARNING ADVANCED MACHINE LEARNING

MACHINE LEARNING ADVANCED MACHINE LEARNING MACHINE LEARNING ADVANCED MACHINE LEARNING Recap of Important Notions on Estimation of Probability Density Functions 2 2 MACHINE LEARNING Overview Definition pdf Definition joint, condition, marginal,

More information

A Practitioner s Guide to Generalized Linear Models

A Practitioner s Guide to Generalized Linear Models A Practitioners Guide to Generalized Linear Models Background The classical linear models and most of the minimum bias procedures are special cases of generalized linear models (GLMs). GLMs are more technically

More information

Equations Quadratic in Form NOT AVAILABLE FOR ELECTRONIC VIEWING. B x = 0 u = x 1 3

Equations Quadratic in Form NOT AVAILABLE FOR ELECTRONIC VIEWING. B x = 0 u = x 1 3 SECTION.4 Equations Quadratic in Form 785 In Eercises, without solving the equation, determine the number and type of solutions... In Eercises 3 4, write a quadratic equation in standard form with the

More information

PDF Estimation via Characteristic Function and an Orthonormal Basis Set

PDF Estimation via Characteristic Function and an Orthonormal Basis Set PDF Estimation via Characteristic Function and an Orthonormal Basis Set ROY M. HOWARD School of Electrical Engineering and Computing Curtin University of Technology GPO Bo U987, Perth 6845. AUSTRALIA r.howard@echange.curtin.edu.au

More information

MEASUREMENTS that are telemetered to the control

MEASUREMENTS that are telemetered to the control 2006 IEEE TRANSACTIONS ON POWER SYSTEMS, VOL. 19, NO. 4, NOVEMBER 2004 Auto Tuning of Measurement Weights in WLS State Estimation Shan Zhong, Student Member, IEEE, and Ali Abur, Fellow, IEEE Abstract This

More information

Effects of Various Uncertainty Sources on Automatic Generation Control Systems

Effects of Various Uncertainty Sources on Automatic Generation Control Systems Effects of Various Uncertainty Sources on Automatic Generation Control Systems D. Apostolopoulou, Y. C. Chen, J. Zhang, A. D. Domínguez-García, and P. W. Sauer University of Illinois at Urbana-Champaign

More information

abc Mathematics Further Pure General Certificate of Education SPECIMEN UNITS AND MARK SCHEMES

abc Mathematics Further Pure General Certificate of Education SPECIMEN UNITS AND MARK SCHEMES abc General Certificate of Education Mathematics Further Pure SPECIMEN UNITS AND MARK SCHEMES ADVANCED SUBSIDIARY MATHEMATICS (56) ADVANCED SUBSIDIARY PURE MATHEMATICS (566) ADVANCED SUBSIDIARY FURTHER

More information

EECS 545 Project Progress Report Sparse Kernel Density Estimates B.Gopalakrishnan, G.Bellala, G.Devadas, K.Sricharan

EECS 545 Project Progress Report Sparse Kernel Density Estimates B.Gopalakrishnan, G.Bellala, G.Devadas, K.Sricharan EECS 545 Project Progress Report Sparse Kernel Density Estimates B.Gopalakrishnan, G.Bellala, G.Devadas, K.Sricharan Introduction Density estimation forms the backbone for numerous machine learning algorithms

More information

Particle Methods as Message Passing

Particle Methods as Message Passing Particle Methods as Message Passing Justin Dauwels RIKEN Brain Science Institute Hirosawa,2-1,Wako-shi,Saitama,Japan Email: justin@dauwels.com Sascha Korl Phonak AG CH-8712 Staefa, Switzerland Email: sascha.korl@phonak.ch

More information

DCDM BUSINESS SCHOOL FACULTY OF MANAGEMENT ECONOMIC TECHNIQUES 102 LECTURE 3 NON-LINEAR FUNCTIONS

DCDM BUSINESS SCHOOL FACULTY OF MANAGEMENT ECONOMIC TECHNIQUES 102 LECTURE 3 NON-LINEAR FUNCTIONS DCDM BUSINESS SCHOOL FACULTY OF MANAGEMENT ECONOMIC TECHNIQUES 10 LECTURE NON-LINEAR FUNCTIONS 0. Preliminaries The following functions will be discussed briefly first: Quadratic functions and their solutions

More information

Transform Techniques - CF

Transform Techniques - CF Transform Techniques - CF [eview] Moment Generating Function For a real t, the MGF of the random variable is t t M () t E[ e ] e Characteristic Function (CF) k t k For a real ω, the characteristic function

More information

Computing Maximum Entropy Densities: A Hybrid Approach

Computing Maximum Entropy Densities: A Hybrid Approach Computing Maximum Entropy Densities: A Hybrid Approach Badong Chen Department of Precision Instruments and Mechanology Tsinghua University Beijing, 84, P. R. China Jinchun Hu Department of Precision Instruments

More information

Sparsity. The implication is that we would like to find ways to increase efficiency of LU decomposition.

Sparsity. The implication is that we would like to find ways to increase efficiency of LU decomposition. Sparsity. Introduction We saw in previous notes that the very common problem, to solve for the n vector in A b ( when n is very large, is done without inverting the n n matri A, using LU decomposition.

More information

AS conceived during the 1970 s [1], [2], [3], [4] State

AS conceived during the 1970 s [1], [2], [3], [4] State A Framework for Estimation of Power Systems Based on Synchronized Phasor Measurement Data Luigi Vanfretti, Student Member, IEEE, Joe H. Chow, Fellow, IEEE, Sanjoy Sarawgi, Member, IEEE, Dean Ellis and

More information

Incorporation of Asynchronous Generators as PQ Model in Load Flow Analysis for Power Systems with Wind Generation

Incorporation of Asynchronous Generators as PQ Model in Load Flow Analysis for Power Systems with Wind Generation Incorporation of Asynchronous Generators as PQ Model in Load Flow Analysis for Power Systems with Wind Generation James Ranjith Kumar. R, Member, IEEE, Amit Jain, Member, IEEE, Power Systems Division,

More information

CS 534: Computer Vision Segmentation III Statistical Nonparametric Methods for Segmentation

CS 534: Computer Vision Segmentation III Statistical Nonparametric Methods for Segmentation CS 534: Computer Vision Segmentation III Statistical Nonparametric Methods for Segmentation Ahmed Elgammal Dept of Computer Science CS 534 Segmentation III- Nonparametric Methods - - 1 Outlines Density

More information

1 Unified Power Flow Controller (UPFC)

1 Unified Power Flow Controller (UPFC) Power flow control with UPFC Rusejla Sadikovic Internal report 1 Unified Power Flow Controller (UPFC) The UPFC can provide simultaneous control of all basic power system parameters ( transmission voltage,

More information

Transform Techniques - CF

Transform Techniques - CF Transform Techniques - CF [eview] Moment Generating Function For a real t, the MGF of the random variable is t t M () t E[ e ] e Characteristic Function (CF) k t k For a real ω, the characteristic function

More information

Daily Lessons and Assessments for AP* Calculus AB, A Complete Course Page 119 Mark Sparks 2012

Daily Lessons and Assessments for AP* Calculus AB, A Complete Course Page 119 Mark Sparks 2012 Unit # Understanding the Derivative Homework Packet f ( h) f ( Find lim for each of the functions below. Then, find the equation of the tangent line to h 0 h the graph of f( at the given value of. 1. f

More information

, and ignoring all load currents, determine

, and ignoring all load currents, determine ECE43 Test 3 Dec 8, 5 Q. (33 pts.) The Zbus for the above 3-bus network with bus as reference, in per unit, is given to be 3.87 j.798 j.8 j Z.798 j.87 j.8 j bus.8 j.8 j j Assuming that the prefault values

More information

Chapter (AB/BC, non-calculator) (a) Find the critical numbers of g. (b) For what values of x is g increasing? Justify your answer.

Chapter (AB/BC, non-calculator) (a) Find the critical numbers of g. (b) For what values of x is g increasing? Justify your answer. Chapter 3 1. (AB/BC, non-calculator) Given g ( ) 2 4 3 6 : (a) Find the critical numbers of g. (b) For what values of is g increasing? Justify your answer. (c) Identify the -coordinate of the critical

More information

Lecture 1c: Gaussian Processes for Regression

Lecture 1c: Gaussian Processes for Regression Lecture c: Gaussian Processes for Regression Cédric Archambeau Centre for Computational Statistics and Machine Learning Department of Computer Science University College London c.archambeau@cs.ucl.ac.uk

More information

HTF: Ch4 B: Ch4. Linear Classifiers. R Greiner Cmput 466/551

HTF: Ch4 B: Ch4. Linear Classifiers. R Greiner Cmput 466/551 HTF: Ch4 B: Ch4 Linear Classifiers R Greiner Cmput 466/55 Outline Framework Eact Minimize Mistakes Perceptron Training Matri inversion LMS Logistic Regression Ma Likelihood Estimation MLE of P Gradient

More information

Gaussians. Hiroshi Shimodaira. January-March Continuous random variables

Gaussians. Hiroshi Shimodaira. January-March Continuous random variables Cumulative Distribution Function Gaussians Hiroshi Shimodaira January-March 9 In this chapter we introduce the basics of how to build probabilistic models of continuous-valued data, including the most

More information

Transform Techniques - CF

Transform Techniques - CF Transform Techniques - CF [eview] Moment Generating Function For a real t, the MGF of the random variable is t e k p ( k) discrete t t k M () t E[ e ] e t e f d continuous Characteristic Function (CF)

More information

Errors Intensive Computation

Errors Intensive Computation Errors Intensive Computation Annalisa Massini - 2015/2016 OVERVIEW Sources of Approimation Before computation modeling empirical measurements previous computations During computation truncation or discretization

More information

Recursive Least Squares for an Entropy Regularized MSE Cost Function

Recursive Least Squares for an Entropy Regularized MSE Cost Function Recursive Least Squares for an Entropy Regularized MSE Cost Function Deniz Erdogmus, Yadunandana N. Rao, Jose C. Principe Oscar Fontenla-Romero, Amparo Alonso-Betanzos Electrical Eng. Dept., University

More information

Nonlinear programming

Nonlinear programming 08-04- htt://staff.chemeng.lth.se/~berntn/courses/otimps.htm Otimization of Process Systems Nonlinear rogramming PhD course 08 Bernt Nilsson, Det of Chemical Engineering, Lund University Content Unconstraint

More information

Outline. Escaping the Double Cone: Describing the Seam Space with Gateway Modes. Columbus Workshop Argonne National Laboratory 2005

Outline. Escaping the Double Cone: Describing the Seam Space with Gateway Modes. Columbus Workshop Argonne National Laboratory 2005 Outline Escaping the Double Cone: Describing the Seam Space with Gateway Modes Columbus Worshop Argonne National Laboratory 005 Outline I. Motivation II. Perturbation Theory and Intersection Adapted Coordinates

More information

Algebra of Random Variables: Optimal Average and Optimal Scaling Minimising

Algebra of Random Variables: Optimal Average and Optimal Scaling Minimising Review: Optimal Average/Scaling is equivalent to Minimise χ Two 1-parameter models: Estimating < > : Scaling a pattern: Two equivalent methods: Algebra of Random Variables: Optimal Average and Optimal

More information

SMO vs PDCO for SVM: Sequential Minimal Optimization vs Primal-Dual interior method for Convex Objectives for Support Vector Machines

SMO vs PDCO for SVM: Sequential Minimal Optimization vs Primal-Dual interior method for Convex Objectives for Support Vector Machines vs for SVM: Sequential Minimal Optimization vs Primal-Dual interior method for Convex Objectives for Support Vector Machines Ding Ma Michael Saunders Working paper, January 5 Introduction In machine learning,

More information

CSE 559A: Computer Vision

CSE 559A: Computer Vision CSE 559A: Computer Vision Fall 208: T-R: :30-pm @ Lopata 0 Instructor: Ayan Chakrabarti (ayan@wustl.edu). Course Staff: Zhihao ia, Charlie Wu, Han Liu http://www.cse.wustl.edu/~ayan/courses/cse559a/ Sep

More information

OPTIMAL POWER FLOW BASED ON PARTICLE SWARM OPTIMIZATION

OPTIMAL POWER FLOW BASED ON PARTICLE SWARM OPTIMIZATION U.P.B. Sci. Bull., Series C, Vol. 78, Iss. 3, 2016 ISSN 2286-3540 OPTIMAL POWER FLOW BASED ON PARTICLE SWARM OPTIMIZATION Layth AL-BAHRANI 1, Virgil DUMBRAVA 2 Optimal Power Flow (OPF) is one of the most

More information

Single objective optimization using PSO with Interline Power Flow Controller

Single objective optimization using PSO with Interline Power Flow Controller Single objective optimization using PSO with Interline Power Flow Controller Praveen.J, B.Srinivasa Rao jpraveen.90@gmail.com, balususrinu@vrsiddhartha.ac.in Abstract Optimal Power Flow (OPF) problem was

More information

Linear Quadratic Regulator (LQR) Design II

Linear Quadratic Regulator (LQR) Design II Lecture 8 Linear Quadratic Regulator LQR) Design II Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Outline Stability and Robustness properties

More information

CSE 559A: Computer Vision Tomorrow Zhihao's Office Hours back in Jolley 309: 10:30am-Noon

CSE 559A: Computer Vision Tomorrow Zhihao's Office Hours back in Jolley 309: 10:30am-Noon CSE 559A: Computer Vision ADMINISTRIVIA Tomorrow Zhihao's Office Hours back in Jolley 309: 0:30am-Noon Fall 08: T-R: :30-pm @ Lopata 0 This Friday: Regular Office Hours Net Friday: Recitation for PSET

More information

MATHEMATICS (SET -3) Labour cost Z 300x 400y (to be minimized) The constraints are: SECTION - A 1. f (x) is continuous at x 3 f (3) lim f (x)

MATHEMATICS (SET -3) Labour cost Z 300x 400y (to be minimized) The constraints are: SECTION - A 1. f (x) is continuous at x 3 f (3) lim f (x) 8 Class th (SET -) BD PPER -7 M T H E M T I C S () SECTION -. f () is continuous at f () lim f () ( ) 6 k lim ( )( 6) k lim ( ) k. adj I 8 I 8 I 8I 8. P : z 5 5 P : 5 5z z 8 Distance between P & P sin

More information

Robustness Analysis of Power Grid under False Data Attacks Against AC State Estimation

Robustness Analysis of Power Grid under False Data Attacks Against AC State Estimation Robustness Analysis of Power Grid under False Data Attacks Against AC State Estimation Presenter: Ming Jin INFORMS 2017 Ming Jin, Prof Javad Lavaei, and Prof Karl Johansson 1 Power system resilience against

More information

The number of marks is given in brackets [ ] at the end of each question or part question. The total number of marks for this paper is 72.

The number of marks is given in brackets [ ] at the end of each question or part question. The total number of marks for this paper is 72. ADVANCED GCE UNIT / MATHEMATICS (MEI Further Methods for Advanced Mathematics (FP THURSDAY JUNE Additional materials: Answer booklet (8 pages Graph paper MEI Eamination Formulae and Tables (MF Morning

More information

DAMPING OF SUBSYNCHRONOUS MODES OF OSCILLATIONS

DAMPING OF SUBSYNCHRONOUS MODES OF OSCILLATIONS Journal of Engineering Science and Technology Vol. 1, No. 1 (26) 76-88 School of Engineering, Taylor s College DAMPING OF SUBSYNCHRONOUS MODES OF OSCILLATIONS JAGADEESH PASUPULETI School of Engineering,

More information

Pre-Calculus and Trigonometry Capacity Matrix

Pre-Calculus and Trigonometry Capacity Matrix Pre-Calculus and Capacity Matri Review Polynomials A1.1.4 A1.2.5 Add, subtract, multiply and simplify polynomials and rational epressions Solve polynomial equations and equations involving rational epressions

More information

Nonparametric Test on Process Capability

Nonparametric Test on Process Capability Nonparametric Test on Process Capability Stefano Bonnini Abstract The study of process capability is very important in designing a new product or service and in the definition of purchase agreements. In

More information

Regression and Prediction

Regression and Prediction -755 Machine Learning for Signal Processing Regression and Prediction Class 5. 23 Oct 202 Instructor: Bhisha Raj 23 Oct 202 755/8797 Matri Identities f 2... D df df d d df d 2 d2... df dd dd he derivative

More information

KINGS COLLEGE OF ENGINEERING Punalkulam

KINGS COLLEGE OF ENGINEERING Punalkulam KINGS COLLEGE OF ENGINEERING Punalkulam 613 303 DEPARTMENT OF ELECTRICAL AND ELECTRONICS ENGINEERING POWER SYSTEM ANALYSIS QUESTION BANK UNIT I THE POWER SYSTEM AN OVERVIEW AND MODELLING PART A (TWO MARK

More information

FALL 2012 MATH 1324 REVIEW EXAM 2

FALL 2012 MATH 1324 REVIEW EXAM 2 FALL 0 MATH 3 REVIEW EXAM MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. Find the order of the matri product AB and the product BA, whenever the

More information

Gaussian Process Vine Copulas for Multivariate Dependence

Gaussian Process Vine Copulas for Multivariate Dependence Gaussian Process Vine Copulas for Multivariate Dependence José Miguel Hernández-Lobato 1,2 joint work with David López-Paz 2,3 and Zoubin Ghahramani 1 1 Department of Engineering, Cambridge University,

More information

Robot Manipulator Control. Hesheng Wang Dept. of Automation

Robot Manipulator Control. Hesheng Wang Dept. of Automation Robot Manipulator Control Hesheng Wang Dept. of Automation Introduction Industrial robots work based on the teaching/playback scheme Operators teach the task procedure to a robot he robot plays back eecute

More information

Dynamic Voltage Stability Enhancement of a Microgrid with Static and Dynamic Loads Using Microgrid Voltage Stabilizer

Dynamic Voltage Stability Enhancement of a Microgrid with Static and Dynamic Loads Using Microgrid Voltage Stabilizer Dynamic Voltage Stability Enhancement of a Microgrid with Static and Dynamic Loads Using Microgrid Voltage Stabilizer Kenan Hatipoglu 1, Ismail Fidan 2, Ghadir Radman 3 1 Electrical and Computer Engineering

More information

Factor Analysis. Qian-Li Xue

Factor Analysis. Qian-Li Xue Factor Analysis Qian-Li Xue Biostatistics Program Harvard Catalyst The Harvard Clinical & Translational Science Center Short course, October 7, 06 Well-used latent variable models Latent variable scale

More information

Lecture 3: Pattern Classification. Pattern classification

Lecture 3: Pattern Classification. Pattern classification EE E68: Speech & Audio Processing & Recognition Lecture 3: Pattern Classification 3 4 5 The problem of classification Linear and nonlinear classifiers Probabilistic classification Gaussians, mitures and

More information

UNIVERSIDAD CARLOS III DE MADRID MATHEMATICS II EXERCISES (SOLUTIONS )

UNIVERSIDAD CARLOS III DE MADRID MATHEMATICS II EXERCISES (SOLUTIONS ) UNIVERSIDAD CARLOS III DE MADRID MATHEMATICS II EXERCISES (SOLUTIONS ) CHAPTER : Limits and continuit of functions in R n. -. Sketch the following subsets of R. Sketch their boundar and the interior. Stud

More information

SHORT QUESTIONS AND ANSWERS. Year/ Semester/ Class : III/ V/ EEE Academic Year: Subject Code/ Name: EE6501/ Power System Analysis

SHORT QUESTIONS AND ANSWERS. Year/ Semester/ Class : III/ V/ EEE Academic Year: Subject Code/ Name: EE6501/ Power System Analysis Srividya colllege of Engg & Tech,Virudhunagar Sri Vidya College of Engineering And Technology Virudhunagar 626 005 Department of Electrical and Electronics Engineering QUESTION BANK SHORT QUESTIONS AND

More information

A New Predictor-Corrector Method for Optimal Power Flow

A New Predictor-Corrector Method for Optimal Power Flow 1 st Brazilian Workshop on Interior Point Methods Federal Univesity of Technology Paraná (UTFPR) A New Predictor-Corrector Method for Optimal Power Flow Roy Wilhelm Probst 27-28 April, 2015 - Campinas,

More information

Power Distribution in Electrical Grids

Power Distribution in Electrical Grids Power Distribution in Electrical Grids Safatul Islam, Deanna Johnson, Homa Shayan, Jonathan Utegaard Mentors: Aalok Shah, Dr. Ildar Gabitov April 5, 2013 Abstract Power in electrical grids is modeled using

More information

Linear, threshold units. Linear Discriminant Functions and Support Vector Machines. Biometrics CSE 190 Lecture 11. X i : inputs W i : weights

Linear, threshold units. Linear Discriminant Functions and Support Vector Machines. Biometrics CSE 190 Lecture 11. X i : inputs W i : weights Linear Discriminant Functions and Support Vector Machines Linear, threshold units CSE19, Winter 11 Biometrics CSE 19 Lecture 11 1 X i : inputs W i : weights θ : threshold 3 4 5 1 6 7 Courtesy of University

More information

Midterm exam CS 189/289, Fall 2015

Midterm exam CS 189/289, Fall 2015 Midterm exam CS 189/289, Fall 2015 You have 80 minutes for the exam. Total 100 points: 1. True/False: 36 points (18 questions, 2 points each). 2. Multiple-choice questions: 24 points (8 questions, 3 points

More information

Calderglen High School Mathematics Department. Higher Mathematics Home Exercise Programme

Calderglen High School Mathematics Department. Higher Mathematics Home Exercise Programme alderglen High School Mathematics Department Higher Mathematics Home Eercise Programme R A Burton June 00 Home Eercise The Laws of Indices Rule : Rule 4 : ( ) Rule 7 : n p m p q = = = ( n p ( p+ q) ) m

More information

APPLICATION OF THE SPARSE CARDINAL SINE DECOMPOSITION TO 3D STOKES FLOWS

APPLICATION OF THE SPARSE CARDINAL SINE DECOMPOSITION TO 3D STOKES FLOWS F. Alouges, et al., Int. J. Comp. Meth. and Ep. Meas., Vol. 5, No. 3 (07) 387 394 APPLICATION OF THE SPARSE CARDINAL SINE DECOMPOSITION TO 3D STOKES FLOWS F. ALOUGES, M. AUSSAL, A. LEFEBVRE-LEPOT, F. PIGEONNEAU

More information

Maximum Likelihood Estimation. only training data is available to design a classifier

Maximum Likelihood Estimation. only training data is available to design a classifier Introduction to Pattern Recognition [ Part 5 ] Mahdi Vasighi Introduction Bayesian Decision Theory shows that we could design an optimal classifier if we knew: P( i ) : priors p(x i ) : class-conditional

More information

Grouped Network Vector Autoregression

Grouped Network Vector Autoregression Statistica Sinica: Supplement Grouped Networ Vector Autoregression Xuening Zhu 1 and Rui Pan 2 1 Fudan University, 2 Central University of Finance and Economics Supplementary Material We present here the

More information

Subspace Projection Matrix Completion on Grassmann Manifold

Subspace Projection Matrix Completion on Grassmann Manifold Subspace Projection Matrix Completion on Grassmann Manifold Xinyue Shen and Yuantao Gu Dept. EE, Tsinghua University, Beijing, China http://gu.ee.tsinghua.edu.cn/ ICASSP 2015, Brisbane Contents 1 Background

More information

The N k Problem using AC Power Flows

The N k Problem using AC Power Flows The N k Problem using AC Power Flows Sean Harnett 5-19-2011 Outline Introduction AC power flow model The optimization problem Some results Goal: find a small set of lines whose removal will cause the power

More information

Name Date Period. Pre-Calculus Midterm Review Packet (Chapters 1, 2, 3)

Name Date Period. Pre-Calculus Midterm Review Packet (Chapters 1, 2, 3) Name Date Period Sections and Scoring Pre-Calculus Midterm Review Packet (Chapters,, ) Your midterm eam will test your knowledge of the topics we have studied in the first half of the school year There

More information

M.S. Project Report. Efficient Failure Rate Prediction for SRAM Cells via Gibbs Sampling. Yamei Feng 12/15/2011

M.S. Project Report. Efficient Failure Rate Prediction for SRAM Cells via Gibbs Sampling. Yamei Feng 12/15/2011 .S. Project Report Efficient Failure Rate Prediction for SRA Cells via Gibbs Sampling Yamei Feng /5/ Committee embers: Prof. Xin Li Prof. Ken ai Table of Contents CHAPTER INTRODUCTION...3 CHAPTER BACKGROUND...5

More information

A Julia JuMP-based module for polynomial optimization with complex variables applied to ACOPF

A Julia JuMP-based module for polynomial optimization with complex variables applied to ACOPF JuMP-dev workshop 018 A Julia JuMP-based module for polynomial optimization with complex variables applied to ACOPF Gilles Bareilles, Manuel Ruiz, Julie Sliwak 1. MathProgComplex.jl: A toolbox for Polynomial

More information

MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question.

MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. Final Eam Review MAC 1 Spring 0 Name MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. Solve and check the linear equation. 1) (- + ) - = -( - 7) {-

More information

Non-linear least squares

Non-linear least squares Non-linear least squares Concept of non-linear least squares We have extensively studied linear least squares or linear regression. We see that there is a unique regression line that can be determined

More information

UBC-SFU-UVic-UNBC Calculus Exam Solutions 7 June 2007

UBC-SFU-UVic-UNBC Calculus Exam Solutions 7 June 2007 This eamination has 15 pages including this cover. UBC-SFU-UVic-UNBC Calculus Eam Solutions 7 June 007 Name: School: Signature: Candidate Number: Rules and Instructions 1. Show all your work! Full marks

More information

EBEM: An Entropy-based EM Algorithm for Gaussian Mixture Models

EBEM: An Entropy-based EM Algorithm for Gaussian Mixture Models EBEM: An Entropy-based EM Algorithm for Gaussian Mixture Models Antonio Peñalver Benavent, Francisco Escolano Ruiz and Juan M. Sáez Martínez Robot Vision Group Alicante University 03690 Alicante, Spain

More information

A New Unsupervised Event Detector for Non-Intrusive Load Monitoring

A New Unsupervised Event Detector for Non-Intrusive Load Monitoring A New Unsupervised Event Detector for Non-Intrusive Load Monitoring GlobalSIP 2015, 14th Dec. Benjamin Wild, Karim Said Barsim, and Bin Yang Institute of Signal Processing and System Theory of,, Germany

More information

ECEN 615 Methods of Electric Power Systems Analysis Lecture 18: Least Squares, State Estimation

ECEN 615 Methods of Electric Power Systems Analysis Lecture 18: Least Squares, State Estimation ECEN 615 Methods of Electric Power Systems Analysis Lecture 18: Least Squares, State Estimation Prof. om Overbye Dept. of Electrical and Computer Engineering exas A&M University overbye@tamu.edu Announcements

More information

Gaussian Process priors with Uncertain Inputs: Multiple-Step-Ahead Prediction

Gaussian Process priors with Uncertain Inputs: Multiple-Step-Ahead Prediction Gaussian Process priors with Uncertain Inputs: Multiple-Step-Ahead Prediction Agathe Girard Dept. of Computing Science University of Glasgow Glasgow, UK agathe@dcs.gla.ac.uk Carl Edward Rasmussen Gatsby

More information