System Diagnostics using Kalman Filter Estimation Error

Size: px
Start display at page:

Download "System Diagnostics using Kalman Filter Estimation Error"

Transcription

1 System Diagostics usig Kalma Filter Estimatio Error Prof. Seugchul Lee, Seugtae Park, Heechag Kim, Hyusuk Huh ICMR2015 (11/25/2015)

2 Machie Health Diagostics Desig Desig DNA + + Blue Prit phagocytes lymphocytes Huma Body Egie - Data-drive - Model-based - Expert system Huma Immue System Egieerig Immue System 2

3 Geeral Methods for Diagostics Geeral framework of data-drive diagostics Time Tred Frequecy Tred Bode plot Orbit Aalysis 3

4 Model-based Diagostics Possible oly for simple systems Aalytical Computer simulatio But, expesive 4

5 Assumptios Model-based Diagostics system ca be approximated as state space represetatio If system dyamics are chaged (due to fault) x 1 Ax y Cx Real-time diagostics via estimatig matrix A From x ad y From A x 1 Ax y Cx x x y : state : observatio (measuremet) A: system matrix C : measuremet matrix : system oise : obervatio oise Ax 1 y Cx 5

6 Kalma Filter for Model-based PHM Widely used i guidace, avigatio ad cotrol of vehicles, particularly aircraft ad spacecraft, trajectory optimizatio Optimally estimate ukow states x usig a series of measuremets y observed over time, cotaiig statistical oise ad ucertaities x늿 x K y C x? 1 1 Kalma gai: T K A C ( C C V ) T t t1 t t1 1 6

7 Machie Learig vs. Kalma Filter Machie Learig (data-drive): Statistical approach o data Data-drive method Supervised Kalma Filter (model-based) Based o physical model + oise distributio Optimal estimator for White oise Kow covariace Kow model 7

8 positio Kalma Gai as Features? Questio: Moitorig the Kalma gai for system diagostics? Tested with a sprig ad mass system x(t) k 0 m x k m x x Ac x 1 0 x x Covariace matrix is statioary Kalma Gai is ot a fuctio of observatios Caot be used for system diagostics T K A C ( C C V ) T t t1 t t1 8 1

9 Estimatio Error: Keep moitorig e Kalma Filter Estimatio Error e y y늿 y Cx 1 Ca be used for a Health Idex (i.e., Coditio Idex) to determie the degree o coditio moitorig 9

10 Doe? or Ay Problems? Must kow system matrix A to apply the Kalma filter System modelig or System idetificatio problem Difficult to idetify matrix A for complicated systems Equally difficult (PHM System Idetificatio) Pseudo Matrix A p 10

11 Pseudo Matrix A p Positio ad velocity Real physical system positio 1 dt positio velocity 0 1 velocity k1 k k 0 km A 1 0 x 1 Ax y Cx xk 1 xk vk t k v v k1 k 1 txk 0 1 v k x k Ap v k x 1 AP x y Cx A p 1 t

12 Simulatio Validatio At time 5 sec Itetioally chaged m ad k Estimatio error x(t) k m Ap 12

13 System Idetificatio System + + z 1 x c v Aˆ X X ( X X ) T T 1 1 A y  K - z Maximum Likelihood z 1 xˆ 1 + c yˆ 1 ( 1) z A P xˆ 1 z 1 Kalma filter with Pseudo A p System idetificatio with MLE 13

14 System Dyamics: Pole Locatios System idetificatio via MLE x 1 Ax y Cx x 1 AP x y Cx x ˆ 1 Ax y Cx Compariso of pole locatios 14

15 Rotatig Machiery: Misaligmet Vibratio measuremet Iduce misaligmet durig operatio Kalma Filter Estimatio error Data-drive ML classificatio (SVM) Cotiuous No traiig step required 15

16 Bearig Fault Detectio Kalma filter with o a prior kowledge of system dyamics of matrix A Fault bearig itroduced 16

17 Coclusio Proposed a model-based progostics method usig Kalma filter Does ot require high fidelity models for complex systems Health idex Estimatio error ca be used for a health idex of system deviatio from kow state Future work Observability Diagosability (?) 17

18 Questios 18

19 19

A Simplified Derivation of Scalar Kalman Filter using Bayesian Probability Theory

A Simplified Derivation of Scalar Kalman Filter using Bayesian Probability Theory 6th Iteratioal Workshop o Aalysis of Dyamic Measuremets Jue -3 0 Göteorg Swede A Simplified Derivatio of Scalar Kalma Filter usig Bayesia Proaility Theory Gregory Kyriazis Imetro - Electrical Metrology

More information

Mechatronics. Time Response & Frequency Response 2 nd -Order Dynamic System 2-Pole, Low-Pass, Active Filter

Mechatronics. Time Response & Frequency Response 2 nd -Order Dynamic System 2-Pole, Low-Pass, Active Filter Time Respose & Frequecy Respose d -Order Dyamic System -Pole, Low-Pass, Active Filter R 4 R 7 C 5 e i R 1 C R 3 - + R 6 - + e out Assigmet: Perform a Complete Dyamic System Ivestigatio of the Two-Pole,

More information

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015 ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],

More information

Statistical Pattern Recognition

Statistical Pattern Recognition Statistical Patter Recogitio Classificatio: No-Parametric Modelig Hamid R. Rabiee Jafar Muhammadi Sprig 2014 http://ce.sharif.edu/courses/92-93/2/ce725-2/ Ageda Parametric Modelig No-Parametric Modelig

More information

Clustering. CM226: Machine Learning for Bioinformatics. Fall Sriram Sankararaman Acknowledgments: Fei Sha, Ameet Talwalkar.

Clustering. CM226: Machine Learning for Bioinformatics. Fall Sriram Sankararaman Acknowledgments: Fei Sha, Ameet Talwalkar. Clusterig CM226: Machie Learig for Bioiformatics. Fall 216 Sriram Sakararama Ackowledgmets: Fei Sha, Ameet Talwalkar Clusterig 1 / 42 Admiistratio HW 1 due o Moday. Email/post o CCLE if you have questios.

More information

Classification with linear models

Classification with linear models Lecture 8 Classificatio with liear models Milos Hauskrecht milos@cs.pitt.edu 539 Seott Square Geerative approach to classificatio Idea:. Represet ad lear the distributio, ). Use it to defie probabilistic

More information

ENGI 4421 Confidence Intervals (Two Samples) Page 12-01

ENGI 4421 Confidence Intervals (Two Samples) Page 12-01 ENGI 44 Cofidece Itervals (Two Samples) Page -0 Two Sample Cofidece Iterval for a Differece i Populatio Meas [Navidi sectios 5.4-5.7; Devore chapter 9] From the cetral limit theorem, we kow that, for sufficietly

More information

Mathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution

Mathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution America Joural of Theoretical ad Applied Statistics 05; 4(: 6-69 Published olie May 8, 05 (http://www.sciecepublishiggroup.com/j/ajtas doi: 0.648/j.ajtas.05040. ISSN: 6-8999 (Prit; ISSN: 6-9006 (Olie Mathematical

More information

Research on Dependable level in Network Computing System Yongxia Li 1, a, Guangxia Xu 2,b and Shuangyan Liu 3,c

Research on Dependable level in Network Computing System Yongxia Li 1, a, Guangxia Xu 2,b and Shuangyan Liu 3,c Applied Mechaics ad Materials Olie: 04-0-06 ISSN: 66-748, Vols. 53-57, pp 05-08 doi:0.408/www.scietific.et/amm.53-57.05 04 Tras Tech Publicatios, Switzerlad Research o Depedable level i Network Computig

More information

Machine Learning.

Machine Learning. 10-701 Machie Learig http://www.cs.cmu.edu/~epxig/class/10701-15f/ Orgaizatioal ifo All up-to-date ifo is o the course web page (follow liks from my page). Istructors - Eric Xig - Ziv Bar-Joseph TAs: See

More information

Outline. Linear regression. Regularization functions. Polynomial curve fitting. Stochastic gradient descent for regression. MLE for regression

Outline. Linear regression. Regularization functions. Polynomial curve fitting. Stochastic gradient descent for regression. MLE for regression REGRESSION 1 Outlie Liear regressio Regularizatio fuctios Polyomial curve fittig Stochastic gradiet descet for regressio MLE for regressio Step-wise forward regressio Regressio methods Statistical techiques

More information

ANALYSIS OF EXPERIMENTAL ERRORS

ANALYSIS OF EXPERIMENTAL ERRORS ANALYSIS OF EXPERIMENTAL ERRORS All physical measuremets ecoutered i the verificatio of physics theories ad cocepts are subject to ucertaities that deped o the measurig istrumets used ad the coditios uder

More information

Research Article Research on Application of Regression Least Squares Support Vector Machine on Performance Prediction of Hydraulic Excavator

Research Article Research on Application of Regression Least Squares Support Vector Machine on Performance Prediction of Hydraulic Excavator Joural of Cotrol Sciece ad Egieerig, Article ID 686130, 4 pages http://dx.doi.org/10.1155/2014/686130 Research Article Research o Applicatio of Regressio Least Squares Support Vector Machie o Performace

More information

Title: Damage Identification of Structures Based on Pattern Classification Using Limited Number of Sensors

Title: Damage Identification of Structures Based on Pattern Classification Using Limited Number of Sensors Cover page Title: Damage Idetificatio of Structures Based o Patter Classificatio Usig Limited Number of Sesors Authors: Yuyi QIAN Akira MITA PAPER DEADLINE: **JULY, ** PAPER LENGTH: **8 PAGES MAXIMUM **

More information

Lecture 11 and 12: Basic estimation theory

Lecture 11 and 12: Basic estimation theory Lecture ad 2: Basic estimatio theory Sprig 202 - EE 94 Networked estimatio ad cotrol Prof. Kha March 2 202 I. MAXIMUM-LIKELIHOOD ESTIMATORS The maximum likelihood priciple is deceptively simple. Louis

More information

First Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise

First Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >

More information

R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State

R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio if the Locatio Parameter Ca Take o Ay Value Betwee Mius Iity ad Plus Iity R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

Statistical Fundamentals and Control Charts

Statistical Fundamentals and Control Charts Statistical Fudametals ad Cotrol Charts 1. Statistical Process Cotrol Basics Chace causes of variatio uavoidable causes of variatios Assigable causes of variatio large variatios related to machies, materials,

More information

Probability and MLE.

Probability and MLE. 10-701 Probability ad MLE http://www.cs.cmu.edu/~pradeepr/701 (brief) itro to probability Basic otatios Radom variable - referrig to a elemet / evet whose status is ukow: A = it will rai tomorrow Domai

More information

State Space Representation

State Space Representation Optimal Cotrol, Guidace ad Estimatio Lecture 2 Overview of SS Approach ad Matrix heory Prof. Radhakat Padhi Dept. of Aerospace Egieerig Idia Istitute of Sciece - Bagalore State Space Represetatio Prof.

More information

Expectation-Maximization Algorithm.

Expectation-Maximization Algorithm. Expectatio-Maximizatio Algorithm. Petr Pošík Czech Techical Uiversity i Prague Faculty of Electrical Egieerig Dept. of Cyberetics MLE 2 Likelihood.........................................................................................................

More information

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5 CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio

More information

Empirical Process Theory and Oracle Inequalities

Empirical Process Theory and Oracle Inequalities Stat 928: Statistical Learig Theory Lecture: 10 Empirical Process Theory ad Oracle Iequalities Istructor: Sham Kakade 1 Risk vs Risk See Lecture 0 for a discussio o termiology. 2 The Uio Boud / Boferoi

More information

Signal Processing in Mechatronics

Signal Processing in Mechatronics Sigal Processig i Mechatroics Zhu K.P. AIS, UM. Lecture, Brief itroductio to Sigals ad Systems, Review of Liear Algebra ad Sigal Processig Related Mathematics . Brief Itroductio to Sigals What is sigal

More information

OBJECTIVES. Chapter 1 INTRODUCTION TO INSTRUMENTATION FUNCTION AND ADVANTAGES INTRODUCTION. At the end of this chapter, students should be able to:

OBJECTIVES. Chapter 1 INTRODUCTION TO INSTRUMENTATION FUNCTION AND ADVANTAGES INTRODUCTION. At the end of this chapter, students should be able to: OBJECTIVES Chapter 1 INTRODUCTION TO INSTRUMENTATION At the ed of this chapter, studets should be able to: 1. Explai the static ad dyamic characteristics of a istrumet. 2. Calculate ad aalyze the measuremet

More information

Random Signals and Noise Winter Semester 2017 Problem Set 12 Wiener Filter Continuation

Random Signals and Noise Winter Semester 2017 Problem Set 12 Wiener Filter Continuation Radom Sigals ad Noise Witer Semester 7 Problem Set Wieer Filter Cotiuatio Problem (Sprig, Exam A) Give is the sigal W t, which is a Gaussia white oise with expectatio zero ad power spectral desity fuctio

More information

MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND.

MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. XI-1 (1074) MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. R. E. D. WOOLSEY AND H. S. SWANSON XI-2 (1075) STATISTICAL DECISION MAKING Advaced

More information

HMM-Based Semantic Learning for a Mobile Robot

HMM-Based Semantic Learning for a Mobile Robot HMM-Based Sematic Learig for a Mobile Robot Kevi Squire Laguage Acquisitio ad Robotics Group Uiversity of Illiois at Urbaa-Champaig Adviser: Stephe E. Leviso Laguage Learig Kevi Squire Licol Laboratory

More information

Tracking Bearing Degradation using Gaussian Wavelets

Tracking Bearing Degradation using Gaussian Wavelets Trackig Bearig Degradatio usig Gaussia Wavelets Toy Galati 1 1 Aerospace Divisio, Defece Sciece ad Techology Group, 56 Lorimer Street, Fishermas Bed, Victoria, 37, Australia Abstract This paper ivestigates

More information

Chapter 12 - Quality Cotrol Example: The process of llig 12 ouce cas of Dr. Pepper is beig moitored. The compay does ot wat to uderll the cas. Hece, a target llig rate of 12.1-12.5 ouces was established.

More information

Research Article Health Monitoring for a Structure Using Its Nonstationary Vibration

Research Article Health Monitoring for a Structure Using Its Nonstationary Vibration Advaces i Acoustics ad Vibratio Volume 2, Article ID 69652, 5 pages doi:.55/2/69652 Research Article Health Moitorig for a Structure Usig Its Nostatioary Vibratio Yoshimutsu Hirata, Mikio Tohyama, Mitsuo

More information

Chapter 11 Output Analysis for a Single Model. Banks, Carson, Nelson & Nicol Discrete-Event System Simulation

Chapter 11 Output Analysis for a Single Model. Banks, Carson, Nelson & Nicol Discrete-Event System Simulation Chapter Output Aalysis for a Sigle Model Baks, Carso, Nelso & Nicol Discrete-Evet System Simulatio Error Estimatio If {,, } are ot statistically idepedet, the S / is a biased estimator of the true variace.

More information

Chapter 12 EM algorithms The Expectation-Maximization (EM) algorithm is a maximum likelihood method for models that have hidden variables eg. Gaussian

Chapter 12 EM algorithms The Expectation-Maximization (EM) algorithm is a maximum likelihood method for models that have hidden variables eg. Gaussian Chapter 2 EM algorithms The Expectatio-Maximizatio (EM) algorithm is a maximum likelihood method for models that have hidde variables eg. Gaussia Mixture Models (GMMs), Liear Dyamic Systems (LDSs) ad Hidde

More information

A STUDY OF VIBRATION MEASURING AND FATIGUE ANALYSIS FOR CANTILEVER BEAMS

A STUDY OF VIBRATION MEASURING AND FATIGUE ANALYSIS FOR CANTILEVER BEAMS Joural of Techology, Vol. 3, No., pp. 47-56 (07) 47, * LabView ANSYS A STUDY OF VIBRATION MEASURING AND FATIGUE ANALYSIS FOR CANTILEVER BEAMS Yuo-Ter Tsai, * Hsie-Yag Li Departmet of Mechaical Egieerig

More information

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would

More information

MECHANICAL INTEGRITY DESIGN FOR FLARE SYSTEM ON FLOW INDUCED VIBRATION

MECHANICAL INTEGRITY DESIGN FOR FLARE SYSTEM ON FLOW INDUCED VIBRATION MECHANICAL INTEGRITY DESIGN FOR FLARE SYSTEM ON FLOW INDUCED VIBRATION Hisao Izuchi, Pricipal Egieerig Cosultat, Egieerig Solutio Uit, ChAS Project Operatios Masato Nishiguchi, Egieerig Solutio Uit, ChAS

More information

Lectures on Stochastic System Analysis and Bayesian Updating

Lectures on Stochastic System Analysis and Bayesian Updating Lectures o Stochastic System Aalysis ad Bayesia Updatig Jue 29-July 13 2005 James L. Beck, Califoria Istitute of Techology Jiaye Chig, Natioal Taiwa Uiversity of Sciece & Techology Siu-Kui (Iva) Au, Nayag

More information

Damped Vibration of a Non-prismatic Beam with a Rotational Spring

Damped Vibration of a Non-prismatic Beam with a Rotational Spring Vibratios i Physical Systems Vol.6 (0) Damped Vibratio of a No-prismatic Beam with a Rotatioal Sprig Wojciech SOCHACK stitute of Mechaics ad Fudametals of Machiery Desig Uiversity of Techology, Czestochowa,

More information

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would

More information

Chapter 10 Advanced Topics in Random Processes

Chapter 10 Advanced Topics in Random Processes ery Stark ad Joh W. Woods, Probability, Statistics, ad Radom Variables for Egieers, 4th ed., Pearso Educatio Ic.,. ISBN 978--3-33-6 Chapter Advaced opics i Radom Processes Sectios. Mea-Square (m.s.) Calculus

More information

Regression and generalization

Regression and generalization Regressio ad geeralizatio CE-717: Machie Learig Sharif Uiversity of Techology M. Soleymai Fall 2016 Curve fittig: probabilistic perspective Describig ucertaity over value of target variable as a probability

More information

Outline. CSCI-567: Machine Learning (Spring 2019) Outline. Prof. Victor Adamchik. Mar. 26, 2019

Outline. CSCI-567: Machine Learning (Spring 2019) Outline. Prof. Victor Adamchik. Mar. 26, 2019 Outlie CSCI-567: Machie Learig Sprig 209 Gaussia mixture models Prof. Victor Adamchik 2 Desity estimatio U of Souther Califoria Mar. 26, 209 3 Naive Bayes Revisited March 26, 209 / 57 March 26, 209 2 /

More information

3/8/2016. Contents in latter part PATTERN RECOGNITION AND MACHINE LEARNING. Dynamical Systems. Dynamical Systems. Linear Dynamical Systems

3/8/2016. Contents in latter part PATTERN RECOGNITION AND MACHINE LEARNING. Dynamical Systems. Dynamical Systems. Linear Dynamical Systems Cotets i latter part PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA Liear Dyamical Systems What is differet from HMM? Kalma filter Its stregth ad limitatio Particle Filter Its simple

More information

Change Point Estimation of Location Parameter in Multistage Processes

Change Point Estimation of Location Parameter in Multistage Processes Proceedigs of e World Cogress o Egieerig 0 Vol I WCE 0 July 6-8 0 Lodo U.K. Chage Poit Estimatio of Locatio Parameter i ultistage Processes Seyed Taghi Ahava Niai ehdi Davoodi Elaz Asghari Toramai Abstract

More information

ME NUMERICAL METHODS Fall 2007

ME NUMERICAL METHODS Fall 2007 ME - 310 NUMERICAL METHODS Fall 2007 Group 02 Istructor: Prof. Dr. Eres Söylemez (Rm C205, email:eres@metu.edu.tr ) Class Hours ad Room: Moday 13:40-15:30 Rm: B101 Wedesday 12:40-13:30 Rm: B103 Course

More information

CDS 101: Lecture 8.2 Tools for PID & Loop Shaping

CDS 101: Lecture 8.2 Tools for PID & Loop Shaping CDS : Lecture 8. Tools for PID & Loop Shapig Richard M. Murray 7 November 4 Goals: Show how to use loop shapig to achieve a performace specificatio Itroduce ew tools for loop shapig desig: Ziegler-Nichols,

More information

1. Introduction (Received 11 February 2013; accepted 3 June 2013)

1. Introduction (Received 11 February 2013; accepted 3 June 2013) 991. Applicatio of EMD-AR ad MTS for hydraulic pump fault diagosis Lu Che, Hu Jiameg, Liu Hogmei 991. APPLICATION OF EMD-AR AND MTS FOR HYDRAULIC PUMP FAULT DIAGNOSIS. Lu Che 1,, 3, Hu Jiameg 1, Liu Hogmei

More information

Study on Coal Consumption Curve Fitting of the Thermal Power Based on Genetic Algorithm

Study on Coal Consumption Curve Fitting of the Thermal Power Based on Genetic Algorithm Joural of ad Eergy Egieerig, 05, 3, 43-437 Published Olie April 05 i SciRes. http://www.scirp.org/joural/jpee http://dx.doi.org/0.436/jpee.05.34058 Study o Coal Cosumptio Curve Fittig of the Thermal Based

More information

APPENDIX A EARLY MODELS OF OXIDE CMP

APPENDIX A EARLY MODELS OF OXIDE CMP APPENDIX A EALY MODELS OF OXIDE CMP Over the past decade ad a half several process models have bee proposed to elucidate the mechaism ad material removal rate i CMP. Each model addresses a specific aspect

More information

Probability and Information Theory for Language Modeling. Statistical Linguistics. Statistical Linguistics: Adult Monolingual Speaker

Probability and Information Theory for Language Modeling. Statistical Linguistics. Statistical Linguistics: Adult Monolingual Speaker Probability ad Iformatio Theory for Laguage Modelig Statistical vs. Symbolic NLP Elemetary Probability Theory Laguage Modelig Iformatio Theory Statistical Liguistics Statistical approaches are clearly

More information

The Bayesian Learning Framework. Back to Maximum Likelihood. Naïve Bayes. Simple Example: Coin Tosses. Given a generative model

The Bayesian Learning Framework. Back to Maximum Likelihood. Naïve Bayes. Simple Example: Coin Tosses. Given a generative model Back to Maximum Likelihood Give a geerative model f (x, y = k) =π k f k (x) Usig a geerative modellig approach, we assume a parametric form for f k (x) =f (x; k ) ad compute the MLE θ of θ =(π k, k ) k=

More information

PhD Preliminary Oral Exam CHARACTERIZATION AND PREDICTION OF CFD SIMULATION UNCERTAINITIES. by Serhat Hosder

PhD Preliminary Oral Exam CHARACTERIZATION AND PREDICTION OF CFD SIMULATION UNCERTAINITIES. by Serhat Hosder PhD Prelimiary Oral Exam CHARACTERIZATION AND PREDICTION OF CFD SIMULATION UNCERTAINITIES by Serhat Hosder Chair: Dr. Berard Grossma Committee Members: Dr. Raphael T. Haftka Dr. William H. Maso Dr. Reece

More information

UNBALANCED MACHINE FAULT DETECTION USING INSTANTANEOUS FREQUENCY

UNBALANCED MACHINE FAULT DETECTION USING INSTANTANEOUS FREQUENCY 158 UNBALANCED MACHINE FAULT DETECTION USING INSTANTANEOUS FREQUENCY Dhay Arifiato ad Adi Rahmadiasyah Departmet of Egieerig Physics, Faculty of Idustrial Techology Sepuluh Nopember Istitute of Techology

More information

Chapter 10: Power Series

Chapter 10: Power Series Chapter : Power Series 57 Chapter Overview: Power Series The reaso series are part of a Calculus course is that there are fuctios which caot be itegrated. All power series, though, ca be itegrated because

More information

Direct Position Determination Algorithm Based on Multi-array in the Presence of Gain-phase Errors

Direct Position Determination Algorithm Based on Multi-array in the Presence of Gain-phase Errors 2016 Joit Iteratioal Coferece o Artificial Itelligece ad Computer Egieerig (AICE 2016) ad Iteratioal Coferece o Network ad Commuicatio Security (NCS 2016) ISBN: 978-1-60595-362-5 Direct Positio Determiatio

More information

SOME RESULTS IN MODEL BASED TRANSVERSE CRACK IDENTIFICATION IN ROTOR SYSTEMS

SOME RESULTS IN MODEL BASED TRANSVERSE CRACK IDENTIFICATION IN ROTOR SYSTEMS SOME RESULTS IN MODEL BASED TRANSVERSE CRACK IDENTIFICATION IN ROTOR SYSTEMS Nicolò Bachschmid () Paolo Peacchi () Sylvie Audebert () () Dipartimeto di Meccaica, Politecico di Milao, P.zza Leoardo da Vici,

More information

Exam. Notes: A single A4 sheet of paper (double sided; hand-written or computer typed)

Exam. Notes: A single A4 sheet of paper (double sided; hand-written or computer typed) Exam February 8th, 8 Sigals & Systems (5-575-) Prof. R. D Adrea Exam Exam Duratio: 5 Mi Number of Problems: 5 Number of Poits: 5 Permitted aids: Importat: Notes: A sigle A sheet of paper (double sided;

More information

SCORE. Exam 2. MA 114 Exam 2 Fall 2017

SCORE. Exam 2. MA 114 Exam 2 Fall 2017 Exam Name: Sectio ad/or TA: Do ot remove this aswer page you will retur the whole exam. You will be allowed two hours to complete this test. No books or otes may be used. You may use a graphig calculator

More information

A Note on Effi cient Conditional Simulation of Gaussian Distributions. April 2010

A Note on Effi cient Conditional Simulation of Gaussian Distributions. April 2010 A Note o Effi ciet Coditioal Simulatio of Gaussia Distributios A D D C S S, U B C, V, BC, C April 2010 A Cosider a multivariate Gaussia radom vector which ca be partitioed ito observed ad uobserved compoetswe

More information

Chapter 6 Sampling Distributions

Chapter 6 Sampling Distributions Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to

More information

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4 MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.

More information

Dynamic Response of Second Order Mechanical Systems with Viscous Dissipation forces

Dynamic Response of Second Order Mechanical Systems with Viscous Dissipation forces Hadout #b (pp. 4-55) Dyamic Respose o Secod Order Mechaical Systems with Viscous Dissipatio orces M X + DX + K X = F t () Periodic Forced Respose to F (t) = F o si( t) ad F (t) = M u si(t) Frequecy Respose

More information

Natural frequencies, mode shapes and modal damping values are the most important parameters to

Natural frequencies, mode shapes and modal damping values are the most important parameters to Abstract Natural frequecies, mode shapes ad modal dampig values are the most importat parameters to describe the oise ad vibratio behaviour of a mechaical system. For rotatig machiery, however, the directivity

More information

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters

More information

CSIE/GINM, NTU 2009/11/30 1

CSIE/GINM, NTU 2009/11/30 1 Itroductio ti to Machie Learig (Part (at1: Statistical Machie Learig Shou de Li CSIE/GINM, NTU sdli@csie.tu.edu.tw 009/11/30 1 Syllabus of a Itro ML course ( Machie Learig, Adrew Ng, Staford, Autum 009

More information

Uncertainty. Variables. assigns to each sentence numerical degree of belief between 0 and 1. uncertainty

Uncertainty. Variables. assigns to each sentence numerical degree of belief between 0 and 1. uncertainty Bayes Classificatio Ucertaity & robability Baye's rule Choosig Hypotheses- Maximum a posteriori Maximum Likelihood - Baye's cocept learig Maximum Likelihood of real valued fuctio Bayes optimal Classifier

More information

Sequential Monte Carlo Methods - A Review. Arnaud Doucet. Engineering Department, Cambridge University, UK

Sequential Monte Carlo Methods - A Review. Arnaud Doucet. Engineering Department, Cambridge University, UK Sequetial Mote Carlo Methods - A Review Araud Doucet Egieerig Departmet, Cambridge Uiversity, UK http://www-sigproc.eg.cam.ac.uk/ ad2/araud doucet.html ad2@eg.cam.ac.uk Istitut Heri Poicaré - Paris - 2

More information

ESTIMATING UNCERTAINTIES in ANTENNA MEASUREMENTS

ESTIMATING UNCERTAINTIES in ANTENNA MEASUREMENTS ESTIMATING UNCERTAINTIES i ANTENNA MEASUREMENTS EuCAP April 013 Gotheburg, Swede Michael H. Fracis Natioal Istitute of Stadards ad Techology 35 Broadway Boulder, CO 80305-338 USA fracis@boulder/ist.gov

More information

IE 230 Probability & Statistics in Engineering I. Closed book and notes. No calculators. 120 minutes.

IE 230 Probability & Statistics in Engineering I. Closed book and notes. No calculators. 120 minutes. Closed book ad otes. No calculators. 120 miutes. Cover page, five pages of exam, ad tables for discrete ad cotiuous distributios. Score X i =1 X i / S X 2 i =1 (X i X ) 2 / ( 1) = [i =1 X i 2 X 2 ] / (

More information

Numerical Methods in Fourier Series Applications

Numerical Methods in Fourier Series Applications Numerical Methods i Fourier Series Applicatios Recall that the basic relatios i usig the Trigoometric Fourier Series represetatio were give by f ( x) a o ( a x cos b x si ) () where the Fourier coefficiets

More information

CS284A: Representations and Algorithms in Molecular Biology

CS284A: Representations and Algorithms in Molecular Biology CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by

More information

Maximum likelihood estimation from record-breaking data for the generalized Pareto distribution

Maximum likelihood estimation from record-breaking data for the generalized Pareto distribution METRON - Iteratioal Joural of Statistics 004, vol. LXII,. 3, pp. 377-389 NAGI S. ABD-EL-HAKIM KHALAF S. SULTAN Maximum likelihood estimatio from record-breakig data for the geeralized Pareto distributio

More information

1.010 Uncertainty in Engineering Fall 2008

1.010 Uncertainty in Engineering Fall 2008 MIT OpeCourseWare http://ocw.mit.edu.00 Ucertaity i Egieerig Fall 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu.terms. .00 - Brief Notes # 9 Poit ad Iterval

More information

11 Hidden Markov Models

11 Hidden Markov Models Hidde Markov Models Hidde Markov Models are a popular machie learig approach i bioiformatics. Machie learig algorithms are preseted with traiig data, which are used to derive importat isights about the

More information

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course Sigal-EE Postal Correspodece Course 1 SAMPLE STUDY MATERIAL Electrical Egieerig EE / EEE Postal Correspodece Course GATE, IES & PSUs Sigal System Sigal-EE Postal Correspodece Course CONTENTS 1. SIGNAL

More information

Research Article Spherical Simplex-Radial Cubature Quadrature Kalman Filter

Research Article Spherical Simplex-Radial Cubature Quadrature Kalman Filter Hidawi Joural of Electrical ad Computer Egieerig Volume 27, Article ID 7863875, 8 pages https://doi.org/.55/27/7863875 Research Article Spherical Simplex-Radial Cubature Quadrature Kalma Filter Zhaomig

More information

CUMULATIVE DAMAGE ESTIMATION USING WAVELET TRANSFORM OF STRUCTURAL RESPONSE

CUMULATIVE DAMAGE ESTIMATION USING WAVELET TRANSFORM OF STRUCTURAL RESPONSE CUMULATIVE DAMAGE ESTIMATION USING WAVELET TRANSFORM OF STRUCTURAL RESPONSE Ryutaro SEGAWA 1, Shizuo YAMAMOTO, Akira SONE 3 Ad Arata MASUDA 4 SUMMARY Durig a strog earthquake, the respose of a structure

More information

CSE 527, Additional notes on MLE & EM

CSE 527, Additional notes on MLE & EM CSE 57 Lecture Notes: MLE & EM CSE 57, Additioal otes o MLE & EM Based o earlier otes by C. Grat & M. Narasimha Itroductio Last lecture we bega a examiatio of model based clusterig. This lecture will be

More information

Lab(8) controller design using root locus

Lab(8) controller design using root locus Lab(8) cotroller desig usig root locus I this lab we will lear how to desig a cotroller usig root locus but before this we eed to aswer the followig questios: What is root locus? What is the purpose of

More information

The z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j

The z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j The -Trasform 7. Itroductio Geeralie the complex siusoidal represetatio offered by DTFT to a represetatio of complex expoetial sigals. Obtai more geeral characteristics for discrete-time LTI systems. 7.

More information

Pixel Recurrent Neural Networks

Pixel Recurrent Neural Networks Pixel Recurret Neural Networks Aa ro va de Oord, Nal Kalchbreer, Koray Kavukcuoglu Google DeepMid August 2016 Preseter - Neha M Example problem (completig a image) Give the first half of the image, create

More information

CHAPTER 2. Mean This is the usual arithmetic mean or average and is equal to the sum of the measurements divided by number of measurements.

CHAPTER 2. Mean This is the usual arithmetic mean or average and is equal to the sum of the measurements divided by number of measurements. CHAPTER 2 umerical Measures Graphical method may ot always be sufficiet for describig data. You ca use the data to calculate a set of umbers that will covey a good metal picture of the frequecy distributio.

More information

TERRAIN REFERENCED UAV NAVIGATION WITH LIDAR A COMPARISON OF SEQUENTAIL PROCESSING AND BATCH PROCESSING ALGORITHMS

TERRAIN REFERENCED UAV NAVIGATION WITH LIDAR A COMPARISON OF SEQUENTAIL PROCESSING AND BATCH PROCESSING ALGORITHMS 8 H INERNAIONAL CONGRESS OF HE AERONAUICAL SCIENCES ERRAIN REFERENCED UAV NAVIGAION WIH LIDAR A COPARISON OF SEQUENAIL PROCESSING AND BACH PROCESSING ALGORIHS Yeoha Hwag, i-jea ah KAIS (Korea Advaced Istitute

More information

Error & Uncertainty. Error. More on errors. Uncertainty. Page # The error is the difference between a TRUE value, x, and a MEASURED value, x i :

Error & Uncertainty. Error. More on errors. Uncertainty. Page # The error is the difference between a TRUE value, x, and a MEASURED value, x i : Error Error & Ucertaity The error is the differece betwee a TRUE value,, ad a MEASURED value, i : E = i There is o error-free measuremet. The sigificace of a measuremet caot be judged uless the associate

More information

THE KALMAN FILTER RAUL ROJAS

THE KALMAN FILTER RAUL ROJAS THE KALMAN FILTER RAUL ROJAS Abstract. This paper provides a getle itroductio to the Kalma filter, a umerical method that ca be used for sesor fusio or for calculatio of trajectories. First, we cosider

More information

Aircraft Gas Turbine Engines' Technical Condition Identification System

Aircraft Gas Turbine Engines' Technical Condition Identification System World Academy of Sciece Egieerig ad Techology Iteratioal Joural of Mechaical Aerospace Idustrial Mechatroic ad Maufacturig Egieerig Vol: No:6 009 Aircraft Gas Turbie Egies' Techical Coditio Idetificatio

More information

GUIDELINES ON REPRESENTATIVE SAMPLING

GUIDELINES ON REPRESENTATIVE SAMPLING DRUGS WORKING GROUP VALIDATION OF THE GUIDELINES ON REPRESENTATIVE SAMPLING DOCUMENT TYPE : REF. CODE: ISSUE NO: ISSUE DATE: VALIDATION REPORT DWG-SGL-001 002 08 DECEMBER 2012 Ref code: DWG-SGL-001 Issue

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

ON-LINE ESTIMATION OF THE TRANSPIRATION IN GREENHOUSE HORTICULTURE

ON-LINE ESTIMATION OF THE TRANSPIRATION IN GREENHOUSE HORTICULTURE Proceedigs Agricotrol 27. 2 d IFAC Iteratioal Coferece o Modelig ad Desig of Cotrol Systems i Agriculture, 3-5 September 27, Osijek Croatia, pp. 29-34. ON-LINE ESTIMATION OF THE TRANSPIRATION IN GREENHOUSE

More information

TABLES AND FORMULAS FOR MOORE Basic Practice of Statistics

TABLES AND FORMULAS FOR MOORE Basic Practice of Statistics TABLES AND FORMULAS FOR MOORE Basic Practice of Statistics Explorig Data: Distributios Look for overall patter (shape, ceter, spread) ad deviatios (outliers). Mea (use a calculator): x = x 1 + x 2 + +

More information

Accuracy assessment methods and challenges

Accuracy assessment methods and challenges Accuracy assessmet methods ad challeges Giles M. Foody School of Geography Uiversity of Nottigham giles.foody@ottigham.ac.uk Backgroud Need for accuracy assessmet established. Cosiderable progress ow see

More information

Calculus II Homework: The Comparison Tests Page 1. a n. 1 n 2 + n + 1. n= n. n=1

Calculus II Homework: The Comparison Tests Page 1. a n. 1 n 2 + n + 1. n= n. n=1 Calculus II Homework: The Compariso Tests Page Questios l coverget or diverget? + 7 3 + 5 coverget or diverget? Example Suppose a ad b are series with positive terms ad b is kow to be coverget. a If a

More information

Problem 1. Problem Engineering Dynamics Problem Set 9--Solution. Find the equation of motion for the system shown with respect to:

Problem 1. Problem Engineering Dynamics Problem Set 9--Solution. Find the equation of motion for the system shown with respect to: 2.003 Egieerig Dyamics Problem Set 9--Solutio Problem 1 Fid the equatio of motio for the system show with respect to: a) Zero sprig force positio. Draw the appropriate free body diagram. b) Static equilibrium

More information

Statistics 300: Elementary Statistics

Statistics 300: Elementary Statistics Statistics 300: Elemetary Statistics Sectios 7-, 7-3, 7-4, 7-5 Parameter Estimatio Poit Estimate Best sigle value to use Questio What is the probability this estimate is the correct value? Parameter Estimatio

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

Fitting an ARIMA Process to Data

Fitting an ARIMA Process to Data Fittig a ARIMA Process to Data Bria Borchers April 6, 1 Now that we uderstad the theoretical behavior of ARIMA processes, we will cosider how to take a actual observed time series ad fit a ARIMA model

More information

Measurement uncertainty of the sound absorption

Measurement uncertainty of the sound absorption Measuremet ucertaity of the soud absorptio coefficiet Aa Izewska Buildig Research Istitute, Filtrowa Str., 00-6 Warsaw, Polad a.izewska@itb.pl 6887 The stadard ISO/IEC 705:005 o the competece of testig

More information

Controlo Em Espaço de Estados. First Test

Controlo Em Espaço de Estados. First Test Mestrado Itegrado em Egeharia Electrotécica e de Computadores Cotrolo Em Espaço de Estados 13/1 First Test April, 1, h. room C1 Duratio hours Its ot allowed either cosultatio of ay kid or programmable

More information

Semi-supervised Inference for Explained Variance in High-dimensional Linear Regression and Its Applications

Semi-supervised Inference for Explained Variance in High-dimensional Linear Regression and Its Applications Semi-supervised Iferece for Explaied Variace i High-dimesioal Liear Regressio ad Its Applicatios T. Toy Cai ad Zijia Guo Uiversity of Pesylvaia ad Rutgers Uiversity March 8, 08 Abstract We cosider statistical

More information