CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK
|
|
- Zoe Scott
- 5 years ago
- Views:
Transcription
1 175 CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 10.1 INTRODUCTION Amongs he research work performed, he bes resuls of experimenal work are validaed wih Arificial Neural Nework. From he experimenal observaion, he bes resul of he fuel was found o be POME and is blends wih diesel as fuel. For beer validaion, he fuel performance like specific fuel consumpion and brake hermal efficiency of diesel engines are validaed wih ANN DEVELOPMENT OF NEURAL NETWORK MODEL ANN is one of he mos powerful compuer modeling echniques based on saisical approach, currenly being used in many fields of engineering for modeling complex relaionships which are very difficul o describe wih physical models. The aracion of neural neworks comes from heir remarkable informaion, processing characerisics perinen mainly o non-lineariy, high parallelism, faul and noise olerance and learning and generalized capabiliy. There has been a coninual increase in he research owards he applicaion of arificial neural neworks in modeling and monioring of performance of CI engine. The objecive of he sudy was o develop an ANN model o predic he performances in palm oil mehyl eser diesel blends (Kiani e al. 2010).
2 Muli Layer Feed Forward Neural Nework The muli-layer nework archiecure has one inpu layer, one oupu layer and also has one or more inermediary layers, called hidden layers. The compuaion unis of hidden layer are known as hidden neurons. The hidden layer aids in performing useful inermediary compuaions before direcing he inpu o he oupu layer. The inpu layer neurons are linked o he hidden layer neurons and he corresponding weighs are referred o as inpu-hidden layer weighs. The hidden layer neurons are again linked o he oupu layer neurons and he corresponding weighs are referred o as hidden-oupu layer weighs. A muli-layer feed forward nework wih n 1 inpu neurons, m 1 neurons in he oupu layer and n 2 oupu neurons is wrien as n 1 - m 1 - n Back Propagaion Nework I is a sysemaic mehod for raining muli-layer arificial neural neworks. I uses gradien descen algorihms and he erm back propagaion refers o he way in which he gradien is compued for non-linear neworks. The algorihm allows experimenal acquisiion of he inpu/oupu mapping knowledge wihin mulilayer neworks. Back propagaion akes place in hree sages. 1. Feed forward of he inpu raining paern 2. Back propagaion of he associaed error 3. Weigh adjusmen During feed forward, each inpu neuron receives an inpu signal and broadcass i o each hidden neuron which in urn compues he acivaion and passes i on o each oupu uni which again compues he acivaion o obain he ne oupu. During raining, he ne oupu is compared wih he arge value and appropriae error is calculaed. From he error, he error facor is obained
3 177 which is used o disribue he error back o he hidden layer. The weighs are updaed accordingly. In a similar manner, he error facor is calculaed for all he unis. Afer he error facors are obained, he weighs are updaed simulaneously Nework Learning Rule for Back Propagaion A neuron is considered as an adapive elemen. The weigh of he neuron is modified depending on he inpu signal i receives and is oupu value and he associaed eacher s response. In some cases, if he eacher signal is no available, he neuron will modify he weigh based on inpu and/or oupu (Zurada, 1997). In general learning, he weighs ha are conneced o he i h neuron is given by Equaion (10.1) W i = [W 1i, W 2i, W 3i W ji. W ni ] T (10.1) The weigh vecor increases in proporion o he produc of inpu X and learning signal r. The learning signal for he dela learning rule is defined by he following Equaion (10.2) r i i i (10.2) The erm f (w i x) is he derivaive of he acivaion funcion f (w i x) and d i is he eacher signal. The dela learning rule for he neural nework model is shown in Figure The learning rule can be readily derived from he condiion of leas squared error beween O i and d i where O i is he prediced value. The gradien vecor wih respec o W i of he squared error E is given by Equaion (10.3) E i i (10.3)
4 178 This is equivalen o 1 E d - f(w X) 2 i i 2 (10.4) The error gradien vecor value is obained as E d O f ' (W X)X i i i (10.5) The componens of he gradien vecor are E d O f ' (W X)X forj 1,2...n (10.6) W i i i j ij The minimizaion of he error requires he weigh changes o be in he negaive direcion, Hence, i (10.7) Where Therefore ' i i i i (10.8) For single weigh he adjusmen becomes ' ij i i i j (10.9) raining. Hence, he weighs can be iniialized a any values for his mehod of
5 179 Figure 10.1 Dela learning rule ANN Model for Performance Characerisics The procedure for he developmen of neural nework model is shown in Figure The four seps used in he developmen of he ANN model for specific fuel consumpion and brake hermal efficiency are as follows: i) Collecion of inpu/oupu daa se; ii) Preprocessing of inpu/oupu daa se; iii) Neural nework designing and raining; iv) Tesing of he nework;
6 180 Sar Impor he daa from workspace Provide properies for he nework (ype, number of layers and raining, adapion learning, performance and ransfer funcions) Number of neurons in hidden layer is 10 Train he nework Compare resuls of five neworks Expor he resuls of he bes nework Sop Figure 10.2 Seps involved in he developmen of neural nework model
7 Collecion of inpu and oupu daa se The inpu parameers used o rain he nework consiss of four neurons for he engine process parameers B, r, L and m w. The oupu parameer used o rain he nework has wo neurons, i.e. SFC and BTE Preprocessing of inpu and oupu daa se dependen on The generalizaion capabiliy of he neural nework is essenially 1. The selecion of appropriae inpu/oupu parameers of he process. 2. The disribuion of daa se. 3. The forma of presenaion of daa se o he nework. nework model. In oal, 30 experimenal daa were colleced for building he neural Neural nework designing and raining The experimenal daa were o be separaed ino raining and esing daa. There were no general guidelines available which could be followed o measure he raio beween he amoun of raining and esing samples. As per he recommended raio of raining and esing, his can be given in percenage such as 90%: 10%, 85%: 15%, 80:20% and 70%: 30%. Hence ou of 30 experimenal daa 70% was used for raining, 15% for esing and 15% for validaion. So he recommended amouns of raining, esing and validaion samples were 20, 5 and 5 respecively. The inpu and oupu daa for he raining, esing and validaion samples are shown in Table 10.1.
8 182 Table 10.1 Design marixes for an ANN model wih measured value and prediced value of performance parameers S. No. Design marix Performance of measured values Performance of Prediced values V r L wf SFC BTE SFC BTE (kg) (ml/s) (kg/kwhr) (%) (kg/kwhr) (%)
9 183 The nex sep was o decide he suiable nework srucure for SFC and BTE. The nework srucure was usually designed based on rial and error. The process of rial and error was carried ou by adjusing he number of nodes of hidden layer of he nework srucure. Though i was free o check he nework wih any number of nodes in he hidden layer, however i was subjec o he complexiy of he mapping, compuer memory, compuaion ime and he desired daa conrol effec. If oo many nodes were used i may resul in wase of compuer memory and compuaion ime, while few nodes may no provide he desired daa conrol effec. Hence, he rial and error in his sudy were limied o one nework, which is The neworks were creaed in MATLAB 7.6. The nework archiecures are shown as Figure Figure 10.3 Nework archiecure showing en neurons in he hidden layer The raining of he nework was done by Levenberg Marquard (LM) algorihm. The Levenberg Marquard algorihm was designed o approach second order raining speed wihou having o compue he Hessian marix. When he performance funcion has he form of a sum of squares (as is ypical
10 184 in raining feed forward neworks) hen he Hessian marix can be approximaed as T H J J (10.10) Where H is he Hessian marix, he gradien can be compued as T g J e (10.11) Where J is he Jacobian marix ha conains firs derivaives of he neworks wih respec o he weighs and biases, e is a vecor of nework errors. The Jacobian marix can be compued hrough a sandard back propagaion echnique ha was much less complex han compuing Hessian marix. The Levenberg Marquard algorihm uses his approximaion o he Hessian marix using Equaion. X k 1 X K T J J 1 T J e (10.12) When X k 1 X K T J J 1 T J e. (10.13) The above equaion represens Newon mehod. This is faser and descen wih a small sep size. Hence, o move owards Newon s mehod o was decreased afer each successful sep (reducion in performance funcion) and was increased only when a enaive sep increases he performance funcion. In his way, he performance funcion was always reduced a he end of he corresponding ieraion of he algorihm. Hence, his algorihm appears o be a faser mehod for raining moderae-sized
11 185 feed forward neural neworks up o several hundred weighs (Mah Work Inc., 2008). During raining, he inpus o he neurons were modified wih approximae weigh. The sum of he modified weigh inpu and bias was hen modified by a an sigmoid ransfer funcion. Similarly, oupu from he las hidden layer was modified by an appropriae weigh and hen he sum of modified oupu signal was again modified by a an sigmoid ransfer funcion. The final oupu was colleced a he oupu layer Tesing of he nework Only one nework was esed o deermine he performance of he ANN model for predicing performance parameers. During raining, each ime a se of inpus X i of a raining sample was presened and he corresponding oupu O i (prediced values) was obained. The prediced value of he nework model was compared wih he acual value (d i ). The comparison was done by calculaing he mean sum of he squared error (MSE) beween d i and O i given in Equaion (10.13). MSE (d O ) 2 (10.14) i i The objecive of he algorihm was o minimize he mean sum of squared error for he enire experimenal daa RESULTS AND DISCUSSIONS Figure 10.4 shows he performance and error graph of SFC and BTE of nework The nework was rained for 174 ieraions and he bes validaion performance was I was obained a 174 epochs. The error percenage of his nework is in he range of -0.45% o 0.50%. This is shown in Figure 10.5 and 10.6.
12 186 Figure 10.4 Performance graph of nework Figure 10.5 Error graph of nework
13 187 Figure 10.6 Error graph of nework I is observed ha a prediced value of specific fuel consumpion and brake hermal efficiency was obained for raining, esing, and validaion of all he daa. The percenage error was wihin he limis of 0.05%. Hence here exiss a close relaionship beween he experimenal and prediced values. This indicaes ha he nework is suiable for he predicion of engine performance parameers of specific fuel consumpion and brake hermal efficiency VALIDATION OF RESULTS Confirmaory ess were conduced wih he same experimenal seup o validae he accuracy of he resuls obained. The resuls of confirmaory ess are presened in Table 10.2.
14 188 Table 10.2 Resuls of confirmaory ess Tes No Process Parameers OV PV B r L m w (ANN SFC BTE model) Specific fuel consumpion % Error Brake hermal efficiency PV (ANN model) % Error Mean Error OV is observed value and PV is prediced value of performance parameers. From he confirmaory ess, i was found ha he ANN model were able o predic he performance parameers wih high accuracy (Amarnah and Prabhakaran, 2012) SUMMARY This chaper has discussed he developmen of he ANN model for predicing performance of diesel engines. I has been found in he analysis of neural neworks ha he performance of he nework highly depends on he number of neurons in he hidden layer. This chaper discussed he performance of single nework which had differen neurons in he hidden layer. From he analysis, he nework which had high accuracy in predicing SFC and BTE was idenified. The models developed o predic he performance characerisics have high accuracy. This has been validaed by conducing confirmaory ess. The direc and ineracive effecs of he process parameers were presened in graphical form. This helped o undersand he behavior of he process parameers on performance characerisics. The algorihm which produced he accurae resul was idenified.
The Rosenblatt s LMS algorithm for Perceptron (1958) is built around a linear neuron (a neuron with a linear
In The name of God Lecure4: Percepron and AALIE r. Majid MjidGhoshunih Inroducion The Rosenbla s LMS algorihm for Percepron 958 is buil around a linear neuron a neuron ih a linear acivaion funcion. Hoever,
More informationSTATE-SPACE MODELLING. A mass balance across the tank gives:
B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing
More informationDimitri Solomatine. D.P. Solomatine. Data-driven modelling (part 2). 2
Daa-driven modelling. Par. Daa-driven Arificial di Neural modelling. Newors Par Dimiri Solomaine Arificial neural newors D.P. Solomaine. Daa-driven modelling par. 1 Arificial neural newors ANN: main pes
More informationDeep Learning: Theory, Techniques & Applications - Recurrent Neural Networks -
Deep Learning: Theory, Techniques & Applicaions - Recurren Neural Neworks - Prof. Maeo Maeucci maeo.maeucci@polimi.i Deparmen of Elecronics, Informaion and Bioengineering Arificial Inelligence and Roboics
More informationPhysics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle
Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,
More information04. Kinetics of a second order reaction
4. Kineics of a second order reacion Imporan conceps Reacion rae, reacion exen, reacion rae equaion, order of a reacion, firs-order reacions, second-order reacions, differenial and inegraed rae laws, Arrhenius
More informationRetrieval Models. Boolean and Vector Space Retrieval Models. Common Preprocessing Steps. Boolean Model. Boolean Retrieval Model
1 Boolean and Vecor Space Rerieval Models Many slides in his secion are adaped from Prof. Joydeep Ghosh (UT ECE) who in urn adaped hem from Prof. Dik Lee (Univ. of Science and Tech, Hong Kong) Rerieval
More informationAn recursive analytical technique to estimate time dependent physical parameters in the presence of noise processes
WHAT IS A KALMAN FILTER An recursive analyical echnique o esimae ime dependen physical parameers in he presence of noise processes Example of a ime and frequency applicaion: Offse beween wo clocks PREDICTORS,
More informationArticle from. Predictive Analytics and Futurism. July 2016 Issue 13
Aricle from Predicive Analyics and Fuurism July 6 Issue An Inroducion o Incremenal Learning By Qiang Wu and Dave Snell Machine learning provides useful ools for predicive analyics The ypical machine learning
More information5 The fitting methods used in the normalization of DSD
The fiing mehods used in he normalizaion of DSD.1 Inroducion Sempere-Torres e al. 1994 presened a general formulaion for he DSD ha was able o reproduce and inerpre all previous sudies of DSD. The mehodology
More informationNotes on Kalman Filtering
Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren
More informationNavneet Saini, Mayank Goyal, Vishal Bansal (2013); Term Project AML310; Indian Institute of Technology Delhi
Creep in Viscoelasic Subsances Numerical mehods o calculae he coefficiens of he Prony equaion using creep es daa and Herediary Inegrals Mehod Navnee Saini, Mayank Goyal, Vishal Bansal (23); Term Projec
More informationEnsamble methods: Bagging and Boosting
Lecure 21 Ensamble mehods: Bagging and Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Ensemble mehods Mixure of expers Muliple base models (classifiers, regressors), each covers a differen par
More informationApplication of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing
Applicaion of a Sochasic-Fuzzy Approach o Modeling Opimal Discree Time Dynamical Sysems by Using Large Scale Daa Processing AA WALASZE-BABISZEWSA Deparmen of Compuer Engineering Opole Universiy of Technology
More informationEnsamble methods: Boosting
Lecure 21 Ensamble mehods: Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Schedule Final exam: April 18: 1:00-2:15pm, in-class Term projecs April 23 & April 25: a 1:00-2:30pm in CS seminar room
More informationCourse Notes for EE227C (Spring 2018): Convex Optimization and Approximation
Course Noes for EE7C Spring 018: Convex Opimizaion and Approximaion Insrucor: Moriz Hard Email: hard+ee7c@berkeley.edu Graduae Insrucor: Max Simchowiz Email: msimchow+ee7c@berkeley.edu Ocober 15, 018 3
More informationKriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number
More informationRandom Walk with Anti-Correlated Steps
Random Walk wih Ani-Correlaed Seps John Noga Dirk Wagner 2 Absrac We conjecure he expeced value of random walks wih ani-correlaed seps o be exacly. We suppor his conjecure wih 2 plausibiliy argumens and
More informationFITTING OF A PARTIALLY REPARAMETERIZED GOMPERTZ MODEL TO BROILER DATA
FITTING OF A PARTIALLY REPARAMETERIZED GOMPERTZ MODEL TO BROILER DATA N. Okendro Singh Associae Professor (Ag. Sa.), College of Agriculure, Cenral Agriculural Universiy, Iroisemba 795 004, Imphal, Manipur
More informationChapter 3 Boundary Value Problem
Chaper 3 Boundary Value Problem A boundary value problem (BVP) is a problem, ypically an ODE or a PDE, which has values assigned on he physical boundary of he domain in which he problem is specified. Le
More informationVehicle Arrival Models : Headway
Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where
More informationTime series Decomposition method
Time series Decomposiion mehod A ime series is described using a mulifacor model such as = f (rend, cyclical, seasonal, error) = f (T, C, S, e) Long- Iner-mediaed Seasonal Irregular erm erm effec, effec,
More informationExperiments on logistic regression
Experimens on logisic regression Ning Bao March, 8 Absrac In his repor, several experimens have been conduced on a spam daa se wih Logisic Regression based on Gradien Descen approach. Firs, he overfiing
More information20. Applications of the Genetic-Drift Model
0. Applicaions of he Geneic-Drif Model 1) Deermining he probabiliy of forming any paricular combinaion of genoypes in he nex generaion: Example: If he parenal allele frequencies are p 0 = 0.35 and q 0
More informationZürich. ETH Master Course: L Autonomous Mobile Robots Localization II
Roland Siegwar Margaria Chli Paul Furgale Marco Huer Marin Rufli Davide Scaramuzza ETH Maser Course: 151-0854-00L Auonomous Mobile Robos Localizaion II ACT and SEE For all do, (predicion updae / ACT),
More informationNONLINEAR SYSTEM IDENTIFICATION USING RBF NETWORKS WITH LINEAR INPUT CONNECTIONS
Malaysian Journal of Compuer Science, Vol. No., June 998, pp. 74-80 NONLINEAR SYSEM IDENIFICAION USING RBF NEWORKS WIH LINEAR INPU CONNECIONS Mohd Yusoff Mashor School of Elecrical Elecronic Engineering
More informationLecture 3: Exponential Smoothing
NATCOR: Forecasing & Predicive Analyics Lecure 3: Exponenial Smoohing John Boylan Lancaser Cenre for Forecasing Deparmen of Managemen Science Mehods and Models Forecasing Mehod A (numerical) procedure
More informationAir Quality Index Prediction Using Error Back Propagation Algorithm and Improved Particle Swarm Optimization
Air Qualiy Index Predicion Using Error Back Propagaion Algorihm and Improved Paricle Swarm Opimizaion Jia Xu ( ) and Lang Pei College of Compuer Science, Wuhan Qinchuan Universiy, Wuhan, China 461406563@qq.com
More informationDiebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles
Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance
More informationTom Heskes and Onno Zoeter. Presented by Mark Buller
Tom Heskes and Onno Zoeer Presened by Mark Buller Dynamic Bayesian Neworks Direced graphical models of sochasic processes Represen hidden and observed variables wih differen dependencies Generalize Hidden
More information10. State Space Methods
. Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he
More informationAn EM based training algorithm for recurrent neural networks
An EM based raining algorihm for recurren neural neworks Jan Unkelbach, Sun Yi, and Jürgen Schmidhuber IDSIA,Galleria 2, 6928 Manno, Swizerland {jan.unkelbach,yi,juergen}@idsia.ch hp://www.idsia.ch Absrac.
More informationA Shooting Method for A Node Generation Algorithm
A Shooing Mehod for A Node Generaion Algorihm Hiroaki Nishikawa W.M.Keck Foundaion Laboraory for Compuaional Fluid Dynamics Deparmen of Aerospace Engineering, Universiy of Michigan, Ann Arbor, Michigan
More informationReferences are appeared in the last slide. Last update: (1393/08/19)
SYSEM IDEIFICAIO Ali Karimpour Associae Professor Ferdowsi Universi of Mashhad References are appeared in he las slide. Las updae: 0..204 393/08/9 Lecure 5 lecure 5 Parameer Esimaion Mehods opics o be
More informationLocal Linear Least Squares: Performing Leave-one-out Without Leaving Anything Out
Local Linear Leas Squares: Performing Leave-one-ou Wihou Leaving Anyhing Ou Gaéan MOARI*, **, Gérard DREYFUS* *École Supérieure de Physique e de Chimie Indusrielles de la Ville de Paris Laboraoire d'élecronique
More informationLab 10: RC, RL, and RLC Circuits
Lab 10: RC, RL, and RLC Circuis In his experimen, we will invesigae he behavior of circuis conaining combinaions of resisors, capaciors, and inducors. We will sudy he way volages and currens change in
More informationSmoothing. Backward smoother: At any give T, replace the observation yt by a combination of observations at & before T
Smoohing Consan process Separae signal & noise Smooh he daa: Backward smooher: A an give, replace he observaion b a combinaion of observaions a & before Simple smooher : replace he curren observaion wih
More informationCSE/NB 528 Lecture 14: From Supervised to Reinforcement Learning (Chapter 9) R. Rao, 528: Lecture 14
CSE/NB 58 Lecure 14: From Supervised o Reinforcemen Learning Chaper 9 1 Recall from las ime: Sigmoid Neworks Oupu v T g w u g wiui w Inpu nodes u = u 1 u u 3 T i Sigmoid oupu funcion: 1 g a 1 a e 1 ga
More informationHW6: MRI Imaging Pulse Sequences (7 Problems for 100 pts)
HW6: MRI Imaging Pulse Sequences (7 Problems for 100 ps) GOAL The overall goal of HW6 is o beer undersand pulse sequences for MRI image reconsrucion. OBJECTIVES 1) Design a spin echo pulse sequence o image
More informationRC, RL and RLC circuits
Name Dae Time o Complee h m Parner Course/ Secion / Grade RC, RL and RLC circuis Inroducion In his experimen we will invesigae he behavior of circuis conaining combinaions of resisors, capaciors, and inducors.
More informationSterilization D Values
Seriliaion D Values Seriliaion by seam consis of he simple observaion ha baceria die over ime during exposure o hea. They do no all live for a finie period of hea exposure and hen suddenly die a once,
More informationINTRODUCTION TO MACHINE LEARNING 3RD EDITION
ETHEM ALPAYDIN The MIT Press, 2014 Lecure Slides for INTRODUCTION TO MACHINE LEARNING 3RD EDITION alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/~ehem/i2ml3e CHAPTER 2: SUPERVISED LEARNING Learning a Class
More informationModal identification of structures from roving input data by means of maximum likelihood estimation of the state space model
Modal idenificaion of srucures from roving inpu daa by means of maximum likelihood esimaion of he sae space model J. Cara, J. Juan, E. Alarcón Absrac The usual way o perform a forced vibraion es is o fix
More informationSimulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010
Simulaion-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Week Descripion Reading Maerial 2 Compuer Simulaion of Dynamic Models Finie Difference, coninuous saes, discree ime Simple Mehods Euler Trapezoid
More informationSequential Importance Resampling (SIR) Particle Filter
Paricle Filers++ Pieer Abbeel UC Berkeley EECS Many slides adaped from Thrun, Burgard and Fox, Probabilisic Roboics 1. Algorihm paricle_filer( S -1, u, z ): 2. Sequenial Imporance Resampling (SIR) Paricle
More informationACE 564 Spring Lecture 7. Extensions of The Multiple Regression Model: Dummy Independent Variables. by Professor Scott H.
ACE 564 Spring 2006 Lecure 7 Exensions of The Muliple Regression Model: Dumm Independen Variables b Professor Sco H. Irwin Readings: Griffihs, Hill and Judge. "Dumm Variables and Varing Coefficien Models
More informationRefraction coefficient determination and modelling for the territory of the Kingdom of Saudi Arabia
Presened a he FIG ongress 08, May 6-, 08 in Isanbul, Turkey Refracion coefficien deerminaion and modelling for he erriory of he Kingdom of Saudi Arabia Ohman AL-KHERAYEF, KSA Vasil VALHINOV, BG Rossen
More informationSub Module 2.6. Measurement of transient temperature
Mechanical Measuremens Prof. S.P.Venkaeshan Sub Module 2.6 Measuremen of ransien emperaure Many processes of engineering relevance involve variaions wih respec o ime. The sysem properies like emperaure,
More informationChapter 7: Inverse-Response Systems
Chaper 7: Invere-Repone Syem Normal Syem Invere-Repone Syem Baic Sar ou in he wrong direcion End up in he original eady-ae gain value Two or more yem wih differen magniude and cale in parallel Main yem
More informationAn introduction to the theory of SDDP algorithm
An inroducion o he heory of SDDP algorihm V. Leclère (ENPC) Augus 1, 2014 V. Leclère Inroducion o SDDP Augus 1, 2014 1 / 21 Inroducion Large scale sochasic problem are hard o solve. Two ways of aacking
More informationACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin
ACE 56 Fall 005 Lecure 4: Simple Linear Regression Model: Specificaion and Esimaion by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Simple Regression: Economic and Saisical Model
More informationSome Basic Information about M-S-D Systems
Some Basic Informaion abou M-S-D Sysems 1 Inroducion We wan o give some summary of he facs concerning unforced (homogeneous) and forced (non-homogeneous) models for linear oscillaors governed by second-order,
More informationR t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t
Exercise 7 C P = α + β R P + u C = αp + βr + v (a) (b) C R = α P R + β + w (c) Assumpions abou he disurbances u, v, w : Classical assumions on he disurbance of one of he equaions, eg. on (b): E(v v s P,
More information) were both constant and we brought them from under the integral.
YIELD-PER-RECRUIT (coninued The yield-per-recrui model applies o a cohor, bu we saw in he Age Disribuions lecure ha he properies of a cohor do no apply in general o a collecion of cohors, which is wha
More informationnot to be republished NCERT MATHEMATICAL MODELLING Appendix 2 A.2.1 Introduction A.2.2 Why Mathematical Modelling?
256 MATHEMATICS A.2.1 Inroducion In class XI, we have learn abou mahemaical modelling as an aemp o sudy some par (or form) of some real-life problems in mahemaical erms, i.e., he conversion of a physical
More informationGeorey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract
Parameer Esimaion for Linear Dynamical Sysems Zoubin Ghahramani Georey E. Hinon Deparmen of Compuer Science Universiy oftorono 6 King's College Road Torono, Canada M5S A4 Email: zoubin@cs.orono.edu Technical
More informationComputer-Aided Analysis of Electronic Circuits Course Notes 3
Gheorghe Asachi Technical Universiy of Iasi Faculy of Elecronics, Telecommunicaions and Informaion Technologies Compuer-Aided Analysis of Elecronic Circuis Course Noes 3 Bachelor: Telecommunicaion Technologies
More informationAir Traffic Forecast Empirical Research Based on the MCMC Method
Compuer and Informaion Science; Vol. 5, No. 5; 0 ISSN 93-8989 E-ISSN 93-8997 Published by Canadian Cener of Science and Educaion Air Traffic Forecas Empirical Research Based on he MCMC Mehod Jian-bo Wang,
More informationLecture 10 - Model Identification
Lecure - odel Idenificaion Wha is ssem idenificaion? Direc impulse response idenificaion Linear regression Regularizaion Parameric model ID nonlinear LS Conrol Engineering - Wha is Ssem Idenificaion? Experimen
More informationd 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3
and d = c b - b c c d = c b - b c c This process is coninued unil he nh row has been compleed. The complee array of coefficiens is riangular. Noe ha in developing he array an enire row may be divided or
More informationL07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms
L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)
More informationEE 301 Lab 2 Convolution
EE 301 Lab 2 Convoluion 1 Inroducion In his lab we will gain some more experience wih he convoluion inegral and creae a scrip ha shows he graphical mehod of convoluion. 2 Wha you will learn This lab will
More informationOn Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature
On Measuring Pro-Poor Growh 1. On Various Ways of Measuring Pro-Poor Growh: A Shor eview of he Lieraure During he pas en years or so here have been various suggesions concerning he way one should check
More informationY. Xiang, Learning Bayesian Networks 1
Learning Bayesian Neworks Objecives Acquisiion of BNs Technical conex of BN learning Crierion of sound srucure learning BN srucure learning in 2 seps BN CPT esimaion Reference R.E. Neapolian: Learning
More informationOutline. lse-logo. Outline. Outline. 1 Wald Test. 2 The Likelihood Ratio Test. 3 Lagrange Multiplier Tests
Ouline Ouline Hypohesis Tes wihin he Maximum Likelihood Framework There are hree main frequenis approaches o inference wihin he Maximum Likelihood framework: he Wald es, he Likelihood Raio es and he Lagrange
More informationClass Meeting # 10: Introduction to the Wave Equation
MATH 8.5 COURSE NOTES - CLASS MEETING # 0 8.5 Inroducion o PDEs, Fall 0 Professor: Jared Speck Class Meeing # 0: Inroducion o he Wave Equaion. Wha is he wave equaion? The sandard wave equaion for a funcion
More informationKINEMATICS IN ONE DIMENSION
KINEMATICS IN ONE DIMENSION PREVIEW Kinemaics is he sudy of how hings move how far (disance and displacemen), how fas (speed and velociy), and how fas ha how fas changes (acceleraion). We say ha an objec
More informationRobust estimation based on the first- and third-moment restrictions of the power transformation model
h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,
More informationChapter 15. Time Series: Descriptive Analyses, Models, and Forecasting
Chaper 15 Time Series: Descripive Analyses, Models, and Forecasing Descripive Analysis: Index Numbers Index Number a number ha measures he change in a variable over ime relaive o he value of he variable
More informationAnalyze patterns and relationships. 3. Generate two numerical patterns using AC
envision ah 2.0 5h Grade ah Curriculum Quarer 1 Quarer 2 Quarer 3 Quarer 4 andards: =ajor =upporing =Addiional Firs 30 Day 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 andards: Operaions and Algebraic Thinking
More informationAdaptive Noise Estimation Based on Non-negative Matrix Factorization
dvanced cience and Technology Leers Vol.3 (ICC 213), pp.159-163 hp://dx.doi.org/1.14257/asl.213 dapive Noise Esimaion ased on Non-negaive Marix Facorizaion Kwang Myung Jeon and Hong Kook Kim chool of Informaion
More informationMagnetic Field Synthesis in an Open-Boundary Region Exploiting Thévenin Equivalent Conditions
Magneic Field Synhesis in an Open-Boundary Region Exploiing Thévenin Equivalen Condiions Paolo DI BARBA, PhD Dep of Indusrial and Informaion Engineering Universiy of Pavia, Ialy paolo.dibarba@unipv.i Ouline
More informationEXERCISES FOR SECTION 1.5
1.5 Exisence and Uniqueness of Soluions 43 20. 1 v c 21. 1 v c 1 2 4 6 8 10 1 2 2 4 6 8 10 Graph of approximae soluion obained using Euler s mehod wih = 0.1. Graph of approximae soluion obained using Euler
More informationWEEK-3 Recitation PHYS 131. of the projectile s velocity remains constant throughout the motion, since the acceleration a x
WEEK-3 Reciaion PHYS 131 Ch. 3: FOC 1, 3, 4, 6, 14. Problems 9, 37, 41 & 71 and Ch. 4: FOC 1, 3, 5, 8. Problems 3, 5 & 16. Feb 8, 018 Ch. 3: FOC 1, 3, 4, 6, 14. 1. (a) The horizonal componen of he projecile
More informationMath 333 Problem Set #2 Solution 14 February 2003
Mah 333 Problem Se #2 Soluion 14 February 2003 A1. Solve he iniial value problem dy dx = x2 + e 3x ; 2y 4 y(0) = 1. Soluion: This is separable; we wrie 2y 4 dy = x 2 + e x dx and inegrae o ge The iniial
More informationEE100 Lab 3 Experiment Guide: RC Circuits
I. Inroducion EE100 Lab 3 Experimen Guide: A. apaciors A capacior is a passive elecronic componen ha sores energy in he form of an elecrosaic field. The uni of capaciance is he farad (coulomb/vol). Pracical
More informationNature Neuroscience: doi: /nn Supplementary Figure 1. Spike-count autocorrelations in time.
Supplemenary Figure 1 Spike-coun auocorrelaions in ime. Normalized auocorrelaion marices are shown for each area in a daase. The marix shows he mean correlaion of he spike coun in each ime bin wih he spike
More informationLinear Response Theory: The connection between QFT and experiments
Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and
More informationDynamic Econometric Models: Y t = + 0 X t + 1 X t X t k X t-k + e t. A. Autoregressive Model:
Dynamic Economeric Models: A. Auoregressive Model: Y = + 0 X 1 Y -1 + 2 Y -2 + k Y -k + e (Wih lagged dependen variable(s) on he RHS) B. Disribued-lag Model: Y = + 0 X + 1 X -1 + 2 X -2 + + k X -k + e
More informationPattern Classification and NNet applications with memristive crossbar circuits. Fabien ALIBART D. Strukov s group, ECE-UCSB Now at IEMN-CNRS, France
Paern Classificaion and NNe applicaions wih memrisive crossbar circuis Fabien ALIBART D. Srukov s group, ECE-UCSB Now a IEMN-CNRS, France Ouline Inroducion: Neural Nework wih memrisive devices Engineering
More informationEmbedded Systems and Software. A Simple Introduction to Embedded Control Systems (PID Control)
Embedded Sysems and Sofware A Simple Inroducion o Embedded Conrol Sysems (PID Conrol) Embedded Sysems and Sofware, ECE:3360. The Universiy of Iowa, 2016 Slide 1 Acknowledgemens The maerial in his lecure
More informationm = 41 members n = 27 (nonfounders), f = 14 (founders) 8 markers from chromosome 19
Sequenial Imporance Sampling (SIS) AKA Paricle Filering, Sequenial Impuaion (Kong, Liu, Wong, 994) For many problems, sampling direcly from he arge disribuion is difficul or impossible. One reason possible
More information5.2. The Natural Logarithm. Solution
5.2 The Naural Logarihm The number e is an irraional number, similar in naure o π. Is non-erminaing, non-repeaing value is e 2.718 281 828 59. Like π, e also occurs frequenly in naural phenomena. In fac,
More informationThe SOC Estimation of Power Li-Ion Battery Based on ANFIS Model *
Smar Grid and Renewable Energy, 202, 3, 5-55 hp://dx.doi.org/0.4236/sgre.202.3007 Published Online February 202 (hp://www.scirp.org/journal/sgre) 5 The SOC Esimaion of Power Li-Ion Baery Based on ANFIS
More informationTypes of Exponential Smoothing Methods. Simple Exponential Smoothing. Simple Exponential Smoothing
M Business Forecasing Mehods Exponenial moohing Mehods ecurer : Dr Iris Yeung Room No : P79 Tel No : 788 8 Types of Exponenial moohing Mehods imple Exponenial moohing Double Exponenial moohing Brown s
More informationINVERSE RESPONSE COMPENSATION BY ESTIMATING PARAMETERS OF A PROCESS COMPRISING OF TWO FIRST ORDER SYSTEMS
Inernaional Journal of Informaion Technology and nowledge Managemen July-December 0, Volume 5, No., pp. 433-438 INVERSE RESPONSE COMPENSATION BY ESTIMATING PARAMETERS OF A PROCESS COMPRISING OF TWO FIRST
More informationPENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD
PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD HAN XIAO 1. Penalized Leas Squares Lasso solves he following opimizaion problem, ˆβ lasso = arg max β R p+1 1 N y i β 0 N x ij β j β j (1.1) for some 0.
More informationThe Simple Linear Regression Model: Reporting the Results and Choosing the Functional Form
Chaper 6 The Simple Linear Regression Model: Reporing he Resuls and Choosing he Funcional Form To complee he analysis of he simple linear regression model, in his chaper we will consider how o measure
More informationTheory of! Partial Differential Equations!
hp://www.nd.edu/~gryggva/cfd-course/! Ouline! Theory o! Parial Dierenial Equaions! Gréar Tryggvason! Spring 011! Basic Properies o PDE!! Quasi-linear Firs Order Equaions! - Characerisics! - Linear and
More informationTime Series Forecasting using CCA and Kohonen Maps - Application to Electricity Consumption
ESANN'2000 proceedings - European Symposium on Arificial Neural Neworks Bruges (Belgium), 26-28 April 2000, D-Faco public., ISBN 2-930307-00-5, pp. 329-334. Time Series Forecasing using CCA and Kohonen
More informationRobust Learning Control with Application to HVAC Systems
Robus Learning Conrol wih Applicaion o HVAC Sysems Naional Science Foundaion & Projec Invesigaors: Dr. Charles Anderson, CS Dr. Douglas Hile, ME Dr. Peer Young, ECE Mechanical Engineering Compuer Science
More informationMean-square Stability Control for Networked Systems with Stochastic Time Delay
JOURNAL OF SIMULAION VOL. 5 NO. May 7 Mean-square Sabiliy Conrol for Newored Sysems wih Sochasic ime Delay YAO Hejun YUAN Fushun School of Mahemaics and Saisics Anyang Normal Universiy Anyang Henan. 455
More informationPade and Laguerre Approximations Applied. to the Active Queue Management Model. of Internet Protocol
Applied Mahemaical Sciences, Vol. 7, 013, no. 16, 663-673 HIKARI Ld, www.m-hikari.com hp://dx.doi.org/10.1988/ams.013.39499 Pade and Laguerre Approximaions Applied o he Acive Queue Managemen Model of Inerne
More informationUNIVERSITÀ DI PISA DIPARTIMENTO DI INGEGNERIA MECCANICA, NUCLEARE E DELLA PRODUZIONE VIA DIOTISALVI 2, PISA
G r u p p o R I c e r c a N u c le a r e S a n P I e r o a G r a d o N u c l e a r a n d I n d u s r I a l E n g I n e e r I n g UNIVERSIÀ DI PISA DIPARIMENO DI INGEGNERIA MECCANICA NUCLEARE E DELLA PRODUZIONE
More informationMATH 5720: Gradient Methods Hung Phan, UMass Lowell October 4, 2018
MATH 5720: Gradien Mehods Hung Phan, UMass Lowell Ocober 4, 208 Descen Direcion Mehods Consider he problem min { f(x) x R n}. The general descen direcions mehod is x k+ = x k + k d k where x k is he curren
More informationContinuous Time. Time-Domain System Analysis. Impulse Response. Impulse Response. Impulse Response. Impulse Response. ( t) + b 0.
Time-Domain Sysem Analysis Coninuous Time. J. Robers - All Righs Reserved. Edied by Dr. Rober Akl 1. J. Robers - All Righs Reserved. Edied by Dr. Rober Akl 2 Le a sysem be described by a 2 y ( ) + a 1
More informationLecture 2 October ε-approximation of 2-player zero-sum games
Opimizaion II Winer 009/10 Lecurer: Khaled Elbassioni Lecure Ocober 19 1 ε-approximaion of -player zero-sum games In his lecure we give a randomized ficiious play algorihm for obaining an approximae soluion
More informationRapid Termination Evaluation for Recursive Subdivision of Bezier Curves
Rapid Terminaion Evaluaion for Recursive Subdivision of Bezier Curves Thomas F. Hain School of Compuer and Informaion Sciences, Universiy of Souh Alabama, Mobile, AL, U.S.A. Absrac Bézier curve flaening
More informationStable block Toeplitz matrix for the processing of multichannel seismic data
Indian Journal of Marine Sciences Vol. 33(3), Sepember 2004, pp. 215-219 Sable block Toepliz marix for he processing of mulichannel seismic daa Kiri Srivasava* & V P Dimri Naional Geophysical Research
More informationElectrical and current self-induction
Elecrical and curren self-inducion F. F. Mende hp://fmnauka.narod.ru/works.hml mende_fedor@mail.ru Absrac The aricle considers he self-inducance of reacive elemens. Elecrical self-inducion To he laws of
More information