Pattern Classification (VI) 杜俊
|
|
- Toby Fletcher
- 5 years ago
- Views:
Transcription
1 Paern lassificaion VI 杜俊
2 Ouline Bayesian Decision Theory How o make he oimal decision? Maximum a oserior MAP decision rule Generaive Models Join disribuion of observaion and label sequences Model esimaion: MLE Bayesian learning discriminaive raining Discriminaive Models Model he oserior robabiliy direcly discriminan funcion Logisic regression suor vecor machine neural nework
3 Saisical Models: Roadma Gaussian -d Mulivariae Gaussian oninuous daa Discree daa GMM Markov hain DHMM DDHMM Grahical Models Mulinomial Mixure of Mulinomial Esimaion: ML Bayesian DT
4 Model Parameer Esimaion Maximum Likelihood ML Esimaion: ML mehod: mos oular model esimaion EM Execed-Maximizaion algorihm Examles: Univariae Gaussian disribuion Mulivariae Gaussian disribuion Mulinomial disribuion Gaussian Mixure model Markov chain model: n-gram for language modeling Hidden Markov Model HMM Discriminaive Training Minimum lassificaion Error ME Maximum Muual Informaion MMI Bayesian Model Esimaion: Bayesian heory
5 Minimum lassificaion Error Esimaion I In a -class aern classificaion roblem given a se of raining daa D{ T T} esimae model arameers for all class o minimize oal classificaion errors in D. ME: minimize emirical classificaion errors Objecive funcion oal classificaion errors in D For each raining daa define misclassificaion measure: or d + max d ln[ ] + max ln[ ] If d >0 incorrec classificaion for error If d <0 correc classificaion for 0 error
6 Minimum lassificaion Error Esimaion II Sof-max: aroximae d by a differeniable funcion: or η η / ] ex[ ln + d η η / ] ln ex[ ln ] ln[ + d where η>.
7 Minimum lassificaion Error Esimaion III Error coun for one daa is a se funcion Hd Toal errors in raining se: Q Λ T H d Se funcion is no differeniable aroximaed by a sigmoid funcion smoohed oal errors in raining se. Q Λ Q' Λ T l d where a>0 is a arameer o conrol is shae.
8 Minimum lassificaion Error Esimaion IV ME esimaion of model arameers for all classes: { } ME arg min Q' Oimizaion: no simle soluion is available Ieraive gradien descen mehod. Sochasic GD bach mode mini-bach mode
9 Minimum lassificaion Error Esimaion V Find iniial model arameers e.g. ML esimaes alculae gradien of he objecive funcion alculae he value of he gradien based on he curren arameers Udae model arameers Ierae unil convergence
10 How o alculae Gradien? [ ] T i T i T i i d d l d l a d d d l d l Q ] [ ' The key issue in ME raining is o se a roer se size exerimenally.
11 Overraining Overfiing Low classificaion error rae in raining se does no always lead o a low error rae in a new es se due o overraining.
12 Measuring Performance of ME Objecive funcion lassificaion Error in % When o converge: monior hree quaniies in he ME The objecive funcion Error rae in raining se Error rae in es se
13 Maximum Muual Informaion Esimaion I The model is viewed as a noisy daa generaion channel lass id observaion feaure Maximize muual informaion beween and noisy daa generaion channel I log log log log arg max } { MMI I
14 Maximum Muual Informaion Esimaion II Difficuly: join disribuion is unknown. Soluion: collec a reresenaive raining se T T o aroximae he join disribuion. Oimizaion: Ieraive gradien-ascen mehod Growh-ransformaion mehod T I MMI log arg max log arg max arg max } {
15 Bayesian Model Esimaion Bayesian mehods view model arameers as random variables having some known rior disribuion. Prior secificaion Secify rior disribuion of model arameers θ as θ. Training daa D allow us o conver he rior disribuion ino a oseriori disribuion. Bayesian learning
16 Bayesian Learning Poseriori Likelihood D θ Prior θmap θml
17 MAP Esimaion Do a oin esimae abou θ based on he oseriori disribuion θ MAP arg max θ θ D arg max θ D θ Then θmap is reaed as esimae of model arameers jus like ML esimae. Someimes need he EM algorihm o derive i. MAP esimaion oimally combine rior knowledge wih new informaion rovided by daa. MAP esimaion is used in seech recogniion o ada seech models o a aricular seaker o coe wih various accens From a generic seaker-indeenden seech model rior ollec a small se of daa from a aricular seaker The MAP esimae give a seaker-adaive model which suis beer o his aricular seaker. θ
18 How o Secify Priors oninformaive riors Wihou enough rior knowledge jus use a fla rior onjugae riors: for comuaion convenience Afer Bayesian leaning he oserior will have he exac same funcion form as he rior exce he all arameers are udaed. o every model has conjugae rior.
19 onjugae Prior For a univariae Gaussian model wih only unknown mean: The conjugae rior of Gaussian is Gaussian Afer observing a new daa x he oserior will sill be Gaussian: ] ex[ µ π µ x x x where ] ex[ µ µ µ µ π µ µ µ x x
20 The Sequenial MAP Esimae of Gaussian For univariae Gaussian wih unknown mean he MAP esimae of is mean afer observing x: Afer observing nex daa x:
21 Projec: Building a -lass lassifier Given some daa from wo classes Build a classifier wih mulivariae Gaussian models ML esimaion Tes wih he lug-in MAP decision rule Imrove i wih GMM models Iniialize GMM wih he K-means clusering Esimae GMM wih he EM algorihm Invesigae GMM wih he mixure number 4 8. Imrove he Gaussian classifier wih discriminaive raining minimum classificaion error esimaion Preferably rogramming wih /++ Reor all of your exerimens and your bes classifier.
Pattern Classification (III) & Pattern Verification
Preare by Prof. Hu Jang CSE638 --4 CSE638 3. Seech & Language Processng o.5 Paern Classfcaon III & Paern Verfcaon Prof. Hu Jang Dearmen of Comuer Scence an Engneerng York Unversy Moel Parameer Esmaon Maxmum
More informationEnsamble methods: Boosting
Lecure 21 Ensamble mehods: Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Schedule Final exam: April 18: 1:00-2:15pm, in-class Term projecs April 23 & April 25: a 1:00-2:30pm in CS seminar room
More informationEnsamble methods: Bagging and Boosting
Lecure 21 Ensamble mehods: Bagging and Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Ensemble mehods Mixure of expers Muliple base models (classifiers, regressors), each covers a differen par
More informationSpeaker Adaptation Techniques For Continuous Speech Using Medium and Small Adaptation Data Sets. Constantinos Boulis
Speaker Adapaion Techniques For Coninuous Speech Using Medium and Small Adapaion Daa Ses Consaninos Boulis Ouline of he Presenaion Inroducion o he speaker adapaion problem Maximum Likelihood Sochasic Transformaions
More informationAnno accademico 2006/2007. Davide Migliore
Roboica Anno accademico 2006/2007 Davide Migliore migliore@ele.polimi.i Today Eercise session: An Off-side roblem Robo Vision Task Measuring NBA layers erformance robabilisic Roboics Inroducion The Bayesian
More informationTom Heskes and Onno Zoeter. Presented by Mark Buller
Tom Heskes and Onno Zoeer Presened by Mark Buller Dynamic Bayesian Neworks Direced graphical models of sochasic processes Represen hidden and observed variables wih differen dependencies Generalize Hidden
More informationA variational radial basis function approximation for diffusion processes.
A variaional radial basis funcion approximaion for diffusion processes. Michail D. Vreas, Dan Cornford and Yuan Shen {vreasm, d.cornford, y.shen}@ason.ac.uk Ason Universiy, Birmingham, UK hp://www.ncrg.ason.ac.uk
More information0.1 MAXIMUM LIKELIHOOD ESTIMATION EXPLAINED
0.1 MAXIMUM LIKELIHOOD ESTIMATIO EXPLAIED Maximum likelihood esimaion is a bes-fi saisical mehod for he esimaion of he values of he parameers of a sysem, based on a se of observaions of a random variable
More informationExperiments on logistic regression
Experimens on logisic regression Ning Bao March, 8 Absrac In his repor, several experimens have been conduced on a spam daa se wih Logisic Regression based on Gradien Descen approach. Firs, he overfiing
More informationDeep Learning: Theory, Techniques & Applications - Recurrent Neural Networks -
Deep Learning: Theory, Techniques & Applicaions - Recurren Neural Neworks - Prof. Maeo Maeucci maeo.maeucci@polimi.i Deparmen of Elecronics, Informaion and Bioengineering Arificial Inelligence and Roboics
More informationFORECASTS GENERATING FOR ARCH-GARCH PROCESSES USING THE MATLAB PROCEDURES
FORECASS GENERAING FOR ARCH-GARCH PROCESSES USING HE MALAB PROCEDURES Dušan Marček, Insiue of Comuer Science, Faculy of Philosohy and Science, he Silesian Universiy Oava he Faculy of Managemen Science
More informationLinear Gaussian State Space Models
Linear Gaussian Sae Space Models Srucural Time Series Models Level and Trend Models Basic Srucural Model (BSM Dynamic Linear Models Sae Space Model Represenaion Level, Trend, and Seasonal Models Time Varying
More informationNon-parametric techniques. Instance Based Learning. NN Decision Boundaries. Nearest Neighbor Algorithm. Distance metric important
on-parameric echniques Insance Based Learning AKA: neares neighbor mehods, non-parameric, lazy, memorybased, or case-based learning Copyrigh 2005 by David Helmbold 1 Do no fi a model (as do LDA, logisic
More informationCptS 570 Machine Learning School of EECS Washington State University. CptS Machine Learning 1
CpS 570 Machine Learning School of EECS Washingon Sae Universiy CpS 570 - Machine Learning 1 Form of underlying disribuions unknown Bu sill wan o perform classificaion and regression Semi-parameric esimaion
More informationNon-parametric techniques. Instance Based Learning. NN Decision Boundaries. Nearest Neighbor Algorithm. Distance metric important
on-parameric echniques Insance Based Learning AKA: neares neighbor mehods, non-parameric, lazy, memorybased, or case-based learning Copyrigh 2005 by David Helmbold 1 Do no fi a model (as do LTU, decision
More informationArticle from. Predictive Analytics and Futurism. July 2016 Issue 13
Aricle from Predicive Analyics and Fuurism July 6 Issue An Inroducion o Incremenal Learning By Qiang Wu and Dave Snell Machine learning provides useful ools for predicive analyics The ypical machine learning
More informationZápadočeská Univerzita v Plzni, Czech Republic and Groupe ESIEE Paris, France
ADAPTIVE SIGNAL PROCESSING USING MAXIMUM ENTROPY ON THE MEAN METHOD AND MONTE CARLO ANALYSIS Pavla Holejšovsá, Ing. *), Z. Peroua, Ing. **), J.-F. Bercher, Prof. Assis. ***) Západočesá Univerzia v Plzni,
More informationON DETERMINATION OF SOME CHARACTERISTICS OF SEMI-MARKOV PROCESS FOR DIFFERENT DISTRIBUTIONS OF TRANSIENT PROBABILITIES ABSTRACT
Zajac, Budny ON DETERMINATION O SOME CHARACTERISTICS O SEMI MARKOV PROCESS OR DIERENT DISTRIBUTIONS O R&RATA # 2(3 ar 2 (Vol. 2 29, June ON DETERMINATION O SOME CHARACTERISTICS O SEMI-MARKOV PROCESS OR
More informationMaterial Resistance and Friction in Cold Rolling
h World Congresses of Srucural and Mulidiscilinary Oimizaion Rio de Janeiro, 30 May - 03 June 200, Brazil Maerial Resisance and Fricion in Cold Rolling A.K. Tieu, C. You, H.T. Zhu, C. Lu, Z.Y. Jiang and
More informationDescription of the MS-Regress R package (Rmetrics)
Descriion of he MS-Regress R ackage (Rmerics) Auhor: Marcelo Perlin PhD Suden / ICMA Reading Universiy Email: marceloerlin@gmail.com / m.erlin@icmacenre.ac.uk The urose of his documen is o show he general
More informationAir Traffic Forecast Empirical Research Based on the MCMC Method
Compuer and Informaion Science; Vol. 5, No. 5; 0 ISSN 93-8989 E-ISSN 93-8997 Published by Canadian Cener of Science and Educaion Air Traffic Forecas Empirical Research Based on he MCMC Mehod Jian-bo Wang,
More informationCSE-473. A Gentle Introduction to Particle Filters
CSE-473 A Genle Inroducion o Paricle Filers Bayes Filers for Robo Localizaion Dieer Fo 2 Bayes Filers: Framework Given: Sream of observaions z and acion daa u: d Sensor model Pz. = { u, z2, u 1, z 1 Dynamics
More informationThe Rosenblatt s LMS algorithm for Perceptron (1958) is built around a linear neuron (a neuron with a linear
In The name of God Lecure4: Percepron and AALIE r. Majid MjidGhoshunih Inroducion The Rosenbla s LMS algorihm for Percepron 958 is buil around a linear neuron a neuron ih a linear acivaion funcion. Hoever,
More informationSpeech and Language Processing
Speech and Language rocessing Lecure 4 Variaional inference and sampling Informaion and Communicaions Engineering Course Takahiro Shinozaki 08//5 Lecure lan (Shinozaki s par) I gives he firs 6 lecures
More informationHidden Markov Models
Hidden Markov Models Probabilisic reasoning over ime So far, we ve mosly deal wih episodic environmens Excepions: games wih muliple moves, planning In paricular, he Bayesian neworks we ve seen so far describe
More information1. Consider a pure-exchange economy with stochastic endowments. The state of the economy
Answer 4 of he following 5 quesions. 1. Consider a pure-exchange economy wih sochasic endowmens. The sae of he economy in period, 0,1,..., is he hisory of evens s ( s0, s1,..., s ). The iniial sae is given.
More informationDimitri Solomatine. D.P. Solomatine. Data-driven modelling (part 2). 2
Daa-driven modelling. Par. Daa-driven Arificial di Neural modelling. Newors Par Dimiri Solomaine Arificial neural newors D.P. Solomaine. Daa-driven modelling par. 1 Arificial neural newors ANN: main pes
More informationINTRODUCTION TO MACHINE LEARNING 3RD EDITION
ETHEM ALPAYDIN The MIT Press, 2014 Lecure Slides for INTRODUCTION TO MACHINE LEARNING 3RD EDITION alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/~ehem/i2ml3e CHAPTER 2: SUPERVISED LEARNING Learning a Class
More informationTasty Coffee example
Lecure Slides for (Binary) Classificaion: Learning a Class from labeled Examples ITRODUCTIO TO Machine Learning ETHEM ALPAYDI The MIT Press, 00 (modified by dph, 0000) CHAPTER : Supervised Learning Things
More informationCHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK
175 CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 10.1 INTRODUCTION Amongs he research work performed, he bes resuls of experimenal work are validaed wih Arificial Neural Nework. From he
More informationAPPLIED ECONOMETRIC TIME SERIES (2nd edition)
INSTRUCTOR S RESOURCE GUIDE TO ACCOMPANY APPLIED ECONOMETRIC TIME SERIES (2nd ediion) Waler Enders Universiy of Alabama Preared by Pin Chung American Reinsurance Comany and Iowa Sae Universiy Waler Enders
More informationTemporal probability models
Temporal probabiliy models CS194-10 Fall 2011 Lecure 25 CS194-10 Fall 2011 Lecure 25 1 Ouline Hidden variables Inerence: ilering, predicion, smoohing Hidden Markov models Kalman ilers (a brie menion) Dynamic
More informationMANY FACET, COMMON LATENT TRAIT POLYTOMOUS IRT MODEL AND EM ALGORITHM. Dimitar Atanasov
Pliska Sud. Mah. Bulgar. 20 (2011), 5 12 STUDIA MATHEMATICA BULGARICA MANY FACET, COMMON LATENT TRAIT POLYTOMOUS IRT MODEL AND EM ALGORITHM Dimiar Aanasov There are many areas of assessmen where he level
More informationComputer Vision. Motion Extraction
Comuer Moion Eracion Comuer Alicaions of moion eracion Change / sho cu deecion Surveillance / raffic monioring Moion caure / gesure analsis HC image sabilisaion Moion comensaion e.g. medical roboics Feaure
More informationOBJECTIVES OF TIME SERIES ANALYSIS
OBJECTIVES OF TIME SERIES ANALYSIS Undersanding he dynamic or imedependen srucure of he observaions of a single series (univariae analysis) Forecasing of fuure observaions Asceraining he leading, lagging
More informationReferences are appeared in the last slide. Last update: (1393/08/19)
SYSEM IDEIFICAIO Ali Karimpour Associae Professor Ferdowsi Universi of Mashhad References are appeared in he las slide. Las updae: 0..204 393/08/9 Lecure 5 lecure 5 Parameer Esimaion Mehods opics o be
More informationOutline. Intro. to Machine Learning. Outline. Course Info. Course Info.: People, References, Resources
Course Info. Machine Learning Curve Fiing Decision Theory Probabiliy Theory Course Info. Machine Learning Curve Fiing Decision Theory Probabiliy Theory Ouline Course Info.: People, References, Resources
More informationAn EM based training algorithm for recurrent neural networks
An EM based raining algorihm for recurren neural neworks Jan Unkelbach, Sun Yi, and Jürgen Schmidhuber IDSIA,Galleria 2, 6928 Manno, Swizerland {jan.unkelbach,yi,juergen}@idsia.ch hp://www.idsia.ch Absrac.
More informationWritten HW 9 Sol. CS 188 Fall Introduction to Artificial Intelligence
CS 188 Fall 2018 Inroducion o Arificial Inelligence Wrien HW 9 Sol. Self-assessmen due: Tuesday 11/13/2018 a 11:59pm (submi via Gradescope) For he self assessmen, fill in he self assessmen boxes in your
More informationState-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter
Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when
More informationUnderstanding the asymptotic behaviour of empirical Bayes methods
Undersanding he asympoic behaviour of empirical Bayes mehods Boond Szabo, Aad van der Vaar and Harry van Zanen EURANDOM, 11.10.2011. Conens 2/20 Moivaion Nonparameric Bayesian saisics Signal in Whie noise
More informationVehicle Arrival Models : Headway
Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where
More informationof Manchester The University COMP14112 Hidden Markov Models
COMP42 Lecure 8 Hidden Markov Model he Univeriy of Mancheer he Univeriy of Mancheer Hidden Markov Model a b2 0. 0. SAR 0.9 0.9 SOP b 0. a2 0. Imagine he and 2 are hidden o he daa roduced i a equence of
More informationhen found from Bayes rule. Specically, he prior disribuion is given by p( ) = N( ; ^ ; r ) (.3) where r is he prior variance (we add on he random drif
Chaper Kalman Filers. Inroducion We describe Bayesian Learning for sequenial esimaion of parameers (eg. means, AR coeciens). The updae procedures are known as Kalman Filers. We show how Dynamic Linear
More informationCSCE 496/896 Lecture 2: Basic Artificial Neural Networks. Stephen Scott. Introduction. Supervised Learning. Basic Units.
(Adaped from Vinod Variyam, Ehem Alpaydin, Tom Michell, Ian Goodfellow, and Aurélien Géron) learning is mos fundamenal, classic form machine learning par comes from he par labels for examples (insances)
More informationFault Tolerant Computing CS 530 Reliability Analysis. Yashwant K. Malaiya Colorado State University
CS 53 eliabiliy Analysis Yashwan K. Malaiya Colorado Sae Universiy February 6, 27 eliabiliy Analysis: Ouline eliabiliy measures: eliabiliy, availabiliy, Transacion eliabiliy, MTTF and (, MTBF Basic Cases
More informationGeorey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract
Parameer Esimaion for Linear Dynamical Sysems Zoubin Ghahramani Georey E. Hinon Deparmen of Compuer Science Universiy oftorono 6 King's College Road Torono, Canada M5S A4 Email: zoubin@cs.orono.edu Technical
More information- The whole joint distribution is independent of the date at which it is measured and depends only on the lag.
Saionary Processes Sricly saionary - The whole join disribuion is indeenden of he dae a which i is measured and deends only on he lag. - E y ) is a finie consan. ( - V y ) is a finie consan. ( ( y, y s
More informationSequential Importance Resampling (SIR) Particle Filter
Paricle Filers++ Pieer Abbeel UC Berkeley EECS Many slides adaped from Thrun, Burgard and Fox, Probabilisic Roboics 1. Algorihm paricle_filer( S -1, u, z ): 2. Sequenial Imporance Resampling (SIR) Paricle
More informationMultivariate analysis of H b b in associated production of H with t t-pair using full simulation of ATLAS detector
Mulivariae analysis of H b b in associaed producion of H wih -pair using full simulaion of ATLAS deecor Sergey Koov MPI für Physik, München ATLAS-D Top meeing, May 19, 26 Sergey Koov (MPI für Physik, München)
More informationCombining Statistical and Knowledge-based Spoken Language Understanding in Conditional Models
COLING/ACL06, pp. 882 889, Associaion for Compuaional Linguisics, Sydney, Ausralia, 2006 Combining Saisical and Knowledge-based Spoken Language Undersanding in Condiional Models Ye-Yi Wang, Alex Acero,
More informationInventory-Based Empty Container Repositioning in a Multi-Port System
Invenory-Based Emy Conainer Reosiioning in a Muli-Por ysem Loo Hay Lee Ek Peng Chew Yi Luo earmen of Indusrial & ysems Engineering Naional Universiy of ingaore ingaore 119260 E-mails: {iseleelh isece iseluoy}@nus.edu.sg
More informationSolutions to the Exam Digital Communications I given on the 11th of June = 111 and g 2. c 2
Soluions o he Exam Digial Communicaions I given on he 11h of June 2007 Quesion 1 (14p) a) (2p) If X and Y are independen Gaussian variables, hen E [ XY ]=0 always. (Answer wih RUE or FALSE) ANSWER: False.
More informationIsolated-word speech recognition using hidden Markov models
Isolaed-word speech recogniion using hidden Markov models Håkon Sandsmark December 18, 21 1 Inroducion Speech recogniion is a challenging problem on which much work has been done he las decades. Some of
More informationInteligencia Artificial. Revista Iberoamericana de Inteligencia Artificial ISSN:
Ineligencia Arificial. Revisa Iberoamericana de Ineligencia Arificial ISSN: 1137-3601 revisa@aepia.org Asociación Española para la Ineligencia Arificial España Tomassi, Diego; Milone, Diego; Forzani, Liliana
More informationModification on Search Algorithm for Computer Simulated Experiment
การประช มว ชาการด านการว จ ยด าเน นงานแห งชาต ประจ าป 255 ว นท 24 25 กรกฎาคม พ.ศ. 255 Modificaion on Search Algorihm for Comuer Simulaed Exerimen Thammara Thamma, Jarasri Rungraanaubol 2* and Anamai Na-udom
More informationAge (x) nx lx. Age (x) nx lx dx qx
Life Tables Dynamic (horizonal) cohor= cohor followed hrough ime unil all members have died Saic (verical or curren) = one census period (day, season, ec.); only equivalen o dynamic if populaion does no
More informationPresentation Overview
Acion Refinemen in Reinforcemen Learning by Probabiliy Smoohing By Thomas G. Dieerich & Didac Busques Speaer: Kai Xu Presenaion Overview Bacground The Probabiliy Smoohing Mehod Experimenal Sudy of Acion
More informationStructural Break Detection in Time Series Models
Srucural Break Deecion in Time Series Models Richard A. Davis Thomas Lee Gabriel Rodriguez-Yam Colorado Sae Universiy (hp://www.sa.colosae.edu/~rdavis/lecures) This research suppored in par by an IBM faculy
More informationVectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1
Vecorauoregressive Model and Coinegraion Analysis Par V Time Series Analysis Dr. Sevap Kesel 1 Vecorauoregression Vecor auoregression (VAR) is an economeric model used o capure he evoluion and he inerdependencies
More informationOrientation. Connections between network coding and stochastic network theory. Outline. Bruce Hajek. Multicast with lost packets
Connecions beween nework coding and sochasic nework heory Bruce Hajek Orienaion On Thursday, Ralf Koeer discussed nework coding: coding wihin he nework Absrac: Randomly generaed coded informaion blocks
More informationLearning Naive Bayes Classifier from Noisy Data
UCLA Compuer Science Deparmen Technical Repor CSD-TR No 030056 1 Learning Naive Bayes Classifier from Noisy Daa Yirong Yang, Yi Xia, Yun Chi, and Richard R Munz Universiy of California, Los Angeles, CA
More informationMachine Learning 4771
ony Jebara, Columbia Universiy achine Learning 4771 Insrucor: ony Jebara ony Jebara, Columbia Universiy opic 20 Hs wih Evidence H Collec H Evaluae H Disribue H Decode H Parameer Learning via JA & E ony
More informationLearning to Process Natural Language in Big Data Environment
CCF ADL 2015 Nanchang Oc 11, 2015 Learning o Process Naural Language in Big Daa Environmen Hang Li Noah s Ark Lab Huawei Technologies Par 2: Useful Deep Learning Tools Powerful Deep Learning Tools (Unsupervised
More informationTracking. Announcements
Tracking Tuesday, Nov 24 Krisen Grauman UT Ausin Announcemens Pse 5 ou onigh, due 12/4 Shorer assignmen Auo exension il 12/8 I will no hold office hours omorrow 5 6 pm due o Thanksgiving 1 Las ime: Moion
More informationLearning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power
Alpaydin Chaper, Michell Chaper 7 Alpaydin slides are in urquoise. Ehem Alpaydin, copyrigh: The MIT Press, 010. alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/ ehem/imle All oher slides are based on Michell.
More informationTemporal probability models. Chapter 15, Sections 1 5 1
Temporal probabiliy models Chaper 15, Secions 1 5 Chaper 15, Secions 1 5 1 Ouline Time and uncerainy Inerence: ilering, predicion, smoohing Hidden Markov models Kalman ilers (a brie menion) Dynamic Bayesian
More informationInference of Sparse Gene Regulatory Network from RNA-Seq Time Series Data
Inference of Sparse Gene Regulaory Nework from RNA-Seq Time Series Daa Alireza Karbalayghareh and Tao Hu Texas A&M Universiy December 16, 2015 Alireza Karbalayghareh GRN Inference from RNA-Seq Time Series
More information5.2. The Natural Logarithm. Solution
5.2 The Naural Logarihm The number e is an irraional number, similar in naure o π. Is non-erminaing, non-repeaing value is e 2.718 281 828 59. Like π, e also occurs frequenly in naural phenomena. In fac,
More informationST2352. Stochastic Processes constructed via Conditional Simulation. 09/02/2014 ST2352 Week 4 1
ST35 Sochasic Processes consruced via Condiional Simulaion 09/0/014 ST35 Week 4 1 Sochasic Processes consruced via Condiional Simulaion Markov Processes Simulaing Random Tex Google Sugges n grams Random
More informationTracking. Many slides adapted from Kristen Grauman, Deva Ramanan
Tracking Man slides adaped from Krisen Grauman Deva Ramanan Coures G. Hager Coures G. Hager J. Kosecka cs3b Adapive Human-Moion Tracking Acquisiion Decimaion b facor 5 Moion deecor Grascale convers. Image
More information1 birth rate γ (number of births per time interval) 2 death rate δ proportional to size of population
Scienific Comuing I Module : Poulaion Modelling Coninuous Models Michael Bader Par I ODE Models Lehrsuhl Informaik V Winer 7/ Discree vs. Coniuous Models d d = F,,...) ) =? discree model: coninuous model:
More informationDoctoral Course in Speech Recognition
Docoral Course in Speech Recogniion Friday March 30 Mas Blomberg March-June 2007 March 29-30, 2007 Speech recogniion course 2007 Mas Blomberg General course info Home page hp://www.speech.h.se/~masb/speech_speaer_rec_course_2007/cours
More informationExpectation- Maximization & Baum-Welch. Slides: Roded Sharan, Jan 15; revised by Ron Shamir, Nov 15
Expecaion- Maximizaion & Baum-Welch Slides: Roded Sharan, Jan 15; revised by Ron Shamir, Nov 15 1 The goal Inpu: incomplee daa originaing from a probabiliy disribuion wih some unknown parameers Wan o find
More informationKriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number
More informationMaximum Likelihood Parameter Estimation in State-Space Models
Maximum Likelihood Parameer Esimaion in Sae-Space Models Arnaud Douce Deparmen of Saisics, Oxford Universiy Universiy College London 4 h Ocober 212 A. Douce (UCL Maserclass Oc. 212 4 h Ocober 212 1 / 32
More information04. Kinetics of a second order reaction
4. Kineics of a second order reacion Imporan conceps Reacion rae, reacion exen, reacion rae equaion, order of a reacion, firs-order reacions, second-order reacions, differenial and inegraed rae laws, Arrhenius
More informationChapter 3 Common Families of Distributions
Chaer 3 Common Families of Disribuions Secion 31 - Inroducion Purose of his Chaer: Caalog many of common saisical disribuions (families of disribuions ha are indeed by one or more arameers) Wha we should
More informationUSP. Surplus-Production Models
USP Surplus-Producion Models 2 Overview Purpose of slides: Inroducion o he producion model Overview of differen mehods of fiing Go over some criique of he mehod Source: Haddon 2001, Chaper 10 Hilborn and
More informationIntroduc)on to Bayesian methods (con)nued) - Lecture 16
Introduc)on to Bayesian methods (con)nued) - Lecture 16 David Sontag New York University Slides adapted from Luke Zettlemoyer, Carlos Guestrin, Dan Klein, and Vibhav Gogate Outline of lectures Review of
More informationAugmented Reality II - Kalman Filters - Gudrun Klinker May 25, 2004
Augmened Realiy II Kalman Filers Gudrun Klinker May 25, 2004 Ouline Moivaion Discree Kalman Filer Modeled Process Compuing Model Parameers Algorihm Exended Kalman Filer Kalman Filer for Sensor Fusion Lieraure
More informationLearning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power
Alpaydin Chaper, Michell Chaper 7 Alpaydin slides are in urquoise. Ehem Alpaydin, copyrigh: The MIT Press, 010. alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/ ehem/imle All oher slides are based on Michell.
More informationConditional Variance Parameters in Symmetric Models
Inernaional Journal of Probabiliy and Saisics 04, 3: -7 DOI: 0593/is040300 Condiional Variance Parameers in Symmeric Models Onyeka-Ubaka J N,*, Abass O, Okafor R O Dearmen of Mahemaics, Universiy of Lagos,
More informationIV. Sign restrictions and Bayesian VAR
PhD Course: Srucural VAR models IV. Sign resricions and Bayesian VAR Hilde C. Bjørnland Norwegian School of Managemen (BI) Lecure noe IV: Sign resricions and Bayesian VAR Conen 1. Inroducion 2. Bayesian
More informationMODELLING AND ANALYZING INTERVAL DATA
MODEING AND ANAYZING INTERVA DATA Paula Brio FEP / NIAAD-IACC - NIV. PORTO PORTGA Ouline Inerval daa Dynamical clusering Sandardizaion A regression model Disersion, associaion and linear combinaions of
More informationEE650R: Reliability Physics of Nanoelectronic Devices Lecture 9:
EE65R: Reliabiliy Physics of anoelecronic Devices Lecure 9: Feaures of Time-Dependen BTI Degradaion Dae: Sep. 9, 6 Classnoe Lufe Siddique Review Animesh Daa 9. Background/Review: BTI is observed when he
More informationGMM - Generalized Method of Moments
GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................
More informationDecentralized Control of Petri Nets
Decenralized Conrol of Peri Nes Marian V. Iordache and Panos J. Ansaklis Dearmen of Elecrical Engineering Universiy of Nore Dame Nore Dame, IN 6556 iordache.@nd.edu June, 00 M.V. Iordache and P.J. Ansaklis,
More informationSelf assessment due: Monday 4/29/2019 at 11:59pm (submit via Gradescope)
CS 188 Spring 2019 Inroducion o Arificial Inelligence Wrien HW 10 Due: Monday 4/22/2019 a 11:59pm (submi via Gradescope). Leave self assessmen boxes blank for his due dae. Self assessmen due: Monday 4/29/2019
More informationEnergy Storage Benchmark Problems
Energy Sorage Benchmark Problems Daniel F. Salas 1,3, Warren B. Powell 2,3 1 Deparmen of Chemical & Biological Engineering 2 Deparmen of Operaions Research & Financial Engineering 3 Princeon Laboraory
More informationHidden Markov Models. Adapted from. Dr Catherine Sweeney-Reed s slides
Hidden Markov Models Adaped from Dr Caherine Sweeney-Reed s slides Summary Inroducion Descripion Cenral in HMM modelling Exensions Demonsraion Specificaion of an HMM Descripion N - number of saes Q = {q
More informationGeneralized Least Squares
Generalized Leas Squares Augus 006 1 Modified Model Original assumpions: 1 Specificaion: y = Xβ + ε (1) Eε =0 3 EX 0 ε =0 4 Eεε 0 = σ I In his secion, we consider relaxing assumpion (4) Insead, assume
More informationFrom Particles to Rigid Bodies
Rigid Body Dynamics From Paricles o Rigid Bodies Paricles No roaions Linear velociy v only Rigid bodies Body roaions Linear velociy v Angular velociy ω Rigid Bodies Rigid bodies have boh a posiion and
More informationTwo Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017
Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =
More informationProbabilistic Robotics
Probabilisic Roboics Bayes Filer Implemenaions Gaussian filers Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel Gaussians : ~ π e p N p - Univariae / / : ~ μ μ μ e p Ν p d π Mulivariae
More informationTracking. Many slides adapted from Kristen Grauman, Deva Ramanan
Tracking Man slides adaped from Krisen Grauman Deva Ramanan Coures G. Hager Coures G. Hager J. Kosecka cs3b Adapive Human-Moion Tracking Acquisiion Decimaion b facor 5 Moion deecor Grascale convers. Image
More informationSimulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010
Simulaion-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Week Descripion Reading Maerial 2 Compuer Simulaion of Dynamic Models Finie Difference, coninuous saes, discree ime Simple Mehods Euler Trapezoid
More informationON THE ANALYSIS OF SYMBOLIC DATA
ON THE ANAYSIS OF SYMBOIC DATA Paula Brio FEP / IACC-NIAAD niv. of Poro, Porugal Ouline From classical o symbolic daa Symbolic variables Conceual versus disance-based clusering Dynamical clusering Sandardizaion
More informationStatistical Distributions
Saisical Disribuions 1 Discree Disribuions 1 The uniform disribuion A random variable (rv) X has a uniform disribuion on he n-elemen se A = {x 1,x 2,,x n } if P (X = x) =1/n whenever x is in he se A The
More informationFigure 1. Jaw RMS target-tracker difference for a.9hz sinusoidal target.
Approaches o Bayesian Smooh Unimodal Regression George Woodworh Dec 3, 999 (Draf - please send commens o george-woodworh@uiowa.edu). Background Speech Ariculaion Daa The daa in Figure were obained by asking
More information