Detection of Oestrus by Monitoring Boar Visits Tage Ostersen Advanced Herd Management 22/ Slide 1/30 1 Background 2 Data 3 Duration of Visits 4

Size: px
Start display at page:

Download "Detection of Oestrus by Monitoring Boar Visits Tage Ostersen Advanced Herd Management 22/ Slide 1/30 1 Background 2 Data 3 Duration of Visits 4"

Transcription

1 Detection of Oestrus by Monitoring Boar Visits Tage Ostersen Advanced Herd Management 22/ Slide 1/30 1 Background 2 Data 3 Duration of Visits 4 Break 5 Frequency of Visits 6 Combining Frequency and Duration of Boar Visits 7 Conclusion Slide 2/30

2 Background 1 European legislation 70 % of Danish sows are group housed a third of these are fed by ESF Non productive day are expensive Manual oestrus detection is dicult when sows are group housed Slide 3/30 Background 2 Slide 4/30

3 Background 3 Slide 5/30 Purpose of Monitoring Visits to a Boar Less work input for farmer Fewer non productive days - i.e. lower cost per reproduction cycle Need of a detection method with short response time - in time to inseminate the sow Slide 6/30

4 Raw Data Slide 7/30 Characteristics of the Raw Data The frequency of visits increases around oestrus The duration of some visit are prolonged around oestrus The duration of visits seem to vary more around oestrus If the duration is accumulated per hour the change is more distinct If the duration is accumulated per 6 hours the number of observations decline steeply Need of a detection method that can detect both the change in duration and in frequency Slide 8/30

5 Overview 3 parts - duration, frequency and combination Duration Multiprocess DLM Detection method: Recognizes "patterns" Frequency DGLM - generalized because frequency is Poisson distributed Detection method: Recognizes outliers Combination Slide 9/30 Denition of the Model Describing Duration Y t is the logarithmical transformed cumulated seconds near the boar per observation hour t denotes the observation hour. Hours, where the sow did not visits the boar are excluded Observation equation : Y t = µ t + v t, where v t N(0, V ) System equation : µ t = µ t 1 + w t, where w t N(0, W ) Slide 10/30

6 Denition of the Model Describing Duration Y t is the logarithmical transformed cumulated seconds near the boar per observation hour t denotes the observation hour. Hours, where the sow did not visits the boar are excluded Observation equation : Y t = µ t + v t, where v t N(0, V ) System equation : µ t = µ t 1 + w t, where w t N(0, W ) NB: A DLM lters raw data provides an estimate of the underlying level (µ t ) and the variance (V ) by means of a Kalman lter Slide 10/30 The Multiprocess DLM (class II) Idea: Instead of one model have multiple models Apply a mixture of the models mixed so that the most appropriate model weighs the most Consider model combinations at time t 2to t Slide 11/30

7 The Multiprocess DLM (class II) Idea: Instead of one model have multiple models Apply a mixture of the models mixed so that the most appropriate model weighs the most Consider model combinations at time t 2to t Present case: 4 models Normal model Outlier model Level shift model Oestrus model 4 models entail 64 model combinations, when considering the last three observations (4 3 = 64) Slide 11/30 Updating Equations of a simple Multiprocess DLM - 1 The model combinations are stated by (ijk) =(M t 2, M t 1, M t ) Prior for θ t at time t a t (ijk) =m t 1(ij) R t (ijk) =C t 1(ij)+W t (k) Slide 12/30

8 Updating Equations of a simple Multiprocess DLM - 1 The model combinations are stated by (ijk) =(M t 2, M t 1, M t ) Prior for θ t at time t a t (ijk) =m t 1(ij) R t (ijk) =C t 1(ij)+W t (k) One step forecast at time t f t (ijk) =a t (ijk) Q t (ijk) =R t (ijk)+v t (k) Slide 12/30 Updating Equations of a simple Multiprocess DLM - 2 Posterior for µ t at time t m t (ijk) =a t (ijk)+a t (ijk) e t (ijk) C t (ijk) =A t (ijk) V t (ijk) A t (ijk) =R t (ijk) Q 1 t (ijk) e t (ijk) =Yt f t (ijk) Slide 13/30

9 Updating Equations of a simple Multiprocess DLM - 3 Posterior model probability p t (ijk) =f (Y t f t (ijk), Q t (ijk)) pt 1(ij) p(k),where f is the density function of a normal distribution and c t i j is a normalizing constant so that k p t(ijk) =1. c t Model Probability Var = 1 Var = 2.25 Var = Slide 14/30 Updating Equations of a simple Multiprocess DLM - 4 Posterior mixture distribution at time t m t C t = i = i j j k m t(ijk) p t (ijk) k (C t(ijk)+(m t m t (ijk)) 2 ) p t (ijk) Slide 15/30

10 Updating Equations of a simple Multiprocess DLM - 5 Model collapsing p t (jk) = i p t(ijk) m t (jk) = i m t(ijk)p t (ijk)/p t (jk) C t (jk) = i (C t (ijk)+(m t m t (ijk)) 2) pt(ijk) p t (jk) Slide 16/30 Updating Equations of a simple Multiprocess DLM - 6 Updating equations of the multiprocess DLM is almost the same as normal DLM Dierences 64 simultaneous models Weighted according to prior transition probability and probability according to forecasted level and variance Can recognize specic patterns Slide 17/30

11 Fitting a Multiprocess DLM to Boar Visit Data Unknown variance - constant? Discount factor to estimate W Oestrus seems to be characterized by higher level and higher variance The time distance between two observations should inuence the belief in oestrus Slide 18/30 Fitting a Multiprocess DLM to Boar Visit Data Unknown variance - constant? Discount factor to estimate W Oestrus seems to be characterized by higher level and higher variance The time distance between two observations should inuence the belief in oestrus p t (ijk) =f (Y t f t (ijk), Q t (ijk)) pt 1(ij) p(k) c t Slide 18/30

12 Fitting a Multiprocess DLM to Boar Visit Data M(α 1 ) Normal model with observational variance factor C k = 1, discount factor δ k = 0.99 and xed transition probability π = π N M(α 2 ) Outlier model with observational variance factor C k = 20, discount factor δ k = 0.99 and xed transition probability π = π O M(α 3 ) Level shift model with observational variance factor C k = 1, discount factor δ k = 0.01 and xed transition probability π = π L M(α 4 ) Oestrus model with observational variance factor C k = 20, discount factor δ k = 0.99 and xed transition probability π = 0 Slide 19/30 ResultsofMultiprocessDLM Log seconds pr. hour Raw data and filtered mean (Sow no 18) (a) Model probability P(M α4 ) Date (b) Slide 20/30

13 ResultsofMultiprocessDLM-2 sensitivity = True Positive True Positive+False Negative specicity = True Negative True Negative+False Positve One alarm during a block means the the whole block is dened as an alarm-block Model Block of 24 hours Block of 72 hours Total TP Total TN Total FP Total FN Sensitivity Specicity Slide 21/30 BREAK Slide 22/30

14 Denition of the Model Describing Frequency Y t is number of visits per 6 hours There is a diurnal pattern of the visits high activity 5 a.m. to 5 p.m. low activity 5 p.m. to 5 a.m. Slide 23/30 Denition of the Model Describing Frequency Y t is number of visits per 6 hours There is a diurnal pattern of the visits high activity 5 a.m. to 5 p.m. low activity 5 p.m. to 5 a.m. Observation equation : (Y t η t, V t ) P(λ η t )=P(eη t ), where : η t = F tθ t System equation : θ t = G t θ t 1 + w t, where w t (0, W ) Slide 23/30

15 Denition of the Model Describing Frequency Y t is number of visits per 6 hours There is a diurnal pattern of the visits high activity 5 a.m. to 5 p.m. low activity 5 p.m. to 5 a.m. Observation equation : (Y t η t, V t ) P(λ η t )=P(eη t ), where : η t = F tθ t System equation : θ t = G t θ t 1 + w t, where w t (0, W ) F high t = ( 1 0 ) F low t = ( 0 1 ) G t = ( ) Slide 23/30 Monitoring the Frequency of Boar Visits oestrus indicator = observed frequency forecasted frequency forecasted frequency Visits per 6 hours Raw data, 1 step forecast and filtered mean (Sow no 18) Oestrus Indicator Observered Frequency Forecasted Frequency Forecasted Frequency Date (a) (b) Slide 24/30

16 Results of DGLM Model Block of 24 hours Block of 72 hours Total TP Total TN Total FP Total FN Sensitivity Specicity Slide 25/30 Combining Frequency and Duration of Boar Visits Bayes Theorem is a way of reversing probabilities Idea: Utilize the probability of oestrus from the multiprocess DLM as a prior probability of oestrus Assume that the test result of the frequency model is independent of the duration model P(oestrus +) = P(+ oestrus) P(+) = P(oestrus) sensitivity P(M α4 ) sensitivity P(M α4 )+(1 specicity) (1 P(M α4 )) Slide 26/30

17 Combining Frequency and Duration of Boar Visits Results Slide 27/30 Combining Frequency and Duration of Boar Visits Results Block of 24 hours Model Combined Duration Frequency Total TP Total TN Total FP Total FN Sensitivity Specicity Slide 28/30

18 Combining Frequency and Duration of Boar Visits Results Block of 24 hours Model Combined Duration Frequency Total TP Total TN Total FP Total FN Sensitivity Specicity Error Rate Slide 28/30 Conclusion 87 % of the sows entering oestrus are detected Signicantly fewer false alarms than earlier attempts The combined model is not signicantly more ecient than duration alone The number of false alarms is still too high Slide 29/30

19 Conclusion 87 % of the sows entering oestrus are detected Signicantly fewer false alarms than earlier attempts The combined model is not signicantly more ecient than duration alone The number of false alarms is still too high Other information about oestrus in the individual sow should be included Farrowing rate of the herd Pregnancy test of the individual sow Activity measurements? Day of reproduction cycle Visual observations? Slide 29/30 Questions? Slide 30/30

Model Probability Var = 1 Var = 2.25 Var = 25

Model Probability Var = 1 Var = 2.25 Var = 25 1 Background Detection of Oestrus by Monitoring Boar Visits Tage Ostersen 2 Data 3 Duration of Visits 4 Break 5 Frequency of Visits 6 Visits 7 Conclusion Advanced Herd Management 22/9 29 Slide 1/3 Slide

More information

Monitoring and data filtering II. Dynamic Linear Models

Monitoring and data filtering II. Dynamic Linear Models Monitoring and data filtering II. Dynamic Linear Models Advanced Herd Management Cécile Cornou, IPH Dias 1 Program for monitoring and data filtering Friday 26 (morning) - Lecture for part I : use of control

More information

Monitoring and data filtering III. The Kalman Filter and its relation with the other methods

Monitoring and data filtering III. The Kalman Filter and its relation with the other methods Monitoring and data filtering III. The Kalman Filter and its relation with the other methods Advanced Herd Management Cécile Cornou, IPH Dias 1 Gain (g) Before this part of the course Compare key figures

More information

Dynamic monitoring of mortality rate for sows and piglets

Dynamic monitoring of mortality rate for sows and piglets Dynamic monitoring of mortality rate for sows and piglets Claudia Bono C. Cornou A. R. Kristensen Dias 1 Background Problem Existing Management Information Systems (MIS) are static and typically computed

More information

Monitoring and data filtering II. Dan Jensen IPH, KU

Monitoring and data filtering II. Dan Jensen IPH, KU Monitoring and data filtering II Dan Jensen IPH, KU Outline Introduction to Dynamic Linear Models (DLM) - Conceptual introduction - Difference between the Classical methods and DLM - A very simple DLM

More information

Online Appendix to: Optimizing policymakers' loss functions in crisis prediction: before, within or after?

Online Appendix to: Optimizing policymakers' loss functions in crisis prediction: before, within or after? Online Appendix to: Optimizing policymakers' loss functions in crisis prediction: before, within or after? Peter Sarlin a,b, Gregor von Schweinitz c,d, a Department of Economics at Hanken School of Economics

More information

CHAPTER 4 DYNAMIC PRODUCTION MONITORING IN PIG HERDS II: MODELING AND MONITORING FARROWING RATE AT HERD LEVEL

CHAPTER 4 DYNAMIC PRODUCTION MONITORING IN PIG HERDS II: MODELING AND MONITORING FARROWING RATE AT HERD LEVEL CHAPTER 4 DYNAMIC PRODUCTION MONITORING IN PIG HERDS II: MODELING AND MONITORING FARROWING RATE AT HERD LEVEL Claudia Bono, Cécile Cornou, Søren Lundbye-Christensen and Anders Ringgaard Kristensen Published

More information

BAYESIAN FORECASTING AND DYNAMIC MODELS APPLIED TO STRAIN DATA FROM THE GÖTA RIVER BRIDGE

BAYESIAN FORECASTING AND DYNAMIC MODELS APPLIED TO STRAIN DATA FROM THE GÖTA RIVER BRIDGE BAYESIAN FORECASTING AND DYNAMIC MODELS APPLIED TO STRAIN DATA FROM THE GÖTA RIVER BRIDGE Ida Kjersem Solhjell Thesis for the Degree of MASTER OF SCIENCE Master in Modelling and Data Analysis Statistics

More information

Answers and expectations

Answers and expectations Answers and expectations For a function f(x) and distribution P(x), the expectation of f with respect to P is The expectation is the average of f, when x is drawn from the probability distribution P E

More information

CIS 390 Fall 2016 Robotics: Planning and Perception Final Review Questions

CIS 390 Fall 2016 Robotics: Planning and Perception Final Review Questions CIS 390 Fall 2016 Robotics: Planning and Perception Final Review Questions December 14, 2016 Questions Throughout the following questions we will assume that x t is the state vector at time t, z t is the

More information

Advanced Herd Management Probabilities and distributions

Advanced Herd Management Probabilities and distributions Advanced Herd Management Probabilities and distributions Anders Ringgaard Kristensen Slide 1 Outline Probabilities Conditional probabilities Bayes theorem Distributions Discrete Continuous Distribution

More information

Markov Decision Processes: Biosens II

Markov Decision Processes: Biosens II Markov Decision Processes: Biosens II E. Jørgensen & Lars R. Nielsen Department of Genetics and Biotechnology Faculty of Agricultural Sciences, University of Århus / 008 : Markov Decision Processes Examples

More information

Target Tracking and Classification using Collaborative Sensor Networks

Target Tracking and Classification using Collaborative Sensor Networks Target Tracking and Classification using Collaborative Sensor Networks Xiaodong Wang Department of Electrical Engineering Columbia University p.1/3 Talk Outline Background on distributed wireless sensor

More information

The Bayes Theorema. Converting pre-diagnostic odds into post-diagnostic odds. Prof. Dr. F. Vanstapel, MD PhD Laboratoriumgeneeskunde UZ KULeuven

The Bayes Theorema. Converting pre-diagnostic odds into post-diagnostic odds. Prof. Dr. F. Vanstapel, MD PhD Laboratoriumgeneeskunde UZ KULeuven slide 1 The Bayes Theorema Converting pre-diagnostic odds into post-diagnostic odds Prof. Dr. F. Vanstapel, MD PhD Laboratoriumgeneeskunde UZ KULeuven slide 2 Problem * The yearly incidence of TBC infections

More information

Advanced topics from statistics

Advanced topics from statistics Advanced topics from statistics Anders Ringgaard Kristensen Advanced Herd Management Slide 1 Outline Covariance and correlation Random vectors and multivariate distributions The multinomial distribution

More information

A simple hidden Markov model for Bayesian modeling with time dependent data SUMMARY Consider a set of real valued realizations of an observable quanti

A simple hidden Markov model for Bayesian modeling with time dependent data SUMMARY Consider a set of real valued realizations of an observable quanti A simple hidden Markov model for Bayesian modeling with time dependent data Glen Meeden School of Statistics University of Minnesota Minneapolis, MN 55455 Stephen Vardeman Department of Statistics Iowa

More information

Lecture 3. G. Cowan. Lecture 3 page 1. Lectures on Statistical Data Analysis

Lecture 3. G. Cowan. Lecture 3 page 1. Lectures on Statistical Data Analysis Lecture 3 1 Probability (90 min.) Definition, Bayes theorem, probability densities and their properties, catalogue of pdfs, Monte Carlo 2 Statistical tests (90 min.) general concepts, test statistics,

More information

Lecture 1: OLS derivations and inference

Lecture 1: OLS derivations and inference Lecture 1: OLS derivations and inference Econometric Methods Warsaw School of Economics (1) OLS 1 / 43 Outline 1 Introduction Course information Econometrics: a reminder Preliminary data exploration 2

More information

Technologie w skali genomowej 2/ Algorytmiczne i statystyczne aspekty sekwencjonowania DNA

Technologie w skali genomowej 2/ Algorytmiczne i statystyczne aspekty sekwencjonowania DNA Technologie w skali genomowej 2/ Algorytmiczne i statystyczne aspekty sekwencjonowania DNA Expression analysis for RNA-seq data Ewa Szczurek Instytut Informatyki Uniwersytet Warszawski 1/35 The problem

More information

Robust State Estimation with Sparse Outliers

Robust State Estimation with Sparse Outliers Robust State Estimation with Sparse Outliers The MIT Faculty has made this article openly available. Please share how this access benefits you. Your story matters. Citation Graham, Matthew C., Jonathan

More information

Performance Evaluation and Comparison

Performance Evaluation and Comparison Outline Hong Chang Institute of Computing Technology, Chinese Academy of Sciences Machine Learning Methods (Fall 2012) Outline Outline I 1 Introduction 2 Cross Validation and Resampling 3 Interval Estimation

More information

Intro to Probability. Andrei Barbu

Intro to Probability. Andrei Barbu Intro to Probability Andrei Barbu Some problems Some problems A means to capture uncertainty Some problems A means to capture uncertainty You have data from two sources, are they different? Some problems

More information

Mean and variance. Compute the mean and variance of the distribution with density

Mean and variance. Compute the mean and variance of the distribution with density Mean and variance Compute the mean and variance of the distribution with density > f

More information

Time-Varying Parameters

Time-Varying Parameters Kalman Filter and state-space models: time-varying parameter models; models with unobservable variables; basic tool: Kalman filter; implementation is task-specific. y t = x t β t + e t (1) β t = µ + Fβ

More information

Dynamic models 1 Kalman filters, linearization,

Dynamic models 1 Kalman filters, linearization, Koller & Friedman: Chapter 16 Jordan: Chapters 13, 15 Uri Lerner s Thesis: Chapters 3,9 Dynamic models 1 Kalman filters, linearization, Switching KFs, Assumed density filters Probabilistic Graphical Models

More information

State-space Model. Eduardo Rossi University of Pavia. November Rossi State-space Model Financial Econometrics / 49

State-space Model. Eduardo Rossi University of Pavia. November Rossi State-space Model Financial Econometrics / 49 State-space Model Eduardo Rossi University of Pavia November 2013 Rossi State-space Model Financial Econometrics - 2013 1 / 49 Outline 1 Introduction 2 The Kalman filter 3 Forecast errors 4 State smoothing

More information

1/sqrt(B) convergence 1/B convergence B

1/sqrt(B) convergence 1/B convergence B The Error Coding Method and PICTs Gareth James and Trevor Hastie Department of Statistics, Stanford University March 29, 1998 Abstract A new family of plug-in classication techniques has recently been

More information

Lecture 10. Factorial experiments (2-way ANOVA etc)

Lecture 10. Factorial experiments (2-way ANOVA etc) Lecture 10. Factorial experiments (2-way ANOVA etc) Jesper Rydén Matematiska institutionen, Uppsala universitet jesper@math.uu.se Regression and Analysis of Variance autumn 2014 A factorial experiment

More information

Approximate Inference

Approximate Inference Approximate Inference Simulation has a name: sampling Sampling is a hot topic in machine learning, and it s really simple Basic idea: Draw N samples from a sampling distribution S Compute an approximate

More information

2D Image Processing. Bayes filter implementation: Kalman filter

2D Image Processing. Bayes filter implementation: Kalman filter 2D Image Processing Bayes filter implementation: Kalman filter Prof. Didier Stricker Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz http://av.dfki.de

More information

Overview of IslandPick pipeline and the generation of GI datasets

Overview of IslandPick pipeline and the generation of GI datasets Overview of IslandPick pipeline and the generation of GI datasets Predicting GIs using comparative genomics By using whole genome alignments we can identify regions that are present in one genome but not

More information

Power Calculations for Preclinical Studies Using a K-Sample Rank Test and the Lehmann Alternative Hypothesis

Power Calculations for Preclinical Studies Using a K-Sample Rank Test and the Lehmann Alternative Hypothesis Power Calculations for Preclinical Studies Using a K-Sample Rank Test and the Lehmann Alternative Hypothesis Glenn Heller Department of Epidemiology and Biostatistics, Memorial Sloan-Kettering Cancer Center,

More information

State-space Model. Eduardo Rossi University of Pavia. November Rossi State-space Model Fin. Econometrics / 53

State-space Model. Eduardo Rossi University of Pavia. November Rossi State-space Model Fin. Econometrics / 53 State-space Model Eduardo Rossi University of Pavia November 2014 Rossi State-space Model Fin. Econometrics - 2014 1 / 53 Outline 1 Motivation 2 Introduction 3 The Kalman filter 4 Forecast errors 5 State

More information

Dynamic linear models (aka state-space models) 1

Dynamic linear models (aka state-space models) 1 Dynamic linear models (aka state-space models) 1 Advanced Econometris: Time Series Hedibert Freitas Lopes INSPER 1 Part of this lecture is based on Gamerman and Lopes (2006) Markov Chain Monte Carlo: Stochastic

More information

Adaptive Track Fusion in a Multisensor Environment. in this work. It is therefore assumed that the local

Adaptive Track Fusion in a Multisensor Environment. in this work. It is therefore assumed that the local Adaptive Track Fusion in a Multisensor Environment Celine Beugnon Graduate Student Mechanical & Aerospace Engineering SUNY at Bualo Bualo, NY 14260, U.S.A. beugnon@eng.bualo.edu James Llinas Center for

More information

Performance Evaluation

Performance Evaluation Performance Evaluation David S. Rosenberg Bloomberg ML EDU October 26, 2017 David S. Rosenberg (Bloomberg ML EDU) October 26, 2017 1 / 36 Baseline Models David S. Rosenberg (Bloomberg ML EDU) October 26,

More information

Bayesian Inference for DSGE Models. Lawrence J. Christiano

Bayesian Inference for DSGE Models. Lawrence J. Christiano Bayesian Inference for DSGE Models Lawrence J. Christiano Outline State space-observer form. convenient for model estimation and many other things. Bayesian inference Bayes rule. Monte Carlo integation.

More information

What you need to know about Kalman Filters

What you need to know about Kalman Filters Readings: K&F: 4.5, 12.2, 12.3, 12.4, 18.1, 18.2, 18.3, 18.4 Switching Kalman Filter Dynamic Bayesian Networks Graphical Models 10708 Carlos Guestrin Carnegie Mellon University November 27 th, 2006 1 What

More information

Bayesian Logic Thomas Bayes:

Bayesian Logic Thomas Bayes: Bayesian Logic Thomas Bayes: 1702-1761 Based on probability, P(X) NOT frequency distributions, BUT all common distributions can be incorporated into a Bayesian analysis : Poisson, Normal (Gaussian) etc.

More information

On Signal Extraction and Non-Certainty-Equivalence in Optimal Monetary Policy Rules Eric T. Swanson Board of Governors of the Federal Reserve System e

On Signal Extraction and Non-Certainty-Equivalence in Optimal Monetary Policy Rules Eric T. Swanson Board of Governors of the Federal Reserve System e On Signal Extraction and Non-Certainty-Equivalence in Optimal Monetary Policy Rules Eric T. Swanson Board of Governors of the Federal Reserve System eswanson@frb.gov Abstract A standard result in the literature

More information

Classifying Sows' Activity Types from Acceleration Patterns. An Application of the Multi- Process Kalman Filter

Classifying Sows' Activity Types from Acceleration Patterns. An Application of the Multi- Process Kalman Filter Classifying Sows' Activity Types from Acceleration Patterns. An Alication of the Multi- Process Kalman Filter Final preprint (uncorrected proof) of article published in Alied Animal Behaviour Science.

More information

ONR Mine Warfare Autonomy Virtual Program Review September 7, 2017

ONR Mine Warfare Autonomy Virtual Program Review September 7, 2017 ONR Mine Warfare Autonomy Virtual Program Review September 7, 2017 Information-driven Guidance and Control for Adaptive Target Detection and Classification Silvia Ferrari Pingping Zhu and Bo Fu Mechanical

More information

1 Introduction 1.1 Problem Denition The general problem we want tosolve is to let a mobile robot explore an unknown environment using range sensing an

1 Introduction 1.1 Problem Denition The general problem we want tosolve is to let a mobile robot explore an unknown environment using range sensing an Globally Consistent Range Scan Alignment for Environment Mapping F. Lu, E. Milios Department of Computer Science, York University, North York, Ontario, Canada flufeng, eemg@cs.yorku.ca April 17, 1997 Abstract

More information

Bayesian Inference. Chapter 4: Regression and Hierarchical Models

Bayesian Inference. Chapter 4: Regression and Hierarchical Models Bayesian Inference Chapter 4: Regression and Hierarchical Models Conchi Ausín and Mike Wiper Department of Statistics Universidad Carlos III de Madrid Advanced Statistics and Data Mining Summer School

More information

Bayesian Networks: Construction, Inference, Learning and Causal Interpretation. Volker Tresp Summer 2016

Bayesian Networks: Construction, Inference, Learning and Causal Interpretation. Volker Tresp Summer 2016 Bayesian Networks: Construction, Inference, Learning and Causal Interpretation Volker Tresp Summer 2016 1 Introduction So far we were mostly concerned with supervised learning: we predicted one or several

More information

2D Image Processing. Bayes filter implementation: Kalman filter

2D Image Processing. Bayes filter implementation: Kalman filter 2D Image Processing Bayes filter implementation: Kalman filter Prof. Didier Stricker Dr. Gabriele Bleser Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche

More information

From Practical Data Analysis with JMP, Second Edition. Full book available for purchase here. About This Book... xiii About The Author...

From Practical Data Analysis with JMP, Second Edition. Full book available for purchase here. About This Book... xiii About The Author... From Practical Data Analysis with JMP, Second Edition. Full book available for purchase here. Contents About This Book... xiii About The Author... xxiii Chapter 1 Getting Started: Data Analysis with JMP...

More information

Timevarying VARs. Wouter J. Den Haan London School of Economics. c Wouter J. Den Haan

Timevarying VARs. Wouter J. Den Haan London School of Economics. c Wouter J. Den Haan Timevarying VARs Wouter J. Den Haan London School of Economics c Wouter J. Den Haan Time-Varying VARs Gibbs-Sampler general idea probit regression application (Inverted Wishart distribution Drawing from

More information

Procedure 2 of Section 2 of ICAR Guidelines Computing of Accumulated Lactation Yield. Computing Lactation Yield

Procedure 2 of Section 2 of ICAR Guidelines Computing of Accumulated Lactation Yield. Computing Lactation Yield of ICAR Guidelines Computing of Accumulated Lactation Yield Table of Contents 1 The Test Interval Method (TIM) (Sargent, 1968)... 4 2 Interpolation using Standard Lactation Curves (ISLC) (Wilmink, 1987)...

More information

Introduction to Bayesian Networks

Introduction to Bayesian Networks Introduction to Bayesian Networks Anders Ringgaard Kristensen Slide 1 Outline Causal networks Bayesian Networks Evidence Conditional Independence and d-separation Compilation The moral graph The triangulated

More information

Bayesian Nonparametric Rasch Modeling: Methods and Software

Bayesian Nonparametric Rasch Modeling: Methods and Software Bayesian Nonparametric Rasch Modeling: Methods and Software George Karabatsos University of Illinois-Chicago Keynote talk Friday May 2, 2014 (9:15-10am) Ohio River Valley Objective Measurement Seminar

More information

Department of Large Animal Sciences. Outline. Slide 2. Department of Large Animal Sciences. Slide 4. Department of Large Animal Sciences

Department of Large Animal Sciences. Outline. Slide 2. Department of Large Animal Sciences. Slide 4. Department of Large Animal Sciences Outline Advanced topics from statistics Anders Ringgaard Kristensen Covariance and correlation Random vectors and multivariate distributions The multinomial distribution The multivariate normal distribution

More information

Notes on Machine Learning for and

Notes on Machine Learning for and Notes on Machine Learning for 16.410 and 16.413 (Notes adapted from Tom Mitchell and Andrew Moore.) Choosing Hypotheses Generally want the most probable hypothesis given the training data Maximum a posteriori

More information

Performance Evaluation

Performance Evaluation Performance Evaluation Confusion Matrix: Detected Positive Negative Actual Positive A: True Positive B: False Negative Negative C: False Positive D: True Negative Recall or Sensitivity or True Positive

More information

X t = a t + r t, (7.1)

X t = a t + r t, (7.1) Chapter 7 State Space Models 71 Introduction State Space models, developed over the past 10 20 years, are alternative models for time series They include both the ARIMA models of Chapters 3 6 and the Classical

More information

TP, TN, FP and FN Tables for dierent methods in dierent parameters:

TP, TN, FP and FN Tables for dierent methods in dierent parameters: TP, TN, FP and FN Tables for dierent methods in dierent parameters: Zhu,Yunan January 11, 2015 Notes: The mean of TP/TN/FP/FN shows NaN means the original matrix is a zero matrix True P/N the bigger the

More information

Statistics 910, #15 1. Kalman Filter

Statistics 910, #15 1. Kalman Filter Statistics 910, #15 1 Overview 1. Summary of Kalman filter 2. Derivations 3. ARMA likelihoods 4. Recursions for the variance Kalman Filter Summary of Kalman filter Simplifications To make the derivations

More information

(Extended) Kalman Filter

(Extended) Kalman Filter (Extended) Kalman Filter Brian Hunt 7 June 2013 Goals of Data Assimilation (DA) Estimate the state of a system based on both current and all past observations of the system, using a model for the system

More information

Sequential Monte Carlo Methods for Bayesian Computation

Sequential Monte Carlo Methods for Bayesian Computation Sequential Monte Carlo Methods for Bayesian Computation A. Doucet Kyoto Sept. 2012 A. Doucet (MLSS Sept. 2012) Sept. 2012 1 / 136 Motivating Example 1: Generic Bayesian Model Let X be a vector parameter

More information

Managing Uncertainty

Managing Uncertainty Managing Uncertainty Bayesian Linear Regression and Kalman Filter December 4, 2017 Objectives The goal of this lab is multiple: 1. First it is a reminder of some central elementary notions of Bayesian

More information

Robotics 2 Data Association. Giorgio Grisetti, Cyrill Stachniss, Kai Arras, Wolfram Burgard

Robotics 2 Data Association. Giorgio Grisetti, Cyrill Stachniss, Kai Arras, Wolfram Burgard Robotics 2 Data Association Giorgio Grisetti, Cyrill Stachniss, Kai Arras, Wolfram Burgard Data Association Data association is the process of associating uncertain measurements to known tracks. Problem

More information

Bayesian Inference. Chapter 4: Regression and Hierarchical Models

Bayesian Inference. Chapter 4: Regression and Hierarchical Models Bayesian Inference Chapter 4: Regression and Hierarchical Models Conchi Ausín and Mike Wiper Department of Statistics Universidad Carlos III de Madrid Master in Business Administration and Quantitative

More information

Part 1: Expectation Propagation

Part 1: Expectation Propagation Chalmers Machine Learning Summer School Approximate message passing and biomedicine Part 1: Expectation Propagation Tom Heskes Machine Learning Group, Institute for Computing and Information Sciences Radboud

More information

Bayesian Networks Basic and simple graphs

Bayesian Networks Basic and simple graphs Bayesian Networks Basic and simple graphs Ullrika Sahlin, Centre of Environmental and Climate Research Lund University, Sweden Ullrika.Sahlin@cec.lu.se http://www.cec.lu.se/ullrika-sahlin Bayesian [Belief]

More information

Mobile Robot Localization

Mobile Robot Localization Mobile Robot Localization 1 The Problem of Robot Localization Given a map of the environment, how can a robot determine its pose (planar coordinates + orientation)? Two sources of uncertainty: - observations

More information

Classifier Evaluation. Learning Curve cleval testc. The Apparent Classification Error. Error Estimation by Test Set. Classifier

Classifier Evaluation. Learning Curve cleval testc. The Apparent Classification Error. Error Estimation by Test Set. Classifier Classifier Learning Curve How to estimate classifier performance. Learning curves Feature curves Rejects and ROC curves True classification error ε Bayes error ε* Sub-optimal classifier Bayes consistent

More information

Quantitative Methods Chapter 0: Review of Basic Concepts 0.1 Business Applications (II) 0.2 Business Applications (III)

Quantitative Methods Chapter 0: Review of Basic Concepts 0.1 Business Applications (II) 0.2 Business Applications (III) Quantitative Methods Chapter 0: Review of Basic Concepts 0.1 Business Applications (II) 0.1.1 Simple Interest 0.2 Business Applications (III) 0.2.1 Expenses Involved in Buying a Car 0.2.2 Expenses Involved

More information

CHAPTER 3 DYNAMIC PRODUCTION MONITORING IN PIG HERDS I: MODELING AND MONITORING LITTER SIZE AT HERD AND SOW LEVEL

CHAPTER 3 DYNAMIC PRODUCTION MONITORING IN PIG HERDS I: MODELING AND MONITORING LITTER SIZE AT HERD AND SOW LEVEL CHAPTER 3 DYNAMIC PRODUCTION MONITORING IN PIG HERDS I: MODELING AND MONITORING LITTER SIZE AT HERD AND SOW LEVEL Claudia Bono, Cécile Cornou and Anders Ringgaard Kristensen Published in Livestock Science

More information

Flexible Top Trading Cycles and Chains Mechanism: Maintaining Diversity in Erasmus Student Exchange

Flexible Top Trading Cycles and Chains Mechanism: Maintaining Diversity in Erasmus Student Exchange 1/52 Flexible Top Trading Cycles and Chains Mechanism: Maintaining Diversity in Erasmus Student Exchange Umut Dur Onur Kesten Utku Ünver Econometric Society World Congress'15 New Market-Old Mechanism 2/52

More information

Bayesian Inference for DSGE Models. Lawrence J. Christiano

Bayesian Inference for DSGE Models. Lawrence J. Christiano Bayesian Inference for DSGE Models Lawrence J. Christiano Outline State space-observer form. convenient for model estimation and many other things. Preliminaries. Probabilities. Maximum Likelihood. Bayesian

More information

A new Hierarchical Bayes approach to ensemble-variational data assimilation

A new Hierarchical Bayes approach to ensemble-variational data assimilation A new Hierarchical Bayes approach to ensemble-variational data assimilation Michael Tsyrulnikov and Alexander Rakitko HydroMetCenter of Russia College Park, 20 Oct 2014 Michael Tsyrulnikov and Alexander

More information

Verification of Continuous Forecasts

Verification of Continuous Forecasts Verification of Continuous Forecasts Presented by Barbara Brown Including contributions by Tressa Fowler, Barbara Casati, Laurence Wilson, and others Exploratory methods Scatter plots Discrimination plots

More information

Olivier Sigaud. September 21, 2012

Olivier Sigaud. September 21, 2012 Supervised and Reinforcement Learning Tools for Motor Learning Models Olivier Sigaud Université Pierre et Marie Curie - Paris 6 September 21, 2012 1 / 64 Introduction Who is speaking? 2 / 64 Introduction

More information

Bayes Filter Reminder. Kalman Filter Localization. Properties of Gaussians. Gaussians. Prediction. Correction. σ 2. Univariate. 1 2πσ e.

Bayes Filter Reminder. Kalman Filter Localization. Properties of Gaussians. Gaussians. Prediction. Correction. σ 2. Univariate. 1 2πσ e. Kalman Filter Localization Bayes Filter Reminder Prediction Correction Gaussians p(x) ~ N(µ,σ 2 ) : Properties of Gaussians Univariate p(x) = 1 1 2πσ e 2 (x µ) 2 σ 2 µ Univariate -σ σ Multivariate µ Multivariate

More information

Overview. I Review of natural deduction. I Soundness and completeness. I Semantics of propositional formulas. I Soundness proof. I Completeness proof.

Overview. I Review of natural deduction. I Soundness and completeness. I Semantics of propositional formulas. I Soundness proof. I Completeness proof. Overview I Review of natural deduction. I Soundness and completeness. I Semantics of propositional formulas. I Soundness proof. I Completeness proof. Propositional formulas Grammar: ::= p j (:) j ( ^ )

More information

Chapte The McGraw-Hill Companies, Inc. All rights reserved.

Chapte The McGraw-Hill Companies, Inc. All rights reserved. er15 Chapte Chi-Square Tests d Chi-Square Tests for -Fit Uniform Goodness- Poisson Goodness- Goodness- ECDF Tests (Optional) Contingency Tables A contingency table is a cross-tabulation of n paired observations

More information

Gaussian Processes for Sequential Prediction

Gaussian Processes for Sequential Prediction Gaussian Processes for Sequential Prediction Michael A. Osborne Machine Learning Research Group Department of Engineering Science University of Oxford Gaussian processes are useful for sequential data,

More information

Machine Learning. Gaussian Mixture Models. Zhiyao Duan & Bryan Pardo, Machine Learning: EECS 349 Fall

Machine Learning. Gaussian Mixture Models. Zhiyao Duan & Bryan Pardo, Machine Learning: EECS 349 Fall Machine Learning Gaussian Mixture Models Zhiyao Duan & Bryan Pardo, Machine Learning: EECS 349 Fall 2012 1 The Generative Model POV We think of the data as being generated from some process. We assume

More information

Ensemble Methods. NLP ML Web! Fall 2013! Andrew Rosenberg! TA/Grader: David Guy Brizan

Ensemble Methods. NLP ML Web! Fall 2013! Andrew Rosenberg! TA/Grader: David Guy Brizan Ensemble Methods NLP ML Web! Fall 2013! Andrew Rosenberg! TA/Grader: David Guy Brizan How do you make a decision? What do you want for lunch today?! What did you have last night?! What are your favorite

More information

Bayesian Decision Theory

Bayesian Decision Theory Introduction to Pattern Recognition [ Part 4 ] Mahdi Vasighi Remarks It is quite common to assume that the data in each class are adequately described by a Gaussian distribution. Bayesian classifier is

More information

Structural Econometrics: Dynamic Discrete Choice. Jean-Marc Robin

Structural Econometrics: Dynamic Discrete Choice. Jean-Marc Robin Structural Econometrics: Dynamic Discrete Choice Jean-Marc Robin 1. Dynamic discrete choice models 2. Application: college and career choice Plan 1 Dynamic discrete choice models See for example the presentation

More information

Robotics 2 Target Tracking. Kai Arras, Cyrill Stachniss, Maren Bennewitz, Wolfram Burgard

Robotics 2 Target Tracking. Kai Arras, Cyrill Stachniss, Maren Bennewitz, Wolfram Burgard Robotics 2 Target Tracking Kai Arras, Cyrill Stachniss, Maren Bennewitz, Wolfram Burgard Slides by Kai Arras, Gian Diego Tipaldi, v.1.1, Jan 2012 Chapter Contents Target Tracking Overview Applications

More information

The Bayesian Paradigm

The Bayesian Paradigm Stat 200 The Bayesian Paradigm Friday March 2nd The Bayesian Paradigm can be seen in some ways as an extra step in the modelling world just as parametric modelling is. We have seen how we could use probabilistic

More information

Assessing Reliability Using Developmental and Operational Test Data

Assessing Reliability Using Developmental and Operational Test Data Assessing Reliability Using Developmental and Operational Test Data Martin Wayne, PhD, U.S. AMSAA Mohammad Modarres, PhD, University of Maryland, College Park Presented at the RAMS-04 Symposium Colorado

More information

Summary of Past Lectures. Target Tracking: Lecture 4 Multiple Target Tracking: Part I. Lecture Outline. What is a hypothesis?

Summary of Past Lectures. Target Tracking: Lecture 4 Multiple Target Tracking: Part I. Lecture Outline. What is a hypothesis? REGLERTEKNIK Summary of Past Lectures AUTOMATIC COROL Target Tracing: Lecture Multiple Target Tracing: Part I Emre Özan emre@isy.liu.se Division of Automatic Control Department of Electrical Engineering

More information

MVE055/MSG Lecture 8

MVE055/MSG Lecture 8 MVE055/MSG810 2017 Lecture 8 Petter Mostad Chalmers September 23, 2017 The Central Limit Theorem (CLT) Assume X 1,..., X n is a random sample from a distribution with expectation µ and variance σ 2. Then,

More information

Time Series Prediction by Kalman Smoother with Cross-Validated Noise Density

Time Series Prediction by Kalman Smoother with Cross-Validated Noise Density Time Series Prediction by Kalman Smoother with Cross-Validated Noise Density Simo Särkkä E-mail: simo.sarkka@hut.fi Aki Vehtari E-mail: aki.vehtari@hut.fi Jouko Lampinen E-mail: jouko.lampinen@hut.fi Abstract

More information

Detecting Avoidance Behaviors Between Moving Object Trajectories

Detecting Avoidance Behaviors Between Moving Object Trajectories Detecting Avoidance Behaviors Between Moving Object Trajectories Blind Review (September, 2014) Several algorithms have been proposed in the last few years for mining dierent mobility patterns from trajectories,

More information

Lecture 4: Dynamic models

Lecture 4: Dynamic models linear s Lecture 4: s Hedibert Freitas Lopes The University of Chicago Booth School of Business 5807 South Woodlawn Avenue, Chicago, IL 60637 http://faculty.chicagobooth.edu/hedibert.lopes hlopes@chicagobooth.edu

More information

MIXTURE MODELS AND EM

MIXTURE MODELS AND EM Last updated: November 6, 212 MIXTURE MODELS AND EM Credits 2 Some of these slides were sourced and/or modified from: Christopher Bishop, Microsoft UK Simon Prince, University College London Sergios Theodoridis,

More information

Smart Home Health Analytics Information Systems University of Maryland Baltimore County

Smart Home Health Analytics Information Systems University of Maryland Baltimore County Smart Home Health Analytics Information Systems University of Maryland Baltimore County 1 IEEE Expert, October 1996 2 Given sample S from all possible examples D Learner L learns hypothesis h based on

More information

Class 4: Classification. Quaid Morris February 11 th, 2011 ML4Bio

Class 4: Classification. Quaid Morris February 11 th, 2011 ML4Bio Class 4: Classification Quaid Morris February 11 th, 211 ML4Bio Overview Basic concepts in classification: overfitting, cross-validation, evaluation. Linear Discriminant Analysis and Quadratic Discriminant

More information

Latent Dirichlet Allocation

Latent Dirichlet Allocation Latent Dirichlet Allocation 1 Directed Graphical Models William W. Cohen Machine Learning 10-601 2 DGMs: The Burglar Alarm example Node ~ random variable Burglar Earthquake Arcs define form of probability

More information

COS Lecture 16 Autonomous Robot Navigation

COS Lecture 16 Autonomous Robot Navigation COS 495 - Lecture 16 Autonomous Robot Navigation Instructor: Chris Clark Semester: Fall 011 1 Figures courtesy of Siegwart & Nourbakhsh Control Structure Prior Knowledge Operator Commands Localization

More information

Efficient Bayesian Inference for Multiple Change-Point and Mixture Innovation Models

Efficient Bayesian Inference for Multiple Change-Point and Mixture Innovation Models Sveriges riksbank 196 working paper series Efficient Bayesian Inference for Multiple Change-Point and Mixture Innovation Models Paolo Giordani and Robert Kohn MAY 2006 Working papers are obtainable from

More information

Hierarchical Bayes Ensemble Kalman Filter

Hierarchical Bayes Ensemble Kalman Filter Hierarchical Bayes Ensemble Kalman Filter M Tsyrulnikov and A Rakitko HydroMetCenter of Russia Wrocław, 7 Sep 2015 M Tsyrulnikov and A Rakitko (HMC) Hierarchical Bayes Ensemble Kalman Filter Wrocław, 7

More information

Examples. 2-input, 1-output discrete-time systems: 1-input, 1-output discrete-time systems:

Examples. 2-input, 1-output discrete-time systems: 1-input, 1-output discrete-time systems: Discrete-Time s - I Time-Domain Representation CHAPTER 4 These lecture slides are based on "Digital Signal Processing: A Computer-Based Approach, 4th ed." textbook by S.K. Mitra and its instructor materials.

More information

Estimation and Inference on Dynamic Panel Data Models with Stochastic Volatility

Estimation and Inference on Dynamic Panel Data Models with Stochastic Volatility Estimation and Inference on Dynamic Panel Data Models with Stochastic Volatility Wen Xu Department of Economics & Oxford-Man Institute University of Oxford (Preliminary, Comments Welcome) Theme y it =

More information

2 MIKE WEST sub-cycles driven by Earth-orbital dynamics. Connections are drawn with other component state-space structures. Practical issues of time s

2 MIKE WEST sub-cycles driven by Earth-orbital dynamics. Connections are drawn with other component state-space structures. Practical issues of time s BAYESIAN TIME SERIES: Models and Computations for the Analysis of Time Series in the Physical Sciences MIKE WEST Institute of Statistics & Decision Sciences Duke University, Durham, NC 2778-25 y Abstract.

More information

Probability and Statistics

Probability and Statistics Kristel Van Steen, PhD 2 Montefiore Institute - Systems and Modeling GIGA - Bioinformatics ULg kristel.vansteen@ulg.ac.be Chapter 3: Parametric families of univariate distributions CHAPTER 3: PARAMETRIC

More information