Statistical Filters for Crowd Image Analysis
|
|
- Dale Powers
- 5 years ago
- Views:
Transcription
1 Statistical Filters for Crowd Image Analysis Ákos Utasi, Ákos Kiss and Tamás Szirányi Distributed Events Analysis Research Group, Computer and Automation Research Institute H-1111 Budapest, Kende utca 13-17, Hungary {utasi, akos.kiss, Abstract A mass of people can behave like as a random moving swarm. Its complexity can be described by statistical features. The paper gives solutions for recognising unusual motion patterns from overall motion statistics. The resulting system is tested on the PETS2009 dataset scenarios S3: Event Recognition and Dataset S1: Person Count and Density Estimation, with convincing results. 1. Introduction While there is a wide range of approaches many of them can not be applied in outdoor surveillance due to unreliable observation data. Surveillance applications face a lot of problems and as discussed in several papers (e.g. [1]) there is a significant gap between laboratory testing and real life applications where there are several sources of noise. This paper describes a statistical based evaluation of special motion events of mass of people tested on the PETS outdoor video dataset. Special events, as walking, running, rapid dispersion, local dispersion, crowd formation and splitting are estimated from statistics over global and local probabilistic models. We give a meaningful solution for unifying models of global motion statistics and local spatiotemporal flow estimation. A 4 dimensional Mixture of Gaussian model (MOG) is used to characterise the usual motion patterns depending on the location in the pedestrian s area. A likelihood function gives the probability of a flow-map, together with the global motion probability. The paper avoids the ambiguous definition of object shape or connectivity here, as they are abruptly change by time in any position. We show that the relatively simple statistical models may support to give adequate answers for the given questions. 2. Our approach Our event recognition method is based on low-level motion statistics. We created several low-level detectors to model different properties of the dense optical flow vector field. Our method performs the following steps: Preprocessing: background-foreground separation, optical flow calculation and filtering; Low-level detectors: produce properties for a given observation (property of the dense optical flow vector field); Event recognition: uses the output of the low-level detectors to categorise the event and provides membership probability; State (event) determination: event category with the highest membership probability is selected. 3. Preprocessing 3.1. Background-foreground separation For background modelling we used the CIE L*U*V* uniform colour space. We trained MOGs for each pixel using EM [2]. For background-foreground separation we used the method proposed by [3], but we omitted the update procedure. Moreover the variances of the L* were increased to handle lightning condition changes more effectively. Match in pixel (i, j) is defined as yi,j c µc i,j < T (1) c Σ c i,j where yi,j c is the value of the pixel in (i, j) in channel c {L, U, V }, µ and Σ denotes the expected value and covariance respectively and I = 6.0 is a constant [3]. The first B backgrounds are chosen as the background model: B = arg min b ( b ) w l > T l=1 where in our case the T parameter was set to 1.0 to select all Gaussians in the model. Finally morphological operators were use to clean the noisy foreground mask. Further improvements can be achieved by removing the shadows from the foreground mask (e.g. using the technique of [4]). (2)
2 3.2. Optical flow calculation, filtering We used the method of [5] to calculate the optical flow, which was smoothed by a spatial median filter of radius r = 1. The optical flow vectors were transformed to polar coordinates followed by several simple filters: unusually small and large magnitudes were dropped; vectors outside the foreground mask were dropped. 4. Low-level detectors In this section we present our detectors we used to model different features of the optical flow field. The models of the detectors are trained on the PETS Regular flow training data Detecting unusual optical flow Mixture of Gaussians were successfully used in several previous work for motion segmentation [7, 9, 8]. Having the training set of regular flows we extracted the optical flow vectors and trained [2] a 4 dimensional (x, y, vx, vy) MOG model (location + velocities) with 64 components in the mixture. The model learns the location, the speed and the direction of the regular activity from the training set. Fig. 1 represents the means of the Gaussians of the mixture: solid red line represents the mean direction and magnitude in the mean location, while the radius of the ellipses are proportional to the location variances. be expressed as P (O) = K K P MOG (o k ) (3) k=1 where P MOG (o) = M l=1 w ln (o µ l, Σ l ). During detection the optical flow vectors are collected from the video frames in a time window of size W = Detecting unusual magnitudes In order to describe the typical magnitudes of the usual activity a 1 dimensional Gaussian model was estimated from the training dataset. Before training the model the optical flow vectors were transformed into 3D space in order to normalise the magnitudes. For calculating the probability of a set of magnitudes we used the formula of Eq. 3 with the Gaussian probability in the product. 5. Event categorisation Our method currently recognises three types of events: regular activity, running and splitting. The recognition can be easily extended by using other low-level feature detector plugins Event recognition Using the low-level feature detectors presented in Sec. 4 we calculated the mean probabilities (or log P r) of the training data. Let denote the P i the mean probability of the ith low-level detector, and D i the standard deviation. Then to express that a given low-level feature f i with p i is similar to the training dataset we can define ( M sim (p i ) = N R pi P ) i, D i (4) membership similarity measure, where N R is a righttruncated Gaussian. Similarly we can define the membership dissimilarity measure as ( M dissim (p i ) = N L pi P ) i K D i, D i (5) Figure 1: Mixture of Gaussian (MOG) ellipses in 4 dimensions: x, y, vx, vy, represented by the cut at 2.5σ, while the velocities are represented by small red vectors in the centre points. Then for an incoming optical flow field O = {o 1,..., o K } (o k = (x k, y k, vx k, vy k )) the probability can where N L denotes the left-truncated Gaussian, the values of K is typically (in our case it was set to 3.5). Fig. 2 demonstrates the two functions. Our event categorisation algorithm is based on the above membership functions. Regular activity for example is constructed from two similarity functions on the two low-level feature detectors (unusual event and unusual magnitude) presented in Sec. 4. We defined the following three recognisers: Regular activity (R reg ): usual flow (M sim ) and usual magnitudes (M sim ), see Fig. 3 top;
3 Figure 2: Membership similarity (black) and dissimilarity (red) functions. Running (R run ): unusual flow (M dissim ) and unusual magnitudes (M dissim ), see Fig. 3 middle; Split (R split ): unusual flow (M dissim ) and usual magnitudes (M sim ), see Fig. 3 bottom. Each recogniser calculates the product of its membership similarity and dissimilarity values. Finally the most probable (highest value) case is selected to define the output state. 6. Experiments We tested our event recognition system on the PETS Event recognition dataset and we selected the videos containing the running and splitting events. The false alarm ratio was extremely low, the confusion matrix is shown below. Event Regular Run Split Regular Run Split Please note that the end of the split event cannot be clearly defined hence the performance might increase. The detected state sequences are demonstrated on Fig Person Count and Density Estimation For person count and density estimation we manually trained an estimator from the training sequences (S0 Regular flow) similar to [10]. Each image frame in the training set of M frames was segmented into N = 40 regions (40 equal columns) and for each region we collected the number of foreground pixels (Sec. 3.1) resulting in an N M matrix denoted as F. Moreover let denote p = [p 1,..., p M ] T the number of pedestrians for the training set. Using the ground truth data of F and p we can estimate the probable number Figure 4: Most probable state sequences. Top: S3.L3 Sequence 1 (running) with timestamp 14-16; Bottom: S3.L3 Sequence 3 (split) with timestamp 14-31; States: 0 - regular, 1 - running, 2 - split of pedestrians per foreground pixels ratio for each regions denoted as r and is computed as the solution of F r = p. (6) For an unknown image i frame we collect the foreground pixels in each region as the feature vector x i then the number of pedestrians is estimated as p i = x i r. (7) Please note that only a subset of regions hold usable information, the others might be skipped or components might be computed from the nearby important regions. We used 800 frames from the S0 Regular flow training sequences to train our estimator and the remaining 421 frames were used for testing. The result is demonstrated on Fig. 5. The algorithm is fast, but occlusion highly reduces its reliability. This is the reason of the deviation of cc. 5-6 detected persons in Fig. 5, which leads to the error diagrams in Fig. 6. The explanation of high relative error values is that the band has approximately the same width, indicating that occlusion means rather additive than multiplicative noise using this model. 8. Summary and Conclusions In this paper we presented a probabilistic event classification system. The design of the proposed system allows us to easily integrate new low-level detector plugins to recognise other complex event classes. In the future we plan to use probabilistic models which take into account the duration of the events (e.g. hidden semi-markov model [6]). Moreover our person count estimator can be improved by including temporal information in the model (e.g. using temporal filters).
4 guessed number of people Guesses grouped by ground truth ground truth train data test data number of people (ground truth) [8] Wei Zhang, Xiangzhong Fang, and Xiaokang Yang Spatiotemporal Gaussian mixture model to detect moving objects in dynamic scenes, J. Electron. Imaging, Vol. 16, [9] Roland Wilson, Andrew Calway, Multiresolution Gaussian Mixture Models for Visual Motion Estimation, in Proc. of the IEEE International Conference on Image Processing, pp Oct [10] Yin, J., Velastin, S., Davies, A., Image Processing Techniques for Crowd Density Estimation Using a Reference Image, in Proc. 2nd Asia-Pacific Conference on Computer. Vision, pp. 610, 1995 Figure 5: S1: Guessed number of people grouped by the S0 ground truth. Acknowledgements This work has been supported by the Hungarian Research Fund OTKA and the European Defense Agency in the MEDUSA project. References [1] Anthony R. Dick and Michael J. Brooks, Issues in Automated Visual Surveillance, Proc. 7th International Conference on Digital Image Computing: Techniques and Applications, pp Sydney, [2] A. P. Dempster, N. M. Laird, and D. B. Rubin, Maximum likelihood from incomplete data via the EM algorithm, J. Royal Stat. Soc., vol. 39, pp. 1 38, [3] C. Stauffer and W. E. L. Grimson, Adaptive Background Mixture Models for Real-time Tracking, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp , Fort Collins, CO, USA, June [4] Cs. Benedek and T. Szirányi Bayesian Foreground and Shadow Detection in Uncertain Frame Rate Surveillance Videos, IEEE Transactions on Image Processing, 17:(4) pp , 2008 [5] J. R. Bergen, R. Hingorani, Hierarchical Motion-Based Frame Rate Conversion, Technical report, David Sarnoff Research Center Princeton NJ 08540, [6] J. Ferguson, Variable duration models for speech, In Proceedings of the Symposium on the Application of HMMs to Text and Speech, pages , [7] Weiss, Y. Adelson, E.H. A unified mixture framework for motion segmentation: incorporating spatial coherence and estimating the number of models, in Proc. Computer Vision and Pattern Recognition, pp
5 Figure 3: Probability values of the low-level detectors for the regular activity (top), running event (middle) and split event (bottom). Left column: output of unusual flow detector, right column: output of unusual magnitude detector. Logarithmic scale is used.
6 Figure 6: Histograms of error (left) and relative error (right) on the training (top) and test (bottom) data.
Mixture Models and EM
Mixture Models and EM Goal: Introduction to probabilistic mixture models and the expectationmaximization (EM) algorithm. Motivation: simultaneous fitting of multiple model instances unsupervised clustering
More informationA Background Layer Model for Object Tracking through Occlusion
A Background Layer Model for Object Tracking through Occlusion Yue Zhou and Hai Tao UC-Santa Cruz Presented by: Mei-Fang Huang CSE252C class, November 6, 2003 Overview Object tracking problems Dynamic
More informationGlobal Behaviour Inference using Probabilistic Latent Semantic Analysis
Global Behaviour Inference using Probabilistic Latent Semantic Analysis Jian Li, Shaogang Gong, Tao Xiang Department of Computer Science Queen Mary College, University of London, London, E1 4NS, UK {jianli,
More informationShape of Gaussians as Feature Descriptors
Shape of Gaussians as Feature Descriptors Liyu Gong, Tianjiang Wang and Fang Liu Intelligent and Distributed Computing Lab, School of Computer Science and Technology Huazhong University of Science and
More informationShankar Shivappa University of California, San Diego April 26, CSE 254 Seminar in learning algorithms
Recognition of Visual Speech Elements Using Adaptively Boosted Hidden Markov Models. Say Wei Foo, Yong Lian, Liang Dong. IEEE Transactions on Circuits and Systems for Video Technology, May 2004. Shankar
More informationHuman Pose Tracking I: Basics. David Fleet University of Toronto
Human Pose Tracking I: Basics David Fleet University of Toronto CIFAR Summer School, 2009 Looking at People Challenges: Complex pose / motion People have many degrees of freedom, comprising an articulated
More informationModeling Complex Temporal Composition of Actionlets for Activity Prediction
Modeling Complex Temporal Composition of Actionlets for Activity Prediction ECCV 2012 Activity Recognition Reading Group Framework of activity prediction What is an Actionlet To segment a long sequence
More informationGraphical Object Models for Detection and Tracking
Graphical Object Models for Detection and Tracking (ls@cs.brown.edu) Department of Computer Science Brown University Joined work with: -Ying Zhu, Siemens Corporate Research, Princeton, NJ -DorinComaniciu,
More informationAutomated Segmentation of Low Light Level Imagery using Poisson MAP- MRF Labelling
Automated Segmentation of Low Light Level Imagery using Poisson MAP- MRF Labelling Abstract An automated unsupervised technique, based upon a Bayesian framework, for the segmentation of low light level
More informationData Analyzing and Daily Activity Learning with Hidden Markov Model
Data Analyzing and Daily Activity Learning with Hidden Markov Model GuoQing Yin and Dietmar Bruckner Institute of Computer Technology Vienna University of Technology, Austria, Europe {yin, bruckner}@ict.tuwien.ac.at
More informationHidden CRFs for Human Activity Classification from RGBD Data
H Hidden s for Human from RGBD Data Avi Singh & Ankit Goyal IIT-Kanpur CS679: Machine Learning for Computer Vision April 13, 215 Overview H 1 2 3 H 4 5 6 7 Statement H Input An RGBD video with a human
More informationSupplementary Material: Minimum Delay Moving Object Detection
Supplementary Material: Minimum Delay Moving Object Detection Dong Lao and Ganesh Sundaramoorthi King Abdullah University of Science & Technology KAUST, Saudi Arabia {dong.lao, ganesh.sundaramoorthi}@kaust.edu.sa.
More informationChange Detection in Optical Aerial Images by a Multi-Layer Conditional Mixed Markov Model
Change Detection in Optical Aerial Images by a Multi-Layer Conditional Mixed Markov Model Csaba Benedek 12 Tamás Szirányi 1 1 Distributed Events Analysis Research Group Computer and Automation Research
More informationK-Means, Expectation Maximization and Segmentation. D.A. Forsyth, CS543
K-Means, Expectation Maximization and Segmentation D.A. Forsyth, CS543 K-Means Choose a fixed number of clusters Choose cluster centers and point-cluster allocations to minimize error can t do this by
More informationLatent Variable Models and Expectation Maximization
Latent Variable Models and Expectation Maximization Oliver Schulte - CMPT 726 Bishop PRML Ch. 9 2 4 6 8 1 12 14 16 18 2 4 6 8 1 12 14 16 18 5 1 15 2 25 5 1 15 2 25 2 4 6 8 1 12 14 2 4 6 8 1 12 14 5 1 15
More informationModeling Multiscale Differential Pixel Statistics
Modeling Multiscale Differential Pixel Statistics David Odom a and Peyman Milanfar a a Electrical Engineering Department, University of California, Santa Cruz CA. 95064 USA ABSTRACT The statistics of natural
More informationTwo-Stream Bidirectional Long Short-Term Memory for Mitosis Event Detection and Stage Localization in Phase-Contrast Microscopy Images
Two-Stream Bidirectional Long Short-Term Memory for Mitosis Event Detection and Stage Localization in Phase-Contrast Microscopy Images Yunxiang Mao and Zhaozheng Yin (B) Computer Science, Missouri University
More informationA RAIN PIXEL RESTORATION ALGORITHM FOR VIDEOS WITH DYNAMIC SCENES
A RAIN PIXEL RESTORATION ALGORITHM FOR VIDEOS WITH DYNAMIC SCENES V.Sridevi, P.Malarvizhi, P.Mathivannan Abstract Rain removal from a video is a challenging problem due to random spatial distribution and
More informationMachine Learning Techniques for Computer Vision
Machine Learning Techniques for Computer Vision Part 2: Unsupervised Learning Microsoft Research Cambridge x 3 1 0.5 0.2 0 0.5 0.3 0 0.5 1 ECCV 2004, Prague x 2 x 1 Overview of Part 2 Mixture models EM
More informationOverlapping Astronomical Sources: Utilizing Spectral Information
Overlapping Astronomical Sources: Utilizing Spectral Information David Jones Advisor: Xiao-Li Meng Collaborators: Vinay Kashyap (CfA) and David van Dyk (Imperial College) CHASC Astrostatistics Group April
More informationHidden Markov Models Part 1: Introduction
Hidden Markov Models Part 1: Introduction CSE 6363 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington 1 Modeling Sequential Data Suppose that
More informationHidden Markov models for time series of counts with excess zeros
Hidden Markov models for time series of counts with excess zeros Madalina Olteanu and James Ridgway University Paris 1 Pantheon-Sorbonne - SAMM, EA4543 90 Rue de Tolbiac, 75013 Paris - France Abstract.
More informationUnsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models
SUBMISSION TO IEEE TRANS. ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 1 Unsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models Xiaogang Wang, Xiaoxu Ma,
More informationLatent Variable Models and Expectation Maximization
Latent Variable Models and Expectation Maximization Oliver Schulte - CMPT 726 Bishop PRML Ch. 9 2 4 6 8 1 12 14 16 18 2 4 6 8 1 12 14 16 18 5 1 15 2 25 5 1 15 2 25 2 4 6 8 1 12 14 2 4 6 8 1 12 14 5 1 15
More informationUnsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models
SUBMISSION TO IEEE TRANS. ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 1 Unsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models Xiaogang Wang, Xiaoxu Ma,
More informationA Probabilistic Relational Model for Characterizing Situations in Dynamic Multi-Agent Systems
A Probabilistic Relational Model for Characterizing Situations in Dynamic Multi-Agent Systems Daniel Meyer-Delius 1, Christian Plagemann 1, Georg von Wichert 2, Wendelin Feiten 2, Gisbert Lawitzky 2, and
More informationShape Outlier Detection Using Pose Preserving Dynamic Shape Models
Shape Outlier Detection Using Pose Preserving Dynamic Shape Models Chan-Su Lee and Ahmed Elgammal Rutgers, The State University of New Jersey Department of Computer Science Outline Introduction Shape Outlier
More informationGaussian Mixture Model Uncertainty Learning (GMMUL) Version 1.0 User Guide
Gaussian Mixture Model Uncertainty Learning (GMMUL) Version 1. User Guide Alexey Ozerov 1, Mathieu Lagrange and Emmanuel Vincent 1 1 INRIA, Centre de Rennes - Bretagne Atlantique Campus de Beaulieu, 3
More informationPredicting Social Interactions for Visual Tracking
XU YAN, ET AL: PREDICTING SOCIAL INTERACTIONS FOR VISUAL TRACKING 1 Predicting Social Interactions for Visual Tracking Xu Yan xyan6@uh.edu Ioannis A. Kakadiaris ioannisk@uh.edu Shishir K. Shah sshah@central.uh.edu
More informationSYMBOL RECOGNITION IN HANDWRITTEN MATHEMATI- CAL FORMULAS
SYMBOL RECOGNITION IN HANDWRITTEN MATHEMATI- CAL FORMULAS Hans-Jürgen Winkler ABSTRACT In this paper an efficient on-line recognition system for handwritten mathematical formulas is proposed. After formula
More informationNote Set 5: Hidden Markov Models
Note Set 5: Hidden Markov Models Probabilistic Learning: Theory and Algorithms, CS 274A, Winter 2016 1 Hidden Markov Models (HMMs) 1.1 Introduction Consider observed data vectors x t that are d-dimensional
More informationLinear Dynamical Systems
Linear Dynamical Systems Sargur N. srihari@cedar.buffalo.edu Machine Learning Course: http://www.cedar.buffalo.edu/~srihari/cse574/index.html Two Models Described by Same Graph Latent variables Observations
More informationHidden Markov Models and Gaussian Mixture Models
Hidden Markov Models and Gaussian Mixture Models Hiroshi Shimodaira and Steve Renals Automatic Speech Recognition ASR Lectures 4&5 23&27 January 2014 ASR Lectures 4&5 Hidden Markov Models and Gaussian
More informationForecasting Wind Ramps
Forecasting Wind Ramps Erin Summers and Anand Subramanian Jan 5, 20 Introduction The recent increase in the number of wind power producers has necessitated changes in the methods power system operators
More informationABSTRACT INTRODUCTION
ABSTRACT Presented in this paper is an approach to fault diagnosis based on a unifying review of linear Gaussian models. The unifying review draws together different algorithms such as PCA, factor analysis,
More informationBayesian Classifiers and Probability Estimation. Vassilis Athitsos CSE 4308/5360: Artificial Intelligence I University of Texas at Arlington
Bayesian Classifiers and Probability Estimation Vassilis Athitsos CSE 4308/5360: Artificial Intelligence I University of Texas at Arlington 1 Data Space Suppose that we have a classification problem The
More informationSpectral Clustering with Eigenvector Selection
Spectral Clustering with Eigenvector Selection Tao Xiang and Shaogang Gong Department of Computer Science Queen Mary, University of London, London E 4NS, UK {txiang,sgg}@dcs.qmul.ac.uk Abstract The task
More informationSpectral clustering with eigenvector selection
Pattern Recognition 41 (2008) 1012 1029 www.elsevier.com/locate/pr Spectral clustering with eigenvector selection Tao Xiang, Shaogang Gong Department of Computer Science, Queen Mary, University of London,
More informationEvent Detection by Eigenvector Decomposition Using Object and Frame Features
Event Detection by Eigenvector Decomposition Using Object and Frame Features Fatih Porikli Tetsuji Haga Abstract We develop an event detection framework that has two significant advantages over past work
More informationExperiments with a Gaussian Merging-Splitting Algorithm for HMM Training for Speech Recognition
Experiments with a Gaussian Merging-Splitting Algorithm for HMM Training for Speech Recognition ABSTRACT It is well known that the expectation-maximization (EM) algorithm, commonly used to estimate hidden
More informationExpectation Maximization
Expectation Maximization Bishop PRML Ch. 9 Alireza Ghane c Ghane/Mori 4 6 8 4 6 8 4 6 8 4 6 8 5 5 5 5 5 5 4 6 8 4 4 6 8 4 5 5 5 5 5 5 µ, Σ) α f Learningscale is slightly Parameters is slightly larger larger
More informationMIXTURE MODELS AND EM
Last updated: November 6, 212 MIXTURE MODELS AND EM Credits 2 Some of these slides were sourced and/or modified from: Christopher Bishop, Microsoft UK Simon Prince, University College London Sergios Theodoridis,
More informationRESTORATION OF VIDEO BY REMOVING RAIN
RESTORATION OF VIDEO BY REMOVING RAIN Sajitha Krishnan 1 and D.Venkataraman 1 1 Computer Vision and Image Processing, Department of Computer Science, Amrita Vishwa Vidyapeetham University, Coimbatore,
More informationA Benchmark for Background Subtraction Algorithms in Monocular Vision: a Comparative Study
A Benchmark for Background Subtraction Algorithms in Monocular Vision: a Comparative Study Yoann Dhome, Nicolas Tronson 2, Antoine Vacavant 3,4, Thierry Chateau 5, Christophe Gabard, Yann Goyat 2 and Dominique
More informationA Probabilistic Relational Model for Characterizing Situations in Dynamic Multi-Agent Systems
A Probabilistic Relational Model for Characterizing Situations in Dynamic Multi-Agent Systems Daniel Meyer-Delius 1, Christian Plagemann 1, Georg von Wichert 2, Wendelin Feiten 2, Gisbert Lawitzky 2, and
More informationMaximum Likelihood and Maximum A Posteriori Adaptation for Distributed Speaker Recognition Systems
Maximum Likelihood and Maximum A Posteriori Adaptation for Distributed Speaker Recognition Systems Chin-Hung Sit 1, Man-Wai Mak 1, and Sun-Yuan Kung 2 1 Center for Multimedia Signal Processing Dept. of
More informationSTA 4273H: Statistical Machine Learning
STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.utstat.utoronto.ca/~rsalakhu/ Sidney Smith Hall, Room 6002 Lecture 11 Project
More informationPATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA
PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA Contents in latter part Linear Dynamical Systems What is different from HMM? Kalman filter Its strength and limitation Particle Filter
More informationAnomaly Detection for the CERN Large Hadron Collider injection magnets
Anomaly Detection for the CERN Large Hadron Collider injection magnets Armin Halilovic KU Leuven - Department of Computer Science In cooperation with CERN 2018-07-27 0 Outline 1 Context 2 Data 3 Preprocessing
More informationOBJECT DETECTION AND RECOGNITION IN DIGITAL IMAGES
OBJECT DETECTION AND RECOGNITION IN DIGITAL IMAGES THEORY AND PRACTICE Bogustaw Cyganek AGH University of Science and Technology, Poland WILEY A John Wiley &. Sons, Ltd., Publication Contents Preface Acknowledgements
More informationPerformance Comparison of K-Means and Expectation Maximization with Gaussian Mixture Models for Clustering EE6540 Final Project
Performance Comparison of K-Means and Expectation Maximization with Gaussian Mixture Models for Clustering EE6540 Final Project Devin Cornell & Sushruth Sastry May 2015 1 Abstract In this article, we explore
More informationAsaf Bar Zvi Adi Hayat. Semantic Segmentation
Asaf Bar Zvi Adi Hayat Semantic Segmentation Today s Topics Fully Convolutional Networks (FCN) (CVPR 2015) Conditional Random Fields as Recurrent Neural Networks (ICCV 2015) Gaussian Conditional random
More informationOptical Flow, Motion Segmentation, Feature Tracking
BIL 719 - Computer Vision May 21, 2014 Optical Flow, Motion Segmentation, Feature Tracking Aykut Erdem Dept. of Computer Engineering Hacettepe University Motion Optical Flow Motion Segmentation Feature
More informationRecent Advances in Bayesian Inference Techniques
Recent Advances in Bayesian Inference Techniques Christopher M. Bishop Microsoft Research, Cambridge, U.K. research.microsoft.com/~cmbishop SIAM Conference on Data Mining, April 2004 Abstract Bayesian
More informationCSC487/2503: Foundations of Computer Vision. Visual Tracking. David Fleet
CSC487/2503: Foundations of Computer Vision Visual Tracking David Fleet Introduction What is tracking? Major players: Dynamics (model of temporal variation of target parameters) Measurements (relation
More informationAutomatic estimation of crowd size and target detection using Image processing
Automatic estimation of crowd size and target detection using Image processing Asst Prof. Avinash Rai Dept. of Electronics and communication (UIT-RGPV) Bhopal avinashrai@rgtu.net Rahul Meshram Dept. of
More informationAn Evolutionary Programming Based Algorithm for HMM training
An Evolutionary Programming Based Algorithm for HMM training Ewa Figielska,Wlodzimierz Kasprzak Institute of Control and Computation Engineering, Warsaw University of Technology ul. Nowowiejska 15/19,
More informationClustering with k-means and Gaussian mixture distributions
Clustering with k-means and Gaussian mixture distributions Machine Learning and Category Representation 2012-2013 Jakob Verbeek, ovember 23, 2012 Course website: http://lear.inrialpes.fr/~verbeek/mlcr.12.13
More informationA Novel Activity Detection Method
A Novel Activity Detection Method Gismy George P.G. Student, Department of ECE, Ilahia College of,muvattupuzha, Kerala, India ABSTRACT: This paper presents an approach for activity state recognition of
More informationHMM part 1. Dr Philip Jackson
Centre for Vision Speech & Signal Processing University of Surrey, Guildford GU2 7XH. HMM part 1 Dr Philip Jackson Probability fundamentals Markov models State topology diagrams Hidden Markov models -
More informationMultiscale Systems Engineering Research Group
Hidden Markov Model Prof. Yan Wang Woodruff School of Mechanical Engineering Georgia Institute of echnology Atlanta, GA 30332, U.S.A. yan.wang@me.gatech.edu Learning Objectives o familiarize the hidden
More informationTracking Human Heads Based on Interaction between Hypotheses with Certainty
Proc. of The 13th Scandinavian Conference on Image Analysis (SCIA2003), (J. Bigun and T. Gustavsson eds.: Image Analysis, LNCS Vol. 2749, Springer), pp. 617 624, 2003. Tracking Human Heads Based on Interaction
More informationPatch similarity under non Gaussian noise
The 18th IEEE International Conference on Image Processing Brussels, Belgium, September 11 14, 011 Patch similarity under non Gaussian noise Charles Deledalle 1, Florence Tupin 1, Loïc Denis 1 Institut
More informationMachine Learning for Signal Processing Expectation Maximization Mixture Models. Bhiksha Raj 27 Oct /
Machine Learning for Signal rocessing Expectation Maximization Mixture Models Bhiksha Raj 27 Oct 2016 11755/18797 1 Learning Distributions for Data roblem: Given a collection of examples from some data,
More informationDefect Detection Using Hidden Markov Random Fields
Electrical and Computer Engineering Publications Electrical and Computer Engineering 5 Defect Detection Using Hidden Markov Random Fields Aleksandar Dogandžić Iowa State University, ald@iastate.edu Nawanat
More informationOnline Appearance Model Learning for Video-Based Face Recognition
Online Appearance Model Learning for Video-Based Face Recognition Liang Liu 1, Yunhong Wang 2,TieniuTan 1 1 National Laboratory of Pattern Recognition Institute of Automation, Chinese Academy of Sciences,
More informationHierarchical Clustering of Dynamical Systems based on Eigenvalue Constraints
Proc. 3rd International Conference on Advances in Pattern Recognition (S. Singh et al. (Eds.): ICAPR 2005, LNCS 3686, Springer), pp. 229-238, 2005 Hierarchical Clustering of Dynamical Systems based on
More informationEEL 851: Biometrics. An Overview of Statistical Pattern Recognition EEL 851 1
EEL 851: Biometrics An Overview of Statistical Pattern Recognition EEL 851 1 Outline Introduction Pattern Feature Noise Example Problem Analysis Segmentation Feature Extraction Classification Design Cycle
More informationPATTERN RECOGNITION AND MACHINE LEARNING
PATTERN RECOGNITION AND MACHINE LEARNING Slide Set 3: Detection Theory January 2018 Heikki Huttunen heikki.huttunen@tut.fi Department of Signal Processing Tampere University of Technology Detection theory
More informationVideo Behaviour Profiling for Anomaly Detection
1 Video Behaviour Profiling for Anomaly Detection Tao Xiang 1 and Shaogang Gong 2 Department of Computer Science Queen Mary, University of London, London E1 4NS, UK Abstract This paper aims to address
More informationCollaborative topic models: motivations cont
Collaborative topic models: motivations cont Two topics: machine learning social network analysis Two people: " boy Two articles: article A! girl article B Preferences: The boy likes A and B --- no problem.
More informationA CUSUM approach for online change-point detection on curve sequences
ESANN 22 proceedings, European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning. Bruges Belgium, 25-27 April 22, i6doc.com publ., ISBN 978-2-8749-49-. Available
More informationIntroduction to Machine Learning Midterm Exam
10-701 Introduction to Machine Learning Midterm Exam Instructors: Eric Xing, Ziv Bar-Joseph 17 November, 2015 There are 11 questions, for a total of 100 points. This exam is open book, open notes, but
More informationHMM and IOHMM Modeling of EEG Rhythms for Asynchronous BCI Systems
HMM and IOHMM Modeling of EEG Rhythms for Asynchronous BCI Systems Silvia Chiappa and Samy Bengio {chiappa,bengio}@idiap.ch IDIAP, P.O. Box 592, CH-1920 Martigny, Switzerland Abstract. We compare the use
More informationChapter 4 Dynamic Bayesian Networks Fall Jin Gu, Michael Zhang
Chapter 4 Dynamic Bayesian Networks 2016 Fall Jin Gu, Michael Zhang Reviews: BN Representation Basic steps for BN representations Define variables Define the preliminary relations between variables Check
More informationCOURSE INTRODUCTION. J. Elder CSE 6390/PSYC 6225 Computational Modeling of Visual Perception
COURSE INTRODUCTION COMPUTATIONAL MODELING OF VISUAL PERCEPTION 2 The goal of this course is to provide a framework and computational tools for modeling visual inference, motivated by interesting examples
More informationSound Recognition in Mixtures
Sound Recognition in Mixtures Juhan Nam, Gautham J. Mysore 2, and Paris Smaragdis 2,3 Center for Computer Research in Music and Acoustics, Stanford University, 2 Advanced Technology Labs, Adobe Systems
More informationUniversity of Cambridge. MPhil in Computer Speech Text & Internet Technology. Module: Speech Processing II. Lecture 2: Hidden Markov Models I
University of Cambridge MPhil in Computer Speech Text & Internet Technology Module: Speech Processing II Lecture 2: Hidden Markov Models I o o o o o 1 2 3 4 T 1 b 2 () a 12 2 a 3 a 4 5 34 a 23 b () b ()
More informationPROBABILISTIC REASONING OVER TIME
PROBABILISTIC REASONING OVER TIME In which we try to interpret the present, understand the past, and perhaps predict the future, even when very little is crystal clear. Outline Time and uncertainty Inference:
More informationIndependent Component Analysis and Unsupervised Learning. Jen-Tzung Chien
Independent Component Analysis and Unsupervised Learning Jen-Tzung Chien TABLE OF CONTENTS 1. Independent Component Analysis 2. Case Study I: Speech Recognition Independent voices Nonparametric likelihood
More informationMulti-Observations Newscast EM for Distributed Multi-Camera Tracking
Multi-Observations Newscast EM for Distributed Multi-Camera Tracking Thomas Mensink Supervisors: Dr. ir. B.J.A. Kröse Dr. W.P. Zajdel August 2007 Multi-Observations Newscast EM for Distributed Multi-Camera
More informationFigure : Learning the dynamics of juggling. Three motion classes, emerging from dynamical learning, turn out to correspond accurately to ballistic mot
Learning multi-class dynamics A. Blake, B. North and M. Isard Department of Engineering Science, University of Oxford, Oxford OX 3PJ, UK. Web: http://www.robots.ox.ac.uk/vdg/ Abstract Standard techniques
More informationTennis player segmentation for semantic behavior analysis
Proposta di Tennis player segmentation for semantic behavior analysis Architettura Software per Robot Mobili Vito Renò, Nicola Mosca, Massimiliano Nitti, Tiziana D Orazio, Donato Campagnoli, Andrea Prati,
More informationDynamic Data Modeling, Recognition, and Synthesis. Rui Zhao Thesis Defense Advisor: Professor Qiang Ji
Dynamic Data Modeling, Recognition, and Synthesis Rui Zhao Thesis Defense Advisor: Professor Qiang Ji Contents Introduction Related Work Dynamic Data Modeling & Analysis Temporal localization Insufficient
More informationIndependent Component Analysis and Unsupervised Learning
Independent Component Analysis and Unsupervised Learning Jen-Tzung Chien National Cheng Kung University TABLE OF CONTENTS 1. Independent Component Analysis 2. Case Study I: Speech Recognition Independent
More informationOn the Influence of the Delta Coefficients in a HMM-based Speech Recognition System
On the Influence of the Delta Coefficients in a HMM-based Speech Recognition System Fabrice Lefèvre, Claude Montacié and Marie-José Caraty Laboratoire d'informatique de Paris VI 4, place Jussieu 755 PARIS
More informationA Gentle Tutorial of the EM Algorithm and its Application to Parameter Estimation for Gaussian Mixture and Hidden Markov Models
A Gentle Tutorial of the EM Algorithm and its Application to Parameter Estimation for Gaussian Mixture and Hidden Markov Models Jeff A. Bilmes (bilmes@cs.berkeley.edu) International Computer Science Institute
More informationSpatial Bayesian Nonparametrics for Natural Image Segmentation
Spatial Bayesian Nonparametrics for Natural Image Segmentation Erik Sudderth Brown University Joint work with Michael Jordan University of California Soumya Ghosh Brown University Parsing Visual Scenes
More informationRobust Sound Event Detection in Continuous Audio Environments
Robust Sound Event Detection in Continuous Audio Environments Haomin Zhang 1, Ian McLoughlin 2,1, Yan Song 1 1 National Engineering Laboratory of Speech and Language Information Processing The University
More informationVariational Methods in Bayesian Deconvolution
PHYSTAT, SLAC, Stanford, California, September 8-, Variational Methods in Bayesian Deconvolution K. Zarb Adami Cavendish Laboratory, University of Cambridge, UK This paper gives an introduction to the
More informationDISTRIBUTION A: Distribution approved for public release.
AFRL-AFOSR-JP-TR-2016-0044 Activity Recognition in Social Media Subhasis Chaudhuri INDIAN INSTITUTE OF TECHNOLOGY BOMBAY 05/09/2016 Final Report. Air Force Research Laboratory AF Office Of Scientific Research
More informationA Variance Modeling Framework Based on Variational Autoencoders for Speech Enhancement
A Variance Modeling Framework Based on Variational Autoencoders for Speech Enhancement Simon Leglaive 1 Laurent Girin 1,2 Radu Horaud 1 1: Inria Grenoble Rhône-Alpes 2: Univ. Grenoble Alpes, Grenoble INP,
More informationMULTI-TARGET TRACKING USING ON-LINE VITERBI OPTIMISATION AND STOCHASTIC MODELLING
MULTI-TARGET TRACKING USING ON-LINE VITERBI OPTIMISATION AND STOCHASTIC MODELLING HÅKAN ARDÖ Centre for Mathematical Sciences Mathematics Mathematics Centre for Mathematical Sciences Lund University Box
More informationEstimating Gaussian Mixture Densities with EM A Tutorial
Estimating Gaussian Mixture Densities with EM A Tutorial Carlo Tomasi Due University Expectation Maximization (EM) [4, 3, 6] is a numerical algorithm for the maximization of functions of several variables
More informationA Bayesian Perspective on Residential Demand Response Using Smart Meter Data
A Bayesian Perspective on Residential Demand Response Using Smart Meter Data Datong-Paul Zhou, Maximilian Balandat, and Claire Tomlin University of California, Berkeley [datong.zhou, balandat, tomlin]@eecs.berkeley.edu
More informationBayesian Networks BY: MOHAMAD ALSABBAGH
Bayesian Networks BY: MOHAMAD ALSABBAGH Outlines Introduction Bayes Rule Bayesian Networks (BN) Representation Size of a Bayesian Network Inference via BN BN Learning Dynamic BN Introduction Conditional
More information10/17/04. Today s Main Points
Part-of-speech Tagging & Hidden Markov Model Intro Lecture #10 Introduction to Natural Language Processing CMPSCI 585, Fall 2004 University of Massachusetts Amherst Andrew McCallum Today s Main Points
More informationGaussian Process Based Image Segmentation and Object Detection in Pathology Slides
Gaussian Process Based Image Segmentation and Object Detection in Pathology Slides CS 229 Final Project, Autumn 213 Jenny Hong Email: jyunhong@stanford.edu I. INTRODUCTION In medical imaging, recognizing
More informationMotion estimation. Digital Visual Effects Yung-Yu Chuang. with slides by Michael Black and P. Anandan
Motion estimation Digital Visual Effects Yung-Yu Chuang with slides b Michael Black and P. Anandan Motion estimation Parametric motion image alignment Tracking Optical flow Parametric motion direct method
More informationCheng Soon Ong & Christian Walder. Canberra February June 2018
Cheng Soon Ong & Christian Walder Research Group and College of Engineering and Computer Science Canberra February June 218 Outlines Overview Introduction Linear Algebra Probability Linear Regression 1
More information