Level-Set Person Segmentation and Tracking with Multi-Region Appearance Models and Top-Down Shape Information Appendix
|
|
- Bertram Walters
- 5 years ago
- Views:
Transcription
1 Level-Set Person Segmentation and Tracking with Multi-Region Appearance Models and Top-Down Shape Information Appendix Esther Horbert, Konstantinos Rematas, Bastian Leibe UMIC Research Centre, RWTH Aachen University This appendix contains a detailed derivation of our segmentation and tracking framework [27] and lists typical values for important parameters. A. Derivation Fig. shows the results of our full model for the sequence WALKSTRAIGHT [26], illustrating the evolution of the three contours. Figure 2. The generative model used in this approach, M Mf, Mf 2, Mb, Mb2. x Pixel s coordinates inside reference frame y Pixel s color p Reference frame position h Shape model W x, p) Warp with parameters p Mf, M f 2 Foreground regions Mb, Mb2 Background regions P y Mk ) Appearance models Φ Level set embedding function Φc, Φf, Φb Embeddings for person and fore/background Ck Contour represented by the zero level set H z) Smoothed Heaviside step function δ z) Smoothed Dirac delta function Table. Notation used in this paper Figure. Results of our full model for the sequence WALK STRAIGHT 25 frames, from [26]). This example nicely illustrates the evolution of the separating contours dark red). The foreground contour Φf is initialized with a horizontal line at 50% of the object frame height, the background contour Φb with a line at 60%. However this is only the initialization and the lines can evolve to very different forms as the person s contour does).
2 The joint distribution for one pixel given by the model in Fig. 2 is: P x i, y i, h i, Φ, p, M) P x i Φ, p, M)P y i M)P h i M)P M)P Φ)P p) ) assumption: y, h independent) 2) P x i, Φ, p, M y i, h i )P y i )P h i ) P x i Φ, p, M)P y i M)P h i M)P M)P Φ)P p) 3) P x i, Φ, p, M y i, h i ) P x i Φ, p, M)P M y i )P M h i )P Φ)P p) 4) Marginalization over the models M yields the pixel-wise posterior probability of shape Φ and location p given a pixel x i, y i, h i : k f,f2,b,b2 k f,f2,b,b2 P x i, Φ, p, M k y i, h i ) P x i, Φ, p y i, h i ) P Φ, p x i, y i, h i )P x i ) 5) l P y i M l )P M l ) P M k h i ) P Φ)P p) 6) It follows P Φ, p x i, y i, h i ) P x) k f,f2,b,b2 l P y M l)p M l ) P M k h i ) P Φ)P p) 7) We use a smoothed Heaviside step function H ɛ to select the respective regions and a smoothed Dirac delta function δ ɛ to select the contours: H c H ɛ Φ c x i )), Hc H ɛ Φ c x i )) 8) H f H ɛ Φ f x i )), Hf H ɛ Φ f x i )) 9) H b H ɛ Φ b x i )), Hb H ɛ Φ b x i )) 0) P M k ) η k η, k f, f2, b, b2, M f M f M f2, M b M b M b2 ) The number of pixels in the four respective regions can be obtained as follows: N N N η k, η f H c H f, η f2 H chf, 2) η b N H c H b, η b2 N H c Hb 3)
3 and thus the probability of pixel x i for each region: P x i Φ, p, M f ) H ch f, P x i Φ, p, M f2 ) H ch f, η f η f2 4) P x i Φ, p, M b ) H c H b, P x i Φ, p, M b2 ) H c Hb. η b η b2 5) Fusing the pixel-wise posteriors with a logarithmic opinion pool yields P Φ, p x, y, h) 6) N [ ] l P y i M l )P M l ) P M k h i ) P Φ)P p) 7) k f,f2,b,b2 N [ Hc H f P y i M f )P M f ) η f l P y i M l )P M l ) P M f h i ) + H ch f P y i M f2 )P M f2 ) η f2 l P y i M l )P M l ) P M f2 h i ) 8) + H c H b P y i M b )P M b ) η b l P y i M l )P M l ) P M b h i ) + H c Hb P y i M b2 )P M b2 ) ] η b2 l P y i M l )P M l ) P M b2 h i ) P Φ)P p) 9) N [ H c H f P f + H chf P f2 + H c H b P b + H c Hb P b2 ]P Φ)P p) 20) N P x i Φ, p, y i, h i )P Φ)P p) 2) where P k P y i M k )P M k )P M k h i ) η k l P y i M l )P M l ) P y i M k )P M k h i ) l η, k f, f2, b, b2 22) lp y i M l ) P x i Φ, p, y i, h i )H c H f P f + H c Hf P f2 + H c H b P b + H c Hb P b2. 23) P y i M k ) is computed from the appearance models, i.e. color histograms. Eq. 2) contains P M k h) for four regions, but the detector only provides probabilities for two regions: foreground and background. However, 2) selects a model for each region by use of H, H f and H b respectively. We set Thus it holds: P M f h) P M f h) + P M f2 h) H f P M f h) + H f P M f h) 24) P M b h) P M b h) + P M b2 h) H b P M b h) + H b P M b h). 25) Either P M f h) P M f h) or P M f h) P M f2 h) and 26) either P M b h) P M b h) or P M b h) P M b2 h). 27) This means in practice P M f h) and P M f h) are both set to P M f h) background accordingly), which is possible because for each pixel one of the subregions is selected. We now specify P Φ) as the internal energy of the level set embedding functions). It contains a geometric prior that rewards a signed distance function: the gradient of the level set function is a normal distribution with mean. It thus makes the level set embedding function numerically stable without the need for periodic re-initializations [20]. The second term as in [0]) describes the length of the contour and rewards a smoother contour. This is very useful for cluttered scenes, where pixels with foreground or background appearance can form very small regions, which can easily result in a very uneven contour. N [ P Φ) σ 2π exp Φx i) ) 2 ) )] 2σ 2 exp λ H ɛ Φ) 28)
4 where σ and λ are the weights of the priors. Maximizing the posterior is equivalent to minimizing its negative logarithm: EΦ) logp Φ, p x, y, h)) N logp x i Φ, p, y i, h i )) Φ )2 2σ 2 A.. Derivation of the Segmentation Framework ) ) λ H ɛ Φ) + N log σ + logp p)) 2π For segmentation we optimize 29) w.r.t Φ, so the last two terms can be dropped, the rest is then differentiated by calculus of variation: Φ c EΦ c) δh f P f + δh f P f2 δh b P b δ H b P b2 )] [ 2 Φc t Φ c P x Φ, p, y, h) σ 2 Φ c ) div 30) Φ c ) Φc +λδ ɛ Φ c )div Φ f t Φ b t EΦ f ) Φ f EΦ b) Φ b Φ c H cδ f P f H c δ f P f2 + H c H b P b + H c Hb P b2 P x Φ, p, y, h) ) Φf +λδ ɛ Φ f )div Φ f :H >0)! δ f P f P f2 ) P x Φ, p, y, h) σ 2 accordingly. )] [ 2 Φf σ 2 Φ f ) div [ )] ) 2 Φf Φf Φ f ) div + λδ ɛ Φ f )div We evolve the two additional level set functions interleaved with the original level set function Φ c. In this way, the four appearance models are optimized at the same time, which leads to more robust and accurate segmentation results. In our implementation we use σ 2 50, λ 2, τ 2, ɛ 6 and 0 if x < ɛ x H ɛ x) 2ɛ + 2π sin ) πx ɛ + 2 if x < ɛ 33) if x > ɛ A.2. Derivation of the Tracking Framework δ ɛ x) 2ɛ + cos πx )) ɛ if x < ɛ 0 else In preparation for differentiation w.r.t p some terms in 29) can be dropped: 29) 3) 32) 34) N ) EΦ) logp x i Φ, p, y i, h i )) + logp p)) + const. 35) Now the warp Wx i, p) is introduced into 35), i.e. pixels x i are warped with parameters p. P p) is dropped for the moment, this is handled with drift correction, as in [3]: EΦ) N log P Wx i, p) Φ, p, y i, h i ) 36) We maximize w.r.t p: p arg max p N log P Wx i, p) Φ, p, y i, h i ) 37)
5 We use a second order Newton optimization scheme as in [4]: With the short-hand notation P...) P Wx i, p) Φ, p, y i, h i ): where with [ N p P...) P...) ) 2 ] N P...) P...) J ch f + H c J f )P f + J chf H c J f )P f2 J c H b P b J c Hb P b2 J c H f P f + H f P f2 H b P b H b P b2 ) + J f H c P f H c P f2 ) 39) J c H c Φ c W Φ c x J f H f Φ f Φ f x 38) p δ ɛφ c x i )) Φ c x i ) W p, 40) W p δ ɛφ f x i )) Φ f x i ) W p 4) We assume that the background does not move with the foreground, thus H ɛ Φ b x i )) is constant w.r.t the derivation. Eq. 39) illustrates that both the person s contour and the division line of the foreground contribute to the warp, whereas the division line of the background does not contribute: J c and J f contain the factor δ ɛ Φ k ), the Dirac delta function of the respective level set function, which is only greater than zero in a narrow band around the contour with width ɛ). For parameters p s, t x, t y ) T with scale and translation the warp is: ) x ) + s 0 tx Wx; p) y + s) x + tx 42) 0 + s t y + s) y + t y The term W is the Jacobian of the warp and with Wx; p) W xx; p), W y x; p)) T : W x ) 0 y 0 43) In our implementation the rigid registration typically converges after 0 to 40 iterations. References [3] C. Bibby and I. Reid. Robust Real-Time Visual Tracking using Pixel-Wise Posteriors. ECCV, [4] C. Bibby and I. Reid. Real-time Tracking of Multiple Occluding Objects using Level Sets. CVPR, 200. [0] D. Cremers, M. Rousson, and R. Deriche. A Review of Statistical Approaches to Level Set Segmentation Integrating Color, Texture, Motion and Shape. IJCV, 72:95-25, [20] C. Li, C. Xu, C. Gui, and M. Fox. Level Set Evolution without Re-initialization: A New Variational Formulation. CVPR, [26] H. Sidenbladh and M. J. Black. Learning the statistics of people in images and video. IJCV, 54-3):83-209, [27] E. Horbert, K. Rematas and B. Leibe. Level-Set Person Segmentation and Tracking with Multi-Region Appearance Models and Top-Down Shape Information. ICCV, 20.
Human Pose Tracking I: Basics. David Fleet University of Toronto
Human Pose Tracking I: Basics David Fleet University of Toronto CIFAR Summer School, 2009 Looking at People Challenges: Complex pose / motion People have many degrees of freedom, comprising an articulated
More informationCSC487/2503: Foundations of Computer Vision. Visual Tracking. David Fleet
CSC487/2503: Foundations of Computer Vision Visual Tracking David Fleet Introduction What is tracking? Major players: Dynamics (model of temporal variation of target parameters) Measurements (relation
More informationKillingFusion: Non-rigid 3D Reconstruction without Correspondences. Supplementary Material
KillingFusion: Non-rigid 3D Reconstruction without Correspondences Supplementary Material Miroslava Slavcheva 1, Maximilian Baust 1 Daniel Cremers 1 Slobodan Ilic 1, {mira.slavcheva,maximilian.baust,cremers}@tum.de,
More informationMotion Estimation (I) Ce Liu Microsoft Research New England
Motion Estimation (I) Ce Liu celiu@microsoft.com Microsoft Research New England We live in a moving world Perceiving, understanding and predicting motion is an important part of our daily lives Motion
More informationMotion Estimation (I)
Motion Estimation (I) Ce Liu celiu@microsoft.com Microsoft Research New England We live in a moving world Perceiving, understanding and predicting motion is an important part of our daily lives Motion
More informationModulation-Feature based Textured Image Segmentation Using Curve Evolution
Modulation-Feature based Textured Image Segmentation Using Curve Evolution Iasonas Kokkinos, Giorgos Evangelopoulos and Petros Maragos Computer Vision, Speech Communication and Signal Processing Group
More informationRiemannian Metric Learning for Symmetric Positive Definite Matrices
CMSC 88J: Linear Subspaces and Manifolds for Computer Vision and Machine Learning Riemannian Metric Learning for Symmetric Positive Definite Matrices Raviteja Vemulapalli Guide: Professor David W. Jacobs
More informationINTEREST POINTS AT DIFFERENT SCALES
INTEREST POINTS AT DIFFERENT SCALES Thank you for the slides. They come mostly from the following sources. Dan Huttenlocher Cornell U David Lowe U. of British Columbia Martial Hebert CMU Intuitively, junctions
More informationActive Contours Snakes and Level Set Method
Active Contours Snakes and Level Set Method Niels Chr. Overgaard 2010-09-21 N. Chr. Overgaard Lecture 7 2010-09-21 1 / 26 Outline What is an mage? What is an Active Contour? Deforming Force: The Edge Map
More informationClustering with k-means and Gaussian mixture distributions
Clustering with k-means and Gaussian mixture distributions Machine Learning and Category Representation 2012-2013 Jakob Verbeek, ovember 23, 2012 Course website: http://lear.inrialpes.fr/~verbeek/mlcr.12.13
More informationA Closed-Form Solution for Image Sequence Segmentation with Dynamical Shape Priors
A Closed-Form Solution for Image Sequence Segmentation with Dynamical Shape Priors Frank R. Schmidt and Daniel Cremers Computer Science Department University of Bonn, Germany Abstract. In this paper, we
More informationLecture 8: Interest Point Detection. Saad J Bedros
#1 Lecture 8: Interest Point Detection Saad J Bedros sbedros@umn.edu Last Lecture : Edge Detection Preprocessing of image is desired to eliminate or at least minimize noise effects There is always tradeoff
More informationSegmenting Images on the Tensor Manifold
Segmenting Images on the Tensor Manifold Yogesh Rathi, Allen Tannenbaum Georgia Institute of Technology, Atlanta, GA yogesh.rathi@gatech.edu, tannenba@ece.gatech.edu Oleg Michailovich University of Waterloo,
More informationIntroduction to motion correspondence
Introduction to motion correspondence 1 IPAM - UCLA July 24, 2013 Iasonas Kokkinos Center for Visual Computing Ecole Centrale Paris / INRIA Saclay Why estimate visual motion? 2 Tracking Segmentation Structure
More informationAnalysis of Numerical Methods for Level Set Based Image Segmentation
Analysis of Numerical Methods for Level Set Based Image Segmentation Björn Scheuermann and Bodo Rosenhahn Institut für Informationsverarbeitung Leibnitz Universität Hannover {scheuerm,rosenhahn}@tnt.uni-hannover.de
More informationIterative Image Registration: Lucas & Kanade Revisited. Kentaro Toyama Vision Technology Group Microsoft Research
Iterative Image Registration: Lucas & Kanade Revisited Kentaro Toyama Vision Technology Group Microsoft Research Every writer creates his own precursors. His work modifies our conception of the past, as
More informationCorners, Blobs & Descriptors. With slides from S. Lazebnik & S. Seitz, D. Lowe, A. Efros
Corners, Blobs & Descriptors With slides from S. Lazebnik & S. Seitz, D. Lowe, A. Efros Motivation: Build a Panorama M. Brown and D. G. Lowe. Recognising Panoramas. ICCV 2003 How do we build panorama?
More informationIntroduction to Gaussian Processes
Introduction to Gaussian Processes Raquel Urtasun TTI Chicago August 2, 2013 R. Urtasun (TTIC) Gaussian Processes August 2, 2013 1 / 59 Motivation for Non-Linear Dimensionality Reduction USPS Data Set
More informationVisual Tracking via Geometric Particle Filtering on the Affine Group with Optimal Importance Functions
Monday, June 22 Visual Tracking via Geometric Particle Filtering on the Affine Group with Optimal Importance Functions Junghyun Kwon 1, Kyoung Mu Lee 1, and Frank C. Park 2 1 Department of EECS, 2 School
More informationLecture 8: Interest Point Detection. Saad J Bedros
#1 Lecture 8: Interest Point Detection Saad J Bedros sbedros@umn.edu Review of Edge Detectors #2 Today s Lecture Interest Points Detection What do we mean with Interest Point Detection in an Image Goal:
More informationA Pseudo-distance for Shape Priors in Level Set Segmentation
O. Faugeras, N. Paragios (Eds.), 2nd IEEE Workshop on Variational, Geometric and Level Set Methods in Computer Vision, Nice, 2003. A Pseudo-distance for Shape Priors in Level Set Segmentation Daniel Cremers
More informationTracking. Readings: Chapter 17 of Forsyth and Ponce. Matlab Tutorials: motiontutorial.m, trackingtutorial.m
Goal: Tracking Fundamentals of model-based tracking with emphasis on probabilistic formulations. Eamples include the Kalman filter for linear-gaussian problems, and maimum likelihood and particle filters
More informationSpatial Transformation
Spatial Transformation Presented by Liqun Chen June 30, 2017 1 Overview 2 Spatial Transformer Networks 3 STN experiments 4 Recurrent Models of Visual Attention (RAM) 5 Recurrent Models of Visual Attention
More informationTracking. Readings: Chapter 17 of Forsyth and Ponce. Matlab Tutorials: motiontutorial.m. 2503: Tracking c D.J. Fleet & A.D. Jepson, 2009 Page: 1
Goal: Tracking Fundamentals of model-based tracking with emphasis on probabilistic formulations. Examples include the Kalman filter for linear-gaussian problems, and maximum likelihood and particle filters
More informationA Background Layer Model for Object Tracking through Occlusion
A Background Layer Model for Object Tracking through Occlusion Yue Zhou and Hai Tao UC-Santa Cruz Presented by: Mei-Fang Huang CSE252C class, November 6, 2003 Overview Object tracking problems Dynamic
More informationIntroduction to Nonlinear Image Processing
Introduction to Nonlinear Image Processing 1 IPAM Summer School on Computer Vision July 22, 2013 Iasonas Kokkinos Center for Visual Computing Ecole Centrale Paris / INRIA Saclay Mean and median 2 Observations
More informationTracking Human Heads Based on Interaction between Hypotheses with Certainty
Proc. of The 13th Scandinavian Conference on Image Analysis (SCIA2003), (J. Bigun and T. Gustavsson eds.: Image Analysis, LNCS Vol. 2749, Springer), pp. 617 624, 2003. Tracking Human Heads Based on Interaction
More informationN-mode Analysis (Tensor Framework) Behrouz Saghafi
N-mode Analysis (Tensor Framework) Behrouz Saghafi N-mode Analysis (Tensor Framework) Drawback of 1-mode analysis (e.g. PCA): Captures the variance among just a single factor Our training set contains
More informationAdvances in Computer Vision. Prof. Bill Freeman. Image and shape descriptors. Readings: Mikolajczyk and Schmid; Belongie et al.
6.869 Advances in Computer Vision Prof. Bill Freeman March 3, 2005 Image and shape descriptors Affine invariant features Comparison of feature descriptors Shape context Readings: Mikolajczyk and Schmid;
More informationMotion estimation. Digital Visual Effects Yung-Yu Chuang. with slides by Michael Black and P. Anandan
Motion estimation Digital Visual Effects Yung-Yu Chuang with slides b Michael Black and P. Anandan Motion estimation Parametric motion image alignment Tracking Optical flow Parametric motion direct method
More informationAchieving scale covariance
Achieving scale covariance Goal: independently detect corresponding regions in scaled versions of the same image Need scale selection mechanism for finding characteristic region size that is covariant
More informationTRACKING and DETECTION in COMPUTER VISION
Technischen Universität München Winter Semester 2013/2014 TRACKING and DETECTION in COMPUTER VISION Template tracking methods Slobodan Ilić Template based-tracking Energy-based methods The Lucas-Kanade(LK)
More informationJoint Optimization of Segmentation and Appearance Models
Joint Optimization of Segmentation and Appearance Models David Mandle, Sameep Tandon April 29, 2013 David Mandle, Sameep Tandon (Stanford) April 29, 2013 1 / 19 Overview 1 Recap: Image Segmentation 2 Optimization
More informationLoG Blob Finding and Scale. Scale Selection. Blobs (and scale selection) Achieving scale covariance. Blob detection in 2D. Blob detection in 2D
Achieving scale covariance Blobs (and scale selection) Goal: independently detect corresponding regions in scaled versions of the same image Need scale selection mechanism for finding characteristic region
More informationCS 231A Section 1: Linear Algebra & Probability Review
CS 231A Section 1: Linear Algebra & Probability Review 1 Topics Support Vector Machines Boosting Viola-Jones face detector Linear Algebra Review Notation Operations & Properties Matrix Calculus Probability
More informationCS 231A Section 1: Linear Algebra & Probability Review. Kevin Tang
CS 231A Section 1: Linear Algebra & Probability Review Kevin Tang Kevin Tang Section 1-1 9/30/2011 Topics Support Vector Machines Boosting Viola Jones face detector Linear Algebra Review Notation Operations
More informationDeformation and Viewpoint Invariant Color Histograms
1 Deformation and Viewpoint Invariant Histograms Justin Domke and Yiannis Aloimonos Computer Vision Laboratory, Department of Computer Science University of Maryland College Park, MD 274, USA domke@cs.umd.edu,
More informationShape Outlier Detection Using Pose Preserving Dynamic Shape Models
Shape Outlier Detection Using Pose Preserving Dynamic Shape Models Chan-Su Lee and Ahmed Elgammal Rutgers, The State University of New Jersey Department of Computer Science Outline Introduction Shape Outlier
More informationSingle-Image-Based Rain and Snow Removal Using Multi-guided Filter
Single-Image-Based Rain and Snow Removal Using Multi-guided Filter Xianhui Zheng 1, Yinghao Liao 1,,WeiGuo 2, Xueyang Fu 2, and Xinghao Ding 2 1 Department of Electronic Engineering, Xiamen University,
More informationMachine Learning Lecture 3
Announcements Machine Learning Lecture 3 Eam dates We re in the process of fiing the first eam date Probability Density Estimation II 9.0.207 Eercises The first eercise sheet is available on L2P now First
More informationLecture 7: Finding Features (part 2/2)
Lecture 7: Finding Features (part 2/2) Dr. Juan Carlos Niebles Stanford AI Lab Professor Fei- Fei Li Stanford Vision Lab 1 What we will learn today? Local invariant features MoPvaPon Requirements, invariances
More informationFisher Vector image representation
Fisher Vector image representation Machine Learning and Category Representation 2014-2015 Jakob Verbeek, January 9, 2015 Course website: http://lear.inrialpes.fr/~verbeek/mlcr.14.15 A brief recap on kernel
More informationSimultaneous Segmentation and Object Behavior Classification of Image Sequences
Simultaneous Segmentation and Object Behavior Classification of Image Sequences Laura Gui 1, Jean-Philippe Thiran 1 and Nikos Paragios 1 Signal Processing Institute (ITS), Ecole Polytechnique Fédérale
More informationBayesian Linear Regression. Sargur Srihari
Bayesian Linear Regression Sargur srihari@cedar.buffalo.edu Topics in Bayesian Regression Recall Max Likelihood Linear Regression Parameter Distribution Predictive Distribution Equivalent Kernel 2 Linear
More informationUncertainty Models in Quasiconvex Optimization for Geometric Reconstruction
Uncertainty Models in Quasiconvex Optimization for Geometric Reconstruction Qifa Ke and Takeo Kanade Department of Computer Science, Carnegie Mellon University Email: ke@cmu.edu, tk@cs.cmu.edu Abstract
More informationDigital Matting. Outline. Introduction to Digital Matting. Introduction to Digital Matting. Compositing equation: C = α * F + (1- α) * B
Digital Matting Outline. Introduction to Digital Matting. Bayesian Matting 3. Poisson Matting 4. A Closed Form Solution to Matting Presenting: Alon Gamliel,, Tel-Aviv University, May 006 Introduction to
More informationA Short Essay on Variational Calculus
A Short Essay on Variational Calculus Keonwook Kang, Chris Weinberger and Wei Cai Department of Mechanical Engineering, Stanford University Stanford, CA 94305-4040 May 3, 2006 Contents 1 Definition of
More informationIntroduction to Machine Learning
Introduction to Machine Learning Linear Regression Varun Chandola Computer Science & Engineering State University of New York at Buffalo Buffalo, NY, USA chandola@buffalo.edu Chandola@UB CSE 474/574 1
More informationSpatial Bayesian Nonparametrics for Natural Image Segmentation
Spatial Bayesian Nonparametrics for Natural Image Segmentation Erik Sudderth Brown University Joint work with Michael Jordan University of California Soumya Ghosh Brown University Parsing Visual Scenes
More informationStatistical Filters for Crowd Image Analysis
Statistical Filters for Crowd Image Analysis Ákos Utasi, Ákos Kiss and Tamás Szirányi Distributed Events Analysis Research Group, Computer and Automation Research Institute H-1111 Budapest, Kende utca
More informationA Generative Perspective on MRFs in Low-Level Vision Supplemental Material
A Generative Perspective on MRFs in Low-Level Vision Supplemental Material Uwe Schmidt Qi Gao Stefan Roth Department of Computer Science, TU Darmstadt 1. Derivations 1.1. Sampling the Prior We first rewrite
More informationComputer Vision Group Prof. Daniel Cremers. 6. Mixture Models and Expectation-Maximization
Prof. Daniel Cremers 6. Mixture Models and Expectation-Maximization Motivation Often the introduction of latent (unobserved) random variables into a model can help to express complex (marginal) distributions
More informationBlobs & Scale Invariance
Blobs & Scale Invariance Prof. Didier Stricker Doz. Gabriele Bleser Computer Vision: Object and People Tracking With slides from Bebis, S. Lazebnik & S. Seitz, D. Lowe, A. Efros 1 Apertizer: some videos
More informationTotal Variation Blind Deconvolution: The Devil is in the Details Technical Report
Total Variation Blind Deconvolution: The Devil is in the Details Technical Report Daniele Perrone University of Bern Bern, Switzerland perrone@iam.unibe.ch Paolo Favaro University of Bern Bern, Switzerland
More informationMalliavin Calculus in Finance
Malliavin Calculus in Finance Peter K. Friz 1 Greeks and the logarithmic derivative trick Model an underlying assent by a Markov process with values in R m with dynamics described by the SDE dx t = b(x
More informationCSE 473/573 Computer Vision and Image Processing (CVIP)
CSE 473/573 Computer Vision and Image Processing (CVIP) Ifeoma Nwogu inwogu@buffalo.edu Lecture 11 Local Features 1 Schedule Last class We started local features Today More on local features Readings for
More informationAbnormal Activity Detection and Tracking Namrata Vaswani Dept. of Electrical and Computer Engineering Iowa State University
Abnormal Activity Detection and Tracking Namrata Vaswani Dept. of Electrical and Computer Engineering Iowa State University Abnormal Activity Detection and Tracking 1 The Problem Goal: To track activities
More informationTwo Simple Nonlinear Edge Detectors
Two Simple Nonlinear Edge Detectors Mladen Victor Wickerhauser Washington University in St. Louis, Missouri victor@math.wustl.edu http://www.math.wustl.edu/~victor International Conference on Wavelet Analysis
More informationPoint Distribution Models
Point Distribution Models Jan Kybic winter semester 2007 Point distribution models (Cootes et al., 1992) Shape description techniques A family of shapes = mean + eigenvectors (eigenshapes) Shapes described
More informationCS5670: Computer Vision
CS5670: Computer Vision Noah Snavely Lecture 5: Feature descriptors and matching Szeliski: 4.1 Reading Announcements Project 1 Artifacts due tomorrow, Friday 2/17, at 11:59pm Project 2 will be released
More informationGeneralized Newton-Type Method for Energy Formulations in Image Processing
Generalized Newton-Type Method for Energy Formulations in Image Processing Leah Bar and Guillermo Sapiro Department of Electrical and Computer Engineering University of Minnesota Outline Optimization in
More informationEdges and Scale. Image Features. Detecting edges. Origin of Edges. Solution: smooth first. Effects of noise
Edges and Scale Image Features From Sandlot Science Slides revised from S. Seitz, R. Szeliski, S. Lazebnik, etc. Origin of Edges surface normal discontinuity depth discontinuity surface color discontinuity
More informationA Flexible Framework for Local Phase Coherence Computation
A Flexible Framework for Local Phase Coherence Computation Rania Hassen, Zhou Wang, and Magdy Salama Department of Electrical and Computer Engineering, University of Waterloo, 200 University Avenue West,
More informationA Generative Model Based Approach to Motion Segmentation
A Generative Model Based Approach to Motion Segmentation Daniel Cremers 1 and Alan Yuille 2 1 Department of Computer Science University of California at Los Angeles 2 Department of Statistics and Psychology
More informationLesson 04. KAZE, Non-linear diffusion filtering, ORB, MSER. Ing. Marek Hrúz, Ph.D.
Lesson 04 KAZE, Non-linear diffusion filtering, ORB, MSER Ing. Marek Hrúz, Ph.D. Katedra Kybernetiky Fakulta aplikovaných věd Západočeská univerzita v Plzni Lesson 04 KAZE ORB: an efficient alternative
More informationPushmeet Kohli Microsoft Research
Pushmeet Kohli Microsoft Research E(x) x in {0,1} n Image (D) [Boykov and Jolly 01] [Blake et al. 04] E(x) = c i x i Pixel Colour x in {0,1} n Unary Cost (c i ) Dark (Bg) Bright (Fg) x* = arg min E(x)
More informationMachine Learning Lecture 5
Machine Learning Lecture 5 Linear Discriminant Functions 26.10.2017 Bastian Leibe RWTH Aachen http://www.vision.rwth-aachen.de leibe@vision.rwth-aachen.de Course Outline Fundamentals Bayes Decision Theory
More informationRESTORATION OF VIDEO BY REMOVING RAIN
RESTORATION OF VIDEO BY REMOVING RAIN Sajitha Krishnan 1 and D.Venkataraman 1 1 Computer Vision and Image Processing, Department of Computer Science, Amrita Vishwa Vidyapeetham University, Coimbatore,
More informationMean-Shift Tracker Computer Vision (Kris Kitani) Carnegie Mellon University
Mean-Shift Tracker 16-385 Computer Vision (Kris Kitani) Carnegie Mellon University Mean Shift Algorithm A mode seeking algorithm Fukunaga & Hostetler (1975) Mean Shift Algorithm A mode seeking algorithm
More informationUnsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models
SUBMISSION TO IEEE TRANS. ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 1 Unsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models Xiaogang Wang, Xiaoxu Ma,
More informationSocial Saliency Prediction. Hyun Soo Park and Jianbo Shi
Social Saliency Prediction Hyun Soo Park and Jianbo Shi Nonverbal social signals 67% Hogan and Stubbs, Can t Get Through 8 Barriers to Communication, 2003. Vinciarelli et al., Social Signal Processing:
More informationUnsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models
SUBMISSION TO IEEE TRANS. ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 1 Unsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models Xiaogang Wang, Xiaoxu Ma,
More informationOptical Flow, Motion Segmentation, Feature Tracking
BIL 719 - Computer Vision May 21, 2014 Optical Flow, Motion Segmentation, Feature Tracking Aykut Erdem Dept. of Computer Engineering Hacettepe University Motion Optical Flow Motion Segmentation Feature
More informationSTA 4273H: Statistical Machine Learning
STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.utstat.utoronto.ca/~rsalakhu/ Sidney Smith Hall, Room 6002 Lecture 3 Linear
More informationPhysics 403. Segev BenZvi. Numerical Methods, Maximum Likelihood, and Least Squares. Department of Physics and Astronomy University of Rochester
Physics 403 Numerical Methods, Maximum Likelihood, and Least Squares Segev BenZvi Department of Physics and Astronomy University of Rochester Table of Contents 1 Review of Last Class Quadratic Approximation
More informationOutline Introduction Edge Detection A t c i ti ve C Contours
Edge Detection and Active Contours Elsa Angelini Department TSI, Telecom ParisTech elsa.angelini@telecom-paristech.fr 2008 Outline Introduction Edge Detection Active Contours Introduction The segmentation
More informationOptical flow. Subhransu Maji. CMPSCI 670: Computer Vision. October 20, 2016
Optical flow Subhransu Maji CMPSC 670: Computer Vision October 20, 2016 Visual motion Man slides adapted from S. Seitz, R. Szeliski, M. Pollefes CMPSC 670 2 Motion and perceptual organization Sometimes,
More informationEdge Detection. CS 650: Computer Vision
CS 650: Computer Vision Edges and Gradients Edge: local indication of an object transition Edge detection: local operators that find edges (usually involves convolution) Local intensity transitions are
More informationKernel Density Topic Models: Visual Topics Without Visual Words
Kernel Density Topic Models: Visual Topics Without Visual Words Konstantinos Rematas K.U. Leuven ESAT-iMinds krematas@esat.kuleuven.be Mario Fritz Max Planck Institute for Informatics mfrtiz@mpi-inf.mpg.de
More information2D Image Processing (Extended) Kalman and particle filter
2D Image Processing (Extended) Kalman and particle filter Prof. Didier Stricker Dr. Gabriele Bleser Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz
More informationDirectional Derivatives and Gradient Vectors. Suppose we want to find the rate of change of a function z = f x, y at the point in the
14.6 Directional Derivatives and Gradient Vectors 1. Partial Derivates are nice, but they only tell us the rate of change of a function z = f x, y in the i and j direction. What if we are interested in
More informationClustering with k-means and Gaussian mixture distributions
Clustering with k-means and Gaussian mixture distributions Machine Learning and Category Representation 2014-2015 Jakob Verbeek, ovember 21, 2014 Course website: http://lear.inrialpes.fr/~verbeek/mlcr.14.15
More informationOutline: Ensemble Learning. Ensemble Learning. The Wisdom of Crowds. The Wisdom of Crowds - Really? Crowd wiser than any individual
Outline: Ensemble Learning We will describe and investigate algorithms to Ensemble Learning Lecture 10, DD2431 Machine Learning A. Maki, J. Sullivan October 2014 train weak classifiers/regressors and how
More informationWhen taking a picture, what color is a (Lambertian) surface?
Shadow removal When taking a picture, what color is a (Lambertian) surface? What if it s not a cloudy day? Region lit by skylight only Region lit by sunlight and skylight What great things could we do
More informationA Tutorial on Active Contours
Elham Sakhaee March 4, 14 1 Introduction I prepared this technical report as part of my preparation for Computer Vision PhD qualifying exam. Here we discuss derivation of curve evolution function for some
More informationSimultaneous Multi-frame MAP Super-Resolution Video Enhancement using Spatio-temporal Priors
Simultaneous Multi-frame MAP Super-Resolution Video Enhancement using Spatio-temporal Priors Sean Borman and Robert L. Stevenson Department of Electrical Engineering, University of Notre Dame Notre Dame,
More informationDegeneracies, Dependencies and their Implications in Multi-body and Multi-Sequence Factorizations
Degeneracies, Dependencies and their Implications in Multi-body and Multi-Sequence Factorizations Lihi Zelnik-Manor Michal Irani Dept. of Computer Science and Applied Math The Weizmann Institute of Science
More informationMarkov Random Fields
Markov Random Fields Umamahesh Srinivas ipal Group Meeting February 25, 2011 Outline 1 Basic graph-theoretic concepts 2 Markov chain 3 Markov random field (MRF) 4 Gauss-Markov random field (GMRF), and
More informationFeature detectors and descriptors. Fei-Fei Li
Feature detectors and descriptors Fei-Fei Li Feature Detection e.g. DoG detected points (~300) coordinates, neighbourhoods Feature Description e.g. SIFT local descriptors (invariant) vectors database of
More informationOutline Lecture 2 2(32)
Outline Lecture (3), Lecture Linear Regression and Classification it is our firm belief that an understanding of linear models is essential for understanding nonlinear ones Thomas Schön Division of Automatic
More informationLoss Functions and Optimization. Lecture 3-1
Lecture 3: Loss Functions and Optimization Lecture 3-1 Administrative Assignment 1 is released: http://cs231n.github.io/assignments2017/assignment1/ Due Thursday April 20, 11:59pm on Canvas (Extending
More informationLecture 6: CS395T Numerical Optimization for Graphics and AI Line Search Applications
Lecture 6: CS395T Numerical Optimization for Graphics and AI Line Search Applications Qixing Huang The University of Texas at Austin huangqx@cs.utexas.edu 1 Disclaimer This note is adapted from Section
More informationMachine Learning. Classification, Discriminative learning. Marc Toussaint University of Stuttgart Summer 2015
Machine Learning Classification, Discriminative learning Structured output, structured input, discriminative function, joint input-output features, Likelihood Maximization, Logistic regression, binary
More informationSupplementary Material for Superpixel Sampling Networks
Supplementary Material for Superpixel Sampling Networks Varun Jampani 1, Deqing Sun 1, Ming-Yu Liu 1, Ming-Hsuan Yang 1,2, Jan Kautz 1 1 NVIDIA 2 UC Merced {vjampani,deqings,mingyul,jkautz}@nvidia.com,
More informationMarkov Random Field driven Region-Based Active Contour Model (MaRACel): Application to Medical Image Segmentation
Markov Random Field driven Region-Based Active Contour Model (MaRACel): Application to Medical Image Segmentation Jun Xu, James P. Monaco, and Anant Madabhushi Department of Biomedical Engineering, Rutgers
More informationGaussian discriminant analysis Naive Bayes
DM825 Introduction to Machine Learning Lecture 7 Gaussian discriminant analysis Marco Chiarandini Department of Mathematics & Computer Science University of Southern Denmark Outline 1. is 2. Multi-variate
More informationInvariant local features. Invariant Local Features. Classes of transformations. (Good) invariant local features. Case study: panorama stitching
Invariant local eatures Invariant Local Features Tuesday, February 6 Subset o local eature types designed to be invariant to Scale Translation Rotation Aine transormations Illumination 1) Detect distinctive
More informationWeighted Minimal Surfaces and Discrete Weighted Minimal Surfaces
Weighted Minimal Surfaces and Discrete Weighted Minimal Surfaces Qin Zhang a,b, Guoliang Xu a, a LSEC, Institute of Computational Mathematics, Academy of Mathematics and System Science, Chinese Academy
More information