Edge Detection and Active Contours Elsa Angelini Department TSI, Telecom ParisTech elsa.angelini@telecom-paristech.fr 2008
Outline Introduction Edge Detection Active Contours
Introduction The segmentation Problem Edges Regions Textures es Segmentation Measures Shape Recognition Structural Scene Analysis
What is a contour? Introduction
Introduction Contours profiles Staircase Ramp Roof
Introduction The segmentation problem: Partition an image into objects: 2 approaches: Region-based Contour-based Edge Detection: Detection of «abrupt changes» in image gradient. Analysis of first and second derivatives of image gradients.
Outline Introduction Edge Detection Active Contours
Edge Detection Gradient-based Edge 1st derivative 2nd derivative Edges: location of gradient maxima, in the direction of the gradient.
Edge Detection Gradient-based Image I( x, y) with a continuous representation: (, ) I xy x G= I (, x y ) = I ( xy, ) y (, ) I( x, y) 2 2 I x y G= I(, x y) = + x y
Edge Detection Gradient-based Filters Gradient Roberts Prewitt Sobel 0 0 0 0 1 0 0 1 0 0 0 0 0 1 0 0 0 1 1 0 1 1 0 1 1 0 1 1 1 1 0 0 0 1 1 1 1 0 1 1 2 1 2 0 2 0 0 0 1 0 1 1 2 1 Oriented edges.
Edge Detection Gradient-based Dedicated Gradient Filters 1. Pre-processing: filtering (Gaussian, Median). 2. Segmentation via thresholding or local maxima detection. 3. Post-processing: contour closing, curve fitting, smoothing.
Edge Detection Gradient-based example: Boundary Tracking Edge map Boundary tracking is very sensitive to noise Use Boundary tracking is very sensitive to noise Use of smoothing, average gradient computation, large «tracking» neighborhoods.
Edge Detection Gradient-based example: morphological post-processing www.mathworks.com
Edge Detection Gradient-based: Line Detection by Hough y Transform Algorithm: Parameter Space 1. Quantize Parameter Space ( m, c ) ( m, c) A( m, c) A( m, c) A ( m, c ) = 0 m, c 1 1 2. Create Accumulator Array 3. Set 4. For each image edge increment: If lies on the line: ( x i, yi ) A( m, c) = A( m, c) + 1 ( m, c) c = xim + y i A( m, c 5. Find local maxima in ) 1 1 1 1 2 1 1 1 1 1 1 x
Edge Detection Gradient-based: Line Detection by Hough Transform
Edge Detection Laplacian-based Edge 1st derivative 2nd derivative Zero Crossing 2 I ( xy, ) 2 I ( xy, ) Ixy (, ) = + x y 2 2
Edge Detection Laplacian-based Laplacian operator on the image: Discrete implementation with convolution kernels: 0 1 0 1 1 1 1 4 1 1 8 1 0 1 0 1 1 1 2 convolution kernels -Set of closed connected contours but Very sensitive to noise!
Edge Detection Laplacian-based: Laplacian of Gaussian (LoG) ( (, )) LoG I x y 2 2 ( I ( xy, ) Gσ ( xy, )) I( xy, ) Gσ ( xy, ) = + 2 2 x y ( ) ( Gσ ( x, y ) ) Gσ ( x, y ) I( x y) = I( x, y) +, x 2 2 ( ) y 2 2 Convolution kernel?
Edge Detection Laplacian-based: Laplacian of Gaussian (LoG) ( ) 1 1 x + y Gσ = e = e 2πσ πσ 2σ 2 2 2 2 x + y 2 2 x + y 2 2 2 σ 2 σ 1 2 4 2 Convolution kernel Band-pass Impulse response Transfer function
Edge Detection Laplacian-based Parameter σ controls the width of central peak : amount of smoothing. - Good approximation with Difference of Gaussians (DoG), with a ratio σ 2 / σ 1 = 1.6. DoG separable in x and y : efficient implementation.
Edge Detection Laplacian of a Gaussian (LoG) Gradient-based LoG
Edge Detection Analytical: CANNY: Hypothesis: 1D contours, staircase model, white Gaussian noise Edge detection via detection of local maxima of Linear Filtering. I( x) = AH( x) + n( x) ( ) ( ) ( ) O x = I x f x x dx 0 edge 0 edge ( ) = ( ) f x f x edge f edge?
Edge Detection Analytical CANNY: Performance Criteria: Good Detection Good Localization Unique Response 0 Σ= Λ= f ' edge f f edge f 2 edge ' edge f '2 edge ( ) x dx ( ) x dx ( 0) ( ) x dx 0 ( 0) fedge ( ) x dx = k ''2 2 f x dx f x dx edge ( ) ( ) edge
Edge Detection Analytical Canny: Optimization of the 3 criteria with Lagrange multipliers. b ( ) ( ' '',,, )( ) Max ΛΣ = L x fedge f edge f edge x dx a b f 2 λ f '2 λ f ''2 λ f dx a edge 1 edge 2 edge 3 edge = + + + 2f 2λ f + 2λ f + λ = 0 '' ''' 1 2 3 edge edge edge
Analytical edge CANNY Solution ( ) x sin ( ) x cos( ) x σ σ σ sin ( ) x σ = + + + cos( ) f x a e wx a e wx a e wx a e wx λ 1 2 3 4 λ 1 λ w λ 4λ 2 2 2 1 2 1 1 2 2 > 0; w = ; 4 = 2 2 2 4 σ 2λ2 σ 2λ2 FIR on [ M, M ]: ( ) ( ) ' ( ) ' ( ) f 0 = 0; f M = 0; f 0 = S; f M = 0 edge edge edge edge ΣΛ =1.12
Edge Detection Analytical Canny Post processing: Hysterisis thresholding 1. A high threshold to select true edges 2. low threshold along the direction of the gradient.
Edge Detection Analytical 1. CANNY s approximation with derivatives of Gaussian (IIR). 2 ( ) x 2 2σ f x = xe, ΛΣ= 0.92 edge 2. CANNY s approximation with IIR (DERICHE) ' ' ( ) ( ) ( ) ( ) f 0 = 0; f = 0; f 0 = S; f = 0 edge edge edge edge ( ) ( α x ) fedge x = ce wx 2α Λ = 2 α ; Σ = 2 2 α + w sin ( )
Edge Detection Analytical DERICHE
Outline Introduction Edge Detection Active Contours
Formulations: Parametric Geometric Statistics Graph-cuts Active Contours N-D Implementation Applications Conclusions and Perspectives
Active Contours Contour placed in the data space and deforming towards an optimal position and shape. Forces of Deformation: Internal forces: define intrinsic shape properties preserve shape smoothness during deformation. External forces: defined from the data. Control contour deformation according to data content (e.g: edge locations).
Active Contours Parametric contours. Geometric contours.
Parametric Active Contours Formulation of the Problem 1. Energy Minimization : Minimize the weighted sum of internal and external energies (Force potentials). Final contour position corresponds to an energy s minimum. 2. Dynamical Forces : Equilibrium between internal and external forces at each point on the contour.
Parametric Active Contours Definition of the Energy An active contour is a curve v(s) =[x(s), y(s)], where s [0, 1] ] is the arc length. s v(s) evolves towards a position minimizing the energy functional: E total = E internal (v(s)) + E external (v(s))
Parametric Active Contours E internal( (v(s))( : Goal: Obtain a smooth contour Penalize the size of the object increased energy with high h area and perimeter values. Penalize irregular contours minimize the contour curvature. Constrain the shape of the contour: circles, ellipses,... Minimization Method: optimization. Finite formulation: Exhaustive search of a minimum, global or with probabilistic algorithms. Infinite formulation: local minimum via progressive adaptation, gradient descent or other PDE solvers.
Parametric Active Contours E internal l(v(s)) : E it interne 2 1 vs ( ) α ( s ) + β ( s ) ( ) 2 2 vs = α + β 0 2 s s d s length of fthe contour Curvature of the contour tension controlled by the rigidity controlled by elasticity coefficient. rigidity coefficient. dθ dy ' ',tan θ, ds x y κ = = = + ds dx s
Parametric Active Contours E external l(v(s)) : Standard formulation: Integral of a force potential. Eexterne = 1 0 ( ) ( ) P v s ds Potential : low values on the contours in the image (e.g.: derived from image gradient) (, ) = (, ) 2 P xy w I xy (, ) = (, ) * (, ) 2 Pxy w G xy Ixy σ
Parametric Active Contours Energy Minimization Goal: find the contour v(s) that minimizes the global energy. Framework: Attract an initial contours towards contours of the image, while avoiding stretching and bending. Method 1: Variational problem formulated with the Euler-Lagrange equation: ( ) 2 2 vs ( ) vs α ( ) = s s s s 2 β Pv 0 2
Parametric Active Contours Energy Minimization Method 2: Dynamic Deformable model: Minimization viewed as a static problem. Buildadynamic system that we evolve towards an equilibrium state according to a Lagrangian mechanical point of view. This dynamical model unifies the shape and motion descriptions, defining an active contour quantification of a shape evolution through time v(s,t).
Parametric Active Contours Energy Minimization Method 2: Dynamic Deformable model: Motion equation: according to the 2 nd law of Newton, : ( ) 2 2 2 v v v vs µ γ α + β P v 2 + 2 2 + t t s s s s ( ) Equilibrium state: v t v t 2 = = 0 2
Parametric Active Contours Energy Minimization Methods 1 & 2: no analytical solution (due to external energy). Need to discretize : Finite Differences: each element of the contour is viewed as a point with individual mechanical properties. Finite Elements : sub-elements between nodes. N control points v = (v 1, v 2,..., v N ), distant with a spatial step h.
Parametric Active Contours Energy Minimization: Numerical Schemes Discretization of spatial derivatives 2 v i v i + 1 2 v i + v i 1 = 2 2 s h Matrix Notation (α, β cst): α ( ) vs ( ) vs 2 4 β Pv 2 4 ( ) = 0 s s ( ) Av= P v 4 v i v i 2 4v i 1+ 6v i 4v i + 1+ v i + 2 = 4 4 s Penta diagonal matrix 2 2 6 β 4 β β α α+ 0...... 2 2 2 h h h β β β β α + 4 2 α 6 α + 4 0... 2 2 2 2 h h h h 1 A = β β h 2 α + 4... 2 2 h h β 0... h...... h
Parametric Active Contours Energy Minimization: Numerical Schemes Problems (, ) (, ) Ax= Px x y v = ( x, y ), Ay= Py x y Internal forces Non-linear terms in the potential force. Matrix A non-invertible invertible. Need for iterative numerical schemes ( 1 1) ( 1, γ ) Ax P x y = x x Ay P x y = y y n n n n n x ( 1 1 1, ) γ ( ) n n n n n y Inertia coefficient i
Parametric Active Contours Energy Minimization: Parameters Spatial continuity spatial step smaller than pixel size. α = elasticity (i.e. dof of points to move away from each others). β = rigidity. Temporal step set to have a maximum Temporal step set to have a maximum displacement of 1-2 pixels at each iteration.
Parametric Active Contours Energy Minimization: Conclusions Advantages Extraction of a locally optimal position via iterative deformation of a curve. Suited for contour extraction: open, closed (v 0 = v N ) With fixed extremities (v 0 et v N fixed) General Framework : several different types exist. Simple an efficient 2D implementation. Numerical stability wrt internal forces.
Parametric Active Contours Energy Minimization: Conclusions Limitations Instability wrt external forces: if spatial step too big, can miss some contours. Sensitive to local minima problems and initialization. Difficult parameterization. No change in topology allowed (i.e. division/fusion of objects). No simultaneous deformation of multiple objects.
Parametric Active Contours Formulation of the Problem 1. Energy Minimization : Minimize the weighted sum of internal and external energies (Force potentials). Final contour position corresponds to an energy s minimum. 2. Dynamical Forces : Equilibrium between internal and external forces at each point on the contour.
Parametric Active Contours Formulation with Dynamical Forces Dynamical problem with more general forces than potential forces. Newton s law : 2 µ C = F C + F C + F C mass tt 2 ( ) ( ) ( ) internal external viscous C γ t
Parametric Active Contours Formulation with Dynamical Forces Simplification: no mass γ C F internal C F external C t t = + ( ) ( ) idem Superposition of forces
Parametric Active Contours F external : GRADIENT forces external : Properties of the Gradient Vectors: Point towards the contours (normals). Large modules near edges. Module around 0 in homogeneous regions. Problems: Weak attraction range (only close to edges) No force in homogeneous areas (nothing moves ). To solve : Initialization problems. Convergence towards concave regions.
Parametric Active Contours Example F external : Balloon [Cohen et Cohen] : A gradient fore to attract the contours towards edges. A pressure force to constrain the model to inflate/deflate: P ( C ) n Fexterne ( C ) = k k1n s P C ( ) +/-: inflate ( ) Computational ti cost: image gradient and normals on the contours for each node. Need to control the dynamical behavior of the contour far from the edges ( weight of k 1 ).
Parametric Active Contours Example F externe : Potential Forces for Distances Distance map D(x, y) (Euclidian or Chamfer) for each pixel to the closest point on the contour field of potential forces. D(x, y) defines the potential energy : ( ) D( (, ) 2 D xy Pdistance x, y = we D ( x, y) and the field of forces F C P x y externe = distance, ( ) ( ) Problem remaining: concave shapes
Parametric Active Contours Example of F externe : GVF [Xu et Prince 1998] Vector field. Preserve gradient properties near the edges. Diffuse these properties in homogeneous regions via «gradient diffuse».
Parametric Active Contours Example of F externe : GVF I ( x, y) GVF is a vector field : V( x, y) = [ u( x, y) v( x, y) ] Ι ( xy) edge, V x, y is defined via energy minimization: ( ) E = ( ) Regularization on the overall domain (, ) (, ) (, ) (, ) ( u 2 2 2 2 ) x xy uy xy vx xy vy xy µ + + + Ω + Ιedge ( xy, ) V ( xy, ) Ι ( xy, ) 2 2 edge Data terms Ι edge xy, = Edge map of the image I ( xy, ) dxdy
Parametric Active Contours Example of F externe : GVF The GVF vector field is obtained by solving the Euler equations : I ( ) ( ) 2 ( ) 2 edge x, y Iedge x, y Iedge x, y µ u( x y) u x y + = ( ) ( ),, 0 x x y I ( ) ( ) ( ) ( ( )) 2 2 edge x, y Iedge x, y Iedge x, y µ v x, y v( x, y) + = 0 y x y Laplace Eq. Gradient data term Gradient of the Edge map
Parametric Active Contours GVF Final result, iter = 50 GVF force Final result, iter = 50 GVF force Final result, iter = 50 GVF force
Parametric Active Contours Example of F externe : GVF Numerical implementation in m mp m the computer lab
Parametric Active Contours Example of F : Example of F externe : GVF
Parametric Active Contours Bibliography 1. Kass M, Witkin A and Terzopoulos D. Snakes: Active contour models. International Journal of Computer Vision 1987; 1-: 321-331. 2. Cohen LD and Cohen I. Finite-elements methods for active contour models and balloons for 2-D and 3-D Images. IEEE Transactions on Pattern Analysis and Machine Intelligence 1993; 15-11: 1131-1147. 3. Xu C and Prince JL. Snakes, shapes and gradient vector Flow. IEEE Transactions on Image Processing 1998: 359-369.
Active Contours Parametric contours. Geometric contours.
Geometric Active Contours Introduction Theory of curve evolution and geometrical flows. The contour deforms with a speed made of 2 terms: Regularizing term (curvature-based motion). Expansion term or contraction to go towards image edges. The active contour is defined via a geometrical flow (PDE). the curve evolution must stop at locations of image edges corresponding to the object to segment.
Geometric Active Contours Geometric Active contours Numerical methods via level sets. Geodesic. Mumford-Shah.
Geometric Active Contours Curve Evolution Theory: Curve evolution through geometric measures (normal vectors to the curve, curvature,...) and independent of curve parameterization (e.g. derivatives). Let a curve X( s, t) = [ x( s, t) y( s, t) ] with spatial parameter s and temporal parameter t The curve evolution in the normal directions controlled by the PDE: Propagation speed Geometric measure of s the curve ( ) X s, t t = V ( κ ) N N
Geometric Active Contours Curve Evolution Theory 1. Constant speed: X ( s, t ) = VN 0 t similar to a pression force (balloon). 2. Motion under curvature: X ( s, t ) = ακ N, α > 0 t similar to an elasticity force.
Geometric Active Contours Numerical Methods with Level Sets Goal: Numerical methods to compute the spatial propagation of acurveintime:add atemporal dimension. Precise characterization of the geometric properties of the contour. Approach: Γ, 0 0 = 0 f dd l φ ( ) φ ( t ) Define a spatio-temporal temporal function. Immerge the contour in a function as its 0-level (iso-contours). Extend the function to other levels. φ : + Ω Γ, = 0
Geometric Active Contours Numerical Methods with Level Sets Definition of the level set function: φ x, y, t > 0, x, y Ω ( ) ( ) i ( x, y, t) < 0, ( x, y) Ω o ( x, y, t) = 0, ( x, y ) Γ( st, ) > Ω Ω φ φ Γ ( s, t ) is defined as the 0 level of φ ( x, y, t ). Γ ( st, ) deforms with a speed applied v on each point. How to control the level l set motion? Ω o Γ Ω i ( s, t )
Geometric Active Contours Numerical Methods with Level Sets Iterative Deformation Scheme: 1. Define a field of speed vectors (cf. theory of curve evolution). 2. Compute initial values of the level set function, based on the initial position of the contour to evolve. 3. Adjust the function in time, so that the level 0 corresponds to the segmentation solution. Evolution equation for the level set function?
Geometric Active Contours Numerical Methods with Level Sets Curve evolution theory: Γ = V t ( κ ) N N ( s, t) Evolution equation of the level set function: dφ ( Γ, t) φ ( Γ, t) = cste = 0 dt ( ) φ Γ, t φ (, t ) Γ + Γ. = 0 t t Γ ( s, t )
Geometric Active Contours Numerical Methods with Level Sets Evolution equation of the level set function: φ ( Γ, t ) + V ( κ ) φ ( Γ, t) N. N = 0 ( s, t ) t Normal vector: N = φ φ ( Γ, t ) ( Γ, t ) Γ ( s, t )
Geometric Active Contours Numerical Methods with Level Sets Evolution equation of the level set function: N ( s, t) φ ( Γ, t ) + V ( κ ) φ ( Γ, t ) = 0 t φ ( Γ ) 0,0 given Γ ( s, t )
Geometric Active Contours Numerical Methods with Level Sets Geometrical properties of the level set curve: directly computed on the level set Γ ( s, t ) function! N ( s, t) φ ( Γ, t ) N = φ ( Γ, t ) ( ) 2 2 φ Γ, t φ xxφ y 2φxφ yφxy + φ yyφx κ =. = 32 2 2 φ Γ, t φ + φ ( ) ( ) x y
Geometric Active Contours Numerical Methods with Level Sets What type of φ function?: Most common choice: signed distance function N ( s, t) N = φ ( Γ, t) φ (, t ) Γ = 1 κ = φ ( Γ, t ) Γ ( s, t) Careful! φ t The solution of = V ( κ ) φ is not the signed distance function of the curve solution to: V κ N. Γ = t ( )
Geometric Active Contours Numerical Methods with Level Sets What speed of propagation? Take into account: Image Information: zero on edges from the objets to segment. Geometric Information of the contour: smoothing via constraints on the countour. Particular case: Motion under curvature Each part of the model evolves in the normal direction, with a speed proportional to the curvature. points can move inward or outward, depending on the curvature s sign.
Geometric Active Contours Numerical Methods with Level Sets Speed of propagation? ( Γ, t ) Defined only on the contour only. Extension of the speed over the whole domain : Natural Extension: e.g. with motion under curvature, computing the curvature on the overall levell set function. Values of the nearest point from the 0-level. problems since the speed does not depend on f and we are not anymore in the H-J framework. φ t + V Γ, = 0 ( κ ) φ ( t) φ ( x, y, t) t (, ) φ (,, ) = V x y φ x y t
Geometric Active Contours Numerical Methods with Level Sets Reinitialization Why reinitialize? Unique correspondence between a curve and its level set function (convergence iif convergence) Preserve a constant gradient norm numerical stability. Methods : Direct evaluation: Detect the 0-level and re-compute the signed distance function. High computational cost! Iterative: Equilibrium state: norm of gradient =1. φt = sign ( φ)( 1 φ ) Opposite flows for negative and positive values. Problem: the 0-level can move during reinitialization!
Geometric Active Contours Numerical Methods with Level Sets Narrow Band Only evolve levell sets in a narrow band around the level zero. Reduce computational cost. No need to compute evolution speed far from the 0-level. less constraints on t for the CFL stability, limiting the maximum speed of deformation.
Geometric Active Contours Level Sets Advantages Change of topology Intrinsic geometric properties easy to compute (normals, curvatures). Extension to N-D straightforward : add new spatial variables to the evolution equation of the volume φ(x, y, z,, t). Numerical implementation: Discretization of φ(x,y,t)on regular grid (x, y). Standard numerical schemes for the spatial derivative.
Geometric Active Contours Level Sets Limitations 3 limitations related to the numerical implementation: Construction of an initial level set function φ(x, y, t = 0) from an initial 0-level (initial contour). Evolution equation only defined for the 0-level the speed function V is not defined in general for the other levels arbitrary spatial extension. Instable definition of the normal to the level set function φ(x, y, t = 0) reinitialization iti + smoothing.
Geometric Active Contours Geometric Active contours Numerical methods via level sets. Geodesic. Mumford-Shah.
Geometric Active Contours Geodesic Deformable Models [Caselles, Kimmel, Sapiro 1997] Geodesic curves in a Riemannian space Geodesic: path (locally) minimal between 2 points. Space with metrics defined from geodesics. Novel approach (equivalent) Min 2 1 1 ( ( ) ) ( ) ' ( ) ( ) E C C s ds g I C s ds 1 = 0 0 ( ( ( ) ) ) ' ( ) Min g I C s C s ds 0 Geodesic computation
Geometric Active Contours Geodesic Deformable Models Euclidian Geodesics ( ) '( ) Length L E C = C s ds = ds C Motion under curvature = κ N t Euclidian Metric and curvature Motion under curvature provides fastest t minimization i i of L E. Geodesics for deformable models 1 Lenght L C = g I C s C ' s ds C t R =g I N- g.n N ( ) κ ( ) ( ) ( ) ( ) ( ) ( ) 0 LE 0 ( C) ( ( )) ( ) '( ) = g I C s C s ds Image characteristics S
Geometric Active Contours Geometric Active contours Numerical methods via level sets. Geodesic. Mumford-Shah.
Geometric Active Contours Mumford and Shah Variational method. Image I 0 segmentation, defined on the domain Ω, is provided by a pair ( CI, ) with: C contours in the image and I a smooth approximation of I 0. Energie associated with the segmentation: (, ) α βlength( ) ( ) 2 2 Ω\ C Ω\ C 0 ECI I d C I I d = Ω+ + Ω 1D, # of points on C 2D, perimeter of C 3D, surface of C
Geometric Active Contours Mumford and Shah Conjuncture There exists a minimal segmentation made of a finite set of curves C 1. [Morel-Solimini 1995, Aubert-Kornprobst 2000]: There exists a minimal segmentation. The minimal segmentation is not unique. The ensemble of solutions is a compact set. Contours are rectifiable (i.e. of finite length). All contours can be included in a single rectifiable curve.
Geometric Active Contours Mumford and Shah Particular case: I 0 is a cartoon-like image. The smooth approximation I of I 0 is a piecewise constant image with values c 1 et c 2 which are the mean values of I 0 in the object and the background. The contour C corresponds to the contours of the objects. 2 ( 1, 2, ) = υ ( ) + λ inside 1 + λ 2 ( C) outside( C) EccC Length C I c I c I = 0 2
Geometric Active Contours Mumford and Shah Deformable models without Edges [Chan, Vese, IEEE TIP 2001] 2 ( ) µ ( ) ν ( ) λ Ω λ 1 inside( C) 0 1 2 outside( C) 0 2 EC LC AC I c d I c d Ω = + + Ω+ Ω 2 Regularizing terms (cf. internal energy) Homogeneity constraints (cf. external energy) c 1 = mean value inside C c 2 = mean value outside C L(C) = length of C A(C) = area of C
Geometric Active Contours Mumford and Shah Deformable models without Edges [Chan, Vese, IEEE TIP 2001] 2 ( ) µ ( ) ν ( ) λ λ inside( C) outside ( C) EC = LC + AC + I c d Ω+ I c d Ω 1 0 1 2 0 2 2 1. Insert the n-d curve C in a level set function (n+1)-d φ { N / φ ( ) 0} { N / φ ( ) 0} { N / φ ( ) 0} C = x x = C = x x < inside C = x x > outside 2. Define a Heaviside function H(φ) H( z) 1if z 0 = 0if z 0 3. Define a Dirac function δ(φ) ( z) δ = dh ( z) dz
Geometric Active Contours Mumford and Shah Deformable models without Edges [Chan, Vese, IEEE TIP 2001] - Level set Function φ = distance to the 0- level φ - Heaviside Function H ( φ ) H ( φ ) 1 2 φ = 1 arctan 2 + π ε - Dirac Function ( ) 2 2 δ φ { (,, ) / φ (,, ) 0 } C = xyz xyz = Area C ( ) = Area ( φ 0 ) = H( φ ) dω Length ( C ) = Length ( φ = 0 ) δ ( φ ) = H( φ ) dω 1 ε = π φ + ε Ω Ω ( ) φ d = δ φ Ω Ω
Geometric Active Contours Mumford and Shah Deformable models without Edges [Chan, Vese, IEEE TIP 2001] ( ) 2 ( φ,, ) = µ δ ( φ) φ + υ ( φ) + λ ( φ) + λ 1 ( φ) E c c dx H I c H dx I c H dx ε 0 1 ε ε 0 Ω 0 0 ε 1 Ω 0 1 ε Ω Ω length area homogeneity homogeneity φ δε ( φ ) µ 2 2 ν λ ( ) λ ( ) div 0 I c0 + 1 I c1 = φ 0 δ φ I ( x, y, z) H ( φ ( x, y, z) ) dxdydz Ω ε ( ) φ = 0 on Ω, c 0 ( φ ) = φ n H ( φ ( x, y, z) ) dxdydz ( φ c c ) Segmentation via inf E,, φ, c, c 0 1 ε 0 1 c 1 ( φ) = Ω Ω ( ( )) I ( x, y, z) 1 H φ ( x, y, z) dxdydz Ω ( 1 H ( φ ( xyz,, ) ) ) dxdydz d d
Geometric Active Contours Bibliography D. Mumford and J. Shah, "Boundary detection by minimizing functional," International Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA, pp. 22-26, 1985. S. Osher and J. A. Sethian, "Fronts propagating with curvaturedependent speed: Algorithms based on Hamilton-Jacobi formulations," Journal of Computational Physics, vol. 79, No. 1, pp. 12-49, 1988. V. Caselles, F. Catté, B. Coll, F. Dibos, A geometric model for edge detection, ti Num. Mathematik, tik 66, 1-31, 1993. R.Malladi, J.A. Sethian, Baba C. Vemuri: Shape modeling with front propagation: A level set approach '. IEEE Transactions on Pattern Analysis and Machine Intelligence 17(2): 158-175, 1995. T. F. Chan and L. A. Vese, "Active contours without t edges," IEEE Transactions on Image Processing, vol. 10, No. 2, pp. 266-277, 2001.
Active Contours Two families of N-D Active Contours: Parametric : Explicit representation of the contour. Compact representation allowing fast implementation (enable real-time applications). Changes of topology very difficult to handle (in 3D). Geometric: Implicit representation of the contour as the level 0 of a scalar function of dimension (N-D+1). Contour parameterization after the deformations. Flexible adaptation ti of the contours topology. Increase dimension of space search.