Confidence and curvature estimation of curvilinear structures in 3-D

Similar documents
Estimators for Orientation and Anisotropy in Digitized Images

On the Equivariance of the Orientation and the Tensor Field Representation Klas Nordberg Hans Knutsson Gosta Granlund Computer Vision Laboratory, Depa

Seismic Fault Preserving Diffusion

A NEW PARTIAL DIFFERENTIAL EQUATION-BASED APPROACH FOR 3D DATA DENOISING AND EDGE PRESERVING

Low-level Image Processing

Notes on Cellwise Data Interpolation for Visualization Xavier Tricoche

The structure tensor in projective spaces

Lecture 8: Interest Point Detection. Saad J Bedros

Image enhancement. Why image enhancement? Why image enhancement? Why image enhancement? Example of artifacts caused by image encoding

INTEREST POINTS AT DIFFERENT SCALES

A quantative comparison of two restoration methods as applied to confocal microscopy

Edges and Scale. Image Features. Detecting edges. Origin of Edges. Solution: smooth first. Effects of noise

A2 HW Imaginary Numbers

Lecture 8: Interest Point Detection. Saad J Bedros

Carotid Lumen Segmentation Based on Tubular Anisotropy and Contours Without Edges Release 0.00

CALCULUS ON MANIFOLDS. 1. Riemannian manifolds Recall that for any smooth manifold M, dim M = n, the union T M =

Image Analysis. Feature extraction: corners and blobs

Generalizing the mean intercept length tensor for gray-level images

Inferring Galaxy Morphology Through Texture Analysis

technical article Satinder Chopra 1*, Kurt J. Marfurt 2 and Ha T. Mai 2

CS 3710: Visual Recognition Describing Images with Features. Adriana Kovashka Department of Computer Science January 8, 2015

Over-enhancement Reduction in Local Histogram Equalization using its Degrees of Freedom. Alireza Avanaki

Using Local 3D Structure for Segmentation of Bone from Computer Tomography Images

1 The Differential Geometry of Surfaces

Lectures in Discrete Differential Geometry 2 Surfaces

Sequential Filter Trees for Ecient D 3D and 4D Orientation Estimation Mats ndersson Johan Wiklund Hans Knutsson omputer Vision Laboratory Linkoping Un

CHAPTER 3. Gauss map. In this chapter we will study the Gauss map of surfaces in R 3.

Tensor fields. Tensor fields: Outline. Chantal Oberson Ausoni

Biomedical Image Analysis. Segmentation by Thresholding

SURF Features. Jacky Baltes Dept. of Computer Science University of Manitoba WWW:

EE 367 / CS 448I Computational Imaging and Display Notes: Image Deconvolution (lecture 6)

Recursive Gaussian filters

Robert W. Vestrum and R. James Brown

118 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 15, NO. 1, JANUARY Joost van de Weijer, Theo Gevers, Member, IEEE, and Arnold W.

Edge Detection. CS 650: Computer Vision

MATH 332: Vector Analysis Summer 2005 Homework

SIFT: Scale Invariant Feature Transform

CS4670: Computer Vision Kavita Bala. Lecture 7: Harris Corner Detec=on

Math 302 Outcome Statements Winter 2013

Lecture 11: Differential Geometry

Steerable Wedge Filters for Local Orientation Analysis

Signal Modeling Techniques in Speech Recognition. Hassan A. Kingravi

Time Localised Band Filtering Using Modified S-Transform

Edge Detection PSY 5018H: Math Models Hum Behavior, Prof. Paul Schrater, Spring 2005

Curvilinear coordinates

Focus was on solving matrix inversion problems Now we look at other properties of matrices Useful when A represents a transformations.

[3] (b) Find a reduced row-echelon matrix row-equivalent to ,1 2 2

Nonlinear Diffusion. 1 Introduction: Motivation for non-standard diffusion

Rigid bodies - general theory

A Riemannian Framework for Denoising Diffusion Tensor Images

Consistent Positive Directional Splitting of Anisotropic Diffusion

Chapter 5. The Second Fundamental Form

CSE 554 Lecture 7: Alignment

1 Introduction: connections and fiber bundles

Feature extraction: Corners and blobs

Coordinate Systems and Canonical Forms

Corners, Blobs & Descriptors. With slides from S. Lazebnik & S. Seitz, D. Lowe, A. Efros

FFTs in Graphics and Vision. Homogenous Polynomials and Irreducible Representations

Edge Detection. Computer Vision P. Schrater Spring 2003

Isotropic Multiresolution Analysis: Theory and Applications

A new class of shift-invariant operators

Orientation Map Based Palmprint Recognition

Lecture 13: Vector Calculus III

graphics + usability + visualization Edge Aware Anisotropic Diffusion for 3D Scalar Data on Regular Lattices Zahid Hossain MSc.

6. Orthogonality and Least-Squares

Classical differential geometry of two-dimensional surfaces

Slide a window along the input arc sequence S. Least-squares estimate. σ 2. σ Estimate 1. Statistically test the difference between θ 1 and θ 2

QUALIFYING EXAMINATION Harvard University Department of Mathematics Tuesday September 21, 2004 (Day 1)

b UVW is a right-angled triangle, therefore VW is the diameter of the circle. Centre of circle = Midpoint of VW = (8 2) + ( 2 6) = 100

Salt Dome Detection and Tracking Using Texture Analysis and Tensor-based Subspace Learning

MATHEMATICS LEARNING AREA. Methods Units 1 and 2 Course Outline. Week Content Sadler Reference Trigonometry

Discrete Simulation of Power Law Noise

Backprojection of Some Image Symmetries Based on a Local Orientation Description

MA 323 Geometric Modelling Course Notes: Day 07 Parabolic Arcs

2001 Higher Maths Non-Calculator PAPER 1 ( Non-Calc. )

Anisotropy of HARDI Diffusion Profiles Based on the L 2 -Norm

Scale Space Smoothing, Image Feature Extraction and Bessel Filters

7.6 Stress in symmetrical elastic beam transmitting both shear force and bending moment

We Prediction of Geological Characteristic Using Gaussian Mixture Model

Detectors part II Descriptors

A short review of continuum mechanics

Worksheet 1.4: Geometry of the Dot and Cross Products

DOA Estimation using MUSIC and Root MUSIC Methods

In situ stress estimation using acoustic televiewer data

2008 by authors and 2008 Springer Science+Business Media

CHAPTER -6- BENDING Part -1-

Affine Normalization of Symmetric Objects

Multimedia Databases. Previous Lecture. 4.1 Multiresolution Analysis. 4 Shape-based Features. 4.1 Multiresolution Analysis

Lecture Notes: Geometric Considerations in Unconstrained Optimization

Course Summary Math 211

MATHEMATICS 200 April 2010 Final Exam Solutions

Multimedia Databases. Wolf-Tilo Balke Philipp Wille Institut für Informationssysteme Technische Universität Braunschweig

CHAPTER THREE SYMMETRIC BENDING OF CIRCLE PLATES

W041 Faults and Fracture Detection based on Seismic Surface Orthogonal Decomposition

CS5670: Computer Vision

Triangular Plate Displacement Elements

Algorithm User Guide:

3.5 Quadratic Approximation and Convexity/Concavity

Geometric Modeling Summer Semester 2010 Mathematical Tools (1)

Discriminative Direction for Kernel Classifiers

Transcription:

Confidence and curvature estimation of curvilinear structures in 3-D P. Bakker, L.J. van Vliet, P.W. Verbeek Pattern Recognition Group, Department of Applied Physics, Delft University of Technology, Lorentzweg 1, 2628 CJ, Delft, The Netherlands, {peterb,lucas,piet}@ph.tn.tudelft.nl abstract In this paper we present a new method for estimating confidence and curvature of 3-D curvilinear structures. The gradient structure tensor (GST) models shift-invariance. The eigenstructure of the tensor allows estimation of local dimensionality, orientation, and the corresponding confidence value. Local rotational invariance, which occurs often in images, causes a lower confidence estimate. This underestimation can be corrected for by a parabolic deformation of the data, in such a way that it becomes translational invariant. We show that the optimal deformation can be found analytically and yields a local curvature estimate as a valuable by-product. We tested our new method on synthetic images and applied it to the detection of channels in 3-D seismic data. 1 Introduction Translation invariant structures in 3-D images can have three different dimensionalities. Isotrope structures (3-D) with translation invariance in all orientations, plane-like structures (2-D) with translation invariance in a plane, and line-like structures (1-D) with translation invariance along one orientation. A mathematical model for translation invariant structures is given by the structure tensor. The eigenvectors of the tensor yield a robust estimator for local orientation [1, 2, 3]. In addition, the eigenvalues contain information about the resemblance of the translation invariant model to the image. This information can be interpreted as a confidence measure for the orientation estimation. A lack of smoothness or deviation of the local structure to translation invariance leads to a decrease of the confidence measure. Curved lines occur more often in practice then straight lines. We must note that the method works on individual lines as well as on bundles of lines. We apply a local coordinate transform in such a way that the curved line becomes translation invariant, i.e. straight. The structure tensor defined on the transformed area is expressed in the original coordinates. This yields a curvature corrected confidence measure. Maximization of this confidence measure occurs for a local parabolic transformation that closest resembles the local structure. From the parameters of the optimal model we obtain an estimate of local curvature. This method was successfully applied in 2-D [4] and now extended to 3-D. We apply the curvature corrected estimates to the detection of channels in a seismic volume. The occurrence of sedimentary structures are important clues for the geological model of a region. A channel is a curvilinear sedimentary structure that is characterized by its meandering morphology. In section 2 we summarize the traditional analysis of 3- D structures using the gradient structure tensor. The theory of [4] is extended to 3-D line-like structures in section 3. Section 4 shows the results of a test of robustness of the new estimators on synthetic images and in section 5 the channel detection application is presented. 2 The Gradient Structure Tensor For a local neighborhood f(x, y, z) the Gradient Structure Tensor (GST) is given by eq.(1), derivative notation by indexes. fx 2 f x f y f x f z T GS = f x f y fy 2 f y f z (1) f x f z f y f z fz 2 Where (.) indicates some weighted local average. In [5] a closed-form analytical solution for the eigenvalues and eigenvectors of T GS is presented. Furthermore, they show that the eigenvalues can be used define local dimensionality

measures. C plane = λ 1 λ 2,C line = λ 2 λ 3 λ 1 + λ 2 λ 2 + λ 3 (2) These measures can differentiate between the following local structures. Isotrope: λ 1 λ 2 λ 3 C plane 0 C line 0 Plane-like: λ 1 λ 2 λ 3 C plane 1 C line 0 Line-like: λ 1 λ 2 λ 3 C plane 0 C line 1 The orientation of the eigenvectors can be used as a robust estimate of the local orientation. 3 The GST in parabolic coordinates for 3-D line bundles In the previous section we stated that for line-like structures the eigenvalues of the structure tensor relate as λ 1 λ 2 λ 3. For the simplest line-like structure, a straight line, C line =1. However for a slightly bend line the third eigenvalue will increase, causing a decrease of the value of C line, indicating a worser fit of the line-model. In this section we will improve this fit by incorporating curvature into the model. We use the orthonormal set of eigenvalues of T GS to define the local axes u, v, w in such way that λ 1 = f 2 u,λ 2 = f 2 v,λ 3 = f 2 w (3) w v The tangent to a line bundle is given by the third eigenvector of the GST, which we defined as the w-axis in eq.(3). For curved lines with a circle-symmetric crossw u u v The coordinate transform to straighten curved line bundles is given by u = u 1 2 κ 1w 2 v = v 1 2 κ 2w 2 w = w u = u + 1 2 κ 1w 2 v = v + 1 2 κ 2w 2 w = w (5) The derivatives of f expressed in the new straightened coordinates u,v,w, using the inverse coordinate transform from eq.(5), are given in eq.(6). f u f v = u u f u + v u f v + w u f w = f u = u v f u + v v f v + w v f w = f v f w = u w f u + v w f v + w w f w = κ 1 wf u + κ 2 wf v + f w We now consider a curved line bundle through the origin of the uvw-space with its rotation center in the uv-plane, see fig.1. Applying the traditional GST method to the u v w - space for arbitrary κ 1,κ 2, we get the parabolic gradient structure tensor (PGST) in eq.(7) (6) fu 2 f u f v f u f w T PGS = f u f v fv 2 f v f w = f u f w f v f w fw 2 fu 2 0 0 0 fv 2 0 (7) 0 0 Q + fw 2 K with the abbreviations Q (κ 1 κ 10 ) 2 a +(κ 1 κ 10 )(κ 2 κ 20 )b +(κ 2 κ 20 ) 2 c be 2cd κ 10 4ac b 2 bd 2ae κ 20 4ac b 2 K aκ 2 10 + bκ 10 κ 20 + cκ 2 20 a w 2 f 2 u,b 2w2 f u f v,c w 2 f 2 v Figure 1: The transform to parabolic coordinates u v w straightens circular bended line bundles section (spaghetti) the bend-plane is the vw-plane. This is not the case for less symmetrical cross-sections. Therefore the curve has two degrees of freedom (κ 1,κ 2 ), which are the curvatures in resp. the uw-plane and the vw-plane. The total curvature κ along the line is thus κ = κ 2 1 + κ2 2 (4) d 2wf u f w,e 2wf v f w Due to the symmetry f(u, v, w) =f(u, v, w), we get f u f w = κ 1 wf 2 u + κ 2wf u f v + f u f w =0 f v f w = κ 1 wf u f v + κ 2 wf 2 v + f vf w =0 f u f v = f u f v =0 The last equation requires mirror symmetry with respect to some axis in the uv-plane. The eigenvalues of T PGS are λ 1 = fu 2,λ 2 = fv 2,λ 3 = Q + fw 2 K. (8) 2

We see that the third eigenvalue can be minimized by choosing κ 1 = κ 10 and κ 2 = κ 20, causing C line to maximized. Therefore we interpret κ 10 and κ 20 as the actual curvatures. In the limit κ 1 0,κ 2 0, we return to the traditional analysis where λ 3 = f 2 w. Substituting κ 1 = κ 10,κ 2 = κ 20, the tensor gets the curvature corrected eigenvalues 0.2 0.15 True κ 20 db 10 db 3 db λ 1 = f 2 u,λ 2 = f 2 v,λ 3 = f 2 w K (9) κ 0.1 4 Test results 0.05 To measure the robustness of the new estimators for confidence and curvature, we created an 3-D image of a torus and added different levels of Gaussian noise, see figure 5. The torus has a Gaussian profile, which makes the object band-limited. We choose the width of the torus σ =2.0 voxel. Since the grey values of the test object are bounded, 0 f(x, y, z) 1, we use the following definition for the signal-to-noise ratio ( ) max(f) min(f) SNR =20log 10 db σ n (10) = 20 log 10 (σ n )db where σ n is the standard deviation of the noise. C line 1 0.8 0.6 0.4 0.2 GST PGST 20 db 10 db 3 db 0 5 10 15 20 25 30 35 40 radius [pixel] Figure 2: A comparison of the traditional (GST) and the curvature corrected (PGST) confidence estimation. The average confidence estimation is depicted as a function of the radius of the torus at different different SNR. The error-bars indicate the standard deviation. The results of the confidence and curvature estimation on the torus image are depicted in resp. figure 2 and 3. The average and the standard deviation for each point in these 0 5 10 15 20 25 30 35 40 radius [pixel] Figure 3: Average curvature estimation on the torus-image for different SNR. The error-bars indicate the standard deviation. figures is taken over 12 measurements. For both the gradient regularisation and for the local averaging of the structure tensor a Gaussian window was used. We applied a gradient smoothing σ g = 1.0 and a tensor smoothing σ T = 4.0 for all measurements. The scale of the tensor smoothing is chosen such that an optimal SNR for the measurement is achieved. More details about the selection of the scale for the tensor smoothing are given in the discussion at the end of the paper. In figure 2 we see that at 10 and 20 db, the curvature corrected method yields a significant improvement in the confidence estimation. At 3 db, however, there is no significant improvement, which means that there is not enough signal energy for a confident fit of the model. As a consequence, the curvature estimation at 3 db is not reliable. The curvature estimation at 10 db has an average relative error of 12%. Note that C line,gst C line,pgst for all radii. This can be explained by the fact that adding an extra parameter to the model, always results in a better fit. The increasing of the bias in the curvature estimation for decreasing SNR, is explained in appendix A. 5 Application For the automatic detection of channels in 3-D migrated seismic reflection data, we model channels as curvilinear structures meandering in 3-D space. The seismic volume containing a channel that we are going to analyze is visualized by 2-D cross-sections in figure 6 and 7. The xy-axes are spatial and the z-axis spans the amplitude of the reflec- 3

tion of an acoustic wavelet as a function of the travel time from the surface. The z-axis can be inverted to depth if the velocity of the acoustic wave is known at each depth. The meandering nature of channels suggests that the curvature corrected model gives a more accurate description of a channel than the traditional straight model. Therefore we expect that the curvature corrected confidence estimation yields a significantly higher value than the traditional confidence estimation. As a preprocessing step, we create an attribute volume by computing the standard deviation within a window of (w x = w y =5,w z =9) voxels, for each voxel in the seismic volume. A cross-section of this volume, corresponding to figure 7 (a), is depicted in figure 10. We performed the confidence estimation on the attribute volume, with both the GST and the PGST method. We applied a gradient smoothing σ g = 1.0 and a tensor smoothing σ T = 3.5 for all measurements. 1 0.8 0.6 0.4 0.2 Noise Straight structure Channel GST PGST 0 0 0.2 0.4 0.6 0.8 1 C line Figure 4: Cumulative distribution of the confidence estimation of selected parts of the seismic volume. To analyze the result, we defined three regions in the seismic volume. One that contains all data points that have manually labeled channel. The second one consist of points from region with no seismic events, and represents the noise in the data. The last regions contains a straight sedimentary structure. For all three regions we created the cumulative distribution of the confidence estimate, which are displayed in figure 4. 6 Discussion and conclusions Inspection of figure 4 leads to several conclusions. As already found in the test results the PGST confidence estimate always yields a higher value than the GST confidence estimate. We convenience denote the confidence improvement as C = C line,pgst C line,gst. (11) The significance of C along the channel depends on the noise. We assume that the noise has the same distribution for position in the volume. The improvement C n =0.03 in the noise region gives an estimation of the improvement due to noise (SNR = ). However, the value of C n is not constant for all C line values. Consider a straight line with SNR =, then C =0thus C n =0. In the straight structure region, the curvature correction improves the fit by giving a better description of the noise. Therefore we have C n =0.01 at C line =0.55. We can now conclude that the noise contribution to C =0.05 in the channel region C n < 0.01, and the improvement is therefore due to a better description of the meandering structure of the channel. Segmentation of channels requires information from larger scales, because on On the scale we used for the tensor smoothing there is often not enough information to do a confident channel segmentation. Therefore it is necessary to include larger scale information. Increasing the local estimation-window size isotropically decreases the SNR. The signal of a linear structure in a 3-D isotropic window increase linearly with the radius R of the window. The noise increases with R 3/2, assuming uncorrelated normally distributed white noise. The solution is to increased the scale only along the channel. This can be done by steering an adaptive window using the estimated orientation and curvature. Acknowledgments This research is partly supported by Senter, Agency of the Ministry of Economic Affairs of the Netherlands, the Royal Netherlands Academy of Arts and Sciences (KNAW), and the Rolling Grants program of the Foundation for Fundamental Research in Matter (FOM). References [1] M. Kass, A. Witkin. Analyzing oriented patterns, Computer Vision Graphics and Image Processing, 1987.37:p. 362-385. [2] Hans Knutsson. Representing Local Structure Using Tensors, The 6th Scandinavian Conference on Image Analysis, Oulu, Finland, pp. 244-251, June 19-22, 1989. 4

[3] L. Haglund. Adaptive multi-dimensional filtering, Ph.D Thesis, Linkoping University, Linkoping, 1992. [4] P.W. Verbeek, L.J. van Vliet, J. van de Weijer. Improved Curvature and Anisotropy Estimation for Curved Line Bundles, Proceedings of ICPR 98, Brisbane, Australia, 17-20 August 1998 [5] G.M.P. van Kempen, N. van de Brink, L.J. van Vliet, P.W. Verbeek, M. van Ginkel, H. Blonk. The application of a Local Dimensionality Estimator to the analysis of 3-D microscopic network structures, The 11th Scandinavian Conference on Image Analysis, Kangerlussuaq, Greenland, pp. 447-455, June 7-11, 1999 Appendix A From figure 3 it is clear that noise introduces a bias in the curvature κ estimation; the estimated curvature is smaller than the actual curvature. This can be explained by examining κ 10,κ 20. (a) (b) κ 10 = w2 f u f v wf v f w w 2 f 2 v wf u f w w 2 f 2 u w 2 f 2 v (w 2 f u f v ) 2 (12) (c) (d) κ 20 = w2 f u f v wf u f w w 2 f 2 u wf v f w w 2 f 2 u w2 f 2 v (w2 f u f v ) 2 (13) κ = κ 2 10 + κ2 20 (14) Figure 5: A slice through the center of the torus-image (a), with Gaussian noise added to SNR 20 db (b), 10 db (c), 3 db (d). The terms w 2 fi 2,i = u, v increase when noise is added, while the other terms do not change. Since the increasing terms appear quadratic in the denominator and linear in the nominator, the curvature estimation becomes smaller when noise is added. The sign of κ 10,κ 20 is lost in eq.14. Appendix B Figure 6: A cross-section of the seismic volume: t-axis plotted along the center-line of the channel. 5

A B A B (a) Figure 9: A xy-slice of the seismic volume with the noise region outlined in white. B B A A (b) Figure 7: Slices of the seismic volume: (a) xy-slice, (b) ytslice, centered in the x-direction. Figure 10: xy-slice through the 3-D attribute volume, corresponding the figure 7 (a). Figure 8: The same as figure 7 (a) with the channel region outlined in white and the straight sedimental structure outlined in black. 6