2D X-Ray Tomographic Reconstruction From Few Projections

Similar documents
Compressive Sensing (CS)

Lecture 22: More On Compressed Sensing

New Coherence and RIP Analysis for Weak. Orthogonal Matching Pursuit

Generalized Orthogonal Matching Pursuit- A Review and Some

Sparse Solutions of an Undetermined Linear System

Introduction to Compressed Sensing

Introduction How it works Theory behind Compressed Sensing. Compressed Sensing. Huichao Xue. CS3750 Fall 2011

Recovery of Sparse Signals from Noisy Measurements Using an l p -Regularized Least-Squares Algorithm

MIT 9.520/6.860, Fall 2017 Statistical Learning Theory and Applications. Class 19: Data Representation by Design

Constrained optimization

Compressibility of Infinite Sequences and its Interplay with Compressed Sensing Recovery

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation

Iterative Methods for Inverse & Ill-posed Problems

Introduction to Sparsity. Xudong Cao, Jake Dreamtree & Jerry 04/05/2012

Sparse linear models

Nonlinear Flows for Displacement Correction and Applications in Tomography

Regularizing inverse problems using sparsity-based signal models

Mathematical introduction to Compressed Sensing

Compressed sensing. Or: the equation Ax = b, revisited. Terence Tao. Mahler Lecture Series. University of California, Los Angeles

Algorithms for sparse analysis Lecture I: Background on sparse approximation

Compressed Sensing - Near Optimal Recovery of Signals from Highly Incomplete Measurements

Optimization for Compressed Sensing

COMPRESSED SENSING IN PYTHON

Recovering overcomplete sparse representations from structured sensing

Minimizing the Difference of L 1 and L 2 Norms with Applications

Bayesian X-ray Computed Tomography using a Three-level Hierarchical Prior Model

SPARSE signal representations have gained popularity in recent

Statistical Issues in Searches: Photon Science Response. Rebecca Willett, Duke University

Lecture Notes 9: Constrained Optimization

PHASE RETRIEVAL OF SPARSE SIGNALS FROM MAGNITUDE INFORMATION. A Thesis MELTEM APAYDIN

AN INTRODUCTION TO COMPRESSIVE SENSING

An algebraic perspective on integer sparse recovery

Strengthened Sobolev inequalities for a random subspace of functions

Sparsity Regularization

Sensing systems limited by constraints: physical size, time, cost, energy

Uncertainty quantification for sparse solutions of random PDEs

Restoration of Missing Data in Limited Angle Tomography Based on Helgason- Ludwig Consistency Conditions

Sparsity and Compressed Sensing

Sparsifying Transform Learning for Compressed Sensing MRI

Sparse and Low Rank Recovery via Null Space Properties

Interpolation-Based Trust-Region Methods for DFO

Compressive Sensing and Beyond

The convex algebraic geometry of rank minimization

COMPRESSIVE SAMPLING USING EM ALGORITHM. Technical Report No: ASU/2014/4

Compressed Sensing: Extending CLEAN and NNLS

Sparse Recovery Beyond Compressed Sensing

Data Sparse Matrix Computation - Lecture 20

Hamburger Beiträge zur Angewandten Mathematik

Sparsity Models. Tong Zhang. Rutgers University. T. Zhang (Rutgers) Sparsity Models 1 / 28

User s Guide to Compressive Sensing

Application to Hyperspectral Imaging

Lecture 5 : Sparse Models

Overview. Optimization-Based Data Analysis. Carlos Fernandez-Granda

Exact Low-rank Matrix Recovery via Nonconvex M p -Minimization

2 Regularized Image Reconstruction for Compressive Imaging and Beyond

Reconstruction from Anisotropic Random Measurements

Lecture: Introduction to Compressed Sensing Sparse Recovery Guarantees

Optimal mass transport as a distance measure between images

Optimization-based sparse recovery: Compressed sensing vs. super-resolution

Compressed Sensing: Lecture I. Ronald DeVore

ECE 8201: Low-dimensional Signal Models for High-dimensional Data Analysis

Sparse solutions of underdetermined systems

Compressed sensing techniques for hyperspectral image recovery

Feature Reconstruction in Tomography

COMPRESSIVE OPTICAL DEFLECTOMETRIC TOMOGRAPHY

Part IV Compressed Sensing

Superiorized Inversion of the Radon Transform

Beyond incoherence and beyond sparsity: compressed sensing in the real world

ECE G: Special Topics in Signal Processing: Sparsity, Structure, and Inference

Compressed sensing and imaging

The uniform uncertainty principle and compressed sensing Harmonic analysis and related topics, Seville December 5, 2008

INDUSTRIAL MATHEMATICS INSTITUTE. B.S. Kashin and V.N. Temlyakov. IMI Preprint Series. Department of Mathematics University of South Carolina

Microlocal Methods in X-ray Tomography

An Overview of Sparsity with Applications to Compression, Restoration, and Inverse Problems

CoSaMP. Iterative signal recovery from incomplete and inaccurate samples. Joel A. Tropp

CS 229r: Algorithms for Big Data Fall Lecture 19 Nov 5

Sparse Legendre expansions via l 1 minimization

Multi-stage convex relaxation approach for low-rank structured PSD matrix recovery

Interpolation via weighted l 1 -minimization

Towards a Mathematical Theory of Super-resolution

Maximal Entropy for Reconstruction of Back Projection Images

Sparse Optimization Lecture: Basic Sparse Optimization Models

Conditions for Robust Principal Component Analysis

LECTURES ON MICROLOCAL CHARACTERIZATIONS IN LIMITED-ANGLE

Uniqueness Conditions for A Class of l 0 -Minimization Problems

Lecture 9 February 2, 2016

Gini Index as Sparsity Measure for Signal Reconstruction from Compressive Samples

A Study of Numerical Algorithms for Regularized Poisson ML Image Reconstruction

The Pros and Cons of Compressive Sensing

1 Sparsity and l 1 relaxation

L-statistics based Modification of Reconstruction Algorithms for Compressive Sensing in the Presence of Impulse Noise

Low-Dimensional Signal Models in Compressive Sensing

Linear Inverse Problems

Fast and Accurate HARDI and its Application to Neurological Diagnosis

Stability (over time) of regularized modified CS (noisy) for recursive causal sparse reconstruction

The Sparsest Solution of Underdetermined Linear System by l q minimization for 0 < q 1

Compressed Sensing and Neural Networks

Recent Developments in Compressed Sensing

Near Optimal Signal Recovery from Random Projections

Phase Transition Phenomenon in Sparse Approximation

Transcription:

2D X-Ray Tomographic Reconstruction From Few Projections Application of Compressed Sensing Theory CEA-LID, Thalès, UJF 6 octobre 2009

Introduction Plan 1 Introduction 2 Overview of Compressed Sensing Theory 3 Formulations of SR problem 4 Numerical results

Introduction Motivations and Objectives Applications of X-Ray imaging systems : Industrial non-destructive control Medical imaging Security control Main interests by using few X-ray projections : Acceleration of data aquisation Reduction of dose

Introduction Radon transform Radon Transform : Rf(ρ, θ) = L f(x, y)dl Analytical tomographic reconstruction : f = R 1 Rf

Introduction Projection-slice theorem Frequential intepretation of Radon transform : F ρ (Rf)(ω, θ) Rf(ρ, θ)e 2πiρω dρ = ˆf(ω cos θ, ω sin θ) IR Starshaped incomplete frequency domain Reconstruction is an ill-posed problem!

Introduction Formulation of reconstruction problem Representation of image by discret basis : f(x) = j f jφ j (x), then : Rf(ρ, θ) = Rφ j (ρ, θ)f j j In real applications, Rf(ρ, θ) is known only for a limited position of (ρ i, θ i ). This gives : A f = b where, Projection matrix A i,j = Rφ j (ρ i, θ i ), A P M N 2 Discret image f = [f 1... f N ] Sinogram b i = Rf(ρ i, θ i ), i = 1... P M Tomographic reconstruction becomes a linear inverse problem.

Introduction Regularization Classical approaches : Reconstruction without regularization : Examples : FBP, EM, ART. min f ker(a) Af b 2 f = A b (1) Introducing regularization term g(f) and and limit the convex admissible set of f : 1 min f C 2 Af b 2 2 + λg(f) (2) Examples : Edge-preserving reconstruction, POCS New approach : Regularization by sparsity

Overview of Compressed Sensing Theory Plan 1 Introduction 2 Overview of Compressed Sensing Theory 3 Formulations of SR problem 4 Numerical results

Overview of Compressed Sensing Theory Notion of sparsity Definition (S-sparsity) A signal x IR N is S-sparse if it has only S non zero entries. Definition (S-biggest term approximation) x S is the S-biggest term approximation of x by retaining only first S biggest (in absolute value) entries. Hypothesis (Fundamental) A good solution is a sparse solution, the best solution is the sparsest solution.

Overview of Compressed Sensing Theory Sparsest solution : l 0 and l 1 norms Find the sparsest solution by l 0 semi-norm : (P 0 ) is NP hard, convex relaxation : Important questions : Uniqueness of (P 0 )? min x x 0 s.t. Ax = b (P 0 ) min x x 1 s.t. Ax = b (P 1 ) Equivalence between (P 0 ) and (P 1 )? Answered by Compressed Sensing (CS) Theory

Overview of Compressed Sensing Theory System matrix characterization Definition (Restricted Isometry Property) RIP of A is the smallest δ S 0 s.t. for all S-sparse signal x : (1 δ S ) x 2 2 Ax 2 2 (1 + δ S ) x 2 2 (3) i.e., all S-submatrix of A act like isometry. Observations : δ s bounds the singular values of S-submatrix Small δ s, nice behaviour of A If δ 2S = 1, then there exists some 2S submatrix A 2S noninjective.

Overview of Compressed Sensing Theory P 0 and P 1 equivalence Theorem (Perfect reconstruction) Given that 2S-RIP of A is δ 2S 2 1, for a S-sparse true signal x, P 1 solution x is exactly x. Theorem (Almost Perfect reconstruction) Under the same hypothesis, for a general true signal x, P 1 solution x obeys : x x 1 C x x S 1 and x x 2 C x x S 1 / S where x S is the S biggest term approximation of x.

Overview of Compressed Sensing Theory Application of CS to X-Ray CT State-of-art CS theory has two parts : Sensing matrix design (satisfying RIP) High precision recovery algorithm (P 1 ) X-Ray CT system matrix is deterministic X-Ray transform! No sensing matrix design problem Image reconstruction by solving (P 1 ) Sparse Reconstruction (SR) approach

Formulations of SR problem Plan 1 Introduction 2 Overview of Compressed Sensing Theory 3 Formulations of SR problem 4 Numerical results

Formulations of SR problem Extentions of CS Prompts more sparsity by sparsifying transform Ψ : Synthesis SR : Analysis SR : min α α 1 s.t. AΨ α = b (P S ) min x Ψ(x) 1 s.t. Ax = b (P A )

Formulations of SR problem Synthesis SR Represent x in a sparse way under basis Ψ : min α α 1 s.t. AΨ α = b (4) Reconstruction of representation coefficient : α, synthesis by x = Ψ α. Frequential basis : DCT Multi-resolution basis : Wavelet Spatial basis : Gradient, Laplacian

Formulations of SR problem Analysis SR Use a (maybe noninvertible) (non)linear transform Ψ(x) : min x Ψ(x) 1 s.t. Ax = b (P A ) Examples : T V transform : T V (x) = i,j (x i+1,j x i,j ) 2 + (x i,j+1 x i,j ) 2 (5) Gradient transform (IR N IR 2N ) : Ψ(x) 1 = i,j x i,j+1 x i,j + x i+1,j x i,j (6)

Numerical results Plan 1 Introduction 2 Overview of Compressed Sensing Theory 3 Formulations of SR problem 4 Numerical results

Numerical results Test phantoms 1.0 1.0 0.9 0.9 0.8 0.8 0.7 0.7 0.6 0.6 0.5 0.5 0.4 0.4 0.3 0.3 0.2 0.2 0.1 0.1 0.0 0.0 (d) (e) Fig.: 128 128 test images. (a) Shepp-Logan phantom, (b) a brain slice Objective : Reduce the number of projections. IPM(Interior Point Method) solver is used for Synthesis and Analysis SR.

Numerical results (P S ) and (P A ) reconstructions (a) (b) Fig.: Reconstruction using : (a) 20 projections by (P A ) with gradient transform, (b) 45 projections by (P S ) with Wavelet dictionary

Numerical results (P S ) and (P A ) reconstructions 1.0 Analysis by Gradient base Original image 0.8 Profile 0.6 0.4 0.2 0.0 0 50 100 150 200 250 Fig.: Central profile of reconstruction (a)

Numerical results (P S ) and (P A ) reconstructions 1.0 Synthesis by Wavelet Original image 0.8 0.6 0.4 0.2 0.0 0 50 100 150 200 250 Fig.: Central profile of reconstruction (b)

Numerical results Monte-Carlo test of projection matrix 64 Relative reconstruction error 0.42 Number of projections 56 48 40 0.36 0.30 0.24 0.18 0.12 0.06 32 0.0 0.125 0.25 0.375 0.5 Sparsity 0.00 Fig.: Monte-Carlo test of Fan-beam siddon projection matrix

Numerical results Conclusions and perspectives Sparse reconstruction is feasible for both piece-wise constant image and natural image Linear gradient transform is as efficient as the non linear TV transform, and wavelet basis can be used to reduce projections on natural image. Study the stability wrt noise Use more efficient sparsifying transforms