arxiv: v1 [cs.lg] 11 Mar 2016

Transcription

1 A Recursive Born Approach to Nonlinear Inverse Scattering Ulugbek S. Kamilov, Dehong Liu, Hassan Mansour, and Petros T. Boufounos March 15, 2016 arxiv: v1 [cs.lg] 11 Mar 2016 Abstract The Iterative Born Approximation (IBA) is a well-known method for describing waves scattered by semi-transparent objects. In this paper, we present a novel nonlinear inverse scattering method that combines IBA with an edge-preserving total variation (TV) regularizer. The proposed method is obtained by relating iterations of IBA to layers of a feedforward neural network and developing a corresponding error backpropagation algorithm for efficiently estimating the permittivity of the object. Simulations illustrate that, by accounting for multiple scattering, the method successfully recovers the permittivity distribution where the traditional linear inverse scattering fails. 1 Introduction Knowledge of the spatial distribution of the permittivity within an object is important for many applications since it enables the visualization of the internal structure and physical properties of the object. Measurements of the permittivity are typically obtained by first illuminating the object with a known incident wave and recording the resulting scattered waves with sensors located outside the object. The spatial map of permittivity is reconstructed from the measurements, using computational inverse scattering methods that rely on physical models describing the object-wave interaction. Traditional approaches to inverse scattering formulate the task as a linear inverse problem by establishing a linear relationship between the permittivity and the scattered wave. The linear model can be obtained by assuming a straight-ray propagation of waves [1], or by adopting more refined single-scattering models based on the first Born [2] or Rytov approximations [3]. Once linearized, the problem can be efficiently solved using the preferred regularized reconstruction methods, typically based on sparsity and iterative optimization [4 6]. Recent experimental results indicate that the resolution and quality of the reconstructed permittivity is improved when nonlinear physical models are used instead of traditional linear ones [7 10]. In particular, nonlinear physical models can account for multiple scattering and provide a more accurate interpretation of the measured data at the cost of increased computational complexity of the reconstruction. In this paper, we develop a new computational imaging method to reconstruct the permittivity distribution of an object from transmitted or reflected waves. Our method is based on a nonlinear physical model that can account for multiple scattering in a computationally efficient way. Specifically, we propose to interpret the iterations of the iterative Born approximation (IBA) as layers of a feedforward neural network. This formulation leads to an efficient error backpropagation algorithm used to evaluate the gradient of the scattered field with respect to the permittivity, thus enabling the recovery of the latter from a set of measured scattered fields. The quality of the final estimate is further enhanced by regularizing the solution with an edge-preserving total variation (TV) penalty. Our simulations indicate that the proposed method accurately models scattering without prohibitive computational overhead, and successfully recovers the object where the traditional linear approaches fail. U. S. Kamilov ( kamilov@merl.com), D. Liu ( liudh@merl.com), H. Mansour ( mansour@merl.com), and P. T. Boufounos ( petrosb@merl.com) are with Mitsubishi Electric Research Laboratories (MERL), 201 Broadway, Cambridge, MA 02140, USA. 1

2 y u in f(x) x imaging area sensor region Figure 1: Schematic representation of a scattering scenario. An object with a scattering potential f(x), x Ω, is illuminated with an input wave u in, which interacts with the object and results in the scattered wave u sc at the sensor region Γ. The scattered wave is measured and used to computationally form an image of f. 2 Related Work A comprehensive review of nonlinear inverse scattering, with detailed description of standard algorithms, is available in the book-chapter by van den Berg [11]. Three common approaches to nonlinear inverse scattering are iterative Born [12 14], modified gradient [15 17], and contrast-source inversion methods [18]. All these methods attempt to iteratively minimize the discrepancy between the actual and predicted measurements, while enforcing the consistency of the fields inside the object. The actual optimization is performed in an alternating fashion by first updating the permittivity for a fixed field, and then updating the field for a fixed permittivity. The difference between the methods is in the actual computation of the updates. Recently, the beam propagation method (BPM) was proposed for performing nonlinear inverse scattering in transmission [10, 19 21]. BPM-based methods circumvent the need to solve an explicit optimization problem for the internal field, by instead numerically propagating the field slice-by-slice through the object. It was shown that BPM can be related to a neural network where each layer corresponds to a spatial slice of the object. An efficient backpropagation algorithm can thus be derived to reconstruct the object from the measurements [21]. This paper substantially extends the BPM-based method by relying on IBA to formulate the nonlinear physical model. One main advantage of the proposed formulation over BPM is that it allows reconstruction when measuring reflections. Additionally, unlike alternating minimization schemes that assume a linear problem for a given internal field, our method directly optimizes the nonlinear model in a tractable way using error backpropagation. 3 Main Results The method presented here can be generalized to a majority of tomographic experiments in transmission or reflection. For simplicity of derivations, we ignore absorption by assuming a real permittivity; however, the equations can be generalized to handle complex permittivities. We additionally assume coherent measurements, i.e., that both the amplitude and phase of the scattered wave are recorded at the sensor locations. 2

3 3.1 Problem Formulation Consider the two-dimensional (2D) scattering problem illustrated in Fig. 1, where an object of real permittivity distribution ɛ(x), with x = (x, y) Ω, is immersed into the background medium of permittivity ɛ b. The line sources that generate the electromagnetic excitation and the sensors collecting the data are located in the sensor region Γ R 2. By assuming, and ignoring, a time dependence exp(jωt), the incident electric field created by the lth source, located at x l Γ, is given by u in (x) = A j 4 H(2) 0 (k b x x l l2 ), (1) for all x R 2, where A is the strength of the source, H (2) 0 is the zero-order Hankel function of the second kind, k b = k 0 ɛb is the wavenumber in the background medium, k 0 = ω/c 0 = 2π/λ is the wavenumber in free space, λ is the wavelength, and c m/s. In the subsequent derivations, we consider the scenario of a single illumination and drop the indices l. The generalization to an arbitrary number of illuminations L is straightforward. The Lippmann-Schwinger integral equation describes the relationship between the permittivity and the wave-field [11] u(x) = u in (x) + g(x x )f(x )u(x ) dx, (2) Ω for all x Ω, where we define the scattering potential and the Green s function for the homogeneous medium f(x) k 2 b (ɛ b ɛ(x)) (3) g(x) j 4 H(2) 0 (k b x l2 ). (4) Similarly, the scattered field in the sensor region can be expressed as u sc (x) = u(x) u in (x) = g(x x )f(x )u(x ) dx (5) for any x Γ. Note that the integrals (2) and (5) extend only over Ω because the scattering potential f is zero for all x / Ω. The goal of inverse scattering is to estimate f, which is equivalent to ɛ, given M measurements of {u sc (x m )} m [1...M] in the sensor region Γ. 3.2 Iterative Born Approximation At first glance, it might seem that (5) directly provides a linear relationship between f and u sc, which can be used to solve the problem. However, the nonlinear nature of the inverse scattering becomes evident if one realizes that the internal field u = u in + u sc in (5) depends on u sc. We now consider a K-term iterative Born approximation (IBA) [22] of the total field (2) u k (x) = u in (x) + g(x x )f(x )u k 1 (x ) dx, (6) Ω where x Ω, u 0 = 0, and k = 1, 2,..., K. When K = 1, eq. (6) reduces to the well-known first-born approximation, which assumes a single scattering from f by approximating u(x) with the incident field u in (x). For K = 2, the approximation of the total field is improved by taking into account the second scattering due to an additional interaction between the object and the field. For higher values of K the approximation is further improved by accounting for multiple scattering of order K (see also the discussion on multiple scattering by Born and Wolf [22]). Ω 3

4 incident field u 0 1 f 1 u 1 u 2 f 1 f 1 error correction predicted field measured field z 1 y 1 u 0 2 f 2 f 2 f 2 compare error z 2 y 2 u 0 3 f 3 scatter f 3 scatter f 3 Figure 2: Schematic representation of the multiple scattering as a neural network for K = 2, N = 3, and M = 2. The scattering potential f R N plays the role of nonlinearities, while matrices H C M N and G C N N represent weights of the network. The error backpropagation algorithm described here allows to efficiently estimate f by comparing predicted field z C M against the actual measurements y C M. In the context of general theory of integral equations, the iterations of type (6) are known as Liouville- Neumann series [23]. The sufficient condition for convergence states that the norm of the integral operator acting on the field should be less than unity. While this implies that IBA might diverge for large permittivity contrasts, it is still expected to work on a wide range of contrasts where the linearized models fail, which is corroborated by our simulations in Section Network Interpretation We now discretize and combine equations (5) and (6) into the following matrix-vector recursion z H(u K f), u k u 0 + G(u k 1 f), (7a) (7b) for k = 1,..., K. Here, the vector f R N is the discretization of the scattering potential f, z C M is the predicted scattered field u sc at sensor locations {x m } m [1...M], u 0 C N is the discretization of the input field u in inside Ω, H C M N is the discretization of the Green s function at sensor locations, G C N N is the discretization of the Green s function inside Ω, and denotes a component-wise multiplication between two vectors. For every k [1... K], the vector u k C N denotes the discretized version of the internal field after the kth scattering. Figure 2 illustrates the representation of (7) as a feedforward neural network [24], where the edge weights are represented in H and G and the nonlinear nodes are described by the scattering potential f. Note that the linear edge weights correspond to convolution operators and can thus be efficiently implemented with FFTs. Accordingly, the total computational cost of evaluating one forward pass through the network is O(KN log(n)). 3.4 Inverse Scattering We formulate the inverse scattering as the following minimization problem f = arg min {D(f) + τr(f)}, (8) f F where D and R are the data-fidelity and regularization terms, respectively, and τ > 0 is the regularization parameter. The convex set F R N enforces physical constraints on the scattering potential such as its, for example, non-negativity. The data-fidelity term is given by D(f) 1 2 y z(f) 2 l 2, 4

5 where y C M contains measurements of the scattered field and z is the field predicted by the recursion (7). As a regularization term, we propose to use isotropic TV penalty [25] R(f) N [Df] n l2 = n=1 N n=1 [D x f] n 2 + [D y f] n 2, where D : R N R N 2 is the discrete gradient operator with matrices D x and D y denoting the finite difference operations along x and y directions, respectively. The optimization (8) can be performed iteratively using a proximal-gradient scheme or one of its accelerated variants [26 28]. Specifically, the scattering potential can be updated with the following iteration f t prox γτr ( f t 1 γ D(f t 1 ) ), (9) where γ > 0 is a step-size and { } 1 prox τr (g) arg min f F 2 f g 2 l 2 + τr(f) (10) is the proximal operator, which corresponds to the TV regularized solution of the denoising problem. Note that, although, the proximal operator for isotropic TV does not admit a closed form, it can be efficiently computed [27]. The gradient D can be expressed as follows { [ ] H D(f) = Re z(f) (z(f) y)}, (11) where H is the Hermitian transpose of the Jacobian z(f) [ z 1... z N ]. (12) Then, by differentiating equations in (7) with respect to f, and simplifying the resulting expressions, we obtain for any two vectors r C M and b C N [ ] H z r = ( H H r ) [ ] u ū K K H (( + H H r ) f ) [ ] u k H b = ( G H b ) [ ] u ū k 1 k 1 H (( + G H b ) f ), where k = 1,..., K, and vector ū contains complex conjugated elements of u. These relationships lead to the following error backpropagation algorithm g k g k+1 + [ G H v k+1] ū k v k [ G H v k+1] f, (13a) (13b) where k = K 1, K 2,..., 0, with the initialization v K = [H H (z y)] f and g K = [ H H (z y) ] ū K. The final value of the gradient (11) is obtained by returning D(f) = Re{g 0 }. The remarkable feature of our error backpropagation approach is that it allows to efficiently evaluate the gradient of the scattered field with respect to the scattering potential. Due to the convolutional structure of the matrices, its computational complexity is equivalent to running a forward pass, which is of order O(KN log(n)). Equipped with this algorithm, the scattering potential can be optimized via iteration (9). Note that the algorithm does not explicitly evaluate and store the Jacobian (12) by instead computing its product with the residual r = (z(f) y), as indicated in (11). 5

6 a b 1.65 db SNR (db) FB #layers (K) 32 FB c db d db RB Figure 3: Evaluation on Shepp-Logan with 15% permittivity contrast at λ = 7.49 cm. (a) True contrast; (b) first-born approximation; (c) alternating minimization; (d) proposed recursive-born method with K = 32. Scale bar is equal to λ. 4 Experimental Validation To validate our Recursive Born (RB) method, we report results for the tomographic experiment illustrated in Fig. 1, where the scattered wave measurements were obtained by running a high-fidelity Finite-Difference Time-Domain (FDTD) [29] simulator. The object is the Shepp-Logan phantom of size 82 cm 112 cm and the background medium is air with ɛ b = 1. The measurements are collected over 24 transmissions on a circle of radius R = 100 cm with 15 o angle increments and, for each transmission, 360 measurements around the object are recorded. The dimensions of the computational domain for reconstruction are set to L x = L y = 120 cm, with sampling steps δx = δy = 0.6 cm, which implies a measurement ratio of M/N 22%. We define the permittivity contrast as f max (ɛ max ɛ b )/ɛ b, where ɛ max max x Ω {ɛ(x)}. We compare results of our approach against two alternative methods. As the first reference method (denoted first Born (FB)), we consider the TV-regularized solution of linearized model based on the first- Born approximation, which is known to be valid only for weakly scattering objects. In addition to the linearized approach, we consider an optimization scheme (denoted Alternating Minimization ()) that alternates between updating the scattering potential for a fixed field and updating the field for a fixed scattering potential. This method is conceptually similar to the one proposed in [13], but with TV replacing the smooth regularizer, due to the edge-preserving properties of the former. Hence, all three methods minimize the same TV-regularized least-squares error functional; however, each method relies on a distinct physical forward model. Additionally, all the methods were initialized with zero, iterated until convergence by measuring the change in two successive estimates, and their regularization parameters were set to the same value τ = y 2 l 2. Figure 3 compares the quality of the images obtained by all three methods for the permittivity contrast of 15% at λ = 7.49 cm. Note that, due to the object s large size and contrast, FB fails to characterize its structure. Alternatively, both and RB succeed at recovering the object, with RB obtaining an image of significantly superior quality. Figure 4 illustrates the influence of the number of layers K on the quality of the reconstructed image (left), and the evolution of the relative data-fit y z 2 l 2 / y 2 l 2 for every iteration 6

7 b 1.65 db SNR (db) FB data fit FB #layers (K) 32 1 iterations (t) Figure 4: Illustration of the reconstruction performance on Shepp-Logan with 15% contrast. Left: SNR is plotted against FBthe number of layers in the neural network. Right: normalized error between the true and predicted fields is plotted at each iteration for K = 32. Results obtained with FB and are marked with dashed lines db d db Table 1: Comparison of three methods in terms of SNR for λ = 10 cm. The best result for each contrast is highlighted. Permittivity Contrast f max 5% 10% 15% 20% RB First Born Alternating Minimization Recursive Born with K = 32 (right). As can be appreciated from these plots, the proposed method outperforms FB and, both in terms of signal-to-noise ratio (SNR) and data-fit for networks with sufficient number of layers. Additionally, the method converges relatively fast within first few tens of iterations. Table 1 presents the results of quantitative evaluation of the methods for different values of the permittivity contrast at λ = 10 cm. As expected, the performance of all the methods degrades as the contrast value increases, which might be due to growing degree of nonlinearity, and hence, nonconvexity of the inverse scattering problem [30]. However, the solutions computed by the proposed RB approach are substantially better than the two alternatives, FB and, for all values of the contrast. Finally, from a computational perspective, a single iteration of the method requires a number of FFTs proportional to the number of scattering layers. In our simulations, accurate results are obtained using about 100 iterations with networks of approximately 20 layers. More concretely, our basic MATLAB implementation requires about 1.3 seconds per iteration to process a transmission on a 4GHz Intel Core i7 processor with 32 GBs of memory. 5 Conclusion The method developed in this paper reconstructs the distribution of the permittivity in an object from a set of measured scattered waves. In particular, the method accounts for multiple scattering of waves, in both transmission and reflection, and can thus be used when linearized models fail. The method is also computationally tractable due to its convolutional structure and can be further accelerated by parallelizing computations over multiple CPUs. We believe that the approach presented here opens rich perspectives for high-resolution tomographic imaging in a range of practical setups where multiple scattering is an issue. References [1] A. C. Kak and M. Slaney, Principles of Computerized Tomographic Imaging. IEEE, [2] E. Wolf, Three-dimensional structure determination of semi-transparent objects from holographic data, Opt. Commun., vol. 1, no. 4, pp , September/October

8 [3] A. J. Devaney, Inverse-scattering theory within the Rytov approximation, Opt. Lett., vol. 6, no. 8, pp , August [4] M. M. Bronstein, A. M. Bronstein, M. Zibulevsky, and H. Azhari, Reconstruction in diffraction ultrasound tomography using nonuniform FFT, IEEE Trans. Med. Imag., vol. 21, no. 11, pp , November [5] Y. Sung and R. R. Dasari, Deterministic regularization of three-dimensional optical diffraction tomography, J. Opt. Soc. Am. A, vol. 28, no. 8, pp , August [6] T. Kim, R. Zhou, M. Mir, S. Babacan, P. Carney, L. Goddard, and G. Popescu, White-light diffraction tomography of unlabelled live cells, Nat. Photonics, vol. 8, pp , March [7] F. Simonetti, Multiple scattering: The key to unravel the subwavelength world from the far-field pattern of scattered wave, Phys. Rev. E: Stat., Nonlinear, Soft Matter Phys., vol. 73, no. 3, p , March [8] F. Simonetti, M. Fleming, and E. A. Marengo, Illustration of the role of multiple scattering in subwavelength imaging from far-field measurements, J. Opt. Soc. Am. A, vol. 25, no. 2, pp , February [9] G. Maire, F. Drsek, J. Girard, H. Giovaninni, A. Talneau, D. Konan, K. Belkebir, P. C. Chaumet, and A. Sentenac, Experimental demonstration of quantitative imaging beyond Abbe s limit with optical diffraction tomography, Phys. Rev. Lett., vol. 102, p , May [10] U. S. Kamilov, I. N. Papadopoulos, M. H. Shoreh, A. Goy, C. Vonesch, M. Unser, and D. Psaltis, Learning approach to optical tomography, Optica, vol. 2, no. 6, pp , June [11] P. M. van den Berg, Scattering. Academic Press, 2002, ch. Nonlinear Scalar Inverse Scattering: Algorithms and Applications, pp [12] A. G. Tijhuis, Born-type reconstruction of material parameters of an inhomogeneous, lossy dielectric slab from reflected-field data, Wave Motion, vol. 11, no. 2, pp , May [13] Y. M. Wang and W. Chew, An iterative solution of the two-dimensional electromagnetic inverse scattering problem, Int. J. Imag. Syst Tech., vol. 1, pp , [14] W. C. Chew and Y. M. Wang, Reconstruction of two-dimensional permittivity distribution using the distorted Born iterative method, IEEE Trans. Med. Imag., vol. 9, no. 2, pp , June [15] R. E. Kleinman and P. M. van den Berg, A modified gradient method for two-dimensional problems in tomography, J. Comput. Appl. Math., vol. 42, no. 1, pp , [16], An extended range-modified gradient technique for profile inversion, Radio Sci., vol. 28, no. 5, pp , September-October [17] K. Belkebir and A. Sentenac, High-resolution optical diffraction microscopy, J. Opt. Soc. Am. A, vol. 20, no. 7, pp , July [18] P. M. van den Berg and R. E. Kleinman, A contrast source inversion method, Inv. Probl., vol. 13, no. 6, pp , December [19] L. Tian and L. Waller, 3D intensity and phase imaging from light field measurements in an LED array microscope, Optica, vol. 2, pp , [20] L. Waller and L. Tian, Machine learning for 3D microscopy, Nature, vol. 523, no. 7561, pp , July

9 [21] U. S. Kamilov, I. N. Papadopoulos, M. H. Shoreh, A. Goy, C. Vonesch, M. Unser, and D. Psaltis, Optical tomographic image reconstruction based on beam propagation and sparse regularization, IEEE Trans. Comp. Imag., vol. 2, no. 1, pp , March [22] M. Born and E. Wolf, Principles of Optics, 7th ed. Cambridge Univ. Press, 2003, ch. Scattering from inhomogeneous media, pp [23] G. B. Arfken and H. J. Weber, Mathematical Methods for Physicists, 6th ed. Elsevier, 2005, ch. Integral equations, pp [24] C. M. Bishop, Neural Networks for Pattern Recognition. Oxford, [25] L. I. Rudin, S. Osher, and E. Fatemi, Nonlinear total variation based noise removal algorithms, Physica D, vol. 60, no. 1 4, pp , November [26] J. M. Bioucas-Dias and M. A. T. Figueiredo, A new TwIST: Two-step iterative shrinkage/thresholding algorithms for image restoration, IEEE Trans. Image Process., vol. 16, no. 12, pp , December [27] A. Beck and M. Teboulle, Fast gradient-based algorithm for constrained total variation image denoising and deblurring problems, IEEE Trans. Image Process., vol. 18, no. 11, pp , November [28] U. S. Kamilov, Parallel proximal methods for total variation minimization, in IEEE Int. Conf. Acoustics, Speech and Signal Process. (ICASSP 2016), Shanghai, China, March 19-25, 2015, arxiv: [cs.it]. [29] A. Taflove and S. C. Hagness, Computational Electrodynamics: The Finite-Difference Time-Domain Method, 3rd ed. Artech House Publishers, [30] O. M. Bucci, L. Cardace, L. Crocco, and T. Isernia, Degree of nonlinearity and a new solution precudure in scalar two-dimensional inverse scattering problems, J. Opt. Soc. Am. A, vol. 18, no. 8, pp , August