arxiv:astro-ph/ v1 24 Jan 2003

Transcription

1 Astronomy & Astrophysics manuscript no. H39 March 3, 218 (DOI: will be inserted by hand later) Digital Deblurring of CMB Maps: Performance and Efficient Implementation R. Vio 1, J.G. Nagy 2, L. Tenorio 3, P. Andreani 4, C. Baccigalupi, and W. Wamsteker 6 arxiv:astro-ph/31493v1 24 Jan 23 1 Chip Computers Consulting s.r.l., Viale Don L. Sturzo 82, S.Liberale di Marcon, 32 Venice, Italy ESA-VILSPA, Apartado 727, 288 Madrid, Spain robertovio@tin.it 2 Department of Mathematics and Computer Science, Emory University, Atlanta, GA 3322, USA. nagy@mathcs.emory.edu 3 Department of Mathematical and Computer Sciences, Colorado School of Mines, Golden CO 841, USA ltenorio@mines.edu 4 Osservatorio Astronomico di Padova, vicolo dell Osservatorio, 3122 Padua, Italy andreani@pd.astro.it SISSA/ISAS, Via Beirut 4, 3414 Trieste, Italy bacci@sissa.it 6 ESA-VILSPA, Apartado 727, 288 Madrid, Spain willem.wamsteker@esa.int Received: 3 May 22; accepted: 14 January 23 Abstract. Digital deblurring of images is an important problem that arises in multifrequency observations of the Cosmic Microwave Background (CMB) where, because of the width of the point spread functions (PSF), maps at different frequencies suffer a different loss of spatial resolution. Deblurring is useful for various reasons: first, it helps to restore high frequency components lost through the smoothing effect of the instrument s PSF; second, emissions at various frequencies observed with different resolutions can be better studied on a comparable resolution; third, some map-based component separation algorithms require maps with similar level of degradation. Because of computational efficiency, deblurring is usually done in the frequency domain. But this approach has some limitations as it requires spatial invariance of the PSF, stationarity of the noise, and is not flexible in the selection of more appropriate boundary conditions. Deblurring in real space is more flexible but usually not used because of its high computational cost. In this paper (the first in a series on the subject) we present new algorithms that allow the use of real space deblurring techniques even for very large images. In particular, we consider the use of Tikhonov deblurring of noisy maps with applications to PLANCK. We provide details for efficient implementations of the algorithms. Their performance is tested on Gaussian and non-gaussian simulated CMB maps, and PSFs with both circular and elliptical symmetry. Matlab code is made available. Key words. Methods: data analysis Methods: statistical Cosmology: cosmic microwave background 1. Introduction During the last decade, observations of the Cosmic Microwave Background (CMB) anisotropies have progressed significantly. After the first evidence of CMB intensity fluctuations measured by the COBE satellite (see Smoot 1999, and references therein), several balloonborne and ground based experiments have successfully detected CMB anisotropies at degree and sub-degree angular scales (de Bernardis et al. 22; Halverson et al. 22; Lee et al. 21; Padin et al. 21). The MAP satellite 1 Send offprint requests to: R. Vio 1 currently in operation will soon provide full sky maps of CMB anisotropies at about 2 arcmin. resolution and a sensitivity of the order of 1 µk, on a frequency range extending from 22 to 9 GHz. This extraordinary experimental enterprise will be followed by the PLANCK satellite, scheduled for launch in 27 2, that will provide full sky maps of total intensity and polarization of CMB anisotropy at a few arcmin. resolution, and a sensitivity of a few µk, on nine frequency channels ranging from 3 to 87 GHz. These new sets of observations will pose new and challenging questions in data analysis. Methods will have to be 2

2 2 R. Vio, J.G. Nagy, L. Tenorio et al.: Digital Deblurring of CMB maps developed to process the large amount of incoming data, and to extract and separate cosmological information from foreground emissions from extra-galactic sources as well as from our own Galaxy. An important question is the creation of sky maps based on small angular scale time ordered data from all-sky CMB observations of MAP and PLANCK; efficient map-making algorithms based on a maximum likelihood approach have been proposed (Natoli et al. 21; Borrill et al. 21; Stompor et al. 22). Regarding the separation of emissions coming from different astrophysical processes, multifrequency observations can be exploited. For example, available prior information about the signals can be used in a regularised inversion via Wiener filtering and maximum entropy methods, either on small sky patches (Hobson et al. 1998) or on the whole sky (Bouchet & Gispert 1999; Stolyarov et al. 22). It has been shown that under certain independence assumption on the signals, the map-operating algorithms based on Independent Component Analysis (ICA) techniques can be applied on sky patches (Baccigalupi et al. 2) as well as on the whole sky (Maino et al. 22). Inthispaperwestudyadifferentproblem.Weconsider the effects of the beam of the instrument used to gather the observations. We present efficient numerical methods to estimate the emission pattern lost through the degradation of the instrument s point spread function (PSF) and noise contamination. This deblurring process may prove very useful in CMB data analyses: first, it helps recover high frequencies smoothed out by the instrument s PSF. Second, a better understanding of sky emissions, from foregrounds in particular, is achieved if multifrequency sky maps are compared on a common resolution. Third, some map-based component separation algorithms, such as ICA (Baccigalupi et al. 2; Maino et al. 22) require input maps with similar level of degradation. Furthermore, although the aim of satellite missions such as Planck and MAP is to obtain full sky maps of the CMB, the strength of the CMB over other backgrounds or contaminating sources will vary over the sky. Therefore, even if some characteristics of CMB are estimated on full sky maps, it will be convenient to check these results on smaller sky patches where CMB dominates the other components (e.g., at high Galactic latitude and at high observing frequency) and data are free from instrumental and/or observational problems. Most deblurring of CMB data has been done in frequency space, (see Hobson et al. 1998; Stolyarov et al. 22). This approach is computationally efficient but has some important limitations; it requires the stationarity of the contaminating noise and the spatial invariance of the PSF. Furthermore, it implicitly assumes periodic boundary conditions which, as we show below, is not necessarily the best choice. Tikhonov regularization provides a more flexible real domain deblurring technique that can be used when any of these assumptions are not met. Until recently, Tikhonov deblurring was avoided becauseofits computationalcost.forexample,for ann N pixelimageinthefrequencydomainoneworkswith N N matrices, while in the spatial domain the matrices are of dimensionn 2 N 2.However,newefficientalgorithmsthat overcome this problem have made Tikhonov deblurring a competitive alternative to frequency domain techniques. Inthisfirstpaper,wepresentsomeofthesealgorithmsand show their good performance not only in regards to their computational cost but also in regards to their numerical stability, which is an important characteristics in any ill-posed inversion problem. Furthermore, we will present some preliminary results concerning the deblurring for the case of spatially varying PSFs. A detailed treatment of this problem will be provided in a future paper. Therestofthepaperisorganizedasfollows.InSects.2 and 3 we provide a formal definition of the map-based deblurring process, focusing on boundary conditions and numerical issues. In Sect. 4 we discuss a regularization approach that is efficient and flexible for deblurring noisy maps; results of numerical experiments are provided in Sect.. Our first application to a realistic map is presented in Sect. 6, where we consider a region in the sky (already addressed by Baccigalupi et al. 2) in which the CMB emission largely dominates over foregrounds. We will assume observational conditions, frequencies, angular resolution and noise level corresponding to the Low Frequency Instrument (LFI) of the PLANCK satellite. Further simulations are presented in Sects. 7 and 8 where we consider non-gaussian random fields and spatially varying PSFs. In Sect. 9 we close with final comments and conclusions. 2. Formalization of the problem When a two-dimensional object f(ξ, η) is observed through an optical (linear) system, it is seen as an image g(x,y) g(x,y) = + + h(x,y,ξ,η)f(ξ,η) dξ dη, (1) where the function h(x, y, ξ, η), called a point-spread function (PSF), represents the blurring action of the optical instrument. Model (1) allows the PSF to vary with position in both(x, y) and(ξ, η) variables(space-variant PSF). Often, it is possible to simplify this model by assuming that the PSF is independent of position (space-invariant PSF), and thus g(x,y) = + + h(x ξ,y η)f(ξ,η) dξ dη. (2) Another useful simplification occurs when PSF is separable, which means that it can be written in the form h(x,y,ξ,η) = h 1 (x,ξ) h 2 (y,η), (3) for the space-variant PSF, and h(x ξ,y η) = h 1 (x ξ) h 2 (y η), (4)

3 R. Vio, J.G. Nagy, L. Tenorio et al.: Digital Deblurring of CMB maps 3 for the space-invariant PSF. In this case models (1), (2) can be simplified to + + g(x,y) = h 1 (x,ξ) h 2 (y,η)f(ξ,η) dη dξ, () and g(x,y) = + h 1 (x ξ) + h 2 (y η)f(ξ,η) dη dξ, (6) respectively. We see that separability of the PSF implies independent blurring along the horizontal and vertical directions. Models (1), (2), (), and (6) are only theoretical. In practical applications, we only have discrete noisy observations of the image g(x,y), which we model as a discrete linear system g = Hf +z. (7) Here, g = vec(g) and f = vec(f) are one-dimensional, column arrays containing, respectively, the observed image G and the true images F in stacked order 3, z is an array containing the noise contribution (assumed to be of additive type), and H is a matrix that represents the discretized blurring operator. By image deblurring we mean solving for f given the linear system (7). This process is not trivial for the following reasons: 1. Images are available only in a finite bounded region. However, points near the boundary are affected by data outside the field of view. 2. If the observed image is an N N matrix, then f, g, and z are N 2 1 vectors and H is an N 2 N 2 matrix. This means that even forsmall images(e.g., N = 12), the matrix H can be quite large. 3. The models (1), (2), (), and (6) are particular examples of a class of integral equations which are well known to be ill-posed (Wing & Zahrt 1991). This implies that the matrix H is severely ill-conditioned and standard techniques that do not take this into account are likely to fail. Points (1) and (2) are addressed in Sect. 3, and point (3) in Sect Numerical issues in image deblurring 3.1. Boundary conditions To resolve the difficulty of points near the image boundary being affected by data outside the field of view, we have to impose some boundary conditions. In image processing, one of the following three boundary conditions is (either explicitly or implicitly) typically made: 3 We recall that for a N M matrix P, vec(p) = (p T 1 pt 2... pt M )T with p i the i-th column of matrix P. Periodic boundary conditions imply that the image repeats in all directions. That is, we assume the image X has been extracted from a larger image that looks like: X X X X X X X X X Zero boundary conditions imply that the scene outside the borders of the image X are all zero. That is, we assume the image X has been extracted from a larger image of the form: X Reflexive boundary conditions model the scene outside the image boundaries as a mirror image of the scene inside the boundaries. That is, we assume the image X has been extracted from a larger image that looks like: X rc X r X rc X c X X c X rc X r X rc where X c is obtained by flipping the columns of X, X r is obtained by flipping the rows of X, and X rc is obtained by flipping the rows and columns of X. For a spatially invariant PSF, each of these choices imposes a particular kind of structure on the matrix H. To describe these structures we need the following notation: An N N matrix with entries that are constant on each diagonal is called a Toeplitz matrix, and it can be written as: h h 1 h 2 h 1 N h 1 h h 1 h 2 N h 2 h 1 h h 3 N. (8) h N 1 h N 2 h N 3 h If an N N Toeplitz matrix has the additional property that each column (and row) is a circular shift of its previous column (row), then it is called a circulant matrix and it has the form: h h N 1 h N 2 h 1 h 1 h h N 1 h 2 h 2 h 1 h h 3. (9) h N 1 h N 2 h N 3 h An N N matrix with entries that are constant on each anti-diagonal is called a Hankel matrix. It can be written as: h h 1 h 2 h N 1 h 1 h 2 h 3 h N h 2 h 3 h 4 h N+1. (1) h N 1 h N h N+1 h 2N 2

4 4 R. Vio, J.G. Nagy, L. Tenorio et al.: Digital Deblurring of CMB maps In two-dimensional applications, such as image deblurring, the matrix H is usually represented in block form. In this case, we need to specify the block structure of the matrix, as well as the structure of each block. For example, if a matrix has the form: H H 1 H 2 H 1 N H 1 H H 1 H 2 N H T = H 2 H 1 H H 3 N, (11) H N 1 H N 2 H N 3 H where each {H i } is an N N matrix, then we say H T is a block Toeplitz matrix. If, in addition, each {H i } is itself a Toeplitz matrix, then we sayh T is a block Toeplitz matrix with Toeplitz blocks. Note that we can combine any number of structures. In this paper, we need the following combinations: BTTB (block Toeplitz with Toeplitz blocks). BCCB (block circulant with circulant blocks). BHHB (block Hankel with Hankel blocks). BTHB (block Toeplitz with Hankel blocks). BHTB (block Hankel with Toeplitz blocks). With this notation, we can precisely describe the structure of H for each of the boundary conditions: With periodic boundary conditions H is BCCB. With zero boundary conditions H is BTTB. With reflexive boundary conditions H is a sum of BTTB, BTHB, BHTB and BHHB matrices. (Each of these matrices takes into account, to some extent, contributions from X, X r, X c, and X rc, respectively.) Very often the choice of boundary conditions is considered secondary to the development of an efficient deblurring algorithm. In fact, in many situations the type of boundary conditions is implicitly imposed by the algorithm itself. For example, Fourier methods implicitly assume periodic boundary conditions. However, an improper selection of boundary conditions may introduce edge effects such as discontinuities, which appear as a slow decay of Fourier coefficients and Gibbs oscillations at the jump, which has obvious consequences on nongaussianity tests and reliable estimations of the regularization parameter (see below). Consequently, the choice of the boundary conditions must be considered an integral part of the deblurring operation and not merely a byproduct of some algorithm Numerical methods for the solution of large linear systems Even for a very large matrix H, there are characteristics of this matrix that make finding a solution of the system (7) feasible. For example: if H is a highly structured matrix, then it is not necessary to store all its entries. For instance, for a BTTB matrix it is sufficient to store the the first column and first row, whereas for a BCCB matrix it is enough to keep the first row. significant memory savings can also be achieved if most of the entries of H are zero, i.e. H is a sparse matrix. Both of these properties can be efficiently exploited to reduce the computational cost considerably. Further discussion of these issues can be found in Appendix B. 4. Numerical regularization From Eq. (1) it is clear the the instrument s PSF smooths out high frequency components of the signal, and thus high frequency information is lost. An important consequence of this is the lack of a unique solution of the linear system (7); any solution subjected to high frequency perturbations will fit the data g equally well. This makes the problem of recovering the signal f ill-posed. The illposedness also affects the stability of the solutions; a small perturbation of the data may result in a completely different solution. Mathematically, the system is ill-posed when the singular values of H decay to zero too fast. The larger the smoothing effect of the PSF the faster the decay of the singular values. Small singular values lead to solutions which fit the data but have very large energy; a property that is not easily justified (for other illustrative examples of ill-posedness see Hansen 1997; Tenorio 21). To find a stable meaningful solution we have to use a regularization method. Ill-posed problem can be regularized by imposing constraints on the unknown signal. For example, a bound on the energy or a smoothness constraint. This class of constraints can be easily implemented in the classical framework of Tikhonov regularization (Tikhonov & Arsenin 1977). The idea is to find a solution f λ that minimizes a weighted combination of data misfit (residual norm) and signal constraint: f λ = argmin ( Hf g 2 2 +λ 2 Lf 2 2), (12) where λ is a scalar quantity and L is, for example, the identity matrix (for energy bound) or a discrete derivative operator of some order (for smoothness constraint). The optimal smoothing functional for deconvolution operators on an infinite domain was determined by Aref eva (1974) (see also Cullum 1979) who showed that it is completely determined by the decay rate of the Fourier coefficients of the unknown function. Unfortunately, in real applications this result cannot be used directly because, in addition to data being available only on a finite domain, it requires the function one is trying to recover. In two-dimensional image processing applications, L is often chosen to be a discretized Laplace operator, which is defined as the second order partial derivative f(x,y) = 2 f x f y2. (13)

5 R. Vio, J.G. Nagy, L. Tenorio et al.: Digital Deblurring of CMB maps A discrete approximation can be implemented as a convolution of f with the kernel (Jain 1989, p.33) (14) 1 The implementation of this convolution and the precise form of the matrix L depend on the boundary conditions. In general, we have T 1 I T 3 I T 2 I L = I I I T 2 I T 3 I T 1, (1) where I is the identity matrix, and the matrices T 1, T 2 and T 3 depend of the boundary conditions: for periodic boundary conditions T 3 = I, T 1 = T 2 = , (16) for zero boundary conditions T 3 =, 4 1 T 1 = T 2 = , (17) 1 4 for reflexive boundary conditions T 3 =, T 1 = , (18) T 2 = (19) Other operators, such as first order derivatives, can be used for L (Jähne 1997). However, these operators have the disadvantage that they are typically applied in only one direction (e.g., x-derivative or y-derivative), and therefore are not isotropic. Nonlinear isotropic implementations are possible but they are computationally more expensive (Jähne 1997). In contrast, the Laplacian is an isotropic linear operator that can be efficiently incorporated into our algorithms (see Appendix B). In Eq.(12), the regularization parameter λ controls the weight given to the signal constraint relative to the data misfit. A good selection of λ is critical. A large λ favours a small solution norm at the cost of a large data misfit, while a small λ leads to data overfit. We next consider practical implementations to both solve problem (12) and estimate an optimal value of λ Numerical methods for Tikhonov map deblurring As previously mentioned, the image deblurring problem is severely ill-conditioned and regularization is needed in order to compute solutions that are not completely corrupted by noise. One approach is Tikhonov regularization, where the solution f λ is given by Eq. (12). Stable algorithms for computing this solution are usually developed by reformulating (12) as the damped least squares problem min f H ( λl ) ( ) g f. (2) 2 It is important to note that the Tikhonov method is just one approach that can be used for regularization but many other schemes may be used. For large scale image deblurring problems, iterative regularization methods, such as conjugate gradients, Landweber iteration, or expectationmaximization (sometimes referred to as Richardson- Lucy), are often recommended. Regularization is enforced through iteration truncation; that is, the iteration index acts as the regularization parameter. Although the specific details of various iterative methods may be different, they usually have the common property that the most computationally expensive operation at each iteration is matrix vector multiplications with H. For large scale image deblurring problems, these computations can be done very efficiently using fast Fourier transforms. A disadvantage with using iterative methods is that it is very difficult to determine when to stop the iteration; that is, how to choose a good regularization parameter. Many methods have been proposed, but they are usually most reliable when used in combination with an interactive visualization of the restorations computed at each iteration. Unfortunately, visualization of CMB maps does not provide an accurate assessment of the accuracy of the computed solution. In the case of Tikhonov regularization, choosing a regularization parameter λ is also a non-trivial issue. However, in comparison with stopping criteria for iterative methods, much more work has been done in this area (Engl et al. 2; Hansen 1997; Vogel 22). The generalized cross validation (GCV) method is probably the most well-known scheme for choosing a value for λ. In

6 6 R. Vio, J.G. Nagy, L. Tenorio et al.: Digital Deblurring of CMB maps Wiener Tikhonov FWHM(arc.min.) rrms(%) rrms(%) σ/σ λ ± ± ±.2 3 ± ± ± ±.2 ± ± ± ±.2 9 ± ± ± ±.2 9 ±.3 Table 1. Results of Tikhonov(with reflexive boundary conditions and discrete Laplacian for L) and Wiener deblurring of a Gaussian random field whose statistical properties are similar to those expected of the CMB sky observed with four channels of PLANCK-LFI for beams with circular symmetry. The field has been contaminated with 1 different realizations of a white noise process (S/N = 2). The dimensions of the map are pixels, which corresponds to a sky area of about 2 2. The relative root mean square (rrms) is defined as the ratio of the residual root mean square (rms) to the rms of the true signal. The third column shows the ratio of the noise standard deviation estimate σ defined by (A.4) to the true noise standard deviation σ. For the Tikhonov method, mean values and dispersions of the GCV estimates of λ are also shown. Wiener Tikhonov FWHM(arc.min.) rrms(%) rrms(%) σ/σ λ ±2 3.66±.66.96±.2 4± ± ±.96±.2 7± ± ±.92.9±.3.8± ± ±1.7.93±.3.81±. Table 2. As in Table 1 with the only difference that a new Gaussian random field is generated for each simulation. Wiener Tikhonov FWHM(arc.min.) rrms(%) rrms(%) σ/σ λ 1 3.2± ±.68.91±.3 3± ± ±.91±.3 6± ± ±.91.9±.4 9± ± ±1.4.89±.4.81±. Table 3. As in Table 2 but with a PSF of elliptical symmetry. The first column provides the FWHM along the major axis that is 1.3 times the FWHM along the minor axis. Axes of the PSF are parallel to the edges of the maps. this scheme, λ is chosen to minimize the GCV function GCV(λ) = Hf λ g 2 2/n [trace(i H(λ))/n] 2, (21) where H is the matrix that defines the estimator of Hf, i.e., Hg = Hf λ, and n is the number of pixels in the image. For Tikhonov regularization H(λ) = H(H T H +λ 2 L T L) 1 H T. (22) The development of the GCV method is based on the assumption that a good value of the regularization parameter should predict missing data values (see Appendix A and Golub et al. 1979). An additional argument for using Tikhonov regularization with GCV is that both have been well studied, and various authors have found this combination of regularization and parameter choice method to be very robust (Thompson et al. 1991; Hanke & Hansen 1993; Hansen 1997; Vogel 22). In Appendix B we describe how to efficiently compute both the minimum of the GCV function (thus computing the regularization parameter) and the solution of the least squares problem (2).. Numerical experiments We have used Monte Carlo simulations to check the reliability and performance of the methodology presented in the previous sections. The simulations have been conducted under two different scenarios. We first fix the sky and generate different realizations of the noise process. Then, to account for the variability of the random field, we simulate different realizations of the random field and of the noise process. To keep the conditions of the experiment under control but still relate it to the CMB problem considered in the next section, we have used Gaussian random fields characterized by a correlation function that has been obtained from the correlation function of the CMB via an approximation with an exponential function (for the de-

7 R. Vio, J.G. Nagy, L. Tenorio et al.: Digital Deblurring of CMB maps 7 rms W/rms T FWHM(arc.min.) β = 1. β = β =.2 β =.1 β = Table 4. Ratio rms W /rms T for different values of the parameter β that increases the correlation length (see text). tails about the parameters used for CMB see Sect. 6). A dominating CMB component is a good approximation to real sky maps at least at medium and high Galactic latitudes where the effects of diffuse foregrounds from our Galaxy can be neglected (see Maino et al. 22, and references therein). The PSFs used in the experiments are Gaussians with FWHM similar to that expected for the PLANCK-LFI instrument. However, since the exact form of the observing beam has not yet been determined with sufficient accuracy, we have tried two different scenarios: PSFs having circular and elliptical symmetry. For the latter, the FWHM along the major axis is set to 1.3 times the FWHM along the minor axis. The axes of the beams are parallel to the edges of the maps. Since the random field is Gaussian and stationary and the noise is assumed white, classical Wiener filtering is expected to provide the smallest mean square error among linear filters. However, this filter requires knowledge of the spectrum of the unknown signal which is not available in practice. We use Wiener deblurring as a sort of benchmark to assess the performance of Tikhonov methods. Simulations were done using reflexive, periodic and zero boundary conditions and with two different types of penalty matrix L, the identity matrix and the discrete approximation of the second derivative operator (note that realizations of a random field are smooth under mild regularity conditions on the correlation function, e.g., Adler 198). However, since reflexive boundary conditions and the Laplacian operator have systematically provided better performance, only results concerning this combination are presented. In particular, we have found that the choice of the boundary conditions is a critical factor. In fact, not only have the results been systematically worse with zero and periodic boundary conditions, but with the latter we have also encountered stability problems in the estimation of the regularization parameter. These effects are the result of discontinuities introduced by zero and periodic boundary conditions; a problem that is much less important for reflexive boundary conditions (Ng et al. 1999). The results of the simulations are shown in Tabs. 1 and 2 for circularly symmetric PSFs, and in Table 3 for PSFs with elliptical symmetry. Note that GCV estimates of the optimal value of λ are stable with respect to both noise and different realizations of the random field. This is an important indication of the reliability of the methodology. It is well known, however, that GCV estimates may occasionally give very small values of λ resulting in an under-smoothed solution, this problem can be easily corrected using a procedure defined in Appendix A. The same tables also show the mean value of the relative root mean square (rrsm) error, defined as f f λ 2 / f 2. As expected, the error increases with the FWHM ofthe beam.therrmserrorindicatesthatwiener and Tikhonov deblurring (with reflexive boundary conditions and and discrete Laplacian) give comparable results. The advantage of the latter is that it does not require the spectrum of the unknown signal. That is, the smoothness constraint and the spectrum information provide similar results. (Note that since the Wiener filter has been implemented using the Fourier transform, only periodic boundary conditions were used for Wiener deblurring.) The third column in the tables compares estimates of the noise standard deviation obtained using (A.4), a formula which arises naturally in the Tikhonov framework, to its true value σ. These estimates are necessary to construct confidence intervals or test hypotheses. An overestimate of σ indicates under-smoothing of the signal estimate while an underestimate indicates over-smoothing. We see that Tikhonov provides reasonably good estimates of σ. An important difference between Wiener and Tikhonov filters is that the former provides deblurred estimates assuming that f is a realization of a process with a particular spectrum, while the latter relies on the particular fixed realization of f on which the data are based. In particular, the Wiener filter minimizes an error over all possible realizations of the signal while the Tikhonov filter assumes the signal is fixed. This means that while Wiener filtering relies on knowledge of the spectrum of the process to approximate the optimal filtering, Tikhonov uses the data to obtain an estimate of the signal s Fourier transform. Wiener filtering may thus give misleading results when the available realization of the signal is in the tail of the process distribution or when the particular realization of f happens to be somewhat unusual for the process, as it may happen when the assumed spectrum is incorrect. To illustrate this point, we repeated the simulations conducted for Table 1 but chose the initial sky realization from a process with successively larger correlation lengths; that is we incorrectly specified the spectrum required by Wiener filtering by multiplying the exponent of the correlation function by β. Table 4 shows the ratio rms W /rms T of the rms error of the Wiener and Tikhonov deblurred

8 8 R. Vio, J.G. Nagy, L. Tenorio et al.: Digital Deblurring of CMB maps Fig.1. Grayscale image of the simulated sky maps at 3 GHz (see text). Each map contains square pixels with side of 3. for a total area of about 2 2. estimates for different values of β. The results show that Tikhonov deblurring may provide better estimates when the spectrum is incorrectly specified. 6. A CMB application We now present tests of the deblurring technique on simulated observations of the PLANCK-LFI. The region analysed is almost identical to the one in Baccigalupi et al. (2): it is a squared patch (34 34 pixels) with side of about 2, centered at l = 9, b = 4 (Galactic coordinates). The latitude is high enough that CMB emission dominates over foregrounds, assumed to be represented by synchrotron (Haslam et al. 1982) and dust (Schlegel et al. 1998) emission. We neglect contributions of point sources. The CMB model, in agreement with current experimental results (de Bernardis et al. 22; Halverson et al. 22; Lee et al. 21), corresponds to a flat Friedmann-Robertson-Walker (FRW) metric with a cosmological constant (7% of the critical density), Hubble parameter today H = 1h km/sec/mpc with h = baryonsat%andcolddarkmatter(2%cdm), with a scale-invariant Gaussian initial spectrum of adiabatic density perturbations. The PLANCK-LFI instrument works at frequencies 3, 44, 7, and 1 GHz. We assume nominal noise and angu- Fig.2. Same as Fig. 1 but at 44 GHz (see text). lar resolution 4. The maps are blurred through Gaussian PSF s with circular symmetry and appropriate FWHM s (i.e., 33 at 3 GHz, 23 at 44 GHz, 14 at 7 GHz, 1 at 1 GHz) and summed up together with simulated white noise with rms level as expected for the considered channels. Since we choose to work with a pixel size of about 3. arcminutes, the noise rms are.42,.49,.42 and.43 mk in antenna temperature at 3, 44, 7, 1 GHz, respectively. The original maps are shown in Figs. 1-4 together with the blurred, blurred plus noise, and deblurred versions (Tikhonov method with reflexive boundary conditions and discrete Laplacian for L). The deblurred maps look reasonably good despite the high noise level. But, as expected, there is a clear loss of high frequencies, especially for the lowest frequency maps. This loss, which is intrinsic to any deblurring operation, is important given the high noise level. For example, Figs. -7 show, respectively, the two-dimensional auto-correlation function of the original maps and their two-dimensional cross-correlation functions with the blurred (but noise-free) and the deblurred maps. These figures show that the deblurring operation provides good results for the lowest contour levels (those mainly determined by the lowest frequencies) and worse results for the highest contour levels ( those determined mainly by the highest frequencies). The same effect can 4

9 R. Vio, J.G. Nagy, L. Tenorio et al.: Digital Deblurring of CMB maps 9 Fig.3. Same as Fig. 1 but at 7 GHz (see text). Fig.4. Same as Fig. 1 but at 1 GHz (see text). also be seen in Fig. 8, which shows a one-dimensional cross-section of the power-spectrum of the original 3 GHz and of the deblurred maps. The performance of the deblurring procedure can be also checked through the angular power spectrum, which, as usual, is defined by the expansion coefficients C l of the two point correlation function in Legendre polynomials. Here l is the multipole associated to an angular scale of about 18/l degrees. Consequently, our analysis applies to l ranging from l 2, corresponding to the degree scale (larger angles are poorly probed due to the finite extension of our patches), up to multipoles corresponding to the instrumental resolution at each frequency. Estimates of the C l coefficients for the original, blurred, blurred noisy, and deblurred maps are shown in Figs Four CMB acoustic peaks are clearly seen in the original spectrum at l 2,,8,11. Since we are analysing a limited part of the sky, sample variance causes oscillations in the coefficients, with increasing amplitude as the angular scale approaches the size of the patch, corresponding to the low multipole tail. As shown in the top panels of Figs. 9-12, the C l are increasingly affected as the frequency decreases; the increasing tail at high multipoles is the effect of the instrument noise. In all four cases the deblurring procedure has two main effects. First, it restores amplitude and shape of the part of the spectrum not dominated by effects of instru GHz GHz GHz GHz Fig.. Contour plot of the two-dimensional autocorrelation function of the original simulated CMB maps. in pixels. mentnoiseandpsf.second,asexpectedfromfigs.-7, it reconstructspartofthepowerwherethepsfcausesamajor degradation. In the 3 GHz case, the reconstruction is better in the multipole range 3 l 4. Similarly, at 44 GHz, anisotropy power is reconstructed up to l,

10 1 R. Vio, J.G. Nagy, L. Tenorio et al.: Digital Deblurring of CMB maps GHz GHz Power Original 3 GHz Power Original 3 GHz GHz GHz Power Deblurred 3 GHz Frequency Power Deblurred 3 GHz Frequency Fig. 6. Contour plot of the two-dimensional crosscorrelation function of the original with the deblurred CMB maps. in pixels GHz GHz Fig. 8. One-dimensional cross-section of the twodimensional Power-spectra in two different frequency ranges of the original 3 GHz and the deblurred CMB maps (see text). Frequency is in Nyquist units. 1 7 GHz GHz Fig. 7. Contour plot of the two-dimensional crosscorrelation function of the original with the blurred noisefree CMB maps. in pixels. Fig. 9. Angular power spectrum in different steps of the analysis at 3 GHz. In the top left panel the plot also shows the shape of the instrumental PSF in harmonic space (dotted line). and up to l 7 at 7 GHz. Finally, at 1 GHz part of the original power is recovered up to l 8. Repeting the same simulations with PSFs of elliptical symmetry gives similar results. In Summary, in all four channels the deblurring procedure was effective in recovering spectral properties of the maps. Although these results have been obtained under the restrictive assumptions of white noise, the characteristics of the deblurring procedure shown above are encouraging and deserve more attention and development in future work. A last comment regarding component separation. In principle, the separation can be obtained if maps of the same regions are available at different frequencies (Maino et al. 22; Hobson et al. 1998). In practice, this problem is technically difficult and is far from being solved. Its treatment is beyond the scope of this paper, but the important point is that maps must have the same spatial resolution in order to carry out the separation. This does not imply, however, that maps have to be deblurred to a common resolution. One can also achieve a common resolution by blurring (smoothing). That is, we take Eq. (7) and apply a frequency dependent smoothing operator S to both sides g = Sg = Sf +Sz = f + z. (23) Component separation can be done using the different estimates of f obtained by smoothing the maps of different

11 R. Vio, J.G. Nagy, L. Tenorio et al.: Digital Deblurring of CMB maps 11 case we have considered before with the difference that this time the noise z is correlated due to the effect of S. Depending on the noise structure, one may be able to model correlated noise in Tikhonov regularization using what is known as mixed effects models, some examples can be found in Ma & Gu (22) and Robinson (1991). If the noise is stationary, one can deconvolve in the frequency domain but again, when the signal spectrum is unknown we may want to regularize the problem using Tikhonov in the frequency domain. Fig.1. Same as Fig. 9 but at 44 GHz. Fig.11. Same as Fig. 9 but at 7 GHz. frequencies. But without prior information on f the best linear estimates are simply the maps g. To include some prior information we can use smoothness constraints via Tikhonov regularization. The problem thus reduces to the 7. An example of deblurring effects on non-gaussianity An important point in CMB research is the detection of non-gaussianity. It is therefore of interest to check the effects of the deblurring procedure on the non-gaussian characteristics of a map. Experimental results have not yet found any evidence of non-gaussianity in CMB maps. It is even difficult to conduct realistic simulations of non-gaussian CMB maps since it is not clear what type of non-gaussian behavior one should lookfor.as an example, weconsiderthe effects of deblurring on the marginal distribution of a particular homogeneous non-gaussian random field whose marginal distribution is slightly different from a Gaussian (skewness.22 and kurtosis.11 see Fig. 13). The field has the same autocorrelation function, PSF (with circular symmetry) and S/N of the Gaussian fields simulated in Sect.. Realizations of this field are simulated via the method presented in Vio et al. (21). Skewness and kurtosis coefficients (normalized to be zero for a Gaussian distribution) are calculated for each simulation. Table presents the average change, from the original values, in skewness and kurtosis over 1 simulations. As expected, noise and blurring have the effect of Gaussianizing the random fields (i.e., the estimated skewness and kurtosis are closer to zero than the original values), with obvious consequences on the response of any non-gaussianity test. Deblurring noticeably improves estimates. These results, together with the power spectrum reconstruction discussed before, provide a further indication of the usefulness of deblurring in the analysis of CMB maps. Fig.12. Same as Fig. 9 but at 1 GHz. 8. An example of deblurring with spatially varying PSF Although the PSF of PLANCK s instrument is designed to be spatially invariant, this condition may change after launch, and there may be other experiments that require more general deblurring methods that can be used with spatially varying PSF. In principle, a real space approach to restoring an image degraded by a spatially variant PSF can be developed, but in practice the methods are quite difficult to chong

12 12 R. Vio, J.G. Nagy, L. Tenorio et al.: Digital Deblurring of CMB maps map skewness kurtosis 3 GHz, blurred.2 ± ± GHz, blurred noisy.98 ± ±.4 3 GHz, deblurred.3 ± ±.4 44 GHz, blurred.38 ± ± GHz, blurred noisy.88 ± ± GHz, deblurred.3 ± ±.42 7 GHz, blurred.24 ± ±.3 7 GHz, blurred noisy.78 ± ±.18 7 GHz, deblurred.24 ± ±.32 1 GHz, blurred.18 ± ±.38 1 GHz, blurred noisy.74 ± ±.2 1 GHz, deblurred.22 ± ±.27 Table. Mean and standard deviation of the difference between the skewness and kurtosis coefficients of the blurred, blurred+noise, and deblurred non-gaussian maps with respect to corresponding values (respectively.22 and.11) of the original map (see text). The results are based on 1 simulations with S/N = 2. implement. Indeed, efficient implementations are currently available for iterative methods (Nagy & O Leary 1997), but direct algorithms similar to those presented in previous sections for invariant PSFs have not been developed yet. We are presently working on this problem. To illustrate the importance of pursuing this work, we present some simulation results that use an iterative method to restore an image blurred by a spatially variant PSF. As claimed in Sect. 4.1, one ofthe most seriousdifficulties with iterative methods is in the choice of an appropriate stopping criteria. Though methods such as the discrepancy principle, L-curve and GCV can be used, our success with these approaches on CMB maps has been marginal. Without an efficient method for choosing a regularization parameter, or for determining an appropriate stopping criteria, iterative methods may not be the ideal choice for CMB maps. However, because matrix-vector multiplications with H and H T (the most expensive part in the iteration procedure) can be done efficiently for spatially varying PSF (Nagy & O Leary 1997), iterative methods do give us a means of determining if better restorations can be obtained with a spatially varying model. To construct a test example, we have used a PSF that changes linearly across the map as shown in Fig. 14. Deblurring was done using a standard conjugate gradient iterative method (Hansen 1997), stopping the iteration when the computed restoration is closest, in a mean square sense,to the true image.thematrix H modellingthe spatially varying PSF is constructed by assuming that it is approximately spatially invariant in small regions. If the corresponding, spatially invariant matrix defined by the PSF in the ith region is H i, then the spatially varying matrix H is defined as H = m D i H i, i=1 where the matrices D i are nonnegative diagonal and Di = I, where I is the identity matrix. Note that using this H is equivalent to interpolation to match the individual PSFs across the different patches. For example, for piecewise constant interpolation the jth diagonal entry of D i is 1 if the jth pixel is in region i, and otherwise. Efficient matrix vector multiplications with H and H T exploitthesparsityofd i andthespatiallyinvariantstructure of H i. The implementation details are tedious to describe; we only mention here that the basic idea is related to overlap-add and overlap-save convolution methods, and refer the interested reader to (Nagy & O Leary 1997) for a description of the algorithms, and to (Lee et al. 22) for a Matlab implementation. The matrix H in our simulations was constructed through piecewise constant interpolation of 121 PSFs uniformly distributed across the map. The computed spatially varying restoration and the corresponding spatially invariant restoration are shown in Fig. 1. We have used a signal to noise ratio of S/N = 4 because the iterative procedure is more sensitive to noise than direct methods. Despite these limitations, Fig. 14 shows the advantage of deblurring with a spatially varying PSF. 9. Discussion and conclusions We have considered Tikhonov regularization for deblurring CMB maps in real space. Although more demanding from the computational point of view, this approach permits the development of algorithms that are more flexible and robust than those based on frequency-space methods. Furthermore, as shown in Fig. 16, the computational cost can be significantly reduced by carefully implementing the algorithms to take advantage of the characteristic structure of the matrices involved. We have applied the Tikhonov methodology to simulated skies at typical CMB frequencies. We considered test signals with known statistics, as well as realistic simulations of the CMB sky contaminated by noise whose rms is that expected for the low frequency instrument aboard the PLANCK satellite. This case is particularly interesting for

13 R. Vio, J.G. Nagy, L. Tenorio et al.: Digital Deblurring of CMB maps 13.4 SB Gaussian ( 1, 1 ) ( 1, 17 ) ( 1, 34 ).2 ( 17, 1 ) ( 17, 17 ) ( 17, 34 ) PDF(x) ( 34, 1 ) ( 34, 17 ) ( 34, 34 ) x Fig. 13. Probability density function used in the simulation of the non-gaussian random fields (see text). It corresponds to a SB distribution belonging to the Johnson s parametric family (see Vio et al. 1994). application of a deblurring procedure, as the instrument observes the sky at 3, 44, 7 and 1 GHz with very different PSFs of resolution 33, 22, 14, 1 arcminutes. We analysed the effects of the deblurring procedure by studying different characteristics of the restored image. Contour plots of the two-dimensional cross-correlation functions of the original and the deblurred maps show that the algorithm effectively improves the resolution, especially that of the worst resolution channels at 3 and 44 GHz. The same effect can be seen in the multipole coefficients of the angular power spectra; the original power on angular scales hidden by the instrument s PSF is recovered on a significant range of multipoles. We also performed an example of skewness and kurtosis recovery by the deblurring procedure. Instrumental noise and PSFs generally have the effect of pushing skewness and kurtosis toward their Gaussian values; deblurring brings these values closer to their true non-gaussian ones. On the basis of these promising results, we plan to develop deblurring algorithms based on the methods we have presented. Since Satellite CMB experiments are able to perform all-sky observations, a robust deblurring procedure which is able to work on the whole sphere is conceivable. We also plan to test map based component separation techniques, requiring multifrequency data of the same resolution, on deblurred maps. Appendix A: Automatic choice of the regularization parameter We briefly describe some methods to estimate the smoothing parameter λ, which is an essential ingredient in Tikhonov regularization. For further discussions of this topic see Hansen (1997); Tenorio (21); Vogel (22). Fig.14. Some of the PSF s used in the experiment of the variant PSF described in the text. The couple of numbers in the header of each panel provides the coordinates of the pixels to which the displayed PSF corresponds. Each PSF is given by a two-dimensional Gaussian function with FWHM = 33 arcmin along the major axis and FWHM = 1 arcmin along the minor axis. The size of each panel is pixels. Sincethedatag arenoisyobservationsofhf,itseems reasonable to choose a value of λ that minimizes the predictive mean square error (PMSE), PMSE(λ) = 1 n Hf Hf λ 2. (A.1) But since f is unknown, we minimize instead a crossvalidation (CV) estimate of (A.1) obtained by plugging in (A.1) the data as a proxy for Hf and a leave-one-out estimate for Hf λ. The result can be written as CV(λ) = 1 n n i=1 ( ) 2 gi ĝ i,λ, (A.2) 1 H ii (λ) where H ii (λ) are the diagonal elements of the hat matrix (22) that maps g into ĝ λ = Hf λ. The CV estimate of λ is the value that minimizes CV(λ). The generalized cross-validation (GCV) function is a smoothed version of CV in which the diagonal elements of H(λ) are replaced by their average GCV(λ) = g ĝ λ 2 2 /n (1 traceh(λ)/n) 2. (A.3) Unlike cross-validation, GCV is invariant under orthogonal transformations of the data. A slight modification of GCV provides and estimate σ 2 of the noise variance σ 2 σ 2 = g ĝ λ 2 2 n traceh(λ). (A.4)

14 14 R. Vio, J.G. Nagy, L. Tenorio et al.: Digital Deblurring of CMB maps 7 6 CPU Time (sec.) Side Length (pixels) Fig.1. a) original map; b) map obtained by blurring the map in the previous panel with a PSF changing uniformly its orientation across the frame. Some of the PSF s are shown in Fig. (14). White noise has been added to the map (S/N = 4); c) map obtained by deblurring with the spatial variant method explained in the text. A set of 121 PSF s uniformly distributed across the map have been used; d) map obtained by deblurring with a spatially invariant PSF. The PSF used is that shown in uppermostleft panel in Fig. (14). The standard deviation of the difference between the deblurred and the true maps is.41 for the spatially varying PSF and.43 for the spatially invariant one. This is just a normalized residual sum of squares where the effective degrees of freedom is determined by the trace of H(λ). The L-curve method (Hansen 1997) is another way to determine a balance between goodness of fit and roughness. As λ > increases, the points C(λ) = ( g Hf λ, Lf λ ) (A.) define a convex curve on the plane that in the log-scale resembles the letter L. The selection of λ corresponds to the corner value where C(λ) has the highest curvature. In general, estimates of λ based on cross-validation are robust to small deviations from the homogeneous variance and Gaussian assumptions and, for large samples, converge to the optimal minimizer of the PMSE (Wahba 199). When the GCV function is almost flat around its Fig.16. CPU time (sec.) required by the full Tikhonov deblurring procedure of N N maps as a function of N. The PSF is the one used for the simulations of CMB maps at 3 GHz (circularly symmetric Gaussian FWHM 9. pixels). Similar results are obtained for elliptic PSF with FWHM = 9. and FWHM = 2.8 pixels along the major and minor axes, respectively, and whose orientations are parallel to the sides of the map. Experiments have been conducted with Matlab 6 on a Pentium IV - 1 GHz processor in a Windows 2 operating system. minimum, it may lead to very small values of λ (undersmoothing). A lower limit on λ that controls undersmoothing can be achieved by multiplying the trace term in (A.3) by a constant k > 1 (Friedman & Silverman 1989; Gu 22). The L-curve has not been studied as much as GCV but some studies seem to indicate that L-curve estimates have the same good properties of GCV and, in addition, may be more robust to correlated noise (Hansen 1997). Note, however, that Vogel (1996) has pointed out some convergence problems with L-curve estimates. Appendix B: Efficient implementation of the Tikhonov algorithms B.1. Exploiting the structure of H and L The efficiency of our approach to computing a minimum of the GCV function (21), and to solving the least squares problem (2), is based on exploiting structure of the matrices H and L. We assume that L is a structured matrix, such as given in Eq. (1). Fast algorithms for certain structured matrices arising in image deblurring are well known. For example, when using periodic boundary conditions with a spatially invariant blur, the matrices H and L are BCCB, and therefore have the spectral factorizations H = F ΣF, L = F F. (B.1)