arxiv: v1 [stat.ap] 17 Sep 2013

Transcription

1 Noname manuscript No. will be inserted by the editor) A Non-Local Means Filter for Removing the Poisson Noise Qiyu JIN Ion Grama Quansheng Liu arxiv: v1 [stat.ap] 17 Sep 013 the date of receipt and acceptance should be inserted later Abstract A new image denoising algorithm to deal with the Poisson noise model is given, which is based on the idea of Non-Local Mean. By using the Oracle concept, we establish a theorem to show that the Non-Local Means Filter can effectively deal with Poisson noise with some modification. Under the theoretical result, we construct our new algorithm called Non-Local Means Poisson Filter and demonstrate in theory that the filter converges at the usual optimal rate. The filter is as simple as the classic Non-Local Means and the simulation results show that our filter is very competitive. Keywords Non-Local Means Mean Square Error Poisson noise Oracle estimator Qiyu JIN Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, No. 800 Dongchuan Road, Minhang District, Shanghai 0040, China UMR 605, Laboratoire de Mathmatiques de Bretagne Atlantique, Université de Bretagne- Sud, Campus de Tohaninic, BP 573, Vannes, France Université Européenne de Bretagne, France Jiangsu Engineering Center of Network Monitoring, Nanjing University of Information Science & Technology, Nanjing 10044, China qiyu.jin008@gmail.com Ion Grama UMR 605, Laboratoire de Mathmatiques de Bretagne Atlantique, Université de Bretagne- Sud, Campus de Tohaninic, BP 573, Vannes, France Université Européenne de Bretagne, France ion.grama@univ-ubs.fr Quansheng Liu UMR 605, Laboratoire de Mathmatiques de Bretagne Atlantique, Université de Bretagne- Sud, Campus de Tohaninic, BP 573, Vannes, France Université Européenne de Bretagne, France School of Mathematics and Computing Sciences, Changsha University of Science and Technology, Changsha , China quansheng.liu@univ-ubs.fr

2 Qiyu JIN et al. 1 Introduction Noise is inevitable in any image device. A digital imaging system consists of an optical system followed by a photodetector and associated electrical filters. The photodetector converts the incident optical intensity to a detector current, i.e. photons to electrons. During the process, the true signals are contaminated by many different sources of noise. The Poisson noise appears in low-light conditions when the number of collected photons is small, such as night vision, medical imaging, underwater imaging, microscopic imaging, optical microscopy imaging and astronomy imaging. Such a noise is signaldependent, and requires to adapt the usual denoising approaches. The key challenge in Poisson intensity estimation problems is that the variances of the observed counts are different. As a result, many methods are introduced to transform the Poisson distributed noise to the data approximately Gaussian and homoscedastic. These methods are called Variance Stabilizing Transformations VST), such as Anscombe root transformation 1948 [4], and 1993 [6]), multiscal VSTs 008 [39]), conditional variance stabilization CVS) 006 [18]), or Haar-Fisz transformation 004 [15] and 007 [14]). Then we can deal with these data as Gaussian noise. Second, the noise is removed using a conventional denoising algorithm for additive white Gaussian noise, see for example Buades, Coll and Morel 005 [8]), Kervrann 006 []), Aharon and Elad and Bruckstein 006 []), Hammond and Simoncelli 008 [16]), Polzehl and Spokoiny 006 [34]), Hirakawa and Parks 006 [17]), Mairal, Sapiro and Elad 008 [7]), Portilla, Strela, Wainwright and Simoncelli 003 [35]), Roth and Black 009 [36]), Katkovnik, Foi, Egiazarian, and Astola 010 [1]), Dabov, Foi, Katkovnik and Egiazarian 006 [9]), Abraham, Abraham, Desolneux and Li-Thiao-Te 007 [1]), and Jin, Grama and Liu 011 [0]). After denoising, some inverse transformations, like Exact Unbiased Inverse EUI) 009 [8] and 011 [9]), are applied to the denoised signal, obtaining the estimate of the signal of interest. Many authors restore the Poisson noise by this type of methods with a three-step procedure see [7, 5, 6, 39] ). Maxmum Likelihood ML) estimation 1996 [38], 009[3]) and Similarity Measure SM) 006 [3]) are also found to be effective since they can account for the special properties of the Poisson distribution. Others methods like as Complexity-Penalized Likelihood Estimation CPLE) 000 [33], 005 [3]) and Total Variation TV) seminorm 009 [5]), have been introduced to deal with the Poisson noise. Le et al. [4]) have adapted the successful ROF model for total variation regularization to deal with Poisson noise. The gradient descent iteration for this model replaces the regularization parameter with a function. The Non-Local Means Filter has been proposed by Buades et al 005 [8]) to denoise images damaged by additive white Gaussian noise. It is based on the similarity phenomenon existing very often in natural images, and assumes that there is enough redundant information pixels having identical noise-free value) in the image to reduce the noise significantly. This filter is known to efficiently reduce the noise and to preserve structures. Some authors see 008

3 A Non-Local Means Filter for Removing the Poisson Noise 3 [7], 010 [10]) combine the Non-Local Means method with other methods to restore the Poisson noise. Deledalle et al. 010 [10]) proposed an extension of the Non-Local Means for images damaged by Poisson noise. It is based on probabilistic similarities to compare noisy patches and patches of a preestimated image. In this paper, a new image denoising algorithm to deal with the Poisson noise model is given, which is based on the idea of Non-Local Mean. Our main idea is as follows: we first obtain an Oracle estimator by minimized a very tight upper bound of the Mean Square Error with changing the size of search window. The Oracle estimator depends on the unknown target function original image), whose concept is developed in Donoho and Johnstone [11]. So the Oracle estimator is not computable, but it can help us to find an available algorithm in mathematic theory. We second establish a theorem by the concept of the Oracle to show that the Non-Local Means Filter can effectively deal with Poisson noise with some modification. Finally, replacing the unknown target function by some estimators, we construct our new algorithm called Non-Local Means Poisson Filter and demonstrate in statistic theorythat the filterconvergesatthe usualoptimal rate.the filter is assimple as the classic Non-Local Means and the simulation results show that our filter is very competitive. The remainder of this paper is organized as follow: we first introduce an Oracle estimator for Poisson noise based on the idea of Non-Local Means, and present a theorem to show the rate of convergence of the Oracle estimator in Section. We second construct an adaptive estimator according to the Oracle estimator and obtain some convergence theorems of the estimator in Section 3. Finally, we demonstrate in Section 4 the ability of approach at restoring image contaminated by Poisson noise with a brief analysis. The Oracle estimator.1 Some notations We suppose that the original image of the object being photographed is a integrable two-dimensional function fx), x 0, 1] 0, 1]. Let the mean value of f in a set B x be ΛB x ) = N B x ft)dt. Typicallyweobservea discretedatasetofcountsy = {NB x )}, where NB x ) is a Poissonrandom variableofintensity ΛB x ). We consider that if B x B y =, then NB x ) is independent of NB y ). Suppose that x = x 1),x ) ) I = { 1 N, 1 N,,1}, and B x = x 1) 1/N,x 1) ] x ) 1/N,x ) ]. Then {B x } x I is a partition of the square 0,1] 0,1]. Using this partition we get a discrete function fx) = ΛB x ), x I. The denoising algorithm aims

4 4 Qiyu JIN et al. at estimating the underlying intensity profile discrete function fx) = ΛB x ). Theimagefunction f is consideredtobe constantoneachb x, x I.Therefore fx) = NB x ), x I. Furthermore, we can estimate the integrable function p by the discrete function f. Let Yx) = NB x ), x I. 1) This model has been used effectively in many contexts. The Poisson noise model can be rewritten in the regression form Yx) = fx)+ǫx), x I, ) where ǫx) = NB x ) fx). It is easy to see that Eǫx)) = 0 and Varǫx)) = fx). Let us set some notations to be used throughout the paper. The Euclidean d ) 1 norm of a vector x = x 1,...,x d ) R d is denoted by x =. The i=1 x i supremum norm of x is denoted by x = sup 1 i d x i. The cardinality of a set A is denoted carda. For a positive integer N the uniform N N grid of pixels on the unit square is defined by I = { 1 N, } N 1,, N N,1. 3) Each element x of the grid I will be called pixel. The number of pixels is n = N. For any pixel x 0 I and a given h > 0, the square window of pixels U x0,h = {x I : x x 0 h} 4) 1 will be called search window at x 0. We naturally take h as a multiple of N h = k N for some k {1,,,N}). The size of the square search window U x0,h is the positive integer number M = Nh+1) = card U x0,h. 5) For any pixel x U x0,h and a given η > 0 a second square window of pixels U x,η will be called patch at x. Like h, the parameter η is also taken as a multiple of 1 N. The size of the patch U x,η is the positive integer m = Nη +1) = card U x0,η. 6). The Non-Local Means algorithm The Non-Local Means algorithm 005 [8]) can be described as follows. For any x I, f = x Iwx)Y x), 7)

5 A Non-Local Means Filter for Removing the Poisson Noise 5 where the weights wx) are given by wx) = e ρ x 0 x)/h / x Ie ρ x 0 x )/H, 8) with ρ x 0 = y U x0,η κy) Yy) YT x y) κy. ) y U x0,η Here H is a bandwidth parameter, U x0,η is given by 4), κy) > 0 are some fixed kernel, and T x is the translation mapping: T x : x 0 +y x+y 9) In practice the bandwidth parameter H is often taken as a linear function of σ see [8])..3 Oracle estimator In order to adapt the Non-Local Means algorithm to the Poisson noise, we introduce an Oracle estimator for details on this concept see Donoho and Johnstone 1994 [11])). Denote f h = wh Yx), 10) where w h x) = e ρ f,x x) 0 H x 0 ) / x U x0,h e ρ f,x x ) 0 H x 0 ) 11) with ρ f,x0 x) fx) fx 0 ), 1) Hx) is a control function subject to γ = inf{hx) : x I} > 0. 13) It is obvious that w hx) = 1 and w hx) 0. 14) Note that the function ρ f,x0 x) 0 characterizes the similarity of the image brightness at the pixel x with respect to the pixel x 0, therefore we shall call

6 6 Qiyu JIN et al. ρ f,x0 similarity function. The usual bias-variance decomposition cf. e.g. [1, 30, 37]) of the Mean Squared Error MSE) Efx 0 ) fh x 0)) 15) = wh x)fx) fx 0)) + wh x) fx) wh x) fx) fx 0) + w h x) fx). The inequality 15) combining with 1) implies the following upper bound Efx 0 ) f hx 0 )) gw hx)), 16) where gw) = wx)ρ f,x0 x) + wx) fx). 17) We shall define a family of estimates by minimizing the function gw h ) by changing the width of the search window. With a Poisson noise in low-light conditions, the upper bound of signal function is small, so we let Γ = sup{fx) : x I}. According to the similarity phenomenon existing very often in natural images, we suppose that the function f satisfies the local Hölder condition fx) fy) L x y β, x, y U x 0,h+η, 18) where β > 0 and L > 0 are constants, h > 0, η > 0 and x 0 I. The following theorem gives the rate of convergence of the Oracle estimator and the proper width h of the search window. Theorem 1 Assume that h = β+ ) 1 Γ 4βL n 1 β+ and γ > Lh β. Suppose that the function f satisfies the local Hölder condition 18) and f h x 0) be given by 10). Then Ef h x 0) fx 0 )) c 0 n β β+, 19) where c 0 = β+6 β+ Γ β β+ L 4 β+ β β β+. 0) For the proof of this theorem see Section 6.1. This theorem shows that at least from the practical point of view, it is justified to optimize the upper bound gw) instead of optimizing the risk Ef h x 0) fx 0 )) itself. The theorem also justifies that we can choose a small search window in place of the whole observed image to estimate a point, without loss of visual quality. That is why we only consider small search windows for the simulations of our algorithm.

7 A Non-Local Means Filter for Removing the Poisson Noise 7 3 Non-Local Means Poisson Filter 3.1 Construction of Non-Local Means Poisson Filter With the theory of Oracle estimator, we construct the Non-Local Means Poisson Filter. Let h > 0 and η > 0 be fixed numbers. Since fx) fx 0 ) = E Yx) Yx 0 ) fx 0 )+fx)), an obvious estimator of E Yx) Yx 0 ) is given by 1 Yy) YT x y), M y U x0,η where T x is given by 9), and fx 0 )+fx)) is estimated by fx 0 ), where fx 0 ) = 1 M fx). Define an estimated similarity function ρ x0 by ρ x 0 x) = 1 M y U x0,η Yy) YT x y) fx 0 ). 1) + The following theorem implies that it is reasonable to let ρ x0 x) be the estimator of ρ f,x0 x). Theorem Assumethat h = β+ ) 1 Γ 4βL ) n 1 β+ and η = c1 n α 1 β) + β+ < α < 1. Suppose that the function f satisfies the local Hölder condition 18) and ρ x 0 x) is given by 1). Then there is a constant c such that { P max ρ x0 x) ρ f,x 0 x) } c n α 1 lnn For the proof of this theorem see Section 6.. As a result, it is natural to define an adaptive estimator f h by f h x 0 ) = O n 1). ) ŵ h x)yx), 3) where ŵ h = e ρ x x) 0 H / x U x0,h e ρ x x ) 0 H. 4) and U x0,h given by 4).

8 8 Qiyu JIN et al. 3. Convergence theorem of Non-Local Means Poisson Filter Now, we turn to the study of the convergenceof the Non-Local Means Poisson Filter. Due to the difficulty in dealing with the dependence of the weights we shall consider a slightly modified version of the proposed algorithm: we divide the set of pixels into two independent parts, so that the weights are constructed from the one part, and the estimation of the target function is a weighted mean along the other part. More precisely, we split the set of pixels into two parts I = I x 0 I x 0 for any x 0 I where I x 0 = { x 0 + i N, j N ) } I : i+jiseven, and I x 0 = I I x 0. Define an estimated similarity function ρ x0 by ρ x0 x) = where 1 cardu x 0,η y U x 0,η f x) = Yy) YT x y) f x 0 ) 1 cardu x 0,h y U x 0,h +, x U x 0,h 5) Yy), 6) and U x 0,η = U x0,η I x 0 with U x0,h given by 4). The adaptive estimator f h is denoted by f hx 0 ) = ŵ hx)yx), 7) where U x 0,h = U x 0,h I x 0 and x U x 0,h ŵ h = e ρ x x) / 0 H X 0 ) e ρ x x ) 0 H x 0). 8) x U x 0,h In the next theorem we prove that the Mean Squared Error of the estimator f h x 0) converges at the rate n β β+ which is the usual optimal rate of convergence for a given Hölder smoothness β > 0 see e.g. Fan and Gijbels 1996 [13])). Theorem 3 Letη = c 3 n α,h = β+ ) 1 Γ 4βL n 1 β+,hx0 ) > 4c n α 1 lnn and γ > max{ Lh β,4c n α 1 lnn}. Suppose that the function f satisfies the Hölder condition 18) and f h x 0) is given by 5). Then ) E f h x 0 ) fx 0 ) c4 n β β+, 9)

9 A Non-Local Means Filter for Removing the Poisson Noise 9 where c 4 = 8 β+6 β+ Γ β β+ L 4 β+ β β β+ ). For the proof of this theorem see Section Simulation results 4.1 Computational algorithm Throughout the simulations, we use the following algorithm to compute the Non-Local Means Poisson estimator f h x 0 ). The input values of the algorithm are Y x), x I the image), and two numbers m and M are given by 6) and 5) respectively. In order to improve the results, we introduce a smoothed version of the estimated similarity distance ρ κ,x 0 x) = y U x0,η κy) Yy) YT x y) fx 0 ) κy ) y U x0,η +. 30) As smoothing kernels κ we use the Gaussian kernel κ g y,h g ) = exp N y x 0 ), 31) h g where h g is a constant, and the following kernel: for y U x0,η, κ 0 y) = Nη k=max1,j) 1 k +1), 3) if y x 0 = j N forsomej {0,1,,Nη}.Weshallalsousetherectangular kernel { 1 cardu κ r y) =, y U x0 x,η 0,η, 33) 0, otherwise. For the simulation we use the kernel κ 0 y) defined by 3). We have seen experimentally that when we take the filtering function H x 0 ) as µ fx 0 ), where µ is a constant depending on the character of the image, to obtain a denoising of high visual quality. We mention that throughout the paper we symmetrize images near the boundary. Algorithm Non-Local Means Poisson Filter NLMPF) Let {M,m,h g } be the parameters. Repeat for each x 0 I

10 10 Qiyu JIN et al. NMISE= NMISE= NMISE= NMISE= NMISE= M = M = M = 9 9 M = M = 7 7 m = m = 3 3 m = 1 1 m = 1 1 m = a) Spots b) Galaxy c) Ridges d) Barbara e) Cells Fig. 1 These images restored by the first step of our algorithm. - compute Step 1 ŵx) = exp ρ κ,x 0 x)/h x 0 )) f 1 x 0 ) = x U ŵx)yx)/ x0,h x U wx) x0,h Step 1 If d+1) x x f 1 0 d/n 1 x) < δ compute fx 0 ) = x x κ 0 d/n gx,h g ) f 1 x)/ x x κ 0 d/n gx,h g ) else fx 0 ) = f 1 x 0 ). Note: we take δ = Numerical performance of the Non-Local Means Poisson Filter By simulations we found that the images with brightness between 0 and 55 like Barbara) are well denoised by the first step, but for the low count levels images with brightness less than µ), the restored images by NLMPF are not smooth enough see Figure 1). This explains why for the low count level images, we smooth the restored images by step. Our experiments are done in the same way as in [39] and [8] to produce comparable results; we also use the same set of test images all of in size): Spots [0.08, 4.99], Galaxy [0, 5], Ridges [0.05, 0.85], Barbara [0.93, 15.73], and Cells [0.53,16.93]. The authors of [39] and [8] kindly provided us with their programs and the test images. A matlab implementation of the algorithms derived in this paper is available online 1. This unoptimized implementation processes the set of test images 145 seconds with a search window of size and patches of size 1 1, 5 seconds with a search window of size 9 9 and patches of size 1 1. The computational time is of about 10s per iteration on a image and Matlab on an Intel Pentium Dual CPU T300 CPU 3.00GHz. 1

11 A Non-Local Means Filter for Removing the Poisson Noise 11 Table 1 A comparison of the denoising performance NMISE) of several denoising algorithms. Algorithm Our OWPNF Poisson EUI+ MS-VST MS-VST algorithm NLM BM3D +7/9 +B3 Spots[0.08, 4.99] Galaxy[0, 5] Ridges[0.05, 0.85] Barbara[0.93, 15.73] Cells[0.53, 16.93] Table A comparison of the denoising performance PSNR, DB) of several denoising algorithms. Algorithm Our OWPNF Poisson EUI+ MS-VST MS-VST algorithm NLM BM3D +7/9 +B3 Spots[0.08, 4.99] Galaxy[0, 5] Ridges[0.05, 0.85] Barbara[0.93, 15.73] Cells[0.53, 16.93] Table 1 shows the NMISE values of images reconstructed by NLMPF, OWPNF[19], Poisson NLM[10], EUI+BM3D[9], MS-VST+7/9[39] and MS- VST+B3 [39]. Our algorithm reach the best in the case of Galaxy[0,5], while OWPNF reach the best in the case of Spots[0.08, 4.99]; for Ridges[0.05, 0.85], Barbara[0.93, 15.73], and Cells[0.53, 16.93], the method EUI+BM3D gives the best results, but our method is also very competitive. Table shows the PSNR values of images reconstructed. Our algorithm also reach the best in the case of Galaxy[0, 5]. The method EUI+BM3D have the highest PSNR value. However, the most important evaluation criteria is the visual quality of restored image. Figures - 6 illustrate the visual quality of these denoised images. It is obvious that The visual quality of the outputs of our method have high visual quality and many details Remained. For example, in the case of restored images of Spots cf. Figures ), our algorithm and OWPNF remain most spots. We can see clearly 7 spots at the third column from left) in Figures c), while EUI+BM3D just remains 4 spots, Poisson NLM Makes several spots sticking together, the images restored by MS-VST + 7/9 and MS-VST + B3 are not smooth enough. In the case of Galaxy cf. Figures 3), visually, our algorithm best preserves the fine textures. In the other case, our method also lead to good result visually.

12 1 Qiyu JIN et al. 5 Conclusion In this paper, we have present a new image denoising algorithm to deal with the Poisson noise model, which is based on the idea of Non-Local Mean. The Oracle estimator is obtained by minimized a very tight upper bound of the Mean Square Error with changing the size of search window. It help to establish a theorem to show that the Non-Local Means Filter can effectively deal with Poisson noise with some modification. As a result, we successfully construct the new algorithm called Non-Local Means Poisson Filter and demonstrate in statistic theory that the filter converges at the usual optimal rate. The filter is as simple as the classic Non-Local Means and the simulation results show that our filter is very competitive. The idea of how to construct an algorithm for Poisson noise model is creative. With our idea, many algorithms to Remove Gaussian Noise could deal with the Poisson noise with some modification. 6 Appendix: Proofs of the main results 6.1 Proof of Theorem 1 Denoting for brevity I 1 = whx)ρ f,x0 x) = x x 0 h x x 0 h e ρ f,x x) 0 f,x0 x) e ρ H x 0 ) H x 0) ρ f,x0 x), 34) and I = fx 0 ) wh x)) = fx 0 ) x x 0 h x x 0 h e ρ f,x x) 0 H x 0 ) e ρ f,x x) 0 H x 0 ), 35) then we have gw h ) = I 1 +I. 36) The conditions 13) and γ > Lh β imply that for x U x0,h, we have L x x 0 β H x) L h β γ 1. 37)

13 A Non-Local Means Filter for Removing the Poisson Noise 13 Noting that e t H x 0), t [0,γ/ ) is decreasing, and using one term Taylor expansion, the inequality 37) implies that x x 0 h e ρ f,x x) 0 H x 0 ) x x 0 h x x0 e L β H x 0 ) x x 0 h 1 L x x 0 β ) H x 0 ) h n. 38) Considering that te t H x 0), t [0,γ/ ) is increasing function, x x 0 h x) f,x0 e ρ H x 0) ρ f,x0 x) x x 0 h x x 0 h The above three inequalities 34), 38) and 39) imply that Taking into account the inequality x x 0 h x x0 L x x 0 β e L β H x 0 ) L x x 0 β 4Lhβ+ n. 39) I 1 4L h β. 40) f,x0 x) e ρ H x 0 ) 35) and 38), it is easily seen that Combining 36), 40), and 41), we give x x 0 h 1 = 4h n, I Γ h n. 41) gw h ) 4L h β + Γ h n. 4) Let h minimize the latter term of the above inequality 4). Then from which we infer that h = Substituting 43) to 4) leads to Therefore 16) implies 19). 8βL h β 1 Γ h 3 n = 0 ) 1 Γ β+ n 1 4βL β+. 43) gw h ) β+6 β+ Γ β β+ L 4 β+ β β β+ n β β+.

14 14 Qiyu JIN et al. 6. Proof of Theorem We shall use following lemma to finish the Proof of Theorem. The lemma can be deduced form the results in Borovkov [6], see also Merlevede, Peligrad and Rio [31] Lemma 1 If, for some δ > 0,γ 0,1) and K > 1 we have supeexpδ X i γ ) K, i = 1,...,n, then there are two positive constants c 1 and c depending only on δ, γ and K such that, for any t > 0, n ) P X i t exp c 1 t /n ) +nexp c t γ ). i=1 Proof of Theorem. Recall that M and m is given by 5) and 6) respectively. Consider that ρ x 0 x) ρ f,x 0 x) 1 m Sx)+ 1 m Rx), 44) where Sx) = y U x0,η Zy), Zy) = Yy) YT x y)) fy) ft x y)) fy) ft x y), 45) and Rx) = fy) ftx y)) +fy)+ft x y) ) fx 0 ) fx)) fx 0 ). y U x0,η SinceYx) hasthe Poissondistribution, with meanfx) andvariancefx), E e Yx)) + = e kfk x)e fx) k! k=0 = efx)e e 1)fx) eγe e 1)Γ. 46) From the inequality 46), we easily deduce supe e Zy) 1/) ) supe e Yy)+YTxy)+Γ+ Γ eγ) e eγ+ Γ 47) By Lemma 1, we see that there are two positive constants c 5 and c 6 such that for any z > 0, 1 P m Sx) z ) exp c 5 z )+mexp c 6 mz) 1 ). 48) m

15 A Non-Local Means Filter for Removing the Poisson Noise 15 Considering m = Nη +1) and η = c 1 n α 1 β)+ ) β+ < α < 1, we have m = c 1 n1 α o1)). Therefore, substituting z = c 5 lnn into the inequality 48), we see that for n large enough, P 1 1 m Sx) c 5 lnn exp lnn ) = m n. From this inequality we easily deduce that 1 P 1 max m Sx) c 5 lnn m We arrive at 1 m Sx) < c 8n α 1 lnn} and c8 is a constant de- where B = {max x Ux0,h pending only on β and L. It is easy to see that Rx) = O n α 1 In the set B, the inequality 50) implies that max ρ x x U 0 x) ρ f,x 0 x) c 8 n β β+ x0,h Combining 49) and 51), we obtain ). P 1 1 m Sx) c 5 lnn m n. PB) c 7 n 1, 49) ). 50) lnn+o n α 1 ) = On β β+ lnn). 51) 6.3 Proof of Theorem 3 Taking into account 5), 7), and the independence of ǫx), we have where E{ f h x 0) fx 0 ) Yx),x I x 0 } g ŵ h ), 5) g w) = x U x 0,h wx)ρ f,x0 x) By the proof of Theorem 1, we obtain g w h) 3 β+6 β+ Γ β β+ L 4 β+ β β β+ +f x 0 ) n β β+ x I x 0 w x). ). 53) By Theorem and its proof, for ρ x 0 is defined by 5), there is a constant c such that { } P max ρ x0 x) ρ f,x 0 x) c n α 1 lnn = O n 1). 54) x U x 0,h

16 16 Qiyu JIN et al. { } Let B = max x U x0 ρ,h x0 x) ρ f,x 0 x) c n α 1 lnn. On the set B, we have ρ f,x 0 x) c n α 1 lnn < ρ x0 x) < ρ f,x 0 x)+c n α 1 lnn, from which we infer that ŵx) = = e ρ x x) 0 H x 0 ) x U x 0,h e ρ f,x x) 0 H x 0 ) x U x 0,h = This implies that e ρ x x ) 0 H x 0 ) α cn 1+ 1 H x 0) f,x0 x) c n α 1 lnn e ρ H x 0 ) x )+c f,x0 n α 1 lnn x U e ρ H x 0 ) x 0,h ) 1+ cnα 1 lnn H x 0) x ) f,x0 e ρ H x 0 ) lnn 1 cnα 1 lnn H x 0) α cn 1+ 1 H x 0) lnn 1 cnα 1 lnn H x 0) g ŵ h ) 1 cnα 1 lnn H x 0) f,x0 x) e ρ H x 0 ) x U x 0,h w h x). α cn 1+ 1 H x 0) lnn 1 cnα 1 lnn H x 0) ) x ) f,x0 e ρ H x 0 ) g w h). The condition 4c n α 1 lnn < γ H x 0 ) implies that Consequently, 5) becomes α cn 1+ 1 lnn H x 0) 1 cnα 1 lnn H x 0). E f h x 0) fx 0 ) ) Yx),x I x 0,B g wh ). 55) Since the function f satisfies the Hölder condition, E f hx 0 ) fx 0 ) Yx),x I x0 ) < g ŵ h ) c 9, 56)

17 A Non-Local Means Filter for Removing the Poisson Noise 17 for a constant c 9 > 0 depending only on β and L. Combining ), 55), and 56), we have E f h x 0) fx 0 ) ) Yx),x I x 0 = E f hx 0 ) fx 0 ) ) Yx),x I x0,b PB) +E f hx 0 ) fx 0 ) ) Yx),x I x0,b PB) g w h )+O n 1) Now, the assertion of the theorem is obtained easily if we take into account 53). References 1. I. Abraham, R. Abraham, A. Desolneux, and S. Li-Thiao-Te. Significant edges in the case of non-stationary gaussian noise. Pattern recognition, 4011): , M. Aharon, M. Elad, and A. Bruckstein. rmk-svd: An algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans. Signal Process., 5411): , F. Alter, Y. Matsushita, and X. Tang. An intensity similarity measure in low-light conditions. Computer Vision ECCV 006, pages 67 80, F.J. Anscombe. The transformation of poisson, binomial and negativebinomial data. Biometrika, 353/4):46 54, A. Beck and M. Teboulle. Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems. IEEE Trans. Image Process., 1811): , A.A. Borovkov. Estimates for the distribution of sums and maxima of sums of random variables without the cramer condition. Siberian Mathematical Journal, 415): , J. Boulanger, J.B. Sibarita, C. Kervrann, and P. Bouthemy. Nonparametric regression for patch-based fluorescence microscopy image sequence denoising. In in Proc. of IEEE Int. Symp. on Biomedical Imaging: From Nano to Macro, ISBI008, pages IEEE, A. Buades, B. Coll, and J.M. Morel. A review of image denoising algorithms, with a new one. SIAM Journal on Multiscale Modeling and Simulation, 4): , T. Buades, Y. Lou, JM Morel, and Z. Tang. A note on multi-image denoising. In Int. workshop on Local and Non-Local Approximation in Image Processing, pages 1 15, August C.A. Deledalle, F. Tupin, and L. Denis. Poisson nl means: Unsupervised non local means for poisson noise. In IEEE Int. Conf. on Image Process. ICIP), th, pages IEEE, D.L. Donoho and J.M. Johnstone. Ideal spatial adaptation by wavelet shrinkage. Biometrika, 813):45, 1994.

18 18 Qiyu JIN et al. 1. J. Fan. Local linear regression smoothers and their minimax efficiencies. The Annals of Statistics, pages , J.Q. Fan and I. Gijbels. Local polynomial modelling and its applications. In Chapman & Hall, London, P. Fryzlewicz, V. Delouille, and G.P. Nason. Goes-8 x-ray sensor variance stabilization using the multiscale data-driven haar fisz transform. J. Roy. Statist. Soc. ser. C, 561):99 116, P. Fryzlewicz and G.P. Nason. A haar-fisz algorithm for poisson intensity estimation. J. Comp. Graph. Stat., 133):61 638, D.K. Hammond and E.P. Simoncelli. Image modeling and denoising with orientation-adapted gaussian scale mixtures. IEEE Trans. Image Process., 1711): , K. Hirakawa and T.W. Parks. Image denoising using total least squares. IEEE Trans. Image Process., 159):730 74, M. Jansen. Multiscale poisson data smoothing. J. Roy. Statist. Soc. B, 681):7 48, Qiyu Jin, Ion Grama, and Quansheng Liu. A new poisson noise filter based on weights optimization. arxiv preprint arxiv: , Q.Y. Jin, I. Grama, and Q.S. Liu. Removing gaussian noise by optimization of weights in non-local means V. Katkovnik, A. Foi, K. Egiazarian, and J. Astola. From local kernel to nonlocal multiple-model image denoising. Int. J. Comput. Vis., 861):1 3, C. Kervrann and J. Boulanger. Optimal spatial adaptation for patchbased image denoising. IEEE Trans. Image Process., 1510): , E.D. Kolaczyk and R.D. Nowak. Multiscale generalised linear models for nonparametric function estimation. Biometrika, 91):119, T. Le, R. Chartrand, and T. J. Asaki. A variational approach to reconstructing images corrupted by poisson noise. Journal of Mathematical Imaging and Vision, 73):57 63, S. Lefkimmiatis, P. Maragos, and G. Papandreou. Bayesian inference on multiscale models for poisson intensity estimation: Applications to photonlimited image denoising. IEEE Trans. Image Process., 188): , F. Luisier, C. Vonesch, T. Blu, and M. Unser. Fast interscale wavelet denoising of poisson-corrupted images. Signal Process., 90):415 47, J. Mairal, G. Sapiro, and M. Elad. Learning multiscale sparse representations for image and video restoration. SIAM Multiscale Modeling and Simulation, 71):14 41, M. Makitalo and A. Foi. On the inversion of the anscombe transformation in low-count poisson image denoising. In Proc. Int. Workshop on Local and Non-Local Approx. in Image Process., LNLA 009, Tuusula, Finland, pages 6 3. IEEE, 009.

19 A Non-Local Means Filter for Removing the Poisson Noise M. Makitalo and A. Foi. Optimal inversion of the anscombe transformation in low-count poisson image denoising. IEEE Trans. Image Process., 01):99 109, J. Mandel. Use of the singular value decomposition in regression analysis. The American Statistician, 361):15 4, F. Merlevède, M. Peligrad, and E. Rio. A bernstein type inequality and moderate deviations for weakly dependent sequences. Probab. Theory Related Fields, I. Moon and B. Javidi. Three dimensional imaging and recognition using truncated photon counting model and parametric maximum likelihood estimator. Optics express, 1718): , R.D. Nowak and E.D. Kolaczyk. A statistical multiscale framework for poisson inverse problems. IEEE Trans. Info. Theory, 465): , J. Polzehl and V. Spokoiny. Propagation-separation approach for local likelihood estimation. Probab. Theory Rel., 1353):335 36, J. Portilla, V. Strela, M.J. Wainwright, and E.P. Simoncelli. Image denoising using scale mixtures of gaussians in the wavelet domain. IEEE Trans. Image Process., 111): , S. Roth and M.J. Black. Fields of experts. Int. J. Comput. Vision, 8):05 9, G. R. Terrell and D. W. Scott. Variable kernel density estimation. The Annals of Statistics, pages , G.M.P. van Kempen, H.T.M. van der Voort, J.G.J. Bauman, and K.C. Strasters. Comparing maximum likelihood estimation and constrained tikhonov-miller restoration. IEEE Engineering in Medicine and Biology Magazine, 151):76 83, B. Zhang, J.M. Fadili, and J.L. Starck. Wavelets, ridgelets, and curvelets for poisson noise removal. IEEE Trans. Image Process., 177): , 008.

20 0 Qiyu JIN et al. a) Original image b) Noisy image c) NLMPF NMISE = PSNR = d)owpnf e) Poisson NLM f) EUI+BM3D NMISE = NMISE = NMISE = PSNR = PSNR = 31.1 PSNR = g) MS-VST + 7/9 h) MS-VST + B3 NMISE = NMISE = PSNR = PSNR = Fig. Denoising an image of simulated spots of different radii image size: 56 56). a) simulated sources amplitudes [0.08, 4.99]; background = 0.03); b) observed counts; c) NLMPF M = 19 19, m = 13 13, d = 3, σ H =.5, µ = 1 NMISE = 0.060); d) Optimal Weights FilterM = 19 19, m = 13 13, d = and H = 1,NMISE = 0.059); e) Poisson NLM NMISE = ); f) Exact unbiased inverse + BM3DNMISE = ) ; g) MS-VST + 7/9 biorthogonal wavelet J = 5, FPR = 0.01,N max = 5 iterations, NMISE = 0.060); h) MS-VST + B3 isotropic wavelet J = 5, FPR = 0.01, N max = 5 iterations, NMISE = ).

21 A Non-Local Means Filter for Removing the Poisson Noise 1 a) Original image b) Noisy image c) NLMPF NMISE = PSNR = 8.09 d)owpnf e) Poisson NLM f) EUI+BM3D NMISE = NMISE = NMISE = PSNR = 7.80 PSNR = 7.77 PSNR = 8.04 g) MS-VST + 7/9 h) MS-VST + B3 NMISE = NMISE = PSNR = 7.57 PSNR = 7.94 Fig. 3 Denoising a galaxy image image size: 56 56). a) galaxy imageintensity [0, 5]); b) observed counts; c) NLMPF M = 13 13, m = 3 3, d =, σ H = 1, µ = 0.6 NMISE = 0.084); d) Optimal Weights Filter M = 15 15, m = 5 5, d = and H = 1, NMISE = 0.085); e) Poisson NLM NMISE = ); f) Exact unbiased inverse + BM3D NMISE = 0.097) ; g) MS-VST + 7/9 biorthogonal wavelet J = 5, FPR = , N max = 5 iterations, NMISE = ); h) MS-VST + B3 isotropic wavelet J = 3, FPR = , N max = 10 iterations, NMISE = ).

22 Qiyu JIN et al. a) Original image b) Noisy image c) NLMPF NMISE = PSNR = 4.69 d)owpnf e) Poisson NLM f) EUI+BM3D NMISE = NMISE = NMISE = PSNR = 3.90 PSNR = 4.94 PSNR = 5.89 g) MS-VST + 7/9 h) MS-VST + B3 NMISE = NMISE = PSNR = 4.49 PSNR = 4.03 Fig. 4 Poisson denoising of smooth ridges image size: 56 56). a) intensity image the peak intensities of the 9 vertical ridges vary progressively from 0.1 to 0.5; the inclined ridge has a maximum intensity of 0.3; background = 0.05); b) Poisson noisy image; c) NLMPF M = 9 9, m = 1 1, d = 4, σ H = 0.5, µ = 0.4, NMISE = ); d) Optimal Weights Filter M = 9 9, m = 19 19, d = 3 and H =, NMISE = 0.016); e) Poisson NLM NMISE = ); f) Exact unbiased inverse + BM3D NMISE = 0.011); g) MS-VST + 7/9 biorthogonal wavelet J = 5, FPR = 0.001, N max = 5 iterations, NMISE = ); h) MS-VST + B3 isotropic wavelet J = 3, FPR = , N max = 10 iterations, NMISE = ).

23 A Non-Local Means Filter for Removing the Poisson Noise 3 a) Original image b) Noisy image c) NLMPF NMISE = PSNR = 4.71 d)owpnf e) Poisson NLM f) EUI+BM3D NMISE = NMISE = NMISE = PSNR = 4.60 PSNR = 4.7 PSNR = 5.9 g) MS-VST + 7/9 h) MS-VST + B3 NMISE = NMISE = PSNR = 1.81 PSNR = 0. Fig. 5 Poisson denoising of the Barbara image image size: 56 56). a) intensity image intensity [0.93,15.73]); b) Poisson noisy image; c) NLMPF M = 15 15, m = 1 1, d = 0, µ = 1, NMISE = ); d) Optimal Weights Filter M = 15 15, m = 1 1 and d = 0, NMISE = ); e) Poisson NLM NMISE = 0.107); f) Exact unbiased inverse + BM3D NMISE = ) h) MS-VST + 7/9 biorthogonal wavelet J = 4, FPR = 0.001, N max = 5 iterations, NMISE = 0.391); h) MS-VST + B3 isotropic wavelet J = 5, FPR = 0.001, N max = 5 iterations, NMISE = ).

24 4 Qiyu JIN et al. a) Original image b) Noisy image c) NLMPF NMISE = PSNR = 9.08 d)owpnf e) Poisson NLM f) EUI+BM3D NMISE = NMISE = NMISE = PSNR = 9.91 PSNR = 9.40 PSNR = g) MS-VST + 7/9 h) MS-VST + B3 NMISE = NMISE = PSNR = 8.87 PSNR = 6.69 Fig. 6 Poisson denoising of fluorescent tubules image size: 56 56). a) intensity image intensity [0.53,16.93]); b) Poisson noisy image; c) NLMPF M = 7 7, m = 13 13, d =, σ H =, µ = 1, NMISE = ); d) Optimal Weights Filter M = 11 11, m = 17 17, d = 1 and H = 0.6, NMISE = ); e) Poisson NLM NMISE = ); f) Exact unbiased inverse + BM3D NMISE = ) g) MS-VST + 7/9 biorthogonal wavelet J = 5, FPR = ,N max = 5 iterations, NMISE = ); h) MS-VST + B3 isotropic wavelet J = 5, FPR = 0.001, N max = 10 iterations, NMISE = ).

25