arxiv: v1 [math.na] 21 Aug 2014 Barbara Kaltenbacher

Transcription

1 ENHANCED CHOICE OF THE PARAMETERS IN AN ITERATIVELY REGULARIZED NEWTON- LANDWEBER ITERATION IN BANACH SPACE arxiv:48.526v [math.na] 2 Aug 24 Barbara Kaltenbacher Alpen-Adria-Universität Klagenfurt Universitätstrasse Klagenfurt, Austria Ivan Tomba Università di Bologna Piazza Porta S. Donato, Bologna, Italy (Communicated by the associate editor name Abstract. This paper is a close follow-up of [9] and [], where Newton- Landweber iterations have been shown to converge either (unconditionally without rates or (under an additional regularity assumption with rates. The choice of the parameters in the method were different in each of these two cases. We now found a unified and more general strategy for choosing these parameters that enables both convergence and convergence rates. Moreover, as opposed to the previous one, this choice yields strong convergence as the noise level tends to zero, also in the case of no additional regularity. Additionally, the resulting method appears to be more efficient than the one from [9], as our numerical tests show.. Introduction. Regularization of inverse problems in Banach spaces is a field of highly active research, cf., e.g., [2, 6, 8] for variational regularization and, e.g., [, 6,,, 3, 5, 2], for iterative methods. The main reason for this lies in the fact that extension of the scope from Hilbert to general Banach spaces better allows to formulate requirements on the searched for solution and to describe realistic noise models. We will here especially concentrate on a combination of a Newton-type strategy with Landweber iterations to approximate the Newton step, which leads to a fully explicit iteration, cf. [9, ]. To formulate the method, consider a nonlinear ill-posed operator equation F (x = y ( where F maps between Banach spaces X and Y. The given data y δ are typically contaminated by noise, and we are going to assume that the noise level δ in y y δ δ (2 2 Mathematics Subject Classification. Primary 65J2, Secondary 65M32. Key words and phrases. regularization, nonlinear inverse problems, Banach space, Newton s method, Landweber iteration..

2 2 BARBARA KALTENBACHER AND IVAN TOMBA is known. In the following, x is some initial guess and we will assume that a solution x to ( exists. { For } some p, r (,, we will make use of the duality mappings Jp X (x := p x p from X to its dual X, and Jr Y (y := { r y r} from Y to Y, respectively. While under the assumptions we will make on X, the mapping Jp X will in fact be single valued, this will not necessarily be the case for Jr Y and we will denote by jr Y a single valued selection from Jr Y. Therewith, we consider a combination of the iteratively regularized Gauss-Newton method with an iteratively regularized Landweber method for approximating the Newton step, using some initial guess x and starting from some x δ (that need not necessarily coincide with x For n =,, 2... do u n, = z n, = x δ n For k =,, 2..., k n do u + = u α Jp X (z x ω F (x δ n ( jr Y (F (x δ n(z x δ n + F (x δ n y δ z + = x + Jp X Jp X (x δ n x + u + x δ n+ = z n. It is clear that the choice of the parameters α, ω, k n, and of the overall stopping index n = n crucially influences the stability and efficiency of the method. While in [9], [] only either convergence or convergence rates have been established with disjoint parameter choices for each of these two cases, the aim of this paper is to provide a unified parameter choice strategy for this method that allows to show both unconditional convergence and convergence rates under additional regularity assumptions on the solution. Moreover, by using an appropriate choice of the stopping index for the inner iteration, differently from [9], [] we can show continuous dependence of the iterates x n on the data y δ for each fixed outer iteration index n and therewith are able to prove strong convergence. Finally, the new parameter choice appears to enhance efficiency as compared to [9], as the numerical tests below show. The remainder of this paper is organized as follows. In Section 2 we provide some preliminaries. The parameter choice as well as convergence results are derived and formulated in Section 3. Section 4 shows some numerical tests for a coefficient identification problem in an elliptic PDE in one and two space dimensions. 2. Preliminaries and assumptions. Throughout this paper we will assume that X is smooth, which means that the duality mapping is single-valued, and moreover, that X is s-convex for some s [p,, which implies c p,s D p (x, y ( x + y s p x y s (4 for some constant c p,s >, cf. Corollary 2.6 in [2]. Here, D p (x, y denotes the Bregman distance D p ( x, x = p x p p x p j X p (x, x x X,X (where j X p (x denotes a single valued selection of J X p (x. We will also make use of its shifted version D x p ( x, x := D p ( x x, x x. (3

3 PARAMETERS IN A NEWTON- LANDWEBER ITERATION IN BANACH SPACE 3 As a consequence of the above assumptions, X is reflexive and we also have D p (x, y C p,s x y s ((pd p (J X p for some C p,s, where s denotes the dual index s = these assumptions, the duality mapping is bijective and J p (x, s p + x y p s, (5 s s, cf. (4 in [9]. Under = Jp X, the latter denoting the (by s-convexity also single-valued duality mapping on the dual X of X. We will also make use of the identities and D p (x, y = D p (x, z + D p (z, y + J X p (z J X p (y, x z X,X (6 D p (y, x = D p (J X p (x, J X p (y. (7 For more details on the geometry of Banach spaces we refer, e.g., to [2], [2] and the references therein. The assumptions on the forward operator besides a condition on the domain B D ρ (x D(F (8 include a structural condition on its degree of nonlinearity. For simplicity of exposition we restrict ourselves to the tangential cone condition F ( x F (x F (x( x x η F ( x F (x, x, x B D ρ (x, (9 and mention in passing that this could be extended to a more general condition on the degree of nonlinearity (cf. [5] as in [2]. Here F is not necessarily the Fréchet derivative of F but just a linearization of F satisfying the Taylor remainder estimate (9. Additionally, we assume that F and F are uniformly bounded on Bρ D (x. Here Bρ D (x = {x X Dp x (x, x ρ 2 } with ρ > such that x Bρ D (x. By distinction between the cases x x < 2 x x and x x 2 x x and the second triangle inequality we obtain from (4 that Bρ D (x B ρ (x = {x X x x ρ} ( with ρ = max{2 x x, ( 2 p 3 s p ρ /p} 2 c p,s For obtaining convergence rates we impose a variational inequality (or variational source condition β > : x B D ρ (x Jp X (x x, x x X X βdp x (x, x 2ν s with with s the parameter of smoothness of X, F (x F (x λ(s,ν 2ν λ(2,ν,( λ(s, ν = 2ν (2 s and ν (, 2 ]. Condition ( corresponds to a source condition x x R((F (x F (x ν in the special case of Hilbert spaces (where s = 2, cf., e.g., [5]. Note that ( is stronger for larger ν and ( always holds for ν = with β = β = x x p ( ( ρ + x x s p c p,s s, (3 due to (4, (. The case ν = can be identified with the situation that no additional regularity (i.e., ( with ν > is known to hold.

4 4 BARBARA KALTENBACHER AND IVAN TOMBA 3. Error estimates and parameter choice. We here first of all follow the lines of Section 2 in [9]. Some of the estimates are the same as in [9] (and will be repeated here only for convenience of the reader. Some of them are different, though and therewith enable different parameter choice strategies. For any n IN we have D x p (x, z + D x p (x, z = Dp x (z, z + + Jp X (z + x Jp X (z x, z x X X }{{} =u + u = D x p (z, z + }{{} (I ω j Y r (A n (z x δ n + F (x δ n y δ, A n (z x Y Y }{{} (II α J X p (x x, z x X X }{{} (III α Jp X (z x Jp X (x x, z x X X, (4 }{{} (IV where we abbreviate A n = F (x δ n, b n = y δ F (x δ n. (5 Assuming that z B D ρ (x, we now estimate each of the terms on the right hand side separately. By (5 and (7 we have for the term (I D x p (z, z + s =u + u C p,s J X p (z + x J X p (z x }{{} ((pρ 2 s p + Jp X (z + x Jp X (z x p s =C p,s (pρ2 s p α Jp X (z x + ω A njr Y (A n (z x δ n + F (x δ n y δ s + C p,s α J X p (z x + ω A nj Y r (A n (z x δ n + F (x δ n y δ p 2 s C p,s (pρ2 s p α z s x (p s + 2 s C p,s (pρ2 s p ω A s njr Y (A n (z x δ n + F (x δ n y δ s + 2 p C p,s αp z x (p p + 2 p C p,s ωp A njr Y (A n (z x δ n + F (x δ n y δ p ( C p,s (pρ 2 s p ρ (p s 2 s α s + ρ p 2 p α p + ϕ(ω t (6 where we have used the triangle inequality in X and X, the inequality { (a + b λ 2 λ (a λ + b λ if λ (a λ + b λ for a, b, (7 if λ

5 PARAMETERS IN A NEWTON- LANDWEBER ITERATION IN BANACH SPACE 5 and (, as well as the abbreviations d = D x p (x, z /2 (8 t = A n (z x δ n + F (x δ n y δ (9 t = A njr Y (A n (z x δ n + F (x δ n y δ (2 A n t r. (2 r n = F (x δ n y δ (22 Here ϕ(λ = 2 s C p,s (pρ2 s p λ s + 2 p C p,s λp, (23 which by p s > defines a strictly monotonically increasing and convex function on R +. Note that estimate (6 is just the same as (5 in [9]. For the term (II in (4 we get, using (9, (2, ω j Y r (A n (z x δ n + F (x δ n y δ, A n (z x Y Y = ω t r +ω j Y r (A n (z x δ n + F (x δ n y δ, A n (x δ n x F (x δ n + y δ Y Y ω t r ω t r (η F (xδ n y δ + ( + ηδ (24 This is the same as (9 in [9]. To make use of the variational inequality ( for estimating (III, we first of all use (9 to conclude F (z F (x = (A n (z x δ n + F (x δ n y δ +(F (z F (x δ n A n ((z x δ n + (y δ y t + η F (z F (x δ n + δ t + η( F (z F (x + F (x δ n y δ + ( + ηδ, hence F (z F (x η (t + ηr n + ( + ηδ. (25 This together with ( implies α J X p (x x, z x X X β ( η 2ν α d 2ν (t + ηr n + ( + ηδ 2ν β } C(λ(s, ν ( η 2ν α {d 2 + (t + ηr n + ( + ηδ 4ν +2ν where we have used the elementary estimate (26 a λ b λ C(λ(a + b for a, b, λ (, (27 with C(λ = λ λ ( λ λ and λ(s, ν as in (2. Note that (26 differs from the corresponding estimate (24 in [9]. Finally, for the term (IV we have that α J X p (x x J X p (z x, x z X X = α (D x p (x, z + D x p (z, x α d 2, (28

6 6 BARBARA KALTENBACHER AND IVAN TOMBA which is just (26 in [9]. Altogether we arrive at the estimate d 2 + ( ( c α d 2 + c α s + c 2 α p where +c 3 α (t + ηr n + ( + ηδ 4ν +2ν ω t r + ω t r (ηr n + ( + ηδ + ϕ(ω t, (29 c = β C(λ(s, ν (3 ( η 2ν c = C p,s (pρ2 s p ρ (p s 2 s (3 c 2 = C p,s ρp 2 p (32 c 3 = β C(λ(s, ν ( η 2ν (33 θ = 4ν r( + 2ν 4ν, (34 (small c denoting constants that can be made small by assuming x to be sufficiently close to x and therewith β, η, x x small, and λ(s, ν as in (2. Multiplying (29 with α θ + and abbreviating we get ( α α + γ + γ θ{( ( c α γ := d 2 α θ, ( α+ α θ γ + (c α s θ + c 2 α p θ + c 3 α θ (t + ηr n + ( + ηδ 4ν +2ν ( } α θ ω t r ω t r (ηr n + ( + ηδ ϕ(ω t. (35 To obtain monotone decay of the sequence γ with increasing k we choose ω such that ϕ (ω t ω ω ω and ω t r c ω (36 for some < ω < ω, c ω >. We will do so by setting ω = ϑ min{t r s s t, t r p p t with ϑ sufficiently small, cf. [9], and assuming that α such that, ω} (37 r s p, (38 α ˇα := τ (t + ηr n + ( + ηδ r +θ (39 and c + c α s θ + c 2 α p θ + c 3 γ, γ, τ θ + γ, τ +θ q <. (4 γ,

7 PARAMETERS IN A NEWTON- LANDWEBER ITERATION IN BANACH SPACE 7 The latter can be achieved by α and (4 s θ +, p θ +, (42 c, c, c 2, c 3, τ sufficiently small. In case ν > we additionally require α + ˆα + := α ( ( qα /θ (43 with an upper bound γ, for γ,. Note that this just means α + in case ν =, i.e., θ =, thus an empty condition in this case. To meet conditions (39, (43 with a minimal α + we set α + = max{ˇα +, ˆα + } for k (44 { αn,kn if n α n, = α, if n =. It remains to choose the inner stopping index k n and the outer stopping index n, see below. Indeed with these choices of ω and α + we can inductively conclude from (35 that ( θ α {( ( θ α+ γ + γ ( qα γ,} α + α θ + ( c ωω t r, α θ + ( c ωω t r. (45 This monotonicity result holds for all n IN and for all k IN. By (45 and α (cf. (4 it can be shown inductively that all iterates remain in Bρ D (x provided γ, ρ 2. (46 Moreover, (45 implies that n= k= hence by α +, ω ω α α θ + ω t r γ, c ω <, (47 t as k for all n IN (48 and sup t as n. (49 k IN Especially, since t n, = r n, (47 implies r r n <, (5 n= hence r n as n. To quantify the behavior as k of the sequence α according to (39, (43, (44 for fixed n we distinguish between two cases. Case (i: there exists a k such that for all k k we have α = ˆα. Considering

8 8 BARBARA KALTENBACHER AND IVAN TOMBA an arbitrary accumulation point ᾱ n of α (which exists since α we ( θ therefore have ᾱ n = ᾱ n ( qᾱ n, hence ᾱ n =. Case (ii: consider the situation that (i does not hold, i.e., there exists a subsequence k j such that for all j IN we have α j = ˇα j. Then by (39, (43, and (48 we have α j τ (ηr n + ( + ηδ r +θ. Altogether we have shown that lim sup α τ (ηr n + ( + ηδ r +θ for all n IN. (5 k Since η and δ can be assumed to be sufficiently small, this especially implies the bound α in (4. We consider z n,kn as our regularized solution, where n, kn (and also k n for all n n ; note that kn is to be distinguished from k n - actually the latter is not defined, since we only define k n for n n! are still to be chosen appropriately, according to the requirements from the proofs of convergence rates in case ν, θ >, convergence for exact data δ =, convergence for noisy data as δ. 3.. Convergence rates in case ν, θ >. From (45 we get hence in order to get the desired rate d 2 γ, α θ for all n, k IN, (52 d 2 n,k n = O(δ rθ +θ in view of (5 (which is a sharp bound in case (ii above we need to have a bound r n τδ (53 for some constant τ >, and we should choose kn large enough so that α n,k n C α(r n + δ r +θ (54 which is possible with a finite kn by (5 for C α > ( τ( + η r +θ. Note that this holds without any requirements on k n for n < n Convergence as n for exact data δ =. To show that (x n n IN is a Cauchy sequence (following the seminal paper [4], for arbitrary m < j, we choose the index l {m,..., j} such that r l is minimal and use the identity D x p (x l, x m = D x p (x, x m D x p (x, x l + J X p (x l x J X p (x m x, x l x X X (55 and the fact that the monotone decrease and boundedness from below of the sequence Dp x (x, x m implies its convergence, hence it suffices to prove that the last term in (55 tends to zero as m < l. (Analogously it can be shown that Dp x (x l, x j tends to zero as l < j. This term can be rewritten as J X p (x l x J X p (x m x, x l x X X = l k n n=m k= u + u, x l x X X,

9 PARAMETERS IN A NEWTON- LANDWEBER ITERATION IN BANACH SPACE 9 where u + u, x l x X X = α J X p (z x, x l x X X +ω j Y r (A n (z x δ n b n, A n (x l x X X 2 ρ p α + ω t r A n(x l x 2 ρ p τ(t + ηr n r + ω t r ( + η(2r n + r l 2 ρ p τ(t + ηr n r + 3( + ηω t r r n by our choice of α = ˇα (note that ˆα = in case θ =, condition (9 and and minimality of r l. Thus we have by ω ω and Young s inequality that there exists C > such that J X p (x l x J X p (x m x, x l x X X C l n=m {( kn k= t r + k n r r n for which we can conclude convergence as m, l from (47 provided that k n r r n as m, n=m which we guarantee by choosing, for an a priori fixed summable sequence (a n n IN, e.g. a n = 2 n k n := [a n r r n ], (56 or, using (5 just k n k for some fixed integer k, e.g., k = 3. This is consistent with (54, since in case δ = we have n =, so condition (54 never gets active in the noiseless case Convergence with noisy data as δ. In case ν, θ >, convergence follows from the convergence rates results in Subsection 3.. Therefore it only remains to show convergence as δ in case ν, θ =. In this section we explicitly emphasize dependence of the computed quantities on the noisy data and on the noise level by a superscript δ. Let y δj y δ j with δ j a zero sequence and n j the corresponding stopping index. As usual [4] we distinguish between the two cases that (i n j has a finite accumulation point and (ii n j tends to infinity. Case (i: there exists an N IN and a subsequence n ji such that for all i IN we have n ji = N. Provided n (δ = N for all δ The mapping δ x δ N is continuous at δ =, (57 we can conclude that x δj i N x N as i, and by taking the limit as i also in (53, x N is a solution to (. Thus we may set x = x N in (45 (with θ = to obtain D x p (x N, z δj i n ji,k n ji = D x p (x N, z δj i N,k n ji D x p (x N, x δj i N as i, where we have again used the continuous dependence (57 in the last step. Case (ii: let n j as j, and let x be a solution to (. For arbitrary ɛ >, by convergence for δ = (see the previous subsection we can find n such

10 BARBARA KALTENBACHER AND IVAN TOMBA that Dp x (x, x n < ɛ 2 and, by Theorem 2.6 (d in [2] there exists j such that for all j j we have n,j n + and Dp x (x, x δj n Dp x (x, x n < ɛ 2, provided n n (δ for all δ The mapping δ x δ n is continuous at δ =. (58 Hence, by monotonicity of the errors we have D x p (x, z δj n j,k n j D x p (x, x δj n D x p (x, x n + D x p (x, x δj n D x p (x, x n < ɛ. Indeed, (57, (58 can be concluded from continuity of F, F, the definition of the method (3, as well as stable dependence of all parameters ω, α, k n according to (37, (39, (43, (44, (56 on the data y δ. Altogether we have derived the following algorithm. Algorithm 3.. (Newton iteratively regularized Landweber method Choose τ, τ, C α sufficiently large, x sufficiently close to x, α, ϑ > sufficiently small, ω >, (a n n IN such that n= a n < For n =,, 2... until r n τδ do u n, = z n, = x δ n α n, = α n,kn if n > { k = kn = a n r r } n if r n > τδ For k =,, 2... until C α(r n + δ r do +θ if r n τδ α n,kn r s s t, t r p p t ω = ϑ min{t, ω} u + = u α Jp X (z x ω F (x δ n ( jr Y (F (x δ n(z x δ n + F (x δ n y δ z + = x + Jp X Jp X (x δ n x + u + α + = max{ˇα +, ˆα + } with ˇα +, ˆα + as in (39, (43 x δ n+ = z n. Here we use the abbreviations according to (5, (9, (2, (22, (34. The analysis above yields the following convergence result. Theorem 3.2. Assume that X is smooth and s-convex with s p, that x is sufficiently close to x, i.e., x Bρ D (x, that F satisfies (9 with (8, that F and F are continuous and uniformly bounded in Bρ D (x, and that (38, (42 hold. Then, the iterates z defined by Algorithm 3. remain in Bρ D (x and converge to a solution x of ( subsequentially as δ (i.e., there exists a convergent subsequence and the limit of every convergent subsequence is a solution. In case of exact data δ =, we have subsequential convergence of x n to a solution of ( as n. If additionally a variational inequality ( with ν (, ] and β sufficiently small is satisfied, we obtain optimal convergence rates Dp x (x 4ν, z n,kn = O(δ 2ν+, as δ. (59 Note that we here deal with an a priori parameter choice: θ and therefore ν has to be known, otherwise ν must be set to a lower bound ν for the true ν and since ν ν implies validity of ( with ν replaced by ν, Theorem 3.2 still implies the (possibly suboptimal rates O(δ 4ν 2ν+, or just convergence if we have set ν =.

11 PARAMETERS IN A NEWTON- LANDWEBER ITERATION IN BANACH SPACE 4. Numerical Experiments. In this section we present some numerical experiments to test the method defined in section 3. We consider the identification of the space-dependent coefficient c in the elliptic boundary value problem { u + cu = f, in Ω (6 u = on Ω from the measurement of u in Ω, where f is a fixed function and where Ω is assumed to be a smooth, bounded domain in R d, d N. Note that inhomogeneous Dirichlet boundary conditions can be easily incorporated into the right-hand side f if necessary. We consider three examples with d = and an example with d = 2. In all cases, we take X := L p (Ω, < p <, Y := L r (Ω, < r < and recall that the following facts hold true. (i For < p <, the duality mapping in X is given by J X p (c = c p sgn(c. (ii If the domain of the forward operator is defined by D(F := {c X c ĉ X γ p, for some ĉ L (Ω, ĉ a.e.}, (6 the condition (8 is satisfied with c =. (iii There follows from Lemma 2 in [5] that the operator F : D(F X Y, F (c = A(c f is well defined. Here A(c : W 2,p (Ω H (Ω L p (Ω is given by A(cu := u + cu. Moreover, F (c and the adjoint of F (c F (ch = A(c (hf (c, F (c w = u(ca(c w, are well defined and bounded. In all the numerical simulations, we take θ = and stop the outer iteration by means of the discrepancy principle (53. Concerning the stopping index of the inner iteration, we slightly modify Algorithm, requiring also that if F (z y δ τδ then the iteration has to be stopped. More precisely, k n = min{k Z, k, and the regularized solution is c δ n = z nn,k n. F (z y δ τδ k a n r r n } ( dimensional examples. We consider the same numerical simulations as in [9], taking Ω = (, and inhomogeneous boundary conditions u( = g, u( = g. We solve all differential equations approximately by a finite difference method by dividing the interval [, ] into N + subintervals with equal length /(N +, in all examples below N = 4. The L p and L r norms are calculated approximately by means of a quadrature method. Example 4.. In the first simulation we assume that the solution is sparse:.5,.3 t.4, c (t =.,.6 t.7,., elsewhere. The test problem is constructed by taking u(t = u(c (t = +5t, f(t = u(tc (t, g = and g = 6. We perturb the exact data u with gaussian white noise: the corresponding perturbed data u δ satisfies u δ u L r = δ, with δ =. 3. We apply Algorithm, with the inner stopping index satisfying (62, with τ =.2, τ =., a n = (5 + n 2. The upper bound c ω is fixed equal to. and ϑ is chosen as 2 j, where j is the first index that satisfies (63 2 s C p,s (pρ2 s /p ϑ s + 2 p C p,s ϑp c ω. (64

12 2 BARBARA KALTENBACHER AND IVAN TOMBA.2 Sparsity reconstruction with 2 spikes: solution c +.2 Sparsity reconstruction with 2 spikes: solution c + δ c n* δ c n* c(t c(t t t (a p = 2, r = 2. (b p =., r = 2. Figure. Reconstructed Solutions for example 4. In figure we show the results obtained by our method with p = 2 and p =. respectively. The reconstructed solutions are very similar to those obtained in [9] and []. Concerning the total number of inner iterations N p = n n= similarly to [9], it is larger in the case p = 2 (N 2 = 3992 than in the case p =. (N. = 363. In both cases, the value of N p is lower than the corresponding value found in [9]. We underline that it is possible to make different choices for τ, c ω, a n to look for further improvements of the speed of the method. The partial freedom in the choices of these parameters makes Algorithm more flexible than the method described in [9]. In our numerical simulations, we tested different choices which gave similar but slightly worse results than those stated here. Example 4.2. We modify the exact solution of the previous example into:.25,. t.5, c.5,.3 t.4, (t =.,.6 t.7,. elsewhere. and choose again δ =. 3. In this case, we take τ =.2, τ =., a n = ( + n 2, c ω =. and ϑ as in the previous example. In figure 2 we show the results obtained by our method with p = 2 and p =. respectively. As usual, the reconstruction of the sparsity is much better for p =.. Concerning the total number of inner iteration N p, in this case we obtain N 2 = 44 (with a corresponding error of. and N. = 3 (with a corresponding error of.482. We observe that although the corresponding error is slightly larger than that obtained in [9], the value of N 2 is slightly more than a fifth than the value obtained in [9], with a gain in the speed of the 42.8%. Moreover, in the case p =. Algorithm performs 45 iterations less than in [9], with a gain in the speed of the 45.5%, and obtains even a lower error. Example 4.3. We consider an example with noisy data where a few data points called outliers are remarkably different from other data points. This situation may k n, (65

13 PARAMETERS IN A NEWTON- LANDWEBER ITERATION IN BANACH SPACE 3.2 Sparsity reconstruction with 2 spikes: solution c +.2 Sparsity reconstruction with 2 spikes: solution c + δ c n* δ c n* c(t c(t t t (a p = 2, r = 2. (b p =., r = 2. Figure 2. Reconstructed Solutions for example 4.2 arise from procedural measurement errors. We suppose c to be a smooth solution c (t = 2 t + 4 sin(2πt (66 and take u(c (t = 2t, f(t = ( 2t(2 t + 4 sin(2πt, u( = g = and u( = g = as exact data of the problem. We start the iteration from the initial guess c (t = 2 t, and take τ = 5 3, a n = ( + n., c ω = 5 3 and ϑ as in the previous example. Using the same Matlab seed for generating random data, we consider the same perturbed data as in [9], Example 3, case B (cf. Figure 3 here and Figure 3, picture (d in that paper. We run both Algorithm with τ =.5 and the algorithm that generated the results presented in [9] for this example with p = 2 and r =.. Pictures (b and (d from figure 3 show the corresponding results. The solution obtained by Algorithm is slightly more precise, with an error equal to.8852 for Algorithm and equal to for the method in [9]. The most interesting fact is that Algorithm computes only N 2 = 249 total inner iterations to obtain this solution, whereas for the method in [9] N 2 = 3285 and the reconstruction is poorer. Moreover, due to the flexibility of our method, we can simply change the value of τ into + 5 to get a more precise solution (see picture (c in figure 3. A visual inspection gives an idea of the improvement: the error of this solution, obtained with 278 total inner iterations, is equal to.67. We summarize the numerical results of the -dimensional examples in Table A 2-dimensional example. We show the performance of Algorithm in the following 2-dimensional example. Let Ω = (, 2 and assume the exact solution to be c (x, y = 4χ [.9,.24] 2(x, y, x, y Ω, (67 where the function χ is the characteristic function on a subset of R 2. We take as exact data u(x, y = + x + y: as a consequence, the fixed right hand side of the problem is f(x, y = c (x, yu(x, y and the data at the boundary are given These values of r and p do not satisfy the condition (38 of Theorem 3.2. However, this condition is needed only to have a lower bound for ω and such a bound is verified experimentally in this example for these values of r and p.

14 4 BARBARA KALTENBACHER AND IVAN TOMBA c(t c + δ c n* t (a Perturbed data with outliers (b Alg. Solution with τ =.5 6 c Data with outliers: p=2 r=. solution c + δ c n* 5 δ c n* c(t 2 c(t t t (c Alg. Solution with τ = + 5 (d Solution of the method in [9] Figure 3. Numerical results for example 4.3: (a are the perturbed data; (b is the solution obtained by the method in [9]; (c and (d are the solutions of Algorithm with different values of τ. by g(x, y = u(x, y for every (x, y Ω. We discretize the interval [, ] x into N + subintervals and the interval [, ] y into M + subintervals and compute the solutions of the forward operator F (c = u(c by a finite difference method. The L p and L r norms in Ω are calculated by a simple quadrature method. We fix p =., N = M = 3, τ = + 5, τ = 4, c ω =. and ϑ as in the -dimensional examples. We run Algorithm starting from c = with the data u δ perturbed by white gaussian noise with two different noise levels. In the first case, we choose a small value for δ = u u δ = 3 with r = 2. In the second case we choose δ = 2 with r = 2 and with r =. In figure 4 we plot the exact solution and the reconstructions obtained using Algorithm in all these cases. The pictures show that the method provides a good reconstruction of the sparsity in this example. In particular, we underline that in the case δ = 2 the choice of a large r improves the result, obtaining a better reconstruction with very few iterations (the total number of iterations is equal to 9 in this case. 5. Conclusions. In this paper we have devised an alternative parameter choice strategy for the iteratively regularized Newton- Landweber iteration proposed in

15 PARAMETERS IN A NEWTON- LANDWEBER ITERATION IN BANACH SPACE 5 -dimensional numerical simulations Example Method Total n. of inner iterations Error: c Alg. p = Alg. p = Example 2 Method Total n. of inner iterations Error: c Alg. p = Alg. p = Example 3 Method Total n. of inner iterations Error: c Alg. τ = Alg. τ = Method from [9] Table. Numerical results for the -dimensional simulations. [9]. This strategy is based on alternative error estimates and allows for a unified treatment of the unconditional convergence case and convergence with rates. In our future research we will try to extend the analysis to faster inner iterations than Landweber such as steepest descent or conjugate gradient methods. 6. Acknowledgment. Support by the German Science Foundation DFG under grant KA 778/5- is gratefully acknowledged. REFERENCES [] A. B. Bakushinsky and M. Yu. Kokurin. Iterative methods for approximate solution of inverse problems. Springer, Dordrecht, 24. [2] M. Burger and S. Osher. Convergence rates of convex variational regularization. Inverse Problems, 2(5:4 42, 24. [3] C. Clason and B. Jin: A semi-smooth Newton method for nonlinear parameter identification problems with impulsive noise, SIAM J. Imaging Sci 5:55 538, 22. [4] M. Hanke, A. Neubauer, and O. Scherzer. A convergence analysis of the Landweber iteration for nonlinear ill-posed problems. Numer. Math. 72:2 37, 995. [5] T. Hein and B. Hofmann. Approximate source conditions for nonlinear ill-posed problems chances and limitations. Inverse Problems, 25:353 (6pp, 29. [6] T. Hein and K.S. Kazimierski. Accelerated Landweber iteration in Banach spaces. Inverse Problems, 26:552 (7pp, 2. [7] T. Hein and K.S. Kazimierski. Modified Landweber iteration in Banach spaces - convergence and convergence rates Numerical Functional Analysis and Optimization 3 (, 2, [8] B. Hofmann, B. Kaltenbacher, C. Pöschl, and O. Scherzer. A convergence rates result for Tikhonov regularization in Banach spaces with non-smooth operators. Inverse Problems, 23(3:987, 27. [9] B. Kaltenbacher and I. Tomba. Convergence rates for an iteratively regularized Newton- Landweber iteration in Banach space. Inverse Problems, 29:25 (8pp, 23. [] Q. Jin. Inexact Newton-Landweber iteration for solving nonlinear inverse problems in Banach spaces. Inverse Problems 28:652 (4pp, 22. [] Q. Jin and L.Stals. Nonstationary iterated Tikhonov regularization for ill-posed problems in Banach spaces. Inverse Problems, to appear. [2] B. Kaltenbacher. Convergence rates for the iteratively regularized Landweber iteration in Banach space. Proceedings of the 25th IFIP TC7 Conference on System Modeling and Optimization, Springer, 23, to appear.

16 6 BARBARA KALTENBACHER AND IVAN TOMBA (a Exact solution (b (c (d Figure 4. Numerical results for the 2-dimensional example: (a is the exact solution; (b is the solution corresponding to δ = 3 and r = 2; (c is the solution corresponding to δ = 2 and r = 2; (d is the solution corresponding to δ = 2 and r =. [3] B. Kaltenbacher and B. Hofmann. Convergence rates for the iteratively regularized gaussnewton method in Banach spaces. Inverse Problems, 26:357 (2pp, 2. [4] B. Kaltenbacher, A. Neubauer, and O. Scherzer. Iterative Regularization Methods for Nonlinear Ill-posed Problems. de Gruyter, 27. [5] B. Kaltenbacher, F. Schöpfer, and Th. Schuster. Convergence of some iterative methods for the regularization of nonlinear ill-posed problems in Banach spaces. Inverse Problems, 25, doi:.88/266-56/25/6/653. [6] A. Neubauer, T. Hein, B. Hofmann, S. Kindermann, and U. Tautenhahn. Improved and extended results for enhanced convergence rates of Tikhonov regularization in Banach spaces. Appl. Anal., 89(: , 2. [7] A.Rieder. On convergence rates of inexact Newton regularizations. Numer. Math. 88: , 2. [8] A.Rieder. Inexact Newton regularization using conjugate gradients as inner iteration. SIAM J. Numer. Anal. 43:64 622, 25. [9] O. Scherzer. A modified Landweber iteration for solving parameter estimation problems. Appl. Math. Optim., 38:45 68, 998. [2] F. Schöpfer, A. K. Louis, and T. Schuster. Nonlinear iterative methods for linear ill-posed problems in Banach spaces. Inverse Problems, 22(:3 329, 26. [2] T. Schuster, B. Kaltenbacher, B. Hofmann, and K. Kazimierski. Regularization Methods in Banach Spaces. de Gruyter, Berlin, New York, 22.

17 PARAMETERS IN A NEWTON- LANDWEBER ITERATION IN BANACH SPACE 7 [22] Z.-B. Xu and G. F. Roach. Characteristic inequalities of uniformly convex and uniformly smooth Banach spaces. Journal of Mathematical Analysis and Applications, 57 (99, address: barbara.kaltenbacher@aau.at address: ivan.tomba3@unibo.it