arxiv: v2 [math.fa] 18 Jul 2008

Similar documents
arxiv: v2 [math.fa] 18 Jul 2008

Morozov s discrepancy principle for Tikhonov-type functionals with non-linear operators

Convergence rates in l 1 -regularization when the basis is not smooth enough

Iterative regularization of nonlinear ill-posed problems in Banach space

c 2011 International Press Vol. 18, No. 1, pp , March DENNIS TREDE

Regularization in Banach Space

DFG-Schwerpunktprogramm 1324

Convergence rates for Morozov s Discrepancy Principle using Variational Inequalities

Accelerated Landweber iteration in Banach spaces. T. Hein, K.S. Kazimierski. Preprint Fakultät für Mathematik

Due Giorni di Algebra Lineare Numerica (2GALN) Febbraio 2016, Como. Iterative regularization in variable exponent Lebesgue spaces

Iterated hard shrinkage for minimization problems with sparsity constraints

The impact of a curious type of smoothness conditions on convergence rates in l 1 -regularization

Convergence rates of convex variational regularization

arxiv: v1 [math.na] 21 Aug 2014 Barbara Kaltenbacher

Linear convergence of iterative soft-thresholding

arxiv: v1 [math.na] 16 Jan 2018

ITERATIVELY SOLVING LINEAR INVERSE PROBLEMS UNDER GENERAL CONVEX CONSTRAINTS. Ingrid Daubechies. Gerd Teschke. Luminita Vese

Modified Landweber iteration in Banach spaces convergence and convergence rates

Sparse Recovery in Inverse Problems

SPARSE SIGNAL RESTORATION. 1. Introduction

Canberra Symposium on Regularization and Chemnitz Symposium on Inverse Problems on Tour

Contents: 1. Minimization. 2. The theorem of Lions-Stampacchia for variational inequalities. 3. Γ -Convergence. 4. Duality mapping.

Statistical regularization theory for Inverse Problems with Poisson data

ESAIM: M2AN Modélisation Mathématique et Analyse Numérique Vol. 34, N o 4, 2000, pp

Robust error estimates for regularization and discretization of bang-bang control problems

Variational image restoration by means of wavelets: simultaneous decomposition, deblurring and denoising

ETNA Kent State University

A range condition for polyconvex variational regularization

An Iterative Thresholding Algorithm for Linear Inverse Problems with a Sparsity Constraint

A Double Regularization Approach for Inverse Problems with Noisy Data and Inexact Operator

A Double Regularization Approach for Inverse Problems with Noisy Data and Inexact Operator

A NEW ITERATIVE METHOD FOR THE SPLIT COMMON FIXED POINT PROBLEM IN HILBERT SPACES. Fenghui Wang

Levenberg-Marquardt method in Banach spaces with general convex regularization terms

Parameter Identification in Partial Differential Equations

A NOTE ON THE NONLINEAR LANDWEBER ITERATION. Dedicated to Heinz W. Engl on the occasion of his 60th birthday

Regularization for a Common Solution of a System of Ill-Posed Equations Involving Linear Bounded Mappings 1

On the distributional divergence of vector fields vanishing at infinity

Tikhonov Replacement Functionals for Iteratively Solving Nonlinear Operator Equations

A note on convergence of solutions of total variation regularized linear inverse problems

Variational Methods in Image Denoising

ANALYSIS OF THE TV REGULARIZATION AND H 1 FIDELITY MODEL FOR DECOMPOSING AN IMAGE INTO CARTOON PLUS TEXTURE. C.M. Elliott and S.A.

Regularization of linear inverse problems with total generalized variation

WEAK CONVERGENCE OF RESOLVENTS OF MAXIMAL MONOTONE OPERATORS AND MOSCO CONVERGENCE

Convex Hodge Decomposition of Image Flows

Key words: denoising, higher-order regularization, stability, weak convergence, Brezis-Lieb condition. AMS subject classifications: 49N45, 94A08.

PDEs in Image Processing, Tutorials

WEAK LOWER SEMI-CONTINUITY OF THE OPTIMAL VALUE FUNCTION AND APPLICATIONS TO WORST-CASE ROBUST OPTIMAL CONTROL PROBLEMS

A note on convergence of solutions of total variation regularized linear inverse problems

ENERGY METHODS IN IMAGE PROCESSING WITH EDGE ENHANCEMENT

Adaptive discretization and first-order methods for nonsmooth inverse problems for PDEs

Semi-discrete equations in Banach spaces: The approximate inverse approach

Optimal Control of Partial Differential Equations I+II

Nonlinear Approximation Schemes Associated With Nonseparable Wavelet Bi-frames

Iteratively Solving Linear Inverse Problems under General Convex Constraints

Sparse tomography. Samuli Siltanen. Department of Mathematics and Statistics University of Helsinki, Finland

Lipschitz p-convex and q-concave maps

Strengthened Sobolev inequalities for a random subspace of functions

Fourier Transform & Sobolev Spaces

Research Article Approximation of Solutions of Nonlinear Integral Equations of Hammerstein Type with Lipschitz and Bounded Nonlinear Operators

Linear convergence of iterative soft-thresholding

Functionalanalytic tools and nonlinear equations

Weak Convergence Methods for Energy Minimization

On the acceleration of the double smoothing technique for unconstrained convex optimization problems

Adaptive methods for control problems with finite-dimensional control space

A Theoretical Framework for the Regularization of Poisson Likelihood Estimation Problems

ON THE REGULARITY OF ONE PARAMETER TRANSFORMATION GROUPS IN BARRELED LOCALLY CONVEX TOPOLOGICAL VECTOR SPACES

On Total Convexity, Bregman Projections and Stability in Banach Spaces

An introduction to Mathematical Theory of Control

EXISTENCE RESULTS FOR QUASILINEAR HEMIVARIATIONAL INEQUALITIES AT RESONANCE. Leszek Gasiński

A generalized forward-backward method for solving split equality quasi inclusion problems in Banach spaces

[11] Peter Mathé and Ulrich Tautenhahn, Regularization under general noise assumptions, Inverse Problems 27 (2011), no. 3,

How much should we rely on Besov spaces as a framework for the mathematical study of images?

Exponential stability of families of linear delay systems

Convergence Rates in Regularization for Nonlinear Ill-Posed Equations Involving m-accretive Mappings in Banach Spaces

Parameter Identification

Variational Formulations

1 Topology Definition of a topology Basis (Base) of a topology The subspace topology & the product topology on X Y 3

Iterative Convex Regularization

Image Cartoon-Texture Decomposition and Feature Selection using the Total Variation Regularized L 1 Functional

Progetto di Ricerca GNCS 2016 PING Problemi Inversi in Geofisica Firenze, 6 aprile Regularized nonconvex minimization for image restoration

Variational image restoration by means of wavelets: Simultaneous decomposition, deblurring, and denoising

The small ball property in Banach spaces (quantitative results)

Sparsity Regularization

Splitting Techniques in the Face of Huge Problem Sizes: Block-Coordinate and Block-Iterative Approaches

A Concise Course on Stochastic Partial Differential Equations

A metric space X is a non-empty set endowed with a metric ρ (x, y):

Notes on Ordered Sets

Convex Hodge Decomposition and Regularization of Image Flows

Local strong convexity and local Lipschitz continuity of the gradient of convex functions

LINEARIZED BREGMAN ITERATIONS FOR FRAME-BASED IMAGE DEBLURRING

Compact operators on Banach spaces

Minimizing Isotropic Total Variation without Subiterations

Sparse Regularization via Convex Analysis

A Generalized Uncertainty Principle and Sparse Representation in Pairs of Bases

Approaching monotone inclusion problems via second order dynamical systems with linear and anisotropic damping

Iterative Regularization Methods for Inverse Problems: Lecture 3

Regularization of Inverse Problems

Besov-type spaces with variable smoothness and integrability

Subdifferential representation of convex functions: refinements and applications

Pseudo-monotonicity and degenerate elliptic operators of second order

Transcription:

Optimal Convergence Rates for Tikhonov Regularization in Besov Scales arxiv:0806095v [mathfa] 8 Jul 008 Introduction D A Lorenz and D Trede Zentrum für Technomathematik University of Bremen D 8334 Bremen Germany E-mail: dlorenz@mathuni-bremende trede@mathuni-bremende Abstract In this paper we deal with linear inverse problems and convergence rates for Tikhonov regularization We consider regularization in a scale of Banach spaces namely the scale of Besov spaces We show that regularization in Banach scales differs from regularization in Hilbert scales in the sense that it is possible that stronger source conditions may lead to weaker convergence rates and vive versa Moreover we present optimal source conditions for regularization in Besov scales AMS classification scheme numbers: 47A565J0 Regularization of inverse problems formulated in Banach spaces have been of recent interest On the one hand there are a several theoretical regularization results such as convergence rates in a general Banach spaces setting see eg [56453] or convergence rates for special sequence spaces such as l p p < see eg [80] On the other hand there are results which deal with solving inverse problems formulated in Banach spaces such as Landweber-like iterations or minimization methods for Tikhonov functionals see eg [6] and [ 4 3 7] respectively The interest in Banach spaces is due to the fact that in many situations a Banach space is better suited to model the data under consideration than a Hilbert space In the context of image processing for example the Banach space BV of functions of bounded variation is used to model images with discontinuities along lines [5 4 8] Moreover [5] presents two examples in which the use of Banach spaces is necessary for a thorough formulation of the problem Another class of Banach spaces are the Besov spaces Bpq s which play an important role in inverse problems related to image processing see eg [7 8 7] InthispaperwemakeafirstattempttoanalyzeinverseproblemsinscalesofBanach spaces generalizing classical Hilbert scales [9] The easiest scale of Banach spaces is the scale of Sobolev spaces Wp s However we are going to use Besov spaces Bpp s since they coincide with the Sobolev scale in most cases if the integrability indices coincide Moreover they come with a characterization in terms of wavelet coefficients which make

Regularization in Besov scales them easy to use for our purposes We apply previous convergence rates regularization results from [5 5] in the scale of Besov spaces and develop optimal convergence rates To this end we derive the source conditions that lead to a convergence rate of O δ) in a certain Sobolev space Consider the equation F u = v ) where F is a linear continuous operator F : B D L between the Besov space B D := B s D pd p D s D R p D > and Lebesgue space L In general these function spaces contain functions or distributions defined on the subset Ω R d Due to clarity we omit Ω in the following The Besov spaces B s pp are subspaces of the space of tempered distributions S and in contrast to S they are Banach spaces for p [5] Different from classical approaches we use the domain B D often a superset of L and not L itself That may be of interest in some applications eg mass-spectrometry where the data consists of delta peaks see [0 6]) which are not elements of L If we assume that only noisy data v δ with noise level v v δ δ are available the solution of ) could be unstable and has to be stabilized by regularization methods We use regularization with a Besov constraint ie we regularize by minimizing a not necessarily quadratic functional T α : B D [0 ] defined by T α u) := Fu v δ L +α u ) where B R := B s R pr is a Besov space not necessarily equal to B D Since T α shall be defined on B D we define u = for u / B R In this paper we will investigate regularization properties and convergence rates of theregularizationmethodconsisting oftheminimizationof) ie u αδ argmint α u) The proceeding is as follows i) In section we introduce the notation and collect preliminary results ii) In section 3 we apply convergence rates results for Banach spaces [5 5] With the constraints on and s R in mind and the parameter rule α = δ we will get a stable approximation ie u αδ u 0 δ 0 and a convergence rate in the Sobolev space H σ u αδ u H σ = O δ) with σ depending on s R and theorems 3 and 3) These results restrict the choice of possible regularization spaces B R Using Besov space embeddings in

Regularization in Besov scales 3 section 4 we will get a generalization of the first result We find a convergence rate also formulated in a Sobolev space which holds for a larger set of Besov space penalties theorem 4) iii) The convergence result gets stronger as σ increases since for θ > 0 it holds H σ+θ H σ Since σ depends on s R and we address the question how to choose B R in a way such that σ is maximal We will find the regularization penalty which gives the best estimate with respect to σ iv) In section 5 we apply these results to some operators defined in Sobolev and Besov spaces to demonstrate the differences Notation and Basic Besov Space Properties As already mentioned Besov spaces Bpq s are subspaces of the space of tempered distributions S They coincide with special cases of traditional smoothness function spaces such as Hölder and Sobolev spaces Note eg that Bpp s = Ws p for s / Z and p and even B s = Hs := W s for all s R As from now we use the term Sobolev space only for the Hilbert spaces H s This clarifies the characterization that the Besov space Bpq s contains functions having s derivatives in L p norm The second integrability index q declares a finer nuance of smoothness In the following we omit the second integrability index q of the Besov spaces which is always equal to the corresponding first one p There are a several ways of defining Besov spaces Most commonly they are defined via the modulus of smoothness a way to model differential properties For a detailed introduction of Besov spaces via moduli of smoothness in conjunction with other smoothness spaces see eg [ section 45] Another way defining Besov spaces is based on wavelet coefficients According to[9] for all s R p > 0 there exists a wavelet basis {ψ λ } λ Λ such that u p B s p λ Λ ps+d p )) λ u λ p 3) where u λ = uψ λ = uψ λ dx are the wavelet coefficients of u The notation A B means that there exist constants cc > 0 such that ca B CA We will use this equivalent norm throughout the paper An important ingredient in the analysis of the regularization method ) is the embedding result cf [5]): Proposition Let B s p B s p be Besov spaces If s d p > s d p and p p 4) then B s p B s p continuously The term s d p is called differential dimension of Bs p

Regularization in Besov scales 4 The embedding of Besov spaces is often visualized with the help of the DeVore diagram[]whereoneplotsthesmoothnesssagainst/pseefigure ByB s p B s p in the following we denote not only the set-theoretical embedding but also the continuous embedding s p B s 0 p 0 s 0 p 0 s = d p +s 0 d p 0 {B B B s 0 p 0 } {B B B s 0 p 0 } Figure DeVore diagram for the embedding of Besov spaces We are going to use the following Besov spaces: B D := B s D pd for the domain of F B R := B s R pr for the space in which we regularize B S := B s S for the source condition B G := B s G pg for the range of F which models the smoothing properties of F As stated above the smoothing properties of the operator F : B D L are modeled by assuming that the range of its adjoint is small namely rgf = B G B D = B s D p D where p is defined via p + p = hence p = p p Consequently we have s G d > s D d p D p D 3 Convergence and Convergence Rates The first result we need is a regularization result in the regularization space B R Theorem 3 Let B R B D and let u be a minimum- -solution of Fu = v Then for each minimizer u αδ of T α u) = Fu v δ +α u and the parameter rule α δ we get convergence u αδ u 0 δ 0 5)

Regularization in Besov scales 5 Proof of theorem 3 We equip B D and L with the weak topologies and want to use theorem 35 from [5] To do so we need the following to be fulfilled: i) The norm L is weakly lower-semicontinuous in L ii) F : B D L is weakly continuous iii) is proper convex and weakly lower-semicontinuous on B D iv) The sets A α = {u Fu v δ +α u < M} are weakly sequentially compact in B D The first point is obvious and the second point is fulfilled by the assumption that F is linear and continuous For the forth point note that due to the continuous embedding we have BD C and hence the sets A α are bounded in B D which implies weak sequential compactness due to reflexivity of B D For the third point note that there exists a wavelet basis {ψ λ } which is an unconditional basis for both B R and B D Now let u k u weakly in B D and u k B R Since the ψ k are also elements of the dual spaces and B D it holds for all λ u k ψ λ k uψ λ and hence a sequence u k bounded in B R converges weakly to u in B R if it does in the larger space B D because the duality pairing is the same in both spaces and {ψ λ } is an unconditional basis in B R This shows the weak lower-semicontinuity of on B R -bounded sets in B D which is sufficient for theorem 35 from [5] to hold) Now by theorem 35 from [5] it follows that u αδ u weakly in B D and by the above considerations also in B R ) and moreover u αδ u Since B R is uniformly convex this implies u αδ u strongly in B R Now we formulate a theorem on the rate of convergence which follows from the general results on regularization in Banach spaces[5] We assume that certain knowledge on the true solution u is available ie a certain source condition is fulfilled The source condition is formulated in terms of Besov smoothness This assumption together with the assumptions on the range of F leads to a regularization term for which a certain convergence rate in Sobolev norm can be proven Theorem 3 Let u B S B D with Then for each minimizer u αδ of the Tikhonov functional T α u) = Fu v δ +α u with = + s R s S s G 6) + and the parameter rule α δ we get the convergence rate where σ := s R +d ) u αδ u H σ = O δ) 7)

Regularization in Besov scales 6 Remark 33 Notice that in general the convergence statements in theorem 3 and theorem 3 correspond to different Besov spaces B R and H σ The spaces coincide if and only if = otherwise we cannot give any information of inclusions because the differential dimensions are equal: σ d = s R d Remark 34 The definitions of and s R in theorem 3 imply that B S B R Otherwise the statement would not be meaningful since if B S B R To see this note that due to B G BD B S B D we get p D and hence u B S : u = the inequality p D p D = + = + ) pd p D + p D ) = holds and because To see the inequality for the differential dimension of B R and B S note that B S B D BG and hence pg s S +s G ) < d ) which leads to s S +s G ) +d + ) d ) pg <d ) +d + ) d ) = 0 Applying this to the constraints 6) for and s R yields s R d s S s G + d + = s S d + s S +s G ) +d + ) d ) + ) < s S d For the proof of theorem 3 we need a property of the mapping : B S [0 ) Proposition 35 Let u B S and let s R and fulfill 6) Then ) { } u = u B G Proof Let u B S Since > 0 = + > we get u ) = { u } = { λ Λ s R +d )) λ signu λ ) u λ } 8)

Regularization in Besov scales 7 and hence u = s G +d )) λ pr s R +d )) p λ R signu λ ) u λ B G λ Λ = p R λ Λ Because 6) if fulfilled we get for the exponent hence since u B S [s G +d ))+ s R +d ))] λ u λ ) s G +d )) + s R +d )) p R pg = s G + s R +d p ) G pg = s G + p ) G s R +s R +d ) s S + d ) u B R B G p R s S +d )) λ u λ p R u BS < Now we are able to do the Proof of theorem 3 In [5] it is proved that the source condition leads to the estimate for the so-called Bregman distance w L : F w u ) 9) D u u αδ u ) = Oδ) for minimizers u αδ of the Tikhonov functional ) and α δ Here by assumption the range of the adjoint operator F is B G and hence with proposition 35 we get ) { } u = u B G = rgf ) thus the source condition 9) is fulfilled Further we get with 8) D u u αδ u ) = u αδ u u u αδ u = λ Λ s R +d )) λ u αδ λ u λ signu λ ) u λ u αδ λ u λ ) ) =Oδ) For ab R C > a b a < L < p by [3 lemma 47] b p a p psigna) a p b a) kpcl) b a

Regularization in Besov scales 8 wherekpcl)isapositive constant whichdepends onp C andl Sincebyremark34 it holds u B S B R and hence C > 0 : s R+d )) p λ R u λ < C λ Λ Furthermore since u αδ u 0 for δ 0 we get according to theorem 3 L > 0 : s R+d )) p λ R [u αδ λ u λ ] < L λ Λ Applying this with a = s R+d )) λ u αδ λ b = s R+d )) λ u λ and p = ] since we get D u u αδ u ) K s R+d ))) p λ R u αδ λ u λ λ Λ K u αδ λ u λ H s R +d ) because of the norm equivalence 3) and the fact that H s = B s Finally this gives u αδ u H σ = O δ) where σ := s R +d ) for all s 4 Source Condition Weakening In the setup of theorem 3 we assumed that a source condition in terms of Besov smoothness is known ie u B S From that a regularization penalty was derived which leads to a convergence rate in a certain Sobolev space Besov spaces are embedded into each other via the non-linear intricate properties 4) of proposition Considering this the question arises which penalties and convergence rates ie which σ) follows from a weakened source condition u Bp s with B S Bp s B D In addition to the embedding properties 4) for application of theorem 3 one has to ensure p This yields to the following set of possible weaker source conditions u B s p such that B S B s p ie s S d > s d p 0) B s p B D ie ] ie p ) s d p > s D d p D ) p p D 3) p 4)

Regularization in Besov scales 9 s p s > d p +s D d p D s D d p D s < d p +s S d s S d s D s S BS BD p D Figure Weaker source conditions u B s p with B S B s p B D p D > Figure illustrates the set of weaker source conditions ie the equalities 0)-4) graphically for p D < which ensures p The direct application of theorem 3 to the idea of weakening the source condition with 0)-4) gives the following theorem Theorem 4 Let u B S B D with Further let p > 0 with p min{p D } and ε > 0 Then for each minimizer u αδ of the Tikhonov functional T α u) = Fu v δ +α u with = p+ s R ps S s G p+ d p+ p )) ε p ) 5) and the parameter rule α δ we get the convergence rate u αδ u H σ = O δ) where σ := s R +d ) Proof From )3) and 4) it follows that theorem 3 is applicable for p > 0 with p min{p D } To ensure the embedding properties for the differential dimension ie equation 0) and ) one has to choose s R with s S d > s d p > s D d p D With that the application of theorem 3 yields 5) and hence the convergence in H σ The convergence result in theorem 4 gets stronger as σ increases Since σ depends ons R and we address the question how to choose B R inaway such that σ is maximal We try to find the regularization penalty which gives the best estimate with

Regularization in Besov scales 0 respect to σ while F and the spaces B S B G and B D are fixed) Since σ depends strictly monotone on s R we have to choose s R as large as possible so that we have to solve the following optimization problem which depends only on p: ps S s G p+ +d max p such that p min{p D } [ p+ p G + p )] ε ) } p Since ε > 0 can be arbitrarily small we neglect the term ε p ) and hence we have to find the maximum of σp) := ps S s G p+ +d = [ p+ pg p G + p )] p s S d ) + p G s G d p+ p+ p G The function σ is monotonically increasing in p since for p > p we get σp ) σp ) p = p ) s S d )+ p + p + p p ) = s S d p + )p + ) since B S B D BG This proves pg ) p ) G p + p + s G d )) > 0 p G s G d ) p G Corollary 4 Let u B S B D and ε > 0 sufficiently small Then the Tikhonov regularization T α with the parameter rule α δ penalty according to 5) with p := min{p D } gives the strongest convergence ) p i) If p D we get with ε := ε = p D + s R = p Ds S s G p D + d p D )) ε p D + a convergence rate result 7) in H σ with σ = p Ds S s [ G +d p D + pg + p )] D ε p D + p G ii) If < p D we obtain with convergence rate 7) in B R = H s R = s R = ss d s G d )) ε 6)

Regularization in Besov scales Remark 43 If < min{p D } the convergence rate in corollary 4 is better than in theorem 3 Note that the Tikhonov functionals do not coincide A curiosity of theorem 3 ie of the straight forward application of the Banach space regularization results [55] is that a more restrictive source condition B T B S does not necessarily enforce a better convergence rate As the following counterexample shows sometimes the converse may happen Counterexample 44 Let ε > 0 be sufficiently small and η > 0 Further let F be an operator with F : H η L rgf = H η i) With the loose source condition u B S = H η theorem 3 yields a convergence rate in Lebesgue space L The choice B S = H η leads to B R = L ) ii) If we tighten the condition to u B η+d +3ε H η we get the regularization space B R = B η+ε+d/6 3/ and a convergence rate in Sobolev space H η 3 +ε which is larger than in L for small ε In contrast to that the usage of Besov space embeddings ie corollary 4 rewards a tighter source condition with a stronger convergence rate: Let B T B S ie s T d p T > s S d p T Then we get consequently for case i) p D ) σb T ) σb S ) = and for case ii) < p D ) 5 Examples σb T ) σb S ) = p D s T d s S d ) ) > 0 p D + p T s T d p T s S d ) ) > 0 In the following we will illustrate the convergence rate results with a few examples With the first one we want to show that the choice of the parameter p resp the choice of the source condition B S B s p B D cf 0)-4)) influences the convergence rate significantly Example 5 Smoothing in the Sobolev scale) Let d = η > and consider the operator F : H η L with rgf = H η ie we consider smoothing of order η in the Sobolev scale Moreover we assume that the source condition u B η H η holds Theorem 4 yields convergence rates

Regularization in Besov scales for Tikhonov penalties p) with p B s R p) S p = p D Since σ s monotone in p p) cf solution of the optimization problem we just investigate in the two boundary values here For p = we get the Tikhonov functional T α u) = Fu v δ +α u 3 B 0 3 With that worst parameter choice resp worst source condition theorem 4 yields σ = η η 3 + 3 = 6 andhence theconvergence rateoccursinasobolevspace H σ withnegative smoothness Next let us check the rate with optimal parameter p = Here we get for the Tikhonov functional T α u) = Fu v δ +α u H η 4 ε the convergence rate in the Sobolev space H σ with smoothness σ = 4η η 4 + 4 +) ε = η 4 ε which is greater than zero for small ε since η > Hence we get a convergence rate in a Sobolev space with positive smoothness The first example may leadtotheconclusion that apenalty formulatedinasobolev space gives the best convergence rate This impression may be intensified because the optimal source also lives in a Sobolev spaces ie p = p D = As we will see now with the next two examples with operators formulated in Banach scales this guess is not true Moreover the following examples illustrate the difference between the cases = min{p D } and < min{p D } In the first case theorem 4 yields a convergence rate for only one Tikhonov functional resp no optimization is possible cf example 5 In the second case we get a set of allowed Tikhonov penalties depending on p p min{p D } Example 5 Smoothing in the Besov scale = min{p D }) Let d = η > 0 arbitrary 0 < θ small and consider the operator F : B η +θ L with rgf = B η +θ = B+θ) η θ which models smoothing in the scale of Besov spaces Further let u B η+θ +θ be the source condition Notice that B η+θ +θ B η +θ and +θ +θ for θ θ and hence we can guarantee Due to = min{p D } = p D it follows from theorem 4 that only the Tikhonov functionals with p = = p D ie T α u) = Fu v δ +α u

Regularization in Besov scales 3 with = p+p p = p = θ + and s R p η +θ)+p η) p+p = η + θ θ+ yields a convergence rate in Sobolev space H σ The maximal smoothness σ is obtained with the penalty with s R = η + θ p and it reads as σ = p η +θ)+p η) p+p To put it roughly: For the operator + p = η + θ θ + F : B η L with rgf = B η the source condition u B η and the Tikhonov functional we a get convergence rate T α u) = Fu v δ +α u B η u αδ u H η = O δ) In the above Besov scale example no optimization of the convergence rate was possible In the next example there is a set of allowed Tikhonov regularizations and hence an optimal one Example 53 Smoothing in the Besov scale < min{p D }) Let d = η > 0 arbitrary 0 < θ small and consider the operator ) F : B η 3 L with rgf = B η 3 = B η 3 Further let u B η+ +θ B η 3 be the source condition Notice that since B S B D and p D < we can guarantee the second assumption of theorem 4 Here theorem 4 yields convergence rates for a set of Tikhonov penalties with p p D We will just investigate in the two boundary values here again With the worst parameter choice ie p = theorem 4 yields with the Tikhonov functional T α u) = Fu v δ +α u with = 4+θ 3 and s R = s S s G + = η + θ+ θ+4 a convergence rate in Hσ with σ = η + + θ θ+4 For the optimal parameter p = p D we get a penalty = p D = 3 and s R = s S pd )) s G p D p D + ε = η + 3 + 9 θ ) ε θ+

Regularization in Besov scales 4 Theorem 4 yields a convergence rate with σ = η + 6 + θ ) ε 9 θ + ) p with small ε := ε D > 0 To put it roughly: Consider the operator F : B η 3 L F : L B η 3 and the source condition u B η+ For the worst choice p = we get for the Tikhonov functional a convergence rate T α u) = Fu v δ +α u 4 3 u αδ u H η = O δ) B η+ 4 4 3 The optimal choice p = p D yields with the Tikhonov functional a convergence rate T α u) = Fu v δ +α u 3 B η+ 9 3 u αδ u H η+ 8 = O δ) 6 Conclusion The aim of this paper was to make a first attempt to analyze scales of Banach spaces for Tikhonov regularization We used Besov spaces to model the smoothing properties of the operator the regularization term and the source condition The convergence rates results were obtained in the Hilbert scale of Sobolev spaces In comparison to regularization in Hilbert scales initiated in [9] the relation between these spaces is more complicated Of particular interest is the fact that on the one hand tighter source conditions may not lead to stronger convergence rates and on the other hand a less tight source condition may result in a stronger result Our examples in section 5 show only slight improvements in the Sobolev exponents when the Besov-penalty is optimized It is questionable if the effect can be observed numerically However the effect that looser source conditions lead to tighter convergence results is interesting on its own We did not use Besov spaces neither for the discrepancy term in the Tikhonov functional nor to measure the convergence rate Both points are of interest and may lead to more general results Since this paper is a first attempt in this direction we postpone this analysis for future work

Regularization in Besov scales 5 References [] Thomas Bonesky Kristian Bredies Dirk A Lorenz and Peter Maass A generalized conditional gradient method for nonlinear operator equations with sparsity constraints Inverse Problems 3:04 058 007 [] Kristian Bredies A forward-backward splitting algorithm for the minimization of non-smooth convex functionals in Banach space Submitted for publication arxiv:08070778 [3] Kristian Bredies and Dirk A Lorenz Iterated hard shrinkage for minimization problems with sparsity constraints SIAM Journal on Scientific Computing 30):657 683 008 [4] Kristian Bredies and Dirk A Lorenz Linear convergence of iterated soft-thresholding To appear in Journal of Fourier Analysis and Applications 008 [5] Martin Burger and Stanley Osher Convergence rates of convex variational regularization Inverse Problems 05):4 40 004 [6] Matrin Burger Elena Resmerita and Lin He Error estimation for Bregman iterations and inverse scale space methods in image restoration Computing 8 3):09 35 007 Special Issue on Industrial Geometry Guest editors: B Jüttler H Pottmann O Scherzer) [7] Antonin Chambolle Ronald A DeVore Namyong Lee and Bradley J Lucier Nonlinear wavelet image processing: Variational problems compression and noise removal through wavelet shrinkage IEEE Transactions on Image Processing 7:39 335 998 [8] Tony F Chan and Jianghong Shen Image Processing and Analysis - Variational PDE Wavelet and Stochastic Methods SIAM Philadelphia 005 [9] Albert Cohen Numerical Analysis of Wavelet Methods Elsevier Science B V 003 [0] Stephan Dahlke Peter Maass Gerd Teschke Karsten Koch Dirk A Lorenz Stephan Müller Stefan Schiffler Andreas Stämpfli Herbert Thiele and Manuel Werner Multiscale approximation In R Dahlhaus J Kurths P Maass and J Timmer editors Mathematical Methods in Signal Processing and Digital Image Analysis pages 75 09 Springer 008 [] Ingrid Daubechies Michel Defrise and Christine De Mol An iterative thresholding algorithm for linear inverse problems with a sparsity constraint Communications in Pure and Applied Mathematics 57):43 457 004 [] Ronald A DeVore Nonlinear approximation Acta Numerica pages 5 50 998 [3] Roland Griesse and Dirk A Lorenz A semismooth Newton method for Tikhonov functionals with sparsity constraints Inverse Problems 4:035007 9pp) 008 [4] Torsten Hein Convergence rates for regularization of ill-posed problems in Banach spaces by approximate source conditions Inverse Problems 44) August 008 [5] Bernd Hofmann Barbara Kaltenbacher Christiane Poeschl and Otmar Scherzer A convergence rates result for Tikhonov regularization in Banach spaces with non-smooth operators Inverse Problems 33):987 00 007 [6] Esther Klann Michael Kuhn Dirk A Lorenz Peter Maass and Herbert Thiele Shrinkage versus deconvolution Inverse Problems 35):3 48 007 [7] Dirk A Lorenz Solving variational methods in image processing via projections - a common view on T V-denoising and wavelet shrinkage Zeitschrift für angewandte Mathematik und Mechanik 87):47 56 007 [8] Dirk A Lorenz Convergence rates and source conditions for Tikhonov regularization with sparsity constraints To appear in Journal of Inverse and Ill-Posed Problems 008 [9] Frank Natterer Error bounds for Tikhonov regularization in Hilbert scales Applicable Analysis 8&):9 37 984 [0] Ronny Ramlau Regularization properties of Tikhonov regularization with sparsity constraints Electronic Transactions on Numerical Analysis 30:54 74 008 [] Ronny Ramlau and Gerd Teschke A Tikhonov-based projection iteration for nonlinear ill-posed problems with sparsity constraints Numerische Mathematik 04):77 03 006 [] Elena Resmerita Regularization of ill-posed problems in Banach spaces: convergence rates

Regularization in Besov scales 6 Inverse Problems 4):303 34 005 [3] Elena Resmerita and Otmar Scherzer Error estimates for non-quadratic regularization and the relation to enhancement Inverse Problems 3):80 84 006 [4] Leonid I Rudin Stanley J Osher and Emad Fatemi Nonlinear total variation based noise removal algorithms Physica D 60:59 68 99 [5] Thomas Runst and Winfried Sickel Sobolev Spaces of Fractional Order Nemytskij Operators and Nonlinear Partial Differential Equations de Gruyter Series in Nonlinear Analysis and Applications Walter de Gruyter 996 [6] Frank Schöpfer Alfred K Louis and Thomas Schuster Nonlinear iterative methods for linear ill-posed problems in Banach spaces Inverse Problems :3 39 006 [7] Thomas Schuster Peter Maass Thomas Bonesky Kamil S Kazimierski and Frank Schöpfer Minimization of Tikhonov functionals in Banach spaces Abstract and Applied Analysis 008:Article ID 9679 9 pages 008 [8] Curtis R Vogel and Robert Acar Analysis of bounded variation penalty methods for ill-posed problems Inverse Problems 0:7 9 994