arxiv: v2 [math.fa] 18 Jul 2008

Size: px
Start display at page:

Download "arxiv: v2 [math.fa] 18 Jul 2008"

Transcription

1 Optimal Convergence Rates for Tikhonov Regularization in Besov Scales arxiv: v [mathfa] 8 Jul 008 Introduction D A Lorenz and D Trede Zentrum für Technomathematik University of Bremen D 8334 Bremen Germany dlorenz@mathuni-bremende trede@mathuni-bremende Abstract In this paper we deal with linear inverse problems and convergence rates for Tikhonov regularization We consider regularization in a scale of Banach spaces namely the scale of Besov spaces We show that regularization in Banach scales differs from regularization in Hilbert scales in the sense that it is possible that stronger source conditions may lead to weaker convergence rates and vive versa Moreover we present optimal source conditions for regularization in Besov scales AMS classification scheme numbers: 47A565J0 Regularization of inverse problems formulated in Banach spaces have been of recent interest On the one hand there are a several theoretical regularization results such as convergence rates in a general Banach spaces setting see eg [56453] or convergence rates for special sequence spaces such as l p p < see eg [80] On the other hand there are results which deal with solving inverse problems formulated in Banach spaces such as Landweber-like iterations or minimization methods for Tikhonov functionals see eg [6] and [ 4 3 7] respectively The interest in Banach spaces is due to the fact that in many situations a Banach space is better suited to model the data under consideration than a Hilbert space In the context of image processing for example the Banach space BV of functions of bounded variation is used to model images with discontinuities along lines [5 4 8] Moreover [5] presents two examples in which the use of Banach spaces is necessary for a thorough formulation of the problem Another class of Banach spaces are the Besov spaces Bpq s which play an important role in inverse problems related to image processing see eg [7 8 7] InthispaperwemakeafirstattempttoanalyzeinverseproblemsinscalesofBanach spaces generalizing classical Hilbert scales [9] The easiest scale of Banach spaces is the scale of Sobolev spaces Wp s However we are going to use Besov spaces Bpp s since they coincide with the Sobolev scale in most cases if the integrability indices coincide Moreover they come with a characterization in terms of wavelet coefficients which make

2 Regularization in Besov scales them easy to use for our purposes We apply previous convergence rates regularization results from [5 5] in the scale of Besov spaces and develop optimal convergence rates To this end we derive the source conditions that lead to a convergence rate of O δ) in a certain Sobolev space Consider the equation F u = v ) where F is a linear continuous operator F : B D L between the Besov space B D := B s D pd p D s D R p D > and Lebesgue space L In general these function spaces contain functions or distributions defined on the subset Ω R d Due to clarity we omit Ω in the following The Besov spaces B s pp are subspaces of the space of tempered distributions S and in contrast to S they are Banach spaces for p [5] Different from classical approaches we use the domain B D often a superset of L and not L itself That may be of interest in some applications eg mass-spectrometry where the data consists of delta peaks see [0 6]) which are not elements of L If we assume that only noisy data v δ with noise level v v δ δ are available the solution of ) could be unstable and has to be stabilized by regularization methods We use regularization with a Besov constraint ie we regularize by minimizing a not necessarily quadratic functional T α : B D [0 ] defined by T α u) := Fu v δ L +α u ) where B R := B s R pr is a Besov space not necessarily equal to B D Since T α shall be defined on B D we define u = for u / B R In this paper we will investigate regularization properties and convergence rates of theregularizationmethodconsisting oftheminimizationof) ie u αδ argmint α u) The proceeding is as follows i) In section we introduce the notation and collect preliminary results ii) In section 3 we apply convergence rates results for Banach spaces [5 5] With the constraints on and s R in mind and the parameter rule α = δ we will get a stable approximation ie u αδ u 0 δ 0 and a convergence rate in the Sobolev space H σ u αδ u H σ = O δ) with σ depending on s R and theorems 3 and 3) These results restrict the choice of possible regularization spaces B R Using Besov space embeddings in

3 Regularization in Besov scales 3 section 4 we will get a generalization of the first result We find a convergence rate also formulated in a Sobolev space which holds for a larger set of Besov space penalties theorem 4) iii) The convergence result gets stronger as σ increases since for θ > 0 it holds H σ+θ H σ Since σ depends on s R and we address the question how to choose B R in a way such that σ is maximal We will find the regularization penalty which gives the best estimate with respect to σ iv) In section 5 we apply these results to some operators defined in Sobolev and Besov spaces to demonstrate the differences Notation and Basic Besov Space Properties As already mentioned Besov spaces Bpq s are subspaces of the space of tempered distributions S They coincide with special cases of traditional smoothness function spaces such as Hölder and Sobolev spaces Note eg that Bpp s = Ws p for s / Z and p and even B s = Hs := W s for all s R As from now we use the term Sobolev space only for the Hilbert spaces H s This clarifies the characterization that the Besov space Bpq s contains functions having s derivatives in L p norm The second integrability index q declares a finer nuance of smoothness In the following we omit the second integrability index q of the Besov spaces which is always equal to the corresponding first one p There are a several ways of defining Besov spaces Most commonly they are defined via the modulus of smoothness a way to model differential properties For a detailed introduction of Besov spaces via moduli of smoothness in conjunction with other smoothness spaces see eg [ section 45] Another way defining Besov spaces is based on wavelet coefficients According to[9] for all s R p > 0 there exists a wavelet basis {ψ λ } λ Λ such that u p B s p λ Λ ps+d p )) λ u λ p 3) where u λ = uψ λ = uψ λ dx are the wavelet coefficients of u The notation A B means that there exist constants cc > 0 such that ca B CA We will use this equivalent norm throughout the paper An important ingredient in the analysis of the regularization method ) is the embedding result cf [5]): Proposition Let B s p B s p be Besov spaces If s d p > s d p and p p 4) then B s p B s p continuously The term s d p is called differential dimension of Bs p

4 Regularization in Besov scales 4 The embedding of Besov spaces is often visualized with the help of the DeVore diagram[]whereoneplotsthesmoothnesssagainst/pseefigure ByB s p B s p in the following we denote not only the set-theoretical embedding but also the continuous embedding s p B s 0 p 0 s 0 p 0 s = d p +s 0 d p 0 {B B B s 0 p 0 } {B B B s 0 p 0 } Figure DeVore diagram for the embedding of Besov spaces We are going to use the following Besov spaces: B D := B s D pd for the domain of F B R := B s R pr for the space in which we regularize B S := B s S for the source condition B G := B s G pg for the range of F which models the smoothing properties of F As stated above the smoothing properties of the operator F : B D L are modeled by assuming that the range of its adjoint is small namely rgf = B G B D = B s D p D where p is defined via p + p = hence p = p p Consequently we have s G d > s D d p D p D 3 Convergence and Convergence Rates The first result we need is a regularization result in the regularization space B R Theorem 3 Let B R B D and let u be a minimum- -solution of Fu = v Then for each minimizer u αδ of T α u) = Fu v δ +α u and the parameter rule α δ we get convergence u αδ u 0 δ 0 5)

5 Regularization in Besov scales 5 Proof of theorem 3 We equip B D and L with the weak topologies and want to use theorem 35 from [5] To do so we need the following to be fulfilled: i) The norm L is weakly lower-semicontinuous in L ii) F : B D L is weakly continuous iii) is proper convex and weakly lower-semicontinuous on B D iv) The sets A α = {u Fu v δ +α u < M} are weakly sequentially compact in B D The first point is obvious and the second point is fulfilled by the assumption that F is linear and continuous For the forth point note that due to the continuous embedding we have BD C and hence the sets A α are bounded in B D which implies weak sequential compactness due to reflexivity of B D For the third point note that there exists a wavelet basis {ψ λ } which is an unconditional basis for both B R and B D Now let u k u weakly in B D and u k B R Since the ψ k are also elements of the dual spaces and B D it holds for all λ u k ψ λ k uψ λ and hence a sequence u k bounded in B R converges weakly to u in B R if it does in the larger space B D because the duality pairing is the same in both spaces and {ψ λ } is an unconditional basis in B R This shows the weak lower-semicontinuity of on B R -bounded sets in B D which is sufficient for theorem 35 from [5] to hold) Now by theorem 35 from [5] it follows that u αδ u weakly in B D and by the above considerations also in B R ) and moreover u αδ u Since B R is uniformly convex this implies u αδ u strongly in B R Now we formulate a theorem on the rate of convergence which follows from the general results on regularization in Banach spaces[5] We assume that certain knowledge on the true solution u is available ie a certain source condition is fulfilled The source condition is formulated in terms of Besov smoothness This assumption together with the assumptions on the range of F leads to a regularization term for which a certain convergence rate in Sobolev norm can be proven Theorem 3 Let u B S B D with Then for each minimizer u αδ of the Tikhonov functional T α u) = Fu v δ +α u with = + s R s S s G 6) + and the parameter rule α δ we get the convergence rate where σ := s R +d ) u αδ u H σ = O δ) 7)

6 Regularization in Besov scales 6 Remark 33 Notice that in general the convergence statements in theorem 3 and theorem 3 correspond to different Besov spaces B R and H σ The spaces coincide if and only if = otherwise we cannot give any information of inclusions because the differential dimensions are equal: σ d = s R d Remark 34 The definitions of and s R in theorem 3 imply that B S B R Otherwise the statement would not be meaningful since if B S B R To see this note that due to B G BD B S B D we get p D and hence u B S : u = the inequality p D p D = + = + ) pd p D + p D ) = holds and because To see the inequality for the differential dimension of B R and B S note that B S B D BG and hence pg s S +s G ) < d ) which leads to s S +s G ) +d + ) d ) pg <d ) +d + ) d ) = 0 Applying this to the constraints 6) for and s R yields s R d s S s G + d + = s S d + s S +s G ) +d + ) d ) + ) < s S d For the proof of theorem 3 we need a property of the mapping : B S [0 ) Proposition 35 Let u B S and let s R and fulfill 6) Then ) { } u = u B G Proof Let u B S Since > 0 = + > we get u ) = { u } = { λ Λ s R +d )) λ signu λ ) u λ } 8)

7 Regularization in Besov scales 7 and hence u = s G +d )) λ pr s R +d )) p λ R signu λ ) u λ B G λ Λ = p R λ Λ Because 6) if fulfilled we get for the exponent hence since u B S [s G +d ))+ s R +d ))] λ u λ ) s G +d )) + s R +d )) p R pg = s G + s R +d p ) G pg = s G + p ) G s R +s R +d ) s S + d ) u B R B G p R s S +d )) λ u λ p R u BS < Now we are able to do the Proof of theorem 3 In [5] it is proved that the source condition leads to the estimate for the so-called Bregman distance w L : F w u ) 9) D u u αδ u ) = Oδ) for minimizers u αδ of the Tikhonov functional ) and α δ Here by assumption the range of the adjoint operator F is B G and hence with proposition 35 we get ) { } u = u B G = rgf ) thus the source condition 9) is fulfilled Further we get with 8) D u u αδ u ) = u αδ u u u αδ u = λ Λ s R +d )) λ u αδ λ u λ signu λ ) u λ u αδ λ u λ ) ) =Oδ) For ab R C > a b a < L < p by [3 lemma 47] b p a p psigna) a p b a) kpcl) b a

8 Regularization in Besov scales 8 wherekpcl)isapositive constant whichdepends onp C andl Sincebyremark34 it holds u B S B R and hence C > 0 : s R+d )) p λ R u λ < C λ Λ Furthermore since u αδ u 0 for δ 0 we get according to theorem 3 L > 0 : s R+d )) p λ R [u αδ λ u λ ] < L λ Λ Applying this with a = s R+d )) λ u αδ λ b = s R+d )) λ u λ and p = ] since we get D u u αδ u ) K s R+d ))) p λ R u αδ λ u λ λ Λ K u αδ λ u λ H s R +d ) because of the norm equivalence 3) and the fact that H s = B s Finally this gives u αδ u H σ = O δ) where σ := s R +d ) for all s 4 Source Condition Weakening In the setup of theorem 3 we assumed that a source condition in terms of Besov smoothness is known ie u B S From that a regularization penalty was derived which leads to a convergence rate in a certain Sobolev space Besov spaces are embedded into each other via the non-linear intricate properties 4) of proposition Considering this the question arises which penalties and convergence rates ie which σ) follows from a weakened source condition u Bp s with B S Bp s B D In addition to the embedding properties 4) for application of theorem 3 one has to ensure p This yields to the following set of possible weaker source conditions u B s p such that B S B s p ie s S d > s d p 0) B s p B D ie ] ie p ) s d p > s D d p D ) p p D 3) p 4)

9 Regularization in Besov scales 9 s p s > d p +s D d p D s D d p D s < d p +s S d s S d s D s S BS BD p D Figure Weaker source conditions u B s p with B S B s p B D p D > Figure illustrates the set of weaker source conditions ie the equalities 0)-4) graphically for p D < which ensures p The direct application of theorem 3 to the idea of weakening the source condition with 0)-4) gives the following theorem Theorem 4 Let u B S B D with Further let p > 0 with p min{p D } and ε > 0 Then for each minimizer u αδ of the Tikhonov functional T α u) = Fu v δ +α u with = p+ s R ps S s G p+ d p+ p )) ε p ) 5) and the parameter rule α δ we get the convergence rate u αδ u H σ = O δ) where σ := s R +d ) Proof From )3) and 4) it follows that theorem 3 is applicable for p > 0 with p min{p D } To ensure the embedding properties for the differential dimension ie equation 0) and ) one has to choose s R with s S d > s d p > s D d p D With that the application of theorem 3 yields 5) and hence the convergence in H σ The convergence result in theorem 4 gets stronger as σ increases Since σ depends ons R and we address the question how to choose B R inaway such that σ is maximal We try to find the regularization penalty which gives the best estimate with

10 Regularization in Besov scales 0 respect to σ while F and the spaces B S B G and B D are fixed) Since σ depends strictly monotone on s R we have to choose s R as large as possible so that we have to solve the following optimization problem which depends only on p: ps S s G p+ +d max p such that p min{p D } [ p+ p G + p )] ε ) } p Since ε > 0 can be arbitrarily small we neglect the term ε p ) and hence we have to find the maximum of σp) := ps S s G p+ +d = [ p+ pg p G + p )] p s S d ) + p G s G d p+ p+ p G The function σ is monotonically increasing in p since for p > p we get σp ) σp ) p = p ) s S d )+ p + p + p p ) = s S d p + )p + ) since B S B D BG This proves pg ) p ) G p + p + s G d )) > 0 p G s G d ) p G Corollary 4 Let u B S B D and ε > 0 sufficiently small Then the Tikhonov regularization T α with the parameter rule α δ penalty according to 5) with p := min{p D } gives the strongest convergence ) p i) If p D we get with ε := ε = p D + s R = p Ds S s G p D + d p D )) ε p D + a convergence rate result 7) in H σ with σ = p Ds S s [ G +d p D + pg + p )] D ε p D + p G ii) If < p D we obtain with convergence rate 7) in B R = H s R = s R = ss d s G d )) ε 6)

11 Regularization in Besov scales Remark 43 If < min{p D } the convergence rate in corollary 4 is better than in theorem 3 Note that the Tikhonov functionals do not coincide A curiosity of theorem 3 ie of the straight forward application of the Banach space regularization results [55] is that a more restrictive source condition B T B S does not necessarily enforce a better convergence rate As the following counterexample shows sometimes the converse may happen Counterexample 44 Let ε > 0 be sufficiently small and η > 0 Further let F be an operator with F : H η L rgf = H η i) With the loose source condition u B S = H η theorem 3 yields a convergence rate in Lebesgue space L The choice B S = H η leads to B R = L ) ii) If we tighten the condition to u B η+d +3ε H η we get the regularization space B R = B η+ε+d/6 3/ and a convergence rate in Sobolev space H η 3 +ε which is larger than in L for small ε In contrast to that the usage of Besov space embeddings ie corollary 4 rewards a tighter source condition with a stronger convergence rate: Let B T B S ie s T d p T > s S d p T Then we get consequently for case i) p D ) σb T ) σb S ) = and for case ii) < p D ) 5 Examples σb T ) σb S ) = p D s T d s S d ) ) > 0 p D + p T s T d p T s S d ) ) > 0 In the following we will illustrate the convergence rate results with a few examples With the first one we want to show that the choice of the parameter p resp the choice of the source condition B S B s p B D cf 0)-4)) influences the convergence rate significantly Example 5 Smoothing in the Sobolev scale) Let d = η > and consider the operator F : H η L with rgf = H η ie we consider smoothing of order η in the Sobolev scale Moreover we assume that the source condition u B η H η holds Theorem 4 yields convergence rates

12 Regularization in Besov scales for Tikhonov penalties p) with p B s R p) S p = p D Since σ s monotone in p p) cf solution of the optimization problem we just investigate in the two boundary values here For p = we get the Tikhonov functional T α u) = Fu v δ +α u 3 B 0 3 With that worst parameter choice resp worst source condition theorem 4 yields σ = η η = 6 andhence theconvergence rateoccursinasobolevspace H σ withnegative smoothness Next let us check the rate with optimal parameter p = Here we get for the Tikhonov functional T α u) = Fu v δ +α u H η 4 ε the convergence rate in the Sobolev space H σ with smoothness σ = 4η η ) ε = η 4 ε which is greater than zero for small ε since η > Hence we get a convergence rate in a Sobolev space with positive smoothness The first example may leadtotheconclusion that apenalty formulatedinasobolev space gives the best convergence rate This impression may be intensified because the optimal source also lives in a Sobolev spaces ie p = p D = As we will see now with the next two examples with operators formulated in Banach scales this guess is not true Moreover the following examples illustrate the difference between the cases = min{p D } and < min{p D } In the first case theorem 4 yields a convergence rate for only one Tikhonov functional resp no optimization is possible cf example 5 In the second case we get a set of allowed Tikhonov penalties depending on p p min{p D } Example 5 Smoothing in the Besov scale = min{p D }) Let d = η > 0 arbitrary 0 < θ small and consider the operator F : B η +θ L with rgf = B η +θ = B+θ) η θ which models smoothing in the scale of Besov spaces Further let u B η+θ +θ be the source condition Notice that B η+θ +θ B η +θ and +θ +θ for θ θ and hence we can guarantee Due to = min{p D } = p D it follows from theorem 4 that only the Tikhonov functionals with p = = p D ie T α u) = Fu v δ +α u

13 Regularization in Besov scales 3 with = p+p p = p = θ + and s R p η +θ)+p η) p+p = η + θ θ+ yields a convergence rate in Sobolev space H σ The maximal smoothness σ is obtained with the penalty with s R = η + θ p and it reads as σ = p η +θ)+p η) p+p To put it roughly: For the operator + p = η + θ θ + F : B η L with rgf = B η the source condition u B η and the Tikhonov functional we a get convergence rate T α u) = Fu v δ +α u B η u αδ u H η = O δ) In the above Besov scale example no optimization of the convergence rate was possible In the next example there is a set of allowed Tikhonov regularizations and hence an optimal one Example 53 Smoothing in the Besov scale < min{p D }) Let d = η > 0 arbitrary 0 < θ small and consider the operator ) F : B η 3 L with rgf = B η 3 = B η 3 Further let u B η+ +θ B η 3 be the source condition Notice that since B S B D and p D < we can guarantee the second assumption of theorem 4 Here theorem 4 yields convergence rates for a set of Tikhonov penalties with p p D We will just investigate in the two boundary values here again With the worst parameter choice ie p = theorem 4 yields with the Tikhonov functional T α u) = Fu v δ +α u with = 4+θ 3 and s R = s S s G + = η + θ+ θ+4 a convergence rate in Hσ with σ = η + + θ θ+4 For the optimal parameter p = p D we get a penalty = p D = 3 and s R = s S pd )) s G p D p D + ε = η θ ) ε θ+

14 Regularization in Besov scales 4 Theorem 4 yields a convergence rate with σ = η θ ) ε 9 θ + ) p with small ε := ε D > 0 To put it roughly: Consider the operator F : B η 3 L F : L B η 3 and the source condition u B η+ For the worst choice p = we get for the Tikhonov functional a convergence rate T α u) = Fu v δ +α u 4 3 u αδ u H η = O δ) B η The optimal choice p = p D yields with the Tikhonov functional a convergence rate T α u) = Fu v δ +α u 3 B η+ 9 3 u αδ u H η+ 8 = O δ) 6 Conclusion The aim of this paper was to make a first attempt to analyze scales of Banach spaces for Tikhonov regularization We used Besov spaces to model the smoothing properties of the operator the regularization term and the source condition The convergence rates results were obtained in the Hilbert scale of Sobolev spaces In comparison to regularization in Hilbert scales initiated in [9] the relation between these spaces is more complicated Of particular interest is the fact that on the one hand tighter source conditions may not lead to stronger convergence rates and on the other hand a less tight source condition may result in a stronger result Our examples in section 5 show only slight improvements in the Sobolev exponents when the Besov-penalty is optimized It is questionable if the effect can be observed numerically However the effect that looser source conditions lead to tighter convergence results is interesting on its own We did not use Besov spaces neither for the discrepancy term in the Tikhonov functional nor to measure the convergence rate Both points are of interest and may lead to more general results Since this paper is a first attempt in this direction we postpone this analysis for future work

15 Regularization in Besov scales 5 References [] Thomas Bonesky Kristian Bredies Dirk A Lorenz and Peter Maass A generalized conditional gradient method for nonlinear operator equations with sparsity constraints Inverse Problems 3: [] Kristian Bredies A forward-backward splitting algorithm for the minimization of non-smooth convex functionals in Banach space Submitted for publication arxiv: [3] Kristian Bredies and Dirk A Lorenz Iterated hard shrinkage for minimization problems with sparsity constraints SIAM Journal on Scientific Computing 30): [4] Kristian Bredies and Dirk A Lorenz Linear convergence of iterated soft-thresholding To appear in Journal of Fourier Analysis and Applications 008 [5] Martin Burger and Stanley Osher Convergence rates of convex variational regularization Inverse Problems 05): [6] Matrin Burger Elena Resmerita and Lin He Error estimation for Bregman iterations and inverse scale space methods in image restoration Computing 8 3): Special Issue on Industrial Geometry Guest editors: B Jüttler H Pottmann O Scherzer) [7] Antonin Chambolle Ronald A DeVore Namyong Lee and Bradley J Lucier Nonlinear wavelet image processing: Variational problems compression and noise removal through wavelet shrinkage IEEE Transactions on Image Processing 7: [8] Tony F Chan and Jianghong Shen Image Processing and Analysis - Variational PDE Wavelet and Stochastic Methods SIAM Philadelphia 005 [9] Albert Cohen Numerical Analysis of Wavelet Methods Elsevier Science B V 003 [0] Stephan Dahlke Peter Maass Gerd Teschke Karsten Koch Dirk A Lorenz Stephan Müller Stefan Schiffler Andreas Stämpfli Herbert Thiele and Manuel Werner Multiscale approximation In R Dahlhaus J Kurths P Maass and J Timmer editors Mathematical Methods in Signal Processing and Digital Image Analysis pages Springer 008 [] Ingrid Daubechies Michel Defrise and Christine De Mol An iterative thresholding algorithm for linear inverse problems with a sparsity constraint Communications in Pure and Applied Mathematics 57): [] Ronald A DeVore Nonlinear approximation Acta Numerica pages [3] Roland Griesse and Dirk A Lorenz A semismooth Newton method for Tikhonov functionals with sparsity constraints Inverse Problems 4: pp) 008 [4] Torsten Hein Convergence rates for regularization of ill-posed problems in Banach spaces by approximate source conditions Inverse Problems 44) August 008 [5] Bernd Hofmann Barbara Kaltenbacher Christiane Poeschl and Otmar Scherzer A convergence rates result for Tikhonov regularization in Banach spaces with non-smooth operators Inverse Problems 33): [6] Esther Klann Michael Kuhn Dirk A Lorenz Peter Maass and Herbert Thiele Shrinkage versus deconvolution Inverse Problems 35): [7] Dirk A Lorenz Solving variational methods in image processing via projections - a common view on T V-denoising and wavelet shrinkage Zeitschrift für angewandte Mathematik und Mechanik 87): [8] Dirk A Lorenz Convergence rates and source conditions for Tikhonov regularization with sparsity constraints To appear in Journal of Inverse and Ill-Posed Problems 008 [9] Frank Natterer Error bounds for Tikhonov regularization in Hilbert scales Applicable Analysis 8&): [0] Ronny Ramlau Regularization properties of Tikhonov regularization with sparsity constraints Electronic Transactions on Numerical Analysis 30: [] Ronny Ramlau and Gerd Teschke A Tikhonov-based projection iteration for nonlinear ill-posed problems with sparsity constraints Numerische Mathematik 04): [] Elena Resmerita Regularization of ill-posed problems in Banach spaces: convergence rates

16 Regularization in Besov scales 6 Inverse Problems 4): [3] Elena Resmerita and Otmar Scherzer Error estimates for non-quadratic regularization and the relation to enhancement Inverse Problems 3): [4] Leonid I Rudin Stanley J Osher and Emad Fatemi Nonlinear total variation based noise removal algorithms Physica D 60: [5] Thomas Runst and Winfried Sickel Sobolev Spaces of Fractional Order Nemytskij Operators and Nonlinear Partial Differential Equations de Gruyter Series in Nonlinear Analysis and Applications Walter de Gruyter 996 [6] Frank Schöpfer Alfred K Louis and Thomas Schuster Nonlinear iterative methods for linear ill-posed problems in Banach spaces Inverse Problems : [7] Thomas Schuster Peter Maass Thomas Bonesky Kamil S Kazimierski and Frank Schöpfer Minimization of Tikhonov functionals in Banach spaces Abstract and Applied Analysis 008:Article ID pages 008 [8] Curtis R Vogel and Robert Acar Analysis of bounded variation penalty methods for ill-posed problems Inverse Problems 0:

arxiv: v2 [math.fa] 18 Jul 2008

arxiv: v2 [math.fa] 18 Jul 2008 Convergence rates and source conditions for Tihonov regularization with sparsity constraints Dir A. Lorenz arxiv:0801.1774v2 [math.fa] 18 Jul 2008 October 26, 2018 Abstract This paper addresses the regularization

More information

Morozov s discrepancy principle for Tikhonov-type functionals with non-linear operators

Morozov s discrepancy principle for Tikhonov-type functionals with non-linear operators Morozov s discrepancy principle for Tikhonov-type functionals with non-linear operators Stephan W Anzengruber 1 and Ronny Ramlau 1,2 1 Johann Radon Institute for Computational and Applied Mathematics,

More information

Convergence rates in l 1 -regularization when the basis is not smooth enough

Convergence rates in l 1 -regularization when the basis is not smooth enough Convergence rates in l 1 -regularization when the basis is not smooth enough Jens Flemming, Markus Hegland November 29, 2013 Abstract Sparsity promoting regularization is an important technique for signal

More information

Iterative regularization of nonlinear ill-posed problems in Banach space

Iterative regularization of nonlinear ill-posed problems in Banach space Iterative regularization of nonlinear ill-posed problems in Banach space Barbara Kaltenbacher, University of Klagenfurt joint work with Bernd Hofmann, Technical University of Chemnitz, Frank Schöpfer and

More information

c 2011 International Press Vol. 18, No. 1, pp , March DENNIS TREDE

c 2011 International Press Vol. 18, No. 1, pp , March DENNIS TREDE METHODS AND APPLICATIONS OF ANALYSIS. c 2011 International Press Vol. 18, No. 1, pp. 105 110, March 2011 007 EXACT SUPPORT RECOVERY FOR LINEAR INVERSE PROBLEMS WITH SPARSITY CONSTRAINTS DENNIS TREDE Abstract.

More information

Regularization in Banach Space

Regularization in Banach Space Regularization in Banach Space Barbara Kaltenbacher, Alpen-Adria-Universität Klagenfurt joint work with Uno Hämarik, University of Tartu Bernd Hofmann, Technical University of Chemnitz Urve Kangro, University

More information

DFG-Schwerpunktprogramm 1324

DFG-Schwerpunktprogramm 1324 DFG-Schwerpuntprogramm 324 Extration quantifizierbarer Information aus omplexen Systemen Regularization With Non-convex Separable Constraints K. Bredies, D. A. Lorenz Preprint Edited by AG Numeri/Optimierung

More information

Convergence rates for Morozov s Discrepancy Principle using Variational Inequalities

Convergence rates for Morozov s Discrepancy Principle using Variational Inequalities Convergence rates for Morozov s Discrepancy Principle using Variational Inequalities Stephan W Anzengruber Ronny Ramlau Abstract We derive convergence rates for Tikhonov-type regularization with conve

More information

Accelerated Landweber iteration in Banach spaces. T. Hein, K.S. Kazimierski. Preprint Fakultät für Mathematik

Accelerated Landweber iteration in Banach spaces. T. Hein, K.S. Kazimierski. Preprint Fakultät für Mathematik Accelerated Landweber iteration in Banach spaces T. Hein, K.S. Kazimierski Preprint 2009-17 Fakultät für Mathematik Impressum: Herausgeber: Der Dekan der Fakultät für Mathematik an der Technischen Universität

More information

Due Giorni di Algebra Lineare Numerica (2GALN) Febbraio 2016, Como. Iterative regularization in variable exponent Lebesgue spaces

Due Giorni di Algebra Lineare Numerica (2GALN) Febbraio 2016, Como. Iterative regularization in variable exponent Lebesgue spaces Due Giorni di Algebra Lineare Numerica (2GALN) 16 17 Febbraio 2016, Como Iterative regularization in variable exponent Lebesgue spaces Claudio Estatico 1 Joint work with: Brigida Bonino 1, Fabio Di Benedetto

More information

Iterated hard shrinkage for minimization problems with sparsity constraints

Iterated hard shrinkage for minimization problems with sparsity constraints Iterated hard shrinkage for minimization problems with sparsity constraints Kristian Bredies, Dirk A. Lorenz June 6, 6 Abstract A new iterative algorithm for the solution of minimization problems which

More information

The impact of a curious type of smoothness conditions on convergence rates in l 1 -regularization

The impact of a curious type of smoothness conditions on convergence rates in l 1 -regularization The impact of a curious type of smoothness conditions on convergence rates in l 1 -regularization Radu Ioan Boț and Bernd Hofmann March 1, 2013 Abstract Tikhonov-type regularization of linear and nonlinear

More information

Convergence rates of convex variational regularization

Convergence rates of convex variational regularization INSTITUTE OF PHYSICS PUBLISHING Inverse Problems 20 (2004) 1411 1421 INVERSE PROBLEMS PII: S0266-5611(04)77358-X Convergence rates of convex variational regularization Martin Burger 1 and Stanley Osher

More information

arxiv: v1 [math.na] 21 Aug 2014 Barbara Kaltenbacher

arxiv: v1 [math.na] 21 Aug 2014 Barbara Kaltenbacher ENHANCED CHOICE OF THE PARAMETERS IN AN ITERATIVELY REGULARIZED NEWTON- LANDWEBER ITERATION IN BANACH SPACE arxiv:48.526v [math.na] 2 Aug 24 Barbara Kaltenbacher Alpen-Adria-Universität Klagenfurt Universitätstrasse

More information

Linear convergence of iterative soft-thresholding

Linear convergence of iterative soft-thresholding arxiv:0709.1598v3 [math.fa] 11 Dec 007 Linear convergence of iterative soft-thresholding Kristian Bredies and Dirk A. Lorenz ABSTRACT. In this article, the convergence of the often used iterative softthresholding

More information

arxiv: v1 [math.na] 16 Jan 2018

arxiv: v1 [math.na] 16 Jan 2018 A FAST SUBSPACE OPTIMIZATION METHOD FOR NONLINEAR INVERSE PROBLEMS IN BANACH SPACES WITH AN APPLICATION IN PARAMETER IDENTIFICATION ANNE WALD arxiv:1801.05221v1 [math.na] 16 Jan 2018 Abstract. We introduce

More information

ITERATIVELY SOLVING LINEAR INVERSE PROBLEMS UNDER GENERAL CONVEX CONSTRAINTS. Ingrid Daubechies. Gerd Teschke. Luminita Vese

ITERATIVELY SOLVING LINEAR INVERSE PROBLEMS UNDER GENERAL CONVEX CONSTRAINTS. Ingrid Daubechies. Gerd Teschke. Luminita Vese Inverse Problems and Imaging Volume 1, No. 1, 2007, 29 46 Web site: http://www.aimsciences.org ITERATIVELY SOLVING LINEAR INVERSE PROBLEMS UNDER GENERAL CONVEX CONSTRAINTS Ingrid Daubechies Princeton University,

More information

Modified Landweber iteration in Banach spaces convergence and convergence rates

Modified Landweber iteration in Banach spaces convergence and convergence rates Modified Landweber iteration in Banach spaces convergence and convergence rates Torsten Hein, Kamil S. Kazimierski August 4, 009 Abstract Abstract. We introduce and discuss an iterative method of relaxed

More information

Sparse Recovery in Inverse Problems

Sparse Recovery in Inverse Problems Radon Series Comp. Appl. Math XX, 1 63 de Gruyter 20YY Sparse Recovery in Inverse Problems Ronny Ramlau and Gerd Teschke Abstract. Within this chapter we present recent results on sparse recovery algorithms

More information

SPARSE SIGNAL RESTORATION. 1. Introduction

SPARSE SIGNAL RESTORATION. 1. Introduction SPARSE SIGNAL RESTORATION IVAN W. SELESNICK 1. Introduction These notes describe an approach for the restoration of degraded signals using sparsity. This approach, which has become quite popular, is useful

More information

Canberra Symposium on Regularization and Chemnitz Symposium on Inverse Problems on Tour

Canberra Symposium on Regularization and Chemnitz Symposium on Inverse Problems on Tour Monday, 19 th November 2012 8:00 Registration 8:45 Welcome and Opening Remarks Chair: Bob Anderssen Jin Cheng (Fudan University Shanghai, China) Ill-posedness and Tikhonov regularization in the study of

More information

Contents: 1. Minimization. 2. The theorem of Lions-Stampacchia for variational inequalities. 3. Γ -Convergence. 4. Duality mapping.

Contents: 1. Minimization. 2. The theorem of Lions-Stampacchia for variational inequalities. 3. Γ -Convergence. 4. Duality mapping. Minimization Contents: 1. Minimization. 2. The theorem of Lions-Stampacchia for variational inequalities. 3. Γ -Convergence. 4. Duality mapping. 1 Minimization A Topological Result. Let S be a topological

More information

Statistical regularization theory for Inverse Problems with Poisson data

Statistical regularization theory for Inverse Problems with Poisson data Statistical regularization theory for Inverse Problems with Poisson data Frank Werner 1,2, joint with Thorsten Hohage 1 Statistical Inverse Problems in Biophysics Group Max Planck Institute for Biophysical

More information

ESAIM: M2AN Modélisation Mathématique et Analyse Numérique Vol. 34, N o 4, 2000, pp

ESAIM: M2AN Modélisation Mathématique et Analyse Numérique Vol. 34, N o 4, 2000, pp Mathematical Modelling and Numerical Analysis ESAIM: M2AN Modélisation Mathématique et Analyse Numérique Vol. 34, N o 4, 2, pp. 799 8 STRUCTURAL PROPERTIES OF SOLUTIONS TO TOTAL VARIATION REGULARIZATION

More information

Robust error estimates for regularization and discretization of bang-bang control problems

Robust error estimates for regularization and discretization of bang-bang control problems Robust error estimates for regularization and discretization of bang-bang control problems Daniel Wachsmuth September 2, 205 Abstract We investigate the simultaneous regularization and discretization of

More information

Variational image restoration by means of wavelets: simultaneous decomposition, deblurring and denoising

Variational image restoration by means of wavelets: simultaneous decomposition, deblurring and denoising Variational image restoration by means of wavelets: simultaneous decomposition, deblurring and denoising I. Daubechies and G. Teschke December 2, 2004 Abstract Inspired by papers of Vese Osher [20] and

More information

ETNA Kent State University

ETNA Kent State University Electronic Transactions on Numerical Analysis. Volume 39, pp. 476-57,. Copyright,. ISSN 68-963. ETNA ON THE MINIMIZATION OF A TIKHONOV FUNCTIONAL WITH A NON-CONVEX SPARSITY CONSTRAINT RONNY RAMLAU AND

More information

A range condition for polyconvex variational regularization

A range condition for polyconvex variational regularization www.oeaw.ac.at A range condition for polyconvex variational regularization C. Kirisits, O. Scherzer RICAM-Report 2018-04 www.ricam.oeaw.ac.at A range condition for polyconvex variational regularization

More information

An Iterative Thresholding Algorithm for Linear Inverse Problems with a Sparsity Constraint

An Iterative Thresholding Algorithm for Linear Inverse Problems with a Sparsity Constraint An Iterative Thresholding Algorithm for Linear Inverse Problems with a Sparsity Constraint INGRID DAUBECHIES Princeton University MICHEL DEFRISE Department of Nuclear Medicine Vrije Universiteit Brussel

More information

A Double Regularization Approach for Inverse Problems with Noisy Data and Inexact Operator

A Double Regularization Approach for Inverse Problems with Noisy Data and Inexact Operator A Double Regularization Approach for Inverse Problems with Noisy Data and Inexact Operator Ismael Rodrigo Bleyer Prof. Dr. Ronny Ramlau Johannes Kepler Universität - Linz Cambridge - July 28, 211. Doctoral

More information

A Double Regularization Approach for Inverse Problems with Noisy Data and Inexact Operator

A Double Regularization Approach for Inverse Problems with Noisy Data and Inexact Operator A Double Regularization Approach for Inverse Problems with Noisy Data and Inexact Operator Ismael Rodrigo Bleyer Prof. Dr. Ronny Ramlau Johannes Kepler Universität - Linz Florianópolis - September, 2011.

More information

A NEW ITERATIVE METHOD FOR THE SPLIT COMMON FIXED POINT PROBLEM IN HILBERT SPACES. Fenghui Wang

A NEW ITERATIVE METHOD FOR THE SPLIT COMMON FIXED POINT PROBLEM IN HILBERT SPACES. Fenghui Wang A NEW ITERATIVE METHOD FOR THE SPLIT COMMON FIXED POINT PROBLEM IN HILBERT SPACES Fenghui Wang Department of Mathematics, Luoyang Normal University, Luoyang 470, P.R. China E-mail: wfenghui@63.com ABSTRACT.

More information

Levenberg-Marquardt method in Banach spaces with general convex regularization terms

Levenberg-Marquardt method in Banach spaces with general convex regularization terms Levenberg-Marquardt method in Banach spaces with general convex regularization terms Qinian Jin Hongqi Yang Abstract We propose a Levenberg-Marquardt method with general uniformly convex regularization

More information

Parameter Identification in Partial Differential Equations

Parameter Identification in Partial Differential Equations Parameter Identification in Partial Differential Equations Differentiation of data Not strictly a parameter identification problem, but good motivation. Appears often as a subproblem. Given noisy observation

More information

A NOTE ON THE NONLINEAR LANDWEBER ITERATION. Dedicated to Heinz W. Engl on the occasion of his 60th birthday

A NOTE ON THE NONLINEAR LANDWEBER ITERATION. Dedicated to Heinz W. Engl on the occasion of his 60th birthday A NOTE ON THE NONLINEAR LANDWEBER ITERATION Martin Hanke Dedicated to Heinz W. Engl on the occasion of his 60th birthday Abstract. We reconsider the Landweber iteration for nonlinear ill-posed problems.

More information

Regularization for a Common Solution of a System of Ill-Posed Equations Involving Linear Bounded Mappings 1

Regularization for a Common Solution of a System of Ill-Posed Equations Involving Linear Bounded Mappings 1 Applied Mathematical Sciences, Vol. 5, 2011, no. 76, 3781-3788 Regularization for a Common Solution of a System of Ill-Posed Equations Involving Linear Bounded Mappings 1 Nguyen Buong and Nguyen Dinh Dung

More information

On the distributional divergence of vector fields vanishing at infinity

On the distributional divergence of vector fields vanishing at infinity Proceedings of the Royal Society of Edinburgh, 141A, 65 76, 2011 On the distributional divergence of vector fields vanishing at infinity Thierry De Pauw Institut de Recherches en Mathématiques et Physique,

More information

Tikhonov Replacement Functionals for Iteratively Solving Nonlinear Operator Equations

Tikhonov Replacement Functionals for Iteratively Solving Nonlinear Operator Equations Tikhonov Replacement Functionals for Iteratively Solving Nonlinear Operator Equations Ronny Ramlau Gerd Teschke April 13, 25 Abstract We shall be concerned with the construction of Tikhonov based iteration

More information

A note on convergence of solutions of total variation regularized linear inverse problems

A note on convergence of solutions of total variation regularized linear inverse problems Inverse Problems PAPER OPEN ACCESS A note on convergence of solutions of total variation regularized linear inverse problems To cite this article: José A Iglesias et al 2018 Inverse Problems 34 055011

More information

Variational Methods in Image Denoising

Variational Methods in Image Denoising Variational Methods in Image Denoising Jamylle Carter Postdoctoral Fellow Mathematical Sciences Research Institute (MSRI) MSRI Workshop for Women in Mathematics: Introduction to Image Analysis 22 January

More information

ANALYSIS OF THE TV REGULARIZATION AND H 1 FIDELITY MODEL FOR DECOMPOSING AN IMAGE INTO CARTOON PLUS TEXTURE. C.M. Elliott and S.A.

ANALYSIS OF THE TV REGULARIZATION AND H 1 FIDELITY MODEL FOR DECOMPOSING AN IMAGE INTO CARTOON PLUS TEXTURE. C.M. Elliott and S.A. COMMUNICATIONS ON Website: http://aimsciences.org PURE AND APPLIED ANALYSIS Volume 6, Number 4, December 27 pp. 917 936 ANALYSIS OF THE TV REGULARIZATION AND H 1 FIDELITY MODEL FOR DECOMPOSING AN IMAGE

More information

Regularization of linear inverse problems with total generalized variation

Regularization of linear inverse problems with total generalized variation Regularization of linear inverse problems with total generalized variation Kristian Bredies Martin Holler January 27, 2014 Abstract The regularization properties of the total generalized variation (TGV)

More information

WEAK CONVERGENCE OF RESOLVENTS OF MAXIMAL MONOTONE OPERATORS AND MOSCO CONVERGENCE

WEAK CONVERGENCE OF RESOLVENTS OF MAXIMAL MONOTONE OPERATORS AND MOSCO CONVERGENCE Fixed Point Theory, Volume 6, No. 1, 2005, 59-69 http://www.math.ubbcluj.ro/ nodeacj/sfptcj.htm WEAK CONVERGENCE OF RESOLVENTS OF MAXIMAL MONOTONE OPERATORS AND MOSCO CONVERGENCE YASUNORI KIMURA Department

More information

Convex Hodge Decomposition of Image Flows

Convex Hodge Decomposition of Image Flows Convex Hodge Decomposition of Image Flows Jing Yuan 1, Gabriele Steidl 2, Christoph Schnörr 1 1 Image and Pattern Analysis Group, Heidelberg Collaboratory for Image Processing, University of Heidelberg,

More information

Key words: denoising, higher-order regularization, stability, weak convergence, Brezis-Lieb condition. AMS subject classifications: 49N45, 94A08.

Key words: denoising, higher-order regularization, stability, weak convergence, Brezis-Lieb condition. AMS subject classifications: 49N45, 94A08. A FEW REMARKS ON VARIATIONAL MODELS FOR DENOISING RUSTUM CHOKSI, IRENE FONSECA, AND BARBARA ZWICKNAGL Abstract. Variational models for image and signal denoising are based on the minimization of energy

More information

PDEs in Image Processing, Tutorials

PDEs in Image Processing, Tutorials PDEs in Image Processing, Tutorials Markus Grasmair Vienna, Winter Term 2010 2011 Direct Methods Let X be a topological space and R: X R {+ } some functional. following definitions: The mapping R is lower

More information

WEAK LOWER SEMI-CONTINUITY OF THE OPTIMAL VALUE FUNCTION AND APPLICATIONS TO WORST-CASE ROBUST OPTIMAL CONTROL PROBLEMS

WEAK LOWER SEMI-CONTINUITY OF THE OPTIMAL VALUE FUNCTION AND APPLICATIONS TO WORST-CASE ROBUST OPTIMAL CONTROL PROBLEMS WEAK LOWER SEMI-CONTINUITY OF THE OPTIMAL VALUE FUNCTION AND APPLICATIONS TO WORST-CASE ROBUST OPTIMAL CONTROL PROBLEMS ROLAND HERZOG AND FRANK SCHMIDT Abstract. Sufficient conditions ensuring weak lower

More information

A note on convergence of solutions of total variation regularized linear inverse problems

A note on convergence of solutions of total variation regularized linear inverse problems www.oeaw.ac.at A note on convergence of solutions of total variation regularized linear inverse problems J.A. Iglesias, G. Mercier, O. Scherzer RICAM-Report 2017-39 www.ricam.oeaw.ac.at A note on convergence

More information

ENERGY METHODS IN IMAGE PROCESSING WITH EDGE ENHANCEMENT

ENERGY METHODS IN IMAGE PROCESSING WITH EDGE ENHANCEMENT ENERGY METHODS IN IMAGE PROCESSING WITH EDGE ENHANCEMENT PRASHANT ATHAVALE Abstract. Digital images are can be realized as L 2 (R 2 objects. Noise is introduced in a digital image due to various reasons.

More information

Adaptive discretization and first-order methods for nonsmooth inverse problems for PDEs

Adaptive discretization and first-order methods for nonsmooth inverse problems for PDEs Adaptive discretization and first-order methods for nonsmooth inverse problems for PDEs Christian Clason Faculty of Mathematics, Universität Duisburg-Essen joint work with Barbara Kaltenbacher, Tuomo Valkonen,

More information

Semi-discrete equations in Banach spaces: The approximate inverse approach

Semi-discrete equations in Banach spaces: The approximate inverse approach Semi-discrete equations in Banach spaces: The approximate inverse approach Andreas Rieder Thomas Schuster Saarbrücken Frank Schöpfer Oldenburg FAKULTÄT FÜR MATHEMATIK INSTITUT FÜR ANGEWANDTE UND NUMERISCHE

More information

Optimal Control of Partial Differential Equations I+II

Optimal Control of Partial Differential Equations I+II About the lecture: Optimal Control of Partial Differential Equations I+II Prof. Dr. H. J. Pesch Winter semester 2011/12, summer semester 2012 (seminar), winter semester 2012/13 University of Bayreuth Preliminary

More information

Nonlinear Approximation Schemes Associated With Nonseparable Wavelet Bi-frames

Nonlinear Approximation Schemes Associated With Nonseparable Wavelet Bi-frames Nonlinear Approximation Schemes Associated With Nonseparable Wavelet Bi-frames Martin Ehler September 26, 2008 Abstract In the present paper, we study nonlinear approximation properties of multivariate

More information

Iteratively Solving Linear Inverse Problems under General Convex Constraints

Iteratively Solving Linear Inverse Problems under General Convex Constraints Konrad-Zuse-Zentrum fu r Informationstechnik Berlin Takustraße 7 D-14195 Berlin-Dahlem Germany I NGRID DAUBECHIES, G ERD T ESCHKE, L UMINITA V ESE Iteratively Solving Linear Inverse Problems under General

More information

Sparse tomography. Samuli Siltanen. Department of Mathematics and Statistics University of Helsinki, Finland

Sparse tomography. Samuli Siltanen. Department of Mathematics and Statistics University of Helsinki, Finland Sparse tomography Samuli Siltanen Department of Mathematics and Statistics University of Helsinki, Finland Minisymposium: Fourier analytic methods in tomographic image reconstruction Applied Inverse Problems

More information

Lipschitz p-convex and q-concave maps

Lipschitz p-convex and q-concave maps Lipschitz p-convex and q-concave maps J. Alejandro Chávez-Domínguez Instituto de Ciencias Matemáticas, CSIC-UAM-UCM-UC3M, Madrid and Department of Mathematics, University of Texas at Austin Conference

More information

Strengthened Sobolev inequalities for a random subspace of functions

Strengthened Sobolev inequalities for a random subspace of functions Strengthened Sobolev inequalities for a random subspace of functions Rachel Ward University of Texas at Austin April 2013 2 Discrete Sobolev inequalities Proposition (Sobolev inequality for discrete images)

More information

Fourier Transform & Sobolev Spaces

Fourier Transform & Sobolev Spaces Fourier Transform & Sobolev Spaces Michael Reiter, Arthur Schuster Summer Term 2008 Abstract We introduce the concept of weak derivative that allows us to define new interesting Hilbert spaces the Sobolev

More information

Research Article Approximation of Solutions of Nonlinear Integral Equations of Hammerstein Type with Lipschitz and Bounded Nonlinear Operators

Research Article Approximation of Solutions of Nonlinear Integral Equations of Hammerstein Type with Lipschitz and Bounded Nonlinear Operators International Scholarly Research Network ISRN Applied Mathematics Volume 2012, Article ID 963802, 15 pages doi:10.5402/2012/963802 Research Article Approximation of Solutions of Nonlinear Integral Equations

More information

Linear convergence of iterative soft-thresholding

Linear convergence of iterative soft-thresholding Linear convergence of iterative soft-thresholding arxiv:0709.1598v4 [math.fa] 9 Apr 008 Kristian Bredies and Dirk A. Lorenz ABSTRACT. In this article a unified approach to iterative soft-thresholding algorithms

More information

Functionalanalytic tools and nonlinear equations

Functionalanalytic tools and nonlinear equations Functionalanalytic tools and nonlinear equations Johann Baumeister Goethe University, Frankfurt, Germany Rio de Janeiro / October 2017 Outline Fréchet differentiability of the (PtS) mapping. Nonlinear

More information

Weak Convergence Methods for Energy Minimization

Weak Convergence Methods for Energy Minimization Weak Convergence Methods for Energy Minimization Bo Li Department of Mathematics University of California, San Diego E-mail: bli@math.ucsd.edu June 3, 2007 Introduction This compact set of notes present

More information

On the acceleration of the double smoothing technique for unconstrained convex optimization problems

On the acceleration of the double smoothing technique for unconstrained convex optimization problems On the acceleration of the double smoothing technique for unconstrained convex optimization problems Radu Ioan Boţ Christopher Hendrich October 10, 01 Abstract. In this article we investigate the possibilities

More information

Adaptive methods for control problems with finite-dimensional control space

Adaptive methods for control problems with finite-dimensional control space Adaptive methods for control problems with finite-dimensional control space Saheed Akindeinde and Daniel Wachsmuth Johann Radon Institute for Computational and Applied Mathematics (RICAM) Austrian Academy

More information

A Theoretical Framework for the Regularization of Poisson Likelihood Estimation Problems

A Theoretical Framework for the Regularization of Poisson Likelihood Estimation Problems c de Gruyter 2007 J. Inv. Ill-Posed Problems 15 (2007), 12 8 DOI 10.1515 / JIP.2007.002 A Theoretical Framework for the Regularization of Poisson Likelihood Estimation Problems Johnathan M. Bardsley Communicated

More information

ON THE REGULARITY OF ONE PARAMETER TRANSFORMATION GROUPS IN BARRELED LOCALLY CONVEX TOPOLOGICAL VECTOR SPACES

ON THE REGULARITY OF ONE PARAMETER TRANSFORMATION GROUPS IN BARRELED LOCALLY CONVEX TOPOLOGICAL VECTOR SPACES Communications on Stochastic Analysis Vol. 9, No. 3 (2015) 413-418 Serials Publications www.serialspublications.com ON THE REGULARITY OF ONE PARAMETER TRANSFORMATION GROUPS IN BARRELED LOCALLY CONVEX TOPOLOGICAL

More information

On Total Convexity, Bregman Projections and Stability in Banach Spaces

On Total Convexity, Bregman Projections and Stability in Banach Spaces Journal of Convex Analysis Volume 11 (2004), No. 1, 1 16 On Total Convexity, Bregman Projections and Stability in Banach Spaces Elena Resmerita Department of Mathematics, University of Haifa, 31905 Haifa,

More information

An introduction to Mathematical Theory of Control

An introduction to Mathematical Theory of Control An introduction to Mathematical Theory of Control Vasile Staicu University of Aveiro UNICA, May 2018 Vasile Staicu (University of Aveiro) An introduction to Mathematical Theory of Control UNICA, May 2018

More information

EXISTENCE RESULTS FOR QUASILINEAR HEMIVARIATIONAL INEQUALITIES AT RESONANCE. Leszek Gasiński

EXISTENCE RESULTS FOR QUASILINEAR HEMIVARIATIONAL INEQUALITIES AT RESONANCE. Leszek Gasiński DISCRETE AND CONTINUOUS Website: www.aimsciences.org DYNAMICAL SYSTEMS SUPPLEMENT 2007 pp. 409 418 EXISTENCE RESULTS FOR QUASILINEAR HEMIVARIATIONAL INEQUALITIES AT RESONANCE Leszek Gasiński Jagiellonian

More information

A generalized forward-backward method for solving split equality quasi inclusion problems in Banach spaces

A generalized forward-backward method for solving split equality quasi inclusion problems in Banach spaces Available online at www.isr-publications.com/jnsa J. Nonlinear Sci. Appl., 10 (2017), 4890 4900 Research Article Journal Homepage: www.tjnsa.com - www.isr-publications.com/jnsa A generalized forward-backward

More information

[11] Peter Mathé and Ulrich Tautenhahn, Regularization under general noise assumptions, Inverse Problems 27 (2011), no. 3,

[11] Peter Mathé and Ulrich Tautenhahn, Regularization under general noise assumptions, Inverse Problems 27 (2011), no. 3, Literatur [1] Radu Boţ, Bernd Hofmann, and Peter Mathé, Regularizability of illposed problems and the modulus of continuity, Zeitschrift für Analysis und ihre Anwendungen. Journal of Analysis and its Applications

More information

How much should we rely on Besov spaces as a framework for the mathematical study of images?

How much should we rely on Besov spaces as a framework for the mathematical study of images? How much should we rely on Besov spaces as a framework for the mathematical study of images? C. Sinan Güntürk Princeton University, Program in Applied and Computational Mathematics Abstract Relations between

More information

Exponential stability of families of linear delay systems

Exponential stability of families of linear delay systems Exponential stability of families of linear delay systems F. Wirth Zentrum für Technomathematik Universität Bremen 28334 Bremen, Germany fabian@math.uni-bremen.de Keywords: Abstract Stability, delay systems,

More information

Convergence Rates in Regularization for Nonlinear Ill-Posed Equations Involving m-accretive Mappings in Banach Spaces

Convergence Rates in Regularization for Nonlinear Ill-Posed Equations Involving m-accretive Mappings in Banach Spaces Applied Mathematical Sciences, Vol. 6, 212, no. 63, 319-3117 Convergence Rates in Regularization for Nonlinear Ill-Posed Equations Involving m-accretive Mappings in Banach Spaces Nguyen Buong Vietnamese

More information

Parameter Identification

Parameter Identification Lecture Notes Parameter Identification Winter School Inverse Problems 25 Martin Burger 1 Contents 1 Introduction 3 2 Examples of Parameter Identification Problems 5 2.1 Differentiation of Data...............................

More information

Variational Formulations

Variational Formulations Chapter 2 Variational Formulations In this chapter we will derive a variational (or weak) formulation of the elliptic boundary value problem (1.4). We will discuss all fundamental theoretical results that

More information

1 Topology Definition of a topology Basis (Base) of a topology The subspace topology & the product topology on X Y 3

1 Topology Definition of a topology Basis (Base) of a topology The subspace topology & the product topology on X Y 3 Index Page 1 Topology 2 1.1 Definition of a topology 2 1.2 Basis (Base) of a topology 2 1.3 The subspace topology & the product topology on X Y 3 1.4 Basic topology concepts: limit points, closed sets,

More information

Iterative Convex Regularization

Iterative Convex Regularization Iterative Convex Regularization Lorenzo Rosasco Universita di Genova Universita di Genova Istituto Italiano di Tecnologia Massachusetts Institute of Technology Optimization and Statistical Learning Workshop,

More information

Image Cartoon-Texture Decomposition and Feature Selection using the Total Variation Regularized L 1 Functional

Image Cartoon-Texture Decomposition and Feature Selection using the Total Variation Regularized L 1 Functional Image Cartoon-Texture Decomposition and Feature Selection using the Total Variation Regularized L 1 Functional Wotao Yin 1, Donald Goldfarb 1, and Stanley Osher 2 1 Department of Industrial Engineering

More information

Progetto di Ricerca GNCS 2016 PING Problemi Inversi in Geofisica Firenze, 6 aprile Regularized nonconvex minimization for image restoration

Progetto di Ricerca GNCS 2016 PING Problemi Inversi in Geofisica Firenze, 6 aprile Regularized nonconvex minimization for image restoration Progetto di Ricerca GNCS 2016 PING Problemi Inversi in Geofisica Firenze, 6 aprile 2016 Regularized nonconvex minimization for image restoration Claudio Estatico Joint work with: Fabio Di Benedetto, Flavia

More information

Variational image restoration by means of wavelets: Simultaneous decomposition, deblurring, and denoising

Variational image restoration by means of wavelets: Simultaneous decomposition, deblurring, and denoising Appl. Comput. Harmon. Anal. 19 (2005) 1 16 www.elsevier.com/locate/acha Variational image restoration by means of wavelets: Simultaneous decomposition, deblurring, and denoising I. Daubechies a,g.teschke

More information

The small ball property in Banach spaces (quantitative results)

The small ball property in Banach spaces (quantitative results) The small ball property in Banach spaces (quantitative results) Ehrhard Behrends Abstract A metric space (M, d) is said to have the small ball property (sbp) if for every ε 0 > 0 there exists a sequence

More information

Sparsity Regularization

Sparsity Regularization Sparsity Regularization Bangti Jin Course Inverse Problems & Imaging 1 / 41 Outline 1 Motivation: sparsity? 2 Mathematical preliminaries 3 l 1 solvers 2 / 41 problem setup finite-dimensional formulation

More information

Splitting Techniques in the Face of Huge Problem Sizes: Block-Coordinate and Block-Iterative Approaches

Splitting Techniques in the Face of Huge Problem Sizes: Block-Coordinate and Block-Iterative Approaches Splitting Techniques in the Face of Huge Problem Sizes: Block-Coordinate and Block-Iterative Approaches Patrick L. Combettes joint work with J.-C. Pesquet) Laboratoire Jacques-Louis Lions Faculté de Mathématiques

More information

A Concise Course on Stochastic Partial Differential Equations

A Concise Course on Stochastic Partial Differential Equations A Concise Course on Stochastic Partial Differential Equations Michael Röckner Reference: C. Prevot, M. Röckner: Springer LN in Math. 1905, Berlin (2007) And see the references therein for the original

More information

A metric space X is a non-empty set endowed with a metric ρ (x, y):

A metric space X is a non-empty set endowed with a metric ρ (x, y): Chapter 1 Preliminaries References: Troianiello, G.M., 1987, Elliptic differential equations and obstacle problems, Plenum Press, New York. Friedman, A., 1982, Variational principles and free-boundary

More information

Notes on Ordered Sets

Notes on Ordered Sets Notes on Ordered Sets Mariusz Wodzicki September 10, 2013 1 Vocabulary 1.1 Definitions Definition 1.1 A binary relation on a set S is said to be a partial order if it is reflexive, x x, weakly antisymmetric,

More information

Convex Hodge Decomposition and Regularization of Image Flows

Convex Hodge Decomposition and Regularization of Image Flows Convex Hodge Decomposition and Regularization of Image Flows Jing Yuan, Christoph Schnörr, Gabriele Steidl April 14, 2008 Abstract The total variation (TV) measure is a key concept in the field of variational

More information

Local strong convexity and local Lipschitz continuity of the gradient of convex functions

Local strong convexity and local Lipschitz continuity of the gradient of convex functions Local strong convexity and local Lipschitz continuity of the gradient of convex functions R. Goebel and R.T. Rockafellar May 23, 2007 Abstract. Given a pair of convex conjugate functions f and f, we investigate

More information

LINEARIZED BREGMAN ITERATIONS FOR FRAME-BASED IMAGE DEBLURRING

LINEARIZED BREGMAN ITERATIONS FOR FRAME-BASED IMAGE DEBLURRING LINEARIZED BREGMAN ITERATIONS FOR FRAME-BASED IMAGE DEBLURRING JIAN-FENG CAI, STANLEY OSHER, AND ZUOWEI SHEN Abstract. Real images usually have sparse approximations under some tight frame systems derived

More information

Compact operators on Banach spaces

Compact operators on Banach spaces Compact operators on Banach spaces Jordan Bell jordan.bell@gmail.com Department of Mathematics, University of Toronto November 12, 2017 1 Introduction In this note I prove several things about compact

More information

Minimizing Isotropic Total Variation without Subiterations

Minimizing Isotropic Total Variation without Subiterations MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Minimizing Isotropic Total Variation without Subiterations Kamilov, U. S. TR206-09 August 206 Abstract Total variation (TV) is one of the most

More information

Sparse Regularization via Convex Analysis

Sparse Regularization via Convex Analysis Sparse Regularization via Convex Analysis Ivan Selesnick Electrical and Computer Engineering Tandon School of Engineering New York University Brooklyn, New York, USA 29 / 66 Convex or non-convex: Which

More information

A Generalized Uncertainty Principle and Sparse Representation in Pairs of Bases

A Generalized Uncertainty Principle and Sparse Representation in Pairs of Bases 2558 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL 48, NO 9, SEPTEMBER 2002 A Generalized Uncertainty Principle Sparse Representation in Pairs of Bases Michael Elad Alfred M Bruckstein Abstract An elementary

More information

Approaching monotone inclusion problems via second order dynamical systems with linear and anisotropic damping

Approaching monotone inclusion problems via second order dynamical systems with linear and anisotropic damping March 0, 206 3:4 WSPC Proceedings - 9in x 6in secondorderanisotropicdamping206030 page Approaching monotone inclusion problems via second order dynamical systems with linear and anisotropic damping Radu

More information

Iterative Regularization Methods for Inverse Problems: Lecture 3

Iterative Regularization Methods for Inverse Problems: Lecture 3 Iterative Regularization Methods for Inverse Problems: Lecture 3 Thorsten Hohage Institut für Numerische und Angewandte Mathematik Georg-August Universität Göttingen Madrid, April 11, 2011 Outline 1 regularization

More information

Regularization of Inverse Problems

Regularization of Inverse Problems Regularization of Inverse Problems Otmar Scherzer Computational Science Center, University Vienna, Austria & Radon Institute of Computational and Applied Mathematics (RICAM), Linz, Austria Otmar Scherzer

More information

Besov-type spaces with variable smoothness and integrability

Besov-type spaces with variable smoothness and integrability Besov-type spaces with variable smoothness and integrability Douadi Drihem M sila University, Department of Mathematics, Laboratory of Functional Analysis and Geometry of Spaces December 2015 M sila, Algeria

More information

Subdifferential representation of convex functions: refinements and applications

Subdifferential representation of convex functions: refinements and applications Subdifferential representation of convex functions: refinements and applications Joël Benoist & Aris Daniilidis Abstract Every lower semicontinuous convex function can be represented through its subdifferential

More information

Pseudo-monotonicity and degenerate elliptic operators of second order

Pseudo-monotonicity and degenerate elliptic operators of second order 2002-Fez conference on Partial Differential Equations, Electronic Journal of Differential Equations, Conference 09, 2002, pp 9 24. http://ejde.math.swt.edu or http://ejde.math.unt.edu ftp ejde.math.swt.edu

More information