ERROR BOUNDS FOR FINITE-DIFFERENCE METHODS FOR RUDIN OSHER FATEMI IMAGE SMOOTHING

Size: px
Start display at page:

Download "ERROR BOUNDS FOR FINITE-DIFFERENCE METHODS FOR RUDIN OSHER FATEMI IMAGE SMOOTHING"

Transcription

1 ERROR BOUNDS FOR FINITE-DIFFERENCE METHODS FOR RUDIN OSHER FATEMI IMAGE SMOOTHING JINGYUE WANG AND BRADLEY J. LUCIER Abstract. We bound te difference between te solution to te continuous Rudin Oser Fatemi image smooting model and te solutions to various finite-difference approximations to tis model. Tese bounds apply to typical images, i.e., images wit edges or wit fractal structure. Tese are te first bounds on te error in numerical metods for ROF smooting. Key words. Total variation, bounded variation, variational problems, finite-difference metods, image processing. AMS subject classifications. 65N06, 65N12, 94A08 1. Introduction. Image noise removal based on total variation smooting was introduced by Rudin, Oser, and Fatemi in [13]. Under tis ROF model, one supposes a true image f defined on Ω = [0, 1] 2 and a corrupted image g derived from f (by adding noise, etc.) wit f g 2 L 2 (Ω) = σ2. In an attempt to reconstruct f from g, one calculates a smooted image u tat minimizes v BV(Ω) = Dv subject to te constraint v g 2 L 2 (Ω) σ2. (1.1) Ω (Precise definitions are given later.) We deal wit te equivalent problem: If we calculate ḡ, te average of g on Ω, ten for any σ wit σ 2 < g ḡ 2 L 2 (Ω) tere exists a unique λ > 0 suc tat te minimizer of (1.1) is te minimizer u of te functional E(v) = 1 2λ v g 2 L 2 (Ω) + v BV(Ω). (1.2) Here λ is a positive parameter tat balances te relative importance of te smootness of te minimizer (important wen λ is large) and te L 2 (Ω) distance between te minimizer and te initial data (important wen λ is small). About te same time, Bouman and Sauer [1] proposed a discrete version of (1.2) in te context of tomograpy. Practically one discretizes E( ) to compute te minimizer of te discrete functional E ( ). We assume te discrete corrupted image g of resolution N N (N = 1/) is simply te piecewise constant projection of te continuous corrupted image g, and define te discrete functional E (v ) = 1 2λ vi gi J (v ), (1.3) i Tis work was partially supported by te Office of Naval Researc, Contract N J-1152, and te Institute for Matematics and its Applications, te University of Minnesota. Department of Matematics, University of Georgia, Atens, Georgia (jwang@mat.uga.edu). Department of Matematics, Purdue University, West Lafayette, Indiana (lucier@mat.purdue.edu). 1

2 were J is a discretized total variation. Te most commonly used J is te discrete variation J ++ used in [13] J ++ (v ) = i (v i+(1,0) v i ) 2 ( v i+(0,1) v ) 2 i + 2. (1.4) Efficient algoritms ave been developed to compute te discrete minimizer([2], [6], [3], [5]). In tis paper, we study te relationsip between te minimizer u of E( ) and te discrete minimizer u of E ( ). It is well known tat E Γ-converges to E in L 1. As a direct deduction u tends to u in L 1. Assuming te discrete variation J satisfies certain conditions tat we explain later, we give a bound of te L 2 norm of te difference between u and u in Teorem 4.2 in Section 4. Because te ROF model is often applied to images, an analysis of te error between solutions of discrete approximations and te solution of te continuous model itself sould apply to functions modeling images. Typical natural images ave little smootness, because of intensity discontinuities at te edges of objects and te fractal structure of many objects temselves (te leaves in a tree, air, etc.). Our results apply to functions in te Lipscitz spaces Lip(α, L 2 (Ω)), wic contain functions wit, rougly speaking, α derivatives in L 2 (Ω). Here 0 < α 1/2 for images wit edges : f BV(Ω) L (Ω) implies f Lip(1/2, L 2 (Ω)), wile functions wit fractal structure usually ave α < 1/2, see [7]. Our convergence results in Section 4 are proved for (1.3) wit J = J, a discrete variation obtained by symmetrizing J ++. Noneteless, our approac is quite general, and in Section 5 we obtain te same results for J U, an upwind discrete variation formulated in [12]. We remark tat an iterative metod for minimizing (1.3) wit J = J U was given in [5]. Wile te ROF model as proved to be tremendously influential, and as been te base of furter algoritms in image processing, we know of no oter results tat bound te difference between te solutions of te continuous problems and its finitedifference approximations. A finite element metod applied to te time-dependent gradient descent problem associated wit (1.2) was studied in [10]; we note tat teir Teorem 4 requires te initial data u 0 to ave two continuous derivatives on Ω so it does not apply to typical natural images wit edges. Te rest of tis section introduces notation and our main results. In Section 2 we compare discrete and continuous variational functionals. In Section 3 we note some properties of te minimizers of E( ) and E ( ) tat we use in Section 4 to first bound te discrete and continuous functionals at teir respective minimizers and ten to bound te L 2 difference between te discrete and continuous minimizers temselves. In Section 5, we prove a number of lemmas for te upwind discretization of te BV semi-norm tat allows us to prove similar error bounds for te discrete minimizer of te upwind sceme. Section 6 summarizes our results and points to variations tat appear elsewere. Finally, we note tat we present ere a sequence of lemmas, te proofs of wic are often omitted as a tedious calculation, or standard given te previous lemmas. We found wen developing tese results, owever, tat dividing te argument into tese smaller steps led to muc greater clarity, and we preserve tat structure in tis paper. 2

3 1.1. Summary of main results. Te major difficulty to overcome in our analysis is to compare J (u ), te discrete variation of te minimizer of te discrete functional (1.3), wit u BV(Ω), te variation of te minimizer of te continuous functional (1.2). Indeed, if we consider P u i, te discrete function tat is computed as te average of u on subsquares Ω i = (i + Ω), ten for general u, no matter wic J we coose, we ave tat lim J (P u) u BV(Ω). 0 So E (P u) does not, in general, converge to E(u) (since P u P g L2 (Ω ) u g L2 (Ω) as 0), and te question of weter E (u ) does converge to E(u) requires a more subtle analysis. We note tat J ++ defined by (1.4) is a consistent approximation to u BV(Ω) for C 1 u: lim 0 J ++ (P u) = u BV(Ω) for smoot u. So, for general u BV(Ω), we first mollify u, computing S ǫ u = η ǫ u, were η ǫ is a mollifier and ǫ is a positive parameter tending to zero in a controlled way tat depends on, and compare E (P S ǫ u) to E(u). Mollifying u introduces an error in te L 2 (Ω) term of (1.2), but it reduces te te J term, making it closer to u BV(Ω). Tat s ow we compare te continuous u to te discrete u ; we also ave to go te oter way. To do tat we require J to ave a certain symmetry, so we consider first a symmetrized version J of J ++ and ten later an upwind discrete variation J U. In more-or-less complete analogy wit te continuous argument, we first compute S L u i, a discrete average of u i on (2L + 1) (2L + 1) squares (wit te point i in te middle of te square) and ten compute a piecewise linear interpolant Int S L u (1.19) of S L u i, comparing E(IntS Lu ) to E (u ). Now L is a positive parameter, depending on, tat tends to infinity as 0. Tus we prove te following two teorems: Teorem 1.1 (Functional difference). Let g Lip(α, L 2 (Ω)) and assume u is te minimizer of E(v) from (3.3) and u is te minimizer of E (v ) from (3.1). Ten tere is a constant C suc tat if ǫ = 1/(α+1) we ave E (P S ǫ u) E(u) + C λ g 2 Lip(α,L 2 (Ω)) α/(α+1). and if L is set to te integer part of α/(α+1) ten Finally, E(IntS L u ) E (u ) + C λ g 2 Lip(α,L 2 (Ω)) α/(α+1). E(u) E (u ) C λ g 2 Lip(α,L 2 (Ω)) α/(α+1). Teorem 1.2 (Minimizer difference). Let g Lip(α, L 2 (Ω)) and assume tat u is te minimizer of E(v) from (3.3) and u is te minimizer of E (v ) from (3.1). Ten tere is a constant C suc tat I u u 2 L 2 (Ω) C g 2 Lip(α,L 2 (Ω)) α/(α+1), were (I u )(x) = u i for x Ω i. 3

4 1.2. Basic notations. We consider te usual L p (Ω) spaces on Ω := [0, 1] 2 R 2, wit v Lp (Ω) := ( Ω v p) 1 p for 1 p <. (We assume te usual cange for p =.) We consider te discrete set Ω to be te set of all pairs i = (i 1, i 2 ) Z 2, Z te integers, wit 0 i 1, i 2 < N, = 1/N, and we refer to functions defined on Ω as discrete functions. So for discrete functions v = vi, we define te discrete Lp (Ω ) norms ( ) 1 v Lp (Ω ) := vi p 2 p for 1 p <. i Ω We define te translation operator for discrete functions by (T l (v )) i := v i+l for any l = (l 1, l 2 ) Z 2. To measure te size of a translation, we introduce l = max( l 1, l 2 ). Similarly, (T τ v)(x) = v(x + τ) for any τ = (τ 1, τ 2 ) R 2 and, for translations, we set τ = max( τ 1, τ 2 ). We often need to extend v L p (Ω) and v L p (Ω ) to all of R 2 and Z 2, respectively; we denote te extensions by Extv and Ext v. For v L p (Ω), we use te following procedure. First, Extv(x) = v(x), x Ω. We ten reflect across te line x 1 = 1, Extv(x 1, x 2 ) = Extv(2 x 1, x 2 ), 1 x 1 2, 0 x 2 1, and reflect again across te line x 2 = 1, Extv(x 1, x 2 ) = Extv(x 1, 2 x 2 ), 0 x 1 2, 1 x 2 2. Having defined Extv on 2Ω, we ten extend Extv periodically on all of R 2. We use te analogous construction of Ext v for discrete functions v. Note tat te value of Ext v at any point immediately outside Ω is te same as te value of v at te closest point inside Ω. For v L p (Ω) we define te (first-order) L p (Ω) modulus of smootness by ( ) 1 We also define ω(v, t) Lp (Ω) = sup τ R 2, τ <t ω(extv, t) Lp (2Ω) := v(x + τ) v(x) p dx x,x+τ Ω sup T τ Extv Extv Lp (2Ω). τ R 2, τ <t Te Lipscitz spaces Lip(α, L p (Ω)) consist of all functions v for wic v Lip(α,Lp (Ω)) := sup t α ω(v, t) Lp (Ω) < ; t>0 we set v Lip(α,Lp (Ω)) := v Lp (Ω) + v Lip(α,Lp (Ω)). We also need a discrete modulus of smootness. Te discrete L p (Ω ) modulus of smootness is ( ) 1 ω(v, m) L p (Ω ) := sup vi+l vi p 2 p. l Z 2, l m i,i+l Ω 4 p.

5 For Ext v we define similarly ω(ext v, m) Lp (2Ω ) = sup T l Ext v Ext v Lp (2Ω ). l Z 2, l m We ave te following relationsip between moduli of smootness and our extension operators; te lemma can be proved as in [8], page 182. Lemma 1.1 (Witney extension). For all 1 p tere exists a constant C suc tat for all v L p (Ω) and v L p (Ω ) and T τ Extv Extv Lp (2Ω) Cω(v, τ ) Lp (Ω) τ R 2 (1.5) T l Ext v Ext v Lp (2Ω ) Cω(v, l ) Lp (Ω ) l Z 2 (1.6) Moreover, for all positive t R, m Z we ave and ω(extv, t) Lp (2Ω) Cω(v, t) Lp (Ω) (1.7) ω(ext v, m) L p (2Ω ) Cω(v, m) L p (Ω ). (1.8) 1.3. Variation functionals. Te variation of a function v L 1 (Ω) is defined as follows. We consider functions φ in te space of C 1 functions from Ω to R 2 wit compact support, i.e., [C0(Ω)] 1 2. Te variation of a function v L 1 (Ω) is ten defined to be v BV(Ω) := Dv := sup v φ. Ω φ [C0 1(Ω)]2, φ 1 pointwise Ω We note tat if v is in te Sobolev space W 1,1 (Ω), so tat its first distributional derivatives are in L 1 (Ω), ten v BV(Ω) = v. We need discrete analogues of te variation of a function. For and independently taking values in te set {+, } and any discrete function v we define J (v ) := (Ext vi (1,0) Ext vi i Ω Ω ) 2 ( Ext vi (0,1) + Ext vi ) 2 2. (1.9) We note tat te sum is over i Ω, and Ext v i = v i for all i Ω. Having defined J ++ (v ), J + (v ), J + (v ), and J (v ), we define for any nonnegative a, b, c, and d wit a + b + c + d = 1 J (v ) = a J ++ (v ) + b J + (v ) + c J + (v ) + dj (v ) (1.10) 5

6 and define te special isotropic discrete variation J (v ) := 1 4( J++ (v ) + J + (v ) + J + (v ) + J (v ) ) ; J is invariant under rotations of Ω by 90 degrees, or under orizontal or vertical reflections. At times we consider discrete variational functionals for discrete functions defined on 2Ω ; for tese purposes we denote by J (v Ω ) te discrete variation defined in (1.9) and J 2Ω (Ext v ) te corresponding sum over 2Ω ; similarly we write J Ω (v ) = J (v ) and J Ω (v ) = J (v ) and we use te notation J 2Ω (Ext v ) for a J 2Ω ++ (Ext v ) + b J 2Ω + (Ext v ) + c J 2Ω + (Ext v ) + dj 2Ω (Ext v ) and J 2Ω (Ext v ) for te corresponding sum wit a = b = c = d = 1/4. We ave te following relationsips between continuous and discrete variations of functions and te continuous and discrete extension operators; te lemma is proved simply by considering te symmetries of J Ω any variation along te lines of reflection. Lemma 1.2 (TV symmetry). For any discrete function v, Tus, we ave J 2Ω and noticing tat Extv does not add J 2Ω (Ext v ) = 4J Ω (v ). (1.11) (Ext v ) = 4J Ω (v ) and for any l Z 2 J 2Ω (T l Ext v ) = 4J Ω (v ). Similarly, for any v BV(Ω), we ave Extv BV(2Ω) = 4 v BV(Ω). We also define a discrete anisotropic variation tat is analogous to te W 1,1 (Ω) Sobolev semi-norm: v W 1,1 (Ω ) = { Ext vi+(1,0) Ext vi + Ext vi+(0,1) Ext vi } 2. i Ω (1.12) Because a 2 + b 2 a + b 2 a 2 + b 2, tere exist positive constants C 1 and C 2 suc tat for any discrete function v and any discrete functional J C 1 v W 1,1 (Ω ) J (v ) C 2 v W 1,1 (Ω ). (1.13) For some intermediate estimates we need second-order continuous and discrete semi-norms, so we define for v in te Sobolev space W (2Ω) wit periodic boundary conditions (i.e., treating 2Ω as a torus) v W (2Ω) = D1v 2 + D2v, 2 2Ω and for periodic discrete functions v on 2Ω we define v W (2Ω ) as { vi+(1,0) 2v i + v i (1,0) + vi+(0,1) 2v i + } v i (0,1) 2. (1.14) i 2Ω 2 6 2

7 Note tat tese semi-norms do not include cross derivatives or differences, but we do not need tese in our estimates. Lemma 1.3 (TV difference). For any two discrete functionals J and J, and any discrete function v we ave J (v ) J (v ) Ext v W (2Ω ). (1.15) Proof. Te quantities summed in (1.9) are te norms of two-vectors of divided differences, wic we coose to write in te following way: J ++ (v ) J + (v ) ( ) = 1 Ext vi+(1,0) Ext v i Ext v i Ω i+(0,1) Ext vi 2 ( 1 Ext vi+(1,0) Ext ) v i ( 1)(Ext v i Ω i (0,1) Ext vi ) 2 ( ) 1 Ext vi+(1,0) Ext ( ) vi Ext v i Ω i+(0,1) Ext vi Ext vi+(1,0) Ext vi ( 1)(Ext vi (0,1) Ext vi ) ( 1 Ext vi+(1,0) Ext ) ( ) vi Ext v Ext v i Ω i+(0,1) Ext vi i+(1,0) Ext vi ( 1)(Ext vi (0,1) Ext vi ) 2 = 1 ( ) 0 Ext vi+(0,1) 2 Ext vi + Ext vi (0,1) 2 i Ω Ext v W (2Ω ). Analogous arguments apply to te oter differences Projectors, injectors, and smooting operators. We define te piecewise constant injector of discrete functions v into L p (Ω): (I v )(x) = vi for x Ω i, were Ω i := ( Ω+i ). Later we define an injector into a space of continuous, piecewise linear functions. We also consider te piecewise constant projector of v L 1 (Ω) onto te space of discrete functions, defined by (P v) i = 1 Ω i Ω i v, i Ω, were Ω i is te measure of Ω i. Lemma 1.4 (Injector and projector). Tere exists a constant C suc tat for all v L 2 (Ω) We also ave for any periodic v W (2Ω) 2 v I P v L2 (Ω) Cω(v, ) L2 (Ω). (1.16) P v W (2Ω ) v W (2Ω). (1.17) 7

8 Proof. Relationsip (1.16) is a special case of a general bound for te error in spline approximation; see [8], Teorem 7.3, page 225. To prove (1.17), we deal wit te differences in te orizontal direction. (P v) i+(1,0) 2(P v) i + (P )v i (1,0) i 2Ω = 1 i 2Ω = 1 2 i 2Ω = 1 2 i 2Ω = 2 i 2Ω 2Ω 2 2 (P v) i+(1,0) (P v) i (P v) i (P v) i (1,0) 2 [(v(x +, y) v(x, y)) (v(x, y) v(x, y))] dx dy Ω i [D 1 v(x + t, y) D 1 v(x + t, y)] dt dx dy 1 Ω i 0 0 Ω i 0 D 11 v(x + t + s, y) ds dt dx dy D 11 v dx dy (excange te order of integration and sum over i) Arguing similarly in te vertical direction, we see tat (1.17) olds. We need anoter map taking v L 2 (Ω ) to L 2 (Ω), in te form of a piecewise linear interpolant of te discrete values of vi. To tis end, let φ be te box spline function wose support is te exagon D in Figure 1.1 wit φ being linear on eac triangle in Figure 1.1 and { 1, i = (0, 0), φ(i) = 0, i (0, 0), i Z 2. x 3 1 x 2 x 4 x 1 1 x 5 x 6 Fig D, te support of φ We dilate and translate φ to obtain te function ( x ( ( 1 φ i (x) := φ i + 2, 1. (1.18) 2))) We see tat supp φ i is D dilated by and translated by ( i + ( 1 2, 1 2)). 8

9 We define te interpolant Int v by Int v = i Z 2 Ext v i φ i. (1.19) We ten ave te following lemma. Lemma 1.5 (Piecewise linear injector). For any v be in L 2 (Ω ) we ave Int v BV(Ω) = 1 2 (J ++(v ) + J (v )). (1.20) Additionally, tere exists a constant C suc tat for all discrete functions v I v Int v L2 (Ω) Cω(v, 1) L 2 (Ω ). (1.21) Proof. Te proofs of (1.20) and (1.21) are just calculations, wic can be found in [14]. For (1.20), te J ++ terms come from triangles wit te orientation of te triangle in te upper-rigt quadrant of Figure 1.1, and te J terms come from triangles wit te orientation of te triangle in te lower-left quadrant. We need bot continuous and discrete smooting operators, wic we define as follows. Assume tat η(x) is a a fixed nonnegative, rotationally symmetric, function wit support in te unit disk; furter, suppose tat η is C and as integral 1. For ǫ > 0 we define te scaled function η ǫ (x) := ǫ 2 η(x/ǫ), x R 2 ; we smoot a function v L p (Ω), 1 p, by computing (S ǫ v)(x) := (η ǫ Extv)(x) = η ǫ (x y) Extv(y) dy, x R 2. R 2 Our discrete smooting operator is defined simply as S L v := It s clear from tese definitions tat 1 (2L + 1) 2 l L T l Ext v. T l S L Ext v = S L T l Ext v and T τ S ǫ Extv = S ǫ T τ Extv (1.22) and tat for any 1 p and S L v Lp (Ω ) S L v Lp (2Ω ) Ext v Lp (2Ω ) 4 v Lp (Ω ) (1.23) S ǫ v Lp (Ω) S ǫ v Lp (2Ω) Extv Lp (2Ω) 4 v Lp (Ω). (1.24) For tese continuous and discrete smooting operators we ave te following results. Lemma 1.6 (Smooting operators). For all v L 2 (Ω) and all discrete functions v, we ave J (S L v ) J (v ) and S ǫ v BV(Ω) v BV(Ω). (1.25) 9

10 Tere exists a constant C > 0 suc for all M, t > 0, ω(s L v, M) L 2 (Ω ) Cω(v, M) L 2 (Ω ) and ω(s ǫ v, t) L2 (Ω) Cω(v, t) L2 (Ω). (1.26) Furtermore, S L v v L2 (Ω ) Cω(v, L) L2 (Ω ) and S ǫ v v L2 (Ω) Cω(v, ǫ) L2 (Ω). (1.27) We also ave S ǫ v W (2Ω) C ǫ v BV(Ω) and S L v W (2Ω ) C L v W 1,1 (Ω ). (1.28) Proof. Te first two inequalities follow simply because te BV semi-norm and J are convex and symmetric on 2Ω ; see Lemma 1.2. Te two inequalities (1.26) follow from te definitions of S L and S ǫ and Lemmas 1.1 and 1.2. Te next two inequalities follow from te definitions of S L, S ǫ, and te properties of te discrete and continuous moduli of smootness; see also (1.5) of Lemma 1.1. Te bound on te discrete W (2Ω ) semi-norm is a typical inverse inequality; to deal wit te differences in te orizontal direction, S Lvi+(1,0) 2S Lvi + S Lv i (1,0) 2 2 i 2Ω = 1 Ext vi+(1,0)+l 2 Ext vi+l + Ext v i+l (1,0) (2L + 1) i 2Ω l L = 1 Ext vi+(l+1,l 2 ) (2L + 1) 2 Ext vi+(l,l 2 ) 2 i 2Ω l 2 L Ext vi (L,l 2 ) Ext vi (L+1,l 2 ) 2 2 (sum over l 1 ) { 1 Ext vi+(l+1,l 2 ) Ext v i+(l,l 2 ) (2L + 1) 2 2 i 2Ω l 2 L Ext + vi (L,l 2 ) Ext v } i (L+1,l 2 ) 2 C (2L + 1) Ext vi+(1,0) Ext v i i 2Ω C L v W 1,1 (Ω ) 2 2 For te bound on te W (2Ω) semi-norm, again we deal wit derivatives in only one direction. We prove 2Ω D2 1S ǫ v C ǫ Ω Dv. 10

11 In fact 2Ω D 2 1S ǫ v = sup φ C 1 0 = sup φ C 1 0 = sup φ C 1 0 (2Ω), φ 1 (2Ω), φ 1 (2Ω), φ 1 = sup φ C0 1 (2Ω), φ 1 (D1S 2 ǫ v) φ R 2 (D 1 S ǫ v) D 1 ( φ) R 2 D 1 (η ǫ Extv) D 1 ( φ) R 2 (Extv) D 1 (D 1 η ǫ φ); R 2 note tat all but te first of tese integrals are over R 2. Notice D 1 η ǫ φ D 1 η ǫ L 1 φ C ǫ, and D 1 η ǫ φ C0 (2Ω ǫ ), were 2Ω ǫ := {x dist(x, 2Ω) ǫ}; terefore D1S 2 ǫ v C D Extv C D Extv C Dv. ǫ 2Ω ǫ ǫ Ω ǫ Ω 2Ω were Ω = {(x, y) x, y 3}. 2. Relationsips between discrete and continuous variation and functionals. We need to compare continuous and discrete variation functionals, so we ave te following tecnical lemma, wic is proved in te appendix. Lemma 2.1 (TV bound). Tere exists a C > 0 suc for any J and any v L 1 (Ω) and for any v defined on Ω J (P v) v BV(Ω) + C Extv W (2Ω) (2.1) Int v BV(Ω) J (v ) + C Ext v W (2Ω ). (2.2) Our goal is to bound te difference between various continuous and discrete convex functionals defined on L 2 (Ω) and L 2 (Ω ). We fix λ > 0. Given g L 2 (Ω), we consider te (unique) minimizer u of te functional E(v) = 1 2λ v g 2 L 2 (Ω) + v BV(Ω) and te (unique) minimizer u of te functional E (v ) = 1 2λ v P g 2 L 2 (Ω ) + J (v ), were J is any of te discrete variational functionals defined above. Most of our analysis concerns itself wit te special case J = J. It is difficult to compare u and u directly, because J (u ) and u BV(Ω) could be far apart, in general, even if u u as 0. However, tere are smooted versions 11

12 of u and u, close to u and u, wose continuous and discrete variations are close, as te following Lemma sows. Lemma 2.2 (TV consistency). Tere exists a constant C suc tat for any discrete function v L 2 (Ω ) and any positive integer L we ave Int S L v BV(Ω) J (v ) + C L J (v ). (2.3) Furtermore, tere is a constant C suc tat for any v BV(Ω) and any positive ǫ and any discrete functional J, we ave J (P S ǫ v) v BV(Ω) + C ǫ v BV(Ω). (2.4) Proof. For te first inequality, we ave from (2.2) in Lemma 2.1 (wit J = J ) IntS L v BV(Ω) J (S L v ) + C S L v W (2Ω ), wile from (1.25) in Lemma 1.6 J (S L v ) J (v ) and (1.28) in te same lemma S L v W (2Ω ) C L v W 1,1 (Ω ) C L J (v ). Te second inequality follows from (1.13). Combining te previous inequalities gives (2.3). For (2.4), we ave from (2.1) in Lemma 2.1 J (P S ǫ v) S ǫ v BV(Ω) + C S ǫ v W (2Ω), wile (1.25) yields S ǫ v BV(Ω) v BV(Ω) and (1.28) gives S ǫ v W (2Ω) C ǫ v BV(Ω). Combining tese tree inequalities yields (2.4). Now we compare discrete and continuous energy functionals. Lemma 2.3 (Comparing discrete and continuous energies). Tere exists a constant C > 0 suc tat for all J and for all v BV(Ω) E (P S ǫ v) E(v) + C ǫ v BV(Ω) + C λ v g ) L (Ω)( 2 ω(v, )L2 (Ω) + ω(v, ǫ) L2 (Ω) + ω(g, ) L2 (Ω) (2.5) + C ( ω(v, ) 2 λ L2 (Ω) + ω(v, ǫ)2 L 2 (Ω) + ω(g, ) )2 L 2 (Ω). Furtermore, if J = J, ten for all discrete functions v E(IntS L v ) E (v ) + C L J (v ) + C λ v P g L2 (Ω )( ω(v ), L) L2 (Ω ) + ω(g, ) L2 (Ω) (2.6) + C ( ω(v, L) 2 L λ 2 (Ω) + ω(g, ) )2 L 2 (Ω). 12

13 Proof. We ave E (P S ǫ v) = J (P S ǫ v) + 1 2λ P S ǫ v P g 2 L 2 (Ω ). (2.7) From (2.4), we see tat te first term on te rigt is bounded by Now v BV(Ω) + C ǫ v BV(Ω). (2.8) P S ǫ v P g 2 L 2 (Ω ) = I P S ǫ v I P g 2 L 2 (Ω), and te quantity on te rigt can be written as (I P S ǫ v S ǫ v) + (S ǫ v v) + (v g) + (g I P g) 2 L 2 (Ω) v g 2 L 2 (Ω) + 2 v g L 2 (Ω) (I P S ǫ v S ǫ v) + (S ǫ v v) + (g I P g) L2 (Ω) + (I P S ǫ v S ǫ v) + (S ǫ v v) + (g I P g) 2 L 2 (Ω). v g 2 L 2 (Ω) + 2 v g L 2 (Ω) ( ) I P S ǫ v S ǫ v L2 (Ω) + S ǫ v v L2 (Ω) + g I P g L2 (Ω) + C ( I P S ǫ v S ǫ v 2 L 2 (Ω) + S ǫv v 2 L 2 (Ω) + g I P g 2 L (Ω)). 2 From (1.27) we can bound S ǫ v v L2 (Ω) Cω(v, ǫ) L2 (Ω) and from (1.16) we know tat I P g g L2 (Ω) Cω(g, ) L2 (Ω). We also ave from (1.16) and (1.26) I P S ǫ v S ǫ v L2 (Ω) Cω(S ǫ v, ) L2 (Ω) Cω(v, ) L2 (Ω). Tus, P S ǫ v P g 2 L 2 (Ω ) v g 2 L 2 (Ω) + C v g L 2 (Ω) ( ) ω(v, ) L 2 (Ω) + ω(v, ǫ) L 2 (Ω) + ω(g, ) L 2 (Ω) + C ( ω(v, ) 2 L 2 (Ω) + ω(v, ǫ)2 L 2 (Ω) + ω(g, )2 L 2 (Ω)). Using tis inequality as well as (2.8) in (2.7) yields (2.5). Now let v be any discrete function. Ten E(IntS L v ) = Int S L v BV(Ω) + 1 2λ IntS Lv g 2 L 2 (Ω). (2.9) By (2.3), te first term on te rigt is bounded by J (v ) + C L J (v ). (2.10) 13

14 Now IntS L v g 2 L 2 (Ω) = (Int S L v I S L v ) + (I S L v I v ) + (I v I P g) + (I P g g) 2 L 2 (Ω) I v I P g 2 L 2 (Ω) + 2 I v I P g L2 (Ω) (IntS L v I S L v ) + (I S L v I v ) + (I P g g) L2 (Ω) + (IntS L v I S L v ) + (I S L v I v ) + (I P g g) 2 L 2 (Ω) I v I P g 2 L 2 (Ω) + 2 I v I P g L2 (Ω) ( IntS L v I S L v L 2 (Ω) + I S L v I v ) L 2 (Ω) + I P g g L 2 (Ω) + C( IntS L v I S L v 2 L 2 (Ω) + I S L v I v 2 L 2 (Ω) + I P g g 2 L 2 (Ω) ) Since, for all discrete v, I v L 2 (Ω) = v L2 (Ω ), te quantity above is bounded by v P g 2 L 2 (Ω ) + 2 v P g L2 (Ω ) ( Int S L v I S L v L2 (Ω) + S L v v ) L2 (Ω ) + I P g g L2 (Ω) + C( IntS L v I S L v 2 L 2 (Ω) + S Lv v 2 L 2 (Ω ) + I P g g 2 L 2 (Ω) ) From (1.27) we ave By (1.21) and (1.26) we ave S L v v L2 (Ω ) Cω(v, L) L2 (Ω ). Int S L v I S L v L2 (Ω) Cω(S L v, 1) L2 (Ω ) Combining tese inequalities, we ave Cω(v, 1) L2 (Ω ) Cω(v, L) L2 (Ω ). Int S L v g 2 L 2 (Ω) v P g 2 L 2 (Ω ) + C v P g L2 (Ω )( ω(v ), L) L2 (Ω ) + ω(g, ) L2 (Ω) + C ( ω(v, L) 2 L 2 (Ω) + ω(g, )2 L 2 (Ω)). Combining tis inequality wit (2.9) and (2.10) yields (2.6). 3. Properties of te continuous and discrete minimizers. We need to discuss some properties of minimizers of te discrete and continuous functionals. We begin by comparing functionals on Ω and Ω and te corresponding functionals on 2Ω and 2Ω. We remind te reader of te notations used in Lemma 1.2. Lemma 3.1 (Extending minimizers). If u is te minimizer of te functional E Ω (v ) = E (v ) = 1 2λ v g 2 L 2 (Ω ) + JΩ (v ), (3.1) ten Ext u is te minimizer over all discrete functions v defined on 2Ω of te functional E 2Ω (v ) = 1 2λ v Ext g 2 L 2 (2Ω ) + J2Ω (v ) (3.2) 14

15 wit periodic boundary conditions. Similarly, if u is te minimizer of ten Extu is te minimizer of E Ω (v) = E(v) = 1 2λ v g 2 L 2 (Ω) + v BV(Ω) (3.3) E 2Ω (v) = 1 2λ v Extg 2 L 2 (2Ω) + v BV(2Ω), (3.4) again wit periodic boundary conditions. Furtermore, if u and w are minimizers of (3.3) wit data g and, respectively, ten u w L2 (Ω) g L2 (Ω); similarly for te discrete and continuous minimizers of (3.1) (3.4). Tus, for te two periodic problems (3.2) and (3.4) we ave and Ext u T l Ext u L2 (2Ω ) Ext g T l Ext g L2 (2Ω ) (3.5) Extu T τ Extu L2 (2Ω) Extg T τ Extg L2 (2Ω). (3.6) Proof. Beginning wit Lemma 1.2, te discrete extension result can be proved wit a tedious calculation, wic can be found in [14]. Te rest of te teorem is standard. Te results of te next lemma follow quickly from te previous one and Lemma 1.1 and we present tem witout proof. Lemma 3.2 (Smootness bounds). Assume u is te minimizer of E(v) from (3.3) and u is te minimizer of E (v ) from (3.1). Ten and ω(u, ǫ) L2 (Ω) Cω(g, ǫ) L2 (Ω) (3.7) ω(u, L) L2 (Ω ) Cω(P g, L) L2 (Ω ) Cω(g, L) L 2 (Ω). (3.8) 4. Proof of te main teorems. We now bound te difference between discrete and continuous functionals at teir respective minimizers. Teorem 4.1 (Functional difference). Assume u is te minimizer of E(v) from (3.3) and u is te minimizer of E (v ) from (3.1). Ten if ǫ = 1/(α+1) we ave E (P S ǫ u) E(u) + C λ g 2 Lip(α,L 2 (Ω)) α/(α+1). (4.1) and if L is set to te integer part of α/(α+1) ten Finally, E(IntS L u ) E (u ) + C λ g 2 Lip(α,L 2 (Ω)) α/(α+1). (4.2) E(u) E (u ) C λ g 2 Lip(α,L 2 (Ω)) α/(α+1). (4.3) 15

16 Proof. We mainly use Lemma 2.3 and Lemma 3.2. By (2.5) of Lemma 2.3 E (P S ǫ u) E(u) + C ǫ u BV(Ω) + C λ u g ) L (Ω)( 2 ω(u, )L2 (Ω) + ω(u, ǫ) L2 (Ω) + ω(g, ) L2 (Ω) + C λ ( ω(u, ) 2 L2 (Ω) + ω(u, ǫ)2 L 2 (Ω) + ω(g, )2 L 2 (Ω)). We ten note u g L2 (Ω) g L2 (Ω) and u BV(Ω) 1 2λ g 2 L 2 (Ω) and apply (3.7) to obtain E (P S ǫ u) E(u) + C ǫλ g 2 L 2 (Ω) + C λ g ) L (Ω)( 2 ω(g, ǫ)l2 (Ω) + ω(g, ) L2 (Ω) + C λ ( ω(g, ) 2 L 2 (Ω) + ω(g, ǫ)2 L 2 (Ω)). Now, ω(g, t) L2 (Ω) g Lip(α,L2 (Ω))t α, t > 0. Tus E (P S ǫ u) E(u) + C ǫλ g 2 L 2 (Ω) + C λ g L 2 (Ω) g Lip(α,L 2 (Ω))(ǫ α + α ) + C λ g 2 Lip(α,L 2 (Ω)) (ǫ2α + 2α ) E(u) + C λ g 2 Lip(α,L 2 (Ω)) ( ǫ + ǫα + α + ǫ 2α + 2α ) We know at a minimum 1 > ǫ >, so setting te largest error terms /ǫ and ǫ α equal, i.e., setting ǫ = 1/(α+1), we ave E (P S ǫ u) E(u) + C λ g 2 Lip(α,L 2 (Ω)) (α/(α+1) + α + 2α + 2α/(α+1) ). Tus we obtain (4.1). We point out tat (4.1) olds for any discrete variation J defined in (1.10). More generally it olds for any discrete variation satisfying Lemma 2.2. Similarly, if one begins wit (2.6), notes tat u P g L2 (Ω ) P g L2 (Ω ) g L 2 (Ω) and J (u ) 1 2λ P g 2 L 2 (Ω ) 1 2λ g 2 L 2 (Ω) and applies (3.8), one finds on setting L to te integer part of α/(α+1) tat E(IntS L u ) E (u ) + C λ g 2 Lip(α,L 2 (Ω)) α/(α+1), wic is (4.2). Because u and u are minimizers of teir respective functionals, we ave E (u ) E (P S ǫ u) E(u) + C λ g 2 Lip(α,L 2 (Ω)) α/(α+1) (4.4) 16

17 and E(u) E(IntS L u ) E (u ) + C λ g 2 Lip(α,L 2 (Ω)) α/(α+1). (4.5) Ten (4.3) is proved. To sow te error bound for minimizers, we need te following result, wic can be proved easily using classical arguments. Lemma 4.1. Assume u is te minimizer of E(v) from (3.3) and u is te minimizer of E (v ) from (3.1). Ten for any v BV(Ω), Also, for any v defined on Ω, v u 2 L 2 (Ω) 2λ(E(v) E(u)). (4.6) v u 2 L 2 (Ω ) 2λ(E (v ) E (u )). (4.7) Teorem 4.2 (Minimizer difference). Let g Lip(α, L 2 (Ω)). Assume tat u is te minimizer of E(v) from (3.3) and u is te minimizer of E (v ) from (3.1). Ten I u u 2 L 2 (Ω) C g 2 Lip(α,L 2 (Ω)) α/(α+1). Proof. We apply (4.7) wit v = P S ǫ u and ǫ = 1/(α+1) : P S ǫ u u 2 L 2 (Ω ) 2λ(E (P S ǫ u ) E (u )) 2λ [ (E(u) + C λ g 2 Lip(α,L 2 (Ω)) α/(α+1) ) + ( E(u) + C λ g 2 Lip(α,L 2 (Ω)) α/(α+1) ) ]. Te first substitution is by (4.1); te second is by (4.5). Tus we ave P S ǫ u u 2 L 2 (Ω ) C g 2 Lip(α,L 2 (Ω)) α/(α+1). (4.8) Ten I u u 2 L 2 (Ω) = I u I P S ǫ u + I P S ǫ u S ǫ u + S ǫ u u 2 L 2 (Ω) 3 ( I u I P S ǫ u 2 L 2 (Ω) + I P S ǫ u S ǫ u 2 L 2 (Ω) + S ǫ u u 2 ) L 2 (Ω) Because I v L2 (Ω) = v L 2 (Ω ) for any v it follows from (4.8) I u I P S ǫ u 2 L 2 (Ω) = P S ǫ u u 2 L 2 (Ω ) C g 2 Lip(α,L 2 (Ω)) α/(α+1). To bound I P S ǫ u S ǫ u L 2 (Ω), by (1.16), (1.26), and (3.7), we ave I P S ǫ u S ǫ u L2 (Ω) Cω(S ǫ u, ) L2 (Ω) (4.9) Cω(u, ) L2 (Ω) Cω(g, ) L2 (Ω). 17

18 Finally by (1.27) and (3.7) S ǫ u u L2 (Ω) Cω(u, ǫ) Cω(g, ǫ). (4.10) Tus combining (4.8), (4.9) and (4.10), we ave ) I u u 2 L 2 (Ω) ( g C 2 Lip(α,L 2 (Ω)) α/(α+1) + ω(g, ) 2 L 2 (Ω) + ω(g, ǫ)2 L 2 (Ω) C ( g 2 Lip(α,L 2 (Ω)) α/(α+1) + g 2 L 2 (Ω) 2α + g 2 L 2 (Ω) 2α/(α+1)) Because te first term dominates te oters, we ave I u u 2 L 2 (Ω) C g 2 Lip(α,L 2 (Ω)) α/(α+1). 5. Error bound for te upwind sceme. In tis section, we prove te error bound for te upwind sceme. Te upwind discrete gradient operator is defined by ( )vi = 1 Ext v i Ext v i+(1,0) Ext v i Ext v i (1,0) Ext v i Ext v i+(0,1) Ext v i Ext v i (0,1). (5.1) Te upwind discrete variation is ten defined by J U (v ) = i Ω ( )v i 0 2 (5.2) were 0 is te vector (0, 0, 0, 0), and p q and p q are componentwise maximum and minimum, respectively, of te vectors p, q R 4. In oter words, we include a difference in te vector norm of te it term in (5.2) only if v is increasing into vi. Noting canges in te following proofs (and one sees little cange in te images temselves) if we cange componentwise maximum ( ) to componentwise minimum ( ) in (5.2). In teir paper, Oser and Setian [12] were solving Hamilton-Jacobi equations were tis substitution could not be made: teir problem, unlike ours, as a true notion of wind. To prove te result for te upwind sceme, we need to adapt to J U te previous lemmas involving J. First we sall prove te convexity of J U. Lemma 5.1. J U is convex Proof. First note tat for two vectors p, q R n, it is easy to verify 0 (p + q) 0 p 0 + q 0, were inequality p q means p i q i for eac index i. Tus, (p + q) 0 p 0 + q 0. (5.3) 18

19 i ( We apply (5.3) to eac term in (5.2) of J U λf + (1 λ)g ), were 1 > λ > 0 and f and g are discrete functions, to find tat ( J U λf + (1 λ)g ) = ( )(λf + (1 λ)g ) i 0 2 i i { λ( )f i 0 + (1 λ)( )g i 0 } 2 = λj U (f ) + (1 λ)j U (g ). In te following we use te notation x and y defined for {+, } by x v i = Ext v i (1,0) Ext v i, y v i = Ext v i (0,1) Ext v i. (5.4) Note tat te divided differences are applied to te extended discrete function and tat te difference is zero if i Ω and te oter index is outside Ω. Using tese operators, we can write J U (v ) = i Ω + x v i 0 x v i 0 + y v i 0 y v i 0 2. (5.5) Te following lemma corresponds to (1.13). Lemma 5.2. J U is equivalent to W 1,1 (Ω ), were W 1,1 (Ω ) is te discrete semi-norm defined in (1.12). Proof. Trivially, 1 2 { + x vi 0 + x vi y vi 0 + y vi 0 } 2 i i { + x v i x v i y v i y v i 0 2} 2 { + x v i 0 + x v i y v i 0 + y v i 0 } 2 Te middle sum is J U (v ), so we need to prove tat te last sum equals v W 1,1 (Ω ). Note tat + x vi 0 + x vi+(1,0) 0 = + x vi x vi 0 = + x vi, so te absolute value of eac orizontal and vertical difference in v is included precisely once in te last sum, so it equals v W 1,1 (Ω ). Te following lemma corresponds to Lemma 1.3. Lemma 5.3. JU (v ) J (v ) Ext v W (5.6) (2Ω ) were J is any discrete variation defined in (1.9). Proof. We only prove te case for J = J ++. Te oter cases are te same. 19

20 Note tat + x v i 2 = + x v i ( + x )v i 0 2, so we can write J ++ (v ) in a similar way to J U (v ) as J ++ (v ) = + x v i 0 + x vi 0 i Ω + y vi y vi 0 Tus, J U (v ) J ++ (v ) + x vi 0 = x vi 0 + x vi 0 i Ω + y vi 0 + x vi 0 y vi 0 + y vi y vi 0 0 x vi 0 + x vi 0 i Ω 0 2 y vi 0 + y vi 0 ( x vi 0 + x vi 0 + y v 0 + y v 0 ) 2. i Ω Because a 0 b 0 a b, we ave J U (v ) J ++ (v ) ( x vi + x vi + y vi + y vi ) 2 i Ω Ext v W (2Ω ). We use Lemma 5.2 and Lemma 5.3 to prove te following lemma tat corresponds to Lemma 2.1. Lemma 5.4. Tere exists a C > 0 suc for any v L 1 (Ω) and for any v defined on Ω J U (P v) v BV(Ω) + C Extv W (2Ω) (5.7) Intv BV(Ω) J U (v ) + C Ext v W (2Ω ). (5.8) Proof. Te second inequality can be proved by simply combining (2.2) and (5.6). To prove te first inequality, again we assume tat Extv W (2Ω), oterwise it is trivial. We apply Lemma 5.3 wit v = P v, ten Ten by (2.1) in Lemma 2.1 J U (P v) J (P v) + C Ext P v W (2Ω ). J U (P v) v BV(Ω) + C Extv W (2Ω) + C Ext P v W (2Ω ) = v BV(Ω) + C Extv W (2Ω) + C P Extv W (2Ω ) v BV(Ω) + C Extv W (2Ω). 20

21 Table 6.1 L 2 (Ω) errors on grids of size 128, 256, and 512, and differences σ = g u L 2 (Ω) of 16, 32, and 64, wit initial data a multiple of te caracteristic function of a disk (6.1); columns 1 3 are te results wit te anisotropic approximation J = J ++ to BV(Ω) ; columns 4 6 are te results wit te upwind approximation J = J U ; α is te estimated order of convergence, u u L2 C α. L 2 (Ω) difference between continuous and discrete solutions anisotropic J upwind J resolution σ = 16 σ = 32 σ = 64 σ = 16 σ = 32 σ = α Te last line follows from (1.17). Lemma 5.5 is te counterpart of te first inequality (1.25) in Lemma 1.6. Lemma 5.5. J U (S L v ) J U (v ). Proof. Te result comes from te symmetry and convexity of J U. Te proof is exactly te same as te proof for J in Lemma 1.6. We note tat te proofs of Lemmas 3.1 and 4.1 carry over directly to J U, and we obtain te following teorem for te upwind discrete variation. Teorem 5.1 (Error bounds for upwind sceme). Assume u is te minimizer of E(v) from (3.3) for g Lip(α, L 2 (Ω)) and u is te minimizer of te discrete functional Ten E (v ) = 1 2λ v P g 2 L 2 (Ω ) + J U(v ). I u u 2 L 2 (Ω) C g 2 Lip(α,L 2 (Ω)) α/(α+1). Te proof is te same as te proof for te symmetric discrete variation J. 6. Discussion and extensions. We remark tat our error bounds are not optimal in an approximation-teory sense. In general, wit suitably smoot piecewise polynomials, one can approximate a function in Lip(α, L p (Ω)) to order α in L p (Ω) for 0 < p <. So one can approximate Lip(α, L 2 (Ω)) functions in L 2 (Ω) to order α ; in contrast, we acieve an error bound of α/(2α+2). Te caracteristic function of a disk is in Lip(α, L p (Ω)) for α = 1/p; if g is te caracteristic function of a disk, ten te minimizer u of E(v) is again te caracteristic function of a disk (for λ small enoug). Tus one as α = 1/2 and one can expect at most a convergence rate of 1/2 in L 2 (Ω). Our results bound te L 2 (Ω) error by C α/(2(α+1)) = C 1/6. In [5] some numerical experiments were conducted; wit permission we reprint a table sowing te results of tese computations wit initial data g = 255χ x ( 1 2, 1 2 ) 1 4, (6.1) Wile te computations were iterative, te iterated approximation to te true discrete solution was provably witin a distance in L 2 (Ω) of 1/4 to te true discrete solution. We note tat te upwind sceme as sligtly smaller errors (because of less smooting in te discrete solution at te edges of te disk) and a sligtly iger 21

22 estimated rate of convergence. In bot cases, te estimated rate of convergence is strictly between our bound of 1/6 and te optimal rate of 1/2 ; we don t know weter tis difference is real. Estimating real rates of convergence for data in Lip(α, L 2 (Ω)) is difficult for many reasons. Even te optimal asymptotic rate of convergence, O( α ), is quite slow, so one needs very small to be convinced tat te parameter is in te asymptotic regime. Furtermore, a function in Lip(α, L 2 (Ω)) for α 1/2 is, in general, not even bounded; if it s te caracteristic function of a set, ten tis set need not ave bounded perimeter. For bot tese reasons, computing wit generic Lip(α, L 2 (Ω)) data is quite difficult. We do not ave an opinion on wat te true rate of convergence migt be. Somewat weaker results were proved by te first autor in [14] for te functional J (v ) = 1 2( J++ (v ) + J (v ) ). Te arguments tere exploit te fact tat for tis particular J Intv BV(Ω) = J (v ); tey also require tat g Lip(β, L 1 (Ω)) L (Ω), wic implies tat g Lip(α, L 2 (Ω)) for α = β/2, and tey acieve te same convergence rate of α/(2α+2). Finally, similar tecniques ave been applied to analyze a central difference approximation to v BV(Ω) in [11]; tere te same convergence rate of approximation O( 1/4 )(α = 1) was acieved, but for quite smoot functions: g is required to be in te Sobolev space W 1,2 (Ω), a space tat does not contain images wit edges. 7. Appendix. We include ere te proof of a tecnical lemma. Proof of Lemma 2.1. One proves te second inequality simply by combining (1.20) and (1.15). As for te first inequality, te left and side is finite for v L 1 (Ω), so if Extv / W (2Ω), we re done. So we assume tat Extv W (2Ω) and we prove (2.1) for J = J ++, te oter cases being te same. We denote P v by v and use te divided differences + x vi and + y vi from (5.4). In te argument tat follows, we write v for Extv. Ten + x vi 1 2 D 1 v = v i+(1,0) v i 1 Ω i Ω 2 D 1 v i = 1 1 [v(x +, y) v(x, y)] dx dy 1 Ω i Ω i 2 D 1 v. Ω i Te integrand of te first integral can be rewritten as an integral of D 1 v, ten combining tese two integrals and once again rewriting te integrand as an integral of te second derivative of v, we ave + x v i 1 2 Ω i D 1 v = 1 3 = 1 3 Ω i 0 t Ω i 0 (D 1 v(x + t, y) D 1 v(x, y)) dt dx dy 0 22 D 2 1v(x + s, y) ds dt dx dy.

23 Terefore + x v i = 1 2 Ω i D 1 v Ω i t 0 0 D 2 1v(x + s, y) ds dt dx dy. ( ) Similarly for + y vi ; so we can bound te norm of + vi = + x vi + y vi by + vi 1 ( ) ( Ω i D 1 v t Ω Ω i D 2 v 3 i 0 0 D2 1v(x + s, y) ds dt dx dy t 0 D2 2v(x, y + s) ds dt dx dy Ω i 0 ) 1 2 Ω i Dv t Ω i 0 0 t Ω i 0 0 D 2 1v(x + s, y) ds dt dx dy D 2 2v(x, y + s) ds dt dx dy. (7.1) ( ) Te last line follows from te fact tat f f 2 + g 2 (by Jensen s inequal- g ity) and a 2 + b 2 a + b. To bound te discrete total variation J ++ (v ), we sum (7.1) over all indices i Ω wit weigt 2 at eac index. We obtain J ++ (v ) Dv + e x + e y, were e x = i 1 C 0 C t 0 0 t Similarly for e y ; terefore J ++ (v ) Ω 0 Ω i Ω t 0 0 D 2 1v(x + s, y) ds dt dx dy { } D1v(x 2 + s, y) dx dy ds dt Ω { } D1v 2 dx dy ds dt Ω D 2 1v. Ω Dv + C ( D1v 2 + D2v ) 2. Ω REFERENCES [1] C. Bouman and K. Sauer, Bayesian estimation of transmission tomograms using segmentation based optimization, IEEE Trans. Nuclear Science, 39 (1992), pp [2] J. L. Carter, Dual Metods for Total Variation-Based Image Restoration, P.D. tesis, 2001, U.C.L.A. [3] A. Cambolle, An algoritm for total variation minimization and applications, J. Mat. Imaging Vision, 20 (2004), pp

24 [4] A. Cambolle, R. A. DeVore, N.-Y. Lee, and B. J. Lucier, Nonlinear wavelet image processing: Variational problems, compression, and noise removal troug wavelet srinkage, IEEE Trans. Image Processing, 7 (1998), pp [5] A. Cambolle, S. E. Levine, and B. J. Lucier, Upwind metods for ROF image smooting, preprint, [6] T. F. Can, G. H. Golub, and P. Mulet, A nonlinear primal-dual metod for total variation-based image restoration, SIAM J. Sci. Comput., 20 (1999), pp [7] R. A. DeVore, B. Jawert, and B. J. Lucier, Image Compression troug wavelet transform coding, IEEE Trans. Information Teory, 38 (1992), pp Special issue on Wavelet Transforms and Multiresolution Analysis. [8] R. A. DeVore and G. G. Lorentz, Constructive Approximation, Springer-Verlag, Berlin Heidelberg, [9] L. C. Evans and R. F. Gariepy, Measure teory and fine properties of functions, CRC Press, Boca Raton, FL, [10] X. Feng, M. von Oesen, and A. Prol, Rate of convergence of regularization procedures and finite element approximations for te total variation flow, Numer. Mat., 100 (2005), pp [11] M.-J. Lai, B. Lucier, and J. Wang, Te convergence of a central-difference discretization of Rudin Oser Fatemi model for image denoising, in Scale Space and Variational Metods in Computer Vision, X.-C.-Tai et al., eds., Lecture Notes in Computer Science, Vol. 5567, Springer Berlin, Heidelberg, 2009, pp [12] S. Oser and J. A. Setian, Fronts propagating wit curvature-dependent speed: Algoritms based on Hamilton Jacobi formulations, J. Comput. Pysics, 79 (1988), pp [13] L. I. Rudin, S. Oser, and E. Fatemi, Nonlinear total variation based noise removal algoritms, Pysica D., 60 (1992), pp [14] J. Wang, Error bounds for numerical metods for te ROF image smooting model, P.D. tesis, 2008, Purdue University. 24

c 2011 Society for Industrial and Applied Mathematics Key words. total variation, variational methods, finite-difference methods, error bounds

c 2011 Society for Industrial and Applied Mathematics Key words. total variation, variational methods, finite-difference methods, error bounds SIAM J. NUMER. ANAL. Vol. 49, No. 2, pp. 845 868 c 211 Society for Industrial and Applied Matematics ERROR BOUNDS FOR FINITE-DIFFERENCE METHODS FOR RUDIN OSHER FATEMI IMAGE SMOOTHING JINGYUE WANG AND BRADLEY

More information

Convergence of a Central Difference Discretization of ROF Model for Image Denoising

Convergence of a Central Difference Discretization of ROF Model for Image Denoising Convergence of a Central Difference Discretization of ROF Model for Image Denoising Ming-Jun Lai and Jingyue Wang Department of Matematics Te University of Georgia Atens, GA 30602 October 8, 2009 Abstract

More information

The Convergence of a Central-Difference Discretization of Rudin-Osher-Fatemi Model for Image Denoising

The Convergence of a Central-Difference Discretization of Rudin-Osher-Fatemi Model for Image Denoising Te Convergence of a Central-Difference Discretization of Rudin-Oser-Fatemi Model for Image Denoising Ming-Jun Lai 1, Bradley Lucier 2, and Jingyue Wang 3 1 University of Georgia, Atens GA 30602, USA mjlai@mat.uga.edu

More information

ERROR BOUNDS FOR THE METHODS OF GLIMM, GODUNOV AND LEVEQUE BRADLEY J. LUCIER*

ERROR BOUNDS FOR THE METHODS OF GLIMM, GODUNOV AND LEVEQUE BRADLEY J. LUCIER* EO BOUNDS FO THE METHODS OF GLIMM, GODUNOV AND LEVEQUE BADLEY J. LUCIE* Abstract. Te expected error in L ) attimet for Glimm s sceme wen applied to a scalar conservation law is bounded by + 2 ) ) /2 T

More information

Poisson Equation in Sobolev Spaces

Poisson Equation in Sobolev Spaces Poisson Equation in Sobolev Spaces OcMountain Dayligt Time. 6, 011 Today we discuss te Poisson equation in Sobolev spaces. It s existence, uniqueness, and regularity. Weak Solution. u = f in, u = g on

More information

PIECEWISE LINEAR APPROXIMATION OF THE CONTINUOUS RUDIN-OSHER-FATEMI MODEL FOR IMAGE DENOISING

PIECEWISE LINEAR APPROXIMATION OF THE CONTINUOUS RUDIN-OSHER-FATEMI MODEL FOR IMAGE DENOISING PIECEWISE LINEAR APPROXIMATION OF THE CONTINUOUS RUDIN-OSHER-FATEMI MODEL FOR IMAGE DENOISING MING-JUN LAI AND LEOPOLD MATAMBA MESSI Abstract. Tis paper is concerned wit te numerical approximation of te

More information

lecture 26: Richardson extrapolation

lecture 26: Richardson extrapolation 43 lecture 26: Ricardson extrapolation 35 Ricardson extrapolation, Romberg integration Trougout numerical analysis, one encounters procedures tat apply some simple approximation (eg, linear interpolation)

More information

Differentiation in higher dimensions

Differentiation in higher dimensions Capter 2 Differentiation in iger dimensions 2.1 Te Total Derivative Recall tat if f : R R is a 1-variable function, and a R, we say tat f is differentiable at x = a if and only if te ratio f(a+) f(a) tends

More information

ch (for some fixed positive number c) reaching c

ch (for some fixed positive number c) reaching c GSTF Journal of Matematics Statistics and Operations Researc (JMSOR) Vol. No. September 05 DOI 0.60/s4086-05-000-z Nonlinear Piecewise-defined Difference Equations wit Reciprocal and Cubic Terms Ramadan

More information

POLYNOMIAL AND SPLINE ESTIMATORS OF THE DISTRIBUTION FUNCTION WITH PRESCRIBED ACCURACY

POLYNOMIAL AND SPLINE ESTIMATORS OF THE DISTRIBUTION FUNCTION WITH PRESCRIBED ACCURACY APPLICATIONES MATHEMATICAE 36, (29), pp. 2 Zbigniew Ciesielski (Sopot) Ryszard Zieliński (Warszawa) POLYNOMIAL AND SPLINE ESTIMATORS OF THE DISTRIBUTION FUNCTION WITH PRESCRIBED ACCURACY Abstract. Dvoretzky

More information

SOLUTIONS OF FOURTH-ORDER PARTIAL DIFFERENTIAL EQUATIONS IN A NOISE REMOVAL MODEL

SOLUTIONS OF FOURTH-ORDER PARTIAL DIFFERENTIAL EQUATIONS IN A NOISE REMOVAL MODEL Electronic Journal of Differential Equations, Vol. 7(7, No., pp.. ISSN: 7-669. URL: ttp://ejde.mat.txstate.edu or ttp://ejde.mat.unt.edu ftp ejde.mat.txstate.edu (login: ftp SOLUTIONS OF FOURTH-ORDER PARTIAL

More information

Lecture XVII. Abstract We introduce the concept of directional derivative of a scalar function and discuss its relation with the gradient operator.

Lecture XVII. Abstract We introduce the concept of directional derivative of a scalar function and discuss its relation with the gradient operator. Lecture XVII Abstract We introduce te concept of directional derivative of a scalar function and discuss its relation wit te gradient operator. Directional derivative and gradient Te directional derivative

More information

Linearized Primal-Dual Methods for Linear Inverse Problems with Total Variation Regularization and Finite Element Discretization

Linearized Primal-Dual Methods for Linear Inverse Problems with Total Variation Regularization and Finite Element Discretization Linearized Primal-Dual Metods for Linear Inverse Problems wit Total Variation Regularization and Finite Element Discretization WENYI TIAN XIAOMING YUAN September 2, 26 Abstract. Linear inverse problems

More information

The derivative function

The derivative function Roberto s Notes on Differential Calculus Capter : Definition of derivative Section Te derivative function Wat you need to know already: f is at a point on its grap and ow to compute it. Wat te derivative

More information

ERROR BOUND FOR NUMERICAL METHODS FOR THE ROF IMAGE SMOOTHING MODEL. A Dissertation. Submitted to the Faculty. Purdue University.

ERROR BOUND FOR NUMERICAL METHODS FOR THE ROF IMAGE SMOOTHING MODEL. A Dissertation. Submitted to the Faculty. Purdue University. ERROR BOUND FOR NUMERCAL METHODS FOR THE ROF MAGE SMOOTHNG MODEL A Dissertation Submitted to the Faculty of Purdue University by Jingyue Wang n Partial Fulfillment of the Requirements for the Degree of

More information

Differential Calculus (The basics) Prepared by Mr. C. Hull

Differential Calculus (The basics) Prepared by Mr. C. Hull Differential Calculus Te basics) A : Limits In tis work on limits, we will deal only wit functions i.e. tose relationsips in wic an input variable ) defines a unique output variable y). Wen we work wit

More information

Function Composition and Chain Rules

Function Composition and Chain Rules Function Composition and s James K. Peterson Department of Biological Sciences and Department of Matematical Sciences Clemson University Marc 8, 2017 Outline 1 Function Composition and Continuity 2 Function

More information

How to Find the Derivative of a Function: Calculus 1

How to Find the Derivative of a Function: Calculus 1 Introduction How to Find te Derivative of a Function: Calculus 1 Calculus is not an easy matematics course Te fact tat you ave enrolled in suc a difficult subject indicates tat you are interested in te

More information

LEAST-SQUARES FINITE ELEMENT APPROXIMATIONS TO SOLUTIONS OF INTERFACE PROBLEMS

LEAST-SQUARES FINITE ELEMENT APPROXIMATIONS TO SOLUTIONS OF INTERFACE PROBLEMS SIAM J. NUMER. ANAL. c 998 Society for Industrial Applied Matematics Vol. 35, No., pp. 393 405, February 998 00 LEAST-SQUARES FINITE ELEMENT APPROXIMATIONS TO SOLUTIONS OF INTERFACE PROBLEMS YANZHAO CAO

More information

Error estimates for a semi-implicit fully discrete finite element scheme for the mean curvature flow of graphs

Error estimates for a semi-implicit fully discrete finite element scheme for the mean curvature flow of graphs Interfaces and Free Boundaries 2, 2000 34 359 Error estimates for a semi-implicit fully discrete finite element sceme for te mean curvature flow of graps KLAUS DECKELNICK Scool of Matematical Sciences,

More information

4. The slope of the line 2x 7y = 8 is (a) 2/7 (b) 7/2 (c) 2 (d) 2/7 (e) None of these.

4. The slope of the line 2x 7y = 8 is (a) 2/7 (b) 7/2 (c) 2 (d) 2/7 (e) None of these. Mat 11. Test Form N Fall 016 Name. Instructions. Te first eleven problems are wort points eac. Te last six problems are wort 5 points eac. For te last six problems, you must use relevant metods of algebra

More information

REVIEW LAB ANSWER KEY

REVIEW LAB ANSWER KEY REVIEW LAB ANSWER KEY. Witout using SN, find te derivative of eac of te following (you do not need to simplify your answers): a. f x 3x 3 5x x 6 f x 3 3x 5 x 0 b. g x 4 x x x notice te trick ere! x x g

More information

Math 31A Discussion Notes Week 4 October 20 and October 22, 2015

Math 31A Discussion Notes Week 4 October 20 and October 22, 2015 Mat 3A Discussion Notes Week 4 October 20 and October 22, 205 To prepare for te first midterm, we ll spend tis week working eamples resembling te various problems you ve seen so far tis term. In tese notes

More information

arxiv: v1 [math.na] 28 Apr 2017

arxiv: v1 [math.na] 28 Apr 2017 THE SCOTT-VOGELIUS FINITE ELEMENTS REVISITED JOHNNY GUZMÁN AND L RIDGWAY SCOTT arxiv:170500020v1 [matna] 28 Apr 2017 Abstract We prove tat te Scott-Vogelius finite elements are inf-sup stable on sape-regular

More information

Mass Lumping for Constant Density Acoustics

Mass Lumping for Constant Density Acoustics Lumping 1 Mass Lumping for Constant Density Acoustics William W. Symes ABSTRACT Mass lumping provides an avenue for efficient time-stepping of time-dependent problems wit conforming finite element spatial

More information

Symmetry Labeling of Molecular Energies

Symmetry Labeling of Molecular Energies Capter 7. Symmetry Labeling of Molecular Energies Notes: Most of te material presented in tis capter is taken from Bunker and Jensen 1998, Cap. 6, and Bunker and Jensen 2005, Cap. 7. 7.1 Hamiltonian Symmetry

More information

1 The concept of limits (p.217 p.229, p.242 p.249, p.255 p.256) 1.1 Limits Consider the function determined by the formula 3. x since at this point

1 The concept of limits (p.217 p.229, p.242 p.249, p.255 p.256) 1.1 Limits Consider the function determined by the formula 3. x since at this point MA00 Capter 6 Calculus and Basic Linear Algebra I Limits, Continuity and Differentiability Te concept of its (p.7 p.9, p.4 p.49, p.55 p.56). Limits Consider te function determined by te formula f Note

More information

1. Introduction. We consider the model problem: seeking an unknown function u satisfying

1. Introduction. We consider the model problem: seeking an unknown function u satisfying A DISCONTINUOUS LEAST-SQUARES FINITE ELEMENT METHOD FOR SECOND ORDER ELLIPTIC EQUATIONS XIU YE AND SHANGYOU ZHANG Abstract In tis paper, a discontinuous least-squares (DLS) finite element metod is introduced

More information

Continuity. Example 1

Continuity. Example 1 Continuity MATH 1003 Calculus and Linear Algebra (Lecture 13.5) Maoseng Xiong Department of Matematics, HKUST A function f : (a, b) R is continuous at a point c (a, b) if 1. x c f (x) exists, 2. f (c)

More information

NUMERICAL DIFFERENTIATION. James T. Smith San Francisco State University. In calculus classes, you compute derivatives algebraically: for example,

NUMERICAL DIFFERENTIATION. James T. Smith San Francisco State University. In calculus classes, you compute derivatives algebraically: for example, NUMERICAL DIFFERENTIATION James T Smit San Francisco State University In calculus classes, you compute derivatives algebraically: for example, f( x) = x + x f ( x) = x x Tis tecnique requires your knowing

More information

Gradient Descent etc.

Gradient Descent etc. 1 Gradient Descent etc EE 13: Networked estimation and control Prof Kan) I DERIVATIVE Consider f : R R x fx) Te derivative is defined as d fx) = lim dx fx + ) fx) Te cain rule states tat if d d f gx) )

More information

SECTION 3.2: DERIVATIVE FUNCTIONS and DIFFERENTIABILITY

SECTION 3.2: DERIVATIVE FUNCTIONS and DIFFERENTIABILITY (Section 3.2: Derivative Functions and Differentiability) 3.2.1 SECTION 3.2: DERIVATIVE FUNCTIONS and DIFFERENTIABILITY LEARNING OBJECTIVES Know, understand, and apply te Limit Definition of te Derivative

More information

OSCILLATION OF SOLUTIONS TO NON-LINEAR DIFFERENCE EQUATIONS WITH SEVERAL ADVANCED ARGUMENTS. Sandra Pinelas and Julio G. Dix

OSCILLATION OF SOLUTIONS TO NON-LINEAR DIFFERENCE EQUATIONS WITH SEVERAL ADVANCED ARGUMENTS. Sandra Pinelas and Julio G. Dix Opuscula Mat. 37, no. 6 (2017), 887 898 ttp://dx.doi.org/10.7494/opmat.2017.37.6.887 Opuscula Matematica OSCILLATION OF SOLUTIONS TO NON-LINEAR DIFFERENCE EQUATIONS WITH SEVERAL ADVANCED ARGUMENTS Sandra

More information

Dedicated to the 70th birthday of Professor Lin Qun

Dedicated to the 70th birthday of Professor Lin Qun Journal of Computational Matematics, Vol.4, No.3, 6, 4 44. ACCELERATION METHODS OF NONLINEAR ITERATION FOR NONLINEAR PARABOLIC EQUATIONS Guang-wei Yuan Xu-deng Hang Laboratory of Computational Pysics,

More information

Topics in Generalized Differentiation

Topics in Generalized Differentiation Topics in Generalized Differentiation J. Marsall As Abstract Te course will be built around tree topics: ) Prove te almost everywere equivalence of te L p n-t symmetric quantum derivative and te L p Peano

More information

The Verlet Algorithm for Molecular Dynamics Simulations

The Verlet Algorithm for Molecular Dynamics Simulations Cemistry 380.37 Fall 2015 Dr. Jean M. Standard November 9, 2015 Te Verlet Algoritm for Molecular Dynamics Simulations Equations of motion For a many-body system consisting of N particles, Newton's classical

More information

Parameter Fitted Scheme for Singularly Perturbed Delay Differential Equations

Parameter Fitted Scheme for Singularly Perturbed Delay Differential Equations International Journal of Applied Science and Engineering 2013. 11, 4: 361-373 Parameter Fitted Sceme for Singularly Perturbed Delay Differential Equations Awoke Andargiea* and Y. N. Reddyb a b Department

More information

Numerical Differentiation

Numerical Differentiation Numerical Differentiation Finite Difference Formulas for te first derivative (Using Taylor Expansion tecnique) (section 8.3.) Suppose tat f() = g() is a function of te variable, and tat as 0 te function

More information

Exam 1 Review Solutions

Exam 1 Review Solutions Exam Review Solutions Please also review te old quizzes, and be sure tat you understand te omework problems. General notes: () Always give an algebraic reason for your answer (graps are not sufficient),

More information

MVT and Rolle s Theorem

MVT and Rolle s Theorem AP Calculus CHAPTER 4 WORKSHEET APPLICATIONS OF DIFFERENTIATION MVT and Rolle s Teorem Name Seat # Date UNLESS INDICATED, DO NOT USE YOUR CALCULATOR FOR ANY OF THESE QUESTIONS In problems 1 and, state

More information

Stability properties of a family of chock capturing methods for hyperbolic conservation laws

Stability properties of a family of chock capturing methods for hyperbolic conservation laws Proceedings of te 3rd IASME/WSEAS Int. Conf. on FLUID DYNAMICS & AERODYNAMICS, Corfu, Greece, August 0-, 005 (pp48-5) Stability properties of a family of cock capturing metods for yperbolic conservation

More information

Copyright c 2008 Kevin Long

Copyright c 2008 Kevin Long Lecture 4 Numerical solution of initial value problems Te metods you ve learned so far ave obtained closed-form solutions to initial value problems. A closedform solution is an explicit algebriac formula

More information

Math 102 TEST CHAPTERS 3 & 4 Solutions & Comments Fall 2006

Math 102 TEST CHAPTERS 3 & 4 Solutions & Comments Fall 2006 Mat 102 TEST CHAPTERS 3 & 4 Solutions & Comments Fall 2006 f(x+) f(x) 10 1. For f(x) = x 2 + 2x 5, find ))))))))) and simplify completely. NOTE: **f(x+) is NOT f(x)+! f(x+) f(x) (x+) 2 + 2(x+) 5 ( x 2

More information

Lecture 15. Interpolation II. 2 Piecewise polynomial interpolation Hermite splines

Lecture 15. Interpolation II. 2 Piecewise polynomial interpolation Hermite splines Lecture 5 Interpolation II Introduction In te previous lecture we focused primarily on polynomial interpolation of a set of n points. A difficulty we observed is tat wen n is large, our polynomial as to

More information

1 Calculus. 1.1 Gradients and the Derivative. Q f(x+h) f(x)

1 Calculus. 1.1 Gradients and the Derivative. Q f(x+h) f(x) Calculus. Gradients and te Derivative Q f(x+) δy P T δx R f(x) 0 x x+ Let P (x, f(x)) and Q(x+, f(x+)) denote two points on te curve of te function y = f(x) and let R denote te point of intersection of

More information

Volume 29, Issue 3. Existence of competitive equilibrium in economies with multi-member households

Volume 29, Issue 3. Existence of competitive equilibrium in economies with multi-member households Volume 29, Issue 3 Existence of competitive equilibrium in economies wit multi-member ouseolds Noriisa Sato Graduate Scool of Economics, Waseda University Abstract Tis paper focuses on te existence of

More information

Superconvergence of energy-conserving discontinuous Galerkin methods for. linear hyperbolic equations. Abstract

Superconvergence of energy-conserving discontinuous Galerkin methods for. linear hyperbolic equations. Abstract Superconvergence of energy-conserving discontinuous Galerkin metods for linear yperbolic equations Yong Liu, Ci-Wang Su and Mengping Zang 3 Abstract In tis paper, we study superconvergence properties of

More information

HOMEWORK HELP 2 FOR MATH 151

HOMEWORK HELP 2 FOR MATH 151 HOMEWORK HELP 2 FOR MATH 151 Here we go; te second round of omework elp. If tere are oters you would like to see, let me know! 2.4, 43 and 44 At wat points are te functions f(x) and g(x) = xf(x)continuous,

More information

A Hybrid Mixed Discontinuous Galerkin Finite Element Method for Convection-Diffusion Problems

A Hybrid Mixed Discontinuous Galerkin Finite Element Method for Convection-Diffusion Problems A Hybrid Mixed Discontinuous Galerkin Finite Element Metod for Convection-Diffusion Problems Herbert Egger Joacim Scöberl We propose and analyse a new finite element metod for convection diffusion problems

More information

ITERATIVE SOLUTION OF A CONSTRAINED TOTAL VARIATION REGULARIZED MODEL PROBLEM

ITERATIVE SOLUTION OF A CONSTRAINED TOTAL VARIATION REGULARIZED MODEL PROBLEM ITERATIVE SOLUTION OF A CONSTRAINED TOTAL VARIATION REGULARIZED MODEL PROBLEM Abstract. Te discretization of a bilaterally constrained total variation minimization problem wit conforming low order finite

More information

A First-Order System Approach for Diffusion Equation. I. Second-Order Residual-Distribution Schemes

A First-Order System Approach for Diffusion Equation. I. Second-Order Residual-Distribution Schemes A First-Order System Approac for Diffusion Equation. I. Second-Order Residual-Distribution Scemes Hiroaki Nisikawa W. M. Keck Foundation Laboratory for Computational Fluid Dynamics, Department of Aerospace

More information

LIMITS AND DERIVATIVES CONDITIONS FOR THE EXISTENCE OF A LIMIT

LIMITS AND DERIVATIVES CONDITIONS FOR THE EXISTENCE OF A LIMIT LIMITS AND DERIVATIVES Te limit of a function is defined as te value of y tat te curve approaces, as x approaces a particular value. Te limit of f (x) as x approaces a is written as f (x) approaces, as

More information

Finding and Using Derivative The shortcuts

Finding and Using Derivative The shortcuts Calculus 1 Lia Vas Finding and Using Derivative Te sortcuts We ave seen tat te formula f f(x+) f(x) (x) = lim 0 is manageable for relatively simple functions like a linear or quadratic. For more complex

More information

Order of Accuracy. ũ h u Ch p, (1)

Order of Accuracy. ũ h u Ch p, (1) Order of Accuracy 1 Terminology We consider a numerical approximation of an exact value u. Te approximation depends on a small parameter, wic can be for instance te grid size or time step in a numerical

More information

Discontinuous Galerkin Methods for Relativistic Vlasov-Maxwell System

Discontinuous Galerkin Methods for Relativistic Vlasov-Maxwell System Discontinuous Galerkin Metods for Relativistic Vlasov-Maxwell System He Yang and Fengyan Li December 1, 16 Abstract e relativistic Vlasov-Maxwell (RVM) system is a kinetic model tat describes te dynamics

More information

Numerical Solution of One Dimensional Nonlinear Longitudinal Oscillations in a Class of Generalized Functions

Numerical Solution of One Dimensional Nonlinear Longitudinal Oscillations in a Class of Generalized Functions Proc. of te 8t WSEAS Int. Conf. on Matematical Metods and Computational Tecniques in Electrical Engineering, Bucarest, October 16-17, 2006 219 Numerical Solution of One Dimensional Nonlinear Longitudinal

More information

2.8 The Derivative as a Function

2.8 The Derivative as a Function .8 Te Derivative as a Function Typically, we can find te derivative of a function f at many points of its domain: Definition. Suppose tat f is a function wic is differentiable at every point of an open

More information

On convexity of polynomial paths and generalized majorizations

On convexity of polynomial paths and generalized majorizations On convexity of polynomial pats and generalized majorizations Marija Dodig Centro de Estruturas Lineares e Combinatórias, CELC, Universidade de Lisboa, Av. Prof. Gama Pinto 2, 1649-003 Lisboa, Portugal

More information

Math 161 (33) - Final exam

Math 161 (33) - Final exam Name: Id #: Mat 161 (33) - Final exam Fall Quarter 2015 Wednesday December 9, 2015-10:30am to 12:30am Instructions: Prob. Points Score possible 1 25 2 25 3 25 4 25 TOTAL 75 (BEST 3) Read eac problem carefully.

More information

Preface. Here are a couple of warnings to my students who may be here to get a copy of what happened on a day that you missed.

Preface. Here are a couple of warnings to my students who may be here to get a copy of what happened on a day that you missed. Preface Here are my online notes for my course tat I teac ere at Lamar University. Despite te fact tat tese are my class notes, tey sould be accessible to anyone wanting to learn or needing a refreser

More information

Reflection Symmetries of q-bernoulli Polynomials

Reflection Symmetries of q-bernoulli Polynomials Journal of Nonlinear Matematical Pysics Volume 1, Supplement 1 005, 41 4 Birtday Issue Reflection Symmetries of q-bernoulli Polynomials Boris A KUPERSHMIDT Te University of Tennessee Space Institute Tullaoma,

More information

Journal of Computational and Applied Mathematics

Journal of Computational and Applied Mathematics Journal of Computational and Applied Matematics 94 (6) 75 96 Contents lists available at ScienceDirect Journal of Computational and Applied Matematics journal omepage: www.elsevier.com/locate/cam Smootness-Increasing

More information

A New Projected Gradient Algorithm for Total Variation Based Image Denoising

A New Projected Gradient Algorithm for Total Variation Based Image Denoising Noname manuscript No. (will be inserted by te editor) A New Projected Gradient Algoritm or Total Variation Based Image Denoising Ming-Jun Lai Leopold Matamba Messi te date o receipt and acceptance sould

More information

Click here to see an animation of the derivative

Click here to see an animation of the derivative Differentiation Massoud Malek Derivative Te concept of derivative is at te core of Calculus; It is a very powerful tool for understanding te beavior of matematical functions. It allows us to optimize functions,

More information

LECTURE 14 NUMERICAL INTEGRATION. Find

LECTURE 14 NUMERICAL INTEGRATION. Find LECTURE 14 NUMERCAL NTEGRATON Find b a fxdx or b a vx ux fx ydy dx Often integration is required. However te form of fx may be suc tat analytical integration would be very difficult or impossible. Use

More information

5 Ordinary Differential Equations: Finite Difference Methods for Boundary Problems

5 Ordinary Differential Equations: Finite Difference Methods for Boundary Problems 5 Ordinary Differential Equations: Finite Difference Metods for Boundary Problems Read sections 10.1, 10.2, 10.4 Review questions 10.1 10.4, 10.8 10.9, 10.13 5.1 Introduction In te previous capters we

More information

A finite element approximation for the quasi-static Maxwell Landau Lifshitz Gilbert equations

A finite element approximation for the quasi-static Maxwell Landau Lifshitz Gilbert equations ANZIAM J. 54 (CTAC2012) pp.c681 C698, 2013 C681 A finite element approximation for te quasi-static Maxwell Landau Lifsitz Gilbert equations Kim-Ngan Le 1 T. Tran 2 (Received 31 October 2012; revised 29

More information

Introduction to Derivatives

Introduction to Derivatives Introduction to Derivatives 5-Minute Review: Instantaneous Rates and Tangent Slope Recall te analogy tat we developed earlier First we saw tat te secant slope of te line troug te two points (a, f (a))

More information

Consider a function f we ll specify which assumptions we need to make about it in a minute. Let us reformulate the integral. 1 f(x) dx.

Consider a function f we ll specify which assumptions we need to make about it in a minute. Let us reformulate the integral. 1 f(x) dx. Capter 2 Integrals as sums and derivatives as differences We now switc to te simplest metods for integrating or differentiating a function from its function samples. A careful study of Taylor expansions

More information

arxiv: v1 [math.na] 11 Apr 2016

arxiv: v1 [math.na] 11 Apr 2016 Hig order approximation to non-smoot multivariate functions Anat Amir David Levin arxiv:164.281v1 [mat.na] 11 Apr 216 April 12, 216 Abstract Approximations of non-smoot multivariate functions return low-order

More information

Practice Problem Solutions: Exam 1

Practice Problem Solutions: Exam 1 Practice Problem Solutions: Exam 1 1. (a) Algebraic Solution: Te largest term in te numerator is 3x 2, wile te largest term in te denominator is 5x 2 3x 2 + 5. Tus lim x 5x 2 2x 3x 2 x 5x 2 = 3 5 Numerical

More information

A = h w (1) Error Analysis Physics 141

A = h w (1) Error Analysis Physics 141 Introduction In all brances of pysical science and engineering one deals constantly wit numbers wic results more or less directly from experimental observations. Experimental observations always ave inaccuracies.

More information

Precalculus Test 2 Practice Questions Page 1. Note: You can expect other types of questions on the test than the ones presented here!

Precalculus Test 2 Practice Questions Page 1. Note: You can expect other types of questions on the test than the ones presented here! Precalculus Test 2 Practice Questions Page Note: You can expect oter types of questions on te test tan te ones presented ere! Questions Example. Find te vertex of te quadratic f(x) = 4x 2 x. Example 2.

More information

Continuity and Differentiability

Continuity and Differentiability Continuity and Dierentiability Tis capter requires a good understanding o its. Te concepts o continuity and dierentiability are more or less obvious etensions o te concept o its. Section - INTRODUCTION

More information

Arbitrary order exactly divergence-free central discontinuous Galerkin methods for ideal MHD equations

Arbitrary order exactly divergence-free central discontinuous Galerkin methods for ideal MHD equations Arbitrary order exactly divergence-free central discontinuous Galerkin metods for ideal MHD equations Fengyan Li, Liwei Xu Department of Matematical Sciences, Rensselaer Polytecnic Institute, Troy, NY

More information

THE IDEA OF DIFFERENTIABILITY FOR FUNCTIONS OF SEVERAL VARIABLES Math 225

THE IDEA OF DIFFERENTIABILITY FOR FUNCTIONS OF SEVERAL VARIABLES Math 225 THE IDEA OF DIFFERENTIABILITY FOR FUNCTIONS OF SEVERAL VARIABLES Mat 225 As we ave seen, te definition of derivative for a Mat 111 function g : R R and for acurveγ : R E n are te same, except for interpretation:

More information

Different Approaches to a Posteriori Error Analysis of the Discontinuous Galerkin Method

Different Approaches to a Posteriori Error Analysis of the Discontinuous Galerkin Method WDS'10 Proceedings of Contributed Papers, Part I, 151 156, 2010. ISBN 978-80-7378-139-2 MATFYZPRESS Different Approaces to a Posteriori Error Analysis of te Discontinuous Galerkin Metod I. Šebestová Carles

More information

ITERATIVE SOLUTION OF A CONSTRAINED TOTAL VARIATION REGULARIZED MODEL PROBLEM

ITERATIVE SOLUTION OF A CONSTRAINED TOTAL VARIATION REGULARIZED MODEL PROBLEM ITERATIVE SOLUTION OF A CONSTRAINED TOTAL VARIATION REGULARIZED MODEL PROBLEM Abstract. Te discretization of a bilaterally constrained total variation minimization problem wit conforming low order finite

More information

arxiv: v2 [math.na] 11 Dec 2016

arxiv: v2 [math.na] 11 Dec 2016 Noname manuscript No. will be inserted by te editor Sallow water equations: Split-form, entropy stable, well-balanced, and positivity preserving numerical metods Hendrik Ranoca arxiv:609.009v [mat.na]

More information

Quaternion Dynamics, Part 1 Functions, Derivatives, and Integrals. Gary D. Simpson. rev 01 Aug 08, 2016.

Quaternion Dynamics, Part 1 Functions, Derivatives, and Integrals. Gary D. Simpson. rev 01 Aug 08, 2016. Quaternion Dynamics, Part 1 Functions, Derivatives, and Integrals Gary D. Simpson gsim1887@aol.com rev 1 Aug 8, 216 Summary Definitions are presented for "quaternion functions" of a quaternion. Polynomial

More information

CS522 - Partial Di erential Equations

CS522 - Partial Di erential Equations CS5 - Partial Di erential Equations Tibor Jánosi April 5, 5 Numerical Di erentiation In principle, di erentiation is a simple operation. Indeed, given a function speci ed as a closed-form formula, its

More information

SECTION 1.10: DIFFERENCE QUOTIENTS LEARNING OBJECTIVES

SECTION 1.10: DIFFERENCE QUOTIENTS LEARNING OBJECTIVES (Section.0: Difference Quotients).0. SECTION.0: DIFFERENCE QUOTIENTS LEARNING OBJECTIVES Define average rate of cange (and average velocity) algebraically and grapically. Be able to identify, construct,

More information

Effect of the Dependent Paths in Linear Hull

Effect of the Dependent Paths in Linear Hull 1 Effect of te Dependent Pats in Linear Hull Zenli Dai, Meiqin Wang, Yue Sun Scool of Matematics, Sandong University, Jinan, 250100, Cina Key Laboratory of Cryptologic Tecnology and Information Security,

More information

A variational approach to a quasi-static droplet model

A variational approach to a quasi-static droplet model A variational approac to a quasi-static droplet model Natalie Grunewald and Inwon Kim Abstract We consider a quasi-static droplet motion based on contact angle dynamics on a planar surface. We derive a

More information

arxiv:math/ v1 [math.ca] 1 Oct 2003

arxiv:math/ v1 [math.ca] 1 Oct 2003 arxiv:mat/0310017v1 [mat.ca] 1 Oct 2003 Cange of Variable for Multi-dimensional Integral 4 Marc 2003 Isidore Fleiscer Abstract Te cange of variable teorem is proved under te sole ypotesis of differentiability

More information

Polynomial Interpolation

Polynomial Interpolation Capter 4 Polynomial Interpolation In tis capter, we consider te important problem of approximatinga function fx, wose values at a set of distinct points x, x, x,, x n are known, by a polynomial P x suc

More information

Math 212-Lecture 9. For a single-variable function z = f(x), the derivative is f (x) = lim h 0

Math 212-Lecture 9. For a single-variable function z = f(x), the derivative is f (x) = lim h 0 3.4: Partial Derivatives Definition Mat 22-Lecture 9 For a single-variable function z = f(x), te derivative is f (x) = lim 0 f(x+) f(x). For a function z = f(x, y) of two variables, to define te derivatives,

More information

AMS 147 Computational Methods and Applications Lecture 09 Copyright by Hongyun Wang, UCSC. Exact value. Effect of round-off error.

AMS 147 Computational Methods and Applications Lecture 09 Copyright by Hongyun Wang, UCSC. Exact value. Effect of round-off error. Lecture 09 Copyrigt by Hongyun Wang, UCSC Recap: Te total error in numerical differentiation fl( f ( x + fl( f ( x E T ( = f ( x Numerical result from a computer Exact value = e + f x+ Discretization error

More information

Analysis of A Continuous Finite Element Method for H(curl, div)-elliptic Interface Problem

Analysis of A Continuous Finite Element Method for H(curl, div)-elliptic Interface Problem Analysis of A Continuous inite Element Metod for Hcurl, div)-elliptic Interface Problem Huoyuan Duan, Ping Lin, and Roger C. E. Tan Abstract In tis paper, we develop a continuous finite element metod for

More information

Quasiperiodic phenomena in the Van der Pol - Mathieu equation

Quasiperiodic phenomena in the Van der Pol - Mathieu equation Quasiperiodic penomena in te Van der Pol - Matieu equation F. Veerman and F. Verulst Department of Matematics, Utrect University P.O. Box 80.010, 3508 TA Utrect Te Neterlands April 8, 009 Abstract Te Van

More information

Average Rate of Change

Average Rate of Change Te Derivative Tis can be tougt of as an attempt to draw a parallel (pysically and metaporically) between a line and a curve, applying te concept of slope to someting tat isn't actually straigt. Te slope

More information

(a) At what number x = a does f have a removable discontinuity? What value f(a) should be assigned to f at x = a in order to make f continuous at a?

(a) At what number x = a does f have a removable discontinuity? What value f(a) should be assigned to f at x = a in order to make f continuous at a? Solutions to Test 1 Fall 016 1pt 1. Te grap of a function f(x) is sown at rigt below. Part I. State te value of eac limit. If a limit is infinite, state weter it is or. If a limit does not exist (but is

More information

f a h f a h h lim lim

f a h f a h h lim lim Te Derivative Te derivative of a function f at a (denoted f a) is f a if tis it exists. An alternative way of defining f a is f a x a fa fa fx fa x a Note tat te tangent line to te grap of f at te point

More information

Computers and Mathematics with Applications. A nonlinear weighted least-squares finite element method for Stokes equations

Computers and Mathematics with Applications. A nonlinear weighted least-squares finite element method for Stokes equations Computers Matematics wit Applications 59 () 5 4 Contents lists available at ScienceDirect Computers Matematics wit Applications journal omepage: www.elsevier.com/locate/camwa A nonlinear weigted least-squares

More information

Numerical Analysis MTH603. dy dt = = (0) , y n+1. We obtain yn. Therefore. and. Copyright Virtual University of Pakistan 1

Numerical Analysis MTH603. dy dt = = (0) , y n+1. We obtain yn. Therefore. and. Copyright Virtual University of Pakistan 1 Numerical Analysis MTH60 PREDICTOR CORRECTOR METHOD Te metods presented so far are called single-step metods, were we ave seen tat te computation of y at t n+ tat is y n+ requires te knowledge of y n only.

More information

Polynomial Interpolation

Polynomial Interpolation Capter 4 Polynomial Interpolation In tis capter, we consider te important problem of approximating a function f(x, wose values at a set of distinct points x, x, x 2,,x n are known, by a polynomial P (x

More information

Basic Nonparametric Estimation Spring 2002

Basic Nonparametric Estimation Spring 2002 Basic Nonparametric Estimation Spring 2002 Te following topics are covered today: Basic Nonparametric Regression. Tere are four books tat you can find reference: Silverman986, Wand and Jones995, Hardle990,

More information

arxiv: v1 [math.na] 12 Mar 2018

arxiv: v1 [math.na] 12 Mar 2018 ON PRESSURE ESTIMATES FOR THE NAVIER-STOKES EQUATIONS J A FIORDILINO arxiv:180304366v1 [matna 12 Mar 2018 Abstract Tis paper presents a simple, general tecnique to prove finite element metod (FEM) pressure

More information

Section 2.7 Derivatives and Rates of Change Part II Section 2.8 The Derivative as a Function. at the point a, to be. = at time t = a is

Section 2.7 Derivatives and Rates of Change Part II Section 2.8 The Derivative as a Function. at the point a, to be. = at time t = a is Mat 180 www.timetodare.com Section.7 Derivatives and Rates of Cange Part II Section.8 Te Derivative as a Function Derivatives ( ) In te previous section we defined te slope of te tangent to a curve wit

More information

Decay of solutions of wave equations with memory

Decay of solutions of wave equations with memory Proceedings of te 14t International Conference on Computational and Matematical Metods in Science and Engineering, CMMSE 14 3 7July, 14. Decay of solutions of wave equations wit memory J. A. Ferreira 1,

More information