arxiv: v1 [math.na] 28 Jan 2009

Transcription

1 The Dynamical Systems Method for solving nonlinear equations with monotone operators arxiv: v1 [math.na] 28 Jan 2009 N. S. Hoang and A. G. Ramm Mathematics Department, Kansas State University, Manhattan, KS , USA Abstract A review of the authors s results is given. Several methods are discussed for solving nonlinear equations F(u) = f, where F is a monotone operatorin a Hilbert space, and noisy data are given in place of the exact data. A discrepancy principle for solving the equation is formulated and justified. Various versions of the Dynamical Systems Method (DSM) for solving the equation are formulated. These methods consist of a regularized Newton-type method, a gradient-type method, and a simple iteration method. A priori and a posteriori choices of stopping rules for these methods are proposed and justified. Convergence of the solutions, obtained by these methods, to the minimal norm solution to the equation F(u) = f is proved. Iterative schemes with a posteriori choices of stopping rule corresponding to the proposed DSM are formulated. Convergence of these iterative schemes to a solution to equation F(u) = f is justified. New nonlinear differential inequalities are derived and applied to a study of large-time behavior of solutions to evolution equations. Discrete versions of these inequalities are established. MSC: 47H05, 47J05, 47N20, 65J20, 65M30. Keywords. ill-posed problems, nonlinear operator equations, monotone operators, nonlinear inequalities. 1 Introduction Consider equation F(u) = f, (1) where F is an operator in a Hilbert space H. Throughout this paper we assume that F is a monotone continuous operator. Monotonicity is understood as follows: F(u) F(v),u v 0, u,v H. (2) We assume that equation (1) has a solution, possibly non-unique. Assume that f is not known but f, the noisy data, f f, are known. Corresponding author. ramm@math.ksu.edu nguyenhs@math.ksu.edu 1

2 There are many practically important problems which are ill-posed in the sense of J.Hadamard. Problem (1) is well-posed in the sense of Hadamard if and only if(=iff) F is injective, surjective, and the inverse operator F 1 is continuous. To solve ill-posed problem (1), one has to use regularization methods rather than the classical Newton s or Newton-Kantorovich s methods. Regularization methods for stable solution of linear illposed problems have been studied extensively (see [11], [13], [35] and references therein). Among regularization methods, the Variational Regularization (VR) is one of the frequently used methods. When F = A, where A is a linear operator, the VR method consists of minimizing the following functional: Au f 2 +α u 2 min. (3) The minimizer u,a of problem (3) can be found from the Euler equation: (A A+αI)u,α = A f. In the VR method the choice of the regularization parameter α is important. Various choices of the regularization parameter have been proposed and justified. Among these, the discrepancy principle (DP) appears to be the most efficient in practice (see [11]). According to the DP one chooses α as the solution to the following equation: Au,α f = C, 1 < C = const. (4) When the operator F is nonlinear, the theory is less complete (see [2], [34]). In this case, one may try to minimize the functional F(u) f 2 +α u 2 min. (5) as in the case of linear operator F. The minimizer to problem (5) solves the following Euler equation F (u,α ) F(u,α )+αu,α = F (u,α ) f. (6) However, there are several principal difficulties in nonlinear problems: there are no general results concerning the solvability of (6), and the notion of minimal-norm solution does not make sense, in general, when F is nonlinear. Other methods for solving (1) with nonlinear F have been studied. Convergence proofs of these methods often rely on the source-type assumptions. These assumptions are difficult to verify in practice and they may not hold. Equation (1) with a monotone operator F is of interest and importance in many applications. Every solvable linear operator equation Au = f can be reduced to solving operator equation with a monotone operator A A. For equations with a boundedoperator A this is a simple fact, and for unbounded, closed, densely defined linear operators A it is proved in [26], [28], [29], [13]. Physical problems with dissipation of energy often can be reduced to solving equations with monotone operators[32]. For simplicity we present the results for equations in Hilbert space, but some results can be generalized to the operators in Banach spaces. When F is monotone then the notion minimal-norm solution makes sense (see, e.g., [13, p. 110]). In [33], Tautenhahn studied a discrepancy principle for solving equation (1). The discrepancy principle in [33] requires solving for α the following equation: (F (u,α )+αi) 1 (F(u,α ) f ) = C, 1 < C = const, (7) 2

3 where u,α solves the equation: F(u,α )+αu,α = f. For this discrepancy principle optimal rate of convergence is obtained in [33]. However, the convergence of the method is justified under source-type assumptions and other restrictive assumptions. These assumptions often do not hold and some of them cannot be verified, in general. In addition, equation (7) is difficult to solve numerically. A continuous analog of the Newton method for solving well-posed operator equations was proposed in [3], in In [1], [4] [31], and in the monograph [13] the Dynamical Systems Method for solving operator equations is studied systematically. The DSM consists of finding a nonlinear map Φ(t,u) such that the Cauchy problem u = Φ(t,u), u(0) = u 0, (8) has a unique solution for all t 0, there exists lim t u(t) := u( ), and F(u( )) = f,! u(t) t 0; u( ); F(u( )) = f. (9) Various choices of Φ were proposedin [13] for (9) to hold. Each such choice yields a version of the DSM. In this paper, several methods developed by the authors for solving stably equation (1) with a monotone operator F in a Hilbert space and noisy data f, given in place of the exact data f, are presented. A discrepancy principle (DP) is formulated for solving stably equation (1) is formulated and justified. In this DP the only assumptions on F are the continuity and monotonicity. Thus, our result is quite general and can be applied for a wide range of problems. Several versions of the Dynamical Systems Method (DSM) for solving equation (1) are formulated. These versions of the DSM are Newton-type method, gradient-type method and a simple iterations method. A priori and a posteriori choices of stopping rules for several versions of the DSM and for the corresponding iterative schemes are proposed and justified. Convergence of the solutions of these versions of the DSM to the minimal-norm solution to the equation F(u) = f is proved. Iterative schemes, corresponding to the proposed versions of the DSM, are formulated. Convergence of these iterative schemes to a solution to equation F(u) = f is established. When one uses these iterative schemes one does not have to solve a nonlinear equation for the regularization parameter. The stopping time is chosen automatically in the course of calculations. Implementation of these methods is illustrated in Section 6 by a numerical experiment. In Sections 2 and 3 basic and auxiliary results are formulated, in Section 4 proofs are given, in Section 5 ideas of application of the basic nonlinear inequality (94) are outlined. 2 Basic results 2.1 A discrepancy principle Let us consider the following equation F(V,a )+av,a f = 0, a > 0, (10) 3

4 where a = const. It is known (see, e.g., [13, p.111]) that equation (10) with a monotone continuous operator F has a unique solution for any f H. Assume that equation (1) has a solution. It is known that the set of solution N := {u : F(u) = f} is convex and closed if F is monotone and continuous (see, e.g., [13], p.110). A closed and convex set N in H has a unique minimal-norm element. This minimal-norm solution to (1) is denoted by y. Theorem 1 Let γ (0,1] and C > 0 be some constants such that C γ >. Assume that F(0) f > C γ. Let y be the minimal-norm solution to equation (1). Then there exists a unique a() > 0 such that F(V,a() ) f = C γ, (11) where V,a() solves (4) with a = a(). If 0 < γ < 1 then lim V,a() y = 0. (12) Instead of using (10), one may use the following equation: F(V,a )+a(v,a ū) f = 0, a > 0, (13) where ū is an element of H. Denote F 1 (u) := F(u + ū). Then F 1 is monotone and continuous. Equation (13) can be written as: F 1 (U,a )+au,a f = 0, U,a := V,a ū, a > 0. (14) Applying Theorem 1 with F = F 1 one gets the following result: Corollary 2 Let γ (0,1] and C > 0 be some constants such that C γ >. Let ū H and z be the solution to (1) with minimal distance to ū. Assume that F(ū) f > C γ. Then there exists a unique a() > 0 such that where Ṽ,a() solves the following equation: If γ (0,1) then this a() satisfies F(Ṽ,a()) f = C γ, (15) F(Ṽ,a)+a()(Ṽ,a ū) f = 0. (16) lim Ṽ,a() z = 0. (17) The following result is useful for the implementation of our DP. Theorem 3 Let,F,f, and y be as in Theorem 1 and 0 < γ < 1. Assume that v H and α() > 0 satisfy the following conditions: F(v )+α()v f θ, θ > 0, (18) and Then one has: C 1 γ F(v ) f C 2 γ, 0 < C 1 < C 2. (19) lim v y = 0. (20) 4

5 Remark 1 Based on Theorem 3 an algorithm for solving nonlinear equations with monotone Lipchitz continuous operators is outlined in [9]. Remark 2 It is an open problem to choose γ and C optimal in some sense. Remark 3 Theorem 1 and Theorem 3 do not hold, in general, for γ = 1. Indeed, let Fu = u,p p, p = 1, p N(F) := {u H : Fu = 0}, f = p, f = p + q, where p,q = 0, q = 1, Fq = 0, q =. One has Fy = p, where y = p, is the minimal-norm solution to the equation Fu = p. Equation Fu + au = p + q, has the unique solution V,a = q/a + p/(1 + a). Equation (11) is C = q + (ap)/(1 + a). This equation yields a = a() = c/(1 c), where c := (C 2 1) 1/2, and we assume c < 1. Thus, lim V,a() = p+c 1 q := v, and Fv = p. Therefore v = lim V,a() is not p, i.e., is not the minimal-norm solution to the equation Fu = p. This argument is borrowed from [12, p. 29]. If equation (1) has a unique solution and γ = 1, then one can prove convergence (12) and (20). 2.2 The Dynamical Systems Method Let a(t) ց 0 be a positive and strictly decreasing sequence. Let V (t) solve the following equation: F(V (t))+a(t)v (t) f = 0. (21) Throughout the paper we assume that equation F(u) = f has a solution in H, possibly nonunique, and y is the minimal-norm solution to this equation. Let f be unknown but f be given, f f The Newton-type DSM Denote A := F (u (t)), A a := A+aI, (22) where I is the identity operator, and u (t) solves the following Cauchy problem: u = A 1 a(t) [F(u )+a(t)u f ], u (0) = u 0. (23) We assume below that F(u 0 ) f > C 1 ζ, where C 1 > 1 and ζ (0,1] are some constants. We also assumewithout loss of generality that (0,1). Assumethat equation (1) has a solution, possibly nonunique, and y is the minimal norm solution to equation (1). Recall that we are given the noisy data f, f f. We assume in addition that F (j) (u) M j (R,u 0 ), u B(u 0,R), 0 j 2. (24) This assumption is satisfied in many applications. 5

6 Lemma 4 ([6] Lemma 2.7) Suppose M 1,c 0, and c 1 are positive constants and 0 y H. Then there exist > 0 and a function a(t) C 1 [0, ), 0 < a(t) ց 0, such that the following conditions hold M 1, (25) y c 0 a(t) [ 1 ȧ(t) ], (26) 2a(t) a(t) ȧ(t) c 1 a(t) a(t) [ 1 ȧ(t) ], (27) 2 a(t) F(0) f a2 (0). (28) In the proof of Lemma 2.7 in [6] we have demonstrated that conditions (26) (28) are satisfied for a(t) = d, where b (0,1], c,d > 0 are constants, c > 6b, and d is (c+t) b sufficiently large. Theorem 5 Assume a(t) = d (c+t) b, where b (0,1], c,d > 0 are constants, c > 6b, and d is sufficiently large so that conditions (26) (28) hold. Assume that F : H H is a monotone operator, (24) holds, u 0 is an element of H, satisfying inequalities u 0 V 0 F(0) f, h(0) = F(u 0 )+a(0)u 0 f 1 a(0) 4 a(0) V (0). (29) Then the solution u (t) to problem (23) exists on an interval [0,T ], lim T =, and there exists a unique t, t (0,T ) such that lim t = and F(u (t )) f = C 1 ζ, F(u (t) f > C 1 ζ, t [0,t ), (30) where C 1 > 1 and 0 < ζ 1. If ζ (0,1) and t satisfies (30), then lim u (t ) y = 0. (31) Remark 4 One can choose u 0 satisfying inequalities (29) (see also (199)). Indeed, if u 0 is a sufficiently close approximation to V (0) the solution to equation (21) then inequalities (29) are satisfied. Note that the second inequality in (29) is a sufficient condition for (201), i.e., e t 2 h(0) 1 4 a(t) V (0) 1 4 a(t) V (t), t 0, (32) to hold. In our proof inequality (32) (or inequality (201)) is used at t = t. The stopping time t is often sufficiently large for the quantity e t 2 h 0 to besmall. Inthis case inequality (32) with t = t is satisfied for a wide range of u 0. Condition c > 6b is used in the proof of Lemma 27. 6

7 2.2.2 The Dynamical system gradient method Denote A := F (u (t)), A a := A+aI, a = a(t), where I is the identity operator, and u (t) solves the following Cauchy problem: Again, we assume in addition that u = A a(t) [F(u )+a(t)u f ], u (0) = u 0. (33) F (j) (u) M j (R,u 0 ), u B(u 0,R), 0 j 2. (34) This assumption is satisfied in many applications. Let us recall the following result: Lemma 6 ([7] Lemma 11) Suppose M 1,c 0, and c 1 are positive constants and 0 y H. Then there exist > 0 and a function a(t) C 1 [0, ), 0 < a(t) ց 0, such that and the following conditions hold M 1 y c 0 (M 1 +a(t)) 2a 2 (t) ȧ(t) a3 (t) 4, (35), (36) [ a 2 (t) 2 ȧ(t) ], (37) a(t) [ a 2 (t) 2 ȧ(t) a(t) ], (38) ȧ(t) c 1 a(t) a2 (t) 2 a 2 g(0) < 1. (39) (0) We have demonstrated in the proof of Lemma 11 in [7] that conditions (35) (39) are satisfied with a(t) = d, where b (0, 1 (c+t) b 4 ], c 1, and d > 0 are constants, and d is sufficiently large. Theorem 7 Let a(t) satisfy conditions (35) (39) of Lemma 6. For example, one can choose a(t) = d, where b (0, 1 (c+t) b 4 ], c 1, and d > 0 are constants, and d is sufficiently large. Assume that F : H H is a monotone operator, (34) holds, u 0 is an element of H, satisfying inequalities h(0) = F(u 0 )+a(0)u 0 f 1 4 a(0) V (0), (40) Then the solution u (t) to problem (33) exists on an interval [0,T ], lim T =, and there exists t, t (0,T ), not necessarily unique, such that F(u (t )) f = C 1 ζ, lim t =, (41) where C 1 > 1 and 0 < ζ 1 are constants. If ζ (0,1) and t satisfies (41), then lim u (t ) y = 0. (42) 7

8 Remark 5 One can easily choose u 0 satisfying inequality (40). Note that inequality (40) is a sufficient condition for inequality (243), i.e., e t 2 h(0) 1 4 a(t) V (0) 1 4 a(t) V (t), t 0, (43) to hold. In our proof inequality (243) (or (43)) is used at t = t. The stopping time t is often sufficiently large for the quantity e ϕ(t ) h 0 to be small. In this case inequality (43) (or (243)) with t = t is satisfied for a wide range of u 0. The parameter ζ is not fixed in (41). While we could fix it, for example, by setting ζ = 0.9, it is an interesting open problem to propose an optimal in some sense criterion for choosing ζ The simple iteration DSM Let us consider a version of the DSM for solving equation (1): u = ( F(u )+a(t)u f ), u (0) = u 0, (44) where F is a monotone operator. The advantage of this version compared with (23) is the absence of the inverse operator in the algorithm, which makes the algorithm (44) less expensive than (23). On the other hand, algorithm (23) converges faster than (44) in many cases. The algorithm (44) is cheaper than the DSM gradient algorithm proposed in (33). The advantage of method (44), a modified version of the simple iteration method, over the Gauss-Newton method and the version (23) of the DSM is the following: neither inversion of matrices nor evaluation of F is needed in a discretized version of (44). Although the convergence rate of the DSM (44) maybe slower than that of the DSM (23), the DSM (44) might be faster than the DSM (23) for large-scale systems due to its lower computation cost. In this Section we investigate a stopping rule based on a discrepancy principle (DP) for the DSM (44). The main results of this Section is Theorem 9 in which a DP is formulated, the existence of a stopping time t is proved, and the convergence of the DSM with the proposed DP is justified under some natural assumptions. Let us assume that sup F (u) M 1 (u 0,R). (45) u B(u 0,R) Lemma 8 ([8] Lemma 11) Suppose M 1 and c 1 are positive constants and 0 y H. Then there exist a number > 0 and a function a(t) C 1 [0, ), 0 < a(t) ց 0, such that ȧ(t) a2 (t) 2, (46) 8

9 and the following conditions hold M 1, (47) y 0 [ a(t) ȧ(t) ], (48) 2a(t) a(t) ȧ(t) c 1 a(t) a(t) [ a(t) ȧ(t) ], (49) 2 a(t) g(0) < 1. (50) a(0) It is shown in the proof of Lemma 11 in [8] that conditions (46) (50) hold for the function a(t) = d, where b (0, 1 (c+t) b 2 ], c 1 and d > 0 are constants, and d is sufficiently large. Theorem 9 Let a(t) satisfy conditions (46) (50) in Lemma 8. For example, one can choose a(t) = d, where b (0, 1 (c+t) b 2 ], c 1 and d > 0 are constants, and d is sufficiently large. Assume that F : H H is a monotone operator, condition (45) holds, and u 0 is an element of H, satisfying inequality h(0) = F(u 0 )+a(0)u 0 f 1 4 a(0) V (0), (51) Assume that equation F(u) = f has a solution y B(u 0,R), possibly nonunique, and y is the minimal-norm solution to this equation. Then the solution u (t) to problem (44) exists on an interval [0,T ], lim T =, and there exists t, t (0,T ), not necessarily unique, such that F(u (t )) f = C 1 ζ, limt =, (52) where C 1 > 1 and 0 < ζ 1 are constants. If ζ (0,1) and t satisfies (52), then lim u (t ) y = 0. (53) Remark 6 One can easily choose u 0 satisfying inequality (51) (see also (278)). Again, inequality (51) is a sufficient condition for (43) (or (282)) to hold. In our proof inequality (43) is used at t = t. The stopping time t is often sufficiently large for the quantity e ϕ(t ) h 0 to be small. In this case inequality (43) with t = t is satisfied for a wide range of u Iterative schemes Let 0 < a n ց 0 be a positive strictly decreasing sequence. Denote V n := V n, where V n, solves the following equation: Note that if a n := a(t n ) then V n, = V (t n ). F(V n, )+a n V n, f = 0. (54) 9

10 2.3.1 Iterative scheme of Newton-type In this section we assume that F is monotone operator, twice Fréchet differentiable, and F (j) (u) M j (R,u 0 ), u B(u 0,R), 0 j 2. (55) Consider the following iterative scheme: u n+1 = u n A 1 n [F(u n )+a n u n f ], A n := F (u n )+a n I, u 0 = u 0, (56) whereu 0 ischosensothatinequality (62)holds. NotethatF (u n ) 0sinceF ismonotone. Thus, A 1 n 1 a n. Lemma 10 ([5] Lemma 2.5) Suppose M 1,c 0, and c 1 are positive constants and 0 y H. Then there exist > 0 and a sequence 0 < (a n ) n=0 ց 0 such that the following conditions hold a n 2a n+1, (57) f F(0) a2 0, (58) M 1 y, (59) a n a n+1 a 2 1 n+1 2c 1, (60) c 0 a n 2 + a n a n+1 a n+1 c 1 a n+1. (61) It is shown in the proof of Lemma 2.5 in [5] that conditions (57) (61) hold for the sequence a n = d 0 (d+n) b, where d 1, 0 < b 1, and d 0 is sufficiently large. Remark 7 In Lemmas 10 14, one can choose a 0 and so that a 0 is uniformly bounded as 0 even if M 1 (R) as R at an arbitrary fast rate. Choices of a 0 and to satisfy this condition are discussed in [5], [7] and [8]. Let a n and satisfy conditions (57) (61). Assume that equation F(u) = f has a solution y B(u 0,R), possibly nonunique, and y is the minimal-norm solution to this equation. Let f be unknown but f be given, and f f. We have the following result: Theorem 11 Assume a n = d 0 (d+n) b where d 1, 0 < b 1, and d 0 is sufficiently large so that conditions (57) (61) hold. Let u n be defined by (56). Assume that u 0 is chosen so that F(u 0 ) f > C 1 γ > and g 0 := u 0 V 0 F(0) f a 0. (62) Then there exists a unique n, depending on C 1 and γ (see below), such that F(u n ) f C 1 γ, C 1 γ < F(u n ) f, n < n, (63) 10

11 where C 1 > 1, 0 < γ 1. Let 0 < ( m ) m=1 be a sequence such that m 0. If N is a cluster point of the sequence n m satisfying (63), then where u is a solution to the equation F(u) = f. If and γ (0,1), then lim u n m m = u, (64) lim n m m =, (65) lim u n m m y = 0. (66) Note that by Remark 8, inequality (62) is satisfied with u 0 = An iterative scheme of gradient-type In this section we assume that F is monotone operator, twice Fréchet differentiable, and F (j) (u) M j (R,u 0 ), u B(u 0,R), 0 j 2. (67) Consider the following iterative scheme: u n+1 = u n α n A n [F(u n)+a n u n f ], A n := F (u n )+a n I, u 0 = u 0, (68) where u 0 is chosen so that inequality (76) holds, and {α n } n=1 is a positive sequence such that 2 0 < α α n a 2 n +(M 1 +a n ) 2, A n M 1 +a n. (69) It follows from this condition that 1 α n A a n A an = Note that F (u n ) 0 since F is monotone. sup a 2 n (M 1+a n) 2 1 α n 1 α n a 2 n. (70) Lemma 12 ([7] Lemma 12) Suppose M 1,c 0,c 1 and α are positive constants and 0 y H. Then there exist > 0 and a sequence 0 < (a n ) n=0 ց 0 such that the following conditions hold a n 2, (71) a n+1 f F(0) a3 0, (72) M 1 y, (73) c 0 (M 1 +a 0 ) 1 2, (74) a 2 n αa4 n 2 + a n a n+1 c 1 a2 n+1 a n+1. (75) 11

12 It is shown in the proof of Lemma 12 in [7] that the sequence satisfying conditions d (71) (75) can be chosen of the form a n =, where c 1, 0 < b 1 (c+n) b 4, and d is sufficiently large. Assume that equation F(u) = f has a solution in B(u 0,R), possibly nonunique, and y is the minimal-norm solution to this equation. Let f be unknown but f be given, and f f. We prove the following result: Theorem 13 Assume a n = d where c 1, 0 < b 1 (c+n) b 4, and d is sufficiently large so that conditions (71) (75) hold. Let u n be defined by (68). Assume that u 0 is chosen so that F(u 0 ) f > C 1 γ > and Then there exists a unique n such that g 0 := u 0 V 0 F(0) f a 0. (76) F(u n ) f C 1 ζ, C 1 ζ < F(u n ) f, n < n, (77) where C 1 > 1, 0 < ζ 1. Let 0 < ( m ) m=1 be a sequence such that m 0. If the sequence {n m := n m } m=1 is bounded, and {n mj } j=1 is a convergent subsequence, then where ũ is a solution to the equation F(u) = f. If and ζ (0,1), then lim u n mj = ũ, (78) j lim n m =, (79) m lim m u n m y = 0. (80) It is pointed out in Remark 8 that inequality (76) is satisfied with u 0 = A simple iteration method In this section we assume that F is monotone operator, Fréchet differentiable. Consider the following iterative scheme: u n+1 = u n α n [F(u n )+a n u n f ], u 0 = u 0, (81) where u 0 is chosen so that inequality (88) holds, and {α n } n=1 is a positive sequence such that 2 0 < α α n a n +(M 1 +a n ), M 1(u 0,R) = sup F (u). (82) u B(u 0,R) It follows from this condition that 1 α n (J n +a n ) = sup a n M 1 +a n 1 α n 1 α n a n. (83) Here, J n is an operator in H such that J n 0 and J n M 1, u B(u 0,R). A specific choice of J n is made in formula (336) below. 12

13 Lemma 14 ([8] Lemma 12) Suppose M 1, c 1 and α are positive constants and 0 y H. Then there exist a number > 0 and a sequence 0 < (a n ) n=0 ց 0 such that the following conditions hold a n a n+1 2, (84) f F(0) a2 0, (85) M 1 y, (86) a n αa2 n + a n a n+1 c 1 a n+1 a n+1. (87) It is shown in the proof of Lemma 12 in [8] that conditions (84) (87) hold for the sequence a n = d, where c 1, 0 < b 1 (c+n) b 2, and d is sufficiently large. Let a n and satisfy conditions (84) (87). Assume that equation F(u) = f has a solution y B(u 0,R), possibly nonunique, and y is the minimal-norm solution to this equation. Let f be unknown but f be given, and f f. We prove the following result: Theorem 15 Assume a n = d where c 1, 0 < b 1 (c+n) b 2, and d is sufficiently large so that conditions (84) (87) hold. Let u n be defined by (81). Assume that u 0 is chosen so that F(u 0 ) f > C 1 γ > and Then there exists a unique n such that g 0 := u 0 V 0 F(0) f a 0. (88) F(u n ) f C 1 ζ, C 1 ζ < F(u n ) f, n < n, (89) where C 1 > 1, 0 < ζ 1. Let 0 < ( m ) m=1 be a sequence such that m 0. If the sequence {n m := n m } m=1 is bounded, and {n mj } j=1 is a convergent subsequence, then where ũ is a solution to the equation F(u) = f. If lim u n mj = ũ, (90) j lim n m =, (91) m and ζ (0,1), then lim m u n m y = 0. (92) According to Remark 8, inequality (88) is satisfied with u 0 = 0. 13

14 2.4 Nonlinear inequalities A nonlinear differential inequality In [13] the following differential inequality ġ(t) γ(t)g(t)+α(t)g 2 (t)+β(t), t τ 0, (93) was studied and applied to various evolution problems. In (93) α(t), β(t), γ(t) and g(t) are continuous nonnegative functions on [τ 0, ) where τ 0 is a fixed number. In [13], an upper bound for g(t) is obtained under some conditions on α,β,γ. In [10] the following generalization of (93): is studied. We have the following result: ġ(t) γ(t)g(t)+α(t)g p (t)+β(t), t τ 0, p > 1, (94) Theorem 16 ([10] Theorem 1) Let α(t),β(t) and γ(t) be continuous functions on [τ 0, ) and α(t) > 0, t τ 0. Suppose there exists a function µ(t) > 0, µ C 1 [τ 0, ), such that α(t) µ p (t) +β(t) 1 [ γ µ(t) ]. (95) µ(t) µ(t) Let g(t) 0 be a solution to inequality (94) such that Then g(t) exists globally and the following estimate holds: Consequently, if lim t µ(t) =, then When p = 2 we have the following corollary: µ(τ 0 )g(τ 0 ) < 1. (96) 0 g(t) < 1 µ(t), t τ 0. (97) lim g(t) = 0. (98) t Corollary 17 ([13] p. 97) If there exists a monotonically growing function µ(t), µ C 1 [τ 0, ), µ > 0, lim t µ(t) =, such that 0 α(t) µ(t) [ 2 β(t) 1 2µ(t) γ µ(t) ], u := du µ(t) dt, (99) [ γ µ(t) ], (100) µ(t) µ(τ 0 )g(τ 0 ) < 1, (101) 14

15 where α(t),β(t),γ(t) and g(t) are continuous nonnegative functions on [τ 0, ), τ 0 0, and g(t) satisfies (93), then the following estimate holds: 0 g(t) < 1 µ(t), t τ 0. (102) If inequalities (99) (101) hold on an interval [τ 0,T), then g(t) exists on this interval and inequality (102) holds on [τ 0,T) A discrete version of the nonlinear inequality Theorem 18 ([10] Theorem 4) Let α n,γ n and g n be nonnegative sequences of numbers, and the following inequality holds: or, equivalently, g n+1 g n h n γ n g n +α n g p n +β n, h n > 0, 0 < h n γ n < 1, (103) g n+1 g n (1 h n γ n )+α n h n g p n +h nβ n, h n > 0, 0 < h n γ n < 1. (104) If there is a monotonically growing sequence of positive numbers (µ n ) n=1, such that the following conditions hold: α n µ p +β n 1 ( γ n µ ) n+1 µ n, (105) n µ n µ n h n then Therefore, if lim n µ n =, then lim n g n = 0. 3 Auxiliary results g 0 1 µ 0, (106) 0 g n 1 µ n n 0. (107) 3.1 Auxiliary results from the theory of monotone operators Recall the following result (see e.g. [13, p.112]): Lemma 19 Assume that equation (1) is solvable, y is its minimal-norm solution, assumption (2) holds, and F is continuous. Then where V a := V 0,a solves equation (10) with = 0. lim V a y = 0, (108) a 0 15

16 3.2 Auxiliary results for the regularized equation Lemma 20 ([9] Lemma 2) Assume F(0) f > 0. Let a > 0, and F be monotone. Denote ψ(a) := V,a, φ(a) := aψ(a) = F(V,a ) f, where V,a solves (10). Then ψ(a) is decreasing, and φ(a) is increasing (in the strict sense). Lemma 21 ([9] Lemma 3) If F is monotone and continuous, then V,a = O( 1 a ) as a, and lim F(V,a) f = F(0) f. (109) a Lemma 22 ([9] Lemma 4) Let C > 0 and γ (0,1] be constants such that C γ >. Suppose that F(0) f > C γ. Then, there exists a unique a() > 0 such that F(V,a() ) f = C γ. Lemma 23 If F is monotone then ( ) max F(u ) F(V ),a u v F(u) F(v)+a(u v), u,v H. (110) Proof. Denote w := F(u) F(v)+a(u v), h := w. (111) Since F(u) F(v),u v 0, one obtains from two equations and w,u v = F(u) F(v)+a(u v),u v, (112) w,f(u) F(v) = F(u) F(v) 2 +a u v,f(u) F(v), (113) the following two inequalities: and a u v 2 v,u v u v h, (114) F(u) F(v) 2 v,f(u) F(v) h F(u) F(v). (115) Inequalities (114) and (115) imply: Lemma 23 is proved. Lemma 24 Let t 0 satisfy Then, and a u v h, F(u) F(v) h. (116) a(t 0 ) = 1 y, C > 1. (117) C 1 F(u(t 0 )) f C, (118) V ȧ ( a y 1+ 1 ), t t 0. (119) C 1 16

17 Proof. This t 0 exists and is unique since a(t) > 0 monotonically decays to 0 as t. Since a(t) > 0 monotonically decays, one has: By Lemma 22 there exists t 1 such that a(t) 1 C 1 y, 0 t t 0. (120) F(V (t 1 )) f = C, F(V (t 1 ))+a(t 1 )V (t 1 ) f = 0. (121) We claim that t 1 [0,t 0 ]. Indeed, from (121) and (137) one gets ( C = a(t 1 ) V (t 1 ) a(t 1 ) y + ) = a(t 1 ) y +, C > 1, a(t 1 ) so Thus, a(t 1) y C 1. a(t 1 ) y C 1 = a(t 0 ). Since a(t) ց 0, one has t 1 t 0. Differentiating both sides of (21) with respect to t, one obtains This and the relations A a(t) V = ȧv. A a := F (u)+ai, F (u) := A 0, imply V ȧ A 1 a(t) V ȧ a V ȧ ( y + ) ȧ ( a a a y 1+ 1 ), t t 0. (122) C 1 Lemma 24 is proved. Lemma 25 Let n 0 satisfy the inequality: Then, and a n0 +1 > 1 C 1 y a n0, C > 1. (123) F(u n0 +1) f C, (124) ( V n y 1+ 2 ), (125) C 1 V n V n+1 a ( n a n+1 y 1+ 2 ), n n (126) a n+1 C 1 17

18 Proof. One has a n a n+1 2, n 0. This and inequality (123) imply 2 2 y > C 1 a n0 a n0 +1 > 1 C 1 y a n0, C > 1. (127) Thus, 2 C 1 y >, n n (128) a n The number n 0, satisfying (123), exists and is unique since a n > 0 monotonically decays to 0 as n. By Lemma 22, there exists a number n 1 such that F(V n1 +1) f C < F(V n1 ) f, (129) where V n solves the equation F(V n )+a n V n f = 0. We claim that n 1 [0,n 0 ]. Indeed, one has F(V n1 ) f = a n1 V n1, and V n1 y + a n1 (cf. (137)), so ( C < a n1 V n1 a n1 y + ) = a n1 y +, C > 1. (130) a n1 Therefore, < a n 1 y C 1. (131) Thus, by (130), < y a n1 C 1 <. (132) a n0 +1 Here the last inequality is a consequence of (130). Since a n decreases monotonically, inequality (132) implies n 1 n 0. This and Lemma 20 implies One has F(u n0 +1) f F(u n1 +1) f C. (133) a n+1 V n V n+1 2 = (a n+1 a n )V n F(V n )+F(V n+1 ),V n V n+1 (a n+1 a n )V n,v n V n+1 (a n a n+1 ) V n V n V n+1. By (137), V n y + a n, and, by (128), (125). Therefore, V n V n+1 a n a n+1 V n a n a n+1 a n+1 Lemma 25 is proved. a n+1 a n 2 y (134) C 1 for all n n This implies ( y 1+ 2 ), n n (135) C 1 Lemma 26 Let V a := V,a =0, so F(V a ) + av f = 0. Let y be the minimal-norm solution to equation (1). Then V,a V a a, V a y, a > 0, (136) and V,a V a + a y +, a > 0. (137) a 18

19 Proof. From (4) one gets F(V,a ) F(V a )+a(v,a V a ) = f f. Multiply this equality by (V,a V a ) and use (2) to obtain V,a V a f f,v,a V a = F(V,a ) F(V a )+a(v,a V a ),V,a V a ) a V,a V a 2. This implies the first inequality in (136). Let us derive a uniform with respect to a bound on V a. From the equation and the monotonicity of F one gets This implies the desired bound: F(V a )+av a F(y) = 0, 0 = F(V a )+av a F(y),V a y a V a,v a y. V a y, a > 0. (138) Similar arguments one can find in [13, p. 113]. Inequalities (137) follow from (136) and (138) and the triangle inequality. Lemma 26 is proved. Lemma 27 ([6] Lemma 2.11) Let a(t) = d (c+t) b where d,c,b > 0, c 6b. One has e t 2 t 0 e s 2 ȧ(s) V (s) ds 1 2 a(t) V (t), t 0. (139) Lemma 28 ([7] Lemma 9) Let a(t) = d where b (0, 1 (c+t) b 4 ], d2 c 1 2b 6b. Define ϕ(t) = 1 a 2 (s) 2 2 ds. Then, one has t 0 t 0 t e ϕ(t) e ϕ(t) ȧ(s) V (s) ds 1 2 a(t) V (t). (140) 0 Lemma 29 ([8] Lemma 9) Let a(t) = d where b (0, 1 (c+t) b 2 ], dc1 b 6b. Define ϕ(t) = 1 a(s) 2 2 ds. Then, one has t e ϕ(t) e ϕ(t) ȧ(s) V (s) ds 1 2 a(t) V (t). (141) 0 19

20 Remark 8 In theorems we choose u 0 H such that g 0 := u 0 V 0 F(0) f a 0. (142) It is easy to choose u 0 satisfying this condition. Indeed, if, for example, u 0 = 0, then by Lemma 20 one gets g 0 = V 0 = a 0 V 0 a 0 If (142) and either (58) or (85) hold then This inequality is used in the proof of Theorem 11 and 15. If (142) and (72) hold, then F(0) f a 0. (143) g 0 a 0. (144) g 0 a2 0. (145) This inequality is used in the proof of Theorem Proofs of the basic results 4.1 Proofs of the Discrepancy Principles Proof of Theorem 1 Proof. [Proof of Theorem 1] The existence and uniqueness of a() follow from Lemma 22. Let us show that lima() = 0. (146) The triangle inequality, the first inequality in (136), equality (11) and equality (10) imply a() V a() a() ( V,a() V a() + V,a() ) From inequality (147), one gets +a() V,a() = +C γ. (147) lim a() V a() = 0. (148) It follows from Lemma 20 with f = f, i.e., = 0, that the function φ 0 (a) := a V a is nonnegative and strictly increasing on (0, ). This and relation (148) imply: From (11) and (137), one gets lima() = 0. (149) C γ = a V,a a() y +. (150) 20

21 Thus, one gets: C γ a() y. (151) If γ < 1 then C 1 γ > 0 for sufficiently small. This implies: 0 lim a() lim 1 γ y = 0. (152) C 1 γ By the triangle inequality and the first inequality (136), one has V,a() y V a() y + V a() V,a() V a() y + a(). (153) Relation (12) follows from (152), (153) and Lemma Proof of Theorem 3 Proof. [Proof of Theorem 3] By Lemma 23 a u v F(u) F(v)+au av, v,u H, a > 0. (154) Using inequality (154) with v = v and u = V,α(), equation (4) with a = α(), and inequality (18), one gets α() v V,α() F(v ) F(V,α() )+α()v α()v,α() = F(v )+α()v f θ. (155) Therefore, Using (137) and (156), one gets: v V,α() θ α(). (156) α() v α() V,α() +α() v V,α() θ+α() y +. (157) From the triangle inequality and inequalities (18) and (19) one obtains: α() v F(v ) f F(v )+α()v f C 1 γ θ. (158) Inequalities (157) and (158) imply C 1 γ θ θ+α() y +. (159) This inequality and the fact that C 1 1 γ 2θ 1 γ > 0 for sufficiently small and 0 < γ < 1 imply α() 1 γ y C 1 1 γ 2θ1 γ, 0 < 1. (160) Thus, one obtains lim = 0. (161) α() 21

22 From the triangle inequality and inequalities (18), (19) and (156), one gets α() V,α() F(v ) f + F(v )+α()v f +α() v V,α() This inequality implies C 2 γ +θ +θ. The triangle inequality and inequality (136) imply From formulas (163) and (162), one gets lim α() V,α() = 0. (162) α V α α ( V,α V α + V,α ) +α V,α. (163) lim α() V α() = 0. (164) It follows from Lemma 20 with f = f, i.e., = 0, that the function φ 0 (a) := a V a is nonnegative and strictly increasing on (0, ). This and relation (164) imply limα() = 0. (165) From the triangle inequality and inequalities (156) and (136) one obtains v y v V,α() + V,α() V α() + V α() y θ α() + α() + V α() y, (166) where V α() solves equation (3) with a = α() and f = f. The conclusion (20) follows from inequalities (161), (165), (166) and Lemma 19. Theorem 3 is proved. 4.2 Proofs of convergence of the Dynamical Systems Method Proof of Theorem 5 Proof. [Proof of Theorem 5] Denote Let One has We use Taylor s formula and get: C := C (167) 2 w := u V, g(t) := w. (168) ẇ = V A 1 a(t)[ F(u ) F(V )+a(t)w ]. (169) F(u ) F(V )+aw = A a w +K, K M 2 2 w 2, (170) 22

23 where K := F(u ) F(V ) Aw, and M 2 is the constant from the estimate (24) and A a := A+aI. Multiplying (169) by w and using (170) one gets Let t 0 be defined as follows gġ g 2 + M 2 2 A 1 a(t) g3 + V g. (171) a(t 0 ) = 1 y, C > 1. (172) C 1 This and Lemma 24 imply that inequalities (118) and (119) hold. Since g 0, inequalities (171) and (119) imply, for all t [0,t 0 ], that ġ g(t)+ c 0 a(t) g2 + ȧ a(t) c 1, c 0 = M ( 2 2, c 1 = y 1+ 1 ). (173) C 1 Inequality (173) is of the type (94) with Let us check assumptions (99) (101). Take γ(t) = 1, α(t) = c 0 a(t), β(t) = c ȧ 1 a(t). (174) µ(t) = a(t), (175) where = const > 0 and satisfies conditions (25) (28) in Lemma 4. It follows that inequalities (99) (101) hold. Since u 0 satisfies the first inequality in (29), one gets g(0), by Remark 8. This, inequalities (99) (101), and Corollary 17 yield a(0) Therefore, g(t) < a(t), t t 0, g(t) := u (t) V (t). (176) F(u (t)) f F(u (t)) F(V (t)) + F(V (t)) f M 1 g(t)+ F(V (t)) f M 1a(t) From (172) and Lemma 24, one gets + F(V (t)) f, t t 0. (177) F(V (t 0 )) f F(V (t 1 )) f = C. (178) This, inequality (177), the inequality M 1 definition C 1 = 2C 1 (see (167)), imply y (see (25)), the relation (117), and the F(u (t 0 )) f M 1a(t 0 ) +C M 1(C 1) +C (2C 1) = C 1. y (179) 23

24 Thus, if F(u (0)) f > C 1 γ, 0 < γ 1, (180) then,bythecontinuity ofthefunctiont F(u (t)) f on[0, ), thereexistst (0,t 0 ) such that F(u (t )) f = C 1 γ (181) for any given γ (0,1], and any fixed C 1 > 1. Let us prove (31). From (177) with t = t, and from (137), one gets C 1 ζ M 1 a(t ) +a(t ) V (t ) M 1 a(t ) + y a(t )+. (182) Thus, for sufficiently small, one gets ) C ζ M1 a(t )( + y, C > 0, (183) where C < C 1 is a constant. Therefore, We claim that lim a(t ) lim Let us prove (185). Using (23), one obtains: This and (21) imply: Denote 1 ζ ( ) M1 C + y = 0, 0 < ζ < 1. (184) lim t =. (185) d ( ) F(u )+au f = Aa u +ȧu = ( ) F(u )+au f +ȧu. (186) dt d [ F(u ) F(V )+a(u V ) ] = [ F(u ) F(V )+a(u V ) ] +ȧu. (187) dt v := v(t) := F(u (t)) F(V (t))+a(t)(u (t) V (t)), h := h(t) := v. (188) Multiplying (187) by v, one obtains hḣ = h2 + v,ȧ(u V ) +ȧ v,v h 2 +h ȧ u V + ȧ h V, h 0. (189) Thus, ḣ h+ ȧ u V + ȧ V. (190) 24

25 Note that from inequality (197) one has Inequalities (190) and (191) imply ( ḣ h Since 1 ȧ a 1 2 Inequality (193) implies: From (194) and (197), one gets a u V h, F(u ) F(V ) h. (191) 1 ȧ a because c 2b, inequality (192) holds if ) + ȧ V. (192) ḣ 1 2 h+ ȧ V. (193) h(t) h(0)e t 2 +e t 2 t 0 e s 2 ȧ V ds. (194) Therefore, F(u (t)) F(V (t)) h(0)e t 2 +e t 2 t 0 e s 2 ȧ V ds. (195) F(u (t)) f F(V (t)) f F(V (t)) F(u (t)) a(t) V (t) h(0)e t 2 e t 2 From Lemma 27 it follows that there exists an a(t) such that t 0 e s 2 ȧ V ds. (196) For example, one can choose 1 2 a(t) V (t) e t 2 a(t) = where d,c,b > 0. Moreover, one can always choose u 0 such that t 0 e s 2 ȧ V (s) ds. (197) d (c+t) b, 6b < c, (198) h(0) = F(u 0 )+a(0)u 0 f 1 4 a(0) V (0), (199) because the equation F(u 0 )+a(0)u 0 f = 0 is solvable. If (199) holds, then If 2b < c, then (198) implies h(0)e t a(0) V (0) e t 2, t 0. (200) e t 2a(0) a(t). 25

26 Therefore, e t 2 h(0) 1 4 a(t) V (0) 1 4 a(t) V (t), t 0, (201) where we have used the inequality V (t) V (t ) for t < t, established in Lemma 20. From (181) and (185) (201), one gets Thus, C 1 ζ = F(u (t )) f 1 4 a(t ) V (t ). (202) lim a(t ) V (t ) lim4c 1 ζ = 0. (203) Since V (t) increases (see Lemma 20), the above formula implies lim a(t ) = 0. Since 0 < a(t) ց 0, it follows that lim t =, i.e., (185) holds. It is now easy to finish the proof of the Theorem 5. From the triangle inequality and inequalities (176) and (136) one obtains u (t ) y u (t ) V + V(t ) V (t ) + V(t ) y a(t ) + a(t ) + V(t ) y. (204) Note that V(t) := V (t) =0 and V (t) solves (21). Note that V(t ) = V 0,a(t ) (see equation (21)). From (184), (185), inequality (204) and Lemma 19, one obtains (31). Theorem 5 is proved. Remark 9 The trajectory u (t) remains in the ball B(u 0,R) := {u : u u 0 < R} for all t t, where R does not depend on as 0. Indeed, estimates (176), (137) and (120) imply: u (t) u 0 u (t) V (t) + V (t) + u 0 a(0) + C y C 1 + u 0 := R, t t. (205) Here we have used the fact that t < t 0 (see Lemma 24). Since one can choose a(t) and so that a(0) is uniformly bounded as 0 and regardless of the growth of M 1 (see Remark 7) one concludes that R can be chosen independent of and M Proof of Theorem 7 Proof. [Proof of Theorem 7] Denote Let One has C := C (206) 2 w := u V, g(t) := w. (207) ẇ = V A a(t)[ F(u ) F(V )+a(t)w ]. (208) 26

27 We use Taylor s formula and get: F(u ) F(V )+aw = A a w +K, K M 2 2 w 2, (209) where K := F(u ) F(V ) Aw, and M 2 is the constant from the estimate (24) and A a := A+aI. Multiplying (208) by w and using (209) one gets gġ a 2 g 2 + M 2(M 1 +a) g V g, g := g(t) := w(t), (210) where the estimates: A aa a w,w a 2 g 2 and A a M 1 + a were used. Note that the inequality A a A aw,w a 2 g 2 is true if A 0. Since F is monotone and differentiable (see (2)), one has A := F (u ) 0. Let t 0 > 0 be such that a(t 0 ) = 1 y, C > 1, (211) C 1 as in (117). It follows from Lemma 24 that inequalities (118) and (119) hold. Since g 0, inequalities (210) and (119) imply, for all t [0,t 0 ], that ġ(t) a 2 (t)g(t)+c 0 (M 1 +a(t))g 2 (t)+ ȧ(t) a(t) c 1, c 0 = M ( 2 2, c 1 = y Inequality (212) is of the type (94) with 1+ 1 C 1 ). (212) γ(t) = a 2 (t), α(t) = c 0 (M 1 +a(t)), β(t) = c 1 ȧ(t) a(t). (213) Let us check assumptions (99) (101). Take µ(t) = a 2, = const. (214) (t) By Lemma 6 there exist and a(t) such that conditions (35) (39) hold. This implies that inequalities (99) (101) hold. Thus, Corollary 17 yields g(t) < a2 (t), t t 0. (215) Note that inequality (215) holds for t = 0 since (39) holds. Therefore, F(u (t)) f F(u (t)) F(V (t)) + F(V (t)) f M 1 g(t)+ F(V (t)) f M 1a 2 (t) + F(V (t)) f, t t 0. It follows from Lemma 20 that F(V (t)) f is decreasing. Since t 1 t 0, one gets (216) F(V (t 0 )) f F(V (t 1 )) f = C. (217) 27

28 This, inequality (216), the inequality M 1 definition C 1 = 2C 1 (see (206)) imply y (see (36)), the relation (211), and the F(u (t 0 )) f M 1a 2 (t 0 ) +C M 1(C 1) +C (2C 1) = C 1. y (218) We have used the inequality a 2 (t 0 ) a(t 0 ) = (C 1) y (219) which is true if is sufficiently small, or, equivalently, if t 0 is sufficiently large. Thus, if then there exists t (0,t 0 ) such that F(u (0)) f C 1 ζ, 0 < ζ 1, (220) F(u (t )) f = C 1 ζ (221) for any given ζ (0,1], and any fixed C 1 > 1. Let us prove (42). If this is done, then Theorem 7 is proved. First, we prove that lim a(t ) = 0. From (216) with t = t, (21) and (137), one gets C 1 ζ a 2 (t ) M 1 a 2 (t ) M 1 Thus, for sufficiently small, one gets ( C ζ M1 a(0) a(t ) where C < C 1 is a constant. Therefore, lim a(t ) lim +a(t ) V (t ) + y a(t )+. (222) ) + y, C > 0, (223) 1 ζ ( ) M1 a(0) + y = 0, 0 < ζ < 1. (224) C Secondly, we prove that Using (33), one obtains: lim t =. (225) d ( ) F(u )+au f = Aa u +ȧu = A a A ( ) a F(u )+au f +ȧu. (226) dt 28

29 This and (21) imply: d [ F(u ) F(V )+a(u V ) ] = A a A [ a F(u ) F(V )+a(u V ) ] +ȧu. (227) dt Denote v := F(u ) F(V )+a(u V ), h := h(t) := v(t). (228) Multiplying (227) by v and using monotonicity of F, one obtains hḣ = A aa av,v + v,ȧ(u V ) +ȧ v,v h 2 a 2 +h ȧ u V + ȧ h V, h 0. (229) Again, we have used the inequality A a A a a2, which holds for A 0, i.e., monotone operators F. Thus, ḣ ha 2 + ȧ u V + ȧ V. (230) From inequality (110) we have Inequalities (230) and (231) imply ( ḣ h Since a 2 ȧ a 3a2 4 > a2 2 Inequality (233) implies: Denote a u V h, F(u ) F(V ) h. (231) a 2 ȧ a ) + ȧ V. (232) by inequality (35), it follows from inequality (232) that h(t) h(0)e R t a 2 (s) 0 2 ds +e R t a 2 (s) 0 ds 2 From (234) and (231), one gets Therefore, ḣ a2 2 h+ ȧ V. (233) ϕ(t) := t 0 t 0 er s 0 a 2 (s) 2 ds. a 2 (ξ) 2 dξ ȧ(s) V (s) ds. (234) t F(u (t)) F(V (t)) h(0)e ϕ(t) +e ϕ(t) e ϕ(s) ȧ(s) V (s) ds. (235) 0 F(u (t)) f F(V (t)) f F(V (t)) F(u (t)) t a(t) V (t) h(0)e ϕ(t) e ϕ(t) e ϕ(s) ȧ V ds. 0 (236) 29

30 From Lemma 28 it follows that there exists an a(t) such that For example, one can choose 1 2 a(t) V (t) e ϕ(t) t 0 e ϕ(s) ȧ V (s) ds. (237) a(t) = c 1 (c+t) b, b (0, 1 4 ], c2 1 c1 2b 6b, (238) where c 1,c > 0. Moreover, one can always choose u 0 such that h(0) = F(u 0 )+a(0)u 0 f 1 4 a(0) V (0), (239) because the equation is solvable. If (239) holds, then F(u 0 )+a(0)u 0 f = 0 (240) h(0)e ϕ(t) 1 4 a(0) V (0) e ϕ(t), t 0. (241) If (238) holds, c 1 and 2b c 2 1, then it follows that e ϕ(t) a(0) a(t). (242) Indeed, inequality a(0) a(t)e ϕ(t) is obviously true for t = 0, and ( a(t)e ϕ(t)) t 0, provided that c 1 and 2b c 2 1. Inequalities (241) and (242) imply e ϕ(t) h(0) 1 4 a(t) V (0) 1 4 a(t) V (t), t 0. (243) where we have used the inequality V (t) V (t ) for t t, established in Lemma 20. From (221) and (225) (243), one gets C ζ = F(u (t )) f 1 4 a(t ) V (t ). (244) Thus, lim a(t ) V (t ) lim4c ζ = 0. (245) Since V (t) is increasing, this implies lim a(t ) = 0. Since 0 < a(t) ց 0, it follows that (225) holds. From the triangle inequality and inequalities (215) and (136) one obtains u (t ) y u (t ) V + V(t ) V (t ) + V(t ) y a2 (t ) + a(t ) + V(t ) y, (246) where V(t) := V (t) =0 and V (t) solves (21). From (224), (225), inequality (246) and Lemma 19, one obtains (42). Theorem 7 is proved. By the arguments, similar to the ones in the proof of Theorem or in Remark 9, one can show that the trajectory u (t) remains in the ball B(u 0,R) := {u : u u 0 < R} for all t t, where R does not depend on as 0. 30

31 4.2.3 Proof of Theorem 9 Proof. [Proof of Theorem 9] Denote Let One has Multiplying (249) by w and using (2) one gets Let t 0 > 0 be such that C := C (247) 2 w := u V, g := g(t) := w(t). (248) ẇ = V [ F(u ) F(V )+a(t)w ]. (249) gġ ag 2 + V g. (250) a(t 0 ) = 1 y, C > 1. (251) C 1 This t 0 exists and is unique since a(t) > 0 monotonically decays to 0 as t. It follows from inequality (251) and Lemma 24 that inequalities (118) and (119) hold. Since g 0, inequalities (250) and (119) imply ġ a(t)g(t)+ ȧ(t) a(t) c 1, c 1 = y Inequality (252) is of the type (94) with Let us check assumptions (99) (101). Take ( 1+ 1 ). (252) C 1 γ(t) = a(t), α(t) = 0, β(t) = c 1 ȧ(t) a(t). (253) µ(t) =, = const. (254) a(t) By Lemma 8 there exist and a(t) such that conditions (47) (50) hold. It follows that inequalities (99) (101) hold. Thus, Corollary 17 yields Therefore, g(t) < a(t), t t 0. (255) F(u (t)) f F(u (t)) F(V (t)) + F(V (t)) f M 1 g(t)+ F(V (t)) f M 1a(t) + F(V (t)) f, t t 0. (256) 31

32 It follows from Lemma 20 that F(V (t)) f is decreasing. Since t 1 t 0, one gets F(V (t 0 )) f F(V (t 1 )) f = C. (257) This, inequality (256), the inequality M 1 definition C 1 = 2C 1 (see (247)) imply y (see (47)), the relation (251), and the F(u (t 0 )) f M 1a(t 0 ) +C M 1(C 1) +C (2C 1) = C 1. y (258) Thus, if then there exists t (0,t 0 ) such that F(u (0)) f C 1 ζ, 0 < ζ 1, (259) F(u (t )) f = C 1 ζ (260) for any given ζ (0,1], and any fixed C 1 > 1. Let us prove (53). If this is done, then Theorem 9 is proved. First, we prove that lim a(t ) = 0. From (256) with t = t, and from (137), one gets C 1 ζ M 1 a(t ) +a(t ) V (t ) M 1 a(t ) + y a(t )+. (261) Thus, for sufficiently small, one gets ) C ζ M1 a(t )( + y, C > 0, (262) where C < C 1 is a constant. Therefore, lim a(t ) lim 1 ζ C ( ) M1 + y = 0, 0 < ζ < 1. (263) Secondly, we prove that Using (44), one obtains: lim t =. (264) d ( ) ( ) F(u )+au f = Aa u +ȧu = A a F(u )+au f +ȧu, (265) dt where A a := F (u )+a. This and (21) imply: d [ F(u ) F(V )+a(u V ) ] [ = A a F(u ) F(V )+a(u V ) ] +ȧu. (266) dt 32

33 Denote v := F(u ) F(V )+a(u V ), h = v. (267) Multiplying (266) by v and using monotonicity of F, one obtains hḣ = A av,v + v,ȧ(u V ) +ȧ v,v h 2 a+h ȧ u V + ȧ h V, h 0. (268) Again, we have used the inequality F (u )v,v 0 which follows from the monotonicity of F. Thus, ḣ ha+ ȧ u V + ȧ V. (269) Inequalities (269) and (276) imply ( ḣ h Since a ȧ a a 2 Inequality (271) implies: Denote a ȧ a ) + ȧ V. (270) by inequality (46), it follows from inequality (270) that h(t) h(0)e R t a(s) 0 2 ds +e R t a(s) 0 From (272) and (276), one gets Therefore, ḣ a 2 h+ ȧ V. (271) ϕ(t) := t 2 ds s er 0 0 t 0 a(ξ) 2 dξ ȧ(s) V (s) ds. (272) a(s) ds. (273) 2 t F(u (t)) F(V (t)) h(0)e ϕ(t) +e ϕ(t) e ϕ(s) ȧ(s) V (s) ds. (274) 0 F(u (t)) f F(V (t)) f F(V (t)) F(u (t)) t a(t) V (t) h(0)e ϕ(t) e ϕ(t) e ϕ(s) ȧ V ds. From Lemma 29 it follows that there exists an a(t) such that 0 (275) For example, one can choose 1 2 a(t) V (t) e ϕ(t) a(t) = t 0 e ϕ(s) ȧ V (s) ds. (276) d (c+t) b, b (0, 1 2 ], dc1 b 6b, (277) 33

34 where d,c > 0. Moreover, one can always choose u 0 such that h(0) = F(u 0 )+a(0)u 0 f 1 4 a(0) V (0), (278) because the equation F(u 0 )+a(0)u 0 f = 0 (279) is uniquely solvable for any f H if a(0) > 0 and F is monotone. If (278) holds, then h(0)e ϕ(t) 1 4 a(0) V (0) e ϕ(t), t 0. (280) If (277) holds, c 1 and 2b d, then it follows that e ϕ(t) a(0) a(t). (281) Indeed, inequality a(0) a(t)e ϕ(t) is obviously true for t = 0, and ( a(t)e ϕ(t)) t 0, provided that c 1 and 2b d. Inequalities (280) and (281) imply e ϕ(t) h(0) 1 4 a(t) V (0) 1 4 a(t) V (t), t 0, (282) where we have used the inequality V (t) V (t ) for t t, established in Lemma 20. From (260) and (264) (282), one gets Thus, C ζ = F(u (t )) f 1 4 a(t ) V (t ). (283) lim a(t ) V (t ) lim4c ζ = 0. (284) Since V (t) is increasing, this implies lim a(t ) = 0. Since 0 < a(t) ց 0, it follows that (264) holds. From the triangle inequality and inequalities (255) and (136) one obtains: u (t ) y u (t ) V + V(t ) V (t ) + V(t ) y a(t ) + a(t ) + V(t ) y, (285) where V(t) := V (t) =0 and V (t) solves (21). From (263), (264), inequality (285) and Lemma 19, one obtains (53). Theorem 9 is proved. By the arguments, similar to the ones in the proof of Theorem or in Remark 9, one can show that: the trajectory u (t) remains in the ball B(u 0,R) := {u : u u 0 < R} for all t t, where R does not depend on as 0. 34

35 4.3 Proofs of convergence of the iterative schemes Proof of Theorem 11 Proof. [Proof of Theorem 11] Denote Let We use Taylor s formula and get: C := C (286) 2 z n := u n V n, g n := z n. (287) F(u n ) F(V n )+a n z n = A an z n +K n, K n M 2 2 z n 2, (288) where K n := F(u n ) F(V n ) F (u n )z n and M 2 is the constant from (24). From (56) and (288) one obtains z n+1 = z n z n A 1 n K(z n) (V n+1 V n ). (289) From (289), (288), and the estimate A 1 n 1 a n, one gets There exists a unique n 0 such that g n+1 M 2g 2 n 2a n + V n+1 V n. (290) a n0 +1 > 1 C 1 y a n0, C > 1. (291) It follows from (291) and Lemma 25 that inequalities (124) and (126) hold. Inequalities (290) and (126) imply g n+1 c 0 gn 2 a + a n a n+1 c 1, c 0 = M ( 2 n a n+1 2, c 1 = y 1+ 2 ), (292) C 1 for all n n Let us show by induction that g n < a n, 0 n n (293) Inequality (293) holds for n = 0 by Remark 8 (see (144)). Suppose (293) holds for some n 0. From (292), (293) and (60), one gets g n+1 c ( ) 2 0 an + a n a n+1 c 1 a n a n+1 = c 0a n 2 + a n a n+1 a n+1 c 1 a n+1. (294) 35

36 Thus, by induction, inequality (293) holds for all n in the region 0 n n From inequality (137) one has V n y + a n. This and the triangle inequality imply u 0 u n u 0 + z n + V n u 0 + z n + y +. (295) a n Inequalities (125), (293), and (295) guarantee that the sequence u n, generated by the iterative process (56), remains in the ball B(u 0,R) for all n n 0 + 1, where R a 0 + u 0 + y + a n. This inequality and the estimate (293) imply that the sequence u n, n n 0 +1, stays in the ball B(u 0,R), where R a 0 + u 0 + y + y C +1 C 1. (296) By Remark 7, one can choose a 0 and so that a 0 is uniformly bounded as 0 even if M 1 (R) as R at an arbitrary fast rate. Thus, the sequence u n stays in the ball B(u 0,R) for n n 0 +1 when 0. An upper bound on R is given above. It does not depend on as 0. One has: F(u n ) f F(u n ) F(V n ) + F(V n ) f M 1 g n + F(V n ) f M 1a n + F(V n ) f, n n 0 +1, where (293) was used and M 1 is the constant from (24). By Lemma 25 one gets (297) F(V n0 +1) f C. (298) From (59), (297), (298), the relation (291), and the definition C 1 = 2C 1 (see (286)), one concludes that F(u n0 +1) f M 1a n0 +1 +C M 1(C 1) +C (2C 1) = C 1. y (299) Thus, if F(u 0 ) f > C 1 γ, 0 < γ 1, (300) then one concludes from (299) that there exists n, 0 < n n 0 +1, such that F(u n ) f C 1 γ < F(u n ) f, 0 n < n, (301) for any given γ (0,1], and any fixed C 1 > 1. Let us prove (64). If n > 0 is fixed, then u,n is a continuous function of f. Denote ũ N = lim u,n, (302) 36