arxiv:math/ v2 [math.na] 15 Nov 2005

Transcription

1 arxiv:math/5247v2 [math.na] 5 Nov 25 A Least Squares Functional for Solving Inverse Sturm-Liouville Problems. Introduction Norbert Röhrl Fachbereich Mathematik, IADM, University of Stuttgart, 75 Stuttgart, Germany norbert.roehrl@mathematik.uni-stuttgart.de AMS classification scheme numbers: 65L9, 34A55 Abstract. We present a variational algorithm for solving the classical inverse Sturm-Liouville problem in one dimension when two spectra are given. All critical points of the least squares functional are at global minima, which suggests minimization by a (conjugate) gradient descent algorithm. Numerical examples show that the resulting algorithm works quite reliable without tuning for particular cases, even in the presence of noise. With the right choice of parameters the minimization procedure converges very quickly. The one dimensional inverse Sturm-Liouville problem and methods for its numerical solution are very well studied [8,, 2]. Still there is no general purpose algorithm, which efficiently satisfies all needs (see eg. [2]). We present a variational algorithm which proves to be very robust under noisy input, does not require any special tuning or additional input besides the partial spectra, and is quite efficient in the class of variational methods. In section 2 we will define the functional and prove the absence of true local minima, which could trap our minimization procedure. Numerical examples, the optimal choice of the weights and the performance under noisy input will be discussed in section 3. Section 4 is concerned with implementation details and compares this algorithm to related approaches, and section 5 finally contains the proof of the linear independence of the squares of eigenfunctions. 2. Definition and Properties of the Functional We consider the Sturm-Liouville equation u + q(x)u = λu on [, ] with q(x) L 2 ([, ], R) real, and separated boundary conditions (SL) u()cosα + u ()sin α =, u()cosβ + u ()sin β =. (αβ) For the asymptotics of the eigenvalues (λ n ) n= wrt. boundary conditions (αβ) there are three cases (see eg. [3, 4, 3, 9]): π 2 n 2 2sin(β α) sin α sin β + q ds + a n if sinαsin β λ n = π 2 (n + /2) 2 2 cos αcos β + sin(β α) + q ds + a n if sinαsin β = sin(β α) π 2 (n + ) 2 + (2.3) q ds + a n if sinα = sin β = where (a n ) l 2.

2 Least Squares Functional for Inverse Sturm-Liouville Problems 2 It is a classical result, that two spectra determine the potential uniquely. Fix three angles α, β, and γ with sin(β γ). Let λ q,i,n, i {, 2} denote the eigenvalues with respect to the boundary conditions (αβ) resp. (αγ). Theorem 2. (Borg [], Levinson [5]). Given potentials Q, q L [, ] with then Q = q. λ Q,i,n = λ q,i,n for all n N, i =, 2, Suppose we are given (partial) spectral data λ Q,i,n with (i, n) in I {, 2} N of an unknown potential Q. For a trial potential q and positive weights ω i,n, we define the functional G(q) = ω i,n (λ q,i,n λ Q,i,n ) 2. (2.4) If I is infinite and the sequence (ω i,n ) is summable, this converges because of the asymptotics of the eigenvalues (2.3) G(q) = ( ω i,n Q q + c i,n )2 <, where c i,n l 2, i =, 2. If moreover I = {, 2} N, the functional is zero if and only if q = Q (by theorem 2.). In the case of partial knowledge of the spectrum, a solution of G(q) = includes all information given about the unknown potential Q. But we only have a chance to get close to the original potential if there is not too much information in the higher eigenvalues, i.e. if the potential to be recovered is sufficiently smooth [7]. An important question is now, for which sequences (λ i,n ) there is a q with G(q) =, i.e. λ q,i,n = λ i,n. It is easy to see with the classical methods [3], that it is necessary for the eigenvalues to interlace λ,n < λ 2,n < λ,n+ or λ 2,n < λ,n < λ 2,n+. It is also known that if we choose either (i) sinα, sin β, sin γ (Levitan [6]) or (ii) α = β =, sinγ (Dahlberg Trubowitz [3]), then the interlacing property in connection with the correct asymptotics is sufficient for the existence of a potential q with G(q) =. An interesting feature of this functional is that all its critical points are at global minima. To prove this, we first compute the derivative of G. The derivative of λ q,i,n wrt. q in direction h is λ q,i,n [h] = hg 2 q,i,n dx, where g q,i,n denotes the normalized eigenfunction corresponding to λ q,i,n (see [9] for a nice proof). Thus the derivative of G is given by Ġ[h](q) = 2 ω i,n (λ q,i,n λ Q,i,n )gq,i,nh 2 dx. We note that if nω i,n is summable, then the gradient G(q) = 2 (n + )ω i,n (λ q,i,n λ Q,i,n ) n + g2 q,i,n (2.5) is in H because gq,i,n 2 H = O(n) [3] and λ q,i,n λ Q,i,n = O(). Theorem 5.2 below shows that the eigenfunctions gq,i,n 2 are linearly independent in H. immediately implies the essential convexity of the functional: This

3 Least Squares Functional for Inverse Sturm-Liouville Problems 3 Theorem 2.2. If I is finite or (nω i,n ) is summable, the functional G has no local minima at q with G(q) >, i.e. Ġ[h](q) = h H [, ] G(q) =. Thus a conjugate gradient algorithm will not get trapped in local minimas, as we will also observe in the examples. Finally, we want to address the question, which of the infinitely many q with G(q) = our algorithm will select. Let us first look at a related functional, which actually was also our first try. It is given by G(q) = ( )2 λ q,i,n λ Q,i,n + (Q q)dx, (2.6) with derivative G[h](q) = 2 ) (λ q,i,n λ Q,i,n (Q q)dx (g 2 q,i,n )h dx. In case the mean of Q is known, this functional works as well as the other. Its gradient flow leaves the mean of q constant by construction. The function gq,i,n 2 is the gradient of λ q,i,n q dx and the direction of strongest increase of λ q,i,n which leaves q dx fixed. Choosing α = β = and γ = π/2, the asymptotics of the squared eigenfunctions are given by g 2 q,i,n = { cos ( (2n + 2)πx ) + O(n ), i = cos ( (2n + )πx ) + O(n ), i = 2. (2.7) Hence the functions {gq,i,n 2 n N, i =, 2} {} are almost orthogonal for large n. Now, the derivative of our functional (2.4) can be written as Ġ[h](q) = 2 ω i,n (λ q,i,n λ Q,i,n ) ( (g 2 q,i,n ) + ) h dx, and the difference λ q+c,i,n (q + c)dx = λ q,i,n q dx is invariant under adding a constant function c to q. It follows that a gradient flow of our functional G leaves λ q,i,n q dx with (i, n) I almost invariant for n large enough. Since also a conjugate gradient descent is just an approximation of the gradient flow, in practice we do get some little changes in the higher eigenvalues. A similar argument holds for the case sin α, sin β, sin γ, but there the asymptotics for i =, 2 are equal. So we still have asymptotic orthogonality in n, but can not separate i = and i = Numerical Examples We use the standard Polak-Ribiere conjugate gradient descent algorithm [] to approximate the gradient flow and thus minimize the functional. To give the basic idea, we explain the simpler steepest descent: (i) choose initial potential q = q (ii) while G(q i ) too big do (a) compute the gradient G(q i ) (b) minimize the one dimensional function G(q i α G(q i )) wrt. α (c) set q i+ equal to the minimizing potential

4 Least Squares Functional for Inverse Sturm-Liouville Problems 4 G(q) = =.8295 λ = iter# = Figure. Plot using ω i,n =. The right two graphs show G(q) and 2 over the number of iterations. G(q) G(q) = = λ = iter# = 4 G(q) Figure 2. Plot using ω i,n = (n + ) 2. On the right side of the 2 plot we zoom in to show the convergence process in more detail. 2 This straight forward minimization scheme has a major disadvantage: consecutive gradients are always orthogonal. To avoid this, conjugate gradient descent computes the direction for the one dimensional minimization using the current and previous gradients. The first natural question is the optimal choice of the constants ω i,n. A short look at the leading coefficients of the asymptotics (2.3) may suggest something like ω i,n = (n + ) 2. But the leading term of λ q,i,n λ Q,i,n is (q Q)dx = O(), which corresponds to choosing ω i,n = and yields the fastest convergence in all examples. Figures and 2 were computed with ω i,n = resp. ω i,n = (n + ) 2. For all plots (except 2 and 3) we chose the lowest number of iterations after which the plot stabilizes, while usually already the second iteration reveals the global structure of the potential. By default we use 3 pairs of eigenvalues, q =, ω i,n =, and the boundary conditions α = β =, γ = π/2. We give the current value of the functional G(q) as well as the L 2 error 2 = q Q 2, and the maximum of the difference of the eigenvalues λ = max { λ q,i,n λ Q,i,n }. In addition if there is a visible difference, we also plot the original potential Q using a dashed line. We see that both G(q) and 2 converge much faster for ω i,n =. With ω i,n = (n + ) 2 on the other hand, q moves through smoother functions (as in figure 2). In contrast to the optical impression these are in general worse approximations wrt. G(q) and 2. But finally q, after around iterations, will also converge to the function shown in figure. From the good average convergence of G(q) in both cases, we can tell, that our algorithm also in practice does not get near a local minimum, as proved in theorem 2.2. The optimal choice of boundary conditions can already be guessed from the asymptotics of the squared eigenfunctions (2.7). Choosing α = β = and γ = π/2, the functions gq,i,n 2 are almost

5 Least Squares Functional for Inverse Sturm-Liouville Problems 5 G(q) = =.2837 λ = iter# = Figure 3. Plot with bounday conditions α = β = π/4, γ = π/4. The light graph shows the 62th iteration, where the iteration stabilizes. G(q) G(q) = =.8535 λ = iter# = 5 G(q) = =.362 λ = iter# = 5 Figure 4. Plots with added white noise of absolute value smaller or equal. resp... orthogonal for large n and i =, 2 (c.f. (2.7)). In contrast, if sinα, sin β, and sinγ are all non zero, gq,,n 2 and g2 q,2,n will get close for large n. Therefore, in the latter case, the algorithm will converge much slower. This can also clearly be observed in numerical examples, like in figure 3. But also there, after approximately 62 iterations, we finally will get a solution which is close to figure. Another important aspect for applications is stability against noise in the given spectral data. In figure 4 we computed two examples with random noise λ Q,i,n λ Q,i,n r, with r =. and r =., respectively. It is remarkable, that the convergence speed in G(q) is not significantly affected by the random noise; both examples reach G(q) 8 in 3 iterations. For testing the robustness, we also fed the functional with the following random sequence ,.6265, , , , 3.9, , 48.88, , 6.988, which is far from the generic asymptotics. Convergence of G(q) is slow but steady. In log scale the graph of G(q) over the number of iteration looks similar to those given above. From G(q) = initially, we get down to G(q) = in 45 iterations. Finally figure 5 shows the results for the other examples of [2, ].

6 Least Squares Functional for Inverse Sturm-Liouville Problems 6 G(q) = = G(q) = λ = iter# = 4 2 = λ = iter# = 3 Figure 5. Continuous examples. 4. Implementation and Comparison The implementation of the conjugate gradient minimization algorithm is straight forward (see eg. []), but our application crucially depends on a reliable eigenvalue problem solver. After some trial and error we settled for d2kdf from the Numerical Algorithms Group (NAG). For standard numerical routines we used the GNU Scientific Library. Another important point is the internal representation of the functions. We used cubic splines on 2 intervals of equal length. For 3 pairs of eigenvalues we already get satisfactory results at 8 intervals. But since the computation time depends only roughly linear on this number, we did not study its influence on the quality of the approximation. Because all high level routines, like the eigenvalue solver, only sample these functions on some points, the details of the representation are not that important. But since very many values are needed, this is the part in the algorithm, where speed optimizations are most valuable. Compared to the variational algorithm by Brown et al. [2], which uses other spectral data, our functional is more expensive to compute, because they only have to solve initial value problems, whereas the present algorithm requires solution of the eigenvalue problems. On the other hand they often need about - times as many iterations to get similar results. Another plus on our side is, that even in presence of noise, we know to get closer to our goal each step and do not have to regularize the process by limiting the number of iterations. The method of Rundell and Sacks [] uses the same spectral data as our algorithm and is without any doubt much faster, but needs the mean Q dx as additional input, which has to be guessed from the (partial) spectral data. Our method does this automatically. In the case of figure for example, the error of the mean is 2 3 % and using 5 pairs of eigenvalues we still only get an error of about.2%. This is probably better than an independent algorithm for computing the mean value from spectral data could do. 5. Linear Independence of Squared Eigenfunctions Define the Wronskian [f, g] = fg f g and the bilinear form Γ : H ([, ], R) 2 R (f, g) [f, g] dx which is bounded by Γ(f, g) f H g H, i.e. Γ(f, ) = f H. (We use the definition f H = f 2 L + f 2 2 L with distributional derivatives.) In particular Γ is 2 continuous on H. We have the following rules for the Wronskian:

7 Least Squares Functional for Inverse Sturm-Liouville Problems 7 (i) [fg, hj] = gj[f, h] + fh[g, j] = fj[g, h] + gh[f, j] (ii) If the functions f and f 2 fulfill the condition then [f, f 2 ](a) =. f i (a)cosα + f i(a)sin α = i =, 2, (iii) For two arbitrary solutions f and f 2 of the equation (SL) with eigenvalue parameters λ and λ 2 we have [f, f 2 ] = f f 2 f 2f = (λ λ 2 )f f 2. In this section we are only talking about a single q and therefore drop it from the index. Let s i,n and c i,n be the solutions of the differential equation (SL) for the eigenvalue parameter λ i,n and initial values s i,n () = sinβ, c i,n () = sinγ, s i,n () = cosβ, c i,n () = cosγ. It is well known and easy to see that the Wronskian of these solutions is constant and we can compute its value at : [s i,n, c i,n ] = sinβ cosγ + cosβ sinγ = sin(γ β). The normalized eigenfunctions are g,n = s,n / s,n 2 and g 2,n = c 2,n / c 2,n 2. Now we prove the central lemma, which builds on the ideas of a similar result for the Dirichlet case in the book of Pöschel and Trubowitz[9]. A result in the same spirit can also already be found in the paper of Borg []. Lemma 5.. Given three angles α, β, and γ with sin(β γ) and denote the L 2 -normalized eigenfunctions of the Sturm-Liouville equation with boundary conditions (αβ) and (αγ) by g i,n, i =, 2. With s i,n, c i,n as defined above we have the following relations for the squared eigenfunctions for all i, j {, 2} and m, n N : (i) Γ(g 2 i,n, g 2 i,m) = (ii) Γ(c i,n s i,n, g 2 j,m) = ( ) i sin(γ β)δ n,m δ i,j Proof. i) Γ(gi,n 2, g2 i,m ) = 2 g i,n g i,m [g i,n, g i,m ] dx If n = m, the term clearly vanishes. If n m, we get Γ(gi,n, 2 gi,m) 2 2 = λ i,n λ i,m [g i,n, g i,m ] [g i,n, g i,m ] dx = because g i,n and g i,m satisfy the same boundary conditions (rule ii). ii) λ i,n λ i,m [g i,n, g i,m ] 2 =, Γ(c i,n s i,n, gj,m 2 ) = ( ci,n g j,m [s i,n, g j,m ] + s i,n g j,m [c i,n, g j,m ] ) dx If i = j =, m = n, the first term vanishes and we are left with s,m g,m [c,m, g,m ] = and if i = j = 2, m = n, the second term vanishes and we get c 2,m g 2,m [s 2,m, g 2,m ] = g 2,m [c,m, s,m ] = sin(γ β), g 2 2,m[s 2,m, c 2,m ] = + sin(γ β).

8 Least Squares Functional for Inverse Sturm-Liouville Problems 8 If (i, n) (j, m) we compute Γ(c i,n s i,n, gj,m 2 ) = ( [ci,n, g j,m ] [s i,n, g j,m ] + [s i,n, g j,m ] [c i,n, g j,m ] ) dx = λ i,n λ j,m [s i,n, g j,m ][c i,n, g j,m ] λ i,n λ = j,m We note that λ i,n λ j,m in this case, because the eigenfunctions satisfy the same boundary conditions at and different boundary conditions at. Theorem 5.2. With the notations of the above lemma, the set of squared eigenfunctions { g 2 i,n (i, n) {, 2} N } is linearly independent in H. Proof. Suppose for some fixed (i, n) we have g 2 i,n = k N a k g 2 k in H, where a k R and g k = g jk,m k with (j k, m k ) (i, n). But this would imply ( ) i sin(γ β) = Γ(c i,n s i,n, gi,n (c 2 ) = Γ i,n s i,n, ) a k gk 2 = Γ(c i,n s i,n, a k gk 2 ) = k N k N Acknowledgments The author wishes to thank Ian Knowles and Rudi Weikard for drawing his attention to this topic and for the interesting discussions during his time at the University of Alabama at Birmingham. References [] G. Borg. Eine Umkehrung der Sturm-Liouvilleschen Eigenwertaufgabe. Bestimmung der Differentialgleichung durch die Eigenwerte. Acta Math., 78: 96, 946. [2] B. M. Brown, V. S. Samko, I. W. Knowles, and M. Marletta. Inverse spectral problem for the Sturm-Liouville equation. Inverse Problems, 9(): , 23. [3] B. E. J. Dahlberg and E. Trubowitz. The inverse Sturm-Liouville problem. III. Comm. Pure Appl. Math., 37(2): , 984. [4] E. L. Isaacson, H. P. McKean, and E. Trubowitz. The inverse Sturm-Liouville problem. II. Comm. Pure Appl. Math., 37():, 984. [5] N. Levinson. The inverse Sturm-Liouville problem. Mat. Tidsskr. B., 949:25 3, 949. [6] B. M. Levitan. Inverse Sturm-Liouville problems. VSP, Zeist, 987. Translated from the Russian by O. Efimov. [7] M. Marletta and R. Weikard. Weak stability for an inverse Sturm-Liouville problem with finite spectral data and complex potential. Inverse Problems, 2(4):275 29, 25. [8] J. R. McLaughlin. Analytical methods for recovering coefficients in differential equations from spectral data. SIAM Rev., 28():53 72, 986. [9] J. Pöschel and E. Trubowitz. Inverse spectral theory, volume 3 of Pure and Applied Mathematics. Academic Press Inc., Boston, MA, 987. [] W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery. Numerical recipes in C. Cambridge University Press, Cambridge, second edition, 992. [] W. Rundell and P. E. Sacks. Reconstruction techniques for classical inverse Sturm-Liouville problems. Math. Comp., 58(97):6 83, 992. [2] P. Schapotschnikow. Inverse Sturm-Liouville problems on trees. a variational approach. Master s thesis, School of Computer Science, Cardiff University, UK, 24. [3] E. C. Titchmarsh. Eigenfunction expansions associated with second-order differential equations. Part I. Second Edition. Clarendon Press, Oxford, 962.