Research Matters. February 25, The Nonlinear Eigenvalue. Director of Research School of Mathematics

Size: px
Start display at page:

Download "Research Matters. February 25, The Nonlinear Eigenvalue. Director of Research School of Mathematics"

Transcription

1 Research Matters February 25, 2009 The Nonlinear Eigenvalue Nick Problem: HighamPart II Director of Research School of Mathematics Françoise Tisseur School of Mathematics The University of Manchester Woudschoten Conference / 6

2 Outline Two lectures: Part I: Mathematical properties of nonlinear eigenproblems (NEPs) Definition and historical aspects Examples and applications Solution structure Part II: Numerical methods for NEPs Solvers based on Newton s method Solvers using contour integrals Linear interpolation methods S. GÜTTEL AND F. TISSEUR, The nonlinear eigenvalue problem. Acta Numerica 26:1 94, University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 2 / 36

3 Solvers Based on Newton s Method Newton s method is a natural approach to compute e vals/e vecs of NEPs provided good initial guesses are available. Local quadratic convergence. Initial guess is the only crucial parameter great advantage over other NEP eigensolvers. Two broad ways NEP F(λ)v = 0 can be tackled by a Newton-type method: Apply Newton s method to a scalar equation f (z) = 0 whose roots are the wanted e vals of F. Apply Newton s method directly to the vector problem F(λ)v = 0 together with some normalization condition on v. University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 3 / 36

4 Newton s Method for Scalar Function Most obvious approach: Find roots of f (z) = detf(z). Combining Newton s method with Jacobi s formula λ (k+1) = λ (k) f (λ(k) ) f (λ (k) ) f (z) = detf(z)trace ( F(z) 1 F (z) ), we obtain the Newton-trace iteration [Lancaster 1966] λ (k+1) = λ (k) 1 trace ( F(λ (k) ) 1 F (λ (k) ) ). University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 4 / 36

5 Newton s Method for Scalar Function Most obvious approach: Find roots of f (z) = detf(z). Combining Newton s method with Jacobi s formula λ (k+1) = λ (k) f (λ(k) ) f (λ (k) ) f (z) = detf(z)trace ( F(z) 1 F (z) ), we obtain the Newton-trace iteration [Lancaster 1966] λ (k+1) = λ (k) 1 trace ( F(λ (k) ) 1 F (λ (k) ) ). Potential problems: Inverse of nearly singular F(λ (k) ) as λ (k) λ. Requires F (z) explicitly. Computationally expensive. Initialization? University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 4 / 36

6 Newton s Method for Scalar Function (Cont.) Kublanovskaya f (z) = r nn (z), where r nn (z) is (n, n) entry of R in rank-revealing QR decomposition of F(z), F(z)Π(z) = Q(z)R(z). This yields the Newton-QR iteration for a root of r nn (z), λ (k+1) = λ (k) 1/(e T n Q kf ( λ (k)) Π k R 1 k e n ). At convergence, we can take x = Π k R 1 k e n, y = Q k e n as approx for the right and left e vecs of the converged e val. University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 5 / 36

7 Newton s Method for Scalar Function (Cont.) Kublanovskaya f (z) = r nn (z), where r nn (z) is (n, n) entry of R in rank-revealing QR decomposition of F(z), F(z)Π(z) = Q(z)R(z). This yields the Newton-QR iteration for a root of r nn (z), λ (k+1) = λ (k) 1/(e T n Q kf ( λ (k)) Π k R 1 k e n ). At convergence, we can take x = Π k R 1 k e n, y = Q k e n as approx for the right and left e vecs of the converged e val. Garret, Bai and Li (2016) propose an efficient implementation for large banded NEPs. MATLAB and C++ implementations including deflation are publicly available. University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 5 / 36

8 Convergence basins [ ] e iz 2 1 F(z) = has e vals 0, ± 2π, ±i 2π in 1 1 Ω = {z C : 3 Re(z) 3, 3 Im(z) 3}. Newton-trace method Newton-QR method University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 6 / 36

9 Convergence basins [ ] e iz 2 1 F(z) = has e vals 0, ± 2π, ±i 2π in 1 1 Ω = {z C : 3 Re(z) 3, 3 Im(z) 3}. Newton-trace method Newton-trace (secant) method University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 6 / 36

10 Newton-QR for Banded NEP Consider the loaded_string problem defined by ( F(λ)v = C 1 λc 2 + λ ) λ σ C 3 v = 0 with C 1, C 2 tridiagonal and C 3 = e n e T n. n = 100. Use NQR4UB [Garret and Li (2013)] to compute the 5 e vals in [4, 296] with lambda0 = 4. Residuals r nn (λ) / F(λ) F at each iter η F (λ i, v i ) = F (λ i )v i 2 F (λ i ) F v i 2 i λ i η F (λ i, v i ) η F (λ i, wi ) e e e e e e e e e e University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 7 / 36

11 Other Variants Many variations based on scalar root finding exist: Newton-LU [Yang 1983, Wobst 1987] BDS (bordered, deletion, substitution) method [Andrew/Chu/Lancaster 1995] implicit determinant method [Spence/Poulton 2005] University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 8 / 36

12 Newton s Method for Vector Equation Applying Newton s method to N [ v λ] = 0 where [ ] [ ] v F(λ)v N = λ u v 1 leads to the Newton s iteration [ ] [ ] [ ] v (k+1) v (k) F(λ λ (k+1) = λ (k) (k) ) F (λ (k) )v (k) 1 [ F(λ (k) )v (k) u 0 u v (k) 1 Other variants include nonlinear inverse iteration [Unger 1950, Ruhe 1973] two-sided Rayleigh functional iteration [Schreiber 2008] residual inverse iteration [Neumaier 1985] ]. University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 9 / 36

13 Iterative Projection Methods for NEPs Let U C n k with k n and U U = I k (search space) and Q C n k, Q Q = I k (test space). Instead of solving F(λ)v = 0, solve k k projected NEP Q F(ϑ)Ux = 0 ( ) University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 10 / 36

14 Iterative Projection Methods for NEPs Let U C n k with k n and U U = I k (search space) and Q C n k, Q Q = I k (test space). Instead of solving F(λ)v = 0, solve k k projected NEP Q F(ϑ)Ux = 0 ( ) Let (ϑ, x) be an e pair of ( ). If F(ϑ)Ux is small enough, accept (ϑ, Ux) as an approximate e pair for F. If not, extend search space into span{u, v} by one step of Newton iteration with initial guess (ϑ, Ux). v solves the Jacobi Davidson correction eqn: (I n F (ϑ)vq )F(ϑ)(I n vv ) v = F(ϑ)v. (Does not need to be solved accurately.) University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 10 / 36

15 Iterative Projection Methods for NEPs Let U C n k with k n and U U = I k (search space) and Q C n k, Q Q = I k (test space). Instead of solving F(λ)v = 0, solve k k projected NEP Q F(ϑ)Ux = 0 ( ) Let (ϑ, x) be an e pair of ( ). If F(ϑ)Ux is small enough, accept (ϑ, Ux) as an approximate e pair for F. If not, extend search space into span{u, v} by one step of Newton iteration with initial guess (ϑ, Ux). v solves the Jacobi Davidson correction eqn: (I n F (ϑ)vq )F(ϑ)(I n vv ) v = F(ϑ)v. (Does not need to be solved accurately.) Variations of Jacobi Davidson for NEPs are proposed by [Hochstenbach and Sleijpen (2003)], [Betcke and Voss (2004)], [Voss (2007)] and [Effenberger (2013)]. University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 10 / 36

16 Deflation of Computed Eigenpairs Prevent the iteration from converging to already computed eigenpairs. Maps the already computed eigenvalues to infinity. Suppose we have computed l simple e vals of F, λ 1,..., λ l and let x i, y i C n be s.t. yi x i = 1, i = 1,..., l. Let l ( ) F(z) = F(z) i=1 I z λ i 1 z λ i Then Λ( F) = Λ(F) { } \ {λ 1,..., λ l }. i=1 y i x i If ṽ is an e vec of F with e val λ then l ( v = I z λ i 1 ) y z λ i xi ṽ i is an e vec of F associated with the e val λ. [Ferng et al. (2001)], [Huang et al. (2016)]. University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 11 / 36.

17 Robust Succesive Computation of Eigenpairs Suppose we have already computed a minimal invariant pair (V, M) C n m C m m for F. Extend (V, M) into one size larger minimal invariant pair ( [ ]) ( V, M) M b = [ V x ], C n (m+1) C (m+1) (m+1). 0 λ [Effenberger (2013)] shows that ( λ, [ x b]) is an eigenpair of an (n + m) (n + m) NEP F(λ) [ x b] = 0. Solve F(λ) [ x b] = 0 by any of the previous methods. University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 12 / 36

18 Block-Newton Method (V, M) C n m C m m is an invariant pair for F H(Ω, C n n ) if F(V, M) = C 1 Vf 1 (Λ) + C 2 Vf 2 (Λ) + + C l Vf l (Λ) = 0 n m. Add normalization condition: N (V, M) = 0 m m. [Kressner (2009)] showed that (V, M) is complete iff Jacobian M : C n m C m m C n m C m m ( V, M) ( L F ( V, M), L N ( V, M) ) is invertible. Newton correction ( V, M) satisfies M( V, M) = ( F ( V, M ), O m m ). University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 13 / 36

19 Safeguarded Iteration for Hermitian NEPs Assume F( z) = F(z) for all z C and that if λ k is a kth eigenvalue of F(z) (i.e., µ = 0 is the kth largest eigenvalue of the Hermitian matrix F(λ k )), then (see Part I) λ k = min V S k V K(p) max p(x) I. x V K(p) x 0 This suggests the safeguarded iteration [Werner 1970]: 1 Choose an initial approx λ (0) to jth e val of F. 2 For k = 0, 1,... until convergence 3 Compute e vec x (k) of jth largest e val of F ( λ (k)). 4 Compute real root ρ of x (k) F(ρ)x (k) = 0 closest to λ (k) 5 set λ (k+1) = ρ. 6 end University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 14 / 36

20 Safeguarded Iteration for Hermitian NEPs Assume F( z) = F(z) for all z C and that if λ k is a kth eigenvalue of F(z) (i.e., µ = 0 is the kth largest eigenvalue of the Hermitian matrix F(λ k )), then (see Part I) λ k = min V S k V K(p) max p(x) I. x V K(p) x 0 This suggests the safeguarded iteration [Werner 1970]: 1 Choose an initial approx λ (0) to jth e val of F. 2 For k = 0, 1,... until convergence 3 Compute e vec x (k) of jth largest e val of F ( λ (k)). 4 Compute real root ρ of x (k) F(ρ)x (k) = 0 closest to λ (k) 5 set λ (k+1) = ρ. 6 end Local quadratic convergence [Niendorf and Voss (2010)]. University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 14 / 36

21 Methods Based on Contour Integration Given F H(Ω, C n n ). By Keldysh s theorem we have F(z) 1 = V (zi J) 1 W + R(z) on some closed set Σ Ω, where J is an m m Jordan block matrix containing all the eigenvalues Λ(F) Σ. University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 15 / 36

22 Methods Based on Contour Integration Given F H(Ω, C n n ). By Keldysh s theorem we have F(z) 1 = V (zi J) 1 W + R(z) on some closed set Σ Ω, where J is an m m Jordan block matrix containing all the eigenvalues Λ(F) Σ. Let Γ Ω be a contour enclosing the eigenvalues of J, let X C n r be a probing matrix, and f H(Ω, C) (filter function). Then A f := 1 f (z)f(z) 1 Xδz 2πi Γ = 1 f (z)v (zi J) 1 W Xδz 2πi Γ = Vf (J)W X. University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 15 / 36

23 Beyn s Integral Approach Construct 1 A 0 := F(z) 1 Xδz = V W X 2πi Γ A 1 := 1 z F(z) 1 Xδz = V J W X. 2πi Γ Assuming that V, W, and W X are of full rank m, can show that e vals of λa 0 A 1 are e vals of F inside Γ. [Asakura 2009] [Beyn 2012] [Yokota/Sakurai 2013] University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 16 / 36

24 Beyn s Integral Approach Construct 1 A 0 := F(z) 1 Xδz = V W X 2πi Γ A 1 := 1 z F(z) 1 Xδz = V J W X. 2πi Γ Assuming that V, W, and W X are of full rank m, can show that e vals of λa 0 A 1 are e vals of F inside Γ. [Asakura 2009] [Beyn 2012] [Yokota/Sakurai 2013] Other filter functions f can be used via A f = 1 f 2πi Γ (z)f(z) 1 Xδz leading to higher-order moments. [Murakami 10] [Güttel et al 15] [Austin/Trefethen 15] [Van Barel 16] University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 16 / 36

25 Quadrature The contour integrals involved in A 0 and A 1 are approximated by numerical quadrature. Let γ : [0, 1] Γ be a parameterization, then n c A j,nc = ω l z j F(γ(t l )) 1 X A j l=1 is a quadrature approximation with n c nodes (j = 1, 2). Note that the n c solves F(γ(t l )) 1 X are completely decoupled and can be assigned to different processors. = Great potential for parallelization! University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 17 / 36

26 Care has to be taken with the quadrature rule The quality of the quadrature approximation determines the accuracy of the computed e vals [Beyn 2012] [Güttel/T. 2017]. Example: Quadrature errors A j A j,nc as n c increases (right) with different quadrature rules on (almost) square contour (left) eigenvalues domain + conformal square Bernstein ellipse 10-2 O(ρ nc ) conformal trapezoid Gauss-Legendre O(n 2 c ) University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 18 / 36

27 Methods based on linear interpolation Instead of solving F(λ)v = 0 directly, we may approximate F R m on Σ C by simpler NEP and solve R m (λ)v = 0. University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 19 / 36

28 Methods based on linear interpolation Instead of solving F(λ)v = 0 directly, we may approximate F R m on Σ C by simpler NEP and solve R m (λ)v = 0. Practical approach: Rational form R m (z) = b 0 (z)d 0 + b 1 (z)d b m (z)d m where D j C n n are fixed and b j are rational functions. University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 19 / 36

29 Methods based on linear interpolation Instead of solving F(λ)v = 0 directly, we may approximate F R m on Σ C by simpler NEP and solve R m (λ)v = 0. Practical approach: Rational form R m (z) = b 0 (z)d 0 + b 1 (z)d b m (z)d m where D j C n n are fixed and b j are rational functions. Particularly useful: (scaled) rational Newton basis b 0 (z) 1, b j+1 (z) = z σ j β j+1 (1 z/ξ j+1 ) b j(z) with interpolation points σ j Σ and poles ξ j C \ Σ. Choice of σ j, ξ j, β j by NLEIGS sampling [Güttel et al 2014]. University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 19 / 36

30 NLEIGS sampling Assume F is holomorphic on Ω = C \ Ξ and we target the eigenvalues in Σ Ω. Assume we have chosen nodes σ 0, σ 1,..., σ m Σ and poles ξ 1,..., ξ m Ξ. Define s m (z) := (z σ m )b m (z). By the Hermite Walsh formula we have F(z) R m (z) = 1 s m (z) F(ζ) 2πi s m (ζ) ζ z dζ, and so the uniform approximation error on Σ satisfies F R m Σ := max z Σ F(z) R m(z) 2 C s m Σ s 1 m Γ Γ Aim: Make s m small on Σ and large on Γ. University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 20 / 36

31 NLEIGS sampling of F on Σ Ξ Σ University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 21 / 36

32 NLEIGS sampling of F on Σ 1. Discretize boundaries of Σ and Ξ sufficiently fine. Ξ Σ University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 21 / 36

33 NLEIGS sampling of F on Σ 1. Discretize boundaries of Σ and Ξ sufficiently fine. 2. Choose interpolation node σ 0 Σ and set R 0 (z) F(σ 0 ). Ξ Σ University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 21 / 36

34 NLEIGS sampling of F on Σ 1. Discretize boundaries of Σ and Ξ sufficiently fine. 2. Choose interpolation node σ 0 Σ and set R 0 (z) F(σ 0 ) error F R j Σ Σ Ξ University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 21 /

35 NLEIGS sampling of F on Σ 1. Discretize boundaries of Σ and Ξ sufficiently fine. 2. Choose interpolation node σ 0 Σ and set R 0 (z) F(σ 0 ). 3. For j = 1, 2,..., m choose σ j and ξ j such that max s j 1(z) = s j 1 (σ j ) and min s j 1(z) = s j 1 (ξ j ). z Σ z Ξ 10 0 error F R j Σ Σ Ξ University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 21 /

36 NLEIGS sampling of F on Σ 1. Discretize boundaries of Σ and Ξ sufficiently fine. 2. Choose interpolation node σ 0 Σ and set R 0 (z) F(σ 0 ). 3. For j = 1, 2,..., m choose σ j and ξ j such that max s j 1(z) = s j 1 (σ j ) and min s j 1(z) = s j 1 (ξ j ). z Σ z Ξ Choose β j such that s j Σ = 1 and set D j = F (σ j ) R j 1 (σ j ) b j (σ j ) error F R j Σ Σ Ξ University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 21 /

37 NLEIGS sampling of F on Σ 1. Discretize boundaries of Σ and Ξ sufficiently fine. 2. Choose interpolation node σ 0 Σ and set R 0 (z) F(σ 0 ). 3. For j = 1, 2,..., m choose σ j and ξ j such that max s j 1(z) = s j 1 (σ j ) and min s j 1(z) = s j 1 (ξ j ). z Σ z Ξ Choose β j such that s j Σ = 1 and set D j = F (σ j ) R j 1 (σ j ) b j (σ j ) error F R j Σ Σ Ξ University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 21 /

38 NLEIGS sampling of F on Σ 1. Discretize boundaries of Σ and Ξ sufficiently fine. 2. Choose interpolation node σ 0 Σ and set R 0 (z) F(σ 0 ). 3. For j = 1, 2,..., m choose σ j and ξ j such that max s j 1(z) = s j 1 (σ j ) and min s j 1(z) = s j 1 (ξ j ). z Σ z Ξ Choose β j such that s j Σ = 1 and set D j = F (σ j ) R j 1 (σ j ) b j (σ j ) error F R j Σ Σ Ξ University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 21 /

39 NLEIGS sampling of F on Σ 1. Discretize boundaries of Σ and Ξ sufficiently fine. 2. Choose interpolation node σ 0 Σ and set R 0 (z) F(σ 0 ). 3. For j = 1, 2,..., m choose σ j and ξ j such that max s j 1(z) = s j 1 (σ j ) and min s j 1(z) = s j 1 (ξ j ). z Σ z Ξ Choose β j such that s j Σ = 1 and set D j = F (σ j ) R j 1 (σ j ) b j (σ j ) error F R j Σ Σ Ξ University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 21 /

40 NLEIGS sampling of F on Σ 1. Discretize boundaries of Σ and Ξ sufficiently fine. 2. Choose interpolation node σ 0 Σ and set R 0 (z) F(σ 0 ). 3. For j = 1, 2,..., m choose σ j and ξ j such that max s j 1(z) = s j 1 (σ j ) and min s j 1(z) = s j 1 (ξ j ). z Σ z Ξ Choose β j such that s j Σ = 1 and set D j = F (σ j ) R j 1 (σ j ) b j (σ j ) error F R j Σ Σ Ξ University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 21 /

41 NLEIGS sampling of F on Σ 1. Discretize boundaries of Σ and Ξ sufficiently fine. 2. Choose interpolation node σ 0 Σ and set R 0 (z) F(σ 0 ). 3. For j = 1, 2,..., m choose σ j and ξ j such that max s j 1(z) = s j 1 (σ j ) and min s j 1(z) = s j 1 (ξ j ). z Σ z Ξ Choose β j such that s j Σ = 1 and set D j = F (σ j ) R j 1 (σ j ) b j (σ j ) error F R j Σ /cap(Σ,Ξ) Σ Ξ University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 21 / 36

42 Krylov solution Interpolation techniques can be combined with linearization of R m structured GEP A m x = λb m x rational Krylov algorithms for solving GEP dynamic increase of degree m during Krylov iteration = infinite Arnoldi method [Jarlebring et al 2012] compact Krylov basis storage of [Lu, Su, Bai 2016] = CORK [Van Beeumen et al 2015]. University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 22 / 36

43 Krylov solution Interpolation techniques can be combined with linearization of R m structured GEP A m x = λb m x rational Krylov algorithms for solving GEP dynamic increase of degree m during Krylov iteration = infinite Arnoldi method [Jarlebring et al 2012] compact Krylov basis storage of [Lu, Su, Bai 2016] = CORK [Van Beeumen et al 2015]. NLEIGS implementations are available in the SLEPc library version 3.7 [Campos & Roman 2016] Rational Krylov Toolbox [Berljafa & Güttel 2015]. University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 22 / 36

44 Concluding Remarks NEPs have interesting mathematical properties. They arise in many applications and their efficient solution requires ideas from numerical linear algebra, complex analysis, and approximation theory (among other fields). University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 23 / 36

45 Concluding Remarks NEPs have interesting mathematical properties. They arise in many applications and their efficient solution requires ideas from numerical linear algebra, complex analysis, and approximation theory (among other fields). There is more to be said, e.g., Structured NEPs? Higher-order integral moments Preconditioning/scaling of linearizations Implementation, software packages University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 23 / 36

46 References I A. L. Andrew, K. E. Chu, and P. Lancaster. On the numerical solution of nonlinear eigenvalue problems. Computing, 55:91 111, J. Asakura, T. Sakurai, H. Tadano, T. Ikegami, and K. Kimura. A numerical method for nonlinear eigenvalue problems using contour integral. JSIAM Letters, 1:52 55, University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 24 / 36

47 References II M. Berljafa and S. Güttel. A Rational Krylov Toolbox for MATLAB. MIMS EPrint , Manchester Institute for Mathematical Sciences, The University of Manchester, UK, Available for download at T. Betcke and H. Voss. A Jacobi Davidson-type projection method for nonlinear eigenvalue problems. Future Generation Computer Systems, 20(3): , University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 25 / 36

48 References III W.-J. Beyn. An integral method for solving nonlinear eigenvalue problems. Linear Algebra Appl., 436(10): , C. Campos and J. E. Roman. Parallel Krylov solvers for the polynomial eigenvalue problem in SLEPc. SIAM J. Sci. Comput., 38(5):S385 S411, C. Effenberger. Robust successive computation of eigenpairs for nonlinear eigenvalue problems. SIAM J. Matrix Anal. Appl., 34(3): , University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 26 / 36

49 References IV W. R. Ferng, W.-W. Lin, D. J. Pierce, and C.-S. Wang. Nonequivalence transformation of λ-matrices eigenproblems and model embedding approach to model tuning. Numer. Linear Algebra Appl., 8(1):53 70, C. K. Garrett, Z. Bai, and R.-C. Li. A nonlinear QR algorithm for banded nonlinear eigenvalue problems. ACM Trans. Math. Software, 43(1):4:1 4:19, University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 27 / 36

50 References V C. K. Garrett and R.-C. Li. Unstructurally banded nonlinear. eigenvalue solver software, http: // S. Güttel and F. Tisseur. The nonlinear eigenvalue problem. In Acta Numerica, volume 26, pages Cambridge University Press, University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 28 / 36

51 References VI S. Güttel, R. Van Beeumen, K. Meerbergen, and W. Michiels. NLEIGS: A class of fully rational Krylov methods for nonlinear eigenvalue problems. SIAM J. Sci. Comput., 36(6):A2842 A2864, M. E. Hochstenbach and G. L. Sleijpen. Two-sided and alternating Jacobi Davidson. Linear Algebra Appl., 358(1): , T.-M. Huang, W.-W. Lin, and V. Mehrmann. A Newton-type method with nonequivalence deflation for nonlinear eigenvalue problems arising in photonic crystal modeling. SIAM J. Sci. Comput., 38(2):B191 B218, University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 29 / 36

52 References VII E. Jarlebring, K. Meerbergen, and W. Michiels. The infinite Arnoldi method and an application to time-delay systems with distributed delay. In R. Sipahi, T. Vyhlídal, S.-I. Niculescu, and P. Pepe, editors, Time Delay Systems: Methods, Applications and New Trends, volume 423 of Lecture Notes in Control and Information Sciences, pages Springer-Verlag, Berlin, D. Kressner. A block Newton method for nonlinear eigenvalue problems. Numer. Math., 114(2): , University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 30 / 36

53 References VIII V. N. Kublanovskaya. On an approach to the solution of the generalized latent value problem for λ-matrices. SIAM J. Numer. Anal., 7: , P. Lancaster. Lambda-Matrices and Vibrating Systems. Pergamon Press, Oxford, ISBN Reprinted by Dover, New York, University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 31 / 36

54 References IX D. Lu, Y. Su, and Z. Bai. Stability analysis of the two-level orthogonal Arnoldi procedure. SIAM J. Matrix Anal. Appl., 37(1): , A. Neumaier. Residual inverse iteration for the nonlinear eigenvalue problem. SIAM J. Numer. Anal., 22(5): , V. Niendorf and H. Voss. Detecting hyperbolic and definite matrix polynomials. Linear Algebra Appl., 432: , University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 32 / 36

55 References X A. Ruhe. Algorithms for the nonlinear eigenvalue problem. SIAM J. Numer. Anal., 10: , K. Schreiber. Nonlinear Eigenvalue Problems: Newton-type methods and Nonlinear Rayleigh Functionals. PhD thesis, Technischen Universitat Berlin, Germany, A. Spence and C. Poulton. Photonic band structure calculations using nonlinear eigenvalue techniques. J. Comput. Phys., 204(1):65 81, University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 33 / 36

56 References XI H. Unger. Nichtlineare Behandlung von Eigenwertaufgaben. ZAMM Z. Angew. Math. Mech., 30(8-9): , M. Van Barel. Designing rational filter functions for solving eigenvalue problems by contour integration. Linear Algebra Appl., 502: , R. Van Beeumen, K. Meerbergen, and W. Michiels. Compact rational Krylov methods for nonlinear eigenvalue problems. SIAM J. Matrix Anal. Appl., 36(2): , University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 34 / 36

57 References XII H. Voss. A Jacobi Davidson method for nonlinear and nonsymmetric eigenproblems. Computers and Structures, 85: , B. Werner. Das Spektrum von Operatorenscharen mit verallgemeinerten Rayleighquotienten. PhD thesis, Universität Hamburg, Hamburg, Germany, R. Wobst. The generalized eigenvalue problem and acoustic surface wave computations. Computing, 39:57 69, University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 35 / 36

58 References XIII W. H. Yang. A method for eigenvalues of sparse λ-matrices. Internat. J. Numer. Methods Eng., 19: , S. Yokota and T. Sakurai. A projection method for nonlinear eigenvalue problems using contour integrals. JSIAM Letters, 5:41 44, University of Manchester Françoise Tisseur The nonlinear eigenvalue problem 36 / 36

Research Matters. February 25, The Nonlinear Eigenvalue Problem. Nick Higham. Part III. Director of Research School of Mathematics

Research Matters. February 25, The Nonlinear Eigenvalue Problem. Nick Higham. Part III. Director of Research School of Mathematics Research Matters February 25, 2009 The Nonlinear Eigenvalue Problem Nick Higham Part III Director of Research School of Mathematics Françoise Tisseur School of Mathematics The University of Manchester

More information

Research Matters. February 25, The Nonlinear Eigenvalue. Director of Research School of Mathematics

Research Matters. February 25, The Nonlinear Eigenvalue. Director of Research School of Mathematics Research Matters February 25, 2009 The Nonlinear Eigenvalue Nick Problem: HighamPart I Director of Research School of Mathematics Françoise Tisseur School of Mathematics The University of Manchester Woudschoten

More information

An Algorithm for. Nick Higham. Françoise Tisseur. Director of Research School of Mathematics.

An Algorithm for. Nick Higham. Françoise Tisseur. Director of Research School of Mathematics. An Algorithm for the Research Complete Matters Solution of Quadratic February Eigenvalue 25, 2009 Problems Nick Higham Françoise Tisseur Director of Research School of Mathematics The School University

More information

Nonlinear Eigenvalue Problems and Contour Integrals

Nonlinear Eigenvalue Problems and Contour Integrals Nonlinear Eigenvalue Problems and Contour Integrals Marc Van Barel a,,, Peter Kravanja a a KU Leuven, Department of Computer Science, Celestijnenlaan 200A, B-300 Leuven (Heverlee), Belgium Abstract In

More information

A numerical method for polynomial eigenvalue problems using contour integral

A numerical method for polynomial eigenvalue problems using contour integral A numerical method for polynomial eigenvalue problems using contour integral Junko Asakura a Tetsuya Sakurai b Hiroto Tadano b Tsutomu Ikegami c Kinji Kimura d a Graduate School of Systems and Information

More information

Algorithms for Solving the Polynomial Eigenvalue Problem

Algorithms for Solving the Polynomial Eigenvalue Problem Algorithms for Solving the Polynomial Eigenvalue Problem Nick Higham School of Mathematics The University of Manchester higham@ma.man.ac.uk http://www.ma.man.ac.uk/~higham/ Joint work with D. Steven Mackey

More information

Arnoldi Methods in SLEPc

Arnoldi Methods in SLEPc Scalable Library for Eigenvalue Problem Computations SLEPc Technical Report STR-4 Available at http://slepc.upv.es Arnoldi Methods in SLEPc V. Hernández J. E. Román A. Tomás V. Vidal Last update: October,

More information

Scaling, Sensitivity and Stability in Numerical Solution of the Quadratic Eigenvalue Problem

Scaling, Sensitivity and Stability in Numerical Solution of the Quadratic Eigenvalue Problem Scaling, Sensitivity and Stability in Numerical Solution of the Quadratic Eigenvalue Problem Nick Higham School of Mathematics The University of Manchester higham@ma.man.ac.uk http://www.ma.man.ac.uk/~higham/

More information

Recent Advances in the Numerical Solution of Quadratic Eigenvalue Problems

Recent Advances in the Numerical Solution of Quadratic Eigenvalue Problems Recent Advances in the Numerical Solution of Quadratic Eigenvalue Problems Françoise Tisseur School of Mathematics The University of Manchester ftisseur@ma.man.ac.uk http://www.ma.man.ac.uk/~ftisseur/

More information

The quadratic eigenvalue problem (QEP) is to find scalars λ and nonzero vectors u satisfying

The quadratic eigenvalue problem (QEP) is to find scalars λ and nonzero vectors u satisfying I.2 Quadratic Eigenvalue Problems 1 Introduction The quadratic eigenvalue problem QEP is to find scalars λ and nonzero vectors u satisfying where Qλx = 0, 1.1 Qλ = λ 2 M + λd + K, M, D and K are given

More information

Solving the Polynomial Eigenvalue Problem by Linearization

Solving the Polynomial Eigenvalue Problem by Linearization Solving the Polynomial Eigenvalue Problem by Linearization Nick Higham School of Mathematics The University of Manchester higham@ma.man.ac.uk http://www.ma.man.ac.uk/~higham/ Joint work with Ren-Cang Li,

More information

KU Leuven Department of Computer Science

KU Leuven Department of Computer Science Compact rational Krylov methods for nonlinear eigenvalue problems Roel Van Beeumen Karl Meerbergen Wim Michiels Report TW 651, July 214 KU Leuven Department of Computer Science Celestinenlaan 2A B-31 Heverlee

More information

Contour Integral Method for the Simulation of Accelerator Cavities

Contour Integral Method for the Simulation of Accelerator Cavities Contour Integral Method for the Simulation of Accelerator Cavities V. Pham-Xuan, W. Ackermann and H. De Gersem Institut für Theorie Elektromagnetischer Felder DESY meeting (14.11.2017) November 14, 2017

More information

Rational Interpolation Methods for Nonlinear Eigenvalue Problems

Rational Interpolation Methods for Nonlinear Eigenvalue Problems Rational Interpolation Methods for Nonlinear Eigenvalue Problems Michael Brennan Thesis submitted to the Faculty of the Virginia Polytechnic Institute and State University in partial fulfillment of the

More information

An Arnoldi method with structured starting vectors for the delay eigenvalue problem

An Arnoldi method with structured starting vectors for the delay eigenvalue problem An Arnoldi method with structured starting vectors for the delay eigenvalue problem Elias Jarlebring, Karl Meerbergen, Wim Michiels Department of Computer Science, K.U. Leuven, Celestijnenlaan 200 A, 3001

More information

Iterative projection methods for sparse nonlinear eigenvalue problems

Iterative projection methods for sparse nonlinear eigenvalue problems Iterative projection methods for sparse nonlinear eigenvalue problems Heinrich Voss voss@tu-harburg.de Hamburg University of Technology Institute of Mathematics TUHH Heinrich Voss Iterative projection

More information

Keeping σ fixed for several steps, iterating on µ and neglecting the remainder in the Lagrange interpolation one obtains. θ = λ j λ j 1 λ j σ, (2.

Keeping σ fixed for several steps, iterating on µ and neglecting the remainder in the Lagrange interpolation one obtains. θ = λ j λ j 1 λ j σ, (2. RATIONAL KRYLOV FOR NONLINEAR EIGENPROBLEMS, AN ITERATIVE PROJECTION METHOD ELIAS JARLEBRING AND HEINRICH VOSS Key words. nonlinear eigenvalue problem, rational Krylov, Arnoldi, projection method AMS subject

More information

A Nonlinear QR Algorithm for Banded Nonlinear Eigenvalue Problems

A Nonlinear QR Algorithm for Banded Nonlinear Eigenvalue Problems A Nonlinear QR Algorithm for Banded Nonlinear Eigenvalue Problems C. KRISTOPHER GARRETT, Computational Physics and Methods, Los Alamos National Laboratory ZHAOJUN BAI, Department of Computer Science and

More information

An Arnoldi Method for Nonlinear Symmetric Eigenvalue Problems

An Arnoldi Method for Nonlinear Symmetric Eigenvalue Problems An Arnoldi Method for Nonlinear Symmetric Eigenvalue Problems H. Voss 1 Introduction In this paper we consider the nonlinear eigenvalue problem T (λ)x = 0 (1) where T (λ) R n n is a family of symmetric

More information

Available online at ScienceDirect. Procedia Engineering 100 (2015 ) 56 63

Available online at   ScienceDirect. Procedia Engineering 100 (2015 ) 56 63 Available online at www.sciencedirect.com ScienceDirect Procedia Engineering 100 (2015 ) 56 63 25th DAAAM International Symposium on Intelligent Manufacturing and Automation, DAAAM 2014 Definite Quadratic

More information

A Jacobi Davidson Method for Nonlinear Eigenproblems

A Jacobi Davidson Method for Nonlinear Eigenproblems A Jacobi Davidson Method for Nonlinear Eigenproblems Heinrich Voss Section of Mathematics, Hamburg University of Technology, D 21071 Hamburg voss @ tu-harburg.de http://www.tu-harburg.de/mat/hp/voss Abstract.

More information

NUMERICAL COMPUTATION IN SCIENCE AND ENGINEERING

NUMERICAL COMPUTATION IN SCIENCE AND ENGINEERING NUMERICAL COMPUTATION IN SCIENCE AND ENGINEERING C. Pozrikidis University of California, San Diego New York Oxford OXFORD UNIVERSITY PRESS 1998 CONTENTS Preface ix Pseudocode Language Commands xi 1 Numerical

More information

Numerical Methods in Matrix Computations

Numerical Methods in Matrix Computations Ake Bjorck Numerical Methods in Matrix Computations Springer Contents 1 Direct Methods for Linear Systems 1 1.1 Elements of Matrix Theory 1 1.1.1 Matrix Algebra 2 1.1.2 Vector Spaces 6 1.1.3 Submatrices

More information

Nonlinear Eigenvalue Problems: An Introduction

Nonlinear Eigenvalue Problems: An Introduction Nonlinear Eigenvalue Problems: An Introduction Cedric Effenberger Seminar for Applied Mathematics ETH Zurich Pro*Doc Workshop Disentis, August 18 21, 2010 Cedric Effenberger (SAM, ETHZ) NLEVPs: An Introduction

More information

Nonlinear Eigenvalue Problems: Interpolatory Algorithms and Transient Dynamics

Nonlinear Eigenvalue Problems: Interpolatory Algorithms and Transient Dynamics Nonlinear Eigenvalue Problems: Interpolatory Algorithms and Transient Dynamics Mark Embree Virginia Tech with Serkan Gugercin Jonathan Baker, Michael Brennan, Alexander Grimm Virginia Tech SIAM Conference

More information

Finding Rightmost Eigenvalues of Large, Sparse, Nonsymmetric Parameterized Eigenvalue Problems

Finding Rightmost Eigenvalues of Large, Sparse, Nonsymmetric Parameterized Eigenvalue Problems Finding Rightmost Eigenvalues of Large, Sparse, Nonsymmetric Parameterized Eigenvalue Problems AMSC 663-664 Final Report Minghao Wu AMSC Program mwu@math.umd.edu Dr. Howard Elman Department of Computer

More information

Polynomial eigenvalue solver based on tropically scaled Lagrange linearization. Van Barel, Marc and Tisseur, Francoise. MIMS EPrint: 2016.

Polynomial eigenvalue solver based on tropically scaled Lagrange linearization. Van Barel, Marc and Tisseur, Francoise. MIMS EPrint: 2016. Polynomial eigenvalue solver based on tropically scaled Lagrange linearization Van Barel, Marc and Tisseur, Francoise 2016 MIMS EPrint: 201661 Manchester Institute for Mathematical Sciences School of Mathematics

More information

Polynomial Jacobi Davidson Method for Large/Sparse Eigenvalue Problems

Polynomial Jacobi Davidson Method for Large/Sparse Eigenvalue Problems Polynomial Jacobi Davidson Method for Large/Sparse Eigenvalue Problems Tsung-Ming Huang Department of Mathematics National Taiwan Normal University, Taiwan April 28, 2011 T.M. Huang (Taiwan Normal Univ.)

More information

A Domain Decomposition Based Jacobi-Davidson Algorithm for Quantum Dot Simulation

A Domain Decomposition Based Jacobi-Davidson Algorithm for Quantum Dot Simulation A Domain Decomposition Based Jacobi-Davidson Algorithm for Quantum Dot Simulation Tao Zhao 1, Feng-Nan Hwang 2 and Xiao-Chuan Cai 3 Abstract In this paper, we develop an overlapping domain decomposition

More information

1. Introduction. In this paper we consider the large and sparse eigenvalue problem. Ax = λx (1.1) T (λ)x = 0 (1.2)

1. Introduction. In this paper we consider the large and sparse eigenvalue problem. Ax = λx (1.1) T (λ)x = 0 (1.2) A NEW JUSTIFICATION OF THE JACOBI DAVIDSON METHOD FOR LARGE EIGENPROBLEMS HEINRICH VOSS Abstract. The Jacobi Davidson method is known to converge at least quadratically if the correction equation is solved

More information

Rational Krylov Decompositions: Theory and Applications. Berljafa, Mario. MIMS EPrint:

Rational Krylov Decompositions: Theory and Applications. Berljafa, Mario. MIMS EPrint: Rational Krylov Decompositions: Theory and Applications Berljafa, Mario 2017 MIMS EPrint: 2017.6 Manchester Institute for Mathematical Sciences School of Mathematics The University of Manchester Reports

More information

Quadratic Matrix Polynomials

Quadratic Matrix Polynomials Research Triangularization Matters of Quadratic Matrix Polynomials February 25, 2009 Nick Françoise Higham Tisseur Director School of of Research Mathematics The University of Manchester School of Mathematics

More information

Solving large sparse eigenvalue problems

Solving large sparse eigenvalue problems Solving large sparse eigenvalue problems Mario Berljafa Stefan Güttel June 2015 Contents 1 Introduction 1 2 Extracting approximate eigenpairs 2 3 Accuracy of the approximate eigenpairs 3 4 Expanding the

More information

HARMONIC RAYLEIGH RITZ EXTRACTION FOR THE MULTIPARAMETER EIGENVALUE PROBLEM

HARMONIC RAYLEIGH RITZ EXTRACTION FOR THE MULTIPARAMETER EIGENVALUE PROBLEM HARMONIC RAYLEIGH RITZ EXTRACTION FOR THE MULTIPARAMETER EIGENVALUE PROBLEM MICHIEL E. HOCHSTENBACH AND BOR PLESTENJAK Abstract. We study harmonic and refined extraction methods for the multiparameter

More information

Matrix Algorithms. Volume II: Eigensystems. G. W. Stewart H1HJ1L. University of Maryland College Park, Maryland

Matrix Algorithms. Volume II: Eigensystems. G. W. Stewart H1HJ1L. University of Maryland College Park, Maryland Matrix Algorithms Volume II: Eigensystems G. W. Stewart University of Maryland College Park, Maryland H1HJ1L Society for Industrial and Applied Mathematics Philadelphia CONTENTS Algorithms Preface xv xvii

More information

SOLVING RATIONAL EIGENVALUE PROBLEMS VIA LINEARIZATION

SOLVING RATIONAL EIGENVALUE PROBLEMS VIA LINEARIZATION SOLVNG RATONAL EGENVALUE PROBLEMS VA LNEARZATON YANGFENG SU AND ZHAOJUN BA Abstract Rational eigenvalue problem is an emerging class of nonlinear eigenvalue problems arising from a variety of physical

More information

DELFT UNIVERSITY OF TECHNOLOGY

DELFT UNIVERSITY OF TECHNOLOGY DELFT UNIVERSITY OF TECHNOLOGY REPORT 10-12 Large-Scale Eigenvalue Problems in Trust-Region Calculations Marielba Rojas, Bjørn H. Fotland, and Trond Steihaug ISSN 1389-6520 Reports of the Department of

More information

Preconditioned inverse iteration and shift-invert Arnoldi method

Preconditioned inverse iteration and shift-invert Arnoldi method Preconditioned inverse iteration and shift-invert Arnoldi method Melina Freitag Department of Mathematical Sciences University of Bath CSC Seminar Max-Planck-Institute for Dynamics of Complex Technical

More information

Solving Polynomial Eigenproblems by Linearization

Solving Polynomial Eigenproblems by Linearization Solving Polynomial Eigenproblems by Linearization Nick Higham School of Mathematics University of Manchester higham@ma.man.ac.uk http://www.ma.man.ac.uk/~higham/ Joint work with D. Steven Mackey and Françoise

More information

KU Leuven Department of Computer Science

KU Leuven Department of Computer Science Backward error of polynomial eigenvalue problems solved by linearization of Lagrange interpolants Piers W. Lawrence Robert M. Corless Report TW 655, September 214 KU Leuven Department of Computer Science

More information

HOMOGENEOUS JACOBI DAVIDSON. 1. Introduction. We study a homogeneous Jacobi Davidson variant for the polynomial eigenproblem

HOMOGENEOUS JACOBI DAVIDSON. 1. Introduction. We study a homogeneous Jacobi Davidson variant for the polynomial eigenproblem HOMOGENEOUS JACOBI DAVIDSON MICHIEL E. HOCHSTENBACH AND YVAN NOTAY Abstract. We study a homogeneous variant of the Jacobi Davidson method for the generalized and polynomial eigenvalue problem. Special

More information

Nonlinear eigenvalue problems - A Review

Nonlinear eigenvalue problems - A Review Nonlinear eigenvalue problems - A Review Namita Behera Department of Electrical Engineering Indian Institute of Technology Bombay Mumbai 8 th March, 2016 Outline 1 Nonlinear Eigenvalue Problems 2 Polynomial

More information

The parallel rational Arnoldi algorithm

The parallel rational Arnoldi algorithm The parallel rational Arnoldi algorithm Mario Berljafa Stefan Güttel May 016 Contents 1 Introduction 1 Parallelization strategies 1 3 Basic usage 1 Near-optimal continuation strategy 3 5 Links to numerical

More information

AMS526: Numerical Analysis I (Numerical Linear Algebra) Lecture 23: GMRES and Other Krylov Subspace Methods; Preconditioning

AMS526: Numerical Analysis I (Numerical Linear Algebra) Lecture 23: GMRES and Other Krylov Subspace Methods; Preconditioning AMS526: Numerical Analysis I (Numerical Linear Algebra) Lecture 23: GMRES and Other Krylov Subspace Methods; Preconditioning Xiangmin Jiao SUNY Stony Brook Xiangmin Jiao Numerical Analysis I 1 / 18 Outline

More information

Solution of eigenvalue problems. Subspace iteration, The symmetric Lanczos algorithm. Harmonic Ritz values, Jacobi-Davidson s method

Solution of eigenvalue problems. Subspace iteration, The symmetric Lanczos algorithm. Harmonic Ritz values, Jacobi-Davidson s method Solution of eigenvalue problems Introduction motivation Projection methods for eigenvalue problems Subspace iteration, The symmetric Lanczos algorithm Nonsymmetric Lanczos procedure; Implicit restarts

More information

that determines x up to a complex scalar of modulus 1, in the real case ±1. Another condition to normalize x is by requesting that

that determines x up to a complex scalar of modulus 1, in the real case ±1. Another condition to normalize x is by requesting that Chapter 3 Newton methods 3. Linear and nonlinear eigenvalue problems When solving linear eigenvalue problems we want to find values λ C such that λi A is singular. Here A F n n is a given real or complex

More information

Numerical Methods I Solving Nonlinear Equations

Numerical Methods I Solving Nonlinear Equations Numerical Methods I Solving Nonlinear Equations Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 MATH-GA 2011.003 / CSCI-GA 2945.003, Fall 2014 October 16th, 2014 A. Donev (Courant Institute)

More information

A block Newton method for nonlinear eigenvalue problems

A block Newton method for nonlinear eigenvalue problems A block Newton method for nonlinear eigenvalue problems Daniel Kressner July 20, 2009 Abstract We consider matrix eigenvalue problems that are nonlinear in the eigenvalue parameter. One of the most fundamental

More information

Improved Newton s method with exact line searches to solve quadratic matrix equation

Improved Newton s method with exact line searches to solve quadratic matrix equation Journal of Computational and Applied Mathematics 222 (2008) 645 654 wwwelseviercom/locate/cam Improved Newton s method with exact line searches to solve quadratic matrix equation Jian-hui Long, Xi-yan

More information

arxiv: v1 [math.na] 15 Feb 2012

arxiv: v1 [math.na] 15 Feb 2012 COMPUTING A PARTIAL SCHUR FACTORIZATION OF NONLINEAR EIGENVALUE PROBLEMS USING THE INFINITE ARNOLDI METHOD ELIAS JARLEBRING, KARL MEERBERGEN, WIM MICHIELS arxiv:1202.3235v1 [math.na] 15 Feb 2012 Abstract.

More information

Exponentials of Symmetric Matrices through Tridiagonal Reductions

Exponentials of Symmetric Matrices through Tridiagonal Reductions Exponentials of Symmetric Matrices through Tridiagonal Reductions Ya Yan Lu Department of Mathematics City University of Hong Kong Kowloon, Hong Kong Abstract A simple and efficient numerical algorithm

More information

The Lanczos and conjugate gradient algorithms

The Lanczos and conjugate gradient algorithms The Lanczos and conjugate gradient algorithms Gérard MEURANT October, 2008 1 The Lanczos algorithm 2 The Lanczos algorithm in finite precision 3 The nonsymmetric Lanczos algorithm 4 The Golub Kahan bidiagonalization

More information

Eigenvalue Problems CHAPTER 1 : PRELIMINARIES

Eigenvalue Problems CHAPTER 1 : PRELIMINARIES Eigenvalue Problems CHAPTER 1 : PRELIMINARIES Heinrich Voss voss@tu-harburg.de Hamburg University of Technology Institute of Mathematics TUHH Heinrich Voss Preliminaries Eigenvalue problems 2012 1 / 14

More information

Square root of a symmetric matrix

Square root of a symmetric matrix Square root of a symmetric matrix Mario Berljafa Stefan Güttel June 2015 Contents 1 Introduction 1 2 Running rkfit 1 3 Evaluating the rational approximant 2 4 Some different choices for the initial poles

More information

of dimension n 1 n 2, one defines the matrix determinants

of dimension n 1 n 2, one defines the matrix determinants HARMONIC RAYLEIGH RITZ FOR THE MULTIPARAMETER EIGENVALUE PROBLEM MICHIEL E. HOCHSTENBACH AND BOR PLESTENJAK Abstract. We study harmonic and refined extraction methods for the multiparameter eigenvalue

More information

A Jacobi Davidson-type projection method for nonlinear eigenvalue problems

A Jacobi Davidson-type projection method for nonlinear eigenvalue problems A Jacobi Davidson-type projection method for nonlinear eigenvalue problems Timo Betce and Heinrich Voss Technical University of Hamburg-Harburg, Department of Mathematics, Schwarzenbergstrasse 95, D-21073

More information

Nick Higham. Director of Research School of Mathematics

Nick Higham. Director of Research School of Mathematics Exploiting Research Tropical Matters Algebra in Numerical February 25, Linear 2009 Algebra Nick Higham Françoise Tisseur Director of Research School of Mathematics The School University of Mathematics

More information

Solution of eigenvalue problems. Subspace iteration, The symmetric Lanczos algorithm. Harmonic Ritz values, Jacobi-Davidson s method

Solution of eigenvalue problems. Subspace iteration, The symmetric Lanczos algorithm. Harmonic Ritz values, Jacobi-Davidson s method Solution of eigenvalue problems Introduction motivation Projection methods for eigenvalue problems Subspace iteration, The symmetric Lanczos algorithm Nonsymmetric Lanczos procedure; Implicit restarts

More information

EIGIFP: A MATLAB Program for Solving Large Symmetric Generalized Eigenvalue Problems

EIGIFP: A MATLAB Program for Solving Large Symmetric Generalized Eigenvalue Problems EIGIFP: A MATLAB Program for Solving Large Symmetric Generalized Eigenvalue Problems JAMES H. MONEY and QIANG YE UNIVERSITY OF KENTUCKY eigifp is a MATLAB program for computing a few extreme eigenvalues

More information

MATHEMATICAL ENGINEERING TECHNICAL REPORTS. Eigenvector Error Bound and Perturbation for Polynomial and Rational Eigenvalue Problems

MATHEMATICAL ENGINEERING TECHNICAL REPORTS. Eigenvector Error Bound and Perturbation for Polynomial and Rational Eigenvalue Problems MATHEMATICAL ENGINEERING TECHNICAL REPORTS Eigenvector Error Bound and Perturbation for Polynomial and Rational Eigenvalue Problems Yuji NAKATSUKASA and Françoise TISSEUR METR 2016 04 April 2016 DEPARTMENT

More information

Numerical Methods I Eigenvalue Problems

Numerical Methods I Eigenvalue Problems Numerical Methods I Eigenvalue Problems Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 MATH-GA 2011.003 / CSCI-GA 2945.003, Fall 2014 October 2nd, 2014 A. Donev (Courant Institute) Lecture

More information

Krylov Subspace Methods for the Evaluation of Matrix Functions. Applications and Algorithms

Krylov Subspace Methods for the Evaluation of Matrix Functions. Applications and Algorithms Krylov Subspace Methods for the Evaluation of Matrix Functions. Applications and Algorithms 2. First Results and Algorithms Michael Eiermann Institut für Numerische Mathematik und Optimierung Technische

More information

Fitting an artificial frequency response

Fitting an artificial frequency response Fitting an artificial frequency response Mario Berljafa Stefan Güttel February 215 Contents 1 Introduction 1 2 Problem setup 1 3 Testing RKFIT 2 4 The rkfun class 3 5 Some other choices for the initial

More information

On the Modification of an Eigenvalue Problem that Preserves an Eigenspace

On the Modification of an Eigenvalue Problem that Preserves an Eigenspace Purdue University Purdue e-pubs Department of Computer Science Technical Reports Department of Computer Science 2009 On the Modification of an Eigenvalue Problem that Preserves an Eigenspace Maxim Maumov

More information

Total least squares. Gérard MEURANT. October, 2008

Total least squares. Gérard MEURANT. October, 2008 Total least squares Gérard MEURANT October, 2008 1 Introduction to total least squares 2 Approximation of the TLS secular equation 3 Numerical experiments Introduction to total least squares In least squares

More information

Applied Numerical Analysis

Applied Numerical Analysis Applied Numerical Analysis Using MATLAB Second Edition Laurene V. Fausett Texas A&M University-Commerce PEARSON Prentice Hall Upper Saddle River, NJ 07458 Contents Preface xi 1 Foundations 1 1.1 Introductory

More information

Introduction. Chapter One

Introduction. Chapter One Chapter One Introduction The aim of this book is to describe and explain the beautiful mathematical relationships between matrices, moments, orthogonal polynomials, quadrature rules and the Lanczos and

More information

ON ORTHOGONAL REDUCTION TO HESSENBERG FORM WITH SMALL BANDWIDTH

ON ORTHOGONAL REDUCTION TO HESSENBERG FORM WITH SMALL BANDWIDTH ON ORTHOGONAL REDUCTION TO HESSENBERG FORM WITH SMALL BANDWIDTH V. FABER, J. LIESEN, AND P. TICHÝ Abstract. Numerous algorithms in numerical linear algebra are based on the reduction of a given matrix

More information

Last Time. Social Network Graphs Betweenness. Graph Laplacian. Girvan-Newman Algorithm. Spectral Bisection

Last Time. Social Network Graphs Betweenness. Graph Laplacian. Girvan-Newman Algorithm. Spectral Bisection Eigenvalue Problems Last Time Social Network Graphs Betweenness Girvan-Newman Algorithm Graph Laplacian Spectral Bisection λ 2, w 2 Today Small deviation into eigenvalue problems Formulation Standard eigenvalue

More information

Math 504 (Fall 2011) 1. (*) Consider the matrices

Math 504 (Fall 2011) 1. (*) Consider the matrices Math 504 (Fall 2011) Instructor: Emre Mengi Study Guide for Weeks 11-14 This homework concerns the following topics. Basic definitions and facts about eigenvalues and eigenvectors (Trefethen&Bau, Lecture

More information

Large scale continuation using a block eigensolver

Large scale continuation using a block eigensolver Universidad Central de Venezuela Facultad de Ciencias Escuela de Computación Lecturas en Ciencias de la Computación ISSN 1316-6239 Large scale continuation using a block eigensolver Z. Castillo RT 2006-03

More information

APPLIED NUMERICAL LINEAR ALGEBRA

APPLIED NUMERICAL LINEAR ALGEBRA APPLIED NUMERICAL LINEAR ALGEBRA James W. Demmel University of California Berkeley, California Society for Industrial and Applied Mathematics Philadelphia Contents Preface 1 Introduction 1 1.1 Basic Notation

More information

Iterative methods for symmetric eigenvalue problems

Iterative methods for symmetric eigenvalue problems s Iterative s for symmetric eigenvalue problems, PhD McMaster University School of Computational Engineering and Science February 11, 2008 s 1 The power and its variants Inverse power Rayleigh quotient

More information

Barycentric interpolation via the AAA algorithm

Barycentric interpolation via the AAA algorithm Barycentric interpolation via the AAA algorithm Steven Elsworth Stefan Güttel November 217 Contents 1 Introduction 1 2 A simple scalar example 1 3 Solving a nonlinear eigenproblem 2 4 References 6 1 Introduction

More information

A HARMONIC RESTARTED ARNOLDI ALGORITHM FOR CALCULATING EIGENVALUES AND DETERMINING MULTIPLICITY

A HARMONIC RESTARTED ARNOLDI ALGORITHM FOR CALCULATING EIGENVALUES AND DETERMINING MULTIPLICITY A HARMONIC RESTARTED ARNOLDI ALGORITHM FOR CALCULATING EIGENVALUES AND DETERMINING MULTIPLICITY RONALD B. MORGAN AND MIN ZENG Abstract. A restarted Arnoldi algorithm is given that computes eigenvalues

More information

ON SYLVESTER S LAW OF INERTIA FOR NONLINEAR EIGENVALUE PROBLEMS

ON SYLVESTER S LAW OF INERTIA FOR NONLINEAR EIGENVALUE PROBLEMS ON SYLVESTER S LAW OF INERTIA FOR NONLINEAR EIGENVALUE PROBLEMS ALEKSANDRA KOSTIĆ AND HEINRICH VOSS Key words. eigenvalue, variational characterization, principle, Sylvester s law of inertia AMS subject

More information

FINDING RIGHTMOST EIGENVALUES OF LARGE SPARSE NONSYMMETRIC PARAMETERIZED EIGENVALUE PROBLEMS

FINDING RIGHTMOST EIGENVALUES OF LARGE SPARSE NONSYMMETRIC PARAMETERIZED EIGENVALUE PROBLEMS FINDING RIGHTMOST EIGENVALUES OF LARGE SPARSE NONSYMMETRIC PARAMETERIZED EIGENVALUE PROBLEMS Department of Mathematics University of Maryland, College Park Advisor: Dr. Howard Elman Department of Computer

More information

Block Bidiagonal Decomposition and Least Squares Problems

Block Bidiagonal Decomposition and Least Squares Problems Block Bidiagonal Decomposition and Least Squares Problems Åke Björck Department of Mathematics Linköping University Perspectives in Numerical Analysis, Helsinki, May 27 29, 2008 Outline Bidiagonal Decomposition

More information

Numerical Mathematics

Numerical Mathematics Alfio Quarteroni Riccardo Sacco Fausto Saleri Numerical Mathematics Second Edition With 135 Figures and 45 Tables 421 Springer Contents Part I Getting Started 1 Foundations of Matrix Analysis 3 1.1 Vector

More information

A Parallel Scalable PETSc-Based Jacobi-Davidson Polynomial Eigensolver with Application in Quantum Dot Simulation

A Parallel Scalable PETSc-Based Jacobi-Davidson Polynomial Eigensolver with Application in Quantum Dot Simulation A Parallel Scalable PETSc-Based Jacobi-Davidson Polynomial Eigensolver with Application in Quantum Dot Simulation Zih-Hao Wei 1, Feng-Nan Hwang 1, Tsung-Ming Huang 2, and Weichung Wang 3 1 Department of

More information

Generalized rational Krylov decompositions with an application to rational approximation. Berljafa, Mario and Güttel, Stefan. MIMS EPrint: 2014.

Generalized rational Krylov decompositions with an application to rational approximation. Berljafa, Mario and Güttel, Stefan. MIMS EPrint: 2014. Generalized rational Krylov decompositions with an application to rational approximation Berljafa, Mario and Güttel, Stefan 2014 MIMS EPrint: 2014.59 Manchester Institute for Mathematical Sciences School

More information

A Jacobi-Davidson method for two real parameter nonlinear eigenvalue problems arising from delay differential equations

A Jacobi-Davidson method for two real parameter nonlinear eigenvalue problems arising from delay differential equations A Jacobi-Davidson method for two real parameter nonlinear eigenvalue problems arising from delay differential equations Heinrich Voss voss@tuhh.de Joint work with Karl Meerbergen (KU Leuven) and Christian

More information

MICHIEL E. HOCHSTENBACH

MICHIEL E. HOCHSTENBACH VARIATIONS ON HARMONIC RAYLEIGH RITZ FOR STANDARD AND GENERALIZED EIGENPROBLEMS MICHIEL E. HOCHSTENBACH Abstract. We present several variations on the harmonic Rayleigh Ritz method. First, we introduce

More information

arxiv: v1 [math.na] 28 Jun 2016

arxiv: v1 [math.na] 28 Jun 2016 Noname manuscript No. (will be inserted by the editor Restarting for the Tensor Infinite Arnoldi method Giampaolo Mele Elias Jarlebring arxiv:1606.08595v1 [math.na] 28 Jun 2016 the date of receipt and

More information

Geometric Modeling Summer Semester 2010 Mathematical Tools (1)

Geometric Modeling Summer Semester 2010 Mathematical Tools (1) Geometric Modeling Summer Semester 2010 Mathematical Tools (1) Recap: Linear Algebra Today... Topics: Mathematical Background Linear algebra Analysis & differential geometry Numerical techniques Geometric

More information

How to Detect Definite Hermitian Pairs

How to Detect Definite Hermitian Pairs How to Detect Definite Hermitian Pairs Françoise Tisseur School of Mathematics The University of Manchester ftisseur@ma.man.ac.uk http://www.ma.man.ac.uk/~ftisseur/ Joint work with Chun-Hua Guo and Nick

More information

Math 411 Preliminaries

Math 411 Preliminaries Math 411 Preliminaries Provide a list of preliminary vocabulary and concepts Preliminary Basic Netwon s method, Taylor series expansion (for single and multiple variables), Eigenvalue, Eigenvector, Vector

More information

Numerical Analysis. A Comprehensive Introduction. H. R. Schwarz University of Zürich Switzerland. with a contribution by

Numerical Analysis. A Comprehensive Introduction. H. R. Schwarz University of Zürich Switzerland. with a contribution by Numerical Analysis A Comprehensive Introduction H. R. Schwarz University of Zürich Switzerland with a contribution by J. Waldvogel Swiss Federal Institute of Technology, Zürich JOHN WILEY & SONS Chichester

More information

arxiv: v1 [math.na] 12 Jun 2007

arxiv: v1 [math.na] 12 Jun 2007 Critical Delays and Polynomial Eigenvalue Problems Elias Jarlebring a arxiv:0706.1634v1 [math.na] 12 Jun 2007 a Technische Universität Braunschweig, Institut Computational Mathematics, 38023 Braunschweig,

More information

Preface. 2 Linear Equations and Eigenvalue Problem 22

Preface. 2 Linear Equations and Eigenvalue Problem 22 Contents Preface xv 1 Errors in Computation 1 1.1 Introduction 1 1.2 Floating Point Representation of Number 1 1.3 Binary Numbers 2 1.3.1 Binary number representation in computer 3 1.4 Significant Digits

More information

Iterative methods for positive definite linear systems with a complex shift

Iterative methods for positive definite linear systems with a complex shift Iterative methods for positive definite linear systems with a complex shift William McLean, University of New South Wales Vidar Thomée, Chalmers University November 4, 2011 Outline 1. Numerical solution

More information

in Numerical Linear Algebra

in Numerical Linear Algebra Exploiting ResearchTropical MattersAlgebra in Numerical Linear Algebra February 25, 2009 Nick Françoise Higham Tisseur Director Schoolof ofresearch Mathematics The School University of Mathematics of Manchester

More information

Lecture 11: CMSC 878R/AMSC698R. Iterative Methods An introduction. Outline. Inverse, LU decomposition, Cholesky, SVD, etc.

Lecture 11: CMSC 878R/AMSC698R. Iterative Methods An introduction. Outline. Inverse, LU decomposition, Cholesky, SVD, etc. Lecture 11: CMSC 878R/AMSC698R Iterative Methods An introduction Outline Direct Solution of Linear Systems Inverse, LU decomposition, Cholesky, SVD, etc. Iterative methods for linear systems Why? Matrix

More information

Introduction to Applied Linear Algebra with MATLAB

Introduction to Applied Linear Algebra with MATLAB Sigam Series in Applied Mathematics Volume 7 Rizwan Butt Introduction to Applied Linear Algebra with MATLAB Heldermann Verlag Contents Number Systems and Errors 1 1.1 Introduction 1 1.2 Number Representation

More information

Introduction to Numerical Analysis

Introduction to Numerical Analysis J. Stoer R. Bulirsch Introduction to Numerical Analysis Second Edition Translated by R. Bartels, W. Gautschi, and C. Witzgall With 35 Illustrations Springer Contents Preface to the Second Edition Preface

More information

A filter diagonalization for generalized eigenvalue problems based on the Sakurai-Sugiura projection method

A filter diagonalization for generalized eigenvalue problems based on the Sakurai-Sugiura projection method A filter diagonalization for generalized eigenvalue problems based on the Sakurai-Sugiura projection method Tsutomu Ikegami a, Tetsuya Sakurai b Umpei Nagashima c a Grid Technology Research Center, AIST,

More information

ITERATIVE PROJECTION METHODS FOR SPARSE LINEAR SYSTEMS AND EIGENPROBLEMS CHAPTER 11 : JACOBI DAVIDSON METHOD

ITERATIVE PROJECTION METHODS FOR SPARSE LINEAR SYSTEMS AND EIGENPROBLEMS CHAPTER 11 : JACOBI DAVIDSON METHOD ITERATIVE PROJECTION METHODS FOR SPARSE LINEAR SYSTEMS AND EIGENPROBLEMS CHAPTER 11 : JACOBI DAVIDSON METHOD Heinrich Voss voss@tu-harburg.de Hamburg University of Technology Institute of Numerical Simulation

More information

EIGENVALUE PROBLEMS. EIGENVALUE PROBLEMS p. 1/4

EIGENVALUE PROBLEMS. EIGENVALUE PROBLEMS p. 1/4 EIGENVALUE PROBLEMS EIGENVALUE PROBLEMS p. 1/4 EIGENVALUE PROBLEMS p. 2/4 Eigenvalues and eigenvectors Let A C n n. Suppose Ax = λx, x 0, then x is a (right) eigenvector of A, corresponding to the eigenvalue

More information

On a root-finding approach to the polynomial eigenvalue problem

On a root-finding approach to the polynomial eigenvalue problem On a root-finding approach to the polynomial eigenvalue problem Dipartimento di Matematica, Università di Pisa www.dm.unipi.it/ bini Joint work with Vanni Noferini and Meisam Sharify Limoges, May, 10,

More information

Nonlinear Eigenvalue Problems: A Challenge for Modern Eigenvalue Methods

Nonlinear Eigenvalue Problems: A Challenge for Modern Eigenvalue Methods Nonlinear Eigenvalue Problems: A Challenge for Modern Eigenvalue Methods Volker Mehrmann Heinrich Voss November 29, 2004 Abstract We discuss the state of the art in numerical solution methods for large

More information