Resonant MEMS, Eigenvalues, and Numerical Pondering

Size: px
Start display at page:

Download "Resonant MEMS, Eigenvalues, and Numerical Pondering"

Transcription

1 Resonant MEMS, Eigenvalues, and Numerical Pondering David Bindel UC Berkeley, CS Division Resonant MEMS, Eigenvalues,and Numerical Pondering p.1/27

2 Introduction I always pass on good advice. It is the only thing to do with it. It is never of any use to oneself. Oscar Wilde Resonant MEMS and some applications Eigenvalue computations: basic notions Some comments (rants) on numerical computing Resonant MEMS, Eigenvalues,and Numerical Pondering p.2/27

3 What are MEMS? Micro-Electro-Mechanical Systems Frequently made from etched Si Involve multiple energy domains (electrical, mechanical, thermal,...) Lots of applications Inertial sensors (accelerometers, gyroscopes) Microfluidic devices (ink-jet print heads, DNA chips) Optics (displays, switches) RF devices (cell phones, RFID tags) Resonant MEMS, Eigenvalues,and Numerical Pondering p.3/27

4 Resonant MEMS A common microsystem design technique: Periodically excite a mechanical structure Measure the position or velocity somewhere Deduce something from the response Examples: Sense capacitance (accelerometers, pressure sensors) Sense frequency shift (chemical and pressure sensors) Filter mechanically (cell phones) Resonant MEMS, Eigenvalues,and Numerical Pondering p.4/27

5 Micromechanical filters and RF Radio signal Mechanical filter Filtered signal Capacitive drive Capacitive sense Mechanical high-frequency (high MHz-GHz) filter Saves power and cost over electronic filters Already used (piezo-actuated quartz SAW filters) Resonant MEMS, Eigenvalues,and Numerical Pondering p.5/27

6 Shear ring resonator 0.9 hw = e Value = 2.66E+07 Hz Ring is driven in a shearing motion Can couple ring to other resonators Resonant MEMS, Eigenvalues,and Numerical Pondering p.6/27

7 Checkerboard resonator 9.27 MHz MHz MHz MHz. Resonant MEMS, Eigenvalues,and Numerical Pondering p.7/27

8 What do we want from simulation? The purpose of computing is insight, not numbers. The purpose of computing numbers is not yet in sight. R.W. Hamming (1961 and 1997) We would mostly like modes, frequencies, and frequency response information. Natural frequencies and mode shapes Frequency response plots Dependence of frequencies on parameters Sensitivity to fabrication errors Sources and effects of damping Resonant MEMS, Eigenvalues,and Numerical Pondering p.8/27

9 Flavors of eigenvalue problem Different problems need different methods: Is the problem Standard? Generalized? Ax = λx Kx = λm x Quadratic? (λ 2 M + λb + K)x = 0 Nonlinear? f(λ)x = 0 How big is the problem? Is it symmetric (Hermitian?) Do we want all or only a few eigenvalues? Do we want corresponding eigenvectors? Do we have the matrices explicitly? Resonant MEMS, Eigenvalues,and Numerical Pondering p.9/27

10 Power iteration Example: 0.1 A = [ ] [ and x 0 = ] 1 1 Compute x j = A j x 0 / A j x 0. Resonant MEMS, Eigenvalues,and Numerical Pondering p.10/27

11 Power iteration Pick random x and compute x j = A j x/ A j x. If A = QΛQ then A j x 0 = QΛ j Q x 0 Let ˆx = Q x and suppose λ 1 > λ 2... λ n. ˆx 1 A j x 0 = QΛ j ˆx = λ j 1 Q (λ 1 /λ 2 ) j ˆx 2. (λj1ˆx 1)q 1 (λ n /λ 2 ) j ˆx n Resonant MEMS, Eigenvalues,and Numerical Pondering p.11/27

12 Power iteration notes Markov chain steps are power method steps Power method is rarely used as is. But it s the idea behind more powerful algorithms. We don t need the matrix explicitly for the power method. Only have to multiply by the matrix. Useful if the matrix is a Jacobian (finite difference) Also useful if the matrix is hidden in another program Resonant MEMS, Eigenvalues,and Numerical Pondering p.12/27

13 Accelerating power iteration Spectral transformations change the eigenvalues of the matrix, but not the eigenvectors: A 1 = QΛ 1 Q A σi = Q(Λ σi)q (A σi) 1 = Q(Λ σi) 1 Q If σ is a good estimate to λ i, then (λ i σ) 1 gets very big, and power iteration on (A σi) 1 converges quickly. Resonant MEMS, Eigenvalues,and Numerical Pondering p.13/27

14 Big problems and small problems For dense problems (n a few hundred, all eigenvalues): Fastest solver for symmetric problems uses inverse iteration together with bisection. Several other methods use the same idea. LAPACK: ( For big problems where we only want a few eigenvalues: Run something like power iteration (possibly with spectral transformation) Look for approximate eigenvectors in the space spanned by the iterates. Templates for Algebraic Eigenvalue Problems ( Resonant MEMS, Eigenvalues,and Numerical Pondering p.14/27

15 How else could we do it? The characteristic polynomial of A is p(λ) = det(a λi). Could we solve the equation p(λ) = 0? Resonant MEMS, Eigenvalues,and Numerical Pondering p.15/27

16 Wilkinson s example Suppose p(λ) = 21 i=1 (x i). Compute the coefficients and try to recover the roots. 0.6 Error in computed roots of Wilkinson s polynomial Absolute error Computed root Resonant MEMS, Eigenvalues,and Numerical Pondering p.16/27

17 What went wrong? I rounded the coefficients to double precision (16 decimal digits) My error would be little better even if I committed no additional rounding errors. The roots are very sensitive functions of the coefficients. But the eigenvalues of a symmetric matrix are not so sensitive to the matrix coefficients! Resonant MEMS, Eigenvalues,and Numerical Pondering p.17/27

18 Problem sensitivity Roots function Polynomials near p(λ) Associated roots How can I quantify the sensitivity of the problem? Resonant MEMS, Eigenvalues,and Numerical Pondering p.18/27

19 Problem sensitivity The condition number κ measures sensitivity of the roots (λ) to changes in polynomial coefficients (p): δλ λ κ = κ δp p λ p p λ + higher order terms If κ is very large, we call the problem ill-conditioned. The same idea works for other problems. Resonant MEMS, Eigenvalues,and Numerical Pondering p.19/27

20 Forward and backward error Forward error: How wrong did I get the answer? λ computed = λ exact (A) + δλ Backward error: How wrong did I get the problem? λ computed = λ exact (A + δa) We usually seek algorithms with small backward error. Resonant MEMS, Eigenvalues,and Numerical Pondering p.20/27

21 Forward = sensitivity backward We try to design algorithms so that backward error input value Cɛ where C is some constant depending on the dimension and ɛ is the rounding threshold (around for double precision). Then to first order forward error output value κ backward error input value Cκɛ Resonant MEMS, Eigenvalues,and Numerical Pondering p.21/27

22 Sensitivity and eigenvalue problems For the symmetric eigenvalue problem: Eigenvalues are perfectly conditioned ( δλ δa ) Cannot even define vectors continuously near a multiple eigenvalue Unless admissible perturbations are restricted to those compatible with some symmetry group The algorithm usually won t preserve all the symmetries of the physical problem. Resonant MEMS, Eigenvalues,and Numerical Pondering p.22/27

23 Choosing numerical software: accuracy Want intermediates to more digits than data deserves. Better maintain relationships from original problem Compensate for accuracy lost in composing answers Significance arithmetic model is very pessimistic May want control over several error metrics Forward error? Backward error? Residual error? Which norm? Want estimate of problem sensitivity (condition number) Resonant MEMS, Eigenvalues,and Numerical Pondering p.23/27

24 Choosing numerical software: speed Premature optimization is the root of all evil. D. Knuth Speed is much more than operation counting. Human cycles are more valuable than human cycles. Making the fast part faster is futile. Resonant MEMS, Eigenvalues,and Numerical Pondering p.24/27

25 Where to go Lesser artists borrow. Great artists steal. I. Stravinsky Numerical accuracy software should be fast, accurate, and robust. It s easy to build code which is none of these. Good sources: Netlib ( Guide to Available Mathematical Software (gams.nist.gov) Environments like Matlab and Mathematica Resonant MEMS, Eigenvalues,and Numerical Pondering p.25/27

26 Conclusions Several MEMS based on steady-state frequency-response Some ideas in eigenvalue calculations Some numerical comments Thinking about accuracy Building for speed and accuracy Where to look for codes Resonant MEMS, Eigenvalues,and Numerical Pondering p.26/27

27 Some concluding quotes Think. Then discretize. V. Rokhlin Oh, I knew All the answers But I couldn t get the questions right. W.A. Yankovic, I Lost on Jeopardy Given a solution to a problem, it is always possible to find a sense in which it is optimal. W. Kahan paraphrasing R. Karp Resonant MEMS, Eigenvalues,and Numerical Pondering p.27/27

Parameter-Dependent Eigencomputations and MEMS Applications

Parameter-Dependent Eigencomputations and MEMS Applications Parameter-Dependent Eigencomputations and MEMS Applications David Bindel UC Berkeley, CS Division Parameter-Dependent Eigencomputations and MEMS Applications p.1/36 Outline Some applications Mathematical

More information

Applications of Matrix Structure

Applications of Matrix Structure Applications of Matrix Structure D. Bindel Department of Computer Science Cornell University 15 Sep 2009 (Cornell University) Brown Bag 1 / 32 The Computational Science Picture Ingredients: Application

More information

Direct methods for symmetric eigenvalue problems

Direct methods for symmetric eigenvalue problems Direct methods for symmetric eigenvalue problems, PhD McMaster University School of Computational Engineering and Science February 4, 2008 1 Theoretical background Posing the question Perturbation theory

More information

Computational Science and Engineering

Computational Science and Engineering Computational Science and Engineering Application modeling Analysis ρü = σ Ax = b Ax = λx Algorithms and software HiQLab, Matscat,... Model reduction methods Structured linear solvers Today: Two applications

More information

Topics. Review of lecture 2/11 Error, Residual and Condition Number. Review of lecture 2/16 Backward Error Analysis The General Case 1 / 22

Topics. Review of lecture 2/11 Error, Residual and Condition Number. Review of lecture 2/16 Backward Error Analysis The General Case 1 / 22 Topics Review of lecture 2/ Error, Residual and Condition Number Review of lecture 2/6 Backward Error Analysis The General Case / 22 Theorem (Calculation of 2 norm of a symmetric matrix) If A = A t is

More information

Institute for Electron Microscopy and Nanoanalysis Graz Centre for Electron Microscopy

Institute for Electron Microscopy and Nanoanalysis Graz Centre for Electron Microscopy Institute for Electron Microscopy and Nanoanalysis Graz Centre for Electron Microscopy Micromechanics Ass.Prof. Priv.-Doz. DI Dr. Harald Plank a,b a Institute of Electron Microscopy and Nanoanalysis, Graz

More information

Numerical Methods I Eigenvalue Problems

Numerical Methods I Eigenvalue Problems Numerical Methods I Eigenvalue Problems Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 MATH-GA 2011.003 / CSCI-GA 2945.003, Fall 2014 October 2nd, 2014 A. Donev (Courant Institute) Lecture

More information

[Disclaimer: This is not a complete list of everything you need to know, just some of the topics that gave people difficulty.]

[Disclaimer: This is not a complete list of everything you need to know, just some of the topics that gave people difficulty.] Math 43 Review Notes [Disclaimer: This is not a complete list of everything you need to know, just some of the topics that gave people difficulty Dot Product If v (v, v, v 3 and w (w, w, w 3, then the

More information

Eigenvalue and Eigenvector Problems

Eigenvalue and Eigenvector Problems Eigenvalue and Eigenvector Problems An attempt to introduce eigenproblems Radu Trîmbiţaş Babeş-Bolyai University April 8, 2009 Radu Trîmbiţaş ( Babeş-Bolyai University) Eigenvalue and Eigenvector Problems

More information

REVIEW FOR EXAM II. The exam covers sections , the part of 3.7 on Markov chains, and

REVIEW FOR EXAM II. The exam covers sections , the part of 3.7 on Markov chains, and REVIEW FOR EXAM II The exam covers sections 3.4 3.6, the part of 3.7 on Markov chains, and 4.1 4.3. 1. The LU factorization: An n n matrix A has an LU factorization if A = LU, where L is lower triangular

More information

Let x be an approximate solution for Ax = b, e.g., obtained by Gaussian elimination. Let x denote the exact solution. Call. r := b A x.

Let x be an approximate solution for Ax = b, e.g., obtained by Gaussian elimination. Let x denote the exact solution. Call. r := b A x. ESTIMATION OF ERROR Let x be an approximate solution for Ax = b, e.g., obtained by Gaussian elimination. Let x denote the exact solution. Call the residual for x. Then r := b A x r = b A x = Ax A x = A

More information

Matrices and Deformation

Matrices and Deformation ES 111 Mathematical Methods in the Earth Sciences Matrices and Deformation Lecture Outline 13 - Thurs 9th Nov 2017 Strain Ellipse and Eigenvectors One way of thinking about a matrix is that it operates

More information

Quadratic Equations Part I

Quadratic Equations Part I Quadratic Equations Part I Before proceeding with this section we should note that the topic of solving quadratic equations will be covered in two sections. This is done for the benefit of those viewing

More information

Structure-preserving model reduction for MEMS

Structure-preserving model reduction for MEMS Structure-preserving model reduction for MEMS David Bindel Department of Computer Science Cornell University SIAM CSE Meeting, 1 Mar 2011 Collaborators Sunil Bhave Emmanuel Quévy Zhaojun Bai Tsuyoshi Koyama

More information

Linear Algebra Massoud Malek

Linear Algebra Massoud Malek CSUEB Linear Algebra Massoud Malek Inner Product and Normed Space In all that follows, the n n identity matrix is denoted by I n, the n n zero matrix by Z n, and the zero vector by θ n An inner product

More information

Jim Lambers MAT 610 Summer Session Lecture 2 Notes

Jim Lambers MAT 610 Summer Session Lecture 2 Notes Jim Lambers MAT 610 Summer Session 2009-10 Lecture 2 Notes These notes correspond to Sections 2.2-2.4 in the text. Vector Norms Given vectors x and y of length one, which are simply scalars x and y, the

More information

Eigenvalues, Resonance Poles, and Damping in MEMS

Eigenvalues, Resonance Poles, and Damping in MEMS Eigenvalues,, and Damping in D. Bindel Computer Science Division Department of EECS University of California, Berkeley Matrix computations seminar, 19 Apr 26 Outline 1 2 3 4 Outline 1 2 3 4 Resonating

More information

Linear Algebra Review

Linear Algebra Review Chapter 1 Linear Algebra Review It is assumed that you have had a course in linear algebra, and are familiar with matrix multiplication, eigenvectors, etc. I will review some of these terms here, but quite

More information

CS168: The Modern Algorithmic Toolbox Lecture #8: How PCA Works

CS168: The Modern Algorithmic Toolbox Lecture #8: How PCA Works CS68: The Modern Algorithmic Toolbox Lecture #8: How PCA Works Tim Roughgarden & Gregory Valiant April 20, 206 Introduction Last lecture introduced the idea of principal components analysis (PCA). The

More information

Algorithms for Solving the Polynomial Eigenvalue Problem

Algorithms for Solving the Polynomial Eigenvalue Problem Algorithms for Solving the Polynomial Eigenvalue Problem Nick Higham School of Mathematics The University of Manchester higham@ma.man.ac.uk http://www.ma.man.ac.uk/~higham/ Joint work with D. Steven Mackey

More information

Numerical Algorithms. IE 496 Lecture 20

Numerical Algorithms. IE 496 Lecture 20 Numerical Algorithms IE 496 Lecture 20 Reading for This Lecture Primary Miller and Boxer, Pages 124-128 Forsythe and Mohler, Sections 1 and 2 Numerical Algorithms Numerical Analysis So far, we have looked

More information

AMS526: Numerical Analysis I (Numerical Linear Algebra)

AMS526: Numerical Analysis I (Numerical Linear Algebra) AMS526: Numerical Analysis I (Numerical Linear Algebra) Lecture 21: Sensitivity of Eigenvalues and Eigenvectors; Conjugate Gradient Method Xiangmin Jiao Stony Brook University Xiangmin Jiao Numerical Analysis

More information

CS 246 Review of Linear Algebra 01/17/19

CS 246 Review of Linear Algebra 01/17/19 1 Linear algebra In this section we will discuss vectors and matrices. We denote the (i, j)th entry of a matrix A as A ij, and the ith entry of a vector as v i. 1.1 Vectors and vector operations A vector

More information

6 Linear Systems of Equations

6 Linear Systems of Equations 6 Linear Systems of Equations Read sections 2.1 2.3, 2.4.1 2.4.5, 2.4.7, 2.7 Review questions 2.1 2.37, 2.43 2.67 6.1 Introduction When numerically solving two-point boundary value problems, the differential

More information

Bindel, Fall 2016 Matrix Computations (CS 6210) Notes for

Bindel, Fall 2016 Matrix Computations (CS 6210) Notes for 1 Iteration basics Notes for 2016-11-07 An iterative solver for Ax = b is produces a sequence of approximations x (k) x. We always stop after finitely many steps, based on some convergence criterion, e.g.

More information

Numerical and semi-analytical structure-preserving model reduction for MEMS

Numerical and semi-analytical structure-preserving model reduction for MEMS Numerical and semi-analytical structure-preserving model reduction for MEMS David Bindel ENUMATH 07, 10 Sep 2007 Collaborators Tsuyoshi Koyama Sanjay Govindjee Sunil Bhave Emmanuel Quévy Zhaojun Bai Resonant

More information

AMS526: Numerical Analysis I (Numerical Linear Algebra)

AMS526: Numerical Analysis I (Numerical Linear Algebra) AMS526: Numerical Analysis I (Numerical Linear Algebra) Lecture 16: Reduction to Hessenberg and Tridiagonal Forms; Rayleigh Quotient Iteration Xiangmin Jiao Stony Brook University Xiangmin Jiao Numerical

More information

MATH 310, REVIEW SHEET 2

MATH 310, REVIEW SHEET 2 MATH 310, REVIEW SHEET 2 These notes are a very short summary of the key topics in the book (and follow the book pretty closely). You should be familiar with everything on here, but it s not comprehensive,

More information

1 Sylvester equations

1 Sylvester equations 1 Sylvester equations Notes for 2016-11-02 The Sylvester equation (or the special case of the Lyapunov equation) is a matrix equation of the form AX + XB = C where A R m m, B R n n, B R m n, are known,

More information

Eigenvalues and Eigenvectors

Eigenvalues and Eigenvectors Eigenvalues and Eigenvectors Philippe B. Laval KSU Fall 2015 Philippe B. Laval (KSU) Eigenvalues and Eigenvectors Fall 2015 1 / 14 Introduction We define eigenvalues and eigenvectors. We discuss how to

More information

Final Review Sheet. B = (1, 1 + 3x, 1 + x 2 ) then 2 + 3x + 6x 2

Final Review Sheet. B = (1, 1 + 3x, 1 + x 2 ) then 2 + 3x + 6x 2 Final Review Sheet The final will cover Sections Chapters 1,2,3 and 4, as well as sections 5.1-5.4, 6.1-6.2 and 7.1-7.3 from chapters 5,6 and 7. This is essentially all material covered this term. Watch

More information

6 EIGENVALUES AND EIGENVECTORS

6 EIGENVALUES AND EIGENVECTORS 6 EIGENVALUES AND EIGENVECTORS INTRODUCTION TO EIGENVALUES 61 Linear equations Ax = b come from steady state problems Eigenvalues have their greatest importance in dynamic problems The solution of du/dt

More information

MAT 1302B Mathematical Methods II

MAT 1302B Mathematical Methods II MAT 1302B Mathematical Methods II Alistair Savage Mathematics and Statistics University of Ottawa Winter 2015 Lecture 19 Alistair Savage (uottawa) MAT 1302B Mathematical Methods II Winter 2015 Lecture

More information

CS 542G: Robustifying Newton, Constraints, Nonlinear Least Squares

CS 542G: Robustifying Newton, Constraints, Nonlinear Least Squares CS 542G: Robustifying Newton, Constraints, Nonlinear Least Squares Robert Bridson October 29, 2008 1 Hessian Problems in Newton Last time we fixed one of plain Newton s problems by introducing line search

More information

Lecture 10: Powers of Matrices, Difference Equations

Lecture 10: Powers of Matrices, Difference Equations Lecture 10: Powers of Matrices, Difference Equations Difference Equations A difference equation, also sometimes called a recurrence equation is an equation that defines a sequence recursively, i.e. each

More information

MATH2071: LAB #5: Norms, Errors and Condition Numbers

MATH2071: LAB #5: Norms, Errors and Condition Numbers MATH2071: LAB #5: Norms, Errors and Condition Numbers 1 Introduction Introduction Exercise 1 Vector Norms Exercise 2 Matrix Norms Exercise 3 Compatible Matrix Norms Exercise 4 More on the Spectral Radius

More information

Scientific Computing: Dense Linear Systems

Scientific Computing: Dense Linear Systems Scientific Computing: Dense Linear Systems Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course MATH-GA.2043 or CSCI-GA.2112, Spring 2012 February 9th, 2012 A. Donev (Courant Institute)

More information

Announcements Wednesday, November 01

Announcements Wednesday, November 01 Announcements Wednesday, November 01 WeBWorK 3.1, 3.2 are due today at 11:59pm. The quiz on Friday covers 3.1, 3.2. My office is Skiles 244. Rabinoffice hours are Monday, 1 3pm and Tuesday, 9 11am. Section

More information

CH 59 SQUARE ROOTS. Every positive number has two square roots. Ch 59 Square Roots. Introduction

CH 59 SQUARE ROOTS. Every positive number has two square roots. Ch 59 Square Roots. Introduction 59 CH 59 SQUARE ROOTS Introduction W e saw square roots when we studied the Pythagorean Theorem. They may have been hidden, but when the end of a right-triangle problem resulted in an equation like c =

More information

Algebra Exam. Solutions and Grading Guide

Algebra Exam. Solutions and Grading Guide Algebra Exam Solutions and Grading Guide You should use this grading guide to carefully grade your own exam, trying to be as objective as possible about what score the TAs would give your responses. Full

More information

printing Three areas: solid calculus, particularly calculus of several

printing Three areas: solid calculus, particularly calculus of several Math 5610 printing 5600 5610 Notes of 8/21/18 Quick Review of some Prerequisites Three areas: solid calculus, particularly calculus of several variables. linear algebra Programming (Coding) The term project

More information

Modern Algebra Prof. Manindra Agrawal Department of Computer Science and Engineering Indian Institute of Technology, Kanpur

Modern Algebra Prof. Manindra Agrawal Department of Computer Science and Engineering Indian Institute of Technology, Kanpur Modern Algebra Prof. Manindra Agrawal Department of Computer Science and Engineering Indian Institute of Technology, Kanpur Lecture 02 Groups: Subgroups and homomorphism (Refer Slide Time: 00:13) We looked

More information

Numerical Methods I Solving Square Linear Systems: GEM and LU factorization

Numerical Methods I Solving Square Linear Systems: GEM and LU factorization Numerical Methods I Solving Square Linear Systems: GEM and LU factorization Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 MATH-GA 2011.003 / CSCI-GA 2945.003, Fall 2014 September 18th,

More information

3.3 Eigenvalues and Eigenvectors

3.3 Eigenvalues and Eigenvectors .. EIGENVALUES AND EIGENVECTORS 27. Eigenvalues and Eigenvectors In this section, we assume A is an n n matrix and x is an n vector... Definitions In general, the product Ax results is another n vector

More information

Bindel, Fall 2016 Matrix Computations (CS 6210) Notes for

Bindel, Fall 2016 Matrix Computations (CS 6210) Notes for 1 Algorithms Notes for 2016-10-31 There are several flavors of symmetric eigenvalue solvers for which there is no equivalent (stable) nonsymmetric solver. We discuss four algorithmic ideas: the workhorse

More information

Scientific Computing

Scientific Computing Scientific Computing Direct solution methods Martin van Gijzen Delft University of Technology October 3, 2018 1 Program October 3 Matrix norms LU decomposition Basic algorithm Cost Stability Pivoting Pivoting

More information

Computational Methods. Eigenvalues and Singular Values

Computational Methods. Eigenvalues and Singular Values Computational Methods Eigenvalues and Singular Values Manfred Huber 2010 1 Eigenvalues and Singular Values Eigenvalues and singular values describe important aspects of transformations and of data relations

More information

Solving the Polynomial Eigenvalue Problem by Linearization

Solving the Polynomial Eigenvalue Problem by Linearization Solving the Polynomial Eigenvalue Problem by Linearization Nick Higham School of Mathematics The University of Manchester higham@ma.man.ac.uk http://www.ma.man.ac.uk/~higham/ Joint work with Ren-Cang Li,

More information

Eigenproblems II: Computation

Eigenproblems II: Computation Eigenproblems II: Computation CS 205A: Mathematical Methods for Robotics, Vision, and Graphics Doug James (and Justin Solomon) CS 205A: Mathematical Methods Eigenproblems II: Computation 1 / 31 Setup A

More information

Lecture: Local Spectral Methods (2 of 4) 19 Computing spectral ranking with the push procedure

Lecture: Local Spectral Methods (2 of 4) 19 Computing spectral ranking with the push procedure Stat260/CS294: Spectral Graph Methods Lecture 19-04/02/2015 Lecture: Local Spectral Methods (2 of 4) Lecturer: Michael Mahoney Scribe: Michael Mahoney Warning: these notes are still very rough. They provide

More information

Last Time. Social Network Graphs Betweenness. Graph Laplacian. Girvan-Newman Algorithm. Spectral Bisection

Last Time. Social Network Graphs Betweenness. Graph Laplacian. Girvan-Newman Algorithm. Spectral Bisection Eigenvalue Problems Last Time Social Network Graphs Betweenness Girvan-Newman Algorithm Graph Laplacian Spectral Bisection λ 2, w 2 Today Small deviation into eigenvalue problems Formulation Standard eigenvalue

More information

Lecture 7. Gaussian Elimination with Pivoting. David Semeraro. University of Illinois at Urbana-Champaign. February 11, 2014

Lecture 7. Gaussian Elimination with Pivoting. David Semeraro. University of Illinois at Urbana-Champaign. February 11, 2014 Lecture 7 Gaussian Elimination with Pivoting David Semeraro University of Illinois at Urbana-Champaign February 11, 2014 David Semeraro (NCSA) CS 357 February 11, 2014 1 / 41 Naive Gaussian Elimination

More information

Lecture 4: Linear Algebra 1

Lecture 4: Linear Algebra 1 Lecture 4: Linear Algebra 1 Sourendu Gupta TIFR Graduate School Computational Physics 1 February 12, 2010 c : Sourendu Gupta (TIFR) Lecture 4: Linear Algebra 1 CP 1 1 / 26 Outline 1 Linear problems Motivation

More information

Chapter 7 Iterative Techniques in Matrix Algebra

Chapter 7 Iterative Techniques in Matrix Algebra Chapter 7 Iterative Techniques in Matrix Algebra Per-Olof Persson persson@berkeley.edu Department of Mathematics University of California, Berkeley Math 128B Numerical Analysis Vector Norms Definition

More information

Singular Value Decomposition and Digital Image Compression

Singular Value Decomposition and Digital Image Compression Singular Value Decomposition and Digital Image Compression Chris Bingham December 1, 016 Page 1 of Abstract The purpose of this document is to be a very basic introduction to the singular value decomposition

More information

Bindel, Fall 2011 Intro to Scientific Computing (CS 3220) Week 3: Wednesday, Jan 9

Bindel, Fall 2011 Intro to Scientific Computing (CS 3220) Week 3: Wednesday, Jan 9 Problem du jour Week 3: Wednesday, Jan 9 1. As a function of matrix dimension, what is the asymptotic complexity of computing a determinant using the Laplace expansion (cofactor expansion) that you probably

More information

Lecture 10: October 27, 2016

Lecture 10: October 27, 2016 Mathematical Toolkit Autumn 206 Lecturer: Madhur Tulsiani Lecture 0: October 27, 206 The conjugate gradient method In the last lecture we saw the steepest descent or gradient descent method for finding

More information

Lecture 11: CMSC 878R/AMSC698R. Iterative Methods An introduction. Outline. Inverse, LU decomposition, Cholesky, SVD, etc.

Lecture 11: CMSC 878R/AMSC698R. Iterative Methods An introduction. Outline. Inverse, LU decomposition, Cholesky, SVD, etc. Lecture 11: CMSC 878R/AMSC698R Iterative Methods An introduction Outline Direct Solution of Linear Systems Inverse, LU decomposition, Cholesky, SVD, etc. Iterative methods for linear systems Why? Matrix

More information

CS227-Scientific Computing. Lecture 4: A Crash Course in Linear Algebra

CS227-Scientific Computing. Lecture 4: A Crash Course in Linear Algebra CS227-Scientific Computing Lecture 4: A Crash Course in Linear Algebra Linear Transformation of Variables A common phenomenon: Two sets of quantities linearly related: y = 3x + x 2 4x 3 y 2 = 2.7x 2 x

More information

Solving Polynomial Eigenproblems by Linearization

Solving Polynomial Eigenproblems by Linearization Solving Polynomial Eigenproblems by Linearization Nick Higham School of Mathematics University of Manchester higham@ma.man.ac.uk http://www.ma.man.ac.uk/~higham/ Joint work with D. Steven Mackey and Françoise

More information

Numerical Methods - Numerical Linear Algebra

Numerical Methods - Numerical Linear Algebra Numerical Methods - Numerical Linear Algebra Y. K. Goh Universiti Tunku Abdul Rahman 2013 Y. K. Goh (UTAR) Numerical Methods - Numerical Linear Algebra I 2013 1 / 62 Outline 1 Motivation 2 Solving Linear

More information

nonlinear simultaneous equations of type (1)

nonlinear simultaneous equations of type (1) Module 5 : Solving Nonlinear Algebraic Equations Section 1 : Introduction 1 Introduction Consider set of nonlinear simultaneous equations of type -------(1) -------(2) where and represents a function vector.

More information

LINEAR ALGEBRA: NUMERICAL METHODS. Version: August 12,

LINEAR ALGEBRA: NUMERICAL METHODS. Version: August 12, LINEAR ALGEBRA: NUMERICAL METHODS. Version: August 12, 2000 74 6 Summary Here we summarize the most important information about theoretical and numerical linear algebra. MORALS OF THE STORY: I. Theoretically

More information

MAA507, Power method, QR-method and sparse matrix representation.

MAA507, Power method, QR-method and sparse matrix representation. ,, and representation. February 11, 2014 Lecture 7: Overview, Today we will look at:.. If time: A look at representation and fill in. Why do we need numerical s? I think everyone have seen how time consuming

More information

Bindel, Fall 2016 Matrix Computations (CS 6210) Notes for

Bindel, Fall 2016 Matrix Computations (CS 6210) Notes for 1 Logistics Notes for 2016-09-14 1. There was a goof in HW 2, problem 1 (now fixed) please re-download if you have already started looking at it. 2. CS colloquium (4:15 in Gates G01) this Thurs is Margaret

More information

From Stationary Methods to Krylov Subspaces

From Stationary Methods to Krylov Subspaces Week 6: Wednesday, Mar 7 From Stationary Methods to Krylov Subspaces Last time, we discussed stationary methods for the iterative solution of linear systems of equations, which can generally be written

More information

DS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.

DS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra. DS-GA 1002 Lecture notes 0 Fall 2016 Linear Algebra These notes provide a review of basic concepts in linear algebra. 1 Vector spaces You are no doubt familiar with vectors in R 2 or R 3, i.e. [ ] 1.1

More information

CS168: The Modern Algorithmic Toolbox Lecture #8: PCA and the Power Iteration Method

CS168: The Modern Algorithmic Toolbox Lecture #8: PCA and the Power Iteration Method CS168: The Modern Algorithmic Toolbox Lecture #8: PCA and the Power Iteration Method Tim Roughgarden & Gregory Valiant April 15, 015 This lecture began with an extended recap of Lecture 7. Recall that

More information

Polynomials; Add/Subtract

Polynomials; Add/Subtract Chapter 7 Polynomials Polynomials; Add/Subtract Polynomials sounds tough enough. But, if you look at it close enough you ll notice that students have worked with polynomial expressions such as 6x 2 + 5x

More information

Iterative Methods for Solving A x = b

Iterative Methods for Solving A x = b Iterative Methods for Solving A x = b A good (free) online source for iterative methods for solving A x = b is given in the description of a set of iterative solvers called templates found at netlib: http

More information

A pragmatic approach to including complex natural modes of vibration in aeroelastic analysis

A pragmatic approach to including complex natural modes of vibration in aeroelastic analysis A pragmatic approach to including complex natural modes of vibration in aeroelastic analysis International Aerospace Symposium of South Africa 14 to 16 September, 215 Stellenbosch, South Africa Louw van

More information

Geometric Modeling Summer Semester 2010 Mathematical Tools (1)

Geometric Modeling Summer Semester 2010 Mathematical Tools (1) Geometric Modeling Summer Semester 2010 Mathematical Tools (1) Recap: Linear Algebra Today... Topics: Mathematical Background Linear algebra Analysis & differential geometry Numerical techniques Geometric

More information

1 The best of all possible worlds

1 The best of all possible worlds Notes for 2017-03-18 1 The best of all possible worlds Last time, we discussed three methods of solving f(x) = 0: Newton, modified Newton, and bisection. Newton is potentially faster than bisection; bisection

More information

Math 411 Preliminaries

Math 411 Preliminaries Math 411 Preliminaries Provide a list of preliminary vocabulary and concepts Preliminary Basic Netwon s method, Taylor series expansion (for single and multiple variables), Eigenvalue, Eigenvector, Vector

More information

A primer on matrices

A primer on matrices A primer on matrices Stephen Boyd August 4, 2007 These notes describe the notation of matrices, the mechanics of matrix manipulation, and how to use matrices to formulate and solve sets of simultaneous

More information

Linear Solvers. Andrew Hazel

Linear Solvers. Andrew Hazel Linear Solvers Andrew Hazel Introduction Thus far we have talked about the formulation and discretisation of physical problems...... and stopped when we got to a discrete linear system of equations. Introduction

More information

Lecture 21: Decay of Resonances

Lecture 21: Decay of Resonances Lecture 21: Decay of Resonances Recall that a resonance involves energy bouncing back and forth between two means of storage. In air resonances in cavities, energy is going back and forth between being

More information

Pitch Rate CAS Design Project

Pitch Rate CAS Design Project Pitch Rate CAS Design Project Washington University in St. Louis MAE 433 Control Systems Bob Rowe 4.4.7 Design Project Part 2 This is the second part of an ongoing project to design a control and stability

More information

Computer Aided Design of Micro-Electro-Mechanical Systems

Computer Aided Design of Micro-Electro-Mechanical Systems Computer Aided Design of Micro-Electro-Mechanical Systems From Resonance Poles to Dick Tracy Watches D. Bindel Courant Institute for Mathematical Sciences New York University Columbia University, 20 March

More information

Math 215 HW #9 Solutions

Math 215 HW #9 Solutions Math 5 HW #9 Solutions. Problem 4.4.. If A is a 5 by 5 matrix with all a ij, then det A. Volumes or the big formula or pivots should give some upper bound on the determinant. Answer: Let v i be the ith

More information

Computer Aided Design of Micro-Electro-Mechanical Systems

Computer Aided Design of Micro-Electro-Mechanical Systems Computer Aided Design of Micro-Electro-Mechanical Systems From Energy Losses to Dick Tracy Watches D. Bindel Courant Institute for Mathematical Sciences New York University Temple University, 7 Nov 2007

More information

MATH 320, WEEK 11: Eigenvalues and Eigenvectors

MATH 320, WEEK 11: Eigenvalues and Eigenvectors MATH 30, WEEK : Eigenvalues and Eigenvectors Eigenvalues and Eigenvectors We have learned about several vector spaces which naturally arise from matrix operations In particular, we have learned about the

More information

18.06 Quiz 2 April 7, 2010 Professor Strang

18.06 Quiz 2 April 7, 2010 Professor Strang 18.06 Quiz 2 April 7, 2010 Professor Strang Your PRINTED name is: 1. Your recitation number or instructor is 2. 3. 1. (33 points) (a) Find the matrix P that projects every vector b in R 3 onto the line

More information

Conjugate Gradient Method

Conjugate Gradient Method Conjugate Gradient Method direct and indirect methods positive definite linear systems Krylov sequence spectral analysis of Krylov sequence preconditioning Prof. S. Boyd, EE364b, Stanford University Three

More information

Computer Aided Design of Micro-Electro-Mechanical Systems

Computer Aided Design of Micro-Electro-Mechanical Systems Computer Aided Design of Micro-Electro-Mechanical Systems From Eigenvalues to Devices David Bindel Department of Computer Science Cornell University Fudan University, 13 Dec 2012 (Cornell University) Fudan

More information

Lecture 5. 1 Review (Pairwise Independence and Derandomization)

Lecture 5. 1 Review (Pairwise Independence and Derandomization) 6.842 Randomness and Computation September 20, 2017 Lecture 5 Lecturer: Ronitt Rubinfeld Scribe: Tom Kolokotrones 1 Review (Pairwise Independence and Derandomization) As we discussed last time, we can

More information

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2018 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing

More information

MATH 423 Linear Algebra II Lecture 20: Geometry of linear transformations. Eigenvalues and eigenvectors. Characteristic polynomial.

MATH 423 Linear Algebra II Lecture 20: Geometry of linear transformations. Eigenvalues and eigenvectors. Characteristic polynomial. MATH 423 Linear Algebra II Lecture 20: Geometry of linear transformations. Eigenvalues and eigenvectors. Characteristic polynomial. Geometric properties of determinants 2 2 determinants and plane geometry

More information

Lecture 17: Iterative Methods and Sparse Linear Algebra

Lecture 17: Iterative Methods and Sparse Linear Algebra Lecture 17: Iterative Methods and Sparse Linear Algebra David Bindel 25 Mar 2014 Logistics HW 3 extended to Wednesday after break HW 4 should come out Monday after break Still need project description

More information

Computer Aided Design of Micro-Electro-Mechanical Systems

Computer Aided Design of Micro-Electro-Mechanical Systems Computer Aided Design of Micro-Electro-Mechanical Systems From Energy Losses to Dick Tracy Watches D. Bindel Courant Institute for Mathematical Sciences New York University Stanford University, 12 Nov

More information

Name: INSERT YOUR NAME HERE. Due to dropbox by 6pm PDT, Wednesday, December 14, 2011

Name: INSERT YOUR NAME HERE. Due to dropbox by 6pm PDT, Wednesday, December 14, 2011 AMath 584 Name: INSERT YOUR NAME HERE Take-home Final UWNetID: INSERT YOUR NETID Due to dropbox by 6pm PDT, Wednesday, December 14, 2011 The main part of the assignment (Problems 1 3) is worth 80 points.

More information

LECSS Physics 11 Introduction to Physics and Math Methods 1 Revised 8 September 2013 Don Bloomfield

LECSS Physics 11 Introduction to Physics and Math Methods 1 Revised 8 September 2013 Don Bloomfield LECSS Physics 11 Introduction to Physics and Math Methods 1 Physics 11 Introduction to Physics and Math Methods In this introduction, you will get a more in-depth overview of what Physics is, as well as

More information

Eigenvalues and Eigenvectors

Eigenvalues and Eigenvectors Chapter 6 Eigenvalues and Eigenvectors 6. Introduction to Eigenvalues Eigenvalues are the key to a system of n differential equations : dy=dt ay becomes dy=dt Ay. Now A is a matrix and y is a vector.y.t/;

More information

QUADRATICS 3.2 Breaking Symmetry: Factoring

QUADRATICS 3.2 Breaking Symmetry: Factoring QUADRATICS 3. Breaking Symmetry: Factoring James Tanton SETTING THE SCENE Recall that we started our story of symmetry with a rectangle of area 36. Then you would say that the picture is wrong and that

More information

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2016 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing

More information

AMS526: Numerical Analysis I (Numerical Linear Algebra)

AMS526: Numerical Analysis I (Numerical Linear Algebra) AMS526: Numerical Analysis I (Numerical Linear Algebra) Lecture 16: Eigenvalue Problems; Similarity Transformations Xiangmin Jiao Stony Brook University Xiangmin Jiao Numerical Analysis I 1 / 18 Eigenvalue

More information

MEMS Tuning-Fork Gyroscope Mid-Term Report Amanda Bristow Travis Barton Stephen Nary

MEMS Tuning-Fork Gyroscope Mid-Term Report Amanda Bristow Travis Barton Stephen Nary MEMS Tuning-Fork Gyroscope Mid-Term Report Amanda Bristow Travis Barton Stephen Nary Abstract MEMS based gyroscopes have gained in popularity for use as rotation rate sensors in commercial products like

More information

Diagonalization of Matrix

Diagonalization of Matrix of Matrix King Saud University August 29, 2018 of Matrix Table of contents 1 2 of Matrix Definition If A M n (R) and λ R. We say that λ is an eigenvalue of the matrix A if there is X R n \ {0} such that

More information

EE C245 / ME C218 INTRODUCTION TO MEMS DESIGN FALL 2009 PROBLEM SET #7. Due (at 7 p.m.): Thursday, Dec. 10, 2009, in the EE C245 HW box in 240 Cory.

EE C245 / ME C218 INTRODUCTION TO MEMS DESIGN FALL 2009 PROBLEM SET #7. Due (at 7 p.m.): Thursday, Dec. 10, 2009, in the EE C245 HW box in 240 Cory. Issued: Thursday, Nov. 24, 2009 PROBLEM SET #7 Due (at 7 p.m.): Thursday, Dec. 10, 2009, in the EE C245 HW box in 240 Cory. 1. Gyroscopes are inertial sensors that measure rotation rate, which is an extremely

More information

Problem 1: Toolbox (25 pts) For all of the parts of this problem, you are limited to the following sets of tools:

Problem 1: Toolbox (25 pts) For all of the parts of this problem, you are limited to the following sets of tools: CS 322 Final Exam Friday 18 May 2007 150 minutes Problem 1: Toolbox (25 pts) For all of the parts of this problem, you are limited to the following sets of tools: (A) Runge-Kutta 4/5 Method (B) Condition

More information