Chapter 12: Iterative Methods

Similar documents
LU Factorization. A m x n matrix A admits an LU factorization if it can be written in the form of A = LU

Solving Linear Systems

Remark By definition, an eigenvector must be a nonzero vector, but eigenvalue could be zero.

and let s calculate the image of some vectors under the transformation T.

Remark 1 By definition, an eigenvector must be a nonzero vector, but eigenvalue could be zero.

Math 215 HW #9 Solutions

Solving Linear Systems

Solving Linear Systems of Equations

Numerical Programming I (for CSE)

Eigenvalues and Eigenvectors

Review of Linear Algebra

Chapter 9: Gaussian Elimination

Up to this point, our main theoretical tools for finding eigenvalues without using det{a λi} = 0 have been the trace and determinant formulas

SyDe312 (Winter 2005) Unit 1 - Solutions (continued)

MA3232 Numerical Analysis Week 9. James Cooley (1926-)

City Suburbs. : population distribution after m years

Math 205, Summer I, Week 4b:

Math 205, Summer I, Week 4b: Continued. Chapter 5, Section 8

1. In this problem, if the statement is always true, circle T; otherwise, circle F.

Chap 3. Linear Algebra

Systems of Algebraic Equations and Systems of Differential Equations

Section 8.2 : Homogeneous Linear Systems

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition

Gauss-Seidel method. Dr. Motilal Panigrahi. Dr. Motilal Panigrahi, Nirma University

0.1 Eigenvalues and Eigenvectors

c c c c c c c c c c a 3x3 matrix C= has a determinant determined by

Computational Linear Algebra

Chapter 5. Linear Algebra. A linear (algebraic) equation in. unknowns, x 1, x 2,..., x n, is. an equation of the form

HANDOUT E.22 - EXAMPLES ON STABILITY ANALYSIS

Math Matrix Algebra

A matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and

Solutions Problem Set 8 Math 240, Fall

TMA4125 Matematikk 4N Spring 2017

A matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition

COURSE Iterative methods for solving linear systems

Eigenvalue and Eigenvector Homework

5.7 Cramer's Rule 1. Using Determinants to Solve Systems Assumes the system of two equations in two unknowns

Conjugate Gradient (CG) Method

THE EIGENVALUE PROBLEM

Linear Algebra And Its Applications Chapter 6. Positive Definite Matrix

ELE/MCE 503 Linear Algebra Facts Fall 2018

Question: Given an n x n matrix A, how do we find its eigenvalues? Idea: Suppose c is an eigenvalue of A, then what is the determinant of A-cI?

MATH 304 Linear Algebra Lecture 33: Bases of eigenvectors. Diagonalization.

A = 3 1. We conclude that the algebraic multiplicity of the eigenvalues are both one, that is,

Online Exercises for Linear Algebra XM511

Properties of Linear Transformations from R n to R m

CS 246 Review of Linear Algebra 01/17/19

LESSON 35: EIGENVALUES AND EIGENVECTORS APRIL 21, (1) We might also write v as v. Both notations refer to a vector.

CAAM 454/554: Stationary Iterative Methods

235 Final exam review questions

Diagonalization. Hung-yi Lee

Numerical Analysis: Solutions of System of. Linear Equation. Natasha S. Sharma, PhD

Chapter 2:Determinants. Section 2.1: Determinants by cofactor expansion

PowerPoints organized by Dr. Michael R. Gustafson II, Duke University

AMS10 HW7 Solutions. All credit is given for effort. (-5 pts for any missing sections) Problem 1 (20 pts) Consider the following matrix 2 A =

Preliminary/Qualifying Exam in Numerical Analysis (Math 502a) Spring 2012

Jordan Canonical Form Homework Solutions

3.2 Iterative Solution Methods for Solving Linear

Applied Mathematics 205. Unit V: Eigenvalue Problems. Lecturer: Dr. David Knezevic

DIAGONALIZATION. In order to see the implications of this definition, let us consider the following example Example 1. Consider the matrix

PY 351 Modern Physics Short assignment 4, Nov. 9, 2018, to be returned in class on Nov. 15.

Department of Mathematics California State University, Los Angeles Master s Degree Comprehensive Examination in. NUMERICAL ANALYSIS Spring 2015

3 Matrix Algebra. 3.1 Operations on matrices

TMA Calculus 3. Lecture 21, April 3. Toke Meier Carlsen Norwegian University of Science and Technology Spring 2013

Study Guide for Linear Algebra Exam 2

Dimension. Eigenvalue and eigenvector

A simple dynamic model of labor market

LINEAR SYSTEMS (11) Intensive Computation

MATH 1553 PRACTICE MIDTERM 3 (VERSION B)

Review Notes for Linear Algebra True or False Last Updated: January 25, 2010

The Solution of Linear Systems AX = B

DEN: Linear algebra numerical view (GEM: Gauss elimination method for reducing a full rank matrix to upper-triangular

Numerical Methods Process Systems Engineering ITERATIVE METHODS. Numerical methods in chemical engineering Edwin Zondervan

Here is an example of a block diagonal matrix with Jordan Blocks on the diagonal: J

4. Determinants.

Linear algebra & Numerical Analysis

Glossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB

Ma/CS 6b Class 20: Spectral Graph Theory

2.3.6 Exercises NS-3. Q 1.1: What condition(s) must hold for p and q such that a, b, and c are always positive 10 and nonzero?

Determinants by Cofactor Expansion (III)

Eigenspaces. (c) Find the algebraic multiplicity and the geometric multiplicity for the eigenvaules of A.

Algebra C Numerical Linear Algebra Sample Exam Problems

Chapter 5 Eigenvalues and Eigenvectors

CHAPTER 5. Basic Iterative Methods

Eigenvalues and Eigenvectors. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB

Eigenvalues, Eigenvectors, and Diagonalization

Linear Algebra and Matrices

Linear Algebraic Equations

Practice Final Exam. Solutions.

Linear Algebra: Matrix Eigenvalue Problems

Math 4A Notes. Written by Victoria Kala Last updated June 11, 2017

Therefore, A and B have the same characteristic polynomial and hence, the same eigenvalues.

MAC Module 3 Determinants. Learning Objectives. Upon completing this module, you should be able to:

Warm-up. True or false? Baby proof. 2. The system of normal equations for A x = y has solutions iff A x = y has solutions

Eigenvalues and Eigenvectors A =

Exact and Approximate Numbers:

Introduction. Math 1080: Numerical Linear Algebra Chapter 4, Iterative Methods. Example: First Order Richardson. Strategy

Eigenvalues and Eigenvectors

Eigenvalues and Eigenvectors

Transcription:

ES 40: Scientific and Engineering Computation. Uchechukwu Ofoegbu Temple University Chapter : Iterative Methods

ES 40: Scientific and Engineering Computation. Gauss-Seidel Method The Gauss-Seidel method is the most commonly used iterative method for solving linear algebraic equations [A]{}={b}. The method solves each equation in a system for a particular variable, and then uses that value in later equations to solve later variables. For a system with nonzero elements along the diagonal, for eample, the j th iteration values are found from the j- th iteration using: j = b a j j a a j = b a j j a a j = b a j a j a

ES 40: Scientific and Engineering Computation. Gauss-Seidel Method The Gauss-Seidel method is the most commonly used iterative method for solving linear algebraic equations [A]{}={b}. The method solves each equation in a system for a particular variable, and then uses that value in later equations to solve later variables. For a system with nonzero elements along the diagonal, for eample, the j th iteration values are found from the j- th iteration using: a a a + a + a + a + a + a + a = = = c c c = ( c = ( c = ( c a a a a a a ) / a ) / a ) / a

ES 40: Scientific and Engineering Computation.. Select an initial guess: 0 0 [,,. Update each variable = ( c = ( c = ( c a. Continue to update the variables 4. Stop when the tolerance is met a a 0 ] a a a Applying the Gauss-Seidel Method ) / a ) / a ) / a ( t) i ε a, i = 00% < ε s ( t ) i ( t) i

ES 40: Scientific and Engineering Computation. Convergence. Sometimes this method diverges. If the magnitude of each diagonal term is greater than the sum of the magnitudes of the other terms in the same row, the method will certainly converge n a ii a ij i=, j i. Rows could be rearranged to ensure convergence 4. Sometimes convergence is attained even when the condition is not met

ES 40: Scientific and Engineering Computation. Eample Solve the following using the Gauss Seidel method + 8 0 = + + 5 = 5 = 4 Now use the GaussSeidel function

ES 40: Scientific and Engineering Computation. Jacobi Iteration The Jacobi iteration is similar to the Gauss- Seidel method, ecept the j-th information is used to update all variables in the jth iteration: a) Gauss-Seidel b) Jacobi

ES 40: Scientific and Engineering Computation. Eample Solve the following using the Jacobi Iteration method + 8 0 = + + 5 = 5 = 4 Compare with GaussSeidel

ES 40: Scientific and Engineering Computation. Eigenvalues and Eigenvectors Nonhomogeneous system: [A]{} = {b} Homogeneous system: [A]{} = 0 Nontrivial solutions eist but are not unique The solution of A satisfies the eigenvalue equation: λ = eigenvalue of A A=λ [A- λ I] = 0 = eigenvector of A Nontrivial solutions eist iff characteristic polynomial, det(a - λi) = 0 The size of A determines the number of eigenvalues

ES 40: Scientific and Engineering Computation. Polynomial method for eigenvalues Root of the characteristic polynomial = λ Eample: + = 0 + 4 = 0 A = 4 λ 4 λ Characteristic poly = f(λ) = det = λ 5λ 5 roots of f(λ) = -0.854, 5.854 In Matlab: p = ploy(a); e = roots(p)

ES 40: Scientific and Engineering Computation. Power method for eigenvalues and eigenvectors Iterative method Determines the largest eigenvalue most of the time Method Set A = λ Choose initial value for Factor out highest element as λ Continue until desired accuracy Eample: A = 4

ES 40: Scientific and Engineering Computation. Eig(A) [v e] = eig(a) Matlab eigenvalues and eigenvectors How would you find the minimum eigenvalue using the power method?

ES 40: Scientific and Engineering Computation. Lab Problem.,. Use the power method to find the minimum eigenvalue of the matri B = [ ; ];