Conjugate Gradient Methods. Michael Bader. Summer term 2012
|
|
- Simon May
- 5 years ago
- Views:
Transcription
1 Gadient Methods Outlines Pat I: Quadatic Foms and Steepest Descent Pat II: Gadients Pat III: Summe tem 2012
2 Pat I: Quadatic Foms and Steepest Descent Outlines Pat I: Quadatic Foms and Steepest Descent Pat II: Gadients Pat III: 1 Quadatic Foms 2 Diection of Steepest Descent 3 Steepest Descent
3 Pat II: Gadients 4 Diections 5 A-Othogonality Outlines Pat I: Quadatic Foms and Steepest Descent Pat II: Gadients Pat III: 6 Gadients 7 A Miacle Occus... 8 CG Algoithm
4 Pat III: 9 CG Convegence 10 Outlines Pat I: Quadatic Foms and Steepest Descent Pat II: Gadients Pat III: 11 CG with Change-of-Basis 12 CG with Matix Peconditione 13 Peconditiones Examples
5 Families of Iteative Solves elaxation methods: Jacobi-, Gauss-Seidel-Relaxation,... Ove-Relaxation-Methods Kylov methods: Steepest Descent, Gadient,... GMRES,... Multilevel/Multigid methods, Domain Decomposition,... Outlines Pat I: Quadatic Foms and Steepest Descent Pat II: Gadients Pat III:
6 Remembe: The Residual Equation fo Ax = b, we defined the esidual as: = b Ax and the eo: e := x x leads to the esidual equation: Outlines Pat I: Quadatic Foms and Steepest Descent Pat II: Gadients Pat III: Ae = elaxation methods: solve a modified easie) SLE: B ê = whee B A multigid methods: coase-gid coection on esidual equation
7 Quadatic Foms Diection of Steepest Descent Pat I Steepest Descent Quadatic Foms and Steepest Descent
8 Quadatic Foms A quadatic fom is a scala, quadatic function of a vecto of the fom: f x) = 1 2 x T Ax b T x + c, whee A = A T Quadatic Foms Diection of Steepest Descent Steepest Descent y x x y
9 Quadatic Foms 2) The gadient of a quadatic fom is defined as x 1 f x) f x) =. x n f x) Quadatic Foms Diection of Steepest Descent Steepest Descent f x) = Ax b f x) = 0 Ax b = 0 Ax = b Ax = b equivalent to a minimisation poblem pope minimum only if A positive definite
10 Diection of Steepest Descent gadient f x): diection of steepest ascent f x) = Ax b = with esidual = b Ax) esidual : diection of steepest descent Quadatic Foms Diection of Steepest Descent Steepest Descent 4 y x
11 Solving SLE via Minimum Seach Quadatic Foms basic idea to find minimum: move into diection of steepest descent most simple scheme: Diection of Steepest Descent Steepest Descent x i+1) = x + α α constant Richadson iteation often consideed as a elaxation method) bette choice of α: move to lowest point in that diection Steepest Descent
12 Steepest Descent find an optimal α task: line seach along the line x 1) = x 0) + α 0) choose α such that f x 1) ) is minimal: Quadatic Foms Diection of Steepest Descent Steepest Descent α f x 1) ) = 0 use chain ule: α f x 1) ) = f x 1) ) T α x 1) = f x 1) ) T 0) emembe f x 1) ) = 1), thus: 1)) T 0)! = 0
13 Steepest Descent find α 2) ) 1) T 0) = b Ax 1)) T 0) b Ax 0) + α 0) ) ) T 0) ) b Ax 0) T 0) α A 0)) T 0) ) 0) T 0) α 0)) T A 0) = 0 = 0 = 0 = 0 Quadatic Foms Diection of Steepest Descent Steepest Descent Solve fo α: ) 0) T 0) α = 0) ) T A 0)
14 Steepest Descent Algoithm 1 = b Ax ) T 2 α i = ) T A 3 x i+1) = x + α i 4 y 2 x Quadatic Foms Diection of Steepest Descent Steepest Descent Obsevations: slow convegence sim. to Jacobi elaxation) e A κ 1 i e 0) κ+1) A fo positive definite A: κ = λ max /λ min lagest/smallest eigenvalues of A) many steps in the same diection -6
15 Diections A-Othogonality Pat II Gadients Gadients A Miacle Occus... CG Algoithm
16 Diections Diections obsevation: Steepest Descent takes epeated steps in the same diection obvious idea: ty to do only one step in each diection possible appoach: choose othogonal seach diections d 0) d 1) d 2)... notice: eos othogonal to pevious diections: e 1) d 0), e 2) d 1) d 0),... A-Othogonality Gadients A Miacle Occus... CG Algoithm
17 Diections 2) compute α fom ) d 0) T e 1) = d 0)) T e 0) αd 0)) = 0 equies popagation of the eo e 1) = x x 1) x 1) = x 0) + α i d 0) x x 1) = x x 0) α i d 0) e 1) = e 0) α i d 0) Diections A-Othogonality Gadients A Miacle Occus... CG Algoithm fomula fo α: α = d 0) ) T e 0) d 0) ) T d 0) but: we don t know e 0)
18 A-Othogonality make the seach diections A-othogonal: d ) T Ad j) = 0 again: eos A-othogonal to pevious diections: e i+1) ) T Ad! = 0 Diections A-Othogonality Gadients A Miacle Occus... CG Algoithm equiv. to minimisation in seach diection d : α f x i+1)) = f x i+1)))t α x i+1) = 0 i+1)) T d = 0 d ) T Ae i+1) = 0
19 A- Diections emembe the fomula fo conjugate diections: ) d 0) T e 0) α = ) d 0) T d 0) same computation, but with A-othogonality: Diections A-Othogonality Gadients A Miacle Occus... CG Algoithm α i = d ) T Ae d ) T Ad = d ) T d ) T Ad fo the i-th iteation) these α i can be computed! still to do: find A-othogonal seach diections
20 A- Diections 2) classical appoach to find othogonal diections conjugate Gam-Schmidt pocess: fom linealy independent vectos u 0), u 1),..., u i 1) constuct othogonal diections d 0), d 1),..., d i 1) i 1 d = u + β ik d k) k=0 β ik = u ) T Ad k) d k) ) T Ad k) Diections A-Othogonality Gadients A Miacle Occus... CG Algoithm needs to keep all old seach vectos in memoy On 3 ) computational complexity infeasible
21 Gadients use esiduals i.e., u := 0) ) to constuct conjugate diections: i 1 d = + β ik d k) k=0 new diection d should be A-othogonal to all d j) : Diections A-Othogonality Gadients A Miacle Occus... CG Algoithm 0 =! d ) T Ad j) = ) i 1 T Ad j) + β ) ik d k) T Ad j) k=0 all diections d k) fo k = 0,..., i 1) ae aleady A-othogonal and j < i), hence: 0 = ) T Ad j) +β ) ) ij d j) T T Ad j) Ad j) β ij = ) d j) T Ad j)
22 Gadients Status 1 conjugate diections: α i = ) d T ) d T Ad x i+1) = x + α i d Diections A-Othogonality Gadients A Miacle Occus... CG Algoithm 2 use esiduals to compute seach diections: i 1 d = + β ik d k) k=0 ) T Ad k) β ik = ) d k) T Ad k) still infeasible, as we need to stoe all vectos d k)
23 Diections A-Othogonality Gadients A Miacle Occus... CG Algoithm
24 A Miacle Occus Pat 1 Two small contibutions: 1 popagation of the eo e = x x x i+1) = x + α i d x x i+1) = x x α i d e i+1) = e α i d Diections A-Othogonality Gadients A Miacle Occus... CG Algoithm we have used this once, aleady) 2 popagation of esiduals i+1) = Ae i+1) = A e α i d ) i+1) = α i Ad
25 A Miacle Occus Pat 2 Othogonality of the esiduals: seach diections ae A-othogonal only one step in each diections hence: eo is A-othogonal to pevious seach diections: d ) T Ae j) = 0, fo i < j esiduals ae othogonal to pevious seach diections: d ) T j) = 0, fo i < j seach diections ae built fom esiduals: span { d 0),..., d i 1)} = span { 0),..., i 1)} hence: esiduals ae othogonal Diections A-Othogonality Gadients A Miacle Occus... CG Algoithm ) T j) = 0, i < j
26 A Miacle Occus Pat 3 combine othogonality and ecuence fo esiduals: ) T j+1) = ) T j) α ) j T Ad j) α ) j T Ad j) = ) T j) ) T j+1) Diections A-Othogonality Gadients A Miacle Occus... CG Algoithm ) T j) = 0, if i j: ) ) 1 T Ad j) α i T, i = j = ) 1 α i 1 T, i = j othewise.
27 A Miacle Occus Pat 4 computation of β ik fo k = 0,..., i 1): ) T Ad k) β ik = ) d k) T Ad k) = thus: seach diections ) T α i 1 d i 1) ) T Ad i 1), i = k i > k + 1 i 1 d = + β ik d k) = + β i,i 1 d i 1) k=0 ) T β i := β i,i 1 = α ) i 1 d i 1) T Ad i 1) Diections A-Othogonality Gadients A Miacle Occus... CG Algoithm
28 A Miacle Occus Pat 5 build seach diections d i+1) = i+1) + β i d ) i+1) T i+1) β i+1 = α ) i d T Ad emembe: α i = d ) T d ) T Ad thus: α i d ) T Ad = d ) T Diections A-Othogonality Gadients A Miacle Occus... CG Algoithm i+1) ) T i+1) i+1) ) T i+1) β i+1 = d ) T = ) T last step: d ) T = + β i 1 d i 1)) T = ) T + β i 1 d i 1) ) T = ) T esidual othogonal to pevious seach diection d i 1) )
29 Gadients Algoithm Stat: d 0) = 0) = b Ax 0) 1 α i = ) T d ) T Ad 2 x i+1) = x + α i d Diections A-Othogonality Gadients A Miacle Occus... CG Algoithm 3 i+1) = α i Ad 4 β i+1 = i+1) ) T i+1) ) T 5 d i+1) = i+1) + β i+1 d
30 CG Convegence Pat III CG with Change-of-Basis CG with Matix Peconditione Peconditiones Examples
31 Gadients Convegence Convegence Analysis: uses Kylow subspace: span { 0), A 0), A 2 0),..., A i 1 0)} Kylow subspace method CG Convegence CG with Change-of-Basis CG with Matix Peconditione Peconditiones Examples Convegence Results: in pinciple: diect method n steps) in pactice: iteative scheme ) i e κ 1 A 2 e 0) κ + 1 A, κ = λmax/λ min
32 convegence depends on matix A idea: modify linea system Ax = b M 1 Ax = M 1 b, then: convegence depends on matix M 1 A optimal peconditione: M 1 = A 1 : CG Convegence CG with Change-of-Basis CG with Matix Peconditione Peconditiones Examples A 1 Ax = A 1 b x = A 1 b. in pactice: avoid explicit computation of M 1 A find an M simila to A, compute effect of M 1 i.e., appoximate solution of SLE) o: find an M 1 simila to A 1
33 CG and just eplace A by M 1 A in the algoithm?? poblem: M 1 A not necessaily symmetic even if M and A both ae) we will ty an altenative fist: symmetic peconditioning CG Convegence CG with Change-of-Basis CG with Matix Peconditione Peconditiones Examples Ax = b LAL T ˆx = Lb, x = L T ˆx Note: fo Finite Element discetization, this coesponds to a change of basis functions! equies some e-computations in the CG algoithm see following slides)
34 Change-of-Basis peconditioned system of equations: Ax = b L} T {{ AL} )ˆx = }{{} L T b, x = Lˆx =:  =: ˆb computation of esidual: ˆ = ˆb  ˆx = LT b L T ALˆx = L T b Ax) = L T computation of α fo new system: ˆ ) Tˆ ˆ ) Tˆ ˆ ) Tˆ α i := ˆd )T =  ˆd ˆd ) = T LT AL ˆd d ) T A d CG Convegence CG with Change-of-Basis CG with Matix Peconditione Peconditiones Examples whee we defined Lˆd =: update of solution: d ˆx i+1) = ˆx + α i ˆd x i+1) = Lˆx i+1) = Lˆx + Lα i ˆd = x + α i d
35 Change-of-Basis 2) update esiduals ˆ: ˆ i+1) = ˆ α i ˆd = ˆ α i L T AL = ˆ α i L T A d computation of β i : ˆ ) i+1) i+1) Tˆ β i+1 = ˆ ) Tˆ ˆd CG Convegence CG with Change-of-Basis CG with Matix Peconditione Peconditiones Examples update of seach diections: ˆd i+1) = ˆ i+1) + β i ˆd d i+1) = Lˆd i+1) = Lˆ i+1) + Lβ i ˆd = Lˆ i+1) + β i d
36 CG with Change-of-Basis Stat: ˆ 0) = L T b Ax 0) ); d 0) = L ˆ 0) 1 α i = ˆ ) Tˆ d ) T A d CG Convegence CG with Change-of-Basis CG with Matix Peconditione Peconditiones Examples 2 x i+1) = x + α i d 3 ˆ i+1) = ˆ α i L T A d 4 β i+1 = ˆ i+1) ) Tˆ i+1) ˆ ) Tˆ 5 d i+1) = L ˆ i+1) + β i d
37 Hieachical Basis Some specifics fo the CG implementation: L tansfoms vecto fom nodal basis to hieachical basis, fo example ˆ = L L T tansfoms the vecto of basis functions fom nodal basis to hieachical basis cmp. FEM) effect of L and L T can be computed in ON) opeations HB-CG fo the Poisson poblem: in 1D: convegence afte a log N iteations! in this case: L T AL diagonal matix with log N diffeent eigenvalues) in 2D and 3D vey fast convegence! futhe impoved by additional diagonal peconditioning so-called hieachical geneating systems change to a multigid basis) achieve multigid-like pefomance CG Convegence CG with Change-of-Basis CG with Matix Peconditione Peconditiones Examples
38 CG and evisited) peconditioning: eplace A by M 1 A poblem: M 1 A not necessaily symmetic compae symmetic peconditioning Ax = b L T ALˆx = Lb, x = Lˆx wokaound: find E T E = M Cholesky fact.), then CG Convegence CG with Change-of-Basis CG with Matix Peconditione Peconditiones Examples Ax = b E T AE 1ˆx = E T b, ˆx = Ex what if E cannot be computed efficiently)? neithe M no M 1 might be known explicitly!) E, E T, E 1 can be eliminated fom algoithm equies some e-computations)
39 CG with Peconditione Stat: 0) = b Ax 0) ; d 0) = M 1 0) 1 α i = ) T M 1 d ) T Ad 2 x i+1) = x + α i d CG Convegence CG with Change-of-Basis CG with Matix Peconditione Peconditiones Examples 3 i+1) = α i Ad 4 β i+1 = i+1) ) T M 1 i+1) ) T M 1 5 d i+1) = M 1 i+1) + β i+1 d
40 Implementation CG Convegence steps: M 1, M 1 i+1) M 1 known then multiply M 1 M known, then solve My = to obtain y = M 1 neithe M, no M 1 ae known explicitly: algoithm to solve My = is sufficient! any appoximate solve fo Ae = algoithm to compute M 1 is sufficient! compute spase) appoximate invese SPAI) Examples: Multigid, Jacobi, ILU, SPAI,... CG with Change-of-Basis CG with Matix Peconditione Peconditiones Examples
41 Peconditiones fo CG Examples find M A and compute effect of M 1 : Jacobi peconditioning: M := D A Gauss-Seidel peconditioning: M := L A, etc. just compute effect of M 1 : any appoximate solve might do incl. multigid methods incomplete LU-decomposition ILU) use a multigid method as peconditione?) wothwhile only) in situations whee multigid does not wok well) as stand-alone solve find an M 1 simila to A 1 spase appoximate invese SPAI) ties to minimise I MA F, whee M is a matix with given) spase non-zeo patten CG Convegence CG with Change-of-Basis CG with Matix Peconditione Peconditiones Examples
42 Liteatue CG Convegence Geneal: Gande, Hebicek: Solving Poblems in Computing Using Maple and MATLAB. Golub, Otega: Computing and Diffeential Equations. Dongaa, et. al.: Numeical linea algeba fo high-pefomance computes. CG with Change-of-Basis CG with Matix Peconditione Peconditiones Examples
43 Liteatue 2) CG Convegence Multigid: Biggs, Henson, McComick: A Multigid Tutoial 2nd ed.). Gadients: Shewchuk: An Intoduction to the Gadient Method Without the Agonizing Pain. CG with Change-of-Basis CG with Matix Peconditione Peconditiones Examples
Scientific Computing II
Scientific Computing II Conjugate Gadient Methods Michael Bade Summe 2014 Conjugate Gadient Methods, Summe 2014 1 Families of Iteative Solves elaxation methods: Jacobi-, Gauss-Seidel-Relaxation,... Ove-Relaxation-Methods
More informationConjugate Gradient (CG) Method
Optimization II Conugate Gaient CG Metho Anothe metho oes not equie explicit secon eivatives, an oes not even stoe appoximation to Hessian matix CG geneates sequence of conugate seach iections, implicitly
More informationMULTILAYER PERCEPTRONS
Last updated: Nov 26, 2012 MULTILAYER PERCEPTRONS Outline 2 Combining Linea Classifies Leaning Paametes Outline 3 Combining Linea Classifies Leaning Paametes Implementing Logical Relations 4 AND and OR
More informationMAC Module 12 Eigenvalues and Eigenvectors
MAC 23 Module 2 Eigenvalues and Eigenvectos Leaning Objectives Upon completing this module, you should be able to:. Solve the eigenvalue poblem by finding the eigenvalues and the coesponding eigenvectos
More informationInformation Retrieval Advanced IR models. Luca Bondi
Advanced IR models Luca Bondi Advanced IR models 2 (LSI) Pobabilistic Latent Semantic Analysis (plsa) Vecto Space Model 3 Stating point: Vecto Space Model Documents and queies epesented as vectos in the
More informationEVALUATION OF PRECONDITIONED KRYLOV SUBSPACE METHODS FOR NAVIER-STOKES EQUATIONS
The Seventh Asia-Pacific Confeence on Wind Engineeing, Novembe 8-12, 2009, Taipei, Taiwan EVALUATION OF PRECONDITIONED KRYLOV SUBSPACE METHODS FOR NAVIER-STOKES EQUATIONS Aishe Zhang 1,2, Ming Gu 3, Cuilan
More informationA Bijective Approach to the Permutational Power of a Priority Queue
A Bijective Appoach to the Pemutational Powe of a Pioity Queue Ia M. Gessel Kuang-Yeh Wang Depatment of Mathematics Bandeis Univesity Waltham, MA 02254-9110 Abstact A pioity queue tansfoms an input pemutation
More informationMATH 220: SECOND ORDER CONSTANT COEFFICIENT PDE. We consider second order constant coefficient scalar linear PDEs on R n. These have the form
MATH 220: SECOND ORDER CONSTANT COEFFICIENT PDE ANDRAS VASY We conside second ode constant coefficient scala linea PDEs on R n. These have the fom Lu = f L = a ij xi xj + b i xi + c i whee a ij b i and
More informationLight Time Delay and Apparent Position
Light Time Delay and ppaent Position nalytical Gaphics, Inc. www.agi.com info@agi.com 610.981.8000 800.220.4785 Contents Intoduction... 3 Computing Light Time Delay... 3 Tansmission fom to... 4 Reception
More informationAbsorption Rate into a Small Sphere for a Diffusing Particle Confined in a Large Sphere
Applied Mathematics, 06, 7, 709-70 Published Online Apil 06 in SciRes. http://www.scip.og/jounal/am http://dx.doi.og/0.46/am.06.77065 Absoption Rate into a Small Sphee fo a Diffusing Paticle Confined in
More informationEM Boundary Value Problems
EM Bounday Value Poblems 10/ 9 11/ By Ilekta chistidi & Lee, Seung-Hyun A. Geneal Desciption : Maxwell Equations & Loentz Foce We want to find the equations of motion of chaged paticles. The way to do
More informationTopic 4a Introduction to Root Finding & Bracketing Methods
/8/18 Couse Instucto D. Raymond C. Rumpf Office: A 337 Phone: (915) 747 6958 E Mail: cumpf@utep.edu Topic 4a Intoduction to Root Finding & Backeting Methods EE 4386/531 Computational Methods in EE Outline
More informationAppendix A. Appendices. A.1 ɛ ijk and cross products. Vector Operations: δ ij and ɛ ijk
Appendix A Appendices A1 ɛ and coss poducts A11 Vecto Opeations: δ ij and ɛ These ae some notes on the use of the antisymmetic symbol ɛ fo expessing coss poducts This is an extemely poweful tool fo manipulating
More informationPart V: Closed-form solutions to Loop Closure Equations
Pat V: Closed-fom solutions to Loop Closue Equations This section will eview the closed-fom solutions techniques fo loop closue equations. The following thee cases will be consideed. ) Two unknown angles
More informationThe Strain Compatibility Equations in Polar Coordinates RAWB, Last Update 27/12/07
The Stain Compatibility Equations in Pola Coodinates RAWB Last Update 7//7 In D thee is just one compatibility equation. In D polas it is (Equ.) whee denotes the enineein shea (twice the tensoial shea)
More informationRigid Body Dynamics 2. CSE169: Computer Animation Instructor: Steve Rotenberg UCSD, Winter 2018
Rigid Body Dynamics 2 CSE169: Compute Animation nstucto: Steve Rotenbeg UCSD, Winte 2018 Coss Poduct & Hat Opeato Deivative of a Rotating Vecto Let s say that vecto is otating aound the oigin, maintaining
More information1D2G - Numerical solution of the neutron diffusion equation
DG - Numeical solution of the neuton diffusion equation Y. Danon Daft: /6/09 Oveview A simple numeical solution of the neuton diffusion equation in one dimension and two enegy goups was implemented. Both
More informationAs is natural, our Aerospace Structures will be described in a Euclidean three-dimensional space R 3.
Appendix A Vecto Algeba As is natual, ou Aeospace Stuctues will be descibed in a Euclidean thee-dimensional space R 3. A.1 Vectos A vecto is used to epesent quantities that have both magnitude and diection.
More information15.081J/6.251J Introduction to Mathematical Programming. Lecture 6: The Simplex Method II
15081J/6251J Intoduction to Mathematical Pogamming ectue 6: The Simplex Method II 1 Outline Revised Simplex method Slide 1 The full tableau implementation Anticycling 2 Revised Simplex Initial data: A,
More informationComplex Eigenvalues. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB
Pepaed by Vince Zaccone Fo ampus Leaning ssistance Sevices at USB omplex Numbes When solving fo the oots of a quadatic equation, eal solutions can not be found when the disciminant is negative. In these
More informationCircuit Synthesizable Guaranteed Passive Modeling for Multiport Structures
Cicuit Synthesizable Guaanteed Passive Modeling fo Multipot Stuctues Zohaib Mahmood, Luca Daniel Massachusetts Institute of Technology BMAS Septembe-23, 2010 Outline Motivation fo Compact Dynamical Passive
More informationEquilibrium Reconstruction with Grad-Shafranov Equation
Equilibium Reconstuction with Gad-Shafanov Equation Qian Peng (qp215) Apil 14, 211 1 Gad-Shafanov equation [1]Fo axial symmetic case, the tooidal B eld is B to = F φ. Whee 2π F (, θ) is the total poloidal
More informationStanford University CS259Q: Quantum Computing Handout 8 Luca Trevisan October 18, 2012
Stanfod Univesity CS59Q: Quantum Computing Handout 8 Luca Tevisan Octobe 8, 0 Lectue 8 In which we use the quantum Fouie tansfom to solve the peiod-finding poblem. The Peiod Finding Poblem Let f : {0,...,
More informationNumerical Integration
MCEN 473/573 Chapte 0 Numeical Integation Fall, 2006 Textbook, 0.4 and 0.5 Isopaametic Fomula Numeical Integation [] e [ ] T k = h B [ D][ B] e B Jdsdt In pactice, the element stiffness is calculated numeically.
More informationAnalytical time-optimal trajectories for an omni-directional vehicle
Analytical time-optimal tajectoies fo an omni-diectional vehicle Weifu Wang and Devin J. Balkcom Abstact We pesent the fist analytical solution method fo finding a time-optimal tajectoy between any given
More informationTemporal-Difference Learning
.997 Decision-Making in Lage-Scale Systems Mach 17 MIT, Sping 004 Handout #17 Lectue Note 13 1 Tempoal-Diffeence Leaning We now conside the poblem of computing an appopiate paamete, so that, given an appoximation
More informationLocalization of Eigenvalues in Small Specified Regions of Complex Plane by State Feedback Matrix
Jounal of Sciences, Islamic Republic of Ian (): - () Univesity of Tehan, ISSN - http://sciencesutaci Localization of Eigenvalues in Small Specified Regions of Complex Plane by State Feedback Matix H Ahsani
More information2. Electrostatics. Dr. Rakhesh Singh Kshetrimayum 8/11/ Electromagnetic Field Theory by R. S. Kshetrimayum
2. Electostatics D. Rakhesh Singh Kshetimayum 1 2.1 Intoduction In this chapte, we will study how to find the electostatic fields fo vaious cases? fo symmetic known chage distibution fo un-symmetic known
More informationMinimization of the quadratic test function
Miimizatio of the quadatic test fuctio A quadatic fom is a scala quadatic fuctio of a vecto with the fom f ( ) A b c with b R A R whee A is assumed to be SPD ad c is a scala costat Note: A symmetic mati
More informationValue Prediction with FA. Chapter 8: Generalization and Function Approximation. Adapt Supervised Learning Algorithms. Backups as Training Examples [ ]
Chapte 8: Genealization and Function Appoximation Objectives of this chapte:! Look at how expeience with a limited pat of the state set be used to poduce good behavio ove a much lage pat.! Oveview of function
More information3. Electromagnetic Waves II
Lectue 3 - Electomagnetic Waves II 9 3. Electomagnetic Waves II Last time, we discussed the following. 1. The popagation of an EM wave though a macoscopic media: We discussed how the wave inteacts with
More informationChapter 8: Generalization and Function Approximation
Chapte 8: Genealization and Function Appoximation Objectives of this chapte: Look at how expeience with a limited pat of the state set be used to poduce good behavio ove a much lage pat. Oveview of function
More informationNumerical Solution of Boundary Value Problems for the Laplacian in R 3 in the Case of Complex Boundary Surface
Computational Applied Mathematics Jounal 5; (: 9-5 Published online Febuay 5 (http://www.aascit.og/jounal/camj Numeical Solution of Bounday Value Poblems fo the Laplacian in R in the Case of Complex Bounday
More informationChapter 5 Linear Equations: Basic Theory and Practice
Chapte 5 inea Equations: Basic Theoy and actice In this chapte and the next, we ae inteested in the linea algebaic equation AX = b, (5-1) whee A is an m n matix, X is an n 1 vecto to be solved fo, and
More informationResearch Design - - Topic 17 Multiple Regression & Multiple Correlation: Two Predictors 2009 R.C. Gardner, Ph.D.
Reseach Design - - Topic 7 Multiple Regession & Multiple Coelation: Two Pedictos 009 R.C. Gadne, Ph.D. Geneal Rationale and Basic Aithmetic fo two pedictos Patial and semipatial coelation Regession coefficients
More information1 Spherical multipole moments
Jackson notes 9 Spheical multipole moments Suppose we have a chage distibution ρ (x) wheeallofthechageiscontained within a spheical egion of adius R, as shown in the diagam. Then thee is no chage in the
More informationPROBLEM SET #1 SOLUTIONS by Robert A. DiStasio Jr.
POBLM S # SOLUIONS by obet A. DiStasio J. Q. he Bon-Oppenheime appoximation is the standad way of appoximating the gound state of a molecula system. Wite down the conditions that detemine the tonic and
More information18.06 Problem Set 4 Solution
8.6 Poblem Set 4 Solution Total: points Section 3.5. Poblem 2: (Recommended) Find the lagest possible numbe of independent vectos among ) ) ) v = v 4 = v 5 = v 6 = v 2 = v 3 =. Solution (4 points): Since
More informationGoodness-of-fit for composite hypotheses.
Section 11 Goodness-of-fit fo composite hypotheses. Example. Let us conside a Matlab example. Let us geneate 50 obsevations fom N(1, 2): X=nomnd(1,2,50,1); Then, unning a chi-squaed goodness-of-fit test
More informationMulti-Objective Optimization Algorithms for Finite Element Model Updating
Multi-Objective Optimization Algoithms fo Finite Element Model Updating E. Ntotsios, C. Papadimitiou Univesity of Thessaly Geece Outline STRUCTURAL IDENTIFICATION USING MEASURED MODAL DATA Weighted Modal
More informationQuestion 1: The dipole
Septembe, 08 Conell Univesity, Depatment of Physics PHYS 337, Advance E&M, HW #, due: 9/5/08, :5 AM Question : The dipole Conside a system as discussed in class and shown in Fig.. in Heald & Maion.. Wite
More informationHomework # 3 Solution Key
PHYSICS 631: Geneal Relativity Homewok # 3 Solution Key 1. You e on you hono not to do this one by hand. I ealize you can use a compute o simply look it up. Please don t. In a flat space, the metic in
More informationCOMP Parallel Computing SMM (3) OpenMP Case Study: The Barnes-Hut N-body Algorithm
COMP 633 - Paallel Computing Lectue 8 Septembe 14, 2017 SMM (3) OpenMP Case Study: The Banes-Hut N-body Algoithm Topics Case study: the Banes-Hut algoithm Study an impotant algoithm in scientific computing»
More informationLecture 8 - Gauss s Law
Lectue 8 - Gauss s Law A Puzzle... Example Calculate the potential enegy, pe ion, fo an infinite 1D ionic cystal with sepaation a; that is, a ow of equally spaced chages of magnitude e and altenating sign.
More informationAn Exact Solution of Navier Stokes Equation
An Exact Solution of Navie Stokes Equation A. Salih Depatment of Aeospace Engineeing Indian Institute of Space Science and Technology, Thiuvananthapuam, Keala, India. July 20 The pincipal difficulty in
More informationPHYS 705: Classical Mechanics. Small Oscillations
PHYS 705: Classical Mechanics Small Oscillations Fomulation of the Poblem Assumptions: V q - A consevative system with depending on position only - The tansfomation equation defining does not dep on time
More informationA Crash Course in (2 2) Matrices
A Cash Couse in ( ) Matices Seveal weeks woth of matix algeba in an hou (Relax, we will only stuy the simplest case, that of matices) Review topics: What is a matix (pl matices)? A matix is a ectangula
More informationPhysics 235 Chapter 5. Chapter 5 Gravitation
Chapte 5 Gavitation In this Chapte we will eview the popeties of the gavitational foce. The gavitational foce has been discussed in geat detail in you intoductoy physics couses, and we will pimaily focus
More informationGeneral Solution of EM Wave Propagation in Anisotropic Media
Jounal of the Koean Physical Society, Vol. 57, No. 1, July 2010, pp. 55 60 Geneal Solution of EM Wave Popagation in Anisotopic Media Jinyoung Lee Electical and Electonic Engineeing Depatment, Koea Advanced
More informationQualifying Examination Electricity and Magnetism Solutions January 12, 2006
1 Qualifying Examination Electicity and Magnetism Solutions Januay 12, 2006 PROBLEM EA. a. Fist, we conside a unit length of cylinde to find the elationship between the total chage pe unit length λ and
More informationReview: Electrostatics and Magnetostatics
Review: Electostatics and Magnetostatics In the static egime, electomagnetic quantities do not vay as a function of time. We have two main cases: ELECTROSTATICS The electic chages do not change postion
More informationConservative Averaging Method and its Application for One Heat Conduction Problem
Poceedings of the 4th WSEAS Int. Conf. on HEAT TRANSFER THERMAL ENGINEERING and ENVIRONMENT Elounda Geece August - 6 (pp6-) Consevative Aveaging Method and its Application fo One Heat Conduction Poblem
More informationGradient-based Neural Network for Online Solution of Lyapunov Matrix Equation with Li Activation Function
Intenational Confeence on Infomation echnology and Management Innovation (ICIMI 05) Gadient-based Neual Netwok fo Online Solution of Lyapunov Matix Equation with Li Activation unction Shiheng Wang, Shidong
More informationEEO 401 Digital Signal Processing Prof. Mark Fowler
EEO 41 Digital Signal Pocessing Pof. Mak Fowle Note Set #31 Linea Phase FIR Design Optimum Equiipple (Paks-McClellan) Reading: Sect. 1.2.4 1.2.6 of Poakis & Manolakis 1/2 Motivation The window method and
More informationFractional Tikhonov regularization for linear discrete ill-posed problems
BIT manuscipt No. (will be inseted by the edito) Factional Tikhonov egulaization fo linea discete ill-posed poblems Michiel E. Hochstenbach Lotha Reichel Received: date / Accepted: date Abstact Tikhonov
More informationMultifrontal sparse QR factorization on the GPU
Multifontal spase QR factoization on the GPU Tim Davis, Sanjay Ranka, Shaanyan Chetlu, Nui Yealan Univesity of Floida Feb 2012 GPU-based Multifontal QR factoization why spase QR? multifontal spase QR in
More informationFE FORMULATIONS FOR PLASTICITY
G These slides ae designed based on the book: Finite Elements in Plasticity Theoy and Pactice, D.R.J. Owen and E. Hinton, 970, Pineidge Pess Ltd., Swansea, UK. Couse Content: A INTRODUCTION AND OVERVIEW
More informationIntroduction to Orbital-Free Density-Functional Theory. Ralf Gehrke FHI Berlin, February 8th 2005
Intoduction to Obital-Fee Density-Functional heoy Ralf Gehke FHI Belin, Febuay 8th 005 Outline Basics of functional deivatives I Pinciples of Obital-fee Density-Functional heoy basics of Density-Functional
More informationPhysics 121 Hour Exam #5 Solution
Physics 2 Hou xam # Solution This exam consists of a five poblems on five pages. Point values ae given with each poblem. They add up to 99 points; you will get fee point to make a total of. In any given
More informationAuchmuty High School Mathematics Department Advanced Higher Notes Teacher Version
The Binomial Theoem Factoials Auchmuty High School Mathematics Depatment The calculations,, 6 etc. often appea in mathematics. They ae called factoials and have been given the notation n!. e.g. 6! 6!!!!!
More informationDOING PHYSICS WITH MATLAB COMPUTATIONAL OPTICS
DOING PHYIC WITH MTLB COMPUTTIONL OPTIC FOUNDTION OF CLR DIFFRCTION THEORY Ian Coope chool of Physics, Univesity of ydney ian.coope@sydney.edu.au DOWNLOD DIRECTORY FOR MTLB CRIPT View document: Numeical
More informationThis is a very simple sampling mode, and this article propose an algorithm about how to recover x from y in this condition.
3d Intenational Confeence on Multimedia echnology(icm 03) A Simple Compessive Sampling Mode and the Recovey of Natue Images Based on Pixel Value Substitution Wenping Shao, Lin Ni Abstact: Compessive Sampling
More informationAnalytic Evaluation of two-electron Atomic Integrals involving Extended Hylleraas-CI functions with STO basis
Analytic Evaluation of two-electon Atomic Integals involving Extended Hylleaas-CI functions with STO basis B PADHY (Retd.) Faculty Membe Depatment of Physics, Khalikote (Autonomous) College, Behampu-760001,
More informationMath 124B February 02, 2012
Math 24B Febuay 02, 202 Vikto Gigoyan 8 Laplace s equation: popeties We have aleady encounteed Laplace s equation in the context of stationay heat conduction and wave phenomena. Recall that in two spatial
More informationNumerical solution of diffusion mass transfer model in adsorption systems. Prof. Nina Paula Gonçalves Salau, D.Sc.
Numeical solution of diffusion mass tansfe model in adsoption systems Pof., D.Sc. Agenda Mass Tansfe Mechanisms Diffusion Mass Tansfe Models Solving Diffusion Mass Tansfe Models Paamete Estimation 2 Mass
More informationVector d is a linear vector function of vector d when the following relationships hold:
Appendix 4 Dyadic Analysis DEFINITION ecto d is a linea vecto function of vecto d when the following elationships hold: d x = a xxd x + a xy d y + a xz d z d y = a yxd x + a yy d y + a yz d z d z = a zxd
More informationGENLOG Multinomial Loglinear and Logit Models
GENLOG Multinomial Loglinea and Logit Models Notation This chapte descibes the algoithms used to calculate maximum-likelihood estimates fo the multinomial loglinea model and the multinomial logit model.
More informationMEI Structured Mathematics. Module Summary Sheets. Numerical Methods (Version B reference to new book)
MEI Matematics in Education and Industy MEI Stuctued Matematics Module Summay Seets (Vesion B efeence to new book) Topic : Appoximations Topic : Te solution of equations Topic : Numeical integation Topic
More informationClassical Mechanics Homework set 7, due Nov 8th: Solutions
Classical Mechanics Homewok set 7, due Nov 8th: Solutions 1. Do deivation 8.. It has been asked what effect does a total deivative as a function of q i, t have on the Hamiltonian. Thus, lets us begin with
More informationPreconditioning of conjugate gradient iterations in interior point MPC method
MISUBISHI ELECRIC RESEARCH LABORAORIES http://wwwmelcom Peconditioning of conjugate gadient iteations in inteio point MPC method Malyshev, A; Quiynen, R; Knyazev, A R2018-120 August 25, 2018 Abstact hee
More informationMODULE 5a and 5b (Stewart, Sections 12.2, 12.3) INTRO: In MATH 1114 vectors were written either as rows (a1, a2,..., an) or as columns a 1 a. ...
MODULE 5a and 5b (Stewat, Sections 2.2, 2.3) INTRO: In MATH 4 vectos wee witten eithe as ows (a, a2,..., an) o as columns a a 2... a n and the set of all such vectos of fixed length n was called the vecto
More informationOn a generalization of Eulerian numbers
Notes on Numbe Theoy and Discete Mathematics Pint ISSN 1310 513, Online ISSN 367 875 Vol, 018, No 1, 16 DOI: 10756/nntdm018116- On a genealization of Euleian numbes Claudio Pita-Ruiz Facultad de Ingenieía,
More information15 Solving the Laplace equation by Fourier method
5 Solving the Laplace equation by Fouie method I aleady intoduced two o thee dimensional heat equation, when I deived it, ecall that it taes the fom u t = α 2 u + F, (5.) whee u: [0, ) D R, D R is the
More informationA Non-overlapping Domain Decomposition Method with Inexact Solvers 1
A Non-ovelapping Domain Decomposition Method with Inexact Solves Qiya Hu and Dudu Sun LSEC, Institute of Computational Mathematics and Scientific/Engineeing Computing, Academy of Mathematics and Systems
More informationAppendix B The Relativistic Transformation of Forces
Appendix B The Relativistic Tansfomation of oces B. The ou-foce We intoduced the idea of foces in Chapte 3 whee we saw that the change in the fou-momentum pe unit time is given by the expession d d w x
More informationPISCES II : 2.5-D RF Cavity Code
CAP'96 (Computational Acceleato Physics) Williamsbug, Viginia PISCES II :.5-D RF Cavity Code Yoshihisa Iwashita Acceleato Laboatoy, Nuclea Science Reseach Facility Institute fo Chemical Reseach, Kyoto
More informationMoment-free numerical approximation of highly oscillatory integrals with stationary points
Moment-fee numeical appoximation of highly oscillatoy integals with stationay points Sheehan Olve Abstact We pesent a method fo the numeical quadatue of highly oscillatoy integals with stationay points.
More informationChapter 2: Introduction to Implicit Equations
Habeman MTH 11 Section V: Paametic and Implicit Equations Chapte : Intoduction to Implicit Equations When we descibe cuves on the coodinate plane with algebaic equations, we can define the elationship
More information-Δ u = λ u. u(x,y) = u 1. (x) u 2. (y) u(r,θ) = R(r) Θ(θ) Δu = 2 u + 2 u. r = x 2 + y 2. tan(θ) = y/x. r cos(θ) = cos(θ) r.
The Laplace opeato in pola coodinates We now conside the Laplace opeato with Diichlet bounday conditions on a cicula egion Ω {(x,y) x + y A }. Ou goal is to compute eigenvalues and eigenfunctions of the
More informationGeometry of the homogeneous and isotropic spaces
Geomety of the homogeneous and isotopic spaces H. Sonoda Septembe 2000; last evised Octobe 2009 Abstact We summaize the aspects of the geomety of the homogeneous and isotopic spaces which ae most elevant
More informationDeconvolution: A Wavelet Frame Approach
Numeische Mathematik manuscipt No. (will be inseted by the edito) Anwei Chai Zuowei Shen Deconvolution: A Wavelet Fame Appoach Received: date / Revised vesion: date Abstact This pape devotes to analyzing
More informationSMT 2013 Team Test Solutions February 2, 2013
1 Let f 1 (n) be the numbe of divisos that n has, and define f k (n) = f 1 (f k 1 (n)) Compute the smallest intege k such that f k (013 013 ) = Answe: 4 Solution: We know that 013 013 = 3 013 11 013 61
More informationOn the integration of the equations of hydrodynamics
Uebe die Integation de hydodynamischen Gleichungen J f eine u angew Math 56 (859) -0 On the integation of the equations of hydodynamics (By A Clebsch at Calsuhe) Tanslated by D H Delphenich In a pevious
More informationEQUATIONS OF MOTION LUCA GUIDO MOLINARI
EQUATIONS OF MOTION LUCA GUIDO MOLINARI 1. Equation of motion of destuction opeatos Conside a system of bosons o femions descibed by a Hamiltonian H = H 1 + H 2, whee H 1 and H 2 ae espectively the one
More informationworking pages for Paul Richards class notes; do not copy or circulate without permission from PGR 2004/11/3 10:50
woking pages fo Paul Richads class notes; do not copy o ciculate without pemission fom PGR 2004/11/3 10:50 CHAPTER7 Solid angle, 3D integals, Gauss s Theoem, and a Delta Function We define the solid angle,
More informationChapter 3 Optical Systems with Annular Pupils
Chapte 3 Optical Systems with Annula Pupils 3 INTRODUCTION In this chapte, we discuss the imaging popeties of a system with an annula pupil in a manne simila to those fo a system with a cicula pupil The
More informationMany Electron Atoms. Electrons can be put into approximate orbitals and the properties of the many electron systems can be catalogued
Many Electon Atoms The many body poblem cannot be solved analytically. We content ouselves with developing appoximate methods that can yield quite accuate esults (but usually equie a compute). The electons
More informationThe Poisson bracket and magnetic monopoles
FYST420 Advanced electodynamics Olli Aleksante Koskivaaa Final poject ollikoskivaaa@gmail.com The Poisson backet and magnetic monopoles Abstact: In this wok magnetic monopoles ae studied using the Poisson
More informationReading Assignment. Problem Description for Homework #9. Read Chapters 29 and 30.
Reading Assignment Read Chaptes 29 and 30. Poblem Desciption fo Homewok #9 In this homewok, you will solve the inhomogeneous Laplace s equation to calculate the electic scala potential that exists between
More informationHua Xu 3 and Hiroaki Mukaidani 33. The University of Tsukuba, Otsuka. Hiroshima City University, 3-4-1, Ozuka-Higashi
he inea Quadatic Dynamic Game fo Discete-ime Descipto Systems Hua Xu 3 and Hioai Muaidani 33 3 Gaduate School of Systems Management he Univesity of suuba, 3-9- Otsua Bunyo-u, oyo -0, Japan xuhua@gssm.otsua.tsuuba.ac.jp
More informationA dual-reciprocity boundary element method for axisymmetric thermoelastodynamic deformations in functionally graded solids
APCOM & ISCM 11-14 th Decembe, 013, Singapoe A dual-ecipocity bounday element method fo axisymmetic themoelastodynamic defomations in functionally gaded solids *W. T. Ang and B. I. Yun Division of Engineeing
More informationMA557/MA578/CS557. Lecture 14. Prof. Tim Warburton. Spring
MA557/MA578/CS557 Lectue 4 Sping 3 Pof. Tim Wabuton timwa@math.unm.edu Matlab Notes To ceate a symbolic vaiable (say theta) use the command: theta = sym( theta ); Example manipulation: Matlab cont To evaluate
More informationCALCULUS II Vectors. Paul Dawkins
CALCULUS II Vectos Paul Dawkins Table of Contents Peface... ii Vectos... 3 Intoduction... 3 Vectos The Basics... 4 Vecto Aithmetic... 8 Dot Poduct... 13 Coss Poduct... 21 2007 Paul Dawkins i http://tutoial.math.lama.edu/tems.aspx
More information5.61 Physical Chemistry Lecture #23 page 1 MANY ELECTRON ATOMS
5.6 Physical Chemisty Lectue #3 page MAY ELECTRO ATOMS At this point, we see that quantum mechanics allows us to undestand the helium atom, at least qualitatively. What about atoms with moe than two electons,
More informationFresnel Diffraction. monchromatic light source
Fesnel Diffaction Equipment Helium-Neon lase (632.8 nm) on 2 axis tanslation stage, Concave lens (focal length 3.80 cm) mounted on slide holde, iis mounted on slide holde, m optical bench, micoscope slide
More informationF-IF Logistic Growth Model, Abstract Version
F-IF Logistic Gowth Model, Abstact Vesion Alignments to Content Standads: F-IFB4 Task An impotant example of a model often used in biology o ecology to model population gowth is called the logistic gowth
More information2 Lecture 2: The Bohr atom (1913) and the Schrödinger equation (1925)
1 Lectue 1: The beginnings of quantum physics 1. The Sten-Gelach expeiment. Atomic clocks 3. Planck 1900, blackbody adiation, and E ω 4. Photoelectic effect 5. Electon diffaction though cystals, de Boglie
More informationRight-handed screw dislocation in an isotropic solid
Dislocation Mechanics Elastic Popeties of Isolated Dislocations Ou study of dislocations to this point has focused on thei geomety and thei ole in accommodating plastic defomation though thei motion. We
More informationA STUDY OF HAMMING CODES AS ERROR CORRECTING CODES
AGU Intenational Jounal of Science and Technology A STUDY OF HAMMING CODES AS ERROR CORRECTING CODES Ritu Ahuja Depatment of Mathematics Khalsa College fo Women, Civil Lines, Ludhiana-141001, Punjab, (India)
More informationQuantum theory of angular momentum
Quantum theoy of angula momentum Igo Mazets igo.mazets+e141@tuwien.ac.at (Atominstitut TU Wien, Stadionallee 2, 1020 Wien Time: Fiday, 13:00 14:30 Place: Feihaus, Sem.R. DA gün 06B (exception date 18 Nov.:
More information