Numerical Analysis of Electromagnetic Fields

Size: px
Start display at page:

Download "Numerical Analysis of Electromagnetic Fields"

Transcription

1 Pei-bai Zhou Numerical Analysis of Electromagnetic Fields With 157 Figures Springer-Verlag Berlin Heidelberg New York London Paris Tokyo Hong Kong Barcelona Budapest

2 Contents Part 1 Universal Concepts for Numerical Analysis of Electromagnetic Field Problems Chapter 1 Fundamental Concepts of Electromagnetic Field Theory Maxwell's equations and boundary value problems Potential equations in different frequency ranges Boundary conditions of the interface Boundary value problems Green's theorem, Green's functions and fundamental Solutions Green's theorem Vector analogue of Green's theorem Green's function Dirac-delta function Green's function Fundamental Solutions Equivalent sources Single layer charge distribution Double layer source distributions Equivalent polarization Charge and magnetization current Integral equations of electromagnetic fields Integral form of Poisson's equation Integral equation for the exterior region Summary 30 References 31 Appendix 1.1 The integral equation of 3-D magnetic fields 31 Chapter 2 General Outline of Numerical Methods Introduction Operator equations Hilbert Space 38

3 XIV Contents Definition and properties of Operators The relationship between the properties of the Operators and the Solution of Operator equations Operator equations of electromagnetic fields Principles of error minimization Principle of weighted residuals Orthogonal projection principle Projection Operator Orthogonal projection Orthogonal projection methods Non-orthogonal projection methods Variational principle Categories of various numerical methods Methods of weighted residuals Method of moments Galerkin's finite element method Collocation methods Boundary element methods Variational approach Summary 58 References 59 Part 2 Domain Methods Cbapter 3 Finite Difference Method (FDM) Introduction Difference formulation of Poisson's equation Discretization mode for 2-D problems Difference equations in 2-D Cartesian coordinates Discretization equation in polar coordinates Discretization formula of axisymmetric fields Discretization formula of the non-linear magnetic fields Difference equations for time-dependent problems Solution methods for difference equations Properties of simultaneous equations Successive over-relaxation (SOR) method Convergence criterion Difference formulations of arbitrary boundaries and interfacial boundaries between different materials Difference formulations on the lines of symmetry Difference equation of a curved boundary Difference formulations for the interface of different materials 82

4 Contents XV 3.5 Examples Further discussions about the finite difference method Physical explanation of the finite difference method The error analysis of the finite difference method Difference equation and the principle of weighted residuals Difference equation and the variational principle Summary 92 References 93 Chapter 4 Fundamentals of Finite Element Method (FFM) Introduction General procedures of the finite dement method Domain discretization and shape functions Method using Galerkin residuals Element matrix equations System matrix equation Storage of the system matrix Treatment of the Dirichlet boundary condition Solution methods of finite element equations Direct methods Gaussian elimination method Cholesky's decomposition (triangulär decomposition) Iterative methods Method of over-relaxation iteration Conjugate-gradient method (CGM) Mesh generation Mesh generation of a triangulär element Automatic mesh generation Examples Summary 127 References 128 Chapter 5 Variational Finite Element Method Introduction Basic concepts of the functional and its variations Definition of the functional and its variations The functional The differentiation and Variation of a function Variation of the functional 135

5 XVI Contents Calculus of variations and Euler's equation Euler's equation Euler's equation for multivariable functions The shortest length of a curve Relationship between the Operator equation and the functional Variational expressions for electromagnetic field problems Variational expression for Poisson's equation Mathematical manipulation Physical manipulation Variational expressions for Poisson's equations in piece-wise homogeneous materials Variational expression for the scalar Helmholtz equation Variational expression for the magnetic field in a non-linear medium Variational finite element method Ritz method Finite element method (FEM) Domain discretization Finite element equation of a Laplacian problem Finite element equation for 2-D magnetic fields Finite element equation for non-linear magnetic fields Finite element equation for Helmholtz's equation (2-D-case) Special problems using the finite element method Approaching floating electrodes by the variational finite element method Open boundary problems Introduction Ballooning method Summary 170 References 171 Chapter 6 Elements and Shape Functions Introduction Types and requirements of the approximating functions Lagrange and Hermite shape functions Requirements of the approximating functions Global, natural, and local coordinates Natural coordinates Local coordinates Lagrange shape function Triangulär elements Quadrilateral elements Tetrahedral and hexahedral elements 188

6 Contents XVII 6.5 Parametric elements Element matrix equation Coordinate transformations, Jacobian matrix Evaluation of the Lagrangian element matrix Universal matrix Hermite shape function One dimensional Hermite shape function Triangulär Hermite shape functions Evaluation of a Hermite element matrix Application discussions Summary 206 References 206 Appendix 6.1 Langrangian shape functions for 2-D cases 207 Appendix 6.2 Commonly used shape functions for 3-D cases 208 Appendix 6.3 The universal matrix of axisymmetric fields 209 Part 3 Boundary Methods Chapter 7 Charge Simulation Method (CSM) Introduction Matrix equations of simulated charges Matrix equation in homogeneous dielectrics Governing equation subject to Dirichlet boundary conditions Governing equation subject to Neumann boundary conditions Mixed boundary conditions and free potential conductors Matrix form of Poisson's equation Matrix equation in piece-wise homogeneous dielectrics Commonly used simulated charges Point Charge Line Charge Ring Charge Charged elliptic cylinder, Applications of the Charge Simulation method Coordinate transformations Transformation matrix Inverse transformation of the field strength Optimized charge Simulation method (OCSM) Objective function Transformation of constrained conditions Examples Error analysis in the charge Simulation method Properties of the errors 241

7 XVIII Contents Error distribution pattern along the electrode contour Factors influencing the errors Summary 246 References 247 Appendix 7.1 Formulations for a point Charge 248 Appendix 7.2 Formulations for a line Charge 248 Appendix 7.3 Formulations for a ring Charge 249 Appendix 7.4 Formulations for a charged elliptic cylinder 249 Appendix 7.5 Approximate formulations for calculating K(k) and E(k) 250 Chapter 8 Surface Charge Simulation Method (SSM) Introduction Example Surface integral equations Single layer or double layer integral equations Integral equations of the interfacial surface Types of surface boundary elements and surface Charge densities Representations of boundary and Charge density Potential and field strength coefficients for 2-D and axisymmetrical problems Planar element with constant or linear Charge density Arced element with constant or linear Charge density Ring element with linear Charge density Elements for 3-D problems Planar triangulär element Cylindrical tetragonal bilinear element Isoparametric high order element Spline function element Magnetic surface Charge Simulation method Evaluation of Singular integrals The semi-analytical technique Method using coordinate transformations Numerical techniques Combine the analytical integral and Gaussian quadrature Applications Summary 280 References 280 Appendix 8.1 Potential and field strength coefficients of 2-D planar elements with constant and linear charge density Appendix 8.2 Potential and field strength coefficients of 2-D arced elements with constant and linear charge density Appendix 8.3 Coefficients of ring elements with linear charge density 285

8 Contents XIX Chapter 9 Boundary Element Method (BEM) Introduction Boundary element equations Method of weighted residuals Green's theorem Variational principle Boundary integral equation Indirect boundary integral equation Matrix formulations of the boundary integral equation Discretization and shape functions Matrix equation of a 2-dimensional constant element Evaluation of H {j and G {j Evaluation of H ü and G Matrix equation of 2-D linear elements Matrix form of Poisson's equation Matrix equation of a piecewise homogeneous domain Matrix equation of axisymmetric problems Discretization of 3-dimensional problems Use of symmetry Eddy current problems Eddy current equations A-cp formulations T-Q formulations One-dimensional Solution of an Eddy current problem BEM for solving Eddy current problems Surface impedance boundary conditions Non-linear and time-dependent problems BEM for non-linear problems Time-dependent problems Summary 321 References 322 Appendix 9.1 Bessel function 323 Chapter 10 Moment Methods Introduction Basis functions and weighting functions Galerkin's methods Point matching method Sub-regions and sub-sectional basis Interpretation using variations 335

9 XX Contents 10.4 Moment methods for solving static field problems Charge distribution of an isolated plate Charge distribution of a charged cylinder Moment methods for solving eddy current problems Integral equation of a 2-D eddy current problem Sub-sectional basis method Moment methods to solve the current distribution of a line antenna Integral equation of a line antenna Solution of Hallen's equation Summary 347 References 348 Part 4 Optimization Methods of Electromagnetic Field Problems Chapter 11 Methods of Applied Optimization Introduction Fundamental concepts Necessary and sufficient conditions for the local minimum Geometrical Interpretation of the minimizer Quadratic functions Basic method for solving unconstrained non-linear optimization problems Stability and convergence Linear search and single variable optimization Golden section method Methods of polynomial interpolation Analytic methods of unconstrained optimization problems The method of steepest descent Conjugate gradient method Conjugate direction Quadratic convergence Selection of conjugate directions Quasi-Newton's methods Davidon-Fletcher-Powell (DFP) method BFGS formulation B matrix formulae Cholesky factorization of the Hessian matrix Method of non-linear least Squares Gauss-Newton method Levenberg-Marquardt method Function comparison methods 374

10 Contents XXI Polytype method Powell's method of quadratic convergence Constrained optimization methods Basic concepts of constrained optimization Kuhn-Tucker conditions Lagrange multiplier method Necessary condition of the first order Necessary and sufficient conditions of the second order Penalty and barrier function methods Sequential unconstrained minimization technique Summary 385 References 386 Chapter 12 Optimizing Electromagnetic Devices Introduction General concepts of Optimum design Objective function Mathematical expressions of the boundary value problem Optimization methods Categories of optimization Contour optimization Method of curvature adjustment Method of charge redistribution Contour optimization by using non-linear programming Problems of domain optimization Field synthesis by using Fredholm's integral equation Domain optimization by using non-linear programming Summary 400 References 400 Subject Index 403

Inverse Problems and Optimal Design in Electricity and Magnetism

Inverse Problems and Optimal Design in Electricity and Magnetism Inverse Problems and Optimal Design in Electricity and Magnetism P. Neittaanmäki Department of Mathematics, University of Jyväskylä M. Rudnicki Institute of Electrical Engineering, Warsaw and A. Savini

More information

TABLE OF CONTENTS INTRODUCTION, APPROXIMATION & ERRORS 1. Chapter Introduction to numerical methods 1 Multiple-choice test 7 Problem set 9

TABLE OF CONTENTS INTRODUCTION, APPROXIMATION & ERRORS 1. Chapter Introduction to numerical methods 1 Multiple-choice test 7 Problem set 9 TABLE OF CONTENTS INTRODUCTION, APPROXIMATION & ERRORS 1 Chapter 01.01 Introduction to numerical methods 1 Multiple-choice test 7 Problem set 9 Chapter 01.02 Measuring errors 11 True error 11 Relative

More information

GEOPHYSICAL INVERSE THEORY AND REGULARIZATION PROBLEMS

GEOPHYSICAL INVERSE THEORY AND REGULARIZATION PROBLEMS Methods in Geochemistry and Geophysics, 36 GEOPHYSICAL INVERSE THEORY AND REGULARIZATION PROBLEMS Michael S. ZHDANOV University of Utah Salt Lake City UTAH, U.S.A. 2OO2 ELSEVIER Amsterdam - Boston - London

More information

MULTIVARIABLE CALCULUS, LINEAR ALGEBRA, AND DIFFERENTIAL EQUATIONS

MULTIVARIABLE CALCULUS, LINEAR ALGEBRA, AND DIFFERENTIAL EQUATIONS T H I R D E D I T I O N MULTIVARIABLE CALCULUS, LINEAR ALGEBRA, AND DIFFERENTIAL EQUATIONS STANLEY I. GROSSMAN University of Montana and University College London SAUNDERS COLLEGE PUBLISHING HARCOURT BRACE

More information

Introduction. Finite and Spectral Element Methods Using MATLAB. Second Edition. C. Pozrikidis. University of Massachusetts Amherst, USA

Introduction. Finite and Spectral Element Methods Using MATLAB. Second Edition. C. Pozrikidis. University of Massachusetts Amherst, USA Introduction to Finite and Spectral Element Methods Using MATLAB Second Edition C. Pozrikidis University of Massachusetts Amherst, USA (g) CRC Press Taylor & Francis Group Boca Raton London New York CRC

More information

Nonlinear Optimization: What s important?

Nonlinear Optimization: What s important? Nonlinear Optimization: What s important? Julian Hall 10th May 2012 Convexity: convex problems A local minimizer is a global minimizer A solution of f (x) = 0 (stationary point) is a minimizer A global

More information

Optimization and Root Finding. Kurt Hornik

Optimization and Root Finding. Kurt Hornik Optimization and Root Finding Kurt Hornik Basics Root finding and unconstrained smooth optimization are closely related: Solving ƒ () = 0 can be accomplished via minimizing ƒ () 2 Slide 2 Basics Root finding

More information

Numerical Mathematics

Numerical Mathematics Alfio Quarteroni Riccardo Sacco Fausto Saleri Numerical Mathematics Second Edition With 135 Figures and 45 Tables 421 Springer Contents Part I Getting Started 1 Foundations of Matrix Analysis 3 1.1 Vector

More information

Sliding Modes in Control and Optimization

Sliding Modes in Control and Optimization Vadim I. Utkin Sliding Modes in Control and Optimization With 24 Figures Springer-Verlag Berlin Heidelberg New York London Paris Tokyo Hong Kong Barcelona Budapest Contents Parti. Mathematical Tools 1

More information

Meshfree Approximation Methods with MATLAB

Meshfree Approximation Methods with MATLAB Interdisciplinary Mathematical Sc Meshfree Approximation Methods with MATLAB Gregory E. Fasshauer Illinois Institute of Technology, USA Y f? World Scientific NEW JERSEY LONDON SINGAPORE BEIJING SHANGHAI

More information

Contents as of 12/8/2017. Preface. 1. Overview...1

Contents as of 12/8/2017. Preface. 1. Overview...1 Contents as of 12/8/2017 Preface 1. Overview...1 1.1 Introduction...1 1.2 Finite element data...1 1.3 Matrix notation...3 1.4 Matrix partitions...8 1.5 Special finite element matrix notations...9 1.6 Finite

More information

Partial Differential Equations with Numerical Methods

Partial Differential Equations with Numerical Methods Stig Larsson Vidar Thomée Partial Differential Equations with Numerical Methods May 2, 2003 Springer Berlin Heidelberg New York Barcelona Hong Kong London Milan Paris Tokyo Preface Our purpose in this

More information

LINEAR AND NONLINEAR PROGRAMMING

LINEAR AND NONLINEAR PROGRAMMING LINEAR AND NONLINEAR PROGRAMMING Stephen G. Nash and Ariela Sofer George Mason University The McGraw-Hill Companies, Inc. New York St. Louis San Francisco Auckland Bogota Caracas Lisbon London Madrid Mexico

More information

Tyn Myint-U Lokenath Debnath. Linear Partial Differential Equations for Scientists and Engineers. Fourth Edition. Birkhauser Boston Basel Berlin

Tyn Myint-U Lokenath Debnath. Linear Partial Differential Equations for Scientists and Engineers. Fourth Edition. Birkhauser Boston Basel Berlin Tyn Myint-U Lokenath Debnath Linear Partial Differential Equations for Scientists and Engineers Fourth Edition Birkhauser Boston Basel Berlin Preface to the Fourth Edition Preface to the Third Edition

More information

Optimization: Nonlinear Optimization without Constraints. Nonlinear Optimization without Constraints 1 / 23

Optimization: Nonlinear Optimization without Constraints. Nonlinear Optimization without Constraints 1 / 23 Optimization: Nonlinear Optimization without Constraints Nonlinear Optimization without Constraints 1 / 23 Nonlinear optimization without constraints Unconstrained minimization min x f(x) where f(x) is

More information

Methods that avoid calculating the Hessian. Nonlinear Optimization; Steepest Descent, Quasi-Newton. Steepest Descent

Methods that avoid calculating the Hessian. Nonlinear Optimization; Steepest Descent, Quasi-Newton. Steepest Descent Nonlinear Optimization Steepest Descent and Niclas Börlin Department of Computing Science Umeå University niclas.borlin@cs.umu.se A disadvantage with the Newton method is that the Hessian has to be derived

More information

Optimization Methods

Optimization Methods Optimization Methods Decision making Examples: determining which ingredients and in what quantities to add to a mixture being made so that it will meet specifications on its composition allocating available

More information

Applied Numerical Analysis

Applied Numerical Analysis Applied Numerical Analysis Using MATLAB Second Edition Laurene V. Fausett Texas A&M University-Commerce PEARSON Prentice Hall Upper Saddle River, NJ 07458 Contents Preface xi 1 Foundations 1 1.1 Introductory

More information

METHODS FOR SOLVING MATHEMATICAL PHYSICS PROBLEMS

METHODS FOR SOLVING MATHEMATICAL PHYSICS PROBLEMS METHODS FOR SOLVING MATHEMATICAL PHYSICS PROBLEMS V.I. Agoshkov, P.B. Dubovski, V.P. Shutyaev CAMBRIDGE INTERNATIONAL SCIENCE PUBLISHING Contents PREFACE 1. MAIN PROBLEMS OF MATHEMATICAL PHYSICS 1 Main

More information

Partial Differential Equations and the Finite Element Method

Partial Differential Equations and the Finite Element Method Partial Differential Equations and the Finite Element Method Pavel Solin The University of Texas at El Paso Academy of Sciences ofthe Czech Republic iwiley- INTERSCIENCE A JOHN WILEY & SONS, INC, PUBLICATION

More information

NUMERICAL COMPUTATION IN SCIENCE AND ENGINEERING

NUMERICAL COMPUTATION IN SCIENCE AND ENGINEERING NUMERICAL COMPUTATION IN SCIENCE AND ENGINEERING C. Pozrikidis University of California, San Diego New York Oxford OXFORD UNIVERSITY PRESS 1998 CONTENTS Preface ix Pseudocode Language Commands xi 1 Numerical

More information

NUMERICAL MATHEMATICS AND COMPUTING

NUMERICAL MATHEMATICS AND COMPUTING NUMERICAL MATHEMATICS AND COMPUTING Fourth Edition Ward Cheney David Kincaid The University of Texas at Austin 9 Brooks/Cole Publishing Company I(T)P An International Thomson Publishing Company Pacific

More information

Static & Dynamic. Analysis of Structures. Edward L.Wilson. University of California, Berkeley. Fourth Edition. Professor Emeritus of Civil Engineering

Static & Dynamic. Analysis of Structures. Edward L.Wilson. University of California, Berkeley. Fourth Edition. Professor Emeritus of Civil Engineering Static & Dynamic Analysis of Structures A Physical Approach With Emphasis on Earthquake Engineering Edward LWilson Professor Emeritus of Civil Engineering University of California, Berkeley Fourth Edition

More information

Contents. Preface. 1 Introduction Optimization view on mathematical models NLP models, black-box versus explicit expression 3

Contents. Preface. 1 Introduction Optimization view on mathematical models NLP models, black-box versus explicit expression 3 Contents Preface ix 1 Introduction 1 1.1 Optimization view on mathematical models 1 1.2 NLP models, black-box versus explicit expression 3 2 Mathematical modeling, cases 7 2.1 Introduction 7 2.2 Enclosing

More information

Lecture 7 Unconstrained nonlinear programming

Lecture 7 Unconstrained nonlinear programming Lecture 7 Unconstrained nonlinear programming Weinan E 1,2 and Tiejun Li 2 1 Department of Mathematics, Princeton University, weinan@princeton.edu 2 School of Mathematical Sciences, Peking University,

More information

Preface. 2 Linear Equations and Eigenvalue Problem 22

Preface. 2 Linear Equations and Eigenvalue Problem 22 Contents Preface xv 1 Errors in Computation 1 1.1 Introduction 1 1.2 Floating Point Representation of Number 1 1.3 Binary Numbers 2 1.3.1 Binary number representation in computer 3 1.4 Significant Digits

More information

Nonlinear Functional Analysis and its Applications

Nonlinear Functional Analysis and its Applications Eberhard Zeidler Nonlinear Functional Analysis and its Applications III: Variational Methods and Optimization Translated by Leo F. Boron With 111 Illustrations Ш Springer-Verlag New York Berlin Heidelberg

More information

Least-Squares Finite Element Methods

Least-Squares Finite Element Methods Pavel В. Bochev Max D. Gunzburger Least-Squares Finite Element Methods Spri ringer Contents Part I Survey of Variational Principles and Associated Finite Element Methods 1 Classical Variational Methods

More information

Finite Element Analysis of Acoustic Scattering

Finite Element Analysis of Acoustic Scattering Frank Ihlenburg Finite Element Analysis of Acoustic Scattering With 88 Illustrations Springer Contents Preface vii 1 The Governing Equations of Time-Harmonic Wave Propagation, 1 1.1 Acoustic Waves 1 1.1.1

More information

Nonlinear Problems of Elasticity

Nonlinear Problems of Elasticity Stuart S. Antman Nonlinear Problems of Elasticity With 105 Illustrations Springer-Verlag New York Berlin Heidelberg London Paris Tokyo Hong Kong Barcelona Budapest Contents Preface vn Chapter I. Background

More information

COMPUTATIONAL ELASTICITY

COMPUTATIONAL ELASTICITY COMPUTATIONAL ELASTICITY Theory of Elasticity and Finite and Boundary Element Methods Mohammed Ameen Alpha Science International Ltd. Harrow, U.K. Contents Preface Notation vii xi PART A: THEORETICAL ELASTICITY

More information

Optimization II: Unconstrained Multivariable

Optimization II: Unconstrained Multivariable Optimization II: Unconstrained Multivariable CS 205A: Mathematical Methods for Robotics, Vision, and Graphics Justin Solomon CS 205A: Mathematical Methods Optimization II: Unconstrained Multivariable 1

More information

Index. C 2 ( ), 447 C k [a,b], 37 C0 ( ), 618 ( ), 447 CD 2 CN 2

Index. C 2 ( ), 447 C k [a,b], 37 C0 ( ), 618 ( ), 447 CD 2 CN 2 Index advection equation, 29 in three dimensions, 446 advection-diffusion equation, 31 aluminum, 200 angle between two vectors, 58 area integral, 439 automatic step control, 119 back substitution, 604

More information

Computer Aided Design of Thermal Systems (ME648)

Computer Aided Design of Thermal Systems (ME648) Computer Aided Design of Thermal Systems (ME648) PG/Open Elective Credits: 3-0-0-9 Updated Syallabus: Introduction. Basic Considerations in Design. Modelling of Thermal Systems. Numerical Modelling and

More information

NUMERICAL METHODS FOR ENGINEERING APPLICATION

NUMERICAL METHODS FOR ENGINEERING APPLICATION NUMERICAL METHODS FOR ENGINEERING APPLICATION Second Edition JOEL H. FERZIGER A Wiley-Interscience Publication JOHN WILEY & SONS, INC. New York / Chichester / Weinheim / Brisbane / Singapore / Toronto

More information

Numerical Optimization Professor Horst Cerjak, Horst Bischof, Thomas Pock Mat Vis-Gra SS09

Numerical Optimization Professor Horst Cerjak, Horst Bischof, Thomas Pock Mat Vis-Gra SS09 Numerical Optimization 1 Working Horse in Computer Vision Variational Methods Shape Analysis Machine Learning Markov Random Fields Geometry Common denominator: optimization problems 2 Overview of Methods

More information

Contents. 1 Basic Equations 1. Acknowledgment. 1.1 The Maxwell Equations Constitutive Relations 11

Contents. 1 Basic Equations 1. Acknowledgment. 1.1 The Maxwell Equations Constitutive Relations 11 Preface Foreword Acknowledgment xvi xviii xix 1 Basic Equations 1 1.1 The Maxwell Equations 1 1.1.1 Boundary Conditions at Interfaces 4 1.1.2 Energy Conservation and Poynting s Theorem 9 1.2 Constitutive

More information

Optimization II: Unconstrained Multivariable

Optimization II: Unconstrained Multivariable Optimization II: Unconstrained Multivariable CS 205A: Mathematical Methods for Robotics, Vision, and Graphics Doug James (and Justin Solomon) CS 205A: Mathematical Methods Optimization II: Unconstrained

More information

Review for Exam 2 Ben Wang and Mark Styczynski

Review for Exam 2 Ben Wang and Mark Styczynski Review for Exam Ben Wang and Mark Styczynski This is a rough approximation of what we went over in the review session. This is actually more detailed in portions than what we went over. Also, please note

More information

Numerical optimization

Numerical optimization Numerical optimization Lecture 4 Alexander & Michael Bronstein tosca.cs.technion.ac.il/book Numerical geometry of non-rigid shapes Stanford University, Winter 2009 2 Longest Slowest Shortest Minimal Maximal

More information

MATHEMATICS FOR COMPUTER VISION WEEK 8 OPTIMISATION PART 2. Dr Fabio Cuzzolin MSc in Computer Vision Oxford Brookes University Year

MATHEMATICS FOR COMPUTER VISION WEEK 8 OPTIMISATION PART 2. Dr Fabio Cuzzolin MSc in Computer Vision Oxford Brookes University Year MATHEMATICS FOR COMPUTER VISION WEEK 8 OPTIMISATION PART 2 1 Dr Fabio Cuzzolin MSc in Computer Vision Oxford Brookes University Year 2013-14 OUTLINE OF WEEK 8 topics: quadratic optimisation, least squares,

More information

Simple Examples on Rectangular Domains

Simple Examples on Rectangular Domains 84 Chapter 5 Simple Examples on Rectangular Domains In this chapter we consider simple elliptic boundary value problems in rectangular domains in R 2 or R 3 ; our prototype example is the Poisson equation

More information

Numerical optimization. Numerical optimization. Longest Shortest where Maximal Minimal. Fastest. Largest. Optimization problems

Numerical optimization. Numerical optimization. Longest Shortest where Maximal Minimal. Fastest. Largest. Optimization problems 1 Numerical optimization Alexander & Michael Bronstein, 2006-2009 Michael Bronstein, 2010 tosca.cs.technion.ac.il/book Numerical optimization 048921 Advanced topics in vision Processing and Analysis of

More information

Linear Partial Differential Equations for Scientists and Engineers

Linear Partial Differential Equations for Scientists and Engineers Tyn Myint-U Lokenath Debnath Linear Partial Differential Equations for Scientists and Engineers Fourth Edition Birkhäuser Boston Basel Berlin Tyn Myint-U 5 Sue Terrace Westport, CT 06880 USA Lokenath Debnath

More information

Algorithms for Constrained Optimization

Algorithms for Constrained Optimization 1 / 42 Algorithms for Constrained Optimization ME598/494 Lecture Max Yi Ren Department of Mechanical Engineering, Arizona State University April 19, 2015 2 / 42 Outline 1. Convergence 2. Sequential quadratic

More information

FINITE-DIMENSIONAL LINEAR ALGEBRA

FINITE-DIMENSIONAL LINEAR ALGEBRA DISCRETE MATHEMATICS AND ITS APPLICATIONS Series Editor KENNETH H ROSEN FINITE-DIMENSIONAL LINEAR ALGEBRA Mark S Gockenbach Michigan Technological University Houghton, USA CRC Press Taylor & Francis Croup

More information

Constrained Optimization

Constrained Optimization 1 / 22 Constrained Optimization ME598/494 Lecture Max Yi Ren Department of Mechanical Engineering, Arizona State University March 30, 2015 2 / 22 1. Equality constraints only 1.1 Reduced gradient 1.2 Lagrange

More information

Kernel-based Approximation. Methods using MATLAB. Gregory Fasshauer. Interdisciplinary Mathematical Sciences. Michael McCourt.

Kernel-based Approximation. Methods using MATLAB. Gregory Fasshauer. Interdisciplinary Mathematical Sciences. Michael McCourt. SINGAPORE SHANGHAI Vol TAIPEI - Interdisciplinary Mathematical Sciences 19 Kernel-based Approximation Methods using MATLAB Gregory Fasshauer Illinois Institute of Technology, USA Michael McCourt University

More information

Discrete Projection Methods for Integral Equations

Discrete Projection Methods for Integral Equations SUB Gttttingen 7 208 427 244 98 A 5141 Discrete Projection Methods for Integral Equations M.A. Golberg & C.S. Chen TM Computational Mechanics Publications Southampton UK and Boston USA Contents Sources

More information

Using MATLAB and. Abaqus. Finite Element Analysis. Introduction to. Amar Khennane. Taylor & Francis Croup. Taylor & Francis Croup,

Using MATLAB and. Abaqus. Finite Element Analysis. Introduction to. Amar Khennane. Taylor & Francis Croup. Taylor & Francis Croup, Introduction to Finite Element Analysis Using MATLAB and Abaqus Amar Khennane Taylor & Francis Croup Boca Raton London New York CRC Press is an imprint of the Taylor & Francis Croup, an informa business

More information

Scientific Computing: An Introductory Survey

Scientific Computing: An Introductory Survey Scientific Computing: An Introductory Survey Chapter 6 Optimization Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign Copyright c 2002. Reproduction permitted

More information

Scientific Computing: An Introductory Survey

Scientific Computing: An Introductory Survey Scientific Computing: An Introductory Survey Chapter 6 Optimization Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign Copyright c 2002. Reproduction permitted

More information

Richard A. Mould. Basic Relativity. With 144 Figures. Springer-Verlag New York Berlin Heidelberg London Paris Tokyo Hong Kong Barcelona Budapest

Richard A. Mould. Basic Relativity. With 144 Figures. Springer-Verlag New York Berlin Heidelberg London Paris Tokyo Hong Kong Barcelona Budapest Richard A. Mould Basic Relativity With 144 Figures Springer-Verlag New York Berlin Heidelberg London Paris Tokyo Hong Kong Barcelona Budapest Contents Preface vii PARTI 1. Principles of Relativity 3 1.1

More information

Programming, numerics and optimization

Programming, numerics and optimization Programming, numerics and optimization Lecture C-3: Unconstrained optimization II Łukasz Jankowski ljank@ippt.pan.pl Institute of Fundamental Technological Research Room 4.32, Phone +22.8261281 ext. 428

More information

Statistics 580 Optimization Methods

Statistics 580 Optimization Methods Statistics 580 Optimization Methods Introduction Let fx be a given real-valued function on R p. The general optimization problem is to find an x ɛ R p at which fx attain a maximum or a minimum. It is of

More information

Code No: RT41033 R13 Set No. 1 IV B.Tech I Semester Regular Examinations, November - 2016 FINITE ELEMENT METHODS (Common to Mechanical Engineering, Aeronautical Engineering and Automobile Engineering)

More information

A THEORETICAL INTRODUCTION TO NUMERICAL ANALYSIS

A THEORETICAL INTRODUCTION TO NUMERICAL ANALYSIS A THEORETICAL INTRODUCTION TO NUMERICAL ANALYSIS Victor S. Ryaben'kii Semyon V. Tsynkov Chapman &. Hall/CRC Taylor & Francis Group Boca Raton London New York Chapman & Hall/CRC is an imprint of the Taylor

More information

Numerical Optimization: Basic Concepts and Algorithms

Numerical Optimization: Basic Concepts and Algorithms May 27th 2015 Numerical Optimization: Basic Concepts and Algorithms R. Duvigneau R. Duvigneau - Numerical Optimization: Basic Concepts and Algorithms 1 Outline Some basic concepts in optimization Some

More information

Review. Numerical Methods Lecture 22. Prof. Jinbo Bi CSE, UConn

Review. Numerical Methods Lecture 22. Prof. Jinbo Bi CSE, UConn Review Taylor Series and Error Analysis Roots of Equations Linear Algebraic Equations Optimization Numerical Differentiation and Integration Ordinary Differential Equations Partial Differential Equations

More information

Chapter 3 Numerical Methods

Chapter 3 Numerical Methods Chapter 3 Numerical Methods Part 2 3.2 Systems of Equations 3.3 Nonlinear and Constrained Optimization 1 Outline 3.2 Systems of Equations 3.3 Nonlinear and Constrained Optimization Summary 2 Outline 3.2

More information

Outline. Scientific Computing: An Introductory Survey. Optimization. Optimization Problems. Examples: Optimization Problems

Outline. Scientific Computing: An Introductory Survey. Optimization. Optimization Problems. Examples: Optimization Problems Outline Scientific Computing: An Introductory Survey Chapter 6 Optimization 1 Prof. Michael. Heath Department of Computer Science University of Illinois at Urbana-Champaign Copyright c 2002. Reproduction

More information

THE NUMERICAL TREATMENT OF DIFFERENTIAL EQUATIONS

THE NUMERICAL TREATMENT OF DIFFERENTIAL EQUATIONS THE NUMERICAL TREATMENT OF DIFFERENTIAL EQUATIONS 2008 AGI-Information Management Consultants May be used for personal purporses only or by libraries associated to dandelon.com network. BY DR. LOTHAR COLLATZ

More information

Math 302 Outcome Statements Winter 2013

Math 302 Outcome Statements Winter 2013 Math 302 Outcome Statements Winter 2013 1 Rectangular Space Coordinates; Vectors in the Three-Dimensional Space (a) Cartesian coordinates of a point (b) sphere (c) symmetry about a point, a line, and a

More information

Y. M. TEMIS AND V. V. KARABAN 1

Y. M. TEMIS AND V. V. KARABAN 1 J. KSIAM Vol.5, No.2, 39-51, 2001 BOUNDARY ELEMENT TECHNIQUE IN TORSION PROBLEMS OF BEAMS WITH MULTIPLY CONNECTED CROSS-SECTIONS Y. M. TEMIS AND V. V. KARABAN 1 Abstract. This paper shows how boundary

More information

Numerical Analysis for Statisticians

Numerical Analysis for Statisticians Kenneth Lange Numerical Analysis for Statisticians Springer Contents Preface v 1 Recurrence Relations 1 1.1 Introduction 1 1.2 Binomial CoefRcients 1 1.3 Number of Partitions of a Set 2 1.4 Horner's Method

More information

Advanced. Engineering Mathematics

Advanced. Engineering Mathematics Advanced Engineering Mathematics A new edition of Further Engineering Mathematics K. A. Stroud Formerly Principal Lecturer Department of Mathematics, Coventry University with additions by Dexter j. Booth

More information

Quasi-Newton Methods

Quasi-Newton Methods Newton s Method Pros and Cons Quasi-Newton Methods MA 348 Kurt Bryan Newton s method has some very nice properties: It s extremely fast, at least once it gets near the minimum, and with the simple modifications

More information

Quantum Mechanics: Foundations and Applications

Quantum Mechanics: Foundations and Applications Arno Böhm Quantum Mechanics: Foundations and Applications Third Edition, Revised and Enlarged Prepared with Mark Loewe With 96 Illustrations Springer-Verlag New York Berlin Heidelberg London Paris Tokyo

More information

ENGINEERING MATHEMATICS I. CODE: 10 MAT 11 IA Marks: 25 Hrs/Week: 04 Exam Hrs: 03 PART-A

ENGINEERING MATHEMATICS I. CODE: 10 MAT 11 IA Marks: 25 Hrs/Week: 04 Exam Hrs: 03 PART-A ENGINEERING MATHEMATICS I CODE: 10 MAT 11 IA Marks: 25 Hrs/Week: 04 Exam Hrs: 03 Total Hrs: 52 Exam Marks:100 PART-A Unit-I: DIFFERENTIAL CALCULUS - 1 Determination of n th derivative of standard functions-illustrative

More information

GAME PHYSICS SECOND EDITION. дяййтаййг 1 *

GAME PHYSICS SECOND EDITION. дяййтаййг 1 * GAME PHYSICS SECOND EDITION DAVID H. EBERLY дяййтаййг 1 * К AMSTERDAM BOSTON HEIDELBERG LONDON NEW YORK OXFORD PARIS SAN DIEGO SAN FRANCISCO SINGAPORE SYDNEY TOKYO MORGAN ELSEVIER Morgan Kaufmann Publishers

More information

5 Handling Constraints

5 Handling Constraints 5 Handling Constraints Engineering design optimization problems are very rarely unconstrained. Moreover, the constraints that appear in these problems are typically nonlinear. This motivates our interest

More information

NonlinearOptimization

NonlinearOptimization 1/35 NonlinearOptimization Pavel Kordík Department of Computer Systems Faculty of Information Technology Czech Technical University in Prague Jiří Kašpar, Pavel Tvrdík, 2011 Unconstrained nonlinear optimization,

More information

Optimization: Insights and Applications. Jan Brinkhuis Vladimir Tikhomirov PRINCETON UNIVERSITY PRESS PRINCETON AND OXFORD

Optimization: Insights and Applications. Jan Brinkhuis Vladimir Tikhomirov PRINCETON UNIVERSITY PRESS PRINCETON AND OXFORD Optimization: Insights and Applications Jan Brinkhuis Vladimir Tikhomirov PRINCETON UNIVERSITY PRESS PRINCETON AND OXFORD Contents Preface 0.1 Optimization: insights and applications xiii 0.2 Lunch, dinner,

More information

The Finite Element Method for Solid and Structural Mechanics

The Finite Element Method for Solid and Structural Mechanics The Finite Element Method for Solid and Structural Mechanics Sixth edition O.C. Zienkiewicz, CBE, FRS UNESCO Professor of Numerical Methods in Engineering International Centre for Numerical Methods in

More information

Chapter 4. Unconstrained optimization

Chapter 4. Unconstrained optimization Chapter 4. Unconstrained optimization Version: 28-10-2012 Material: (for details see) Chapter 11 in [FKS] (pp.251-276) A reference e.g. L.11.2 refers to the corresponding Lemma in the book [FKS] PDF-file

More information

Optimization Methods

Optimization Methods Optimization Methods Categorization of Optimization Problems Continuous Optimization Discrete Optimization Combinatorial Optimization Variational Optimization Common Optimization Concepts in Computer Vision

More information

Back Matter Index The McGraw Hill Companies, 2004

Back Matter Index The McGraw Hill Companies, 2004 INDEX A Absolute viscosity, 294 Active zone, 468 Adjoint, 452 Admissible functions, 132 Air, 294 ALGOR, 12 Amplitude, 389, 391 Amplitude ratio, 396 ANSYS, 12 Applications fluid mechanics, 293 326. See

More information

Numerical Methods with MATLAB

Numerical Methods with MATLAB Numerical Methods with MATLAB A Resource for Scientists and Engineers G. J. BÖRSE Lehigh University PWS Publishing Company I(T)P AN!NTERNATIONAL THOMSON PUBLISHING COMPANY Boston Albany Bonn Cincinnati

More information

INTRODUCTION TO THE CALCULUS OF VARIATIONS AND ITS APPLICATIONS

INTRODUCTION TO THE CALCULUS OF VARIATIONS AND ITS APPLICATIONS INTRODUCTION TO THE CALCULUS OF VARIATIONS AND ITS APPLICATIONS Frederick Y.M. Wan University of California, Irvine CHAPMAN & HALL I(J)P An International Thomson Publishing Company New York Albany Bonn

More information

Conjugate Directions for Stochastic Gradient Descent

Conjugate Directions for Stochastic Gradient Descent Conjugate Directions for Stochastic Gradient Descent Nicol N Schraudolph Thore Graepel Institute of Computational Science ETH Zürich, Switzerland {schraudo,graepel}@infethzch Abstract The method of conjugate

More information

Fundamental Numerical Methods for Electrical Engineering

Fundamental Numerical Methods for Electrical Engineering Stanislaw Rosloniec Fundamental Numerical Methods for Electrical Engineering 4y Springei Contents Introduction xi 1 Methods for Numerical Solution of Linear Equations 1 1.1 Direct Methods 5 1.1.1 The Gauss

More information

CAM Ph.D. Qualifying Exam in Numerical Analysis CONTENTS

CAM Ph.D. Qualifying Exam in Numerical Analysis CONTENTS CAM Ph.D. Qualifying Exam in Numerical Analysis CONTENTS Preliminaries Round-off errors and computer arithmetic, algorithms and convergence Solutions of Equations in One Variable Bisection method, fixed-point

More information

Electromagnetic Theory for Microwaves and Optoelectronics

Electromagnetic Theory for Microwaves and Optoelectronics Keqian Zhang Dejie Li Electromagnetic Theory for Microwaves and Optoelectronics Second Edition With 280 Figures and 13 Tables 4u Springer Basic Electromagnetic Theory 1 1.1 Maxwell's Equations 1 1.1.1

More information

From Completing the Squares and Orthogonal Projection to Finite Element Methods

From Completing the Squares and Orthogonal Projection to Finite Element Methods From Completing the Squares and Orthogonal Projection to Finite Element Methods Mo MU Background In scientific computing, it is important to start with an appropriate model in order to design effective

More information

Introduction to Numerical Analysis

Introduction to Numerical Analysis J. Stoer R. Bulirsch Introduction to Numerical Analysis Second Edition Translated by R. Bartels, W. Gautschi, and C. Witzgall With 35 Illustrations Springer Contents Preface to the Second Edition Preface

More information

Optimization Methods for Circuit Design

Optimization Methods for Circuit Design Technische Universität München Department of Electrical Engineering and Information Technology Institute for Electronic Design Automation Optimization Methods for Circuit Design Compendium H. Graeb Version

More information

Numerisches Rechnen. (für Informatiker) M. Grepl P. Esser & G. Welper & L. Zhang. Institut für Geometrie und Praktische Mathematik RWTH Aachen

Numerisches Rechnen. (für Informatiker) M. Grepl P. Esser & G. Welper & L. Zhang. Institut für Geometrie und Praktische Mathematik RWTH Aachen Numerisches Rechnen (für Informatiker) M. Grepl P. Esser & G. Welper & L. Zhang Institut für Geometrie und Praktische Mathematik RWTH Aachen Wintersemester 2011/12 IGPM, RWTH Aachen Numerisches Rechnen

More information

Course Outline. Date Lecture Topic Reading

Course Outline. Date Lecture Topic Reading Course Outline Date Lecture Topic Reading Graduate Mathematical Physics Tue 24 Aug Linear Algebra: Theory 744 756 Vectors, bases and components Linear maps and dual vectors Inner products and adjoint operators

More information

Boundary. DIFFERENTIAL EQUATIONS with Fourier Series and. Value Problems APPLIED PARTIAL. Fifth Edition. Richard Haberman PEARSON

Boundary. DIFFERENTIAL EQUATIONS with Fourier Series and. Value Problems APPLIED PARTIAL. Fifth Edition. Richard Haberman PEARSON APPLIED PARTIAL DIFFERENTIAL EQUATIONS with Fourier Series and Boundary Value Problems Fifth Edition Richard Haberman Southern Methodist University PEARSON Boston Columbus Indianapolis New York San Francisco

More information

Engineering Electromagnetics

Engineering Electromagnetics Nathan Ida Engineering Electromagnetics With 821 Illustrations Springer Contents Preface vu Vector Algebra 1 1.1 Introduction 1 1.2 Scalars and Vectors 2 1.3 Products of Vectors 13 1.4 Definition of Fields

More information

METHODS OF THEORETICAL PHYSICS

METHODS OF THEORETICAL PHYSICS METHODS OF THEORETICAL PHYSICS Philip M. Morse PROFESSOR OF PHYSICS MASSACHUSETTS INSTITUTE OF TECHNOLOGY Herman Feshbach PROFESSOR OF PHYSICS MASSACHUSETTS INSTITUTE OF TECHNOLOGY PART I: CHAPTERS 1 TO

More information

IDL Advanced Math & Stats Module

IDL Advanced Math & Stats Module IDL Advanced Math & Stats Module Regression List of Routines and Functions Multiple Linear Regression IMSL_REGRESSORS IMSL_MULTIREGRESS IMSL_MULTIPREDICT Generates regressors for a general linear model.

More information

Contents. Chapter 1 Vector Spaces. Foreword... (vii) Message...(ix) Preface...(xi)

Contents. Chapter 1 Vector Spaces. Foreword... (vii) Message...(ix) Preface...(xi) (xiii) Contents Foreword... (vii) Message...(ix) Preface...(xi) Chapter 1 Vector Spaces Vector space... 1 General Properties of vector spaces... 5 Vector Subspaces... 7 Algebra of subspaces... 11 Linear

More information

Chap. 1 Fundamental Concepts

Chap. 1 Fundamental Concepts NE 2 Chap. 1 Fundamental Concepts Important Laws in Electromagnetics Coulomb s Law (1785) Gauss s Law (1839) Ampere s Law (1827) Ohm s Law (1827) Kirchhoff s Law (1845) Biot-Savart Law (1820) Faradays

More information

Fluid Dynamics: Theory, Computation, and Numerical Simulation Second Edition

Fluid Dynamics: Theory, Computation, and Numerical Simulation Second Edition Fluid Dynamics: Theory, Computation, and Numerical Simulation Second Edition C. Pozrikidis m Springer Contents Preface v 1 Introduction to Kinematics 1 1.1 Fluids and solids 1 1.2 Fluid parcels and flow

More information

COPYRIGHTED MATERIAL. Index

COPYRIGHTED MATERIAL. Index Index A Admissible function, 163 Amplification factor, 36 Amplitude, 1, 22 Amplitude-modulated carrier, 630 Amplitude ratio, 36 Antinodes, 612 Approximate analytical methods, 647 Assumed modes method,

More information

Principles of Electron Optics

Principles of Electron Optics Principles of Electron Optics Volume 1 Basic Geometrical Optics by P. W. HAWKES CNRS Laboratory of Electron Optics, Toulouse, France and E. KASPER Institut für Angewandte Physik Universität Tübingen, Federal

More information

Contents. Preface to the Third Edition (2007) Preface to the Second Edition (1992) Preface to the First Edition (1985) License and Legal Information

Contents. Preface to the Third Edition (2007) Preface to the Second Edition (1992) Preface to the First Edition (1985) License and Legal Information Contents Preface to the Third Edition (2007) Preface to the Second Edition (1992) Preface to the First Edition (1985) License and Legal Information xi xiv xvii xix 1 Preliminaries 1 1.0 Introduction.............................

More information

Chapter 1 Mathematical Foundations

Chapter 1 Mathematical Foundations Computational Electromagnetics; Chapter 1 1 Chapter 1 Mathematical Foundations 1.1 Maxwell s Equations Electromagnetic phenomena can be described by the electric field E, the electric induction D, the

More information

5 Quasi-Newton Methods

5 Quasi-Newton Methods Unconstrained Convex Optimization 26 5 Quasi-Newton Methods If the Hessian is unavailable... Notation: H = Hessian matrix. B is the approximation of H. C is the approximation of H 1. Problem: Solve min

More information