Optimization with COMSOL Multiphysics COMSOL Tokyo Conference Walter Frei, PhD Applications Engineer
|
|
- Naomi Briggs
- 6 years ago
- Views:
Transcription
1 Optimization with COMSOL Multiphysics COMSOL Tokyo Conference 2014 Walter Frei, PhD Applications Engineer
2 Product Suite COMSOL 5.0
3 Agenda An introduction to optimization A lot of concepts, and a little bit of math What do these options mean? Demo Overview of Examples
4 A quick conceptual introduction, and some terminologies - Dimensions - Material Constrained Properties Design - Operating Variables: Conditions χ -etc Black Box u(χ) K(χ)u=b(χ) - Performance Objective: f(u(χ)) - Failure criteria & -etc Constraints: g(u(χ)) Optimization
5 More formally, optimization is min χ R such that : χ p g L f ( χ) ( u( χ) ) χ 0 ( u( χ) ) = χ U 0 Objective function Simple bounds on the design variables Pointwise constraints on the design variables General Equality constraints h ( u( χ) ) 0 General Inequality constraints
6 The design variables: χ χ 2 Design Space χ 2,U Pointwise constraints p(χ) 0 χ 1,L χ 1,U χ 1 χ 2,L Upper and Lower Bounds
7 The design space must be continuous χ 2 Design Space 1 Design Space 2 χ 1 Break this up into two separate optimization problems
8 Why no equality constraints for χ? χ 2 χ 2,U p(χ) = 0 χ 1,L χ 1,U χ 1 χ 2,L An equality constraint is equivalent to a different optimization problem with one less design variable
9 Introduce a new design variable instead χ 2 χ 2,U χ A,U χ 1 = f(χ A ) χ 2 = f(χ A ) χ A χ 1,L χ 1,U χ 1 χ A,L χ 2,L
10 The design space must be continuous in the real number space χ 2 χ 1 Optimizing over a set of discrete values is an Integer Programming problem LiveLink for MATLAB & LiveLink for Excel can be used to interface to 3 rd party optimizers
11 It is helpful if the design space is convex Usually more difficult Every point can see every other design point
12 Now lets look at the objective function: f(u(χ)) or f(χ) χ 2 χ 1 χ 1 χ 2
13 We are always starting somewhere f We want to improve this χ 2 Tip: Always start optimizing from a feasible design Initial design χ 1
14 Lets first assume a smooth and differentiable objective function with a single minimum f χ f χ 2 1) Find the gradient 2) Search along the line 3) Find the minimum 4) Repeat χ 1
15 Repeat until converged Start from a point, find the direction of steepest descent (the gradient) and search in that direction for a minimum Repeat Once the gradient is zero, or the boundary of the design space is reached, stop
16 Adjoint method is used to compute derivatives χ u χ f χ ( ) u b( χ) K χ ( K( χ) u b( χ) ) ( ) K χ χ = ( ) u + K χ 0 u χ 1 b = K ( χ) χ f u = u χ = 0 ( χ) b = χ ( χ) K( χ) χ u Finite element equations Differentiate w.r.t. χ Expand Re-arrange Assuming f is differentiable w.r.t. u Computing this derivative only doubles the computational requirements, regardless of how many design variables there are
17 If we hit a constraint, follow it Start from a point, find the direction of steepest descent (the gradient) and search in that direction for a minimum Repeat Once the gradient is zero, or the boundary of the design space is reached, stop
18 What if we have multiple minima? Depends on where you start! You are never guaranteed of finding the global minimum, but you can find a local minimum
19 What if the objective function is not smooth or differentiable? Approximate the shape by evaluating the objective function repeatedly For example, Nelder-Mead evaluates n+1 points when optimizing n design variables
20 What if the objective function is not smooth or differentiable? Approximate the shape by evaluating the objective function repeatedly For example, Nelder-Mead evaluates n+1 points when optimizing n design variables
21 What if we want to include general equality and inequality constraints? g(u(χ)) = 0 χ 1 χ 2 Highly constrained design space h(u(χ)) 0 χ 1 χ 2 Strong dependence on initial conditions
22 Summary Design variables must be continuous and real-valued Design space: Simple (Cartesian) bounds Pointwise inequality constraints If you want to set up an equality constraint, get rid of one design variable Convex design space is better Objective function If it is smooth and differentiable, can use the Adjoint method and the gradient-based optimization technique If it is non-smooth or non-differentiable Use the gradient-free approach General Equality and Inequality Constraints Equality constraints can severely complicate the optimization problem Inequality constraints can make the design space non-continuous
23 Demo: A bracket with a hole Fixed Load
24 First, minimize the mass by changing the hole radius R The radius must be greater than zero, and not so large as to cut the bracket in half
25 Next, add a constraint on the maximum stress within the part σ < σ max But the location of the peak stress is not known, So we use a maximum coupling operator & a constraint
26 What about moving & resizing the hole?
27 Let s look at the constraints... How can we express these mathematically?
28 Add one more design variable R A
29 Let s take these constraints a few at a time With a bit of (behind the scenes) trigonometry: B = (1-0.25*A)/(1+sqrt(4.25)/2) R A R Which leads to the constraint: B-R>0
30 What about the other limits? A R>0.2 A R
31 Sometimes we can just ignore a constraint Based upon the simulations so far, its likely this constraint will never be an issue
32 The available optimization solvers Optimization Module Gradient-Free Methods Gradient-Based Methods Monte -Carlo MMA SNOPT Levenberg- Marquardt Coordinate Search Nelder- Mead BOBYQA COBYLA
33 When to use gradient-free methods? Non-differentiable objective function, and/or constraints Few design variables Optimization time increases exponentially with number of variables Aim for less than 10 design variables Whenever re-meshing will occur Re-meshing results in a non-smooth objective function
34 Faster Slower Usually the Most Robust The gradient-free solvers COBYLA Similar to BOBYQA, but uses a linear approximation Can consider constraints BOBYQA Constructs a quadratic approximant to the objective function Probably the fastest, but needs a reasonably smooth objective function Nelder-Mead Construct a simplex, and improve the worst point Probably the best if the objective function is relatively noisy Can consider constraints Coordinate Search Search along one design variable at a time Estimate the gradients along that line, move on to next variable, repeat Monte-Carlo Random choices of design variables are evaluated Only a very dense statistical sampling can find the global optimum
35 When to use gradient-based methods? Differentiable objective function, and/or constraints Many design variables Optimization speed does not depend strongly on number of variables 100,000+ design variables are not unreasonable Topology Optimization
36 The gradient-based solvers SNOPT Sequential Quadratic Programming algorithm MMA Linear convergence rate near the optimum Popular in the Topology Optimization community Levenberg-Marquardt Only for unconstrained least squares minimization problems Very fast
37 Scaling and Tolerances Specify scales for all control variables In Optimization study step for global parameters In Optimization interface features for fields All solvers work with rescaled variables Solver tolerances are relative to these Keep objectives and constraints close to 1 Solvers may use scaled gradient for termination
38 Comparison of Algorithms Objective Function Design Variables Gradient-Free Any scalar output Anything, including geometric dimensions Gradient-Based Must be both smooth and differentiable Anything, but cannot result in remeshing of the geometry Allows Yes No Remeshing Constraints Can only constrain scalar outputs Constraints must be smooth and differentiable, but can be at each point in space Relative Performance Increases exponentially with the number of design variables Performance is not very sensitive to the number of design variables
39 So what else can you do? Parameter Estimation & Curve Fitting Shape & Dimension Topology
40 Optimization of joint positions in a truckmounted crane. Reduces force on boom lift cylinder for a range of operation conditions Uses the Multibody Dynamics Module Structural Sizing
41 Multi-study Structural Sizing Weight minimization of a mounting bracket. Multi-study constraints Maximum stress under static load Lowest eigenfrequency
42 Estimating the material properties based upon experimental data
43 Example: Optimizing a Flywheel, with Constraints Make stress distribution as uniform along the radius as possible Constrain the mass not to change Constrain the moment of inertia not to change Gradient-based approach
44 Example: Band dispersion in a microchannel Minimize the difference is transit time between inside and outside Gradient-Free optimization
45 Example: Optimizing a Horn Maximize the sound intensity along the axis of the horn The shape of the horn is described by a sum of sine waves Truncated Fourier series The Deformed Mesh functionality is used to avoid remeshing the domain Gradient-Based approach
46 Example: Optimizing a Heater Maximize the temperature at the outlet Such that the temperature at each heater stays below a target
47 Example: Optimizing a Spinning Wheel Minimize the Mass By changing: r inner r outer Constrain the maximum stress
48 Topology Optimization: Buy this book
49 Example: Optimizing a Beam Minimize the compliance Add constraint on total material SIMP method
50 Example: Tesla Microvalve Flow to the right: Minimize p Flow to the left: Maximize p Laurits Højgaard Olesen, Fridolin Okkels and Henrik Bruus, A high-level programming-language implementation of topology optimization applied to steady-state Navier Stokes flow, Int. J. Numer. Meth. Engng 2006; 65:
51 COMSOL Conference Papers on Topology Optimization Topology Optimization in Multiple Physics Problems, O. Sigmund, DTU Mechanical Engineering, Multiphysics Topology Optimization of Heat Transfer and Fluid Flow Systems, E. Dede, Toyota Research Institute of North America, Simulation of Topology Optimized Electrothermal Microgrippers, O. Sardan, D. Petersen, O. Sigmund, & P. Boggild, DTU Mechanical Engineering, Implementation of Structural Topology Optimization in COMSOL, B. Lemke, Z. Liu, & J. G. Korvink, Department of Microsystems Engineering, University of Freiburg, Topology Optimization of Dielectric Metamaterials Based on the Level Set Method Using COMSOL Multiphysics, M. Otomori & S. Nishiwaki, Kyoto University, Optimization of a Photonic Crystal Waveguide Termination, W. Frei, COMSOL,
52 When to use which one? Early in the design process, when you have a lot of time to run analyses, and don t have a very rigid idea about your final design? Already have the basic topology fixed, but can change the shape? It s about to go to production, and we realized it doesn t work!!!
53 When to use which one? Early in the design process, when you have a lot of time to run analyses, and don t have a very rigid idea about your final design? Topology Optimization Already have the basic topology fixed, but can change the shape? Shape Optimization It s about to go to production, and we realized it doesn t work!!! Dimensional Optimization
54 Some general optimization tips Scale your objective function to be close to unity Do not get frustrated, the software doesn t know that you haven t asked the right question Start as simple as possible, especially with constraints
55 Concluding remarks min χ R such that : χ p g h L f ( u( χ) ) χ χ U ( χ) 0 ( u( χ) ) = 0 ( u( χ) ) 0
Optimisation and Operations Research
Optimisation and Operations Research Lecture 22: Linear Programming Revisited Matthew Roughan http://www.maths.adelaide.edu.au/matthew.roughan/ Lecture_notes/OORII/ School
More informationDESIGN OF MICRO-FLUIDIC BIO-REACTORS USING TOPOLOGY OPTIMIZATION
European Conference on Computational Fluid Dynamics ECCOMAS CFD 2006 P. Wesseling, E. Oñate and J. Périaux (Eds) c TU Delft, The Netherlands, 2006 DESIGN OF MICRO-FLUIDIC BIO-REACTORS USING TOPOLOGY OPTIMIZATION
More informationNumerical Optimization Professor Horst Cerjak, Horst Bischof, Thomas Pock Mat Vis-Gra SS09
Numerical Optimization 1 Working Horse in Computer Vision Variational Methods Shape Analysis Machine Learning Markov Random Fields Geometry Common denominator: optimization problems 2 Overview of Methods
More informationNonlinear Optimization for Optimal Control
Nonlinear Optimization for Optimal Control Pieter Abbeel UC Berkeley EECS Many slides and figures adapted from Stephen Boyd [optional] Boyd and Vandenberghe, Convex Optimization, Chapters 9 11 [optional]
More informationTOPOLOGY OPTIMIZATION OF NAVIER-STOKES FLOW IN MICROFLUIDICS
European Congress on Computational Methods in Applied Sciences and Engineering ECCOMAS 2004 P. Neittaanmäki, T. Rossi, S. Korotov, E. Oñate, J. Périaux, and D. Knörzer (eds.) Jyväskylä, 24 28 July 2004
More informationElectromagnetics in COMSOL Multiphysics is extended by add-on Modules
AC/DC Module Electromagnetics in COMSOL Multiphysics is extended by add-on Modules 1) Start Here 2) Add Modules based upon your needs 3) Additional Modules extend the physics you can address 4) Interface
More informationTopology Optimization of Micro Tesla Valve in low and moderate Reynolds number
Sen Lin (CIOMP.CAS) E-mail: SenLin41@gmail.com of Micro Tesla Valve 1 / 22 Topology of Micro Tesla Valve in low and moderate Reynolds number (Summary of my works during the past year) Sen Lin Advised by
More informationMVE165/MMG631 Linear and integer optimization with applications Lecture 13 Overview of nonlinear programming. Ann-Brith Strömberg
MVE165/MMG631 Overview of nonlinear programming Ann-Brith Strömberg 2015 05 21 Areas of applications, examples (Ch. 9.1) Structural optimization Design of aircraft, ships, bridges, etc Decide on the material
More informationAM 205: lecture 19. Last time: Conditions for optimality Today: Newton s method for optimization, survey of optimization methods
AM 205: lecture 19 Last time: Conditions for optimality Today: Newton s method for optimization, survey of optimization methods Optimality Conditions: Equality Constrained Case As another example of equality
More informationNumerical optimization
Numerical optimization Lecture 4 Alexander & Michael Bronstein tosca.cs.technion.ac.il/book Numerical geometry of non-rigid shapes Stanford University, Winter 2009 2 Longest Slowest Shortest Minimal Maximal
More informationScientific Computing: Optimization
Scientific Computing: Optimization Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course MATH-GA.2043 or CSCI-GA.2112, Spring 2012 March 8th, 2011 A. Donev (Courant Institute) Lecture
More informationToday. Introduction to optimization Definition and motivation 1-dimensional methods. Multi-dimensional methods. General strategies, value-only methods
Optimization Last time Root inding: deinition, motivation Algorithms: Bisection, alse position, secant, Newton-Raphson Convergence & tradeos Eample applications o Newton s method Root inding in > 1 dimension
More informationGradient Descent. Dr. Xiaowei Huang
Gradient Descent Dr. Xiaowei Huang https://cgi.csc.liv.ac.uk/~xiaowei/ Up to now, Three machine learning algorithms: decision tree learning k-nn linear regression only optimization objectives are discussed,
More informationFitting The Unknown 1/28. Joshua Lande. September 1, Stanford
1/28 Fitting The Unknown Joshua Lande Stanford September 1, 2010 2/28 Motivation: Why Maximize It is frequently important in physics to find the maximum (or minimum) of a function Nature will maximize
More informationThe use of second-order information in structural topology optimization. Susana Rojas Labanda, PhD student Mathias Stolpe, Senior researcher
The use of second-order information in structural topology optimization Susana Rojas Labanda, PhD student Mathias Stolpe, Senior researcher What is Topology Optimization? Optimize the design of a structure
More informationMath (P)Review Part II:
Math (P)Review Part II: Vector Calculus Computer Graphics Assignment 0.5 (Out today!) Same story as last homework; second part on vector calculus. Slightly fewer questions Last Time: Linear Algebra Touched
More informationLecture V. Numerical Optimization
Lecture V Numerical Optimization Gianluca Violante New York University Quantitative Macroeconomics G. Violante, Numerical Optimization p. 1 /19 Isomorphism I We describe minimization problems: to maximize
More informationPeristaltic Pump. Introduction. Model Definition
Peristaltic Pump Introduction In a peristaltic pump, rotating rollers are squeezing a flexible tube. As the pushed down rollers move along the tube, the fluid in the tube follows the motion. The main advantage
More informationThe Influence of Channel Aspect Ratio on Performance of Optimized Thermal-Fluid Structures
Excerpt from the Proceedings of the COMSOL Conference 2010 Boston The Influence of Channel Aspect Ratio on Performance of Optimized Thermal-Fluid Structures Ercan M. Dede 1* 1 Technical Research Department,
More informationOptimization. Totally not complete this is...don't use it yet...
Optimization Totally not complete this is...don't use it yet... Bisection? Doing a root method is akin to doing a optimization method, but bi-section would not be an effective method - can detect sign
More information6.252 NONLINEAR PROGRAMMING LECTURE 10 ALTERNATIVES TO GRADIENT PROJECTION LECTURE OUTLINE. Three Alternatives/Remedies for Gradient Projection
6.252 NONLINEAR PROGRAMMING LECTURE 10 ALTERNATIVES TO GRADIENT PROJECTION LECTURE OUTLINE Three Alternatives/Remedies for Gradient Projection Two-Metric Projection Methods Manifold Suboptimization Methods
More informationNumerical optimization
THE UNIVERSITY OF WESTERN ONTARIO LONDON ONTARIO Paul Klein Office: SSC 408 Phone: 661-111 ext. 857 Email: paul.klein@uwo.ca URL: www.ssc.uwo.ca/economics/faculty/klein/ Numerical optimization In these
More informationScientific Computing: An Introductory Survey
Scientific Computing: An Introductory Survey Chapter 6 Optimization Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign Copyright c 2002. Reproduction permitted
More informationScientific Computing: An Introductory Survey
Scientific Computing: An Introductory Survey Chapter 6 Optimization Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign Copyright c 2002. Reproduction permitted
More informationNumerical optimization. Numerical optimization. Longest Shortest where Maximal Minimal. Fastest. Largest. Optimization problems
1 Numerical optimization Alexander & Michael Bronstein, 2006-2009 Michael Bronstein, 2010 tosca.cs.technion.ac.il/book Numerical optimization 048921 Advanced topics in vision Processing and Analysis of
More informationBenchmarking of optimization methods for topology optimization problems
Downloaded from orbit.dtu.dk on: Feb, 18 Benchmarking of optimization methods for topology optimization problems Rojas Labanda, Susana; Stolpe, Mathias Publication date: 14 Document Version Peer reviewed
More informationCS 542G: Robustifying Newton, Constraints, Nonlinear Least Squares
CS 542G: Robustifying Newton, Constraints, Nonlinear Least Squares Robert Bridson October 29, 2008 1 Hessian Problems in Newton Last time we fixed one of plain Newton s problems by introducing line search
More informationGradient Descent. Sargur Srihari
Gradient Descent Sargur srihari@cedar.buffalo.edu 1 Topics Simple Gradient Descent/Ascent Difficulties with Simple Gradient Descent Line Search Brent s Method Conjugate Gradient Descent Weight vectors
More informationDeep Learning. Authors: I. Goodfellow, Y. Bengio, A. Courville. Chapter 4: Numerical Computation. Lecture slides edited by C. Yim. C.
Chapter 4: Numerical Computation Deep Learning Authors: I. Goodfellow, Y. Bengio, A. Courville Lecture slides edited by 1 Chapter 4: Numerical Computation 4.1 Overflow and Underflow 4.2 Poor Conditioning
More informationOutline. Scientific Computing: An Introductory Survey. Optimization. Optimization Problems. Examples: Optimization Problems
Outline Scientific Computing: An Introductory Survey Chapter 6 Optimization 1 Prof. Michael. Heath Department of Computer Science University of Illinois at Urbana-Champaign Copyright c 2002. Reproduction
More informationMotivating examples Introduction to algorithms Simplex algorithm. On a particular example General algorithm. Duality An application to game theory
Instructor: Shengyu Zhang 1 LP Motivating examples Introduction to algorithms Simplex algorithm On a particular example General algorithm Duality An application to game theory 2 Example 1: profit maximization
More informationCHAPTER 2: QUADRATIC PROGRAMMING
CHAPTER 2: QUADRATIC PROGRAMMING Overview Quadratic programming (QP) problems are characterized by objective functions that are quadratic in the design variables, and linear constraints. In this sense,
More informationMultidisciplinary System Design Optimization (MSDO)
Multidisciplinary System Design Optimization (MSDO) Numerical Optimization II Lecture 8 Karen Willcox 1 Massachusetts Institute of Technology - Prof. de Weck and Prof. Willcox Today s Topics Sequential
More informationHomework 4 in 5C1212; Part A: Incompressible Navier- Stokes, Finite Volume Methods
Homework 4 in 5C11; Part A: Incompressible Navier- Stokes, Finite Volume Methods Consider the incompressible Navier Stokes in two dimensions u x + v y = 0 u t + (u ) x + (uv) y + p x = 1 Re u + f (1) v
More informationLecture 2: Linear regression
Lecture 2: Linear regression Roger Grosse 1 Introduction Let s ump right in and look at our first machine learning algorithm, linear regression. In regression, we are interested in predicting a scalar-valued
More informationLecture 7: Numerical Tools
Lecture 7: Numerical Tools Fatih Guvenen January 10, 2016 Fatih Guvenen Lecture 7: Numerical Tools January 10, 2016 1 / 18 Overview Three Steps: V (k, z) =max c,k 0 apple u(c)+ Z c + k 0 =(1 + r)k + z
More informationMinimization of Static! Cost Functions!
Minimization of Static Cost Functions Robert Stengel Optimal Control and Estimation, MAE 546, Princeton University, 2017 J = Static cost function with constant control parameter vector, u Conditions for
More informationLecture 5: Gradient Descent. 5.1 Unconstrained minimization problems and Gradient descent
10-725/36-725: Convex Optimization Spring 2015 Lecturer: Ryan Tibshirani Lecture 5: Gradient Descent Scribes: Loc Do,2,3 Disclaimer: These notes have not been subjected to the usual scrutiny reserved for
More informationShape, Convection and Convergence
Presented at the COMSOL Conference 2008 Boston Shape, Convection and Convergence,VP Research, Inc. Who is? Who is? We are: A Technical Consultation firm in business since 1993 Who is? We are: A Technical
More informationFlow Focusing Droplet Generation Using Linear Vibration
Flow Focusing Droplet Generation Using Linear Vibration A. Salari, C. Dalton Department of Electrical & Computer Engineering, University of Calgary, Calgary, AB, Canada Abstract: Flow focusing microchannels
More informationTrust-region methods for rectangular systems of nonlinear equations
Trust-region methods for rectangular systems of nonlinear equations Margherita Porcelli Dipartimento di Matematica U.Dini Università degli Studi di Firenze Joint work with Maria Macconi and Benedetta Morini
More information2.098/6.255/ Optimization Methods Practice True/False Questions
2.098/6.255/15.093 Optimization Methods Practice True/False Questions December 11, 2009 Part I For each one of the statements below, state whether it is true or false. Include a 1-3 line supporting sentence
More informationCONTROL AND TOPOLOGICAL OPTIMIZATION OF A LARGE MULTIBEAM ARRAY ANTENNA
CONTROL AND TOPOLOGICAL OPTIMIZATION OF A LARGE MULTIBEAM ARRAY ANTENNA Thierry Touya and Didier Auroux Mathematics Institute of Toulouse University of Toulouse Paul Sabatier 31062 Toulouse cedex 9 France
More informationOptimization Concepts and Applications in Engineering
Optimization Concepts and Applications in Engineering Ashok D. Belegundu, Ph.D. Department of Mechanical Engineering The Pennsylvania State University University Park, Pennsylvania Tirupathi R. Chandrupatia,
More informationNUMERICAL SOLUTION OF ODE IVPs. Overview
NUMERICAL SOLUTION OF ODE IVPs 1 Quick review of direction fields Overview 2 A reminder about and 3 Important test: Is the ODE initial value problem? 4 Fundamental concepts: Euler s Method 5 Fundamental
More informationUnconstrained Multivariate Optimization
Unconstrained Multivariate Optimization Multivariate optimization means optimization of a scalar function of a several variables: and has the general form: y = () min ( ) where () is a nonlinear scalar-valued
More informationIterative Methods for Solving A x = b
Iterative Methods for Solving A x = b A good (free) online source for iterative methods for solving A x = b is given in the description of a set of iterative solvers called templates found at netlib: http
More informationHybrid Analog-Digital Solution of Nonlinear Partial Differential Equations
Hybrid Analog-Digital Solution of Nonlinear Partial Differential Equations Yipeng Huang, Ning Guo, Kyle Mandli, Mingoo Seok, Yannis Tsividis, Simha Sethumadhavan Columbia University Hybrid Analog-Digital
More informationAn Introduction to COMSOL Multiphysics v4.3b & Subsurface Flow Simulation. Ahsan Munir, PhD Tom Spirka, PhD
An Introduction to COMSOL Multiphysics v4.3b & Subsurface Flow Simulation Ahsan Munir, PhD Tom Spirka, PhD Agenda Provide an overview of COMSOL 4.3b Our products, solutions and applications Subsurface
More information4M020 Design tools. Algorithms for numerical optimization. L.F.P. Etman. Department of Mechanical Engineering Eindhoven University of Technology
4M020 Design tools Algorithms for numerical optimization L.F.P. Etman Department of Mechanical Engineering Eindhoven University of Technology Wednesday September 3, 2008 1 / 32 Outline 1 Problem formulation:
More informationSection Notes 9. IP: Cutting Planes. Applied Math 121. Week of April 12, 2010
Section Notes 9 IP: Cutting Planes Applied Math 121 Week of April 12, 2010 Goals for the week understand what a strong formulations is. be familiar with the cutting planes algorithm and the types of cuts
More information1 Numerical optimization
Contents 1 Numerical optimization 5 1.1 Optimization of single-variable functions............ 5 1.1.1 Golden Section Search................... 6 1.1. Fibonacci Search...................... 8 1. Algorithms
More informationAM 205: lecture 19. Last time: Conditions for optimality, Newton s method for optimization Today: survey of optimization methods
AM 205: lecture 19 Last time: Conditions for optimality, Newton s method for optimization Today: survey of optimization methods Quasi-Newton Methods General form of quasi-newton methods: x k+1 = x k α
More informationQuasi-Newton Methods
Newton s Method Pros and Cons Quasi-Newton Methods MA 348 Kurt Bryan Newton s method has some very nice properties: It s extremely fast, at least once it gets near the minimum, and with the simple modifications
More informationCHAPTER 7 NUMERICAL MODELLING OF A SPIRAL HEAT EXCHANGER USING CFD TECHNIQUE
CHAPTER 7 NUMERICAL MODELLING OF A SPIRAL HEAT EXCHANGER USING CFD TECHNIQUE In this chapter, the governing equations for the proposed numerical model with discretisation methods are presented. Spiral
More informationOptimization and Root Finding. Kurt Hornik
Optimization and Root Finding Kurt Hornik Basics Root finding and unconstrained smooth optimization are closely related: Solving ƒ () = 0 can be accomplished via minimizing ƒ () 2 Slide 2 Basics Root finding
More informationNUMERICAL MODELING OF TRANSIENT ACOUSTIC FIELD USING FINITE ELEMENT METHOD
POZNAN UNIVE RSITY OF TE CHNOLOGY ACADE MIC JOURNALS No 73 Electrical Engineering 213 Lukáš KOUDELA* Jindřich JANSA* Pavel KARBAN* NUMERICAL MODELING OF TRANSIENT ACOUSTIC FIELD USING FINITE ELEMENT METHOD
More informationNumerical Optimization Prof. Shirish K. Shevade Department of Computer Science and Automation Indian Institute of Science, Bangalore
Numerical Optimization Prof. Shirish K. Shevade Department of Computer Science and Automation Indian Institute of Science, Bangalore Lecture - 13 Steepest Descent Method Hello, welcome back to this series
More informationThis chapter focuses on the study of the numerical approximation of threedimensional
6 CHAPTER 6: NUMERICAL OPTIMISATION OF CONJUGATE HEAT TRANSFER IN COOLING CHANNELS WITH DIFFERENT CROSS-SECTIONAL SHAPES 3, 4 6.1. INTRODUCTION This chapter focuses on the study of the numerical approximation
More informationA high-level programming-language implementation of topology optimization applied to steady-state Navier Stokes flow
INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN ENGINEERING Int. J. Numer. Meth. Engng 2006; 65:975 1001 Published online 1 September 2005 in Wiley InterScience (www.interscience.wiley.com). DOI: 10.1002/nme.1468
More information7 The Navier-Stokes Equations
18.354/12.27 Spring 214 7 The Navier-Stokes Equations In the previous section, we have seen how one can deduce the general structure of hydrodynamic equations from purely macroscopic considerations and
More informationStatics. Introductions Review Course Outline and Class Schedule Course Expectations Chapter 1
Statics ENGR 1205 Kaitlin Ford kford@mtroyal.ca B175 Today Introductions Review Course Outline and Class Schedule Course Expectations Chapter 1 1 Review the Course Outline and Class Schedule Go through
More informationContents. Preface. 1 Introduction Optimization view on mathematical models NLP models, black-box versus explicit expression 3
Contents Preface ix 1 Introduction 1 1.1 Optimization view on mathematical models 1 1.2 NLP models, black-box versus explicit expression 3 2 Mathematical modeling, cases 7 2.1 Introduction 7 2.2 Enclosing
More informationLarge Scale Fluid-Structure Interaction by coupling OpenFOAM with external codes
Large Scale Fluid-Structure Interaction by coupling OpenFOAM with external codes Thomas Gallinger * Alexander Kupzok Roland Wüchner Kai-Uwe Bletzinger Lehrstuhl für Statik Technische Universität München
More informationConstrained data assimilation. W. Carlisle Thacker Atlantic Oceanographic and Meteorological Laboratory Miami, Florida USA
Constrained data assimilation W. Carlisle Thacker Atlantic Oceanographic and Meteorological Laboratory Miami, Florida 33149 USA Plan Range constraints: : HYCOM layers have minimum thickness. Optimal interpolation:
More informationIntroduction to Optimization
Introduction to Optimization Gradient-based Methods Marc Toussaint U Stuttgart Gradient descent methods Plain gradient descent (with adaptive stepsize) Steepest descent (w.r.t. a known metric) Conjugate
More informationMath (P)Review Part I:
Lecture 1: Math (P)Review Part I: Linear Algebra Computer Graphics CMU 15-462/15-662, Fall 2017 Homework 0.0 (Due Monday!) Exercises will be a bit harder / more rigorous than what you will do for the rest
More informationOptimization Tutorial 1. Basic Gradient Descent
E0 270 Machine Learning Jan 16, 2015 Optimization Tutorial 1 Basic Gradient Descent Lecture by Harikrishna Narasimhan Note: This tutorial shall assume background in elementary calculus and linear algebra.
More informationCHAPTER 4 OPTIMIZATION OF COEFFICIENT OF LIFT, DRAG AND POWER - AN ITERATIVE APPROACH
82 CHAPTER 4 OPTIMIZATION OF COEFFICIENT OF LIFT, DRAG AND POWER - AN ITERATIVE APPROACH The coefficient of lift, drag and power for wind turbine rotor is optimized using an iterative approach. The coefficient
More informationMATH 308 COURSE SUMMARY
MATH 308 COURSE SUMMARY Approximately a third of the exam cover the material from the first two midterms, that is, chapter 6 and the first six sections of chapter 7. The rest of the exam will cover the
More informationIntroduction to Scientific Computing
Introduction to Scientific Computing Benson Muite benson.muite@ut.ee http://kodu.ut.ee/ benson https://courses.cs.ut.ee/2018/isc/spring 26 March 2018 [Public Domain,https://commons.wikimedia.org/wiki/File1
More informationChapter 3. Load and Stress Analysis
Chapter 3 Load and Stress Analysis 2 Shear Force and Bending Moments in Beams Internal shear force V & bending moment M must ensure equilibrium Fig. 3 2 Sign Conventions for Bending and Shear Fig. 3 3
More informationLecture 9 - Rotational Dynamics
Lecture 9 - Rotational Dynamics A Puzzle... Angular momentum is a 3D vector, and changing its direction produces a torque τ = dl. An important application in our daily lives is that bicycles don t fall
More informationSimulation of Aeroelastic System with Aerodynamic Nonlinearity
Simulation of Aeroelastic System with Aerodynamic Nonlinearity Muhamad Khairil Hafizi Mohd Zorkipli School of Aerospace Engineering, Universiti Sains Malaysia, Penang, MALAYSIA Norizham Abdul Razak School
More informationLecture 7: Minimization or maximization of functions (Recipes Chapter 10)
Lecture 7: Minimization or maximization of functions (Recipes Chapter 10) Actively studied subject for several reasons: Commonly encountered problem: e.g. Hamilton s and Lagrange s principles, economics
More informationSolving Distributed Optimal Control Problems for the Unsteady Burgers Equation in COMSOL Multiphysics
Excerpt from the Proceedings of the COMSOL Conference 2009 Milan Solving Distributed Optimal Control Problems for the Unsteady Burgers Equation in COMSOL Multiphysics Fikriye Yılmaz 1, Bülent Karasözen
More informationThermal Analysis. with SolidWorks Simulation 2013 SDC. Paul M. Kurowski. Better Textbooks. Lower Prices.
Thermal Analysis with SolidWorks Simulation 2013 Paul M. Kurowski SDC PUBLICATIONS Schroff Development Corporation Better Textbooks. Lower Prices. www.sdcpublications.com Visit the following websites to
More informationOptimization Methods
Optimization Methods Decision making Examples: determining which ingredients and in what quantities to add to a mixture being made so that it will meet specifications on its composition allocating available
More informationThe case where there is no net effect of the forces acting on a rigid body
The case where there is no net effect of the forces acting on a rigid body Outline: Introduction and Definition of Equilibrium Equilibrium in Two-Dimensions Special cases Equilibrium in Three-Dimensions
More informationA multiscale framework for lubrication analysis of bearings with textured surface
A multiscale framework for lubrication analysis of bearings with textured surface *Leiming Gao 1), Gregory de Boer 2) and Rob Hewson 3) 1), 3) Aeronautics Department, Imperial College London, London, SW7
More information10. Ellipsoid method
10. Ellipsoid method EE236C (Spring 2008-09) ellipsoid method convergence proof inequality constraints 10 1 Ellipsoid method history developed by Shor, Nemirovski, Yudin in 1970s used in 1979 by Khachian
More informationInverse Heat Flux Evaluation using Conjugate Gradient Methods from Infrared Imaging
11 th International Conference on Quantitative InfraRed Thermography Inverse Heat Flux Evaluation using Conjugate Gradient Methods from Infrared Imaging by J. Sousa*, L. Villafane*, S. Lavagnoli*, and
More informationLecture 17: Numerical Optimization October 2014
Lecture 17: Numerical Optimization 36-350 22 October 2014 Agenda Basics of optimization Gradient descent Newton s method Curve-fitting R: optim, nls Reading: Recipes 13.1 and 13.2 in The R Cookbook Optional
More informationUnit 21 Couples and Resultants with Couples
Unit 21 Couples and Resultants with Couples Page 21-1 Couples A couple is defined as (21-5) Moment of Couple The coplanar forces F 1 and F 2 make up a couple and the coordinate axes are chosen so that
More informationPrimal/Dual Decomposition Methods
Primal/Dual Decomposition Methods Daniel P. Palomar Hong Kong University of Science and Technology (HKUST) ELEC5470 - Convex Optimization Fall 2018-19, HKUST, Hong Kong Outline of Lecture Subgradients
More informationCSC373: Algorithm Design, Analysis and Complexity Fall 2017 DENIS PANKRATOV NOVEMBER 1, 2017
CSC373: Algorithm Design, Analysis and Complexity Fall 2017 DENIS PANKRATOV NOVEMBER 1, 2017 Linear Function f: R n R is linear if it can be written as f x = a T x for some a R n Example: f x 1, x 2 =
More information24. Nonlinear programming
CS/ECE/ISyE 524 Introduction to Optimization Spring 2017 18 24. Nonlinear programming ˆ Overview ˆ Example: making tires ˆ Example: largest inscribed polygon ˆ Example: navigation using ranges Laurent
More informationDesign Principles of Superconducting Magnets
1 Design Principles of Superconducting Magnets Aki Korpela Tampere University of Technology DESIGN PRINCIPLES OF SUPERCONDUCTING MAGNETS 2 Content of the presentation Background Short-sample measurement
More informationA COUPLED-ADJOINT METHOD FOR HIGH-FIDELITY AERO-STRUCTURAL OPTIMIZATION
A COUPLED-ADJOINT METHOD FOR HIGH-FIDELITY AERO-STRUCTURAL OPTIMIZATION Joaquim Rafael Rost Ávila Martins Department of Aeronautics and Astronautics Stanford University Ph.D. Oral Examination, Stanford
More informationAn Essay on Higher Order Mathematics for Rotational Moment of Inertia A Cylindrical Mapping of Boolean Shapes By Joshua Milgram
An Essay on Higher Order Mathematics for Rotational Moment of Inertia A Cylindrical Mapping of Boolean Shapes By Joshua Milgram Abstract: This essay makes three main estimates: (1) Boolean Volume (2) Boolean
More informationA Level Maths. Course Guide
A Level Maths Course Guide 2017-18 AS and A Level Maths Course Guide Welcome to A Level Maths. In this course you will develop your mathematical skills from GCSE, and will learn many new and powerful techniques
More informationFebruary 22, Introduction to the Simplex Algorithm
15.53 February 22, 27 Introduction to the Simplex Algorithm 1 Quotes for today Give a man a fish and you feed him for a day. Teach him how to fish and you feed him for a lifetime. -- Lao Tzu Give a man
More informationOutline Introduction: Problem Description Diculties Algebraic Structure: Algebraic Varieties Rank Decient Toeplitz Matrices Constructing Lower Rank St
Structured Lower Rank Approximation by Moody T. Chu (NCSU) joint with Robert E. Funderlic (NCSU) and Robert J. Plemmons (Wake Forest) March 5, 1998 Outline Introduction: Problem Description Diculties Algebraic
More informationSensitivity and Reliability Analysis of Nonlinear Frame Structures
Sensitivity and Reliability Analysis of Nonlinear Frame Structures Michael H. Scott Associate Professor School of Civil and Construction Engineering Applied Mathematics and Computation Seminar April 8,
More informationISM206 Lecture Optimization of Nonlinear Objective with Linear Constraints
ISM206 Lecture Optimization of Nonlinear Objective with Linear Constraints Instructor: Prof. Kevin Ross Scribe: Nitish John October 18, 2011 1 The Basic Goal The main idea is to transform a given constrained
More informationCSMA ème Colloque National en Calcul des Structures mai 2017, Presqu île de Giens (Var)
CSMA 207 3ème Colloque National en Calcul des Structures 5-9 mai 207, Presqu île de Giens (Var) TOPOLEV: Topological optimization using level-set method D. Lachouette, Ph. Conraux 2, G. Allaire 3, F. Jouve
More informationBellman s Curse of Dimensionality
Bellman s Curse of Dimensionality n- dimensional state space Number of states grows exponen
More informationThe Not-Formula Book for C1
Not The Not-Formula Book for C1 Everything you need to know for Core 1 that won t be in the formula book Examination Board: AQA Brief This document is intended as an aid for revision. Although it includes
More informationOptimal control problems with PDE constraints
Optimal control problems with PDE constraints Maya Neytcheva CIM, October 2017 General framework Unconstrained optimization problems min f (q) q x R n (real vector) and f : R n R is a smooth function.
More informationQuiz Discussion. IE417: Nonlinear Programming: Lecture 12. Motivation. Why do we care? Jeff Linderoth. 16th March 2006
Quiz Discussion IE417: Nonlinear Programming: Lecture 12 Jeff Linderoth Department of Industrial and Systems Engineering Lehigh University 16th March 2006 Motivation Why do we care? We are interested in
More information