Optimization with COMSOL Multiphysics COMSOL Tokyo Conference Walter Frei, PhD Applications Engineer

Size: px
Start display at page:

Download "Optimization with COMSOL Multiphysics COMSOL Tokyo Conference Walter Frei, PhD Applications Engineer"

Transcription

1 Optimization with COMSOL Multiphysics COMSOL Tokyo Conference 2014 Walter Frei, PhD Applications Engineer

2 Product Suite COMSOL 5.0

3 Agenda An introduction to optimization A lot of concepts, and a little bit of math What do these options mean? Demo Overview of Examples

4 A quick conceptual introduction, and some terminologies - Dimensions - Material Constrained Properties Design - Operating Variables: Conditions χ -etc Black Box u(χ) K(χ)u=b(χ) - Performance Objective: f(u(χ)) - Failure criteria & -etc Constraints: g(u(χ)) Optimization

5 More formally, optimization is min χ R such that : χ p g L f ( χ) ( u( χ) ) χ 0 ( u( χ) ) = χ U 0 Objective function Simple bounds on the design variables Pointwise constraints on the design variables General Equality constraints h ( u( χ) ) 0 General Inequality constraints

6 The design variables: χ χ 2 Design Space χ 2,U Pointwise constraints p(χ) 0 χ 1,L χ 1,U χ 1 χ 2,L Upper and Lower Bounds

7 The design space must be continuous χ 2 Design Space 1 Design Space 2 χ 1 Break this up into two separate optimization problems

8 Why no equality constraints for χ? χ 2 χ 2,U p(χ) = 0 χ 1,L χ 1,U χ 1 χ 2,L An equality constraint is equivalent to a different optimization problem with one less design variable

9 Introduce a new design variable instead χ 2 χ 2,U χ A,U χ 1 = f(χ A ) χ 2 = f(χ A ) χ A χ 1,L χ 1,U χ 1 χ A,L χ 2,L

10 The design space must be continuous in the real number space χ 2 χ 1 Optimizing over a set of discrete values is an Integer Programming problem LiveLink for MATLAB & LiveLink for Excel can be used to interface to 3 rd party optimizers

11 It is helpful if the design space is convex Usually more difficult Every point can see every other design point

12 Now lets look at the objective function: f(u(χ)) or f(χ) χ 2 χ 1 χ 1 χ 2

13 We are always starting somewhere f We want to improve this χ 2 Tip: Always start optimizing from a feasible design Initial design χ 1

14 Lets first assume a smooth and differentiable objective function with a single minimum f χ f χ 2 1) Find the gradient 2) Search along the line 3) Find the minimum 4) Repeat χ 1

15 Repeat until converged Start from a point, find the direction of steepest descent (the gradient) and search in that direction for a minimum Repeat Once the gradient is zero, or the boundary of the design space is reached, stop

16 Adjoint method is used to compute derivatives χ u χ f χ ( ) u b( χ) K χ ( K( χ) u b( χ) ) ( ) K χ χ = ( ) u + K χ 0 u χ 1 b = K ( χ) χ f u = u χ = 0 ( χ) b = χ ( χ) K( χ) χ u Finite element equations Differentiate w.r.t. χ Expand Re-arrange Assuming f is differentiable w.r.t. u Computing this derivative only doubles the computational requirements, regardless of how many design variables there are

17 If we hit a constraint, follow it Start from a point, find the direction of steepest descent (the gradient) and search in that direction for a minimum Repeat Once the gradient is zero, or the boundary of the design space is reached, stop

18 What if we have multiple minima? Depends on where you start! You are never guaranteed of finding the global minimum, but you can find a local minimum

19 What if the objective function is not smooth or differentiable? Approximate the shape by evaluating the objective function repeatedly For example, Nelder-Mead evaluates n+1 points when optimizing n design variables

20 What if the objective function is not smooth or differentiable? Approximate the shape by evaluating the objective function repeatedly For example, Nelder-Mead evaluates n+1 points when optimizing n design variables

21 What if we want to include general equality and inequality constraints? g(u(χ)) = 0 χ 1 χ 2 Highly constrained design space h(u(χ)) 0 χ 1 χ 2 Strong dependence on initial conditions

22 Summary Design variables must be continuous and real-valued Design space: Simple (Cartesian) bounds Pointwise inequality constraints If you want to set up an equality constraint, get rid of one design variable Convex design space is better Objective function If it is smooth and differentiable, can use the Adjoint method and the gradient-based optimization technique If it is non-smooth or non-differentiable Use the gradient-free approach General Equality and Inequality Constraints Equality constraints can severely complicate the optimization problem Inequality constraints can make the design space non-continuous

23 Demo: A bracket with a hole Fixed Load

24 First, minimize the mass by changing the hole radius R The radius must be greater than zero, and not so large as to cut the bracket in half

25 Next, add a constraint on the maximum stress within the part σ < σ max But the location of the peak stress is not known, So we use a maximum coupling operator & a constraint

26 What about moving & resizing the hole?

27 Let s look at the constraints... How can we express these mathematically?

28 Add one more design variable R A

29 Let s take these constraints a few at a time With a bit of (behind the scenes) trigonometry: B = (1-0.25*A)/(1+sqrt(4.25)/2) R A R Which leads to the constraint: B-R>0

30 What about the other limits? A R>0.2 A R

31 Sometimes we can just ignore a constraint Based upon the simulations so far, its likely this constraint will never be an issue

32 The available optimization solvers Optimization Module Gradient-Free Methods Gradient-Based Methods Monte -Carlo MMA SNOPT Levenberg- Marquardt Coordinate Search Nelder- Mead BOBYQA COBYLA

33 When to use gradient-free methods? Non-differentiable objective function, and/or constraints Few design variables Optimization time increases exponentially with number of variables Aim for less than 10 design variables Whenever re-meshing will occur Re-meshing results in a non-smooth objective function

34 Faster Slower Usually the Most Robust The gradient-free solvers COBYLA Similar to BOBYQA, but uses a linear approximation Can consider constraints BOBYQA Constructs a quadratic approximant to the objective function Probably the fastest, but needs a reasonably smooth objective function Nelder-Mead Construct a simplex, and improve the worst point Probably the best if the objective function is relatively noisy Can consider constraints Coordinate Search Search along one design variable at a time Estimate the gradients along that line, move on to next variable, repeat Monte-Carlo Random choices of design variables are evaluated Only a very dense statistical sampling can find the global optimum

35 When to use gradient-based methods? Differentiable objective function, and/or constraints Many design variables Optimization speed does not depend strongly on number of variables 100,000+ design variables are not unreasonable Topology Optimization

36 The gradient-based solvers SNOPT Sequential Quadratic Programming algorithm MMA Linear convergence rate near the optimum Popular in the Topology Optimization community Levenberg-Marquardt Only for unconstrained least squares minimization problems Very fast

37 Scaling and Tolerances Specify scales for all control variables In Optimization study step for global parameters In Optimization interface features for fields All solvers work with rescaled variables Solver tolerances are relative to these Keep objectives and constraints close to 1 Solvers may use scaled gradient for termination

38 Comparison of Algorithms Objective Function Design Variables Gradient-Free Any scalar output Anything, including geometric dimensions Gradient-Based Must be both smooth and differentiable Anything, but cannot result in remeshing of the geometry Allows Yes No Remeshing Constraints Can only constrain scalar outputs Constraints must be smooth and differentiable, but can be at each point in space Relative Performance Increases exponentially with the number of design variables Performance is not very sensitive to the number of design variables

39 So what else can you do? Parameter Estimation & Curve Fitting Shape & Dimension Topology

40 Optimization of joint positions in a truckmounted crane. Reduces force on boom lift cylinder for a range of operation conditions Uses the Multibody Dynamics Module Structural Sizing

41 Multi-study Structural Sizing Weight minimization of a mounting bracket. Multi-study constraints Maximum stress under static load Lowest eigenfrequency

42 Estimating the material properties based upon experimental data

43 Example: Optimizing a Flywheel, with Constraints Make stress distribution as uniform along the radius as possible Constrain the mass not to change Constrain the moment of inertia not to change Gradient-based approach

44 Example: Band dispersion in a microchannel Minimize the difference is transit time between inside and outside Gradient-Free optimization

45 Example: Optimizing a Horn Maximize the sound intensity along the axis of the horn The shape of the horn is described by a sum of sine waves Truncated Fourier series The Deformed Mesh functionality is used to avoid remeshing the domain Gradient-Based approach

46 Example: Optimizing a Heater Maximize the temperature at the outlet Such that the temperature at each heater stays below a target

47 Example: Optimizing a Spinning Wheel Minimize the Mass By changing: r inner r outer Constrain the maximum stress

48 Topology Optimization: Buy this book

49 Example: Optimizing a Beam Minimize the compliance Add constraint on total material SIMP method

50 Example: Tesla Microvalve Flow to the right: Minimize p Flow to the left: Maximize p Laurits Højgaard Olesen, Fridolin Okkels and Henrik Bruus, A high-level programming-language implementation of topology optimization applied to steady-state Navier Stokes flow, Int. J. Numer. Meth. Engng 2006; 65:

51 COMSOL Conference Papers on Topology Optimization Topology Optimization in Multiple Physics Problems, O. Sigmund, DTU Mechanical Engineering, Multiphysics Topology Optimization of Heat Transfer and Fluid Flow Systems, E. Dede, Toyota Research Institute of North America, Simulation of Topology Optimized Electrothermal Microgrippers, O. Sardan, D. Petersen, O. Sigmund, & P. Boggild, DTU Mechanical Engineering, Implementation of Structural Topology Optimization in COMSOL, B. Lemke, Z. Liu, & J. G. Korvink, Department of Microsystems Engineering, University of Freiburg, Topology Optimization of Dielectric Metamaterials Based on the Level Set Method Using COMSOL Multiphysics, M. Otomori & S. Nishiwaki, Kyoto University, Optimization of a Photonic Crystal Waveguide Termination, W. Frei, COMSOL,

52 When to use which one? Early in the design process, when you have a lot of time to run analyses, and don t have a very rigid idea about your final design? Already have the basic topology fixed, but can change the shape? It s about to go to production, and we realized it doesn t work!!!

53 When to use which one? Early in the design process, when you have a lot of time to run analyses, and don t have a very rigid idea about your final design? Topology Optimization Already have the basic topology fixed, but can change the shape? Shape Optimization It s about to go to production, and we realized it doesn t work!!! Dimensional Optimization

54 Some general optimization tips Scale your objective function to be close to unity Do not get frustrated, the software doesn t know that you haven t asked the right question Start as simple as possible, especially with constraints

55 Concluding remarks min χ R such that : χ p g h L f ( u( χ) ) χ χ U ( χ) 0 ( u( χ) ) = 0 ( u( χ) ) 0

Optimisation and Operations Research

Optimisation and Operations Research Optimisation and Operations Research Lecture 22: Linear Programming Revisited Matthew Roughan http://www.maths.adelaide.edu.au/matthew.roughan/ Lecture_notes/OORII/ School

More information

DESIGN OF MICRO-FLUIDIC BIO-REACTORS USING TOPOLOGY OPTIMIZATION

DESIGN OF MICRO-FLUIDIC BIO-REACTORS USING TOPOLOGY OPTIMIZATION European Conference on Computational Fluid Dynamics ECCOMAS CFD 2006 P. Wesseling, E. Oñate and J. Périaux (Eds) c TU Delft, The Netherlands, 2006 DESIGN OF MICRO-FLUIDIC BIO-REACTORS USING TOPOLOGY OPTIMIZATION

More information

Numerical Optimization Professor Horst Cerjak, Horst Bischof, Thomas Pock Mat Vis-Gra SS09

Numerical Optimization Professor Horst Cerjak, Horst Bischof, Thomas Pock Mat Vis-Gra SS09 Numerical Optimization 1 Working Horse in Computer Vision Variational Methods Shape Analysis Machine Learning Markov Random Fields Geometry Common denominator: optimization problems 2 Overview of Methods

More information

Nonlinear Optimization for Optimal Control

Nonlinear Optimization for Optimal Control Nonlinear Optimization for Optimal Control Pieter Abbeel UC Berkeley EECS Many slides and figures adapted from Stephen Boyd [optional] Boyd and Vandenberghe, Convex Optimization, Chapters 9 11 [optional]

More information

TOPOLOGY OPTIMIZATION OF NAVIER-STOKES FLOW IN MICROFLUIDICS

TOPOLOGY OPTIMIZATION OF NAVIER-STOKES FLOW IN MICROFLUIDICS European Congress on Computational Methods in Applied Sciences and Engineering ECCOMAS 2004 P. Neittaanmäki, T. Rossi, S. Korotov, E. Oñate, J. Périaux, and D. Knörzer (eds.) Jyväskylä, 24 28 July 2004

More information

Electromagnetics in COMSOL Multiphysics is extended by add-on Modules

Electromagnetics in COMSOL Multiphysics is extended by add-on Modules AC/DC Module Electromagnetics in COMSOL Multiphysics is extended by add-on Modules 1) Start Here 2) Add Modules based upon your needs 3) Additional Modules extend the physics you can address 4) Interface

More information

Topology Optimization of Micro Tesla Valve in low and moderate Reynolds number

Topology Optimization of Micro Tesla Valve in low and moderate Reynolds number Sen Lin (CIOMP.CAS) E-mail: SenLin41@gmail.com of Micro Tesla Valve 1 / 22 Topology of Micro Tesla Valve in low and moderate Reynolds number (Summary of my works during the past year) Sen Lin Advised by

More information

MVE165/MMG631 Linear and integer optimization with applications Lecture 13 Overview of nonlinear programming. Ann-Brith Strömberg

MVE165/MMG631 Linear and integer optimization with applications Lecture 13 Overview of nonlinear programming. Ann-Brith Strömberg MVE165/MMG631 Overview of nonlinear programming Ann-Brith Strömberg 2015 05 21 Areas of applications, examples (Ch. 9.1) Structural optimization Design of aircraft, ships, bridges, etc Decide on the material

More information

AM 205: lecture 19. Last time: Conditions for optimality Today: Newton s method for optimization, survey of optimization methods

AM 205: lecture 19. Last time: Conditions for optimality Today: Newton s method for optimization, survey of optimization methods AM 205: lecture 19 Last time: Conditions for optimality Today: Newton s method for optimization, survey of optimization methods Optimality Conditions: Equality Constrained Case As another example of equality

More information

Numerical optimization

Numerical optimization Numerical optimization Lecture 4 Alexander & Michael Bronstein tosca.cs.technion.ac.il/book Numerical geometry of non-rigid shapes Stanford University, Winter 2009 2 Longest Slowest Shortest Minimal Maximal

More information

Scientific Computing: Optimization

Scientific Computing: Optimization Scientific Computing: Optimization Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course MATH-GA.2043 or CSCI-GA.2112, Spring 2012 March 8th, 2011 A. Donev (Courant Institute) Lecture

More information

Today. Introduction to optimization Definition and motivation 1-dimensional methods. Multi-dimensional methods. General strategies, value-only methods

Today. Introduction to optimization Definition and motivation 1-dimensional methods. Multi-dimensional methods. General strategies, value-only methods Optimization Last time Root inding: deinition, motivation Algorithms: Bisection, alse position, secant, Newton-Raphson Convergence & tradeos Eample applications o Newton s method Root inding in > 1 dimension

More information

Gradient Descent. Dr. Xiaowei Huang

Gradient Descent. Dr. Xiaowei Huang Gradient Descent Dr. Xiaowei Huang https://cgi.csc.liv.ac.uk/~xiaowei/ Up to now, Three machine learning algorithms: decision tree learning k-nn linear regression only optimization objectives are discussed,

More information

Fitting The Unknown 1/28. Joshua Lande. September 1, Stanford

Fitting The Unknown 1/28. Joshua Lande. September 1, Stanford 1/28 Fitting The Unknown Joshua Lande Stanford September 1, 2010 2/28 Motivation: Why Maximize It is frequently important in physics to find the maximum (or minimum) of a function Nature will maximize

More information

The use of second-order information in structural topology optimization. Susana Rojas Labanda, PhD student Mathias Stolpe, Senior researcher

The use of second-order information in structural topology optimization. Susana Rojas Labanda, PhD student Mathias Stolpe, Senior researcher The use of second-order information in structural topology optimization Susana Rojas Labanda, PhD student Mathias Stolpe, Senior researcher What is Topology Optimization? Optimize the design of a structure

More information

Math (P)Review Part II:

Math (P)Review Part II: Math (P)Review Part II: Vector Calculus Computer Graphics Assignment 0.5 (Out today!) Same story as last homework; second part on vector calculus. Slightly fewer questions Last Time: Linear Algebra Touched

More information

Lecture V. Numerical Optimization

Lecture V. Numerical Optimization Lecture V Numerical Optimization Gianluca Violante New York University Quantitative Macroeconomics G. Violante, Numerical Optimization p. 1 /19 Isomorphism I We describe minimization problems: to maximize

More information

Peristaltic Pump. Introduction. Model Definition

Peristaltic Pump. Introduction. Model Definition Peristaltic Pump Introduction In a peristaltic pump, rotating rollers are squeezing a flexible tube. As the pushed down rollers move along the tube, the fluid in the tube follows the motion. The main advantage

More information

The Influence of Channel Aspect Ratio on Performance of Optimized Thermal-Fluid Structures

The Influence of Channel Aspect Ratio on Performance of Optimized Thermal-Fluid Structures Excerpt from the Proceedings of the COMSOL Conference 2010 Boston The Influence of Channel Aspect Ratio on Performance of Optimized Thermal-Fluid Structures Ercan M. Dede 1* 1 Technical Research Department,

More information

Optimization. Totally not complete this is...don't use it yet...

Optimization. Totally not complete this is...don't use it yet... Optimization Totally not complete this is...don't use it yet... Bisection? Doing a root method is akin to doing a optimization method, but bi-section would not be an effective method - can detect sign

More information

6.252 NONLINEAR PROGRAMMING LECTURE 10 ALTERNATIVES TO GRADIENT PROJECTION LECTURE OUTLINE. Three Alternatives/Remedies for Gradient Projection

6.252 NONLINEAR PROGRAMMING LECTURE 10 ALTERNATIVES TO GRADIENT PROJECTION LECTURE OUTLINE. Three Alternatives/Remedies for Gradient Projection 6.252 NONLINEAR PROGRAMMING LECTURE 10 ALTERNATIVES TO GRADIENT PROJECTION LECTURE OUTLINE Three Alternatives/Remedies for Gradient Projection Two-Metric Projection Methods Manifold Suboptimization Methods

More information

Numerical optimization

Numerical optimization THE UNIVERSITY OF WESTERN ONTARIO LONDON ONTARIO Paul Klein Office: SSC 408 Phone: 661-111 ext. 857 Email: paul.klein@uwo.ca URL: www.ssc.uwo.ca/economics/faculty/klein/ Numerical optimization In these

More information

Scientific Computing: An Introductory Survey

Scientific Computing: An Introductory Survey Scientific Computing: An Introductory Survey Chapter 6 Optimization Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign Copyright c 2002. Reproduction permitted

More information

Scientific Computing: An Introductory Survey

Scientific Computing: An Introductory Survey Scientific Computing: An Introductory Survey Chapter 6 Optimization Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign Copyright c 2002. Reproduction permitted

More information

Numerical optimization. Numerical optimization. Longest Shortest where Maximal Minimal. Fastest. Largest. Optimization problems

Numerical optimization. Numerical optimization. Longest Shortest where Maximal Minimal. Fastest. Largest. Optimization problems 1 Numerical optimization Alexander & Michael Bronstein, 2006-2009 Michael Bronstein, 2010 tosca.cs.technion.ac.il/book Numerical optimization 048921 Advanced topics in vision Processing and Analysis of

More information

Benchmarking of optimization methods for topology optimization problems

Benchmarking of optimization methods for topology optimization problems Downloaded from orbit.dtu.dk on: Feb, 18 Benchmarking of optimization methods for topology optimization problems Rojas Labanda, Susana; Stolpe, Mathias Publication date: 14 Document Version Peer reviewed

More information

CS 542G: Robustifying Newton, Constraints, Nonlinear Least Squares

CS 542G: Robustifying Newton, Constraints, Nonlinear Least Squares CS 542G: Robustifying Newton, Constraints, Nonlinear Least Squares Robert Bridson October 29, 2008 1 Hessian Problems in Newton Last time we fixed one of plain Newton s problems by introducing line search

More information

Gradient Descent. Sargur Srihari

Gradient Descent. Sargur Srihari Gradient Descent Sargur srihari@cedar.buffalo.edu 1 Topics Simple Gradient Descent/Ascent Difficulties with Simple Gradient Descent Line Search Brent s Method Conjugate Gradient Descent Weight vectors

More information

Deep Learning. Authors: I. Goodfellow, Y. Bengio, A. Courville. Chapter 4: Numerical Computation. Lecture slides edited by C. Yim. C.

Deep Learning. Authors: I. Goodfellow, Y. Bengio, A. Courville. Chapter 4: Numerical Computation. Lecture slides edited by C. Yim. C. Chapter 4: Numerical Computation Deep Learning Authors: I. Goodfellow, Y. Bengio, A. Courville Lecture slides edited by 1 Chapter 4: Numerical Computation 4.1 Overflow and Underflow 4.2 Poor Conditioning

More information

Outline. Scientific Computing: An Introductory Survey. Optimization. Optimization Problems. Examples: Optimization Problems

Outline. Scientific Computing: An Introductory Survey. Optimization. Optimization Problems. Examples: Optimization Problems Outline Scientific Computing: An Introductory Survey Chapter 6 Optimization 1 Prof. Michael. Heath Department of Computer Science University of Illinois at Urbana-Champaign Copyright c 2002. Reproduction

More information

Motivating examples Introduction to algorithms Simplex algorithm. On a particular example General algorithm. Duality An application to game theory

Motivating examples Introduction to algorithms Simplex algorithm. On a particular example General algorithm. Duality An application to game theory Instructor: Shengyu Zhang 1 LP Motivating examples Introduction to algorithms Simplex algorithm On a particular example General algorithm Duality An application to game theory 2 Example 1: profit maximization

More information

CHAPTER 2: QUADRATIC PROGRAMMING

CHAPTER 2: QUADRATIC PROGRAMMING CHAPTER 2: QUADRATIC PROGRAMMING Overview Quadratic programming (QP) problems are characterized by objective functions that are quadratic in the design variables, and linear constraints. In this sense,

More information

Multidisciplinary System Design Optimization (MSDO)

Multidisciplinary System Design Optimization (MSDO) Multidisciplinary System Design Optimization (MSDO) Numerical Optimization II Lecture 8 Karen Willcox 1 Massachusetts Institute of Technology - Prof. de Weck and Prof. Willcox Today s Topics Sequential

More information

Homework 4 in 5C1212; Part A: Incompressible Navier- Stokes, Finite Volume Methods

Homework 4 in 5C1212; Part A: Incompressible Navier- Stokes, Finite Volume Methods Homework 4 in 5C11; Part A: Incompressible Navier- Stokes, Finite Volume Methods Consider the incompressible Navier Stokes in two dimensions u x + v y = 0 u t + (u ) x + (uv) y + p x = 1 Re u + f (1) v

More information

Lecture 2: Linear regression

Lecture 2: Linear regression Lecture 2: Linear regression Roger Grosse 1 Introduction Let s ump right in and look at our first machine learning algorithm, linear regression. In regression, we are interested in predicting a scalar-valued

More information

Lecture 7: Numerical Tools

Lecture 7: Numerical Tools Lecture 7: Numerical Tools Fatih Guvenen January 10, 2016 Fatih Guvenen Lecture 7: Numerical Tools January 10, 2016 1 / 18 Overview Three Steps: V (k, z) =max c,k 0 apple u(c)+ Z c + k 0 =(1 + r)k + z

More information

Minimization of Static! Cost Functions!

Minimization of Static! Cost Functions! Minimization of Static Cost Functions Robert Stengel Optimal Control and Estimation, MAE 546, Princeton University, 2017 J = Static cost function with constant control parameter vector, u Conditions for

More information

Lecture 5: Gradient Descent. 5.1 Unconstrained minimization problems and Gradient descent

Lecture 5: Gradient Descent. 5.1 Unconstrained minimization problems and Gradient descent 10-725/36-725: Convex Optimization Spring 2015 Lecturer: Ryan Tibshirani Lecture 5: Gradient Descent Scribes: Loc Do,2,3 Disclaimer: These notes have not been subjected to the usual scrutiny reserved for

More information

Shape, Convection and Convergence

Shape, Convection and Convergence Presented at the COMSOL Conference 2008 Boston Shape, Convection and Convergence,VP Research, Inc. Who is? Who is? We are: A Technical Consultation firm in business since 1993 Who is? We are: A Technical

More information

Flow Focusing Droplet Generation Using Linear Vibration

Flow Focusing Droplet Generation Using Linear Vibration Flow Focusing Droplet Generation Using Linear Vibration A. Salari, C. Dalton Department of Electrical & Computer Engineering, University of Calgary, Calgary, AB, Canada Abstract: Flow focusing microchannels

More information

Trust-region methods for rectangular systems of nonlinear equations

Trust-region methods for rectangular systems of nonlinear equations Trust-region methods for rectangular systems of nonlinear equations Margherita Porcelli Dipartimento di Matematica U.Dini Università degli Studi di Firenze Joint work with Maria Macconi and Benedetta Morini

More information

2.098/6.255/ Optimization Methods Practice True/False Questions

2.098/6.255/ Optimization Methods Practice True/False Questions 2.098/6.255/15.093 Optimization Methods Practice True/False Questions December 11, 2009 Part I For each one of the statements below, state whether it is true or false. Include a 1-3 line supporting sentence

More information

CONTROL AND TOPOLOGICAL OPTIMIZATION OF A LARGE MULTIBEAM ARRAY ANTENNA

CONTROL AND TOPOLOGICAL OPTIMIZATION OF A LARGE MULTIBEAM ARRAY ANTENNA CONTROL AND TOPOLOGICAL OPTIMIZATION OF A LARGE MULTIBEAM ARRAY ANTENNA Thierry Touya and Didier Auroux Mathematics Institute of Toulouse University of Toulouse Paul Sabatier 31062 Toulouse cedex 9 France

More information

Optimization Concepts and Applications in Engineering

Optimization Concepts and Applications in Engineering Optimization Concepts and Applications in Engineering Ashok D. Belegundu, Ph.D. Department of Mechanical Engineering The Pennsylvania State University University Park, Pennsylvania Tirupathi R. Chandrupatia,

More information

NUMERICAL SOLUTION OF ODE IVPs. Overview

NUMERICAL SOLUTION OF ODE IVPs. Overview NUMERICAL SOLUTION OF ODE IVPs 1 Quick review of direction fields Overview 2 A reminder about and 3 Important test: Is the ODE initial value problem? 4 Fundamental concepts: Euler s Method 5 Fundamental

More information

Unconstrained Multivariate Optimization

Unconstrained Multivariate Optimization Unconstrained Multivariate Optimization Multivariate optimization means optimization of a scalar function of a several variables: and has the general form: y = () min ( ) where () is a nonlinear scalar-valued

More information

Iterative Methods for Solving A x = b

Iterative Methods for Solving A x = b Iterative Methods for Solving A x = b A good (free) online source for iterative methods for solving A x = b is given in the description of a set of iterative solvers called templates found at netlib: http

More information

Hybrid Analog-Digital Solution of Nonlinear Partial Differential Equations

Hybrid Analog-Digital Solution of Nonlinear Partial Differential Equations Hybrid Analog-Digital Solution of Nonlinear Partial Differential Equations Yipeng Huang, Ning Guo, Kyle Mandli, Mingoo Seok, Yannis Tsividis, Simha Sethumadhavan Columbia University Hybrid Analog-Digital

More information

An Introduction to COMSOL Multiphysics v4.3b & Subsurface Flow Simulation. Ahsan Munir, PhD Tom Spirka, PhD

An Introduction to COMSOL Multiphysics v4.3b & Subsurface Flow Simulation. Ahsan Munir, PhD Tom Spirka, PhD An Introduction to COMSOL Multiphysics v4.3b & Subsurface Flow Simulation Ahsan Munir, PhD Tom Spirka, PhD Agenda Provide an overview of COMSOL 4.3b Our products, solutions and applications Subsurface

More information

4M020 Design tools. Algorithms for numerical optimization. L.F.P. Etman. Department of Mechanical Engineering Eindhoven University of Technology

4M020 Design tools. Algorithms for numerical optimization. L.F.P. Etman. Department of Mechanical Engineering Eindhoven University of Technology 4M020 Design tools Algorithms for numerical optimization L.F.P. Etman Department of Mechanical Engineering Eindhoven University of Technology Wednesday September 3, 2008 1 / 32 Outline 1 Problem formulation:

More information

Section Notes 9. IP: Cutting Planes. Applied Math 121. Week of April 12, 2010

Section Notes 9. IP: Cutting Planes. Applied Math 121. Week of April 12, 2010 Section Notes 9 IP: Cutting Planes Applied Math 121 Week of April 12, 2010 Goals for the week understand what a strong formulations is. be familiar with the cutting planes algorithm and the types of cuts

More information

1 Numerical optimization

1 Numerical optimization Contents 1 Numerical optimization 5 1.1 Optimization of single-variable functions............ 5 1.1.1 Golden Section Search................... 6 1.1. Fibonacci Search...................... 8 1. Algorithms

More information

AM 205: lecture 19. Last time: Conditions for optimality, Newton s method for optimization Today: survey of optimization methods

AM 205: lecture 19. Last time: Conditions for optimality, Newton s method for optimization Today: survey of optimization methods AM 205: lecture 19 Last time: Conditions for optimality, Newton s method for optimization Today: survey of optimization methods Quasi-Newton Methods General form of quasi-newton methods: x k+1 = x k α

More information

Quasi-Newton Methods

Quasi-Newton Methods Newton s Method Pros and Cons Quasi-Newton Methods MA 348 Kurt Bryan Newton s method has some very nice properties: It s extremely fast, at least once it gets near the minimum, and with the simple modifications

More information

CHAPTER 7 NUMERICAL MODELLING OF A SPIRAL HEAT EXCHANGER USING CFD TECHNIQUE

CHAPTER 7 NUMERICAL MODELLING OF A SPIRAL HEAT EXCHANGER USING CFD TECHNIQUE CHAPTER 7 NUMERICAL MODELLING OF A SPIRAL HEAT EXCHANGER USING CFD TECHNIQUE In this chapter, the governing equations for the proposed numerical model with discretisation methods are presented. Spiral

More information

Optimization and Root Finding. Kurt Hornik

Optimization and Root Finding. Kurt Hornik Optimization and Root Finding Kurt Hornik Basics Root finding and unconstrained smooth optimization are closely related: Solving ƒ () = 0 can be accomplished via minimizing ƒ () 2 Slide 2 Basics Root finding

More information

NUMERICAL MODELING OF TRANSIENT ACOUSTIC FIELD USING FINITE ELEMENT METHOD

NUMERICAL MODELING OF TRANSIENT ACOUSTIC FIELD USING FINITE ELEMENT METHOD POZNAN UNIVE RSITY OF TE CHNOLOGY ACADE MIC JOURNALS No 73 Electrical Engineering 213 Lukáš KOUDELA* Jindřich JANSA* Pavel KARBAN* NUMERICAL MODELING OF TRANSIENT ACOUSTIC FIELD USING FINITE ELEMENT METHOD

More information

Numerical Optimization Prof. Shirish K. Shevade Department of Computer Science and Automation Indian Institute of Science, Bangalore

Numerical Optimization Prof. Shirish K. Shevade Department of Computer Science and Automation Indian Institute of Science, Bangalore Numerical Optimization Prof. Shirish K. Shevade Department of Computer Science and Automation Indian Institute of Science, Bangalore Lecture - 13 Steepest Descent Method Hello, welcome back to this series

More information

This chapter focuses on the study of the numerical approximation of threedimensional

This chapter focuses on the study of the numerical approximation of threedimensional 6 CHAPTER 6: NUMERICAL OPTIMISATION OF CONJUGATE HEAT TRANSFER IN COOLING CHANNELS WITH DIFFERENT CROSS-SECTIONAL SHAPES 3, 4 6.1. INTRODUCTION This chapter focuses on the study of the numerical approximation

More information

A high-level programming-language implementation of topology optimization applied to steady-state Navier Stokes flow

A high-level programming-language implementation of topology optimization applied to steady-state Navier Stokes flow INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN ENGINEERING Int. J. Numer. Meth. Engng 2006; 65:975 1001 Published online 1 September 2005 in Wiley InterScience (www.interscience.wiley.com). DOI: 10.1002/nme.1468

More information

7 The Navier-Stokes Equations

7 The Navier-Stokes Equations 18.354/12.27 Spring 214 7 The Navier-Stokes Equations In the previous section, we have seen how one can deduce the general structure of hydrodynamic equations from purely macroscopic considerations and

More information

Statics. Introductions Review Course Outline and Class Schedule Course Expectations Chapter 1

Statics. Introductions Review Course Outline and Class Schedule Course Expectations Chapter 1 Statics ENGR 1205 Kaitlin Ford kford@mtroyal.ca B175 Today Introductions Review Course Outline and Class Schedule Course Expectations Chapter 1 1 Review the Course Outline and Class Schedule Go through

More information

Contents. Preface. 1 Introduction Optimization view on mathematical models NLP models, black-box versus explicit expression 3

Contents. Preface. 1 Introduction Optimization view on mathematical models NLP models, black-box versus explicit expression 3 Contents Preface ix 1 Introduction 1 1.1 Optimization view on mathematical models 1 1.2 NLP models, black-box versus explicit expression 3 2 Mathematical modeling, cases 7 2.1 Introduction 7 2.2 Enclosing

More information

Large Scale Fluid-Structure Interaction by coupling OpenFOAM with external codes

Large Scale Fluid-Structure Interaction by coupling OpenFOAM with external codes Large Scale Fluid-Structure Interaction by coupling OpenFOAM with external codes Thomas Gallinger * Alexander Kupzok Roland Wüchner Kai-Uwe Bletzinger Lehrstuhl für Statik Technische Universität München

More information

Constrained data assimilation. W. Carlisle Thacker Atlantic Oceanographic and Meteorological Laboratory Miami, Florida USA

Constrained data assimilation. W. Carlisle Thacker Atlantic Oceanographic and Meteorological Laboratory Miami, Florida USA Constrained data assimilation W. Carlisle Thacker Atlantic Oceanographic and Meteorological Laboratory Miami, Florida 33149 USA Plan Range constraints: : HYCOM layers have minimum thickness. Optimal interpolation:

More information

Introduction to Optimization

Introduction to Optimization Introduction to Optimization Gradient-based Methods Marc Toussaint U Stuttgart Gradient descent methods Plain gradient descent (with adaptive stepsize) Steepest descent (w.r.t. a known metric) Conjugate

More information

Math (P)Review Part I:

Math (P)Review Part I: Lecture 1: Math (P)Review Part I: Linear Algebra Computer Graphics CMU 15-462/15-662, Fall 2017 Homework 0.0 (Due Monday!) Exercises will be a bit harder / more rigorous than what you will do for the rest

More information

Optimization Tutorial 1. Basic Gradient Descent

Optimization Tutorial 1. Basic Gradient Descent E0 270 Machine Learning Jan 16, 2015 Optimization Tutorial 1 Basic Gradient Descent Lecture by Harikrishna Narasimhan Note: This tutorial shall assume background in elementary calculus and linear algebra.

More information

CHAPTER 4 OPTIMIZATION OF COEFFICIENT OF LIFT, DRAG AND POWER - AN ITERATIVE APPROACH

CHAPTER 4 OPTIMIZATION OF COEFFICIENT OF LIFT, DRAG AND POWER - AN ITERATIVE APPROACH 82 CHAPTER 4 OPTIMIZATION OF COEFFICIENT OF LIFT, DRAG AND POWER - AN ITERATIVE APPROACH The coefficient of lift, drag and power for wind turbine rotor is optimized using an iterative approach. The coefficient

More information

MATH 308 COURSE SUMMARY

MATH 308 COURSE SUMMARY MATH 308 COURSE SUMMARY Approximately a third of the exam cover the material from the first two midterms, that is, chapter 6 and the first six sections of chapter 7. The rest of the exam will cover the

More information

Introduction to Scientific Computing

Introduction to Scientific Computing Introduction to Scientific Computing Benson Muite benson.muite@ut.ee http://kodu.ut.ee/ benson https://courses.cs.ut.ee/2018/isc/spring 26 March 2018 [Public Domain,https://commons.wikimedia.org/wiki/File1

More information

Chapter 3. Load and Stress Analysis

Chapter 3. Load and Stress Analysis Chapter 3 Load and Stress Analysis 2 Shear Force and Bending Moments in Beams Internal shear force V & bending moment M must ensure equilibrium Fig. 3 2 Sign Conventions for Bending and Shear Fig. 3 3

More information

Lecture 9 - Rotational Dynamics

Lecture 9 - Rotational Dynamics Lecture 9 - Rotational Dynamics A Puzzle... Angular momentum is a 3D vector, and changing its direction produces a torque τ = dl. An important application in our daily lives is that bicycles don t fall

More information

Simulation of Aeroelastic System with Aerodynamic Nonlinearity

Simulation of Aeroelastic System with Aerodynamic Nonlinearity Simulation of Aeroelastic System with Aerodynamic Nonlinearity Muhamad Khairil Hafizi Mohd Zorkipli School of Aerospace Engineering, Universiti Sains Malaysia, Penang, MALAYSIA Norizham Abdul Razak School

More information

Lecture 7: Minimization or maximization of functions (Recipes Chapter 10)

Lecture 7: Minimization or maximization of functions (Recipes Chapter 10) Lecture 7: Minimization or maximization of functions (Recipes Chapter 10) Actively studied subject for several reasons: Commonly encountered problem: e.g. Hamilton s and Lagrange s principles, economics

More information

Solving Distributed Optimal Control Problems for the Unsteady Burgers Equation in COMSOL Multiphysics

Solving Distributed Optimal Control Problems for the Unsteady Burgers Equation in COMSOL Multiphysics Excerpt from the Proceedings of the COMSOL Conference 2009 Milan Solving Distributed Optimal Control Problems for the Unsteady Burgers Equation in COMSOL Multiphysics Fikriye Yılmaz 1, Bülent Karasözen

More information

Thermal Analysis. with SolidWorks Simulation 2013 SDC. Paul M. Kurowski. Better Textbooks. Lower Prices.

Thermal Analysis. with SolidWorks Simulation 2013 SDC. Paul M. Kurowski. Better Textbooks. Lower Prices. Thermal Analysis with SolidWorks Simulation 2013 Paul M. Kurowski SDC PUBLICATIONS Schroff Development Corporation Better Textbooks. Lower Prices. www.sdcpublications.com Visit the following websites to

More information

Optimization Methods

Optimization Methods Optimization Methods Decision making Examples: determining which ingredients and in what quantities to add to a mixture being made so that it will meet specifications on its composition allocating available

More information

The case where there is no net effect of the forces acting on a rigid body

The case where there is no net effect of the forces acting on a rigid body The case where there is no net effect of the forces acting on a rigid body Outline: Introduction and Definition of Equilibrium Equilibrium in Two-Dimensions Special cases Equilibrium in Three-Dimensions

More information

A multiscale framework for lubrication analysis of bearings with textured surface

A multiscale framework for lubrication analysis of bearings with textured surface A multiscale framework for lubrication analysis of bearings with textured surface *Leiming Gao 1), Gregory de Boer 2) and Rob Hewson 3) 1), 3) Aeronautics Department, Imperial College London, London, SW7

More information

10. Ellipsoid method

10. Ellipsoid method 10. Ellipsoid method EE236C (Spring 2008-09) ellipsoid method convergence proof inequality constraints 10 1 Ellipsoid method history developed by Shor, Nemirovski, Yudin in 1970s used in 1979 by Khachian

More information

Inverse Heat Flux Evaluation using Conjugate Gradient Methods from Infrared Imaging

Inverse Heat Flux Evaluation using Conjugate Gradient Methods from Infrared Imaging 11 th International Conference on Quantitative InfraRed Thermography Inverse Heat Flux Evaluation using Conjugate Gradient Methods from Infrared Imaging by J. Sousa*, L. Villafane*, S. Lavagnoli*, and

More information

Lecture 17: Numerical Optimization October 2014

Lecture 17: Numerical Optimization October 2014 Lecture 17: Numerical Optimization 36-350 22 October 2014 Agenda Basics of optimization Gradient descent Newton s method Curve-fitting R: optim, nls Reading: Recipes 13.1 and 13.2 in The R Cookbook Optional

More information

Unit 21 Couples and Resultants with Couples

Unit 21 Couples and Resultants with Couples Unit 21 Couples and Resultants with Couples Page 21-1 Couples A couple is defined as (21-5) Moment of Couple The coplanar forces F 1 and F 2 make up a couple and the coordinate axes are chosen so that

More information

Primal/Dual Decomposition Methods

Primal/Dual Decomposition Methods Primal/Dual Decomposition Methods Daniel P. Palomar Hong Kong University of Science and Technology (HKUST) ELEC5470 - Convex Optimization Fall 2018-19, HKUST, Hong Kong Outline of Lecture Subgradients

More information

CSC373: Algorithm Design, Analysis and Complexity Fall 2017 DENIS PANKRATOV NOVEMBER 1, 2017

CSC373: Algorithm Design, Analysis and Complexity Fall 2017 DENIS PANKRATOV NOVEMBER 1, 2017 CSC373: Algorithm Design, Analysis and Complexity Fall 2017 DENIS PANKRATOV NOVEMBER 1, 2017 Linear Function f: R n R is linear if it can be written as f x = a T x for some a R n Example: f x 1, x 2 =

More information

24. Nonlinear programming

24. Nonlinear programming CS/ECE/ISyE 524 Introduction to Optimization Spring 2017 18 24. Nonlinear programming ˆ Overview ˆ Example: making tires ˆ Example: largest inscribed polygon ˆ Example: navigation using ranges Laurent

More information

Design Principles of Superconducting Magnets

Design Principles of Superconducting Magnets 1 Design Principles of Superconducting Magnets Aki Korpela Tampere University of Technology DESIGN PRINCIPLES OF SUPERCONDUCTING MAGNETS 2 Content of the presentation Background Short-sample measurement

More information

A COUPLED-ADJOINT METHOD FOR HIGH-FIDELITY AERO-STRUCTURAL OPTIMIZATION

A COUPLED-ADJOINT METHOD FOR HIGH-FIDELITY AERO-STRUCTURAL OPTIMIZATION A COUPLED-ADJOINT METHOD FOR HIGH-FIDELITY AERO-STRUCTURAL OPTIMIZATION Joaquim Rafael Rost Ávila Martins Department of Aeronautics and Astronautics Stanford University Ph.D. Oral Examination, Stanford

More information

An Essay on Higher Order Mathematics for Rotational Moment of Inertia A Cylindrical Mapping of Boolean Shapes By Joshua Milgram

An Essay on Higher Order Mathematics for Rotational Moment of Inertia A Cylindrical Mapping of Boolean Shapes By Joshua Milgram An Essay on Higher Order Mathematics for Rotational Moment of Inertia A Cylindrical Mapping of Boolean Shapes By Joshua Milgram Abstract: This essay makes three main estimates: (1) Boolean Volume (2) Boolean

More information

A Level Maths. Course Guide

A Level Maths. Course Guide A Level Maths Course Guide 2017-18 AS and A Level Maths Course Guide Welcome to A Level Maths. In this course you will develop your mathematical skills from GCSE, and will learn many new and powerful techniques

More information

February 22, Introduction to the Simplex Algorithm

February 22, Introduction to the Simplex Algorithm 15.53 February 22, 27 Introduction to the Simplex Algorithm 1 Quotes for today Give a man a fish and you feed him for a day. Teach him how to fish and you feed him for a lifetime. -- Lao Tzu Give a man

More information

Outline Introduction: Problem Description Diculties Algebraic Structure: Algebraic Varieties Rank Decient Toeplitz Matrices Constructing Lower Rank St

Outline Introduction: Problem Description Diculties Algebraic Structure: Algebraic Varieties Rank Decient Toeplitz Matrices Constructing Lower Rank St Structured Lower Rank Approximation by Moody T. Chu (NCSU) joint with Robert E. Funderlic (NCSU) and Robert J. Plemmons (Wake Forest) March 5, 1998 Outline Introduction: Problem Description Diculties Algebraic

More information

Sensitivity and Reliability Analysis of Nonlinear Frame Structures

Sensitivity and Reliability Analysis of Nonlinear Frame Structures Sensitivity and Reliability Analysis of Nonlinear Frame Structures Michael H. Scott Associate Professor School of Civil and Construction Engineering Applied Mathematics and Computation Seminar April 8,

More information

ISM206 Lecture Optimization of Nonlinear Objective with Linear Constraints

ISM206 Lecture Optimization of Nonlinear Objective with Linear Constraints ISM206 Lecture Optimization of Nonlinear Objective with Linear Constraints Instructor: Prof. Kevin Ross Scribe: Nitish John October 18, 2011 1 The Basic Goal The main idea is to transform a given constrained

More information

CSMA ème Colloque National en Calcul des Structures mai 2017, Presqu île de Giens (Var)

CSMA ème Colloque National en Calcul des Structures mai 2017, Presqu île de Giens (Var) CSMA 207 3ème Colloque National en Calcul des Structures 5-9 mai 207, Presqu île de Giens (Var) TOPOLEV: Topological optimization using level-set method D. Lachouette, Ph. Conraux 2, G. Allaire 3, F. Jouve

More information

Bellman s Curse of Dimensionality

Bellman s Curse of Dimensionality Bellman s Curse of Dimensionality n- dimensional state space Number of states grows exponen

More information

The Not-Formula Book for C1

The Not-Formula Book for C1 Not The Not-Formula Book for C1 Everything you need to know for Core 1 that won t be in the formula book Examination Board: AQA Brief This document is intended as an aid for revision. Although it includes

More information

Optimal control problems with PDE constraints

Optimal control problems with PDE constraints Optimal control problems with PDE constraints Maya Neytcheva CIM, October 2017 General framework Unconstrained optimization problems min f (q) q x R n (real vector) and f : R n R is a smooth function.

More information

Quiz Discussion. IE417: Nonlinear Programming: Lecture 12. Motivation. Why do we care? Jeff Linderoth. 16th March 2006

Quiz Discussion. IE417: Nonlinear Programming: Lecture 12. Motivation. Why do we care? Jeff Linderoth. 16th March 2006 Quiz Discussion IE417: Nonlinear Programming: Lecture 12 Jeff Linderoth Department of Industrial and Systems Engineering Lehigh University 16th March 2006 Motivation Why do we care? We are interested in

More information