Nonsmooth Schur Newton Methods and Applications

Size: px
Start display at page:

Download "Nonsmooth Schur Newton Methods and Applications"

Transcription

1 Nonsmooth Schur Newton Methods and Applications C. Gräser, R. Kornhuber, and U. Sack IMA Annual Program Year Workshop Numerical Solutions of Partial Differential Equations: Fast Solution Techniques November 29 December 3, 2010 Matheon

2 Outline Motivation: Phase separation in alloys (Matheon C17: Kh., Sprekels, Sack) - Cahn-Larché equations (Dreyer & Müller 1999,..., Garcke 01,05,..., Weikard 01,...) Nonsmooth PDE constrained optimal control - nonsmooth saddle point problem - globally convergent nonsmooth Schur Newton methods (Gräser & Kh. 06, 09, Gräser 10) - numerical experiments: robust convergence Phase separation in alloys: Some numerical results

3 The Lead-Free Movement classical solder joints: SnPb alloy distribution of lead by electronic waste: kg/year environmentally friendly manufacturing: lead-free solders (EU: July 1, 2006) SnAg, CuSn, SnAgCu, SnAgCuSb,...

4 Assessing Solder Joint Reliability in Lead-Free Assemblies cracks: and failure: main reasons: thermomechanical stress demixing of alloys (phase separation)

5 Experimental results: Aging of a AgCu Alloy 2 hours 5 hours 20 hours 40 hours T. Bo hme & W.H. Mu ller 2006

6 Cahn Larché Equations u t = ( M(u) w ) w = (γ(u) u) + Ψ (u) + W,u (u,ε) W,ε (u,ε) = 0 concentration of component α: u [ 1,1] mobility: M(u) = ω(u)m α + (1 ω(u))m β, ω(u) [0, 1] surface tension: γ(u) = ω(u)γ α + (1 ω(u))γ β nonsmooth (logarithmic) free energy: Ψ(u) = 1 2ε T( (1 + u)log(1 + u) + (1 u)log(1 u) ) 1 2ε T c(1 u 2 ) strain energy: W(u,ε) = 1 2C(u)(ε ε(u)) : (ε ε(u)) elasticity tensor: C(u), linearized strain: ε, eigenstrain ε(u)

7 Some References Cahn Hilliard equations: Elliott et al. (1991, 1991, 1992, 1993,...,1996, ), Barrett & Blowey (1995,..., 2001),... Cahn Larché equations: modelling: Dreyer & Müller (1999, 2001,...) logarithmic free energy analysis: Garcke (2003, 2005) existence, logarithmic free energy Sprekels et al. (2002) viscous case, existence + uniqueness, logarithmic free energy numerical analysis: Garcke, Rumpf & Weikard (2001) qualitative study, quartic free energy, Newton solver Garcke & Weikard (2005) convergence of the discretization, quartic free energy Merkle (2005) quantitative numerical study, piecewise polynomial free energy, Newton solver not covered: logarithmic free energy widely open: multicomponent alloys

8 Some References Cahn Hilliard equations: Elliott et al. (1991, 1991, 1992, 1993,...,1996, ), Barrett & Blowey (1995,..., 2001),... Cahn Larché equations: modelling: Dreyer & Müller (1999, 2001,...) logarithmic free energy analysis: Garcke (2003, 2005) existence, logarithmic free energy Sprekels et al. (2002) viscous case, existence + uniqueness, logarithmic free energy numerical analysis: Garcke, Rumpf & Weikard (2001) qualitative study, quartic free energy, Newton solver Garcke & Weikard (2005) convergence of the discretization, quartic free energy Merkle (2005) quantitative numerical study, piecewise polynomial free energy, Newton solver not covered: logarithmic free energy widely open: multicomponent alloys

9 Discretization in time: semi implicit Euler scheme (Blowey & Elliott 92) fully implicit: second order terms semi implicit: free energy Ψ = Φ + Σ unconditionally stable Φ convex implicit Σ concave explicit frozen mobilities, surface tension, and coefficients in elasticity decouples Cahn-Hilliard equation and elasticity adaptive multigrid solvers for linear elasticity available (..., Sander,...) fast adaptive solver for the time-discrete Cahn-Hilliard equation needed! in space: piecewise finite elements S j = span {λ (j) p p N j } missing: convergence analysis ongoing work: systematic numerical assessment

10 Discretization in time: semi implicit Euler scheme (Blowey & Elliott 92) fully implicit: second order terms semi implicit: free energy Ψ = Φ + Σ unconditionally stable Φ convex implicit Σ concave explicit frozen mobilities, surface tension, and coefficients in elasticity decouples Cahn-Hilliard equation and elasticity adaptive multigrid solvers for linear elasticity available (..., Sander,...) fast adaptive solver for the time-discrete Cahn-Hilliard equation needed! in space: piecewise finite elements S j = span {λ (j) p p N j } missing: convergence analysis ongoing work: systematic numerical assessment

11 Discretization in time: semi implicit Euler scheme (Blowey & Elliott 92) fully implicit: second order terms semi implicit: free energy Ψ = Φ + Σ unconditionally stable Φ convex implicit Σ concave explicit frozen mobilities, surface tension, and coefficients in elasticity decouples Cahn-Hilliard equation and elasticity adaptive multigrid solvers for linear elasticity available (..., Sander,...) fast adaptive solver for the time-discrete Cahn-Hilliard equation needed! in space: piecewise finite elements S j = span {λ (j) p p N j } missing: convergence analysis ongoing work: systematic numerical assessment

12 Discrete Spatial Problem u k j, v + τ(m wk j (γ u k j, v) + Φ (u k j ),v wk j, v, v) = uk 1 j, v = (W,u(u k 1 j, ε k ),v) Σ (u k 1 j ), v singularly perturbed nonlinear system: variational inequality for T 0 no classical Newton linearization (multicomponent) Cahn-Hilliard: high numerical complexity efficient and reliable algebraic solvers strongly varying solution adaptivity in space and time Φ for shallow quench, deep quench and deep quench limit

13 Nonsmooth PDE-Constrained Optimal Control (Blowey&Elliott 92, Gräser&Kh. 06) minimize J (y, q) = 1 2 a(y, y) + 1 2b(q,q) + φ(y, q) f(y) g(q) pde constraints: c(y,v) + q, v = h(v) v S j a(, ), b(, ) s.p.d., c(, ) s.p.s.d. φ convex, l.s.c., proper L 2 control problem with control constraints: a(y, v) = y, v, b(q, v) = ε q, v, c(y, v) = ( y, v), φ(y,q) = χ [0,1] (q) spatial Cahn-Hilliard problem: u = q, w = λ (Lagrange multiplier) c(y,v) = τ(m y, z), a(y, z) = c(y, z) + y, 1 z,1, b(q,v) = (γ q, v) + q,1 v, 1, φ(y,q) = p N j Φ(q(p)) α p

14 Karush-Kuhn-Tucker: NonSmooth Saddle-Point Problem ( F B T ) ( u ) ( f ) B C λ g u = (y, q) T, F = A + Φ A R n,n s.p.d., B R m,n, C R m,m symmetric, positive semi-definite sufficient assumptions on nonlinearity: F = ϕ, ϕ : R n R strictly convex, l.s.c., proper, coercive: ( ϕ) 1 single valued, Lipschitz

15 Recent Approaches to Algebraic Solution splitting algorithm of Lions & Mercier 79: (Blowey & Elliott 92,... ) box constraints, global convergence proof, expensive and slow block Gauß Seidel relaxation: (Barrett 98, Barrett, Nürnberg & Styles 05,...) box constraints, global convergence proof, slow multilevel block Gauß Seidel: (Baňas & Nürnberg 09) box constraints, no convergence proof nonsmooth Schur Newton methods: (Gräser & Kornhuber 07, 06-09, Gräser 09) piecewise smooth Φ (box constraints, log. potential), global convergence proof active set approach to box constraints: (Blank, Butz & Garcke 09) box constraints, locally exact Moreau-Yosida-type regularization of box constraints: (Hintermüller, Hinze &Tber 09) box constraints, convergence analysis in function space

16 Recent Approaches to Algebraic Solution splitting algorithm of Lions & Mercier 79: (Blowey & Elliott 92,... ) box constraints, global convergence proof, expensive and slow block Gauß Seidel relaxation: (Barrett 98, Barrett, Nürnberg & Styles 05,...) box constraints, global convergence proof, slow multilevel block Gauß Seidel: (Baňas & Nürnberg 09) box constraints, no convergence proof nonsmooth Schur Newton methods: (Gräser & Kornhuber 07, 06-09, Gräser 09) piecewise smooth Φ (box constraints, log. potential), global convergence proof active set approach to box constraints: (Blank, Butz & Garcke 09) box constraints, locally exact Moreau-Yosida-type regularization of box constraints: (Hintermüller, Hinze &Tber 09) box constraints, convergence analysis in function space

17 Recent Approaches to Algebraic Solution splitting algorithm of Lions & Mercier 79: (Blowey & Elliott 92,... ) box constraints, global convergence proof, expensive and slow block Gauß Seidel relaxation: (Barrett 98, Barrett, Nürnberg & Styles 05,...) box constraints, global convergence proof, slow multilevel block Gauß Seidel: (Baňas & Nürnberg 09) box constraints, no convergence proof nonsmooth Schur Newton methods: (Gräser & Kornhuber 07, 06-09, Gräser 09) piecewise smooth Φ (box constraints, log. potential), global convergence proof active set approach to box constraints: (Blank, Butz & Garcke 09) box constraints, locally exact Moreau-Yosida-type regularization of box constraints: (Hintermüller, Hinze &Tber 09) box constraints, convergence analysis in function space

18 Recent Approaches to Algebraic Solution splitting algorithm of Lions & Mercier 79: (Blowey & Elliott 92,... ) box constraints, global convergence proof, expensive and slow block Gauß Seidel relaxation: (Barrett 98, Barrett, Nürnberg & Styles 05,...) box constraints, global convergence proof, slow multilevel block Gauß Seidel: (Baňas & Nürnberg 09) box constraints, no convergence proof nonsmooth Schur Newton methods: (Gräser & Kornhuber 07, 06-09, Gräser 09) box constraints, log. potential and other Φ, global convergence proof active set approach to box constraints: (Blank, Butz & Garcke 09) box constraints, locally exact Moreau-Yosida-type regularization of box constraints: (Hintermüller, Hinze &Tber 09) box constraints, convergence analysis in function space

19 Recent Approaches to Algebraic Solution splitting algorithm of Lions & Mercier 79: (Blowey & Elliott 92,... ) box constraints, global convergence proof, expensive and slow block Gauß Seidel relaxation: (Barrett 98, Barrett, Nürnberg & Styles 05,...) box constraints, global convergence proof, slow multilevel block Gauß Seidel: (Baňas & Nürnberg 09) box constraints, no convergence proof nonsmooth Schur Newton methods: (Gräser & Kornhuber 07, 06-09, Gräser 09) box constraints, log. potential and other Φ, global convergence proof active set approach to box constraints: (Blank, Butz & Garcke 09) box constraints, locally exact Moreau-Yosida-type regularization of box constraints: (Hintermüller, Hinze &Tber 09) box constraints, convergence analysis in function space

20 Recent Approaches to Algebraic Solution splitting algorithm of Lions & Mercier 79: (Blowey & Elliott 92,... ) box constraints, global convergence proof, expensive and slow block Gauß Seidel relaxation: (Barrett 98, Barrett, Nürnberg & Styles 05,...) box constraints, global convergence proof, slow multilevel block Gauß Seidel: (Baňas & Nürnberg 09) box constraints, no convergence proof nonsmooth Schur Newton methods: (Gräser & Kornhuber 07, 06-09, Gräser 09) box constraints, log. potential and other Φ, global convergence proof active set approach to box constraints: (Blank, Butz & Garcke 09) box constraints, locally exact Moreau-Yosida-type regularization of box constraints: (Hintermüller, Hinze &Tber 09) box constraints, convergence analysis in function space

21 Nonlinear Schur Complement F B T!!! u f B C λ g H(λ) = 0, H(λ) = BF 1 (f B T λ) + Cλ + g Proposition Let ϕ : R n R denote the polar functional of ϕ with F = ϕ J (λ) = ϕ (f B T λ) (Cλ, λ) + (g, λ) is Fréchet differentiable H = J H(λ) = 0 is equivalent to unconstrained (!) convex minimization λ R n : J (λ) J (v) v R n

22 Nonlinear Schur Complement F B T!!! u f B C λ g H(λ) = 0, H(λ) = BF 1 (f B T λ) + Cλ + g Proposition Let ϕ : R n R denote the polar functional of ϕ with F = ϕ J (λ) = ϕ (f B T λ) (Cλ, λ) + (g, λ) is Fréchet differentiable H = J H(λ) = 0 is equivalent to unconstrained (!) convex minimization λ R n : J (λ) J (v) v R n

23 Gradient-Related Descent Methods λ ν+1 = λ ν + ρ ν d ν, d ν = S 1 ν J (λ ν ), S ν s.p.d. Assumption on d ν : c v 2 (S ν v, v) C v 2 ν N Assumption on ρ ν : J (λ ν + ρ ν d ν ) J (λ ν ) c( J (λ ν ),d ν ) 2 / d ν 2 Theorem: (..., Ortega & Rheinboldt 70, Nocedal 92, Powell 98, Deuflhard 04,...) The iteration is globally convergent.

24 Damping Strategies classical Armijo damping: two parameters, expensive evaluation of J inexact damping: approximate the solution of (H(λ ν + ρd ν ), d ν ) = 0 by bisection computational cost: evaluation of ( ϕ) 1 in each bisection step numerical experience: usually 1 step, but up to 8 steps in exceptional cases monotonicity test: (Gräser & Kh. 09, Gräser 10) no damping necessary, if d ν σ d ν 1, σ < 1

25 Damping Strategies classical Armijo damping: two parameters, expensive evaluation of J inexact damping: approximate the solution of (H(λ ν + ρd ν ), d ν ) = 0 by bisection computational cost: evaluation of ( ϕ) 1 in each bisection step numerical experience: usually 1 step, but up to 8 steps in exceptional cases monotonicity test: (Gräser & Kh. 09, Gräser 10) no damping necessary, if d ν σ d ν 1, σ < 1

26 Damping Strategies classical Armijo damping: two parameters, expensive evaluation of J inexact damping: approximate the solution of (H(λ ν + ρd ν ), d ν ) = 0 by bisection computational cost: evaluation of ( ϕ) 1 in each bisection step numerical experience: usually 1 step, but up to 8 steps in exceptional cases monotonicity test: (Gräser & Kh. 09, Gräser 10) no damping necessary, if d ν σ d ν 1, σ < 1

27 Inexact Evaluation of S 1 ν Proposition: Let d ν d ν = S 1 ν J (λ ν ). Then the accuracy conditions d ν d ν 1 ν d ν, (H(λ ν ), d ν ) < 0 ν N preserve convergence.

28 Selection of S ν : Nonsmooth Schur Newton Methods gradient-related descent method: λ ν+1 = λ ν ρ ν S 1 ν H(λ ν ) H(λ ν ) = Bu ν+1 + Cλ ν + g, u ν+1 = F 1 (f B T λ ν ) smooth nonlinearity: Newton s method: S ν = H (λ ν ) = B ( F (u ν+1 ) ) 1 B T + C nonsmooth nonlinearity: nonsmooth Newton: S ν = H (λ ν ) = B ( δf(u ν+1 ) ) + B T + C

29 Selection of S ν : Nonsmooth Schur Newton Methods gradient-related descent method: λ ν+1 = λ ν ρ ν S 1 ν H(λ ν ) H(λ ν ) = Bu ν+1 + Cλ ν + g, u ν+1 = F 1 (f B T λ ν ) smooth nonlinearity: Newton s method: S ν = H (λ ν ) = B ( (F 1 ) (f B T λ ν ) ) B T + C nonsmooth nonlinearity: nonsmooth Newton: S ν = H (λ ν ) = B ( δ(f 1 )(f B T λ ν ) ) B T + C

30 Selection of S ν : Nonsmooth Schur Newton Methods gradient-related descent method: λ ν+1 = λ ν ρ ν S 1 ν H(λ ν ) H(λ ν ) = Bu ν+1 + Cλ ν + g, u ν+1 = F 1 (f B T λ ν ) smooth nonlinearity: Newton s method: S ν = H (λ ν ) = B ( (F 1 ) (f B T λ ν ) ) B T + C nonsmooth nonlinearity: nonsmooth Newton: S ν = H (λ ν ) = B ( δ(f 1 )(f B T λ ν ) ) B T + C

31 Selection of S ν : Nonsmooth Schur Newton Methods gradient-related descent method: λ ν+1 = λ ν ρ ν S 1 ν H(λ ν ) H(λ ν ) = Bu ν+1 + Cλ ν + g, u ν+1 = F 1 (f B T λ ν ) smooth nonlinearity: Newton s method: S ν = H (λ ν ) = B ( (F 1 ) (f B T λ ν ) ) B T + C nonsmooth nonlinearity: nonsmooth Newton: S ν = H (λ ν ) = B ( δ(f 1 )(f B T λ ν )) ) B T + C

32 Selection of S ν : Nonsmooth Schur Newton Methods gradient-related descent method: λ ν+1 = λ ν ρ ν S 1 ν H(λ ν ) H(λ ν ) = Bu ν+1 + Cλ ν + g, u ν+1 = F 1 (f B T λ ν ) smooth nonlinearity: Newton s method: S ν = H (λ ν ) = B ( (F 1 ) (f B T λ ν ) ) B T + C nonsmooth nonlinearity: nonsmooth Newton: S ν = H (λ ν ) = B ( δ(f 1 )(F(u ν+1 )) ) B T + C

33 Selection of δ(f 1 )(F(u ν+1 )): Truncated Derivatives ( ) + postulating the chain rule: δ(f 1 )(F(u ν+1 )) := ˆF (u ν+1 ) Φ piecewise smooth: (logarithmic potential) F = A+ Φ: δ(f 1 )(F(u ν+1 )) = ( A + Φ (u ν+1 )) + truncation at large Φ uniformly bounded Φ with finitely many jumps truncation at jumps characteristic function Φ = χ [ 1,1] : (box constraints) F = A + χ [ 1,1] : δ(f 1 )(F(u ν+1 )) = (Â(u ν+1 )) + truncation at active nodes

34 Selection of δ(f 1 )(F(u ν+1 )): Truncated Derivatives ( ) + postulating the chain rule: δ(f 1 )(F(u ν+1 )) := ˆF (u ν+1 ) Φ piecewise smooth: (logarithmic potential) F = A+Φ : δ(f 1 )(F(u ν+1 )) = ( A + Φ (u ν+1 ) ) 1 truncation at large Φ uniformly bounded Φ with finitely many jumps truncation at jumps characteristic function Φ = χ [ 1,1] : (box constraints) F = A + χ [ 1,1] : δ(f 1 )(F(u ν+1 )) = (Â(u ν+1 )) + truncation at active nodes

35 Selection of δ(f 1 )(F(u ν+1 )): Truncated Derivatives ( ) + postulating the chain rule: δ(f 1 )(F(u ν+1 )) := ˆF (u ν+1 ) Φ piecewise smooth: (logarithmic potential) F = A+ Φ: δ(f 1 )(F(u ν+1 )) = ( A + Φ (u ν+1 )) + truncation at large Φ uniformly bounded Φ with finitely many jumps truncation at jumps characteristic function Φ = χ [ 1,1] : (box constraints) F = A + χ [ 1,1] : δ(f 1 )(F(u ν+1 )) = (Â(u ν+1 )) + truncation at active nodes

36 Selection of δ(f 1 )(F(u ν+1 )): Truncated Derivatives ( ) + postulating the chain rule: δ(f 1 )(F(u ν+1 )) := ˆF (u ν+1 ) Φ piecewise smooth: (logarithmic potential) F = A+ Φ: δ(f 1 )(F(u ν+1 )) = ( A + Φ (u ν+1 )) + truncation at large Φ uniformly bounded Φ with finitely many jumps truncation at jumps characteristic function Φ = χ [ 1,1] : (box constraints) F = A + χ [ 1,1] : δ(f 1 )(F(u ν+1 )) = (Â(u ν+1 )) + truncation at active nodes

37 Selection of δ(f 1 )(F(u ν+1 )): Truncated Derivatives ( ) + postulating the chain rule: δ(f 1 )(F(u ν+1 )) := ˆF (u ν+1 ) Φ piecewise smooth: (logarithmic potential) F = A+ Φ: δ(f 1 )(F(u ν+1 )) = ( A + Φ (u ν+1 )) + truncation at large Φ uniformly bounded Φ with finitely many jumps truncation at jumps characteristic function Φ = χ [ 1,1] : (box constraints) F = A + χ [ 1,1] : δ(f 1 )(F(u ν+1 )) = (Â(u ν+1 )) + truncation at active nodes

38 Convergence Results for Nonsmooth Schur Newton Methods Theorem: (Gräser & Kh. 09, Gräser 09) global convergence (exact and inexact version) independent of any parameters piecewise smooth and uniformly bounded Φ : S ν = B ( A + Φ (u ν+1 ) ) + B T + C H(λ ν ) (B-derivative) for rank B = n locally quadratic convergence for non-degenerate problems inexact version: asymptotic linear convergence for C s.p.d. characteristic function Φ = χ [ 1,1] finite termination

39 Convergence Results for Nonsmooth Schur Newton Methods Theorem: (Gräser & Kh. 09, Gräser 09) global convergence (exact and inexact version) independent of any parameters piecewise smooth and uniformly bounded Φ : S ν = B ( A + Φ (u ν+1 ) ) + B T + C H(λ ν ) (B-derivative) for rank B = n locally quadratic convergence for non-degenerate problems inexact version: asymptotic linear convergence for C s.p.d. characteristic function Φ = χ [ 1,1] finite termination

40 Convergence Results for Nonsmooth Schur Newton Methods Theorem: (Gräser & Kh. 09, Gräser 09) global convergence (exact and inexact version) independent of any parameters piecewise smooth and uniformly bounded Φ : S ν = B ( A + Φ (u ν+1 ) ) + B T + C H(λ ν ) (B-derivative) for rank B = n locally quadratic convergence for non-degenerate problems inexact version: asymptotic linear convergence for C s.p.d. characteristic function Φ = χ [ 1,1] finite termination

41 nonsmooth Schur Newton iteration: Interpretations u ν+1 = F 1 (f B T λ ν ), λ ν+1 = λ ν ρ ν S 1 ν H(λ ν ), H(λ ν ) = Bu ν+1 B T + Cλ ν + g S ν = B ( δ(f 1 )(F(u ν+1 )) ) B T + C preconditioned Uzawa iteration: evaluation of F 1 : semilinear elliptic problem (obstacle potential: active set) nonlinear Gauß-Seidel, multigrid (Kh. 94,02,...), damped Jacobi ( Blank et al.), (inexact) evaluation of Sν 1 : linear saddle point problem multigrid (..., Vanka 86, Zulehner & Schöberl 03,...), exact extension and globalization of primal-dual active set strategies: (Gräser 07) L 2 -control: preconditioned Uzawa primal-dual active set (Hintermüller, Ito, Kunisch 03)

42 nonsmooth Schur Newton iteration: Interpretations u ν+1 = F 1 (f B T λ ν ), λ ν+1 = λ ν ρ ν S 1 ν H(λ ν ), H(λ ν ) = Bu ν+1 B T + Cλ ν + g S ν = B ( δ(f 1 )(F(u ν+1 )) ) B T + C preconditioned Uzawa iteration: evaluation of F 1 : semilinear elliptic problem (obstacle potential: active set) nonlinear Gauß-Seidel, multigrid (Kh. 94,02,...), damped Jacobi ( Blank et al.), (inexact) evaluation of Sν 1 : linear saddle point problem multigrid (..., Vanka 86, Zulehner & Schöberl 03,...), exact extension and globalization of primal-dual active set strategies: (Gräser 07) L 2 -control: preconditioned Uzawa primal-dual active set (Hintermüller, Ito, Kunisch 03)

43 nonsmooth Schur Newton iteration: Interpretations u ν+1 = F 1 (f B T λ ν ), λ ν+1 = λ ν ρ ν S 1 ν H(λ ν ), H(λ ν ) = Bu ν+1 B T + Cλ ν + g S ν = B ( δ(f 1 )(F(u ν+1 )) ) B T + C preconditioned Uzawa iteration: evaluation of F 1 : semilinear elliptic problem (obstacle potential: active set) nonlinear Gauß-Seidel, multigrid (Kh. 94,02,...), damped Jacobi ( Blank et al.), (inexact) evaluation of Sν 1 : linear saddle point problem multigrid (..., Vanka 86, Zulehner & Schöberl 03,...), exact extension and globalization of primal-dual active set strategies: (Gräser 07) nonsmooth Schur-Newton for L 2 -control primal-dual active set (Hintermüller, Ito, Kunisch 03)

44 Numerical Properties convergence properties: superlinear convergence no damping and fast convergence for good initial iterates nested iteration provides good initial iterates nested iteration provides mesh-independent convergence Cahn-Hilliard: obstacle potential: linear saddle-point problem dominates complexity logarithmic potential: robust convergence for varying temperature T [0,T c ]

45 Numerical Properties convergence properties: superlinear convergence no damping and fast convergence for good initial iterates nested iteration provides good initial iterates nested iteration provides mesh-independent convergence Cahn-Hilliard: obstacle potential: linear saddle-point problem dominates complexity logarithmic potential: robust convergence for varying temperature T [0,T c ]

46 Numerical Properties convergence properties: superlinear convergence no damping and fast convergence for good initial iterates nested iteration provides good initial iterates nested iteration provides mesh-independent convergence Cahn-Hilliard: obstacle potential: linear saddle-point problem dominates complexity logarithmic potential: robust convergence for varying temperature T [0,T c ]

47 Numerical Properties convergence properties: superlinear convergence no damping and fast convergence for good initial iterates nested iteration provides good initial iterates mesh-independent convergence by nested iteration Cahn-Hilliard: obstacle potential: linear saddle-point problem dominates complexity logarithmic potential: robust convergence for varying temperature T [0,T c ]

48 Numerical Properties convergence properties: superlinear convergence no damping and fast convergence for good initial iterates nested iteration provides good initial iterates mesh-independent convergence by nested iteration Cahn-Hilliard: obstacle potential: linear saddle-point problem dominates complexity logarithmic potential: robust convergence for varying temperature T [0,T c ]

49 Numerical Properties convergence properties: superlinear convergence no damping and fast convergence for good initial iterates nested iteration provides good initial iterates mesh-independent convergence by nested iteration Cahn-Hilliard: obstacle potential: linear saddle-point problem dominates complexity logarithmic potential: robust convergence for varying temperature T [0,T c ]

50 Anisotropic Cahn-Hilliard Equation with Logarithmic Potential interfacial energy: u u g 2 ( u), g(y) = d i=0 y 2 i + δ y 2 parameters: γ = 10 3, δ = 10 3, temperature T = 10 3, T c = 1 discretization parameters: τ = 10 3, h min = 2 7 γ 1/2 /4 t = 1τ t = 10τ t = 100τ t = 250τ

51 temperature: T = 10 1, 10 3, Iteration Histories 1 work unit: CPU time for 1 multigrid step for u ν+1 = F 1 (f B T λ ν ) error T=1e 01 T=1e 03 T=1e multigrid steps bad initial iterate superlinear convergence

52 Iteration Histories temperature: T = 10 1, 10 3, work unit: CPU time for 1 multigrid step for u ν+1 = F 1 (f B T λ ν ) nested iteration: T=1e 01 T=1e 03 T=1e 10 error error T=1e 01 T=1e 03 T=1e multigrid steps bad initial iterate multigrid steps good initial iterate robust superlinear convergence, error reduction / work unit 0.75 (nested iteration)

53 Iteration Histories temperature: T = 10 1, 10 3, work unit: CPU time for 1 multigrid step for u ν+1 = F 1 (f B T λ ν ) nested iteration: T=1e 01 T=1e 03 T=1e 10 error error T=1e 01 T=1e 03 T=1e multigrid steps bad initial iterate multigrid steps good initial iterate robust superlinear convergence, error reduction/work unit 0.75 (nested iteration)

54 Asymptotic Mesh-Dependence of Nonsmooth Schur Newton number of iteration steps to roundoff error over dofs: Newton damped Newton iteration steps degrees of freedom good initial iterate: nested iteration

55 Small Scale Computations for an AgCu-Alloy realistic material data (Böhme et al 08), small length scale L = 0.1µm γ discretization: mesh size h = γ 1/2 /10, time step τ = 10 4 γ initial condition t = 0.25s t = 2.5s t = 12.5s equilibrium concentrations and convergence rates:

56 Large Scale Computations for an AgCu-Alloy experimental length scale: L = 10µm γ discretization: mesh size h min = γ 1/2 /10, time step τ = 10 4 experimental data initial condition t = 50 min (12 time steps) Schur-Newton solver: fast, mesh independent convergence ( unknowns) severe complexity issues: improved implementation: code cleaning, linear solver, parallelization,... averaged quantities: coarsening rates

57 Large Scale Computations for an AgCu-Alloy experimental length scale: L = 10µm γ discretization: mesh size h min = γ 1/2 /10, time step τ = 10 4 experimental data initial condition t = 50 min (12 time steps) Schur-Newton solver: fast, mesh independent convergence ( unknowns) severe complexity issues: improved implementation: code cleaning, linear solver, parallelization,... averaged quantities: coarsening rates

58 Conclusion Nonsmooth Schur Newton methods: preconditioned nonlinear Uzawa iterations globally convergent, no additional (regularization) parameters numerical properties: mesh independence and robustness straightforward generalization to the vector-valued case Hierarchical a posteriori error erstimates: numerical properties: mesh independence and robustness Phase separation in alloys: satisfying small-scale computations towards comparisons with experiments...

59 Conclusion Nonsmooth Schur Newton methods: preconditioned nonlinear Uzawa iterations globally convergent, no additional (regularization) parameters numerical properties: mesh independence and robustness straightforward generalization to the vector-valued case Hierarchical a posteriori error erstimates: numerical properties: mesh independence and robustness Phase separation in alloys: satisfying small-scale computations towards comparisons with experiments...

Constrained Minimization and Multigrid

Constrained Minimization and Multigrid Constrained Minimization and Multigrid C. Gräser (FU Berlin), R. Kornhuber (FU Berlin), and O. Sander (FU Berlin) Workshop on PDE Constrained Optimization Hamburg, March 27-29, 2008 Matheon Outline Successive

More information

On Multigrid for Phase Field

On Multigrid for Phase Field On Multigrid for Phase Field Carsten Gräser (FU Berlin), Ralf Kornhuber (FU Berlin), Rolf Krause (Uni Bonn), and Vanessa Styles (University of Sussex) Interphase 04 Rome, September, 13-16, 2004 Synopsis

More information

On preconditioned Uzawa-type iterations for a saddle point problem with inequality constraints

On preconditioned Uzawa-type iterations for a saddle point problem with inequality constraints On preconditioned Uzawa-type iterations for a saddle point problem with inequality constraints Carsten Gräser and Ralf Kornhuber FU Berlin, FB Mathematik und Informatik (http://www.math.fu-berlin.de/rd/we-02/numerik/)

More information

Numerical Approximation of Phase Field Models

Numerical Approximation of Phase Field Models Numerical Approximation of Phase Field Models Lecture 2: Allen Cahn and Cahn Hilliard Equations with Smooth Potentials Robert Nürnberg Department of Mathematics Imperial College London TUM Summer School

More information

Universität Regensburg Mathematik

Universität Regensburg Mathematik Universität Regensburg Mathematik On the stable discretization of strongly anisotropic phase field models with applications to crystal growth John W. Barrett, Harald Garcke and Robert Nürnberg Preprint

More information

arxiv: v1 [cs.na] 13 Jan 2016

arxiv: v1 [cs.na] 13 Jan 2016 An Optimal Block Diagonal Preconditioner for Heterogeneous Saddle Point Problems in Phase Separation Pawan Kumar 1 arxiv:1601.03230v1 [cs.na] 13 Jan 2016 1 Arnimallee 6 1 Department of Mathematics and

More information

Priority Programme The Combination of POD Model Reduction with Adaptive Finite Element Methods in the Context of Phase Field Models

Priority Programme The Combination of POD Model Reduction with Adaptive Finite Element Methods in the Context of Phase Field Models Priority Programme 1962 The Combination of POD Model Reduction with Adaptive Finite Element Methods in the Context of Phase Field Models Carmen Gräßle, Michael Hinze Non-smooth and Complementarity-based

More information

Numerical Solution of Elliptic Optimal Control Problems

Numerical Solution of Elliptic Optimal Control Problems Department of Mathematics, University of Houston Numerical Solution of Elliptic Optimal Control Problems Ronald H.W. Hoppe 1,2 1 Department of Mathematics, University of Houston 2 Institute of Mathematics,

More information

A sharp diffuse interface tracking method for approximating evolving interfaces

A sharp diffuse interface tracking method for approximating evolving interfaces A sharp diffuse interface tracking method for approximating evolving interfaces Vanessa Styles and Charlie Elliott University of Sussex Overview Introduction Phase field models Double well and double obstacle

More information

Affine covariant Semi-smooth Newton in function space

Affine covariant Semi-smooth Newton in function space Affine covariant Semi-smooth Newton in function space Anton Schiela March 14, 2018 These are lecture notes of my talks given for the Winter School Modern Methods in Nonsmooth Optimization that was held

More information

Modelling of interfaces and free boundaries

Modelling of interfaces and free boundaries University of Regensburg Regensburg, March 2009 Outline 1 Introduction 2 Obstacle problems 3 Stefan problem 4 Shape optimization Introduction What is a free boundary problem? Solve a partial differential

More information

Numerical approximation for optimal control problems via MPC and HJB. Giulia Fabrini

Numerical approximation for optimal control problems via MPC and HJB. Giulia Fabrini Numerical approximation for optimal control problems via MPC and HJB Giulia Fabrini Konstanz Women In Mathematics 15 May, 2018 G. Fabrini (University of Konstanz) Numerical approximation for OCP 1 / 33

More information

Nonlinear Optimization: What s important?

Nonlinear Optimization: What s important? Nonlinear Optimization: What s important? Julian Hall 10th May 2012 Convexity: convex problems A local minimizer is a global minimizer A solution of f (x) = 0 (stationary point) is a minimizer A global

More information

Part IV: Numerical schemes for the phase-filed model

Part IV: Numerical schemes for the phase-filed model Part IV: Numerical schemes for the phase-filed model Jie Shen Department of Mathematics Purdue University IMS, Singapore July 29-3, 29 The complete set of governing equations Find u, p, (φ, ξ) such that

More information

Numerical Optimization of Partial Differential Equations

Numerical Optimization of Partial Differential Equations Numerical Optimization of Partial Differential Equations Part I: basic optimization concepts in R n Bartosz Protas Department of Mathematics & Statistics McMaster University, Hamilton, Ontario, Canada

More information

Solving Distributed Optimal Control Problems for the Unsteady Burgers Equation in COMSOL Multiphysics

Solving Distributed Optimal Control Problems for the Unsteady Burgers Equation in COMSOL Multiphysics Excerpt from the Proceedings of the COMSOL Conference 2009 Milan Solving Distributed Optimal Control Problems for the Unsteady Burgers Equation in COMSOL Multiphysics Fikriye Yılmaz 1, Bülent Karasözen

More information

Universität Regensburg Mathematik

Universität Regensburg Mathematik Universität Regensburg Mathematik Optimal control of Allen-Cahn systems Luise Blank, M. Hassan Farshbaf-Shaker, Claudia Hecht Josef Michl and Christoph Rupprecht Preprint Nr. 21/2013 Optimal control of

More information

An optimal control problem for a parabolic PDE with control constraints

An optimal control problem for a parabolic PDE with control constraints An optimal control problem for a parabolic PDE with control constraints PhD Summer School on Reduced Basis Methods, Ulm Martin Gubisch University of Konstanz October 7 Martin Gubisch (University of Konstanz)

More information

Key words. preconditioned conjugate gradient method, saddle point problems, optimal control of PDEs, control and state constraints, multigrid method

Key words. preconditioned conjugate gradient method, saddle point problems, optimal control of PDEs, control and state constraints, multigrid method PRECONDITIONED CONJUGATE GRADIENT METHOD FOR OPTIMAL CONTROL PROBLEMS WITH CONTROL AND STATE CONSTRAINTS ROLAND HERZOG AND EKKEHARD SACHS Abstract. Optimality systems and their linearizations arising in

More information

A Line search Multigrid Method for Large-Scale Nonlinear Optimization

A Line search Multigrid Method for Large-Scale Nonlinear Optimization A Line search Multigrid Method for Large-Scale Nonlinear Optimization Zaiwen Wen Donald Goldfarb Department of Industrial Engineering and Operations Research Columbia University 2008 Siam Conference on

More information

ITERATIVE METHODS FOR NONLINEAR ELLIPTIC EQUATIONS

ITERATIVE METHODS FOR NONLINEAR ELLIPTIC EQUATIONS ITERATIVE METHODS FOR NONLINEAR ELLIPTIC EQUATIONS LONG CHEN In this chapter we discuss iterative methods for solving the finite element discretization of semi-linear elliptic equations of the form: find

More information

Title of your thesis here

Title of your thesis here Title of your thesis here Your name here A Thesis presented for the degree of Doctor of Philosophy Your Research Group Here Department of Mathematical Sciences University of Durham England Month and Year

More information

Mixed Finite Element Methods. Douglas N. Arnold, University of Minnesota The 41st Woudschoten Conference 5 October 2016

Mixed Finite Element Methods. Douglas N. Arnold, University of Minnesota The 41st Woudschoten Conference 5 October 2016 Mixed Finite Element Methods Douglas N. Arnold, University of Minnesota The 41st Woudschoten Conference 5 October 2016 Linear elasticity Given the load f : Ω R n, find the displacement u : Ω R n and the

More information

Multigrid Methods for Elliptic Obstacle Problems on 2D Bisection Grids

Multigrid Methods for Elliptic Obstacle Problems on 2D Bisection Grids Multigrid Methods for Elliptic Obstacle Problems on 2D Bisection Grids Long Chen 1, Ricardo H. Nochetto 2, and Chen-Song Zhang 3 1 Department of Mathematics, University of California at Irvine. chenlong@math.uci.edu

More information

Fast Iterative Solution of Saddle Point Problems

Fast Iterative Solution of Saddle Point Problems Michele Benzi Department of Mathematics and Computer Science Emory University Atlanta, GA Acknowledgments NSF (Computational Mathematics) Maxim Olshanskii (Mech-Math, Moscow State U.) Zhen Wang (PhD student,

More information

1. Introduction. In this work we consider the solution of finite-dimensional constrained optimization problems of the form

1. Introduction. In this work we consider the solution of finite-dimensional constrained optimization problems of the form MULTILEVEL ALGORITHMS FOR LARGE-SCALE INTERIOR POINT METHODS MICHELE BENZI, ELDAD HABER, AND LAUREN TARALLI Abstract. We develop and compare multilevel algorithms for solving constrained nonlinear variational

More information

A Recursive Trust-Region Method for Non-Convex Constrained Minimization

A Recursive Trust-Region Method for Non-Convex Constrained Minimization A Recursive Trust-Region Method for Non-Convex Constrained Minimization Christian Groß 1 and Rolf Krause 1 Institute for Numerical Simulation, University of Bonn. {gross,krause}@ins.uni-bonn.de 1 Introduction

More information

An Inexact Newton Method for Nonlinear Constrained Optimization

An Inexact Newton Method for Nonlinear Constrained Optimization An Inexact Newton Method for Nonlinear Constrained Optimization Frank E. Curtis Numerical Analysis Seminar, January 23, 2009 Outline Motivation and background Algorithm development and theoretical results

More information

On Nonlinear Dirichlet Neumann Algorithms for Jumping Nonlinearities

On Nonlinear Dirichlet Neumann Algorithms for Jumping Nonlinearities On Nonlinear Dirichlet Neumann Algorithms for Jumping Nonlinearities Heiko Berninger, Ralf Kornhuber, and Oliver Sander FU Berlin, FB Mathematik und Informatik (http://www.math.fu-berlin.de/rd/we-02/numerik/)

More information

Multigrid Based Optimal Shape and Topology Design in Magnetostatics

Multigrid Based Optimal Shape and Topology Design in Magnetostatics Multigrid Based Optimal Shape and Topology Design in Magnetostatics Dalibor Lukáš 1 Department of Applied Mathematics, VŠB Technical University of Ostrava, 17. listopadu 15, 708 33 Ostrava Poruba, Czech

More information

Inexact Newton Methods and Nonlinear Constrained Optimization

Inexact Newton Methods and Nonlinear Constrained Optimization Inexact Newton Methods and Nonlinear Constrained Optimization Frank E. Curtis EPSRC Symposium Capstone Conference Warwick Mathematics Institute July 2, 2009 Outline PDE-Constrained Optimization Newton

More information

On the Parametric Finite Element Approximation of Evolving Hypersurfaces in R 3

On the Parametric Finite Element Approximation of Evolving Hypersurfaces in R 3 On the Parametric Finite Element Approximation of Evolving Hypersurfaces in R 3 John W. Barrett Harald Garcke Robert Nürnberg Abstract We present a variational formulation of motion by minus the Laplacian

More information

Kasetsart University Workshop. Multigrid methods: An introduction

Kasetsart University Workshop. Multigrid methods: An introduction Kasetsart University Workshop Multigrid methods: An introduction Dr. Anand Pardhanani Mathematics Department Earlham College Richmond, Indiana USA pardhan@earlham.edu A copy of these slides is available

More information

Constrained Optimization

Constrained Optimization 1 / 22 Constrained Optimization ME598/494 Lecture Max Yi Ren Department of Mechanical Engineering, Arizona State University March 30, 2015 2 / 22 1. Equality constraints only 1.1 Reduced gradient 1.2 Lagrange

More information

Multigrid and Iterative Strategies for Optimal Control Problems

Multigrid and Iterative Strategies for Optimal Control Problems Multigrid and Iterative Strategies for Optimal Control Problems John Pearson 1, Stefan Takacs 1 1 Mathematical Institute, 24 29 St. Giles, Oxford, OX1 3LB e-mail: john.pearson@worc.ox.ac.uk, takacs@maths.ox.ac.uk

More information

Evolution Under Constraints: Fate of Methane in Subsurface

Evolution Under Constraints: Fate of Methane in Subsurface Evolution Under Constraints: Fate of Methane in Subsurface M. Peszyńska 1 Department of Mathematics, Oregon State University SIAM PDE. Nov.2011 1 Research supported by DOE 98089 Modeling, Analysis, and

More information

LECTURE 3: DISCRETE GRADIENT FLOWS

LECTURE 3: DISCRETE GRADIENT FLOWS LECTURE 3: DISCRETE GRADIENT FLOWS Department of Mathematics and Institute for Physical Science and Technology University of Maryland, USA Tutorial: Numerical Methods for FBPs Free Boundary Problems and

More information

Adaptive methods for control problems with finite-dimensional control space

Adaptive methods for control problems with finite-dimensional control space Adaptive methods for control problems with finite-dimensional control space Saheed Akindeinde and Daniel Wachsmuth Johann Radon Institute for Computational and Applied Mathematics (RICAM) Austrian Academy

More information

UNCONDITIONALLY ENERGY STABLE SCHEME FOR CAHN-MORRAL EQUATION 3

UNCONDITIONALLY ENERGY STABLE SCHEME FOR CAHN-MORRAL EQUATION 3 UNCONDITIONALLY ENERGY STABLE TIME STEPPING SCHEME FOR CAHN-MORRAL EQUATION: APPLICATION TO MULTI-COMPONENT SPINODAL DECOMPOSITION AND OPTIMAL SPACE TILING R. TAVAKOLI Abstract. An unconditionally energy

More information

FETI domain decomposition method to solution of contact problems with large displacements

FETI domain decomposition method to solution of contact problems with large displacements FETI domain decomposition method to solution of contact problems with large displacements Vít Vondrák 1, Zdeněk Dostál 1, Jiří Dobiáš 2, and Svatopluk Pták 2 1 Dept. of Appl. Math., Technical University

More information

A Posteriori Estimates for Cost Functionals of Optimal Control Problems

A Posteriori Estimates for Cost Functionals of Optimal Control Problems A Posteriori Estimates for Cost Functionals of Optimal Control Problems Alexandra Gaevskaya, Ronald H.W. Hoppe,2 and Sergey Repin 3 Institute of Mathematics, Universität Augsburg, D-8659 Augsburg, Germany

More information

Inexact Algorithms in Function Space and Adaptivity

Inexact Algorithms in Function Space and Adaptivity Inexact Algorithms in Function Space and Adaptivity Anton Schiela adaptive discretization nonlinear solver Zuse Institute Berlin linear solver Matheon project A1 ZIB: P. Deuflhard, M. Weiser TUB: F. Tröltzsch,

More information

Newton s Method. Ryan Tibshirani Convex Optimization /36-725

Newton s Method. Ryan Tibshirani Convex Optimization /36-725 Newton s Method Ryan Tibshirani Convex Optimization 10-725/36-725 1 Last time: dual correspondences Given a function f : R n R, we define its conjugate f : R n R, Properties and examples: f (y) = max x

More information

Non-Newtonian Fluids and Finite Elements

Non-Newtonian Fluids and Finite Elements Non-Newtonian Fluids and Finite Elements Janice Giudice Oxford University Computing Laboratory Keble College Talk Outline Motivating Industrial Process Multiple Extrusion of Pastes Governing Equations

More information

1. Introduction. In this work, we consider the solution of finite-dimensional constrained optimization problems of the form

1. Introduction. In this work, we consider the solution of finite-dimensional constrained optimization problems of the form SIAM J. SCI. COMPUT. Vol. 31, No. 6, pp. 4152 4175 c 2009 Society for Industrial and Applied Mathematics MULTILEVEL ALGORITHMS FOR LARGE-SCALE INTERIOR POINT METHODS MICHELE BENZI, ELDAD HABER, AND LAUREN

More information

Iterative Rigid Multibody Dynamics A Comparison of Computational Methods

Iterative Rigid Multibody Dynamics A Comparison of Computational Methods Iterative Rigid Multibody Dynamics A Comparison of Computational Methods Tobias Preclik, Klaus Iglberger, Ulrich Rüde University Erlangen-Nuremberg Chair for System Simulation (LSS) July 1st 2009 T. Preclik

More information

Adaptive discretization and first-order methods for nonsmooth inverse problems for PDEs

Adaptive discretization and first-order methods for nonsmooth inverse problems for PDEs Adaptive discretization and first-order methods for nonsmooth inverse problems for PDEs Christian Clason Faculty of Mathematics, Universität Duisburg-Essen joint work with Barbara Kaltenbacher, Tuomo Valkonen,

More information

RESEARCH ARTICLE. A strategy of finding an initial active set for inequality constrained quadratic programming problems

RESEARCH ARTICLE. A strategy of finding an initial active set for inequality constrained quadratic programming problems Optimization Methods and Software Vol. 00, No. 00, July 200, 8 RESEARCH ARTICLE A strategy of finding an initial active set for inequality constrained quadratic programming problems Jungho Lee Computer

More information

Basic Principles of Weak Galerkin Finite Element Methods for PDEs

Basic Principles of Weak Galerkin Finite Element Methods for PDEs Basic Principles of Weak Galerkin Finite Element Methods for PDEs Junping Wang Computational Mathematics Division of Mathematical Sciences National Science Foundation Arlington, VA 22230 Polytopal Element

More information

An introduction to PDE-constrained optimization

An introduction to PDE-constrained optimization An introduction to PDE-constrained optimization Wolfgang Bangerth Department of Mathematics Texas A&M University 1 Overview Why partial differential equations? Why optimization? Examples of PDE optimization

More information

A multigrid method for large scale inverse problems

A multigrid method for large scale inverse problems A multigrid method for large scale inverse problems Eldad Haber Dept. of Computer Science, Dept. of Earth and Ocean Science University of British Columbia haber@cs.ubc.ca July 4, 2003 E.Haber: Multigrid

More information

An Inexact Newton Method for Optimization

An Inexact Newton Method for Optimization New York University Brown Applied Mathematics Seminar, February 10, 2009 Brief biography New York State College of William and Mary (B.S.) Northwestern University (M.S. & Ph.D.) Courant Institute (Postdoc)

More information

Goal-oriented error control of the iterative solution of finite element equations

Goal-oriented error control of the iterative solution of finite element equations J. Numer. Math., Vol. 17, No. 2, pp. 143 172 (2009) DOI 10.1515/ JNUM.2009.009 c de Gruyter 2009 Goal-oriented error control of the iterative solution of finite element equations D. MEIDNER, R. RANNACHER,

More information

An Inexact Sequential Quadratic Optimization Method for Nonlinear Optimization

An Inexact Sequential Quadratic Optimization Method for Nonlinear Optimization An Inexact Sequential Quadratic Optimization Method for Nonlinear Optimization Frank E. Curtis, Lehigh University involving joint work with Travis Johnson, Northwestern University Daniel P. Robinson, Johns

More information

Numerical Methods for Large-Scale Nonlinear Systems

Numerical Methods for Large-Scale Nonlinear Systems Numerical Methods for Large-Scale Nonlinear Systems Handouts by Ronald H.W. Hoppe following the monograph P. Deuflhard Newton Methods for Nonlinear Problems Springer, Berlin-Heidelberg-New York, 2004 Num.

More information

Numerical Optimization Professor Horst Cerjak, Horst Bischof, Thomas Pock Mat Vis-Gra SS09

Numerical Optimization Professor Horst Cerjak, Horst Bischof, Thomas Pock Mat Vis-Gra SS09 Numerical Optimization 1 Working Horse in Computer Vision Variational Methods Shape Analysis Machine Learning Markov Random Fields Geometry Common denominator: optimization problems 2 Overview of Methods

More information

Structural and Multidisciplinary Optimization. P. Duysinx and P. Tossings

Structural and Multidisciplinary Optimization. P. Duysinx and P. Tossings Structural and Multidisciplinary Optimization P. Duysinx and P. Tossings 2018-2019 CONTACTS Pierre Duysinx Institut de Mécanique et du Génie Civil (B52/3) Phone number: 04/366.91.94 Email: P.Duysinx@uliege.be

More information

Fast solvers for steady incompressible flow

Fast solvers for steady incompressible flow ICFD 25 p.1/21 Fast solvers for steady incompressible flow Andy Wathen Oxford University wathen@comlab.ox.ac.uk http://web.comlab.ox.ac.uk/~wathen/ Joint work with: Howard Elman (University of Maryland,

More information

Newton s Method and Efficient, Robust Variants

Newton s Method and Efficient, Robust Variants Newton s Method and Efficient, Robust Variants Philipp Birken University of Kassel (SFB/TRR 30) Soon: University of Lund October 7th 2013 Efficient solution of large systems of non-linear PDEs in science

More information

An Introduction to Algebraic Multigrid (AMG) Algorithms Derrick Cerwinsky and Craig C. Douglas 1/84

An Introduction to Algebraic Multigrid (AMG) Algorithms Derrick Cerwinsky and Craig C. Douglas 1/84 An Introduction to Algebraic Multigrid (AMG) Algorithms Derrick Cerwinsky and Craig C. Douglas 1/84 Introduction Almost all numerical methods for solving PDEs will at some point be reduced to solving A

More information

Goal-oriented error control of the iterative solution of finite element equations

Goal-oriented error control of the iterative solution of finite element equations J. Numer. Math., Vol. 0, No. 0, pp. 1 31 (2009) DOI 10.1515/ JNUM.2009.000 c de Gruyter 2009 Prepared using jnm.sty [Version: 20.02.2007 v1.3] Goal-oriented error control of the iterative solution of finite

More information

Well-posedness and asymptotic analysis for a Penrose-Fife type phase-field system

Well-posedness and asymptotic analysis for a Penrose-Fife type phase-field system 0-0 Well-posedness and asymptotic analysis for a Penrose-Fife type phase-field system Buona positura e analisi asintotica per un sistema di phase field di tipo Penrose-Fife Salò, 3-5 Luglio 2003 Riccarda

More information

Introduction into Implementation of Optimization problems with PDEs: Sheet 3

Introduction into Implementation of Optimization problems with PDEs: Sheet 3 Technische Universität München Center for Mathematical Sciences, M17 Lucas Bonifacius, Korbinian Singhammer www-m17.ma.tum.de/lehrstuhl/lehresose16labcourseoptpde Summer 216 Introduction into Implementation

More information

Newton s Method. Javier Peña Convex Optimization /36-725

Newton s Method. Javier Peña Convex Optimization /36-725 Newton s Method Javier Peña Convex Optimization 10-725/36-725 1 Last time: dual correspondences Given a function f : R n R, we define its conjugate f : R n R, f ( (y) = max y T x f(x) ) x Properties and

More information

PROBLEM OF CRACK UNDER QUASIBRITTLE FRACTURE V.A. KOVTUNENKO

PROBLEM OF CRACK UNDER QUASIBRITTLE FRACTURE V.A. KOVTUNENKO PROBLEM OF CRACK UNDER QUASIBRITTLE FRACTURE V.A. KOVTUNENKO Overview: 1. Motivation 1.1. Evolutionary problem of crack propagation 1.2. Stationary problem of crack equilibrium 1.3. Interaction (contact+cohesion)

More information

Suboptimal feedback control of PDEs by solving Hamilton-Jacobi Bellman equations on sparse grids

Suboptimal feedback control of PDEs by solving Hamilton-Jacobi Bellman equations on sparse grids Suboptimal feedback control of PDEs by solving Hamilton-Jacobi Bellman equations on sparse grids Jochen Garcke joint work with Axel Kröner, INRIA Saclay and CMAP, Ecole Polytechnique Ilja Kalmykov, Universität

More information

Convex Optimization on Large-Scale Domains Given by Linear Minimization Oracles

Convex Optimization on Large-Scale Domains Given by Linear Minimization Oracles Convex Optimization on Large-Scale Domains Given by Linear Minimization Oracles Arkadi Nemirovski H. Milton Stewart School of Industrial and Systems Engineering Georgia Institute of Technology Joint research

More information

K. Krumbiegel I. Neitzel A. Rösch

K. Krumbiegel I. Neitzel A. Rösch SUFFICIENT OPTIMALITY CONDITIONS FOR THE MOREAU-YOSIDA-TYPE REGULARIZATION CONCEPT APPLIED TO SEMILINEAR ELLIPTIC OPTIMAL CONTROL PROBLEMS WITH POINTWISE STATE CONSTRAINTS K. Krumbiegel I. Neitzel A. Rösch

More information

A BIHARMONIC-MODIFIED FORWARD TIME STEPPING METHOD FOR FOURTH ORDER NONLINEAR DIFFUSION EQUATIONS. Andrea L. Bertozzi. Ning Ju.

A BIHARMONIC-MODIFIED FORWARD TIME STEPPING METHOD FOR FOURTH ORDER NONLINEAR DIFFUSION EQUATIONS. Andrea L. Bertozzi. Ning Ju. DISCRETE AND CONTINUOUS DYNAMICAL SYSTEMS Volume 29, Number 4, April 2011 doi:10.3934/dcds.2011.29.xx pp. 1 XX A BIHARMONIC-MODIFIED FORWARD TIME STEPPING METHOD FOR FOURTH ORDER NONLINEAR DIFFUSION EQUATIONS

More information

Numerical optimization

Numerical optimization Numerical optimization Lecture 4 Alexander & Michael Bronstein tosca.cs.technion.ac.il/book Numerical geometry of non-rigid shapes Stanford University, Winter 2009 2 Longest Slowest Shortest Minimal Maximal

More information

Constrained Optimization and Lagrangian Duality

Constrained Optimization and Lagrangian Duality CIS 520: Machine Learning Oct 02, 2017 Constrained Optimization and Lagrangian Duality Lecturer: Shivani Agarwal Disclaimer: These notes are designed to be a supplement to the lecture. They may or may

More information

A Sobolev trust-region method for numerical solution of the Ginz

A Sobolev trust-region method for numerical solution of the Ginz A Sobolev trust-region method for numerical solution of the Ginzburg-Landau equations Robert J. Renka Parimah Kazemi Department of Computer Science & Engineering University of North Texas June 6, 2012

More information

Nonlinear Multigrid and Domain Decomposition Methods

Nonlinear Multigrid and Domain Decomposition Methods Nonlinear Multigrid and Domain Decomposition Methods Rolf Krause Institute of Computational Science Universit`a della Svizzera italiana 1 Stepping Stone Symposium, Geneva, 2017 Non-linear problems Non-linear

More information

Path-following and augmented Lagrangian methods for contact problems in linear elasticity

Path-following and augmented Lagrangian methods for contact problems in linear elasticity Journal of Computational and Applied Mathematics 203 (2007) 533 547 www.elsevier.com/locate/cam Path-following and augmented Lagrangian methods for contact problems in linear elasticity Georg Stadler Center

More information

Priority Program 1253

Priority Program 1253 Deutsce Forscungsgemeinscaft Priority Program 53 Optimization wit Partial Differential Equations Luise Blank, Martin Butz and Harald Garcke Solving te Can-Hilliard Variational Inequality wit a Semi-Smoot

More information

Recent Developments of Alternating Direction Method of Multipliers with Multi-Block Variables

Recent Developments of Alternating Direction Method of Multipliers with Multi-Block Variables Recent Developments of Alternating Direction Method of Multipliers with Multi-Block Variables Department of Systems Engineering and Engineering Management The Chinese University of Hong Kong 2014 Workshop

More information

Econ 508-A FINITE DIMENSIONAL OPTIMIZATION - NECESSARY CONDITIONS. Carmen Astorne-Figari Washington University in St. Louis.

Econ 508-A FINITE DIMENSIONAL OPTIMIZATION - NECESSARY CONDITIONS. Carmen Astorne-Figari Washington University in St. Louis. Econ 508-A FINITE DIMENSIONAL OPTIMIZATION - NECESSARY CONDITIONS Carmen Astorne-Figari Washington University in St. Louis August 12, 2010 INTRODUCTION General form of an optimization problem: max x f

More information

Nonparametric density estimation for elliptic problems with random perturbations

Nonparametric density estimation for elliptic problems with random perturbations Nonparametric density estimation for elliptic problems with random perturbations, DqF Workshop, Stockholm, Sweden, 28--2 p. /2 Nonparametric density estimation for elliptic problems with random perturbations

More information

1.The anisotropic plate model

1.The anisotropic plate model Pré-Publicações do Departamento de Matemática Universidade de Coimbra Preprint Number 6 OPTIMAL CONTROL OF PIEZOELECTRIC ANISOTROPIC PLATES ISABEL NARRA FIGUEIREDO AND GEORG STADLER ABSTRACT: This paper

More information

Lectures Notes Algorithms and Preconditioning in PDE-Constrained Optimization. Prof. Dr. R. Herzog

Lectures Notes Algorithms and Preconditioning in PDE-Constrained Optimization. Prof. Dr. R. Herzog Lectures Notes Algorithms and Preconditioning in PDE-Constrained Optimization Prof. Dr. R. Herzog held in July 2010 at the Summer School on Analysis and Numerics of PDE Constrained Optimization, Lambrecht

More information

Optimization for Learning and Big Data

Optimization for Learning and Big Data Optimization for Learning and Big Data Donald Goldfarb Department of IEOR Columbia University Department of Mathematics Distinguished Lecture Series May 17-19, 2016. Lecture 1. First-Order Methods for

More information

Preconditioners for reduced saddle point systems arising in elliptic PDE-constrained optimization problems

Preconditioners for reduced saddle point systems arising in elliptic PDE-constrained optimization problems Zeng et al. Journal of Inequalities and Applications 205 205:355 DOI 0.86/s3660-05-0879-x RESEARCH Open Access Preconditioners for reduced saddle point systems arising in elliptic PDE-constrained optimization

More information

Chapter 6. Finite Element Method. Literature: (tiny selection from an enormous number of publications)

Chapter 6. Finite Element Method. Literature: (tiny selection from an enormous number of publications) Chapter 6 Finite Element Method Literature: (tiny selection from an enormous number of publications) K.J. Bathe, Finite Element procedures, 2nd edition, Pearson 2014 (1043 pages, comprehensive). Available

More information

Numerical optimization. Numerical optimization. Longest Shortest where Maximal Minimal. Fastest. Largest. Optimization problems

Numerical optimization. Numerical optimization. Longest Shortest where Maximal Minimal. Fastest. Largest. Optimization problems 1 Numerical optimization Alexander & Michael Bronstein, 2006-2009 Michael Bronstein, 2010 tosca.cs.technion.ac.il/book Numerical optimization 048921 Advanced topics in vision Processing and Analysis of

More information

Scientific Computing: An Introductory Survey

Scientific Computing: An Introductory Survey Scientific Computing: An Introductory Survey Chapter 11 Partial Differential Equations Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign Copyright c 2002.

More information

E5295/5B5749 Convex optimization with engineering applications. Lecture 8. Smooth convex unconstrained and equality-constrained minimization

E5295/5B5749 Convex optimization with engineering applications. Lecture 8. Smooth convex unconstrained and equality-constrained minimization E5295/5B5749 Convex optimization with engineering applications Lecture 8 Smooth convex unconstrained and equality-constrained minimization A. Forsgren, KTH 1 Lecture 8 Convex optimization 2006/2007 Unconstrained

More information

Chapter Two: Numerical Methods for Elliptic PDEs. 1 Finite Difference Methods for Elliptic PDEs

Chapter Two: Numerical Methods for Elliptic PDEs. 1 Finite Difference Methods for Elliptic PDEs Chapter Two: Numerical Methods for Elliptic PDEs Finite Difference Methods for Elliptic PDEs.. Finite difference scheme. We consider a simple example u := subject to Dirichlet boundary conditions ( ) u

More information

Spectral gradient projection method for solving nonlinear monotone equations

Spectral gradient projection method for solving nonlinear monotone equations Journal of Computational and Applied Mathematics 196 (2006) 478 484 www.elsevier.com/locate/cam Spectral gradient projection method for solving nonlinear monotone equations Li Zhang, Weijun Zhou Department

More information

A Differential Variational Inequality Approach for the Simulation of Heterogeneous Materials

A Differential Variational Inequality Approach for the Simulation of Heterogeneous Materials A Differential Variational Inequality Approach for the Simulation of Heterogeneous Materials Lei Wang 1, Jungho Lee 1, Mihai Anitescu 1, Anter El Azab 2, Lois Curfman McInnes 1, Todd Munson 1, Barry Smith

More information

Part 4: Active-set methods for linearly constrained optimization. Nick Gould (RAL)

Part 4: Active-set methods for linearly constrained optimization. Nick Gould (RAL) Part 4: Active-set methods for linearly constrained optimization Nick Gould RAL fx subject to Ax b Part C course on continuoue optimization LINEARLY CONSTRAINED MINIMIZATION fx subject to Ax { } b where

More information

Lecture 18: Optimization Programming

Lecture 18: Optimization Programming Fall, 2016 Outline Unconstrained Optimization 1 Unconstrained Optimization 2 Equality-constrained Optimization Inequality-constrained Optimization Mixture-constrained Optimization 3 Quadratic Programming

More information

Optimization Tutorial 1. Basic Gradient Descent

Optimization Tutorial 1. Basic Gradient Descent E0 270 Machine Learning Jan 16, 2015 Optimization Tutorial 1 Basic Gradient Descent Lecture by Harikrishna Narasimhan Note: This tutorial shall assume background in elementary calculus and linear algebra.

More information

Efficient smoothers for all-at-once multigrid methods for Poisson and Stokes control problems

Efficient smoothers for all-at-once multigrid methods for Poisson and Stokes control problems Efficient smoothers for all-at-once multigrid methods for Poisson and Stoes control problems Stefan Taacs stefan.taacs@numa.uni-linz.ac.at, WWW home page: http://www.numa.uni-linz.ac.at/~stefant/j3362/

More information

Numerical Modeling of Methane Hydrate Evolution

Numerical Modeling of Methane Hydrate Evolution Numerical Modeling of Methane Hydrate Evolution Nathan L. Gibson Joint work with F. P. Medina, M. Peszynska, R. E. Showalter Department of Mathematics SIAM Annual Meeting 2013 Friday, July 12 This work

More information

Appendix A Taylor Approximations and Definite Matrices

Appendix A Taylor Approximations and Definite Matrices Appendix A Taylor Approximations and Definite Matrices Taylor approximations provide an easy way to approximate a function as a polynomial, using the derivatives of the function. We know, from elementary

More information

1. Fast Iterative Solvers of SLE

1. Fast Iterative Solvers of SLE 1. Fast Iterative Solvers of crucial drawback of solvers discussed so far: they become slower if we discretize more accurate! now: look for possible remedies relaxation: explicit application of the multigrid

More information

Accelerated Block-Coordinate Relaxation for Regularized Optimization

Accelerated Block-Coordinate Relaxation for Regularized Optimization Accelerated Block-Coordinate Relaxation for Regularized Optimization Stephen J. Wright Computer Sciences University of Wisconsin, Madison October 09, 2012 Problem descriptions Consider where f is smooth

More information

Nonlinear Optimization for Optimal Control

Nonlinear Optimization for Optimal Control Nonlinear Optimization for Optimal Control Pieter Abbeel UC Berkeley EECS Many slides and figures adapted from Stephen Boyd [optional] Boyd and Vandenberghe, Convex Optimization, Chapters 9 11 [optional]

More information

POD for Parametric PDEs and for Optimality Systems

POD for Parametric PDEs and for Optimality Systems POD for Parametric PDEs and for Optimality Systems M. Kahlbacher, K. Kunisch, H. Müller and S. Volkwein Institute for Mathematics and Scientific Computing University of Graz, Austria DMV-Jahrestagung 26,

More information

Adaptive C1 Macroelements for Fourth Order and Divergence-Free Problems

Adaptive C1 Macroelements for Fourth Order and Divergence-Free Problems Adaptive C1 Macroelements for Fourth Order and Divergence-Free Problems Roy Stogner Computational Fluid Dynamics Lab Institute for Computational Engineering and Sciences University of Texas at Austin March

More information