On Clearing Coupled Day-Ahead Electricity Markets

Similar documents
A new primal-dual framework for European day-ahead electricity auctions

Motivation. Lecture 2 Topics from Optimization and Duality. network utility maximization (NUM) problem:

EUROPEAN EXPERIENCE: Large-scale cross-country forecasting with the help of Ensemble Forecasts

Optimization Basics for Electric Power Markets

SHORT-TERM hydropower planning under uncertainty is

A three-level MILP model for generation and transmission expansion planning

Review of Optimization Basics

Analysis of Adaptive Certainty-Equivalent Techniques for the Stochastic Unit Commitment Problem

Constrained Optimization and Lagrangian Duality

Tutorial 2: Modelling Transmission

Firms and returns to scale -1- Firms and returns to scale

Perfect and Imperfect Competition in Electricity Markets

MEDIUM-TERM HYDROPOWER SCHEDULING BY STOCHASTIC DUAL DYNAMIC INTEGER PROGRAMMING: A CASE STUDY

OPTIMIZATION. joint course with. Ottimizzazione Discreta and Complementi di R.O. Edoardo Amaldi. DEIB Politecnico di Milano

Firms and returns to scale -1- John Riley

Transmission capacity allocation in zonal electricity markets

Storing energy or Storing Consumption?

Stochastic Unit Commitment with Topology Control Recourse for Renewables Integration

Optimization Tutorial 1. Basic Gradient Descent

Dual Decomposition.

Lagrange Duality. Daniel P. Palomar. Hong Kong University of Science and Technology (HKUST)

CMSC 858F: Algorithmic Game Theory Fall 2010 Market Clearing with Applications

LINEAR PROGRAMMING APPROACH FOR THE TRANSITION FROM MARKET-GENERATED HOURLY ENERGY PROGRAMS TO FEASIBLE POWER GENERATION SCHEDULES

4. The Dual Simplex Method

Thermal Unit Commitment Problem

Introduction to Machine Learning Lecture 7. Mehryar Mohri Courant Institute and Google Research

Mathematical Foundations -1- Constrained Optimization. Constrained Optimization. An intuitive approach 2. First Order Conditions (FOC) 7

Mixed Integer Linear Programming Formulation for Chance Constrained Mathematical Programs with Equilibrium Constraints

The Tactical Berth Allocation Problem with Quay-Crane Assignment and Transshipment Quadratic Costs

ECG 740 GENERATION SCHEDULING (UNIT COMMITMENT)

An Integrated Method for Planning and Scheduling to Minimize Tardiness

A Unified Framework for Defining and Measuring Flexibility in Power System

2018 Annual Review of Availability Assessment Hours

Dynamic Network Utility Maximization

On the Method of Lagrange Multipliers

Convex Optimization Overview (cnt d)

Convex Optimization & Lagrange Duality

Tradable Permits for System-Optimized Networks. Anna Nagurney Isenberg School of Management University of Massachusetts Amherst, MA 01003

Duality. Geoff Gordon & Ryan Tibshirani Optimization /

Modelling wind power in unit commitment models

Multi-Area Stochastic Unit Commitment for High Wind Penetration in a Transmission Constrained Network

Practical Tips for Modelling Lot-Sizing and Scheduling Problems. Waldemar Kaczmarczyk

Appendix A Solving Systems of Nonlinear Equations

A Benders decomposition method for locating stations in a one-way electric car sharing system under demand uncertainty

Value of Forecasts in Unit Commitment Problems

Robust Scheduling with Logic-Based Benders Decomposition

Energy System Modelling Summer Semester 2018, Lecture 7

A Robust Optimization Approach to the Self-scheduling Problem Using Semidefinite Programming

Nonlinear Programming (Hillier, Lieberman Chapter 13) CHEM-E7155 Production Planning and Control

A Stochastic-Oriented NLP Relaxation for Integer Programming

Status of the CWE Flow Based Market Coupling Project

Using Integer Programming for Strategic Underground and Open Pit-to-Underground Scheduling

An RLT Approach for Solving Binary-Constrained Mixed Linear Complementarity Problems

Multi-Area Stochastic Unit Commitment for High Wind Penetration

Decision Models Lecture 5 1. Lecture 5. Foreign-Currency Trading Integer Programming Plant-location example Summary and Preparation for next class

Non-uniform pricing and thermal orders for the day-ahead Market

Overview of course. Introduction to Optimization, DIKU Monday 12 November David Pisinger

The System's Limitations Costs Determination Using the Duality Concept of Linear Programming

NONLINEAR. (Hillier & Lieberman Introduction to Operations Research, 8 th edition)

Linear and Integer Programming - ideas

SURVIVABLE ENERGY MARKETS

Bilevel Programming-Based Unit Commitment for Locational Marginal Price Computation

Short-Term Demand Forecasting Methodology for Scheduling and Dispatch

LINEAR PROGRAMMING II

Chapter 5. Transmission networks and electricity markets

Lecture 18: Optimization Programming

Economic Foundations of Symmetric Programming

Bringing Renewables to the Grid. John Dumas Director Wholesale Market Operations ERCOT

A new stochastic program to facilitate intermittent renewable generation

2.098/6.255/ Optimization Methods Practice True/False Questions

Column Generation for Extended Formulations

Integer Linear Programming (ILP)

Valid Inequalities for Optimal Transmission Switching

Accelerating the Convergence of Stochastic Unit Commitment Problems by Using Tight and Compact MIP Formulations

1 Review Session. 1.1 Lecture 2

The Dual Simplex Algorithm

Accelerating the Convergence of MIP-based Unit Commitment Problems

DM545 Linear and Integer Programming. Lecture 13 Branch and Bound. Marco Chiarandini

Congestion Management in a Smart Grid via Shadow Prices

Chapter 1: Linear Programming

ARE202A, Fall 2005 CONTENTS. 1. Graphical Overview of Optimization Theory (cont) Separating Hyperplanes 1

MVE165/MMG631 Linear and integer optimization with applications Lecture 8 Discrete optimization: theory and algorithms

ICS-E4030 Kernel Methods in Machine Learning

Numerical optimization

21. Set cover and TSP

Linear Programming Versus Convex Quadratic Programming for the Module Allocation Problem

EconS Oligopoly - Part 2

Solving a Class of Generalized Nash Equilibrium Problems

Coordinated Aggregation of Distributed Resources

Learning to Branch. Ellen Vitercik. Joint work with Nina Balcan, Travis Dick, and Tuomas Sandholm. Published in ICML 2018

Brief summary of linear programming and duality: Consider the linear program in standard form. (P ) min z = cx. x 0. (D) max yb. z = c B x B + c N x N

Predicting the Electricity Demand Response via Data-driven Inverse Optimization

PART 4 INTEGER PROGRAMMING

USAEE/IAEE. Diagnostic metrics for the adequate development of efficient-market baseload natural gas storage capacity.

Multi-Area Interchange Scheduling under Uncertainty

Integer Programming Part II

Dual decomposition approach for dynamic spatial equilibrium models

Distributed Optimization. Song Chong EE, KAIST

Software Tools: Congestion Management

Linear Programming: Simplex

Transcription:

On Clearing Coupled Day-Ahead Electricity Markets Johannes C. Müller Johannes.Mueller@math.uni-erlangen.de joint work with Alexander Martin Sebastian Pokutta Oct 2010 Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 1 / 22

1 Electricity Markets 2 Mixed Integer Quadratic Programm Maximization of the Economic Surplus Optimality Conditions Block Price Condition 3 Algorithms Fast Heuristic Exact Algorithm 4 Results Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 2 / 22

Day-Ahead Electricity Auctions Day-Ahead Auction 1. collect demand and supply orders for the following day 2. start auction maximize economic surplus accept/reject orders find clearing price 3. return execution schedule for the following day Infrastructure Market Areas Interconnectors Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 3 / 22

Day-Ahead Electricity Auctions Day-Ahead Auction 1. collect demand and supply orders for the following day 2. start auction maximize economic surplus accept/reject orders find clearing price 3. return execution schedule for the following day Infrastructure Market Areas Interconnectors Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 3 / 22

Basic elements of energy markets Bids / Orders are characterized by quantity (demand/supply, area, hour) price limit allow partial execution (yes/no) Order Types Hourly Bids Block Bids Flexible Bids Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 4 / 22

Basic elements of energy markets Bids / Orders are characterized by quantity (demand/supply, area, hour) price limit allow partial execution (yes/no) Order Types Hourly Bids Block Bids Flexible Bids Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 4 / 22

Hourly Bids Aggregation of hourly bid curves provides one hourly net curve per area and hour bid curve trading quantities depending on the price downward sloping curves Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 5 / 22

Block Bids 90 80 70 60 Quantity 50 40 30 20 10 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Time Slot Block executed Block not executed A block bid allows for trading electricity in several hours using only one price limit for all hours: (net gain) < 0 don t execute Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 6 / 22

Flexible Bids 60 50 40 Price, /MW 30 20 System Price Flex Bid Price Limit Supply Flex Bid can be executed 10 0 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 Time Slot Flexible bids allow for trading electricity without defining the delivery hour using a limit price to avoid a loss (gain in hour t) < 0 don t execute in hour t Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 7 / 22

Interconnectors Function of Interconnectors balance net demand of adjacent areas NO4 harmonize prices NO5 NO3 SE FI NO1 NO2 EST Transmission Constraints Available Transmission Capacity (ATC): limits the flow Ramp Rate: limits the change of flow FR BE NL DKA SEA DK1 DK2 GER Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 8 / 22

Interconnectors Function of Interconnectors balance net demand of adjacent areas NO4 harmonize prices NO5 NO3 SE FI NO1 NO2 EST Transmission Constraints Available Transmission Capacity (ATC): limits the flow Ramp Rate: limits the change of flow FR BE NL DKA SEA DK1 DK2 GER Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 8 / 22

Maximization of the Economic Surplus, subject to Transmission Constraints: Overview δh max q h p h (u) du + p b q b,t β b + K h H 0 s.t. a A, t T : b B,t T q h δ h + q b,t β b = h H a,t b B a c C a (MIQP) τ c,t c C + a τ c,t c C, t T : τ c,t τ c,t τ c,t c C, t T : τ c τ c,t τ c,t 1 τ c c C, t T : τ c,t R h H : δ h [0, 1] b B : β b {0, 1} Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 9 / 22

Mixed Integer Quadratic Programm Objective: Economic Surplus max δh q h p h (u) du + p b q b,t β b + K h H 0 b B,t T Notation: β b {0, 1} p b, q b,t δ h [0, 1] p h (u) execution state of block bid b B price limit; net demand of block b B in hour t T execution state of hourly net curve segment h H parametrization of the price of curve segment h H Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 10 / 22

Mixed Integer Quadratic Programm Constraints: 1. net demand = net import: a A, t T q h δ h + q b,t β b = h H a,t b B a c C a τ c,t c C + a τ c,t 2. ATC: c C, t T τ c,t τ c,t τ c,t 3. ramp rate: c C, t T τ c τ c,t τ c,t 1 τ c Notation: τ c,t R transmission on connector c C, hour t T h H a,t net curve segments in area a A, hour t T b B a block bids in area a c C + a connectors leaving area a Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 11 / 22

Mixed Integer Quadratic Programm Constraints: 1. net demand = net import: a A, t T q h δ h + q b,t β b = h H a,t b B a c C a τ c,t c C + a τ c,t 2. ATC: c C, t T τ c,t τ c,t τ c,t 3. ramp rate: c C, t T τ c τ c,t τ c,t 1 τ c Notation: τ c,t R transmission on connector c C, hour t T h H a,t net curve segments in area a A, hour t T b B a block bids in area a c C + a connectors leaving area a Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 11 / 22

Mixed Integer Quadratic Programm Constraints: 1. net demand = net import: a A, t T q h δ h + q b,t β b = h H a,t b B a c C a τ c,t c C + a τ c,t 2. ATC: c C, t T τ c,t τ c,t τ c,t 3. ramp rate: c C, t T τ c τ c,t τ c,t 1 τ c Notation: τ c,t R transmission on connector c C, hour t T h H a,t net curve segments in area a A, hour t T b B a block bids in area a c C + a connectors leaving area a Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 11 / 22

Optimality Conditions Optimal solution to (MIQP) can be computed with MIQP solvers (e.g. IBM CPLEX 12.1) Analyze optimal solution: fix the combinatorial bid selection apply Karush-Kuhn-Tucker-Condition for QPs (cf. [1]) obtain dual variables, also called shadow prices Shadow Prices π to (MIQP) satisfy (cf. [3]) Filling Condition Flow Price Condition Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 12 / 22

Optimality Conditions Optimal solution to (MIQP) can be computed with MIQP solvers (e.g. IBM CPLEX 12.1) Analyze optimal solution: fix the combinatorial bid selection apply Karush-Kuhn-Tucker-Condition for QPs (cf. [1]) obtain dual variables, also called shadow prices Shadow Prices π to (MIQP) satisfy (cf. [3]) Filling Condition Flow Price Condition Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 12 / 22

Filling Condition MW δ = 0 1 δ = 1 2 price / MW Filling Condition Price change is linear in the partial execution of the active segment: Filling condition is satisfied, if for all segments h H a,t in area a, hour t p h (δ h ), if δ h = 1 π a,t = p h (δ h ), if δ h (0, 1). p h (δ h ), if δ h = 0 (1) Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 13 / 22

Flow Price Condition 23 42 21 21 Simplified Flow Price Condition For adjacent areas it holds: Prices deviate a transmission constraint is active. No active transmission constraint prices coincide. (π, τ) satisfies simplified flow price condition, if for all connectors c = (r, s), hours t π r,t π s,t τ c,t {τ c,t, τ c,t } active ATC τ c,t τ c,t 1 = τ c active ramping [ τ c,t τ c,t+1 = τ c ] active ramping. Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 14 / 22

Block Price Condition Block can be executed, if it does not incur a loss. a A, b B a : β b = 1 Notation: (p b π a,t ) q b,t 0. t T π a,t β b p b, q b,t price in area a, time t execution state of block b B a in area a price limit; net demand in hour t T Optimal Solution to (MIQP) For an optimal bid selection β of (MIQP) the existence of shadow prices that satisfy all block price conditions is not given. Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 15 / 22

Block Price Condition Block can be executed, if it does not incur a loss. a A, b B a : β b = 1 Notation: (p b π a,t ) q b,t 0. t T π a,t β b p b, q b,t price in area a, time t execution state of block b B a in area a price limit; net demand in hour t T Optimal Solution to (MIQP) For an optimal bid selection β of (MIQP) the existence of shadow prices that satisfy all block price conditions is not given. Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 15 / 22

Infeasibility Cut: Bid Cut Given: bid selection β Assume: no shadow prices exist, satisfying all block price conditions. Define the following cut: Bid Cut L: executed blocks incurring a loss at prices π. L = {b B β b = 1 and (p b πa,t)q b,t < 0}, t T Cut(L): prohibits execution of at least one bid of L. Cut(L) : β b L 1. b L Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 16 / 22

Infeasibility Cut: Bid Cut Given: bid selection β Assume: no shadow prices exist, satisfying all block price conditions. Define the following cut: Bid Cut L: executed blocks incurring a loss at prices π. L = {b B β b = 1 and (p b πa,t)q b,t < 0}, t T Cut(L): prohibits execution of at least one bid of L. Cut(L) : β b L 1. b L Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 16 / 22

Bid Cut Heuristic Algorithm: 1. (β, δ, τ ) Solve (MIQP). 2. (π, L) Find shadow prices for (β, δ, τ ). 3. if L > 0, then 4. Add Cut(L) to the model (MIQP). 5. Go to step 1. 6. end if Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 17 / 22

Bid Cut Heuristic Algorithm: 1. (β, δ, τ ) Solve (MIQP). 2. (π, L) Find shadow prices for (β, δ, τ ). 3. if L > 0, then 4. Add Cut(L) to the model (MIQP). 5. Go to step 1. 6. end if Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 17 / 22

Bid Cut Heuristic Algorithm: 1. (β, δ, τ ) Solve (MIQP). 2. (π, L) Find shadow prices for (β, δ, τ ). 3. if L > 0, then 4. Add Cut(L) to the model (MIQP). 5. Go to step 1. 6. end if Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 17 / 22

Bid Cut Heuristic, Discussion (+) Fast Algorithm (4 seconds for 10 market areas) (+) Good Relative Gap (1.926 10 6 ) (o) Bid Cut slightly to strong (o) Not Optimal in pathological cases (4% of the cases) Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 18 / 22

Branch-and-Cut Decomposition Replace Bid Cut by a less restrictive Cut: Exact Bid Cut (cf. [2]) Exclude only one infeasible bid selection β : Cut(β ) : β b + (1 β b ) 1 b B:β b =0 b B:β b =1 Improved version: Branching over the Bid Cut Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 19 / 22

Branch-and-Cut Decomposition Replace Bid Cut by a less restrictive Cut: Exact Bid Cut (cf. [2]) Exclude only one infeasible bid selection β : Cut(β ) : β b + (1 β b ) 1 b B:β b =0 b B:β b =1 Improved version: Branching over the Bid Cut Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 19 / 22

Branch-and-Cut Decomposition, Discussion (+) Optimal Algorithm (+) Good Relative Gap (1.924 10 6 ) (o) Slight improvement of Relative Gap (0.002 10 6 ) ( ) Exact Bid Cut not strong enough ( ) Slow ( 10 minutes in 62% of the cases) Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 20 / 22

Results 79 realistic test cases: 10 market areas, ca. 600 blocks, ca. 31.700 curve segments Algorithm Optimal Bid Relative Computing Selection Gap Time Bid Cut Heuristic 38% 1.926E-6 4.1 sec B&C Decomposition 38% 1.924E-6 10 min Optimal bid selection: relative gap 1 10 12 within 10 minutes Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 21 / 22

Thank you for your attention! Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010 22 / 22

References References [1] BOYD, Stephen ; VANDENBERGHE, Lieven: Convex Optimization. Cambridge University Press, 2004. ISBN 0521833787 [2] CHU, Y. ; XIA, Q.: Generating Benders cuts for a general class of integer programming problems. In: Lecture Notes in Computer Science 3011, CPAIOR 2004, edited by J.-C. Régin and M. Rueher (2004), S. 127 141 [3] MÜLLER, Johannes C.: Optimierungsmethoden für die Kopplung von Day-Ahead-Strommärkten, TU-Darmstadt, Diplomarbeit, November 2009 Johannes C. Müller Clearing Coupled Day-Ahead Electricity Markets Energy Finance 2010