Subway stations energy and air quality management
|
|
- Samson Newman
- 6 years ago
- Views:
Transcription
1 Subway saions energy and air qualiy managemen wih sochasic opimizaion Trisan Rigau 1,2,4, Advisors: P. Carpenier 3, J.-Ph. Chancelier 2, M. De Lara 2 EFFICACITY 1 CERMICS, ENPC 2 UMA, ENSTA 3 LISIS, IFSTTAR 4 June 6, 2016 Saions Opimal Managemen June 6, / 30
2 Opimizaion for subway saions Paris urban railway ranspor sysem energy consumpion = 1 subway saions + 2 racion sysem 3 3 Subway saions presen a signicanly high pariculae maers concenraion We use opimizaion o harves unexploied energy ressources and improve air qualiy. Saions Opimal Managemen June 6, / 30
3 Ouline 1 Subway saions opimal managemen problem Energy Air qualiy Energy/Air managemen sysem 2 Two mehods o solve he problem We are looking for a policy Dynamic programming in he non Markovian case Model Predicive Conrol 3 Numerical resuls Random variables modeling Mehods Resuls Saions Opimal Managemen June 6, / 30
4 Ouline 1 Subway saions opimal managemen problem Energy Air qualiy Energy/Air managemen sysem 2 Two mehods o solve he problem We are looking for a policy Dynamic programming in he non Markovian case Model Predicive Conrol 3 Numerical resuls Random variables modeling Mehods Resuls Saions Opimal Managemen June 6, / 30
5 Energy Saions Opimal Managemen June 6, / 30
6 Subway saions ypical energy consumpion Saions Opimal Managemen June 6, / 30
7 Subway saions have unexploied energy ressources Saions Opimal Managemen June 6, / 30
8 Energy recovery requires a buer Saions Opimal Managemen June 6, / 30
9 Air qualiy Saions Opimal Managemen June 6, / 30
10 Subways arrivals generae pariculae maers Rails/brakes wear and resuspension increase PM10 concenraion Recovering energy improves air qualiy Saions Opimal Managemen June 6, / 30
11 Energy/Air managemen sysem Saions Opimal Managemen June 6, / 30
12 Subway saion microgrid concep Saions Opimal Managemen June 6, / 30
13 Objecive: We wan o minimize energy consumpion and paricles concenraion A parameer λ measures he relaive weighs of he 2 objecives: T Cos (E Supply Saion + E Supply Baery ) +λ CP In =0 }{{}}{{} Grid supply PM10 We should conrol he sysem every 5 seconds Saions Opimal Managemen June 6, / 30
14 We conrol he baery Saions Opimal Managemen June 6, / 30
15 Energy sysem equaions Sae of charge dynamics: Soc +1 = Soc 1 U B + ρ c (U B+ ρ } dc {{} Discharge + E Surplus Train ) } {{ } Charge We have consrains on he baery level o ensure good ageing: Soc Min Soc Soc Max We ensure he supply/demand balance a saion and baery nodes: U B+ + E Surplus Train }{{} Charge ESaion Demand }{{} Saion consumpion = E Supply Baery }{{} Grid supply = E Supply Saion }{{} Grid supply + ETrain Recovered }{{} E Train Available E Train Excess + U B }{{} Discharge Saions Opimal Managemen June 6, / 30
16 We conrol he saion venilaions Saions Opimal Managemen June 6, / 30
17 Paricles concenraion dynamics In he indoor air and on he oor CP In In +1 =C + ρr P + d V Venil S C P Floor }{{} Resuspension Ou (CP C In P ) } {{ } In/Ou exchange ρd V C P In + Q P }{{}}{{} V Deposiion Generaion CP Floor +1 =C Floor P + ρd S C P In }{{} Deposiion ρr V C P Floor }{{} Resuspension Saions Opimal Managemen June 6, / 30
18 We have many uncerainies Le W he random variables vecor of uncerainies a ime : Regeneraive braking : ETrain Available Saion consumpion : ESaion Demand Cos of elecriciy : Cos Paricles generaion : Q P Resuspension rae : ρ R Deposiion rae : ρ D Oudoor paricles concenraion : CP Ou Saions Opimal Managemen June 6, / 30
19 Summary of he equaions Sae of he sysem: X = Conrols: U = And he dynamics: U B U B+ d Venil, Soc C In P CP Floor X +1 = f (X, U, W +1 ) We add he non-anicipaiviy consrains: U σ(w 1,..., W ) Saions Opimal Managemen June 6, / 30
20 We se a sochasic opimal conrol problem s. ( min E T Cos (E Supply U U Saion + E Supply Baery ) + λcp ) } In Objecive =0 Soc +1 = Soc 1 U B + ρ c (U B+ ρ dc C In P +1 = C In + ρr P + d V Venil Ou (CP C P In ) S C P Floor ρd V C P In + Q P V C Floor P U B+ = C Floor +1 P + ρd S C In + E Surplus Train = E Supply ESaion Demand = E Supply Saion + UB Soc Min Soc Soc Max C In P 0 P ρr } + E Surplus Train ) Baery dynamics V C P Floor Baery + ETrain Recovered Paricles dynamics } } Supply/demand balance Consrains Saions Opimal Managemen June 6, / 30
21 Compac sochasic opimal conrol problem We obained a sochasic opimizaion problem consisen wih he general form of a ime addiive cos sochasic opimal conrol problem: min E X,U ( T 1 ) L (X, U, W +1 ) + K(X T ) =0 s.. X +1 = f (X, U, W +1 ) U σ(x 0, W 1,..., W ) U U Saions Opimal Managemen June 6, / 30
22 Ouline 1 Subway saions opimal managemen problem Energy Air qualiy Energy/Air managemen sysem 2 Two mehods o solve he problem We are looking for a policy Dynamic programming in he non Markovian case Model Predicive Conrol 3 Numerical resuls Random variables modeling Mehods Resuls Saions Opimal Managemen June 6, / 30
23 We are looking for a policy Saions Opimal Managemen June 6, / 30
24 Wha is a soluion? In he general case an opimal soluion is a funcion of pas uncerainies: U σ(x 0, W 1,..., W ) U = π (X 0, W 1,..., W ) This is an hisory-dependen policy In he Markovian case (noises ime independence) i is enough o limi he search o sae feedbacks: U = π (X ) Saions Opimal Managemen June 6, / 30
25 Backward inducion: Sochasic Dynamic Programming In he Markovian case we inroduce he value funcions: ( T 1 ) x X, V (x) = min E L (X, π (X ), W π +1) + K(X T ) Algorihm s. = X = x and dynamics Oine: We compue he value funcions by backward inducion using Bellman equaion, knowing he nal cos: ( ) V (x) = min E L (x, u, W +1 ) + V +1 (f (x, u, W +1 )) u U Online: We compue he conrol a ime using he equaion: ( ) u arg min E L (x, u, W +1 ) + V +1 (f (x, u, W +1 )) u U Saions Opimal Managemen June 6, / 30
26 Dynamic programming in he non Markovian case Saions Opimal Managemen June 6, / 30
27 Dynamic programming in he general case Bellman equaion does no hold in he non Markovian case. Le P be he probabiliy s. (W ) [ 1,T ] are ime independen bu keep he same marginal laws. Algorihm Oine: We produce value funcions wih Bellman equaion using his probabiliy measure: ( ) Ṽ (x) = min u U E P L (x, u, W +1 ) + Ṽ +1 (f (x, u, W +1 )) Online: We plug he compued value funcions as fuure coss a ime : ( ) u arg min L u U E P (x, u, W +1 ) + Ṽ +1 (f (x, u, W +1 )) Saions Opimal Managemen June 6, / 30
28 Remarks Wih P he probabiliy updaing W +1 marginal law aking ino accoun all he pas informaions: i, W i = w i. I is a ool o produce hisory-dependen conrols. If he (W ) 1..T +1 are independen he conrols are opimal and P = P Sochasic Dynamic Programming suers he well known "curse of dimensionaliy". Saions Opimal Managemen June 6, / 30
29 Model Predicive Conrol Saions Opimal Managemen June 6, / 30
30 Rollou algorihms To avoid value funcions compuaion we can plug a lookahead fuure cos for a given policy: ( ) u arg min E L (x, u, W +1 ) + J+1(f π (x, u, W +1 )) u U I gives he cos of conrolling he sysem in he fuure according o he given policy: ( T 1 x X +1, J+1(x) π =E s. =+1 ) L (X, π (X ), W +1) + K(X T ) X +1 = x, and he dynamics Saions Opimal Managemen June 6, / 30
31 Model Predicive Conrol Choosing π in he class of open loop policies minimizing he expeced fuure cos: i + 1, u i R n, x, π i (x) = u i u arg min u U min (u +1,...,u T 1 ) E ( L (x, u, W +1 ) + T 1 =+1 ) L (X, u, W +1) Wih E replacing noises by forecass, we obain a deerminisic problem. Algorihm Online: A every MPC sep, compue a forecas ( w +1,..., w T +1 ) using he observaions i, W i = w i. Then compue conrol u : u arg min u U min L (x, u, w +1 ) + (u +1,...,u T 1 ) T 1 =+1 L (x, u, w +1) MPC is ofen dened wih a rolling horizon. Saions Opimal Managemen June 6, / 30
32 Ouline 1 Subway saions opimal managemen problem Energy Air qualiy Energy/Air managemen sysem 2 Two mehods o solve he problem We are looking for a policy Dynamic programming in he non Markovian case Model Predicive Conrol 3 Numerical resuls Random variables modeling Mehods Resuls Saions Opimal Managemen June 6, / 30
33 Random variables modeling Saions Opimal Managemen June 6, / 30
34 Some random variables are aken deerminisic Regeneraive braking : ETrain Available Saion consumpion : ESaion Demand Cos of elecriciy : Cos Paricles generaion : Q P Resuspension rae : ρ R Deposiion rae : ρ D Oudoor paricles concenraion : CP Ou Saions Opimal Managemen June 6, / 30
35 Sochasic models We have muliple equiprobable scenarios: Braking energy and ouside PM10 concenraion every 5s We deduce he discree marginal laws from hese scenarios. Saions Opimal Managemen June 6, / 30
36 Deails on he mehods Sochasic Dynamic Programming: We compue value funcions every 5s. We can compue a conrol every 5s. The algorihm is coded in Julia. Model Predicive Conrol: The deerminisic problem is linearized leading o a MILP. I is solved every 15 min wih a 2 hours horizon. We use wo forecass sraegies: MPC1: Expecaion of each noise ignoring he noises dependence MPC2: Scenarios where he nex ouside PM10 concenraion is no oo far from he previous one Saions Opimal Managemen June 6, / 30
37 Resuls Saions Opimal Managemen June 6, / 30
38 Air qualiy simulaion Saions Opimal Managemen June 6, / 30
39 Energy recovery lower peaks Saions Opimal Managemen June 6, / 30
40 Energeic resuls Assessor: 50 scenarios of 24h wih ime sep = 5 sec Reference: Energy consumpion cos over a day wihou baery and venilaion conrol MPC1 SDP Oine comp. ime 0 12h Online comp. ime [10s,200s] [0s,1s] Economic savings -26% -31% On jus one assessmen scenario for he momen: MPC1: -22.3% MPC2: -22.7% SDP: -26.8% Saions Opimal Managemen June 6, / 30
41 Conclusion & Ongoing work Our sudy leads o he following conclusions: A baery and a proper venilaion conrol provide signican economic savings SDP provides slighly beer resuls han MPC bu requires more oine compuaion ime We are now focusing on: Using oher mehods ha handle more sae/conrol variables Taking ino accoun more uncerainy sources Calibraing air qualiy models for a more realisic concenraion dynamics behavior Ulimae goal: apply our mehods o laboraory and real size demonsraors Saions Opimal Managemen June 6, / 30
3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon
3..3 INRODUCION O DYNAMIC OPIMIZAION: DISCREE IME PROBLEMS A. he Hamilonian and Firs-Order Condiions in a Finie ime Horizon Define a new funcion, he Hamilonian funcion, H. H he change in he oal value of
More informationEnergy Storage and Renewables in New Jersey: Complementary Technologies for Reducing Our Carbon Footprint
Energy Sorage and Renewables in New Jersey: Complemenary Technologies for Reducing Our Carbon Fooprin ACEE E-filliaes workshop November 14, 2014 Warren B. Powell Daniel Seingar Harvey Cheng Greg Davies
More informationTwo Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017
Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =
More informationAn introduction to the theory of SDDP algorithm
An inroducion o he heory of SDDP algorihm V. Leclère (ENPC) Augus 1, 2014 V. Leclère Inroducion o SDDP Augus 1, 2014 1 / 21 Inroducion Large scale sochasic problem are hard o solve. Two ways of aacking
More informationME425/525: Advanced Topics in Building Science
ME425/525: Advanced Topics in Building Science Indoor environmenal qualiy for susainable buildings: Lecure 6 Dr. Ellio T. Gall, Ph.D. Lecure 6 Today s objecives o Error propagaion Apply o SS soluion (venilaion,
More informationT L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB
Elecronic Companion EC.1. Proofs of Technical Lemmas and Theorems LEMMA 1. Le C(RB) be he oal cos incurred by he RB policy. Then we have, T L E[C(RB)] 3 E[Z RB ]. (EC.1) Proof of Lemma 1. Using he marginal
More informationSimulating models with heterogeneous agents
Simulaing models wih heerogeneous agens Wouer J. Den Haan London School of Economics c by Wouer J. Den Haan Individual agen Subjec o employmen shocks (ε i, {0, 1}) Incomplee markes only way o save is hrough
More informationIntroduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate.
Inroducion Gordon Model (1962): D P = r g r = consan discoun rae, g = consan dividend growh rae. If raional expecaions of fuure discoun raes and dividend growh vary over ime, so should he D/P raio. Since
More informationL07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms
L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)
More informationBU Macro BU Macro Fall 2008, Lecture 4
Dynamic Programming BU Macro 2008 Lecure 4 1 Ouline 1. Cerainy opimizaion problem used o illusrae: a. Resricions on exogenous variables b. Value funcion c. Policy funcion d. The Bellman equaion and an
More informationProbabilistic Robotics
Probabilisic Roboics Bayes Filer Implemenaions Gaussian filers Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel Gaussians : ~ π e p N p - Univariae / / : ~ μ μ μ e p Ν p d π Mulivariae
More informationExcel-Based Solution Method For The Optimal Policy Of The Hadley And Whittin s Exact Model With Arma Demand
Excel-Based Soluion Mehod For The Opimal Policy Of The Hadley And Whiin s Exac Model Wih Arma Demand Kal Nami School of Business and Economics Winson Salem Sae Universiy Winson Salem, NC 27110 Phone: (336)750-2338
More informationNotes on Kalman Filtering
Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren
More informationSZG Macro 2011 Lecture 3: Dynamic Programming. SZG macro 2011 lecture 3 1
SZG Macro 2011 Lecure 3: Dynamic Programming SZG macro 2011 lecure 3 1 Background Our previous discussion of opimal consumpion over ime and of opimal capial accumulaion sugges sudying he general decision
More informationarxiv: v1 [math.oc] 27 Jul 2009
PARTICLE METHODS FOR STOCHASTIC OPTIMAL CONTROL PROBLEMS PIERRE CARPENTIER GUY COHEN AND ANES DALLAGI arxiv:0907.4663v1 [mah.oc] 27 Jul 2009 Absrac. When dealing wih numerical soluion of sochasic opimal
More informationIntroduction to Mobile Robotics
Inroducion o Mobile Roboics Bayes Filer Kalman Filer Wolfram Burgard Cyrill Sachniss Giorgio Grisei Maren Bennewiz Chrisian Plagemann Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel
More informationOnline Convex Optimization Example And Follow-The-Leader
CSE599s, Spring 2014, Online Learning Lecure 2-04/03/2014 Online Convex Opimizaion Example And Follow-The-Leader Lecurer: Brendan McMahan Scribe: Sephen Joe Jonany 1 Review of Online Convex Opimizaion
More information1 Review of Zero-Sum Games
COS 5: heoreical Machine Learning Lecurer: Rob Schapire Lecure #23 Scribe: Eugene Brevdo April 30, 2008 Review of Zero-Sum Games Las ime we inroduced a mahemaical model for wo player zero-sum games. Any
More informationApplication of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing
Applicaion of a Sochasic-Fuzzy Approach o Modeling Opimal Discree Time Dynamical Sysems by Using Large Scale Daa Processing AA WALASZE-BABISZEWSA Deparmen of Compuer Engineering Opole Universiy of Technology
More informationLecture 20: Riccati Equations and Least Squares Feedback Control
34-5 LINEAR SYSTEMS Lecure : Riccai Equaions and Leas Squares Feedback Conrol 5.6.4 Sae Feedback via Riccai Equaions A recursive approach in generaing he marix-valued funcion W ( ) equaion for i for he
More informationGeorey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract
Parameer Esimaion for Linear Dynamical Sysems Zoubin Ghahramani Georey E. Hinon Deparmen of Compuer Science Universiy oftorono 6 King's College Road Torono, Canada M5S A4 Email: zoubin@cs.orono.edu Technical
More informationSequential Importance Resampling (SIR) Particle Filter
Paricle Filers++ Pieer Abbeel UC Berkeley EECS Many slides adaped from Thrun, Burgard and Fox, Probabilisic Roboics 1. Algorihm paricle_filer( S -1, u, z ): 2. Sequenial Imporance Resampling (SIR) Paricle
More informationLecture 1 Overview. course mechanics. outline & topics. what is a linear dynamical system? why study linear systems? some examples
EE263 Auumn 27-8 Sephen Boyd Lecure 1 Overview course mechanics ouline & opics wha is a linear dynamical sysem? why sudy linear sysems? some examples 1 1 Course mechanics all class info, lecures, homeworks,
More informationOptimal Investment under Dynamic Risk Constraints and Partial Information
Opimal Invesmen under Dynamic Risk Consrains and Parial Informaion Wolfgang Puschögl Johann Radon Insiue for Compuaional and Applied Mahemaics (RICAM) Ausrian Academy of Sciences www.ricam.oeaw.ac.a 2
More informationSpeaker Adaptation Techniques For Continuous Speech Using Medium and Small Adaptation Data Sets. Constantinos Boulis
Speaker Adapaion Techniques For Coninuous Speech Using Medium and Small Adapaion Daa Ses Consaninos Boulis Ouline of he Presenaion Inroducion o he speaker adapaion problem Maximum Likelihood Sochasic Transformaions
More informationParticle Swarm Optimization
Paricle Swarm Opimizaion Speaker: Jeng-Shyang Pan Deparmen of Elecronic Engineering, Kaohsiung Universiy of Applied Science, Taiwan Email: jspan@cc.kuas.edu.w 7/26/2004 ppso 1 Wha is he Paricle Swarm Opimizaion
More informationRL Lecture 7: Eligibility Traces. R. S. Sutton and A. G. Barto: Reinforcement Learning: An Introduction 1
RL Lecure 7: Eligibiliy Traces R. S. Suon and A. G. Baro: Reinforcemen Learning: An Inroducion 1 N-sep TD Predicion Idea: Look farher ino he fuure when you do TD backup (1, 2, 3,, n seps) R. S. Suon and
More informationSmoothing. Backward smoother: At any give T, replace the observation yt by a combination of observations at & before T
Smoohing Consan process Separae signal & noise Smooh he daa: Backward smooher: A an give, replace he observaion b a combinaion of observaions a & before Simple smooher : replace he curren observaion wih
More informationLecture Notes 3: Quantitative Analysis in DSGE Models: New Keynesian Model
Lecure Noes 3: Quaniaive Analysis in DSGE Models: New Keynesian Model Zhiwei Xu, Email: xuzhiwei@sju.edu.cn The moneary policy plays lile role in he basic moneary model wihou price sickiness. We now urn
More information1. An introduction to dynamic optimization -- Optimal Control and Dynamic Programming AGEC
This documen was generaed a :45 PM 8/8/04 Copyrigh 04 Richard T. Woodward. An inroducion o dynamic opimizaion -- Opimal Conrol and Dynamic Programming AGEC 637-04 I. Overview of opimizaion Opimizaion is
More informationParticle Swarm Optimization Combining Diversification and Intensification for Nonlinear Integer Programming Problems
Paricle Swarm Opimizaion Combining Diversificaion and Inensificaion for Nonlinear Ineger Programming Problems Takeshi Masui, Masaoshi Sakawa, Kosuke Kao and Koichi Masumoo Hiroshima Universiy 1-4-1, Kagamiyama,
More informationRecent Developments In Evolutionary Data Assimilation And Model Uncertainty Estimation For Hydrologic Forecasting Hamid Moradkhani
Feb 6-8, 208 Recen Developmens In Evoluionary Daa Assimilaion And Model Uncerainy Esimaion For Hydrologic Forecasing Hamid Moradkhani Cener for Complex Hydrosysems Research Deparmen of Civil, Consrucion
More informationBias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé
Bias in Condiional and Uncondiional Fixed Effecs Logi Esimaion: a Correcion * Tom Coupé Economics Educaion and Research Consorium, Naional Universiy of Kyiv Mohyla Academy Address: Vul Voloska 10, 04070
More information3.1 More on model selection
3. More on Model selecion 3. Comparing models AIC, BIC, Adjused R squared. 3. Over Fiing problem. 3.3 Sample spliing. 3. More on model selecion crieria Ofen afer model fiing you are lef wih a handful of
More informationModeling Economic Time Series with Stochastic Linear Difference Equations
A. Thiemer, SLDG.mcd, 6..6 FH-Kiel Universiy of Applied Sciences Prof. Dr. Andreas Thiemer e-mail: andreas.hiemer@fh-kiel.de Modeling Economic Time Series wih Sochasic Linear Difference Equaions Summary:
More informationVehicle Arrival Models : Headway
Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where
More information1. Consider a pure-exchange economy with stochastic endowments. The state of the economy
Answer 4 of he following 5 quesions. 1. Consider a pure-exchange economy wih sochasic endowmens. The sae of he economy in period, 0,1,..., is he hisory of evens s ( s0, s1,..., s ). The iniial sae is given.
More informationHydropower Economics: An Overview
ydropower Economics: An Overview Finn R Førsund Professor Emerius Universiy of Oslo * Slides prepared for ECON4925 - Resource Economics Ocober 5 2017 ydropower economics 1 Curriculum ydropower Economics:
More informationAugmented Reality II - Kalman Filters - Gudrun Klinker May 25, 2004
Augmened Realiy II Kalman Filers Gudrun Klinker May 25, 2004 Ouline Moivaion Discree Kalman Filer Modeled Process Compuing Model Parameers Algorihm Exended Kalman Filer Kalman Filer for Sensor Fusion Lieraure
More informationZürich. ETH Master Course: L Autonomous Mobile Robots Localization II
Roland Siegwar Margaria Chli Paul Furgale Marco Huer Marin Rufli Davide Scaramuzza ETH Maser Course: 151-0854-00L Auonomous Mobile Robos Localizaion II ACT and SEE For all do, (predicion updae / ACT),
More informationCONTROL SYSTEMS, ROBOTICS AND AUTOMATION Vol. XI Control of Stochastic Systems - P.R. Kumar
CONROL OF SOCHASIC SYSEMS P.R. Kumar Deparmen of Elecrical and Compuer Engineering, and Coordinaed Science Laboraory, Universiy of Illinois, Urbana-Champaign, USA. Keywords: Markov chains, ransiion probabiliies,
More informationLinear Gaussian State Space Models
Linear Gaussian Sae Space Models Srucural Time Series Models Level and Trend Models Basic Srucural Model (BSM Dynamic Linear Models Sae Space Model Represenaion Level, Trend, and Seasonal Models Time Varying
More informationEnergy Storage Benchmark Problems
Energy Sorage Benchmark Problems Daniel F. Salas 1,3, Warren B. Powell 2,3 1 Deparmen of Chemical & Biological Engineering 2 Deparmen of Operaions Research & Financial Engineering 3 Princeon Laboraory
More informationLecture 3: Exponential Smoothing
NATCOR: Forecasing & Predicive Analyics Lecure 3: Exponenial Smoohing John Boylan Lancaser Cenre for Forecasing Deparmen of Managemen Science Mehods and Models Forecasing Mehod A (numerical) procedure
More informationDiebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles
Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance
More informationCompetitive and Cooperative Inventory Policies in a Two-Stage Supply-Chain
Compeiive and Cooperaive Invenory Policies in a Two-Sage Supply-Chain (G. P. Cachon and P. H. Zipkin) Presened by Shruivandana Sharma IOE 64, Supply Chain Managemen, Winer 2009 Universiy of Michigan, Ann
More informationPolicy regimes Theory
Advanced Moneary Theory and Policy EPOS 2012/13 Policy regimes Theory Giovanni Di Barolomeo giovanni.dibarolomeo@uniroma1.i The moneary policy regime The simple model: x = - s (i - p e ) + x e + e D p
More informationSUPPLEMENTARY INFORMATION
SUPPLEMENTARY INFORMATION DOI: 0.038/NCLIMATE893 Temporal resoluion and DICE * Supplemenal Informaion Alex L. Maren and Sephen C. Newbold Naional Cener for Environmenal Economics, US Environmenal Proecion
More informationPresentation Overview
Acion Refinemen in Reinforcemen Learning by Probabiliy Smoohing By Thomas G. Dieerich & Didac Busques Speaer: Kai Xu Presenaion Overview Bacground The Probabiliy Smoohing Mehod Experimenal Sudy of Acion
More informationLecture 10 Estimating Nonlinear Regression Models
Lecure 0 Esimaing Nonlinear Regression Models References: Greene, Economeric Analysis, Chaper 0 Consider he following regression model: y = f(x, β) + ε =,, x is kx for each, β is an rxconsan vecor, ε is
More informationPhysics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle
Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,
More informationTutorial: A Unified Modeling and Algorithmic Framework for Optimization under Uncertainty
Tuorial: A Unified Modeling and Algorihmic Framework for Opimizaion under Uncerainy Informs Opimizaion Sociey Meeing March 23, 2018 Warren B. Powell Princeon Universiy Deparmen of Operaions Research and
More informationOnline Appendix to Solution Methods for Models with Rare Disasters
Online Appendix o Soluion Mehods for Models wih Rare Disasers Jesús Fernández-Villaverde and Oren Levinal In his Online Appendix, we presen he Euler condiions of he model, we develop he pricing Calvo block,
More informationProblem Set 5. Graduate Macro II, Spring 2017 The University of Notre Dame Professor Sims
Problem Se 5 Graduae Macro II, Spring 2017 The Universiy of Nore Dame Professor Sims Insrucions: You may consul wih oher members of he class, bu please make sure o urn in your own work. Where applicable,
More informationRobust and Learning Control for Complex Systems
Robus and Learning Conrol for Complex Sysems Peer M. Young Sepember 13, 2007 & Talk Ouline Inroducion Robus Conroller Analysis and Design Theory Experimenal Applicaions Overview MIMO Robus HVAC Conrol
More informationChapter 2. Models, Censoring, and Likelihood for Failure-Time Data
Chaper 2 Models, Censoring, and Likelihood for Failure-Time Daa William Q. Meeker and Luis A. Escobar Iowa Sae Universiy and Louisiana Sae Universiy Copyrigh 1998-2008 W. Q. Meeker and L. A. Escobar. Based
More informationt is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t...
Mah 228- Fri Mar 24 5.6 Marix exponenials and linear sysems: The analogy beween firs order sysems of linear differenial equaions (Chaper 5) and scalar linear differenial equaions (Chaper ) is much sronger
More informationAnnouncements. Recap: Filtering. Recap: Reasoning Over Time. Example: State Representations for Robot Localization. Particle Filtering
Inroducion o Arificial Inelligence V22.0472-001 Fall 2009 Lecure 18: aricle & Kalman Filering Announcemens Final exam will be a 7pm on Wednesday December 14 h Dae of las class 1.5 hrs long I won ask anyhing
More informationProbabilistic Robotics SLAM
Probabilisic Roboics SLAM The SLAM Problem SLAM is he process by which a robo builds a map of he environmen and, a he same ime, uses his map o compue is locaion Localizaion: inferring locaion given a map
More information13.3 Term structure models
13.3 Term srucure models 13.3.1 Expecaions hypohesis model - Simples "model" a) shor rae b) expecaions o ge oher prices Resul: y () = 1 h +1 δ = φ( δ)+ε +1 f () = E (y +1) (1) =δ + φ( δ) f (3) = E (y +)
More information1. An introduction to dynamic optimization -- Optimal Control and Dynamic Programming AGEC
This documen was generaed a :37 PM, 1/11/018 Copyrigh 018 Richard T. Woodward 1. An inroducion o dynamic opimiaion -- Opimal Conrol and Dynamic Programming AGEC 64-018 I. Overview of opimiaion Opimiaion
More informationINTRODUCTION TO MACHINE LEARNING 3RD EDITION
ETHEM ALPAYDIN The MIT Press, 2014 Lecure Slides for INTRODUCTION TO MACHINE LEARNING 3RD EDITION alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/~ehem/i2ml3e CHAPTER 2: SUPERVISED LEARNING Learning a Class
More informationScheduling of Crude Oil Movements at Refinery Front-end
Scheduling of Crude Oil Movemens a Refinery Fron-end Ramkumar Karuppiah and Ignacio Grossmann Carnegie Mellon Universiy ExxonMobil Case Sudy: Dr. Kevin Furman Enerprise-wide Opimizaion Projec March 15,
More informationShort-Term Trading for a Wind Power Producer
Shor-Term Trading for a Wind Power Producer Anonio J. Conejo Juan M. Morales Juan Pérez Univ. Casilla La Mancha Spain 2010 1 2 Wha 1. Aim 2. Moivaion 3. Problem descripion 4. Mahemaical formulaion 5. Sochasic
More informationSTATE-SPACE MODELLING. A mass balance across the tank gives:
B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing
More informationExamples of Dynamic Programming Problems
M.I.T. 5.450-Fall 00 Sloan School of Managemen Professor Leonid Kogan Examples of Dynamic Programming Problems Problem A given quaniy X of a single resource is o be allocaed opimally among N producion
More informationEconomics 8105 Macroeconomic Theory Recitation 6
Economics 8105 Macroeconomic Theory Reciaion 6 Conor Ryan Ocober 11h, 2016 Ouline: Opimal Taxaion wih Governmen Invesmen 1 Governmen Expendiure in Producion In hese noes we will examine a model in which
More informationProbabilistic Robotics SLAM
Probabilisic Roboics SLAM The SLAM Problem SLAM is he process by which a robo builds a map of he environmen and, a he same ime, uses his map o compue is locaion Localizaion: inferring locaion given a map
More informationAir Quality Index Prediction Using Error Back Propagation Algorithm and Improved Particle Swarm Optimization
Air Qualiy Index Predicion Using Error Back Propagaion Algorihm and Improved Paricle Swarm Opimizaion Jia Xu ( ) and Lang Pei College of Compuer Science, Wuhan Qinchuan Universiy, Wuhan, China 461406563@qq.com
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON4325 Moneary Policy Dae of exam: Tuesday, May 24, 206 Grades are given: June 4, 206 Time for exam: 2.30 p.m. 5.30 p.m. The problem se covers 5 pages
More informationAn Optimal Dynamic Generation Scheduling for a Wind-Thermal Power System *
Energy and Power Engineering, 2013, 5, 1016-1021 doi:10.4236/epe.2013.54b194 Published Online July 2013 (hp://www.scirp.org/journal/epe) An Opimal Dynamic Generaion Scheduling for a Wind-Thermal Power
More informationTutorial: A Unified Framework for Optimization under Uncertainty
Tuorial: A Unified Framework for Opimizaion under Uncerainy Informs Annual Meeing - Nashville November 13, 2016 Warren B. Powell Princeon Universiy Deparmen of Operaions Research and Financial Engineering
More informationThis document was generated at 1:04 PM, 09/10/13 Copyright 2013 Richard T. Woodward. 4. End points and transversality conditions AGEC
his documen was generaed a 1:4 PM, 9/1/13 Copyrigh 213 Richard. Woodward 4. End poins and ransversaliy condiions AGEC 637-213 F z d Recall from Lecure 3 ha a ypical opimal conrol problem is o maimize (,,
More informationEssential Microeconomics : OPTIMAL CONTROL 1. Consider the following class of optimization problems
Essenial Microeconomics -- 6.5: OPIMAL CONROL Consider he following class of opimizaion problems Max{ U( k, x) + U+ ( k+ ) k+ k F( k, x)}. { x, k+ } = In he language of conrol heory, he vecor k is he vecor
More informationPlanning in POMDPs. Dominik Schoenberger Abstract
Planning in POMDPs Dominik Schoenberger d.schoenberger@sud.u-darmsad.de Absrac This documen briefly explains wha a Parially Observable Markov Decision Process is. Furhermore i inroduces he differen approaches
More informationLecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still.
Lecure - Kinemaics in One Dimension Displacemen, Velociy and Acceleraion Everyhing in he world is moving. Nohing says sill. Moion occurs a all scales of he universe, saring from he moion of elecrons in
More informationInformation Relaxations and Duality in Stochastic Dynamic Programs
OPERATIONS RESEARCH Vol. 58, No. 4, Par 1 of 2, July Augus 2010, pp. 785 801 issn 0030-364X eissn 1526-5463 10 5804 0785 informs doi 10.1287/opre.1090.0796 2010 INFORMS Informaion Relaxaions and Dualiy
More informationLecture 2 October ε-approximation of 2-player zero-sum games
Opimizaion II Winer 009/10 Lecurer: Khaled Elbassioni Lecure Ocober 19 1 ε-approximaion of -player zero-sum games In his lecure we give a randomized ficiious play algorihm for obaining an approximae soluion
More informationDecentralized Stochastic Control with Partial History Sharing: A Common Information Approach
1 Decenralized Sochasic Conrol wih Parial Hisory Sharing: A Common Informaion Approach Ashuosh Nayyar, Adiya Mahajan and Demoshenis Tenekezis arxiv:1209.1695v1 [cs.sy] 8 Sep 2012 Absrac A general model
More informationMagnetic Field Synthesis in an Open-Boundary Region Exploiting Thévenin Equivalent Conditions
Magneic Field Synhesis in an Open-Boundary Region Exploiing Thévenin Equivalen Condiions Paolo DI BARBA, PhD Dep of Indusrial and Informaion Engineering Universiy of Pavia, Ialy paolo.dibarba@unipv.i Ouline
More informationThe Brock-Mirman Stochastic Growth Model
c December 3, 208, Chrisopher D. Carroll BrockMirman The Brock-Mirman Sochasic Growh Model Brock and Mirman (972) provided he firs opimizing growh model wih unpredicable (sochasic) shocks. The social planner
More informationRobust estimation based on the first- and third-moment restrictions of the power transformation model
h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,
More informationAir Traffic Forecast Empirical Research Based on the MCMC Method
Compuer and Informaion Science; Vol. 5, No. 5; 0 ISSN 93-8989 E-ISSN 93-8997 Published by Canadian Cener of Science and Educaion Air Traffic Forecas Empirical Research Based on he MCMC Mehod Jian-bo Wang,
More informationKriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number
More informationSingle-loop System Reliability-based Topology Optimization Accounting for Statistical Dependence between Limit-states
11 h US Naional Congress on Compuaional Mechanics Minneapolis, Minnesoa Single-loop Sysem Reliabiliy-based Topology Opimizaion Accouning for Saisical Dependence beween imi-saes Tam Nguyen, Norheasern Universiy
More informationInventory Control of Perishable Items in a Two-Echelon Supply Chain
Journal of Indusrial Engineering, Universiy of ehran, Special Issue,, PP. 69-77 69 Invenory Conrol of Perishable Iems in a wo-echelon Supply Chain Fariborz Jolai *, Elmira Gheisariha and Farnaz Nojavan
More information5. Stochastic processes (1)
Lec05.pp S-38.45 - Inroducion o Teleraffic Theory Spring 2005 Conens Basic conceps Poisson process 2 Sochasic processes () Consider some quaniy in a eleraffic (or any) sysem I ypically evolves in ime randomly
More informationUSP. Surplus-Production Models
USP Surplus-Producion Models 2 Overview Purpose of slides: Inroducion o he producion model Overview of differen mehods of fiing Go over some criique of he mehod Source: Haddon 2001, Chaper 10 Hilborn and
More informationA variational radial basis function approximation for diffusion processes.
A variaional radial basis funcion approximaion for diffusion processes. Michail D. Vreas, Dan Cornford and Yuan Shen {vreasm, d.cornford, y.shen}@ason.ac.uk Ason Universiy, Birmingham, UK hp://www.ncrg.ason.ac.uk
More informationOpen loop vs Closed Loop. Example: Open Loop. Example: Feedforward Control. Advanced Control I
Open loop vs Closed Loop Advanced I Moor Command Movemen Overview Open Loop vs Closed Loop Some examples Useful Open Loop lers Dynamical sysems CPG (biologically inspired ), Force Fields Feedback conrol
More informationLars Nesheim. 17 January Last lecture solved the consumer choice problem.
Lecure 4 Locaional Equilibrium Coninued Lars Nesheim 17 January 28 1 Inroducory remarks Las lecure solved he consumer choice problem. Compued condiional demand funcions: C (I x; p; r (x)) and x; p; r (x))
More informationOsipenko Denis, Retail Risk Management, Raiffeisen Bank Aval JSC, Kiev, Ukraine. Credit Scoring and Credit Control XII conference August 24-26, 2011
Osipenko enis Reail Risk Managemen Raiffeisen Bank Aval JSC Kiev Ukraine Credi Scoring and Credi Conrol XII conference Augus - By he reason of risks inerpeneraion: Credi Risk => osses => Balance iquidiy
More informationTemporal probability models. Chapter 15, Sections 1 5 1
Temporal probabiliy models Chaper 15, Secions 1 5 Chaper 15, Secions 1 5 1 Ouline Time and uncerainy Inerence: ilering, predicion, smoohing Hidden Markov models Kalman ilers (a brie menion) Dynamic Bayesian
More informationGlobal Optimization for Scheduling Refinery Crude Oil Operations
Global Opimizaion for Scheduling Refinery Crude Oil Operaions Ramkumar Karuppiah 1, Kevin C. Furman 2 and Ignacio E. Grossmann 1 (1) Deparmen of Chemical Engineering Carnegie Mellon Universiy (2) Corporae
More informationFrom Particles to Rigid Bodies
Rigid Body Dynamics From Paricles o Rigid Bodies Paricles No roaions Linear velociy v only Rigid bodies Body roaions Linear velociy v Angular velociy ω Rigid Bodies Rigid bodies have boh a posiion and
More informationChapter 14 Wiener Processes and Itô s Lemma. Options, Futures, and Other Derivatives, 9th Edition, Copyright John C. Hull
Chaper 14 Wiener Processes and Iô s Lemma Copyrigh John C. Hull 014 1 Sochasic Processes! Describes he way in which a variable such as a sock price, exchange rae or ineres rae changes hrough ime! Incorporaes
More informationStochastic optimal control of a domestic microgrid equipped with solar panel and battery
1 Sochasic opimal conrol of a domesic microgrid equipped wih solar panel and baery François Pacaud, Pierre Carpenier, Jean-Philippe Chancelier, Michel De Lara Efficaciy ENSTA CERMICS-ENPC arxiv:1801.06479v1
More informationSystem of Linear Differential Equations
Sysem of Linear Differenial Equaions In "Ordinary Differenial Equaions" we've learned how o solve a differenial equaion for a variable, such as: y'k5$e K2$x =0 solve DE yx = K 5 2 ek2 x C_C1 2$y''C7$y
More informationBOKDSGE: A DSGE Model for the Korean Economy
BOKDSGE: A DSGE Model for he Korean Economy June 4, 2008 Joong Shik Lee, Head Macroeconomeric Model Secion Research Deparmen The Bank of Korea Ouline 1. Background 2. Model srucure & parameer values 3.
More informationHomework 6 AERE331 Spring 2019 Due 4/24(W) Name Sec. 1 / 2
Homework 6 AERE33 Spring 9 Due 4/4(W) Name Sec / PROBLEM (5p In PROBLEM 4 of HW4 we used he frequency domain o design a yaw/rudder feedback conrol sysem for a plan wih ransfer funcion 46 Gp () s The conroller
More information