SeDFAM: Semiconductor Demand Forecast Accuracy Model

Size: px
Start display at page:

Download "SeDFAM: Semiconductor Demand Forecast Accuracy Model"

Transcription

1 UTDallas.edu/ Metin SeDFAM: Semiconductor Demand Forecast Accuracy Model Metin Çakanyıldırım School of Management University of Texas at Dallas Robin Roundy School of Operations Research Cornell University IIE Portland Conference 23

2 UTDallas.edu/ Metin 2 Semiconductor Industry Industry Characteristics High Technology - Competition leads to Short Product Life Cycles and Frequent Line Width Changes Volatile Demand Fab financing: tool prices Business Contribution: Quantify Risk and Uncertainty Capacity acquisition Customer service: meet market demand Tool utilization

3 UTDallas.edu/ Metin 3 Goals of the Research Forecast Modeling. Covariances of product demands; substitutes - complements 2. Signal deteriorating forecasts 3. Forecast simulation

4 UTDallas.edu/ Metin 4 Demand Modeling A hierarchical model: Product families by general functionality, i.e. memory Products by functionality and line width, i.e. memory CMOS 2 Level of detail driven by capacity planning For families with persistent demands Products have transient demands Family demands are often correlated: Memory and CPU chips Correlations can often be strong. Correlation among the products of the same family e.g. between (memory,cmos8) and (memory,cmos) 2. Correlation among the products of different product families e.g. between (memory,cmos), (X86,CMOS)

5 UTDallas.edu/ Metin 5 Notation p, q: families (e.g. ASICS, X86) tec, tec+: a line width and its successor (e.g. CMOS, CMOS2) (p, tec): a product (e.g. (memory, CMOS)) d p,tec s,t : demand forecast made in s for t for a product (p, tec) d p s,t : demand forecast made in s for t for a family p d p s,t = tec d p,tec s,t H : forecast horizon

6 UTDallas.edu/ Metin 6 Inputs to Forecast Evolution Forecast history for a product (p, tec) Lags Jan... Sep... Dec d p,tec jan,jan... d p,tec sep,sep... d p,tec dec,dec t s = 2 d p,tec nov,jan... d p,tec jul,sep... d p,tec oct,dec H d p,tec jan H,jan... d p,tec sep H,sep... d p,tec dec H,dec

7 UTDallas.edu/ Metin 7 Heath-Jackson Framework for Family Demands d p t,t d p s,t. d p s,t s- d p s,t s d p t,t t v p s,t = d p s,t d p s,t d p t,t d p s,t v p s,t uncorrelated with v p s+,t Distribution of v p s,t depends on t s v p s,t correlated with vs,r q v s = [vs,t]: p Family forecast update vector at time s

8 UTDallas.edu/ Metin 8 SeDFAM Fractional Forecasts: f p,tec s,t : Fraction of demand for family p line width tec or shorter, forecasted from s for t Analyzing Fractional Forecasts f p,tec s,t = linewidth tec dp,tec s,t d p s,t Heath-Jackson approach is not directly applicable Apply a nonlinear transformation mapping Fractional Forecasts to Perceived Ages Apply Heath-Jackson to Perceived Age Forecasts

9 UTDallas.edu/ Metin 9 Computing Perceived Ages from Fractional Forecasts R(δ) f p,tec s,t δ p,tec s,t L δ Perceived age update u p,tec s,t = δ p,tec s,t δ p,tec s,t

10 UTDallas.edu/ Metin Perceived Age Update Vectors Construct iid update vectors u 4 s = [us,s X86,4,..., u X86,4 s,s+h, umem,4 s,s,..., u Mem,4 P C,4 s,s+h, ups,s,...] iid: updates for different technologies are independent u 6 s = [u X86,6 s,s,..., u X86,6 s,s+h, umem,6 s,s,..., u Mem,6 P C,6 s,s+h, up s,s,...] iid: updates created in different time periods are independent u 6 s+ = [u X86,6 s+,s+,..., ux86,6 s+,s+h, umem,6 s+,s+,..., umem,6 s+,s+h Data is missing if (X86, 6) production ends before s + H, up P C,6 s+,s+,...] u tec s N(, Σ), use EM (Expectation Maximization) algorithm by Schafer (997)

11 UTDallas.edu/ Metin Summary: SeDFAM Estimation Procedure Inputs : Demand forecasts, d p,tec s,t. Estimate family forecast update covariance matrix, ˆΛ 2. Fit ramp function ˆR to fractional forecasts 3. Compute perceived age forecasts δ p,tec s,t = ˆR (f p,tec s,t ) 4. Estimate perceived age forecast update covariance matrix, ˆΣ (using the EM algorithm) 5. Use ˆR, ˆΛ, ˆΣ to compute variances and covariances of demands as seen in period r

12 UTDallas.edu/ Metin 2 Step 5 of SeDFAM Estimation Procedure Computing variance of R(δ p,tec s,t ) is complicated because R is not linear Options: Monte-Carlo Sampling or Numerical Integration R is a quadratic spline with 3 knots Knots define regions of integration in R 2 We use Monte-Carlo Sampling

13 UTDallas.edu/ Metin 3 Flowchart for Simulating Forecasts Test accuracy of SeDFAM in estimating capacity demand covariances Perceived Ages δ p,tec r,t = p,tec r,t I r. Perceived Age Updates = (U p,tec s,t ) N(, Σ). U tec s Family Demands d p r,t = Dp r,t I r. Family Demand Updates V s = (V p s,t ) N(, Λ). Perceived Age Forecasts p,tec s,t = p,tec s,t + U p,tec s,t. Family Demand Forecasts D p s,t = Dp s,t + V p s,t. Fractional Demand Forecasts F p,tec s,t = R( p,tec s,t ) Product Demand Forecast D p,tec s,t = D p s,t (F p,tec s,t F p,tec+ s,t ), see (??).

14 UTDallas.edu/ Metin 4 Biases Lag bias: E(update), simple modification of forecast evolution Nonlinearity bias: Fractional forecasts = R (perceived ages) perceived ages unbiased implies fractional forecasts biased Small when R is close to linear.

15 UTDallas.edu/ Metin 5 Capacity Demanded from a Critical Tool A critical tool Used for technologies tec = and tec = 2, and for families A and B Consider capacity demands for a critical tool with processing times, c p,tec tec = tec = 2 A..3 B.7.

16 UTDallas.edu/ Metin 6 Experimental Design Simulation Model Historical Forecasts up to period now N independent evolutions from period now on Estimated covariance matrix of forecasts generated in now True covariance matrix of forecasts generated in now

17 UTDallas.edu/ Metin 7 Heuristics Allocation: Family variances are allocated to technologies Proportional to forecasted volume Proportion: Update is proportional to the forecast d p,tec t h,t dp,tec t,t d p,tec t h,t ξ h Assume ξ h, h =..H has the same distribution for (p, tec) t [Variance of error in d p,tec t,t ] = (d p,tec now,t) 2 var(ξ t now ) Neither Allocation nor Proportion capture correlations (time-wise or among families)

18 UTDallas.edu/ Metin 8 Results: Capacity Acquisition Customer Service: P(meet customer demand) targeted at 84. %. Method LT=2 LT=4 LT=6 LT=8 LT= LT=2 Aver SeDFAM Allocation Proportion Tool Utilization : E(excess capacity / mean demand for capacity) Method LT=2 LT=4 LT=6 LT=8 LT= LT=2 Aver True SeDFAM Allocation Proportion

19 UTDallas.edu/ Metin 9 Robustness Analysis C s,t : forecast (from s for t) of the critical tool capacity required Γ: covariance matrix of [C now+,now+,..., C now+h+,now+h+ ] Performance measure: F (Γ) = (Estimated Γ) (T rue Γ) (T rue Γ) Properties varied without significant effect on performance: Skewness of ramp curves Forecast horizon, H Magnitude of covariances in perceived age updates Correlations across families & time in family demand & age updates

20 UTDallas.edu/ Metin 2 Robustness Analysis: Forecast History.4.35 x, o, +, * : individual runs with 9, 6, 45, 3 months of forecast history.3.25 F(Γ) month aver. 45 month aver. 6 month aver. 9 month aver Starting Months for Replications SedFAM estimates Γ more accurately with longer forecast history

21 UTDallas.edu/ Metin 2 Tests with Industrial Data Model assumptions pass statistical tests with the industrial data Perceived age stationarity tested visually: 5 Perceived age update Ramp age

22 UTDallas.edu/ Metin 22 Product Family Demands 5 DREC MPZ RSP 5 SAPC MPCN MXS SPC 5 SREC Quarters 2 3 Quarters

23 UTDallas.edu/ Metin 23 Data Analysis Select Families: SAPC, SREC, DREC, MXS Life Cycles for MPZ, RSP ended Life Cycles for MPCN, SPC started Make demand stationary Family SAPC SREC DREC MXS Exponent

24 UTDallas.edu/ Metin 24 Family and Fractional Forecasts 3 Family Forecasts Fractional Ramp Forecasts SAPC 2 SAPC SREC 2 SREC DREC 2 DREC MXS 2 MXS Quarters Quarters

25 UTDallas.edu/ Metin 25 Resolution of Uncertainty in Family Forecasts Family Demand Coefficient of Variation in Years DREC, mean= SAPC, mean= MXS, mean= Forecast Lag in Years SREC, mean= Forecast Lag in Years

26 UTDallas.edu/ Metin 26 Resolution of Uncertainty in Perceived Age Forecasts 3 Perceived Age Forecasts, Standard Deviation of Error in Years DREC SAPC SREC Forecast Lag in Years

27 UTDallas.edu/ Metin 27 Correlations in Family Demands DREC SAPC MXS SREC DREC DREC SAPC SAPC-2 MXS MXS SREC SREC DREC and SAPC subtitutes. MXS and SREC complements.

28 UTDallas.edu/ Metin 28 Correlations in Perceived Ages DREC SAPC SREC DREC DREC SAPC SAPC SREC SREC-2-57

29 UTDallas.edu/ Metin 29 Effectiveness of SeDFAM in estimating Γ, in % All key assumptions are statistically verified Correlations: Strong or weak Update Frequency Only impacts SeDFAM performance thru amount of data available Bayesian approach; Computationally stable, but sensitive to prior Sample size Size of F (Γ) by Quarters Aver Λ, Σ Λ, Σ F (Γ) Annu,Quar,Bay. 5, x Semi,Quar,Bay., 22 4x Quar,Quar,Bay. 2, 5 6x Quar,Quar,Fre. 2, 5 6x

30 UTDallas.edu/ Metin 3 Conclusion SeDFAM accurately estimates forecast error variances & correlations is robust requires about 48 periods of history for good performance benefits. quantify risk and uncertainty 2. signals deteriorating forecasts 3. forecast simulation

Uncertainty quantification of world population growth: A self-similar PDF model

Uncertainty quantification of world population growth: A self-similar PDF model DOI 10.1515/mcma-2014-0005 Monte Carlo Methods Appl. 2014; 20 (4):261 277 Research Article Stefan Heinz Uncertainty quantification of world population growth: A self-similar PDF model Abstract: The uncertainty

More information

BUSI 460 Suggested Answers to Selected Review and Discussion Questions Lesson 7

BUSI 460 Suggested Answers to Selected Review and Discussion Questions Lesson 7 BUSI 460 Suggested Answers to Selected Review and Discussion Questions Lesson 7 1. The definitions follow: (a) Time series: Time series data, also known as a data series, consists of observations on a

More information

Quantifying Stochastic Model Errors via Robust Optimization

Quantifying Stochastic Model Errors via Robust Optimization Quantifying Stochastic Model Errors via Robust Optimization IPAM Workshop on Uncertainty Quantification for Multiscale Stochastic Systems and Applications Jan 19, 2016 Henry Lam Industrial & Operations

More information

A Modified Fractionally Co-integrated VAR for Predicting Returns

A Modified Fractionally Co-integrated VAR for Predicting Returns A Modified Fractionally Co-integrated VAR for Predicting Returns Xingzhi Yao Marwan Izzeldin Department of Economics, Lancaster University 13 December 215 Yao & Izzeldin (Lancaster University) CFE (215)

More information

Empirical properties of large covariance matrices in finance

Empirical properties of large covariance matrices in finance Empirical properties of large covariance matrices in finance Ex: RiskMetrics Group, Geneva Since 2010: Swissquote, Gland December 2009 Covariance and large random matrices Many problems in finance require

More information

2013 WEATHER NORMALIZATION SURVEY. Industry Practices

2013 WEATHER NORMALIZATION SURVEY. Industry Practices 2013 WEATHER NORMALIZATION SURVEY Industry Practices FORECASTING SPECIALIZATION Weather Operational Forecasting Short-term Forecasting to support: System Operations and Energy Trading Hourly Load Financial/Budget

More information

WHITE PAPER BENEFITS OF USING EXPERT FX RISK MANAGEMENT RESOURCES PREPARED BY ANDRE CILLIERS DIRECTOR AND CURRENCY RISK STRATEGIST AT TREASURYONE

WHITE PAPER BENEFITS OF USING EXPERT FX RISK MANAGEMENT RESOURCES PREPARED BY ANDRE CILLIERS DIRECTOR AND CURRENCY RISK STRATEGIST AT TREASURYONE WHITE PAPER BENEFITS OF USING EXPERT FX RISK MANAGEMENT RESOURCES EXCHANGE RATE RISK MANAGEMENT PREPARED BY ANDRE CILLIERS DIRECTOR AND CURRENCY RISK STRATEGIST AT TREASURYONE SEPTEMBER 2018 Introduction

More information

NOWCASTING THE NEW TURKISH GDP

NOWCASTING THE NEW TURKISH GDP CEFIS WORKING PAPER SERIES First Version: August 2017 NOWCASTING THE NEW TURKISH GDP Barış Soybilgen, İstanbul Bilgi University Ege Yazgan, İstanbul Bilgi University Nowcasting the New Turkish GDP Barış

More information

HEALTHCARE. 5 Components of Accurate Rolling Forecasts in Healthcare

HEALTHCARE. 5 Components of Accurate Rolling Forecasts in Healthcare HEALTHCARE 5 Components of Accurate Rolling Forecasts in Healthcare Introduction Rolling Forecasts Improve Accuracy and Optimize Decisions Accurate budgeting, planning, and forecasting are essential for

More information

Chapter 8 - Forecasting

Chapter 8 - Forecasting Chapter 8 - Forecasting Operations Management by R. Dan Reid & Nada R. Sanders 4th Edition Wiley 2010 Wiley 2010 1 Learning Objectives Identify Principles of Forecasting Explain the steps in the forecasting

More information

Volatility. Gerald P. Dwyer. February Clemson University

Volatility. Gerald P. Dwyer. February Clemson University Volatility Gerald P. Dwyer Clemson University February 2016 Outline 1 Volatility Characteristics of Time Series Heteroskedasticity Simpler Estimation Strategies Exponentially Weighted Moving Average Use

More information

The Kalman Filter. An Algorithm for Dealing with Uncertainty. Steven Janke. May Steven Janke (Seminar) The Kalman Filter May / 29

The Kalman Filter. An Algorithm for Dealing with Uncertainty. Steven Janke. May Steven Janke (Seminar) The Kalman Filter May / 29 The Kalman Filter An Algorithm for Dealing with Uncertainty Steven Janke May 2011 Steven Janke (Seminar) The Kalman Filter May 2011 1 / 29 Autonomous Robots Steven Janke (Seminar) The Kalman Filter May

More information

Robust Backtesting Tests for Value-at-Risk Models

Robust Backtesting Tests for Value-at-Risk Models Robust Backtesting Tests for Value-at-Risk Models Jose Olmo City University London (joint work with Juan Carlos Escanciano, Indiana University) Far East and South Asia Meeting of the Econometric Society

More information

Predictive Engineering and Computational Sciences. Local Sensitivity Derivative Enhanced Monte Carlo Methods. Roy H. Stogner, Vikram Garg

Predictive Engineering and Computational Sciences. Local Sensitivity Derivative Enhanced Monte Carlo Methods. Roy H. Stogner, Vikram Garg PECOS Predictive Engineering and Computational Sciences Local Sensitivity Derivative Enhanced Monte Carlo Methods Roy H. Stogner, Vikram Garg Institute for Computational Engineering and Sciences The University

More information

Approximating fixed-horizon forecasts using fixed-event forecasts

Approximating fixed-horizon forecasts using fixed-event forecasts Approximating fixed-horizon forecasts using fixed-event forecasts Comments by Simon Price Essex Business School June 2016 Redundant disclaimer The views in this presentation are solely those of the presenter

More information

Chapter 7 Forecasting Demand

Chapter 7 Forecasting Demand Chapter 7 Forecasting Demand Aims of the Chapter After reading this chapter you should be able to do the following: discuss the role of forecasting in inventory management; review different approaches

More information

Nowcasting the Finnish economy with a large Bayesian vector autoregressive model

Nowcasting the Finnish economy with a large Bayesian vector autoregressive model Nowcasting the Finnish economy with a large Bayesian vector autoregressive model Itkonen,J. & Juvonen,P. Suomen Pankki Conference on Real-Time Data Analysis, Methods and Applications 19.10.2017 Introduction

More information

High-dimensional Markov Chain Models for Categorical Data Sequences with Applications Wai-Ki CHING AMACL, Department of Mathematics HKU 19 March 2013

High-dimensional Markov Chain Models for Categorical Data Sequences with Applications Wai-Ki CHING AMACL, Department of Mathematics HKU 19 March 2013 High-dimensional Markov Chain Models for Categorical Data Sequences with Applications Wai-Ki CHING AMACL, Department of Mathematics HKU 19 March 2013 Abstract: Markov chains are popular models for a modelling

More information

Short Questions (Do two out of three) 15 points each

Short Questions (Do two out of three) 15 points each Econometrics Short Questions Do two out of three) 5 points each ) Let y = Xβ + u and Z be a set of instruments for X When we estimate β with OLS we project y onto the space spanned by X along a path orthogonal

More information

Uncertainty in energy system models

Uncertainty in energy system models Uncertainty in energy system models Amy Wilson Durham University May 2015 Table of Contents 1 Model uncertainty 2 3 Example - generation investment 4 Conclusion Model uncertainty Contents 1 Model uncertainty

More information

Volume 38, Issue 2. Nowcasting the New Turkish GDP

Volume 38, Issue 2. Nowcasting the New Turkish GDP Volume 38, Issue 2 Nowcasting the New Turkish GDP Barış Soybilgen İstanbul Bilgi University Ege Yazgan İstanbul Bilgi University Abstract In this study, we predict year-on-year and quarter-on-quarter Turkish

More information

Lecture 3: Policy Evaluation Without Knowing How the World Works / Model Free Policy Evaluation

Lecture 3: Policy Evaluation Without Knowing How the World Works / Model Free Policy Evaluation Lecture 3: Policy Evaluation Without Knowing How the World Works / Model Free Policy Evaluation CS234: RL Emma Brunskill Winter 2018 Material builds on structure from David SIlver s Lecture 4: Model-Free

More information

Introduction to Econometrics

Introduction to Econometrics Introduction to Econometrics STAT-S-301 Introduction to Time Series Regression and Forecasting (2016/2017) Lecturer: Yves Dominicy Teaching Assistant: Elise Petit 1 Introduction to Time Series Regression

More information

Econ 423 Lecture Notes: Additional Topics in Time Series 1

Econ 423 Lecture Notes: Additional Topics in Time Series 1 Econ 423 Lecture Notes: Additional Topics in Time Series 1 John C. Chao April 25, 2017 1 These notes are based in large part on Chapter 16 of Stock and Watson (2011). They are for instructional purposes

More information

Warwick Business School Forecasting System. Summary. Ana Galvao, Anthony Garratt and James Mitchell November, 2014

Warwick Business School Forecasting System. Summary. Ana Galvao, Anthony Garratt and James Mitchell November, 2014 Warwick Business School Forecasting System Summary Ana Galvao, Anthony Garratt and James Mitchell November, 21 The main objective of the Warwick Business School Forecasting System is to provide competitive

More information

Different Criteria for Active Learning in Neural Networks: A Comparative Study

Different Criteria for Active Learning in Neural Networks: A Comparative Study Different Criteria for Active Learning in Neural Networks: A Comparative Study Jan Poland and Andreas Zell University of Tübingen, WSI - RA Sand 1, 72076 Tübingen, Germany Abstract. The field of active

More information

Multivariate modelling of long memory processes with common components

Multivariate modelling of long memory processes with common components Multivariate modelling of long memory processes with common components Claudio Morana University of Piemonte Orientale, International Centre for Economic Research (ICER), and Michigan State University

More information

A Dynamic model for requirements planning with application to supply chain optimization

A Dynamic model for requirements planning with application to supply chain optimization This summary presentation is based on: Graves, Stephen, D.B. Kletter and W.B. Hetzel. "A Dynamic Model for Requirements Planning with Application to Supply Chain Optimization." Operations Research 46,

More information

Integration of WindSim s Forecasting Module into an Existing Multi-Asset Forecasting Framework

Integration of WindSim s Forecasting Module into an Existing Multi-Asset Forecasting Framework Chad Ringley Manager of Atmospheric Modeling Integration of WindSim s Forecasting Module into an Existing Multi-Asset Forecasting Framework 26 JUNE 2014 2014 WINDSIM USER S MEETING TONSBERG, NORWAY SAFE

More information

Lecture Prepared By: Mohammad Kamrul Arefin Lecturer, School of Business, North South University

Lecture Prepared By: Mohammad Kamrul Arefin Lecturer, School of Business, North South University Lecture 15 20 Prepared By: Mohammad Kamrul Arefin Lecturer, School of Business, North South University Modeling for Time Series Forecasting Forecasting is a necessary input to planning, whether in business,

More information

Organization. I MCMC discussion. I project talks. I Lecture.

Organization. I MCMC discussion. I project talks. I Lecture. Organization I MCMC discussion I project talks. I Lecture. Content I Uncertainty Propagation Overview I Forward-Backward with an Ensemble I Model Reduction (Intro) Uncertainty Propagation in Causal Systems

More information

Predict GARCH Based Volatility of Shanghai Composite Index by Recurrent Relevant Vector Machines and Recurrent Least Square Support Vector Machines

Predict GARCH Based Volatility of Shanghai Composite Index by Recurrent Relevant Vector Machines and Recurrent Least Square Support Vector Machines Predict GARCH Based Volatility of Shanghai Composite Index by Recurrent Relevant Vector Machines and Recurrent Least Square Support Vector Machines Phichhang Ou (Corresponding author) School of Business,

More information

Bayesian Estimation of Input Output Tables for Russia

Bayesian Estimation of Input Output Tables for Russia Bayesian Estimation of Input Output Tables for Russia Oleg Lugovoy (EDF, RANE) Andrey Polbin (RANE) Vladimir Potashnikov (RANE) WIOD Conference April 24, 2012 Groningen Outline Motivation Objectives Bayesian

More information

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Andrew O. Finley 1 and Sudipto Banerjee 2 1 Department of Forestry & Department of Geography, Michigan

More information

Forecasting with Expert Opinions

Forecasting with Expert Opinions CS 229 Machine Learning Forecasting with Expert Opinions Khalid El-Awady Background In 2003 the Wall Street Journal (WSJ) introduced its Monthly Economic Forecasting Survey. Each month the WSJ polls between

More information

NSP Electric - Minnesota Annual Report Peak Demand and Annual Electric Consumption Forecast

NSP Electric - Minnesota Annual Report Peak Demand and Annual Electric Consumption Forecast Page 1 of 5 7610.0320 - Forecast Methodology NSP Electric - Minnesota Annual Report Peak Demand and Annual Electric Consumption Forecast OVERALL METHODOLOGICAL FRAMEWORK Xcel Energy prepared its forecast

More information

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Alan Gelfand 1 and Andrew O. Finley 2 1 Department of Statistical Science, Duke University, Durham, North

More information

An Introduction to Rational Inattention

An Introduction to Rational Inattention An Introduction to Rational Inattention Lecture notes for the course Bounded Rationality and Macroeconomics December 2, 2005 1 Introduction The objective of modelling economic agents as being rationally

More information

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Sudipto Banerjee 1 and Andrew O. Finley 2 1 Biostatistics, School of Public Health, University of Minnesota,

More information

Exploring non linearities in Hedge Funds

Exploring non linearities in Hedge Funds Exploring non linearities in Hedge Funds An application of Particle Filters to Hedge Fund Replication Guillaume Weisang 1 Thierry Roncalli 2 1 Bentley University, Waltham, MA 2 Lyxor AM January 28-29,

More information

Knowing What Others Know: Coordination Motives in Information Acquisition

Knowing What Others Know: Coordination Motives in Information Acquisition Knowing What Others Know: Coordination Motives in Information Acquisition Christian Hellwig and Laura Veldkamp UCLA and NYU Stern May 2006 1 Hellwig and Veldkamp Two types of information acquisition Passive

More information

Fractional Imputation in Survey Sampling: A Comparative Review

Fractional Imputation in Survey Sampling: A Comparative Review Fractional Imputation in Survey Sampling: A Comparative Review Shu Yang Jae-Kwang Kim Iowa State University Joint Statistical Meetings, August 2015 Outline Introduction Fractional imputation Features Numerical

More information

2013 Weather Normalization Survey. Itron, Inc El Camino Real San Diego, CA

2013 Weather Normalization Survey. Itron, Inc El Camino Real San Diego, CA Itron, Inc. 11236 El Camino Real San Diego, CA 92130 2650 858 724 2620 March 2014 Weather normalization is the process of reconstructing historical energy consumption assuming that normal weather occurred

More information

Page No. (and line no. if applicable):

Page No. (and line no. if applicable): COALITION/IEC (DAYMARK LOAD) - 1 COALITION/IEC (DAYMARK LOAD) 1 Tab and Daymark Load Forecast Page No. Page 3 Appendix: Review (and line no. if applicable): Topic: Price elasticity Sub Topic: Issue: Accuracy

More information

statistical methods for tailoring seasonal climate forecasts Andrew W. Robertson, IRI

statistical methods for tailoring seasonal climate forecasts Andrew W. Robertson, IRI statistical methods for tailoring seasonal climate forecasts Andrew W. Robertson, IRI tailored seasonal forecasts why do we make probabilistic forecasts? to reduce our uncertainty about the (unknown) future

More information

OPTIMAL DESIGN INPUTS FOR EXPERIMENTAL CHAPTER 17. Organization of chapter in ISSO. Background. Linear models

OPTIMAL DESIGN INPUTS FOR EXPERIMENTAL CHAPTER 17. Organization of chapter in ISSO. Background. Linear models CHAPTER 17 Slides for Introduction to Stochastic Search and Optimization (ISSO)by J. C. Spall OPTIMAL DESIGN FOR EXPERIMENTAL INPUTS Organization of chapter in ISSO Background Motivation Finite sample

More information

Econometrics. Week 4. Fall Institute of Economic Studies Faculty of Social Sciences Charles University in Prague

Econometrics. Week 4. Fall Institute of Economic Studies Faculty of Social Sciences Charles University in Prague Econometrics Week 4 Institute of Economic Studies Faculty of Social Sciences Charles University in Prague Fall 2012 1 / 23 Recommended Reading For the today Serial correlation and heteroskedasticity in

More information

Estimating and Testing the US Model 8.1 Introduction

Estimating and Testing the US Model 8.1 Introduction 8 Estimating and Testing the US Model 8.1 Introduction The previous chapter discussed techniques for estimating and testing complete models, and this chapter applies these techniques to the US model. For

More information

Inflation Revisited: New Evidence from Modified Unit Root Tests

Inflation Revisited: New Evidence from Modified Unit Root Tests 1 Inflation Revisited: New Evidence from Modified Unit Root Tests Walter Enders and Yu Liu * University of Alabama in Tuscaloosa and University of Texas at El Paso Abstract: We propose a simple modification

More information

Modification and Improvement of Empirical Likelihood for Missing Response Problem

Modification and Improvement of Empirical Likelihood for Missing Response Problem UW Biostatistics Working Paper Series 12-30-2010 Modification and Improvement of Empirical Likelihood for Missing Response Problem Kwun Chuen Gary Chan University of Washington - Seattle Campus, kcgchan@u.washington.edu

More information

An Efficient Estimation Method for Longitudinal Surveys with Monotone Missing Data

An Efficient Estimation Method for Longitudinal Surveys with Monotone Missing Data An Efficient Estimation Method for Longitudinal Surveys with Monotone Missing Data Jae-Kwang Kim 1 Iowa State University June 28, 2012 1 Joint work with Dr. Ming Zhou (when he was a PhD student at ISU)

More information

Nowcasting Norwegian GDP

Nowcasting Norwegian GDP Nowcasting Norwegian GDP Knut Are Aastveit and Tørres Trovik May 13, 2007 Introduction Motivation The last decades of advances in information technology has made it possible to access a huge amount of

More information

This note introduces some key concepts in time series econometrics. First, we

This note introduces some key concepts in time series econometrics. First, we INTRODUCTION TO TIME SERIES Econometrics 2 Heino Bohn Nielsen September, 2005 This note introduces some key concepts in time series econometrics. First, we present by means of examples some characteristic

More information

Regression: Ordinary Least Squares

Regression: Ordinary Least Squares Regression: Ordinary Least Squares Mark Hendricks Autumn 2017 FINM Intro: Regression Outline Regression OLS Mathematics Linear Projection Hendricks, Autumn 2017 FINM Intro: Regression: Lecture 2/32 Regression

More information

FORECASTING: A REVIEW OF STATUS AND CHALLENGES. Eric Grimit and Kristin Larson 3TIER, Inc. Pacific Northwest Weather Workshop March 5-6, 2010

FORECASTING: A REVIEW OF STATUS AND CHALLENGES. Eric Grimit and Kristin Larson 3TIER, Inc. Pacific Northwest Weather Workshop March 5-6, 2010 SHORT-TERM TERM WIND POWER FORECASTING: A REVIEW OF STATUS AND CHALLENGES Eric Grimit and Kristin Larson 3TIER, Inc. Pacific Northwest Weather Workshop March 5-6, 2010 Integrating Renewable Energy» Variable

More information

Endogenous Information Choice

Endogenous Information Choice Endogenous Information Choice Lecture 7 February 11, 2015 An optimizing trader will process those prices of most importance to his decision problem most frequently and carefully, those of less importance

More information

Quick Review on Linear Multiple Regression

Quick Review on Linear Multiple Regression Quick Review on Linear Multiple Regression Mei-Yuan Chen Department of Finance National Chung Hsing University March 6, 2007 Introduction for Conditional Mean Modeling Suppose random variables Y, X 1,

More information

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Andrew O. Finley Department of Forestry & Department of Geography, Michigan State University, Lansing

More information

= observed volume on day l for bin j = base volume in jth bin, and = residual error, assumed independent with mean zero.

= observed volume on day l for bin j = base volume in jth bin, and = residual error, assumed independent with mean zero. QB research September 4, 06 Page -Minute Bin Volume Forecast Model Overview In response to strong client demand, Quantitative Brokers (QB) has developed a new algorithm called Closer that specifically

More information

1 Random walks and data

1 Random walks and data Inference, Models and Simulation for Complex Systems CSCI 7-1 Lecture 7 15 September 11 Prof. Aaron Clauset 1 Random walks and data Supposeyou have some time-series data x 1,x,x 3,...,x T and you want

More information

Dominant Factor Analysis by Nonlinear Polymodels

Dominant Factor Analysis by Nonlinear Polymodels Dominant Factor Analysis by Nonlinear Polymodels RAPHAEL DOUADY Stony Brook University Labex ReFi, CNRS OCTOBER 9, 2017 M C FA M D I S T I N G U I S H E D L E C T U R E Traditional Multi-Factor Analysis

More information

Complex Systems Workshop Lecture III: Behavioral Asset Pricing Model with Heterogeneous Beliefs

Complex Systems Workshop Lecture III: Behavioral Asset Pricing Model with Heterogeneous Beliefs Complex Systems Workshop Lecture III: Behavioral Asset Pricing Model with Heterogeneous Beliefs Cars Hommes CeNDEF, UvA CEF 2013, July 9, Vancouver Cars Hommes (CeNDEF, UvA) Complex Systems CEF 2013, Vancouver

More information

Statistics - Lecture One. Outline. Charlotte Wickham 1. Basic ideas about estimation

Statistics - Lecture One. Outline. Charlotte Wickham  1. Basic ideas about estimation Statistics - Lecture One Charlotte Wickham wickham@stat.berkeley.edu http://www.stat.berkeley.edu/~wickham/ Outline 1. Basic ideas about estimation 2. Method of Moments 3. Maximum Likelihood 4. Confidence

More information

J2.4 SKILLFUL SEASONAL DEGREE-DAY FORECASTS AND THEIR UTILITY IN THE WEATHER DERIVATIVES MARKET

J2.4 SKILLFUL SEASONAL DEGREE-DAY FORECASTS AND THEIR UTILITY IN THE WEATHER DERIVATIVES MARKET J2.4 SKILLFUL SEASONAL DEGREE-DAY FORECASTS AND THEIR UTILITY IN THE WEATHER DERIVATIVES MARKET Jeffrey A. Shorter, Todd M. Crawford, Robert J. Boucher, James P. Burbridge WSI Corporation, Billerica, MA

More information

Components for Accurate Forecasting & Continuous Forecast Improvement

Components for Accurate Forecasting & Continuous Forecast Improvement Components for Accurate Forecasting & Continuous Forecast Improvement An ISIS Solutions White Paper November 2009 Page 1 Achieving forecast accuracy for business applications one year in advance requires

More information

interval forecasting

interval forecasting Interval Forecasting Based on Chapter 7 of the Time Series Forecasting by Chatfield Econometric Forecasting, January 2008 Outline 1 2 3 4 5 Terminology Interval Forecasts Density Forecast Fan Chart Most

More information

Energy Forecasting Customers: Analysing end users requirements Dec 3rd, 2013 Carlos Alberto Castaño, PhD Head of R&D

Energy Forecasting Customers: Analysing end users requirements Dec 3rd, 2013 Carlos Alberto Castaño, PhD Head of R&D IT Solutions for Renewables Energy Forecasting Customers: Analysing end users requirements Dec 3rd, 2013 Carlos Alberto Castaño, PhD Head of R&D carlos.castano@gnarum.com I. Who we are II. Customers Profiles

More information

Bagging and Forecasting in Nonlinear Dynamic Models

Bagging and Forecasting in Nonlinear Dynamic Models DBJ Discussion Paper Series, No.0905 Bagging and Forecasting in Nonlinear Dynamic Models Mari Sakudo (Research Institute of Capital Formation, Development Bank of Japan, and Department of Economics, Sophia

More information

Econometric Forecasting

Econometric Forecasting Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 1, 2014 Outline Introduction Model-free extrapolation Univariate time-series models Trend

More information

Nonlinear and/or Non-normal Filtering. Jesús Fernández-Villaverde University of Pennsylvania

Nonlinear and/or Non-normal Filtering. Jesús Fernández-Villaverde University of Pennsylvania Nonlinear and/or Non-normal Filtering Jesús Fernández-Villaverde University of Pennsylvania 1 Motivation Nonlinear and/or non-gaussian filtering, smoothing, and forecasting (NLGF) problems are pervasive

More information

arxiv: v1 [cs.lg] 2 Feb 2018

arxiv: v1 [cs.lg] 2 Feb 2018 Short-term Memory of Deep RNN Claudio Gallicchio arxiv:1802.00748v1 [cs.lg] 2 Feb 2018 Department of Computer Science, University of Pisa Largo Bruno Pontecorvo 3-56127 Pisa, Italy Abstract. The extension

More information

Machine learning, shrinkage estimation, and economic theory

Machine learning, shrinkage estimation, and economic theory Machine learning, shrinkage estimation, and economic theory Maximilian Kasy December 14, 2018 1 / 43 Introduction Recent years saw a boom of machine learning methods. Impressive advances in domains such

More information

Discussion of Tests of Equal Predictive Ability with Real-Time Data by T. E. Clark and M.W. McCracken

Discussion of Tests of Equal Predictive Ability with Real-Time Data by T. E. Clark and M.W. McCracken Discussion of Tests of Equal Predictive Ability with Real-Time Data by T. E. Clark and M.W. McCracken Juri Marcucci Bank of Italy 5 th ECB Workshop on Forecasting Techniques Forecast Uncertainty in Macroeconomics

More information

Particle Filtering for Data-Driven Simulation and Optimization

Particle Filtering for Data-Driven Simulation and Optimization Particle Filtering for Data-Driven Simulation and Optimization John R. Birge The University of Chicago Booth School of Business Includes joint work with Nicholas Polson. JRBirge INFORMS Phoenix, October

More information

Deep Learning Architecture for Univariate Time Series Forecasting

Deep Learning Architecture for Univariate Time Series Forecasting CS229,Technical Report, 2014 Deep Learning Architecture for Univariate Time Series Forecasting Dmitry Vengertsev 1 Abstract This paper studies the problem of applying machine learning with deep architecture

More information

Recovery Analysis Methods and Data Requirements Study

Recovery Analysis Methods and Data Requirements Study Elevation Recovery Analysis Methods and Data Requirements Study Update to NTB Phase II Local Technical Peer Review Group December 3, 2003 Time 1 Schedule for Pumpage Reductions 180 160 140 120 158 121

More information

Diagnostic Test for GARCH Models Based on Absolute Residual Autocorrelations

Diagnostic Test for GARCH Models Based on Absolute Residual Autocorrelations Diagnostic Test for GARCH Models Based on Absolute Residual Autocorrelations Farhat Iqbal Department of Statistics, University of Balochistan Quetta-Pakistan farhatiqb@gmail.com Abstract In this paper

More information

If we want to analyze experimental or simulated data we might encounter the following tasks:

If we want to analyze experimental or simulated data we might encounter the following tasks: Chapter 1 Introduction If we want to analyze experimental or simulated data we might encounter the following tasks: Characterization of the source of the signal and diagnosis Studying dependencies Prediction

More information

Economic modelling and forecasting

Economic modelling and forecasting Economic modelling and forecasting 2-6 February 2015 Bank of England he generalised method of moments Ole Rummel Adviser, CCBS at the Bank of England ole.rummel@bankofengland.co.uk Outline Classical estimation

More information

Chapter 13: Forecasting

Chapter 13: Forecasting Chapter 13: Forecasting Assistant Prof. Abed Schokry Operations and Productions Management First Semester 2013-2014 Chapter 13: Learning Outcomes You should be able to: List the elements of a good forecast

More information

Double Robustness. Bang and Robins (2005) Kang and Schafer (2007)

Double Robustness. Bang and Robins (2005) Kang and Schafer (2007) Double Robustness Bang and Robins (2005) Kang and Schafer (2007) Set-Up Assume throughout that treatment assignment is ignorable given covariates (similar to assumption that data are missing at random

More information

ECON3327: Financial Econometrics, Spring 2016

ECON3327: Financial Econometrics, Spring 2016 ECON3327: Financial Econometrics, Spring 2016 Wooldridge, Introductory Econometrics (5th ed, 2012) Chapter 11: OLS with time series data Stationary and weakly dependent time series The notion of a stationary

More information

Comparing Variance Reduction Techniques for Monte Carlo Simulation of Trading and Security in a Three-Area Power System

Comparing Variance Reduction Techniques for Monte Carlo Simulation of Trading and Security in a Three-Area Power System Comparing Variance Reduction Techniques for Monte Carlo Simulation of Trading and Security in a Three-Area Power System Magnus Perninge Email: magnus.perninge@ee.kth.se Mikael Amelin Email: mikael.amelin@ee.kth.se

More information

Bootstrapping Long Memory Tests: Some Monte Carlo Results

Bootstrapping Long Memory Tests: Some Monte Carlo Results Bootstrapping Long Memory Tests: Some Monte Carlo Results Anthony Murphy and Marwan Izzeldin University College Dublin and Cass Business School. July 2004 - Preliminary Abstract We investigate the bootstrapped

More information

Information Transmission and the Bullwhip Effect: Online Supplement

Information Transmission and the Bullwhip Effect: Online Supplement Information Transmission and the Bullwhip Effect: Online Supplement Robert L. Bray, Haim Mendelson Appendix A. Proposition Proofs Proof of Proposition 1: We first consider the case in which all signals

More information

Short-Term Irradiance Forecasting Using an Irradiance Sensor Network, Satellite Imagery, and Data Assimilation

Short-Term Irradiance Forecasting Using an Irradiance Sensor Network, Satellite Imagery, and Data Assimilation Short-Term Irradiance Forecasting Using an Irradiance Sensor Network, Satellite Imagery, and Data Assimilation Antonio Lorenzo Dissertation Defense April 14, 2017 Problem & Hypothesis Hypothesis 1: ground

More information

Chapter 5 Identifying hydrological persistence

Chapter 5 Identifying hydrological persistence 103 Chapter 5 Identifying hydrological persistence The previous chapter demonstrated that hydrologic data from across Australia is modulated by fluctuations in global climate modes. Various climate indices

More information

Lecture 7: Dynamic panel models 2

Lecture 7: Dynamic panel models 2 Lecture 7: Dynamic panel models 2 Ragnar Nymoen Department of Economics, UiO 25 February 2010 Main issues and references The Arellano and Bond method for GMM estimation of dynamic panel data models A stepwise

More information

Identifying Aggregate Liquidity Shocks with Monetary Policy Shocks: An Application using UK Data

Identifying Aggregate Liquidity Shocks with Monetary Policy Shocks: An Application using UK Data Identifying Aggregate Liquidity Shocks with Monetary Policy Shocks: An Application using UK Data Michael Ellington and Costas Milas Financial Services, Liquidity and Economic Activity Bank of England May

More information

Are financial markets becoming systemically more unstable?

Are financial markets becoming systemically more unstable? Are financial markets becoming systemically more unstable? Lucio Maria Calcagnile joint work with Giacomo Bormetti, Michele Treccani, Stefano Marmi, Fabrizio Lillo www.list-group.com www.quantlab.it Parma,

More information

Internal vs. external validity. External validity. This section is based on Stock and Watson s Chapter 9.

Internal vs. external validity. External validity. This section is based on Stock and Watson s Chapter 9. Section 7 Model Assessment This section is based on Stock and Watson s Chapter 9. Internal vs. external validity Internal validity refers to whether the analysis is valid for the population and sample

More information

Topics in Nonlinear Economic Dynamics: Bounded Rationality, Heterogeneous Expectations and Complex Adaptive Systems

Topics in Nonlinear Economic Dynamics: Bounded Rationality, Heterogeneous Expectations and Complex Adaptive Systems Topics in Nonlinear Economic Dynamics: Bounded Rationality, Heterogeneous Expectations and Complex Adaptive Systems CeNDEF, Amsterdam School of Economics University of Amsterdam PhD - Workshop Series in

More information

FE670 Algorithmic Trading Strategies. Stevens Institute of Technology

FE670 Algorithmic Trading Strategies. Stevens Institute of Technology FE670 Algorithmic Trading Strategies Lecture 8. Robust Portfolio Optimization Steve Yang Stevens Institute of Technology 10/17/2013 Outline 1 Robust Mean-Variance Formulations 2 Uncertain in Expected Return

More information

Is the Macroeconomy Locally Unstable and Why should we care?

Is the Macroeconomy Locally Unstable and Why should we care? Is the Macroeconomy Locally Unstable and Why should we care? Paul Beaudry, Dana Galizia & Franck Portier NBER macroannual April 2016 1 / 22 Introduction In most macro-models, BC fluctuation arises as the

More information

MFM Practitioner Module: Risk & Asset Allocation. John Dodson. February 18, 2015

MFM Practitioner Module: Risk & Asset Allocation. John Dodson. February 18, 2015 MFM Practitioner Module: Risk & Asset Allocation February 18, 2015 No introduction to portfolio optimization would be complete without acknowledging the significant contribution of the Markowitz mean-variance

More information

Appendix of the paper: Are interest rate options important for the assessment of interest rate risk?

Appendix of the paper: Are interest rate options important for the assessment of interest rate risk? Appendix of the paper: Are interest rate options important for the assessment of interest rate risk? Caio Almeida,a, José Vicente b a Graduate School of Economics, Getulio Vargas Foundation b Research

More information

Lecture 5: Unit Roots, Cointegration and Error Correction Models The Spurious Regression Problem

Lecture 5: Unit Roots, Cointegration and Error Correction Models The Spurious Regression Problem Lecture 5: Unit Roots, Cointegration and Error Correction Models The Spurious Regression Problem Prof. Massimo Guidolin 20192 Financial Econometrics Winter/Spring 2018 Overview Stochastic vs. deterministic

More information

The Prediction of Monthly Inflation Rate in Romania 1

The Prediction of Monthly Inflation Rate in Romania 1 Economic Insights Trends and Challenges Vol.III (LXVI) No. 2/2014 75-84 The Prediction of Monthly Inflation Rate in Romania 1 Mihaela Simionescu Institute for Economic Forecasting of the Romanian Academy,

More information

Market Risk. MFM Practitioner Module: Quantitiative Risk Management. John Dodson. February 8, Market Risk. John Dodson.

Market Risk. MFM Practitioner Module: Quantitiative Risk Management. John Dodson. February 8, Market Risk. John Dodson. MFM Practitioner Module: Quantitiative Risk Management February 8, 2017 This week s material ties together our discussion going back to the beginning of the fall term about risk measures based on the (single-period)

More information

Learning in Real Time: Theory and Empirical Evidence from the Term Structure of Survey Forecasts

Learning in Real Time: Theory and Empirical Evidence from the Term Structure of Survey Forecasts Learning in Real Time: Theory and Empirical Evidence from the Term Structure of Survey Forecasts Andrew Patton and Allan Timmermann Oxford and UC-San Diego November 2007 Motivation Uncertainty about macroeconomic

More information