Multi-Model Calibrated Probabilistic Seasonal Forecasts of Regional Arctic Sea Ice Coverage

Similar documents
Current status and plans for developing sea ice forecast services and products for the WMO Arctic Regional Climate Centre Sea Ice Outlook

Seasonal Prediction, based on Canadian Seasonal to Interannual Prediction system (CanSIPS) for the Fifth South West Indian Ocean Climate Outlook Forum

Second Session of the Pan-Arctic Regional Climate Outlook Forum (PARCOF-2), virtual forum, October 2018

SEA ICE PREDICTION NETWORK (SIPN) Pan-Arctic Sea Ice Outlook Core Contributions June 2015 Report

Sea ice thickness. Ed Blanchard-Wrigglesworth University of Washington

Climate Models and Snow: Projections and Predictions, Decades to Days

Environment and Climate Change Canada / GPC Montreal

The Canadian Seasonal to Interannual Prediction System (CanSIPS)

The role of sea-ice in extended range prediction of atmosphere and ocean

Seasonal forecast skill of Arctic sea ice area in a dynamical forecast system

Developing Operational MME Forecasts for Subseasonal Timescales

2014 September Arctic Sea Ice Outlook

ALASKA REGION CLIMATE OUTLOOK BRIEFING. July 20, 2018 Rick Thoman National Weather Service Alaska Region

The Northern Hemisphere Sea ice Trends: Regional Features and the Late 1990s Change. Renguang Wu

Using Arctic Ocean Color Data in ocean-sea ice-biogeochemistry seasonal forecasting systems

Sea Ice Forecast Verification in the Canadian Global Ice Ocean Prediction System

An Assessment of the Navy's Sea Ice Outlook Predictions for 2014

SEA ICE OUTLOOK 2016 Report

Quantifying uncertainty in monthly and seasonal forecasts of indices

Seasonal Climate Watch June to October 2018

ALASKA REGION CLIMATE OUTLOOK BRIEFING. June 22, 2018 Rick Thoman National Weather Service Alaska Region

Arctic sea ice falls below 4 million square kilometers

S e a s o n a l F o r e c a s t i n g f o r t h e E u r o p e a n e n e r g y s e c t o r

Advancements and Limitations in Understanding and Predicting Arctic Climate Change

Behind the Climate Prediction Center s Extended and Long Range Outlooks Mike Halpert, Deputy Director Climate Prediction Center / NCEP

Seasonal Forecasts of River Flow in France

SEA ICE OUTLOOK 2016 Report

Changing Marine Access in the Arctic Ocean: The Arctic Climate Impact Assessment Panama Canal Authority 11 January 2005

ALASKA REGION CLIMATE OUTLOOK BRIEFING. November 16, 2018 Rick Thoman Alaska Center for Climate Assessment and Policy

SEA ICE OUTLOOK 2016 Report

Is CESM the best Earth System Model? Reto Knutti Institute for Atmospheric and Climate Science ETH Zurich, Switzerland

Climate Outlook for October 2017 March 2018

(1) Arctic Sea Ice Predictability,

Arctic Ocean simulation in the CCSM4

The Canadian approach to ensemble prediction

Winter Forecast for GPC Tokyo. Shotaro TANAKA Tokyo Climate Center (TCC) Japan Meteorological Agency (JMA)

Multi model seasonal forecast of Arctic sea ice: forecast uncertainty at pan Arctic and regional scales

Fire Season Prediction for Canada, Kerry Anderson Canadian Forest Service

Ensemble Verification Metrics

Expansion of Climate Prediction Center Products

Canadian contribution to the Year of Polar Prediction: deterministic and ensemble coupled atmosphere-ice-ocean forecasts

arxiv: v5 [physics.ao-ph] 12 Sep 2018

Assessing the impact of Arctic sea ice variability on Greenland Ice Sheet surface mass and energy exchange

EMC Probabilistic Forecast Verification for Sub-season Scales

Sea ice outlook 2010

CNRM pan-arctic sea ice outlook for September 2016 sea ice extent initialized in early July Matthieu Chevallier, Constantin Ardilouze, Lauriane Batté

Strategy for Using CPC Precipitation and Temperature Forecasts to Create Ensemble Forcing for NWS Ensemble Streamflow Prediction (ESP)

Kevin Ewans Shell International Exploration and Production

BREA Final Results Forum Results from the Canadian Centre for Climate Modelling and Analysis

Challenges for Climate Science in the Arctic. Ralf Döscher Rossby Centre, SMHI, Sweden

T2.2: Development of assimilation techniques for improved use of surface observations

CMIP5-based global wave climate projections including the entire Arctic Ocean

3.6 NCEP s Global Icing Ensemble Prediction and Evaluation

Variations of the Asian Monsoon and Simulations and Predictions by the NCEP CFS Song Yang

The CMC Monthly Forecasting System

ENSEMBLE FLOOD INUNDATION FORECASTING: A CASE STUDY IN THE TIDAL DELAWARE RIVER

Seasonal Climate Watch July to November 2018

Seasonal Climate Watch September 2018 to January 2019

Seasonal forecasting with the NMME with a focus on Africa

Outline: 1) Extremes were triggered by anomalous synoptic patterns 2) Cloud-Radiation-PWV positive feedback on 2007 low SIE

arxiv: v2 [physics.ao-ph] 16 Nov 2017

Correction to Evaluation of the simulation of the annual cycle of Arctic and Antarctic sea ice coverages by 11 major global climate models

NSIDC Sea Ice Outlook Contribution, 31 May 2012

Extreme, transient Moisture Transport in the high-latitude North Atlantic sector and Impacts on Sea-ice concentration:

Drought forecasting methods Blaz Kurnik DESERT Action JRC

Arctic sea ice prediction from days to centuries

ALASKA REGION CLIMATE OUTLOOK BRIEFING. December 22, 2017 Rick Thoman National Weather Service Alaska Region

Arctic Cap Nowcast Forecast System (ACNFS) end of summer 2013 Ice Extent Projection July Report

ALASKA REGION CLIMATE OUTLOOK BRIEFING. November 17, 2017 Rick Thoman National Weather Service Alaska Region

Dynamical Statistical Seasonal Prediction of Atlantic Hurricane Activity at NCEP

Twenty-five winters of unexpected Eurasian cooling unlikely due to Arctic sea-ice loss

Physical systematic biases

ALASKA REGION CLIMATE FORECAST BRIEFING. January 23, 2015 Rick Thoman ESSD Climate Services

June Report: Outlook Based on May Data Regional Outlook: Beaufort and Chuckchi Seas, High Arctic, and Northwest Passage

Advantages and limitations of different statistical downscaling approaches for seasonal forecasting

Sea Ice Data Assimilation in the Arctic via DART/CICE5 in the CESM1

5.2 PRE-PROCESSING OF ATMOSPHERIC FORCING FOR ENSEMBLE STREAMFLOW PREDICTION

Seasonal Forecasts of the Pan-Arctic Sea Ice Extent Using a GCM-Based Seasonal Prediction System

Basic Verification Concepts

Worrying about Snow. Ed B-W, UW, Seattle with CC Bitz. Thanks to NCAR (Jen Kay, PCWG)

Possible Applications of Deep Neural Networks in Climate and Weather. David M. Hall Assistant Research Professor Dept. Computer Science, CU Boulder

Attribution of Surface Radiation Biases in NWP and Climate Models near the US Southern Great Plains

Evaluating weather and climate forecasts

FAMOS for YOPP Forum for Arctic Modeling and Observational Synthesis (FAMOS) for Year of Polar Prediction (YOPP)

Operational use of ensemble hydrometeorological forecasts at EDF (french producer of energy)

Inflow Forecasting for Hydropower Operations: Bayesian Model Averaging for Postprocessing Hydrological Ensembles

Projections of 21st century Arctic sea ice loss. Alexandra Jahn University of Colorado Boulder

The MSC Beaufort Wind and Wave Reanalysis

Use of extended range and seasonal forecasts at MeteoSwiss

ON IMPROVING ENSEMBLE FORECASTING OF EXTREME PRECIPITATION USING THE NWS METEOROLOGICAL ENSEMBLE FORECAST PROCESSOR (MEFP)

Climate Projections and Energy Security

ALASKA REGION CLIMATE FORECAST BRIEFING. October 27, 2017 Rick Thoman National Weather Service Alaska Region

Verification of Probability Forecasts

Sea ice outlook 2011

Seasonal predictions of ice extent in the Arctic Ocean

Early Student Support to Investigate the Role of Sea Ice-Albedo Feedback in Sea Ice Predictions

Conditional weather resampling for ensemble streamflow forecasting

On assessing temporal variability and trends of coupled arctic energy budgets. Michael Mayer Leo Haimberger

JP3.7 SHORT-RANGE ENSEMBLE PRECIPITATION FORECASTS FOR NWS ADVANCED HYDROLOGIC PREDICTION SERVICES (AHPS): PARAMETER ESTIMATION ISSUES

Using Convection-Allowing Models to Produce Forecast Guidance For Severe Thunderstorm Hazards via a Surrogate-Severe Approach!

Transcription:

Multi-Model Calibrated Probabilistic Seasonal Forecasts of Regional Arctic Sea Ice Coverage 2018 Polar Prediction Workshop Arlan Dirkson, William Merryfield, Bertrand Denis Thanks to Woosung Lee and Adam Monahan Support: CanSISE and FRAMS Département des sciences de la Terre et de l Atmosphére Université du Québec à Montréal May 8, 2018 1 / 13

Sea Ice Probability, SIO 2017 https://www.arcus.org/sipn/sea-ice-outlook 2 / 13

Sea Ice Probability, SIO 2017 https://www.arcus.org/sipn/sea-ice-outlook 2 / 13

Motivation Sea ice forecasts on seasonal and sub-seasonal timescales are uncertain uncertainty should be quantified. 3 / 13

Motivation Sea ice forecasts on seasonal and sub-seasonal timescales are uncertain uncertainty should be quantified. Sea ice probability (SIP) metric for Sea Ice Outlook (Stroeve, 2015; Wrigglesworth et al. 2017). 3 / 13

Motivation Sea ice forecasts on seasonal and sub-seasonal timescales are uncertain uncertainty should be quantified. Sea ice probability (SIP) metric for Sea Ice Outlook (Stroeve, 2015; Wrigglesworth et al. 2017). Forecast ensembles are (generally) small and can inadequately described the forecast probability distribution (Richardson, 2001). 3 / 13

Motivation Sea ice forecasts on seasonal and sub-seasonal timescales are uncertain uncertainty should be quantified. Sea ice probability (SIP) metric for Sea Ice Outlook (Stroeve, 2015; Wrigglesworth et al. 2017). Forecast ensembles are (generally) small and can inadequately described the forecast probability distribution (Richardson, 2001). Estimate by fitting appropriate distribution to forecast ensemble (Wilks, 2002). 3 / 13

Motivation Sea ice forecasts on seasonal and sub-seasonal timescales are uncertain uncertainty should be quantified. Sea ice probability (SIP) metric for Sea Ice Outlook (Stroeve, 2015; Wrigglesworth et al. 2017). Forecast ensembles are (generally) small and can inadequately described the forecast probability distribution (Richardson, 2001). Estimate by fitting appropriate distribution to forecast ensemble (Wilks, 2002). Model errors can be large, and need to be corrected. 3 / 13

Motivation Sea ice forecasts on seasonal and sub-seasonal timescales are uncertain uncertainty should be quantified. Sea ice probability (SIP) metric for Sea Ice Outlook (Stroeve, 2015; Wrigglesworth et al. 2017). Forecast ensembles are (generally) small and can inadequately described the forecast probability distribution (Richardson, 2001). Estimate by fitting appropriate distribution to forecast ensemble (Wilks, 2002). Model errors can be large, and need to be corrected. Multi-model averaging (cancellation of biases) 3 / 13

Motivation Sea ice forecasts on seasonal and sub-seasonal timescales are uncertain uncertainty should be quantified. Sea ice probability (SIP) metric for Sea Ice Outlook (Stroeve, 2015; Wrigglesworth et al. 2017). Forecast ensembles are (generally) small and can inadequately described the forecast probability distribution (Richardson, 2001). Estimate by fitting appropriate distribution to forecast ensemble (Wilks, 2002). Model errors can be large, and need to be corrected. Multi-model averaging (cancellation of biases) Calibration (based on past forecasts and observations) 3 / 13

Motivation Sea ice forecasts on seasonal and sub-seasonal timescales are uncertain uncertainty should be quantified. Sea ice probability (SIP) metric for Sea Ice Outlook (Stroeve, 2015; Wrigglesworth et al. 2017). Forecast ensembles are (generally) small and can inadequately described the forecast probability distribution (Richardson, 2001). Estimate by fitting appropriate distribution to forecast ensemble (Wilks, 2002). Model errors can be large, and need to be corrected. Multi-model averaging (cancellation of biases) Calibration (based on past forecasts and observations) Combination of both 3 / 13

Multi-Model Forecast Calibration (in a nutshell) Model 1 Observations Model 2 4 / 13

Multi-Model Forecast Calibration (in a nutshell) Model 1 Y = g(x 1 ) Observations Model 2 Y = h(x 2 ) 4 / 13

Multi-Model Forecast Calibration (in a nutshell) Model 1 Y = g(x 1 ) Observations Model 2 Y = h(x 2 ) 4 / 13

Multi-Model Forecast Calibration (in a nutshell) Model 1 Y = g(x 1 ) g Observations Model 2 Y = h(x 2 ) 4 / 13

Multi-Model Forecast Calibration (in a nutshell) Model 1 Y = g(x 1 ) g Observations Model 2 h Y = h(x 2 ) 4 / 13

Overview Experiment Details 5 / 13

Overview Experiment Details Models: CanCM3 and CanCM4 (Canadian Seasonal to Interannual Prediction System; CanSIPS) 5 / 13

Overview Experiment Details Models: CanCM3 and CanCM4 (Canadian Seasonal to Interannual Prediction System; CanSIPS) Hindcasts: September, 2000-2017 5 / 13

Overview Experiment Details Models: CanCM3 and CanCM4 (Canadian Seasonal to Interannual Prediction System; CanSIPS) Hindcasts: September, 2000-2017 Initialization Months: June, July, August 5 / 13

Overview Experiment Details Models: CanCM3 and CanCM4 (Canadian Seasonal to Interannual Prediction System; CanSIPS) Hindcasts: September, 2000-2017 Initialization Months: June, July, August Multi-Model Calibration 5 / 13

Overview Experiment Details Models: CanCM3 and CanCM4 (Canadian Seasonal to Interannual Prediction System; CanSIPS) Hindcasts: September, 2000-2017 Initialization Months: June, July, August Multi-Model Calibration Performed on the sea ice concentration (SIC) variable per model and per grid point. 5 / 13

Overview Experiment Details Models: CanCM3 and CanCM4 (Canadian Seasonal to Interannual Prediction System; CanSIPS) Hindcasts: September, 2000-2017 Initialization Months: June, July, August Multi-Model Calibration Performed on the sea ice concentration (SIC) variable per model and per grid point. Utilizes a parametric probability distribution suitable for SIC, the zero- and one- inflated beta (BEINF) distribution (Ospina and Ferrari, 2010). 5 / 13

Overview Experiment Details Models: CanCM3 and CanCM4 (Canadian Seasonal to Interannual Prediction System; CanSIPS) Hindcasts: September, 2000-2017 Initialization Months: June, July, August Multi-Model Calibration Performed on the sea ice concentration (SIC) variable per model and per grid point. Utilizes a parametric probability distribution suitable for SIC, the zero- and one- inflated beta (BEINF) distribution (Ospina and Ferrari, 2010). Trend-adjusted quantile mapping (TAQM) designed for the BEINF distribution and accounts for trends (Dirkson et al., 2018, Jclim (submitted)). 5 / 13

Multi-Model TAQM: September 2017, June-init Example for grid cell in East-Siberian Sea Sea Ice Concentration Sea Ice Concentration Sea Ice Concentration 1.0 0.8 0.6 0.4 Step 1. Adjust Historical Data for Trend CanCM3 t=2017 0.2 Original Trend-Adjusted 0.0 1980 1985 1990 1995 2000 CanCM4 2005 2010 2015 1.0 Original 0.8 Trend-Adjusted 0.6 0.4 0.2 0.0 1980 1985 1990 1995 2000 2005 Observations 2010 2015 1.0 0.8 0.6 0.4 0.2 Original Trend-Adjusted 0.0 1980 1985 1990 1995 2000 2005 2010 2015 Year t=2017 t=2017 6 / 13

Multi-Model TAQM: September 2017, June-init Example for grid cell in East-Siberian Sea Sea Ice Concentration Sea Ice Concentration Sea Ice Concentration 1.0 0.8 0.6 0.4 Step 2. Fit Historical Data to BEINF Distribution CanCM3 t=2017 0.2 Original Trend-Adjusted 0.0 1980 1985 1990 1995 2000 CanCM4 2005 2010 2015 1.0 Original 0.8 Trend-Adjusted 0.6 0.4 0.2 0.0 1980 1985 1990 1995 2000 2005 Observations 2010 2015 1.0 0.8 0.6 0.4 0.2 Original Trend-Adjusted 0.0 1980 1985 1990 1995 2000 2005 2010 2015 Year t=2017 t=2017 Probability Density Probability Density Probability Density 4 3 2 1 CanCM3 Original Trend-Adjusted 0 0.0 0.2 0.4 0.6 0.8 1.0 CanCM4 4 3 2 1 Original Trend-Adjusted 0 0.0 0.2 0.4 0.6 0.8 1.0 Observations 6 5 4 3 2 1 Original Trend-Adjusted 0 0.0 0.2 0.4 0.6 0.8 1.0 Sea Ice Concentration 7 / 13

Multi-Model TAQM: September 2017, June-init Example for grid cell in East-Siberian Sea Step 3. Calibrate Quantile map fcst values 0 < x t < 1: ˆx t = F 1 o,beta [F m,beta(x t )] Correct mean bias in P(x t = 0) and P(x t = 1) 1.0 CanCM3 Historical: 1981-2016 1.0 CanCM3 Forecast: 2017 Fbeta, Bernoulli Masses 0.8 0.6 0.4 0.2 CanCM3, x Obs, y Fbeta, Bernoulli Masses 0.8 0.6 0.4 0.2 uncal, xt taqm, xt 0.0 0.0 0.2 0.4 0.6 0.8 1.0 CanCM4 Historical: 1981-2016 1.0 0.0 0.0 0.2 0.4 0.6 0.8 1.0 CanCM4 Forecast: 2017 1.0 Fbeta, Bernoulli Masses 0.8 0.6 0.4 0.2 CanCM4, x Obs, y Fbeta, Bernoulli Masses 0.8 0.6 0.4 0.2 uncal, xt taqm, xt 0.0 0.0 0.2 0.4 0.6 0.8 1.0 Sea Ice Concentration 0.0 0.0 0.2 0.4 0.6 0.8 1.0 Sea Ice Concentration 8 / 13

Multi-Model TAQM: September 2017, June-init June-init 2017 September SIP P(SIC>0.15) CanCM3 (raw) BS = 0.217 CanCM4 (raw) BS = 0.129 observed ice edge CanCM3+CanCM4 (raw) BS = 0.136 1.0 0.8 0.6 CanCM3 (calibrated) CanCM4 (calibrated) BS = 0.096 BS = 0.091 CanCM3+CanCM4 (calibrated) BS = 0.087 0.4 0.2 0.0 9 / 13

Probabilistic Hindcast Skill: September 2000-2017 red=skill blue=no skill 2000-2017 September Hindcast Skill CRPSS = 1 CRPS fcst /CRPS climo June-init July-init August-init CanCM3+CanCM4 (raw) CanCM3+CanCM4 (raw) CanCM3+CanCM4 (raw) 0.5 0.25 0.0 CanCM3+CanCM4 (calibrated) CanCM3+CanCM4 (calibrated) CanCM3+CanCM4 (calibrated) -0.25-0.5-0.75-1.0 10 / 13

Early Forecast Contribution: Route Access May-init 2018 September Probability of OW Access 1.0 0.8 0.6 0.4 0.2 0.0 Low probability for access via both the NSR and NWP (< 20% for both) 11 / 13

Early-Consensus Forecast Contribution: Regional SIA Low 81% Low 75% Arctic Basin Greenland Sea Extreme 6% Low 5% Extreme 8% High High 13% Extreme Low 8% High Kara Sea Low Extreme High 19% Low 7% 19% 54% Extreme High East Siberian Sea Extreme Low Low 34% 14% High 39% 14% Extreme High Beaufort Sea Extreme Low Low 30% 29% 38% High Baffin Bay/Labrador Sea Ice Free Barents Sea Low Extreme 20% Low 20% 60% High Laptev Sea Low 22% 41% Extreme Low 27% 10% Extreme High High Chuckchi Sea Extreme Low Low 29% 29% 12% 30% High Extreme High Canadian Archipelago Low 35% Extreme Low 30% 32% High Arctic Basin: Low (very confident) Canadian Archipelago: Low (somewhat uncertain) Greenland Sea: Low (very confident) Barents/Kara Sea: High or Extreme High (somewhat confident) Laptev/East-Siberian Sea: High (somewhat uncertain) Beaufort/Chukchi Sea: Equal Prob (very uncertain) Baffin Bay/Labrador Sea: Ice Free (very confident) 12 / 13

Methods are open source! :) https://adirkson.github.io/sic-probability arlan.dirkson@gmail.com Thank you for listening! 13 / 13