Improving the accuracy of solar irradiance forecasts based on Numerical Weather Prediction

Similar documents
Assessment of the Australian Bureau of Meteorology hourly gridded solar data

Validation of operational NWP forecasts for global, diffuse and direct solar exposure over Australia

FORECAST ASSESSMENT OF SURFACE SOLAR RADIATION OVER AUSTRALIA

Importance of Numerical Weather Prediction in Variable Renewable Energy Forecast

OPTIMISING THE TEMPORAL AVERAGING PERIOD OF POINT SURFACE SOLAR RESOURCE MEASUREMENTS FOR CORRELATION WITH AREAL SATELLITE ESTIMATES

An Adaptive Multi-Modeling Approach to Solar Nowcasting

SOLAR POWER FORECASTING BASED ON NUMERICAL WEATHER PREDICTION, SATELLITE DATA, AND POWER MEASUREMENTS

A Community Gridded Atmospheric Forecast System for Calibrated Solar Irradiance

The document was not produced by the CAISO and therefore does not necessarily reflect its views or opinion.

Solar Nowcasting with Cluster-based Detrending

CARLOS F. M. COIMBRA (PI) HUGO T. C. PEDRO (CO-PI)

A SOLAR AND WIND INTEGRATED FORECAST TOOL (SWIFT) DESIGNED FOR THE MANAGEMENT OF RENEWABLE ENERGY VARIABILITY ON HAWAIIAN GRID SYSTEMS

Tom Durrant Frank Woodcock. Diana Greenslade

The Forecasting Challenge. The Forecasting Challenge CEEM,

Probabilistic forecasting of solar radiation

Global Solar Dataset for PV Prospecting. Gwendalyn Bender Vaisala, Solar Offering Manager for 3TIER Assessment Services

Chapter 2 Available Solar Radiation

Multi-Plant Photovoltaic Energy Forecasting Challenge with Regression Tree Ensembles and Hourly Average Forecasts

David John Gagne II, NCAR

Short-Term Irradiance Forecasting Using an Irradiance Sensor Network, Satellite Imagery, and Data Assimilation

ECMWF global reanalyses: Resources for the wind energy community

Teaming up for the solar powered future

DRAFT: CLOUD VELOCITY ESTIMATION FROM AN ARRAY OF SOLAR RADIATION MEASUREMENTS

Short- term solar forecas/ng with sta/s/cal models and combina/on of models

Mean monthly radiation surfaces for Australia at 1 arc-second resolution

Forecasting Solar Irradiance from Time Series with Exogenous Information

Solar irradiance forecasting for Chulalongkorn University location using time series models

Improving Efficiency of PV Systems Using Statistical Performance Monitoring

CLOUD VELOCITY ESTIMATION FROM AN ARRAY OF SOLAR RADIATION MEASUREMENTS

AN AUSTRALIAN CLIMATIC DATA BANK FOR USE IN THE ESTIMATION OF BUILDING ENERGY USE. P J WALSH*, M C MUNRO', and J W SPENCER

HIGH SPATIAL AND TEMPORAL RESOLUTION ATMOSPHERIC MOTION VECTORS GENERATION, ERROR CHARACTERIZATION AND ASSIMILATION

Solar Resource Mapping in South Africa

FORECAST OF ENSEMBLE POWER PRODUCTION BY GRID-CONNECTED PV SYSTEMS

Height correction of atmospheric motion vectors (AMVs) using lidar observations

THE ROAD TO BANKABILITY: IMPROVING ASSESSMENTS FOR MORE ACCURATE FINANCIAL PLANNING

Implementation of global surface index at the Met Office. Submitted by Marion Mittermaier. Summary and purpose of document

Bias correction of satellite data at Météo-France

Post-processing of solar irradiance forecasts from WRF Model at Reunion Island

AN ARTIFICIAL NEURAL NETWORK BASED APPROACH FOR ESTIMATING DIRECT NORMAL, DIFFUSE HORIZONTAL AND GLOBAL HORIZONTAL IRRADIANCES USING SATELLITE IMAGES

Short-term Solar Forecasting

Short and medium term solar irradiance and power forecasting given high penetration and a tropical environment

Climate Variables for Energy: WP2

Module 11: Meteorology Topic 5 Content: Weather Maps Notes

IMPROVED MODEL FOR FORECASTING GLOBAL SOLAR IRRADIANCE DURING SUNNY AND CLOUDY DAYS. Bogdan-Gabriel Burduhos, Mircea Neagoe *

Satellite-based solar irradiance assessment and forecasting in tropical insular areas

SUNY Satellite-to-Solar Irradiance Model Improvements

COMPARISON OF CLEAR-SKY MODELS FOR EVALUATING SOLAR FORECASTING SKILL

AN INTERNATIONAL SOLAR IRRADIANCE DATA INGEST SYSTEM FOR FORECASTING SOLAR POWER AND AGRICULTURAL CROP YIELDS

Impact of METOP ASCAT Ocean Surface Winds in the NCEP GDAS/GFS and NRL NAVDAS

Utilization of Forecast Models in High Temporal GOES Sounding Retrievals

Multi-Model Ensemble for day ahead PV power forecasting improvement

SDG&E Meteorology. EDO Major Projects. Electric Distribution Operations

Sky Cover: Shining Light on a Gloomy Problem

FORECASTING: A REVIEW OF STATUS AND CHALLENGES. Eric Grimit and Kristin Larson 3TIER, Inc. Pacific Northwest Weather Workshop March 5-6, 2010

Bucharest Romania.

Assimilation of Cloud Affected Infrared Radiances in HIRLAM 4D Var

WMO Aeronautical Meteorology Scientific Conference 2017

Speedwell High Resolution WRF Forecasts. Application

STATUS OF JAPANESE METEOROLOGICAL SATELLITES AND RECENT ACTIVITIES OF MSC

Solar irradiance forecasting for Chulalongkorn University location using time series models

Shadow camera system for the validation of nowcasted plant-size irradiance maps

ECML PKDD Discovery Challenges 2017

The Center for Renewable Resource Integration at UC San Diego

Data Analytics for Solar Energy Management

Remote Sensing and Sensor Networks:

Country scale solar irradiance forecasting for PV power trading

MÉRA: Met Éireann ReAnalysis Global Shortwave Radiation

Using Multivariate Adaptive Constructed Analogs (MACA) data product for climate projections

COMPARISON OF CLEAR-SKY MODELS FOR EVALUATING SOLAR FORECASTING SKILL

Satellite-to-Irradiance Modeling A New Version of the SUNY Model

4.5 Comparison of weather data from the Remote Automated Weather Station network and the North American Regional Reanalysis

Purdue University Meteorological Tool (PUMET)

Introducing NREL s Gridded National Solar Radiation Data Base (NSRDB)

London Heathrow Field Site Metadata

Interactive comment on Characterisation of J(O 1 D) at Cape Grim by S. R. Wilson

DNICast Direct Normal Irradiance Nowcasting methods for optimized operation of concentrating solar technologies

Simulating roll clouds associated with low-level convergence in WRF

onboard of Metop-A COSMIC Workshop 2009 Boulder, USA

Nonlinear Bias Correction for Satellite Data Assimilation using A Taylor Series Polynomial Expansion of the Observation Departures

The WMO Global Basic Observing Network (GBON)

ABOUT UNCERTAINTIES IN SIMULATION MODELS FOR BUILDING SYSTEMS CONTROL

Introduction to Meteorology and Weather Forecasting

Recent Data Assimilation Activities at Environment Canada

3TIER Global Solar Dataset: Methodology and Validation

Irradiance Forecasts for Electricity Production. Satellite-based Nowcasting for Solar Power Plants and Distribution Networks

Numerical Weather prediction at the European Centre for Medium-Range Weather Forecasts

Multi-Plant Photovoltaic Energy Forecasting Challenge: Second place solution

Weather Forecasting. March 26, 2009

Application and verification of ECMWF products 2009

AC : INVESTIGATIONS ON SOLAR DATA AND A GRID-TIED SOLAR PHOTOVOLTAIC ARRAY

142 HAIL CLIMATOLOGY OF AUSTRALIA BASED ON LIGHTNING AND REANALYSIS

OSSE to infer the impact of Arctic AMVs extracted from highly elliptical orbit imagery

Creation of a 30 years-long high resolution homogenized solar radiation data set over the

Sun to Market Solutions

AMPS Update June 2016

Weather Forecasting. pencils, colored daily weather maps for consecutive days (5)

CHAPTER 13 WEATHER ANALYSIS AND FORECASTING MULTIPLE CHOICE QUESTIONS

PIRP Forecast Performance

Direct Normal Radiation from Global Radiation for Indian Stations

Current best practice of uncertainty forecast for wind energy

Transcription:

Improving the accuracy of solar irradiance forecasts based on Numerical Weather Prediction Bibek Joshi, Alistair Bruce Sproul, Jessie Kai Copper, Merlinde Kay

Why solar power forecasting? Electricity grid management Solar power plant operation Residential energy management P2P trading

Spatial resolution/ horizon (km) PV power and solar irradiance forecasting methods 1000 100 10 1 0.1 Sky Imagery Satellite Imagery Best forecasts from NWP Solar irradiance forecasts Temperature ad wind forecasts PV system model 0.01 PV generation forecasts 0.001 0.01 0.1 1 10 100 1000 Time horizon (hr) Figure: Classification of forecast model based on spatial and temporal resolution (Inspired by Diagne et al. 2013)

Numerical Weather Prediction (NWP) Data products Surface level forecasts Isobaric levels forecasts Source: http://www.jma.go.jp/jma/jma-eng/jma-center/nwp/grid.jpg

NWP errors Data collection and assimilation Grid resolution Cloud representation Error propagation Machine learning models can learn significant portion of the complex atmospheric process

Data sources Attributes NWP Domain Spatial resolution Time steps Description ACCESS-R APS2 Australian continent and surrounding seas 0.11 (~12 km) Hourly out to 72 hours Data period: Aug 2017 Jul 2018 Location of ground measurement stations

NWP Errors x x Obs: Observations C: ACCESS-C NWP R: ACCESS-R NWP CS: Clear sky model

Input dataset Surface level forecasts Global horizontal irradiance Direct horizontal irradiance Diffuse horizontal irradiance Air temperature Total cloud cover High cloud cover Middle cloud cover Low cloud cover Specific humidity Mean sea level pressure Wind speed (u component) Wind speed (v component) Heights of cloud bases for different oktas Isobaric levels forecasts Air temperature Relative humidity Wind speed (u component) Wind speed (v component) Vertical wind speed Geopotential height Isobaric levels (hpa): 500,600,700,800,850,900,950, 1000 Solar position variables Solar zenith angle Extraterrestrial irradiance Measured Global Horizontal Irradiance (GHI) Hourly aggregated GHI from ground stations

Inputs Relevant surface level forecasts Relevant isobaric levels forecasts Solar position variables Total number of features = 63 Improving GHI forecast accuracy: Machine learning framework Feature selection Mutual Info Regression Principle Component Analysis Gradient Boosting Regression (GBR) Optimization of model parameters Training, validation and testing Hourly average GHI forecasts (1-24h) Immediate past 3 months data used for training Training stage Target hourly GHI The model is trained separately for each site on a daily rolling basis to forecast 24-h window.

Dynamic selection of hyperparameters of GBR Site: Adelaide Site: Adelaide Trained using default hyperparameters Computation time per site: ~ 220 seconds Trained using dynamic selection of hyperparameters Computation time per site: ~415 seconds

Forecast vs Observed GHI: All sites R 2 =0.84 R 2 =0.88 R 2 =0.91 Raw model Model 1 Inputs to machine learning Surface level forecasts Solar position variables Model 2 Inputs to machine learning Surface level forecasts Isobaric level forecasts Solar position variables

Performance metrics for GHI forecasts: All sites 40% 30% 20% 10% 0% -10% NMBD NMAD NRMSD Persistence Raw Model1 Model2 NRMSD for Model 1 and Model 2 reduced by 17% and 31%, respectively, with respect to the raw model NMBD: Normalized Mean Bias Deviation NMAD: Normalized Mean Absolute Deviation NRMSD: Normalized Root Mean Squared Deviation

Performance metrics: individual sites MBD (W/m 2 ) 20 10 0-10 -20-30 -40-50 -60-70 Adelaide Alice Springs Broome Cape Grim Darwin Geraldton Kalgoorlie Boulder Learmonth Melbourne Rockhampton Townsville Wagga Wagga Raw Model 1 Model 2 Persistence RMSD (W/m 2 ) 250 200 150 100 50 0 Adelaide Alice Springs Broome Cape Grim Darwin Geraldton Kalgoorlie Boulder Learmonth Melbourne Rockhampton Townsville Wagga Wagga Raw Model 1 Model 2 Persistence

Forecast performance in different sky conditions Overcast Cloudy Clear kk tt = GGGGII tt GGGGII cccc wwwwwwwww GGGGII tt iiii oooooooooooooooo GGGGGG aaaaaa GGGGII cccc iiii estimated cccccccccc ssssss GGGGGG Observed

Sample time series Site: Adelaide

Summary and conclusions Information from forecast variables other than solar irradiance can be leveraged to improve solar irradiance forecast accuracy. Isobaric forecasts contribute to additional improvement in forecast accuracy relative to the models using surface level forecasts only. Boosting methods can easily overfit the training data. Dynamic selection of hyperparameters can mitigate overfitting issues.

Thank you! Acknowledgements This research is funded by Cooperative Research Centres for Low Carbon Living Ltd (CRC-LCL), an Australian Government Initiative and supported by Solar Analytics Pty Ltd, an automated fault monitoring service for rooftop solar energy systems The ACCESS NWP forecasts were provided by the Australian Bureau of Meteorology for this research.