Accurately forecasting wind and solar power output poses challenges for deeply decarbonized electricity systems. Grid operators must commit resources to provide reserves to ensure reliable operations in the face of forecast errors, a process which can increase fuel consumption and emissions. We apply neural network-based machine learning to expand the usefulness of median point forecast data by creating probabilistic distributions of short-term uncertainty in demand, wind, and solar forecasts that adapt to prevailing grid conditions. Machine learning derived estimates of forecast errors compare favorably to estimates based on incumbent methods. Reserves derived from machine learning are usually smaller than values derived using incumbent methods, which enables fuel savings during most hours. Machine learning reserves are generally larger than incumbent reserves during times of higher forecast error, potentially improving system reliability. Performance is tested using multistage production simulation modeling of the California Independent System Operator system. Machine learning reserves provide production cost and greenhouse gas (GHG) emission reductions of approximately 0.3% relative to historical 2019 requirements. Savings in the 2030 timeframe are highly dependent on battery storage capacity. At lower levels of battery capacity, savings of 0.4% from machine learning reserves are shown. Significant quantities of battery storage are expected to be added to meet California's resource adequacy needs and GHG reduction targets. The addition of these batteries saturates reserve needs and results in minimal within-hour balancing costs in 2030.

1.
J.
Williams
,
B.
Haley
,
F.
Kahrl
,
J.
Moore
,
A. D.
Jones
,
M. S.
Torn
, and
H.
McJeon
, “
Pathways to deep decarbonization in the United States
.” The U.S. report of the Deep Decarbonization Pathways Project of the Sustainable Development Solutions Network and the Institute for Sustainable Development and International Relations (
2015
), see https://irp-cdn.multiscreensite.com/be6d1d56/files/uploaded/DDPP_2015_REPORT.pdf.
2.
J.
Williams
,
A.
DeBenedictis
,
R.
Ghanadan
,
A.
Mahone
,
J.
Moore
,
W.
Morrow
 III
,
S.
Price
, and
M.
Torn
, “
The technology path to deep greenhouse gas emissions cuts by 2050: The pivotal role of electricity
,”
Science
335
(
6064
),
53
59
(
2012
).
3.
Y.
Sun
,
G.
Szűcs
, and
A. R.
Brandt
, “
Solar PV output prediction from video streams using convolutional neural networks
,”
Energy Environ. Sci.
11
,
1811
(
2018
).
4.
R.
Marquez
and
C.
Coimbra
, “
Intra-hour DNI forecasting based on cloud tracking images 515 analysis
,”
Sol. Energy
91
,
327
(
2013
).
5.
See Energy Exemplar, https://energyexemplar.com/products/plexos for “
PLEXOS Software version 8.3, 2021;
” accessed 21 December 2021.
6.
See
K.
Westendorf
, https://www.caiso.com/Documents/FlexibleRampingProductUncertaintyCalculationImplementationIssues.pdf for “
Flexible ramping product uncertainty calculation and implementation issues, 2018
;” accessed 21 December 2021.
7.
I.
Krad
,
E.
Ibanez
, and
W.
Gao
, “
A comprehensive comparison of current operating reserve methodologies
,” in
2016 IEEE/PES Transmission and Distribution Conference and Exposition (T&D)
,
2016
.
8.
E.
Spyrou
,
V.
Krishnan
,
Q.
Xu
, and
B. F.
Hobbs
, “
What is the value of alternative methods for estimating ramping needs?
,” in
2020 IEEE Green Technologies Conference
(
IEEE
,
2020
), pp.
159
164
.
9.
See Electricity Reliability Council of Texas ERCOT, http://www.ercot.com/content/wcm/key_documents_lists/137978/9_2019_Methodology_for_Determining_Minimum_Ancillary_Service_Requirements.pdf for “
Item 9: 2019 methodology for determining minimum ancillary service requirements;
” accessed 21 December 2021.
10.
S. A.
Fatemi
,
A.
Kuh
, and
M.
Fripp
, “
Parametric methods for probabilistic forecasting of solar irradiance
,”
Renewable Energy
129
,
666
(
2018
).
11.
I.
Takeuchi
,
Q.
Le
,
T.
Sears
, and
A.
Smola
, “
Nonparametric quantile estimation
,”
J. Mach. Learn. Res.
7
,
1231
(
2006
), see https://www.jmlr.org/papers/volume7/takeuchi06a/takeuchi06a.pdf.
12.
P.
Lauret
,
M.
David
, and
H. T.
Pedro
, “
Probabilistic solar forecasting using quantile regression models
,”
Energies
10
(
10
),
1591
(
2017
).
13.
A.
Khosravi
,
S.
Nahavandi
,
D.
Creighton
, and
A. F.
Atiya
, “
Lower upper bound estimation method for construction of neural network-based prediction intervals
,”
IEEE Trans. Neural Networks
22
(
3
),
337
(
2010
).
14.
F.
Liu
,
C.
Li
,
Y.
Xu
,
G.
Tang
, and
Y.
Xie
, “
A new lower and upper bound estimation model using gradient descend training method for wind speed interval prediction
,”
Wind Energy
24
(
3
),
290
(
2021
).
15.
F.
Golestaneh
,
P.
Pinson
, and
H. B.
Gooi
, “
Very short-term nonparametric probabilistic forecasting of renewable energy generation—With application to solar energy
,”
IEEE Trans. Power Syst.
31
(
5
),
3850
(
2016
).
16.
N.
Meinshausen
and
G.
Ridgeway
, “
Quantile regression forests
,”
J. Mach. Learn. Res.
7
,
983
(
2006
), see https://www.jmlr.org/papers/volume7/meinshausen06a/meinshausen06a.pdf.
17.
A.
Mayr
, “
Prediction inference with ensemble methods
,” Doctoral dissertation (
Institut Für Statistik
,
2010
).
18.
See Electric Power Research Institute, https://www.epri.com/research/programs/067417/ for “
Dynamic assessment and determination of operating reserve
;” accessed 21 December 2021.
19.
C.
Zhao
and
C.
Wan
, “
Operating reserve quantification using prediction intervals of wind power: An integrated probabilistic forecasting and decision methodology
,”
IEEE Trans. Power Syst.
36
(
4
),
3701
(
2021
).
20.
M.
Mattos
,
R.
Bessa
,
A.
Botterud
, and
Z.
Zhou
,
Renewable Energy Forecasting: From Models to Applications
(
Woodhead Publishing
,
2017
), pp.
279
308
.
21.
K.
De Vos
,
N.
Stevens
,
O.
Devolder
,
A.
Papavasiliou
,
B.
Hebb
, and
J.
Matthys-Donnadieu
, “
Dynamic dimensioning approach for operating reserves: Proof of concept in Belgium
,”
Energy Policy
124
,
272
(
2019
).
22.
See
J.
Novacheck
,
G.
Brinkman
, and
G.
Porro
, https://www.nrel.gov/docs/fy18osti/71465.pdf for “
Operational analysis of the eastern interconnection at very high renewable penetrations, 2018;
” accessed 5 May 2022.
23.
A.
Mileva
,
J.
Johnston
,
J. H.
Nelson
, and
D.
Kammen
, “
Power system balancing for deep decarbonization of the electricity sector
,”
Appl. Energy
162
,
1001
1009
(
2016
).
24.
See
Energy and Environmental Economics, Inc.
, https://www.ethree.com/wp-content/uploads/2017/02/PacifiCorp-ISOEnergyImbalanceMarketBenefits-1.pdf for “
Pacificorp-ISO energy imbalance market benefits, 2013
,” accessed 5 May 2022.
25.
J.
Nelson
,
S.
Kasina
,
J.
Stevens
,
J.
Moore
, and
A.
Olson
, “
Investigating the economic value of flexible solar power plant operation
” (Energy and Environmental Economics, Inc.,
2018
), see https://www.ethree.com/wp-content/uploads/2018/10/Investigating-the-Economic-Value-of-Flexible-Solar-Power-Plant-Operation.pdf.
26.
See
J.
Nelson
and
L.
Wisland
, https://www.ucsusa.org/sites/default/files/attach/2015/08/Achieving-50-Percent-Renewable-Electricity-In-California.pdf for “
Achieving 50 percent renewable electricity in California
,” (
2015
); accessed 5 May 2022.
27.
B.
Frew
,
B.
Sergi
,
P.
Denholm
,
W.
Cole
,
N.
Gates
,
D.
Levie
, and
R.
Margolis
, “
The curtailment paradox in the transition to high solar power systems
,”
Joule
5
,
1143
(
2021
).
28.
See
California Independent System Operator
, http://oasis.caiso.com/mrioasis/logon.do for “
California ISO open access same-time information system, 2021;
” accessed 21 December 2021.
29.
See
Tensorflow
, https://www.tensorflow.org/ for “
An end-to-end open source platform for machine learning
;” accessed 27 December 2021.
30.
See
Energy and Environmental Economics, Inc
., https://github.com/e3-/RESERVE for “
E3 RESERVE model;
” accessed 21 December 2021.
31.
D.
Kingma
and
J.
Ba
, “
Adam: A method for stochastic optimization
,” in
International Conference on Learning Representations
,
2015
.
32.
See
California Independent System Operator
, http://www.caiso.com/InitiativeDocuments/AppendixC-QuantileRegressionApproach-FlexibleRampingProductRequirements.pdf for “
Flexible ramping product refinements initiative, appendix C—Quantile regression approach, 2020
;” accessed 21 December 2021.
33.
See
North American Electric Reliability Corporation
, https://www.nerc.com/pa/Stand/Reliability%20Standards/BAL-001-2.pdf for “
Standard BAL-001-2—Real power balancing control performance, 2020
;” accessed 21 December 2021.
34.
See
California Independent System Operator
, http://www.caiso.com/InitiativeDocuments/Analysis-FlexibleRampingUncertaintyCalculationintheWesternEnergyImbalanceMarket.pdf for “
Flexible ramping uncertainty calculation in the western energy imbalance market (EIM), 2022
;” accessed 9 May 2022.
35.
See
California Independent System Operator
, https://bpmcm.caiso.com/Lists/PRR%20Details/Attachments/479/Market%20Operations%20BPM%2072hr%20RUC%20PRR.pdf for “
Market processes and products
;” accessed 21 December 2021.
36.
See
California Public Utilities Commission
, https://www.cpuc.ca.gov/industries-and-topics/electrical-energy/electric-power-procurement/long-term-procurement-planning/2019-20-irp-events-and-materials/portfolios-and-modeling-assumptions-for-the-2021-2022-transmission-planning-process for “
RESOLVE transmission preferred portfolio public release 2020–2021: 46 MMT scenario, 2021
;” accessed 21 December 2021.
37.
See
Southern California Edison
, https://www.sce.com/regulatory/tariff-books/rates-pricing-choices/renewable-energy-credit for “
Renewable Energy Credit (REC)
;” accessed 16 November 2021.
38.
See
Western Energy Imbalance Market
, https://www.westerneim.com/Pages/About/QuarterlyBenefits.aspx for “
ISO EIM benefits report Q1–Q4 2019;
” accessed 21 December 2021.
40.
V.
Nair
and
G.
Hinton
, “
Rectified linear units improve restricted Boltzmann machines
,” in
Proceedings of the 27th International Conference on Machine Learning
,
2010
.
41.
Y.
Bengio
, “
Practical recommendations for gradient-based training of deep architectures
,”
Neural Networks: Tricks of the Trade
(
Springer
,
Berlin/Heidelberg
,
2012
), pp.
437
478
.
42.
See CAISO, http://www.caiso.com/market/Pages/ReportsBulletins/RenewablesReporting.aspx for “
Renewables and emissions reports, 2021
;” accessed 21 December 2021.
43.
See
U.S. Department of Energy's Energy Information Agency
, https://www.eia.gov/electricity/gridmonitor/about for “
Hourly grid electricity monitor
” (
2020
).
44.
C.
Loutan
,
P.
Klauer
,
S.
Chowdhury
,
S.
Hall
,
M.
Morjaria
,
V.
Chadliev
,
N.
Milam
,
C.
Milan
, and
V.
Gevorgian
, “
Demonstration of essential reliability services by a 300-MW solar photovoltaic power plant
,”
Report No. NREL/TP-5D00-67799
(
NREL
,
Boulder, CO
,
2017
).
45.
C.
Loutan
,
V.
Gevorgian
,
S.
Chowdhury
,
M.
Bosanac
,
E.
Kester
,
D.
Hummel
,
R.
Leonard
,
M.
Rutemiller
,
J.
Fregoe
,
D.
Pittman
, and
C.
Kosuth
, “
Avangrid renewables Tule Wind Farm: Demonstration of capability to provide essential grid services
” (
CAISO
,
Folsom, CA
,
2020
), see http://www.caiso.com/documents/windpowerplanttestresults.pdf.
46.
P. L.
Denholm
,
Y.
Sun
, and
T. T.
Mai
, “
An introduction to grid services: Concepts, technical requirements, and provision from wind
,”
Report No. NREL/TP-6A20-72578
(
National Renewable Energy Lab
,
2019
).
47.
F.
Kahrl
,
J. H.
Kim
,
A.
Mills
,
R.
Wiser
,
C. C.
Montañés
, and
W.
Gorman
, “
Variable renewable energy participation in U.S. ancillary services markets
” (
Lawrence Berkeley National Laboratory
,
2021
), see https://escholarship.org/uc/item/29r4z5mx.
You do not currently have access to this content.