Soiling puts operators of solar power plants before the challenge of finding the right strategy for the cleaning of their solar fields. The trade-off between a low cleanliness and thus low revenues on the one hand and elevated cleaning costs and high field efficiency on the other hand has to be met.

In this study we address this problem using a reinforced learning algorithm. Reinforced learning is a trial and error based learning process based on a scalar reward. The algorithms improve with an increasing number of training runs, each performed on a different one-year data set. The reward being the profit of the CSP project. In order to prevent overfitting to a special case, the training data has to be sufficiently large. To increase our 5 year soiling-rate and 25 year meteorological measurement data set from CIEMAT’s Plataforma Solar de Almeria (PSA). We first present a method to create artificial long term data sets based on these measurements that are representative of the sites’ weather conditions. With the extended datasets we are able to train the algorithm sufficiently before testing it on the validation dataset.

The algorithm is given the daily choice to deploy up to two cleaning units in day and/or night shifts. In a second step, it is given soiling rate forecasts with different forecast horizons. At PSA our trained algorithm can increase a project’s profit by 1.28 % compared to a reference constant cleaning frequency (RPI) if only the current cleanliness of the solar field is known. If it is given a one day soiling-rate forecast the profit can be increased by 1.33 %. A three day soiling-rate-forecast can increase the profit by 1.37 %. An extended forecast horizon does not seem to increase the RPI further. For sites with higher dust loads than PSA the RPI is expected to be significantly higher than at PSA.

Reinforced learning in combination with the data extension algorithm can be a useful method to increase a CSP project’s profit over its lifetime.

1.
A.
Heimsath
,
M.
Heck
,
G.
Morin
,
W.
Kiewitt
, and
W.
Platzer
, “
Soiling of aluminum and glass mirrors under different climatic conditions and techno-economic optimization of cleaning intervals
,”
2010
.
2.
K.
Kattke
and
L.
Vant-Hull
, “
Optimum target reflectivity for heliostat washing
,” 11. - 14. September 2012
2012
.
3.
F.
Wolfertstetter
,
S.
Wilbert
,
J.
Dersch
,
S.
Dieckmann
,
R.
Pitz-Paal
, and
A.
Ghennioui
, “
Integration of soiling-rate measurements and cleaning strategies in yield analysis of parabolic trough plants
,”
Journal of Solar Energy engineering
, vol.
140
, no.
4
, p.
041008
,
2018
.
4.
H. Truong
Ba
,
M. E.
Cholette
,
R.
Wang
,
P.
Borghesani
,
L.
Ma
, and
T. A.
Steinberg
, “
Optimal condition-based cleaning of solar power collectors
,”
Solar Energy
, vol.
157
, pp.
762
777
,
2017
.
5.
S.
Wilbert
,
B.
Reinhardt
,
J.
DeVore
,
M.
Roeger
,
R.
Pitz-Paal
,
C.
Gueymard
, and
R.
Buras
, “
Measurement of solar radiance profiles with the sun and aureole measurement system
,”
Journal of Solar Energy Engineering
, vol.
135
, pp.
041002
041002
,
2013
.
6.
F.
Wolfertstetter
,
K.
Pottler
,
A. Alami
Merrouni
,
A.
Mezrhab
, and
R.
Pitz-Paal
, “
Novel method for automatic real-time monitoring of mirror soiling rates
,”
2012
.
7.
F.
Wolfertstetter
,
K.
Pottler
,
N.
Geuder
,
R.
Affolter
,
A. A.
Merrouni
,
A.
Mezrhab
, and
R.
Pitz-Paal
, “
Monitoring of mirror and sensor soiling with tracs for improved quality of ground based irradiance measurements
,”
Energy Procedia
, vol.
49
, pp.
2422
2432
,
2014
.
8.
F.
Wolfertstetter
,
Auswirkungen von Verschmutzung auf konzentrierende solarthermische Kraftwerke.
Phd,
2016
.
9.
M.
Schroedter-Homscheidt
,
M.
Kosmale
,
S.
Jung
, and
J.
Kleissl
, “
Classifying ground-measured 1 minute temporal variability within hourly intervals for direct normal irradiances
,”
Meteorologische Zeitschrift
,
2018
.
10.
F. A.
Mejia
and
J.
Kleissl
, “
Soiling losses for solar photovoltaic systems in california
,”
Solar Energy
, vol.
95
, pp.
357
363
,
2013
.
11.
R.
Hammond
,
D.
Srinivasan
,
A.
Harris
,
K.
Whitfield
, and
J.
Wohlgemuth
, “
Effects of soiling on pv module and radiometer performance
,” in
Photovoltaic Specialists Conference, 1997., Conference Record of the Twenty-Sixth IEEE
, pp.
1121
1124
, IEEE,
1997
.
12.
A.
Kimber
,
L.
Mitchell
,
S.
Nogradi
, and
H.
Wenger
, “
The effect of soiling on large grid-connected photovoltaic systems in california and the southwest region of the united states
,” in
Photovoltaic Energy Conversion, Conference Record of the 2006 IEEE 4th World Conference on, vol. 2
, pp.
2391
2395
, IEEE,
2006
.
13.
M.
Naeem
and
G.
Tamizhmani
, “
Climatological relevance to the soiling loss of photovoltaic modules
,” in
Smart Grid (SASG), 2015 Saudi Arabia
, pp.
1
5
, IEEE,
2015
.
14.
J.
Dersch
,
K.
Hennecke
, and
V.
Quaschning
, “
Free greenius new options and availability
,”
2012
.
15.
R. S.
Sutton
and
A. G.
Barto
,
Reinforcement Learning: An Introduction
.
The MIT Press
, second ed.,
2018
.
16.
R. J.
Williams
,
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
, pp.
5
32
.
Boston, MA
:
Springer US
,
1992
.
17.
S.
Ruder
, “
An overview of gradient descent optimization algorithms
,” CoRR, vol. abs/1609.04747,
2016
.
18.
D. P.
Kingma
and
J.
Ba
, “
Adam: A method for stochastic optimization
,”
CoRR
, vol. abs/1412.6980,
2014
.
19.
C.
Szepesvri
,
Algorithms for Reinforcement Learning
, vol.
4
.
Morgan & Claypool Publishers
, 01
2010
.
This content is only available via PDF.