The infinite duration Semi-Markov decision process is investigated in the paper. The gain optimization problem subject to availability constraint for the Semi-Markov model of the operation is considered. The problem is transformed on some linear programing problem. The semi-Markov reliability model of a system operation is constructed. For the model the gain optimization problem subject to availability constraint is formulated and solved. An example illustrating the theoretical results is presented in the work.

Topics
Optimization problems, Markov processes
1.
Barlow
,
R.E.
 &
Proschan
,
F.
 (
1965
).
Mathematical theory of reliability
.
Wiley
,
New York, London, Sydney
.
Google Scholar
 
2.
Boussemart
 
M
,
Limnios
 
N
,
Markov decision processes with aconstraint on the average asymptotic failure rate
,
Communication in Statistics-Theory and Methods
,
33
(
7
),
1689
–
1714
.
https://doi.org/10.1081/STA-120037268
Crossref
Search ADS
 
3.
Feller
,
W.
 (
1966
).
An Introduction to Probability Theory and Its Applications
,
New York, London, Sydney
;
John Wiley& Sons. Inc
,
2
.
Google Scholar
 
4.
Gertsbakh
,
I.B.
 (
1969
).
Models of preventive service
.
Sovetskoe radio
.
Moscow (in Russian)
.
Google Scholar
 
5.
Grabski
,
F.
 (
1982
).
Theory of Semi-Markov Operation Processes
(in Polish).
ZN AMW, 75A
,
Gdynia
Google Scholar
 
6.
Grabski
,
F.
 (
2014
)
Semi-Markov Processes: Applications in Systems Reliability and Maintenance
,
Elsevier
(in preparation).
Google Scholar
 
7.
Howard
,
R.A.
 (
1960
).
Dynamic Programing and Markov Processes
.
Cambridge, Massachusetts
,
MIT Press
.
Google Scholar
 
8.
Howard
,
R.A.
 (
1964
).
Research of semi-Markovian decision structures
.
Journal of Operations Research Society
Japan
6
,
163
–
199
.
Google Scholar
 
9.
Howard
,
R.A.
 (
1971
). Dynamic probabilistic system.
Semi-Markow and decision processes
.
New York – London – Sydney – Toronto
,
Wiley
, Vol
II
.
Google Scholar
 
10.
Jewell
,
W.S.
 (
1963
).
Markov-renewal Programming
.
Operation Research
 
11
,
938
–
971
.
https://doi.org/10.1287/opre.11.6.938
Google Scholar
Crossref
Search ADS
 
11.
Korolyuk
,
V.S.
 &
Turbin
,
A.F.
 (
1976
).
Semi-Markov processes and their applications
(in Russian),
Kiev
,
Naukova Dumka
.
Google Scholar
 
12.
Limnios
,
N
 &
Oprisan
,
G.
 (
2001
)
Semi-Markov Processes and Reliability
.
Boston
,
Birkhauser
.
Google Scholar
Crossref
Search ADS
 
13.
Mine
,
H.
 &
Osaki
,
S.
 (
1970
).
Markovian Decision Processes
.
New York
,
AEPCI
.
Google Scholar
 
14.
Silvestrov
,
D. C.
 (
1980
).
Semi-Markov processes with a discrete state space
(in Russian),
Moscow
,
Sovetskoe Radio
.
Google Scholar
 
This content is only available via PDF.
© 2019 Author(s).
2019
Author(s)
You do not currently have access to this content.