The Optimization of cost in any product is plays the important role. The Gradient descent method is used to solve the problem of local minimization. This is an Optimizing algorithm that also used for minimize the cost function in various machine learning. Basically we discussed the types of Gradient descent algorithm like Batch gradient descant, Stochastic gradient descant and Mini batch descant. This paper will be discussed on the different parts of Gradient descant and stochastic gradient descant algorithm. This paper is the comparative study of both algorithms.

Topics
Machine learning, Optimization algorithms, Stochastic processes
1.
S.
Liu
 and
Y.
Takaki
,
Appl. Sci.
10
,
4283
(
2020
).
https://doi.org/10.3390/app10124283
Google Scholar
Crossref
Search ADS
 
2.
A.C.
Kara
 and
F.
Hardalac
,
Mach. learn. knowl. extr.
3
,
1009
–
1029
(
2021
).
https://doi.org/10.3390/make3040050
Google Scholar
Crossref
Search ADS
 
3.
F. F.
Lopes
,
J. C.
Ferrcira
 and
M.
Fernandes
,
Electronics
8
,
631
(
2019
).
https://doi.org/10.3390/electronics8060631
Google Scholar
Crossref
Search ADS
 
4.
G. S.
Sharma
,
Int. J. Curr. Adv. Res
10
,
25642
–
25644
(
2021
).
Google Scholar
 
5.
W. Z
Geem
 and
Y.S.
Chung
,
Complexity
8
, (
2018
).
https://doi.org/10.1155/2018/2480365
.
Google Scholar
 
6.
M.
Farhaoui
,
Water Resour. Prot.
8
,
777
–
786
(
2016
).
https://doi.org/10.4236/jwarp.2016.88063
Google Scholar
Crossref
Search ADS
 
7.
P.
Baladi
,
IEEE Trans Neural Netw Learn syst.
6
,
182
–
195
(
1995
).
https://doi.org/10.1109/72.363438
Google Scholar
Crossref
Search ADS
 
8.
S. H.
Haji
 and
A. M.
Abdulazeez
,
PalArch’s J. Archaeol. Egypt/ Egyptol
18
,
2715
–
2743
(
2021
).
Google Scholar
 
9.
Z.
Kaoudi
 and
S.
Chawla
, “
A cost based Optimizer for gradient descent optimizer
” in
Proceedings of the 2017 ACM International Conference on Management of Data, Qatar Computing Research Institute, HBKU
(
Association for Computing Machinery
,
New York, NY, United States
,
2017
).
Google Scholar
Crossref
Search ADS
 
10.
G.
Li
,
S.
Li
 and
M.
You
,
Math Methods Oper Res.
70
,
1
–
17
(
2020
).
Google Scholar
 
11.
R. L.
Bot
 and
E. R.
Csetnek
,
Optim. Lett.
66
,
1383
–
1396
(
2017
).
https://doi.org/10.1080/02331934.2017.1294592
Google Scholar
Crossref
Search ADS
 
12.
L. G.
Drummond
 and
B.
Svaiter
,
J. Comput. Appl. Math.
175
,
229
–
238
(
2005
).
Google Scholar
 
This content is only available via PDF.
©2023 Authors. Published by AIP Publishing.
2023
Author(s)
You do not currently have access to this content.