Hyperparameter optimization is an important stage in modeling using machine learning, especially using deep learning algorithm, in which there are many combinations of parameters that will be used to produce a high-accuracy model. There are various methods for hyperparameter optimization of a model architecture, ranging from simple methods, namely trial error, to the most advanced and complex method, such as genetic algorithms. This paper will explain the hyperparameter optimization using the Grid Search Cross Validation (GSVC) method which is relatively simple but quite efficient in calculation time and produces an acceptable model accuracy. The hyperparameter to be optimized are optimizer and activation function. The options for optimizer are Adam, Adamax, Nadam, Stochastic Gradient Descent (SGD), and Root Mean Squared Propagation (RMSProp). The options for activation functions are TanH, Sigmoid, Elu and Relu. The options for optimizer and activation function are combined and selected using GSCV to provide the best performance at a given network architecture. The GSCV method will be used to optimize a model for aerodynamic coefficient of an amphibious aircraft (N219A) based on test data in wind tunnels, i.e. namely CL (coefficient of lift), CD (coefficient of drag) and CM25 (coefficient of bending moment). The best combination of hyperparameters for the aerodynamic coefficient model is (Adam & Sigmoid) for CL, (Adam & Elu) for CD and (Adamax & Elu) for CM25. The results of validation using testing data produce the following RMSE (Root Mean Square Error) and R2 (R-Squared) i.e. (0.0137 & 0.9949) for CL; (0.0113 & 0.9969) for CD and (0.02096 & 0.9984) for CM25 show that the error of the prediction in CL, CD and CM25 is acceptable and the relationship between independent and dependent variables are quite strong.

1.
T.
Rajkumar
and
J.
Bardina
, “
Prediction of Aerodynamic Coefficients using Neural Networks for Sparse Data
,”
Flairs
, pp.
242
246
,
2002
, [Online]. Available: www.aaai.org
2.
H.
Moin
,
H. Z. I.
Khan
,
S.
Mobeen
, and
J.
Riaz
, “
Airfoil’s Aerodynamic Coefficients Prediction using Artificial Neural Network
,” pp.
1
8
,
2021
, [Online]. Available: http://arxiv.org/abs/2109.12149
3.
M. S.
Khurana
,
H.
Winarto
, and
A. K.
Sinha
, “
Application of swarm approach and artificial neural networks for airfoil shape optimization
,”
12th AIAA/ISSMO Multidiscip. Anal. Optim. Conf. MAO
, no. December
2014
, 2008, doi: .
4.
A.
Pumsirirat
and
L.
Yan
, “
Credit card fraud detection using deep learning based on auto-encoder and restricted Boltzmann machine
,”
Int. J. Adv. Comput. Sci. Appl.
, vol.
9
, no.
1
, pp.
18
25
,
2018
, doi: .
5.
F.
Hutter
,
L.
Kotthoff
, and
J.
Vanschoren
,
Automated machine learning Method, Systems, Challenges.
2020
. doi: .
6.
G. A.
Lujan-Moreno
,
P. R.
Howard
,
O. G.
Rojas
, and
D. C.
Montgomery
, “
Design of experiments and response surface methodology to tune machine learning hyperparameters, with a random forest case-study
,”
Expert Syst. Appl.
, vol.
109
, pp.
195
205
,
2018
, doi: .
7.
J. P.
Lalor
,
H.
Wu
, and
H.
Yu
, “
CIFT: Crowd-Informed Fine-Tuning to Improve Machine Learning Ability
,”
2017
, [Online]. Available: http://arxiv.org/abs/1702.08563v2
8.
S.
Patel
, “
Fundamental concepts for Model Selection and Model Evaluation — Part2
,”
Medium
,
2020
. https://medium.com/analytics-vidhya/fundamental-concepts-for-model-selection-and-model-evaluation-part2-e72b384f8ab6 (accessed May 10, 2022).
9.
J.
Bergstra
and
Y.
Bengio
, “
Random search for hyper-parameter optimization
,”
J. Mach. Learn. Res.
, vol.
13
, pp.
281
305
,
2012
.
10.
E.
Elgeldawi
,
A.
Sayed
,
A. R.
Galal
, and
A. M.
Zaki
, “
Hyperparameter tuning for machine learning algorithms used for arabic sentiment analysis
,”
Informatics
, vol.
8
, no.
4
, pp.
1
21
,
2021
, doi: .
11.
E.
Andrés-Pérez
, “
Data mining and machine learning techniques for aerodynamic databases: Introduction, methodology and potential benefits
,”
Energies
, vol.
13
, no.
21
,
2020
, doi: .
12.
F.
Hidiyanto
and
S. T.
Atmaja
, “
Exploratory Analysis and Feature selection of Low-Speed Wind Tunnel Data for Prediction Force and Momentum of Aircraft
,”
Maj. Ilm. Pengkaj. Ind.
, vol.
16
, no.
2
,
2022
.
13.
T.
Wang
, “
A combined model for short-term wind speed forecasting based on empirical mode decomposition, feature selection, support vector regression and crossvalidated lasso
,”
PeerJ Comput. Sci.
, vol.
7
, pp.
1
23
,
2021
, doi: .
14.
T.
Zhang
and
X.
You
, “
Improvement of the Training and Normalization Method of Artificial Neural Network in the Prediction of Indoor Environment
,”
Procedia Eng.
, vol.
121
, pp.
1245
1251
,
2015
, doi: .
15.
S. T.
Atmaja
, “
GITHUB: Dataset of the experimental test of the amphibious aircraft in the Indonesian Low Speed Tunnel
,”
2022
. https://github.com/seagatecodeset/amphibious_air_craft_dataset
This content is only available via PDF.
You do not currently have access to this content.