The urgency of this research is the formation of an artificial intelligence-based evaluation application that is ready to be used to provide accurate recommendations regarding the evaluation results of the effectiveness of e-learning implementation in health universities. Based on that urgency, this research aimed to show the usage test results of the CIPP (Context-Input-Process-Product) evaluation application was integrated with the SAW (Simple Additive Weighting) method. This research approach was development research. The development method was R&D (Research & Development) and the development model used Borg and Gall model. The development stage was focused on the stage of usage tests. These usage tests involved four experts, 20 lecturers, and 30 students. The tools were used for the usage tests related to the effectiveness of evaluation application were questionnaires consisting of 15 questions. The usage tests of application were carried out at six health universities in Bali. The analysis technique used to analyze the usage tests data was the quantitative descriptive technique. This technique was carried out by interpreting the results of a comparison between the effectiveness percentage of usage test results with the effectiveness standard categorizations based on the eleven's scale. The usage test results showed that the CIPP evaluation application integrated with SAW was in a good category. It was based on the usage test results of the SAW formula which showed an accurate calculation process. Besides, the results of the effectiveness tests toward the evaluation application by experts, lecturers, and students, respectively showed the effectiveness percentages were 90.67%, 90.47%, and 90.49%. Those indicated the effectiveness of the evaluation application was classified as a good category.
REFERENCES
1.
I.P.W.
Ariawan
, M.K.W.
Giri
, and D.G.H.
Divayana
, “Simulation of SAW-based CIPP evaluation model calculation in determining improvement priority for e-learning services
,” in 2020 4th International Conference on Vocational Education and Training (ICOVET)
, Malang, Indonesia, 1
–6
(2020
).2.
A.
Rasouli
, Z.
Rahbania
, and M.
Attaran
, “Students’ readiness for e-learning application in higher education
,” Malaysian Online Journal of Educational Technology
, 4
(3
), 51
–64
(2016
).3.
R.
Setiawan
, and R.
Munajah
, “Evaluation of the application of online learning in Indonesian universities
,” TEM Journal
, 9
(3
), 1194
–1199
(2020
).4.
S.C.
Eze
, V.C.A.
Chinedu-Eze
, C.K.
Okike
, and A.O.
Bello
, “Factors influencing the use of e-learning facilities by students in a private Higher Education Institution (HEI) in a developing economy
,” Humanities and Social Sciences Communications
, 7
, 1
–15
(2020
).5.
S.
Barteit
, D.
Guzek
, A.
Jahn
, T.
Bärnighausen
, M.M.
Jorge
, and F.
Neuhann
, “Evaluation of e-learning for medical education in low- and middle-income countries: A systematic review
,” Computers & Education
, 145
, 1
–18
(2020
).6.
R.Y.K.
Chin
, R.
Tjahjono
, M.J.R.
Rutledge
, T.
Lambert
, and N.
Deboever
, “The evaluation of e-learning resources as an adjunct to otolaryngology teaching: a pilot study
,” BMC Medical Education
19
, 1
–9
(2019
).7.
D.G.H.
Divayana
, P.W.A.
Suyasa
, and I.B.G.S.
Abadi
, “Digital library evaluation application based on combination of CSE-UCLA with weighted product
,” Journal of Engineering and Applied Sciences
, 14
(4
), 1318
–1330
(2019
).8.
A.
Said
, and E.
Syarif
, “The development of online tutorial program design using problem-based learning in open distance learning system
,” Journal of Education and Practice
, 7
(18
), 222
–229
(2016
).9.
S.T.
Martaningsih
, Soenarto, and E.
Istiyono
, “Evaluation model of career counseling program in vocational high school
,” International Journal of Evaluation and Research in Education
, 8
(2
), 318
–329
(2019
).10.
G.
Setiadi
, S.
Joyoatmojo
, and Sajidan, “The development of blended learning-based self-learning on classroom action research training material to improve teachers professionalism
,” International Journal of Education and Research
, 4
(9
), 213
–224
(2016
).11.
M.
Muslihudin
, Trisnawati, S.
Mukodimah
, W.
Hashim
, B.
Ayshwarya
, P.T.
Nguyen
, K.
Shankar
, S.K.
Peteraitis
, and A.
Maseleno
, “Performance of SAW and WP method in determining the feasibility of motorcycle engineering workshop for competency test of vocational high school student
,” International Journal of Recent Technology and Engineering
, 8
(2S2
), 348
–353
(2019
).12.
R.E.
Setyani
, and R.
Saputra
, “Flood-prone areas mapping at Semarang city by using simple additive weighting method
,” Procedia - Social and Behavioral Sciences
, 227
, 378
–386
(2016
).13.
N.
Aminudin
, M.
Huda
, A.
Kilani
, W.H.W.
Embong
, A.M.
Mohamed
, B.
Basiron
, S.S.
Ihwani
, S.S.M.
Noor
, K.A.
Jasmi
, J.
Safar
, N.L.
Ivanova
, A.
Maseleno
, A.
Triono
, and Nungsiati, “Higher education selection using simple additive weighting
,” International Journal of Engineering & Technology
, 7
(2.27
), 211
–217
(2018
).14.
R.R.
Aliyev
, “Multi-attribute decision making based on z-valuation
,” Procedia - Computer Science
, 102
, 218
– 222
(2016
).15.
E.Y.
Anggraeni
, W.
Andewi
, and Oktafianto, “Simple additive weighting for modeling DSS to determine the best college in Pringsewu
,” International Journal of Information System and Computer Science
, 1
(1
), 8
–16
(2017
).16.
R.
Meri
, “Simple additive weighting (SAW) method on the selection of new teacher candidates at integrated Islamic elementary school
,” International Journal of Information System & Technology
4
(1
), 428
–435
(2020
).17.
K.K.
Myint
, T.T.
Soe
, and M.M.
Toe
, “Grant selection process using simple additive weighting approach
,” International Journal of Trend in Scientific Research and Development
, 3
(4
), 1681
–1686
(2019
).18.
M.
Ibrohim
, and Sumiati, “Decision support system for determining the scholarship recipients using simple additive weighting (SAW
),” International Journal of Computer Applications
, 151
(2
), 10
–13
(2016
).19.
I.J.T.
Situmeang
, S.
Hummairoh
, S.M.
Harahap
, and Mesran, “Application of SAW (simple additive weighting) for the selection of campus ambassadors
,” International Journal of Informatics and Computer Science
, 5
(1
), 21
–28
(2021
).20.
H.L.H.S.
Warnars
, A.
Fahrudin
, and W.H.
Utomo
, “Student performance prediction using simple additive weighting method
,” IAES International Journal of Artificial Intelligence
, 9
(4
), 630
–637
(2020
).21.
S.A.
Sari
, and Y.S.
Rezeki
, “The development of an ingenious circuit based on chemo-edutainment learning
,” International Journal of Educational Research Review
, 4
(1
), 15
–25
(2019
).22.
Sutirna
, “Subject teachers’ perceptions of academic mentoring and counseling services
,” COUNS-EDU: the International Journal of Counseling and Education
, 4
(4
), 129
–133
(2019
).23.
M.
Dalimunte
, and M.
Salmiah
, “Students’ ability at changing direct into indirect speech and indirect into direct speech
,” Budapest International Research and Critics Institute-Journal
, 2
(2
), 178
–185
(2019
).24.
I.P.W.
Ariawan
, W.
Simatupang
, A.M.
Ishak
, A.A.G.
Agung
, Suratmin, A.
Adiarta
, and D.G.H.
Divayana
, “Development of ANEKA evaluation model based on TOPSIS in searching the dominant aspects of computer learning quality determinants
,” Journal of Theoretical and Applied Information Technology
, 96
(19
), 6580
–6596
(2018
).25.
A.A.G.
Agung
, I.G.P.
Sudiarta
, and D.G.H.
Divayana
, “The quality evaluation of school management model based on Balinese local wisdom using weighted product calculation
,” Journal of Theoretical and Applied Information Technology
, 96
(19
), 6570
–6579
(2018
).26.
D.G.H.
Divayana
, I.P.W.
Ariawan
, and A.
Adiarta
, “Development of countenance application oriented on combining ANEKA-Tri Hita Karana as a mobile web to evaluate the computer knowledge and morality
,” International Journal of Interactive Mobile Technologies
, 13
(12
), 81
–103
(2019
).27.
G.A.D.
Sugiharni
, N.W.
Setiasih
, I.W.E.
Mahendra
, I.M.
Ardana
, and D.G.H.
Divayana
, “Development of Alkin model instruments as evaluation tools of blended learning implementation in discrete mathematics course on STIKOM Bali
,” Journal of Theoretical and Applied Information Technology
, 96
(17
), 5803
– 5818
(2018
).28.
U.A.
Faruq
, S.
Anwar
, and L.
Sesriyani
, “The evaluation of e-learning programs in higher education using the CIPP model (the empiric study in two institutions of Sasmita Jaya foundation
),” in 1st international conference on economics engineering and social science
, 17–18 July 2020, Bekasi, Indonesia, 1
–10
(2021
).29.
H.
Rosiyanti
, and Faisal, “Evaluation of e-campus-based e-learning implementation by mathematics education study program students at the University of Muhammadiyah Jakarta
,” Advances in Social Science, Education and Humanities Research
, 512
, 349
–354
(2020
).30.
S.T.
Nugraha
, S.
Suwandi
, J.
Nurkamto
, and K.
Saddhono
, “Evaluation of e-learning in Indonesian as a foreign language
,” in Proceedings of the Tenth Conference on Applied Linguistics and the Second English Language Teaching and Technology Conference in collaboration with the First International Conference on Language, Literature, Culture, and Education (CONAPLIN and ICOLLITE 2017), Literacy, Culture, and Technology in Language Pedagogy and Use
, 22–23 November 2017, Bandung, Indonesia, 481
–486
(2018
).
This content is only available via PDF.
©2023 Authors. Published by AIP Publishing.
2023
Author(s)
You do not currently have access to this content.
