The rise in popularity of online learning has highlighted the importance of finding a reliable way to assess student engagement. Traditional methods are not effective enough to monitor participation properly in an online learning environment. This lack of visibility can lead to unnoticed challenges faced by students, ultimately impeding their progress and development. Our research suggests a unique system for capturing and examining students' emotions during virtual lectures. We conducted a thorough assessment of this model by conducting training sessions, tests, and comparisons with existing models. Our findings revealed that the Yolov8 architecture-based model outperformed other models in recognizing student engagement. Further, our proposed model outperforms many existing works in engagement recognition on the same dataset.

1.
A.
Abedi
,
C.
Thomas
,
D.
Jayagopi
, and
S. S.
Khan
, "
Bag of states: a non-sequential approach to video-based engagement measurement
,"
Multimedia Systems
, vol.
30
, no.
1
, pp.
1
16
,
2024
.
2.
S.
Abtahi
,
M.
Omidyegane
,
S.
Shirmohammadi
, and
B.
Hariri
, "
Yawdd: A yawning detection dataset
," in
Proc. of the 5th ACM Multimedia Systems Conference
,
2014
, pp.
24
28
.
3.
P. N.
Belhumeur
,
J. P.
Hespanham
, and
D. J.
Kriegman
, "
Eigenfaces vs. fisherfaces: recognition using class specific linear projection
,"
IEEE Transactions on Pattern Analysis and Machine Intelligence
, vol.
19
, no.
7
, pp.
711
720
,
1997
.
4.
C.
Berka
et al, "
Real-time analysis of EEG indexes of alertness, cognition, and memory acquired with a wireless EEG headset
,"
International Journal of Human-Computer Interaction
, vol.
17
, no.
2
, pp.
151
170
,
2004
.
5.
G.-D.
Guo
and
H.-J.
Zhang
, "
Boosting for fast face recognition
," in
Proc. IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems
,
2001
, pp.
96
100
.
6.
G.
Guo
,
S. Z.
Li
, and
K.
Chan
, "
Face recognition by support vector machine
," in
Proc. Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580)
,
2000
, pp.
196
201
.
7.
A.
Gupta
,
A.
D'Cunha
,
K.
Awasthi
, and
V.
Balasubramanian
, "
Daisee: dataset for affective states in e-learning environments
,"
CoRR
, vol. abs/1609.01885,
2016
.
8.
N.
Herbig
et al, "
Investigating multi-modal measures for cognitive load detection in e-learning
," in
Proc. 28th ACM Conference on User Modeling, Adaptation and Personalization
,
2020
, pp.
88
97
.
9.
Y.
Hu
,
Z.
Jiang
, and
K.
Zhu
, "
An optimized CNN model for engagement recognition in e-learning environment
,"
Applied Science
, vol.
12
, no.
16
, p.
8007
,
2022
.
10.
B.
Moghaddam
,
T.
Jebara
, and
A.
Pentland
, "
Bayesian face recognition
,"
Pattern Recognition
, vol.
33
, no.
11
, p.
1771
1782
,
2000
.
11.
S.
Patel
and
N. R.
Khan
, "
A weighted-average-ensembling based hybrid CNN model for improved COVID-19 detection
,"
2023
.
12.
N.
Sharma
,
S.
Baral
,
M. P.
Paing
, and
R.
Chawuthai
, "
Parking time violation tracking using YOLOv8 and tracking algorithms
,"
Sensors
, vol.
23
, p.
5843
,
2023
.
13.
M.
Turk
and
A.
Pentland
, "
Eigenfaces for recognition
,"
Journal of Cognitive Neuroscience
, vol.
3
, no.
1
, pp.
71
86
,
1991
.
14.
M.
Yang
,
L.
Zhang
,
J.
Yang
, and
D.
Zhang
, "
Metaface learning for sparse representation based face recognition
," in
2010 IEEE International Conference on Image Processing
,
2010
, pp.
1601
1604
.
15.
Y.
Zhang
,
C.
Yang
, and
A.
Merkulov
, "
Breast cancer screening using convolutional neural network and followup digital mammography
,"
2018
, p.
4
.
This content is only available via PDF.
You do not currently have access to this content.