A real-time facial recognition and tracking system has been developed that includes functions for detecting and tracking faces in real time and allows local images to be uploaded for face comparison. Its key advantage is the ability to instantly analyze captured facial images and identify recognized individuals without delay. The paper aims to survey previous research on real-time facial recognition and tracking to better understand the techniques and methods used in this field. Assessing and comparing other research enhances the picture of both the strong and weak points of that research and the chances for development. It can be a source of information for designing the upcoming technologies for the increasing precision of the existing technologies utilized in the real-time face recognition and tracking. The study discusses the applications of various artificial intelligence, machine learning, and convolutional neural network techniques for the specific aim of accurate and speedy facial identification, particularly in the case of multiple faces. Lastly, there is the tabular presentation of the differences between the techniques together with the methods of previous researchers. This survey can help identify current and future face recognition and tracking trends. The paper provides insights into the challenges and processes involved in real-time face recognition and tracking and can help researchers and developers in this field.

1.
XueMei
Zhao
,
ChengBing
Wei
, “
A Real-time Face Recognition System Based on the Improved LBPH Algorithm
,”
IEEE 2nd International Conference on Signal and Image Processing
, pp.
72
76
,
30
November
2017
.
2.
Lixiang Li; Xiaohui Mu; Siying Li; Haipeng
Peng
, “
A Review of Face Recognition Technology
,”
IEEE
, pp.
139110
139120
,
21
July
2020
.
3.
Lamiaa A.
Elrefaei
,
Alaa
Alharthi
,
Huda
Alamoudi
,
Shatha
Almutairi
, and Fatima Al-rammah1, “
Real-time Face Detection and Tracking on Mobile Phones for Criminal Detection
,”
International Conference on Anti-Cyber Crimes (ICACC) IEEE
, pp.
75
80
,
2017
.
4.
Hiten
Goyal
,
Karanveer
Sidana
,
Charanjeet
Singh
,
Abhilasha
Jain
&
Swati
Jindal
, “
A real time face mask detection system using convolutional neural network
,”
Multimedia Tools and Applications
, p.
14999
15015
,
2022
.
5.
Hiyam
Hatem
,
Zou
Beiji
, and
Raed
Majeed
, “
Human Facial Features Detection and Tracking in Images and Video
,”
Journal of Computational and Theoretical Nanoscience
, vol.
12
, p.
1
,
2015
.
6.
W.S.
Mada
Sanjaya
,
Dyah
Anggraeni
,
Atip
Juwardi
, and, “
Design of Real Time Facial Tracking and Expression Recognition for Human-Robot Interaction
,”
International Conference on Computation in Science and Engineering
,
2018
.
7.
D. E. A.
Fatima
B.
Ibrahim
, “
Real Time Face Recognition System based Hybrid Method
,”
International Journal of Scientific Engineering and Applied Science (IJSEAS)
, vol.
4
, no.
4
, p.
6
,
May
2018
.
8.
Israa AbdulAmeer AbdulJabbar Zainab Ali
Yakoob
, “
Hybrid techniques to improve face recognition based on features extraction methods and Haar discrete wavelet transformation
,”
Journal of AL-Qadisiyah for computer science and mathematics
, vol.
10
, no.
2
,
2018
.
9.
Hiten
Goyal
,
Karanveer
Sidana
,
Charanjeet
Singh
,
Abhilasha
Jain
,
Swati
Jindal
, “
A real time face mask detection system using convolutional neural network
,”
Multimedia Tools and Applications
,
2022
.
10.
B. Anil
Kumar
and
Mohan
Bansal
, “
Face Mask Detection on Photo and Real-Time Video Images Using Caffe-MobileNetV2 Transfer Learning
,”
Appl. Sci.
, vol.
13
, p.
935
,
2023
.
11.
M. E.
Abdulminuim
, “
Propose an Efficient Face Recognition Model in WSN Based on Zak
,”
Iraqi Journal of Science
, vol.
58
, pp.
759
766
,
2017
.
12.
Jiankang
Deng
,
Jia
Guo
,
Evangelos
Ververas
,
Irene
Kotsia
,
Stefanos
Zafeiriou
, “
Retina Face: Single-shot Multi-level Face Localisation in the Wild
,”
Insight Face is a nonprofit Github project for 2D and 3Dface analysis.
,
2020
.
13.
Muhamad Dwisnanto
Putro
,
Duy-Linh
Nguyen
and
Kang-Hyun
Jo
, “
Lightweight Convolutional Neural Network for Real-Time Face Detector on CPU Supporting Interaction of Service Robot
,”
02
July
2022
.
14.
V´ıtor
Albiero
,
Xingyu
Chen
,
Xi
Yin
,
Guan
Pang
,
Tal
Hassner
, “
img2pose: Face Alignment and Detection via 6DoF, Face Pose Estimation
,” * Joint first authorship., p.
7617
,
2021
.
15.
Hana’a M.
Salman
and
Rana T.
Rasheed
, “
Smart Door for Handicapped People via Face Recognition and
,”
Engineering and Technology Journal
, vol.
39
, no.
01
, pp.
222
230
,
2021
.
16.
“Face Recognition and Tracking Framework for Human–Robot Interaction,”
Appl. Sci.
, pp.
2
-
19
, 30 May 2022.
17.
Dhuha Basheer
Abdullah
and
Mohanad Rafaa
Mohammed
, “
Real-time Face Tracking for Service-Robot
,”
Technium, vol. 4, no. 9
, pp.
47
-
52
, 22.
18.
Shaimaa Hameed
Shaker
,
Farah Qais
Al-Khalidi
, “
Human Gender and Age Detection Based on Attributes of Face
,”
International Journal of Interactive Mobile Technologies (iJIM)
, p.
176
,
may
2022
.
19.
Shaimaa H.
Shaker
,
Najlaa Abd
Hamza
, “
Three-dimensional Face Reconstruction using 3D Morphable Model Fitting Method
,”
Journal of AL-Qadisiyah for computer science and mathematics
, vol.
10
, no.
3
, pp.
25
37
,
2018
.
20.
Raheem
Ogla
,
Ali Adel
Saeid
,
Shaimaa H.
Shaker
, “
Technique for recognizing faces using a hybrid of moments and a local binary pattern histogram
,”
International Journal of Electrical and Computer Engineering (IJECE)
, vol.
12
, no.
3
, p.
2571
2581
,
June
2022
.
21.
P. K. B. a. M. J
, “
Design and Evaluation of a Real-Time Face Recognition System using Convolutional Neural Networks
,”
Procedia Computer Science
, p.
1651
1659
,
2020
.
22.
S. T. X. &. W. D.
Liu
, “
Facial Expression Recognition Based on Sobel Operator and Improved CNN-SVM
,”
IEEE 3rd International Conference on Information Communication and Signal Processing (ICICSP
), p.
236
240
,
2022
.
23.
S. Z. C. B. M. &. S. K.
Gao
, “
Facial Ethnicity Recognition Based on Transfer Learning from Deep Convolutional Networks
,”
3rd International Conference on Advanced Electronic Materials, Computers and Software Engineering (AEMCSE)
, p.
310
314
,
2020
.
24.
Y. L. Y. H. G. &. Z. Z.
Zhou
, “
Face Recognition Based on Global and Local Feature Fusion
,”
IEEE Symposium Series on Computational Intelligence (SSCI)
, p.
2771
2775
,
2019
.
25.
X.-F. Z. L. D. C.-D. &. L. Y.
Xu
, “
Research on Inception Module Incorporated Siamese Convolutional Neural Networks to Realize Face Recognition
.,”
IEEE Access
, p.
12168
12178
,
2020
.
26.
Zhongyuan
Wang
,
Guangcheng
Wang
,
Baojin
Huang
,
Zhangyang
Xiong
,
Qi
Hong
,
Hao
Wu
,
Peng
Yi
,
Kui
Jiang
,
Nanxi
Wang
,
Yingjiao
Pei
,
Heling
Chen
,
Yu
Miao
,
Zhibing
Huang
, and
Jinbi
Liang
, “
Masked Face Recognition Dataset and Application
,”
IEEE Transactions on Biometrics, Behavior, and Identity Science
,
2023
.
27.
Y.
Kortli
,
M.
Jridi
,
A.
Al Falou
, and
M.
Atri
, “
Face Recognition Systems: A Survey
,”
Sensors
, vol.
20
, p.
342
,
Jan
.
2020
.
28.
Anis Koubaa; Adel Ammar; Anas Kanhouch; Yasser
Alhabashi
, “
Cloud versus Edge Deployment Strategies of Real-Time Face Recognition Inference
,”
CISTER Research Centre, IEEE
, pp.
1
18
,
2020
.
29.
Bansal
A.
,
Nanduri
A.
,
Castillo
C.D.
,
Ranjan
R.
,
Chellappa
R.
, “
Umdfaces: An annotated face dataset for training deep networks
.,”
IEEE international joint conference on biometrics (IJCB)
, pp.
464
473
,
2017
Oct
1
.
30.
M.
Mukhiddinov
,
O.
Djuraev
,
F.
Akhmedov
,
A.
Mukhamadiyev
, and
J.
Cho
, “
Masked Face Emotion Recognition Based on Facial Landmarks and Deep Learning Approaches for Visually Impaired People
,”
Sensors
, vol.
23
, no.
3
, p.
1080
,
Jan.
2023
.
31.
Ashu
Kumar
,
Amandeep
Kaur
and
Munish
Kumar
, “
Face detection techniques: a review
,”
Springer Nature B.V.
2018
, pp.
927
948
,
2019
Aug
15
.
32.
Delong
Qi
,
Weijun
Tan
,
Qi
Yao
,
Jingfeng
Liu
, “
YOLO5Face: Why Reinventing a Face Detector
,”
Cham
:
Springer Nature Switzerland
., pp.
228
244
,
October
23–27
,
2022
.
33.
Elham
Bagherian
,
Rahmita Wirza O.K.
Rahmat
, “Facial feature extraction for face recognition: a review,”
International Symposium on Information Technology IEEE
, vol.
2
, pp.
1
9
,
2008
.
34.
A. M. I. B.
Rouhi
R., “
A review on feature extraction techniques in face recognition
,”
Signal & Image Processing.
,
2012
.
35.
Urvashi
Bakshi
,
Rohit
Singhal
, “
A SURVEY ON FACE DETECTION METHODS AND FEATURE EXTRACTION TECHNIQUES OF FACE RECOGNITION
,”
International Journal of Emerging Trends & Technology in Computer Science (IJETTCS)
, vol.
3
, no.
3
, pp.
233
237
,
May-June
2014
.
36.
Rondik J.
Hassan
&
Adnan Mohsin
Abdulazeez
, “
Deep Learning Convolutional Neural Network for Face Recognition: A Review
,”
International Journal of Science and Business
, vol.
5
, no.
2
, pp.
114
127
,
2021
.
37.
L. L. H. Z. Q. &. S. Z.
He
, “
Dynamic Feature Matching for Partial Face Recognition
,”
IEEE Transactions on Image Processing
, p.
791
802
,
2019
.
38.
S. M. A. &. H. L.
Annagrebah
, “
Real-time Face Recognition based on Deep neural network methods to solve occlusion problems
.,”
Third International Conference on Intelligent Computing in Data Sciences (ICDS
), pp.
1
4
,
2019
.
39.
Akshat
Agarwal
,
Ipshita
Biswas
, “
The fundamentals of facial recognition
,”
embedded
,
March
17
,
2021
.
40.
Tong
Zhang
and
Herman Martins
Gomes
, “
Technology Survey on Video Face Tracking
,”
SPIE Digital Library
, vol.
9027
,
3
March
2014
.
41.
Minyoung
Kim
,
Sanjiv
Kumar
,
Vladimir
Pavlovic
, and
Henry
Rowley
, “
Face Tracking and Recognition with Visual Constraints in Real-World Videos
,” In
2008 IEEE Conference on computer vision and pattern recognition
, pp.
1
8
,
2018
.
42.
Grigorios G.
Chrysos
,
Epameinondas
Antonakos
,
Patrick
Snape
,
Akshay
Asthana
,
Stefanos
Zafeiriou
, “
A Comprehensive Performance Evaluation of Deformable Face Tracking ‘In-the-Wild’
,”
Int J Comput Vis
, vol.
126
, p.
198
232
,
2018
.
43.
Faleh
Alqahtani
,
Jasmine
Banks
,
Vinod
Chandran
, and
Jinglan
Zhang
, “
3D Face Tracking Using Stereo Cameras: A Review
,”
ACCESS, IEEE
, vol.
8
, pp.
94373
94393
,
June
2
,
2020
.
44.
Bhadula
,
S.
,
Sharma
,
S.
,
Juyal
,
P.
, &
Kulshrestha
,
C.
, “
Machine learning algorithms based skin disease detection
.,”
nternational Journal of Innovative Technology and Exploring Engineering (IJITEE)
, vol.
2
, no.
9
, pp.
4044
4049
, (
2019
).
45.
Ghadi
,
N. M.
, &
Salman
,
N. H.
, “
eep Learning-Based Segmentation and Classification Techniques for Brain Tumor MRI: A Review
.,”
Journal of Engineering
, vol.
28
, no.
12
, pp.
93
112
,
2022
.
This content is only available via PDF.
You do not currently have access to this content.