Two-dimensional face recognition has been researched for the past few decades. With the recent development of Deep Convolutional Neural Network (DCNN) deep learning approaches, two-dimensional face recognition had achieved impressive recognition accuracy rate. However, there are still some challenges such as pose variation, scene illumination, facial emotions, facial occlusions exist in the two-dimensional face recognition. This problem can be solved by adding the depth images as input as it provides valuable information to help model facial boundaries and understand the global facial layout and provide low-frequency patterns. RGB-D images are more robust compared to RGB images. Unfortunately, the lack of sufficient RGB-D face databases to train the DCNN are the main reason for this research to remain undiscovered. So, in this research, new RGB-D face database is constructed using the Intel RealSense D435 Depth Camera which has 1280 x 720-pixel depth. Twin DCNN streams are developed and trained on RGB images at one stream and Depth images at another stream, and finally combined the output through fusion soft-max layers. The proposed DCNN model shows an accuracy of 95% on a newly constructed RGB-D database.

1.
P.
Shunmugam
,
K.
Kamarudin
,
A. A. A.
Mosed
and
S. A. A.
Shukor
, “
Human Identification through Kinect’s Depth, RGB, and Sound Sensor
” (
IOP Conf. Ser. Mater. Sci. Eng.
,
705
,
1
,
2019
) p.
012040
.
2.
H.
Zhang
,
H.
Han
,
J.
Cui
,
S.
Shan
and
X.
Chen
, “
RGB-D face recognition via deep complementary and common feature learning
,” (
Proc. - 13th IEEE Int. Conf. Autom. Face Gesture Recognition
,
2018
) pp.
8
15
.
3.
X.
Xiong
, “
Utilization of Resnet in RGB-D Facial Recognition Problems
” (
International Symposium on Benchmarking, Measuring and Optimization
,
2019
) pp.
156
161
.
4.
L.
Jiang
,
J.
Zhang
, and
B.
Deng
, “
Robust RGB-D Face Recognition Using Attribute-Aware Loss
” (
IEEE Trans. Pattern Anal. Mach. Intell.
2019
) pp.
1
5.
T. Y.
Lin
,
C. T.
Chiu
and
C. T.
Tang
, “
RGB-D Based Multi-Modal Deep Learning for Face Identification
,” (
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP
,
2020
) pp.
1668
1672
.
6.
N.
Grati
,
A.
Ben-Hamadou
and
M.
Hammami
,
Expert Syst. Appl.
150
,
113319
(
2020
).
7.
Intel
, “
Intel® RealSenseTM Camera D400 series Product Family Datasheet
,” no. January,
2019
.
8.
R. I.
Hg
,
P.
Jasek
,
C.
Rofidal
,
K.
Nasrollahi
,
T. B.
Moeslund
and
G.
Tranchet
, “
An RGB-D database using microsoft’s kinect for windows for face detection
,” (
8th Int. Conf. Signal Image Technol. Internet Based Syst
.
2012
), pp.
42
46
.
This content is only available via PDF.
You do not currently have access to this content.