The integration of Augmented Reality (AR) technology into oral medical diagnosis has the potential to revolutionize the field. AR glasses can help improve the preservation of the shape of patients’ oral mucosa and aid in the diagnostic process by providing additional data. Oral white lesions, such as oral leukoplakia and oral moss, are often difficult to distinguish due to their high similarity, leading to a higher risk of misdiagnosis. This challenge is compounded by the frequent head movements of dentists during oral examinations. To tackle these issues, this study suggests using AR glasses based on Mask-RCNN as an auxiliary diagnostic tool for the identification of oral white lesions. The algorithm has been developed by enhancing the Mask-RCNN network, which allows for the extraction of high-dimensional features from images of oral macular diseases. The proposed algorithm is capable of accurately detecting the specific location and precise area of related lesions, as well as identifying the types of lesions. The use of AR technology in oral medical diagnosis has the potential to improve the accuracy and efficiency of diagnosis, providing patients with better and more efficient medical care.

1.
S.
Horgan
,
D.
Vanuno
.
Robots in laparoscopic surgery
.
Journal of Laparoendoscopic & Advanced Surgical Techniques
,
11
(
6
),
415
419
(
2001
).
2.
N.
Al-Hadithy
,
S.
Ghosh
.
Smartphones and the plastic surgeon
.
Journal of Plastic, Reconstructive & Aesthetic Surgery
,
66
(
10
),
e155
e161
(
2013
).
3.
J. S.
Mak
,
J. W.
Lian
.
Augmented reality technology: A review
.
Sensors
,
19
(
17
),
1
-
28
(
2019
).
4.
R. A.
Mann
.
Rehabilitation engineering
.
The Annals of the New York Academy of Sciences
,
131
(
1
),
621
635
(
1965
).
5.
I. E.
Sutherland
.
The ultimate display
.
Proceedings of IFIP Congress
,
2
,
506
508
(
1965
).
6.
S. K.
Feiner
,
B.
MacIntyre
, and
D.
Seligmann
.
Augmented reality: An application of heads-up display technology to manual manufacturing processes
.
Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences
,
2
,
659
669
(
1992
).
7.
R. T.
Azuma
.
A survey of augmented reality
.
Presence: Teleoperators and Virtual Environments
,
6
(
4
),
355
385
(
1997
).
8.
Yu. J.
Ferniany
,
W. B.
Guthrie
, et al.
Lessons learned from Google Glass: Telemedical spark or unfulfilled promise? Surgical Innovation
,
23
(
2
),
156
165
(
2016
).
9.
J. S.
Mak
,
J. W.
Lian
.
Augmented reality technology: A review
.
Sensors
,
19
(
17
),
1
28
(
2019
).
10.
L.
Perez
,
J.
Wang
.
The effectiveness of data augmentation in image classification using deep learning
. arXiv preprint arXiv:1712.04621 (
2017
).
11.
J.
Yosinski
,
J.
Clune
, and
Y.
Bengio
and
H.
Lipson
.
How transferable are features in deep neural networks?
In Advances in neural information processing systems
(pp.
3320
3328
) (
2014
).
12.
Z. W.
Zhou
,
J.
Shin
, and
L.
Zhang
, and
S. R.
Gurudu
.
Fine-tuning convolutional neural networks for biomedical image analysis: actively and incrementally
. In
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
(pp.
7340
7351
) (
2017
).
13.
X. L.
Peng
,
H. X.
Zhang
, and
Q. Y.
Hu
.
Facial/paralysis expression recognition based on multitask learning of deep convolution neural network
.
Journal of Northwest University (Natural Science Edition)
,
49
(
2
),
187
192
(
2019
).
14.
He.K.
Gkioxari
,
G. P.
Dollár
, and
R.
Girshick
.
Mask R-CNN
. In
Proceedings of the IEEE International Conference on Computer Vision (ICCV)
(pp.
2961
2969
) (
2017
).
15.
S.
Ioffe
,
C.
Szegedy
.
Batch normalization: Accelerating deep network training by reducing internal covariate shift
. arXiv preprint arXiv:1502.03167 (
2015
).
16.
Y.
Kihara
,
G.
Duan
, and
T.
Nishida
, and
M.
Ishikawa
.
A dynamic facial expression database for quantitative analysis of facial paralysis
. In
2011 6th International Conference on Computer Sciences and Convergence Information Technology (ICCIT)
(pp.
949
954
) (
2011
).
This content is only available via PDF.
You do not currently have access to this content.