In recent years, there has been a growing demand in Japan for efficient knowledge and technology transfer from veteran workers to younger workers and for improved productivity against the backdrop of labor shortages and aging populations in the nursing care and manufacturing industries. Conventional digital twin systems have focused on sensor data, and have been working to improve operational efficiency in digital space based on the collected sensor data. Therefore, we propose the concept of a Human Centric Digital Twin that captures human awareness and context in cyberspace, and utilizes human awareness and thought by machine sensors and human sensors. This knowledge generated by humans themselves contains a lot of contexts, which is difficult to incorporate in conventional DX methods. In many cases, the knowledge that workers in the field have is context-dependent and dynamic, unlike the formal knowledge described in manuals. Therefore, the cost of converting “Gen-Ba Knowledge” into formal knowledge as it is high, and has prevented its utilization. We have developed “kNowledge eXplication AugmenteR (kNeXaR)” and “Smart Voice Messaging System (SVMS)” as methods and tools to support structuring human awareness and thoughts. kNeXaR is a knowledge structuring method and tool for procedurally describing dynamic knowledge such as tasks in a goal-oriented manner while maintaining human readability and machine readability. SVMS is able to collect onsite knowledge in the form of spoken words, which is difficult to collect in the past. Using a smartphone, workers in the field can voice record what they notice and think about while working. In many cases, the messages obtained during the work are recorded with the purpose of the work, the content of the work, what they thought about what they observed in light of their own experience, and unusual situations. In this paper, while introducing the respective functions of kNeXaR and SVMS, we introduce the concept of implementing the Human Centric Digital Twin, which is a structured knowledge component based on messages from SVMS that collects work and observations in the field. We propose a method to dynamically create “Structured Knowledge Snippets”, which are parts of structured knowledge, based on messages from SVMS, and to construct structured knowledge in a workshop using kNeXaR.

1.
Ministry of Economy, Trade and Industry
, ed.,
The White paper on Monodzukuri 2021
(
2021
).
2.
H.
Kagermann
,
J.
Helbig
,
A.
Hellinger
, and
W.
Wahlster
,
Recommendations for implementing the strategic initiative INDUSTRIE 4.0: Securing the future of German manufacturing industry; final report of the Industrie 4.0 Working Group
(
Forschungsunion
,
2013
).
3.
C. f. S. Technology and Innovation
, “
Report on the 5th science and technology basic plan
,” (
2015
).
4.
T.
Fujimoto
, “Architecture-based comparative advantage―a design information view of manufacturing,”
Evolutionary and Institutional Economics Review
4
,
55
112
(
2007
), publisher:
Springer
.
5.
E.
Glaessgen
and
D.
Stargel
, “
The digital twin paradigm for future NASA and US Air Force vehicles
,” in
53rd AIAA/ASME/ASCE/AHS/ASC structures, structural dynamics and materials conference 20th AIAA/ASME/AHS adaptive structures conference 14th AIAA
(
2012
) p.
1818
.
6.
W.
Shengli
, “
Is Human Digital Twin possible?
Computer Methods and Programs in Biomedicine Update
1
,
100014
(
2021
).
7.
Y.
Umeda
,
J.
Ota
,
S.
Shirafuji
,
F.
Kojima
,
M.
Saito
,
H.
Matsuzawa
, and
T.
Sukekawa
, “
Exercise of digital kaizen activities based on ‘digital triplet’ concept
,”
Procedia Manufacturing
45
,
325
330
(
2020
).
8.
N.
Uchihira
,
T.
Nishimura
, and
K.
Ijuin
, “
Human-centric Digital Twin Focused on “Gen-Ba” Knowledge: Proposal of Conceptual Model and Examples
,” in
2023 Portland International Conference on Management of Engineering and Technology (PICMET)
(
IEEE
,
2023
) pp.
1
8
.
9.
N.
Uchihira
,
S.
Choe
,
K.
Hiraishi
,
K.
Torii
,
T.
Chino
,
Y.
Hirabayashi
, and
T.
Sugihara
, “
Collaboration management by smart voice messaging for physical and adaptive intelligent services
,” in
2013 Proceedings of PICMET ’13: Technology Management in the IT-Driven Services (PICMET)
(
2013
) pp.
251
258
, iSSN: 2159-5100.
10.
N.
Uchihira
and
M.
Yoshida
, “
Agricultural Knowledge Management Using Smart Voice Messaging Systems: Combination of Physical and Human Sensors
,” arXiv preprint arXiv:2008.03711 (
2020
).
11.
S.
Nishimura
,
Y.
Kitamura
,
M.
Sasajima
,
A.
Williamson
, and
C.
Kinoshita
, “
CHARM as activity model to share knowledge and transmit procedural knowledge and its application to nursing guidelines integration
,”
Journal of Advanced Computational Intelligence
Vol
17
(
2013
).
12.
S.
Nishimura
,
K.
Fukuda
, and
T.
Nishimura
, “
Knowledge Explication: Current Situation and Future Prospects
.”
CAID@ IJCAI
,
27
33
(
2017
).
13.
N.
Iino
,
S.
Nishimura
,
K.
Fukuda
,
K.
Watanabe
, and
T.
Nishimura
, “
Development and Use of an Activity Model Based on Structured Knowledge: A Music Teaching Support System
,” in
2017 IEEE International Conference on Data Mining Workshops (ICDMW)
(
IEEE
,
2017
) pp.
584
589
.
14.
N.
Iino
,
H.
Takeda
, and
T.
Nishimura
, “An Ontology-Based Development of Activity Knowledge and System Design,” in
Semantic Technology
, Lecture Notes in Computer Science, edited by
X.
Wang
,
F. A.
Lisi
,
G.
Xiao
, and
E.
Botoeva
(
Springer International Publishing
,
Cham
,
2020
) pp.
369
384
.
15.
Q.
Le
and
T.
Mikolov
, “
Distributed representations of sentences and documents
,” (
2014
).
This content is only available via PDF.
You do not currently have access to this content.