Robots application areas are considered, including directions of space robotics expected applications. It is shown that an important direction is a robotic manipulator to work with the onboard control panel controls. Such robotic manipulators’ development is an urgent and practically important task. A robotic manipulator organizing the autonomous operation problem is investigated. Manipulation objects are objects (controls) located on some technical object control panel. The subsystems that ensure the target task fulfillment are a robotic arm with a control system and a vision system. The robot manipulator interaction with objects should provide: on/off toggle switch, the switch handle turn, pressing a button, etc. At the same time, to manipulate objects, their position and orientation an assessment is required, which is realized with a computer vision system help. The subsystems’ operation coordination is necessary for planning and implementing manipulator controls, taking into account the objects relative position. The article presents a manipulator interaction diagram with a control panel, a methodology for organizing a vision system and a manipulator coordinated functioning when manipulating controls, including the interest objects position an assessment relative to a robot manipulator, and an algorithm for planning controls based on neural network technology. It is shown that the obtained control accuracy meets the requirements for a robot manipulator when working with a control panel.

1.
M.
Bajones
,
D.
Fischinger
,
A.
Weiss
,
P. D. L.
Puente
,
D.
Wolf
,
M.
Vincze
,
T.
Körtner
,
M.
Weninger
,
K.
Papoutsakis
,
D.
Michel
,
A.
Qammaz
,
P.
Panteleris
,
M.
Foukarakis
,
I.
Adami
,
D.
Leonidis
,
M.
Antona
,
A.
Argyros
,
P.
Mayer
,
P.
Panek
,
H.
Eftring
and
S.
Frennert
,
J. Hum.-Robot Interact
,
9
(
2
), (
2019
).
2.
E.
Broadbent
,
C.
Jayawardena
,
N.
Kerse
,
R.
Stafford
and
B.
MacDonald
,
Proceedings of the Thirty-One AAAI Conference on Artificial Intelligence (Papers from the 2011 AAAI Workshop, WS-11-12
,
2011
, pp
13
19
.
3.
S.
Amiri
,
M. S.
Shirazi
and
S.
Zhang
,
Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence
2020
, pp.
2726
2733
.
4.
I. V.
Alekseev
and
M. A.
Mitrokhin
,
Proceedings of Higher Education Institutions. Volga region. Engineering sciences
2
(
50
), (
2019
).
5.
A. M.
Minitaeva
,
Software products and systems
3, (2013
).
6.
S. V.
Manko
,
R. I.
Alexandrova
and
D. S. Abdel
Kader
,
Engineering sciences
3
(
152
), (
2014
).
7.
S. L.
Zenkevich
and
A. S.
Yushchenko
,
The Basics of Controlling Manipulation Robots: Textbook for Universities
, 2nd ed. fix. and add. (
The MSTU Publishing House named after N. E. Bauman
,
Moscow
,
2004
), p.
480
.
8.
N. V.
Kim
,
Image Processing and Analysis in Computer Vision Systems: Study Guide
(
The MAI Publishing house
,
Moscow
,
2001
), p.
164
.
9.
M.
Endsley
,
B.
Bolte
and
D.
Jones
,
Designing for Situation Awareness: An Approach to User-Centered Design
(
Taylor & Francis
,
New York
,
2003
), p.
312
.
10.
N.
Kim
and
N.
Bodunkov
, “Adaptive surveillance algorithms based on the situation analysis”,
Computer Vision in Control Systems
, 2 eds., edited by
M.
Favorskaya
,
L.
Jain
(
Springer
,
New-York
,
2015
), chapter 7, pp.
169
200
.
11.
K.
He
,
X.
Zhang
,
S.
Ren
and
J.
Sun
,
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
,
2016
, pp.
770
778
.
12.
A. N.
Balukhto
,
Artificial Intelligence in Space Technology. State. Application Prospects. Monograph
(
Radio engineering
,
Moscow
,
2021
), p.
440
.
13.
E. A.
Dudorov
,
I. G.
Sokhin
,
A. A.
Bogdanov
and
B. G.
Kolbasin
,
News of higher educational institutions. Engineering
1
(
730
),
16
26
(
2021
).
14.
E. A.
Dudorov
,
I. G.
Sokhin
and
A. A.
Kuritsyn
,
The MSTU Stankin Bulletin
1
(
56
),
64
75
(
2021
).
15.
E. A.
Dudorov
and
I. G.
Sokhin
,
News of higher educational institutions. Engineering
12
(
729
),
3
15
(
2020
).
16.
V. N.
Zhidkov
,
Soft Computing in Integrated Systems of Aircraft: Study Guide
(
The MAI Publishing house
,
Moscow
,
2013
), p.
386
.
17.
D. A.
Oskin
,
A. A.
Dyda
and
E. A.
Konstantinova
,
Modern science-intensive technologies
12-2
,
254
257
(
2015
).
18.
V. V.
Titov
and
A. V.
Timofeev
,
Information Technologies in Management (ITU-2012)
(
Concern Central Research Institute Electropribor
,
St. Petersburg
,
2012
), pp.
816
828
.
19.
N. V.
Rostov
,
The SPbSPU Scientific and Technical Bulletin. Informatics. Telecommunications. Control
5
(
205
),
93
99
(
2014
).
20.
A. A.
Bol’shakov
,
M. B.
Brovkova
,
V. P.
Glazkov
 et al.,
Artificial Intelligence Systems in Mechatronics: a Tutorial
(
The Saratov State Technical University named after Yu.A. Gagarin
,
EBS ASV, Saratov
,
2014
).
This content is only available via PDF.
You do not currently have access to this content.