METHOD FOR INFORMATION INTERACTION BETWEEN AN OPERATOR AND AN AUV EQUIPPED WITH A HYDROACOUSTIC COMMUNICATION CHANNEL FOR TARGET OBJECT IDENTIFICATION

Abstract

The execution of inspection and manipulation operations by autonomous unmanned underwater vehicles (AUVs) under operator supervision is limited by the low bandwidth of the hydroacoustic communication channel, which does not allow the transmission of video streams and high-quality photographic images in real time. At the same time, existing methods for automatic recognition of target objects by onboard machine vision systems of AUVs do not guarantee accurate determination of the object’s position and shape when defects are present on its surface (siltation, biofouling, mechanical damage). To address this problem, the paper formulates the task of developing a method that enables information interaction between the operator and the AUV via a low-bandwidth hydroacoustic communication channel. This interaction allows the operator to evaluate the quality of target object recognition and subsequently generate target designations for the vehicle and its onboard manipulator. The proposed method is based on an algorithm for identifying objects with defects, which employs a modified ICP point cloud registration approach with the exclusion of defective regions and characteristic features (CFs). The detected CFs and defect regions are transformed into a compact set of geometric primitives transmitted to the operator through the hydroacoustic communication channel with the AUV. Based on the received information, incoming telemetry from the AUV, and a reference three-dimensional model of the object, the graphical interface visualizes the scanned scene, allowing the operator to assess the recognition accuracy. Full-scale experimental tests of the method were conducted using a hydroacoustic modem manufactured by the Institute of Marine Technology Problems, Far Eastern Branch of the Russian Academy of Sciences (IMTP FEB RAS) and an onboard computer NVIDIA Jetson TX2. The information packet transmitted within 1 minute contained the object type, its position, a defect map, and the coordinates of the characteristic features, with a data volume three orders of magnitude smaller than that required for transmitting the full point cloud of the scanned object. Based on the received information, the operator confirmed successful object identification even when up to 30% of the surface area was covered by defects. The practical significance of the proposed method lies in enabling the execution of critical missions under operator supervision in conditions of environmental uncertainty

References

1. Palomeras N. Peñalver A., Massot-Campos M., Negre P.L., Fernández J.J., Ridao P., Oliver-Codina G. I-AUV docking and panel intervention at sea, Sensors, 2016, Vol. 16, No. 10, 1673 p.

2. Ridao P., Carreras M., Ribas D., Sanz P.J., Oliver G. Intervention AUVs: the next challenge, Annual Reviews in Control, 2015, Vol. 40, pp. 227-241.

3. Konoplin A. Krasavin N., Yurmanov A., Piatavin P., Vasilenko R., Panchuk M. Development of a control system for underwater vehicles with multilink manipulators performing contact manipulation operations, Journal of Marine Science and Engineering, 2024, Vol. 12, No. 7, 1126 p.

4. Panchuk M.O., Yurmanov A.P., Konoplin A.Yu. Sistema avtomaticheskoy inspektsii problemnykh uchastkov protyazhennykh ob"ektov s pomoshch'yu ANPA [Automatic inspection system for problem-atic sections of extended objects using AUV], Podvodnye issledovaniya i robototekhnika [Underwater Research and Robotics], 2025, No. 2 (52), pp. 41-52.

5. Jaber N., Wehbe B., Kirchner F. 3D-DUO: 3D detection of underwater objects in low-resolution multibeam echosounder maps, Ocean Engineering, 2025, Vol. 331, pp. 121254.

6. Besl P., McKay H. A method for registration of 3-D shapes, IEEE Transactions on Pattern Analysis and Machine Intelligence, 1992, Vol. 14, No. 2, pp. 239-256.

7. Tam G.K.L., Cheng Z.Q., Lai Y.K., Langbein F.C., Liu Y., Marshall D., Martin R.R., Sun X.F., Rosin P.L. Registration of 3D point clouds and meshes: A survey from rigid to nonrigid, IEEE Transactions on Visualization and Computer Graphics, 2012, Vol. 19, No. 7, pp. 1199-1217.

8. Lv C., Lin W., Zhao B. KSS-ICP: Point Cloud Registration Based on Kendall Shape Space, IEEE Transactions on Image Processing, 2023, Vol. 32, pp. 1681-1693.

9. Filaretov V.F., Zuev A.V., Gubankov A.S. Upravlenie manipulyatorami pri vypolnenii razlichnykh tekhnologicheskikh operatsiy [Control of manipulators when performing various technological opera-tions]. Moscow: Nauka, 2018, 254 p.

10. Marani G., Yuh J. The SAUVIM Underwater Vehicle-Manipulator System, Introduction to Autono-mous Manipulation: Case Study with an Underwater Robot, SAUVIM. Berlin, Heidelberg: Springer, 2014, pp. 79-105.

11. López-Barajas S.S., Solis A., Marín-Prades R., Sanz P.J. Towards Autonomous Coordination of Two I-AUVs in Submarine Pipeline Assembly, Journal of Marine Science and Engineering, 2025, Vol. 13, No. 8, 1490 p.

12. Denisov V.E. Propusknaya sposobnost' gidroakusticheskogo kanala svyazi [Bandwidth of hydroacoustic communication channel], Russian Technological Journal, 2023, Vol. 11, No. 1, pp. 31-40.

13. Konoplin A.Yu., Konoplin N.Yu., Shuvalov B.V. Technology for implementation of manipulation opera-tions with different underwater objects by AUV, 2019 International Conference on Industrial Engineer-ing, Applications and Manufacturing (ICIEAM). IEEE, 2019, pp. 1-5.

14. Konoplin A., Yurmanov A., Krasavin N., Piatavin P. Development of a control system for multilink ma-nipulators on unmanned underwater vehicles dynamically positioned over seafloor objects, Applied Sci-ences, 2022, Vol. 12, No. 3, pp. 1666.

15. Hegedűs-Kuti J., Szőlősi J., Varga D., Abonyi J., Ando M., Ruppert T. 3D scanner-based identification of welding defects – clustering the results of point cloud alignment, Sensors, 2023, Vol. 23, No. 5,

pp. 2503.

16. Konoplin A., Yurmanov A., Krasavin N., Piatavin P., Panchuk M., Vasilenko R. System for identifying target objects to perform manipulative operations by unmanned underwater vehicles, 2022 International Conference on Ocean Studies (ICOS). IEEE, 2022, pp. 55-59.

17. How to use a KdTree to search. Available at: https://pcl.readthedocs.io/projects/tutorials/en/latest/ kdtree_search.html (accessed 01 March 2026).

18. Nguyen A., Cano A. M., Edahiro M., Kato S. Fast Euclidean cluster extraction using GPUs, Journal of Robotics and Mechatronics, 2020, Vol. 32, No. 3, pp. 548-560.

19. Van Loan C. F., Golub G. Matrix computations. Third Ed. Johns Hopkins University Press, 1996,

Vol. 1, 723 p.

20. Rodionov A.Yu. TSifrovye sistemy svyazi i navigatsii v nestatsionarnykh gidroakusticheskikh sredakh: diss. … d-ra tekhn. nauk: 05.08.06. FGAOU VO «Dal'nevostochnyy federal'nyy universitet» [Digital communication and navigation systems in non-stationary hydroacoustic environments: dr. of eng. sc. diss.: 05.08.06. Far Eastern Federal University]. Vladivostok, 2022, 352 p.

21. Konoplin A.Yu., Krasavin N.A., Vasilenko R.P. Sistema stabilizatsii ANPA, osnashchaemogo dopolnitel'nym dvizhitelem dlya kompensatsii dinamicheskikh vozdeystviy so storony mnogozvennogo manipulyatora [Stabilization system of an AUV equipped with an additional thruster for compensation of dynamic disturbances from a multilink manipulator], Podvodnye issledovaniya i robototekhnika [Under-water Exploration and Robotics], 2023, No. 3, pp. 20-29

Скачивания

Published:

2026-04-29

Issue:

Section:

SECTION II. CONTROL AND MODELING SYSTEMS

DOI:

Keywords:

Autonomous unmanned underwater vehicle, multi-link manipulator, machine vision system, object identification, underwater operations, hydroacoustic communication channel, point clouds, ICP algorithm, data transmission