Search

Search Results

• APPLICATION OF A SURROUND-VIEW CAMERA SYSTEM FOR MOBILE ROBOT MOVEMENT SAFETY

  I.S. Fomin , А. А. Baseltsev

  2026-04-29

  Abstract ▼

  This paper addresses the problem of ensuring the motion safety of a mobile robotic platform in an environment with known object classes, based on object detection results from a surround-view camera system. While solutions based on optical flow or other methods for detecting moving objects in a camera's field of view are well-known, this work proposes to use the results from a dedicated object detector for safety assurance. Here, we propose to utilize object positions, calculated from the output of a neural network detector, for safety purposes. The surround-view camera system (SVS) consists of 4 cameras with wide-angle lenses. Several approaches for feeding objects into the neural network detector are considered. Differences in quality and performance for these approaches are demonstrated, and methodological recommendations for their use are formulated. To calculate object positions in the camera coordinate system and, through camera positions, in the robot's coordinate frame, 2 solutions based on camera calibration and certain assumptions are proposed. In the first case, the robot's position on the surface is assumed to be horizontal, and the camera's height above the surface is assumed constant and known. In the second case, one of the metric dimensions of objects for each class are assumed to be known in advance. The proposed solution has been deployed and tested on a Rockchip 3588-based computing platform, demonstrating high performance in terms of detection count (from 8 to 19 objects per frame on average, depending on settings) and processing speed (0.29 s for 8 objects per frame and about 1.05 s for the result of 19 objects per frame). Regarding the accuracy of distance estimation to objects, for the first method, the standard deviation ranged from 4.2 to 7.9 mm, and for the second method, from 3.8 to 7.6 mm. The standard deviation of object size estimation for the first method ranged from 0.64 to 2.02 mm, and for the second method from 1.63 to 2.22 mm, respectively. The obtained results allow us to confidently state that the proposed object detection algorithm is applicable for ensuring the safety and navigation of a mobile robot using surround-view system cameras