PARTICLE FILTER BASED DETECTION OF DYNAMIC OBJECTS ON AN ACCUMULATED OCCUPANCY MAP

  • I.О. Shepel Southern Federal University
Keywords: Occupancy map, lidar, point cloud, particle filter, obstacle detection, dynamic object, autonomous movement

Abstract

The paper considers the problem of detecting dynamic obstacles on the accumulated occupancy
map generated by the computer vision system of a mobile robot. The purpose of this research is to
improve the quality of the obstacle detection algorithm by adding a particle filter to find moving objects
from the map data. In the paper, the problem of correct accumulation of data in the occupancy
map and reducing the delay in updating the map cells in which the object moves is solved. The modification
of the particle filter presented in the paper is able to work correctly with dynamic obstacles
in a wide range of speeds; it is resistant to outliers caused by random generation of the initial particles
velocities, and is workable under real conditions in real time in an environment with a lot of
moving objects. A heuristic has been created that reduces the number of misclassifications in occluded
areas. It is shown that the algorithm for detecting dynamic objects in the map is invariant to the
type of sensors used in the vision system, and an implementation combined with an accumulated
occupancy map is described. The algorithm is implemented and tested on board an autonomous mobile
robot, as well as on an open dataset. The article also provides a comparison with other approaches
of dynamic obstacles detection, as well as calculated performance metrics for all analyzed
methods for computers based on the GPU Nvidia RTX 3070 and Jetson AGX Xavier. Promising directions
for further research to improve the presented algorithm are formulated.

References

1. Elfes A. Using occupancy grids for mobile robot perception and navigation, Computer, 1989,
Vol. 22, No. 6, pp. 46-57.
2. Geiger A., Lenz P., Urtasun R. Are we ready for autonomous driving? the kitti vision benchmark
suite, 2012 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2012,
pp. 3354-3361.
3. Caesar H. et al. nuscenes: A multimodal dataset for autonomous driving, Proceedings of the
IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 11621-11631.
4. Shi S., Wang X., Li H. pointrcnn: 3d object proposal generation and detection from point cloud,
Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019,
pp. 770-779.
5. Yin T., Zhou X., Krahenbuhl P. Center-based 3d object detection and tracking, Proceedings of the
IEEE/CVF conference on computer vision and pattern recognition, 2021, pp. 11784-11793.
6. Shepel' I.O. Algoritm kompleksirovaniya neskol'kikh istochnikov dannykh v obshchuyu kartu
zanyatosti [Algorithm for combining multiple data sources into a common employment map],
Izvestiya YuFU. Tekhnicheskie nauki [Izvestiya SFedU. Engineering Sciences], 2021, No. 3
(220), pp. 64-71.
7. Shepel I. et al. Occupancy Grid Generation With Dynamic Obstacle Segmentation in Stereo
Images, IEEE Transactions on Intelligent Transportation Systems, 2021.
8. Long J., Shelhamer E., Darrell T. Fully convolutional networks for semantic segmentation,
Proceedings of the IEEE conference on computer vision and pattern recognition, 2015,
pp. 3431-3440.
9. Eppenberger T. et al. Leveraging stereo-camera data for real-time dynamic obstacle detection
and tracking, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems
(IROS). IEEE, 2020, pp. 10528-10535.
10. Cortinhal T., Tzelepis G., Erdal Aksoy E. SalsaNext: Fast, uncertainty-aware semantic segmentation
of LiDAR point clouds, International Symposium on Visual Computing. Springer,
Cham, 2020, pp. 207-222.
11. Xu J. et al. Rpvnet: A deep and efficient range-point-voxel fusion network for lidar point cloud
segmentation, Proceedings of the IEEE/CVF International Conference on Computer Vision,
2021, pp. 16024-16033.
12. Mohajerin N., Rohani M. Multi-step prediction of occupancy grid maps with recurrent neural
networks, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition,
2019, pp. 10600-10608.
13. Schreiber M., Hoermann S., Dietmayer K. Long-term occupancy grid prediction using recurrent
neural networks, 2019 International Conference on Robotics and Automation (ICRA).
IEEE, 2019, pp. 9299-9305.
14. Danescu R., Nedevschi S. A Particle-Based Solution for Modeling and Tracking Dynamic
Digital Elevation Maps, IEEE Transactions on Intelligent Transportation Systems, 2014,
Vol. 3, No. 15, pp. 1002-1015.
15. Tanzmeister G. et al. Grid-based mapping and tracking in dynamic environments using a uniform
evidential environment representation, 2014 IEEE International Conference on Robotics
and Automation (ICRA). IEEE, 2014, pp. 6090-6095.
16. Nuss D. et al. A random finite set approach for dynamic occupancy grid maps with real-time application,
The International Journal of Robotics Research, 2018, Vol. 37, No. 8, pp. 841-866.
17. Shepel' I.O. Modifitsirovannyy algoritm postroeniya karty zanyatosti po oblaku tochek ot
neskol'kikh lidarov [A modified algorithm for constructing an employment map based on a
cloud of points from several lidars], Programmnye produkty i sistemy [Software products and
Systems], 2020, Vol. 33, No. 2.
18. Dempster A.P. Upper and lower probabilities induced by a multivalued mapping, Classic
works of the Dempster-Shafer theory of belief functions. Springer, Berlin, Heidelberg, 2008,
pp. 57-72.
19. Li T., Bolic M., Djuric P.M. Resampling methods for particle filtering: classification, implementation,
and strategies, IEEE Signal processing magazine, 2015, Vol. 32, No. 3, pp. 70-86.
20. Sun P. et al. Scalability in perception for autonomous driving: Waymo open dataset, Proceedings of
the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 2446-2454.
Published
2022-08-09
Section
SECTION II. INFORMATION PROCESSING ALGORITHMS