MULTI-AGENT ALGORITHM FOR AUTOMATIC DETECTION AND TRACKING OF NON-DETERMINISTIC OBJECTS
Abstract
In order to develop a robust algorithm for the automatic detection and tracking of non-deterministic objects for embedded computing systems, in this work, a study and analysis in the field of state-of-the-art general-purpose automatic tracking algorithms is performed. The most successful of those algorithms suitable for long-term stable automatic tracking of objects (without a priori knowledge of the type of object being tracked) have already gone beyond solving exclu-sively tracking problems, and include a synergistic combination of several heterogeneous tracking algorithms, as well as at least one automatic detection and / or classification algorithm. Thus, the authors of the article conclude that the most stable modern automatic tracking algorithms are a multi-agent system that makes a decision about the current position, size and other parameters of the tracked object image based on intelligent voting of system’s submodules that independently monitor the object and form its model. Individual models of each of the submodules are updated based on the results of a collective decision. The authors of the study identified the most effective of the applied basic algorithms suitable for use in embedded computing systems of robotic systems, and developed a new multi-agent algorithm for the automatic detection and tracking of non-deterministic objects. The presented multi-agent algorithm includes a submodule for extracting and matching key points in images, a clustering and filtering submodule for key points using the DBSCAN algorithm, a tracking submodule based on the optical flow calculation algorithm, and a key point classification submodule. A semi-natural testing of the developed algorithm was carried out and its effectiveness in solving tasks not only of automatic tracking of objects, but also in tasks of automatic objects detection using several reference images were evaluated. In conclusion, the authors present steps for further improving the accuracy and performance of the developed algo-rithm for its forthcoming implementation for on-board computing systems of aerial vehicles.
References
2. Georg Nebehay, Roman Pflugfelder. Consensus-based Matching and Tracking of Keypoints for Object Tracking. Safety and Security Department. AIT Austrian Institute of Technolo-gy.Austria, 2014.
3. Sam Hare, Amir Saffari, Philip H.S. Torr. Struck: Structured Output Tracking with Kernels. Oxford Brookes University. Oxford, UK 2Sony Computer Entertainment Europe, London, UK. 2014.
4. Bondarenko V.A., Kaplinskiy G.E., Pavlova V.A., Tupikov V.A. Metod poiska i sopostavleniya klyuchevykh osobennostey izobrazheniy dlya raspoznavaniya obrazov i soprovozhdeniya ob"ektov [Method for searching and matching key features of images for image recognition and object tracking], Izvestiya YuFU. Tekhnicheskie nauki [Izvestiya SFedU. Engineering Sci-ences], 2019, No. 1 (213), pp. 281-293.
5. Rodehorst V., Koschan A. Comparison and evaluation of feature point detectors, Proceedings of 5th International Symposium Turkish-German Joint Geodetic Days, 2006.
6. Tuytelaars T., Mikolajczyk K. Local Invariant Feature Detectors – Survey, Foundations and Trends in Computer Graphics and Vision, 2008, No. 3 (3), pp. 177-280.
7. Ethan Rublee, Vincent Rabaud, Kurt Konolige, Gary Bradski. ORB: an efficient alternative to SIFT or SURF. Willow Garage, Menlo Park, California. 2011.
8. Erich Schubert, Jörg Sander, Martin Ester, Hans Peter Kriegel, Xiaowei Xu. DBSCAN Revisited, Revisited: Why and How You Should (Still) Use DBSCAN, ACM Trans. Database Syst., 2017.
9. Amila Jakubovic, Jasmin Velagic. Image Feature Matching and Object Detection using Brute-Force Matchers. Faculty of Electrical Engineering/University of Sarajevo Sarajevo, Bosnia and Herzegovina. 2018.
10. Lucas B.D. and Kanade T. An iterative image registration technique with an application to stereo vision, International Joint Conference on Artificial Intelligence, 1981, pp. 674-679.
11. Eibe Frank, Remco R. Bouckaert. Naive Bayes for Text Classification with Unbalanced Clas-ses. Computer Science Department, University of Waikato, New Zealand, Xtal Mountain In-formation Technology, Auckland, New Zealand. 2006.
12. Lowe D.G. Object recognition from local scale-invariant features, Proceedings of the Interna-tional Conference on Computer Vision, 1999, No. 2, pp. 1150-1157.
13. Sung-Joo Y., Kim T. Development of Stereo Visual Odometry Based on Photogrammetric Fea-ture Optimization, Remote Sensing, 2019, No. 11.
14. Horn B.K.P. and Schunck B.G. Determining optical flow, Artificial intelligence, 1981, Vol. 17, No. 1-3, pp. 185-203.
15. Shi J. and Tomasi C. Good features to track, Conference on Computer Vision and Pattern Recognition, 1994.
16. Leutenegger S., Chli M., and Siegwart R.Y. BRISK: Binary robust invariant scalable keypoints, In ICCV, 2011.
17. Shahed Nejhum S.M., Ho J., and Yang M.-H. Visual tracking with histograms and articulating blocks, In CVPR, 2008.
18. Zhang L. and van der Maaten L. Structure preserving object tracking, In CVPR, 2013.
19. Martin Ester, Hans-Peter Kriegel, Jiirg Sander, Xiaowei Xu. A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise. Institute for Computer Science, University of Munich Oettingenstr. 67, D-80538 Miinchen, Germany, 1996.
20. Taheri S., Mammadov M. Learning the naive Bayes classifier with optimization models. Cen-tre for Informatics and Applied Optimization School of Science, Information Technology and Engineering, University of Ballarat, Victoria 3353, Australia. 2.
21. Andrew Moores. Efficient memory-based learning for robot control. 15 JJ Thomson Avenue Cambridge CB3 0FDUnited Kingdom. 1990.
