OPTIMIZATION OF THE COMPUTATIONAL SCHEME FOR THE INTERPOLATION OF DECADAL METEOROLOGICAL DATA BY INVERSE DISTANCE WEIGHTING WITH PARALLEL PROCESSING OF MULTIPLE TIME SLICES
Abstract
The present study is devoted to solving the problem of computational inefficiency in spatial interpolation of large arrays of decadal meteorological data using the inverse distance weighting method. Traditional approaches involving sequential and independent processing of each time slice demonstrate a linear increase in execution time and significant RAM consumption, which becomes a critical barrier to the rapid construction of detailed and geographically linked raster fields in GeoTIFF format. This significantly limits the use of the method in tasks requiring rapid processing of long-term data archives. The purpose of this work is to develop and validate an optimized computational scheme that can radically reduce time costs while maintaining the completeness and accuracy of the results. The key scientific novelty of the proposed approach lies in the fundamental rethinking of the computational process. Instead of repeating identical operations many times, a scheme is proposed based on a single calculation of the full vector of geodetic distances from each grid cell to all weather stations. This most resource-intensive operation is performed only once. Subsequently, the resulting distance vector is applied to all time slices (decades) to calculate the interpolated values, which eliminates the main computational redundancy and ensures a sublinear dependence of processing time on the number of decades. To further improve performance, a parallel processing mechanism is used at the CPU level, implemented by dynamically dividing the raster into independent computing units (batches). The size of the batches is adaptively adjusted taking into account the available RAM, which guarantees the stability and scalability of the solution on systems of various capacities. The testing of the method on real meteorological data for the period 2015-2024 demonstrated a radical reduction in the execution time. In particular, processing ten decade time slices on a standard laptop takes less than 3.5 minutes, and on a server platform it takes about 3 minutes, which represents a multiple acceleration compared to traditional implementations. Thus, the developed solution makes the operational processing of large spatial and temporal meteorological arrays a reality for a wide range of researchers, opening up new opportunities for climate monitoring, agrometeorology and geoinformation analysis without the need for specialized expensive equipment
References
1. Volkov A.E., Suetina N.V. Primenenie sovremennykh kompleksov optiko-elektronnogo nablyudeniya s vysokim razresheniem v sistemakh aerokosmicheskogo monitoringa Zemli [Application of modern high-resolution optoelectronic observation systems in aerospace Earth monitoring systems], Inzhenernyy zhurnal: nauka i innovatsii [Engineering Journal: Science and Innovation], 2012, No. 12 (12).
2. Fedotova E.V., Maglinets Yu.A., Brezhnev R.V., Starodubtsev A.I. Opyt prognozirovaniya urozhaynosti sel'skokhozyaystvennykh kul'tur s ispol'zovaniem imitatsionnykh modeley [The possibilities of GIS technologies for assessing and monitoring the climatic conditions of the Makazhoy Fepression (Chechen Republic, Russia)], Vestnik KrasGAU [Bulletin of Krasnoyarsk State Agrarian University], 2020, No. 8 (161).
3. Klochkov A.V., Solomko O.B., Klochkova O.S. Vliyanie pogodnykh usloviy na urozhaynost' sel'skokho-zyaystvennykh kul'tur [The influence of weather conditions on the yield of agricultural crops], Vestnik Belorusskoy gosudarstvennoy sel'skokhozyaystvennoy akademii [Bulletin of the Belarusian State Agri-cultural Academy], 2019, No. 2.
4. Kalinin V.G., Sumaneeva K.I., Rusakov V.S. Analiz metodov interpolyatsii prostranstvennogo raspre-deleniya meteorologicheskikh kharakteristik pri raschetakh vesennego snegotayaniya [Analysis of inter-polation methods for the spatial distribution of meteorological characteristics in the calculation of spring snowmelt], Geograficheskiy vestnik [Geographical Bulletin], 2017, No. 2 (41).
5. Bratkov V.V., Bekmurzaeva R.Kh., Bekmurzaeva L.R. Vozmozhnosti GIS‐tekhnologiy dlya otsenki i monitoringa klimaticheskikh usloviy Makazhoyskoy kotloviny (Chechenskaya Respublika) [The possi-bilities of GIS technologies for assessing and monitoring the climatic conditions of the Makazhoy Fe-pression (Chechen Republic, Russia)], Yug Rossii: ekologiya, razvitie [South of Russia: ecology, devel-opment], 2024, No. 2.
6. Botneva Yu.S., Potapov A.A. Primenenie geoinformatsionnykh sistem v sel'skom khozyaystve [Applica-tion of geoinformation systems in agriculture], Voprosy nauki i obrazovaniya [Issues of science and ed-ucation], 2018, No. 10 (22).
7. Arkhipov A.V., Pryanikov V.S. Matematicheskoe modelirovanie magnitnogo polya Zemli v sisteme Matlab [Mathematical modelling of the magnetic field of the ground in Matlab system], Vestnik ChGU [Bulletin of the Chuvash State University], 2008, No. 2.
8. Timirbaev V.E. Geoinformatsionnaya sistema dlya monitoringa i analiza geomagnitnykh sputnikovykh nablyudeniy [Geoinformation system for monitoring and analysis of geomagnetic satellite observations], Problemy nedropol'zovaniya [Subsoil Use Problems], 2022, No. 1 (32).
9. Koroteev I.V., Bryn' M.Ya. Postroenie pol'zovatel'skogo interfeysa putem integratsii programm na yazyke R v sistemu Microsoft Visual Studio pri obrabotke dannykh dlya zadach geodezii [Creation of the User Interface by Integration of Programs at Language R with the Microsoft Visual Studio System at Data Processing for Problems of Geodesy], Intellektual'nye tekhnologii na transporte [Intelligent Technolo-gies on Transport], 2018, No. 2 (14).
10. Vasil'ev A.A., Chashchin A.N., Lobanova E.S. Prostranstvennoe modelirovanie magnitnoy vospriim-chivosti pochv tsentral'noy chasti g. Permi [Spatial modeling of the magnetic susceptibility of soils in the central part of Perm], Sotsial'no-ekologicheskie tekhnologii [Socio-ecological technologies], 2021, No. 4.
11. Belikova M.Yu., Karanina S.Yu., Karanin A.V., Glebova A.V. Vizualizatsiya i analiz dannykh seti WWLLN na territorii Altae-Sayanskogo regiona sredstvami veb-GIS [Visualization and analysis of WWLLN network data in the Altai-Sayan region by means of web-GIS], Kibernetika i programmiro-vanie [Cybernetics and Programming], 2018, No. 2.
12. Krovnin A.S., Mel'nikov S.P., Artemenkov D.V., Muryy G.P., Nikitenko A.I. Vliyanie krupnomassht-abnykh klimaticheskikh faktorov na dinamiku zapasa tikhookeanskoy sayry [Impact of the large-scale climatic factors on dynamics of pacific saury stock], Tr. VNIRO [Proceedings of VNIRO], 2018.
13. Baranov M.D., Kuz'min D.A., Zhukova Zh.S. Sravnenie podkhodov k napisaniyu neyronnykh setey na Python [Comparison of approaches to writing neural networks in Python], Mezhdunarodnyy zhurnal gumanitarnykh i estestvennykh nauk [International Journal of Humanities and Natural Sciences], 2024, No. 5-1 (92).
14. Potapov V.P., Kostylev M.A., Popov S.E. Potokovaya obrabotka radarnykh dannykh v raspredelennoy srede Apache Spark [The streaming processing of sar data in distributed environment with Apache Spark], Vestnik SPbGU. Seriya 10. Prikladnaya matematika. Informatika. Protsessy upravleniya [Vest-nik of Saint Petersburg University. Series 10. Applied mathematics. Computer science. Control processes], 2017, No. 2.
15. Ryazanov S.S., Kulagina V.I. Sravnitel'nyy analiz metodov interpolyatsii topograficheskikh dannykh dlya sozdaniya tsifrovoy modeli rel'efa na primere natsional'nogo parka "Nizhnyaya Kama" [Comparative analysis of methods of the digital terrain model interpolation (case study of the ‟Nizhnaya Kama” nation-al park)], Vestnik Moskovskogo universiteta. Seriya 5. Geografiya [Moscow University Herald. Series 5. Geography], 2022, No. 3.
16. Isupov K.S., Knyaz'kov V.S., Kuvaev A.S. Summirovanie mnogokratnoy tochnosti na tsentral'nykh i graficheskikh protsessorakh s ispol'zovaniem biblioteki MPRES [Summation of the multiple accuracy on central and graphic processors using the MPRES library], Izvestiya YuFU. Tekhnicheskie nauki [Izvesti-ya SFedU. Engineering Sciences], 2018, No. 8 (202).
17. Getmanskiy V.V., Movchan E.O., Andreev A.E. Uskorenie rascheta dinamicheskogo napryazhenno-deformirovannogo sostoyaniya s pomoshch'yu naborov vektornykh instruktsiy [Dynamical stress-strain simulation speedup using SIMD instructions], Izvestiya YuFU. Tekhnicheskie nauki [Izvestiya SFedU. Engineering Sciences], 2016, No. 11 (184).
18. Kozlovskiy A.V., Mel'nik E.V. Issledovanie effektivnosti algoritmov obrabotki informatsii pri formiro-vanii izobrazheniy gruppoy mobil'nykh ob"ektov [Investigation of the effectiveness of information pro-cessing algorithms in the formation of images by a group of mobile objects], Modelirovanie, optimizatsi-ya i informatsionnye tekhnologii [Modeling, Optimization and Information Technology], 2025, 13 (4).
19. Kozlovskiy A.V. Rasparallelivanie obrabotki informatsii pri formirovanii sostavnykh izobrazheniy [Paral-lelization of information processing in the formation of composite images], Izvestiya YuFU. Tekhniches-kie nauki [Izvestiya SFedU. Engineering Sciences], 2025, No. 1, pp. 92-103.
20. Tsymbler M.L., Poluyanov A.N., Kraeva Ya.A. Parallel'nyy algoritm vosstanovleniya sensornykh dannykh v rezhime real'nogo vremeni dlya mnogoyadernogo protsessora [Parallel algorithm for real-time sensor data recovery for a many-core processor], Vestnik YuUrGU. Seriya: Vychislitel'naya matematika i informatika [Bulletin of the South Ural State University. Series: Computational Mathematics and Informatics], 2022, No. 3.
