ABOUT THE REAL POSSIBILITIES OF MODERN COMPUTING SYSTEMS FOR DISTRIBUTED MULTIPLICATION OF LARGE-DIMENSIONAL MATRICES
Cite as: V.M. Glushan, L.A. Popov, A.A. Tselykh. About the real possibilities of modern computing systems for distributed multiplication of large-dimensional matrices // Izvestiya SFedU. Engineering Sciences – 2024. – N. 6. - P. 164-176. doi: 10.18522/2311-3103-2024-6-164-176
Abstract
The needs of practice constantly require improving the performance of computing systems. For
quite a long time, multiprocessor systems have been the main way to build ultra-high performance computing
systems. When creating such systems, many difficult problems arise. They are related to the need toparallelize the computing process in order to efficiently load the system processors, overcome conflicts
when several processors try to use the same system resource, reduce the impact of conflicts on system
performance, etc. With microelectronics overcoming the milestone of a billion transistors on a silicon
chip, a new paradigm of multicore processors has emerged. At the same time, the problem of the ratio of
multicore and multithreading in modern computers arose. This is due to the dilemma of preference between
them. A multicore processor contains two or more electronic computing cores placed on a single
semiconductor crystal. Each core of a multicore processor is a full-fledged microprocessor. Multicore is
an obvious and traditional method of distributed solution of many complex tasks. But this cannot be said
about multithreading, which relies on the use of very fast cache memory associated with the main memory
and serves to reduce the average access time to the main memory of the processor. The relative novelty of
modern approaches to the construction of computing systems requires comparative experimental studies
of their capabilities. A promising and convenient mathematical object for these purposes is the distributed
multiplication of matrices of large dimensions. The article presents practical results of distributed multiplication
of square matrices with sizes from 300*300 to 2000*2000 and randomly generated values of
elements in the matrices in the range from -100 to +100. Based on the experimental data presented in the
corresponding tables and graphs, hyperbolic relations are obtained for the dependence of the matrix multiplication
time on the number of virtual machines (cores) in the laptop used. Similar results were obtained
by multiplying square matrices on single-processor computers connected to a local network. Analytical
expressions in this case also represent hyperbolic time dependencies. But the numerical values in
them significantly exceed those for the hyperbolic formula obtained for the laptop. Based on the results
obtained, the conducted research allows us to conclude that the use of a single-processor computer connected
to a local network for multiplying matrices of large dimensions is inferior to the performance of a
laptop. This is due to the significant time spent moving data over the local network.
References
multiconveyor computing structures]. 2nd edition, reprint. and additional, Under the general editorship
of I.A. Kalyaev. Rostov-on-Don: Izd-vo YuNTS RAN, 2009, 344 p.
2. Voevodin I.B., Voevodin Vl.V. Parallel'nye vychisleniya [Parallel computing]. Saint Petersburg:
BKhV-Peterburg, 2004, 608 p.
3. Ivashko E.E. Sovremennye tekhnologii vysokoproizvoditel'nykh vychisleniy [Modern technologies of
high-performance computing]. Petrozavodsk, 2016, 61 p.
4. Available at: https://habr.com/ru/companies/intel/articles/243385/.
5. Kadomskiy A.A. , Zakharov V.A. Effektivnost' mnogopotochnykh prilozheniy [Efficiency of multithreaded
applications], Nauchnyy zhurnal [Scientific journal], 2016, No. 7 (8), pp. 26-28.
6. Zakon Amdala [Amdahl's Law]. Available at: https://dic.academic.ru/dic.nsf/ruwiki/433588.
7. Zakon Amdala i budushchee mnogoyadernykh protsessorov [Amdahl's law and the future of multicore
processors]. Available at: https://www.osp.ru/os/2009/04/9288815.
8. Glushan' V.M., Lavrik P.V. Ogranichenie bystrodeystviya vychislitel'nykh sistem v rezul'tate
sovmeshcheniya zakona Amdala i gipotezy Minskogo [Limitation of the speed of computing systems
as a result of combining Amdahl's law and the Minsk hypothesis], Tr. Kongressa po intellektual'nym
sistemam i informatsionnym tekhnologiyam «IS-IT’13» [Proceedings of the Congress on Intelligent
Systems and Information Technologies "IS-IT'13"]. Scientific publication in 4 vol. Vol. 1. Moscow:
Fizmatlit, 2013, pp. 129-137.
9. Pavlov A.V. Arkhitektura vychislitel'nykh system [Architecture of computing systems]. Saint Petersburg:
Universitet ITMO, 2016, 86 p.
10. Available at: https://www.kakprosto.ru/kak-901137-mnogoyadernye-processory-principy-rabot.
11. Radchenko G.I. Raspredelennye vychislitel'nye sistemy [Distributed computing systems]. Chelyabinsk:
Fotokhudozhnik, 2012, 184 p.
12. Glushan' V.M., Krasyuk O.I., Lozovoy A.Yu. Parallel'noe umnozhenie matrits bol'shikh razmernostey
na zadannom mnozhestve protsessorov [Parallel multiplication of large-dimensional matrices on a given
set of processors], Vestnik RGRTU [Bulletin of the Russian State Technical University], 2020,
No. 74, pp. 42-55.
13. Glushan' V.M. Rasshirenie funktsionala klient-servernoy podsistemy raspredelennogo proektirovaniya
SBIS [Expanding the functionality of the client-server subsystem of distributed VLSI design],
Informatizatsiya i svyaz' [Informatization and Communication], 2021, No. 3, pp. 33-38.
14. Glushan V.M., Lozovoy A.Yu. On Distributed Multiplication of Large-Scale Matrices, 2021 IEEE 15th
International Conference on Application of Information and Communication Technologies (AICT),
2021, pp. 1-4.
15. Glushan' V.M. Ierarkhicheskie klient-servernye arkhitektury v raspredelennom proektirovanii i
parallel'nykh vychisleniyakh [Hierarchical client-server architectures in distributed design and parallel
computing], Sovremennye komp'yuternye tekhnologii: Mater. II nauchno-metodicheskoy konferentsii
NPR [Modern computer technologies: materials of the II scientific and methodological conference of
the NPR]. Taganrog, 2021, pp. 14-18.
16. Glushan' V.M., Popov L.A. Raspredelennoe umnozhenie matrits na komp'yuterakh s mnogoyadernymi
protsessorami [Distributed matrix multiplication on computers with multicore processors], Tr.
Mezhdunarodnogo nauchno-tekhnicheskogo kongressa «Intellektual'nye sistemy i informatsionnye
tekhnologii – 2024» («IS&IT'») [Proceedings of the International Scientific and Technical Congress
"Intelligent Systems and Information Technologies - 2024" ("IS&IT'")]. Scientific publication in 2 vol.
Vol. 2. Taganrog: Izd-vo Stupina S.A., 2024, pp. 65-70.
17. Glushan' V.M., Popov L.A. Programma umnozheniya matrits na komp'yutere s mnogoyadernymi
protsessorami. Svidetel'stvo o gosudarstvennoy registratsii programmy dlya EVM № 2024663001,
zaregistrirovano 03.06.2024 [Matrix multiplication program on a computer with multicore processors.
Certificate of state registration of the computer program No. 2024663001, registered on 06/03/2024].
18. Sosnin V.V., Balakshin P.V. Vvedenie v parallel'nye vychisleniya [Introduction to parallel computing].
Saint Petersburg: Universitet ITMO, 2015, 51 p.
19. AMD Ryzen™ 5 4600H Drivers & Support. Available at: https://www.amd.com/en/support/apu/amdryzen-
processors/amd-ryzen-5-mobile-processors-radeon-graphics/amd-ryzen-5-4600h.
20. Onlayn kal'kulyator: Approksimatsiya funktsii odnoy peremennoy [Online calculator: Approximation of a
function of one variable], PlanetCalc. Available at: https://planetcalc.ru/5992/ (accessed 29 April 2024).