71865

Автор(ы): 

Автор(ов): 

4

Параметры публикации

Тип публикации: 

Доклад

Название: 

Architecture of a Distributed Parallel Computing System Using Docker Cluster

Электронная публикация: 

Да

ISBN/ISSN: 

978-1-6654-9368-0

DOI: 

10.1109/ICCT56057.2022.9976525

Наименование конференции: 

  • 6th International Scientific Conference on Information, Control, and Communication Technologies (ICCT 2022)

Наименование источника: 

  • Proceedings of the 6th International Scientific Conference on Information, Control, and Communication Technologies (ICCT 2022)

Город: 

  • Астрахань

Издательство: 

  • IEEE

Год издания: 

2022

Страницы: 

https://ieeexplore.ieee.org/abstract/document/9976525
Аннотация
One of the critical problems in computer modeling is getting numerical results from heavy computational models for large input parameter sets. In particular, this problem arises when researchers need to get accurate results for data visualization or machine learning. For instance, executing a simulation model on thousands of input parameter combinations can take days or weeks. Other tasks include estimating queuing networks properties, solving optimization problems, and various physics and economics models. This article describes an architecture of a distributed system that uses the docker technology for problem execution. The system includes a backend server, SQL and Redis databases, supervisor service and workers, where the problems are computed. Supervisor checks Redis queue for new tasks and distributes them between workers. Any input problem is automatically split into smaller chunks - tasks that workers compute. The user interacts with the system using the web interface written in JavaScript. For problem execution, the user creates a JSON file with problem description and docker image in which tasks will be executed. The system can be deployed in any public cloud. We implemented several different strategies for tasks prioritization and distribution among workers. Numerical results, presented in the paper, demonstrate the influence of the choice of the method of tasks distribution and prioritization on the duration of the computation under moderate workload.

Библиографическая ссылка: 

Соколов А.М., Ларионов А.А., Мухтаров А.А., Федотов И.А. Architecture of a Distributed Parallel Computing System Using Docker Cluster / Proceedings of the 6th International Scientific Conference on Information, Control, and Communication Technologies (ICCT 2022). Астрахань: IEEE, 2022. С. https://ieeexplore.ieee.org/abstract/document/9976525.