Machine learning in a multi-agent system for distributed computing management

Статья конференции

Bychkov I.V., Feoktistov A.G., Sidorov I.A., Edelev A.V., Gorsky S.A., Kostromin R.O.

Журнал: CEUR Workshop Proceedings

4th International Conference on Information Technology and Nanotechnology - Session: Data Science, DS-ITNT 2018

CEUR Workshop Proceedings. Vol.2212. P.89-97.

2018

We address the relevant problem of machine learning in a multi-agent system for distributed computing management. We propose a new approach to the agent learning in the system for managing job flows of scalable applications in a heterogeneous distributed computing environment, which includes high-performance computing clusters, as its main components. We manage parameter sweep applications that execute their jobs in a virtual machine environment. We use the specialized tools to implement such environment. In contrast to the known approaches, our approach is based on the integrated applying of methods for job classification and parameter adjustment of algorithms for functioning agents. Simulation modeling the environment allows eliciting the necessary knowledge for parameter adjustment. During the learning of agents, we use the expert knowledge of environment node administrators. An example of solving the complex practical problem that relates to studying energy development directions of Russia demonstrates advantages of the proposed approach. © 2018 CEUR-WS. All rights reserved.

Библиографическая ссылка

Bychkov I.V., Feoktistov A.G., Sidorov I.A., Edelev A.V., Gorsky S.A., Kostromin R.O. Machine learning in a multi-agent system for distributed computing management // CEUR Workshop Proceedings. Vol.2212. 2018. P.89-97. http://ceur-ws.org/Vol-2212/paper12.pdf

learning systems