Population based metaheuristics in Spark: Towards a general framework using PSO as a case study
![Thumbnail](/dspace/bitstream/handle/2183/36167/Pardo_XoanC_2024_Population_based_metaheuristics_in_Spark.pdf.jpg?sequence=5&isAllowed=y)
Use este enlace para citar
http://hdl.handle.net/2183/36167
A non ser que se indique outra cousa, a licenza do ítem descríbese como Attribution 4.0 International (CC BY)
Coleccións
- GI-GAC - Artigos [190]
Metadatos
Mostrar o rexistro completo do ítemTítulo
Population based metaheuristics in Spark: Towards a general framework using PSO as a case studyData
2024-03Cita bibliográfica
X. C. Pardo, P. González, J. R. Banga and R. Doallo, "Population based metaheuristics in Spark: Towards a general framework using PSO as a case study", Swarm and Evolutionary Computation, Vol. 85, 101483, mar. 2024, doi: 10.1016/j.swevo.2024.101483
Resumo
[Abstract]: Over the years metaheuristics have been successfully applied to optimization problems in many real-world applications. The increasing complexity and scale of the problems addressed has posed new challenges to researchers in the field. The application of distributed metaheuristics is a common approach to speed up the time to solution or improve its quality by leveraging traditional parallel programming models on platforms like multicore processors or computer clusters. More recently, the emergence of Cloud Computing and new programming models and frameworks for Big Data has facilitated access to an unprecedented amount of computational resources, which led to a growing interest in optimization frameworks that support the development and execution of distributed metaheuristics taking advantage of this potential. In this paper, we present the current status of development of one such framework that aims to provide support for the application of distributed population-based metaheuristics to the global optimization of large-scale problems in Spark. The framework provides a reduced set of abstractions to represent the general structure of population-based metaheuristics as templates and strategies to particularize them into concrete metaheuristics, as well as other nice features like out of the box implementations of the most common distributed models, full configurability through a human-friendly format, and the possibility of rapid prototyping and testing metaheuristics in the Spark shell. To validate the approach, a template for Particle Swarm Optimization (PSO) was implemented as a proof of concept, which includes strategies for instantiating different variants of the algorithm, configurable topologies, and sequential and distributed execution models.
Palabras chave
Apache Spark
Distributed metaheuristics
Metaheuristic optimization framework
Particle swarm optimization
Population based metaheuristics
Distributed metaheuristics
Metaheuristic optimization framework
Particle swarm optimization
Population based metaheuristics
Descrición
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG
Versión do editor
Dereitos
Attribution 4.0 International (CC BY)