Design of efficient Java message-passing collectives on multi-core clusters
![Thumbnail](/dspace/bitstream/handle/2183/22022/G.L.Taboada_2011_Design_of_efficient_Java_message-passing_collectives_on_multi-core_clusters.pdf.jpg?sequence=4&isAllowed=y)
Use este enlace para citar
http://hdl.handle.net/2183/22022Colecciones
- GI-GAC - Artigos [190]
Metadatos
Mostrar el registro completo del ítemTítulo
Design of efficient Java message-passing collectives on multi-core clustersFecha
2011-02Cita bibliográfica
Taboada, G.L., Ramos, S., Touriño, J. et al. J Supercomput (2011) 55: 126. https://doi.org/10.1007/s11227-010-0464-5
Resumen
[Abstract] This paper presents a scalable and efficient Message-Passing in Java (MPJ) collective communication library for parallel computing on multi-core architectures. The continuous increase in the number of cores per processor underscores the need for scalable parallel solutions. Moreover, current system deployments are usually multi-core clusters, a hybrid shared/distributed memory architecture which increases the complexity of communication protocols. Here, Java represents an attractive choice for the development of communication middleware for these systems, as it provides built-in networking and multithreading support. As the gap between Java and compiled languages performance has been narrowing for the last years, Java is an emerging option for High Performance Computing (HPC).
Our MPJ collective communication library increases Java HPC applications performance on multi-core clusters: (1) providing multi-core aware collective primitives; (2) implementing several algorithms (up to six) per collective operation, whereas publicly available MPJ libraries are usually restricted to one algorithm; (3) analyzing the efficiency of thread-based collective operations; (4) selecting at runtime the most efficient algorithm depending on the specific multi-core system architecture, and the number of cores and message length involved in the collective operation; (5) supporting the automatic performance tuning of the collectives depending on the system and communication parameters; and (6) allowing its integration in any MPJ implementation as it is based on MPJ point-to-point primitives. A performance evaluation on an InfiniBand and Gigabit Ethernet multi-core cluster has shown that the implemented collectives significantly outperform the original ones, as well as higher speedups when analyzing the impact of their use on collective communications intensive Java HPC applications. Finally, the presented library has been successfully integrated in MPJ Express (http://mpj-express.org), and will be distributed with the next release.
Palabras clave
Message Passing in Java (MPJ)
Multi-core clusters
Scalable collective communication
High performance computing
Performance evaluation
Multi-core clusters
Scalable collective communication
High performance computing
Performance evaluation
Descripción
This is a post-peer-review, pre-copyedit version of an article published in The Journal of Supercomputing. The final authenticated version is available online at: https://doi.org/10.1007/s11227-010-0464-5
Versión del editor
ISSN
0920-8542
1573-0484
1573-0484