Mostrar o rexistro simple do ítem
SMusket: Spark-based DNA error correction on distributed-memory systems
dc.contributor.author | Expósito, Roberto R. | |
dc.contributor.author | González-Domínguez, Jorge | |
dc.contributor.author | Touriño, Juan | |
dc.date.accessioned | 2023-12-18T11:00:12Z | |
dc.date.available | 2023-12-18T11:00:12Z | |
dc.date.issued | 2020 | |
dc.identifier.citation | R. R. Expósito, J. González-Domínguez, and J. Touriño, "SMusket: Spark-based DNA error correction on distributed-memory systems", Future Generation Computer Systems, vol. 111, pp. 698-713, 2020, https://doi.org/10.1016/j.future.2019.10.038 | es_ES |
dc.identifier.uri | http://hdl.handle.net/2183/34529 | |
dc.description | ©2020 Elsevier B.V. All rights reserved. This manuscript version is made available under the CC-BY-NC-ND 4.0 license https://creativecommons.org/licenses/bync-nd/4.0/. This version of the article has been accepted for publication in Future Generation Computer Systems. The Version of Record is available online at https://doi.org/10.1016/j.future.2019.10.038 | es_ES |
dc.description | This is the accepted version of: R. R. Expósito, J. González-Domínguez, and J. Touriño, "SMusket: Sparkbased DNA error correction on distributed-memory systems", Future Generation Computer Systems, vol. 111, pp. 698-713, 2020, https://doi.org/10.1016/j.future.2019.10.038 | es_ES |
dc.description.abstract | [Abstract]: Next-Generation Sequencing (NGS) technologies have revolutionized genomics research over the last decade, bringing new opportunities for scientists to perform groundbreaking biological studies. Error correction in NGS datasets is considered an important preprocessing step in many workflows as sequencing errors can severely affect the quality of downstream analysis. Although current error correction approaches provide reasonably high accuracies, their computational cost can be still unacceptable when processing large datasets. In this paper we propose SparkMusket (SMusket), a Big Data tool built upon the open-source Apache Spark cluster computing framework to boost the performance of Musket, one of the most widely adopted and top-performing multithreaded correctors. Our tool efficiently exploits Spark features to implement a scalable error correction algorithm intended for distributed-memory systems built using commodity hardware. The experimental evaluation on a 16-node cluster using four publicly available datasets has shown that SMusket is up to 15.3 times faster than previous state-of-the-art MPI-based tools, also providing a maximum speedup of 29.8 over its multithreaded counterpart. SMusket is publicly available under an open-source license at https://github.com/rreye/smusket | es_ES |
dc.description.sponsorship | This work was supported by the Ministry of Economy, Industry and Competitiveness of Spain and FEDER, Spain funds of the European Union (project TIN2016-75845-P, AEI/FEDER/EU); and by Xunta de Galicia, Spain (projects ED431G/01 and ED431C 2017/04). | es_ES |
dc.description.sponsorship | Xunta de galicia; ED431G/01 | es_ES |
dc.description.sponsorship | Xunta de Galicia; ED431C 2017/04 | es_ES |
dc.language.iso | eng | es_ES |
dc.publisher | Elsevier B.V. | es_ES |
dc.relation | info:eu-repo/grantAgreement/MINECO/Plan Estatal de Investigación Científica y Técnica y de Innovación 2013-2016/TIN2016-75845-P/ES/NUEVOS DESAFIOS EN COMPUTACION DE ALTAS PRESTACIONES: DESDE ARQUITECTURAS HASTA APLICACIONES (II)/ | es_ES |
dc.relation.isversionof | https://doi.org/10.1016/j.future.2019.10.038 | |
dc.relation.uri | https://doi.org/10.1016/j.future.2019.10.038 | es_ES |
dc.rights | Atribución-NoComercial-SinDerivadas 3.0 España | es_ES |
dc.rights.uri | http://creativecommons.org/licenses/by-nc-nd/3.0/es/ | * |
dc.subject | Next-Generation Sequencing (NGS) | es_ES |
dc.subject | Sequence analysis | es_ES |
dc.subject | Big Data | es_ES |
dc.subject | Apache Spark | es_ES |
dc.subject | Error correction | es_ES |
dc.title | SMusket: Spark-based DNA error correction on distributed-memory systems | es_ES |
dc.type | info:eu-repo/semantics/article | es_ES |
dc.rights.access | info:eu-repo/semantics/openAccess | es_ES |
UDC.journalTitle | Future Generation Computer Systems | es_ES |
UDC.volume | 111 | es_ES |
UDC.startPage | 698 | es_ES |
UDC.endPage | 713 | es_ES |
dc.identifier.doi | 10.1016/j.future.2019.10.038 |
Ficheiros no ítem
Este ítem aparece na(s) seguinte(s) colección(s)
-
GI-GAC - Artigos [189]