Limaylla-Lunarejo, María-IsabelCondori Fernández, NellyRodríguez Luaces, Miguel2026-10-192026-10-192023Limaylla-Lunarejo, MI., Condori-Fernandez, N., Luaces, M.R. (2023). Requirements Classification Using FastText and BETO in Spanish Documents. In: Ferrari, A., Penzenstadler, B. (eds) Requirements Engineering: Foundation for Software Quality. REFSQ 2023. Lecture Notes in Computer Science, vol 13975, pp. 59–176. Springer, Cham. https://doi.org/10.1007/978-3-031-29786-1_11978-3-031-29786-1https://hdl.handle.net/2183/49829Presented at: 29th International Working Conference on Requirements Engineering: Foundation for Software Quality (REFSQ 2023), April 17–20, 2023, Barcelona, Spain. This version of the article has been accepted for publication, after peer review and is subject to Springer Nature’s AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1007/978-3-031-29786-1_11 Code and datasets used: https://zenodo.org/records/7311148[Abstract] Context and motivation: Machine Learning (ML) algorithms and Natural Language Processing (NLP) techniques have effectively supported the automatic software requirements classification. The emergence of pre-trained language models, like BERT, provides promising results in several downstream NLP tasks, such as text classification. Question/problem: Most ML/DL approaches on requirements classification show a lack of analysis for requirements written in the Spanish language. Moreover, there has not been much research on pre-trained language models, like fastText and BETO (BERT for the Spanish language), neither in the validation of the generalization of the models. Principal ideas/results: We aim to investigate the classification performance and generalization of fastText and BETO classifiers in comparison with other ML/DL algorithms. The findings show that Shallow ML algorithms outperformed fastText and BETO when training and testing in the same dataset, but BETO outperformed other classifiers on prediction performance in a dataset with different origins. Contribution: Our evaluation provides a quantitative analysis of the classification performance of fastTest and BETO in comparison with ML/DL algorithms, the external validity of trained models on another Spanish dataset, and the translation of the PROMISE NFR dataset in Spanish.eng© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AGSpanish requirementsAutomatic classification requirementsFastTextBETORequirements Classification Using FastText and BETO in Spanish Documentsconference outputopen access10.1007/978-3-031-29786-1_11