Vázquez Lema, DavidÁlvarez-Estévez, DiegoMosqueira-Rey, Eduardo2026-09-182026-09-182025Vázquez Lema, D., Álvarez Estévez, D., Mosqueira Rey, E. (2026). Application of Transformers for Sleep Stage Classification. In Proceedings XoveTIC 2025: Impulsando el talento científico (pp. 99-106). Servizo de Publicacións UDC. https://doi.org/10.17979/spu.23.c23978-84-9749-925-5https://hdl.handle.net/2183/49323Presentado en: VIII Congreso Xove TIC: impulsando el talento científico. Octubre, 2025, A Coruña.[Abstract] Transformer architectures have revolutionized the field of artificial intelligence. This work investigates the application of Transformers to the sleep stage classification problem. Despite promising results in recent studies, the clinical application of these methods remains limited. In this paper, we propose a novel model that replaces the LSTM component of a state-of-the-art CNN+LSTM architecture with a Transformer encoder, comparing its performance against our baseline and several state-of-the-art models. The results showed faster convergence, reduced complexity, and enhanced performance. Leveraging the Transformer architecture, we propose and investigate an interpretability method based on attention mechanisms. Finally, we evaluate the inter-database generalization performance of our model.engAttribution-NonCommercial-NoDerivatives 4.0 Internationalhttp://creativecommons.org/licenses/by-nc-nd/4.0/Sleep stage classificationTransformersAttention mechanismsDeep learningInter-database generalizationconference outputopen access10.17979/spu.23.c23