Ezquerro, AnaGómez-Rodríguez, CarlosVilares, David2026-06-112026-06-112026Ana Ezquerro, Carlos Gómez-Rodríguez, and David Vilares. 2026. Bringing Emerging Architectures to Sequence Labeling in NLP. In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 4886–4909, Rabat, Morocco. Association for Computational Linguistics. https://doi.org/10.18653/v1/2026.eacl-long.227979-8-89176-380-7https://hdl.handle.net/2183/48565Presented at: 19th Conference of the European Chapter of the Association for Computational Linguistics, March 24–29, 2026, Rabat, Morocco[Abstract]: Pretrained Transformer encoders are the dominant approach to sequence labeling. While some alternative architectures-such as xLSTMs, structured state-space models, diffusion models, and adversarial learning-have shown promise in language modeling, few have been applied to sequence labeling, and mostly on flat or simplified tasks. We study how these architectures adapt across tagging tasks that vary in structural complexity, label space, and token dependencies, with evaluation spanning multiple languages. We find that the strong performance previously observed in simpler settings does not always generalize well across languages or datasets, nor does it extend to more complex structured tasks.engAttribution 4.0 Internationalhttp://creativecommons.org/licenses/by/4.0/Sequence LabelingEmerging ArchitecturesTransformer Encodersconference outputopen access10.18653/v1/2026.eacl-long.227