Vilares, DavidGómez-Rodríguez, Carlos2024-05-242024-05-242019-07David Vilares and Carlos Gómez-Rodríguez. 2019. HEAD-QA: A Healthcare Dataset for Complex Reasoning. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 960–966, Florence, Italy. Association for Computational Linguistics.http://hdl.handle.net/2183/36616Took place in Florence (Italy) at the 'Fortezza da Basso' from July 28th to August 2nd, 2019.[Absctract]: We present HEAD-QA, a multi-choice question answering testbed to encourage research on complex reasoning. The questions come from exams to access a specialized position in the Spanish healthcare system, and are challenging even for highly specialized humans. We then consider monolingual (Spanish) and cross-lingual (to English) experiments with information retrieval and neural techniques. We show that: (i) HEAD-QA challenges current methods, and (ii) the results lag well behind human performance, demonstrating its usefulness as a benchmark for future work.engAtribución 3.0 Españahttp://creativecommons.org/licenses/by/3.0/es/Healthcare datasetComplex reasoningMulti-choice question answeringCross-lingual experimentsconference outputopen access