ALBAYZIN Query-by-example Spoken Term Detection 2016 evaluation
![Thumbnail](/dspace/bitstream/handle/2183/37657/Lopez_Otero_Paula_2018_ALBAYZIN.pdf.jpg?sequence=5&isAllowed=y)
Use this link to cite
http://hdl.handle.net/2183/37657Collections
- GI-IRlab-Artigos [27]
Metadata
Show full item recordTitle
ALBAYZIN Query-by-example Spoken Term Detection 2016 evaluationAuthor(s)
Date
2018Citation
Tejedor, J., Toledano, D., Lopez-Otero, P. et al. ALBAYZIN Query-by-example Spoken Term Detection 2016 evaluation. J AUDIO SPEECH MUSIC PROC. 2018, 2 (2018). https://doi.org/10.1186/s13636-018-0125-9
Abstract
[Abstract]: Query-by-example Spoken Term Detection (QbE STD) aims to retrieve data from a speech repository given an acoustic (spoken) query containing the term of interest as the input. This paper presents the systems submitted to the ALBAYZIN QbE STD 2016 Evaluation held as a part of the ALBAYZIN 2016 Evaluation Campaign at the IberSPEECH 2016 conference. Special attention was given to the evaluation design so that a thorough post-analysis of the main results could be carried out. Two different Spanish speech databases, which cover different acoustic and language domains, were used in the evaluation: the MAVIR database, which consists of a set of talks from workshops, and the EPIC database, which consists of a set of European Parliament sessions in Spanish. We present the evaluation design, both databases, the evaluation metric, the systems submitted to the evaluation, the results, and a thorough analysis and discussion. Four different research groups participated in the evaluation, and a total of eight template matching-based systems were submitted. We compare the systems submitted to the evaluation and make an in-depth analysis based on some properties of the spoken queries, such as query length, single-word/multi-word queries, and in-language/out-of-language queries.
Keywords
Query-by-example Spoken Term Detection
International evaluation
Spanish
Search on spontaneous speech
International evaluation
Spanish
Search on spontaneous speech
Editor version
Rights
Atribución 4.0 Internacional
ISSN
1687-4722