Parallel Texts Dataset for Uzbek-Kazakh Machine Translation

UDC.coleccionInvestigación
UDC.departamentoLetras
UDC.grupoInvLingua e Sociedade da Información (LYS)
UDC.institutoCentroCITIC - Centro de Investigación de Tecnoloxías da Información e da Comunicación
UDC.journalTitleData in Brief
UDC.startPage110194
UDC.volume53
dc.contributor.authorAllaberdiev, Bobur
dc.contributor.authorMatlatipov, Gayrat
dc.contributor.authorKuriyozov, Elmurod
dc.contributor.authorRakhmonov, Zafar
dc.date.accessioned2026-11-05T12:36:37Z
dc.date.available2026-11-05T12:36:37Z
dc.date.issued2024-04
dc.descriptionDataset: https://huggingface.co/datasets/Sanatbek/uzbek-kazakh-parallel-corpora
dc.description.abstract[Abstract] This paper presents a parallel corpus of raw texts between the Uzbek and Kazakh languages as a dataset for machine translation applications, focusing on the data collection process, dataset description, and its potential for reuse. The dataset-building process includes three separate stages, starting with a tiny portion of already available parallel data, then some more compiled from openly available resources like literature books, and web news texts, which were aligned using the sentence alignment method, encompassing a wide range of topics and genres. Finally, the majority of the dataset was taken from a raw text corpus in Uzbek and manually translated into Kazakh by a group of experts who are fluent in both languages. The resulting parallel corpus serves as a valuable resource for researchers and practitioners interested in Kazakh and Uzbek language processing tasks, particularly in the context of neural machine translation, where the presented data can be used for testing the rule-based machine translation models, or it can be used for both training statistical and neural machine translation models as well. The dataset has been made accessible through the widely recognized Hugging Face platform, a repository known for facilitating collaborative efforts and advancing Natural Language Processing (NLP) applications. This combination of methods to obtain a parallel corpus plays as a pivot for other languages among other low-resource Turkic languages.
dc.description.sponsorshipThis publication has been produced within the framework of the Grant “REP-25112021/113 - UzUDT: Universal Dependencies Treebank and parser for natural language processing on the Uzbek Language”, funded under the MUNIS Project, hosted by The National University of Uzbekistan named after Mirzo Ulugbek, supported by the World Bank and the Government of the Republic of Uzbekistan. The statements do not necessarily reflect the official position of the World Bank and the Government of the Republic of Uzbekistan. The authors also would like to thank all the students who participated in the translation process for their time and effort spent.
dc.description.sponsorshipUzbekistan. The National University of Uzbekistan named after Mirzo Ulugbek / MUNIS Project; REP-25112021/113
dc.description.urihttps://huggingface.co/datasets/Sanatbek/uzbek-kazakh-parallel-corpora
dc.identifier.citationB. Allaberdiev, G. Matlatipov, E. Kuriyozov, and Z. Rakhmonov, "Parallel Texts Dataset for Uzbek-Kazakh Machine Translation", Data in Brief, vol. 53, 110194, April 2024, https://doi.org/10.1016/j.dib.2024.110194
dc.identifier.doi10.1016/j.dib.2024.110194
dc.identifier.issn2352-3409
dc.identifier.urihttps://hdl.handle.net/2183/50133
dc.language.isoeng
dc.publisherElsevier
dc.relation.referencestoDataset
dc.relation.urihttps://doi.org/10.1016/j.dib.2024.110194
dc.rightsAttribution 4.0 Internationalen
dc.rights.accessRightsopen access
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/
dc.subjectMachine translation
dc.subjectParallel corpus
dc.subjectText dataset
dc.subjectNLP
dc.subjectUzbek language
dc.subjectKazakh language
dc.subjectTurkic languages
dc.titleParallel Texts Dataset for Uzbek-Kazakh Machine Translation
dc.typejournal article
dc.type.hasVersionVoR
dspace.entity.typePublication

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Kuriyozov_Elmurod_2024_Parallel_texts_dataset_for_Uzbek_Kazakh_machine_translation.pdf
Size:
563.66 KB
Format:
Adobe Portable Document Format