RUC UDC
 

RUC >
1. Investigación >
Departamento de Computación >
Grupo de Investigación en Compiladores e Linguaxes. COLE >
DC-COLE - Artigos >

Please use this identifier to cite or link to this item: http://hdl.handle.net/2183/148

Title: Formal Methods of Tokenization for Part-of-Speech Tagging
Authors: Graña Gil, Jorge
Barcala Rodríguez, Francisco Mario
Vilares Ferro, Manuel
Issue Date: 2002
Publisher: Springer-Verlag
Citation: Proceedings of the Third International Conference on Computational Linguistics and Intelligent Text Processing (CICLING-2002), Ciudad de Méjico (Méjico). Published in Lecture Notes in Computer Science, vol. 2276, pp. 240-249. Springer Verlag. Gelbukh, A. (ed.).
Abstract: One of the most important prior tasks for robust part-of-speech tagging is the correct tokenization or segmentation of the texts. This task can involve processes which are much more complex than the simple identification of the diferent sentences in the text and each of their individual components, but it is often obviated in many current applications. Nevertheless, this preprocessing step is an indispensable task in practice, and it is particularly dificult to tackle it with scientific precision with-out falling repeatedly in the analysis of the specific casuistry of every phenomenon detected. In this work, we have developed a scheme of preprocessing oriented towards the disambiguation and robust tagging of Galician. Nevertheless, it is a proposal of a general architecture that can be applied to other languages, such as Spanish, with very slight modifications.
URI: http://hdl.handle.net/2183/148
ISBN: 3-540-43219-1
ISSN: 0302-9743
Appears in Collections:DC-COLE - Artigos

Files in This Item:

File Description SizeFormat
GranaCICLING2002.ps188.73 kBPostscriptView/Open

All items in RUC are protected by copyright, with all rights reserved.

 

Valid XHTML 1.0! Dspace Software Copyright © 2002-2005 MIT and Hewlett-Packard - Feedback