Istituto di Scienza e Tecnologie dell'Informazione     
Esuli A., Sebastiani F. Training data cleaning for text classification. In: ICTIR 2009 - Advances in Information Retrieval Theory. Second International Conference on the Theory of Information Retrieval (Cambridge, UK, 10-12 September 2009). Proceedings, pp. 29 - 41. Leif Azzopardi, Gabriella Kazai, Stephen E. Robertson, Stefan M. Rüger, Milad Shokouhi, Dawei Song, Emine Yilmaz: (eds.). (Lecture Notes in Computer Science, vol. 5766). Springer Verlag, 2009.
In text classification (TC) and other tasks involving supervised learning, labelled data may be scarce or expensive to obtain. Semi-supervised learning and active learning are two strategies whose aim is maximizing the effectiveness of the resulting classifiers while minimizing the required amount of training effort; both strategies have been actively investigated for TC in recent years. Much less research has been devoted to a third such strategy, training data cleaning (TDC), which consists in devising ranking functions that sort the original training examples in terms of how likely it is that the human annotator has misclassified them, thereby providing a convenient means for the human annotator to revise the training set so as to improve its quality. Working in the context of boosting-based learning methods we present three different techniques for performing TDC and, on two widely used TC benchmarks, evaluate them by their capability of spotting misclassified texts purposefully inserted in the training set.
URL: http://www.springerlink.com/content/t6k42014l412/
DOI: 10.1007/978-3-642-04417-5_4
Subject Training data cleaning
Error correction
Text classification
Data quality
I.2.6 Learning
I.5.2 Design Methodology. Classifier design and evaluation

Icona documento 1) Download Document PDF

Icona documento Open access Icona documento Restricted Icona documento Private


Per ulteriori informazioni, contattare: Librarian http://puma.isti.cnr.it

Valid HTML 4.0 Transitional