Istituto di Scienza e Tecnologie dell'Informazione     
Baccianella S., Esuli A., Sebastiani F. Using micro-documents for feature selection: the case of ordinal text classification. In: IIR 2011 - 2nd Italian Information Retrieval Workshop (Milano, IT, 27-28 gennaio 2011). Atti, article n. 4. Massimo Melucci, Stefano Mizzaro, Gabriella Pasi (eds.). (CEUR Workshop Proceedings, vol. 704). CEUR-WS.org, 2011.
Most popular feature selection (FS) methods for text classification (TC) such as information gain (a.k.a. mutual information), chi-square, and odds ratio, are based on binary information concerning the presence/absence of the feature in each training document. As such, these methods do not exploit a rich source of information, namely, the information concerning how frequently the feature occurs in each training document (term frequency). In order to overcome this drawback we break down each training document of length k into k training "micro-documents", each consisting of a single word occurrence and endowed with the same class information of the original training document. This move has the double effect of (a) allowing all the original FS methods to be still straightforwardly applicable, and (b) making them sensitive to term frequency. We study the impact of this strategy in the case of ordinal TC, using four recently introduced FS functions, two SVM-based learning methods, and two large datasets of product reviews. The experiments show that the use of this strategy substantially improves the accuracy of ordinal TC.
URL: http://ceur-ws.org/Vol-704/7.pdf
Subject Feature selection
Ordinal regression
Ordinal classification
Text classification
I.2.6 Learning
I.5.2 Design Methodology * Classifier design and evaluation

Icona documento 1) Download Document PDF

Icona documento Open access Icona documento Restricted Icona documento Private


Per ulteriori informazioni, contattare: Librarian http://puma.isti.cnr.it

Valid HTML 4.0 Transitional