Istituto di Scienza e Tecnologie dell'Informazione     
Debole F., Sebastiani F. Supervised term weighting for automated text categorization. Technical report, 2002.
The construction of a text classifier usually involves (i) a phase of emph{term selection}, in which the most relevant terms for the classification task are identified, (ii) a phase of emph{term weighting}, in which document weights for the selected terms are computed, and (iii) a phase of emph{classifier learning}, in which a classifier is generated from the weighted representations of the training documents. This process involves an activity of {em supervised learning}, in which information on the membership of training documents in categories is used. Traditionally, supervised learning enters only phases (i) and (iii). In this paper we propose instead that learning from the training data should also affect phase (ii), i.e. that information on the membership of training documents to categories be used to determine term weights. We call this idea emph{supervised term weighting} (STW). As an example of STW, we propose a number of ``supervised variants'' of $tfidf$ weighting, obtained by replacing the $idf$ function with the function that has been used in phase (i) for term selection. The use of STW allows the terms that are distributed most differently in the positive and negative examples of the categories of interest to be weighted highest. We present experimental results obtained on the standard textsf{Reuters-21578} benchmark with three classifier learning methods (Rocchio, $k$-NN, and support vector machines), three term selection functions (information gain, chi-square, and gain ratio), and both local and global term selection and weighting.
Subject Supervised term weighting
Text categorization
Text classification
Support vector machines
Supervised learning
Term weighting
H.3.1 [Information storage and retrieval]{Content analysis and indexing:Indexing methods
I.2.3 [Artificial Intelligence] Learnin: Induction

Icona documento 1) Download Document PDF

Icona documento Open access Icona documento Restricted Icona documento Private


Per ulteriori informazioni, contattare: Librarian http://puma.isti.cnr.it

Valid HTML 4.0 Transitional