PUMA
Istituto di Scienza e Tecnologie dell'Informazione     
Debole F., Sebastiani F. Supervised term weighting for automated text categorization. In: ACM Symposium on Applied Computing. SAC 2003 (Melbourne, Florida, March 9-12, 2003). Proceedings, pp. 784 - 788. ACM, 2003.
 
 
Abstract
(English)
The construction of a text classi.er usually involves (i) a phase of term selection, in which the most relevant terms for the classi.cation task are identi.ed, (ii) a phase of term weighting, in which document weights for the selected terms are computed, and (iii) a phase of classi.er learning, in which a classi.er is generated from the weighted representations of the training documents. This process involves an activity of supervised learning, in which information on the membership of training documents in categories is used. Traditionally, supervised learning enters only phases (i) and (iii). In this paper we propose instead that learning from training data should also a.ect phase (ii), i.e. that information on the membership of training documents to categories be used to determine term weights. We call this idea supervised term weighting (STW). As an example, we propose a number of "supervised variants" of tfidf weighting, obtained by replacing the idf function with the function that has been used in phase (i) for term selection. We present experimental results obtained on the standard Reuters-21578 benchmark with one classi.er learning method (support vector machines), three term selection functions (information gain, chi-square, and gain ratio), and both local and global term selection and weighting.
Subject text categorization
I.5.2 Classifier Design and Evaluation
I.2.6 Learning
H.3.3 Information Search and Retrieval
I.5.2 Feature Evaluation and Selecting
H.3.1 Content Analysis and Indexing


Icona documento 1) Download Document PDF


Icona documento Open access Icona documento Restricted Icona documento Private

 


Per ulteriori informazioni, contattare: Librarian http://puma.isti.cnr.it

Valid HTML 4.0 Transitional