PUMA
Istituto di Scienza e Tecnologie dell'Informazione     
Esuli A., Sebastiani F. Evaluating information extraction. In: CLEF'10 - International Conference on Multilingual and Multimodal Information Access Evaluation (Padova, IT, 20-23 Settembre 2010). Proceedings, pp. 100 - 111. Maristella Agosti, Nicola Ferro, Carol Peters, Maarten de Rijke, Alan Smeaton (eds.). (Lecture Notes in Computer Science, vol. 6360). Springer, 2010.
 
 
Abstract
(English)
The issue of how to experimentally evaluate information extraction (IE) systems has received hardly any satisfactory solution in the literature. In this paper we propose a novel evaluation model for IE and argue that, among others, it allows (i) a correct appreciation of the degree of overlap between predicted and true segments, and (ii) a fair evaluation of the ability of a system to correctly identify segment boundaries. We describe the properties of this models, also by presenting the result of a re-evaluation of the results of the CoNLL'03 and CoNLL'02 Shared Tasks on Named Entity Extraction.
URL: http://www.springerlink.com/content/n433t630q3178540
DOI: 10.1007/978-3-642-15998-5_12
Subject Experimental evaluation
Information Extraction
Wrapper induction
Named entity recognition
H.3.3 Information Search and Retrieval
I.2.7 Natural Language Processing


Icona documento 1) Download Document PDF


Icona documento Open access Icona documento Restricted Icona documento Private

 


Per ulteriori informazioni, contattare: Librarian http://puma.isti.cnr.it

Valid HTML 4.0 Transitional