PUMA
Istituto di Scienza e Tecnologie dell'Informazione     
Esuli A., Sebastiani F. Evaluating information extraction. Technical report, 2010.
 
 
Abstract
(English)
The issue of how to experimentally evaluate information extraction (IE) systems has received hardly any satisfactory solution in the literature. In this paper we propose a novel evaluation model for IE and argue that, among others, it allows (i) a correct appreciation of the degree of overlap between predicted and true segments, and (ii) a fair evaluation of the ability of a system to correctly identify segment boundaries. We describe the properties of this models, also by presenting the result of a re-evaluation of the results of the CoNLL'03 and CoNLL'02 Shared Tasks on Named Entity Extraction.
Subject Experimental evaluation
Information Extraction
Wrapper induction
Named entity recognition
F1
H.3.3 Information Search and Retrieval
I.2.7 Natural Language Processing


Icona documento 1) Download Document PDF


Icona documento Open access Icona documento Restricted Icona documento Private

 


Per ulteriori informazioni, contattare: Librarian http://puma.isti.cnr.it

Valid HTML 4.0 Transitional