PUMA
Istituto di Scienza e Tecnologie dell'Informazione     
Esuli A., Fagni T., Sebastiani F. Machines that learn how to code open-ended survey data. Part I: the basic approach and a working system. Technical report, 2009.
 
 
Abstract
(English)
In the last seven years we have carried out experimental research aimed at developing software that automatically codes open-ended survey responses. These projects have led to the generation of an industrial-strength software package now in operation at the Customer Insight division of a large international banking group, and now integrated into a widely-used software platform for the management of open-ended survey data. This software, which can code data at a rate of tens of thousands of open-ended responses per hour, and that can address responses formulated in any of five major European languages, is the result of contributions from different fields of computer science, including Information Retrieval, Machine Learning, Computational Linguistics, and Opinion Mining. Our approach is based on a learning metaphor, whereby automated verbatim coders are automatically generated by a general-purpose process that learns, from a user-provided sample of manually coded verbatims, the characteristics that new, uncoded verbatims should have in order to be attributed the codes in the codeframe. In this paper we discuss the basic philosophy underlying this software. In a forthcoming companion paper we present the results of experiments we have run on several datasets of real respondent data in which we have compared the accuracy of the software against the accuracy of human coders.
Subject Survey coding
Open-ended questions
Open-ended responses
Automatic coding
Machine learning
Opinion mining
Sentiment analysis
I.2.6 Learning (K.3.2)
I.5.2 Design Methodology. Classifier design and evaluation
J.1 Administrative Data Processing. Marketing


Icona documento 1) Download Document PDF


Icona documento Open access Icona documento Restricted Icona documento Private

 


Per ulteriori informazioni, contattare: Librarian http://puma.isti.cnr.it

Valid HTML 4.0 Transitional