PUMA
Istituto di Scienza e Tecnologie dell'Informazione     
Perego R., Silvestri F., Puppin D., Beaza-Yates R. Incremental caching for collection selection architectures. In: INFOSCALE 2007 (Suzhou, China, June 6-8 2007). Proceedings, ICST, 2007.
 
 
Abstract
(English)
To address the rapid growth of the Internet, modern Web search engines have to adopt distributed organizations, where the collection of indexed documents is partitioned among several servers, and query answering is performed as a parallel and distributed task. Collection selection can be a way to reduce the overall computing load, by finding a trade-off between the quality of results retrieved and the cost of solving queries. In this paper, we analyze the relationship between the caching subsystem and the collection selection strategy, by exploring the design-space of this combined approach. In particular, we propose a novel caching policy able to incrementally refine the effectiveness of the results returned for each subsequent cache hit. The combination of collection selection and incremental caching strategies allows our system to retrieve two thirds of the top-ranked results returned by a baseline centralized index, with only one fifth of the computing workload.
Subject Web search engines
Caching
Efficiency
H.3 Information Storage and Retrieval


Icona documento 1) Download Document PDF


Icona documento Open access Icona documento Restricted Icona documento Private

 


Per ulteriori informazioni, contattare: Librarian http://puma.isti.cnr.it

Valid HTML 4.0 Transitional