Istituto di Scienza e Tecnologie dell'Informazione     
Broccolo D., Macdonald C., Orlando S., Ounis I., Perego R., Silvestri F., Tonellotto N. Load-sensitive selective pruning for distributed search. In: CIKM'13 - 22nd ACM International Conference on information & Knowledge Management (San Francisco, October 27 -1 November 2013). Proceedings, pp. 379 - 388. ACM, 2013.
A search engine infrastructure must be able to provide the same quality of service to all queries received during a day. During normal operating conditions, the demand for resources is considerably lower than under peak conditions, yet an oversized infrastructure would result in an unnecessary waste of computing power. A possible solution adopted in this situation might consist of de ning a maximum threshold processing time for each query, and dropping queries for which this threshold elapses, leading to disappointed users. In this paper, we propose and evaluate a di erent approach, where, given a set of di erent query processing strategies with di ering eciency, each query is considered by a framework that sets a maximum query processing time and selects which processing strategy is the best for that query, such that the processing time for all queries is kept below the threshold. The processing time estimates used by the scheduler are learned from past queries. We experimentally validate our approach on 10,000 queries from a standard TREC dataset with over 50 million documents, and we compare it with several baselines. These experiments encompass testing the system under di erent query loads and di erent maximum tolerated query response times. Our results show that, at the cost of a marginal loss in terms of response quality, our search system is able to answer 90% of queries within half a second during times of high query volume.
URL: http://dl.acm.org/citation.cfm?id=2505699
DOI: 10.1145/2505515.2505699
Subject Distributed Search Engines
H.3.3 Information Search and Retrieval

Icona documento 1) Download Document PDF
Icona documento 2) Download Document PDF

Icona documento Open access Icona documento Restricted Icona documento Private


Per ulteriori informazioni, contattare: Librarian http://puma.isti.cnr.it

Valid HTML 4.0 Transitional