Istituto di Scienza e Tecnologie dell'Informazione     
Freire A., Macdonald C., Tonellotto N., Ounis I., Cacheda F. Scheduling queries across replicas. In: SIGIR 2012 - 35th International ACM SIGIR Conference on Research and Development in Information Retrieval (Portland, OR, USA, 12-16 August 2012). Proceedings, pp. 1139 - 1140. ACM, 2012.
For increased efficiency, an information retrieval system can split its index into multiple shards, and then replicate these shards across many query servers. For each new query, an appropriate replica for each shard must be selected, such that the query is answered as quickly as possible. Typically, the replica with the lowest number of queued queries is selected. However, not every query takes the same time to execute, particularly if a dynamic pruning strategy is applied by each query server. Hence, the replica's queue length is an inaccurate indicator of the workload of a replica, and can result in inefficient usage of the replicas. In this work, we propose that improved replica selection can be obtained by using query efficiency prediction to measure the expected workload of a replica. Experiments are conducted using 2.2k queries, over various numbers of shards and replicas for the large GOV2 collection. Our results show that query waiting and completion times can be markedly reduced, showing that accurate response time predictions can improve scheduling accuracy and attesting the benefit of the proposed scheduling algorithm.
URL: http://dl.acm.org/citation.cfm?id=2348508&CFID=276679955&CFTOKEN=53698396
DOI: 10.1145/2348283.2348508
Subject Performance
H.3.3 Information Search & Retrieval

Icona documento 1) Download Document PDF
Icona documento 2) Download Document PDF

Icona documento Open access Icona documento Restricted Icona documento Private


Per ulteriori informazioni, contattare: Librarian http://puma.isti.cnr.it

Valid HTML 4.0 Transitional