Visual Pool: A Tool to Visualize and Interact with the Pooling Method

Type: 
Proceedings contribution
Proceedings: 
Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval
Publisher: 
ACM
Pages: 
1321 - 1324
ISBN: 
ISBN: 978-1-4503-5022-8
Year: 
2017
Abstract: 
Every year more than 25 test collections are built among the main Information Retrieval (IR) evaluation campaigns. They are extremely important in IR because they become the evaluation praxis for the forthcoming years. Test collections are built mostly using the pooling method. The main advantage of this method is that it drastically reduces the number of documents to be judged. It does so at the cost of introducing biases, which are sometimes aggravated by non optimal configuration. In this paper we develop a novel visualization technique for the pooling method, and integrate it in a demo application named Visual Pool. This demo application enables the user to interact with the pooling method with ease, and develops visual hints in order to analyze existing test collections, and build better ones.
TU Focus: 
Computational Science and Engineering
Reference: 

A. Lipani, M. Lupu, A. Hanbury:
"Visual Pool: A Tool to Visualize and Interact with the Pooling Method";
in: "Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval", ACM, Shinjuku, Tokyo, Japan, 2017, ISBN: 978-1-4503-5022-8, S. 1321 - 1324.

Zusätzliche Informationen

Last changed: 
15.12.2017 17:46:00
TU Id: 
264551
Accepted: 
Accepted
Invited: 
Department Focus: 
Author List: 
A. Lipani, M. Lupu, A. Hanbury
Abstract German: