Skip to main content
SpringerLink
Log in

An Information Visualization Tool for the Interactive Component-Based Evaluation of Search Engines

  • Conference paper
  • First Online:
Book cover Digital Libraries: The Era of Big Data and Data Science (IRCDL 2020)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1177))

Included in the following conference series:

Abstract

In this paper, we present an InfoVis tool based on SanKey diagrams for the exploration of large combinatorial combinations of IR components – the Grid of Points (GoP).

The goal of this tool is to ease the comprehension of the behavior of single IR components within fully functioning off-the-shelf IR systems without recurring to complex statistical tools. In order to assess the quality of the proposed SanKey-based InfoVis tool we conduceted an initial user study that led to interesting conclusions, yet to be validated in a future and more comprehensive study.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://gridofpoints.dei.unipd.it/.

  2. 2.

    http://www.terrier.org/.

References

  1. Angelini, M., Fazzini, V., Ferro, N., Santucci, G., Silvello, G.: CLAIRE: A combinatorial visual analytics system for information retrieval evaluation. Inf. Process. Manag. (2018). https://doi.org/10.1016/j.jvlc.2013.12.003. in print

    Google Scholar 

  2. Angelini, M., Ferro, N., Santucci, G., Silvello, G.: VIRTUE: a visual tool for information retrieval performance evaluation and failure analysis. J. Vis. Lang. Comput. (JVLC) 25(4), 394–413 (2014)

    Google Scholar 

  3. Angelini, M., Ferro, N., Santucci, G., Silvello, G.: A visual analytics approach for what-if analysis of information retrieval systems. In: Perego et al. [14], pp. 1081–1084 (2016)

    Google Scholar 

  4. Crestani, F., Vegas, J., de la Fuente, P.: A graphical user interface for the retrieval of hierarchically structured documents. Inf. Process. Manag. 40(2), 269–289 (2004)

    Google Scholar 

  5. Dunnett, C.W.: A multiple comparison procedure for comparing several treatments with a control. J. Am. Stat. Assoc. 50(272), 1096–1121 (1955)

    MATH  Google Scholar 

  6. Ferro, N., Silvello, G.: A general linear mixed models approach to study system component effects. In: Perego et al. [14], pp. 25–34

    Google Scholar 

  7. Ferro, N., Silvello, G.: 3.5K runs, 5K topics, 3M assessments and 70M measures: what trends in 10 years of Adhoc-ish CLEF?.Inf. Process. Manag. 53(1), 175–202 (2017)

    Google Scholar 

  8. Ferro, N., Silvello, G.: Towards an anatomy of IR system component performances. J. Am. Soc. Inf. Sci. Technol. (JASIST) 69(2), 187–200 (2017)

    Google Scholar 

  9. Fowler, R.H., Lawrence-Fowler, W.A., Wilson, B.A.: Integrating query, thesaurus, and documents through a common visual representation. In: Fox, E.A. (ed.) Proc. 14th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 1991). ACM Press, New York, USA (1991)

    Google Scholar 

  10. Hearst, M.A.: “Natural” search user interfaces. Commun. ACM (CACM) 54(11), 60–67 (2011)

    Google Scholar 

  11. Koshman, S.: Testing user interaction with a prototype visualization-based information retrieval system. J. Am. Soc. Inf. Sci. Technol. (JASIST) 56(8), 824–833 (2005). https://doi.org/10.1002/asi.20175

    Google Scholar 

  12. Lipani, A., Lupu, M., Hanbury, A.: Visual pool: a tool to visualize and interact with the pooling method. In: Kando, N., Sakai, T., Joho, H., Li, H., de Vries, A.P., White, R.W. (eds.) Proceedings of 40th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2017). ACM Press, New York (2017)

    Google Scholar 

  13. Morse, E.L., Lewis, M., Olsen, K.A.: Testing visual information retrieval methodologies case study: comparative analysis of textual, icon, graphical, and spring displays. J. Am. Soc. Inf. Sci. Technol. (JASIST) 53(1), 28–40 (2002)

    Google Scholar 

  14. Perego, R., Sebastiani, F., Aslam, J., Ruthven, I., Zobel, J. (eds.): Proceedings of 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2016). ACM Press, New York (2016)

    Google Scholar 

  15. Zhang, J.: TOFIR: a tool of facilitating information retrieval - introduce a visual retrieval model. Inf. Process. Manag. 37(4), 639–657 (2001)

    MATH  Google Scholar 

  16. Zhang, J.: Visualization for Information Retrieval. Springer, Heidelberg, Germany (2008)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Information Engineering, University of Padua, Padua, Italy

    Giacomo Rocco & Gianmaria Silvello

Authors
  1. Giacomo Rocco
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gianmaria Silvello
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gianmaria Silvello .

Editor information

Editors and Affiliations

  1. University of Bari, Bari, Italy

    Michelangelo Ceci

  2. University of Bari, Bari, Italy

    Stefano Ferilli

  3. Sapienza University of Rome, Rome, Italy

    Antonella Poggi

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Rocco, G., Silvello, G. (2020). An Information Visualization Tool for the Interactive Component-Based Evaluation of Search Engines. In: Ceci, M., Ferilli, S., Poggi, A. (eds) Digital Libraries: The Era of Big Data and Data Science. IRCDL 2020. Communications in Computer and Information Science, vol 1177. Springer, Cham. https://doi.org/10.1007/978-3-030-39905-4_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-39905-4_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-39904-7

  • Online ISBN: 978-3-030-39905-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation