skip to main content
10.1145/2856767.2856797acmconferencesArticle/Chapter ViewAbstractPublication PagesiuiConference Proceedingsconference-collections
research-article

Rank As You Go: User-Driven Exploration of Search Results

Published: 07 March 2016 Publication History

Abstract

Whenever users engage in gathering and organizing new information, searching and browsing activities emerge at the core of the exploration process. As the process unfolds and new knowledge is acquired, interest drifts occur inevitably and need to be accounted for. Despite the advances in retrieval and recommender algorithms, real-world interfaces have remained largely unchanged: results are delivered in a relevance-ranked list. However, it quickly becomes cumbersome to reorganize resources along new interests, as any new search brings new results. We introduce uRank and investigate interactive methods for understanding, refining and reorganizing documents on-the-fly as information needs evolve. uRank includes views summarizing the contents of a recommendation set and interactive methods conveying the role of users' interests through a recommendation ranking. A formal evaluation showed that gathering items relevant to a particular topic of interest with uRank incurs in lower cognitive load compared to a traditional ranked list. A second study consisting in an ecological validation reports on usage patterns and usability of the various interaction techniques within a free, more natural setting.

References

[1]
Keith Andrews, Wolfgang Kienreich, Vedran Sabol, Jutta Becker, Georg Droschl, Frank Kappe, Michael Granitzer, Peter Auer, and Klaus Tochtermann. 2002. The InfoSky visual explorer: exploiting hierarchical structure and document similarities. Information Visualization 1, 3--4 (2002), 166--181.
[2]
David M Blei and John D Lafferty. 2009. Topic Models. Text Mining: Classification, Clustering, and Applications (2009), 71--89.
[3]
Eric Brill. 1992. A Simple Rule-based Part of Speech Tagger. In Proceedings of the Workshop on Speech and Natural Language (HLT '91). 112--116.
[4]
John Brooke. 1996. SUS - A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4--7.
[5]
Douglass R Cutting, David R Karger, Jan O Pedersen, and John W Tukey. 1992. Scatter / Gather : Browsing A Cluster-based Large Document Approach Collections to Scatter / Gather. Sigir'92 (1992), 318--329.
[6]
Cecilia di Sciascio, Vedran Sabol, and Eduardo E Veas. 2015. uRank: Exploring Document Recommendations through an Interactive User-Driven Approach. In Proceedings of the Joint Workshop on Interfaces and Human Decision Making for Recommender Systems, IntRS 2015, co-located with ACM Conference on Recommender Systems (RecSys 2015), Vol. 1438. 29--36. http://ceur-ws.org/Vol-1438/paper5.pdf
[7]
Debasis Ganguly, Johannes Leveling, and Gareth J F Jones. 2013. TopicVis : A GUI for Topic-based Feedback and Navigation. In Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval SIGIR '13. 1103--1104.
[8]
Erick Gomez-Nieto, Frizzi San Roman, Paulo Pagliosa, Wallace Casaca, Elias S Helou, Maria Cristina F de Oliveira, and Luis Gustavo Nonato. 2014. Similarity preserving snippet-based visualization of web search results. IEEE transactions on visualization and computer graphics 20, 3 (March 2014), 457--70.
[9]
Samuel Gratzl, Alexander Lex, Nils Gehlenborg, Hanspeter Pfister, and Marc Streit. 2013. LineUp: visual analysis of multi-attribute rankings. IEEE transactions on visualization and computer graphics 19, 12 (Dec. 2013), 2277--86.
[10]
Brynjar Gretarsson, John O'Donovan, Svetlin Bostandjiev, Tobias Höllerer, Arthur Asuncion, David Newman, and Padhraic Smyth. 2012. TopicNets: Visual Analysis of Large Text Corpora with Topic Modeling. ACM Trans. Intell. Syst. Technol. 3, 2, Article 23 (Feb. 2012), 26 pages.
[11]
Mark Harrower and Cynthia A. Brewer. 2003. ColorBrewer.org: An Online Tool for Selecting Colour Schemes for Maps. The Cartographic Journal 40, 1 (June 2003), 27--37.
[12]
M Hearst. 2011. User interfaces for search. Modern Information Retrieval (2011). http://people.ischool. berkeley.edu/~hearst/papers/mir_revision.pdf
[13]
Marti A. Hearst. 1995. TileBars: Visualization of Term Distribution Information in Full Text Information Access. In Proceedings of the SIGCHI conference on Human factors in computing systems CHI '95. ACM Press, 59--66.
[14]
Jeffrey Heer and George Robertson. 2007. Animated transitions in statistical data graphics. IEEE transactions on visualization and computer graphics 13, 6 (2007), 1240--7.
[15]
Orland Hoeber and Xue Dong Yang. 2006. The Visual Exploration of Web Search Results Using HotMap. In 10th International Conference on Information Visualisation, IV 2006. 157--165.
[16]
Yuening Hu, Jordan Boyd-Graber, Brianna Satinoff, and Alison Smith. 2014. Interactive topic modeling. Machine Learning 95, 3 (2014), 423--469.
[17]
Antti Kangasrääsiö, Dorota Glowacka, and Samuel Kaski. 2015. Improving Controllability and Predictability of Interactive Recommendation Interfaces for Exploratory Search. In IUI. 247--251.
[18]
Judy Kay. 2006. Scrutable adaptation: Because we can and must. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 4018 LNCS. 11--19.
[19]
Bart P. Knijnenburg, Svetlin Bostandjiev, John O'Donovan, and Alfred Kobsa. 2012. Inspectability and control in social recommenders. Proceedings of the 6th ACM conference on Recommender systems - RecSys '12 (2012), 43.
[20]
M. Krishnan, S. Bohn, W. Cowley, V. Crow, and J. Nieplocha. 2007. Scalable Visual Analytics of Massive Textual Datasets. In 2007 IEEE International Parallel and Distributed Processing Symposium. IEEE, 1--10.
[21]
James R. Lewis and Jeff Sauro. 2009. The factor structure of the system usability scale. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 5619 LNCS (2009), 94--103.
[22]
Christopher D. Manning. 2008. Introduction to Information Retrieval. Cambridge University Press.
[23]
Gary Marchionini. 2006. Exploratory search: from finding to understanding. Commun. ACM 49, 4 (2006), 41.
[24]
Tien N Nguyen and Jin Zhang. 2006. A novel visualization model for web search results. IEEE transactions on visualization and computer graphics 12, 5 (2006), 981--8.
[25]
John O'Donovan, Barry Smyth, Brynjar Gretarsson, Svetlin Bostandjiev, and Tobias Höllerer. 2008. PeerChooser: Visual Interactive Recommendation. Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems (2008), 1085--1088.
[26]
Denis Parra, Peter Brusilovsky, and Christoph Trattner. 2014. See what you want to see: Visual User-Driven Approach for Hybrid Recommendation. Proceedings of the 19th international conference on Intelligent User Interfaces IUI '14 (2014), 235--240.
[27]
M.F. Porter. 1980. An algorithm for suffix stripping. Program: electronic library and information systems 40, 3 (1980), 211--218.
[28]
Ramana Rao and Stuart K Card. 1994. The table lens. In Proceedings of the SIGCHI conference on Human factors in computing systems celebrating interdependence CHI '94. ACM Press, New York, New York, USA, 318--322.
[29]
Manuela Rauch, Werner Klieber, Ralph Wozelka, Santokh Singh, and Vedran Sabol. 2015. Knowminer Search - a Multi-Visualisation Collaborative Approach to Search Result Analysis. In Information Visualisation (iV), 2015 19th International Conference on. 379--385.
[30]
Harald Reiterer, Gabriela Tullius, and TM Mann. 2005. Insyder: a content-based visual-information-seeking system for the web. International Journal on Digital Libraries (2005), 25--41. http://link.springer.com/article/10.1007/ s00799-004-0111-y
[31]
Francesco Ricci, Lior Rokach, and Bracha Shapira. 2011. Introduction to Recommender Systems Handbook. In Recommender Systems Handbook, Francesco Ricci, Lior Rokach, Bracha Shapira, and Paul B. Kantor (Eds.). Springer, 1--35.
[32]
Jeff Sauro and James R. Lewis. 2012. Quantifying the User Experience. Morgan Kaufmann.
[33]
Christin Seifert, Johannes Jurgovsky, and Michael Granitzer. 2014. FacetScape : A Visualization for Exploring the Search Space. In Proceedings 18th International Conference on Information Visualzation. 94--101.
[34]
Christin Seifert, Barbara Kump, Wolfgang Kienreich, Gisela Granitzer, and Michael Granitzer. 2008. On the Beauty and Usability of Tag Clouds. 2008 12th International Conference Information Visualisation (July 2008), 17--25.
[35]
Guy Shani and N Tractinsky. 2013. Displaying relevance scores for search results. Proceedings of the 36th international ACM SIGIR (2013), 901--904. http://dl.acm.org/citation.cfm?id=2484112
[36]
Anselm Spoerri. 2004. Coordinated Views and Tight Coupling to Support Meta Searching. In Proceedings of Second International Conference on Coordinated and Multiple Views in Exploratory Visualization. 39--48.
[37]
Marc Streit and Nils Gehlenborg. 2014. Bar charts and box plots. Nature methods 11, 2 (Feb. 2014), 117. http://www.ncbi.nlm.nih.gov/ /24645191
[38]
K. Swearingen and R. Sinha. 2001. Beyond Algorithms Beyond Algorithms: An HCI Perspective on Recommender Systems. ACM SIGIR 2001 Workshop on Recommender Systems (2001) (2001), 1--11.
[39]
Nava Tintarev and Judith Masthoff. 2012. Evaluating the Effectiveness of Explanations for Recommender Systems. User Modeling and User-Adapted Interaction 22, 4--5 (Oct. 2012), 399--439.
[40]
Katrien Verbert, Denis Parra, Peter Brusilovsky, and Erik Duval. 2013. Visualizing recommendations to support exploration, transparency and controllability. Proceedings of the 2013 international conference on Intelligent user interfaces IUI '13 (2013), 351.
[41]
Michelle Q. Wang Baldonado, Allison Woodruff, and Allan Kuchinsky. 2000. Guidelines for using multiple views in information visualization. Proceedings of the working conference on Advanced visual interfaces (AVI) (2000), 110--119.
[42]
Matthew O Ward, Georges Grinstein, and Daniel A Keim. 2010. Interactive Data Visualization: Foundations, Techniques, and Application. A. K. Peters, Ltd.
[43]
C Ware. 2013. Information visualization: perception for design (3rd ed.). Elsevier.
[44]
Ka-Ping Yee, Kirsten Swearingen, Kevin Li, and Marti Hearst. 2003. Faceted metadata for image search and browsing. Proceedings of the conference on Human factors in computing systems CHI '03 (2003), 401--408.

Cited By

View all
  • (2024)Unlocking the Power of Explainability in Ranking Systems: A Visual Analytics Approach with XAI TechniquesExplainable Artificial Intelligence and Process Mining Applications for Healthcare10.1007/978-3-031-54303-6_1(3-13)Online publication date: 26-Feb-2024
  • (2023)EDAssistant: Supporting Exploratory Data Analysis in Computational Notebooks with In Situ Code Search and RecommendationACM Transactions on Interactive Intelligent Systems10.1145/354599513:1(1-27)Online publication date: 9-Mar-2023
  • (2023)Search in Archival Facsimile Documents for Digital History2023 IEEE 19th International Conference on e-Science (e-Science)10.1109/e-Science58273.2023.10254826(1-10)Online publication date: 9-Oct-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
IUI '16: Proceedings of the 21st International Conference on Intelligent User Interfaces
March 2016
446 pages
ISBN:9781450341370
DOI:10.1145/2856767
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 March 2016

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. interaction
  2. search interface
  3. user study
  4. visual analytics

Qualifiers

  • Research-article

Funding Sources

  • EEXCESS (EC 7th Framework)
  • COMET Program (managed by the Austrian Research Promotion Agency - FFG)

Conference

IUI'16
Sponsor:

Acceptance Rates

IUI '16 Paper Acceptance Rate 49 of 194 submissions, 25%;
Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)28
  • Downloads (Last 6 weeks)3
Reflects downloads up to 18 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Unlocking the Power of Explainability in Ranking Systems: A Visual Analytics Approach with XAI TechniquesExplainable Artificial Intelligence and Process Mining Applications for Healthcare10.1007/978-3-031-54303-6_1(3-13)Online publication date: 26-Feb-2024
  • (2023)EDAssistant: Supporting Exploratory Data Analysis in Computational Notebooks with In Situ Code Search and RecommendationACM Transactions on Interactive Intelligent Systems10.1145/354599513:1(1-27)Online publication date: 9-Mar-2023
  • (2023)Search in Archival Facsimile Documents for Digital History2023 IEEE 19th International Conference on e-Science (e-Science)10.1109/e-Science58273.2023.10254826(1-10)Online publication date: 9-Oct-2023
  • (2023)AMED: Aggregated multimedia exploratory and discovery search softwareSoftwareX10.1016/j.softx.2023.10131221(101312)Online publication date: Feb-2023
  • (2022)FeedLens: Polymorphic Lenses for Personalizing Exploratory Search over Knowledge GraphsProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545631(1-15)Online publication date: 29-Oct-2022
  • (2022)An Explanatory Study on User Behavior in Discovering Aggregated Multimedia Web ContentIEEE Access10.1109/ACCESS.2022.317759710(56316-56330)Online publication date: 2022
  • (2022)Interactive visual facets to support fluid exploratory searchJournal of Visualization10.1007/s12650-022-00865-426:1(211-230)Online publication date: 30-Jul-2022
  • (2022)Justification of recommender systems results: a service-based approachUser Modeling and User-Adapted Interaction10.1007/s11257-022-09345-833:3(643-685)Online publication date: 29-Oct-2022
  • (2021)Interactive Visual Facets to Support Fluid Exploratory SearchProceedings of the 14th International Symposium on Visual Information Communication and Interaction10.1145/3481549.3481565(1-10)Online publication date: 6-Sep-2021
  • (2021)A Service-oriented Perspective on the Summarization of Recommendations: Preliminary ExperimentAdjunct Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization10.1145/3450614.3464475(213-219)Online publication date: 21-Jun-2021
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media