skip to main content
10.1145/3170427.3186493acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
demonstration

Demonstrating Reality-Based Information Retrieval

Published: 20 April 2018 Publication History

Abstract

With this work, we demonstrate our concept of Reality-Based Information Retrieval. Our principal idea is to bring Information Retrieval closer to the real world, for a new class of future, immersive IR interfaces. Technological advances in computer vision and machine learning will allow mobile Information Retrieval to make even better use of the people's surroundings and their ability to interact with the physical world. Reality-Based Information Retrieval augments the classic Information Retrieval process with context-dependent search cues and situated query and result visualizations using Augmented Reality technologies. We briefly describe our concept as an extension of the Information Retrieval pipeline and present two prototype implementations that showcase the potential of Reality-Based Information Retrieval.

Supplemental Material

MP4 File - suppl.mov
Supplemental video
MP4 File - suppl.mov
Supplemental video

References

[1]
Antti Ajanki, Mark Billinghurst, Toni Järvenpää, Melih Kandemir, Samuel Kaski, Markus Koskela, Mikko Kurimo, Jorma Laaksonen, Kai Puolamäki, Teemu Ruokolainen, and others. 2010. Contextual information access with augmented reality. In Proc. 2010 IEEE Int. Workshop MLSP. IEEE, 95--100.
[2]
Mark Billinghurst, Adrian Clark, and Gun Lee. 2015. A Survey of Augmented Reality. Found. Trends Hum.-Comput. Interact. 8, 2-3 (March 2015), 73--272.
[3]
Wolfgang Büschel, Annett Mitschick, and Raimund Dachselt. 2018. Here and Now: Reality-Based Information Retrieval. In Proc. CHIIR '18. ACM, New York, NY, USA, to appear.
[4]
Neven ElSayed, Bruce Thomas, Kim Marriott, Julia Piantadosi, and Ross Smith. 2015. Situated Analytics. In 2015 Big Data Visual Analytics (BDVA). 1--8.
[5]
Barrett Ens and Pourang Irani. 2017. Spatial Analytic Interfaces: Spatial User Interfaces for In Situ Visual Analytics. IEEE Comp. Graph. Appl. 37, 2 (2017), 66--79.
[6]
Xin Fan, Xing Xie, Zhiwei Li, Mingjing Li, and Wei-Ying Ma. 2005. Photo-to-search: Using Multimodal Queries to Search the Web from Mobile Devices. In Proc. MIR '05. ACM, New York, NY, USA, 143--150.
[7]
Masakazu Iwamura, Kai Kunze, Yuya Kato, Yuzuko Utsumi, and Koichi Kise. 2014. Haven't We Met Before?: A Realistic Memory Assistance System to Remind You of the Person in Front of You. In Proc. AH '14. ACM, New York, NY, USA, Article 32, 4 pages.
[8]
Bradley J. Rhodes and Pattie Maes. 2000. Just-in-time Information Retrieval Agents. IBM Syst. J. 39, 3-4 (July 2000), 685--704.

Cited By

View all
  • (2023)PSA: A Cross-Platform Framework for Situated Analytics in MR and VR2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00027(92-96)Online publication date: 16-Oct-2023
  • (2023)Making paper labels smart for augmented wine recognitionThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-023-03119-y40:8(5519-5531)Online publication date: 27-Oct-2023

Index Terms

  1. Demonstrating Reality-Based Information Retrieval

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems
    April 2018
    3155 pages
    ISBN:9781450356213
    DOI:10.1145/3170427
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 20 April 2018

    Check for updates

    Author Tags

    1. augmented reality
    2. immersive visualization
    3. in situ visual analytics
    4. reality-based information retrieval
    5. spatial user interface

    Qualifiers

    • Demonstration

    Funding Sources

    • Bundesministerium für Bildung und Forschung

    Conference

    CHI '18
    Sponsor:

    Acceptance Rates

    CHI EA '18 Paper Acceptance Rate 1,208 of 3,955 submissions, 31%;
    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)11
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)PSA: A Cross-Platform Framework for Situated Analytics in MR and VR2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00027(92-96)Online publication date: 16-Oct-2023
    • (2023)Making paper labels smart for augmented wine recognitionThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-023-03119-y40:8(5519-5531)Online publication date: 27-Oct-2023

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media