Skip to main content
SpringerLink
Log in

Traceable Asynchronous Workflows in Video Retrieval with vitrivr-VR

  • Conference paper
  • First Online:
MultiMedia Modeling (MMM 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13833))

Included in the following conference series:

Abstract

Virtual reality (VR) interfaces allow for entirely new modes of user interaction with systems and interfaces. Much like in physical workspaces, documents, tools, and interfaces can be used, put aside, and used again later. Such asynchronous workflows are a great advantage of virtual environments, as they enable users to perform multiple tasks in an interleaved manner. However, VR interfaces also face new challenges, such as text input without physical keyboards, and the analysis of such asynchronous workflows. In this paper we present the version of vitrivr-VR participating in the Video Browser Showdown (VBS) 2023. We describe the current state of our system, with a focus on improvements in text input methods and logging of asynchronous workflows.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://github.com/vitrivr/vitrivr-vr.

  2. 2.

    https://github.com/mozilla/DeepSpeech.

  3. 3.

    https://github.com/Spiess/deep-speech-upm.

  4. 4.

    https://github.com/Philipp1202/WGKeyboard.

References

  1. Boletsis, C., Kongsvik, S.: Controller-based text-input techniques for virtual reality: an empirical comparison. Int. J. Virtual Reality 19(3), 2–15 (2019). https://doi.org/10.20870/IJVR.2019.19.3.2917

  2. Chen, S., Wang, J., Guerra, S., Mittal, N., Prakkamakul, S.: Exploring word-gesture text entry techniques in virtual reality. In: CHI Conference on Human Factors in Computing Systems. ACM (2019). https://doi.org/10.1145/3290607.3312762

  3. Gasser, R., Rossetto, L., Heller, S., Schuldt, H.: Cottontail DB: an open source database system for multimedia retrieval and analysis. In: International Conference on Multimedia, pp. 4465–4468. Association for Computing Machinery, New York, NY, USA (2020). https://doi.org/10.1145/3394171.3414538

  4. Heller, S., et al.: Interactive video retrieval evaluation at a distance: Comparing sixteen interactive video search systems in a remote setting at the 10th video browser showdown. Int. J. Multimedia Inf. Retrieval 11(1), 1–18 (2022). https://doi.org/10.1007/s13735-021-00225-2

  5. Kim, J.R., Tan, H.Z.: A study of touch typing performance with keyclick feedback. In: IEEE Haptics Symposium, pp. 227–233 (2014). https://doi.org/10.1109/HAPTICS.2014.6775459

  6. Kristensson, P.O., Zhai, S.: SHARK2: a large vocabulary shorthand writing system for pen-based computers. In: Symposium on User Interface Software and Technology, pp. 43–52. ACM (2004). https://doi.org/10.1145/1029632.1029640

  7. Radford, A., et al.: Learning transferable visual models from natural language supervision. arXiv (2021). https://doi.org/10.48550/ARXIV.2103.00020

  8. Rossetto, L.: Multi-modal video retrieval, Ph. D. thesis, University of Basel (2018). https://doi.org/10.5451/unibas-006859522

  9. Spiess, F., et al.: Multi-modal video retrieval in virtual reality with vitrivr-VR. In: Þór Jónsson, B., et al. (eds.) MMM 2022. LNCS, vol. 13142, pp. 499–504. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-98355-0_45

  10. Spiess, F., Gasser, R., Heller, S., Rossetto, L., Sauter, L., Schuldt, H.: Competitive interactive video retrieval in virtual reality with vitrivr-VR. In: Lokoč, J., et al. (eds.) MMM 2021. LNCS, vol. 12573, pp. 441–447. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-67835-7_42

  11. Yu, C., Gu, Y., Yang, Z., Yi, X., Luo, H., Shi, Y.: Tap, dwell or gesture? Exploring head-based text entry techniques for HMDs. In: CHI Conference on Human Factors in Computing Systems, pp. 4479–4488. ACM (2017). https://doi.org/10.1145/3025453.3025964

Download references

Acknowledgements

This work was partly supported by the Swiss National Science Foundation through projects “Participatory Knowledge Practices in Analog and Digital Image Archives” (contract no. 193788) and “MediaGraph” (contract no. 202125).

Author information

Authors and Affiliations

  1. Department of Mathematics and Computer Science, University of Basel, Basel, Switzerland

    Florian Spiess, Silvan Heller, Loris Sauter, Philipp Weber & Heiko Schuldt

  2. Department of Informatics, University of Zurich, Zurich, Switzerland

    Luca Rossetto

Authors
  1. Florian Spiess
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Silvan Heller
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Luca Rossetto
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Loris Sauter
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Philipp Weber
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Heiko Schuldt
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Philipp Weber .

Editor information

Editors and Affiliations

  1. University of Bergen, Bergen, Norway

    Duc-Tien Dang-Nguyen

  2. Dublin City University, Dublin, Ireland

    Cathal Gurrin

  3. Radboud University Nijmegen, Nijmegen, The Netherlands

    Martha Larson

  4. Dublin City University, Dublin, Ireland

    Alan F. Smeaton

  5. University of Amsterdam, Amsterdam, The Netherlands

    Stevan Rudinac

  6. National Institute of Information and Communications Technology, Tokyo, Japan

    Minh-Son Dao

  7. Department of Information Science and Media Studies, University of Bergen, Bergen, Norway

    Christoph Trattner

  8. La Trobe University, Melbourne, VIC, Australia

    Phoebe Chen

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Spiess, F., Heller, S., Rossetto, L., Sauter, L., Weber, P., Schuldt, H. (2023). Traceable Asynchronous Workflows in Video Retrieval with vitrivr-VR. In: Dang-Nguyen, DT., et al. MultiMedia Modeling. MMM 2023. Lecture Notes in Computer Science, vol 13833. Springer, Cham. https://doi.org/10.1007/978-3-031-27077-2_49

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-27077-2_49

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-27076-5

  • Online ISBN: 978-3-031-27077-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation