Skip to main content

Mixed Reality Annotations System for Museum Space Based on the UWB Positioning and Mobile Device

  • Conference paper
  • First Online:
Augmented Reality, Virtual Reality, and Computer Graphics (AVR 2020)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 12242))

Abstract

In this research, the authors designed a mixed reality annotations system based on UWB positioning and mobile device, which is a low-cost innovative solution especially for wide range of indoor environments. This design can be targeted to solve the problem of low investment in museums in most parts of the developing country and large visitor flow during holidays. The position of the visitor is obtained through the UWB antenna tag which was attached on smartphones. The gyroscope data and focal length was also used to keep virtual camera and real camera consistent and virtual space’s calibration. The system can ensure that when there is a large flow of people, visitors can watch the multimedia annotation of exhibits on their phones during the queuing far away from the exhibits. The types of annotation are mainly video, 3D model and audio. In China, many museums have the function of science education. A rich form of annotation can enhances this functionality. At last, we compare and analyze the localization advantage of this system (to solve the problem of congestion and shortage of funds), and recruited 10 volunteers to experience system. We find that this system can achieve the exact matching standard when the visitors are 0.75 –1 m away from the exhibits, while when the visitors are more than 3 m away from the exhibits, it has the advantages that other systems cannot have, such as playing and watching videos when they cannot get close to the exhibits due to crowding. This system provides a new solution for the application of MR in large indoor area and updated the exhibition of museum.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bajura, M., Fuchs, H., Ohbuchi, R.: Merging virtual objects with the real world: seeing ultrasound imagery within the patient. Comput. Graphics 26(2), 203–210 (1992)

    Article  Google Scholar 

  2. Milgram, P., Kishio, F.: A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. 77(12), 1321–1329 (1994)

    Google Scholar 

  3. Adam, T.: Introduction to the HoloLens, Part 2: Spatial Mapping. https://docs.microsoft.com/en-us/archive/msdn-magazine/2017/january/hololens-introduction-to-the-hololens-part-2-spatial-mapping

  4. Borrmann, D., et al.: A mobile robot based system for fully automated thermal 3D mapping. Adv. Eng. Inf. 28(4), 425–440 (2014)

    Article  Google Scholar 

  5. Fraundorfer, F., et al.: Vision-based autonomous mapping and expLoRation using a quadrotor MAV. In: Proceedings IROS 2012, pp. 45574564 (2012)

    Google Scholar 

  6. Shin, T., Roh, B. H.: Component mapping method for indoor localization system based on mixed reality. In: 2019 Eleventh International Conference on Ubiquitous and Future Networks (ICUFN), pp. 379–383 . IEEE, July 2019

    Google Scholar 

  7. Munoz-Montoya, F., Juan, M.C., Mendez-Lopez, M., Fidalgo, C.: Augmented reality based on SLAM to assess spatial short-term memory. IEEE Access 7, 2453–2466 (2018)

    Article  Google Scholar 

  8. Bae, H., Golparvar-Fard, M., White, J.: High-precision vision-based mobile augmented reality system for context-aware architectural engineering construction and facility management (AEC/FM) applications. Visual. Eng. 1(1), 1–13 (2013)

    Article  Google Scholar 

  9. Hashemifar, Z.S., Adhivarahan, C., Balakrishnan, A., Dantu, K.: Augmenting Visual SLAM with Wi-Fi Sensing For Indoor Applications. arXiv preprint arXiv:1903.06687 (2019).

  10. Oh, J., Lee, M.H., Park, H., Park, J.I., Kim, J.S., Son, W.: Efficient mobile museum guidance system using augmented reality. In: 2008 IEEE International Symposium on Consumer Electronics, pp. 1–4, IEEE, April 2008

    Google Scholar 

  11. Baeka, F., Ha, I., Kim, H.: Augmented reality system for facility management using image-based indoor localization. Autom. Const. 99, 18–26 (2019)

    Article  Google Scholar 

  12. Chun, Qi.: Digital Museum Application Research Based on Mixed Reality Technology (Master’s thesis, Tianjin University) (2018). (In Chinese) https://kns.cnki.net/KCMS/detail/detail.aspx?dbcode=CMFD&dbname=CMFD201901&filename=1019702184.nh)

  13. White, M., et al.: ARCO-an architecture for digitization, management and presentation of virtual exhibitions. In: Proceedings Computer Graphics International, pp. 622–625. IEEE, July 2004

    Google Scholar 

  14. Huan, X.: Research on Construction and Roaming Technology of Mixed Reality Application System in Large-scale Indoor Space (Master’s thesis, Shan Dong University) (2019). (In Chinese) https://kns.cnki.net/KCMS/detail/detail.aspx?dbcode=CMFD&dbname=CMFD201902&filename=1019055727.nh

  15. Briso, C., Calvo, C., Xu, Y.: UWB propagation measurements and modelling in large indoor environments. IEEE Access 7, 41913–41920 (2019)

    Article  Google Scholar 

  16. Cirulis, A.: Ultra wideband tracking potential for augmented reality environments. In: International Conference on Augmented Reality, Virtual Reality and Computer Graphics, pp. 126–136, Springer, Cham, June 2019

    Google Scholar 

  17. Mazhar, F., Khan, M.G., Sällberg, B.: Precise indoor positioning using UWB: a review of methods, algorithms and implementations. Wireless Per. Commun. 97(3), 4467–4491 (2017)

    Article  Google Scholar 

  18. Kopta, V., Enz, C.C.: A 4-GHz low-power, multi-user approximate zero-IF FM-UWB transceiver for IoT. IEEE J. Solid-State Circuits 54(9), 2462–2474 (2019)

    Article  Google Scholar 

  19. Yin, Z., Jiang, X., Yang, Z., Zhao, N., Chen, Y.: WUB-IP: a high-precision UWB positioning scheme for indoor multiuser applications. IEEE Syst. J. 13(1), 279–288 (2017)

    Article  Google Scholar 

  20. Yang, L., Giannakis, G.B.: Ultra-wideband communications: an idea whose time has come. IEEE Signal Process. Mag. 21(6), 26–54 (2004)

    Article  Google Scholar 

  21. Liu, F., Wang, J., Zhang, J., Han, H.: An indoor localization method for pedestrians base on combined UWB/PDR/floor map. Sensors 19(11), 2578 (2019)

    Article  Google Scholar 

  22. Zhang, Y.Z., Shen, Y., Zhang, W.W., Zhu, Z.Q., Ma, P.F.: Interactive spatial augmented reality system for Chinese opera. In: ACM SIGGRAPH 2019 Posters (SIGGRAPH & apos2019). ACM, New York, NY, USA, Article 14, 2 p. (2019)

    Google Scholar 

  23. Puljiz, D., Riesterer, K.S., Hein, B., Kröger, T.: Referencing between a Head-Mounted Device and Robotic Manipulators. arXiv preprint arXiv:1904.02480(2019).

  24. Puljiz, D., Hein, B.: Concepts for End-to-end Augmented Reality based Human-Robot Interaction Systems. arXiv preprint arXiv:1910.04494(2019).

  25. https://vuforia.csdn.net/m/zone/vuforia/resources

  26. Dai, C., Song, L., Yan, D.: Three-dimensional spatial localization algorithm based on four-node RSSI. Comput. Measure. Control. 24(1), 229–232. (2016) (In chinese)https://kns.cnki.net/KCMS/detail/detail.aspx?dbcode=CJFQ&dbname=CJFDLAST2016&filename=JZCK201601065)

Download references

Acknowledgements

The work is supported by Ministry of Education (China) Humanities and Social Sciences Research Foundation under Grant No.: 19A10358002.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to YanXiang Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhang, Y., Zi, Y. (2020). Mixed Reality Annotations System for Museum Space Based on the UWB Positioning and Mobile Device. In: De Paolis, L., Bourdot, P. (eds) Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2020. Lecture Notes in Computer Science(), vol 12242. Springer, Cham. https://doi.org/10.1007/978-3-030-58465-8_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-58465-8_25

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-58464-1

  • Online ISBN: 978-3-030-58465-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics