Skip to main content

Exploration of Underinvestigated Indoor Environment Based on Mobile Robot and Mixed Reality

  • Conference paper
  • First Online:
Human Interaction and Emerging Technologies (IHIET 2019)

Abstract

Mobile robots allow human to explore impassable or unsafe indoor locations remotely. There are a large number of scenarios where the implementation of mobile robots is the only way to successfully complete them. Herewith, human-robot interaction is the key factor that determines the efficiency of overall mission accomplishment. This paper presents a real-time approach for remote exploration of underinvestigated indoor environment conducted by human-robot interaction. The approach is based on the mobile robot and mixed reality. We have chosen a differential drive mobile robot platform called Plato and mixed reality glasses Microsoft Hololens for experimental investigation of the proposed approach. Our paper demonstrates the results of experimental investigations of the proposed approach. The results have shown that the proposed approach is helpful, intuitive and convenient for spatial understanding and improves natural interaction both with a mobile robot and remote environment. Moreover, our approach is able to significantly increase the speed of indoor environment exploration.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Terrence, F., Nourbakhsh, I., Dautenhahn, K.: A survey of socially interactive robots. J. Robot. Auton. Syst. 42(3–4), 143–166 (2003)

    MATH  Google Scholar 

  2. Goodrich, M., Schultz, A.: Human–robot interaction: a survey. J. Found. Trends Hum.–Comput. Interact. 1(3), 203–275 (2008)

    Article  Google Scholar 

  3. Avery, B., Piekarski, W., Thomas, B.: Visualizing occluded physical objects in unfamiliar outdoor augmented reality environments. In: the 6th IEEE and ACM International Symposium on Mixed and Augmented Reality. IEEE Computer Society, (2007)

    Google Scholar 

  4. Grisetti, G., Stachniss, C., Burgard, W.: Improved techniques for grid mapping with rao-blackwellized particle filters. J. IEEE Trans. Robot. 23(1), 34–46 (2007)

    Article  Google Scholar 

  5. Yagfarov, R., Ivanou, M., Afanasyev, I.: Map comparison of lidar-based 2D SLAM algorithms using precise ground truth. In: 15th International Conference on Control, Automation, Robotics and Vision, ICARCV (2018)

    Google Scholar 

  6. Hess, W., Kohler, D., Rapp, H., Andor, D.: Real-time loop closure in 2D lidar slam. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 1271–1278. IEEE Press (2016)

    Google Scholar 

  7. Kohlbrecher, S., Von Stryk, O., Meyer, J., Klingauf, U.: A flexible and scalable slam system with full 3D motion estimation. In: IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), pp. 155–160. IEEE Press (2011)

    Google Scholar 

  8. Presentation of the Research. https://www.youtube.com/watch?v=DDF83pcj5gY

  9. Besl, P.J. McKay, N.D.: Method for regis- tration of 3-D shapes. In: Sensor Fusion IV: Control Paradigms and Data Structures, vol. 1611, pp. 586–607. International Society for Optics and Photonics (1992)

    Google Scholar 

  10. Algorithms for Human-robot Interaction. https://github.com/AydarAkhmetzyanov/plato_hololens

Download references

Acknowledgments

This research was supported by the Russian Education Ministry under the Agreement No. 075-10-2018-017 on granting a subsidy from 11.26.2018 “Development of a commercial urban transport with the intellectual driver assistance system “City Pilot”. The customer is a federal target program. The unique identifier of the project RFMEFI60918X0005. Industrial partner - KAMAZ

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Aydar Akhmetzyanov .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Akhmetzyanov, A., Yagfarov, R., Gafurov, S., Ostanin, M., Klimchik, A. (2020). Exploration of Underinvestigated Indoor Environment Based on Mobile Robot and Mixed Reality. In: Ahram, T., Taiar, R., Colson, S., Choplin, A. (eds) Human Interaction and Emerging Technologies. IHIET 2019. Advances in Intelligent Systems and Computing, vol 1018. Springer, Cham. https://doi.org/10.1007/978-3-030-25629-6_49

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-25629-6_49

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-25628-9

  • Online ISBN: 978-3-030-25629-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics