Skip to main content
Springer Nature Link
Log in

Enhancing Mall Security Based on Augmented Reality in the Post-pandemic World

  • Conference paper
  • First Online:
Human Interface and the Management of Information: Applications in Complex Technological Environments (HCII 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13306))

Included in the following conference series:

  • 1368 Accesses

Abstract

COVID-19 has shocked the retail industry, customers’ concerns for their health and safety are taking business away from shopping malls. Mall owners are thinking of finding new ways to bring their business back in this post-pandemic world. How to protect customers from COVID-19 in shopping malls has been a problem. This study presents an enhanced mall security system to help enforce wearing masks and proper social distancing in shopping malls using augmented reality (AR). We created a novel visualization way: Radar vision to display detected people in the perspective of mall guards, to help guards react quickly to violations, and better enforce the mandatory rules. When the mall guards wearing hololens activate the radar vision function, they can see all people violating wearing masks or social distance mandates through the wall. Mall guards can use gaze to select the target person and then use the voice command to activate the navigation arrow to help them quickly go to the scene. In addition to helping mall guards to enforce mandates, the system also provides assisted functions to protect customers. When the violation situation appears around a customer, the system will alert them to avoid and show an avoidance arrow until the user goes in the correct direction. We demonstrated a preliminary system with four surveillance cameras in our school building area. The pilot study shows that our system can effectively detect and display radar images, increasing the efficiency of mall guards and reducing customer safety concerns.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Pantano, E., Pizzi, G., Scarpi, D., Dennis, C.: Competing during a pandemic? Retailers’ ups and downs during the COVID-19 outbreak. J. Bus. Res. 116, 209–213 (2020)

    Article  Google Scholar 

  2. Grant, R., et al.: Impact of SARS-CoV-2 Delta variant on incubation, transmission settings and vaccine effectiveness: results from a nationwide case-control study in France. Lancet Reg. Health – Europe 13, 100278 (2021)

    Google Scholar 

  3. Sheth, J.: Impact of Covid-19 on consumer behavior: will the old habits return or die? J. Bus. Res. 117, 209–213 (2020)

    Article  MathSciNet  Google Scholar 

  4. Eikenberry, S., et al.: To mask or not to mask: modeling the potential for face mask use by the general public to curtail the COVID-19 pandemic. Infect. Dis. Model. 5, 293–308 (2020)

    Google Scholar 

  5. Berry, C., Berry, H., Berry, R.: Mask mandates and COVID-19 infection growth rates. In: 2020 IEEE International Conference on Big Data (Big Data), pp. 5639–5642 (2020)

    Google Scholar 

  6. Thu, T., Ngoc, P., Hai, N., Tuan, L.: Effect of the social distancing measures on the spread of COVID-19 in 10 highly infected countries. Sci. Total Environ. 742, 140430 (2020)

    Article  Google Scholar 

  7. Kulyukin, V., Gharpure, C., Nicholson, J., Pavithran, S.: RFID in robot-assisted indoor navigation for the visually impaired. In: 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), vol. 2, pp. 1979–1984 (2004)

    Google Scholar 

  8. Chumkamon, S., Tuvaphanthaphiphat, P., Keeratiwintakorn, P.: A blind navigation system using RFID for indoor environments. In: 2008 5th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology, pp. 765–768 (2008)

    Google Scholar 

  9. Barsocchi, P., Lenzi, S., Chessa, S., Giunta, G.: A novel approach to indoor RSSI localization by automatic calibration of the wireless propagation model. In: VTC Spring 2009 - IEEE 69th Vehicular Technology Conference, pp. 1–5 (2009)

    Google Scholar 

  10. Alarifi, A., et al.: Ultra wideband indoor positioning technologies: analysis and recent advances. Sensors 16(5), 707 (2016)

    Article  Google Scholar 

  11. Cooper, A., Hegde, P.: An indoor positioning system facilitated by computer vision. In: 2016 IEEE MIT Undergraduate Research Technology Conference (URTC), pp. 1–5 (2016)

    Google Scholar 

  12. Liu, W., et al.: SSD: single shot multibox detector. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) Computer Vision – ECCV 2016. ECCV 2016. Lecture Notes in Computer Science(), vol. 9905. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46448-0_2

  13. Redmon, J., Divvala, S., Girshick, R., Farhadi, A: You only look once: unified, realtime object detection. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 779–788 (2016)

    Google Scholar 

  14. Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39(6), 1137–1149 (2017)

    Article  Google Scholar 

  15. Boyko, A., Abdelpakey, M., Shehata, M.: GroupNet: detecting the social distancing violation using object tracking in crowdscene. In: 2021 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE), pp. 1–5 (2021)

    Google Scholar 

  16. Bhambani, K., Jain, T., Sultanpure, K.: Real-time face mask and social distancing violation detection system using YOLO. In: 2020 IEEE Bangalore Humanitarian Technology Conference (B-HTC), pp. 1–6 (2020)

    Google Scholar 

  17. Wu, M., Popescu, V.: Efficient VR and AR navigation through multiperspective occlusion management. IEEE Trans. Visual Comput. Graph. 24(12), 3069–3080 (2018)

    Article  Google Scholar 

  18. Kameda, Y., Takemasa, T., Ohta, Y.: Outdoor see-through vision utilizing surveillance cameras. In: Third IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 151–160 (2004)

    Google Scholar 

  19. Avery, B., Sandor, C., Thomas, B.: Improving spatial perception for augmented reality x-ray vision. In: 2009 IEEE Virtual Reality Conference, pp. 79–82 (2009)

    Google Scholar 

  20. Zollmann, S., Grasset, R., Reitmayr, G., Langlotz, T.: Image-based X-ray visualization techniques for spatial understanding in outdoor augmented reality. In: Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: The Future of Design, pp. 194–203 (2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Waseda University, Kitakyushu, Japan

    Like Wu & Jiro Tanaka

Authors
  1. Like Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jiro Tanaka
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jiro Tanaka .

Editor information

Editors and Affiliations

  1. Tokyo University of Science, Tokyo, Saitama, Japan

    Sakae Yamamoto

  2. Tokyo City University, Tokyo, Japan

    Hirohiko Mori

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wu, L., Tanaka, J. (2022). Enhancing Mall Security Based on Augmented Reality in the Post-pandemic World. In: Yamamoto, S., Mori, H. (eds) Human Interface and the Management of Information: Applications in Complex Technological Environments. HCII 2022. Lecture Notes in Computer Science, vol 13306. Springer, Cham. https://doi.org/10.1007/978-3-031-06509-5_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-06509-5_21

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-06508-8

  • Online ISBN: 978-3-031-06509-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics