skip to main content
10.1145/3615522.3615536acmotherconferencesArticle/Chapter ViewAbstractPublication PagesvinciConference Proceedingsconference-collections
research-article

PMM: A Smart Shopping Guider Based on Mobile AR

Authors Info & Claims
Published:20 October 2023Publication History

ABSTRACT

Augmented reality (AR) is a burgeoning interaction technology with the ability to provide users with immersive everyday experiences. Shopping is among the most common experiences. When consumers purchase products, they often encounter difficulties in obtaining detailed information relevant to their interests, such as ingredients, origin, and product comparisons, leading to frustration. This situation can be undeniably frustrating. We can use visualization technology [18] to organize it more orderly and friendly. This paper proposes a mobile augmented reality-based application framework, Product Magic Mirror (PMM), which helps to integrate basic visualization design into the application. The augmented information can be rich, e.g. they can be some visualizations and vivid data videos. In the evaluation, we simulated a goods purchase scene, and applied information to the real world by using AR. The real environment and virtual objects were superimposed on the same screen in real time, so as to achieve an experience beyond reality [24]. In our user survey, users rated our tools as a way to make better shopping choices, giving them a positive score for an immersive shopping experience. We predict that displaying information such as instructions, ingredients, and/or user review information next to products could allow consumers to make better consumption choices while reducing decision time and making shopping more immersive.

References

  1. Samir Abou El-Seoud and Islam Taj-Eddin. 2019. An android augmented reality application for retail fashion shopping. (2019).Google ScholarGoogle Scholar
  2. Junho Ahn, James Williamson, Mike Gartrell, Richard Han, Qin Lv, and Shivakant Mishra. 2015. Supporting healthy grocery shopping via mobile augmented reality. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 12, 1s (2015), 1–24.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Jesús Omar Álvarez Márquez and Jürgen Ziegler. 2017. Improving the Shopping Experience with an Augmented Reality-Enhanced Shelf. Mensch und Computer 2017-Workshopband (2017).Google ScholarGoogle Scholar
  4. Aasha Bodhani. 2013. Getting a purchase on AR. Engineering & Technology 8, 4 (2013), 46–49.Google ScholarGoogle ScholarCross RefCross Ref
  5. Dimitris Chatzopoulos, Carlos Bermejo, Zhanpeng Huang, and Pan Hui. 2017. Mobile Augmented Reality Survey: From Where We Are to Where We Go. IEEE Access 5 (2017), 6917–6950. https://doi.org/10.1109/ACCESS.2017.2698164Google ScholarGoogle ScholarCross RefCross Ref
  6. Hung-Lin Chi, Shih-Chung Kang, and Xiangyu Wang. 2013. Research trends and opportunities of augmented reality applications in architecture, engineering, and construction. Automation in construction 33 (2013), 116–122.Google ScholarGoogle Scholar
  7. Ajaya Kumar Dash, Santosh Kumar Behera, Debi Prosad Dogra, and Partha Pratim Roy. 2018. Designing of marker-based augmented reality learning environment for kids using convolutional neural network architecture. Displays 55 (2018), 46–54.Google ScholarGoogle ScholarCross RefCross Ref
  8. Oche A Egaji, Ikram Asghar, Will Warren, Mark Griffiths, and Simon Evans. 2019. An augmented reality application for personalised diamond shopping. In 2019 25th International Conference on Automation and Computing (ICAC). IEEE, 1–7.Google ScholarGoogle ScholarCross RefCross Ref
  9. Francisco Gutiérrez, Katrien Verbert, and Nyi Nyi Htun. 2018. PHARA: an augmented reality grocery store assistant. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (Barcelona, Spain) (MobileHCI ’18). Association for Computing Machinery, New York, NY, USA, 339–345.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Nelli Hänninen. 2020. Augmented reality in an amusement park environment: AR concept for Linnanmäki. (2020).Google ScholarGoogle Scholar
  11. Nauman Zafar Hashmi, Aun Irtaza, Wakeel Ahmed, and Nudrat Nida. 2020. An augmented reality based Virtual dressing room using Haarcascades Classifier. In 2020 14th International Conference on Open Source Systems and Technologies (ICOSST). IEEE, 1–6.Google ScholarGoogle ScholarCross RefCross Ref
  12. Kuo-Lun Hsiao, Miltiadis D Lytras, and Chia-Chen Chen. 2020. An in-app purchase framework for location-based AR games: the case of Pokémon Go. Library Hi Tech 38, 3 (2020), 638–653.Google ScholarGoogle ScholarCross RefCross Ref
  13. Nick Jones. 2020. Spaces mapped and monstrous: Digital 3D cinema and visual culture. Columbia University Press, New York Chichester, West Sussex. 229–264 pages.Google ScholarGoogle Scholar
  14. Timothy Jung, M Claudia Tom Dieck, Hyunae Lee, and Namho Chung. 2020. Moderating role of long-term orientation on augmented reality adoption. International Journal of Human–Computer Interaction 36, 3 (2020), 239–250.Google ScholarGoogle ScholarCross RefCross Ref
  15. Gerrit Kahl, Lübomira Spassova, Johannes Schöning, Sven Gehring, and Antonio Krüger. 2011. Irl smartcart-a user-adaptive context-aware interface for shopping assistance. In Proceedings of the 16th international conference on Intelligent user interfaces (Palo Alto, CA, USA) (IUI ’11). Association for Computing Machinery, New York, NY, USA, 359–362.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Marike Kellermayr-Scheucher, Laura Hörandner, and Patrick Brandtner. 2022. Digitalization at the point-of-sale in grocery retail-state of the art of smart shelf technology and application scenarios. Procedia Computer Science 196 (2022), 77–84.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Mehmet Kesim and Yasin Ozarslan. 2012. Augmented reality in education: current technologies and the potential for education. Procedia-social and behavioral sciences 47 (2012), 297–302.Google ScholarGoogle Scholar
  18. Richen Liu, Min Gao, Lijun Wang, Xiaohan Wang, Yuzhe Xiang, Aolin Zhang, Jiazhi Xia, Yi Chen, and Siming Chen. 2022. Interactive Extended Reality Techniques in Information Visualization. IEEE Transactions on Human-Machine Systems 52, 6 (2022), 1338–1351. https://doi.org/10.1109/THMS.2022.3211317Google ScholarGoogle ScholarCross RefCross Ref
  19. Richen Liu, Min Gao, Shunlong Ye, and Jiang Zhang. 2021. IGScript: An Interaction Grammar for Scientific Data Presentation. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 26, 13 pages.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Aladdin Masri and Muhannad Al-Jabi. 2019. Virtual dressing room application. In 2019 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology (JEEIT). IEEE, 694–698.Google ScholarGoogle ScholarCross RefCross Ref
  21. Beatrice Romano, Sean Sands, and Jason I Pallant. 2021. Augmented reality and the customer journey: an exploratory study. Australasian Marketing Journal 29, 4 (2021), 354–363.Google ScholarGoogle ScholarCross RefCross Ref
  22. Phelippe Souza-Herod and Abdelwahab Hamam. 2021. Augmented Reality Shopping Framework. In SoutheastCon 2021. 1–6.Google ScholarGoogle ScholarCross RefCross Ref
  23. Ailie KY Tang. 2019. A systematic literature review and analysis on mobile apps in m-commerce: Implications for future research. Electronic Commerce Research and Applications 37 (2019), 100885.Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. VentureBeat. 2014. Google Glass makes doctors better surgeons, Stanford study shows. (2014).Google ScholarGoogle Scholar
  25. Waraporn Viyanon, Thanadon Songsuittipong, Phattarika Piyapaisarn, and Suwanun Sudchid. 2017. AR Furniture: Integrating Augmented Reality Technology to Enhance Interior Design Using Marker and Markerless Tracking. In Proceedings of the 2nd International Conference on Intelligent Information Processing (Bangkok, Thailand) (ICIIP ’17). Association for Computing Machinery, New York, NY, USA, Article 32, 7 pages.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Nuwee Wiwatwattana, Sasivimon Sukaphat, Thanidtha Putwanpen, Suteekarn Thongnuch, and Puwakit Kanokudomsin. 2014. Augmenting for purchasing with mobile: Usage and design scenario for ice dessert. In IISA 2014, The 5th International Conference on Information, Intelligence, Systems and Applications. IEEE, 446–450.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. PMM: A Smart Shopping Guider Based on Mobile AR

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          VINCI '23: Proceedings of the 16th International Symposium on Visual Information Communication and Interaction
          September 2023
          308 pages
          ISBN:9798400707513
          DOI:10.1145/3615522

          Copyright © 2023 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 20 October 2023

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed limited

          Acceptance Rates

          Overall Acceptance Rate71of193submissions,37%
        • Article Metrics

          • Downloads (Last 12 months)50
          • Downloads (Last 6 weeks)8

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format .

        View HTML Format