Skip to main content
SpringerLink
Log in

Modelling and Forecasting Customer Navigation in Intelligent Retail Environments

  • Published:
Journal of Intelligent & Robotic Systems Aims and scope Submit manuscript

Abstract

Understanding shopper behaviour is one of the keys to success for retailers. In particular, it is necessary that managers know which retail attributes are important to which shoppers and their main goal is to improve the consumer shopping experience. In this work, we present sCREEN (Consumer REtail ExperieNce), an intelligent mechatronic system for indoor navigation assistance in retail environments that minimizes the need for active tagging and does not require metrics maps. The tracking system is based on Ultra-wideband technology. The digital devices are installed in the shopping carts and baskets and sCREEN allows modelling and forecasting customer navigation in retail environments. This paper contributes the design of an intelligent mechatronic system with the use of a novel Hidden Markov Models (HMMs) for the representation of shoppers’ shelf/category attraction and usual retail scenarios such as product out of stock or changes on store layout. Observations are viewed as a perceived intelligent system performance. By forecasting consumers next shelf/category attraction, the system can present the item location information to the consumer, including a walking route map to a location of the product in the retail store, and/or the number of an aisle in which the product is located. Effective and efficient design processes for mechatronic systems are a prerequisite for competitiveness in an intelligent retail environment. Experiments are performed in a real retail environment that is a German supermarket, during business hours. A dataset, with consumers trajectories, timestamps and the corresponding ground truth for training as well as evaluating the HMM, have been built and made publicly available. The results in terms of Precision, Recall and F1-score demonstrate the effectiveness and suitability of our approach, with a precision value that exceeds the 76% in all test cases.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Allahdadi, A., Morla, R., Cardoso, J.S.: Outlier detection in 802.11 wireless access points using hidden markov models. In: Wireless and mobile networking conference (WMNC), 2014 7th IFIP, pp. 1–8. IEEE, Piscataway (2014)

  2. Baum, L.E.: An equality and associated maximization technique in statistical estimation for probabilistic functions of markov processes. Inequalities 3, 1–8 (1972)

    Google Scholar 

  3. Boada, B.L., Blanco, D., Moreno, L.: Symbolic place recognition in voronoi-based maps by using hidden markov models. J. Intell. Robot. Syst. 39(2), 173–197 (2004)

    Article  Google Scholar 

  4. Cai, Y., Wang, H., Chen, X., Jiang, H.: Trajectory-based anomalous behaviour detection for intelligent traffic surveillance. IET Intell. Transp. Syst. 9(8), 810–816 (2015)

    Article  Google Scholar 

  5. Contigiani, M., Pietrini, R., Mancini, A., Zingaretti, P.: Implementation of a tracking system based on uwb technology in a retail environment. In: 2016 12th IEEE/ASME international conference on mechatronic and embedded systems and applications (MESA), pp. 1–6. IEEE, Piscataway (2016)

  6. Toit, J.D., Van Vuuren, J.H.: Semi-automated maritime vessel activity detection using hidden markov models. In: Proceedings of the 43rd annual conference of the operations research society of South Africa, Parys, pp. 71–78 (2014)

  7. Ducatel, K., Bogdanowicz, M., Scapolo, F., Leijten, J., Burgelman, J.-C.: Scenarios for ambient intelligence in 2010, Office for official publications of the European Communities (2001)

  8. Forney, G.D.: The viterbi algorithm. Proc. IEEE 61(3), 268–278 (1973)

    Article  MathSciNet  Google Scholar 

  9. Frontoni, E., Marinelli, F., Rosetti, R., Zingaretti, P.: Shelf space re-allocation for out of stock reduction. Comput. Ind. Eng. 106, 32–40 (2017)

    Article  Google Scholar 

  10. Frontoni, E., Mancini, A., Zingaretti, P.: Embedded vision sensor network for planogram maintenance in retail environments. Sensors 15(9), 21114–21133 (2015)

    Article  Google Scholar 

  11. Frontoni, E., Mancini, A., Zingaretti, P., Placidi, V.: Information management for intelligent retail environment: the shelf detector system. Information 5(2), 255–271 (2014)

    Article  Google Scholar 

  12. Kohavi, R., Provost, F.: Glossary of terms. Mach. Learn. 30(2–3), 271–274 (1998)

    Google Scholar 

  13. Kourouthanassis, P., Roussos, G.: Developing consumer-friendly pervasive retail systems. IEEE Pervasive Comput. 2(2), 32–39 (2003)

    Article  Google Scholar 

  14. Larson, J.S., Bradlow, E.T., Fader, P.S.: An exploratory look at supermarket shopping paths. Int. J. Res. Mark. 22(4), 395–414 (2005)

    Article  Google Scholar 

  15. Daniele Liciotti, Marco Contigiani, Emanuele Frontoni, Adriano Mancini, Primo Zingaretti, Valerio Placidi: Shopper analytics: A customer activity recognition system using a distributed rgb-d camera network. In: International workshop on video analytics for audience measurement in retail and digital signage, pp. 146–157. Springer, Berlin (2014)

  16. Liciotti, D., Frontoni, E., Mancini, A., Zingaretti, P.: Pervasive system for consumer behaviour analysis in retail environments. In: International workshop on face and facial expression recognition from real world videos, pp. 12–23. Springer, Berlin (2016)

  17. Coppola, C., Krajnık, T., Duckett, T., Bellotto, N.: Learning temporal context for activity recognition. In: ECAI 2016: 22nd European conference on artificial intelligence, 29 August-2 September 2016, the hague, the Netherlands-including prestigious applications of artificial intelligence (PAIS 2016), vol. 285, p. 107. IOS Press, Amsterdam (2016)

  18. Liciotti, D., Frontoni, E., Zingaretti, P., Bellotto, N., Duckett, T.: Hmm-based activity recognition with a ceiling rgb-d camera. In: ICPRAM (International conference on pattern recognition applications and methods) (2017)

  19. Liciotti, D., Zingaretti, P., Placidi, V.: An automatic analysis of shoppers behaviour using a distributed rgb-d cameras system. In: 2014 IEEE/ASME 10th international conference on Mechatronic and embedded systems and applications (MESA), pp. 1–6. IEEE, Piscataway (2014)

  20. Marin-Hernandez, A., de Jesús Hoyos-Rivera, G., Garcia-Arroyo, M., Marin-Urias, L.F.: Conception and implementation of a supermarket shopping assistant system. In: 2012 11th Mexican international conference on artificial intelligence (MICAI), pp. 26–31. IEEE, Piscataway (2012)

  21. Merzouki, R., Samantaray, A.K., Pathak, P.M., Bouamama, B.O.: Intelligent mechatronic systems: modeling, control and diagnosis. Springer Science & Business Media, Berlin (2012)

    Google Scholar 

  22. Milella, A., Di Paola, D., Mazzeo, P.L., Spagnolo, P., Leo, M., Cicirelli, G., D’Orazio, T.: Active surveillance of dynamic environments using a multi-agent system. IFAC Proceedings Volumes 43(16), 13–18 (2010)

    Article  Google Scholar 

  23. Newman, A.J., Foxall, G.R.: In-store customer behaviour in the fashion sector: some emerging methodological and theoretical directions. Int. J. Retail Distrib. Manag. 31(11), 591–600 (2003)

    Article  Google Scholar 

  24. Petitti, A., Di Paola, D., Milella, A., Mazzeo, P.L., Spagnolo, P., Cicirelli, G., Attolico. G.: A heterogeneous robotic network for distributed ambient assisted living. In: Human Behavior Understanding in Networked Sensing, pp. 321–338. Springer, Berlin (2014)

  25. Purohit, A., Sun, Z., Pan, S., Zhang, P.: Sugartrail: Indoor navigation in retail environments without surveys and maps. In: 2013 10th annual IEEE communications society conference on sensor, mesh and Ad Hoc communications and networks (SECON), pp. 300–308. IEEE, Piscataway (2013)

  26. Rabiner, L., Juang, B.: An introduction to hidden markov models. ieee assp magazine 3(1), 4–16 (1986)

    Article  Google Scholar 

  27. Rabiner, L.R.: A tutorial on hidden markov models and selected applications in speech recognition. Proc. IEEE 77(2), 257–286 (1989)

    Article  Google Scholar 

  28. Ramos, C., Augusto, J.C., Shapiro, D.: Ambient intelligence—the next step for artificial intelligence. IEEE Intell. Syst. 23(2), 15–18 (2008)

    Article  Google Scholar 

  29. Rzevski, G.: On conceptual design of intelligent mechatronic systems. Mechatronics 13(10), 1029–1044 (2003)

    Article  Google Scholar 

  30. Sgouropoulos, K., Stergiopoulou, E., Papamarkos, N.: A dynamic gesture and posture recognition system. J. Intell. Robot. Syst. 76(2), 283 (2014)

    Article  Google Scholar 

  31. Sokolova, M., Japkowicz, N., Szpakowicz, S.: Beyond accuracy, f-score and roc: a family of discriminant measures for performance evaluation. In: Australasian joint conference on artificial intelligence, pp. 1015–1021. Springer, Berlin (2006)

  32. Tél, F., Tóth, E.: Stereo image processing and virtual reality in an intelligent robot control system. In: Advances in manufacturing, pp. 295–308. Springer, Berlin (1999)

  33. Trigueiros, P., Ribeiro, F., Reis, L.P.: Generic system for human-computer gesture interaction. In: 2014 IEEE international conference on autonomous robot systems and competitions (ICARSC), pp. 175–180. IEEE, Piscataway (2014)

  34. Wang, C., Lin, H., Jiang, H.: Trajectory-based multi-dimensional outlier detection in wireless sensor networks using hidden markov models. Wirel. Netw 20(8), 2409–2418 (2014)

    Article  Google Scholar 

  35. Yan, Z., Chi, D., Deng, C.: An outlier detection method with wavelet hmm for uuv prediction following. Int. J. Inf. Comput. Sci. 10(1), 323–334 (2013)

    Google Scholar 

  36. Yang, S., Liu, W.: Anomaly detection on collective moving patterns: A hidden markov model based solution. In: Internet of Things (iThings/CPSCom), 2011 International Conference on and 4th International Conference on Cyber, Physical and Social Computing, pp. 291–296. IEEE, Piscataway (2011)

  37. Yuan, Y., Meng, Y., Lin, L., Sahli, H., Yue, A., Chen, J., Zhao, Z., Kong, Y., He, D.: Continuous change detection and classification using hidden markov model: a case study for monitoring urban encroachment onto farmland in beijing. Remote Sens. 7(11), 15318–15339 (2015)

    Article  Google Scholar 

  38. Aarno, D., Kragić, D.: Layered hmm for motion intention recognition. In: in IEEE/RSJ international conference on intelligent robots and systems, IROS’06 (2006)

  39. Zhu, J., Ge, Z., Song, Z.: Hmm-driven robust probabilistic principal component analyzer for dynamic process fault classification. IEEE Trans. Ind. Electron. 62(6), 3814–3821 (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Information Engineering (DII), Università Politecnica delle Marche, Via Brecce Bianche, Ancona, Italy

    Marina Paolanti, Daniele Liciotti, Rocco Pietrini, Adriano Mancini & Emanuele Frontoni

Authors
  1. Marina Paolanti
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Daniele Liciotti
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rocco Pietrini
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Adriano Mancini
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Emanuele Frontoni
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marina Paolanti.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Paolanti, M., Liciotti, D., Pietrini, R. et al. Modelling and Forecasting Customer Navigation in Intelligent Retail Environments. J Intell Robot Syst 91, 165–180 (2018). https://doi.org/10.1007/s10846-017-0674-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10846-017-0674-7

Keywords

Search

Navigation