Skip to main content

An IOT Edge-Fog-Cloud Architecture for Vision Based Pallet Integrity

  • Conference paper
  • First Online:
New Trends in Image Analysis and Processing – ICIAP 2019 (ICIAP 2019)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 11808))

Included in the following conference series:

  • 1261 Accesses

Abstract

Improving the availability of products in a store in order to avoid the OOS (out-of-stock) problem is a crucial topic nowadays. The reduction of OOS events leads to a series of consequences, including, an increase in customer satisfaction and loyalty to the store and brand, the production of positive advertising with a consequent growth in sales, and finally an increase in profitability and sales for a specific category. In this context, we propose the Pallet Integrity system for the automatic and real-time detection of OOS on promo pallets and promo forecasting using computer vision. The system uses two cameras placed in top-view configuration; one equipped with a depth sensor used to determines the number of pieces on the pallet and the other, a very high resolution web-cam, that is used for the facing recognition. The computer vision depth process takes place on edge, while the product recognition and promo OOS alarms runs on the fog, with a processing unit per store; the multi-promo forecasting service and the data aggregation and visualization is on cloud. The system was extensively tested on different real stores worldwide with accurate OOS detection and forecasting results.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Berger, R.: Full-shelf satisfaction, reducing out-of-stocks in a grocery channel. Grocery Manufacturers of America (GMA) (2002)

    Google Scholar 

  2. Colacchio, F., Tikhonova, O., Kisis, J.: Consumer response to out-of stock: decision making process and influencing factors. In: ECR European Conference (2003)

    Google Scholar 

  3. Corsten, D., Gruen, T.: Stock-outs cause walkouts. Harv. Bus. Rev 82, 26–28 (2004)

    Google Scholar 

  4. Ferracuti, N., Norscini, C., Frontoni, E., Gabellini, P., Paolanti, M., Placidi, V.: A business application of rtls technology in intelligent retail environment: defining the shopper’s preferred path and its segmentation. J. Retail. Consum. Serv. 47, 184–194 (2019)

    Article  Google Scholar 

  5. Frontoni, E., Mancini, A., Zingaretti, P.: Real time out of shelf detection using embedded sensor network. IEEE/ASME 10th International Conference on Mechatronic and Embedded Systems and Apllications (MESA) (2014)

    Google Scholar 

  6. Gruen, T.W., Corsten, D., Bharadwaj, S.: Retail out of stocks: a worldwide examination of extent, causes, and consumer responses. Grocery Manufacturers of America (2002)

    Google Scholar 

  7. Hausruckinger, G.: Approaches to measuring on-shelf availability at the point of sale. ECR Europe, Mnchen (2005)

    Google Scholar 

  8. Kim, M., Lennon, S.: Consumer response to online apparel stockouts. Psych. Mark. 28, 115–144 (2011)

    Article  Google Scholar 

  9. Liciotti, D., Zingaretti, P., Placidi, V.: An automatic analysis of shoppers behaviour using a distributed RGB-D cameras system. In: IEEE/ASME 10th International Conference on Mechatronic and Embedded Systems and Apllications (MESA), pp. 1–6 (2014)

    Google Scholar 

  10. Liciotti, D., Paolanti, M., Frontoni, E., Zingaretti, P.: People detection and tracking from an RGB-D camera in top-view configuration: review of challenges and applications. In: Battiato, S., Farinella, G.M., Leo, M., Gallo, G. (eds.) ICIAP 2017. LNCS, vol. 10590, pp. 207–218. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-70742-6_20

    Chapter  Google Scholar 

  11. Liciotti, D., Paolanti, M., Pietrini, R., Frontoni, E., Zingaretti, P.: Convolutional networks for semantic heads segmentation using top-view depth data in crowded environment. In: 2018 24rd International Conference on Pattern Recognition (ICPR). IEEE (2018)

    Google Scholar 

  12. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 91–110 (2004)

    Article  Google Scholar 

  13. Paolanti, M., Frontoni, E., Mancini, A., Pierdicca, R., Zingaretti, P.: Automatic classification for anti mixup events in advanced manufacturing system. In: ASME 2015 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, pp. V009T07A061–V009T07A061. American Society of Mechanical Engineers (2015)

    Google Scholar 

  14. Paolanti, M., Liciotti, D., Pietrini, R., Mancini, A., Frontoni, E.: Modelling and forecasting customer navigation in intelligent retail environments. J. Intell. Robot. Syst. 91(2), 165–180 (2018)

    Article  Google Scholar 

  15. Paolanti, M., Romeo, L., Felicetti, A., Mancini, A., Frontoni, E., Loncarski, J.: Machine learning approach for predictive maintenance in industry 4.0. In: 2018 14th IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications (MESA), pp. 1–6. IEEE (2018)

    Google Scholar 

  16. Paolanti, M., Romeo, L., Martini, M., Mancini, A., Frontoni, E., Zingaretti, P.: Robotic retail surveying by deep learning visual and textual data. Robot. Auton. Syst. 118, 179–188 (2019)

    Article  Google Scholar 

  17. Paolanti, M., Sturari, M., Mancini, A., Zingaretti, P., Frontoni, E.: Mobile robot for retail surveying and inventory using visual and textual analysis of monocular pictures based on deep learning. In: 2017 European Conference on Mobile Robots (ECMR), pp. 1–6. IEEE (2017)

    Google Scholar 

  18. Sturari, M., Paolanti, M., Frontoni, E., Mancini, A., Zingaretti, P.: Robotic platform for deep change detection for rail safety and security. In: 2017 European Conference on Mobile Robots (ECMR), pp. 1–6. IEEE (2017)

    Google Scholar 

  19. Zinn, W., Liu, P.: Consumer response to retail stockouts. J. Bus. Logis 22, 49–71 (2001)

    Article  Google Scholar 

Download references

Acknowledgments

This work was funded by Grottini Lab (www.grottinilab.com).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Roberto Pierdicca .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Vaira, R., Pietrini, R., Pierdicca, R., Zingaretti, P., Mancini, A., Frontoni, E. (2019). An IOT Edge-Fog-Cloud Architecture for Vision Based Pallet Integrity. In: Cristani, M., Prati, A., Lanz, O., Messelodi, S., Sebe, N. (eds) New Trends in Image Analysis and Processing – ICIAP 2019. ICIAP 2019. Lecture Notes in Computer Science(), vol 11808. Springer, Cham. https://doi.org/10.1007/978-3-030-30754-7_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-30754-7_30

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-30753-0

  • Online ISBN: 978-3-030-30754-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics