Skip to main content

Video Classification Technology in a Knowledge-Vision-Integration Platform for Personal Protective Equipment Detection: An Evaluation

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10751))

Abstract

This work is part of an effort for the development of a Knowledge-Vision Integration Platform for Hazard Control (KVIP-HC) in industrial workplaces, adaptable to a wide range of industrial environments. This paper focuses on hazards resulted from the non-use of personal protective equipment (PPE), and examines a few supervised learning techniques to compose the proposed system for the purpose of recognition of three protective equipment: hard hat, gloves and boots. In the KVIP-HC, classifiers, feature images and any context information are represented explicitly using the Set of Experience Knowledge Structure (SOEKS), grouped and stored as Decisional DNA (DDNA). The collected knowledge is used for reasoning and to reinforce the system from time to time, customizing the service according to each scenario and application. Therefore, in choosing the classification methodology that best suits the application, processing time for training (once the system will be eventually reinforced in real time), accuracy, detection time and the predictor sizes (for the purpose of storing data) are analyzed to propose the most reasonable candidates to compose the platform.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Safetycare Australia: Recognition, evaluation and control of hazards, Malvern East, Victoria (2015)

    Google Scholar 

  2. Zambrano, A., Toro, C., Nieto, M., Sotaquirá, R., Sanín, C., Szczerbicki, E.: Video semantic analysis framework based on run-time production rules – towards cognitive vision. J. Univ. Comput. Sci. 21(6), 856–870 (2015)

    MathSciNet  Google Scholar 

  3. de Oliveira, C.S., Sanin, C., Szczerbicki, E.: Hazard control in industrial environments: a knowledge-vision-based approach. In: Wilimowska, Z., Borzemski, L., Świątek, J. (eds.) ISAT 2017. AISC, vol. 657, pp. 243–252. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-67223-6_23

    Google Scholar 

  4. Sanín, C., Szczerbicki, E.: Set of experience: a knowledge structure for formal decisionevents. Found. Control Manag. Sci. 3, 95–113 (2005)

    Google Scholar 

  5. Sanín, C., Szczerbicki, E.: Towards the construction of decisional DNA: a set of experience knowledge structure Java class within an ontology system. Cybern. Syst. 38 (2007)

    Google Scholar 

  6. Han, S., Lee, S.: A vision-based motion capture and recognition framework for behavior-based safety management. Autom. Constr. 35, 131–141 (2013)

    Article  Google Scholar 

  7. Chen, L., Hoey, J., Nugent, C.D., Cook, D.J., Yu, Z.: Sensor-based activity recognition. IEEE Trans. Syst. Man Cybern. Part C (Appl. Rev.) 42(6), 790–808 (2012)

    Article  Google Scholar 

  8. Zhong, H., Shi, J., Visontai, M.: Detecting unusual activity in video. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004, pp. 819–826. IEEE (2004)

    Google Scholar 

  9. Ramteke, R.J., Khachane, M.Y.: Automatic medical image classification and abnormality detection using K-Nearest Neighbour. Int. J. Adv. Comput. Res. 2(4), 190–196 (2012)

    Google Scholar 

  10. Revathy, M.: Image classification with application to MRI brain using 2nd order moment based algorithm. Int. J. Eng. Res. Appl. (IJERA) 2(3), 1821–1824 (2012)

    Google Scholar 

  11. Steinwart, I.: Sparness of support vector machines–some asymptotically sharpbounds. In: Thrun, S., Saul, L., Schölkopf, B. (eds.) Advances in Neural Information Processing Systems, vol. 16, pp. 169–184. MIT Press, Cambridge (2004)

    Google Scholar 

  12. Fukunaga, K.: Introduction to Statistical Pattern Recognition, 2nd edn. Academic Press, Inc., Cambridge (1990)

    MATH  Google Scholar 

  13. Gardner-Lubbe, S., Dube, F.S.: Visualisation of quadratic discriminant analysis and its application in exploration of microbial interactions. BioData Min. 8, 8 (2015)

    Article  Google Scholar 

  14. Wald, P.W., Kronmal, R.A.: Discriminant functions when covariances are unequal and sample sizes are moderate. Biometrics 33, 479–484 (1977)

    Article  MATH  Google Scholar 

  15. Shapire, R., Freund, Y., Bartlett, P., Lee, W.: Boosting the margin: a new explanation for the effectiveness of voting methods. Ann. Stat. 26(5), 1651–1686 (1998)

    Article  MathSciNet  MATH  Google Scholar 

  16. Breiman, L.: Bagging predictors. Mach. Learn. 24(2), 123–140 (1996)

    MathSciNet  MATH  Google Scholar 

  17. Ridgeway, G.: The state of boosting. Comput. Sci. Stat. 31, 172–181 (1999)

    Google Scholar 

  18. Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001)

    Article  MATH  Google Scholar 

  19. Rokach, L., Maimon, O.: Top-down induction of decision trees classifiers-a survey. IEEE Trans. Syst. Man. Cybern. Part C (Appl. Rev.) 35(4), 476–487 (2005)

    Article  Google Scholar 

  20. Geurts, P., Ernst, D., Wehenkel, L.: Extremely randomized trees. Mach. Learn. 63(1), 3–42 (2006)

    Article  MATH  Google Scholar 

  21. Warren, W., Pitts, W.: A logical calculus of ideas immanent in nervous activity. Bull. Math. Biophys. 5(4), 115–133 (1943)

    Article  MathSciNet  MATH  Google Scholar 

  22. Ivakhnenko, A.G., Lapa, V.G.: Cybernetics and Forecasting Techniques. American Elsevier Publishing Co., New York (1967)

    Google Scholar 

  23. Werbos, P.J.: Beyond regression: new tools for prediction and analysis in the behavioral sciences (1975)

    Google Scholar 

  24. Srivastava, N.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)

    MathSciNet  MATH  Google Scholar 

  25. Ciresan, D.C., Meier, U., Masci, J., Gambardella, L.M., Schmidhuber, J.: Flexible, high performance convolutional neural networks for image classification. In: International Joint Conference on Artificial Intelligence (2011)

    Google Scholar 

  26. Ciresan, D., Meier, U., Schmidhuber, J.: Multi-column deep neural networks for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition (2012)

    Google Scholar 

  27. Mosberger, R., Andreasson, H., Lilienthal, A.J.: Multi-human tracking using high-visibility clothing for industrial safety. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2013), pp. 638–644 (2013)

    Google Scholar 

  28. Davis, R., Shrobe, H., Szolovits, P.: What is a knowledge representation? AI Mag. 14(1), 17–33 (1993)

    Google Scholar 

  29. Van Rossum, G., Drake, F.L.: Python 3: Reference Manual. SohoBooks, New York (2009)

    Google Scholar 

  30. Kluyver, T., Ragan-Kelley, B., Pérez, F., Granger, B.E., Bussonnier, M., Frederic, J., Ivanov, P.: Jupyter Notebooks-a publishing format for reproducible computational workflows. In: ELPUB, pp. 87–90 (2016)

    Google Scholar 

  31. Tomar, S.: Converting video formats with FFmpeg. Linux J. 146, 10 (2006)

    Google Scholar 

  32. Van der Walt, C.M., Barnard, E.: Data characteristics that determine classifier performance (2006)

    Google Scholar 

  33. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Vanderplas, J.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011)

    MathSciNet  MATH  Google Scholar 

  34. Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Kudlur, M.: TensorFlow: a system for large-scale machine learning. OSDI 16, 265–283 (2016)

    Google Scholar 

  35. Bergstra, J., Bengio, Y.: Random search for hyper-parameter optimization. J. Mach. Learn. Res. 13, 281–305 (2012)

    MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Caterine Silva de Oliveira .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

de Oliveira, C.S., Sanin, C., Szczerbicki, E. (2018). Video Classification Technology in a Knowledge-Vision-Integration Platform for Personal Protective Equipment Detection: An Evaluation. In: Nguyen, N., Hoang, D., Hong, TP., Pham, H., Trawiński, B. (eds) Intelligent Information and Database Systems. ACIIDS 2018. Lecture Notes in Computer Science(), vol 10751. Springer, Cham. https://doi.org/10.1007/978-3-319-75417-8_42

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-75417-8_42

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-75416-1

  • Online ISBN: 978-3-319-75417-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics