Abstract
Cognitive Vision Systems have gained significant interest from academia and industry during the past few decade, and one of the main reasons behind this is the potential of such technologies to revolutionize human life as they intend to work under complex visual scenes, adapting to a comprehensive range of unforeseen changes, and exhibiting prospective behavior. The combination of these properties aims to mimic the human capabilities and create more intelligent and efficient environments. Nevertheless, preserving the environment such as humans do still remains a challenge in cognitive systems applications due to the complexity of such process. Experts believe the starting point towards real cognitive vision systems is to establish a representation which could integrate image/video modularization and virtualization, together with information from other sources (wearable sensors, machine signals, context, etc.) and capture its knowledge. In this paper we show through a case study how Decisional DNA (DDNA), a multi-domain knowledge structure that has the Set of Experience Knowledge Structure (SOEKS) as its basis can be utilized as a comprehensive embedded knowledge representation in a Cognitive Vision System for Hazard Control (CVP-HC). The proposed application aims to ensure that workers remain safe and compliant with Health and Safety policy for use of Personal Protective Equipment (PPE) and serves as a showcase to demonstrate the representation of visual and non-visual content together as an experiential knowledge in one single structure.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Sanin, C., Haoxi, Z., Shafiq, I., Waris, M.M., de Oliveira, C.S., Szczerbicki, E.: Experience based knowledge representation for Internet of Things and Cyber Physical Systems with case studies. Future Gener. Comput. Syst. 92, 604–616 (2019)
Vernon, D.: The space of cognitive vision. In: Christensen, H.I., Nagel, H.-H. (eds.) Cognitive Vision Systems. LNCS, vol. 3948, pp. 7–24. Springer, Heidelberg (2006). https://doi.org/10.1007/11414353_2
Gregory, R.L.: Eye and Brain: The Psychology of Seeing. McGraw-Hill, Blacklick (1973)
De Oliveira, C.S., Sanin, C., Szczerbicki, E.: Visual content representation and retrieval for Cognitive Cyber Physical Systems. In: 23rd International Conference on Knowledge-Based and Intelligent Information & Engineering Systems (2019)
Sanin, C., et al.: Decisional DNA: a multi-technology shareable knowledge structure for decisional experience. Neurocomputing 88, 42–53 (2012)
Sanin, C., Szczerbicki, E.: Experience-based knowledge representation SOEKS. Cybern. Syst. 40(2), 99–122 (2009)
Sanin, C., Szczerbicki, E.: Decisional DNA and the smart knowledge management system: a process of transforming information into knowledge. In: Gunasekaran, A. (ed.) Techniques and Tool for the Design and Implementation of Enterprise Information Systems, pp. 149–175. IGI Global, New York (2008)
de Oliveira, C.S., Sanin, C., Szczerbicki, E.: Cognition and decisional experience to support safety management in workplaces. In: Świątek, J., Borzemski, L., Wilimowska, Z. (eds.) ISAT 2018. AISC, vol. 853, pp. 266–275. Springer, Cham (2019). https://doi.org/10.1007/978-3-319-99996-8_24
Han, S., Lee, S.: A vision-based motion capture and recognition framework for behavior-based safety management. Autom. Constr. 35, 131–141 (2013)
Ciresan, D.C., Meier, U., Masci, J., Maria Gambardella, L., Schmidhuber, J.: Flexible, high performance convolutional neural networks for image classification. In: IJCAI Proceedings-International Joint Conference on Artificial Intelligence, vol. 22, no. 1, p. 1237, July 2011
Little, S., et al.: An information retrieval approach to identifying infrequent events in surveillance video. In: Proceedings of the 3rd ACM Conference on International Conference on Multimedia Retrieval, pp. 223–230. ACM, April 2013
Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)
Mosberger, R., Andreasson, H., Lilienthal, A.J.: Multi-human tracking using high-visibility clothing for industrial safety. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 638–644. IEEE, November 2013
Chen, L., Hoey, J., Nugent, C.D., Cook, D.J., Yu, Z.: Sensor-based activity recognition. IEEE Trans. Syst. Man Cybern. Part C (Appl. Rev.) 42(6), 790–808 (2012)
Zambrano, A., Toro, C., Nieto, M., Sotaquirá, R., Sanín, C., Szczerbicki, E.: Video semantic analysis framework based on run-time production rules – towards cognitive vision. J. Univ. Comput. Sci. 21(6), 856–870 (2015)
Aditya, S., Yang, Y., Baral, C., Aloimonos, Y., Fermuller, C.: Image Understanding using vision and reasoning through Scene Description Graph. Comput. Vis. Image Underst. 173, 33–45 (2017)
de Oliveira, C.S., Sanin, C., Szczerbicki, E.: Flexible knowledge–vision–integration platform for personal protective equipment detection and classification using hierarchical convolutional neural networks and active leaning. Cybern. Syst. 49(5–6), 355–367 (2018)
Hollnagel, E., Woods, D.D.: Joint Cognitive Systems: Foundations of Cognitive Systems Engineering. CRC Press, Boca Raton (2005)
Cole, G.S.: Tort liability for artificial intelligence and expert systems. Computer/LJ 10, 127 (1990)
Ashby, W.R.: An Introduction to Cybernetics. Chapman & Hall Ltd., London (1961)
Yu, Y., et al.: Intelligence-augmented rat cyborgs in maze solving. PLoS ONE 11(2), e0147754 (2016)
Pathak, N.: The future of AI. In: Artificial Intelligence for NET: Speech, Language, and Search, pp. 247–259. Apress, Berkeley (2017)
Brézillon, P., & Pomerol, J. C.: Contextual knowledge and proceduralized context. In Proceedings of the AAAI-99 Workshop on Modeling Context in AI Applications, Orlando, Florida, USA, July. AAAI Technical Report (1999)
de Oliveira, C.S., Sanin, C., Szczerbicki, E.: Towards Knowledge Formalization and Sharing in a Cognitive Vision Platform for Hazard Control (CVP-HC). In: Nguyen, N.T., Gaol, F.L., Hong, T.-P., Trawiński, B. (eds.) ACIIDS 2019. LNCS (LNAI), vol. 11431, pp. 53–61. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-14799-0_5
Safe Work Australia: Australian Work Health and Safety Strategy 2012–2022. Creative Commons (2012)
Health and Safety Executive (HSE): Measuring the Effectiveness of HSES Field Activities. HSE Occasional Paper Series, OPll, Health and Safety Commission. HSE, London (2018)
DeJoy, D.M.: Behavior change versus culture change: divergent approaches to man-aging workplace safety. Saf. Sci. 43(2), 105–129 (2005)
de Oliveira, C.S., Sanin, C., Szczerbicki, E.: Contextual knowledge to enhance workplace hazard recognition and interpretation in a cognitive vision platform. Procedia Comput. Sci. 126, 1837–1846 (2018)
Au, K.W., et al.: U.S. Patent No. 9,695,981. U.S. Patent and Trademark Office, Washington, DC (2017)
Cortes, C., Mohri, M.: AUC optimization vs. error rate minimization. In: Advances in Neural Information Processing Systems, pp. 313–320 (2004)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Silva de Oliveira, C., Sanin, C., Szczerbicki, E. (2020). Image Representation for Cognitive Systems Using SOEKS and DDNA: A Case Study for PPE Compliance. In: Nguyen, N., Jearanaitanakij, K., Selamat, A., Trawiński, B., Chittayasothorn, S. (eds) Intelligent Information and Database Systems. ACIIDS 2020. Lecture Notes in Computer Science(), vol 12033. Springer, Cham. https://doi.org/10.1007/978-3-030-41964-6_19
Download citation
DOI: https://doi.org/10.1007/978-3-030-41964-6_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-41963-9
Online ISBN: 978-3-030-41964-6
eBook Packages: Computer ScienceComputer Science (R0)