Abstract
Visual content searching, browsing and retrieval tools have been a focus area of interest as they are required by systems from many different domains. Context-based, Content-Based, and Semantic-based are different approaches utilized for indexing/retrieving, but have their drawbacks when applied to systems that aim to mimic the human capabilities. Such systems, also known as Cognitive Systems, are still limited in terms of processing different sources of information (especially when structured in different ways) for decision making purposes. This issue becomes significantly greater when past information is retrieved and taken in account. We address this issue by proposing a Structuralized Context-Aware Indexing and Retrieval using Set of Experience Knowledge Structure (SOEKS) and Decisional DNA (DDNA). SOEKS and DDNA allow the creation of a multi-modal space composed of information from different sources, such as contextual, visual, auditory etc., in a form of a structure and explicit experiential knowledge. SOKES is composed by fields that allow this experiences to participate in the processes of similarity, uncertainty, impreciseness, or incompleteness measures and facilitate the indexing and retrieval of knowledge in Cognitive Systems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Sanin, C., Haoxi, Z., Shafiq, I., Waris, M.M., de Oliveira, C.S., Szczerbicki, E.: Experience based knowledge representation for Internet of Things and Cyber Physical Systems with case studies. Future Gener. Comput. Syst. (2018)
Vernon, D.: The space of cognitive vision. In: Cognitive Vision Systems, pp. 7–24. Springer, Heidelberg (2006)
Gregory, R.L.: Eye and Brain: The Psychology of Seeing. McGraw-Hill, New York (1973)
Malik, S., Jain, S.: Ontology based context aware model. In: 2017 International Conference on Computational Intelligence in Data Science (ICCIDS), Chennai, pp. 1–6 (2017). https://doi.org/10.1109/ICCIDS.2017.8272632
Manzoor, U., Ejaz, N., Akhtar, N., Umar, M., Khan, M.S., Umar, H.: Ontology based image retrieval. In: 2012 International Conference for Internet Technology and Secured Transactions, London, pp. 288–293 (2012)
Sanin, C., Szczerbicki, E.: Experience-based knowledge representation SOEKS. Cybernet Sys. 40(2), 99–122 (2009)
Sanin, C., Toro, C., Haoxi, Z., Sanchez, E., Szczerbicki, E., Carrasco, E., Man-cilla-Amaya, L.: Decisional DNA: a multi-technology shareable knowledge structure for decisional experience. Neurocomputing 88, 42–53 (2012)
De Marsicoi, M., Cinque, L., Levialdi, S.: Indexing pictorial documents by their content: a survey of current techniques. Image Vis. Comput. 15, 119–141 (1997)
Rui, Y., Huang, T., Chang, S.: Image retrieval past, present, and future. In: International Symposium on Multimedia Information Processing (1997)
Rui, Y., Huang, T., Chang, S.: Image retrieval: current techniques, promising directions and open issues. J. Vis. Commun. Image Represent. 10, 39–62 (1999)
Muller, D.B.H., Michoux, N., Geissbuhler, A.: A review of content-based image retrieval systems in medical applications clinical benefits and future directions. Int. J. Med. Informatics 73, 1–23 (2004)
Westerveld, T.: Image retrieval: content versus context. In: Content-Based Multimedia Information Access-Volume 1, pp. 276–284, April 2000
Raveaux, R., Burie, J.C., Ogier, J.M.: Structured representations in a content based image retrieval context. J. Vis. Commun. Image Represent. 24(8), 1252–1268 (2013)
Alkhawlani, M., Elmogy, M., El Bakry, H.: Text-based, content-based, and semantic-based image retrievals: a survey. Int. J. Comput. Inf. Technol. 4(01) (2015)
Tamura, H., Yokoya, N.: Image database systems: a survey. Pattern Recogn. 17, 29–43 (1984)
Oard, D.W., Dorr, B.J.: A survey of multilingual text retrieval. Technical report UMIACS-TR-96-19, University of Maryland, Institute for Advanced Computer Studies (1996)
Liu, S.H., Chang, S.K.: Picture indexing and abstraction techniques for pictorial databases. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 6(4), 475–483 (1984)
Datta, R., Joshi, D., Li, J., Wang, J.Z.: Image retrieval: ideas, influences, and trends of the new age. ACM Comput. Surv. 39, 2007 (2006)
Danielsson, P.E.: Euclidean distance mapping. Comput. Graph. Image Process. 14(3), 227–248 (1980)
Wang, H.H., Mohamad, D., Ismail, N.: Image retrieval: techniques, challenge, and trend. In: International Conference on Machine Vision, Image Processing and Pattern Analysis, Bangkok. Citeseer (2009)
Shanmugapriya, N., Nallusamy, R.: A new content based image retrieval system using GMM and relevance feedback. J. Comput. Sci. 10(2), 330–340 (2013)
Gorkani, M.M., Picard, R.W.: Texture orientation for sorting photos “at a glance”. In: International Conference on Pattern Recognition, p. 459, October 1994
Yiu, E.C.: Image classification using color cues and texture orientation. Doctoral dissertation, Massachusetts Institute of Technology (1996)
Zhu, S.C., Wu, Y., Mumford, D.: Filters, random fields and maximum entropy (FRAME): towards a unified theory for texture modeling. Int. J. Comput. Vision 27(2), 107–126 (1998)
Zin, N.A.M., Yusof, R., Lashari, S.A., Mustapha, A., Senan, N., Ibrahim, R.: Content-based image retrieval in medical domain: a review. J. Phys: Conf. Ser. 1019(1), 012044 (2018)
Bandura, A.: Human agency in social cognitive theory. Am. Psychol. 44(9), 1175 (1989)
Hollnagel, E., Woods, D.D.: Joint Cognitive Systems: Foundations of Cognitive Systems Engineering. CRC Press (2005)
Amores, J., Sebe, N., Radeva, P.: Context-based object-class recognition and retrieval by generalized correlograms. IEEE Trans. Pattern Anal. Mach. Intell. 29(10), 1818–1833 (2007)
de Oliveira, C.S., Sanin, C., Szczerbicki, E.: Visual content learning in a cognitive vision platform for hazard control (CVP-HC). Cybern. Syst. 50(2), 197–207 (2019)
de Oliveira, C.S., Sanin, C., Szczerbicki, E.: Towards knowledge formalization and sharing in a cognitive vision platform for hazard control (CVP-HC). In: Asian Conference on Intelligent Information and Database Systems, pp. 53–61. Springer, Cham (2019)
Deserno, T.M., Antani, S., Long, R.: Ontology of gaps in content-based image retrieval. J. Digit. Imaging 22(2), 202–215 (2009)
Sanin, C., Szczerbicki, E.: Using XML for implementing set of experience knowledge structure. In: Khosla, R., Howlett, R.J., Jain, L.C. (eds.) KES 2005. LNCS (LNAI), vol. 3681, pp. 946–952. Springer, Heidelberg (2005)
Sanín, C.A.M.: Smart knowledge management system. University of Newcastle (2007)
Wang, P., Sanin, C., Szczerbicki, E.: Enhancing set of experience knowledge structure (SOEKS) WITH A nearest neighbor algorithm RELIE-F. In: Information Systems Architecture and Technology, 13 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
de Oliveira, C.S., Sanin, C., Szczerbicki, E. (2020). Context-Aware Indexing and Retrieval for Cognitive Systems Using SOEKS and DDNA. In: Borzemski, L., Świątek, J., Wilimowska, Z. (eds) Information Systems Architecture and Technology: Proceedings of 40th Anniversary International Conference on Information Systems Architecture and Technology – ISAT 2019. ISAT 2019. Advances in Intelligent Systems and Computing, vol 1050. Springer, Cham. https://doi.org/10.1007/978-3-030-30440-9_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-30440-9_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-30439-3
Online ISBN: 978-3-030-30440-9
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)