Skip to main content

Abstract

Visual content searching, browsing and retrieval tools have been a focus area of interest as they are required by systems from many different domains. Context-based, Content-Based, and Semantic-based are different approaches utilized for indexing/retrieving, but have their drawbacks when applied to systems that aim to mimic the human capabilities. Such systems, also known as Cognitive Systems, are still limited in terms of processing different sources of information (especially when structured in different ways) for decision making purposes. This issue becomes significantly greater when past information is retrieved and taken in account. We address this issue by proposing a Structuralized Context-Aware Indexing and Retrieval using Set of Experience Knowledge Structure (SOEKS) and Decisional DNA (DDNA). SOEKS and DDNA allow the creation of a multi-modal space composed of information from different sources, such as contextual, visual, auditory etc., in a form of a structure and explicit experiential knowledge. SOKES is composed by fields that allow this experiences to participate in the processes of similarity, uncertainty, impreciseness, or incompleteness measures and facilitate the indexing and retrieval of knowledge in Cognitive Systems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Sanin, C., Haoxi, Z., Shafiq, I., Waris, M.M., de Oliveira, C.S., Szczerbicki, E.: Experience based knowledge representation for Internet of Things and Cyber Physical Systems with case studies. Future Gener. Comput. Syst. (2018)

    Google Scholar 

  2. Vernon, D.: The space of cognitive vision. In: Cognitive Vision Systems, pp. 7–24. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  3. Gregory, R.L.: Eye and Brain: The Psychology of Seeing. McGraw-Hill, New York (1973)

    Google Scholar 

  4. Malik, S., Jain, S.: Ontology based context aware model. In: 2017 International Conference on Computational Intelligence in Data Science (ICCIDS), Chennai, pp. 1–6 (2017). https://doi.org/10.1109/ICCIDS.2017.8272632

  5. Manzoor, U., Ejaz, N., Akhtar, N., Umar, M., Khan, M.S., Umar, H.: Ontology based image retrieval. In: 2012 International Conference for Internet Technology and Secured Transactions, London, pp. 288–293 (2012)

    Google Scholar 

  6. Sanin, C., Szczerbicki, E.: Experience-based knowledge representation SOEKS. Cybernet Sys. 40(2), 99–122 (2009)

    Article  Google Scholar 

  7. Sanin, C., Toro, C., Haoxi, Z., Sanchez, E., Szczerbicki, E., Carrasco, E., Man-cilla-Amaya, L.: Decisional DNA: a multi-technology shareable knowledge structure for decisional experience. Neurocomputing 88, 42–53 (2012)

    Article  Google Scholar 

  8. De Marsicoi, M., Cinque, L., Levialdi, S.: Indexing pictorial documents by their content: a survey of current techniques. Image Vis. Comput. 15, 119–141 (1997)

    Article  Google Scholar 

  9. Rui, Y., Huang, T., Chang, S.: Image retrieval past, present, and future. In: International Symposium on Multimedia Information Processing (1997)

    Google Scholar 

  10. Rui, Y., Huang, T., Chang, S.: Image retrieval: current techniques, promising directions and open issues. J. Vis. Commun. Image Represent. 10, 39–62 (1999)

    Article  Google Scholar 

  11. Muller, D.B.H., Michoux, N., Geissbuhler, A.: A review of content-based image retrieval systems in medical applications clinical benefits and future directions. Int. J. Med. Informatics 73, 1–23 (2004)

    Article  Google Scholar 

  12. Westerveld, T.: Image retrieval: content versus context. In: Content-Based Multimedia Information Access-Volume 1, pp. 276–284, April 2000

    Google Scholar 

  13. Raveaux, R., Burie, J.C., Ogier, J.M.: Structured representations in a content based image retrieval context. J. Vis. Commun. Image Represent. 24(8), 1252–1268 (2013)

    Article  Google Scholar 

  14. Alkhawlani, M., Elmogy, M., El Bakry, H.: Text-based, content-based, and semantic-based image retrievals: a survey. Int. J. Comput. Inf. Technol. 4(01) (2015)

    Google Scholar 

  15. Tamura, H., Yokoya, N.: Image database systems: a survey. Pattern Recogn. 17, 29–43 (1984)

    Article  Google Scholar 

  16. Oard, D.W., Dorr, B.J.: A survey of multilingual text retrieval. Technical report UMIACS-TR-96-19, University of Maryland, Institute for Advanced Computer Studies (1996)

    Google Scholar 

  17. Liu, S.H., Chang, S.K.: Picture indexing and abstraction techniques for pictorial databases. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 6(4), 475–483 (1984)

    MATH  Google Scholar 

  18. Datta, R., Joshi, D., Li, J., Wang, J.Z.: Image retrieval: ideas, influences, and trends of the new age. ACM Comput. Surv. 39, 2007 (2006)

    Google Scholar 

  19. Danielsson, P.E.: Euclidean distance mapping. Comput. Graph. Image Process. 14(3), 227–248 (1980)

    Article  Google Scholar 

  20. Wang, H.H., Mohamad, D., Ismail, N.: Image retrieval: techniques, challenge, and trend. In: International Conference on Machine Vision, Image Processing and Pattern Analysis, Bangkok. Citeseer (2009)

    Google Scholar 

  21. Shanmugapriya, N., Nallusamy, R.: A new content based image retrieval system using GMM and relevance feedback. J. Comput. Sci. 10(2), 330–340 (2013)

    Article  Google Scholar 

  22. Gorkani, M.M., Picard, R.W.: Texture orientation for sorting photos “at a glance”. In: International Conference on Pattern Recognition, p. 459, October 1994

    Google Scholar 

  23. Yiu, E.C.: Image classification using color cues and texture orientation. Doctoral dissertation, Massachusetts Institute of Technology (1996)

    Google Scholar 

  24. Zhu, S.C., Wu, Y., Mumford, D.: Filters, random fields and maximum entropy (FRAME): towards a unified theory for texture modeling. Int. J. Comput. Vision 27(2), 107–126 (1998)

    Article  Google Scholar 

  25. Zin, N.A.M., Yusof, R., Lashari, S.A., Mustapha, A., Senan, N., Ibrahim, R.: Content-based image retrieval in medical domain: a review. J. Phys: Conf. Ser. 1019(1), 012044 (2018)

    Google Scholar 

  26. Bandura, A.: Human agency in social cognitive theory. Am. Psychol. 44(9), 1175 (1989)

    Article  Google Scholar 

  27. Hollnagel, E., Woods, D.D.: Joint Cognitive Systems: Foundations of Cognitive Systems Engineering. CRC Press (2005)

    Google Scholar 

  28. Amores, J., Sebe, N., Radeva, P.: Context-based object-class recognition and retrieval by generalized correlograms. IEEE Trans. Pattern Anal. Mach. Intell. 29(10), 1818–1833 (2007)

    Article  Google Scholar 

  29. de Oliveira, C.S., Sanin, C., Szczerbicki, E.: Visual content learning in a cognitive vision platform for hazard control (CVP-HC). Cybern. Syst. 50(2), 197–207 (2019)

    Article  Google Scholar 

  30. de Oliveira, C.S., Sanin, C., Szczerbicki, E.: Towards knowledge formalization and sharing in a cognitive vision platform for hazard control (CVP-HC). In: Asian Conference on Intelligent Information and Database Systems, pp. 53–61. Springer, Cham (2019)

    Google Scholar 

  31. Deserno, T.M., Antani, S., Long, R.: Ontology of gaps in content-based image retrieval. J. Digit. Imaging 22(2), 202–215 (2009)

    Article  Google Scholar 

  32. Sanin, C., Szczerbicki, E.: Using XML for implementing set of experience knowledge structure. In: Khosla, R., Howlett, R.J., Jain, L.C. (eds.) KES 2005. LNCS (LNAI), vol. 3681, pp. 946–952. Springer, Heidelberg (2005)

    Google Scholar 

  33. Sanín, C.A.M.: Smart knowledge management system. University of Newcastle (2007)

    Google Scholar 

  34. Wang, P., Sanin, C., Szczerbicki, E.: Enhancing set of experience knowledge structure (SOEKS) WITH A nearest neighbor algorithm RELIE-F. In: Information Systems Architecture and Technology, 13 (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Caterine Silva de Oliveira .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

de Oliveira, C.S., Sanin, C., Szczerbicki, E. (2020). Context-Aware Indexing and Retrieval for Cognitive Systems Using SOEKS and DDNA. In: Borzemski, L., Świątek, J., Wilimowska, Z. (eds) Information Systems Architecture and Technology: Proceedings of 40th Anniversary International Conference on Information Systems Architecture and Technology – ISAT 2019. ISAT 2019. Advances in Intelligent Systems and Computing, vol 1050. Springer, Cham. https://doi.org/10.1007/978-3-030-30440-9_2

Download citation

Publish with us

Policies and ethics