Skip to main content
Springer Nature Link
Log in

Automatic image annotation using fuzzy association rules and decision tree

  • Special Issue Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

    We’re sorry, something doesn't seem to be working properly.

    Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Abstract

The problem of sharp boundary widely exists in image classification algorithms that use traditional association rules. This problem makes classification more difficult and inaccurate. On the other hand, massive image data will produce a lot of redundant association rules, which greatly decrease the accuracy and efficiency of image classification. To relieve the influence of these two problems, this paper proposes a novel approach integrating fuzzy association rules and decision tree to accomplish the task of automatic image annotation. According to the original features with membership functions, the approach first obtains fuzzy feature vectors, which can describe the ambiguity and vagueness of images. Then fuzzy association rules are generated from fuzzy feature vectors with fuzzy support and fuzzy confidence. Fuzzy association rules can capture correlations between low-level visual features and high-level semantic concepts of images. Finally, to tackle the large size of fuzzy association rules base, we adopt decision tree to reduce the unnecessary rules. As a result, the algorithm complexity is decreased to a large extent. We conduct the experiments on two baseline datasets, i.e. Corel5k and IAPR-TC12. The evaluation measures include precision, recall, F-measure and rule number. The experimental results show that our approach performs better than many state-of-the-art automatic image annotation approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Carneiro, G., Chan, A.B., Moreno, P.J., Vasconcelos, N.: Supervised learning of semantic classes for image annotation and retrieval. IEEE Trans. Patt. Anal. Mach. Intell. 29(3), 394–410 (2007)

    Article  Google Scholar 

  2. Chang, S.K., Hsu, A.: Image information systems: where do we go from here? IEEE Trans. Knowl. Data Eng. 4(5), 431–442 (1992)

    Article  Google Scholar 

  3. Dong, J., Sheng, G.: Remote sensing image classification based on fuzzy association classification. J. Comp. Res. Dev. 49(7), 1500–1506 (2012)

    Google Scholar 

  4. Duygulu, P., Barnard, K., de Freitas, N., Forsyth, D.: Object recognition as machine translation: learning a lexicon for a fixed image vocabulary. In: Proceedings of the 7th European Conference on Computer Vision, pp. 97–112 (2002)

  5. Feng, S.L., Manmatha, R., Lavrenko, V.: Multiple bernoulli relevance models for image and video annotation. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1002–1009 (2004)

  6. F.P. Pach, J.A.: Selecting fuzzy if-then rules for classification problems using genetic algorithms. International Scholarly and Scientific Research and Innovation 2(1), 546–551 (2008)

  7. Hu, Y., Chen, R., Tzeng, G.: Mining fuzzy association rules for classification problems. Comp. Ind. Eng. 43(4), 735–750 (2002)

    Article  Google Scholar 

  8. Ishibuchi, H., Nozaki, K.: Selecting fuzzy if-then rules for classification problems using genetic algorithms. IEEE Trans. Fuzzy Syst. 3(3), 260–270 (1995)

    Article  Google Scholar 

  9. Ishibuchi, H., Nozaki, K., Tanaka, H.: Distributed representation of fuzzy rules and its application to pattern classification. Fuzzy Sets Syst. 52(1), 21–32 (1992)

    Article  Google Scholar 

  10. Jeon, J., Lavrenko, V., Manmatha, R.: Automatic image annotation and retrieval using cross-media relevance models. In: Proceedings of the 26th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 119–126 (2003)

  11. Jing, G., Zhao, B.: New method about how to construct decision tree based on association rule. In: Proceedings of International Workshop on Open-Source for Scientific Computation, pp. 131–135 (2011)

  12. Jukic, N., Nestorov, S.: Comprehensive data warehouse exploration with qualified association rule mining. Decision Supp. Syst. 42(2), 859–878 (2006)

    Article  Google Scholar 

  13. Kuok, C.M., Fu, A., Wong, M.H.: Mining fuzzy association rules in databases. ACM SIGMOD Record 27(1), 41–46 (1998)

    Article  Google Scholar 

  14. Lavrenko, V., Manmatha, R., Jeon, J.: A model for learning the semantics of pictures. Adv. Neural Inform. Process. Syst. 16, 553–560 (2003)

    Google Scholar 

  15. Li, F.F., Fergus, R., Perona, P.: One-shot learning of object categories. IEEE Trans. Patt. Anal. Mach. Intell. 28(4), 594–611 (2006)

    Article  Google Scholar 

  16. Li, Z., Shi, Z., Zhao, W., Li, Z., Tang, Z.: Learning semantic concepts from image database with hybrid generative/discriminative approach. Eng. Appl. Art. Intel. 26(9), 2143–2152 (2013)

    Article  Google Scholar 

  17. Lowe, D.: Distinctive image features form scale-invariant keypoints. Int. J. Comp. Vision 60(2), 91–110 (2004)

    Article  Google Scholar 

  18. Makadia, A., Pavlovic, V., Kumar, S.: Baselines for image annotation. Int. J. Comp. Vision 90(1), 88–105 (2010)

    Article  Google Scholar 

  19. Mangalampalli, A., Pudi, V.: Fuzzy association rule mining algorithm for fast and efficient performance on very large datasets. In: Proceedings of IEEE International Conference on Fuzzy Systems, pp. 1163–1168 (2009)

  20. Mangalampalli, A., Pudi, V.: A fuzzy associative classification approach to visual concept detection. Int. J. Uncertain. Fuzz. Knowl.-Based Syst. 22(3), 429–452 (2014)

    Article  Google Scholar 

  21. Markkula, M., Sormunen, E.: End-user searching challenges indexing practices in the digital newspaper photo archive. Inform. Retriev. 1(4), 259–285 (2000)

    Article  MATH  Google Scholar 

  22. Monay, F., Gatica-Perez, D.: Modeling semantic aspects for cross-media image indexing. IEEE Trans. Patt. Anal. Mach. Intel. 29(10), 1802–1817 (2007)

    Article  Google Scholar 

  23. Pass, G., Zabith, R.: Histogram refinement for content-based image retrieval. In: Proceedings of the 3rd IEEE Workshop on Applications of Computer Vision, pp. 96–102 (1996)

  24. Quanlan, J.: C4.5: programs for machine learning. Morgan Kaufmann, San Francisco, CA, USA (1993)

  25. Ru, L., Ma, S., Lu, J.: Boosting-based automatic linguistic indexing of pictures. J. Image Graph. 11(4), 486–491 (2006)

    Google Scholar 

  26. Silaa, C.N., Freitas, A.A.: A survey of hierarchical classification across different application domains. Data Mining Knowl Discov 22(1–2), 31–72 (2011)

    Article  MATH  MathSciNet  Google Scholar 

  27. Sumathi, T., Hemalatha, M.: An innovative hybrid hierarchical model for automatic image annotation. In: P.V. Krishna, M.R. Babu, E. Ariwa (eds.) Global Trends in Information Systems and Software Applications, vol. 270. Springer (2012)

  28. Tazaree, A., Eftekhari-Moghadam, A., Sajadi-Ghaem-Maghami, S.: A semantic image classifier based on hierarchical fuzzy association rule mining. Multi. Tools Appl. 69(3), 921–949 (2014)

    Article  Google Scholar 

  29. Wang, Y., Mei, T., Gonga, S., Huang, X.S.: Combining global, regional and contextual features for automatic image annotation. Patt. Recogn. 42(2), 259–266 (2009)

    Article  MATH  Google Scholar 

  30. Zhang, C., Cheng, J., Liu, J., Pang, J., Liang, C., Huang, Q., Tian, Q.: Object categorization in sub-semantic space. NeuroComputing 142, 248–255 (2014)

    Article  Google Scholar 

  31. Zhang, C., Liu, J., Tian, Q., Xu, C., Lu, H., Ma, S.: Image classification by non-negative sparse coding, low-rank and sparse decomposition. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1673–1680 (2011)

  32. Zhang, D., Islam, M.M., Lu, G.: A review on automatic image annotation techniques. Patt. Recogn. 45(1), 346–362 (2012)

    Article  Google Scholar 

  33. Zhang, J., Hu, W.: Effective multi-modal multi-label learning for automatic image annotation. In: Proceedings of the 9th International Conference on Fuzzy Systems and Knowledge Discovery, pp. 1216–1220 (2012)

Download references

Acknowledgments

This work is supported by the National Natural Science Foundation of China (Nos. 61663004, 61262005, 61363035, 61365009, 61165009), the Guangxi Natural Science Foundation (2013GXNSFAA019345, 2014GXNSFAA118368), the National Basic Research Program of China (No. 2012CB326403) and the Guangxi “Bagui Scholar” Teams for Innovation and Research Project, Guangxi Collaborative Innovation Center of Multi-source Information Integration and Intelligent Processing.

Author information

Authors and Affiliations

  1. Guangxi Key Lab of Multi-source Information Mining and Security, Guangxi Normal University, Guilin, 541004, China

    Zhixin Li, Lingzhi Li, Kaobi Yan & Canlong Zhang

  2. Guangxi Experiment Center of Information Science, Guilin, 541004, China

    Zhixin Li & Canlong Zhang

Authors
  1. Zhixin Li
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Lingzhi Li
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Kaobi Yan
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Canlong Zhang
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Zhixin Li.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, Z., Li, L., Yan, K. et al. Automatic image annotation using fuzzy association rules and decision tree. Multimedia Systems 23, 679–690 (2017). https://doi.org/10.1007/s00530-016-0530-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-016-0530-9

Keywords