Skip to main content

A Framework for Analyzing News Images and Building Multimedia-Based Recommender

  • Conference paper
  • First Online:
Innovations for Community Services (I4CS 2019)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1041))

Included in the following conference series:

  • 735 Accesses

Abstract

The number and accessibility of published news items have grown recently. Publishers have developed recommender systems supporting users in finding relevant news. Traditional news recommender systems focus on collaborative filtering and content-based strategies. Unlike texts, multimedia content has received little attention. However, images and other multimedia elements affect how users perceive the news. In this work, we present a system that aggregates text-based, image-based, and user interests-based features to foster recommender systems for news. The system monitors a live stream of news and interactions with them. It applies text analysis and automatic image labeling methods for enriching the news stream. A web application visualizes the collected data and statistics. We show that image features are valuable for developing news recommender systems. The created feature-rich dataset constitutes the basis for developing innovative news recommendation approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    http://www.newsreelchallenge.org/.

  2. 2.

    http://www.acmmm.org/.

  3. 3.

    http://www.imageclef.org/.

  4. 4.

    http://www.multimediaeval.org/.

  5. 5.

    http://www.image-net.org/.

  6. 6.

    https://flask.pocoo.org/.

  7. 7.

    https://jinja.pocoo.org/.

  8. 8.

    https://startbootstrap.com/template-overviews/sb-admin/.

  9. 9.

    https://www.sqlalchemy.org/.

References

  1. Abadi, M., et al.: Tensorflow: a system for large-scale machine learning. In: Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation. OSDI 2016, pp. 265–283. USENIX Association, Berkeley (2016). http://dl.acm.org/citation.cfm?id=3026877.3026899

  2. Acar, E., Hopfgartner, F., Albayrak, S.: A comprehensive study on mid-levelrepresentation and ensemble learning for emotional analysis of videomaterial. Multimedia Tools Appl. 76(9), 11809–11837 (2016). https://doi.org/10.1007/s11042-016-3618-5

    Article  Google Scholar 

  3. Arenas, H., Islam, M.B., Mothe, J.: Overview of ImageCLEF 2017 population estimation (remote) task. In: WN for CLEF 2017 Conference, Dublin, Ireland, 11–14 September 2017 (2017)

    Google Scholar 

  4. Bobadilla, J., Ortega, F., Hernando, A., Bernal, J.: A collaborative filtering approach to mitigate the new user cold start problem. Knowl.-Based Syst. 26, 225–238 (2012). https://doi.org/10.1016/j.knosys.2011.07.021

    Article  Google Scholar 

  5. Chollet, F., et al.: Keras (2015). https://keras.io

  6. Corsini, F., Larson, M.: CLEF NewsREEL 2016: image based recommendation. In: WN of CLEF 2016, Évora, Portugal, 5–8 September 2016, pp. 618–827 (2016)

    Google Scholar 

  7. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: A large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255, June 2009. https://doi.org/10.1109/CVPR.2009.5206848

  8. Duda, R.O., Hart, P.E., Stork, D.G., et al.: Pattern Classification, 2nd edn, p. 55. Wiley, New York (2001)

    MATH  Google Scholar 

  9. Dutta, A., Gupta, A., Zissermann, A.: VGG image annotator (VIA) (2016). http://www.robots.ox.ac.uk/ vgg/software/via/

  10. Fang, L., et al.: Brain image labeling using multi-atlas guided 3D fully convolutional networks. In: Wu, G., Munsell, B.C., Zhan, Y., Bai, W., Sanroma, G., Coupé, P. (eds.) Patch-Based Techniques in Medical Imaging, pp. 12–19. Springer Intl. Publishing, Cham (2017)

    Chapter  Google Scholar 

  11. Filonenko, A., Kurnianggoro, L., Jo, K.H.: Comparative study of modern convolutional neural networks for smoke detection on image data. In: 2017 10th International Conference on Human System Interactions (HSI), pp. 64–68, July 2017. https://doi.org/10.1109/HSI.2017.8004998

  12. Jin, Y., Li, J., Ma, D., Guo, X., Yu, H.: A semi-automatic annotation technology for traffic scene image labeling based on deep learning preprocessing. In: 2017 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC), vol. 01, pp. 315–320 (2017)

    Google Scholar 

  13. Kumaresan, T., Saravanakumar, S., Balamurugan, R.: Visual and textual features based email spam classification using s-cuckoo search and hybrid kernel support vector machine. Cluster Comput. (2017). https://doi.org/10.1007/s10586-017-1615-8

  14. Lommatzsch, A., et al.: CLEF 2017 NewsREEL overview: a stream-based recommender task for evaluation and education. In: Jones, G.J.F., et al. (eds.) CLEF 2017. LNCS, vol. 10456, pp. 239–254. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-65813-1_23

    Chapter  Google Scholar 

  15. Nogueira, K., et al.: Data-driven flood detection using neural networks. In: Proceedings of the MediaEval 2017 WS co-located CLEF 2017, Dublin, Ireland, 13–15 September 2017 (2017)

    Google Scholar 

  16. Ploch, D., Lommatzsch, A., Schultze, F.: An advanced press review system combining deep news analysis and machine learning algorithms. In: Proceedings of the 54th Annual Meeting of the ACL, Berlin, Germany. ACL 2016, pp. 109–114. Association for Computational Linguistics, Stroudsburg (2016)

    Google Scholar 

  17. Python Software Foundation: Imagehash 4.0 - a image hashing library written in python. https://pypi.python.org/pypi/ImageHash. Accessed 25 Feb 2018

  18. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. CoRR abs/1409.1556 (2014)

    Google Scholar 

  19. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. CoRR abs/1512.00567 (2015). http://arxiv.org/abs/1512.00567

  20. Villegas, M., Paredes, R.: Overview of the ImageCLEF 2012 scalable web image annotation task. In: WN for CLEF 2012 Conference, Rome, Italy, September 17–20 (2012). http://ceur-ws.org/Vol-1178/CLEF2012wn-ImageCLEF-ThomeeEt2012.pdf

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Andreas Lommatzsch .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lommatzsch, A., Kille, B., Styp-Rekowski, K., Karl, M., Pommering, J. (2019). A Framework for Analyzing News Images and Building Multimedia-Based Recommender. In: Lüke, KH., Eichler, G., Erfurth, C., Fahrnberger, G. (eds) Innovations for Community Services. I4CS 2019. Communications in Computer and Information Science, vol 1041. Springer, Cham. https://doi.org/10.1007/978-3-030-22482-0_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-22482-0_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-22481-3

  • Online ISBN: 978-3-030-22482-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics