Abstract
The number and accessibility of published news items have grown recently. Publishers have developed recommender systems supporting users in finding relevant news. Traditional news recommender systems focus on collaborative filtering and content-based strategies. Unlike texts, multimedia content has received little attention. However, images and other multimedia elements affect how users perceive the news. In this work, we present a system that aggregates text-based, image-based, and user interests-based features to foster recommender systems for news. The system monitors a live stream of news and interactions with them. It applies text analysis and automatic image labeling methods for enriching the news stream. A web application visualizes the collected data and statistics. We show that image features are valuable for developing news recommender systems. The created feature-rich dataset constitutes the basis for developing innovative news recommendation approaches.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Abadi, M., et al.: Tensorflow: a system for large-scale machine learning. In: Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation. OSDI 2016, pp. 265–283. USENIX Association, Berkeley (2016). http://dl.acm.org/citation.cfm?id=3026877.3026899
Acar, E., Hopfgartner, F., Albayrak, S.: A comprehensive study on mid-levelrepresentation and ensemble learning for emotional analysis of videomaterial. Multimedia Tools Appl. 76(9), 11809–11837 (2016). https://doi.org/10.1007/s11042-016-3618-5
Arenas, H., Islam, M.B., Mothe, J.: Overview of ImageCLEF 2017 population estimation (remote) task. In: WN for CLEF 2017 Conference, Dublin, Ireland, 11–14 September 2017 (2017)
Bobadilla, J., Ortega, F., Hernando, A., Bernal, J.: A collaborative filtering approach to mitigate the new user cold start problem. Knowl.-Based Syst. 26, 225–238 (2012). https://doi.org/10.1016/j.knosys.2011.07.021
Chollet, F., et al.: Keras (2015). https://keras.io
Corsini, F., Larson, M.: CLEF NewsREEL 2016: image based recommendation. In: WN of CLEF 2016, Évora, Portugal, 5–8 September 2016, pp. 618–827 (2016)
Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: A large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255, June 2009. https://doi.org/10.1109/CVPR.2009.5206848
Duda, R.O., Hart, P.E., Stork, D.G., et al.: Pattern Classification, 2nd edn, p. 55. Wiley, New York (2001)
Dutta, A., Gupta, A., Zissermann, A.: VGG image annotator (VIA) (2016). http://www.robots.ox.ac.uk/ vgg/software/via/
Fang, L., et al.: Brain image labeling using multi-atlas guided 3D fully convolutional networks. In: Wu, G., Munsell, B.C., Zhan, Y., Bai, W., Sanroma, G., Coupé, P. (eds.) Patch-Based Techniques in Medical Imaging, pp. 12–19. Springer Intl. Publishing, Cham (2017)
Filonenko, A., Kurnianggoro, L., Jo, K.H.: Comparative study of modern convolutional neural networks for smoke detection on image data. In: 2017 10th International Conference on Human System Interactions (HSI), pp. 64–68, July 2017. https://doi.org/10.1109/HSI.2017.8004998
Jin, Y., Li, J., Ma, D., Guo, X., Yu, H.: A semi-automatic annotation technology for traffic scene image labeling based on deep learning preprocessing. In: 2017 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC), vol. 01, pp. 315–320 (2017)
Kumaresan, T., Saravanakumar, S., Balamurugan, R.: Visual and textual features based email spam classification using s-cuckoo search and hybrid kernel support vector machine. Cluster Comput. (2017). https://doi.org/10.1007/s10586-017-1615-8
Lommatzsch, A., et al.: CLEF 2017 NewsREEL overview: a stream-based recommender task for evaluation and education. In: Jones, G.J.F., et al. (eds.) CLEF 2017. LNCS, vol. 10456, pp. 239–254. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-65813-1_23
Nogueira, K., et al.: Data-driven flood detection using neural networks. In: Proceedings of the MediaEval 2017 WS co-located CLEF 2017, Dublin, Ireland, 13–15 September 2017 (2017)
Ploch, D., Lommatzsch, A., Schultze, F.: An advanced press review system combining deep news analysis and machine learning algorithms. In: Proceedings of the 54th Annual Meeting of the ACL, Berlin, Germany. ACL 2016, pp. 109–114. Association for Computational Linguistics, Stroudsburg (2016)
Python Software Foundation: Imagehash 4.0 - a image hashing library written in python. https://pypi.python.org/pypi/ImageHash. Accessed 25 Feb 2018
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. CoRR abs/1409.1556 (2014)
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. CoRR abs/1512.00567 (2015). http://arxiv.org/abs/1512.00567
Villegas, M., Paredes, R.: Overview of the ImageCLEF 2012 scalable web image annotation task. In: WN for CLEF 2012 Conference, Rome, Italy, September 17–20 (2012). http://ceur-ws.org/Vol-1178/CLEF2012wn-ImageCLEF-ThomeeEt2012.pdf
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Lommatzsch, A., Kille, B., Styp-Rekowski, K., Karl, M., Pommering, J. (2019). A Framework for Analyzing News Images and Building Multimedia-Based Recommender. In: Lüke, KH., Eichler, G., Erfurth, C., Fahrnberger, G. (eds) Innovations for Community Services. I4CS 2019. Communications in Computer and Information Science, vol 1041. Springer, Cham. https://doi.org/10.1007/978-3-030-22482-0_14
Download citation
DOI: https://doi.org/10.1007/978-3-030-22482-0_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-22481-3
Online ISBN: 978-3-030-22482-0
eBook Packages: Computer ScienceComputer Science (R0)