skip to main content
10.1145/3109859.3120955acmconferencesArticle/Chapter ViewAbstractPublication PagesrecsysConference Proceedingsconference-collections
research-article

User Preferences Analysis Using Visual Stimuli

Published: 27 August 2017 Publication History

Abstract

Recommender systems aim at enhancing user experience on the Web by employing the results of users behavior analysis for recommending items. However, user behavior is usually influenced by various aspects. Even though visual stimuli greatly influence almost every part of our life, it is yet poorly reflected in the domain of recommendation. In our work, we study the impact of visual stimuli (specifically images) on recommendation process on the Web. We focus on the domains where the impact of images is substantial (e.g.,~movies and shopping). First results of our experiments suggest that features extracted from the images are able to improve the ranking of the current recommendation approaches.

References

[1]
Dmitry Bogdanov, Martín Haro, Ferdinand Fuhrmann, Anna Xambó, Emilia Gómez, and Perfecto Herrera. 2013. Semantic audio content-based music recommendation and visualization based on user preference examples. Information Processing & Management 49, 1 (2013), 13--33.
[2]
Pedro Cano, Markus Koppenberger, and Nicolas Wack. 2005. Content-based Music Audio Recommendation. In Proceedings of the 13th Annual ACM International Conference on Multimedia (MULTIMEDIA '05). ACM, New York, NY, USA, 211--212.
[3]
Paolo Cremonesi, Yehuda Koren, and Roberto Turrin. 2010. Performance of Recommender Algorithms on Top-n Recommendation Tasks. In Proceedings of the Fourth ACM Conference on Recommender Systems (RecSys '10). ACM, New York, NY, USA, 39--46.
[4]
Yashar Deldjoo, Mehdi Elahi, and Paolo Cremonesi. 2016. Using visual features and latent factors for movie recommendation. CBRecSys 2016 (2016), 15.
[5]
J. Deng, W. Dong, R. Socher, L. J. Li, Kai Li, and Li Fei-Fei. 2009. ImageNet: A largescale hierarchical image database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition. 248--255.
[6]
Wei Di, Neel Sundaresan, Robinson Piramuthu, and Anurag Bhardwaj. 2014. Is a Picture Really Worth a Thousand Words? - on the Role of Images in e-Commerce. In Proceedings of the 7th ACM International Conference on Web Search and Data Mining (WSDM '14). ACM, New York, NY, USA, 633--642.
[7]
Jeff Donahue, Yangqing Jia, Oriol Vinyals, Judy Hoffman, Ning Zhang, Eric Tzeng, and Trevor Darrell. 2013. DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition. CoRR abs/1310.1531 (2013). http://arxiv.org/abs/1310.1531
[8]
Bruce Ferwerda, Markus Schedl, and Marko Tkalcic. 2015. Predicting Personality Traits with Instagram Pictures. In Proceedings of the 3rd Workshop on Emotions and Personality in Personalized Systems 2015 (EMPIRE '15). ACM, New York, NY, USA, 7--10.
[9]
Zhiwei Guan and Edward Cutrell. 2007. An Eye Tracking Study of the Effect of Target Rank on Web Search. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 417--420.
[10]
F. Maxwell Harper and Joseph A. Konstan. 2015. The MovieLens Datasets: History and Context. ACM Trans. Interact. Intell. Syst. 5, 4, Article 19 (Dec. 2015), 19 pages.
[11]
Ruining He and Julian McAuley. 2016. Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering. CoRR abs/1602.01585 (2016). http://arxiv.org/abs/1602.01585
[12]
Gawesh Jawaheer, Martin Szomszor, and Patty Kostkova. 2010. Comparison of Implicit and Explicit Feedback from an Online Music Recommendation Service. In Proceedings of the 1st International Workshop on Information Heterogeneity and Fusion in Recommender Systems (HetRec '10). ACM, New York, NY, USA, 47--51.
[13]
Yoshiyuki Kawano and Keiji Yanai. 2014. Food Image Recognition with Deep Convolutional Features. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication (UbiComp '14 Adjunct). ACM, New York, NY, USA, 589--593.
[14]
Michal Kompan and Mária Bieliková. 2010. Content-Based News Recommendation. Springer Berlin Heidelberg, Berlin, Heidelberg, 61--72.
[15]
Eduard Kuric and Maria Bielikova. 2015. ANNOR: Efficient image annotation based on combining local and global features. Computers & Graphics 47 (2015), 1--15.
[16]
Kernix Lab. 2016. Image classification with a pretrained deep neural network. https://www.kernix.com/blog/image-classification-with-a-pre-trained-deep-neural-network_p11. (2016).
[17]
Tie-Yan Liu et al. 2009. Learning to rank for information retrieval. Foundations and Trends® in Information Retrieval 3, 3 (2009), 225--331.
[18]
Xin Liu and Karl Aberer. 2014. Towards a Dynamic top-N Recommendation Framework. In Proceedings of the 8th ACM Conference on Recommender Systems (RecSys '14). ACM, New York, NY, USA, 217--224.
[19]
Walid Maalej, Hans-Jörg Happel, and Asarnusch Rashid. 2009. When Users Become Collaborators: Towards Continuous and Context-aware User Input. In Proceedings of the 24th ACM SIGPLAN Conference Companion on Object Oriented Programming Systems Languages and Applications (OOPSLA '09). ACM, New York, NY, USA, 981--990.
[20]
Marcelo G. Manzato. 2012. Discovering Latent Factors from Movies Genres for Enhanced Recommendation. In Proceedings of the Sixth ACM Conference on Recommender Systems (RecSys '12). ACM, New York, NY, USA, 249--252.
[21]
Julia Neidhardt, Leonhard Seyfang, Rainer Schuster, and Hannes Werthner. 2015. A picture-based approach to recommender systems. Information Technology & Tourism 15, 1 (2015), 49--69.
[22]
Aäron van den Oord, Sander Dieleman, and Benjamin Schrauwen. 2013. Deep Content-based Music Recommendation. In Proceedings of the 26th International Conference on Neural Information Processing Systems (NIPS'13). Curran Associates Inc., USA, 2643--2651. http://dl.acm.org/citation.cfm?id=2999792.2999907
[23]
Owen Phelan, Kevin McCarthy, and Barry Smyth. 2009. Using Twitter to Recommend Real-time Topical News. In Proceedings of the Third ACM Conference on Recommender Systems (RecSys '09). ACM, New York, NY, USA, 385--388.
[24]
István Pilászy and Domonkos Tikk. 2009. Recommending New Movies: Even a Few Ratings Are More Valuable Than Metadata. In Proceedings of the Third ACM Conference on Recommender Systems (RecSys '09). ACM, New York, NY, USA, 93--100.
[25]
Francesco Ricci, Lior Rokach, and Bracha Shapira. 2015. Recommender Systems Handbook (2nd ed.). Springer US, New York, NY, USA.
[26]
Stephen E. Robertson and K. Sparck Jones. 1976. Relevance weighting of search terms. Journal of the American Society for Information science 27, 3 (1976), 129--146.
[27]
Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jonathon Shlens, and Zbigniew Wojna. 2015. Rethinking the Inception Architecture for Computer Vision. CoRR abs/1512.00567 (2015). http://arxiv.org/abs/1512.00567
[28]
M. Tkalcic and J. F. Tasic. 2003. Colour spaces: perceptual, historical and applicational background. In The IEEE Region 8 EUROCON 2003. Computer as a Tool. Vol. 1. 304--308 vol.1.
[29]
Patricia Valdez and Albert Mehrabian. 1994. Effects of color on emotions. Journal of experimental psychology: General 123, 4 (1994), 394.
[30]
Hastagiri P. Vanchinathan, Isidor Nikolic, Fabio De Bona, and Andreas Krause. 2014. Explore-exploit in top-N Recommender Systems via Gaussian Processes. In Proceedings of the 8th ACM Conference on Recommender Systems (RecSys '14). ACM, New York, NY, USA, 225--232.
[31]
Li Yu, Fangjian Han, Shaobing Huang, and Yiwen Luo. 2017. A content-based goods image recommendation system. Multimedia Tools and Applications (2017), 1--15.
[32]
Mi Zhang. 2009. Enhancing Diversity in Top-N Recommendation. In Proceedings of the Third ACM Conference on Recommender Systems (RecSys '09). ACM, New York, NY, USA, 397--400.

Cited By

View all
  • (2020)Artificial intelligence in recommender systemsComplex & Intelligent Systems10.1007/s40747-020-00212-w7:1(439-457)Online publication date: 1-Nov-2020
  • (2019)Enhancing Fashion Recommendation with Visual Compatibility RelationshipThe World Wide Web Conference10.1145/3308558.3313739(3434-3440)Online publication date: 13-May-2019

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
RecSys '17: Proceedings of the Eleventh ACM Conference on Recommender Systems
August 2017
466 pages
ISBN:9781450346528
DOI:10.1145/3109859
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 August 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. content-based
  2. hybrid
  3. image features
  4. learning to rank
  5. rank
  6. top-n recommender

Qualifiers

  • Research-article

Funding Sources

  • Scientific Grant Agency of the Slovak Republic
  • Slovak Research and Development Agency

Conference

RecSys '17
Sponsor:

Acceptance Rates

RecSys '17 Paper Acceptance Rate 26 of 125 submissions, 21%;
Overall Acceptance Rate 254 of 1,295 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)5
  • Downloads (Last 6 weeks)1
Reflects downloads up to 03 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2020)Artificial intelligence in recommender systemsComplex & Intelligent Systems10.1007/s40747-020-00212-w7:1(439-457)Online publication date: 1-Nov-2020
  • (2019)Enhancing Fashion Recommendation with Visual Compatibility RelationshipThe World Wide Web Conference10.1145/3308558.3313739(3434-3440)Online publication date: 13-May-2019

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media