Jose San Pedro
ABSTRACT
Web 2.0 applications like Flickr, YouTube, or Del.icio.us are increasingly popular online communities for creating, editing and sharing content. The growing size of these folksonomies poses new challenges in terms of search and data mining. In this paper we introduce a novel methodology for automatically ranking and classifying photos according to their attractiveness for folksonomy members. To this end, we exploit image features known for having significant effects on the visual quality perceived by humans (e.g. sharpness and colorfulness) as well as textual meta data, in what is a multi-modal approach. Using feedback and annotations available in the Web 2.0 photo sharing system Flickr, we assign relevance values to the photos and train classification and regression models based on these relevance assignments. With the resulting machine learning models we categorize and rank photos according to their attractiveness. Applications include enhanced ranking functions for search and recommender methods for attractive content. Large scale experiments on a collection of Flickr photos demonstrate the viability of our approach.
- J. Bigun. Vision with Direction: A Systematic Introduction to Image Processing and Computer Vision. Springer-Verlag, Secaucus, NJ, USA, 2005. Google Scholar
Digital Library
- C. Burges, T. Shaked, E. Renshaw, A. Lazier, M. Deeds, N. Hamilton, and G. Hullender. Learning to rank using gradient descent. In ICML, pages 89--96, New York, NY, USA, 2005. ACM. Google ScholarDigital Library
- C. J. C. Burges. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery, 2(2):121--167, 1998. Google ScholarDigital Library
- S. Chakrabarti. Mining the Web: Discovering Knowledge from Hypertext Data. Morgan-Kauffman, 2002. Google ScholarDigital Library
- M. Dubinko, R. Kumar, J. Magnani, J. Novak, P. Raghavan, and A. Tomkins. Visualizing tags over time. In Proc. 15th Int. WWW Conference, May 2006. Google ScholarDigital Library
- R. Duda, P. Hart, and D. Stork. Pattern Classification. Wiley, 2000. Google ScholarDigital Library
- S. Dumais and H. Chen. Hierarchical classification of web content. In SIGIR '00, pages 256--263, New York, NY, USA, 2000. ACM. Google ScholarDigital Library
- S. Dumais, J. Platt, D. Heckerman, and M. Sahami. Inductive learning algorithms and representations for text categorization. In CIKM'98, pages 148--155, Maryland, United States, 1998. ACM Press. Google ScholarDigital Library
- T. Hammond, T. Hannay, B. Lund, and J. Scott. Social Bookmarking Tools (I): A General Review. D-Lib Magazine, 11(4), April 2005.Google Scholar
- S. Hasler and S. Susstrunk. Measuring colorfulness in real images. volume 5007, pages 87--95, 2003.Google Scholar
- A. Hotho, R. J¨aschke, C. Schmitz, and G. Stumme. Information Retrieval in Folksonomies: Search and Ranking. In The Semantic Web: Research and Applications, volume 4011 of LNAI, pages 411--426, Heidelberg, 2006. Springer. Google ScholarDigital Library
- K. Q. Huang, Q. Wang, and Z. Y. Wu. Natural color image enhancement and evaluation algorithm based on human visual system. Comput. Vis. Image Underst., 103(1):52--63, 2006. Google ScholarDigital Library
- Y. Jing and S. Baluja. Pagerank for product image search. In WWW, pages 307--316, New York, NY, USA, 2008. ACM. Google ScholarDigital Library
- T. Joachims. Text categorization with Support Vector Machines: Learning with many relevant features. ECML, 1998. Google ScholarDigital Library
- T. Joachims. Making large-scale support vector machine learning practical, pages 169--184. MIT Press, Cambridge, MA, USA, 1999. Google ScholarDigital Library
- D. Kalenova, P. Toivanen, and V. Bochko. Preferential spectral image quality model. pages 389--398. 2005.Google Scholar
- W. H. Kruskal. Ordinal measures of association. Journal of the American Statistical Association, 53(284):814--861, 1958.Google ScholarCross Ref
- B. Lund, T. Hammond, M. Flack, and T. Hannay. Social Bookmarking Tools (II): A Case Study -- Connotea. D-Lib Magazine, 11(4), 2005.Google ScholarCross Ref
- W. Madison, Y. Yang, and J. Pedersen. A comparative study on feature selection in text categorization. In ICML, 1997. Google ScholarDigital Library
- B. S. Manjunath and W. Y. Ma. Texture features for browsing and retrieval of image data. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 18(8):837--842, 1996. Google ScholarDigital Library
- C. Manning and H. Schuetze. Foundations of Statistical Natural Language Processing. MIT Press, 1999. Google ScholarDigital Library
- E. Peli. Contrast in complex images. Journal of the Optical Society of America, 7:2032--2040, 1990.Google ScholarCross Ref
- M. Richardson, A. Prakash, and E. Brill. Beyond pagerank: machine learning for static ranking. In WWW'06, pages 707--715, NY, USA, 2006. ACM. Google ScholarDigital Library
- A. E. Savakis, S. P. Etz, and A. C. Loui. Evaluation of image appeal in consumer photography. In B. E. Rogowitz and T. N. Pappas, editors, SPIE Conference Series, volume 3959, pages 111--120, June 2000.Google Scholar
- A. E. Savakis and A. C. Loui. Method For Automatically Detecting Digital Images that are Undesirable for Placing in Albums, volume US 6535636. March 2003.Google Scholar
- A. E. Savakis and R. Mehrotra. Retrieval and browsing of database images based on image emphasis and appeal. US 6847733, 2005.Google Scholar
- C. Schmitz, A. Hotho, R. Jaeschke, and G. Stumme. Mining Association Rules in Folksonomies. In Data Science and Classification, pages 261--270. Springer Berlin Heidelberg, 2006.Google ScholarCross Ref
- A. J. Smola and B. Sch¨olkopf. A tutorial on support vector regression. Statistics and Computing, 14(3):199--222, Kluwer Academic Publishers, 2004. Google ScholarDigital Library
- S. van Dongen. A cluster algorithm for graphs. National Research Institute for Mathematics and Computer Science in the Netherlands, Amsterdam, Technical Report INS-R0010, 2000. Google ScholarDigital Library
- C. Y. Wee and R. Paramesran. Measure of image sharpness using eigenvalues. Inf. Sci., 177(12):2533--2552, 2007. Google ScholarDigital Library
- S. Winkler. Visual fidelity and perceived quality: Towards comprehensive metrics. In in Proc. SPIE, volume 4299, pages 114--125, 2001.Google Scholar
- S. Winkler and C. Faller. Perceived audiovisual quality of low-bitrate multimedia content. Multimedia, IEEE Transactions on, 8(5):973--980, 2006. Google ScholarDigital Library
- S. Yao, W. Lin, S. Rahardja, X. Lin, E. P. Ong, Z. K. Lu, and X. K. Yang. Perceived visual quality metric based on error spread and contrast. In Circuits and Systems, 2005. ISCAS 2005. IEEE International Symposium on, pages 3793--3796 Vol. 4, 2005.Google Scholar
Index Terms
- Ranking and classifying attractiveness of photos in folksonomies
Recommendations
Context-based ranking in folksonomies
HT '09: Proceedings of the 20th ACM conference on Hypertext and hypermediaWith the advent of Web 2.0 tagging became a popular feature. People tag diverse kinds of content, e.g. products at Amazon, music at Last.fm, images at Flickr, etc. Clicking on a tag enables the users to explore related content. In this paper we ...
Ranking resources in folksonomies by exploiting semantic information
i-KNOW '12: Proceedings of the 12th International Conference on Knowledge Management and Knowledge TechnologiesOrganizing and sharing resources are the main aims of social bookmarking applications. By tagging resources, folksonomies emerge collaboratively. Information in folksonomies is valuable for ranking resources in social bookmarking applications as well as ...
A k-Nearest-Neighbour Method for Classifying Web Search Results with Data in Folksonomies
WI-IAT '08: Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology - Volume 01Traditional Web search engines mostly adopt a keyword-based approach. When the keyword submitted by the user is ambiguous, search result usually consists of documents related to various meanings of the keyword, while the user is probably interested in ...
Comments