Article

EnjoyPhoto: a vertical image search engine for enjoying high-quality photos

Authors:

Wei-Ying MaAuthors Info & Claims

MM '06: Proceedings of the 14th ACM international conference on Multimedia

Pages 367 - 376

https://doi.org/10.1145/1180639.1180719

Published: 23 October 2006 Publication History

Abstract

In this paper, we propose building a vertical image search engine called EnjoyPhoto that leverages rich metadata from various photo forum web sites to meet users' requirements for enjoying high-quality photos, which is virtually impossible in traditional image search engines. To solve the ranking problem when aggregating multiple photo forums, we propose a novel rank fusion algorithm that uses duplicate photos to normalize rating scores. To further improve user experiences in enjoying photos, we design an in-place image browsing interface, and compare it with several other interfaces in a user study. With rich metadata and rating information, more attractive user interfaces are enabled, including slideshow authoring and photo recommendations. We conducted experiments and user studies on a 2.5-million image database to evaluate the proposed rank fusion algorithm, investigate the rationale behind building a vertical image search engine, and study user interfaces and preferences for the purpose of enjoying high-quality photos. The experimental results demonstrate the effectiveness of the proposed ranking algorithm. The results also show that the 2.5-million high-quality image database in EnjoyPhoto performs comparably with Google's 1- billion image database for queries related to location, nature, and daily life categories. Finally, our results show that the in-place browsing interface-called Force-Transfer view-is much more convenient for users than traditional interfaces.

References

[1]

Burges C., Shaked T., Renshaw E., et al. Learning to Rank Using Gradient Descent. In Proc. of the 22nd International Conference on Machine Learning, 2005, 89--96.

Digital Library

[2]

Chen, Z., Liu, W.Y., Hu, C.H., Li, M.J., and Zhang H.J. A Web Image Search Engine. In Proc. ACM SIGIR, 2001.

Digital Library

[3]

Dwork C., Kumar R., Naor M., and Sivakumar D. Rank Aggregation Methods for the Web. In Proc. of the 10th International WWW Conference, Hong-Kong, 2001.

Digital Library

[4]

Fagin R., Kumar R., and Sivakumar D. Comparing Top K Lists. SIAM Journal on Discrete Mathematics, 17(1), 2003.

Digital Library

[5]

Frankel, C., Swain, M.J., and Athitsos, V. WebSeer: An Image Search Engine for the World Wide Web. Technical Report TR-94-14, Computer Science Department, University of Chicago, 1996

Digital Library

[6]

Freund Y., Iyer R., Schapire R. E., and Singer Y. An Efficient Boosting Algorithm for Combining Preferences. Journal of Machine Learning Research, 4(1), 2004, 933--969.

Digital Library

[7]

Google image search; http://images.google.com.

[8]

Huang, X., and Lai. W. Force-Transfer: A New Approach to Removing Overlapping Nodes in Graph Layout. In Proc. The 25th Australian Computer Science Conference, 2003.

Digital Library

[9]

IMDB, Formula for calculating the top-rated 250 titles in imdb; http://www.imdb.com/chart/top.

[10]

Joachims, T. Optimizing Search Engines using Clickthrough Data. In Proc. 8th ACM SIGKDD, 2002, 133--142.

Digital Library

[11]

Li, Z.W., Xu, G., Li, M., Ma, W.Y., and Zhang H.J. Grouping WWW Image Search Results by Novel Inhomogeneous Clustering Method. In Proc. 7th International Multimedia Modeling Conference, 2005.

Digital Library

[12]

Liu, H., Xie, X., Tang, X.O., Li, Z.W., and Ma, W.Y. Effective Browsing of Web Image Search Results. In Proc. 6th ACM SIGMM International Workshop on Multimedia Information Retrieval (MIR 2004), 2004.

Digital Library

[13]

Nie Z., Zhang Y., Wen J.R., and Ma W.Y. Object-Level Ranking: Bringing Order to Web Objects. In Proc. 14th International Conference on World Wide Web, 2005.

Digital Library

[14]

Page, L., Brin, S., Motwani, R. and Winograd, T. The PageRank Citation Ranking: Bringing Order to the Web. Technical report, Stanford Digital Libraries, 1998.

[15]

PicSearch; http://www.picsearch.com.

[16]

Robertson E., Walker S., and Jones S., Hancock-Beaulieu M.M., Gatford M. Okapi at TREC-3, In Proc. Second Text Retrieval Conf. (TREC-3), 1995.

[17]

Sarkar, M., and Brown, M.H. Graphical Fisheye Views. Communications of the ACM, 1993.

Digital Library

[18]

Savakis, A.E., Etz, S.P. and Loui, A.C. Evaluation of Image Appeal in Consumer Photography. In Proc. SPIE Human Vision and Electronic Imaging V, SPIE, 2000, 111--120.

[19]

Sclaroff, S., Cascia, M.L. and Sethi, S. Unifying Textual and Visual Cues for Content-Based Image Retrieval on the World Wide Web. Computer Vision and Image Understanding, 75, 1/2 (1999):86--98.

Digital Library

[20]

Smith, J.R. and Chang, S.F. WebSeek: Visually Searching the Web for Content. IEEE MultiMedia, 4, 3 (1997):12--20.

Digital Library

[21]

Sullivan, D. Hitwise Search Engine Ratings. Search Engine Watch Articles, August 23, 2005; http://searchenginewatch.com/reports/article.php/3099931.

[22]

Süsstrunk, S. and Winkler, S. Color Image Quality on the internet. In Proc. IS&T/SPIE Electronic Imaging 2004: Internet Imaging V, IS&T/SPIE, vol. 5304 (2004):118--131.

[23]

Tong, H.H., Li, M.J., Zhang H.J., He, J.H., and Zhang C.S. Classification of Digital Photos Taken by Photographers or Home Users. In Proc. Pacific-Rim Conference on Multimedia (PCM), 2004, 198--205.

Digital Library

[24]

Wang B., Li Z.W., Li M.J., and Ma W.Y. Large-Scale Duplicate Detection For Web Image Search, in Proc. ICME, 2006.

[25]

Yahoo image search; http://images.yahoo.com.

[26]

Yee, K.P., Swearingen, K., Li, K., and Hearst, M. Faceted Metadata for Image Search and Browsing. In Proc. ACM SIGCHI, 2003

Digital Library

Cited By

Mousas CKrogmeier CWang Z(2021)Photo Sequences of Varying Emotion: Optimization with a Valence-Arousal Annotated DatasetACM Transactions on Interactive Intelligent Systems10.1145/345884411:2(1-19)Online publication date: 21-Jul-2021
https://dl.acm.org/doi/10.1145/3458844
Cruz DCabral DCampos P(2021)Human-Centered Visual Interfaces for Image Retrieval: An Exploratory StudyHuman-Computer-Interaction – INTERACT 202110.1007/978-3-030-85607-6_53(436-441)Online publication date: 27-Aug-2021
https://doi.org/10.1007/978-3-030-85607-6_53
Kim HSohn SKim J(2019)Revisiting Gist-PCA Hashing for Near Duplicate Image DetectionJournal of Signal Processing Systems10.1007/s11265-018-1360-091:6(575-586)Online publication date: 1-Jun-2019
https://dl.acm.org/doi/10.1007/s11265-018-1360-0
Show More Cited By

Index Terms

EnjoyPhoto: a vertical image search engine for enjoying high-quality photos
1. Human-centered computing
2. Information systems
  1. Information retrieval
    1. Information retrieval query processing

Recommendations

The impact of images on user clicks in product search
MDMKDD '12: Proceedings of the Twelfth International Workshop on Multimedia Data Mining

Product search engine faces unique challenges that differ from web page search. The goal of a product search engine is to rank relevant items that the user may be interested in purchasing. Clicks provide a strong signal of a user's interest in an item. ...
The 2nd workshop on Vertical Search Relevance at WSDM 2015
WSDM '15: Proceedings of the Eighth ACM International Conference on Web Search and Data Mining

As the web information exponentially grows and the needs of users become more specific, traditional general web search engines are not able to perfectly satisfy the nowadays user requirement. Vertical search engines have emerged in various domains, ...
Online Exploration for Detecting Shifts in Fresh Intent
CIKM '14: Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management

In web search, recency ranking refers to the task of ranking documents while taking into account freshness as one of the criteria of their relevance. There are two approaches to recency ranking. One focuses on extending existing learning to rank ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '06: Proceedings of the 14th ACM international conference on Multimedia

October 2006

1072 pages

ISBN:1595934472

DOI:10.1145/1180639

General Chairs:
Klara Nahrstedt
UIUC
,
Matthew Turk
UCSB
,
Program Chairs:
Yong Rui
Microsoft Research
,
Wolfgang Klas
Universität Wien
,
Ketan Mayer-Patel
UNC

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

MM06

Sponsor:

MM06: The 14th ACM International Conference on Multimedia 2006

October 23 - 27, 2006

CA, Santa Barbara, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
801
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Mousas CKrogmeier CWang Z(2021)Photo Sequences of Varying Emotion: Optimization with a Valence-Arousal Annotated DatasetACM Transactions on Interactive Intelligent Systems10.1145/345884411:2(1-19)Online publication date: 21-Jul-2021
https://dl.acm.org/doi/10.1145/3458844
Cruz DCabral DCampos P(2021)Human-Centered Visual Interfaces for Image Retrieval: An Exploratory StudyHuman-Computer-Interaction – INTERACT 202110.1007/978-3-030-85607-6_53(436-441)Online publication date: 27-Aug-2021
https://doi.org/10.1007/978-3-030-85607-6_53
Kim HSohn SKim J(2019)Revisiting Gist-PCA Hashing for Near Duplicate Image DetectionJournal of Signal Processing Systems10.1007/s11265-018-1360-091:6(575-586)Online publication date: 1-Jun-2019
https://dl.acm.org/doi/10.1007/s11265-018-1360-0
Sánchez LAlfonso-Cendón JOliveira TOrdieres-Meré JLimas MNovais P(2017)Information system for image classification based on frequency curve proximityInformation Systems10.1016/j.is.2016.08.00164:C(12-21)Online publication date: 1-Mar-2017
https://dl.acm.org/doi/10.1016/j.is.2016.08.001
Li ZLi Z(2017)Understanding-Oriented Multimedia News RetrievalUnderstanding-Oriented Multimedia Content Analysis10.1007/978-981-10-3689-7_5(101-129)Online publication date: 27-May-2017
https://doi.org/10.1007/978-981-10-3689-7_5
Wu ZXie XLiu YZhang MMa S(2017)A Study of User Image Search Behavior Based on Log AnalysisInformation Retrieval10.1007/978-3-319-68699-8_6(69-80)Online publication date: 21-Oct-2017
https://doi.org/10.1007/978-3-319-68699-8_6
Moriyama YPark BIwaoki SMatsushita MOgier JAizawa KOsaka KBurie JYamasaki TOsaka M(2016)Designing a question-answering system for comic contentsProceedings of the 1st International Workshop on coMics ANalysis, Processing and Understanding10.1145/3011549.3011554(1-6)Online publication date: 4-Dec-2016
https://dl.acm.org/doi/10.1145/3011549.3011554
Li ZLiu JWang MXu CLu H(2013)Enhancing news organization for convenient retrieval and browsingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/248873210:1(1-20)Online publication date: 27-Dec-2013
https://dl.acm.org/doi/10.1145/2488732
Hoque EHoeber OGong M(2013)CIDERInformation Processing and Management: an International Journal10.1016/j.ipm.2012.12.00149:5(1122-1138)Online publication date: 1-Sep-2013
https://dl.acm.org/doi/10.1016/j.ipm.2012.12.001
Li ZWang MLiu JXu CLu HCandan KPanchanathan SPrabhakaran BSundaram HFeng WSebe N(2011)News contextualization with geographic and visual informationProceedings of the 19th ACM international conference on Multimedia10.1145/2072298.2072317(133-142)Online publication date: 28-Nov-2011
https://dl.acm.org/doi/10.1145/2072298.2072317
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten