skip to main content
10.1145/1386352.1386394acmconferencesArticle/Chapter ViewAbstractPublication PagescivrConference Proceedingsconference-collections
poster

Classification and annotation of digital photos using optical context data

Published: 07 July 2008 Publication History

Abstract

Other than the pixel information, a digital photo of today has a host of other information regarding the photo shooting event. These information are captured by different sensors present on the camera and are stored as metadata. In this paper we exploit this meta information and derive useful semantics about the digital photo. We also compare our results with classical relevance models used for automatic photo annotation. We create a dataset of digital photos containing all information and report results on it. We also make the dataset available to the community for further experiments.

References

[1]
http://http://www.flickr.com/photos/tags/.
[2]
http://www.flickr.com/.
[3]
http://www.ics.uci.edu/~psinha/dataset.html.
[4]
EXIF: Exchangeable image file format for digital cameras:version 2.2. Technical report, JEITI Association, 2002.
[5]
K. Barnard and D. Forsyth. Learning the semantics of words and pictures. In Proc of IEEE Intl Conf Computer Vision, volume 2, pages 408--415, 2000.
[6]
D. Blei and M. I. Jordan. Modeling annotated data. In Proc. ACM SIGIR, 2003.
[7]
M. Boutell and J. Luo. Bayesian fusion of camera metadata cues in semantic scene classification. In Proc. IEEE CVPR, 2004.
[8]
M. Boutell and J. Luo. Photo classification by integrating image content and camera metadata. In Proc. of ICPR, 2004.
[9]
C. Carson, S. Belongie, H. Greenspan, and J. Malik. Blobworld: Image segmentation using expectation maximization and application to image querying. IEEE Transactions in PAMI, 24(8):1026--1040, 2002.
[10]
M. Cooper, J. Foote, A. Girgensohn, and L. Wilcox. Temporal event clustering for digital photo collections. In Proc. ACM SIGMM, 2003.
[11]
P. Duygulu, K. Barnard, N. de Freitas, and D. Forsyth. Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary. In Proc. ECCV, 2002.
[12]
C. Fraley and A. Raftery. How many clusters? which clustering method? answers via model based cluster analysis. The Computer Journal, 1998.
[13]
Y. Gong. Advancing content-based image retrieval by exploiting image color and region features. Multimedia Systems, 7(6):449--457, 1999.
[14]
J. Jeon, V. Lavrenko, and R. Manmatha. Automatic image annotation and retrieval using cross-media relevance models. In Proc. ACM SIGIR, 2003.
[15]
V. Lavrenko, R. Manmatha, and J. Jeon. A model for learning the semantics of pictures. In Proc. NIPS, 2003.
[16]
X. Liu, L. Zhang, M. Li, H. Zhang, and D. Wang. Boosting image classification with lda based feature combination for digital photograph management. Pattern Recognition, 38:887--901, 2005.
[17]
D. G. Lowe. Distinctive image features from scaleinvariant key points. International Journal of Computer Vision, 60:91--110, 2004.
[18]
B. Manjunath and W. Ma. Texture features for browsing and retrieval of image data. IEEE Transactions in PAMI, 18:837--842, 1996.
[19]
G. Schwarz. Estimating dimensions of a model. The Annals of Statistics, 6:461--464, 1978.
[20]
P. Sinha and R. Jain. Concept annotation and search space decrement of digital photos using optical context information. In Proc of Multimedia Content Access: Algorithms and Systems, SPIE Electronic Imaging, 2008.
[21]
A. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain. Content based image retrieval at the end of the early years. IEEE Transactions in PAMI, 22:1349--1380, 2000.
[22]
M. Tuffield, S. Harris, D. Dupplaw, A.Chakravarthy, B. Brewster, N. Gibbins, K. O'Hara, F. Ciravegna, D. Sleeman, N. Shadbolt, and Y. Wilks. Image annotation with photocopain. In International Workshop on Semantic Web Annotations for Multimedia, 2006.
[23]
T. Westerveld and A. de Vries. Experimental evaluation of a generative probabilistic image retrieval model on 'easy' data. In Proc of ACM SIGIR Multimedia Information Retrieval Workshop, 2003.

Cited By

View all
  • (2024)Semantic labeling of social big media using distributed online robust classificationEngineering Applications of Artificial Intelligence10.1016/j.engappai.2024.107928132(107928)Online publication date: Jun-2024
  • (2024)Images to Describe Research Data: A Case Study on the Use of Imagery MetadataMetadata and Semantic Research10.1007/978-3-031-65990-4_9(103-116)Online publication date: 31-Jul-2024
  • (2023)Images as Metadata: A New Perspective for Describing Research DataJournal of Library Metadata10.1080/19386389.2023.225272223:3-4(87-101)Online publication date: 12-Sep-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CIVR '08: Proceedings of the 2008 international conference on Content-based image and video retrieval
July 2008
674 pages
ISBN:9781605580708
DOI:10.1145/1386352
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 July 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. automatic annotation
  2. camera metadata
  3. context
  4. digital photo
  5. search

Qualifiers

  • Poster

Conference

CIVR08

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 12 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Semantic labeling of social big media using distributed online robust classificationEngineering Applications of Artificial Intelligence10.1016/j.engappai.2024.107928132(107928)Online publication date: Jun-2024
  • (2024)Images to Describe Research Data: A Case Study on the Use of Imagery MetadataMetadata and Semantic Research10.1007/978-3-031-65990-4_9(103-116)Online publication date: 31-Jul-2024
  • (2023)Images as Metadata: A New Perspective for Describing Research DataJournal of Library Metadata10.1080/19386389.2023.225272223:3-4(87-101)Online publication date: 12-Sep-2023
  • (2022)Semantic Image Analysis on Social Networks and Data ProcessingHandbook of Research on Foundations and Applications of Intelligent Business Analytics10.4018/978-1-7998-9016-4.ch009(189-214)Online publication date: 2022
  • (2020)Semantic analysis on social networks: A surveyInternational Journal of Communication Systems10.1002/dac.442433:11Online publication date: 16-Apr-2020
  • (2019)Factors in Personal Information Management EvaluationAdvances in Visual Informatics10.1007/978-3-030-34032-2_46(523-536)Online publication date: 2019
  • (2018)Content and ContextMultimedia Computing10.1017/CBO9781139049351.020(290-304)Online publication date: 12-Sep-2018
  • (2018)Multimedia Information RetrievalMultimedia Computing10.1017/CBO9781139049351.016(188-208)Online publication date: 12-Sep-2018
  • (2017)A survey on context-aware mobile visual recognitionMultimedia Systems10.1007/s00530-016-0523-823:6(647-665)Online publication date: 1-Nov-2017
  • (2013)Transforming personal artifacts into probabilistic narrativesProceedings of the 2013 UAI Conference on Application Workshops: Big Data meet Complex Models and Models for Spatial, Temporal and Network Data - Volume 102410.5555/3020285.3020290(29-38)Online publication date: 15-Jul-2013
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media