research-article

Automatic image description by using word-level features

Authors:

Shingo Horiuchi,

Hirotaka Moriguchi,

Shinichi Honiden,

Xu ShengboAuthors Info & Claims

ICIMCS '13: Proceedings of the Fifth International Conference on Internet Multimedia Computing and Service

Pages 309 - 314

https://doi.org/10.1145/2499788.2499823

Published: 17 August 2013 Publication History

Get Access

Abstract

Automatic image description is one of the challenging tasks of image recognitions. However, there are image descriptions that contain some too specific phrases that cannot be judged only from appearance of images. In this paper, we propose a novel approach to collect general phrases for generating image descriptions. On the assumption that there are high frequency phrases related to an query image in the image descriptions of similar images, we select nouns and their attribute phrases from the image descriptions of similar images based on their frequency. In order to evaluate the relevance of our image description, we conduct comparative experiments with existing approaches. Our experimental results show that our image descriptions are short, concise and visually relevant to query images.

References

[1]

N. Chen, Q. Y. Zhou, and V. Prasanna. Understanding web images by object relation network. In Proceedings of the 21st international conference on World Wide Web, pages 291--300. ACM, 2012.

Digital Library

Google Scholar

[2]

A. Farhadi, M. Hejrati, M. Sadeghi, P. Young, C. Rashtchian, J. Hockenmaier, and D. Forsyth. Every picture tells a story: Generating sentences from images. Computer Vision-ECCV 2010, pages 15--29, 2010.

Digital Library

Google Scholar

[3]

G. Kulkarni, V. Premraj, S. Dhar, S. Li, Y. Choi, A. C. Berg, and T. L. Berg. Baby talk: Understanding and generating simple image descriptions. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pages 1601--1608. IEEE, 2011.

Digital Library

Google Scholar

[4]

P. Kuznetsova, V. Ordonez, A. C. Berg, T. L. Berg, and Y. Choi. Collective generation of natural image descriptions. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers - Volume 1, ACL '12, pages 359--368, Stroudsburg, PA, USA, 2012. Association for Computational Linguistics.

Digital Library

Google Scholar

[5]

V. Ordonez, G. Kulkarni, and T. L. Berg. Im2text: Describing images using 1 million captioned photographs. In Proceedings of NIPS, 2011.

Google Scholar

[6]

B. Z. Yao, X. Yang, L. Lin, M. W. Lee, and S. C. Zhu. I2t: Image parsing to text description. Proceedings of the IEEE, 98(8):1485--1508, 2010.

Crossref

Google Scholar

Cited By

View all

R MAnu MS D(2021)Building A Voice Based Image Caption Generator with Deep Learning2021 5th International Conference on Intelligent Computing and Control Systems (ICICCS)10.1109/ICICCS51141.2021.9432091(943-948)Online publication date: 6-May-2021
https://doi.org/10.1109/ICICCS51141.2021.9432091
Srivastava GSrivastava R(2018)A Survey on Automatic Image CaptioningMathematics and Computing10.1007/978-981-13-0023-3_8(74-83)Online publication date: 14-Apr-2018
https://doi.org/10.1007/978-981-13-0023-3_8

Index Terms

Automatic image description by using word-level features
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Graphics processors

Recommendations

Automatic Image Annotation Using Global and Local Features
SMAP '11: Proceedings of the 2011 Sixth International Workshop on Semantic Media Adaptation and Personalization

Automatic image annotation methods require a quality training image dataset, from which annotations for target images are obtained. At present, the main problem with these methods is their low effectiveness and scalability if a large-scale training ...
Fuzzy bag of words for social image description

Rapid growth of social media resources brings huge challenges and opportunities for image description technologies. The performance of image description method directly affects the accuracy of image retrieval, image annotation and image recognition. Bag ...
Rich Image Description Based on Regions
MM '15: Proceedings of the 23rd ACM international conference on Multimedia

Abstract Automatically describing the content of an image is a fundamental problem in artificial intelligence that connects computer vision and natural language processing. In contrast to the previous image description methods that focus on describing ...

Comments

Information & Contributors

Information

Published In

ICIMCS '13: Proceedings of the Fifth International Conference on Internet Multimedia Computing and Service

August 2013

419 pages

ISBN:9781450322522

DOI:10.1145/2499788

Conference Chair:
Tat-Seng Chua
National University of Singapore, Singapore
,
General Chairs:
Ke Lu
University of Chinese Academy of Sciences, China
,
Tao Mei
Microsoft Research Asia, China
,
Xindong Wu
Hefei University of Technology, China

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 August 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICIMCS '13

Sponsor:

NSF of China
University of Sciences & Technology, Hefei

ICIMCS '13: International Conference on Internet Multimedia Computing and Service

August 17 - 19, 2013

Huangshan, China

Acceptance Rates

ICIMCS '13 Paper Acceptance Rate 20 of 94 submissions, 21%;

Overall Acceptance Rate 163 of 456 submissions, 36%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
191
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

R MAnu MS D(2021)Building A Voice Based Image Caption Generator with Deep Learning2021 5th International Conference on Intelligent Computing and Control Systems (ICICCS)10.1109/ICICCS51141.2021.9432091(943-948)Online publication date: 6-May-2021
https://doi.org/10.1109/ICICCS51141.2021.9432091
Srivastava GSrivastava R(2018)A Survey on Automatic Image CaptioningMathematics and Computing10.1007/978-981-13-0023-3_8(74-83)Online publication date: 14-Apr-2018
https://doi.org/10.1007/978-981-13-0023-3_8

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Automatic Image Annotation Using Global and Local Features

Fuzzy bag of words for social image description

Rich Image Description Based on Regions

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations