Skip to main content
SpringerLink
Log in

Object discovery in high-resolution remote sensing images: a semantic perspective

  • Regular Paper
  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

Given its importance, the problem of object discovery in high-resolution remote-sensing (HRRS) imagery has received a lot of attention in the literature. Despite the vast amount of expert endeavor spent on this problem, more efforts have been expected to discover and utilize hidden semantics of images for object detection. To that end, in this paper, we address this problem from two semantic perspectives. First, we propose a semantic-aware two-stage image segmentation approach, which preserves the semantics of real-world objects during the segmentation process. Second, to better capture semantic features for object discovery, we exploit a hyperclique pattern discovery method to find complex objects that consist of several co-existing individual objects that usually form a unique semantic concept. We consider the identified groups of co-existing objects as new feature sets and feed them into the learning model for better performance of image retrieval. Experiments with real-world datasets show that, with reliable segmentation and new semantic features as starting points, we can improve the performance of object discovery in terms of various external criteria.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Duygulu P, Barnard K, de Freitas N, Dorsyth D (2002) Object recognition as machine translation: learning a lexcicon for a fixed image vocabulary. In: Seventh European conference on computer vision, Vol 4. pp 97–112

  2. Feng S, Manmatha R, Lavrenko V (2004) Multiple bernoulli relevance models for image and video annotation. In: Computer vision and pattern recognition, CVPR04, pp 1002–1009

  3. Fung G, Stoeckel J (2007) Svm feature selection for classification of spect images of alzheimer’s disease using spatial information. Knowl Inf Syst 11(2): 243–258

    Article  Google Scholar 

  4. Gupta A, Weymouth T, Jain R (1991) Sematnic queries in image databases. Vis Database Syst 2(1): 204–218

    Google Scholar 

  5. Mori Y, Takahashi H, Oka R (1999) Image-to-word transformation based on dividing and vector quantizing images with words. In: MISRM’99 first international workshop on multimedia intelligent storage and retrieval management

  6. Wang L, Khan L, Liu L, Wu W (2004) Automatic image annotation and retrieval using weighted feature selection. In: Proceedings of the IEEE sixth international symposium on multimedia software engineering. Kulwer, Dordrecht

  7. Guo D, Atluri V, Adam N (2005) Texture-based remote-sensing image segmentation. In: Proceedings Of the 2005 international conference on multimedia and Expo, pp 1472–1475

  8. Xiong H, Tan P, Kumar V (2003) Mining strong affinity association patterns in data sets with skewed support distribution. In: Proceedings of the third IEEE international conference on data mining, pp 387–394

  9. Jeon, J, Lavrenko, V, Manmatha, R (2003) Automatic image annotation and retrieval using cross-media relevance models. In: SIGIR, pp 254–261

  10. Eakins J, Graham M (1999) Content-based image retrieval, Technical report, JISC Technology Applications Programm. http://www.unn.ac.uk/iidr/report.html

  11. Dial G, Gibson L, Poulsen R (2001) Ikonos satellite imagery and its use in automated road extraction. In: Automatic extraction of man-made objects from aerial and space images (III), Vol 1. ISPRS, pp 357–367

  12. Baltsavias EP (2004) Object extraction and revision by image analysis using existing geodata and knowledge: current status and steps towards operational systems. ISPRS J Photogramm Remote Sens 58(1): 129–151

    Article  Google Scholar 

  13. Sohn G, Dowman I (2001) Extraction of buildings from high-resolution satellite data. In: Automatic extraction of man-made objects from aerial and space images (III), Vol 1. ISPRS, pp 345–355

  14. Mayer H (1999) Automatic object extraction from aerial imagery—a survey focusing on buildings. Comput Vis Image Underst 74(2): 138–149

    Article  Google Scholar 

  15. Muller M, Segl K (1999) Object recognition based on high spatial resolution panchromatic satellite imagery. In: Joint workshop of ISPRS on Sensors and Mapping from Space 1999, ISPRS

  16. Castelli V, Bergman LD, Kontoyiannis I, Li C-S, Robinson JT, Turek JJ (1998) Progressive search and retrieval in large image archives. IBM J Res Dev 42(2): 253–268

    Article  Google Scholar 

  17. Datcu M, Daschiel H, Pelizzari A, Quartulli M, Galoppo A, Colapicchioni A, Pastori M, Seidel K, Marchetti PG, D’Elia S (2003) Information mining in remote sensing image archives: system concepts. IEEE Trans Geosci Remote Sens 41(12): 2923–2936

    Article  Google Scholar 

  18. Datcu M, Pelizzari A, Daschiel H, Quartulli M, Seidel K (2002) Advanced value adding to metric resolution sar data: information mining. In: Proceedings of fourth European conference of syntetic aperture radar, EUSAE

  19. Barnard K, Duygulu P, de Freitas N, Forsyth D, Blei D, Jordan MI (2003) Matching words and pictures. Mach Learn Res 3(1): 1107–1135

    Article  MATH  Google Scholar 

  20. Zhou ZH, Zhang ML (2006) Multi-instance multi-label learning with application to scene classification. In: Proceedings of the twentieth annual conference on neural information processing systems (NIPS), Vancouver, British Columbia, Canada, 4–7 December 2006, pp 1609–1616

  21. Zhu L, Zhang A, Rao A, Shihari R (2000) Keyblock: an approach for content-based image retrieval. In: Proceedings of ACM multimedia 2000, pp 147–156

  22. Yoshitaka A, Kishida S, Hirakawa M, Ichikawa T (1994) Knowledge-assisted content-based retrieval for multimedia database. IEEE Multimed 1(4): 12–21

    Article  Google Scholar 

  23. Egenhofer MJ (1997) Query processing in spatial-query-by-sketch. J Vis Lang Comput 8(4): 403–424

    Article  Google Scholar 

  24. Sheikholeslami G, Chang W, Zhang A (2002) Semquery: semantic clustering and querying on heterogeneous features for visual data. IEEE Trans Knowl Data Eng 14(5): 988–1002

    Article  Google Scholar 

  25. http://www.definiensimaging.com/ 2004, Ecognition userguide

  26. Shyu M-L, Chen S-C, Kashyap RL (2001) Generalized affinity-based association rule mining for multimedia database queries. Knowl Inf Syst 3(3): 319–337

    Article  MATH  Google Scholar 

  27. Teredesai AM, Ahmad MA, Kanodia J, Gaborski RS (2006) Comma: a framework for integrated multimedia mining using multi-relational associations. Knowl Inf Syst 10(2): 135–162

    Article  Google Scholar 

  28. Lavrenko V, Choquette M, Croft W (2002) Cross-lingual relevance models. In: Proceedings of the 25th annual international ACM SIGIR conference, pp 175–182

  29. Lavrenko V, Croft W (2001) Relevance-based language models. In: Proceedings of the 24th annual international ACM SIGIR conference, pp 120–127

  30. Shekhar S, Chawla S (2003) Spatial databases: a tour. Prentice-Hall, Englewood Cliffs

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Management Science and Information Systems, CIMIC, Rutgers University, Newark, NJ, 07102, USA

    Dihua Guo, Hui Xiong, Vijayalakshmi Atluri & Nabil R. Adam

Authors
  1. Dihua Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hui Xiong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Vijayalakshmi Atluri
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nabil R. Adam
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hui Xiong.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Guo, D., Xiong, H., Atluri, V. et al. Object discovery in high-resolution remote sensing images: a semantic perspective. Knowl Inf Syst 19, 211–233 (2009). https://doi.org/10.1007/s10115-008-0160-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-008-0160-4

Keywords

Search

Navigation