Skip to main content
SpringerLink
Log in

A novel benchmark dataset of color steel sheds for remote sensing image retrieval

  • Research Article
  • Published:
Earth Science Informatics Aims and scope Submit manuscript

Abstract

Benchmark datasets play an important role in evaluating remote sensing image retrieval (RSIR) methods. The current datasets cover many scene categories, but omit an important scene of color steel sheds, which are widely distributed with a large number on the earth’s surface. Therefore, we propose a new benchmark dataset of color steel sheds (CSS) from Google map imagery for RSIR and share it open access in our V-RSIR system. The new dataset has rich intra-class and inter-class diversity, and is composed of blue, red and white color steel sheds with the total number of 2407 remote sensing images. We conduct evaluation experiments on the new dataset by using ten low/mid feature-based and ten deep learning feature-based methods. Experimental results indicate that the dataset is effective for evaluating RSIR methods and using the dataset can construct an effective retrieval model for color steel sheds. Besides, we have experimentally demonstrated that color constancy does affect retrieval performance on our CSS dataset. Furthermore, some experiments of merging the CSS dataset with the PatternNet, VGoogle and NWPU45 datasets are also conducted. Experimental results demonstrate that our dataset can be used as a complement to other retrieval datasets. Furthermore, these experimental results can be used as baseline for future applications on RSIR.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • An P, Ma B, Jin S, Zhang L (2020) The landscape style and features of historical and cultural blocks in Handan, Hebei Province, China. J Landsc Res 12:95–100

    Google Scholar 

  • Bapu JJ, Florinabel DJ (2020) Automatic annotation of satellite images with multi class support vector machine. Earth Sci Inf 13:811–819. https://doi.org/10.1007/s12145-020-00471-8

    Article  Google Scholar 

  • Chen L-K et al (2021) Modular composite building in urgent emergency engineering projects: a case study of accelerated design and construction of Wuhan Leishenshan/Leishenshan hospital to COVID-19 pandemic. Autom Constr 124:103555. https://doi.org/10.1016/j.autcon.2021.103555

    Article  Google Scholar 

  • Cheng G, Han J, Lu X (2017) Remote sensing image scene classification: benchmark and state of the art. Proc IEEE 105:1865–1883. https://doi.org/10.1109/jproc.2017.2675998

    Article  Google Scholar 

  • Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05). IEEE, San Diego, pp 886–893. https://doi.org/10.1109/CVPR.2005.177

  • Ge Y, Jiang S, Xu Q, Jiang C, Ye F (2018) Exploiting representations from pre-trained convolutional neural networks for high-resolution remote sensing image retrieval. Multimed Tools Appl 77:17489–17515

    Article  Google Scholar 

  • Han L, Li P, Bai X, Grecos C, Zhang X, Ren P (2020) Cohesion intensive deep hashing for remote sensing image retrieval. Remote Sens 12:101

    Article  Google Scholar 

  • Haralick RM, Shanmugam K, Dinstein IH (1973) Textural features for image classification. IEEE Trans Syst Man Cybern SMC-3:610–621. https://doi.org/10.1109/TSMC.1973.4309314

    Article  Google Scholar 

  • He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, Las Vegas, pp 770–778. https://doi.org/10.1109/CVPR.2016.90

  • Hou D, Miao Z, Xing H, Wu H (2019) V-RSIR: an open access web-based image annotation tool for remote sensing image retrieval. IEEE Access 7:83852–83862. https://doi.org/10.1109/access.2019.2924933

    Article  Google Scholar 

  • Hou D, Miao Z, Xing H, Wu H (2020) Exploiting low dimensional features from the MobileNets for remote sensing image retrieval. Earth Sci Inf 13:1437–1443. https://doi.org/10.1007/s12145-020-00484-3

    Article  Google Scholar 

  • Hou D, Miao Z, Xing H, Wu H (2021) Two novel benchmark datasets from ArcGIS and bing world imagery for remote sensing image retrieval. Int J Remote Sens 42:240–258. https://doi.org/10.1080/01431161.2020.1804090

    Article  Google Scholar 

  • Howard AG et al (2017) Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:170404861

  • Huang J, Ravi Kumar S, Mitra M, Zhu W-J, Zabih R (1999) Spatial color indexing and applications. Int J Comput Vis 35:245–268. https://doi.org/10.1023/a:1008108327226

    Article  Google Scholar 

  • Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, Honolulu, pp 4700–4708. https://doi.org/10.1109/CVPR.2017.243

  • Jégou H, Douze M, Schmid C, Pérez P (2010) Aggregating local descriptors into a compact image representation. In: 2010 IEEE computer society conference on computer vision and pattern recognition (CVPR). IEEE, San Francisco, pp 3304–3311. https://doi.org/10.1109/cvpr.2010.5540039

  • Li P, Yang S, Yao H, Yang M, Yong W (2017) Research on extraction of the urban color steel shed based on high-resolution remote sensing images. Geospatial Inf 15:13–18

    Google Scholar 

  • Li Y, Zhang Y, Huang X, Zhu H, Ma J (2018) Large-scale remote sensing image retrieval by deep hashing neural networks. IEEE Trans Geosci Remote Sens 56:950–965. https://doi.org/10.1109/tgrs.2017.2756911

    Article  Google Scholar 

  • Li D, Shao Z, Zhang R (2020) Advances of geo-spatial intelligence at LIESMARS. Geo-spatial Inf Sci 23:40–51

    Article  Google Scholar 

  • Li Y, Ma J, Zhang Y (2021) Image retrieval from remote sensing big data: a survey. Inf Fusion 67:94–115

    Article  Google Scholar 

  • Liu J, Shao Z, Cheng Q (2011) Color constancy enhancement under poor illumination. Opt Lett 36:4821–4823

    Article  Google Scholar 

  • Liu Y, Chen C, Han Z, Ding L, Liu Y (2020a) High-resolution remote sensing image retrieval based on classification-similarity networks and double fusion. IEEE J Sel Top Appl Earth Obs Remote Sens 13:1119–1133

    Article  Google Scholar 

  • Liu Y, Ding L, Chen C, Liu Y (2020b) Similarity-based unsupervised deep transfer learning for remote sensing image retrieval. IEEE Trans Geosci Remote Sens 58:7872–7889. https://doi.org/10.1109/TGRS.2020.2984703

    Article  Google Scholar 

  • Manjunath BS, Ma W-Y (1996) Texture features for browsing and retrieval of image data. IEEE Trans Pattern Anal Mach Intell 18:837–842

    Article  Google Scholar 

  • Napoletano P (2018) Visual descriptors for content-based retrieval of remote-sensing images. Int J Remote Sens 39:1343–1376

    Article  Google Scholar 

  • Ojala T, Pietikainen M, Harwood D (1994) Performance evaluation of texture measures with classification based on Kullback discrimination of distributions. In: 12th International Conference on Pattern Recognition. IEEE, Jerusalem, pp 582–585. https://doi.org/10.1109/ICPR.1994.576366

  • Oliva A, Torralba A (2001) Modeling the shape of the scene: a holistic representation of the spatial envelope. Int J Comput Vis 42:145–175

    Article  Google Scholar 

  • Philbin J, Chum O, Isard M, Sivic J, Zisserman A (2007) Object retrieval with large vocabularies and fast spatial matching. In: 2007 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, Minneapolis, pp 1–8. https://doi.org/10.1109/CVPR.2007.383172

  • Qi X, Zhu P, Wang Y, Zhang L, Peng J, Wu M, Chen J, Zhao X, Zang N, Mathiopoulos PT (2020) MLRSNet: a multi-label high spatial resolution remote sensing dataset for semantic scene understanding. ISPRS J Photogramm Remote Sens 169:337–350

    Article  Google Scholar 

  • Shao Z, Zhou W, Zhang L, Hou J (2014) Improved color texture descriptors for remote sensing image retrieval. J Appl Remote Sens 8:083584

    Article  Google Scholar 

  • Shao Z, Yang K, Zhou W (2018) Performance evaluation of single-label and multi-label remote sensing image retrieval using a dense labeling dataset. Remote Sens 10:964

    Article  Google Scholar 

  • Shao Z, Zhou W, Deng X, Zhang M, Cheng Q (2020) Multilabel remote sensing image retrieval based on fully convolutional network. IEEE J Sel Top Appl Earth Obs Remote Sens 13:318–328. https://doi.org/10.1109/JSTARS.2019.2961634

    Article  Google Scholar 

  • Sheng G, Yang W, Xu T, Sun H (2012) High-resolution satellite scene classification using a sparse coding based multiple feature combination. Int J Remote Sens 33:2395–2412. https://doi.org/10.1080/01431161.2011.608740

    Article  Google Scholar 

  • Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:14091556

  • Stricker MA, Orengo M (1995) Similarity of color images. In: IS&T/SPIE’s Symposium on Electronic Imaging: Science and Technology. SPIE, San Jose, pp 381–392. https://doi.org/10.1117/12.205308

  • Sudha S, Aji S (2019) A review on recent advances in remote sensing image retrieval techniques. J Indian Soc Remote Sens 47:2129–2139

    Article  Google Scholar 

  • Sun M, Deng Y, Li M, Jiang H, Huang H, Liao W, Liu Y, Yang J, Li Y (2020) Extraction and analysis of blue steel roofs information based on CNN using Gaofen-2 imageries. Sensors 20:4655

    Article  Google Scholar 

  • Tong X-Y, Xia G-S, Hu F, Zhong Y, Datcu M, Zhang L (2020) Exploiting deep features for remote sensing image retrieval: a systematic investigation. IEEE Trans Big Data 6:507–521. https://doi.org/10.1109/TBDATA.2019.2948924

    Article  Google Scholar 

  • Van De Weijer J, Gevers T, Gijsenij A (2007) Edge-based color constancy. IEEE Trans Image Process 16:2207–2214

    Article  Google Scholar 

  • Wang X, Shao Z, Zhou X, Liu J (2014) A novel remote sensing image retrieval method based on visual salient point features. Sens Rev 34:349–359

    Article  Google Scholar 

  • Wang J, Yang W, Yang S, Yan H (2019) Spatial distribution characteristics of color steel plate buildings in Lanzhou City. Mod Environ Sci Eng 5:583–589

    Google Scholar 

  • Xia G et al (2017) AID: a benchmark data set for performance evaluation of aerial scene classification. IEEE Trans Geosci Remote Sens 55:3965–3981. https://doi.org/10.1109/tgrs.2017.2685945

    Article  Google Scholar 

  • Xiao Z, Long Y, Li D, Wei C, Tang G, Liu J (2017) High-resolution remote sensing image retrieval based on CNNs from a dimensional perspective. Remote Sens 9:725

    Article  Google Scholar 

  • Xie S, Girshick R, Dollár P, Tu Z, He K (2017) Aggregated residual transformations for deep neural networks. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, Honolulu, pp 5987–5995. https://doi.org/10.1109/CVPR.2017.634

  • Xu K, Huang S, Cheng G, Song X (2019) A Multi-task learning approach based on convolutional neural network for acoustic scene classification. In: Proceedings of the 2019 2nd International Conference on Algorithms, Computing and Artificial Intelligence. Association for Computing Machinery, Sanya, pp 23–27. https://doi.org/10.1145/3377713.3377720

  • Yang Y, Newsam S (2010) Bag-of-visual-words and spatial extensions for land-use classification. In: Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems. Association for Computing Machinery, San Jose, pp 270–279. https://doi.org/10.1145/1869790.1869829

  • Ye F, Zhao X, Luo W, Li D, Min W (2020) Query-adaptive remote sensing image retrieval based on image rank similarity and image-to-query class similarity. IEEE Access 8:116824–116839

    Article  Google Scholar 

  • Zhao B, Zhong Y, Xia G, Zhang L (2016) Dirichlet-derived multiple topic scene classification model for high spatial resolution remote sensing imagery. IEEE Trans Geosci Remote Sens 54:2108–2123. https://doi.org/10.1109/tgrs.2015.2496185

    Article  Google Scholar 

  • Zhou W, Shao Z, Diao C, Cheng Q (2015) High-resolution remote-sensing imagery retrieval using sparse features by auto-encoder. Remote Sens Lett 6:775–783

    Article  Google Scholar 

  • Zhou W, Newsam S, Li C, Shao Z (2017) Learning low dimensional convolutional neural networks for high-resolution remote sensing image retrieval. Remote Sens 9:489

    Article  Google Scholar 

  • Zhou W, Newsam S, Li C, Shao Z (2018) PatternNet: a benchmark dataset for performance evaluation of remote sensing image retrieval. ISPRS J Photogramm Remote Sens 145:197–209. https://doi.org/10.1016/j.isprsjprs.2018.01.004

    Article  Google Scholar 

  • Zou Q, Ni L, Zhang T, Wang Q (2015) Deep learning based feature selection for remote sensing scene classification. IEEE Geosci Remote Sens Lett 12:2321–2325. https://doi.org/10.1109/lgrs.2015.2475299

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the PatternNet, NWPU45 and other datasets for their open access. The authors also would like to thank the editors and the anonymous reviewers for their constructive comments and suggestions.

Funding

This work was supported in part by Yunnan Fundamental Research Projects under Grant 202001AS070032, and in part by the National Natural Science Foundation of China under Grant 41801308, and in part by the National Key Research and Development Program of China under Grant 2018YFB0505002.

Author information

Authors and Affiliations

  1. School of Geosciences and Info-Physics, Central South University, Changsha, 410083, People’s Republic of China

    Dongyang Hou & Siyuan Wang

  2. School of Surveying and Geo-Informatics, Shandong Jianzhu University, Jinan, 250101, People’s Republic of China

    Huaqiao Xing

Authors
  1. Dongyang Hou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Siyuan Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Huaqiao Xing
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Huaqiao Xing.

Ethics declarations

Conflict of interest

No potential conflict of interest was reported by the authors.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hou, D., Wang, S. & Xing, H. A novel benchmark dataset of color steel sheds for remote sensing image retrieval. Earth Sci Inform 14, 809–818 (2021). https://doi.org/10.1007/s12145-021-00593-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12145-021-00593-7

Keywords

Search

Navigation