Elsevier

Journal of Systems Architecture

Volume 64, March 2016, Pages 122-132
Journal of Systems Architecture

Real-time continuous feature extraction in large size satellite images

https://doi.org/10.1016/j.sysarc.2015.11.006Get rights and content

Highlights

  • Real-time continuous feature extraction.

  • Remote sensing.

  • Image processing.

  • Satellite image.

Abstract

Remotely sensed imagery is being increasingly used for the development of the earth observation satellites to investigate human activities, to monitor environmental changes and to update existing geospatial data. The ordinary pictures are difficult to process automatically by computers but can be easily interpreted by humans. The most significant step is how to get anticipated information from the images and how to convert these images into useful data for further studies. The key objective is to satisfy an algorithm claiming to be efficient in large size image processing includ enhanced processing efficiency, finding correlation among data, and extracting continuous features. To achieve these objectives in the setting mentioned above, we propose a real-time approach for continuous feature extraction and detection in remote sensory earth observatory satellite images to find rivers, roads, and main highways. Deep analysis is made on the ENVISAT satellite missions datasets and based on this analysis the algorithm is proposed using statistical measurements, RepTree machine learning classifier, and Euclidean distance. The system is developed using Hadoop ecosystem to improve the efficiency of the system. The designed system consists of various steps including collection, filtration, load balancing, processing, merging, and interpretation. The system is implemented on Apache Hadoop system using MapReduce programming with higher efficiency results in a massive volume of satellite ASAR/ ENVISAT mission datasets.

Introduction

Digital image processing is becoming a hot topic these days because of its various applications in security, medical healthcare, agriculture, entertainment and fun, area monitoring, etc. Digital image processing is the use of computer algorithms on digital images to perform image processing. This technology is widely used for the image morphology, feature extraction, segmentation, rendering, and pattern recognition [1], [2], [3], [4] and many other digital image operations. Various research also works on image processing aspect of H264/AVC [5], [6], [7], [8], [9] such as, in edge detection, deblocking filter, and motion estimation in H264/AVC. Moreover, Feature extraction is the most widely used part of the image processing that can be used for many application such as, security and authentication, object detection, and pattern matching, etc. In practice, two types of feature extraction (feature selection) methods are used, i.e., type I and type II. Type I feature extraction methods mainly focus on the finding of original parameters from the scratch for feature extraction while type II feature extraction method is used to optimize the accuracy of a feature set by removing inconsistent features [10] by given set of features. Also, Type II also used to discover a subset of features associated with optimal identification accuracy [11]. Simpson et al. do well at this in the article Genetic & Evolutionary Type II feature extraction for periocular-based biometric recognition [12].

Remotely sensed imagery is being increasingly used for the development of the earth observation satellites to investigate human activities, to monitor environmental changes and to update existing geospatial data [1], [13]. The ordinary pictures are difficult to process automatically by computers but can be easily interpreted by humans. The most significant step is how to get anticipated information from the images and how to convert these images into useful data for different further studies. Moroever, the processing of larger size images or large datasets of thousands of satalite images in an efficient manner is also a key challenge [14].

The continuous features extraction such as roads, river, and highways detection through satellite image is very valuable and efficient for most of the urban planning application. Very few work has been done in the field of continuous natured feature extraction using satellite image processing. The painted lane markings that exist in the most urban roads, in campus sites or in the comparable environments of the theme parks, industrial estates and science parks may not be easily discernible by closed-circuit television (CCTV) cameras because of bad weather conditions, poor lighting and insufficient maintenance. Similar is the case with the river as well. The existence of pavements or curbs is the important feature of roads or rivers on either side defining the boundaries. For the implementation of autonomous navigation or driver assistance systems, the curbs that are parallel to the roads can be harnessed to extort useful features of the roads.

Due to the fact that the use of vision image data is a difficult task for the extraction of the curbs or features of the road edge as curbs are not perceptible in the vision image. Favorable and heuristic lighting and extensive image processing requires to extract the curbs from the camera image. A laser range measurement system is one of the favorable for obstacle detection and depth range measurement under poor lighting, bad weather condition with its best features of the low cast of an alternative to millimeter wave radar system. The significant rise has been observed in the use of laser range measurement system for an autonomous navigation task in the past several years [15], [16], [17], [18], [19], [20], [21], [22]. However, the major domain of their use has been in indoor environments [17], [18], [19], [20], [21], [22]. Laser range measurements systems have found some of the common tasks of obstacle detection [15], [16], map building [21], [22], navigation [17], [18], and localization [19], [20].

However, to keep the properties of rivers in mind, they are long in length and geometrically smooth. These particular attributes can give advantages to most algorithm to construct a river network. River finding, river tracking, and river linking are three typical stages of river extraction. To search the potential river pixels, this methodology is set with in a river window. When creating consecutive river points, the local properties like magnitude and direction are accounted. Continuous and smooth groups of river seeds are linked together to produce different lengths of segments once the river points are found. Finally, the river segments with longer length are selected as a piece of river in the river linkage stage to form a river network.

Therefore, based on the aforementioend needs, this paper presents an efficient mechanism that detects the continuous features in the images (such as river) using statistical computations, Euclidean distance, and machine learning approaches. To gain the more efficiency of the system, the system is implemented on the parallel environment of Hadoop server. The Hadoop has distributed file system, i.e., HDFS and distributed programming language MapReduce, which have the capability to process large size and a large amount of images using parallel tasking on the same dataset. Moreover, the proposed system divides the whole process into various steps to increase the efficiency of the detection mechanism, which includes collection and filtration, segmentation, processing, and merging.

The rest of the paper describes the background and related work in Section 2. Section 3 demonstrates the details of the datasets used for analysis and tested. Section 4 presented the analysis and discussion based on which the proposed system is developed. The proposed system details are given in Section 5. While the evaluation is done in Section 6. Finally, the conclusion is made in Section 7.

Section snippets

Background and related work

Remote sensing technology has opened a new way of the data collection era. Automated image processing has reduced human labor and became a desired outcome to increase the efficiency of extracting information. Roads are the one of the most critical components of the landscape while considering continuous feature extraction. That is why automated road extraction from remotely sensed imaginary has become a vigorous research topic.

In the past two decades, a variety of road extractions approaches

Dataset and tools used for analysis and evaluation

Datasets are taken from European Space Agency (ESA) [37] for analysis and testing that contain various earth observatory satellite products by monitoring different locations on earth. Two main satellite sensors' data, i.e., Advanced Synthetic Apertures Radar (ASAR) and medium resolution imaging spectrometer (MERIS), of ENVISAT mission, is taken for analysis as shown in Table 1. ENVISAT was working and monitoring Earth from approximately 800 km above the surface [38]. Different types of products

Image analysis for continues feature extraction

The main focus of the analysis is on ENVISAT/ASAR EO products especially Product1 since ASAR Product1 has more and diverse nature of Rivers as well as diverse covered areas, such as, Sea, and small lakes, city, etc. Initially, the satellite image data is taken from Measurement Dataset (MDS) portion of the product. Keeping in view the continuous behavior of the Rivers, statistical analysis, and pixel value distribution is made for exploring the properties, pattern and behavior of Rivers in the

Proposed system

Based on the exploration and analysis made in the previous section on earth observatory images, a system is proposed to extract the continuous features, especially rivers exist in the earth observatory satellite images. The proposed system includes the complete implementation model and the algorithm. The proposed system contains various phases including data collection, filtration, segmentation, processing, merging, and the interpretation. The implementation model is depicted in Fig. 3, which

Evaluation

We evaluate our system with respect to the algorithm computational complexity, accuracy, and the most important, the efficiency with respect to average processing time and throughput.

Conclusion

In this paper, continuous features extraction mechanism from satellite images is proposed by taking the river as a continuous feature. The River detection within satellite images is performed by using proposed implementation model. The implementation model has various units and phases including collection, filtration, segmentation, computation, processing, merging and interpretation. The algorithm proposed is based on segmentation, statistical computation, machine learning and the Euclidean

Acknowledgment

This work was supported in part by the Brain Korea 21 Plus Project (SW Human Resource Development Program for Supporting Smart Life) funded by Ministry of Education, School of Computer Science and Engineering, Kyungpook National University, Korea under Grant 21A20131600005, and in part by the Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIP). [No. 10041145, Self-Organized Software platform (SoSp) for Welfare Devices]

Muhammad Mazhar Ullah Rathore received the Master's degree in computer and communication security from the National University of Sciences and Technology, Islamabad, Pakistan, in 2012, and is currently pursuing the Ph.D. degree at Kyungpook National University, Daegu, Korea. His research interests include Big Data analytics, network traffic analysis and monitoring, intrusion detection, and computer and network security.

References (40)

  • Anand Paul et al.

    Region similarity based edge detection for motion estimation in H.264/AVC

    IEICE Electron. Express

    (2010)
  • An-Chao Tsai et al.

    Intensity gradient technique for efficient intra prediction in H.264/AVC

    (2008)
  • Anand Paul et al.

    Projection based adaptive window size selection for efficient motion estimation in H.264/AVC

    IEICE Trans. Fundam. Electron. Commun. Comput. Sci.

    (2006)
  • P.F.Karen Hollingsworth et al.

    All iris code bits are not created equal

  • J. Adams et al.

    GEFE: genetic & evolutionary feature extraction for periocular-based biometric recognition

  • Simpson Lamar

    Genetic & evolutionary type II feature extraction for periocular-based biometric recognition

  • Jiao Shi et al.

    Change detection in synthetic aperture radar image based on fuzzy active contour models and genetic algorithms

    Math. Prob. Eng.

    (2014)
  • RathoreN.M.U. et al.

    Real-time bid data analytical architecture for remote sensing application

    IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens.

    (2015)
  • T. Dunlay

    Obstacle avoidance perception processing for the autonomous land vehicle

  • HenriksenE. Krotkov

    Natural terrain hazard detection with a laser rangefinder

  • Cited by (22)

    • A two-fold transformation model for human action recognition using decisive pose

      2020, Cognitive Systems Research
      Citation Excerpt :

      There is a number of robust features used for understanding and tracking of objects. In (Rathore et al., 2016), a real-time approach is developed, which uses the continuous features for detection of rivers, road, and highways in satellite images. A depth dataset based HAR is developed that utilizes the dense RGB-D Map features (Farooq et al., 2015) and this approach is very reliable for a various realistic scene.

    • Series in remote sensing: Telegeoprocessing

      2023, Series in Remote Sensing: Telegeoprocessing
    • Change Detection Flood Water Mapping from Remotely Sensed Images- A survey

      2022, International Conference on Sustainable Computing and Data Communication Systems, ICSCDS 2022 - Proceedings
    • A Fast Defogging Image Recognition Algorithm Based on Bilateral Hybrid Filtering

      2021, ACM Transactions on Multimedia Computing, Communications and Applications
    View all citing articles on Scopus

    Muhammad Mazhar Ullah Rathore received the Master's degree in computer and communication security from the National University of Sciences and Technology, Islamabad, Pakistan, in 2012, and is currently pursuing the Ph.D. degree at Kyungpook National University, Daegu, Korea. His research interests include Big Data analytics, network traffic analysis and monitoring, intrusion detection, and computer and network security.

    Awais Ahmad (S'14) received the B.S. degree (CS) from the University of Peshawar, Peshawar, Pakistan, and the M.S. degree (telecommunication and networking) from Bahria University, Islamabad, Pakistan, in 2008 and 2010, respectively. Currently, he is pursuing the Ph.D. degree at Kyungpook National University, Daegu, Korea. During his research work, he worked on energy efficient congestion control schemes in Mobile Wireless Sensor Networks (WSN). There he got research experience on Big Data analytics, machineto- machine communication, and wireless sensor network. Mr. Ahmad was the recipient of three prestigious awards: (1) Research Award from President of Bahria University Islamabad, Pakistan in 2011 (2) best Paper Nomination Award in WCECS 2011 at UCLA, USA, and (3) best Paper Award in 1st Symposium on CS&E, Moju Resort, Korea, in 2013.

    Anand Paul (SM'15) received the Ph.D. degree in electrical engineering from the National Cheng Kung University, Tainan, Taiwan, in 2010. He is currently working as an Associate Professor with the School of Computer Science and Engineering, Kyungpook National University, Daegu, Korea. He is a delegate representing Korea for M2M focus group and for MPEG. His research interests include algorithm and architecture reconfigurable embedded computing. Prof. Paul has Guest Edited various international journals and he is also part of Editorial Team for Journal of Platform Technology and Cyber Physical Systems. He serves as a Reviewer for various IEEE/IET journals. He is the track Chair for smart human computer interaction in ACMSAC 2015, 2014. He was the recipient of the Outstanding International Student Scholarship Award in 2004–2010, the Best Paper Award in National Computer Symposium, Taipei, Taiwan, in 2009, and International Conference on Softcomputing and Network Security, India, in 2015.

    Jiaji Wu is a professor at Xidian University, Xi'an, China. He received the B.S. degree in electrical engineering from Xidian University, Xi'an China, in 1996, the M.S. degree from National Time Service Center (NTSC), the Chinese Academy of Sciences in 2002, and the Ph.D. degree in electrical engineering from Xidian University in 2005.

    View full text