Real-time continuous feature extraction in large size satellite images
Introduction
Digital image processing is becoming a hot topic these days because of its various applications in security, medical healthcare, agriculture, entertainment and fun, area monitoring, etc. Digital image processing is the use of computer algorithms on digital images to perform image processing. This technology is widely used for the image morphology, feature extraction, segmentation, rendering, and pattern recognition [1], [2], [3], [4] and many other digital image operations. Various research also works on image processing aspect of H264/AVC [5], [6], [7], [8], [9] such as, in edge detection, deblocking filter, and motion estimation in H264/AVC. Moreover, Feature extraction is the most widely used part of the image processing that can be used for many application such as, security and authentication, object detection, and pattern matching, etc. In practice, two types of feature extraction (feature selection) methods are used, i.e., type I and type II. Type I feature extraction methods mainly focus on the finding of original parameters from the scratch for feature extraction while type II feature extraction method is used to optimize the accuracy of a feature set by removing inconsistent features [10] by given set of features. Also, Type II also used to discover a subset of features associated with optimal identification accuracy [11]. Simpson et al. do well at this in the article Genetic & Evolutionary Type II feature extraction for periocular-based biometric recognition [12].
Remotely sensed imagery is being increasingly used for the development of the earth observation satellites to investigate human activities, to monitor environmental changes and to update existing geospatial data [1], [13]. The ordinary pictures are difficult to process automatically by computers but can be easily interpreted by humans. The most significant step is how to get anticipated information from the images and how to convert these images into useful data for different further studies. Moroever, the processing of larger size images or large datasets of thousands of satalite images in an efficient manner is also a key challenge [14].
The continuous features extraction such as roads, river, and highways detection through satellite image is very valuable and efficient for most of the urban planning application. Very few work has been done in the field of continuous natured feature extraction using satellite image processing. The painted lane markings that exist in the most urban roads, in campus sites or in the comparable environments of the theme parks, industrial estates and science parks may not be easily discernible by closed-circuit television (CCTV) cameras because of bad weather conditions, poor lighting and insufficient maintenance. Similar is the case with the river as well. The existence of pavements or curbs is the important feature of roads or rivers on either side defining the boundaries. For the implementation of autonomous navigation or driver assistance systems, the curbs that are parallel to the roads can be harnessed to extort useful features of the roads.
Due to the fact that the use of vision image data is a difficult task for the extraction of the curbs or features of the road edge as curbs are not perceptible in the vision image. Favorable and heuristic lighting and extensive image processing requires to extract the curbs from the camera image. A laser range measurement system is one of the favorable for obstacle detection and depth range measurement under poor lighting, bad weather condition with its best features of the low cast of an alternative to millimeter wave radar system. The significant rise has been observed in the use of laser range measurement system for an autonomous navigation task in the past several years [15], [16], [17], [18], [19], [20], [21], [22]. However, the major domain of their use has been in indoor environments [17], [18], [19], [20], [21], [22]. Laser range measurements systems have found some of the common tasks of obstacle detection [15], [16], map building [21], [22], navigation [17], [18], and localization [19], [20].
However, to keep the properties of rivers in mind, they are long in length and geometrically smooth. These particular attributes can give advantages to most algorithm to construct a river network. River finding, river tracking, and river linking are three typical stages of river extraction. To search the potential river pixels, this methodology is set with in a river window. When creating consecutive river points, the local properties like magnitude and direction are accounted. Continuous and smooth groups of river seeds are linked together to produce different lengths of segments once the river points are found. Finally, the river segments with longer length are selected as a piece of river in the river linkage stage to form a river network.
Therefore, based on the aforementioend needs, this paper presents an efficient mechanism that detects the continuous features in the images (such as river) using statistical computations, Euclidean distance, and machine learning approaches. To gain the more efficiency of the system, the system is implemented on the parallel environment of Hadoop server. The Hadoop has distributed file system, i.e., HDFS and distributed programming language MapReduce, which have the capability to process large size and a large amount of images using parallel tasking on the same dataset. Moreover, the proposed system divides the whole process into various steps to increase the efficiency of the detection mechanism, which includes collection and filtration, segmentation, processing, and merging.
The rest of the paper describes the background and related work in Section 2. Section 3 demonstrates the details of the datasets used for analysis and tested. Section 4 presented the analysis and discussion based on which the proposed system is developed. The proposed system details are given in Section 5. While the evaluation is done in Section 6. Finally, the conclusion is made in Section 7.
Section snippets
Background and related work
Remote sensing technology has opened a new way of the data collection era. Automated image processing has reduced human labor and became a desired outcome to increase the efficiency of extracting information. Roads are the one of the most critical components of the landscape while considering continuous feature extraction. That is why automated road extraction from remotely sensed imaginary has become a vigorous research topic.
In the past two decades, a variety of road extractions approaches
Dataset and tools used for analysis and evaluation
Datasets are taken from European Space Agency (ESA) [37] for analysis and testing that contain various earth observatory satellite products by monitoring different locations on earth. Two main satellite sensors' data, i.e., Advanced Synthetic Apertures Radar (ASAR) and medium resolution imaging spectrometer (MERIS), of ENVISAT mission, is taken for analysis as shown in Table 1. ENVISAT was working and monitoring Earth from approximately 800 km above the surface [38]. Different types of products
Image analysis for continues feature extraction
The main focus of the analysis is on ENVISAT/ASAR EO products especially Product1 since ASAR Product1 has more and diverse nature of Rivers as well as diverse covered areas, such as, Sea, and small lakes, city, etc. Initially, the satellite image data is taken from Measurement Dataset (MDS) portion of the product. Keeping in view the continuous behavior of the Rivers, statistical analysis, and pixel value distribution is made for exploring the properties, pattern and behavior of Rivers in the
Proposed system
Based on the exploration and analysis made in the previous section on earth observatory images, a system is proposed to extract the continuous features, especially rivers exist in the earth observatory satellite images. The proposed system includes the complete implementation model and the algorithm. The proposed system contains various phases including data collection, filtration, segmentation, processing, merging, and the interpretation. The implementation model is depicted in Fig. 3, which
Evaluation
We evaluate our system with respect to the algorithm computational complexity, accuracy, and the most important, the efficiency with respect to average processing time and throughput.
Conclusion
In this paper, continuous features extraction mechanism from satellite images is proposed by taking the river as a continuous feature. The River detection within satellite images is performed by using proposed implementation model. The implementation model has various units and phases including collection, filtration, segmentation, computation, processing, merging and interpretation. The algorithm proposed is based on segmentation, statistical computation, machine learning and the Euclidean
Acknowledgment
This work was supported in part by the Brain Korea 21 Plus Project (SW Human Resource Development Program for Supporting Smart Life) funded by Ministry of Education, School of Computer Science and Engineering, Kyungpook National University, Korea under Grant 21A20131600005, and in part by the Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIP). [No. 10041145, Self-Organized Software platform (SoSp) for Welfare Devices]
Muhammad Mazhar Ullah Rathore received the Master's degree in computer and communication security from the National University of Sciences and Technology, Islamabad, Pakistan, in 2012, and is currently pursuing the Ph.D. degree at Kyungpook National University, Daegu, Korea. His research interests include Big Data analytics, network traffic analysis and monitoring, intrusion detection, and computer and network security.
References (40)
- et al.
3D terrain real-time rendering method based on CUDA-OpenGL interoperability
IETE Technical Review ahead-of-print
(2015) - et al.
Morphological dilation image coding with context weights prediction
Signal Process. Image Commun.
(2010) - et al.
Note: finding road seeds in aerial images
CVGIP: Image Underst.
(1993) - et al.
Detection of roads and linear structures in low resolution aerial imagery using a multisource knowledge integration technique
Comput. Graph. Imaging Process.
(1981) - et al.
Road extraction from aerial and satellite images by dynamic programming
ISPRS J. Photogramm. Remote Sens.
(1995) - et al.
Extracting urban features from LiDAR digital surface models
Comput. Environ. Urban Syst.
(2000) A game theory-based block image compression method in encryption domain
The Journal of Supercomputing
(2015)- et al.
A Partition-based active contour model incorporating local information for image segmentation
Sci. World J.
(2014) High performance adaptive deblocking filter for H.264/AVC
IETE Tech. Rev.
(2013)- et al.
Gradient-based edge detection for motion estimation in H.264/AVC
IET Image Process.
(2011)
Region similarity based edge detection for motion estimation in H.264/AVC
IEICE Electron. Express
Intensity gradient technique for efficient intra prediction in H.264/AVC
Projection based adaptive window size selection for efficient motion estimation in H.264/AVC
IEICE Trans. Fundam. Electron. Commun. Comput. Sci.
All iris code bits are not created equal
GEFE: genetic & evolutionary feature extraction for periocular-based biometric recognition
Genetic & evolutionary type II feature extraction for periocular-based biometric recognition
Change detection in synthetic aperture radar image based on fuzzy active contour models and genetic algorithms
Math. Prob. Eng.
Real-time bid data analytical architecture for remote sensing application
IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens.
Obstacle avoidance perception processing for the autonomous land vehicle
Natural terrain hazard detection with a laser rangefinder
Cited by (22)
A two-fold transformation model for human action recognition using decisive pose
2020, Cognitive Systems ResearchCitation Excerpt :There is a number of robust features used for understanding and tracking of objects. In (Rathore et al., 2016), a real-time approach is developed, which uses the continuous features for detection of rivers, road, and highways in satellite images. A depth dataset based HAR is developed that utilizes the dense RGB-D Map features (Farooq et al., 2015) and this approach is very reliable for a various realistic scene.
Series in remote sensing: Telegeoprocessing
2023, Series in Remote Sensing: TelegeoprocessingState of the Art: High-Performance and High-Throughput Computing for Remote Sensing Big Data
2022, IEEE Geoscience and Remote Sensing MagazineSupMPN: Supervised Multiple Positives and Negatives Contrastive Learning Model for Semantic Textual Similarity
2022, Applied Sciences (Switzerland)Change Detection Flood Water Mapping from Remotely Sensed Images- A survey
2022, International Conference on Sustainable Computing and Data Communication Systems, ICSCDS 2022 - ProceedingsA Fast Defogging Image Recognition Algorithm Based on Bilateral Hybrid Filtering
2021, ACM Transactions on Multimedia Computing, Communications and Applications
Muhammad Mazhar Ullah Rathore received the Master's degree in computer and communication security from the National University of Sciences and Technology, Islamabad, Pakistan, in 2012, and is currently pursuing the Ph.D. degree at Kyungpook National University, Daegu, Korea. His research interests include Big Data analytics, network traffic analysis and monitoring, intrusion detection, and computer and network security.
Awais Ahmad (S'14) received the B.S. degree (CS) from the University of Peshawar, Peshawar, Pakistan, and the M.S. degree (telecommunication and networking) from Bahria University, Islamabad, Pakistan, in 2008 and 2010, respectively. Currently, he is pursuing the Ph.D. degree at Kyungpook National University, Daegu, Korea. During his research work, he worked on energy efficient congestion control schemes in Mobile Wireless Sensor Networks (WSN). There he got research experience on Big Data analytics, machineto- machine communication, and wireless sensor network. Mr. Ahmad was the recipient of three prestigious awards: (1) Research Award from President of Bahria University Islamabad, Pakistan in 2011 (2) best Paper Nomination Award in WCECS 2011 at UCLA, USA, and (3) best Paper Award in 1st Symposium on CS&E, Moju Resort, Korea, in 2013.
Anand Paul (SM'15) received the Ph.D. degree in electrical engineering from the National Cheng Kung University, Tainan, Taiwan, in 2010. He is currently working as an Associate Professor with the School of Computer Science and Engineering, Kyungpook National University, Daegu, Korea. He is a delegate representing Korea for M2M focus group and for MPEG. His research interests include algorithm and architecture reconfigurable embedded computing. Prof. Paul has Guest Edited various international journals and he is also part of Editorial Team for Journal of Platform Technology and Cyber Physical Systems. He serves as a Reviewer for various IEEE/IET journals. He is the track Chair for smart human computer interaction in ACMSAC 2015, 2014. He was the recipient of the Outstanding International Student Scholarship Award in 2004–2010, the Best Paper Award in National Computer Symposium, Taipei, Taiwan, in 2009, and International Conference on Softcomputing and Network Security, India, in 2015.
Jiaji Wu is a professor at Xidian University, Xi'an, China. He received the B.S. degree in electrical engineering from Xidian University, Xi'an China, in 1996, the M.S. degree from National Time Service Center (NTSC), the Chinese Academy of Sciences in 2002, and the Ph.D. degree in electrical engineering from Xidian University in 2005.