Parallel Geospatial Raster Data I/O Using File View

Wei XIONG; Ye WU; Luo CHEN; Ning JING

doi:10.1587/transinf.2015PAL0001

Special Section on Parallel and Distributed Computing and Networking

Parallel Geospatial Raster Data I/O Using File View

Wei XIONG, Ye WU, Luo CHEN, Ning JING

Author information

Keywords: parallel I/O, geospatial raster, file view, MPI

JOURNAL FREE ACCESS

2015 Volume E98.D Issue 12 Pages 2192-2195

DOI https://doi.org/10.1587/transinf.2015PAL0001

Details

Abstract

The challenges of providing a divide-and-conquer strategy for tackling large geospatial raster data input/output (I/O) are longstanding. Solutions need to change with advances in the technology and hardware. After analyzing the reason for the problems of traditional parallel raster I/O mode, a parallel I/O strategy using file view is proposed to solve these problems. Message Passing Interface I/O (MPI-IO) is used to implement this strategy. Experimental results show how a file view approach can be effectively married to General Parallel File System (GPFS). A suitable file view setting provides an efficient solution to parallel geospatial raster data I/O.

Corresponding author

Register with J-STAGE for free!