Login / Signup

PYTAF: A Python Tool for Spatially Resampling Earth Observation Data.

Guangyu ZhaoMuqun YangYizhao GaoYizhe ZhanH Joe LeeLarry Di Girolamo
Published in: Earth science informatics (2020)
Earth observation data have revolutionized Earth science and significantly enhanced the ability to forecast weather, climate and natural hazards. The storage format of the majority of Earth observation data can be classified into swath, grid or point structures. Earth science studies frequently involve resampling between swath, grid and point data when combining measurements from multiple instruments, which can provide more insights into geophysical processes than using any single instrument alone. As the amount of Earth observation data increases each day, the demand for a high computational efficient tool to resample and fuse Earth observation data has never been greater. We present a software tool, called pytaf, that resamples Earth observation data stored in swath, grid or point structures using a novel block indexing algorithm. This tool is specially designed to process large scale datasets. The core functions of pytaf were implemented in C with OpenMP to enable parallel computations in a shared memory environment. A user-friendly python interface was also built. The tool has been extensively tested on supercomputers and successfully used to resample the data from five instruments on the EOS-Terra platform at a mission-wide scale.
Keyphrases
  • electronic health record
  • big data
  • public health
  • data analysis
  • machine learning
  • deep learning
  • multidrug resistant
  • climate change
  • single cell
  • rna seq
  • low cost