https://github.com/jiayuasu/sernetcdf

https://github.com/jiayuasu/sernetcdf

Last synced: about 1 month ago
JSON representation

• Host: GitHub
• URL: https://github.com/jiayuasu/sernetcdf
• Owner: jiayuasu
• License: apache-2.0
• Created: 2017-04-27T08:22:07.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2017-04-27T09:28:24.000Z (over 7 years ago)
• Last Synced: 2024-10-15T18:21:03.572Z (2 months ago)
• Language: Java
• Size: 868 KB
• Stars: 0
• Watchers: 4
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# SerNetCDF

[![Maven Central](https://maven-badges.herokuapp.com/maven-central/org.datasyslab/sernetcdf/badge.svg)](https://maven-badges.herokuapp.com/maven-central/org.datasyslab/sernetcdf)

## Main features

SerNetCDF is a NetCDF/HDF library for GeoSpark. It enables GeoSpark to load and process NetCDF/HDF data.

However, any Hadoop MapReduce or Spark enthusiasts can take this library and process large scale NetCDF/HDF data (of course, it may take you some time to understand all the underlying stuff).

SerNetCDF provides a serializable/deserializable interface for users to access HDF/NetCDF format data. It is a serializable wrapper for the original Unidata NetCDF-java library. 

## Acknowledgement

  

SerNetCDF is a Java Rewrite of SciSpark NetCDFUtils. But SerNetCDF provides some new functions:

1. getDataSym(): get an observation from a symmetric mapping. One observation maps one geo-location.

2. getDataAsym(): get an observation from a asymmetric mapping. One geolocation maps more than one observation. Or, one observation maps more than one geolocation.

3. SerNetCDF doesn't force user to do 2D->1D array transformation. Because observations array does not follow asymmetric mapping, many of the observations are actually not used at all. It is no need to convert them at the beginning. It will directly jump to the desired array cell with O(1) complexity.

4. SerNetCDF considers hdf increment and hdf offset. These two variables control the mapping between geolocations and observations.

## Contact

Jia Yu (jiayu2 at asu dot edu)

Mohamed Sarwat (msarwat at asu dot edu)

## License

SerNetCDF is under Apache License 2.0.