FEP - Format Use by a Researcher - Doug Hunt - NetCDF

1. Format (Format System) Identification

NetCDF

2. Original Motivation

We needed a format to handle many columns of data. We wanted a binary format for speed, and we wanted it to be extensible so we could add new columns when we wanted in a backwards compatible way. We also wanted to use a standard format.

NetCDF has met admirably all the above criteria.

3. Data Types

We use NetCDF to store 'higher level' data output from orbiting GPS receivers. These data are converted to temperature/pressure profiles of the atmosphere.

They are also converted to ionospheric data: total electron count and electron density profiles.

4. Support

UCAR/UNIDATA has provided support when necessary, but little support has been needed.

5. Software

I have worked with the C and FORTRAN interfaces to NetCDF. I have also built a perl/PDL interface to NetCDF. We have also used the MATLAB NetCDF interface.

6. Environment

Our environment is UNIX: Either SUN Solaris, Linux x86 or DEC UNIX. NetCDF works nicely in all these environments.

7. Usage

We read data into MATLAB, perl/PDL and raw FORTRAN from NETCDF.

8. Experience

Quite nice for regular hyperslaps of numbers. Self documenting and straight-forward. Handles metadata well.

9. Desired Functionality

Better handling of irregularly sized arrays (e.g. vectors not all the same size) would be nice.

10. Selection Criteria

Our new project, COSMIC, plans to use NetCDF as well. I would like these qualities:

1. Recognized standard
2. Fast
3. Portable
4. Able to store whatever we need
5. Free, open source

11. Impact on Research

12. Other Comments

Wider Views