FEP - Format Use by a Project - Upper Atmosphere Research Satellite Particle Environment Monitor (UARS/PEM) - IDFS

1. Format (Format System) Identification

IDFS V2.1

2. Data Model Extensions by Project

None.

3. Original Format Selection Rationale

Store data from multiple missions and instruments in a common form to allow easy analysis and prevent reprocessing.

4. Data Types

Data in the following formats have been placed under IDFS Level 0, Level 1A, Level 1B, Ground-based and Higher level physical parameter data

Object Types include Images, Spectra, Time Series, Multi-variate distributions, and tensors.

5. Support

IDFS development group at SwRI

6. Project Software

All analysis tools (SDDAS) provided by SwRI. Includes an API library for extracting data.

7. Experience

Advantage : self-documenting, network transportable, stable standardized data environment.

Negative/Postitive Since the format requires certain types of meta-data, a complete understanding of the data set is necessary before storing data in this format.

At the project level, detailed documentation and control must be established and maintained. This allows general users of any skill level to have access to high-resolution, scientifically calibrated data with minimal overhead.

The IDFS files are created automatically as part of the production processing at GSFC. The ingest operation into the PEM archive at SwRI is equally automatic, with occasional manual actions needed to handle some types of errors.

8. Desired Functions

Tensor storage/operations within the SCF environment.

9. Selection Criteria

Ability to maintain data at all levels with full reversibility of necessary levels. Why? Cost and improvement in science.

10. Handling Plans for Format Evolution

This will be handled by the API library. Unrecognized extensions within future versions of the format are simply ignored by older versions of the API library.

11. Other Comments

Wider Views