[FEP LOGO]  

FEP - Format Use by an Archive - Experimental Space Physics Lab - IDFS

Richard Murphy
Southwest Research Institute
 
Comment on this template in the HyperNews Discussion.  

1. Archive Identification

Southwest Research Institute Experimental Space Physics Laboratory

1.1 Nature of Ingest Activity

Both scenarios are used, dependent upon the data source. UARS/PEM data is as in case 1, most other date is acquired as in case 2.

1.2 Nature of User Community

All of the data maintained in this archive location is intended to be used by the space physics and aeronomy community without expert intervention. A catalog subsystem and data display subsystem is provided for this purpose.

1.3 Nature of Archive

We consider it permanent in the sense that the data will be maintained as long as it might be considered useful by the community.

2. Format (Format System) Identification

IDFS is the format of a majority of the data. There may be small amounts of unconverted telemetry files stored as well, but this data does not show up in the catalog.

3. Format Selection Rationale

It is required before data can be ingested because the archive is built around a set of software tools used to provide quick analysis abilities. There are two archive sites in Europe using the same software/format, so it is useful for data exchange with these archives as well.

4. Roles of Format

Role 3- The catalog/data display system is very useful for many kinds of analysis, which are overlayed on the storage/retrieval functions. The archive is intended to work in a distributed manner and the data analysis software will acquire data from any archive it knows by using the Internet. It is transparent to the user, except for the delay in copying data. This aspect relates to role number 4. Some work has been done to allow data to be exported in both ASCII flat files and CDFs.

Role 5- This was a very important consideration. The archived data does not have to be reprocessed be the level 0 to level X processing is done "on the fly" using metadata within the archive. The metadata can be modified to produce corrections without restoring the raw data.

5. Data Structures Supported

spectra, time series, images

6. Support

Southwest Research Institute supports the format, both through ongoing MO&DA funding from NASA and through other sources of funding.

7. Software

Southwest Data Display and Analysis System (SDDAS) is the primary mechanism of archive usage. This system is rather complex, but it provides many tools useful for examining the particles and fields environment at multiple points in space at a given time.

8. Desired Functions

The major inprovement envisioned involves the transistion of all metadata files to a PVL as opposed to a positional syntax.

9. Other Comments

Like many archives, we are moving towards a Web type interface and the provision of small applets to acquire and display data from the archive

Comment on this template in the HyperNews Discussion.

 

Wider Views

Formats Evolution Process (FEP) Discussion Forums Page
Formats Evolution Process (FEP) Home Page
NASA/Science Office of Standards and Technology (NOST) Home Page

URL: http://ssdoo.gsfc.nasa.gov/nost/fep/archive-espl-idfs.html

A service of NOST at NSSDC.
Access statistics for this web are available.
Comments and suggestions are always welcome.

Author: Richard Murphy / Southwest Research Institute / (richard@swri.org) 210-522-3259
Curator: John Garrett (John.Garrett@gsfc.nasa.gov) +1.301.286.3575
NASA Official: Code 633.2 / Don Sawyer (Don.Sawyer@gsfc.nasa.gov) +1.301.286.2748
Last Revised: 1999-06-22T22:06:33, Richard Murphy (1999-08-04, John Garrett)