1 / 8

Storing EOS data using HDF5 Archival Information Package(AIP)

Storing EOS data using HDF5 Archival Information Package(AIP). MuQun Yang The HDF Group Ruth Duerr NSIDC. Overview. NOAA Scientific Data Stewardship(SDS) program Operational production of high quality Climate Data Records

doli
Download Presentation

Storing EOS data using HDF5 Archival Information Package(AIP)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Storing EOS data using HDF5 Archival Information Package(AIP) MuQun Yang The HDF Group Ruth Duerr NSIDC HDF and HDF-EOS Workshop XI, Landover, MD

  2. Overview • NOAA Scientific Data Stewardship(SDS) program • Operational production of high quality Climate Data Records - “Generation of CDR context capable of surviving transformative migration” • NOAA CLASS may archive EOS2 data as well as future NPOESS HDF5 data • One year project • Collaboration between THG and NSIDC HDF and HDF-EOS Workshop XI, Landover, MD

  3. Goals • An alternative solution to long-term archiving EOS2 data • Provide openly available tools to convert ECS metadata into FGDC compliant forms HDF and HDF-EOS Workshop XI, Landover, MD

  4. HDF5 Archive Information Package Data file HDF5 METS Metadata file Primary SchemaExtension Schema |<mets> |---<dmdSec>----------------<MODS> |---<amdSec>--------------|--<techMD> | |--<rightsMD> | |--<sourceMD> |----<fileGrp> |----<structMap> HDF5 AIP Components http://www.hdfgroup.uiuc.edu/papers/papers/AIP/HDF5_AIP_White_Paper.pdf HDF and HDF-EOS Workshop XI, Landover, MD

  5. Scientific Datatypes Point Trajectory Station Profile Radial Grid Swath Common Data Model Layers Coordinate Systems Data Access HDF and HDF-EOS Workshop XI, Landover, MD

  6. CDM/NetCDF4 NMMR NCDC:CLASS ECS to NMMR HDF5-AIP NSIDC/ECSMetadata NetCDF4 / HDF5 Data METS ECS to METS NSIDC/ ECS HDF4-data H4toH5 NetCDF4/HDF5-data

  7. Deliverables • Three conversion tools • Enhanced HDF4 to HDF5 conversion tool • ECS to METS metadata extraction tool • ECS system to NMMR conversion tool • Tool tests • Final report HDF and HDF-EOS Workshop XI, Landover, MD

  8. Acknowledgement • This work was supported under NOAA Scientific Stewardship Program grant number NA07OAR4310286. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of NOAA.  HDF and HDF-EOS Workshop XI, Landover, MD

More Related