240 likes | 475 Views
CEOS ICF. Baseband Data Archive InterChange Format. Stéphane MBAYE GAEL Consultant Stephane.Mbaye@gael.fr. Commitee on Earth Observation Satellites (CEOS) Working Group on Information Systems and Services (WGISS) Meeting Frascati, Italy. Rationale. Document status CEOS ICF - Changes
E N D
CEOS ICF Baseband Data Archive InterChange Format Stéphane MBAYEGAEL ConsultantStephane.Mbaye@gael.fr Commitee on Earth Observation Satellites (CEOS) Working Group on Information Systems and Services (WGISS) Meeting Frascati, Italy
Rationale • Document status • CEOS ICF - Changes • Presentation - “Data Request Broker” (DRB) • Demo – Derby application
Document status • 21/04/2000 – Draft 0 - Creation of the document • 29/08/2000 – Draft 1 - Use of XML Schema instead of DTD • 09/01/2001 – Draft 2 - Includes outputs of Bangkok ATT meeting • 09/04/2001 – Draft 3 – Presented at Sioux Falls (USA) • 23/07/2001 – Draft 4 – Includes outputs of Sioux Falls ATT meeting • 23/08/2001 – Draft 5 – Vega France - Technical proof reading • 06/04/2002 – Draft 6 – ESA-ESRIN - Technical proof reading • 19/04/2002 – GAEL-CEOS-ICF-060.2 – Issue 1, Revision 0
1 <<uriReference>> 1..* <<file>> MetadataFile (XML) <<file>> SignalDataFile (binary) <<basebandUnit>> CEOS ICF Partitioning – Analysis Allows partitioning • For archives biggest than2 Gigabytes • Continuous subsets of a single Baseband Interchange Unit • Free cutting policy Doc. §3.1
ceos_icf subset signal_data subset 1..* 1 signal_data start : dateTime stop : dateTime block 1 block Partitioning – Declaration • New markup: <subset> • Moved attribute: “src” • Updated Naming convention <signal_data> <subset source="ERS-1-1999-03-12T09:38:12.354666-1.dat"/> <subset source="ERS-1-1999-03-12T09:38:12.354666-2.dat"/> <start>1999-03-12T09:37:12.354666</start> <stop> 1999-03-12T09:46:52.223553</stop> <block type=”composite”> … </block> </signal_data> Examples ERS-1-19980225103347732-19980225102345876-1.dat ERS-1-19980225103347732-19980225102345876-2.dat
CEOS ICF Namespace • New XML Namespace: http://wgiss.ceos.org/ceos-icf-20020423 • Proposed XML Schema location: http://wgiss.ceos.org/ceos-icf-20020423.xsd (TBC) • Use of xsd:targetNamespace in the CEOS ICF Schema • Recommend the use of xsi:schemaLocation <ceos_icf xmlns=”http://wgiss.ceos.org/ceos-icf-20020423“ xmlns:xsi=”http://www.w3.org/2001/XMLSchema-instance” xsi:schemaLocation=”http://wgiss.ceos.org/ceos-icf-20020423 http://wgiss.ceos.org/ceos-icf-20020423.xsd”> … </ceos_icf> Doc. §4.1
<<interface>> block name : string name : string type : string type : string offset : positiveInteger offset : positiveInteger length : positiveInteger length : positiveInteger occurrence : positiveInteger Block interface
composite Composite block <block name=”Signal Data Record” type=”composite”> <occurrence>117235</occurrence> <block type=”telemetry_map”> <length>6120</length> <downlink_length>6120</downlink_offset> </block> </block>
telemetry_map downlinkOffset : positiveInteger downlinkOffset : positiveInteger downlinkLength : positiveInteger downlinkLength : positiveInteger property [*] : string property [*] : string Telemetry map
Telemetry map - example <block name=”Channel 1 status” type=”telemetry_map”> <-- Definition within the CEOS ICF Signal Data File --> <offset>2</offset> <length>2</length> <-- Corresponding subset within the telemetry --> <downlink_offset unit=”bit”>200</downlink_offset> <downlink_length unit=”byte”>25</downlink_length> <-- Applied transformations --> <property>pn_decoded</property> <property>compressed</property> <-- Just for example --> </block>
time_stamp facility Facility Timestamp
Timestamp - example <block type=”time_stamp”> <offset>2</offset> <facility> <organization>ESA</organization> <site>FUCINO</site> <country>ITALY</country> <system type="software"> <name>TMFR</name> <release>1.4.0</release> </system> </facility> </block>
quality_flag Quality flag <block type=”quality_flag”> <length unit=”bit”>1</length> </block>
ERS example <signal_data> <subset source="ERS-2-1999-03-12T09:38:12.354666-1999-03-12T09:47:52.223553.1.dat"/> <start>1999-03-12T09:37:12.354666</start> <stop> 1999-03-12T09:46:52.223553</stop> <block name="Signal Data Record" type="composite"> <occurence>6541</occurence> <block name="Frame 0" type="telemetry_map"> <length>253</length> <downlink_offset>3</downlink_offset> <downlink_length>253</downlink_length> </block> <block name="Frame 1-28" type="telemetry_map"> <length>253</length> <occurence>28</occurence> <downlink_offset>259</downlink_offset> <downlink_length>253</downlink_length> </block> </block> </signal_data>
DerbySoftware DRB + extension
DRB architecture Applications XQueryscripts Data Request Broker (DRB) XQuery Engine Facilities Interface Schema XML File SDF HDF Implementations XML Schema Directories& Files XMLdocs HDFfiles Binary files Data sources ENVISAT-PDS Formats Landsat 5/7 CEOS, Fast SPOT 123-4 etc. CEOS ICF SPOT 5 - DIMAP
Application 1 – Sharing knowledge description ESA CAOControl Authority Office Version management ESA + IndustryProcessor design in ground segments Validation, non regression ESA PDCCLong loop Quality Control ENVISAT AATSR XML Schema ENVISAT MERIS XML Schema ESA + IndustryFormat designiterative loop ESA Ground segmentsProduct Quality Control ENVISAT ASAR XML Schema ERS SAR XML Schema Sciences communityMulti-disciplinary approach Other agenciesArchive interchange End usersData display, analysis
CEOS ICF formatGeneric « EO mission » model FRED to CEOS ICF semantic translation CEOS ICF to MDPS semantic translation DOM DOM FRED reader MDPS writer FREDbasebandArchive CEOS ICFinterchangeArchive MDPSbasebandArchive FRED to MDPSsemantic translation FRED reader MDPS writer Application 2 – Towards a generic transcription 1 – Physical + logical transcription
CEOS ICF XML Schema orGeneric « EO mission » model FRED XML Schema MDPS XML Schema FRED to CEOS ICF semantic translation CEOS ICF to MDPS semantic translation DRB / XML DRB / XML DRB / SDF DRB / SDF FREDbasebandArchive CEOS ICFinterchangeArchive MDPSbasebandArchive FRED to MDPSsemantic translation DRB / SDF DRB / SDF Application 2 – Up to a generic transcription 2 - Logical transcription (DRB)
CEOS ICF XML Schema orGeneric « EO mission » model FRED XML Schema MDPS XML Schema Generictranslationengine Generictranslationengine DRB / XML DRB / XML DRB / SDF DRB / SDF FREDbasebandArchive CEOS ICFinterchangeArchive MDPSbasebandArchive Generictranslationengine DRB / SDF DRB / SDF Application 2 – Up to a generic transcription 3 - Generic transcription