1 / 104

CEOS IDN Task Team

CEOS IDN Task Team. Chiang Mai, Thailand May 17, 2003. IDN Agenda. Minutes from Toulouse, France May 2003 http://idn.ceos.org/IDN/Meetings/2003_05_Toulouse IDN Reports Keyword Update Process for adopting DIF Changes Status of DIF Proposals Thesaurus Semantic Web

tyler
Download Presentation

CEOS IDN Task Team

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. CEOS IDN Task Team Chiang Mai, Thailand May 17, 2003

  2. IDN Agenda • Minutes from Toulouse, France May 2003 http://idn.ceos.org/IDN/Meetings/2003_05_Toulouse • IDN Reports • Keyword Update • Process for adopting DIF Changes • Status of DIF Proposals • Thesaurus • Semantic Web • IDN Tools and Software Update • MD8, MD9, DocBuilder • Discussion/Issues

  3. Minutes from Toulouse • IDN Reports (4 presentations, 2 written) • ISO 19115 Update • Updated controlled keywords • DIF Modification Proposals • Enhanced Project Description • MD8 Report from UNEP • MD8 operations and testing • Efforts with PostgresSQL • MD9 Update

  4. IDN Reports

  5. Status at the American Coordinating Node

  6. New DIFs January 1999 - August 2003

  7. DIF Population by Earth Science Topic

  8. DIF Population by Node

  9. GCMD Usage by Domain TypeJanuary 1999 - August 2003

  10. Unique Hosts by DomainComparison of 2000, 2001 and 2002

  11. # Web Page Hits Since January 2001

  12. Searches by Controlled Keyword

  13. GCMD Portals to Community-focused Data Global Change Master Directory DODS

  14. http://gcmd.nasa.gov/Data/portal_index.html • The index of all of the Portals created by GCMD are available online from the portal index. • Portal visibility will be improved with link to portals from the GCMD homepage (currently the link is available only via the GCMD sitemap). Portal Index

  15. New Portals This Past Year • National Center for Atmospheric Research • World Water Forum • Remote Sensing for Conservation Portal • United Nations Earth Science Data • Antarctic Master Directory • Finland • Belgium • Argentina

  16. IDN/CEOS-GRID Activities • Participate on the CEOS/GRID Catalog Tiger Team • Potential CEOS/GRID Collaborations • Directory search across CEOS/GRID databases • Use of IDN controlled keyword hierarchy • Mapping of IDN DIF fields to core ISO 19115 fields as a minimum set of metadata elements

  17. IDN Agency Reports

  18. Keyword Update

  19. New Earth Science Parameter Keywords • 47 New Earth science keywords suggested by the Global • Observing System Information Center (GOSIC) • (comprising the GOOS, GTOS and GCOS) • These new keywords were mapped to existing • GCMD/IDN keywords. Although not all of the suggested • keywords were adopted, some reorganization • of existing keywords resulted in new and modified keywords

  20. New Earth Science Parameter Keywords TOPIC keyword Radiance or Imagery will be restructured to Engineering/Spectral Measurements To accommodate engineering and level 0 raw data measured from satellites and other remote sensing platforms A new TERM under this TOPIC will be: Engineering/Spectral > Spectral Measurements > Acoustic Waves

  21. New Earth Science Parameter Keywords New Glaciers/Ice Sheets TERM and variables Cryosphere > Glaciers/Ice Sheets > Ablation Zones/Accumulation Zones Cryosphere > Glaciers/Ice Sheets > Icebergs Cryosphere > Glaciers/Ice Sheets > Glacier Facies Cryosphere > Glaciers/Ice Sheets > Glacier Mass Balance/Ice Sheet Mass Balance Cryosphere > Glaciers/Ice Sheets > Glacier Thickness/Ice Sheet Thickness Cryosphere > Glaciers/Ice Sheets > Glacier Topography/Ice Sheet Topography Cryosphere > Glaciers/Ice Sheets > Glacier Elevation/Ice Sheet Elevation Cryosphere > Glaciers/Ice Sheets > Glacier Motion/Ice Sheet Motion

  22. New Earth Science Parameter Keywords New Soils Keywords Land Surface > Soils > Micronutrients/Trace Elements Land Surface > Soils > Heavy Metals Land Surface > Soils > Microfauna Land Surface > Soils > Microflora Land Surface > Soils > Macrofauna Land Surface > Soils > Soil Rooting Depth Land Surface > Soils > Soil Erosion Land Surface > Soils > Soil Infiltration Note: Also applies to TOPIC Agriculture > Soils

  23. New Earth Science Parameter Keywords New Biosphere keywords: Biosphere > Ecological Dynamics > Habitat Biosphere > Ecological Dynamics > Indicator Species Biosphere > Ecological Dynamics > Biodiversity

  24. New Earth Science Parameter Keywords Additional new keywords Atmosphere > Atmospheric Radition > Incoming Solar Radiation Hydrosphere > Water Quality/Water Chemistry > Water Potability

  25. Keyword Citation GCMD will be providing a citation that we kindly request should be used by organizations and agencies that use the IDN keywords • Many groups have adopted the keywords • It is important to know how they are being used so agencies and be informed of updates • GCMD science coordinators put a lot of effort and expertise in choosing scientifically accepted terminology

  26. Changes to the IDN DIF Standard

  27. Proposals to Modify the DIF Structure • Through Formal Standard: ISO 19115 compatibility • Through CEOS IDN Interoperability Group • Current examples • Numerical Model Field Data Set • Spatial/Temporal Resolution • Advantages • More flexible for specified purposes beyond ISO. • Faster turnaround time for implementation.

  28. DIF Changes and the Interoperability Process • Anyone can request a change to the DIF format • The proposal is circulated on the interop mailing list (interop@gcmd.gsfc.nasa.gov) • Based on comments and feedback the proposal may be modified and resubmitted • A vote is requested by the Interop Voting Committee

  29. DIF Proposals • A proposal passes with a majority vote • Results of the vote are conveyed to the interop list • Prioritization, scheduling, and completion of software changes are dependent on the resources of participating members.

  30. Interop Voting Committee • Andrea Buffam (CCRS/GeoConnections) Andrea.Buffam@ccrs.nrcan.gc.ca • Cheryl Solomon (USGS/BRD/GCMD) Cheryl_Solomon@gcmd.nasa.gov • Jolyon Martin (ESA) jolyon.martin@esa.int • Lee Belbin (JCADM) Lee.Belbin@aad.gov.au • Osamu Ochai (NASDA) ochiai.osamu@nasda.go.jp • Lyne Yohe (NSIDC) yohe@nsidc.org • Victor Pusztai (UNEP GRID-Budapest) pusztai@mail5.ktm.hu • Lorant Czaran (UNEP) czaran@grida.no • Sherry Harrison (GHRC) sherry.harrison@msfc.nasa.gov

  31. Proposals to Modify the DIF Structure • ISO 19115 compatibility • Numerical Model Field • Data Set Spatial/Temporal Resolution

  32. DIF/ISO Conversion(Fields that need attention) ISO DIF Category>Topic > Term > Variable: Earth Science > Biosphere > Ecological Dynamics > Population ISO Topic Category: farming, biota, boundaries, climatologyMeteorologyAtmosphere, economy, elevation, environment, geoscientific information, healthimageryBaseMapsEarthCover, inlandWaters Personnel: Address Personnel: Address, City, State or Province, Zip Code, Country Not currently in the DIF Metadata Standard Format Metadata Standard Version

  33. ISO Topic Categories farming, biota, boundaries, climatologyMeteorologyAtmosphere, economy, elevation, environment, geoscientific information, health, imageryBaseMapsEarthCover, intelligenceMilitary,inlandWaters, location, oceans, planningCadastre, society, structure, transportation, utilitiesCommunication

  34. Summary of Proposal Status Non-controversial proposal to bring the DIF into compliance with the international standard.

  35. Numerical Model Fields Proposed for the DIF • Anne Sophie Archambeau from IPSL, France proposed an • addition to the DIF to handle numerical output data sets: • Group: Numerical_Experiment • Model_Name: • Model_Version: • Model_URL: • Model_Configuration: • Model_Resolution: • Model_Calendar: • Group: Model_Integration_Period • Start_Date: • Stop_Date: • End_Group • Simulation_Name: • Initial_Conditions: • Perturbation: • Imposed_Boundary_Conditions: • End_Group • Interop discussions on the proposed new fields are summarized • in the CEOS IDN Interop Newsletter for April 2003 • (http://gcmd.gsfc.nasa.gov/pipermail/interop/2003-April/000011.html)

  36. Summary of Proposal Status • Received November 18, 2002 • The additional information could be included in the summary • Development schedules do not permit the prioritization of this addition to the database at this time. • Comments will be extended until such time that development schedules might permit the initiation of change • The proposal will be presented to a modeling group in London at the end of September for comment

  37. Data Resolution Proposal Proposal to provide users with the capability of refining GCMD database searches by Geospatial and Temporal Resolution. Proposed DIF Syntax – (Changes inBold) +Group: Data_Resolution Latitude_Resolution: Longitude_Resolution: +Horizonal_Resolution_Range:[choose from the list of geospatial ranges] Vertical_Resolution: +Vertical_Resolution_Range: [choose from the list of vertical resolutions] Temporal_Resolution: +Temporal_Resolution_Range:[choose from the list of temporal resolutions] End_Group

  38. Data Resolution Proposal Valids DIF authors must select from the set of Geospatial (Horizontal) resolution range valids. Horizontal Resolution Range < 1 meter 1 meter - < 30 meters 30 meters - < 100 meters 100 meters - < 1 km 1 km - < 100 km or approximately 0.1 degree - < 1 degree 100 km - < 250 km or approximately 1 degree - < 2.5 degrees 250 km - < 500 km or approximately 2.5 degrees - < 5.0 degrees 500 km - < 1000 km or approximately 5 degrees - < 10 degrees 1000 km or > 10 degrees

  39. Data Resolution Proposal Valids Vertical Resolution refers to both Altitude and Depth resolution. Vertical Resolution Range Temporal Resolution Range Climatology Weekly Climatology Monthly climatology Annual Annual climatology Decadal Climate Normal (30-year climatology) < 1 second 1 second - < 1 minute 1 minute - < 1 hour Hourly Daily Weekly Monthly Hourly Climatology Daily Climatology Pentad < 1 meter 1 meter - < 10 meters 10 meters - < 30 meters 30 meters - < 100 meters 100 meters - < 1 km > 1 km

  40. Data Resolution Proposal Example Example Group: Data_Resolution Latitude_Resolution: 1 meter Longitude_Resolution: 1 meter Horizontal_Resolution_Range: 1 meter - < 10 meters Vertical_Resolution: 5 meters Vertical_Resolution_Range: 1 meter - < 10 meters Temporal_Resolution: Daily Temporal_Resolution_Range: Hourly - < Daily End_Group

  41. Summary of Proposal Status New proposal sent through the Interop

  42. Thesaurus Support when Searching Earth Science Data W.N. Martin, J. C. French (NSF) and A.K. Naidu Department of Computer Science University of Virginia

  43. The Vocabulary Problem • Data is indexed using one set of terms • Searcher casts query using another set of terms • Result: relevant data is overlooked

  44. Objective Assist users in specifying queries when the indexing vocabulary is unknown or unfamiliar. Provide a thesaurus facility to Earth science searchers.

  45. Thesaurus Overview • DLR gave Thesaurus Server in 1998. • Lookup Assistant and Modification Tool by University of Virginia • Dr. Jim French • Dr. Worthy Martin • Amit K. Naidu (student) • Minor server changes have been made.

  46. air contamination air pollutant air pollutants air pollution air-borne contaminants air-borne contamination air-borne contaminations air-pollutants atmospheric impurities atmospheric impurity atmospheric pollutant ... atmospheric pollutants atmospheric pollution contaminated air contaminated atmosphere polluted air polluted atmosphere pollution of the air pollution of the atmosphere urban air urban air pollution urban atmosphere ... global change pollution (4) (6) ... ... ... air pollution (22) food indoor acidification global warming contamination pollution (1) (5) (2) (1) ... ... ... ... ... trace gases air quality (11) (2) ... ... ... ... ... ... carbon aerosols NOx sulfur dioxide monoxide (5) (1) (6) (6) Conceptual Thesaurus Structure Broader Terms (Top Terms) Unrelated Terms Related Terms Narrower Terms

  47. Final Search Results Document Search servlet Saurus.pl (Perl script) Port 6188 ISIS Thesaurus Server Document Database Thesaurus Search Applet Modified Query Port 1521 Oracle Thesaurus Database Demo.cgi (Perl Script) Main Page Thesaurus Architecture

More Related