240 likes | 335 Views
CUAHSI. Crossing the Digital Divide. Presented by: Fernando R. Salas David Maidment , Enrico Boldrini , Ben Domenico , Stefano Nativi CUAHSI Conference on Hydrologic Data and Information Systems Logan, Utah April 22, 2011. Introduction and Motivation.
E N D
CUAHSI Crossing the Digital Divide Presented by: Fernando R. Salas David Maidment, Enrico Boldrini, Ben Domenico, Stefano Nativi CUAHSI Conference on Hydrologic Data and Information Systems Logan, Utah April 22, 2011
Introduction and Motivation Source: Iowa State University Department of Natural Resource Ecology and Management
What is the Digital Divide? Climate Observations and Grids Observations and Time Series Geographic Information Systems (GIS) Remote Sensing
Interoperability Challenges Observations Data Gridded Data Measures variables over a continuous space-time domain Stored in large multi-dimensional arrays in specialized formats • Measures variables over a discrete space-time domain • Stored in tables, relational databases and geodatabases How can we connect these very different worlds together?
Observations Data Information Model • Data Source • United States Geological Survey (USGS) • Network • National Water Information System – Unit Values • Sites • Colorado River at Austin • Variables • Streamflow • Values • 2,500 cfs at 8:30 am on • June 19th, 2011
Gridded Data Information Model • Data Source • National Climatic Data Center (NCDC) • Dataset • North American Regional Reanalysis (NARR) • Grid Size • 32 kilometer • Variables • Temperature • Values • 78 deg. Fahrenheit • at 8:00 am on • June 15th, 2000 NARR Time 1
Data Cube Time {t} Time {t} Space {x,y} Space {x,y,z} Variable {vi} Variable {vi}
THREDDS Data Servers WCS NetCDF HTTP OpenDAP WMS
Distributed File Sharing Systems Enables users to access large quantities of gridded data using standardized data services Source: http://www.esrl.noaa.gov/thredds/catalog/Datasets/NARR/catalog.html
Building a Series Catalog for Observations Data Datacart – a collection of data series organized thematically • Observations Metadata Catalog • Source • Site Name • Location (Lat/Long) • Variable Name • Variable Units • Concept • Start Date • End Date • WaterML URI WFS WFS
Building a Series Catalog for Gridded Data Datacart – a collection of data series organized thematically • Observations Metadata Catalog • Source • Coverage Name • Location (Lat/Long Box) • Variable Name • Variable Units • Concept • Start Date • End Date • WCS URI WFS WFS WFS WFS
Building a Catalog of Services CSW Time Series Raster Series WaterML NetCDF THREDDS Servers WFS WFS HydroServers
Services Stack Framework CSW CSW WFS WFS SOS WCS • Catalog Services for the Web (CSW) enable metadata services describing observations data to be registered in a catalog of services. • Web Feature Services (WFS) enable data services to be completely described by metadata in a series catalog. • Sensor Observation Services (SOS) and Web Coverage Services (WCS) enable observations and climate data to be conveyed through the internet in a standardized manner. Catalog Catalog Metadata Metadata Data Data Services Services
One Common Ontology Streamflow Cloud Cover Turbidity Snow Precipitation Precipitation Precip Rainfall Rain Total Precip Precip Rainfall Rain Total Precip CUAHSI Ontology
HydroPortal – A Catalog Service Geoportal Extension of ArcGIS implements Catalog Services for the Web (CSW) …enables data discovery across multiple data sources and types…
GI-cat Service Broker Courtesy of Enrico Boldrini from the Earth and Space Science Informatics Lab • GI-cat broker catalog mediation/adaptation solution • Standard based solution • Support to several international and community standards, including THREDDS, WCS, WFS, CSW. • Support to several standard discovery interfaces, including CSW 2.0.2 AP ISO, OpenSearch • Successful harvesting of more than 400,000 resources
Bind Order Find Publish Service Consumer Client A SOA Broker/Mediator component Service Registry Harvest Service Provider Bind Server Protocol sharing Service Broker Courtesy of Enrico Boldrini from the Earth and Space Science Informatics Lab Mediator
Service Consumer Client Service Providers GI-cat Broker/Mediation component Registry Processing capability Local Repository/Cache WPS OpenModeller INSPIRE portal Discovery capability Harvest CSW ISO CSW-Core GeoNetwork CSW client GI-cat Service Broker / Mediator OpenSearch CSW ebRIM GBIF CSW/ebRIM-EO ArcGIS Explorer CSW client CSW-ISO Inventory capability THREDDS/OPeNDAP CDI • Functions: • Mediation • Distribution • Messaging • Persistence • Access • ..... GEO portal WCS WMS WFS ESA-HMA portal CSW-EBRIM CIM/EO Access capability WMS WCS WFS Web browser GBIF THREDDS/OPeNDAP OpenSearch Mediator Courtesy of Enrico Boldrini from the Earth and Space Science Informatics Lab Server
Interoperability Enabled by Standard Web Services CSW Data Services Catalog Services CSW HydroCatalog THREDDS Servers HydroServers
Hydrometeorologic Information System WFS CSW SOS WCS