280 likes | 295 Views
This presentation discusses the use of open source GIS tools and web services to disseminate environmental data in Iowa, specifically focusing on the Iowa Environmental Mesonet and its various formats and protocols for data distribution. It also highlights the advantages of using open source solutions, such as transparency and excellent support. The key component, PostGIS, is explained in detail and its role in managing data and GIS metadata is showcased. The presentation concludes by showcasing some of the GIS web apps developed by the Iowa Environmental Mesonet and discussing future work and potential collaborations.
E N D
Iowa Environmental Mesonet: Using Open Source GIS Tools and Web Services to Disseminate Environmental Data Daryl Herzmann Iowa State University 28 Feb 2008 UNI GeoTREE Visit
Data, data, everywhere data 28 Feb 2008 UNI GeoTREE Visit
28 Feb 2008 UNI GeoTREE Visit
The Desperate Challenge The data comprising the IEM is made available to us in the following formats and network protocols. • Disparate Formats – Grib – METAR – Text CSV – Free form text – ADAS III – SHEF – Excel (gasp!) • Disparate Network Protocols – HTTP – FTP – LDM IDD (tcp) – TCP stream – Modems 28 Feb 2008 UNI GeoTREE Visit
Why an Open Source solution? 1. They are the best tools out there. UNIX mentality -> Do something small and do it well. 2. Transparency. We are a public institution doing public funded research. 3. Excellent Support • Public bug trackers • Community forums • IRC • Motivated developers 28 Feb 2008 UNI GeoTREE Visit
Open Source Solution Python Data processing and network services PostGIS / PostgreSQL Spatial Database Map Server Mapping Engine + Scripting GDAL Swiss Army Knife of all things GIS Red Hat Linux Operating System PHP Dynamic Website 28 Feb 2008 UNI GeoTREE Visit
Key Component: PostGIS • Early IEM code (2001) was a series of flat files in Shapefile format and database of observations. This was a disaster. • PostGIS provided the opportunity to manage data, metadata, and the GIS data in one location. – Network scalability – Transaction / stored procedure support – Speed / functionality with merge of GEOS library 28 Feb 2008 UNI GeoTREE Visit
Look at all of my data! 28 Feb 2008 UNI GeoTREE Visit
Here’s an idea, lets create a webpage where they can download the data! 28 Feb 2008 UNI GeoTREE Visit
The Open Geospatial Consortium (OGC) Way 28 Feb 2008 UNI GeoTREE Visit
28 Feb 2008 UNI GeoTREE Visit
Supporting the Load 28 Feb 2008 UNI GeoTREE Visit
Available OGC Services 28 Feb 2008 UNI GeoTREE Visit
http://mesonet.agron.iastate.edu/ogc/ • CONUS GOES (Infrared, Visible) • CONUS NEXRAD Base Reflectivity, Storm Total Precip, 1 Hour Precip • NWS issued advisories,watches, and warnings • Iowa Rainfall Estimates • Iowa Road Conditions • IEM Data Services (temp, winds, etc) 28 Feb 2008 UNI GeoTREE Visit
Raw NEXRAD Composites Have a large amount of noise due to ground clutter. A simple GDAL script comparing radar echos to its elevation quickly gets rid of most noise. 28 Feb 2008 UNI GeoTREE Visit
Cleaned Composite 28 Feb 2008 UNI GeoTREE Visit
Some IEM developed GIS webapps 28 Feb 2008 UNI GeoTREE Visit
28 Feb 2008 UNI GeoTREE Visit
28 Feb 2008 UNI GeoTREE Visit
28 Feb 2008 UNI GeoTREE Visit
28 Feb 2008 UNI GeoTREE Visit
28 Feb 2008 UNI GeoTREE Visit
28 Feb 2008 UNI GeoTREE Visit
4 May 2003, heavy rains on freshly tilled soils 25 Sep 2005, heavy rains on mature crops 28 Feb 2008 UNI GeoTREE Visit
What others have done. 28 Feb 2008 UNI GeoTREE Visit
28 Feb 2008 UNI GeoTREE Visit
Future Work • Work with end users on getting IEM data into their platform. 28 Feb 2008 UNI GeoTREE Visit
Time for Questions? Daryl Herzmann 515.294.5978 akrherz@iastate.edu 28 Feb 2008 UNI GeoTREE Visit