80 likes | 327 Views
The Integrated Surface Hourly (ISH) Global Database. ESDIM/OGP funded, FCC effort 2 QC phases thus far Full POR online via FTP, partial POR via CDO
E N D
The Integrated Surface Hourly (ISH) Global Database • ESDIM/OGP funded, FCC effort • 2 QC phases thus far • Full POR online via FTP, partial POR via CDO • ISH is being renamed ISD – Integrated Surface Data, to reflect its usage in the Integrated Surface Data Processing System, and inclusion of hourly, daily, etc data
ISH Quality Control Phase 1 • Data comparisons as part of merge process to ensure records are for same station-time • Inventory system to ensure no data loss from beginning to end of process • Test data to verify all software is working properly • Random checks of “Version 1” output data • Reprocessing as necessary
ISH Quality Control Phase 2 • 57 quality control algorithms (1 or multi-checks per algorithm, fully automated) • Validity checks for all data fields • Extreme value checks to eliminate gross errors • Temporal continuity checks (2-sided) for elements such as temperature, dew point, wind, & pressure • Internal consistency checks between elements • Checks for several known systematic problems • Test data verification • Random checks of “Version 2” output data
The Results….~ 20,000 stations historically.As early as 1900 to present.Available data increases in 1948, and further increases in 1973.
Future Plans • Place full period of record online in CDO--now have most recent data online (http://cdo.ncdc.noaa.gov) • Additional online capabilities, summaries, etc • Integrated Surface Data Processing System—now in development for near real-time QC of all data • Merge additional data sources into ISH • Improve and enhance the metadata • Phase 3 quality control: more sophisticated temporal checks, spatial checks, homogeneity adjustments, etc • Partnerships with other agencies and groups
Data Access Via Climate Data Online System- Access for U.S. and global digital data- Surface hourly, daily, monthly, with others plannedhttp://cdo.ncdc.noaa.gov
Impacts/Issues • Rapidly changing technology • Hardware implementation and problems • Adequate numbers and training of personnel • Better communication across Divisions • Adequate funding for the tasks at hand