NCEP Computing Update for Family of Services

1. NCEP Computing Updatefor Family of Services Michelle Mainelli Deputy Director NCEP Central Operations With input from NCO Staff… 5 August 2014

2. Current & Future High Performance Computing FOS Meeting – NCEP Computing – 5 August 2014

3. Weather & Climate Supercomputing System (WCOSS)Transition in July 2013 • Significance • Where United States weather forecast process starts for the protection of lives and livelihood • Produces model guidance at global, national, and regional scales • Examples: • Hurricane Forecasts • Aviation / Transportation • Air Quality • Fire Weather Location • Primary • Reston, VA (IBM provided facility) - Tide • Backup • Orlando, FL (IBM provided facility) - Gyre Configuration • Identical Systems (per site) • IBM iDataPlex/Intel Sandy Bridge/Linux • 213 trillion calculations/sec • 10,048 processing cores • 2.59 petabytes of storage • Performance Requirements • Minimum 99.9% Operational Use Time • Minimum 99.0% On-time Product Generation • Minimum 99.0% Development Use Time • Minimum 99.0% System Availability • Failover tested regularly Inputs and Outputs • Processes 3.5 billion observations/day • Produces over 15 million products/day FOS Meeting – NCEP Computing – 5 August 2014

4. HPC Growth TeraFLOP per operational system Projected 735 Built into the contract are capability and storage increases approximately every 3 years with no increase in funding NOAA modeling plans rely heavily on “built-in” contractual increases 213 73.9 69.7 15.5 14.0 4.4 1.8 1.2 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 FOS Meeting – NCEP Computing – 5 August 2014 WCOSS Phase 1 Bridge

5. WCOSS Future Capacities Phase 1: 2013 – Now • 628 Compute Nodes (10,048 Cores Intel Sandy Bridge 2.6 Ghz) • 2.59 PB of Disk Storage • 600 TB of Tape Storage Phase 2: Beginning now - 2017 • +1,008 Compute Nodes (24,192 Cores Intel IVYBridge 2.7 Ghz) • +2.034 PB of disk storage * Estimated Peak – Theoretical peak rate of floating point operations, the upper bound FOS Meeting – NCEP Computing – 5 August 2014

6. System Utilization Production Utilization 59.3% - July 17, 2014 38.2% Production, 21% Parallel down from 77.7% early June 2014 • Current Parallels: • NAM • HRRR • NLDAS • HYSPLIT • White Space: • CPC Hurricane Seasonal Forecasts FOS Meeting – NCEP Computing – 5 August 2014

7. Development System Utilization unspecified “dev” NAM RAP GFS GEFS GFS FOS Meeting – NCEP Computing – 5 August 2014

8. NOAA Research & Development Supercomputing FOS Meeting – NCEP Computing – 5 August 2014

9. Visualization & Dissemination Tools FOS Meeting – NCEP Computing – 5 August 2014

10. NCEP Migration to AWIPS IIStatus • All NCEP Centers have migrated from AWIPS I to AWIPS II • All Centers using both NAWIPS & AWIPS II • CPC and NCO/SDMs plan to enter FOTE by September • All NCEP Centers migration completed to AWIPS II in FY16 AWIPS N-AWIPS AWIPS II Migrated System FOS Meeting – NCEP Computing – 5 August 2014

11. AWIPS II National Center Perspective:Data Display • Radar mosaic • Global Satellite data • Re-mapped solar imagery • ASCAT data • Deterministic Model data • Ensemble mean/spread model data • Conventional observations Product Generation FOS Meeting – NCEP Computing – 5 August 2014

12. Model Analysis & GuidanceWebsite http://mag.ncep.noaa.gov FOS Meeting – NCEP Computing – 5 August 2014

13. FTPPRD & NOMADS FTPPRD: Access to full GRIB2 model data / no cut-splice-dice NOMADS: Access to Numerical Forecast Guidance data, tailored to user needs Data downloaded via Grib Filter and OpenDAP Methods http://ftpprd.ncep.noaa.gov http://nomads.ncep.noaa.gov FOS Meeting – NCEP Computing – 5 August 2014

14. NOAA Integrated Dissemination Program • NOAA’s Integrated Dissemination Program (IDP) established to transform organization’s dissemination capabilities from a collection of independent stovepipes to an integrated enterprise-wide dissemination service • Primary IDP dissemination service-oriented dissemination infrastructure at the primary facility as part of NCEP Central Operations in College Park, MD and a backup facility in Boulder, CO • Projects and applications are to be moved into (e.g. NOAA National Operational Model Archive and Distribution System (NOMADS)) or established in overall dissemination service facilities • Implementing a scalable, robust, secure, and commonly shared dissemination infrastructure to support a variety of applications enabling the access and delivery of weather data to internal and external stakeholders FOS Meeting – NCEP Computing – 5 August 2014

15. NOAA IDP: High Level Application Onboarding FY14 FY15 FY16 FY17 FTPPRD, NOMADS, and MAG are already running operationally FOS Meeting – NCEP Computing – 5 August 2014

16. Current Monitoring ofIDP Applications runningin College Park FOS Meeting – NCEP Computing – 5 August 2014

17. Opportunities For Notifications & Future Interactions NCO WEB Site http://www.nco.ncep.noaa.gov/pmb/changes/ Model Evaluation Mailing List Notification of availability of test data for major model upgrades: https://lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.modelevalinfo Weekly Change Memo List of every module, script, or data flow change: https://lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.rfcmemo In response to NOAA’s decision to abandon the establishment of a Cooperation Research and Development Agreement (CRADA), NCO remains committed to meet the needs of our non-Federal sectors. If you would like the opportunity to discuss your data needs with NCO please contact me to arrange a meeting: michelle.m.mainelli@noaa.gov FOS Meeting – NCEP Computing – 5 August 2014

18. Questions? “From the Sun to the Sea… Where America’s Climate, Weather, Ocean and Space Weather Services Begin” Michelle.M.Mainelli@noaa.gov FOS Meeting – NCEP Computing – 5 August 2014

19. Conventional Data Received FOS Meeting – NCEP Computing – 5 August 2014

20. Non-Conventional Data Received FOS Meeting – NCEP Computing – 5 August 2014 20

21. Non-Conventional Assimilated Data FOS Meeting – NCEP Computing – 5 August 2014 21