1 / 15

SDSS Data Transfer

SDSS Data Transfer. Jing-Jou Yen Division Manager National Center for High-Performance Computing (August 26, 2005). OUTLINE. Project Background Introduction to NCHC/TWAREN Sloan Digital Sky Survey ( SDSS) Overview Network Architecture and Configuration Network Performance Monitoring

davis-bishop
Download Presentation

SDSS Data Transfer

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SDSS Data Transfer Jing-Jou Yen Division ManagerNational Center for High-Performance Computing (August 26, 2005)

  2. OUTLINE • Project Background • Introduction to NCHC/TWAREN • Sloan Digital Sky Survey (SDSS) Overview • Network Architecture and Configuration • Network Performance Monitoring • Future Plan

  3. It is a joint program NCHC with the Fermi Laboratories to mirror the SDSS data. The goal is to speed up the SDSS information sharing for physicists working in R&E institutes in Taiwan. NCHC computing, storage and networking resources enhance functions in the astronomical research. NCHC uses TaiWan Advanced Research and Education Network (TWAREN) for the SDSS data transfer. NCHC’s Operations teams will ensure the quality for all efforts. Hsinchu Tainan Taipei Taichung Computing Center Knowledge Center Core node equipment Network Operation Center SDSS Data Transfer Project

  4. NCHC is Taiwan’s only National Lab Dedicated to • High-Performance Computing & Applications • Storage, Networking & the Applications Development • NCHC Mission • Provide resources and services • Do research and development • Offer education, training, and outreach Resources and Services High-performance Computing & Networking Research and Development High-performance Computers TANet2/TWAREN PC Clusters Storage/Databases Application SW Industrial, Government, Academic Projects International Collaborations Conferences Education, Training and Outreach Consultation Training Workshops Lectures Exhibits National Center for High-performance Computing NCHC

  5. SINICA NCU NTU NCTU Taipei NTHU Hsinchu NDHU NCHU NCNU Taichung CCU Tainan NCKU NSYSU TaiWan Advanced Research and Education Network TWAREN • TWAREN - Successor of TANet2 • TWAREN -One of the Most Advanced Networks/Operations in the World • TWAREN Goals • To provide a network infrastructure for academic and R&E community. • To stimulate creativity and foster talents • TWAREN Architecture • A hybrid network with 20G POS and DWDM technologies at its core. • Hierarchical topology: 3 layers (core, GigaPoPs, end nodes) • Eleven GigaPoPs - each links to the core • node at 20 Gbps and 1 dark fiber. • Highly scalable and flexible • Providing multiple services • International links to the USA • Integrated NMS Architecture

  6. NTU Sinica NCU Taipei NCTU NTHU Hsinchu NTU NCHU Taichung NCNU Tainan CCU NCKU NSYSU TWAREN Network topology Pacific Wave CANARIE NETHER Land StarLight CANARIE 2G 3*STM-4+3*STM-1 2.5G 2.5G 1.25G 1.8G 3*STM-4+2*STM-1 1.25G 1.25G MAN LAN LALALAN

  7. TWAREN NMS Architecture HP OpenView Service Information Portal (SIP) Service Desk Carrier OSS/ NMS Alarm SLA Reports NOC BMS Remedy Help Desk (Trouble Ticket System) HP OpenView Performance Insight & Report Pack for Cisco MPLS VPN / IP QoS / Cisco Ping / SA/ Netflow / IPT / CAR / RMON & Customize Report Raw Data SMS Cisco Info Center (Micromuse) HP OpenView Operation Manager Apps Apps Cisco IP Solution Center Cisco Secure ACS Apps Apps HP OpenView Extend Topology & Multicast Apps Apps NMS HP OpenView Network Node Manager (NNM) & CiscoWorks2000 for LAN/WAN & CTM Apps Apps Apps EMS WAN/LAN IP Telephony Network Elements IPv6 Multicast MPLS Multimedia

  8. Sloan Digital Sky Survey (SDSS) Overview • It is an very ambitious astronomical survey project. • The goal is to image one-half of the northern celestial hemisphere, and a smaller portion of the southern sky. • It determines the positions and absolute brightnesses of more than 100 million celestial objects. • The SDSS Southern Coadd project combines all images to detect very faint and distant astronomical objects. • Fermi National Accelerator Laboratory (FNAL) uses Grid3 to carry out a full coadd of all available data.

  9. NTU Sinica NCU Taipei NCTU NTHU Hsinchu NTU NCHU Taichung NCNU Tainan CCU NCKU NSYSU TWAREN Connections to Fermi Lab Pacific Wave CANARIE NETHER Land StarLight CANARIE 2G 3*STM-4+3*STM-1 2.5G 2.5G 1.25G 1.8G 3*STM-4+2*STM-1 1.25G 1.25G MAN LAN LALALAN

  10. 15600 HC 15600 TP1 15454 TP2 15454 SF 15454 CH Network Topology 198.49.208.10 131.225.7.156 140.110.240.10/24 [FNAL measurement server for CDF] [SDSS-server] [SDSS client] FNAL-SW NCHC-SW1 211.79.63.59/29 211.79.63.57/29 TWAREN International Optical Network ONS in Sartlight 211.79.63.58/29 NCHC ONS (HC) HC-7609P (NCHC-SW2) 211.79.59.250 211.79.59.252 [NCHC measurement server] [FNAL measurement client for CDF]

  11. Network Connections 198.49.208.10 131.225.7.156 140.110.240.10/24 [FNAL measurement server for CDF] [SDSS-server] [SDSS client] FNAL-SW NCHC-SW1 211.79.63.59/29 211.79.63.57/29 TWAREN International Optical Network HC NCHC ONS ONS in Chicago Sartlight 211.79.63.58/29 HC-7609P (NCHC-SW2) 211.79.59.250 211.79.59.252 [NCHC measurement server] [FNAL measurement client for CDF]

  12. TWAREN International Network ONS ONS Network Set-ups • Use Cisco 7609 & ONS (15454/15600) for connection • Use CTC, CTM or UCLP for lightpath set-up • Layer 1 international link for Hsin-Chu – Chicago • 622 Mbps lightpath (Hsin-Chu – Taipei – S.F. – Chicago) • 7 ONS’s included in the lightpath • Rsync: 2MB/s  8MB/s • Data Fragmentation • Policy Route • 5.0 TB Storage FNAL Hsin-chu NCHC Starlight

  13. Network Performance Monitoring • IPERF.MBPS: Max= 228.78 Mbps • Reverse IPERF.MBPS: Max= 213.27 Mbps • Available BW(Mbps): Max= 600.00 Mbps • RTT: 182 ms • No. of Hops: 3

  14. Network Monitoring Topology at Fermilab

  15. Future Plan • Resources (Computing + Storage+ Network) • Partnership with Universities and Institutes • Production Certificate Authority • Processing Functions • Applications Definition • International Collaborations

More Related