End-to-End Performance Initiative

1. End-to-End Performance Initiative Russ Hobby May 30, 2001 Internet2 Campus Workshop Atlanta, Georgia

2. The Problem • Even with high bandwidth network links, the Internet2 community often does not see expected performance. Internet2 Campus Workshop (May 30, 2001)

3. E2E Perf Initiative Vision • To enable the end-user to obtain optimal performance from the available current and future infrastructure on a routine basis. Internet2 Campus Workshop (May 30, 2001)

4. Work to Date • Initial planning in the late fall and winter • Campus Workshop in San Diego • Planning Meeting in Ann Arbor • Recasting of work plan • Formation of Design Team • Design Team White Paper • Spring Member Meeting • New Initiative Director, Cheryl Munn-Freemon Starts June 5 Internet2 Campus Workshop (May 30, 2001)

5. Design Team • The End-to-End Performance Initiative Design Team includes: • George Brett, NCSA/NLANR DAST/Web 100 • Claudia de Luna, NASA Jet Propulsion Laboratory • Doug Gale, OARnet • Andy Germain, NASA Goddard Space Flight Center • Terry Gray, University of Washington and Pacific/Northwest GigaPoP • Wendy Huntoon, PSC/NLANR NCNE • Basil Irwin, Web100 • Cheryl Munn-Fremon, University of Michigan • Ronn Ritke, SDSC/NLANR MOAT • Matthew Schmitz, Cisco Systems • Internet2 Staff Participants: • Guy Almes, Laurie Burns, Steve Corbató, Ted Hanss, Russ Hobby (chair), Kathleen Young, and Matt Zekauskas. Internet2 Campus Workshop (May 30, 2001)

6. The Initiative is • A Coordinating Structure • Will not replace current activities in the area • Will encourage work where there are missing activities • Coordinate activities to support E2E Performance • Help to move developments into operation • A Communications Facilitator • Promote communications for common areas • Tools for cross-area communications • A Knowledge Repository • Collect and disseminate knowledge gained • Distribute tools developed Internet2 Campus Workshop (May 30, 2001)

7. Participants • The Initiative is Structured Around Partnerships among • Applications Communities • Network Operators • Gigapops • Network Researchers • Campuses • Corporate partners • Internet2 Staff Internet2 Campus Workshop (May 30, 2001)

8. Applications Communities • They are the reason to have the network! • The Initiative will: • Work closely with selected test communities • Focus on helping them do what they want to do • Use their key applications to evaluate and improve network performance Internet2 Campus Workshop (May 30, 2001)

9. Campuses include the “Ends” in End-to-End • Campus concerns include: • Campus Users - overall performance and end result of the application. • System Administrators - computer hardware and operating system. • Network Operators - performance of the network. Internet2 Campus Workshop (May 30, 2001)

10. Focus Areas • Applications End-to-End • Host Computer and Operating Systems • The Network • Operational Support Internet2 Campus Workshop (May 30, 2001)

11. End-to-End Applications • Develop Test Case Disciplines • Study and Resolve Their Problems • Examples: • High Energy Physics • Astronomy • Medicine • Identify Key Applications to Test Performance • FTP • Video Conferencing • Remote Instrument Control Internet2 Campus Workshop (May 30, 2001)

12. End-to-End Applications • Develop Techniques and Tools to Make Networks Friendly to Applications • Applications Design • Best Practices • Resource Determination • Implementation • Best Practices • Software Libraries • Applications Development Systems • Operation • Obtaining Resources • Self Tuning Applications • Capabilities to Isolate Problems Internet2 Campus Workshop (May 30, 2001)

13. Host Computer and Operating System • Web100 is a Key Player for this Area • Techniques and Tools to Analyze • The Various Computer Sub-systems and Software • Different Hardware/Operating System Combinations and present options for to obtain optimal performance • Optimal Computer Configurations • Publicize Methodologies, Tools, and Results • Case Studies, Best Common Practices • Analysis Tools for Different Computers Internet2 Campus Workshop (May 30, 2001)

14. Host/OS Sub-Layers • API/library interface for accessing network resources • Kernel interface • Kernel memory-management subsystem • TCP-handling stack • IP-handling stack • Device driver and driver interface to kernel • NIC • Host bus or buses • Memory subsystem • CPU • Disk subsystem Internet2 Campus Workshop (May 30, 2001)

15. The Network • Establish a Common Measurement Infrastructure • Standard Instrumentation Locations along the Path • Common Data Sets Collected • Applications Reference Servers • Download of Special Testing Software • Develop Analysis Tools • Study Network Behavior • Pinpoint Source of Problems • Determine the Health of the Network Internet2 Campus Workshop (May 30, 2001)

16. Operational Support • Develop a Coordination and Communication Structure for Support Personnel Groups • Computer System Administrators, LAN Managers, Campus NOCs • Access to Experts • Cross-Campus Support • Establish the Performance Evaluation and Review Framework (PERF) • A Coordination Structure to Study and Resolve Hard Problems • Help populate the Knowledgebase of Solutions Internet2 Campus Workshop (May 30, 2001)

17. Operational Support • Other Operational Developments • Knowledgebase creation and use • Cross-Domain Trouble Ticket System for use by NOCs (initially) and End-Users (later) • Standard Sets of Operational Data that everyone can use to determine network capabilities and limitations. Internet2 Campus Workshop (May 30, 2001)

18. Initiative Management and Support • Initiative Structure • Series of Calls for Participation (CFPs) • Participation by Internet2 Community Partners • Initiative Management Structure • An Initiative Advisory Committee • Internet2 Provides • Initiative Management • Communications Tools • Information Resources and Tools • Evaluation and Assessment Internet2 Campus Workshop (May 30, 2001)

19. Show Me the Money UCAID has committed ~$1.5 million in project funding to provide central coordination and support Initiative coordination activities include proactively identifying potential funding sources and developing funding opportunities Potential funding agencies have participated in the planning stages and discussions will continue Internet2 Campus Workshop (May 30, 2001)

20. Next Steps White paper still open for comments Design Team work continues Produce an action plan and post Develop the Calls for Participation Specify review process Issue first set of CFPs, and begin work in specific areas Form an advisory and management structures Internet2 Campus Workshop (May 30, 2001)

21. Further Information • End-to-End Performance Initiative • http://www.internet2.edu/e2eperf/ • Initiative Design Paper • http://www.internet2.edu/e2eperf/papers/End-to-End-Perf-Design-Paper.pdf Internet2 Campus Workshop (May 30, 2001)