1 / 27

Large Scale Experimental Grids

Grid’5000. Large Scale Experimental Grids. &. Grid eXplorer. Franck Cappello INRIA fci@lri.fr. Grid experimental platforms rational. Grid raises a lot of research issues:

caine
Download Presentation

Large Scale Experimental Grids

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Grid'5000 and Grid eXplorer Grid’5000 Large Scale Experimental Grids & Grid eXplorer Franck Cappello INRIA fci@lri.fr

  2. Grid'5000 and Grid eXplorer Grid experimental platformsrational • Grid raises a lot of research issues: • Security, Performance, Fault tolerance, Scalability, Load Balancing, Coordination, Message passing, Data storage, Programming, Communication protocols and architecture,Deployment, etc. Theoretical models and simulators cannot capture real life conditions Production platforms have strong difficulties to reproduce experimental conditions • How to test and compare? • Fault tolerance protocols • Security mechanisms • Deployment tools • etc.

  3. Grid'5000 and Grid eXplorer Tools for Distributed System Studies To investigate Distributed System issues, we need: 1) Tools (model, simulators, emulators, experi. Platforms) 2) Strong interaction between these research tools Tools for Large Scale Distributed Systems log(cost) Real systems Real applications “In-lab” platforms Synthetic conditions Real systems Real applications Real platforms Real conditions Models: Sys, apps, Platforms, conditions Key system mecas. Algo, app. kernels Virtual platforms Synthetic conditions log(realism) emulation math simulation live systems

  4. Grid'5000 and Grid eXplorer We need a Grid experimental platform According to the current knowledge: There is no large scale testbed dedicated to Grid experiments • Grid’5000 as a live system • Grid eXplorer as a large scale emulator log(cost) Grid’5000 TERAGrid PlanetLab Naregi Testbed Grid eXplorer WANinLab Emulab SimGrid MicroGrid Bricks NS, etc. Model Protocol proof log(realism) emulation math simulation live systems

  5. Grid'5000 and Grid eXplorer Fundamental components of Grids • Systems • nodes, OS, • distributed systems mechanisms (resource discovery, storage, scheduling, etc.), • middleware, runtimes, • Fault (crash, transient) • Workload (multiple users/multiple applications) • Heterogeneity (resource diversity, performance) • Malicious users/behaviors • Networks • routers, links, topology, • protocols, • Theoretical features: synchronous, pseudo synchronous or asynchronous • Disconnection • Packet loss • Congestion Static Dyn. Static Dyn.

  6. Grid'5000 and Grid eXplorer What do we need for Grid experiments ? • Remotely controllable Grid nodes installed in geographically distributed laboratories • A « Controllable » and « Monitorable » Network between the • Grid nodes • A middleware infrastructure connecting the nodes (security) • A playground to prepare experiments • A toolkit to deploy, run, monitor,control experiments and collect results We need these components for A nation wide Experimental Platforms and Emulators

  7. Grid'5000 and Grid eXplorer Grid’5000 Grid experiments under real life conditions Technical Committee: Steering Committee: (organizer: Franck Cappello, Orsay) -David Gueldrech (Sophia) -Jean Claude Barbet (Orsay) -Franck Bonnassieux (UREC) -Julien le duc (Grenoble) -Fred Desprez (Lyon) -Yvon Jégou (Rennes) -Olivier Coulaud (Bordeaux) -Frédéric Barbaresco (Toulouse) -Thierry Priol (ACI Grid Director) -Brigitte Plateau (President of ACI Grid SC) -Dani Vandrome (Director of Renater) -Frédéric Desprez (Lyon) -Michel Daydé (Toulouse) -Yvon Jégou (Rennes) -Stéphane Lantéri (Sophia) -Raymond Namyst (Bordeaux) -Pascale Primet (Lyon) -Olivier Richard (Grenoble) Forums: Deployment/exploitation: Franck Cappello (AS1, RTP8) Programming models: Raymond Namyst (AS2, RTP8)

  8. Grid'5000 and Grid eXplorer The Grid’5000 Project • Building a nation wide experimental platform for • Grid researches (like a particle accelerator for the computer • scientists) • 10/11 geographically distributed sites • every site hosts a cluster (from 256 CPUs to 1K CPUs) • All sites are connected by RENATER (French Res. and Edu. Net.) • RENATER hosts probes to trace network load conditions • Design and develop a system/middleware environment • for safely test and repeat experiments • 2) Use the platform for Grid experiments in real life conditions • Address critical issues of Grid system/middleware: • Programming, Scalability, Fault Tolerance, Scheduling • Address critical issues of Grid Networking • High performance transport protocols,Qos • Port and test applications • Investigate original mechanisms • P2P resources discovery, Desktop Grids

  9. Grid'5000 and Grid eXplorer Grid’5000 Big Picture Control site Site 2 Users (ssh loggin + password) Front end Control Master Control Slave Site 1 LAB/Firewall Router Control Slave Test Cluster Firewall/nat Lab’s Network Site 3 Gateway +VPN (192. For all nodes) Test Cluster One machine Can be seen as a Virtual Grid Gateway

  10. Grid'5000 and Grid eXplorer Grid’5000 Schedule Call for Expression Of Interest Vendor selection Instal. First tests Final review Fisrt Demo (SC04) Call for proposals Selection of 7 sites ACI GRID Funding Grid’5000 Hardware Grid’5000 System/middleware Forum Security Prototypes (not full size) Control Prototypes (not full size) Grid’5000 Programming Forum Grid’5000 Builder Community Grid’5000 Experiments March04 Jun/July 04 Spt 04 Oct 04 Nov 04 Sept03 Nov03 Jan04

  11. Grid'5000 and Grid eXplorer Grid’5000 in November’2004 Grid eXplorer Pau Grid 5000 nodes (soon 4) 3

  12. Grid'5000 and Grid eXplorer Grid’5000 Experiments

  13. Grid'5000 and Grid eXplorer Summary of Grid5000 experimentsof Grid’5000 members • Networking • End Host Communication layer • High performance long distance protocols • High Speed Network Emulation • Middleware / OS • Grid’5000 control/access • Grid’5000 experiment automation • Scheduling / data distribution in Grid • Fault tolerance in Grid • Resource management • Grid SSI OS and Grid I/O • Desktop Grid/P2P systems • Programming • Component programming for the Grid (Java, Corba) • GRID-RPC • GRID-MPI • Code Coupling • Applications • Multi-parametric applications (Climate modeling/Functional Genomic) • Large scale experimentation of distributed applications (Electromagnetism, multi-material fluid mechanics, parallel optimization algorithms, CFD, astrophysics • Medical images, Collaborating tools in virtual 3D environment

  14. Grid'5000 and Grid eXplorer Middleware1(XP)Grid5000 XP: eXPeriments on • Grid’5000 control - Computing Environment deployment (Ka-tools) - Experiment automation (security and control) - VGrid « mapping a virtual Grid on a real testbed » - Monitoring, benchmarking, performance characterization and analysis • Scheduling / distribution - Scheduling : Data transfers, global communications, work stealing,... • Data re-distribution in Grid • Task distribution and load balancing in heterogeneous Grid • Mixed Parallelism (task and data parallelism) • Mixing data management and task scheduling • Hierarchical and Distributed Scheduling • Fault tolerance - Fault tolerant Grid-RPC (RPC-V) • Hierarchical Fault tolerant MPI (MPICH-V) • Fault tolerant in data-flow approach (Athapascan)

  15. Grid'5000 and Grid eXplorer Middleware2(XP)Grid5000 • Management - AROMA tool : resources management over a Grid of clusters with different classes of services - Mobile agents for open Grid management - Management of Grids and hosted services (security, QoS, monitoring & control, dynamic configuration, …) - Optimization for wide area distributed query processing • Virtualization of data storage on Grids • Automatic Deploymentof GridRPC middle tier. - Multiclusters and lightweights Grid resource management (OAR/CIGRI) • Global Computing/P2P Middleware - Executing Web Services on Desktop Grid Workers (XtremWeb) - Distributing the Coordination in Desktop Grids (XtremWeb) - Harnessing Clusters as parallel Workers - Probabilistic certification in peer-to-peer systems - Large Scale Data Sharing Service based on JXTA (JuxMem) - Experimenting management services for textual document in P2P systems • Grid SSI OS and Grid I/O • Grid file system (NFSG) • Grid-aware OS (Kerrighed) • Coupling Computational Grid with Reality Center

  16. Grid'5000 and Grid eXplorer Network(XP)Grid5000 • End Host Communication layer - Intelligent Usage of NICs for local and wide area communications - Direct file access over Myrinet : ORFA/NFS and ORFA/LUSTRE • High performance long distance protocols • - Alternative Transport for very high speed networks (backpressure) • - Differentiated transport with delay control on WAN • Reliable active and non active Multicast • Network Bandwidth optimization in Grid (VTHD++, Paco++). • High Speed Network Emulation - Automatic Deployment of emulated high speed domains - Experiment design for grid flow interactions studies • Grid Networking Layer • - Network Resource and QoS on demand • - Grid Overlay and Programmable Routers • Measurement Services for network aware middleware

  17. Grid'5000 and Grid eXplorer Programming(XP)Grid5000 • Component programming on the grid • - ProActive : a JAVA library (parallel, distributed, concurrent • computing with security and mobility) • Assessment of scalability, deployment, security and fault • tolerance issues • Hierarchical components architecture • PadicoTM/Paco++ combining parallel and distributed computing • RPC Environment • Large scale experimentation of the DIET platform (Distributed • Interactive Engineering Toolbox) • Client/Agent/Server model following the GridRPC standard with • distributed scheduling agents • MPI Environment • - Time sharing Grid resources • Migration over Clusters with heterogeneous high speed networks • Code Coupling - Application coupling with Athapascan • Communication / method invocation rescheduling into ORB (HOMA) • - Fluid transfer simulation and geological code with PadicoTM/Paco++

  18. Grid'5000 and Grid eXplorer Applications(XP)Grid5000 • Multi-parametric applications - ACI GRID-TLSE Project : expertise site for sparse linear algebra - Climate modeling and Global Change • DataGène Project : Functional genomic • Large scale experimentation of distributed message passing applications • JECS: a JAVA Environment for Computational Steering • Distributed computing and interactive visualization of 3D numerical simulations (Caiman and Oasis project-teams) • Collaborative environment • Computational Electromagnetism application (JEM3D) • MECAGRID (ACI GRID project, Smash project-team) • Massively parallel computations in multi-material fluid mechanics • Study of numerical algorithms for heterogeneous computing platforms • Grid computing for medical applications (Epidaure project-team) • Interoperable medical image registration grid service • Optimal design of complex systems (Coprin project-team) • Evaluation of parallel optimization algorithms based on interval analysis techniques • Study of load balancing strategies on heterogeneous resources + CFD, astrophysics,… applications + Collaborating tools in virtual 3D environment.

  19. Grid'5000 and Grid eXplorer Other experiments on Grid’5000 • Grid’5000 will be opened to other French Grid researchers (certainly through a selection procedure) • Grid’5000 will be connected to the EU CoreGrid testbed and may be used as an experimental platform for CoreGrid researchers (still through a kind of selection procedure)

  20. Grid'5000 and Grid eXplorer Grid’5000 + Grid eXplorer Combining two Grid research instruments log(cost) Grid’5000 Grid eXplorer Relax Real Life Conditions SimGrid MicroGrid Bricks NS, etc. Relax Conditions Reproducibility Model Protocol proof log(realism) emulation math simulation live systems

  21. Grid'5000 and Grid eXplorer Grid experiments undersynthetic reproducible conditions Grid eXplorer • Build the instrument: - 1K CPU cluster (may be only 500 depending on the budget) - configurable network (Ethernet, Myrinet, others?) - configurable OS (kernel, distribution, etc.) - A set of emulation/simulation tools (existing + new ones) - Multi-users - Located/managed by IDRIS • Study impact of Scale in Grid/P2P systems • Address critical issues of Grid system/middleware: • Programming, Scalability, Fault Tolerance, Scheduling • Address critical issues of Grid Networking • High performance transport protocols,Qos • Port and test applications • Investigate original mechanisms • P2P resources discovery, Desktop Grids Grid'5000 and Grid eXplorer

  22. Grid'5000 and Grid eXplorer Grid eXplorerBig picture A set of sensors in Grid’5000 A set of tools for analysis Emulator Core Hardware + Soft: Emulation & Simulation An experimental conditions data base Validation on Grid’5000 Emulab cluster

  23. Grid'5000 and Grid eXplorer Laboratories involved in GdX 13 Labs

  24. Grid'5000 and Grid eXplorer

  25. Grid'5000 and Grid eXplorer Grid eXplorer and Grid’5000interactions Design Test/Check Validation under Real Life Conditions Grid’5000 Integration to standard middleware, Deployment, Performance Design Test/Check Validation of Scalability and under Synthetic Conditions Grid eXplorer Scalability, Fault tolerance

  26. Researches in Grid and P2P need large scale platforms To study protocols, systems, middleware, programming models and applications in real life OR reproducible experimental conditions Grid’5000 and Grid eXplorer Will be experimental platforms for Grid researchers (like particle accelerator for physicists) - A nation wide platform and a large scale emulator Strong relations between this two projects (researchers are the same persons for the two projects!) Hardware should be installed by November 2004 Prototypes (security and control) should work for November 2004 Will be opened for experiments in early 2005 Grid'5000 and Grid eXplorer Summary

  27. Grid'5000 and Grid eXplorer Q&A

More Related