1 / 26

GISELA in the IBERGRID context: - A Resource Infrastructure Provider Partner

GISELA in the IBERGRID context: - A Resource Infrastructure Provider Partner An opportunity for VRCs Bernard Marechal (Project Coordinator) 5 th Iberian Grid Infrastructure Conference, 8 th -10 th June 2011 Santander (Spain). Outline. GISELA as Resource Infrastructure Provider: General

yaron
Download Presentation

GISELA in the IBERGRID context: - A Resource Infrastructure Provider Partner

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. GISELA in the IBERGRID context: • - A Resource Infrastructure Provider Partner • An opportunity for VRCs • Bernard Marechal (Project Coordinator) • 5th Iberian Grid Infrastructure Conference, 8th-10th June 2011 • Santander (Spain)

  2. Outline • GISELA as Resource Infrastructure Provider: • General • is much experienced in Grid computing • has a powerful Infrastructure • complies with EGI policies & recommendations • Specificities • Both Service (gLite) and Opportunistic Computing (OurGrid) supported • GISELA: an option for VRCs • Platform for all kinds of Applications • Offers a series of new, well-supported Services (e.g. DIRAC) • VRC Training & Support • Collaborates with EGI and Regional Initiatives • GISELA interests in the IBERGRID context • Welcomes international VRCs • Creates emulation process in LA • Interest in Iberian VRCs collaborating with Latin America IBERGRID 2011 - 8/10 June - Santander (Spain) 2

  3. Remembering the past 6 Iberian Institutions in EELA • Portugal: • Laboratório de Instrumentação e Física Experimental de Partículas (LIP) • Spain: • CIEMAT • Consejo Superior de Investigaciones Científicas (CSIC) • Universidad Politecnica de Valencia (UPV) • Universidad de Cantabria (UC) • Red Académica y de Investigación Española (REDIRIS) • 10 Iberian Institutions in EELA-2 • Portugal: • Universidade do Porto (UPORTO) • Universidade de Aveiro (UAV) • Universidade do Minho (UMINHO) • Spain: • CETA-CIEMAT • Centro de Supercomputación de Galicia (CESGA) • MAAT GKnowledge (MAAT) • Universidad de Cantabria (UC) • Universidad Complutense de Madrid (UCM) • Universidad de Extremadura (UEX) • Grupo de Reds y Computación de Altas Prestaciones (GRyCAP - UPV) IBERGRID 2011 - 8/10 June - Santander (Spain)

  4. GISELA Countries & Partners 15 Countries (11 in Latin America) 19 Partners (14 in Latin America) 12 Third Parties (11 in Latin America) • UPORTO Third Party • Uminho • UNIANDES Third Parties • UIS • PUJ • UNAM Third Parties • CICESE • ITV • ITESM • IPN-CIC • UAEM • UNISON The GISELA spirit is not anymore to consider Institutions, but rather representatives of JRU / NGI, with the advantage to “accept” de facto all JRU / NGI members. • REUNA Third Parties • UFRO • UTFSM • UFRJ Third Party • CEFET-RJ IBERGRID 2011 - 8/10 June - Santander (Spain) 4

  5. GISELA as Resource Infrastructure Provider IBERGRID 2011 - 8/10 June - Santander (Spain) 5

  6. Long record in e-Science support • Fruit of 5-6 year experience of successful e-Science EU-LA Collaboration, through EU funded projects (EELA, EELA-2, GISELA) • Has long outstanding collaboration with Spain (CIEMAT- Coordinating Institution) and Portugal • Present in almost all LA countries • Most encompassing e-Infrastructure for scientific collaborations between Latin America and Europe • Sound long-term sustainability approach rooted on CLARA, NRENs, LA NGIs IBERGRID 2011 - 8/10 June - Santander (Spain) 6

  7. GISELA e-Infrastructure (1) Committed CPU & Storage resources (from the GISELA DoW) IBERGRID 2011 - 8/10 June - Santander (Spain)

  8. GISELA e-Infrastructure (2) • GISELA gLite sites integrated in the infrastructure • CEFET-RJ, CIEMAT-TIC, EELA-UNLP, ICN-UNAM, INFN-CATANIA, UFRJ-IF, ULA-MERIDA, UMinho-CP, Uniandes and UPorto • About 1000 cores (VO “prod.vo.eu-eela.eu”) • Non-GISELA sites contributing to the VO “prod.vo.eu-eela.eu” • CERN-PROD, csTCDie, EELA-UTFSM, IEETAand UNICAN • OurGrid sites - about 400 cores (all in Brazil): • LCC2, GMF,DCA, AESA, LCC1, LSD IBERGRID 2011 - 8/10 June - Santander (Spain)

  9. GISELA e-Infrastructure (3) • UFRJ is the most active site (gLite only) • specInt2000 IBERGRID 2011 - 8/10 June - Santander (Spain)

  10. GISELA e-Infrastructure (4) • Accumulated load per VO (gLite only) IBERGRID 2011 - 8/10 June - Santander (Spain)

  11. EGI compliant Infrastructure • EGI - GISELA Resource Infrastructure Provider MoU signed • EGI compliance is based on the adoption of common services and practices • The Operational Level Agreement (OLA) (http://documents.gisela-grid.eu/record/87?ln=en) • Monitoring System (Nagios) • Ticket System (GGUS) • Accounting System (APEL) • Middleware (gLite) • Resource database (GOCDB) • Operations Dashboard IBERGRID 2011 - 8/10 June - Santander (Spain) 11

  12. Platform for any Application / VRC • VRC initial situation: • EELA-2 ended up supporting 70Applications from 78 Institutions • Emerging VRCs • Legacy: EELA-2 User Communities, typically 1-2 Institution group(s), largely located in Latin America, alone or collaborating with a few Institutions. • A few large VRCs from Life Sciences (e.g. WeNMR, Biomed), Earth Sciences (WRF4G, Seismic simulations) and HEP (Auger, LHC experiments at CERN) • More than 200 scientific contacts in LA, e.g. CLARA surveyed communities IBERGRID 2011 - 8/10 June - Santander (Spain) 12

  13. Comprehensive framework for VRC support IBERGRID 2011 - 8/10 June - Santander (Spain) 13

  14. Rich portfolio of new, well supported Services • Broad range of services, covering both Application and Infrastructure support • Examples of services for which support is available: • Application-related Services • Job, Catalogue, File and Data Management • Digital archives, Secure storage, WatchDog, lcg-rec toolkit • Infrastructure-related Services • Support for opportunistic resources (OurGrid middleware) • Support for infrastructure bridging (OurGrid and gLite) • Support for Storage Accounting (SAGE) • Data processing and distributed user analysis services • DIRAC: workload and data management system (cf DIRAC meeting in Barcelona) IBERGRID 2011 - 8/10 June - Santander (Spain) 14

  15. Comprehensive VRC Training & Support (1) Tailorable to VRCs needs IBERGRID 2011 - 8/10 June - Santander (Spain) 15

  16. Comprehensive VRC Training & Support (2) Adaptable to VRCs IBERGRID 2011 - 8/10 June - Santander (Spain) 16

  17. Collaboration with EGI & Regional projects • EGEE, EGI • EGEE: Long, outstanding interaction (MoU) in collaboration with other related projects (EUMedGrid, EU-IndiaGrid, EUAsiaGrid, SEE-Grid-2, BalticGrid, BELIEF,..) • EGI: Natural follow up of the EGEE cooperation • Infrastructure Providers MoU, signed with EGI.eu • Project MoU(Dissemination, Training, Support tools & Services), signed with EGI-InSPIRE • EGI-related projects / Regional Initiatives • DEGISCO: Volunteer computing support (gLite <-> OurGrid bridge) • EU: UNIZAR-IBERCIVIS, ATOS ORIGIN, CNRS,… • LA: UFCG-Brazil • CHAIN: Focus on VRC support (MoU under preparation) • EU: INFN, CIEMAT • LA: CLARA • EPIKHJoint sponsoring /organisation of Tutorials & Workshops (MoU signed) • EU: INFN, CIEMAT, CNRS,.. • LA: Brazil: CEFET/RJ, UFRJ, Chile: UTFSM, Mexico: UNAM) IBERGRID 2011 - 8/10 June - Santander (Spain) 17

  18. GISELA specific interests in the IBERGRID context IBERGRID 2011 - 8/10 June - Santander (Spain) 18

  19. GISELA interests • Welcome international VRCs • A few largeVRCs already on board such as from Life Sciences (e.g. WeNMR, Biomed), Earth Sciences (WRF4G, Seismic simulations) and HEP (Auger, LHC experiments) • Create emulation process in Latin America • Not enough intensive productions from LA VRCs • Wish to stimulate LA Institutions to move on from small tests to evaluate the Grid technology to mass production as exemplified by the large VRCs. • Hope to stimulate new collaborations • Interest in “Iberian” VRCs collaborating with Latin America • GISELA is (was) naturally looking for existing or foreseen collaborations between SPAIN & Portugal and Latin America IBERGRID 2011 - 8/10 June - Santander (Spain) 19

  20. CAM (CommunityAtmospheric Model) • Domain: Earth Sciences / Climate forecast • Collaboration: UNICAN (Spain), UCH+CMM (Chile), SENAHMI (Peru) • From EELA: “…Therefore, there is a real need for a seamless global+regional climate application in grid environment allowing users to access and submit runs or experiments using a friendly tool (e.g. a portal).” • Current status, perspectives? IBERGRID 2011 - 8/10 June - Santander (Spain)

  21. WRF4G (WeatherResearch and ForecastingforGrid) • Domain: Earth Sciences / Climate simulation • Collaboration: UNICAN (Spain) • From EELA-2: “One of the advantages of having ported the WRF to the Grid is the large community of end users around this model world wide. Especially the Latin America has a well established community around the WRF model. If we combine this community with the benefits of the Grid, the WRF4G will allow to create a new virtual community around this application supported by the Grid technology provided by the EELA-2 project.” • Current status, perspectives? IBERGRID 2011 - 8/10 June - Santander (Spain)

  22. BLAST (BasicLocalAlignmentSearchTool) • Domain: Life Science / Bio-informatics • Collaboration: UPV (Spain) • From EELA-2: “…processing these databases with BLAST demands computational resources that exceed the capabilities of most research groups. Nevertheless, these massive experiments can be performed by means of e Science infrastructures (such as EGEE, EELA and some NGIs) following ‘High-Throughput’ approaches” • Current status, perspectives? IBERGRID 2011 - 8/10 June - Santander (Spain)

  23. GAMOS (Geant-based Architecture for Medicine-OrientedSimulations) GAMOS: Framework for the simulation of medical applications, in (PET/SPECT) and radiotherapy • Domain: Life Sciences / Medical Physics • Collaboration: CIEMAT (Spain), UTFSM (Chile), UNIANDES (Colombia) • From EELA-2: “the gridified version GAMOS has been successfully deployed and tested on a first group of selected EELA-2 resources. The suitability of this application for Grid environments has been demonstrated performing a real simulation based in calibrating a commercial accelerator, which is in use in multiple hospitals for radiotherapy.” • Current status, perspectives? IBERGRID 2011 - 8/10 June - Santander (Spain)

  24. CROSS FIRE CROSS FIRE: An integrated system aimed at the simulation of fire growth over complex topology • Domain: Civil Protection • Collaboration: UMINHO (Portugal) • From EGRIS1: “Collaborative Resources Online to Support Simulations on Forest Fires: a Grid Platform to Integrate Geo-referenced Web Services for Real-Time Management” • Current status, perspectives? IBERGRID 2011 - 8/10 June - Santander (Spain)

  25. Conclusions (1) • GISELA still young (9 months old) but … • Some concerns (from a managerial point of view): • Slow implementation of the CLARA business plan for long-term sustainability • Handover to CLARA and NRENS of the GISELA activities • (Not enough) use of the GISELA e-Infrastructure • Third parties not yet fully on board • Slow and painful NGIs implementation in LA: • Different levels of development in LA countries' grid infrastructures/services • Local political issues • Non-uniform enthusiasm (but appreciable efforts in Colombia and Mexico) IBERGRID 2011 - 8/10 June - Santander (Spain)

  26. Conclusions (2) • However… • 6 important MoUs already signed and 2 in progress (WP1) • Excellent dissemination and Outreach activities (WP2) • VRCs supported and training available (WP3) • Infrastructure operating satisfactorily (WP4) • Late, but currently satisfactory, ramping up of the Network Resource Provision (WP5) • Infrastructure and Applications-oriented Services for User Communities (WP6)rather productive (DIRAC) • Finally … How could we strengthen the Portugal / Spain – LA collaborations? IBERGRID 2011 - 8/10 June - Santander (Spain)

More Related