1 / 18

RGMA Deployment

RGMA Deployment. Laurence Field / RAL <l.field@rl.ac.uk> Steve Fisher / RAL <s.m.fisher@rl.ac.uk>. R-GMA. Producer. Uses the Grid Monitoring Architecture from Global Grid Forum R-GMA is a relational implementation Applied to both information and monitoring

natan
Download Presentation

RGMA Deployment

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. RGMA Deployment Laurence Field / RAL <l.field@rl.ac.uk> Steve Fisher / RAL <s.m.fisher@rl.ac.uk>

  2. R-GMA Producer • Uses the Grid Monitoring Architecture from Global Grid Forum • R-GMA is a relational implementation • Applied to both information and monitoring • Creates impression that you have one RDBMS per Virtual Organisation Registry Information flow Meta-data flow Consumer R-GMA Deployment

  3. SiteInfo Example dn: in=siteinfo,Mds-Vo-name=ralrgma,o=grid objectclass: SiteInfo objectclass: DataGridTop objectclass: DynamicObject siteName: RALRGMA sysAdminContact: edg-site-admin@gridpp.rl.ac.uk userSupportContact: edg-site-admin@gridpp.rl.ac.uk siteSecurityContact: edg-site-admin@gridpp.rl.ac.uk dataGridVersion: v1_4_3 installationDate: 20021111103000Z createTimestamp: 20030129111208Z modifyTimestamp: 20030129111208Z entryTtl: 1200 Gin Gout dn siteName sysAdminContact admin@gridpp.rl.ac.uk RAL in=siteinfo,Mds-Vo-name=ralrgma,o=grid R-GMA Deployment

  4. edg-rgma Gin • Uses the same information provider as MDS • Can run MDS and R-GMA in parallel • Can compare information systems R-GMA MDS GRIS Gin CircularBuffer Producer Information Provider R-GMA Deployment

  5. Gout • LDAP Server is queried by RB • Two RBs should be used currently in the UK • one for MDS and one for R-GMA LDAP Server Archiver Consumer (CE) R-GMA ConsumerAPI DataBase Producer Consumer (SE) Consumer (SiteInfo) RDBMS GOUT R-GMA Deployment

  6. R-GMA CLI Join CE and SE Tables “Select a ComputingElement with at least 1 free CPU that also has a CloseStorageElement with at least 1000 MB of free space” SELECT DISTINCT ComputingElement.CEId FROM ComputingElement, CloseStorageElement,StorageElementStatus WHERE ComputingElement.FreeCPUs > 0 AND (ComputingElement.CEId = CloseStorageElement.CEId AND CloseStorageElement.CloseSE = StorageElementStatus.SEId AND StorageElementStatus.SEfreespace > 1000) R-GMA Deployment

  7. R-GMA Browser InfoCat • One logical registry per VO • Replication/Distribution system ready soon • At the moment only using one for all VOs • Located at RAL • Infocat.gridpp.rl.ac.uk • InfoCat machine also hosts BrowserServlet R-GMA Deployment

  8. jobsubmission R-GMA Deployment Information Catalogue Information flow Tomcat Registry Servlet Schema Servlet MetaData flow Server Config Resource Broker Tomcat Tomcat ProducerServlet ArchiverServlet Site A Client Config Gout Gin Archiever API Gin Producer API Producer API LDAP Information Provider Information Provider R-GMA Deployment

  9. R-GMA Tools • R-GMA CLI • Command Line Interface (similar to MySQL) • Supports single query and interactive modes • R-GMA Browser • JSP application dynamically generating web pages • Supports pre-defined and user-defined queries • Pulse • R-GMA Java client-based GUI • Supports streaming and simple graphical displays • Nagios • R-GMA plug-in instantiates an Archiver and uses that information to populate Nagios displays • Users can benefit from Nagios alert mechanism R-GMA Deployment

  10. R-GMABrowser Service Status • Monitors EDG components • Provides a standard interface for plug-in service status scripts • Return 0 or 1 OK or fail • Returns message from standard out • Browsing via the web R-GMA Deployment

  11. How to upgrade • Based on edg version 1_4_3 • Install rpms need for R-GMA • Configure via lcfg (or manually) R-GMA Deployment

  12. RPMS EDG RPMS edg-info-main-2.0.1-0 CE edg-info-siteinfo-1.0.0-1 SE edg-info-se-2.0.0-4 Externals j2sdk-1.4.1-fcs log4cpp-0.2.7-3 mm.mysql-2.0.6-2 xerces-c-1.7.0-1 MySQL-python2.1-0.9.2-1 python2-2.1.3-2 log4j-1.2.6-1jpp SWIG-1.3.11-edg1 R-GMA edg-rgma-api-c-2.2.8-1 edg-rgma-common-2.2.8-1 edg-rgma-api-cpp-2.2.8-1 edg-rgma-demo-2.2.8-1 edg-rgma-api-java-2.2.8-1 edg-rgma-servlets-2.2.8-5 edg-rgma-api-perl-2.2.8-1 edg-rgma-tools-2.2.8-5 edg-rgma-api-python-2.2.8-1 LCFG obj-rgma-2.2.8-5 obj-infoproviders-2.0.1-9 R-GMA Deployment

  13. LCFG R-GMA rgma.servletlocation localhost rgma.registrylocation INFOCAT_HOSTNAME rgma.GOUT no rgma.service RGMA MDS GIN rgma.VO_RGMA SE_GDMP_VOS rgma.cmd_RGMA /opt/edg/bin/rgma-servlet-status /etc/tomcat4/server.xml rgma.VO_MDS SE_GDMP_VOS rgma.cmd_MDS /etc/rc.d/init.d/globus-mds status rgma.VO_GIN SE_GDMP_VOS rgma.cmd_GIN /etc/rc.d/init.d/edg-rgma-gin status R-GMA Deployment

  14. LCFG InfoProviders infoproviders.GRID_INFO_USER edginfo infoproviders.INFO_LOCATION info infoproviders.INFO_PROVIDER_LOG /opt/edg/var/info/info-provider-log infoproviders.SIenabled yes infoproviders.siteName SITE_NAME_ infoproviders.sysAdminContact SITE_MAILROOT infoproviders.userSupportContact SITE_MAILROOT infoproviders.siteSecurityContact SITE_MAILROOT infoproviders.dataGridVersion SITE_EDG_VERSION infoproviders.installationDate SITE_INSTALLATION_DATE_ infoproviders.SITE_DN Mds-Vo-name=local,o=grid infoproviders.SITE_GIN_UPDATE_PERIOD 600 infoproviders.CEenabled yes R-GMA Deployment

  15. BOSS job,edg-rgma-pulse CMS - BOSS • Batch Object Submission System • A wrapper for any jobs a user wants to run • A BOSS job is submitted containing the user’s job, whereupon BOSS carries out the following: • Forks the job off to a worker node • Parses (i.e. filters) ‘standard output’ and writes selected data from that output to a local database • User application using R-GMA to stream data • CircularBufferProducer used to publish parsed Standard Output • Archiver used to collect and store information from multiple jobs R-GMA Deployment

  16. R-GMA Deployment and Performance • Deployment of WP3 Demo Testbed (used in EU review) • Revealed R-GMA bug with multiple Tomcat instances – subsequently fixed • UK and INFN deployment following WP3 Demo Testbed • R-GMA is being used by: • WP1 (logging and book keeping) • WP2 (replica manager using R-GMA as the information provider) • WP7 (network monitoring) • CMS (Imperial College, Brunel) (BOSS) • Performance and Optimisation • Using NetLogger and profiling tools to identify possible bottlenecks R-GMA Deployment

  17. Programme for 2003 • Functionality • Enhanced Mediator • Complete GRM integration for monitoring parallel applications • Nagios Integration • Resilience and Scalability • Consider all failure modes • Complete Registry and Schema replication • Security • Authorisation • Performance Optimisation • OGSA Compliant Implementation • GT3 inter-operability • Include wrapper for backwards compatibility R-GMA Deployment

  18. Summary • R-GMA works! • Need to deploy to enable R-GMA to be tested in a real grid environment • Within UK and Italy initially • Problems found will be fixed quickly • Currently focusing on reliability, stability and performance R-GMA Deployment

More Related