1 / 22

The Virgo Grid

Gergely Debreczeni (MTA KFKI RMKI) RMKI VIRGO Group. The Virgo Grid. Tier-2 WLCG Workshop Hepy, Wien. Several predictions of Einstein's general relativity has already been confirmed experimentally, like advance of perihelium gravitational lensing

pearl
Download Presentation

The Virgo Grid

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Gergely Debreczeni (MTA KFKI RMKI) RMKI VIRGO Group The Virgo Grid Tier-2 WLCG WorkshopHepy, Wien

  2. Several predictions of Einstein's general relativity has already been confirmed experimentally, like advance of perihelium gravitational lensing change of elapse of time in strong gravitational fields, etc... but we have only indirect (but very good) proof for the existence of gravitational waves The direct detection of GWs are the goal of the VIRGO experiment. About gravitational waves Debreczeni Gergely - Tier-2 Workshop, Wien

  3. When big masses are moving with high speed they emmit gravitational waves These waves are no propagating in space, they are the vibration of the space itself, i.e. that of the metric. Change of metric results change in distance between any two point. By measuring distance we can detect GWs, but very difficult measurement. ! About gravitational waves Debreczeni Gergely - Tier-2 Workshop, Wien

  4. Vibration of space is different in different direction. By continously measuring the distance between two points one can detect periodic changes... 10-18 m precision... The output of the experiement is a time series,i.e a distance as a function of time. About gravitational waves Debreczeni Gergely - Tier-2 Workshop, Wien

  5. Cascina, Italy 3 km-es arm length Fabry-Perot cavities 50/150 finess 6800 m3, 10-10 mbar vacuum!! The Virgo experiemnt • 20 W laser • solid concrete base, 20-50 m deep • 1 MW power consumption • excellent seizmic isolation (10-5) Debreczeni Gergely - Tier-2 Workshop, Wien

  6. Ligo and VIRGO is now one big collaboration They share data, software, analysis methods, having joint collaboration meetings Computing infrastructure Need for common, compatible and interoperable computing infrastructure • Virgo • resources as part of EGI • LSF, PBS, BQS, Condor LRMSes • no shared disks • EGI resources are extensively used • Ligo • dedicated and isolated clusters • condor batch scheduler • shared disk areas • some early usage of OSG resources Debreczeni Gergely - Tier-2 Workshop, Wien

  7. Computing infrastructure • Virgo • official VO of the EGI Grid • 34 sites (Bologna, Roma, Lyon, etc... supports) • France, Italy, Hungary, Poland, Germany • cc. 150 member • not using up its allocated resources • Ligo • much larger membership • cc. 6 clusters 10.0000 CPU • Great Britan, US, Germany • enough resource for most of the analysis, but peak usage problems Debreczeni Gergely - Tier-2 Workshop, Wien

  8. The Virgo Pilot framework • The well-known pilot job solution: • pilots are sent from the UI through the ordinary Grid submission scheme • pilot frame jobs awakened on the WNs connect back to the Pilot server (virgo-pilot-server.kfki.hu) • the formed condor pool is now able to accepts jobs from any condor client (Grid UI or laptop) • condor client AFS installation makes it very comfortable to use Debreczeni Gergely - Tier-2 Workshop, Wien

  9. The Virgo Pilot framework Ligo condor clusters connected to pilot pool via Condor - flocking Virgo EGI sites Ligo clusters Coordinated by RMKI Pilot server Debreczeni Gergely - Tier-2 Workshop, Wien

  10. Hierarchical workflows GW data analysis are expressed as hierarchical workflows the mapping of which to non-Condor batch systems is either non-trivial or very slow. The pegasus dispatcher and the pilot job solution successfully addresses this problem. Debreczeni Gergely - Tier-2 Workshop, Wien

  11. The Pegasus dispatcher Gravitational wave analysis workflows are expressed as condor DAGs or batch system independent abstract workflow description DAX-es. These descriptor are generated automatically by some script. Before submission to a specific cluster they can be subjected to re-organisation and re-groupping by the Pegasus job dispatcher. http://pegasus.isi.edu Debreczeni Gergely - Tier-2 Workshop, Wien

  12. Pilot pool policy configuration Policy configuration depends on various factors like batch system, data type, site policy, funding... • pilots running under SM's (mine) credentials • possibility of future usage of glexec • pilots are checking the queue and fetching jobs, • depending on the funding, they stay Idle if there is no job in the queue or terminating • when MaxWallClockTime - MaxJobRunningTime is reached they reconfigure themselves in order not to accept any more new job • virtual job slots for debugging and interactive ssh login • no firewall modification is necessary for incoming ports • negotiating interwall is set to 90 seconds -> instant job execution • x509 based authentication is considered Debreczeni Gergely - Tier-2 Workshop, Wien

  13. Data analysis and GPUs The pilot framework has its own priority handling, information system, scheduler and job dispatcher, checkpointing, resubmitting, etc. The DATA: The amount of data is much smaller than that of the HEP experiements (100 TB/ year), but its arithmetic density is far much higher. GPU acceleration: GPU enabled machines have been added to the cluster and advertised in the information system. Properly compiled jobs can make use of it ! http://gpu.kfki.hu Debreczeni Gergely - Tier-2 Workshop, Wien

  14. GPUs in the Virgo pilot pool FFT - 16 x SNR - 35 x Template generation - 40 x http://gpu.kfki.hu Debreczeni Gergely - Tier-2 Workshop, Wien

  15. Gergely Debreczeni (MTA KFKI RMKI) The GenaGrid project Tier-2 WLCG WorkshopHepy, Wien Debreczeni Gergely - Tier-2 Workshop, Wien

  16. The GenaGrid project • Phenotypes, genotypes: identifying associations, causal relations, dependencies and control mechanisms • Lot of observations huge number of possible graphs and models • Genom wide association studies (GAS) • Partial genom screening studies (PGSS) • The goal is the exploration of.. • the relevance of explanatory variables w.r.t the target variables • the interdependence of the explanatory variables Debreczeni Gergely - Tier-2 Workshop, Wien

  17. The GenaGrid project Debreczeni Gergely - Tier-2 Workshop, Wien

  18. The project goals • GenaGrid planner: assistance for planning genomics experiments • GenaGrid analyzer: support foranalyzing genomics data for experts, doctors, researchers and students • GenaGrid fusion: competence based interpretation of experimental results • GenaGrid pharma: pharmaceutical developments, 'tailor-made' pharmacy, auxiliary tool for industrial applications • GenaGrid adviser: consulting system for clinical geneticist • GenaGrid browser: open database for public domain results of genetical results Debreczeni Gergely - Tier-2 Workshop, Wien

  19. The GenaGrid consortium Debreczeni Gergely - Tier-2 Workshop, Wien

  20. The Monster: SGI ICE • The machine • 512 CPU (64 x 8 ) • Intel Xeon, X5365 @ 3 GHz • 16 GB mem/8 core • 10 TB Raid5 disk storage • Infiniband (40 Gb/s) blade connectvity • Software • RedHat Enterprise Linux • Condor and PBS batch scheduler, SGI MPI, Tempo cluster management, OpenMPI, SGI ProPack, etc... • Power • Water cooling • 37 KW peak power • 7 TeraFlop computing capatcity Debreczeni Gergely - Tier-2 Workshop, Wien

  21. The GenaGrid user portal • The portal • Java and Drupal based web portal interface • user registration • gsissh tunnel towards the ICE cluster • certificate and/or user/pass based authentication • job monitoring, logging and bookkeeping by means of APEL and/or CondorView • user file upload • storage of profiles, settings, results Debreczeni Gergely - Tier-2 Workshop, Wien

  22. The GenaGrid CA • The GenaGrid CA • Obtaining a certificate from NIIF is still too slow and over administrated. • Decision for setting up an internal GenaGrid CA • Certificates issued are used for authentication for the portal, authentication to the cluster • small number of users • registration is open and free • group leader approval is necessary • has to be replaced by EuGridPMA recognized CA when using BioMed Debreczeni Gergely - Tier-2 Workshop, Wien

More Related