80 likes | 177 Views
Status of CAF. Marco MEONI Jan Fiete GROSSE-OETRINGHAUS CERN - Offline Week – 28.10.2009. Proof w orker xrootd disk server. Proof w orker xrootd disk server. local disk. local disk. CERN Analysis Facility (CAF). CASTOR MSS. AliEn SEs. Direct Access. Staging. CAF.
E N D
Status of CAF Marco MEONI Jan Fiete GROSSE-OETRINGHAUS CERN - Offline Week – 28.10.2009
Proof worker xrootd diskserver Proof worker xrootd diskserver local disk local disk CERN Analysis Facility (CAF) CASTOR MSS AliEn SEs DirectAccess Staging CAF Authentication Proof master,xrootd redirector LDAP ...
SW • ROOT v5-24-00a • ROOT v5-25-02 in preparation • AliRoot v4-17-Release • deployed to AFS and enabled via meta par-files containing no source code • AF-v4-17.par (loads VMC, Net, Tree, Physics, STEERBase, ANALYSIS, ESD, AOD, ANALYSISalice) • AF-v4-17-rec.par (enables the full AliRoot) • New features • Direct access to Grid files (read/write) • Raw reconstruction (see Cvetan’s talk) How to use CAF at http://aliceinfo.cern.ch/Offline/Activities/Analysis/CAF/index.html
HW • Very few interventions on the CAF machines over the last 4 months • 30 more machines in two batches of 15 • one by end November • one by beginning of next year with similar configuration
CAF Usage • Up to 21 users in parallel • Not assigned users will be refused access to CAF in the future • They receive an email every hour • CAF user ’foo' running in group 'default' • Number of groups: 20 • Number of unique users: 154(a user can belong to several groups)
Dataset Dataset URI | # Files | Default tree | # Events | Disk | Staged … /COMMON/COMMON/LHC08c11_10TeV_0.5T | 1850 | /esdTree | 277500 | 129 GB | 100 % /COMMON/COMMON/LHC08c12_0.9TeV_0.5T | 2126 | /esdTree | 318900 | 101 GB | 100 % /COMMON/COMMON/LHC08c13_10TeV_0T | 2312 | /esdTree | 346350 | 213 GB | 99 % /COMMON/COMMON/LHC08c14_0.9TeV_0T | 1646 | /esdTree | 246900 | 94 GB | 100 % /COMMON/COMMON/LHC08c15_10TeV_0.5T_Phojet | 1526 | /esdTree | 222300 | 98 GB | 97 % /COMMON/COMMON/LHC08c16_0.9TeV_0.5T_Phojet| 1415 | /esdTree | 201750 | 71 GB | 95 % /COMMON/COMMON/LHC08c17_10TeV_0T_Phojet | 1314 | /esdTree | 180750 | 109 GB | 91 % /COMMON/COMMON/LHC08c18_0.9TeV_0T_Phojet | 1554 | /esdTree | 222750 | 96 GB | 95 % /COMMON/COMMON/LHC09a14_0.9TeV_0.5T | 1349 | /esdTree | 222780 | 38 GB | 99 % /COMMON/COMMON/LHC09a15_0.9TeV_0T | 1093 | /esdTree | 212600 | 42 GB | 97 % /COMMON/COMMON/LHC09a2_run8000X | 9795 | /esdTree | 683850 | 1 TB | 46 % /COMMON/COMMON/LHC09a4_10TeV | 6831 | /HLTesdTree | 1343400 | 486 GB | 98 % /COMMON/COMMON/LHC09a4_10TeV_200k | 989 | /HLTesdTree | 194000 | 70 GB | 98 % /COMMON/COMMON/LHC09a4_run8010X | 3042 | /HLTesdTree | 603400 | 250 GB | 99 % /COMMON/COMMON/LHC09a4_run8100X | 2947 | /HLTesdTree | 587800 | 154 GB | 99 % /COMMON/COMMON/LHC09a4_run81011 | 989 | /HLTesdTree | 197600 | 52 GB | 99 % /COMMON/COMMON/LHC09a4_run8101X | 7744 | /esdTree | 1547000 | 408 GB | 99 % /COMMON/COMMON/LHC09a4_run8158X | 9683 | /HLTesdTree | 1936600 | 512 GB | 100 % /COMMON/COMMON/LHC09a4_run8159X | 5745 | /HLTesdTree | 1149000 | 303 GB | 100 % /COMMON/COMMON/LHC09a5_run9000X | 8125 | /HLTesdTree | 1620600 | 452 GB | 99 % /COMMON/COMMON/LHC09a6_run9200X | 5791 | /HLTesdTree | 1148600 | 488 GB | 99 % /COMMON/COMMON/LHC09b10_0.9TeV_0.5T_Phojet| 1935 | /esdTree | 282000 | 75 GB | 72 % /COMMON/COMMON/LHC09b11_0.9TeV_0T_Phojet | 1176 | /esdTree | 232000 | 73 GB | 98 % /COMMON/COMMON/LHC09b12_7TeV_0.5T | 298 | /esdTree | 59600 | 22 GB | 100 % /COMMON/COMMON/LHC09b13_7TeV_0T | 1533 | /esdTree | 276600 | 127 GB | 90 % /COMMON/COMMON/LHC09b14_7TeV_0.5T_Phojet | 1157 | /esdTree | 217800 | 76 GB | 94 % /COMMON/COMMON/LHC09b15_7TeV_0T_Phojet | 1104 | /esdTree | 175400 | 76 GB | 79 % /COMMON/COMMON/LHC09b8_0.9TeV_0.5T | 468 | /esdTree | 93600 | 21 GB | 100 % /COMMON/COMMON/LHC09b9_0.9TeV_0T | 1883 | /esdTree | 275800 | 81 GB | 73 % /COMMON/COMMON/tutorial_small | 200 | /esdTree | 20000 | 8 GB | 100 % … #DS has increased a lot and users should also remember cleanup
CPU Usage • CAF usage is significantly increased • Group default is not any more the most relevant Average CPU Usage = 4.2% Average CPU Usage = 4.8% 9 months, 2.47x109 secs CPUtime=1.03x108 secs 4 months, 1.1x109 secs CPUtime=0.53x108 secs
Overview • CAF • Reached a proved stability, few reboots • Current SW suite includes ROOT v5/24-00a + AliRoot v4-17-Release • User support • Monthly tutorials at CERN, ~700 people attended so far • Mailing list: alice-project-analysis-task-force@cern.ch • Web page: http://aliceinfo.cern.ch/Offline/Analysis/CAF • Under development • Top hits in Gerri’s talk • Regular biweekly meeting among CAF/PROOF/Grid experts