LPSC Grenoble Benjamin Trocm ATLAS France CAFPAF meeting
LPSC Grenoble Benjamin Trocmé ATLAS France CAF-PAF meeting IPNL Lyon, 27 November 2018 ATLAS France CAF-PAF meeting, 27 th November 2018 1
Team • Composition of the team • 10 staff physicists, 2 post docs, 2 Ph. D students, 3 computing engineers • Recent / ongoing analyses: tt. H, HH, gg resonances, ttbar resonances • Involvement of the team in computing • CRC : 0. 2 FTE (physicist) • LPSC Tier 2 : 0. 1 FTE (physicist) + 0. 5 FTE (IE/IR) • LCG: 0. 15 FTE (physicist) + 1 FTE (IE/IR) • Involvement of the team in software • AMI development : 0. 15 FTE (physicist) + 3 FTE (IE/IR) • Jet reconstruction : 0. 4 FTE (physicist) ATLAS France CAF-PAF meeting, 27 th November 2018 2
Computing resources in 2019 • « Grid » resources (should correspond to Tier 2 pledged resources) • storage = 850 TB (ATLAS – with ALICE: 1. 2 PB) • computing = 13 325 HS 06 (ATLAS – with ALICE : 17 765 HS 06) • Other « grid » resources (if available, correspond to non pledged resources) - storage = 85 TB i. e LOCALGROUPDISK • Other local (lab, university) resources (whatever is non grid) • storage : 3 local disks (~45 TB) • computing (servers, clusters, etc. . . ): 13 “old” servers (former Tier 2 servers) available for all groups. • high performance computing (HPC, GPU …. ): CIMENT • Gricad : local UMS collecting various resources (CIMENT, SUMMER…) ATLAS France CAF-PAF meeting, 27 th November 2018 3
Analysis and needs • gg high mass resonances (750 Ge. V bump) • • Benefiting from Ciment infrastructure to produce high stats Monte Carlo (DIPHOX background): 112 000 CPU hours Event scanning: need to rerun on RAW data to produce the ESD (after event picking in mini-x. AOD). • Few hours to skim mini-x. AOD, one day for event picking, then few minutes for processing. Processing at CERN/CC-IN 2 P 3/locally HH HL-LHC prospects (CERN yellow report and beyond) • CERN Yellow report: event generation (no full sim) on all facilities: • Mainly at CC-IN 2 P 3 : “short” jobs, local batch (~6800 CPU hours in last 12 month), storage on sps (1. 5 TB) and hpss (1 TB) • LPSC interactive nodes: few long jobs (> 5 days) • Marginally on CERN interactive nodes for private MC production : ~200 CPU hours and 10 -15 GB storage on AFS • Recent Matrix Element Method development (Mad. Graph/Mad. Event) • Very CPU consuming. Local development on LPSC machines, production at CC-IN 2 P 3 (150 000 CPU hours in 2 months in local batch). • Storage at CC-IN 2 P 3 (sps) reasonable (<1 TB so far). ATLAS France CAF-PAF meeting, 27 th November 2018 4
Analysis and needs (2) • High mass ttbar resonances • • Mainly local analysis • LOCALGROUPDISK: 10 TB + local disks: 1 TB • local cluster: 2 x 1500 CPU hours • Input data : MC+data AOD/d. AOD. Validation tests on lxplus. d. AOD production on grid Good points: local, flexible Difficulties: instable accesses to LOCALGROUPDISK • tt. H analysis • • • Commitment in Htop->ML ntuple production: Grid production Very large (even skimmed) ntuples to compute systematics : ~800 GB per production Analysis either at CERN or at CC-IN 2 P 3 Main limitation : slow data access (few hours to overnight) at CERN (eos), hence major benefit running at CC-IN 2 P 3 but requiring local copy of ~800 GB. Would benefit from more space at CC-IN 2 P 3 to have at least 2 production at a time. ATLAS France CAF-PAF meeting, 27 th November 2018 5
Near future • Activities of the team • Ending tt. H, ttbar, gg. • New developments in HH (Matrix elements) requiring potential extensive computing (Jet machine learning perhaps later). • Ramping up LLP analysis • Resources and needs • No Tier 2 growth expected so far • 165 TB Tier 2 disks : to be reused for local storage / DOMAFR? Not yet debated. • New batch system Ht-Condor now installed for local servers. • Improvements ideas but still restricted to manpower constraints. ATLAS France CAF-PAF meeting, 27 th November 2018 6
Backup • CIMENT performances: • https: //ciment. ujf-grenoble. fr/wikipub/index. php/HPC_hardware • • • Total number of cores: 6592 Total memory: 33. 616 TB Total disk space: 2893. 17 TB Total op/s: 168. 7026 TFlop/s Accelerators op/s *: 24. 38 TFlop/s ATLAS France CAF-PAF meeting, 27 th November 2018 7
- Slides: 7