RDMS CMS data processing and analysis workflow CMS

  • Slides: 18
Download presentation
RDMS CMS data processing and analysis workflow CMS Tier 1 an Tier 2 Sites

RDMS CMS data processing and analysis workflow CMS Tier 1 an Tier 2 Sites V. Gavrilov 1, I. Golutvin 2, V. Ilyin 3, O. Kodolova 3, V. Korenkov 2, E. Tikhonenko 2, S. Shmatov 2 , V. Zhiltsov 2 1 - Institute of Theoretical and Experimental Physics, Moscow, Russia 2 - Joint Institute for Nuclear Research, Dubna, Russia 3 – Skobeltsyn Institute of Nuclear Physics, Moscow, Russia NEC’ 2011 Varna, Bulgaria, September 12 -19, 2011 1

Composition of the RDMS Collaboration RDMS - Russia and Dubna Member States CMS Collaboration

Composition of the RDMS Collaboration RDMS - Russia and Dubna Member States CMS Collaboration Russian Federation Dubna Member States Armenia Georgia · Institute for High Energy Physics, Protvino · Yerevan Physics Institute, · High Energy Physics Institute, Tbilisi State University, Tbilisi · Institute for Theoretical and Experimental Yerevan · Institute of Physics, Academy Physics, Moscow of Science , Tbilisi · Institute for Nuclear Research, RAS, Moscow · Moscow State University, Institute for Belarus Ukraine Nuclear Physics, Moscow · Byelorussian State University, · Institute of Single Crystals of · Petersburg Nuclear Physics Institute, RAS, Minsk National Academy of Science, St. Petersburg · Research Institute for Nuclear Kharkov · P. N. Lebedev Physical Institute, Moscow Problems, Minsk · National Scientific Center, · National Centre for Particle Associated members: Kharkov Institute of Physics · High Temperature Technology Center of and High Energy Physics, and Technology, Kharkov Research & Development Institute of Power Minsk · Kharkov State University, · Research Institute for Applied Kharkov Engineering, Moscow Physical Problems, Minsk · Russian Federal Nuclear Centre – Scientific Research Institute for Technical Physics, Bulgaria Snezhinsk Uzbekistan · Institute for Nuclear Research · Myasishchev Design Bureau, Zhukovsky · Institute for Nuclear Physics, JINR National Research Institute, St. and Nuclear Energy, BAS, · Electron, UAS, Tashkent ·Petersburg Joint Institute for Nuclear Research, Dubna Sofia · University of Sofia, Sofia the RDMS Collaboration was founded in Dubna in September 1994 2

RDMS Participation in CMS Construction RDMS Full Responsibility ME 1/ 1 RDMS Participation ME

RDMS Participation in CMS Construction RDMS Full Responsibility ME 1/ 1 RDMS Participation ME SE EE HE HF FS 3

RDMS Participation in CMS Project Full responsibility including management, design, construction, installation, commissioning, maintenance

RDMS Participation in CMS Project Full responsibility including management, design, construction, installation, commissioning, maintenance and operation for: Endcap Hadron Calorimeter, HE 1 st Forward Muon Station, ME 1/1 Participation in: Forward Hadron Calorimeter, HF Endcap ECAL, EE Endcap Preshower, SE Endcap Muon System, ME Forward Shielding, FS 4

RDMS activities in CMS q Design, production and installation H (150 Ge. V) Z

RDMS activities in CMS q Design, production and installation H (150 Ge. V) Z 0 Z 0 4 q Calibration and alignment q Reconstruction algorithms q Data processing and analysis q Monte Carlo simulation 5

RDMS CMS T 2 association Now Future interest Analysis Groups Exotica: T 2_RU_JINR Exotica:

RDMS CMS T 2 association Now Future interest Analysis Groups Exotica: T 2_RU_JINR Exotica: T 2_RU_INR HI: T 2_RU_SINP Electroweak: T 2_UA_KIPT QCD: Top: FWD: Object/Performance Groups Muon: T 2_RU_JINR Jet. MET-HCAL: T 2_RU_ITEP T 2_RU_PNPI T 2_RU_SINP T 2_RU_IHEP e-gamma-ECAL: T 2_RU_INR 6

Physics groups association RU_JINR - Muons and Exotica RU_SINP - Heavy Ions RU_ITEP -

Physics groups association RU_JINR - Muons and Exotica RU_SINP - Heavy Ions RU_ITEP - Jet. MET/HCAL UA_KIPT - Electroweak 7

RDMS CMS in Physics analysis Forward Physics Observation of diffraction in minbias events at

RDMS CMS in Physics analysis Forward Physics Observation of diffraction in minbias events at LHC Study of 2 jet production in hard single diffraction Study of 2 jet production in central diffraction Search for BFKL effects at di-jet production Higgs Search for Higgs bosons in decays into 2 photons, 4 leptons, 2 leptons and 2 jets, 2 leptons and 2 neutrinos QCD Measurement of the gamma+jet cross-sections Study of Bose-Einstein correlations Study of jet shapes Study of jet fragmentation EWK Measurement of DY muon pair production Measurement of forward-backward asymmetry in muon pair production Measurement of triple boson couplings Top physics Observing the t-channel single top process SUSY Search for sleptons and lepton flavor number violation Exotics Search for heavy neutrino and WR Search for new resonances (extra dimensions, Z’ and other exotic states) in DY Search for non-resonance di-muon signals from ADD and compositeness Heavy Ion QGP hard probes (heavy quarkonia and jets) and soft probes (elliptic flow) SINP MSU IHEP, SINP MSU, Erevan IHEP, ITEP, SINP, Erevan PNPI, ITEP, INR JINR, ITEP, MSU, Kharkov JINR, ITEP, SINP MSU, ITEP JINR, Minsk, Gomel JINR Minsk IHEP, SINP INR JINR SINP MSU, LPI 8

CMS T 2 requirements (before April, 2011) Basic requirements to CMS VO T 2

CMS T 2 requirements (before April, 2011) Basic requirements to CMS VO T 2 sites for Physics group hosting: a) info on contact persons responsible for site operation b) site visibility (BDII) c) availability of CMSSW actual version d) regular file transfer test “OK” e) Certified links with CMS T 1: 2 up and 4 down f) CMS job robot test “OK” g) disk space ~ 150 -200 TB for: - central space (~30 TB) - analysis space (~60 -100 TB) - MC space (~20 TB) - local space (~30 -60 TB) - local CMS users space (~2 TB per user) h) CPU resources ~ 3 KSI 2 K per 1 TB disk space, 2 GB memory per job 9 9

T 2 readiness requirements • Site visibility and CMS VO support • Availability of

T 2 readiness requirements • Site visibility and CMS VO support • Availability of disk and CPU resources • Daily SAM availability > 80% • Daily JR-MM efficiency > 90% • Commissioned (active) links TO Tier-1 sites ≥ 2 • Commissioned (active) links FROM Tier-1 sites ≥ 4 10

RDMS CMS T 2 Readiness (July, 2011) 11

RDMS CMS T 2 Readiness (July, 2011) 11

Status of Readiness (14 September, 2011) 12

Status of Readiness (14 September, 2011) 12

Normalized CPU time (in 1 K. SI 2 K. Hours) consumed by the CMS

Normalized CPU time (in 1 K. SI 2 K. Hours) consumed by the CMS sites September, 2010 – August, 2011) In total 283, 729, 684 K. SI 2 K. Hours 13

Total Number of CMS Jobs at RDMS CMS sites January, 2010 – August, 2010

Total Number of CMS Jobs at RDMS CMS sites January, 2010 – August, 2010 and January, 2011 – August, 2011 1 747 182 jobs 5. 8% 2 253 116 jobs 8. 7% 14

Job Summary at RDMS CMS Sites for 2011 as in the CMS Dashboard Job

Job Summary at RDMS CMS Sites for 2011 as in the CMS Dashboard Job Status per Sites Site Activity Job Efficiency 15

PHEDEX Transfer Rate&Transfer Volumes for RDMS CMS sites (Oct. 2010 -Sept. 2011) 16

PHEDEX Transfer Rate&Transfer Volumes for RDMS CMS sites (Oct. 2010 -Sept. 2011) 16

JINR-KIPT Common Activities in CMS Computing Support Cooperation between JINR and KIPT (Kharkov, Ukraine)

JINR-KIPT Common Activities in CMS Computing Support Cooperation between JINR and KIPT (Kharkov, Ukraine) has been supported by 2 grants of Russian Foundation for Basic Research (RFBR) and Ukrainian Academy of Science: § 08 -07 -90410 -Ukr_a (2008 -2009 гг. ) “Preparation of LIT JINR (Dubna) and NSC KIPT (Kharkov) computing centers for CMS (CERN) distributed data analysis on the base of grid technologies” – completed (see: Bunetsky O. O. et al. , Preparation of NSC KIPT and JINR Grid-Infrastructures for Data Analysis at the CMS Experiment (CERN), P 11 -2010 -11, Dubna, 2010, http: //www 1. jinr. ru/Preprints/2010/011%28 P 11 -2010 -11%29. pdf) § 10 -07 -90400 -Ukr_а (2010 -2011 гг. ) “Support and development of LIT JINR and NSC KIPT grid-infrastructures for CMS distributed data processing during the first two years of LHC operation” – in a progress 17

Summary IHEP, INR, ITEP, JINR, PNPI, SINP and UA_KIPT are in a stable state

Summary IHEP, INR, ITEP, JINR, PNPI, SINP and UA_KIPT are in a stable state RRC_KI – was not in a stable state but by the moment the situation has been significantly improved Current task is to define status of the RDMS CMS sites in context of the new CMS requirements to CMS T 2 18