Status of analysis MC farms Concezio Bozzi INFN
Status of analysis & MC farms Concezio Bozzi INFN Ferrara 30/08/2002 30/08/02 Concezio Bozzi (Ferrara)
The name of the game Three farms in Italy today: – “MC”: for official Simulation Production (formerly at Caspur, now at INFN Rome) – “Analysis”: a Tier B with Kanga data located at Caspur (Rome) – “Repro”: located in Padova, will reprocess all Babar Run 1+Run 2 data starting this summer 30/08/02 Concezio Bozzi (Ferrara)
INFN Farms in Rome Monte. Carlo Farm - Today - Upgrade Analysis Farm - Today - Upgrade Monte. Carlo Farm has been moved June 15 th from Caspur to INFN (Rome) The Analysis Farm is still at Caspur 30/08/02 Concezio Bozzi (Ferrara)
Monte. Carlo Farm today - 1 server Linux, dual cpu, PIII 800 MHz, 512 MB (NFS and lock servers, batch queues, Moca. Espresso) - 14 Linux clients, dual cpu, PIII 800 MHz, 768 MB - 2 Array RAID EIDE : 2 x 0, 5 = 1 TB Event rate: 3. 5 M events/month 30 M events in 1 year 30/08/02 Concezio Bozzi (Ferrara)
Monte. Carlo Farm: jobs 30/08/02 Concezio Bozzi (Ferrara)
Farm Monte. Carlo: comparisons …
Farm Monte. Carlo: comparisons … 19. 4 M events from August 15 th 2001 to June 15 th 2002
Farm Monte. Carlo: comparisons … we are here !
Monte. Carlo Farm: CPU SCSI problems stop/start production re-validation
Monte. Carlo Farm: disk & net
Monte. Carlo Farm: Upgrades 2002: increase production to 6 -8 Mevents/month - clone Linux farm - 17 2 -CPUs, 1. 26 GHz, 1 GB RAM: installing now - Server and disk (1 TB) ordered - use Analysis farm resources when available -Problems with a Sun disk (1 TB), recovering… 2003: increase production to 20 M events/month - more CPUs (150*30 Spec. Int 95 ~ 35 1. 6 GHz 2 x. CPUs) - use repro farm whenever possible 30/08/02 Concezio Bozzi (Ferrara)
Analysis Farm: Today - 5 Sun E 450, 4 x 400 MHz, 2 GB (NFS data server) 15 Linux clients, dual cpu, PIII 1 GHz, 1 GB: 1 Sun Ultra 10: lock server 1 Sun Ultra 10: monitoring (to be dismissed soon) Disk space: 9 TB for Kanga Data: All. Events + 8 streams. The complete (99 -02) dataset is available - MC: ~650 M events available - Private & Toy MC - SP MC production as “infn 2” (lower priority wrt analysis) 30/08/02 Concezio Bozzi (Ferrara)
Linux SUN Analysis Farm: users 30/08/02 Concezio Bozzi (Ferrara)
Analysis Farm: jobs Linux CPU efficiency Running jobs Pending jobs 30/08/02 Concezio Bozzi (Ferrara)
Analysis farm: Upgrade 2002: - 17 Linux clients, dual cpu (in hand) - 3 TB disk space (ordered): 15 TB total This will be enough until March 2003: - cpu power x 3: 210 30 Spec. Ints 95 (50 1. 6 GHz 2 x. CPUs) - Disk: from Padova (? ) - maintain Kanga until end of reprocessing, (spring 03) - Next: Computing Model Working Group OBJY vs. non-OBJY Event Store, MINI vs. MICRO, etc… 30/08/02 Concezio Bozzi (Ferrara)
Babar-Grid - Some activity going on in Italy - Define and implement a Grid-scheme for MC production - Installing/testing on the INFN-Grid Ferrara testbed 30/08/02 Concezio Bozzi (Ferrara)
Farmers …. - Ferrara: D. Andreotti, V. Azzolini, C. Bozzi, E. Luppi + CS students - Padova: A. Ceseracciu, A. Crescente, A. Dorigo, F. Galeazzi, M. Marzolla, M. Morandin, R. Stroili, G. Tiozzo, G. Vedovato - Rome: C. Bulfon, F. Safai Tehrani - Trieste: G. Della Ricca 30/08/02 Concezio Bozzi (Ferrara)
- Slides: 17