LHCb datasets and processing stages LHCb datasets and
LHCb datasets and processing stages
LHCb datasets and processing stages 200 Hz 100 k. B 200 k. B 150 k. B 0. 1 k. B 70 k. B 0. 1 k. B 10 k. B
Data Rates DAQ Reconstruction 14 MB/s 20 MB/s Raw 4 MB/s Reprocessing 20 MB/s Physics analysis EVTEC 14 MB/s Reconstructed Analysis 660 MB/s Simulation Tags 35 MB/s DATA REPOSITORY 360 MB/s User Analysis J. Harvey , 10 Nov 1998 Slide 3
Data Volumes Assume run for 107 secs each year Data type a) Raw data b) Interesting physics data c) Simulated data (bx 10) d) Reconstructed Raw e) Reconstructed Sim f) Analysis data TOTAL EVTEC Rate /sec 20 MB/s 10 MB/s 14 MB/s 7 MB/s 4 MB/s J. Harvey , 10 Nov 1998 Volume /year 200 TB 100 TB 140 TB 70 TB 40 TB 560 TB Slide 4
CPU Resources Assumption is that the cpu power / processor in 2004 will be ~4000 Mips CPU Resources at the experiment data production and triggering reconstruction 1, 400 x 1000 Mips 800 x 1000 Mips Total 350 nodes 200 nodes 550 nodes Event simulation and reprocessing (4 month duty cycle) monte carlo production reprocessing, event tag creation 1, 400 x 1000 Mips 800 x 1000 Mips Total 350 nodes 200 nodes 550 nodes 10 groups 107 k. Ms/refinement/week 100 107 k. Ms/job *2 /week Total 46 nodes 91 nodes 137 nodes Physics Analysis physics production user analysis EVTEC J. Harvey , 10 Nov 1998 Slide 5
CPU Farms q Setup low maintenance commodity processor farms ã PCs running NT or Linux ã central server, rack-mounted screenless nodes q Automated massive installation, upgrade, booting q Remote disk access by many satellites to central server q Remote management and monitoring ã centralised error logs, alarms ã performance ã node failure detection and recovery q Tools for messaging q Production facilities - batch, scripts, bookkeeping, tape management Common LHC project - Filter Farms EVTEC J. Harvey , 10 Nov 1998 Slide 6
Data management q q q Technology Database Technology - ODBMS Mass Storage - HPSS Datasets Event repository Parameter descriptions - detector, Secondary data - calibrations, alignment, output from quality checks EVTEC J. Harvey , 10 Nov 1998 Slide 7
Computing Model - CE(R)NTRIC EVTEC J. Harvey , 10 Nov 1998 Slide 8
Computing Model - DISTRIBUTED EVTEC J. Harvey , 10 Nov 1998 Slide 9
Computing Model - To be studied MONARC • study access patterns • simulation • technology watch EVTEC J. Harvey , 10 Nov 1998 Slide 10
- Slides: 10