The EDG Testbed Deployment Details The European Data
The EDG Testbed Deployment Details The European Data. Grid Project http: //www. eu-datagrid. org
Contents u EDG Logical Machine Type u Current EDG Testbed u Current INFN-GRID Testbed u Tutorial Testbed Infrastructure The EDG Testbed Deployment Details - n° 2
EDG Logical Machine Types 1. User Interface (UI) 4. Computing Element (CE) n Gatekeeper (Front-end Node) n 2. Resource Broker (RB) 3. Information Service (IS) Worker Nodes (WN) 5. Storage Element (SE) 6. Replica Catalog (RC) The EDG Testbed Deployment Details - n° 3
CE and WN: LRMS Computing Element : gatekeeper & LRMS server Working Node : LRMS client Local Resource Management System example: Portable Batch System (PBS) CE: WN: pbs_server pbs_mom pbs_sched pbs_mom On the CE node you can also run a mom The EDG Testbed Deployment Details - n° 4
Testbed Site Configuration UI User Interface CE Computing Element SE WN WN Worker WN Node Worker Node Storage Element Minimal Testbed LCFG Proxy RB Installation Server Proxy renewal Resource Broker MDS RC Meta Data Server Replica Catalog The EDG Testbed Deployment Details - n° 5
Services per Machine Type Deamon UI IS CE WN SE RC RB Globus Gatekeeper - - - Replica Catalog - - - GSI-enabled FTPd - - Globus MDS - - - - Info-MDS - - - - Resource Broker - - - Job Submission - - - Information Index - - - Logging & Bookkeeping - - - Local Logger - - CRL Update - - Grid mapfile Update - - RFIO - - - GDMP - - - (frontend) The EDG Testbed Deployment Details - n° 6
Current EDG Testbed Nordu. Grid Testbed 1 EDG sites Reference site: CERN Manchester NIKHEF RAL 21 sites Lyon Core Sites CERN Italy: • Bologna • Cagliari • Catania • Milano • Padova • Parma • Pisa • Roma • Torino (Oct 2002) Nordu. Grid: • Bergen • Copenhage n • Helsinki • Lund • Oslo • Stockholm • Uppsala Nordu. Grid is as a Grid infrastructure in the Nordic countries About 400 machines are available. Most of them are dual processor. Some machines are only used for EDG. They are split into: - Production - Development The EDG Testbed Deployment Details - n° 7
Example CERN Testbed Structure http: //marianne. in 2 p 3. fr/datagrid/giis/cern-status. html uover u 2 100 nodes Major and several minor testbeds u. Production Testbed ("application test site" ) 2 UI 2 SE 1 CE 79 WN 2 RB 1 MDS 1 PX 1 RC u. Development EDG 1_3_4 Testbed 1 UI 1 SE 1 CE 1 WN 1 RB 1 MDS 1 PX 1 RC EDG 1_3_4 u. Infrastructure u 2 NFS server with 1 Tbyte mirrored disk u. NIS server to manage u. LCFG user accounts servers for installation The EDG Testbed Deployment Details - n° 8
CERN Production Testbed NIS NFS SE lxshare 072 d Lxshare 072 d+73 d lxshare 0393 Provides: /home/griduserxxx /flatfiles/SE 00/VOXX CE UI lxshare 0399 testbed 010 NIS Domain Oct 2002 WNs lxshare 0348 -365 lxshare 0219 -221 lxshare 0377 LCFG lxshare 0371 Installs and configures (almost) all nodes Proxy MDS RB 1 RB 2 RC lxshare 0375 lxshare 0225 lxshare 0382 lxshare 0383 lxshare 0226 The EDG Testbed Deployment Details - n° 9
Example IS Content Site: NIKHEF ------------------------CE tbn 09. nikhef. nl: 2119/jobmanager-pbs-qlong: - PBS queue "qlong" with 96 hours time limit - Software installed: ATLAS-3. 2. 1 ALICE-3. 07. 01 LHCb-1. 1. 1 IDL-5. 4 NIKHEF D 0 MCC-0. 1 -4 - There are 0 jobs running and 0 waiting, with 24 CPUs free Close SE tbn 03. nikhef. nl with mount point /flatfiles -------------------------CE tbn 09. nikhef. nl: 2119/jobmanager-pbs-qshort: - PBS queue "qshort" with 240 minutes time limit - Software installed: ATLAS-3. 2. 1 ALICE-3. 07. 01 LHCb-1. 1. 1 IDL-5. 4 NIKHEF D 0 MCC-0. 1 -4 -------------------------SE tbn 03. nikhef. nl close to 2 CEs: - tbn 09. nikhef. nl: 2119/jobmanager-pbs-qshort - tbn 09. nikhef. nl: 2119/jobmanager-pbs-qlong - VOs supported: alice, atlas, lhcb, biomedical, earthob, iteam (wpsix) - gridftp on port 2811 - rfio on port 3147 - file - 29216 Mb of free space - There are 0 jobs running and 0 waiting, with 24 CPUs free Close SE tbn 03. nikhef. nl with mount point /flatfiles The EDG Testbed Deployment Details - n° 10
Outlook u EDG Testbed 1. x contains basic services u Plan for a hierarchy of testbeds n Developers testbeds for individual WPs n Development testbed for integration (time shared between WPs) n Certification testbed for tests and certification (run by LCFG) n Application testbed to allow applications to do final tests The EDG Testbed Deployment Details - n° 11
Current INFN-GRID Testbed 19 SITES • • • • • Bari Bologna CNAF Cagliari Catania Ferrara Genova Lecce LNL Milano Napoli Padova Parma Pavia Pisa Roma 1 Roma 3 Torino Trieste The EDG Testbed Deployment Details - n° 12
INFN-GRID Testbed Infrastructure CNAF RB IS UI SE CE WNs Catania UI SE CE WNs Padova UI SE CE WNs Torino UI SE CE WNs Milano UI SE CE WNs Pisa UI SE CE WNs Bari UI CE WNs Bologna UI CE WNs Cagliari UI SE CE WNs Ferrara UI SE CE WNs Genova SE CE Lecce UI SE CE WNs LNL UI SE CE WN Napoli SE CE Parma 2*CE WN Pavia UI SE CE WNs Roma 1 SE 2*CE Roma 3 CE Trieste CE WNs EDG 1_2_3 13 UI 14 SE 22 CE 30 WN The EDG Testbed Deployment Details - n° 13
Example IS Content: CE Site: Torino INFN common CE grid 002. to. infn. it: 2119/jobmanager-pbs-medium: - pbs queue "medium" with 60 minutes time limit -Software installed: CMS-1. 1. 0 ATLAS-3. 2. 1 ALICE-3. 07. 01 LHCb-1. 1. 1 IDL-5. 4 CERN-MSS CMSIM-125 ORCA-6. 0. 2 INFN TORINO ALIEN EDG-TEST - There are 0 jobs running and 0 waiting, with 6 CPUs free Close SE grid 001. to. infn. it with mount point /flatfiles/SE 00 INFN site specific CE grid 002. to. infn. it: 2119/jobmanager-pbs-long: - pbs queue "long" with 12 hours time limit -Software installed: CMS-1. 1. 0 ATLAS-3. 2. 1 ALICE-3. 07. 01 LHCb-1. 1. 1 IDL-5. 4 CERN-MSS CMSIM-125 ORCA-6. 0. 2 INFN TORINO ALIEN EDG-TEST - There are 0 jobs running and 0 waiting, with 6 CPUs free Close SE grid 001. to. infn. it with mount point /flatfiles/SE 00 Queue time limit CE grid 002. to. infn. it: 2119/jobmanager-pbs-short: - pbs queue "short" with 10 minutes time limit -Software installed: CMS-1. 1. 0 ATLAS-3. 2. 1 ALICE-3. 07. 01 LHCb-1. 1. 1 IDL-5. 4 CERN-MSS CMSIM-125 ORCA-6. 0. 2 INFN TORINO ALIEN EDG-TEST Job in queue - There are 0 jobs running and 0 waiting, with 6 CPUs free Close SE grid 001. to. infn. it with mount point /flatfiles/SE 00 CE grid 002. to. infn. it: 2119/jobmanager-pbs-infinite: - pbs queue "infinite" with 27 hours time limit -Software installed: CMS-1. 1. 0 ATLAS-3. 2. 1 ALICE-3. 07. 01 LHCb-1. 1. 1 IDL-5. 4 CERN-MSS CMSIM-125 ORCA-6. 0. 2 INFN TORINO ALIEN EDG-TEST - There are 0 jobs running and 0 waiting, with 6 CPUs free CE nfs mount Close SE grid 001. to. infn. it with mount point /flatfiles/SE 00 The EDG Testbed Deployment Details - n° 14
Example IS Content: SE Site: Torino SE grid 001. to. infn. it close to 4 CEs: - grid 002. to. infn. it: 2119/jobmanager-pbs-short supported VO path close CE list - grid 002. to. infn. it: 2119/jobmanager-pbs-medium - grid 002. to. infn. it: 2119/jobmanager-pbs-long - grid 002. to. infn. it: 2119/jobmanager-pbs-infinite -VOs supported: alice: /flatfiles/SE 00/alice atlas: /flatfiles/SE 00/atlas cms: /flatfiles/SE 00/cms lhcb: /flatfiles/SE 00/lhcb biome: /flatfiles/SE 00/biome eo: /flatfiles/SE 00/eo wpsix: /flatfiles/SE 00/wpsix tutor: /flatfiles/SE 00/tutor - gridftp on port 2811 gridftp port number - rfio on port 3147 - file free storage - 32444 Mb of free space The EDG Testbed Deployment Details - n° 15
Tutorial Testbed Infrastructure II RC CE + SE Terminal UI RB The EDG Testbed Deployment Details - n° 16
Further Information u EDG Testbed homepage: http: //marianne. in 2 p 3. fr u INFN-GRID Testbed homepage: http: //server 11. infn. it/testbed-grid/ The EDG Testbed Deployment Details - n° 17
- Slides: 17