LargeScale Distributed Computing in the Netherlands an overview
Large-Scale Distributed Computing in the Netherlands an overview David Groep, NIKHEF
What is Dutch. Grid? • collaboration of 12 organisations • established in 2000 • functions as a platform, getting manpower & hardware from partner orgs • major contributors Virtual Laboratory Project (ICES/KIS-II) – ASCI (5 combined Dutch CS Faculties) – Foundation NCF (NWO – natl research council) – NIKHEF (EDG) – WTCW
Dutch. Grid Sites WCW Amsterdam ASTRON, JIVE NIKHEF SARA Uv. A AMOLF CWI Amsterdam Telin Leiden Delft KNMI Utrecht Nijmegen WCW VU Dutch. Grid site map 20021104 David Groep, NIKHEF
Resources • ASCI DAS-2 (VU, Uv. A, Leiden, TUDelft, Utrecht) – 200 dual P-III 1 GHz CPUs – homogeneous clusters, 5 locations • NIKHEF Data. Grid clusters – 75 dual P-III ~ 1 GHz – 1 Gb/s IPv 4 + 1 Gb/s IPv 6 • NCF Grid national computer facilities foundation from NWO – – 66 node dual AMD-K 7 Fabric Research Cluster (NIKHEF) 32 node duals “production quality” cluster (SARA)* 10 Gb/s optical “lambda” test bed† … • Bio. ASP – various smaller O(10 node) clusters
Resources (cont. ) SARA – National HPC Centre • Processing – SGI 1024 processor MPP • Mass storage – Storage. Tek Near. Line tape robot – currently: 200 TByte – can grow “indefinitely” • User expertise centre In Total Operations/deployment effort ~ 8 FTE available Research effort O (40 FTE) over 12 organisations
Resource Usage
Networks 2 x. Gb. E ONS CHICAGO, IL STAR TAP 6509 2. 5 Gb lambda BR 1 CHI 10 Gb. E 7 x. Gb. E SP 01 BR 1 AMS 2. 5 G POS 622 Mb to “rest” 10 G POS Level 3 Uv. A NIKHEF “NCSA” “ANL” OC 48 c SR Gb. E 622 Mb L 2 VPN Star Light T 640 Global Xing AMSTERDAM IGRID 18 x. Gb. E ARGONNE IL Sing. AREN TANet 2 … Gb. E’s ONS 2 x. Gb. E Star Light 6509 Gb. E Star Light RTR ONS 622 Mb “rest” 2 x 2. 5 Gb 2 x. Gb. E OC 48 c lambda RTR 15454 CERN, CH CERN AR 5 10 G POS BR 4 CR 1 -1 CR 1 -2 BR 2 CR 2 -1 CR 2 -2 10 G POS Tyco ABILENE NY NY 622 M PO Prot. Tyco/IEEAF
NIKHEF network load Monthly graph NIKHEF-SURFnet 5 IPv 4 interconnect October/November 2002
New Initiatives inside NL NCFGrid strengthening Grid Infrastructure in NL • 4 partners (NIKHEF, ASCI, SARA, ASTRON) • 600 k. EUR funding • hardware (3 clusters, 10 Gb/s networking) and people (1. 5 FTE over 3 years) • fabric research + production-quality grids • new apps: bio informatics, astronomy • approved August 2002 First cluster assembled and being tested…
New Initiatives inside NL (2) Virtual Laboratory for e-Science Dutch “knowledge infrastructure” project • Higher-level services to efficiently use global resources • Both “bottom-up” and “top-down” in same project
What is happening where in NL? Looking for complementarities and overlap in Dutch. Grid and Nordu. Grid
Dutch. Grid Op Services • Authentication Services (Certification Authority) – EDG CACG “proper” CA – Student and educational CA – EDG “Tutorial” CA • Regular coordination and info meetings • Installation support – Have been distributing EDG 1. 2 till now • User support
Some Apps • HEP: DØ, Atlas, LHCb, Alice Monte-Carlo and Analysis • OPERA – ozone monitoring • WTCW Virtual Laboratory visual analysis environment for (small-scale) experimental science – Chemo-physical surface analysis (PIXE, FT-IR, SIMS) – Bio. ASP – correlating “omics” databases – Virtual Surgery (planning by-passes, artery repairs) • Eco. Grid correlating bio-diversity information databases • Radio Astronomy LOFAR, AVO, VLBI – semi-online and offline processing
Research Areas in NL • High-bandwidth networking SURFnet, Uv. A, SARA, NIKHEF • Generic AAA and `security’ Uv. A, NIKHEF • Cluster, Storage Management & Monitoring NIKHEF, SARA • Adaptive programming environments Free University Amsterdam • Memory-processor co-allocation TU Delft • Federated Information & Content Management Uv. A • Interactive visualisation CWI, Uv. A
Summary • Dutch. Grid Platform started informally in 2000 • de-facto focus for Grid computing in NL • ops supported by partners: CA, web, … • mix of people from all ‘layers’ networks, fabrics, security&AAA, prog. environments, HPC visualisation, semantic DBs, applications Looking forward to collaboration
- Slides: 15