NE ROC Sweden Interaction Integration and Interface with

  • Slides: 18
Download presentation
NE ROC Sweden • Interaction, Integration and Interface with other grid projects and infrastructures

NE ROC Sweden • Interaction, Integration and Interface with other grid projects and infrastructures • SWEGRID Six 100 cpu clusters at 6 sites • Up to 1/3 of the resources available for egee • Six sites using ARC (Nordugrid) • Three sites LCG 2 • • ARC aka Nordu. Grid • • Nordic Data Grid Facility • • Until end 2004 competence and software development Euro. Grid (Codine) • • Used on SWEGRID for primarily for Atlas VO but a number of other users have joined Parallab (Bergen) expertise on enabling of applications and grid technologies More… Baltic Grid Event, Vilnius, 2004 -10 -07 - 1

NE ROC Sweden HPC 2 N PDC NSC Baltic Grid Event, Vilnius, 2004 -10

NE ROC Sweden HPC 2 N PDC NSC Baltic Grid Event, Vilnius, 2004 -10 -07 - 2

National Supercomputer Center, NSC Linköping University, Sweden • Established 1989 • 10 full time

National Supercomputer Center, NSC Linköping University, Sweden • Established 1989 • 10 full time and 3 half time employees • EGEE: Leif Nixon and Johan Gunnarsson • More than 250 users from the Swedish academic HPC community. • Partnerships with • Saab AB • Swedish Meteorological and Hydrological Institute 3

National Supercomputer Center, NSC Linköping University, Sweden • HPC resources • Cluster resources: more

National Supercomputer Center, NSC Linköping University, Sweden • HPC resources • Cluster resources: more than 850 proc. • High speed interconnects: Infiniband, Scali • Shared memory resources: SGI 3 K, 128 proc • Organizes the annual workshop on Linux Clusters for Supercomputing, LCSC 4

Grid activities at NSC • First Grid activities at NSC were initiated 2002. •

Grid activities at NSC • First Grid activities at NSC were initiated 2002. • Swe. Grid, GRID test bed for computing and storage • technical manager, Niclas Anderson, NSC • NSC is representing Sweden in Grid Deployment Board of the LHC Computing Grid • Parterns in EU-FP 6 grid related projects: • EGEE, Enabling Grids for E-science in Europe • ENACTS, Technology watch programme • HPC 4 U, Highly Predicable Clusters For Internet Grids 5

HPC 2 N – Some History ° 1989 – 95: Supercomputing Center North °

HPC 2 N – Some History ° 1989 – 95: Supercomputing Center North ° Bank grant (IBM 3090 VF-600 J) ° 1996: HPC 2 N consortium established ° HPDR contract, KAW grant (IBM SP - knut) ° 1997 -2002 Grants from HPDR, FRN and VR ° 2003– VR/SNIC grants, Swe. Grid (ingrid) ° HPC systems financed by grants from ° Knut and Alice Wallenberg Foundation (knut, alice, and sarek) ° Kempe Foundations (seth) HPC 2 N 2004 all rights reserved

Research and Development #1 ° Public Domain Software Libraries ° HPC systems demand software

Research and Development #1 ° Public Domain Software Libraries ° HPC systems demand software that utilize their special architectures efficiently ° Software contributions and international collaboration: LAPACK, Sca. LAPACK, SLICOT, IBM-ESSL ° Novel algorithms for deep memory hierarchies ° Recursive blocked algorithms, hybrid data formats, with IBM T. J. Watson Res. Center ° NICONET - Numerics in Control Network (EC) ° Web computing environment

Research and Development #2 ° VR/SNIC: Generic Grid research for resource management, portals and

Research and Development #2 ° VR/SNIC: Generic Grid research for resource management, portals and algorithms ° Resource brokering ° Accounting and bookkeeping ° HPC 2 N Portal SNIC Portal ° Web site for submitting jobs, job status information, access to data files, project management, grid access etc. ° VISTA - Visual Interactive Simulation - Tools and Applications ° with VRlab, EC Mål 1 funding

PDC Per Öster <per@pdc. kth. se> 9

PDC Per Öster <per@pdc. kth. se> 9

Background • Research in parallel computation since about 1985 • Formalized as a Center

Background • Research in parallel computation since about 1985 • Formalized as a Center at KTH in 1990 • Successfully competed for the national HPC center in 1995 • Assumed role as main national center in 1996 • Successful review of center buildup in the fall of 1996 • HPDR closed in 1998. One-year continuation funding 1999 – 2002. First three-year award from SNIC in 2003. NE ROC Technical Meeting Amsterdam, October 28 -29, 2004 10

Representative R&D Projects • EDG – EGEE (EU) • Next. Grid (EU) • VR-IT

Representative R&D Projects • EDG – EGEE (EU) • Next. Grid (EU) • VR-IT Grid Research (VR) SGAS, Grid Accounting System • Swe. Grid (SNIC, KA Wallenberg) • Jaco 3: Java and Corba Collaborative Computing environment (EU) • Ens. CUBE: European Numerical Services for SMEs (EU) • Neurogenerator (EU), Neurodisseminator (EU) • BINS (SSF) • Universe (EU) • Virtual Fires (EU) • FHS (Swedish National Defense College) • SEPTools (EU) • PDCTTN (EU) NE ROC Technical Meeting Amsterdam, October 28 -29, 2004 11

Collaborations • • • Globus Alliance Global Grid Forum European Grid Support Center International

Collaborations • • • Globus Alliance Global Grid Forum European Grid Support Center International Summer School on Grid Computing Gelato Federation LACSI HP IBM (KTH Open Source Lab, IBM Research) Intel PSCI (Parallel Scientific Computing Institute) KCSE (KTH Computational Science and Engineering centre) • VIC (Visualization, Interaction and Communication centre) NE ROC Technical Meeting Amsterdam, October 28 -29, 2004 12

High-Performance Networking • Distributed simulation at SC 97, San Jose (Sunet, Nordu. Net, Startap,

High-Performance Networking • Distributed simulation at SC 97, San Jose (Sunet, Nordu. Net, Startap, and Internet 2) • Interactive distributed virtual reality at Alliance‘ 98 (NCSA, Utah, EVL, UH, PDC, Sunet, Nordu. Net, Startap, NSF and Internet 2) strong influence on Nordunet transatlantic upgrade schedule, UCAID and Eurolink agreements • Distributed Visualization ENVIS @SC 99 (Exhibit, PDC) • Computational Steering at i. NET 2000, Yokohama (PDC, UH, EVL, Sunet, Nordu. Net, Startap, and APAN) • λ-technology for tele-microscopy (Nordu. Net, Surfnet, Starlight, Internet 2, KI, UCSD/NCMIR) NE ROC Technical Meeting Amsterdam, October 28 -29, 2004 13

Visualization • Immersa. Desk 1996 (Alliance) • VR-Cube 1998 • Innovative Projects Technology •

Visualization • Immersa. Desk 1996 (Alliance) • VR-Cube 1998 • Innovative Projects Technology • An extensible simulation and navigation system “Navier” • A simulation environment for spatial sound Applications • • • High-performance visualization of CFD Visualization and computational steering of very large CEM data sets High quality visualization of architectural models Visualization of fires in tunnels (EU project starting 2001) Virtual Exhibits, Art • Undergraduate Advanced Visualization Courses • Advanced CAVE workshop, October 2001, with CAVE Research Network support NE ROC Technical Meeting Amsterdam, October 28 -29, 2004 14

Storage services • • • Space data (Telefoton, Odin, Pamela): Data repository for the

Storage services • • • Space data (Telefoton, Odin, Pamela): Data repository for the research satellite Odin (260 GB raw data, 270 GB processed data, Growth 220 GB/yr collaboration between SE, FI, CA, FR) Genomics: Data repository for SSF Genotyping Laboratory at UU (Data Migration service) Mutual back-ups PDC – HPC 2 N (~12 TB) Brain Images (Neurogenerator): Data repository and data analysis of PET and f. MRI images (a few MB/image, 10 – 100 GB/object, 10 – 100 TB/study) Human Proteome Resource, 30 TB 2004, possibly 300 TB by 2007 (10, 000 anti-bodies, 30 GB/anti-body) Amanda 5 TB 2004, 15 – 20 TB 2005 Pamela, ~7 TB/yr Swe. Grid SNIC, ~5 TB/yr NE ROC Technical Meeting Amsterdam, October 28 -29, 2004 15

Computer Systems at PDC NE ROC Technical Meeting Amsterdam, October 28 -29, 2004 16

Computer Systems at PDC NE ROC Technical Meeting Amsterdam, October 28 -29, 2004 16

User applications Gaussian Jaguar ABAQUS Fluent Star. CD NWChem Macro. Model Matlab Gene. Hunter

User applications Gaussian Jaguar ABAQUS Fluent Star. CD NWChem Macro. Model Matlab Gene. Hunter DL-Poly CHARMM GAMESS Dalton GROMACS Numerical Libraries Total. View Vampir TAU PAPI Net. CDF HDF 4 HDF 5 Compilers Debuggers Batch system EASY SRB MPI PDC HSM commands GM LAPI FTP WEB DNS MAIL SSH PKI Grid services Services Tools User Applications Clients Open. AFS/Arla ECCE PSEs Web portals Gridapps Kerberos travel-kit TSM Kerberos Packet filtering Fabric AFS GPFS Lustre PVFS HSM/DMF TSM Compute resources Servers Computers Tape Switches 100/1 k/10 k Myrinet Infiniband Robot Routers “lambda” Disk Storage Networking NE ROC Technical Meeting Amsterdam, October 28 -29, 2004 17

NE ROC Items for Discussion Support • Single point of contact? • • •

NE ROC Items for Discussion Support • Single point of contact? • • • ARC aka Nordu. Grid • • Until end 2004 competence and software development Euro. Grid (Codine) • • Used on SWEGRID for primarily for Atlas VO but a number of other users have joined Nordic Data Grid Facility • • Six 100 cpu clusters at 6 sites Up to 1/3 of the resources available for egee Six sites using ARC (Nordugrid) Three sites LCG 2 Parallab (Bergen) expertise on enabling of applications and grid technologies More… Baltic Grid Event, Vilnius, 2004 -10 -07 - 18