Southwest Tier 2 Center Status Report U S

  • Slides: 11
Download presentation
Southwest Tier 2 Center Status Report U. S. ATLAS Tier 2/3 Workshop - IU

Southwest Tier 2 Center Status Report U. S. ATLAS Tier 2/3 Workshop - IU Mark Sosebee for the SWT 2 Center June 22, 2007 Mark Sosebee

Overview The Southwest Tier 2 Center is a collaboration between the University of Texas

Overview The Southwest Tier 2 Center is a collaboration between the University of Texas at Arlington (UTA), the University of Oklahoma (OU), and Langston University (LU) Personnel: q UTA: Kaushik De, Patrick Mc. Guigan, Victor Reece, Mark Sosebee q OU: Karthik Arunachalam, Horst Severini, Pat Skubic, Joel Snow (LU) June 22, 2007 Mark Sosebee South. West Tier 2

SWT 2 Resources SWT 2 facilities include both project-funded and leveraged (local) resources: q

SWT 2 Resources SWT 2 facilities include both project-funded and leveraged (local) resources: q Project-funded: Ø UTA_SWT 2 Ø OU_OCHEP_SWT 2 q Leveraged systems: Ø UTA-DPCC Ø OU_OSCER_ATLAS q June 22, 2007 Mark Sosebee South. West Tier 2

UTA_SWT 2 and OU_OCHEP_SWT 2 Hardware Configurations 200 compute nodes (UTA 160, OU 40):

UTA_SWT 2 and OU_OCHEP_SWT 2 Hardware Configurations 200 compute nodes (UTA 160, OU 40): Ø Dual Xeon EM 64 T, 3. 2 GHz, 4 GB RAM, 160 GB disk q Front-end nodes: Ø Dual Xeon EM 64 T, 8 GB RAM, 73 GB SCSI RAID 1 q 20 TB SAN storage (IBRIX) (UTA 16, OU 4): Ø 100 x 250 GB SATA disks Ø I/O servers, management servers q ~20 TB potential in compute nodes q June 22, 2007 Mark Sosebee South. West Tier 2

UTA-DPCC Hardware Configuration Shared resource with CSE department q 75 compute nodes: Ø Dual

UTA-DPCC Hardware Configuration Shared resource with CSE department q 75 compute nodes: Ø Dual Xeon 2. 4 -2. 6 GHz Ø 2 GB RAM Ø 60 -80 GB local disks q 45 TB among 10 NFS servers (IDE RAID) q Typically ~100 ATLAS production queue slots q June 22, 2007 Mark Sosebee South. West Tier 2

OU_OSCER_ATLAS (topdawg) q Replacement for old OSCER cluster (boomer): Ø 512 dual Xeon EM

OU_OSCER_ATLAS (topdawg) q Replacement for old OSCER cluster (boomer): Ø 512 dual Xeon EM 64 T nodes, 3. 2 GHz Ø 10 TB storage Ø Opportunistic usage for ATLAS Tier 2 & DØ computing – capped at 192 batch slots Ø Since San Diego T 2 meeting successfully configured to use the DQ 2 site services on OC_OUHEP_SWT 2 June 22, 2007 Mark Sosebee South. West Tier 2

Network Connectivity UTA: Ø Gigabit link to the North Texas Gigapop Ø Gigabit link

Network Connectivity UTA: Ø Gigabit link to the North Texas Gigapop Ø Gigabit link (LEARN) from NTG to Houston peering site (I 2) Ø Testing currently underway to evaluate options for 10 Gb link via LEARN to Houston q OU: Ø Campus backbone 10 Gbps Ø Connection to NLR via One. Net Ø OU One. Net NLR 10 Gbps Ø “Last 10 feet” still needs new network device Ø Traffic to all HEP end points routed through NLR q June 22, 2007 Mark Sosebee South. West Tier 2

OS’s, Software Versions, etc. All SWT 2 clusters running RHEL 3 (except for topdawg,

OS’s, Software Versions, etc. All SWT 2 clusters running RHEL 3 (except for topdawg, RHEL 4) Ø Plan to upgrade all to RHEL 4 this summer q Batch systems: Ø UTA_SWT 2, UTA-DPCC: Torque Ø OU_OCHEP_SWT 2: Condor Ø OU_OSCER_ATLAS: LSF q Upgrade to OSG 0. 6 done at OU_OSCER_ATLAS, soon on all other clusters q June 22, 2007 Mark Sosebee South. West Tier 2

Latest Hardware Acquisitions at SWT 2 New cluster delivered to UTA – installation awaiting

Latest Hardware Acquisitions at SWT 2 New cluster delivered to UTA – installation awaiting electrical work in server room: Ø 200 cores (Opteron 2216’s) Ø 2 GB RAM per core Ø 75 TB (raw space) in SATA RAID (Dell MD 1000’s) Ø d. Cache q OU has ordered: Ø 18 TB (raw space) of additional IBRIX-based storage Ø 184 additional Xeon cores (dual CPU, quad cores) q June 22, 2007 Mark Sosebee South. West Tier 2

Hardware Profile Summary at SWT 2 CPU (cores) Storage (TB) Projectfunded 800 95 Leveraged

Hardware Profile Summary at SWT 2 CPU (cores) Storage (TB) Projectfunded 800 95 Leveraged 292 55 June 22, 2007 Mark Sosebee South. West Tier 2

Conclusion q SWT 2 is generally performing very well q New hardware awaiting installation

Conclusion q SWT 2 is generally performing very well q New hardware awaiting installation at UTA – on order at OU q Large topdawg cluster at OU has been enabled for ATLAS production q Supporting regional analysis – “best effort” q http: //www. atlas-swt 2. org/twiki/bin/view/SWT 2/Web. Home June 22, 2007 Mark Sosebee South. West Tier 2