INFNCNAF networking Luca dellAgnello INFNCNAF INFNCNAF networking 1

INFN-CNAF networking Luca dell’Agnello INFN-CNAF

• • INFN-CNAF networking (1) Main network infrastructure based on optical fibres (~ 20 Km) LAN has a “classical” star topology with 2 Core Switch/Router (ER 16, BD) – Migration to Black Diamond 10808 with 180 GE and 12 x 10 GE ports (it can scale up to 480 GE or 48 x 10 GE) completed – CPU racks equipped with FE/GE switch (2 x. Gbps optical uplinks to core switch) – Disk servers connected via GE to core switch (mainly fibre) • Some servers concentrated with copper cables to a dedicated switch • – VLAN’s defined across switches (802. 1 q) 43 rack switches (21 switches 10 Gb ready): several brands, homogeneous characteristics – 48 Copper FEthernet ports (21 switches have all GEthernet ports) – Support of main standards (e. g. 802. 1 q) • – 2 Gigabit up-links (optical fibers) to core switch CNAF interconnected to GARR-G backbone at 1 Gbps + 10 Gbps for SC – Giga-Po. P co-located – New access router (Cisco 7600 with 4 x 10 GE and 4 x. GE interfaces) installed

INFN-CNAF networking (2) • • LAN connectivity ready for 10 GE technology with capacity for 10 GE link aggregation Data flows will land on disk buffer system • 1 network prefix for LHCOPN (131. 154. 128/17) • • – possibly CASTOR, but also other SRM systems (Stor. RM and d. Cache) under evaluation – 1 additional prefix for SC (192. 135. 23/24) Security model will be based on L 3 filters (ACLs) within the L 3 equipment – On BD Monitoring via snmp (presently v 2) – mrtg, nagios

INFN CNAF TIER 1 LHC Network General Schema CERN(LHC) GARR CNAF general purpose link 0 G Storage Servers b/s Exterme BD 10808 • Disk Servers • Castor Stagers Extreme Summit 400 /s Gb 10 b/s G x 1 2 Extreme Summit 400 CNAF Tier 1 Network for LHC (131. 154. 128. 0/17) 2 x 1 G b/s 2 x 10 Gb/s Fiber Channel 2 x 101 G Gbb //ss Storage Devices b/s 10 G s 2 x 1 / 10 Gb 7600 LHC-NET dedicated link Service Challenge Servers b/s 1 G Extreme Summit 400 Worker Nodes SAN Extreme Summit 400 ER 16 2 x 2 x 1 Gb/s In Case of network Congestion: Uplink upgrade To 10 Gb/s Extreme Summit 400 1 G b/s Extreme Summit 400 Worker Nodes

TIER 1 – Network 31/03/2006 Matrix M 5 Juniper R&D Sez. Di Bologna SW-08 -02 (sc) 49 GE 0/1/0 Bo GARR 5/1 Welcome 131. 154. 1. 5 Appletal k 0/0 et. 6. 2 SSR 8600 St. 1(gi. 3. 1, gi. 5. 1). 6 et. 3. 8 (5/2, 6/1). 7 7600 (3/ SW-03 -05 1, 3 /2) (1: 1: 2 4, 2 , 8 (7: 59 SW-06 -01 SW-AC : 59) : 4) 1: 5 BD 10 K ) : 6 , 8 : 6 7 ( 8: 5) (7: 5, (7: 4, 8: 4) (7: 3 , 8: 3 ) St. 35(gi. 3. 2, gi. 4. 2) gi. 12. 2 SW-08 -03 St. 37(gi. 3. 4, gi. 4. 4) gi. 12. 3 gi. 6. 8 St. 36(gi. 3. 3, gi. 4. 3) SW-08 -05 St. 15(gi. 15, 16. 1, 2) SW-04 -04 SW-08 -07 SW-04 -05 SW-04 -06 SW-06 -08 6. 8) sw-06 -06 ) 16. 7. 7, gi. SW-06 -05 15. 8, gi. 1 LHCBSW 1 (gi. 15 SW-04 -10 St. 13(gi. 5. 5, gi. 5. 8, gi. 6. 5) 0) -1 9 9( SW-04 -09 St. 20 49(49 -50) Farm. SWG 1 SW-04 -08 St. 21(gi. sw-04 -03 49(49 -50) 29(29 -32) SW-03 -03 SW-03 -02 HP Babar Farm. SWG 3 Farm. SWF 1 Farm. SWF 2 SW-03 -06 SW-03 -07 SW-03 -08 SW-03 -09 SW-03 -10 4) 16. , gi. 5) 5. 4 16. gi. 1 5, gi. 6. 6) 17( 15. , gi. 1 8(gi. 15. 6 St. 1 9(gi. St. 1 sw-04 -02 3(3 -4) 5(5 -6) 7(7 -8) S t. 3 St. SW-04 -07 49(49 -50) i. 2, g . i. 5 0(g St. 16(gi. 15. 3, gi. 16. 3) St. 2 2(g i. 1 2. 6, g i. 1 3. 6) 7) 3. . 1 gi 7, gi. 6) 2. 1. 5, . 1 i. 1 0. gi 3( i. 1 0. 6, g. 2 8(g 1 St t. 2 ) 9(gi. S t. . 52 1 S 1 cat 6500 2) 6. ER 16 St. 3 1( gi St. 1. 2 0 (g St i. 1. 7, . 3. 1 g (gi St. 1. , gi. i. 11. 4( 2 2. . g , St. i 5(g. 1. 3 gi. 2. 1) 7) , gi i. 1 2 St. . 4, . 2. ) 6(g gi. i. 1 2. 3). 5, St. 12 gi. 2 4) (gi. 5. 4. 5) , gi. 6. 4 St. 1 1(gi. ) 5. 3, St. 32(gi. 5. gi. 6. 6, gi. 6. 6) 3) 1/1 SW-08 -08 sw-04 -01 St. 33 (xg. 7. 1, xg. 14. 1) gi. 12. 4 SW-08 -04 1) 1. i. 1 , g ) 1 0. . 2. 8 ) i. 1 (gi. 8, g i. 4. 1 5. 2. 1 , g St 9(gi i. 3. 1. ) St 34(g 2. 6. , gi. 6 St 1. 7(gi. St. SW-03 -04 SW-03 -11 SW-05 -02 SW-05 -03 SW-05 -04 SW-05 -05