Fermilab T 1 infrastructure D Petravick LHC OPN

Fermilab T 1 infrastructure D. Petravick LHC OPN Meeting CASPUR, April 4, 2006 4/4/06 D Petravick - CASPUR LHC OPN Meeting

Current • Fermi. Light Path • Mission: – R&D, overflow • • Terminates in 6506 2 ea 10 gigabit 2 ea 1 gigabit Used for > 13 projects, including R 2, CMS to date 4/4/06 D Petravick - CASPUR LHC OPN Meeting 2

DOE Presence at Starlight • Fermilab has a dark fiber to starlight. • Argonne has i. Wire fiber to starlight. • FNAL and ANL proposed Chicago MAN. – Physically, contractually independent fibers • Acquire fiber FNAL<->ANL • Light w/ CIENA equipment • Provision lambdas to ESNET • Retain existing capabilities. 4/4/06 D Petravick - CASPUR LHC OPN Meeting 3

MAN overview (FNAL) • IDEA: FNAL and ANL provision lambdas to the MAN. – FNAL, ANL control a ring of fiber to Starlight – FNAL, light point to point paths • Not a protected loop – BGP provides failover. – No breakout at peer lab • Also, Spur to the NBC building where QWEST is. 4/4/06 D Petravick - CASPUR LHC OPN Meeting 4

Optical infrastructure • CIENA metro – Fermi Light path – i. Wire • Expand w/ 4200’s to provision ESNET MAN • Status: – Evaluated – Requisition, formal installation pending. 4/4/06 D Petravick - CASPUR LHC OPN Meeting 5

Production (routed) • ESNET will furnish 10 gig link to NBC building dedicated to FNAL • MAN will provide redundant paths to FNAL • Can see the end of the commercially provided 0. 622 gb link. 4/4/06 D Petravick - CASPUR LHC OPN Meeting 6

Proposed OPN provisioning • ESNET SDN will carry the OPN from FNAL to USLHCNET at Starlight. • Fermilab proposes 10 Gb dedicated provisioning • ESNET proposes that SDN will be MPLS, inside, present vlan to USLHCNET, FNAL internal infrastructure. 4/4/06 D Petravick - CASPUR LHC OPN Meeting 7

Other CMS provisioning • FNAL proposes Additional 10 Gig channels from FNAL over SDN • ESNET will make any reasonable connections to MAN 6509. – For any party transferring w/FNAL 4/4/06 D Petravick - CASPUR LHC OPN Meeting 8

FNAL operational role in ESNET MAN • Monitoring the channels at Layer 1 • MAN operation is joint ANL/FNAL, – organization is pending. – Initially FNAL 24 x 7 support is available +1 -630840 -2345 – Support will evolve • Traffic at our (extended) border, w/ usual support for wide systems. • n. b. FNAL “research” links are independent of ESNET, and are still there. 4/4/06 D Petravick - CASPUR LHC OPN Meeting 9

Networking within FNAL • Computer Security • Campus Network Engineering. 4/4/06 D Petravick - CASPUR LHC OPN Meeting 10

Computer Security Policy • • • History of firewalls and performance is problematic. New CSPP does not require firewalls, and allows for bypass if present Passed scrutiny by outside experts -- “DOE site assist visit” FNAL supplies Compensatory Controls in its security infrastructure -- automated scanning, blocking, etc. Figure illustrates pattern 4/4/06 D Petravick - CASPUR LHC OPN Meeting 11

Campus Network Engineering • CMS fits into the same general pattern as other large computing workgroups. • Competent networking makes the two main locations for computing transparent. • 30 gig workgroup connectivity is being extended. • Alternate paths available for data intensive flows. 4/4/06 D Petravick - CASPUR LHC OPN Meeting 12