Introduction to GENI Network Architecture www geni net

Introduction to GENI Network Architecture www. geni. net Sponsored by the National Science Foundation

GENI: Infrastructure for Experimentation GENI provides geographically distributed compute resources that can be connected in experimenter specified Layer 2 topologies. Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 2

GENI Key Concepts GENI is deeply programmable – experiments control forwarding My experiment runs across the evolving GENI federation. GENI Rack GENI is sliceable – supports concurrent experiments Commercial Clouds Backbone #1 Campus My GENI Slice Access #1 Research Testbed Regional Corporate GENI suites GENI is a Federation – to the user appears as one testbed Non-US Testbeds GENI Rack Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 3

GENI Network Map Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 4

GENI Network Architecture Overview Internet ISP Metro Research Backbones g g GENI-enabled hardware g Campus Regional Networks Legend Layer 2 Data Plane Layer 3 Control Plane • Spans campus/metro, regional, • Includes VMs, bare metal nodes, and nationwide networks SDN switches (Open. Flow 1. 0), Wi. MAX/LTE base stations and • GENI relies on participants to clients, L 2 network access contribute compute and network resources Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 5

The GENI Rack Internet ISP Metro Research Backbones g g GENI-enabled hardware g Campus Sponsored by the National Science Foundation Regional Networks Legend GENI Network Architecture – 20 October 2014 Layer 2 Data Plane Layer 3 Control Plane www. geni. net 6

GENI Rack Network s to s e c des Ac o n t en m i r e exp Multiple data interfaces sliceable SDN data switch can be controlled by the experimenter GENI network is sliced by VLAN Embed a variety of topologies within one rack sliced by VLAN Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 7

GENI Rack Open. Flow switch Different Open. Flow modes – switches in pure OF mode are acting as one datapath – Hybrid VLAN switches are one datapath per VLAN (sliced at the switch) – Hybrid port switches are two datapaths (one OF and one non. OF) 3 1 2 OFslice switch • Need slicer for pure OF and port hybrid – Flow. Visor, Flow. Space Firewall Embed a variety of topologies within one rack sliced by VLAN Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 8

GENI Rack Network o s t nt s ce ime c A er s p ex node Mu ltip inte le da rfac ta es GENI Wireless resources Campus resources Each Rack is a separate AM that ensures that experiment nodes are connected to the appropriate external resources Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 9

Extra Devices in a Rack Custom Hardware Sliverable Storage GENI Wireless resources Campus resources AM may control extra devices or just provide connectivity Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 10

GENI Wireless Internet ISP Metro Research Backbones g g GENI-enabled hardware g Campus Sponsored by the National Science Foundation Regional Networks Legend GENI Network Architecture – 20 October 2014 Layer 2 Data Plane Layer 3 Control Plane www. geni. net 11

GENI Wi. MAX Deployment 2014 U Wisconsin Madison U Michigan UMass Wayne State Rutgers Stanford U Colorado Boulder NYU Drexel UCLA Columbia Temple Clemson Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 12

GENI Wi. MAX • Agreement with Sprint – Sprint and Rutgers University have signed a master spectrum agreement – encompassing all Wi. MAX sites, to ensure operation in the EBS Band. – An emergency stop procedure, in case of interference with Sprint service, has been agreed upon. • Sci. Winet GENI Mobile Virtual Network Operator (MVNO) - Partner with Sprint and Arterra (a Sprint partner) to create and operate an (MVNO) that serves the academic research community - The effort is led by Jim Martin and Ivan Seskar, to learn more: http: //sciwinet. org Wi. MAX Developers session Wed: 11: 30 am – 12: 30 pm Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 13

GENI Wi. MAX Site Network Architecture Internet Wi. MAX Research Backbones Wi. Fi GENI-enabled hardware Wireless Edge Regional Network Legend Layer 2 Data Plane Layer 3 Control Plane • Wi. MAX and Wifi edge networks. • Multi-point VLAN interconnecting all Wi. MAX sites via racks. • Layer 2 dataplane connectivity to GENI racks. Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 14

OPEN BTS Software: Wi. MAX • OMF AM REST Interface • Each slice contains a sw router (click or OVS) • Slicing of OFDMA resource blocks by mapping client MAC to VLANs • Clients are mapped to VLANs Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 15

OPEN BTS Software: LTE New LTE Base station has it own AM to manage the slicing Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 16

The GENI-enabled Campus Internet ISP Metro Research Backbones g g GENI-enabled hardware g Campus Sponsored by the National Science Foundation Regional Networks Legend GENI Network Architecture – 20 October 2014 Layer 2 Data Plane Layer 3 Control Plane www. geni. net 17

GENI – Enabled Campus • Layer 2 transport through the campus – Usually statically provisioned – Might provide access to programmable switches • Layer 2 connectivity to: – – to GENI wireless resources local resources (university labs, specialized equipment) to local community tesbeds (e. g. ORBIT) to metro networks Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 18

Wisconsin: a great example Internet 2 Po. P To other GENI campuses Suman Banerjee, PI Parmesh Ramanathan, PI Connectivity through MOXI Regional Dale W. Carter, Campus admin GENI Rack Campus Resources Connection to local community GENI Wi. MAX Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 19

The GENI Core Network Internet ISP Metro Research Backbones g g GENI-enabled hardware g Campus Sponsored by the National Science Foundation Regional Networks Legend GENI Network Architecture – 20 October 2014 Layer 2 Data Plane Layer 3 Control Plane www. geni. net 20

GENI Regionals • Provide simple transport – static network configuration of multiple connections managed by edge Aggregate Managers (e. g. NOX) – May provide dynamic circuit provisioning (e. g. MAX) • Provide access to routing to experimenters through SDN capable devices (e. g. Star. Light) • Provide access to compute and storage through a colocated GENI Rack (e. g. Cenic) Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 21

Example regional network CENIC Open. Flow buildout CENIC GENI Rack Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 22

GENI Core Network History • Non-programmable dynamic Layer 2 transport through ION • Prototype static programmable backbone with SDN capable devices (decommissioning) Prototype GENI Backbone over I 2 and NLR with 10 Open. Flow Switches Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 23

GENI Core network moving to AL 2 S • In-progress migration from “prototype GENI” to AL 2 S production system – Testing GENI dynamic provision on AL 2 S AM – Testing Experimenter Open. Flow controllers on AL 2 S Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 24

Creating Inter-Aggregate Experiments Internet ISP Metro Research Backbones g g GENI-enabled hardware g Campus Sponsored by the National Science Foundation Regional Networks Legend GENI Network Architecture – 20 October 2014 Layer 2 Data Plane Layer 3 Control Plane www. geni. net 25

GENI Stitching • Setup point-to-point VLANs – Between hosts on different Ams • One host/per AM/per stitch Regio nal 2 – Not a broadcast domain • Dynamic, real-time setup GENI RAC KB Backbone – Need to coordinate multiple AMs – Takes time – Can fail GENI RAC KA Regio nal 1 Regio nal 3 GENI RAC KB A common concept used in other networks, applied to GENI, e. g. OSCARS, GLIF • Provides traffic isolation and bandwidth constraints Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 26

GENI Stitching: Under the Hood How does GENI Stitching Work? 1. Rack Configuration (network admins) • • • Long process (~weeks, months) Done once in advance Manual 1. Inter-aggregate link reservations (experimenters) • • Automated (tools can make them) Quickish (usually a few minutes) Live, Easy Repeatable Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 27

Example “Pre-work” for End-to-End Data Connections SOX • Identify paths from a rack to GENI core – Identify the network providers • Typically a campus, a regional, a nationwide provider(GATech, Missouri, Stanford, MAX, SOX, ION, and AL 2 S) – Identify endpoints and allocate VLAN to GENI that can be used to connect to the rack • • Configure racks with VLANS for GENI stitching Test for connectivity Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 28

Stitching Computation Service Finding a workable path, and the right reservation order can be hard. • Stitching Computation Service (SCS) for path and workflow computation – – – • Tom Lehman and Xi Yang wrote this optional service Includes many heuristics to optimize path, chance of success Allows excluding particular connection points, VLANs Other tools may use different heuristics – Stitcher uses the SCS ION https: //wiki. maxgigapop. net/twiki/bin/view/GENI/Network. Stitching. API Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 29

Internet 2 ION Aggregate Manager • ION AM maps GENI calls to OSCARS calls • Runs the code from MAX Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 31

Coming Soon: Internet 2 OESS • Upcoming replacement for ION – Different dataplane technology: Open. Flow VLANs vs MPLS L 2 VPN • Supports multipoint circuits – We hope to support that in GENI at some point • AL 2 S Aggregate Manager – Will control OESS as the ION AM controls ION – Developed by Internet 2 based on FOAM and OESS • Can use GENI AM API to stitch between ION and AL 2 S Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 32

Experimenter: Creating a Circuit Automated by the tool 1. Simple Request Too l 7. Manifest Back Over 16, 000 stitched slivers since November, 2013 Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 33

Running Services for non-GENI users Internet ISP Metro Research Backbones g g GENI-enabled hardware g Campus Sponsored by the National Science Foundation Regional Networks Legend GENI Network Architecture – 20 October 2014 Layer 2 Data Plane Layer 3 Control Plane www. geni. net 34

Access to the local community through GENI resources Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 35

Use the commodity Internet Parmesh Ramanathan U. Wisconsin GENI Cinema Persistent live video streaming service over GENI KC Wang U. Clemson Opt-in users can view and source live streams Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 36

Custom L 3 Dataplan e Connectivity Elder. Care as a Service Providing service to the community. Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 37

GENI’s International Collaborations Internet ISP Metro Research Backbones g g GENI-enabled hardware g Campus Sponsored by the National Science Foundation Regional Networks Legend GENI Network Architecture – 20 October 2014 Layer 2 Data Plane Layer 3 Control Plane www. geni. net 40

GENI’s International Collaborations GENI is working actively with peer efforts on five continents to define and adopt common concepts and APIs. Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 41

GENI – FIRE Federation Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 42

GENI – FIRE Federation 50 VLANS 50 Vlans between I 2 Po. P@ NY and i. Minds • use stitching with FIRE or GENI account • look for the demo on Tuesday evening Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 43

Questions? GENI Network map Sponsored by the National Science Foundation GENI Network Architecture – 20 October 2014 www. geni. net 44