Experimentation using GENI Mark Berman GENI Project Office

Experimentation using GENI Mark Berman GENI Project Office February 18, 2011 www. geni. net groups. geni. net Sponsored by the National Science Foundation

Thank You To Deniz Gurkan for organizing this workshop To all of you for coming The GENI team hopes to engage you in • Using GENI for your experiments • GENI-enabling your infrastructure GEC 10 – San Juan, March 15 -17: www. geni. net Sponsored by the National Science Foundation Feb 18, 2011 2

Outline • • GENI Basics for Experimenters Some Example Resources Some Example Experiments Please Get Involved Sponsored by the National Science Foundation Feb 18, 2011 3

GENI’s Unique Advance • Today – – Lots of specific testbeds Mostly homogeneous Require separate accounts, tools Interconnected via Internet • GENI – – – End-to-end, controlled interconnection Shared toolset Common authentication, access control Direct L 2 access to end-users Lots of stuff (quantity and diversity) Sponsored by the National Science Foundation Feb 18, 2011 4

Spiral 2 Initial GENI AM API Implementation • Initial implementation with 3 aggregate types • 20 aggregates advertise 5, 000+ resources via the GENI AM API • Shared credentials offer experimenters single point of access October 19, 2010 Network Resources: Open. Flow switches, Planet. Lab/VINI links, Proto. GENI links Compute Resources: Planet. Lab nodes, Proto. GENI nodes Sponsored by the National Science Foundation Feb 18, 2011 5

Today’s Resources Accessible via GENI AM API Planet. Lab, Proto. GENI, and Open. Flow October 20, 2010 We want all GENI resources to appear on this map! Sponsored by the National Science Foundation Feb 18, 2011 6

GENI Is a Virtual Laboratory • To succeed as a virtual laboratory, GENI must support a wide variety of experiments. • Early GENI goals include support for – – – Repeatable and/or “in the wild” behavior Large-scale infrastructure Novel network architecture Deep programmability Programmable switches and routers Opt-in users • These capabilities are rapidly taking shape – GENI will continue to increase in capability, scale, and interoperability Sponsored by the National Science Foundation Feb 18, 2011 7

GENI Experimenter Interests (June 2010) Sponsored by the National Science Foundation Feb 18, 2011 8

Resource discovery Aggregates publish resources, schedules, etc. , via clearinghouses What resources can I use? GENI Clearinghouse These Researcher Components Aggregate A Aggregate B Aggregate C Computer Cluster Backbone Net Metro Wireless Sponsored by the National Science Foundation Feb 18, 2011 9

Slice creation Clearinghouse checks credentials & enforces policy Aggregates allocate resources & create topologies Create my slice GENI Clearinghouse Components Aggregate A Aggregate B Aggregate C Computer Cluster Backbone Net Metro Wireless Sponsored by the National Science Foundation Feb 18, 2011 10

Experimentation Researcher loads software, debugs, collects measurements Experiment – Install my software, debug, collect data, retry, etc. GENI Clearinghouse Components Aggregate A Aggregate B Aggregate C Computer Cluster Backbone Net Metro Wireless Sponsored by the National Science Foundation Feb 18, 2011 11

Slice growth & revision Allows successful, long-running experiments to grow larger Make my slice bigger ! GENI Clearinghouse Components Aggregate A Aggregate B Aggregate C Computer Cluster Backbone Net Metro Wireless Sponsored by the National Science Foundation Feb 18, 2011 12

Federation of Clearinghouses Growth path to international, semi-private, and commercial GENIs Make my slice even bigger ! GENI Clearinghouse Federated Clearinghouse Components Aggregate A Aggregate B Aggregate C Aggregate D Computer Cluster Backbone Net Metro Wireless Non-NSF Resources Sponsored by the National Science Foundation Feb 18, 2011 13

Operations & Management Always present in background for usual reasons Will need an ‘emergency shutdown’ mechanism Stop the experiment immediately ! GENI Clearinghouse Oops Federated Clearinghouse Components Aggregate A Aggregate B Aggregate C Aggregate D Computer Cluster Backbone Net Metro Wireless Non-NSF Resources Sponsored by the National Science Foundation Feb 18, 2011 14

Outline • • GENI Basics for Experimenters Some Example Resources Some Example Experiments Please Get Involved Sponsored by the National Science Foundation Feb 18, 2011 15

Spiral 2 infrastructure Building the GENI Meso-scale Prototype Wi. MAX Open. Flow Stanford U Washington Wisconsin Indiana Rutgers Princeton Clemson Georgia Tech Kansas State Stanford UCLA UC Boulder Wisconsn Rutgers Polytech Inst NYU UMass Columbia Open. Flow backbone Shadow. Net Seattle Sunnyvale Los Angeles Denver Houston Chicago Atlanta Washington DC New York City Salt Lake City Kansas City Washington DC Atlanta Pronto 3290 Ethernet Switch HP Pro. Curve 5400 Switch Juniper MX 240 Ethernet Services Router Sponsored by the National Science Foundation Arista 7124 S Switch NEC Wi. MAX Base Station NEC IP 8800 Ethernet Switch Feb 18, 2011 16

World-class GENI Partners National Lambda. Rail and Internet 2 Proto. GENI & SPP National Lambda. Rail Up to 30 Gbps bandwidth Buildout for GENI prototyping within two national footprints to provide end-to-end GENI slices (IP or non-IP) Sponsored by the National Science Foundation Feb 18, 2011 Photo by Chris Tracy 17

Campus GENI build-outs Researchers teaming with campus IT staff • Open. Flow in 2 GTRNOC lab bldgs now • Open. Flow/BGPMux coursework now Nick Feamster Ellen Zegura PI • Dormitory trial • Access control, authentication focus Russ Clark, GT-RNOC Ron Hutchins, OIT How are we “GENI-enabling” campuses? GENI racks Wi. MAX Sponsored by the National Science Foundation Vitaliy Neret Feb 18, 2011 18

Example Proto. GENI Resources U. Wisconsin: 2 PCs Wail: 100+ PCs 50+ Routers U. Utah/Emulab: 600+ PCs 6 net. FPGA Internet 2 Kansas City Po. P: 2 PCs 4 Net. FPGA SPP node Internet 2 DC Po. P 2 PCs 4 Net. FPGA SPP node Internet 2 SLC Po. P: 4 Net. FPGA 2 PCs SPP node U. Kentucky: 90 PCs Sponsored by the National Science Foundation Feb 18, 2011 19

Programmable Wi. Max Base Stations Virtual GENI Router (at Po. P) GENI Backbone Network GENI Access Network (Ethernet SW & Routers) Wi. MAX Base Station (GBSN) GENI terminals (Wi. MAX phone/PDA running GENI/Linux) GENI Compliant WIMAX Base Station Controller • • Sponsored by the National Science Foundation Feb 18, 2011 Site now: – WINLAB Rutgers – BBN Cambridge – NYU Poly Sites in progress: – Columbia – UMass Amherst – Univ Wisconsin – Univ Colorado Boulder – UCLA 20

Planet. Lab & SPP • Planet. Lab Central: 1000+ nodes worldwide • SPP: programmable router in 5 Internet 2 Po. Ps • Other sites running local versions of Planet. Lab: – Gp. ENI high-speed network in Kansas – GENI-enabled campuses net FPGA CP External Switch GPE NPE Chassis Switch External Switch Network Processing Engine Line Card GP Processing Engines Line Card Chassis Switch 10 x 1 Gb. E Sponsored by the National Science Foundation Feb 18, 2011 21

Outline • • GENI Basics for Experimenters Some Example Resources Some Example Experiments Please Get Involved Sponsored by the National Science Foundation Feb 18, 2011 22

Pathlet Architecture GEC 9 experiment demonstration Resilient Routing in the Pathlet Architecture Deploy innovative routing architecture deep into network switches across the US Ashish Vulimiri and Brighten Godfrey University of Illinois at Urbana-Champaign path 1 • Lets users monitor and select their own network paths to optimize their services • Protects critical traffic even without waiting for adaptation time Sponsoredby bythe the. National. Science. Foundation failed link 23 path 2 November 3, 2010 Feb 18, 2011 23

Active. CDN GEC 9 experiment demonstration Program content distribution services deep into the network, adapt distribution in real time as demand shifts Active. CDN GPO Utah Kansas Clemson Benefits of Active. CDN: • • Dynamic deployment based on load Localized services such as weather, ads and news Sponsored by the National Science Foundation Jae Woo Lee, Janak, Roberto Francescangeli, Suman. Srinivasan, Eric Liu, Michael Kester, Salman. Baset, Wonsang Song, and Henning Schulzrinne 24 Feb 18, 2011 Internet Real-Time Lab, Columbia University

Vi. SE views steerable radars as shared, virtualized resources http: //geni. cs. umass. edu/vise David Irwin et al Weather Now. Casting GEC 9 experiment demonstration Generate “raw” live data Vi. SE/CASA radar nodes http: //stb. ece. uprm. edu/current. jsp Create and run realtime “weather service on demand” as storms turn life-threatening Nowcast images for display 1. “raw” live data Spin up system in Amazon commercial EC 2 and S 3 services on demand Multi-radar Net. CDF Data Nowcast Processing Sponsored by the National Science Foundation Feb 18, 2011 25

GEC 9 experiment demonstration Aster*x Load Balancing (via Open. Flow) Nikhil Handigol et al, Stanford Univ. Program realtime load-balancing functionality deep into the network itself Sponsored by the National Science Foundation Feb 18, 2011 26

Outline • • GENI Basics for Experimenters Some Example Resources Some Example Experiments Please Get Involved Sponsored by the National Science Foundation Feb 18, 2011 27

Experiments Guide GENI Development • GENI needs your feedback – As experimenters, you are the GENI user community – What works? Doesn’t work? Hasn’t been built yet? • GENI Solicitation 3 addresses some key needs – Place more GENI-enabled switches in backbone and regional networks – Additional Wi. Max deployments – “GENI racks” for increased in-network storage and computation – Instrumentation – Experiment Support Sponsored by the National Science Foundation Feb 18, 2011 28

GENI’s next steps • Substantially ramp up research experimentation – More experimenters, more experiments – Support experimenters via training, course materials, summer camps, and help desk – Transition to reliable operations • Enhance the growing meso-scale GENI – – Increase number of GENI-enabled campuses Enhance build-outs in campuses and backbones GENI-enable 5 -6 regional networks Deploy 50 -80 GENI-racks throughout US • Begin to grow from meso-scale to “at scale” GENI We hope you will be a part of GENI’s success. Sponsored by the National Science Foundation Feb 18, 2011 29

Have an Experiment in Mind? • GPO can help – – Bring us in early Advice on best match to your goals Establishment of end-to-end VLANs Some software support If interested, contact Mark Berman (mberman@bbn. com) Sponsored by the National Science Foundation Feb 18, 2011 30

Want to affiliate your infrastructure? • If so, you will become a new GENI “aggregate” – You own / operate your aggregate, and “affiliate” into GENI – You make (some of) your resources available for experiments – Examples: testbeds, campuses, regionals and backbone networks, commercial providers, . . . • Three actions needed on your part – Download GENI API software, modify to reflect your infrastructure resources and local policies – Connect to GENI, ideally at Layer 2 but otherwise via GRE tunnel – Agree to GENI policies, sign MOUs, join GENI operations • Reminder: GENI is still a really early prototype! If interested, contact Heidi Dempsey (hdempsey@bbn. com) Sponsored by the National Science Foundation Feb 18, 2011 31

Conclusion • GENI is entering an exciting phase! • Nobody has done this before • The GPO is here to help GPO Points of Contact Project Director: Chip Elliott, elliott@bbn. com Architecture: Aaron Falk, falk@bbn. com Engineering: Heidi Dempsey, hdempsey@bbn. com Experiments: Mark Berman, mberman@bbn. com Sponsored by the National Science Foundation Feb 18, 2011 32