Open Flow Experiencias en Implementacin y Gestin de

Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales Open. Flow: Experiencias en implementación y operación de testbeds internacionales Joan A. García-Espín Jornadas Técnicas de Red. IRIS 28 Noviembre 2012

Introduction Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales • OF provides a way of controlling the forwarding of packets through a network element from a remote server, using the OF protocol. • OF Testbed Facilities enable researchers to try new ideas over production equipment at an affordable cost NW Control application Open. Flow controller – Some facilities (OFELIA) offer it at NO cost for academic research • During the last years i 2 CAT has been designing, implementing and deploying a Future Internet facility for four main initiatives: – – FP 7 OFELIA project FP 7 FIBRE project Géant 3 project Own facility, codenamed EXPERIMENTA Switch packet/ circuits Processing

Experience from FP 7 OFELIA Initial OF island design and OFELIA Control Framework

Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales OFELIA at a glance - Started September 2010 - Duration: 3 years - Total budget 6. 3 M€, funding 4. 45 M€ - 12 partners – – – Academic institutions Industry partners: DT, NEC, ADVA Optical Stanford university (Nick Mc. Keown, Guru Parulkar) official partner (control framework, architecture, experience) - 8 Open. Flow-enabled islands at academic institutions - Objective: Create a pan-european Openflow testbed Offer Openflow as a service for European experimenters Berlin (TUB) partial replacement of existing campus network with Open. Flowenabled Switches Gent (IBBT) central hub, large-scale emulation Zürich (ETH) connection to One. Lab and GENI Barcelona (i 2 CAT) L 2 switches and Optical equipment (ROADM ring) Essex (UEssex) national hub for UK optical community; L 2 switches and L 1/L 0 ROADMs (optical mesh network), FPGA testbed Rome and Catania (CNIT) two islands with focus on Information Centric Networking Trento (CREATENET) a city-wide distributed island based on L 2 switches and Net. FPGA; opt-in users via heterogeneous access technologies

Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales OFELIA Offering • The OFELIA facility is open as a best-effort service: – Any user accepting the usage policy is welcome – Connection to the facility through Open. VPN via the central hub at IBBT in Ghent – Through a GUI, a user can create and run experiments • An experiment/slice consists of: Facility is publicly available for experiments Feedback is very much appreciated – A number of end points (Xen-based virtual machines, currently) – Open. Flow access to a set of switches that connect the end points • The user’s Open. Flow controller can be deployed on one of the VMs – Links between end points and switch ports: • Best effort (shared), mostly • Dedicated capacity will be available at least on some lines • Instructions, Wiki, Videos, Open Calls, press releases… http: //fp 7 -ofelia. eu The control framework software is free Build your own OFELIA islands, connect over to us, develop further

i 2 CAT OFELIA island overview i 2 CAT OFELIA island (Barcelona) Multi-vendor extensive L 2 deployment. Complete meshed topology on the experimental Openflow network. No “opted-in user” traffic, only experimental traffic. Computing equipment (In production) 5 x Super. Micro SYS-6010 T-T servers. Network equipment (OF enabled) (In production) 5 x NEC IP 8800/S 3640 -24 T 2 XW switches (Ready for production) 3 x HP E 3500 -48 G-Po. E+yl switches EXPERIMENTA’s i 2 CAT testbed (not part of OFELIA) (Conn. on demand) 1 x Juniper MX 480 3 D + OF support Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales

Network design: Equipment in the OFELIA island NFS LDAP Public internet DNS Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales Expedient FV Rest of internal services Management VPN (Open. VPN L 2) VT-AM NEC Experimental Private (offices, …) Other testbeds Open. Flow, connects VMs andand OFOF • Experimental: Open. Flow, connects VMs and OF switches, experimental traffic. • Control: IPv 4, connects infrastructure and gives Legacy, access to the user services. access to the users. • Management: IPv 4, IM management, no user traffic.

Network design: Federation of OFELIA islands Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales • Unique Ethernet segment spanning all Europe for experimentation • Interconnection through Open. VPN tunnels. In the next months, connect through GEANT backbone ( L 2 VPN as backup). • Control and management L 3 routed IP 4 network, with 2 logical networks (VLAN). Routing OSPF • Access through L 2 VPN (from the Internet) i 2 CAT Island IBBT Island IP 4 ctrl&mgmt tunnel Openflow tunnel

OFELIA Control Framework (OCF) Capabilities Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales • Supported resources Open. Flow Switch Virtualized Servers Net FPGA Optical APs Vertigo Xen (virt. Topologies) … Virtual. Wall Emulab nodes • Extensible to new resources: AM Base Class • Easy federation schema: – Federation at AM’s level: isolating administrative domains – Intra federation (homogenous CF) out of the box – Inter federation (heterogenous CF) focused on resource sharing and possible through multiple interfaces (SFA, GENI…) • Multiple user interfaces : Web. UI CLI …

OCF Current Architecture (v 0. x) Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales Expedient: – User Web. UI – Plugins: handling visualization, and resource specific communication. – Clearinghouse: projects/slice mgmt, users permissions. VT AM: virtualized servers AM. – API: XMLRPC, custom Rspec. – Agent: VM provisioning and hypervisor comm. OPTIN Manager: OF AM. – Flow. Visor (openflow proxy controller). Manage flowvisor flowspace for slicing slice the openflow network – API: GENI XMLRPC, OF RSpec v 1

OCF Screenshots (1/2) Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales

OCF Screenshots (2/2) Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales

Experience from FP 7 FIBRE Federation with OMF and intercontinental testbed

Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales FIBRE at a glance • What? • Create a common space between the EU and Brazil for Future Internet (FI) experimental research into network infrastructure and distributed applications. • Who? 15 partners, coordinated by i 2 CAT and UFPA UEssex NICTA UFG UPMC i 2 CAT Nextworks UTH UFSCar CPq. D, USP UNIFACS RNP, UFF UFRJ • How? Requested to the EC 1. 1 M€ and CNPq R$ 2. 3 in funding to perform 6 activities – – – WP 1: Project management WP 2, WP 3: Building and operating the Brazilian (WP 2) and European (WP 3) facilities WP 4: Federation of FIBRE-EU and FIBRE-BR facilities WP 5: Joint pilot experiments to showcase the potential of the federated FIBRE facility WP 6: Dissemination and collaboration

Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales CONCEPT: What do we want? • • • Federation of testbeds (OCF and OMF –based testbeds) Enhancement of actual CFs Resource sharing • Registration in one site – Access from anyone FIBRE-EU Enhanced CF FIBRE-BR Enhanced CF UFSCar CPq. D OFELIA OCF UFPA UFG UNIFACS USP UFRJ i 2 CAT UEssex RNP UFF FIBRE NITOS OMF

FIBRE and OFELIA i 2 CAT islands Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales

Experience from GEANT 3 Network Factory Apply lessons learned to help design a software based OF testbed on top of GEANT 3

Participants Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales • GRNET / ICCS (Greece) • SWITCH (Switzerland) • Fundació i 2 CAT (Catalonia, Spain) • DANTE (United Kingdom) A perfect-fit collaboration of two European NRENs, a Research Institute and a pan-European R&D Infrastructure Operator

Key facts about Open. Flow in JRA 2 -T 5 Network Factory Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales • A software-switch based facility – Architected so that Open. Flow-enabled hardware switches can be introduced seamlessly • Functionality delivered to end-users: – Slice request submission – Slice instantiation – Slice management – Slice decommissioning functionalities • Experimenting within a slice is not disrupted, while the GÉANT production environment remains unaffected

GN 3 Open. Flow Po. P Design Principles • Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales 5 Open. Flow Po. Ps interconnected with a full mesh of L 2 VPNs over GÉANT – Co-located with GÉANT Po. Ps • 2 general purpose servers per Po. P for: – Open v. Switch – XEN hypervisor to deliver user VMs • Using Open. Flow v 1. 0 -> VLAN-based slicing – Limited capabilities for non-VLAN slicing for VLAN-based experimentation • Orchestration software: FP 7 OFELIA Control Framework (OCF) Resource allocation and instantiation (per slice) Authentication/Authorization (AA) and policy framework Web-based user interface for slice access and management Robustness, stability and scalability in terms of number of users, support for concurrent experiments and number of managed resources. – Monitoring of slices and the OCF components themselves – –

GN 3 Open. Flow Po. P Implementation over GEANT Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales

GN 3 Open. Flow Po. P A closer look to the setup Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales

GN 3 Open. Flow Po. P Use Cases • Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales UC#1: LHCONE MPTCP testing group: To carry some of the MPTCP stack & Open. Flow experimentation for LHCONE over the GÉANT Open. Flow testbed. • UC#2 Using Open. Flow as a TE mechanism to manage the backbone paths, etc. to serve specialized applications and protocols at the end systems. Examples: – DC live migration middleware – Ultra-high bandwidth data transport • UC#3 Using Open. Flow to deliver L 2 slices for experimentation at L 2 and above on the data and control plane. Examples: – Ethernet OAM testing – Protocol development/research

EXPERIMENTA. i 2 CAT’s Open Experimental Facility

EXPERIMENTA Facilities @ Barcelona Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales

Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales Gracias por su atención Más información en: www. fibre-ict. eu www. geant. net www. fp 7 -ofelia. eu Joan A. García-Espín joan. antoni. garcia@i 2 cat. net Jornadas Técnicas de Red. IRIS

Back-up 27

Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales OEFELIA Timeline Explain how an early operative prototype project will. Three be gradually phases expanded and who to set-up and will do it, including extend budgetary issues Operation of the individual islands: – Phase i: OF controllers and switches in place, first local experiments concluded – Phase ii: Connect islands and extend OF experimentation to wireless and optics – Phase iii: Automate resource assignment and provide connections to other FIRE and non-European research facilities the facility Gradual expansion of early operative facility Open Calls to extend facility & consortium on M 5 (jan’ 11) and M 17 (jan’ 12) - Total budget € 830, 000 max. 200 K€ funding per experiment • First closed March 2011 • Second closed March 2012 Open Calls i: Create islands on L 2 ii: Connect islands and extend to wireless/optics M 7 iii: Ressource assignment automization and connection to other facilities M 19

OFELIA Control Framework (OCF) Introduction Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales • What is OCF? – OCF is an open source testbed management software originally developed to be used in the OFELIA facility. • Objectives of the OCF – – – Orchestrate and automate testbed resource sharing Ensure OFELIA distributed and autonomous nature Offer Openflow network resources (slices) Provision L 2 aware IT resources (VMs) Allow resource (both network and IT) basic monitoring Provide an easy to use web interface (at least)

Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales OCF Roadmap (v 1. x) WEB UI … CLI UI CH Administrative Domain Resources Domain AM VT AM OPENFLOW AM (FOAM BASED) …… Plugin–based UIs – GUI: plugin-based independent web UI. – CLI: OMNI-based, evolved if required. AM APIs: Driver based APIs – Native OFELIA API, intially based on a GENI evolution towards OFELIA requirements including MONITORING – SFA – Native GENIv 3…

Current OFELIA XEN Servers configuration Open. Flow: Experiencias en Implementación y Gestión de Testbeds Internacionales vif 1. 0 | eth 0 eth 1. 999 vif 1. 0 | eth 1 Dom. U 1 Management interfaces (SSH) Experimentation interfaces Server management interface vif 1. n | ethn eth 2 Dom 0 vif. N. 0 | eth 0 vif. N. 1 | eth 1 eth. N Dom. U N vif. N. n | ethn peth 1. 999 eth 0 eth 1 peth 2 peth. N • eth 0 provides access to the server for management and internet. • eth 1. 999 eth 2. . eth. N are linux bridges connecting VIFs (VMs) with physical interfaces of dom 0 (server). • eth 1. 999 tags control traffic (SSH for the VMs) transparently to the user (IP 4 out-band network) • eth 2…eth. N are used for experimental (OF) traffic. • Linux bridge to be replaced by Openvswitch soon.