Universidad Politcnica de Madrid UPM Solo WAN open

Universidad Politécnica de Madrid (UPM) Solo. WAN: open source WAN optimization David Fernández, F. Javier Ruiz, Luis Bellido, Raúl Álvarez, German Martín, Carlos Vega, Roberto Montero, Mattia Peirano, Francisco Huertas, Antonio Celorio, Juan Carlos Dueñas solowan@dit. upm. es Center for Open Middleware Universidad Politécnica de Madrid

Contents • • WAN optimization techniques Solo. WAN project Use case scenarios and results Virtual testbeds scenarios based on VNX Solo. WAN Project - 2

WAN Optimization Techniques • Objective: improve WAN links performance – WAN link characteristics: lower bandwidth, higher delays, higher cost Data Center B Data Center A WAN • Techniques: – Compression, Deduplication (or dictionary based compression), TCP optimization, Application caches, etc. Solo. WAN Project - 3

WAN optimization based on deduplication Data Center B WOC WAN Optimization Devices WAN WOC B Dictionary/cache Data Center A WOC A Dictionary/cache Solo. WAN Project - 4

WAN optimization based on deduplication Data Center B WOC Info block replaced by a short symbol WAN (hash) Data Center A WOC Redundancy info block detected WOC B Dictionary/cache WOC A Dictionary/cache Solo. WAN Project - 5

WAN optimization based on deduplication Data Center B WOC Data Center A WAN WOC Original info block info recovered WOC B Dictionary/cache WOC A Dictionary/cache Solo. WAN Project - 6

Solo. WAN rationale • Commercial WOC solutions: – Complex systems – Scalability and elasticity issues – High cost in terms of equipment and licensing What about open source software (OSS) based WAN optimization solutions? Solo. WAN Project - 7

Solo. WAN initial objective Evaluate the use of Open Source Software (OSS) for Any OSS mature WAN optimization in solution the context of corporate found? YES communications • Study of available solutions • Creation of virtual and NO real testing environments • Test OSS solutions and conclude Objective reoriented to enhance OSS Open. NOP recommendations WAN optimization platform with: • Efficient deduplication algorithm • Scalable and elastic architecture running on standard hardware Solo. WAN Project - 8

Solo. WAN Architecture • Based on Open Network Optimization Platform (Open. NOP, www. opennop. org) Linux User Space • Linux kernel module + application in user-space • Use of netfilter to capture traffic • Multithread (worker) • Written in C Linux Kernel Solo. WAN Project - 9

Deduplication Algorithm • Deduplication functionality based on: – Neil T. Spring and David Wetherall. A Protocol-Independent Technique for Eliminating Redundant Network Traffic. SIGCOMM '00. • Main problem: how to efficiently identify repeated content? – Computationally intensive • Simplification: – Compare only fixed size blocks (64 bytes) at a reduced number of positions (32) – Calculate a hash (fingerprint) for each block inside a packed and store it in the dictionary together with the packet – Once a match is detected, look around matching block to see if more bytes match ? = New packet to Tx Solo. WAN Project - 10 Transmitted packet cache

Solo. WAN characteristics • Algorithms: – Compression (originally included in Open. NOP) – Deduplication + Compression • Available as a linux daemon or as a docker container • First version released in nov 2014 – https: //github. com/solowan • Multithread architecture with dictionaries shared among threads • Demo virtual machine available with VNX based virtual scenarios • Wireshark Plugin to decode Solo. WAN packet format Solo. WAN Project - 11

Solo. WAN Scenarios – Optimizer-in-the-Network (oitn) WAN Optimizer 1 Optimizer 2 – End-to-End (e 2 e) Application WAN R 1 R 2 Opennopd opennopd h 1 h 2 Process or docker container Solo. WAN Project - 12

Solo. WAN Tests • Mainly tested with FTP, HTTP and access to mysql databases – Not suitable for encrypted traffic • Using benchmark files from Silesia Corpus: – Set of representative files (de 6 a 51 M) – http: //www. data-compression. info/Corpora/Silesia. Corpus/ Solo. WAN Project - 13

Web application interface • Limited management and real time statistics: Solo. WAN Project - 14

Solo. WAN in German IT press • Solo. WAN in the popular German enterprise IT magazine: i. X - Magazin für Professionelle Informationstechnik • Article about open source based optimization solutions: – – Open. NOP Solo. WAN Traffic. Squeezer Wanproxy • Includes laboratory tests: – Highlights the easy installation and high compression rate provided by Solo. WAN Project - 15 WAN

Solo. WAN Scenarios • Traffic redirection based on WCCPv 2 LAN 1 Optimizers Router 1 Router 2 h 1 h 2 LAN 2 h 4 WAN WCCP h 5 h 3 h 6 o 2 o 1 Solo. WAN Project - 16

Solo. WAN cloud architecture • Create a scalable architecture based in Solo. WAN with support for multiple parallel optimizers – Multiple threads per machine – Multiple servers Easy expansion(plug&play) O 4 D 4 Optimizer O 3 Traffic Load Balancer (SDN based) D 3 O 2 D 2 • Use cloud computing paradigms to add optimizers as needed O 1 LAN Solo. WAN Project - 17 D 1 LAN

SDN based Solo. WAN cloud architecture • Reference and testbed scenario: WAN Optimizer LAN A Router 2 Router 1 h 11 h 21 WAN h 12 LAN B lb 2 lb 1 h 13 h 22 h 23 o 11 o 12 o 21 o 13 Floodlight Open. Flow Controllers Solo. WAN Project - 18 o 22 o 23

Scalable architecture Tests Solo. WAN Project - 19

WAN Optimization as a Service • Idea: Integrate WAN optimization as a service available in Openstack Iaa. S • Proof of Concept implementation developed – https: //github. com/carlosv 5/Oaa. S-network • Based on Firewall as a Service (FWaa. S) Openstack code Solo. WAN Project - 20 20

Typical Openstack Scenario Management Network eth 1 controller network compute 1 compute 2 vm 1 Router vm 4 vm 3 Sw Sw NAT eth 2 eth 3 eth 2 Virtual Network Tunnel Network External Network Internet Solo. WAN Project - 21 vm 5

WAN Optimization as a Service Management Network eth 1 controller network compute 1 compute 2 Router NAT eth 2 eth 3 vm 2 vm 1 FWaa. S LBaa. S vm 4 vm 3 Sw Sw WOaa. S eth 2 Virtual Network Tunnel Network External Network Internet Solo. WAN Project - 22 vm 5

WOaa. S Complete Test Scenario (I) • Basic scenario tested over two Openstack clouds h 1 h 2 O 1 WAN Management Network Cloud B Cloud A eth 1 compute 1 network controller Management Network eth 1 controller network compute 1 WOaa. S h 1 WOaa. S Router NAT eth 2 eth 3 h 2 Router NAT eth 2 eth 3 eth 2 Virtual Network Tunnel Network External Network A External Network B GRE tunnel Solo. WAN Project - 23

WOaa. S Complete Test Scenario (II) • Testing infrastructure: Management Network eth 1 compute 1 network controller WOaa. S h 1 Cloud B Cloud A Management Network eth 1 controller network compute 1 Router NAT eth 2 eth 3 WOaa. S eth 2 eth 3 eth 2 Virtual Network Tunnel Network Virtual Scenario A h 2 NAT eth 2 Tunnel Network External Network A External Network B GRE tunnel Virtual Scenario B Laptop. A Switch Solo. WAN Project - 24

Virtual Testbeds • Most Solo. WAN testbeds developed using virtual testbeds based on VNX tool • Combining VM and virtual network emulation on the host it is possible to run Virtual Network Scenarios Virtual Scenario Virtual nodes Net 2 Net 1 Host Net 3 Net 1 Net 4 Internet Real Scenario Virtual Networks VNX tool http: //www. dit. upm. es/vnx Solo. WAN Project - 26 Net 2 Net 3 Net 4 Internet

VNX: Virtual Networks over Linu. X VNX is a general purpose open-source virtualization tool designed to help building virtual network testbeds automatically • Characteristics: – Uses libvirt (Linux virtualization library) – Autoconfiguration for Linux, Free. BSD, Open. BSD and Windows – Support for Dynamips (CISCO) and Olive (Juniper) – LXC containers support – Open v. Switch support • Design Specification Creation Interaction Solo. WAN Project - 27 http: //www. dit. upm. es/vnx 27

Solo. WAN Demo VM • Ubuntu VM including Solo. WAN virtual scenarios Available at: https: //goo. gl/YE 6 QXW Solo. WAN Project - 28

VNX Example scenario: Collaborative OSPF/BGP Practice Requirements for ~400 students: • Backbone: 15 dynamips routers, 5 servidores • Cient networks : 400 x 5 routers Linux with quagga routers, 4 PCs • Switches • Configuration management • 400 different configurations Solo. WAN Project - 29

References • Center for Open Middleware (COM). – http: //www. centeropenmiddleware. com/ • Solo. WAN repository at Github. – https: //github. com/solowan • Virtual Networks over Linux (VNX). – http: //vnx. dit. upm. es • WOaa. S Prof-of-concept implementation. – https: //github. com/carlosv 5/Oaa. S-network Solo. WAN Project - 30

Universidad Politécnica de Madrid (UPM) Thanks for your attention Any questions?