Serverless Network Srvices In Open Stack Data Centers

Serverless Network Srvices In Open. Stack Data Centers Open. Stack Summit Eran Gampel, CEO at Cloudigo Erez Cohen, VP Cloud. X program at Mellanox Boston May 2017

Virtual Networking § Mature. Provides virtualization, Isolation, advance services … § But does it fit high IO performance use cases? § More and More Use cases for High-Performance Virtual Network are emerging. VM VM Hypervisor v. Switch NIC Cloudigo & Mellanox Technologies 2017 2

Existing Solutions For Virtualized High performance IO • OVS-DPDK • VPP • SR-IOV Cloudigo & Mellanox Technologies 2017 3

SR-IOV § Single Root I/O Virtualization (SR-IOV) specify a standard way of bypassing the VMM’s involvement in data movement by providing independent memory space, interrupts, and DMA streams for each virtual machine. § SR-IOV allows a physical network adapter to appear as multiple PCIe network devices. Software Switch VM VM SR-IOV Hypervisor VM VM Hypervisor v. Switch NIC Cloudigo & Mellanox Technologies 2017 Physical Function (PF) Virtual Function (VF) SR-IOV NIC 4

SR-IOV: Pros And Cons § Pros • Lower processor utilization and network latency • High IO performance • Persistent performance up to line rate SR-IOV Hypervisor VM VM § Cons • Static VF allocation, VF relay on PF configuration • Most NIC include limited switching capabilities for VF’s on the same NIC • No local virtual services such as Security Groups (SG) and more Cloudigo & Mellanox Technologies 2017 Virtual Function (VF) SR-IOV NIC 5

High Performance Virtualized Services Challenges § Use relatively high CPU footprint for virtual network services § Relay on the virtual switch features, no custom action unless redirected to controller § Overhead (CPU, latency and bandwidth) increases with the number of flows § For advance services that are provided in VM or appliance, traffic need to be steered to service Compute Node Network Node Virtual Services VM SR-IOV VM VM Hypervisor v. Switch SR-IOV NIC Cloudigo & Mellanox Technologies 2017 6

Web Application Evaluation - Progression to Serverless Tier 1 App Tier 2 Tier 3 Monolithic Application Cloudigo & Mellanox Technologies Services 2017 Microservice Serverless 7

Serverless For Networking Services - Is It Possible? VM NAT Shapi ng OEM CT Qo S Alar m ACL TCP L 2 Route IPS HA Tunn el Monolithic Appliance Cloudigo & Mellanox Technologies NAT Scale DPI Shapi ng MN G OEM Virtual Appliance 2017 CT Qo S Alar m ACL Scale DPI TCP IPS Rout e Smart NIC NAT Dpi LB Route ENCA P SEC HA L 2 Tunn el LB Serverless 8

The Rise Of The Smart NIC § Modern data centers demand advance, smart NICs • • High bandwidth, 100 G today, 200 G this year Low latency Transport offloads Kernel bypass Advance virtualization support Flow based switch Software programmable § Smart NICs are the future • ASIC: Highest performance and efficiency • ASIC + FPGA: High efficiency and flexibility • CPU / System On a Chip: Most programmable Cloudigo & Mellanox Technologies 2017 9

Mellanox Connect. X Family Introduction § ASIC based smart NIC § Features • • • Connect. X-5 150, 00 131, 74 84, 18 100, 00 45, 23 23, 44 11, 979, 618, 12 50, 00 Cloudigo & Mellanox Technologies 2017 15 Cores Line Rate 12 8 25 6 51 2 10 24 12 80 15 18 0, 00 64 Frame rate [mpps] Gen 3 and Gen 4 X 16 PCIe 2 Network Ports, 10, 25, 40, 50 and 100 G Stateless offloads (inc. overlay offload) Highest DPDK performance (over 131 Mpps) Single Root IO Virtualization (SR-IOV) - HW based Qo. S, High Availability • Accelerated Switch And Packet Processing (ASAP 2) - In host network services offload or acceleration - VNF acceleration • Remote Direct Memory Access (RDMA) - Storage and application transport acceleration 10

Accelerated Switching And Packet Proccessing (ASAP 2) § NIC contains advance embedded flow based switch/router (e. Switch) § Offload “Match -> Action” operations § HW based classification, steering, encap/decap, header rewrite and more § Open source, standard control APIs: TC, DPDK Connect. X-5 Cloudigo & Mellanox Technologies 2017 11

ASAP 2 Implementation Example – OVS Offload OVS DPDK 1 Flow VLAN 7. 6 M PPS 60 K flows 1. 9 M PPS VXLAN ASAP 2 Direct 33 M PPS 16. 4 M PPS § Zero! CPU utilization on hypervisor Million Packet Per Second 35 compared to 2 cores with OVS over DPDK • Same CPU load on VM 30 4, 5 2 Cores 25 20 15 10 3, 5 2, 5 [VALUE] MPPS 2 1, 5 [VALUE] Cores 5 OVS over DPDK Message Rate 2017 4 3 0 Cloudigo & Mellanox Technologies [VALUE] MPPS 1 0, 5 0 Number of Dedicated Cores Test OVS Offload Dedicated Hypervisor Cores 12

Open. Stack Virtual Services For SR-IOV § Line rate SR-IOV including distributed statefull services. SG, Virtual Router, LB § Linear Scale up to line rate without using extra CPU resources Physical Host layout Tenant Overlay Logical View Virtual Router Neutron. Server Neutron Virtual Switch Compute Node VM CLOUDIGO ENGINE VM SG Virtual Function (VF) VM 1 SG SG VM 2 VM 3 SR-IOV NIC Cloudigo & Mellanox Technologies 2017 13

Cloudigo’s Programmable Network Infrastructure § Programmable Infrastructure with Built-In ultra efficient network services § Seamless offload of the core discrete functions to commodity HW 20% Other… CLOUDIGO SW PROGRAMMABLE ENGINE NAT FW DDo. S LB User Defined Offload Learning Engine ASIC Layer - NIC Adapter Cloudigo & Mellanox Technologies 2017 14

Cloudigo – HW + SW Engine VM VM Thin layer with minimal latency and resource usage Zero Copy Ports (SR-IOV like) CLOUDIGO SW PROGRAMMABLE ENGINE SR-IOV VF CLOUDIGO SW PROGRAMMABLE ENGINE NAT DDo. S FW SR-IOV VF HW Pipeline LB 3 rd Party NAT LB FW DDo. S Route CLOUDIGO INSTALLED PIPELINE External Ports Cloudigo & Mellanox Technologies 2017 15

Open. Stack Virtual Services For SR-IOV § Line rate SR-IOV including distributed statefull services. § SG, Virtual Router, LB § Linear Scale without using extra CPU resources Logical Router 20% Other … CLOUDIGO ENGINE VM VM … VM DDo. S SR-IOV VF CLOUDIGO INSTALLED PIPELINE Connect. X 5 LB 3 rd Party Logical Switch SG VM 1 SG Logical Switch SG VM 2 VM 3 External Ports Cloudigo & Mellanox Technologies 2017 16

CPU Utilization VM density and Latency Improvement Test Scenario: Virtual routing and state full security groups for VM’s Server: 2 x. E 5 -2690 v 4 (14 cores) Total: 28 cores 90% CPU saving Improving VM density by almost 200% Almost eliminating latency for virtual network services SR-IOV + Cloudigo OVS-DPDK VM VM OVS-DPDK NIC OVS-DPDK – ~8 Gbps for 1 core For 100 Gbps = 12 cores 16 cores left for VM’s = 4 x 16 = ~64 VMs Minimal Latency for OVS-DPDK layer = 33 us Cloudigo & Mellanox Technologies 2017 VM Cloudigo VM Virtual Functions (VF) Smart NIC 1 core of Cloudigo engine for 100 Gbps 27 cores left for VM’s = 4 x 27 = ~ 108 VMs Latency for Cloudigo layer = ~0 us 17

Solutions Use Cases § v. CPE § v. BNG §… VM VM VM SR-IOV CLOUDIGO ENGINE SR-IOV NIC Tunnel LB Cloudigo & Mellanox Technologies 2017 Qin. Q PPPo. E Route SEC … 18

Questions? Eran Gampel, CEO at Cloudigo (eran@cloudigo. io) Erez Cohen, VP Cloud. X program at Mellanox (erezc@mellanox. com) Cloudigo & Mellanox Technologies 2017 19