Blueprint Proposal IEC Type 5 Smart NIC Yongsu

Blueprint Proposal: IEC Type 5 – Smart. NIC Yongsu Zhang <zhangyongsu@bytedance. com> Xuan Jia <jiaxuan@chinamobile. com> Sheng Wang<wangshang@chinamobile. com> Yan Mou<mouyan@chinamobile. com> Qihui Zhao <zhaoqihui@chinamobile. com> Fazil Osman <fazil. osman@broadcom. com> Frankie Fan <frankie. fan@broadcom. com> David Berry <david. berry@broadcom. com> Song Zhu <song. zhu@arm. com>

Blueprint Proposal: IEC Type 5 – Smart. NIC Attributes Type Industry Sector Business driver Business use cases Business Cost - Initial Build Cost Target Objective Description New Edge Cloud, Telco VPC (Virtual Private Cloud), 5 G UPF can use Smart. NIC to accelerate the performance. 1. Demonstrate Smart. NIC accelerated Edge stack • OVN-K 8 s in host and OVS offloaded in Smart. NIC 2. Software ecosystem support for Smart. NIC platform 3. Kubernetes support for networking acceleration and Smart. NIC • Upstream Linux SDK • Common drivers for x 86 and Arm • Comprehensive Guest OS support • Full DPDK support • Overlay support (Vx. LAN, GRE) • Hardware offload for Linux • Open. Flow integration • FED & kernel verbs for Ro. CE v 1/2 • Openstack and remote management • Crypto offload drivers

Blueprint Proposal: IEC Type 5 – Smart. NIC Attributes Business Cost – Target Operational Objective Security need Regulations Other restrictions Additional details Description • OVN/Open v. Switch • Open v. Switch offload on Smart. NIC platform • DPDK • Driver support • Kubernetes • Smart. NIC for Kubernetes • CPU manager for Kubernetes • Huge page support • Node Feature Discovery • Related CNI projects • Virtio • Interface to host/VNFs • Crypto offload drivers N/A N/A

Smart. NIC OVS and OVN (VPC Use Case) - Phase 1 Host Controlled OVS Network Controlled OVS Centralized OVN Controller Server OVN Agent Server Kernel Smart. NIC OVN Agent Foundation for other Networking Services: Segment Routing, NFV/VNF, SDS, IPSec, Firewall, etc

Future Use Case – UPF NOW Vender A UPF Securi ty GTP Rule Lookup Qo. S Charg ing IP FWD DPI Host CPU V M Container in VM M g m t VNF Hypervisor SRIOV NIC Ethernet Flow Table Bearer Table GTP Qo. S Charg ing Vender B Smart. NIC IP FWD HW ü Lower CPU usage ü Lower latency ü Lower packet loss ü Wider bandwidth 5

IEC blueprint family software stack Lightweight App orchestration Knative Apps Bare metal Kubeflow Apps Container Edge. X • Networking Software Linux System Networking Infra Orchestration and Installer Kubernetes Containerized Compass Controller VPP, OVS OVN-K 8 s Real Time Linux distribution Network Equipment • • Acceleration Integrated Accelerators Smart NICs FPGA/GPU Switch/GW VM, container, bare metal Servers and customized Edge platforms Virtualized NFs and Physical NFs Resource constraints • • • SR-IOV, DPDK Edge Servers or Networking Edge Platform • • Calico, NSM Contiv/VPP Heterogeneous Architecture Kubernetes SDN Controller for K 8 s HW Accelerations • Integrated accelerators • PCIe/CCIX attached accelerator (Smart NICs, FPGA/GPU)

Accelerated with SRIOV/DPDK VNFs/CNFs (with DPDK) Virtlet Kubelet Multus CNI SRIOV CNI Flannel SRIOV Enabled NIC HW

Accelerated with Smart. NIC VNFs/CNFs (with DPDK) with virtio-user VNFs/CNFs/Micro Service using v. Eth Virtlet Kubelet Multus CNI Flannel Kube-OVN CNI Smart. NICs exposing vhost interfaces and VFs

Example: Stingray Smart. NIC Architecture Application services domain Customer Applications, VM’s & Containers Server Architecture Rightsizing Host CPU Dedicated Customer Cores increasing revenue & Qo. S Fewer Sockets/Cores per Server Node ~$300 -500 per Core Infrastructure Services Domain Platform Architecture: High Performance CPU’s Proven BRCM 100 G NIC/PHY PCIe Gen 3 Complex (x 16) High Speed DDR 4 (x 2) Up to 100 Gb/s Acceleration Engines for Networking, Security and Storage – Low Power: 16 nm, 35 W TDP – – – Programmable Packet Accelerator Crypto HW Accelerator 8 x A 72 @ 3 GHz 100 G MH RNIC HW-based RAID/EC Runs Standard Linux Fast Migration of Overhead Services

Smart. NIC Applications Architectural flexibility to quickly offload multiple overhead Iaa. S services Onload Hardware Appliances… • • Firewall IDS/IPS SD-WAN Router ADC v. TAP Packet Broker …Offload SDS, SDN, NFV Services • • v. Switch v. Router IPSec/SSL/TLS NVMe-o. F RAID/EC KV Store NFV VNFs

Smart. NIC Datacenter Services Layer Datacenter Enterprise/Campus Mobile Telco Clouds Edge Clouds Core Application Services Layer: Containers, Virtual Machines, and Bare Metal Isolation and Encryption VNF’s and Container Re-Use Qo. S and Performance Scaling Packet Processing Services Unified Management End-2 -End Smart. NIC Datacenter Services across all Clouds

Smart. NIC enable Bare Metal Services & Isolation Tenant Managed Nonsecure Provider Managed Secure V M Virtual Server Bare Metal Server Host CPU V M M g m t Tenant Software Tenant Managed Nonsecure Hypervisor Smart. NIC Ethernet CPU NIC Ethernet v. Switch / SDS Security / Management / Provider Managed Secure

Summary › Smart. NIC: Improve network performance and make the network more intellegent. › VPC (Virtual Private Cloud): OVN or OVS offload › 5 G UPF: OVS and decapsulated function offload

Thank you!