Is Open Stack Ready for 5 G Malini

Is Open. Stack* Ready for 5 G? Malini Bhandaru Principal Engineer/Cloud Architect, Intel Acknowledgements: Yunhong Jiang, Brian Skerry, Sandra Rivera

AGENGA • 5 G: What? When? • Expectations & Challenges • Jitter and Latency • Open Source Initiatives Acknowledgements: Yunhong Jiang, Brian Skerry, Joseph Gasparakis, 2

5 G: What? When? Challenges

5 G: Wireless TECHNOLOGY EVOLUTION Higher speeds, Higher Capacity, Ultra Low Latencies 4 G: Wi. MAX, LTE 100 Megabits -> Gigabits 2017 - Pre-5 G 2018 – 5 G NR (New Radio) Standard 20 Gbps and 1 ms latency 2020 - True-5 G + devices 4

Source: Sandra Riviera 2017 Keynote ONS https: //www. uryoutube. com/watch? v=1 m. TYSJGvot 0 5

TENANT ISOLATION, QOS, POLICY 6

Latency & Jitter

Time Scales • Voice Over IP (VOIP): 150 milliseconds • LTE Cloud RAN (Radio Access Network): 1 millisecond • 5 G requires 1/10 shorter latencies • Automated Stock Trades: microseconds CPU to Memory Speed: 6 -8 GBps PCI-Express x 16: 5 GBps RAM Access: 200 ns L 3 Cache Access: 4 ns Context Switch: 1000 ns (3. 2 GHz) Network interfaces: 10 Gbps http: //www. slideshare. net/OPNFV/summit-16 -achieving-low-latency-network-function-with-opnfv

TIME CONSUMERS System Calls Context Switches Data Copying Reserve Resources Reduce Interrupts Qo. S Interrupt Handling Resource Contention 9

SOURCES OF Latency VNF Network VCPU Open. Stack* Service v. CPU Function Open v. Switch Daemon Apps Kernel v. CPU Preemption v. HW Virt. IO Interrupt Latency Soft IRQ Latency v. CPU scheduling NICs Threads/IS R Linux* OVS Kernel Module KVM v. Host Kernel Network Stack HW Resource Contention CPU core Multiple Bridges HW NIC Virtualization Overhead Memory *Other names and brands may be claimed as the property of others. L 3 Cache

Open Source Ecosystem OPNFV, ONAP, DPDK, ODL …

Intel Active Octopus Releng Pharos Moon OPNFV Projects Others Active Little Activity External Development Infrastructure Legend Armband Genesis Barometer Models SFC Fuel Net. Ready Availability IPv 6 VES Copper Multisite vsperf Apex Doctor Prediction Parser SDNVPN Domino Escalator Func. Test Kolla Promise VNFFG Inspector ENFV Pinpoint Movie Bottleneck Stor. Perf s Feature Development Joid Compass Daisy Opera Courtesy: Brian Skerry/Intel Open. Daylight KVM 4 NFV ONOSFW Open. Retriever (Containers) (Open-O) Openstack Orchestra (Open Baton) Installers Yardstick OVNO (Open. Contrail) KVM Open Source Ingredients Dovetail ovsnfv DPACC Stor. Perf DPDK Cperf ODP Policy. Test fds (fd. io) OVS Open. Contrail Test Suites 12

KVM 4 NFV: BIOS & OS Configs Jitter Latency Disable Power Features Skip Syncs & Legacy Support C-State, P-State, Turbo Disable Sharing RCU Sync, Legacy USB & Port emulation No Hyper-threading, Data scrubbing No RT Throttling, Leverage Affinity: IRQ, NUMA Yes CPU Isolation Yes Memory allocation Yes Huge pages Direct Access: Device pass-through, IOMMU Clock : Reduce tick frequency, Disable TSC watchdog 13

KVM 4 NFV: Speeding LIVE MIGRATION Need: service upgrades/patches/HW failures Ineffective: Compression (SW), RDMA (zero-page benefit lost), auto-converge (reduces responsiveness) Optimizations: • Defer clean-up operations, • Using AVX 2 for zero page checking (32 versus 16 ) • Drop redundant synch http: //opnfvdocsdemo. readthedocs. io/en/latest/submodules/kvmfornfv/docs/release/userguide/index. html 14

Intel® Quick. Assist KVM 4 NFV - SPEED INTER-VM COMMUNICATION Technology Quick. Assist Crypto Accelerator r CPU & Software Protected SHARED MEMORY Host Interface IDS/ IPS Firewall v. Swtich Flow Director Tx Scheduler ACL / GFT Parser VEB TEP VEB Inline Decrypt Inline Crypto Policer ACL Parser MAC Tx MAC Rx NIC Receive VPN NIC Transmit VEB – Virtual Embedded Bridge TEP – Tunnel End Point ACL – Access Control List GFT – Generic Flow Table VNF – Virtual Network Functions VM to VM communication between Virtual Network Functions, needs multi- 100 s of Gbps throughput Gateway / Router Virtual Network Functions https: //wiki. opnfv. org/display/kvm/Vm 2 vm+Mst

OPNFV - Enhanced Switching Linux Packet Processing Data Plane Development Kit (DPDK) Leverages processor affinity, huge pages, shared memory, lockless sync, polling, NUMA awareness & vector processing DPDK Packet Processing http: //www. slideshare. net/garyachy/dpdk-44585840

OPNFV: NETWORK SERVICES Ben. CHMARK (NSB) • Real Telco Workloads Thanks: Brian SKERRY/Intel • Dimensions & Stress Vectors • NFV Scalability & Agility • System capacity needs • TCO Models VNF-ENV Native Linux Standalone Virt env Managed Virt env Scale-Up Scale-Out KPIs Network VNF NVFI Telco VNF Open Source Approximations ACL, Firewall CG-NAT, PE, SAE-GW …. https: //github. com/opnfv/yardstick/blob/master/docs/testing/userguide/13 -nsb-overview. rst https: //networkbuilders. intel. com/blog/industry-standard-benchmarks-for-nfv 17

OPNFV – PHAROS COMMUNITY LABS INVITATION -- TEST ON REAL SERVERS ! https: //wiki. opnfv. org/display/pharos/Community+Labs Intel, Nokia, Ericsson, Huawei, CENGN, DELL Orange, China. Mobile. . https: //www. youtube. com/watch? v=_8 qr. K 3 bvjt. Q&feature=youtu. be 18

Open. STACK* – Intel® Resource Director Tech. NOLOGY (RDT) Allocate resources, Measure usage Predictable performance DESPITE noisy neighbors Shared Last Level Cache 19

OPENSTACK - Accelerators: Intel® Quick Assist technology • Function: Fixed & Programmable, HW offload (QAT) & FPGAs • Scalable, zero-copy memory, SR_IOV pass-through • Agnostic: Operating System, user/kernel space, sync/async • Crypto (symmetric & public-key), compression/decompression • VPNs, HTTPS (Gmail/Facebook/Twitter, Compress (Live Migration) QAT Compress/decompress: 24 Gbps Crypto: 50 Gbps 20

FUTURE • Intel® RDT – memory & network bandwidth monitoring and allocation • Local monitor and adapt • Intel ® Rack Scale Design – software defined infrastructure • Disaggregated compute, storage, networking • 5 G modems • Microsecond platform time granularity 21

Get Involved! Edge Clouds, ONAP, OPNFV - Share Benchmarks, Use Pharos

Is Open. Stack Ready for 5 G? Is closer! Get Involved!!! 23

Thank You!!! Visit our booth for demos of Intel® RDT, Intel® Rack Scale Design, and Intel® QAT 24

REFERENCES • Open. Stack Barcelona Videos: https: //www. openstack. org/videos/summits/barcelona-2016 • What is 5 G? http: //www. pcmag. com/article/345387/what-is-5 g • http: //www. slideshare. net/garyachy/dpdk-44585840 25

REFERENCES • KVM 4 NFV: https: //wiki. opnfv. org/display/kvm/Nfv-kvm • http: //artifacts. opnfv. org/kvmfornfv/docs/index. html • http: //rhelblog. redhat. com/2015/09/29/pushing-the-limits-of-kernelnetworking/ • https: //builders. intel. com/docs/container-and-kvm-virtualization-for-nfv. PDF • https: //software. intel. com/en-us/articles/using-hardware-features-in-intelarchitecture-to-achieve-high-performance-in-nfv 26

REFERENCES • SR-IOV: http: //www. intel. com/content/dam/www/public/us/en/documents/technologybriefs/sr-iov-nfv-tech-brief. pdf • QAT: https: //software. intel. com/en-us/articles/how-intel-quickassisttechnology-accelerates-nfv-use-cases • ONAP: https: //wiki. onap. org/ • https: //www. openstack. org/summit/boston-2017/summitschedule/events/18954/introducing-onap-with-the-linux-foundation • Pharos Lab https: //www. youtube. com/watch? v=_8 qr. K 3 bvjt. Q&feature=youtu. be 27

REFERENCES • RDT: http: //www. intel. com/content/www/us/en/architecture-andtechnology/resource-director-technology. html • Deterministic performance : https: //builders. intel. com/docs/networkbuilders/deterministic_network_functio ns_virtualization_with_Intel_Resource_Director_Technology. pdf • http: //schd. ws/hosted_files/lcccna 2016/d 3/Drive. Scale-Lyon-Rack. Scale. pdf • https: //en. wikipedia. org/wiki/Time-Sensitive_Networking 28

REFERENCES – EDGE CLOUDS • https: //www. openstack. org/summit/boston-2017/summit-schedule/globalsearch? t=edge • https: //www. openstack. org/summit/boston-2017/summitschedule/events/18988/openstack-on-the-edge-fogedgemassively-distributed-cloudsbirds-of-a-feather • https: //etherpad. openstack. org/p/BOS-UC-brainstorming-Massively. Distributed-Fog. Edge • https: //www. openstack. org/summit/boston-2017/summitschedule/events/18671/fogedgemassively-distributed-clouds-working-group • https: //etherpad. openstack. org/p/Massively_distributed_wg_boston_summit 29