MEF 3 0 Workshop III Certifying Services Technology

MEF 3. 0 Workshop III – Certifying Services, Technology & Professionals MEF Q 3/19 Members Meeting, July 2019

Agenda • Objectives • MEF 3. 0 Services and Technology Certification • MEF Professional Certification

MEF certification programs enabled the $80 B global CE market $US Billion GLOBAL CE SERVICES MARKET MEF CERTIFIED PROFESSIONALS 80 7000 70 6000 60 5000 50 4000 40 3000 30 2000 20 10 1000 0 0 2013 2014 2015 Sources: Ovum, 2017; MEF, 2019. 2016 2017 2018 2019 2020 2013 2014 2015 2016 2017 2018

MEF 3. 0 services, technology and professional certifications enable full participation in the industry's digital transformation. Certified Services Implementation-agnostic service standards for rapid market adoption • Common language supporting broad industry growth • Attributes and specifications necessary for machine-based automation • Certified Technologies MEF compliance accelerates procurement and deployment • Path to inter-operability and intraprovider automation • Simplification reduces risk • Certification Addressing skills gap challenge Continuous updates to support assured and automated services • Accelerated design and provisioning of solutions between stakeholders • • Certified Professionals

MEF 3. 0 Service & Technology Certification & Roadmaps – CE, SD-WAN & LSO Sonata Marc Cohn, Certification Committee Co-Chair, MEF; Solutions & Technical Strategy, Strategic Marketing, Spirent Bob Mandeville, President, Iometrix Isabelle Morency, Head of Engineering & Standards, Iometrix MEF Q 3/19 Members Meeting, July 2019

MEF 3. 0 uses a new, agile approach to certification. Including Support for multi-service certification Ongoing testing to enable incremental service releases Testing which couples services to LSO APIs MEF 3. 0 CERTIFICATION DELIVERS rapid setup and reduced cost using a cloud-based platform empowering, on-demand testing using a portal-driven certification service accelerated time-to-market through unlimited testing with on-demand model

MEF 3. 0 certification includes updated CE services, plus other new services, APIs and a new platform. E-Line, E-LAN E-Tree, E-Access E-Line, Transit E-Line Active Service Certifications: CE & SD-WAN (Pilot) Active LSO API Certifications: Sonata (Pilot) Virtualized Test Platform; Certification on Demand Considering: IP and Optical Transport Certifications Certify new releases, features, software, upgrades * Pending Release * *

Status: Services and Technology Certifications Services • MEF 3. 0 CE: Available for all CE services • MEF 3. 0 SD-WAN: pilot introduced late July 2019 • MEF 3. 0 Optical Transport: Requires ”Market Assessment” • MEF 3. 0 IP: Requires ”Market Assessment” LSO • LSO Sonata: pilot commencing October 2019

MEF 3. 0 CE Certification MEF LSO Sonata Certification

How it works using a new agile certification platform. CLOUD MANAGER Create | Execute | Compute and Log test cases Portal Test Manager l na o i pt Cloud Test Engine USER PORTAL O Setup | Test | Review the results API Client Emulator SOFTWARE PROBES UNI (or ENNI) Software Test Probe Customer owned whiteboxes runs test software UNI MEF 3. 0 SERVICE Software Test Probe

MEF 3. 0 Certification Workflow with Iometrix 06 MEF 3. 0 Certification Publication in Registry 01 Create an Account with Iometrix and Activate Subscription 02 05 Access Portal, Connect to Cloud and Setup Probes Submit Test Results to Iometrix for Validation 04 Run Tests, Review Test Results and Troubleshoot 03 Configure MEF 3. 0 Service on Network / Product

Real-time industry validation of certifications via the on-line MEF certification registry.

Enabling drill-down on MEF service certification specifics. Service Name MEF 3. 0 Service Certification Date

… and certified MEF 3. 0 technology providers. With drill-down to certification specifics: • • • Hardware Model Software Version MEF 3. 0 Services Test Record Date of Issue

MEF 3. 0 LSO Sonata Certification

Certification Drives Adoption Opportunity Faster time-to-revenue via global adoption of standardized services with inter-carrier APIs Automation Operators will need to automate most inter-carrier transactions for increasingly on-demand, dynamic services Enablement MEF 3. 0 delivers a multi-service, tested, certified bundle consisting of standardized services and APIs

LSO Sonata Certification Overview for Service Providers 1 Players API Carrier Ethernet Access E-Line BUYER Service Providers OSS Vendors 2 BUYER Scope LSO Sonata APIs • • Serviceability Quote Ordering Inventory & Seller Emulator Buyer Emulator LSO Sonata API Emulators Carrier Ethernet Access E-Line SELLER Operators OSS Vendors SELLER • • Test Probe 3 Inputs API with Serviceability Quote Ordering Inventory MEF 3. 0 Service LSO Sonata APIs Test Probe MEF E-Access Service TS IPS IIS SDK TR Technical Specifications Interface Profile Specifications Inter-Provider Implementation Specifications LSO Sonata SDK Certification Test Requirements

Understanding the ‘what’ in LSO Sonata certification. MEF 3. 0 CE Access E-Line Service: • Functionality and performance testing of all certifiable parameters: o Defined by relevant MEF standards, • Examples: o Functional & performance o L 2 CP o SOAM o BW profile test cases LSO Sonata APIs: • Initial certification is for Ordering API • Test cases validate Ordering Management API Requests, Responses and Message Formats. • Examples: o Create New Order o Query Order Details • Testing of additional LSO Sonata APIs available as standards are ratified

LSO Sonata Certification Pilot Service Providers

Pilot Objectives: MEF Perspective 1 st to Market Inaugural API Testing Provide participating SPs the opportunity to establish “first to market” position Awareness • Validate & optimize testing documentation, methodologies and s/w • Quantify benefits – 1 st effort to integrate API development and testing within a certification program Create awareness within the global SP community of pending programs, supported by the right cross sections of participants Certification Registry Pricing Model Validate medium-to-long term options Validate information structure and detail

Pilot Components 1 2 3 MEF 3. 0 CE Access E-Line Certification Optimized Development of LSO Sonata API(s) MEF 3. 0 LSO Sonata Certification

Participant Selection – Who Are We Looking for? Buyers & Sellers of wholesale Carrier Ethernet services MEF 3. 0 Access ELine service delivery in Q 3/Q 4 Service & API resource commitment for limited implementation 1 5 Target participants in initial phase of pilot.

Interested in the LSO Sonata Pilot? For more on LSO Sonata pilot registration bob@iometrix. com info@iometrix. com

MEF 3. 0 SD-WAN Certification

Why SD-WAN Certification is Needed Now What are the most significant challenges for service providers offering or migrating to Managed SD-WAN services? Lack of standardized interoperability between SD-WAN devices from different vendors 49% Technical resources required for design, engineering, customer installation and support Lack of an industry-standard SD-WAN definition Orchestration across multiple technology domains within our network Integration of SD-WAN into customer web portal for other services Integration of security services Supporting different service provider underlay networks Migration to MEF 3. 0 Services Powered by LSO Service Provider Survey – Q 4/2018 MEF with Vertical Systems Group Major Challenge Moderate Challenge 56%

MEF SD-WAN Standard (MEF 70) is now available • MEF 70 Status – Standard MEF 70 approved 7/29! – MEF 70 Phase 2 already underway • SD-WAN Pilot Certification – Compliance testing with MEF 70 standard – Key MEF priority for CY 2019 • Detailed roadmap available on MEF Wiki

MEF 3. 0 SD-WAN Pilot Certification Program Development Collaboration • Analyze and specify the Certification Test Requirements Development • Develop and implement the Certification Test Environment Testing • Major Milestones – MEF 90 (SD-WAN Certification – • Perform testing with pilot partners (operators and vendors) – – – Ramp-Up • Ramp-up and promote the production program – Test Requirements MEF SD-WAN Test Plan MEF SD-WAN Test Environment Pilot Certification Launch 1 st Certifications announced Production program

The Spirent pilot certification workflow. 6 Publish MEF 3. 0 Certification in registry 1 Coordinate with Spirent and execute Certification agreement 2 5 Collaborate with Spirent on a Certification plan Submit test results to Spirent for validation 4 Run tests, review test results and troubleshoot 3 Finalize the target testing environment for the Product/Service under test

MEF SD-WAN Pilot Certification Program Status (Jul 30, 2019) Date 2019 Certification Status References (Wiki) Notes May MEF 70 SD-WAN Service Std. Draft Standard: Released Draft Std. MEF 70 (R 1) June MEF 90 Certification Test Requirements (Standard) Draft: Cf. C review (June) Final Release: 1 Q 2020 MEF 90 Final release: Following pilot July SD-WAN Test Plan Draft circulated for review SD-WAN Cert. Test Plan SD-WAN Cert. Test Partner (S-CTP) specification MEF 70 SD-WAN Service Std. Standard approved 7/29 MEF 70 Ratified by MEF Bo. D Aug Select Pilot Partners MEF is considering partners SD-WAN Pilot Certification Overview If interested, contact Daniel Bar-Lev, MEF ASAP Sep MEF Pilot Certification Launch planning underway N/A Launch event: SD-WAN Summit (Sep 24 -26, Paris) Oct Pilot Certification Testing Planning underway SD-WAN Pilot Certification Overview Contact (S-CTP) for details Nov Announce 1 st SD-WAN Certifications Targeted for MEF 19 N/A Nov 18 -22, Los Angeles Dec Pilot Certification Conclude Target N/A Pilot feedback drives production Cert. program

Why participate in the Pilot? • Attain the first MEF SD-WAN Certification!! • Gain insights on the MEF SDWAN Standards platform • Demonstrate MEF (and industry) leadership • AND, contribute to the MEF Community • To become a Pilot Partner Daniel Bar-Lev, MEF Daniel@mef. net • For more details on the Pilot Marc Cohn, Spirent marc. cohn@spirent. com • # of Pilot Partners – 2 -3 operators – 2 -3 vendors

MEF 3. 0 Service & Technology Certification & Roadmaps – CE, SD-WAN & LSO Sonata Marc Cohn, Certification Committee Co-Chair, MEF; Solutions & Technical Strategy, Strategic Marketing, Spirent Bob Mandeville, President, Iometrix Isabelle Morency, Head of Engineering & Standards, Iometrix MEF Q 3/19 Members Meeting, July 2019