PNDA Review PNDA Project Summary Project recap What

PNDA Review

PNDA Project Summary • Project recap – What is PNDA • Latest PNDA Release: PNDA 5. 0 released in November • PNDA Collaboration • ONAP: PNDA integration, providing data platform to DCAE • MEF: PNDA as big-data reference platform in MEF LSO architecture • PNDA Community Evolution: Towards a regular LFN project © 2016 PNDA a Linux Foundation Collaborative Project. All rights reserved. 2

Why PNDA? Innovation in the big data space is extremely rapid, but combining multiple technologies into an end-to-end solution can be extremely complex and time-consuming PNDA removes this complexity and allows you to focus on developing the analytics applications, not on developing the pipeline – significantly reducing the effort required and time-toinsight © 2016 PNDA a Linux Foundation Collaborative Project. All rights reserved. 3

PNDA Logstash Open. BPM pmacct XR Telemetry Data Distribution ODL Processing Query Visualisation and Exploration Real -time SQL Query Data Exploration Stream OLAP Cube Metric Visualisation Batch Search/ Lucene Event Visualisation File Store No. SQL Time Series Platform Services: Installation, Mgmt, Security, Data Privacy PNDA Plugins PNDA Producer API • Simple, scalable open data platform • Provides a common set of services for developing analytics applications • Accelerates the process of developing big data analytics applications whilst significantly reducing the TCO • PNDA provides a platform for convergence of network data analytics PNDA Applications Unmnged App PNDA Mnged App App Packaging and Mgmt PNDA Consumer API © 2016 PNDA a Linux Foundation Collaborative Project. All rights reserved. 4

PNDA Capabilities • • Platform for data aggregation, distribution, processing and storage Openstack, AWS, bare-metal, VMware • RHEL and Cent. OS • Typical install ~1 hr • Online and offline install; modular install Open producer and consumer APIs • • Avro platform schema Apache Kafka for data distribution • Plugins for Logstash, pmacct, Open. BMP, Open. Daylight, Cisco XR-telemetry, bulk ingest … Data store: Automated data partitioning and storage (HDFS) • Open. TSDB – time series analysis • Automated installation, creation, and configuration • • • Hbase - No. SQL Support for batch and stream processing: • Apache Spark and Spark Streaming • Jupyter notebooks for prototyping and data exploration • Impala-based SQL query support • Grafana for time series visualisation • PNDA application packaging • PNDA management and dashboard © 2016 PNDA a Linux Foundation Collaborative Project. All rights reserved. 5

Project Statistics • ~40 contributors from ~10 companies • Main Contributors to PNDA 5. 0: Cisco, Xoriant, Gradiant, Maple. Labs • 4869 commits across 16 repositories • 848 Jira issues in 2018 – 483 done • 120 discussion topics in 2 mailing lists © 2016 PNDA a Linux Foundation Collaborative Project. All rights reserved. 6

New in PNDA 5. 0 • Perimeter security with Knox as well as user sign-on across components • Revised ingest with Gobblin • Name based service resolution with Consul • Apache Flink integration • Experimental deployment to VMware with Terraform • Integration with ONAP as analytics platform for DCAE (ONAP Casablanca Release) • Containerisation of Red PNDA © 2016 PNDA a Linux Foundation Collaborative Project. All rights reserved. 7

PNDA Collaboration: ONAP Integration • Casablanca Release • PNDA deployment integrated into OOM project • Delivers PNDA as part of DCAE on Openstack • End to end VNF analytics showcased as part of virtual firewall use case • Roadmap • Application deployment and orchestration • Improved data integration • Kubernetes native PNDA © 2016 PNDA a Linux Foundation Collaborative Project. All rights reserved. 8

PNDA Collaboration: MEF Enabling LSO to realise the vision of reactive networking Orchestration service models provide necessary context for analytics Output from analytics can close the control loop to realize reactive networking © 2016 PNDA a Linux Foundation Collaborative Project. All rights reserved. 9

PNDA Community Evolution Objective: Evolve PNDA to a regular LFN project • • Community growth being driven by • • • Broad Community Evolve governance Leverage LFN tools, Infrastructure PNDA platform evolution: Containerization and Kubernetes Collaboration: ONAP integration Education & SDO community Test & Deployment environment availability (community labs) Accelerated community building (ongoing) • • • Weekly community calls Working on evolved charter and governance Establishing a Technical Steering Committee Community events Gathering requirements and planning roadmap for PNDA 6. 0 © 2016 PNDA a Linux Foundation Collaborative Project. All rights reserved. 10