m Plane Building an Intelligent Measurement Plane for
m. Plane – Building an Intelligent Measurement Plane for the Internet Alessandro D’Alconzo FTW Forschungszentrum Telekommunikation Wien, AT dalconzo@ftw. at IFIP TC 6 2014/2 Strategic Review Meeting, Dagstuhl, Germany November 12 -14, 2014
m. Plane project quick facts n n n n n m. Plane is an FP 7 Integrated Project acronym: m. Plane Project full title: “m. Plane – an Intelligent Measurement Plane for Future Network and Application Management” Grant agreement no: 318627 Staring Date: November 1 st 2012 Total Cost: 11, 274, 908. 00 € Duration: 3 years Partners: 16 Coordinator: Prof. Marco Mellia – Politecnico di Torino - IT 2
Who we are n n 3 operators 6 research centers 5 universities 2 small enterprises Coordinator Marco Mellia POLITO Ernst Biersack Eurecom Andrea Fregosi Fastweb Guy Leduc Univ. Liege Tech. Coordinator Dina Papagiannaki Telefonica Saverio Nicolini NEC Brian Trammell ETH Tivadar Szemethy Net. Visor Dario Rossi ENST Fabrizio Invernizzi Telecom Italia Pedro Casas FTW Pietro Michiardi Eurecom 3
The m. Plane community n Many Academic and research institutions come from the Traffic Monitoring Analysis (TMA) COST Action: q n Poli. To, ETH, ENST, Eurecom, Uni. Liege, FTW, NEC Some others were part of previous EU projects: q q PRISM: FTW, ETH Napa. Wine: Poli. To, ENST, Net. Visor, NEC DEMONS: FTW, ETHZ, NEC, TID … 4
Which problem(s) m. Plane aims at solving
The nowadays Internet “The Internet is the first thing that humanity has built that humanity doesn't understand, the largest experiment in anarchy that we have ever had. ” Eric Schmidt – ex Google Exec. Chairman 6
A complicated technology… § Internet: different technologies are combined to offer a plethora of services § We sorely miss the technology to understand what is happening in the network and thus to optimize its performance and utilization § Specially when something goes wrong! 7
A complicated technology… …that no one controls and n Why is not working? understands n n n Which is the best ISP in my area? Where is traffic coming from? How to optimize my network for facebook? ols to o n e ! r a e e m r e p l h e T h o t 8
Why we are here: m. Plane motivation n The Internet is a global interconnection of networks q q n In case of “failure”, who can tell what’s going wrong? q q n Each ISP may have a figure of what happens inside its network But what if the failure depends on other ISPs? Or on the content provider? Or on the CDN? Or on user equipment? Today, the web is a tangle q q n No single organization operates, administers or governs it It is robust thanks to its diversity, but it is vulnerable and fragile Nobody really understands what happens today in the Internet How to predict what will happen tomorrow? We need an intelligent system that collects, analyzes, provides visibility to support better management: an oracle that provides answers 9
How can m. Plane solve the problem(s)?
The m. Plane vision n Goal: design and demonstration of a measurement plane for the Internet q q q n A distributed infrastructure for network measurement … which perform passive and active measurements, continuously or on-demand, at a wide variety of scales … with built-in support for iterative measurement and automated iteration. m. Plane is about q q q large scale network measurements, and intelligent big-data analysis for troubleshooting support embedding measurement into the Internet as an additional capability 11
m. Plane in a slide Build a distributed, open, standard measurement infrastructure for the Internet q Probes (WP 2) – get the data n n q Build on existing tools/methodologies Offer a flexible, programmable, open platform to run and collect Pietro Michiardi passive, active, hybrid measurement Repositories (WP 3) – store and preprocess the data n n n q Tivadar Szemethy Collect measurement in a standard way Pre-process large amounts of data in efficient ways Grant access to interested parties (ISP, content providers, end-users, regulation agencies, etc. ) subject to authorization rules Pedro Casas Intelligent reasoner (WP 4) – dig into the data n n Mine automatically the data and extract useful information Help in drilling down to the root cause of a problem 12
m. Plane WPs’organization WP 8 - Project Management WP 7 - Dissemination, Exploitation and Standardization WP 4 - m. Plane Supervisor: Iterative and Adaptive Analysis (supervision layer) WP 3 - Large-scale Data Analysis (Repository and Analysis Layer) WP 2 – Programmable Probes (Measurement Layer) WP 1 Use Cases, Requirements and Architecture Ruediger Martin WP 5 Integration, Deployment, Data Collection, Evaluation WP 6 Demonstration 13
m. Plane in a picture Coordination Intelligent Reasoner WP 4 Module N Module 2 Module 1 Analysis Modules Repository and Analysis Layer Data collection & processing Supervisor legacy. DB 1 legacy. DB 2 legacy. DB N m. Plane Repository WP 3 DBStream Blockmon Measurement Layer WP 2 m. Interface Raw data m. Interface m. Probe 1 m. Probe 2 m. Probe N m. Interface legacy. Probe 1 legacy. Probe 2 m. Interface e legacy. Probe N 14
Some of the m. Plane Use Cases n Cloud services troubleshooting n Mobile network performance issues troubleshooting n Web browsing Qo. E troubleshooting n Anomaly detection and diagnosis in large scale netoworks n Multimedia content delivery troubleshooting n Content and service popularity estimation & caching for network optimization n SLA verification and certification 15
Who benefits from m. Plane? n q q q m. Plane benefits everyone: ISPs get a fine-grained picture of the network status, empowering effective management, operation, and troubleshooting. Content and Application providers gain powerful tools for handling performance issues of their delivery systems and applications. Regulators and end-users can verify adherence to SLAs, even when these involve many parties. Customers of all kinds can objectively compare network performance, improving competition in the market. The Research Community gets a system to accelerate the pace of research driven by Internet measurements 16
Collaborating Institutions n m. Plane promotes collaboration with external partners q q q n Official list of collaborating institutions q q q n To strengthen the standardization effort in m. Plane To allow larger deployment of the m. Plane system To enable external partners to get in touch with m. Plane technology Univ. Federal de Juiz de Fora (Prof. Borges Vieira) , BR Univ. Federal de Minas Gerais (Prof. s Marques de Almeida and Couto da Silva), BR Univ of Auckland (Nevil Brownlee), NZ Univ. of Wurzburg (Prof. Tran-Gia, Tobias Hossfeld), DE Orange Polska S. A (Dr Zbigniew Kopertowski), PL University of Twente (Aiko Pras, Anna Sperotto), NL Active Collaborations q q University of Waterloo (Prof. Lukasz Golab), CND Cooperative Association for Internet Data Analysis (Dr Alberto Dainotti), US Northwestern University (Prof. Fabian Bustamante), US Boston University (Prof. Mark Crovella), US 17
Dissemination activities (1) n Schools q Summer school on "Big-Data Algorithms and Applications to Traffic Measurements” in collaboration with Big. Foot project (bigfootproject. eu) n n q 4 th TMA Ph. D School, in collaboration with ACM SIGCOMM, March 15 -16 th 2014, London n On m. Plane architecture and coding of m. Plane-compatible monitoring probes during the METRICS bootcamp n Aug. 25 – Sept. 5, 2014, Université Catholique de Louvain, Belgium Seminar q Contribution to the organisation of the Dagstuhl Seminar on "Global Measurement Framework". n n Organizers: Dario Rossi – ENST Speakers from ENST, Poli. To, Uni Liege, Inria, Uni Pierre and Marie Curie Workshop q n Organizers: Marco Mellia – Poli. To, Dario Rossi - ENST Speakers: Pietro Michiardi, Antonio Barbuzzi – Eurecom Organizers: Philip Eardley (BT Research R&D, GB), Marco Mellia (Poli. To, IT), Jörg Ott (Aalto University, FI), Jürgen Schönwälder (Jacobs University Bremen, DE), Henning Schulzrinne (Columbia University, US) 20 invited talks and project presentations 18
Dissemination activities (2) n Conferences q q q n Gold sponsor of ACM IMC 2013, organized by TID in Barcelona TMA 2013, in conjunction with IEEE Infocom in Turin, and chaired by m. Plane partners Several m. Plane partners involved in the organization of ACM IMC, Co. NEXT, IEEE Infocom, TMA, IEEE TRAC Standardization q IETF: ETH active in several working groups and meetings n n q q Brian Trammel from ETH is the chair of the IETF IP Performance Metrics (IPPM) Contributes to Large-Scale Measurement of Broadband Performance (LMAP), Congestion Exposure (Con. Ex), and TCP Maintenance and Minor Extensions (tcpm) WGs 3 RFCs have being published during the project 5 RFCs drafts are in progress Full list at: http: //www. ict-mplane. eu/public/standardization q q IRTF: A-LBELL actively contributes to the Network Management Research Group (NMRG) Brian Trammel appointed as Internet Architecture Board (IAB) member on February 2014 19
Other ongoing efforts for measurement frameworks n FP 7 European projects q n Integrated Project (IP) n 3 years 2 left, 16 partners, 11. 2 Meuros … is like a “m. Plane use case” q “From global measurements to local management” Specific Targeted Research Projects (STRe. P) n 3 years 2 left, 10 partners, 3. 8 Meuros n Build a measure framework out of probes Strong similarities for n the architecture core n IETF, Large-Scale Measurement of Broadband Performance (LMAP) q q n Standardization effort on how to do broadband measurements n Defining the components, protocols, rules, etc. It does not specifically target adding “a brain” to the system Brian Trammell ETH Initial discussion with institutions such as RIPE and CAIDA 20
Where we are n n We are at the end of 2 nd year We have lot of “tools” q n n Active, passive, mobile, browsers, edge, core, … We have lot of research papers in the most prominent conferences, including ACM IMC, IEEE Infocom, PAM, IFIP TMA, IEEE TRAC q 47 items during 1 st year q 25 items during 9 months of 2 nd year q 2 Awards (ANRP 2013, ITC 25) … https: //www. ict-mplane. eu 21
Conclusions n m. Plane aims at simplifying network monitoring practices q Reasoning and Analysis focused on iterative measurements n q Open source release of software n q Tstat, Blockmon, Qo. F, Tracebox, etc. Maximum reuse of existing measurement tools n n Troubleshooting support First software libraries available at the m. Plane website Open for collaborations q Collaboration Institutions (CI) n q Mlab, Orange Lab Poland, Endace, etc. Other (less formal) ways are welcomed as well 22
Thank you for Your attention! Alessandro D’Alconzo – FTW dalconzo@ftw. at
- Slides: 23