LAMP Spiral 2 Yearend Project Review LAMP University

LAMP Spiral 2 Year-end Project Review LAMP University of Delaware PI: Martin Swany Staff: Eric Boyd, Jason Zurawski, Internet 2 Students: Guilherme Fernandes, Ezra Kissel 29 -August-2010 Sponsored by the National Science Foundation

Project Summary • LAMP (Leveraging and Abstracting Measurements with perf. SONAR) is an effort to use and extend the perf. SONAR system for Instrumentation and Measurement (I&M) in Proto. GENI – perf. SONAR (www. perfsonar. net) has wide adoption in research and education networks – One key to the success of perf. SONAR system is its extensibility – Ability to wrap many data sources, while fully capturing relevant metadata • Key Goals of LAMP – Inclusion of various modes of operation • Slice creation with embedded I&M • Dynamic dedicated monitoring slice • Access to persistent I&M services – Generic metadata, including slice topology and data description to provide “lingua franca” for various I&M projects – Easy access to commonly-desired data – Easy support for experiment-specific metrics – Exploratory work toward GENI I&M Architecture Sponsored by the National Science Foundation 29 -August-2010 2

Milestone & QSR Status ID Milestone Status On Time? On Wiki? GPO signoff ? S 2. a Requirements and design doc Document draft complete >2 mo late & comp N (today) N S 2. c Updated Prospectus on integration with GENI monitoring efforts has largely been combined with the I&M Architecture Doc <2 mo late & incomp N N S 2. d Demonstration of perf. SONAR on Proto. GENI Presentation/demo at GEC 7 on time Y Y S 2. e V 1. 0 of perf. SONAR on Proto. GENI Software is functional, no formal announcement due to lack of documentation on time N N S 2. j GENI measurement and data schema demonstration No demonstration, but schema efforts are ongoing with Proto. GENI RSpec, others <2 mo late & incomp N N S 2. f V 1. 1 of perf. SONAR on Proto. GENI Planned release on September 15 th <2 wks late & incomp N N S 2. g Demonstration of perf. SONAR on Proto. GENI Demo occurred at GEC 8 on time Y N S 2. h Evaluation Report in progress QSR: 1 Q 2010 complete on time Y Y QSR: 2 Q 2010 in progress <2 mo late & incomp N (this wk) N Sponsored by the National Science Foundation 29 -August-2010 3

Accomplishments 1: Advancing GENI Spiral 2 Goals • One of the main Spiral 2 goals was to establish various Instrumentation and Measurement (I&M) Systems and to work toward a strawman proposal for a GENI-wide framework – LAMP has the twin goals of a working system and exploratory investigation toward the larger framework • The LAMP team has actively participated in the I&M WG to advance the I&M Architecture – This effort has been substantial and wasn’t reflected in our original milestones! • Development of an I&M System Prototype that integrates perf. SONAR in Proto. GENI, while serving as a continuous experimenter – This helped improve the Control Framework by identifying needs of I&M systems, providing feedback on general CF use/design, and generating bug reports • • We have paid substantial attention to Interoperability by understanding the various RSpecs used by CFs and looking toward a common representation Similarly, we have faced Identity Management questions from the outset, and have worked toward support for this in LAMP Sponsored by the National Science Foundation 29 -August-2010 4

Accomplishments 2: Other Project Accomplishments • Deployed perf. SONAR measurement infrastructure for Proto. GENI backbone nodes • Substantial integration with Proto. GENI – I&M infrastructure deployment and bootstrapping integrated with the CF – Proto. GENI AA support added to perf. SONAR services and global infrastructure – Proto. GENI RSpec translated into UNIS topology schema • Developed a different approach for bootstrapping and configuring the perf. SONAR I&M infrastructure that – Nodes configure themselves by retrieving annotations on the topology description of the slice – Continuous configuration changes possible – Nodes can push changes back into the topology description so that information is up-to-date (e. g. IP addresses) • The measurement and (UNIS) topology schema integration in the LAMP I&M system demonstrates a possible solution for storing and sharing measurement data from virtual topologies (i. e. non-public IP addresses, etc) Sponsored by the National Science Foundation 29 -August-2010 5

Issues • We (LAMP) need to improve in our completion (and revision if necessary) of project milestones – When we became substantially involved in the I&M WG, we let our own milestone languish as the analysis and description was largely the same • Lack of instrumentation/measurement resources (e. g. measurement boxes) at various aggregates – Creates difficulties in integrating substrate and slice measurement planes • Topology of the substrates should be described in more detail • Lack of dedicated measurement plane network • CFs and RSpecs are very different underneath – This will be a major barrier to fully integrating I&M systems to all CFs (i. e. bootstrapping, determining virtual topology vs physical topology mappings (including hostnames/IPs), etc). Sponsored by the National Science Foundation 29 -August-2010 6

Plans • • Integrating the rest of the perf. SONAR-PS services Adapting the p. S-PS-Toolkit web configuration tool for managing distributed services through changes to UNIS Making the topology based (node) configuration service a full blown p. S service Improve GUIs available to GENI experimenters for visualizing perf. SONAR data of slices (Periscope, perf. Admin, others) Public release of software available to all experiments with documentation and user manual Continued emphasis on GENI I&M Architecture document and discussion The GPO is starting to formulate goals for Spiral 3. What are your thoughts regarding potential Spiral 3 work? – An increased emphasis on common language and more correspondence in RPecs. Diversity is good, but not for its own sake. Sponsored by the National Science Foundation 29 -August-2010 7