Information Monitoring Services Antony Wilson WP 3 Antony

Information & Monitoring Services Antony Wilson WP 3 Antony Wilson CERN ATF-WP 3 09/04/02 1

Introduction • WP 3 Overview Dependencies Boundaries Redundancy/Duplication Holes Planning • R-GMA • GRM/PROVE Antony Wilson CERN ATF-WP 3 09/04/02 2

Dependencies • dependencies on external software & components provided by other WPs jdk Xerces-J Xerces-C Java. CC w 3 c-libwww junit log 4 cpp My. SQL Antony Wilson Tomcat Þ JWSDP Ant alien doxygen used for documentation transfig graphviz Spitfire security } CERN ATF-WP 3 09/04/02 3

Boundaries • vagueness of boundaries or responsibilities between WPs My. SQL – WP 1 WP 2 WP 3 Tomcat (server. xml) – WP 2 WP 3 Antony Wilson CERN ATF-WP 3 09/04/02 4

Redundancy/Duplication • redundancy or duplication that may exist between components and or WPs Logging and bookkeeping use of R-GMA achiever Antony Wilson CERN ATF-WP 3 09/04/02 5

Holes • perceived "holes" or gaps in provided functionality that seem to fall outside the responsibility of any component or WP none Antony Wilson CERN ATF-WP 3 09/04/02 6

Planning • look forward at what is needed for the EDG testbed 2 in Autumn 2002 R-GMA web service compliant by release 2 changes in API naming conventions • take into account developments in Globus (OGSA) and the US related Grid activities Still a moving target internal changes Future of LDAP within Globus is uncertain Antony Wilson CERN ATF-WP 3 09/04/02 7

R-GMA • Relational Grid Monitoring Architecture A relational implementation of the GGF’s GMA Based upon Java servlets Consists of Consumers, Producers and a discovery service Antony Wilson CERN ATF-WP 3 09/04/02 8

R-GMA - The Producer Consumer Model Client side Hidden components Circular Buffer Producer Servlet Sensor Application Invocation Information Antony Wilson Schema Servlet Consumer Registry Servlet API CERN ATF-WP 3 09/04/02 9

R-GMA Data. Base Producer • • Uses a RDBMS to avoid data loss Consumer cannot tell the difference Data inserted like a Circular Buffer Producer Can produce more than one table Data. Base Producer Servlet RDBMS Sensor Code Antony Wilson CERN ATF-WP 3 09/04/02 10

R-GMA Archiver: Producer/Consumer Utility Archiver API Application Code Archiver Servlet Consumer API Consumer Servlet Data. Base Producer Servlet Antony Wilson Data. Base Producer CERN ATF-WP 3 09/04/02 11

R-GMA Use Case • at RAL a producer would publish a table of RTT measurements Site. A RAL RAL Site. B Lyon CERN … Tool Pinger … Measurement 1500 800 … • CERN and Lyon would contribute further views where site A was Lyon or CERN • conceptually all of this information is held in a single table Antony Wilson CERN ATF-WP 3 09/04/02 12

R-GMA Use Case • Storage. Element SEId RAL_S 1 Lyon_S 1 CERN_S 1 Site RAL Lyon … Diskfree 100 200 … • Computing. Element CEId RAL_Q 1 CERN_Q 1 Lyon_Q 1 Antony Wilson Site RAL CERN … LRMS PBS LSF … CERN ATF-WP 3 09/04/02 13

R-GMA Use Case • SELECT C. CEId, S. SEId, R. Measurement FROM Computing. Element C, Storage. Element S, RTTMeasurement R WHERE C. Site=R. Site. A AND S. Site=R. Site. B AND R. Measurement < 1000 • Result. Set CEId RAL_Q 1 Antony Wilson SEId CERN_S 1 Measurement 800 CERN ATF-WP 3 09/04/02 14

GRM/PROVE • developed by SZTAKI originally for monitoring parallel programs in a cluster environment • GRM/PROVE similar to Netlogger • GRM provides C API for application monitoring • PROVE visualisation tool Antony Wilson CERN ATF-WP 3 09/04/02 15

GRM • produces statistics about different processes and blocks of code which are written to a trace file • at present the trace file is passed back for interpretation at the end of the job • the incorporation of R-GMA will allow semi online visualization Antony Wilson CERN ATF-WP 3 09/04/02 16

GRM/PROVE instrument the application (GRM lib) Antony Wilson execute in grid transfer trace file back as a regular output file CERN ATF-WP 3 09/04/02 visualize with PROVE 17

PROVE • Statistics some of which are not meaningful for one process applications execution time for all processes execution time for individual processes execution time for a single process amount of communications for all processes Antony Wilson CERN ATF-WP 3 09/04/02 18

PROVE Antony Wilson CERN ATF-WP 3 09/04/02 19

Further Information http: //hepunx. rl. ac. uk/edg/wp 3/documentation/index. html Antony Wilson CERN ATF-WP 3 09/04/02 20