EDG WP 7 Network Monitoring Schema Paul Mealor

EDG WP 7 Network Monitoring Schema Paul Mealor pdm@hep. ucl. ac. uk NM-WG GGF 7 Presented by Richard Hughes-Jones NMWG GGF 7 Tokyo March 2003 Paul Mealor UCL

Menu u. LDAP schema u. R-GMA schema NMWG GGF 7 Tokyo March 2003 Paul Mealor UCL

LDAP schema design considerations u. LDAP schema for MDS in EDG u. Publication of most recent network measurements for host-to-host pairs u. Early work, so Schema design n Should be easy to add new metrics to the Schema n Should be easy to add new measurement parameters n The (EDG? ) MDS setup made it hard to add new LDAP objectclasses NMWG GGF 7 Tokyo March 2003 Paul Mealor UCL

Example of a LDAP schema objectclass ( 1. 3. 6. 1. 4. 1. 8005. 666. 2. 4. 26 NAME 'Network. Measurement‘ DESC 'Describes a single measurement. ‘ SUP ( Network. Monitor. Source $ Network. Monitor. Dest $ Network. Monitor. Metric ) STRUCTURAL MUST ( NMMeasure. Id $ Metric. Value $ Metric. Time ) ) objectclass ( 1. 3. 6. 1. 4. 1. 8005. 666. 2. 4. 24 NAME 'Network. Monitor. Source' DESC 'Describes a network monitoring host from which measurements are made. This is here to help the with implementation. ' SUP Data. Grid. Top STRUCTURAL MUST ( Source. Host ) MAY ( Source. Site $ Source. NE ) ) objectclass ( 1. 3. 6. 1. 4. 1. 8005. 666. 2. 4. 22 NAME 'Network. Monitor. Metric' DESC 'Describes a single metric and its parameters. Abstract: do not use. ' SUP Network. Monitor. Tool. Name ABSTRACT MUST ( Metric. Name $ Metric. Unit ) MAY ( Parameter ) ) objectclass ( 1. 3. 6. 1. 4. 1. 8005. 666. 2. 4. 25 NAME 'Network. Monitor. Dest' DESC 'Describes a network monitoring host to which measurements are made. This is here to help the with implementation. ' SUP Data. Grid. Top STRUCTURAL MUST ( Dest. Host ) MAY ( Dest. Site $ Dest. NE ) ) NMWG GGF 7 Tokyo March 2003 Paul Mealor UCL

Schema in use – LDAP Object object. Class: Network. Measurement nm. Measure. Id: foo. ac. uk/bar. ac. uk/rttavg source. Host: a. foo. ac. uk dest. Host: b. bar. ac. uk source. NE: foo. ac. uk dest. NE: bar. ac. uk metric. Name: rttavg metric. Unit: ms parameter: packetsize: 100 parameter: packets: 10 metric. Value: 67 metric. Time: 20020625123506 Z This LDAP object contains the average RTT of a measurement between a. foo. ac. uk and b. bar. ac. uk that was made with 10 packets of 100 bytes each. Provides Mappings between source and destination “NEs” and Computing or Storage Elements held elsewhere on site LDAP Tree structure discouraged Tree different dependent on location Map Objects in Net Info Index NMWG GGF 7 Tokyo March 2003 Paul Mealor UCL

R-GMA Schema Design Considerations u Relational database schema n R-GMA looks a lot like a relational database! u R-GMA allows historical information in SQL Dbase u Easier to use: n n n n Better understanding of network monitoring & tools now Adding new tables easier Can add custom schemas at run-time Tables store observations between hosts Different tables for different metrics Include parameters (entity annotations) in the table Separate tables for mapping CE & SE to Network monitoring Much better for SQL queries searching for observations NMWG GGF 7 Tokyo March 2003 Paul Mealor UCL

Schema in use – RGMA Tables Network. RTT Network. CE ¥ 1 NMId. Source ¥ CEId NMId. Destination ¥ Network. CE 1 NMId tool CEId packet. Size 1 NMId time minimum maximum average Network. SE Network. TCPThroughput SEId NMId. Source 1 NMId. Destination tool buffer. Size ID for Network Monitor nodes streams Tables provide mappings: duration SE – Net Monitor node time CE – Net Monitor node value NMWG GGF 7 Tokyo March 2003 Paul Mealor UCL Computing. Element CEId GRAMVersion Architecture Op. Sys &c… u Tables defined for: n RTT n TCP throughput n ICMP packet loss n 1 -way IPDV n UDP throughput n UDP packet loss