Middleware Technology Operational Issues in Directories Performance Monitoring

  • Slides: 17
Download presentation
Middleware Technology. Operational Issues in Directories Performance Monitoring I 2 Annual Fall 2002 Conference

Middleware Technology. Operational Issues in Directories Performance Monitoring I 2 Annual Fall 2002 Conference Brendan Bellina, University of Notre Dame Internet-2 Annual Fall Conference – Los Angeles, CA October 28, 2002

Presentation Overview Why Monitor Performance What Performance Metrics To Monitor How To Gather Performance

Presentation Overview Why Monitor Performance What Performance Metrics To Monitor How To Gather Performance Metrics Tools for Performance Monitoring @ ND • Orcallator • Look I 2 Annual Fall 2002 Conference Middleware: Directories 2

Why Monitor Performance Availability It’s up… isn’t it? Directories often require 7 x 24

Why Monitor Performance Availability It’s up… isn’t it? Directories often require 7 x 24 availability Responsiveness It’s fast enough… maybe. Directories often require extremely fast response Scalability We can handle that… I think. Structural changes, indices, increases # of entries or # of attributes can all affect performance. I 2 Annual Fall 2002 Conference Middleware: Directories 3

What Performance Metrics To Monitor Response time Directory Cache Tries Connection requests Bind response

What Performance Metrics To Monitor Response time Directory Cache Tries Connection requests Bind response time Bind requests Search response time Bind errors Current connections Search requests Avg connection length Search errors Current binds Avg count & size of search results Current searches Directory Cache Hits # Entries transmitted # Bytes transmitted I 2 Annual Fall 2002 Conference Middleware: Directories 4

How To Gather Performance Metrics Directory internal query (i. Planet, Open. LDAP) base search

How To Gather Performance Metrics Directory internal query (i. Planet, Open. LDAP) base search on cn=monitor ldapsearch -h directory. whatsamattau. edu -b"cn=monitor" -s base objectclass=* objectclass=top objectclass=extensible. Object cn=monitor version=Netscape-Directory/4. 16 B 01. 300. 2035 threads=30 currentconnections=27 totalconnections=118499 dtablesize=1024 readwaiters=0 I 2 Annual Fall 2002 Conference Middleware: Directories 5

How To Gather Performance Metrics base search on cn=monitor cont. opsinitiated=410383 opscompleted=410382 entriessent=173812 bytessent=59522106

How To Gather Performance Metrics base search on cn=monitor cont. opsinitiated=410383 opscompleted=410382 entriessent=173812 bytessent=59522106 currenttime=20021023212714 Z starttime=20021023115756 Z nbackends=1 dataversion=directory. whatsamattau. edu: 389 020010212195544 0 ldapserverconfigdn=cn=ldap: //: 389, dc=directory, dc=whatsamattau, dc=edu backendmonitordn=cn=monitor, cn=ldbm I 2 Annual Fall 2002 Conference Middleware: Directories 6

How To Gather Performance Metrics base search on cn=monitor, cn=ldbm ldapsearch -h directory. whatsamattau.

How To Gather Performance Metrics base search on cn=monitor, cn=ldbm ldapsearch -h directory. whatsamattau. edu -b"cn=monitor, cn=ldbm" -s base objectclass=* objectclass=top objectclass=extensible. Object cn=monitor database=ldbm readonly=0 entrycachehits=505559 entrycachetries=540329 entrycachehitratio=93 currententrycachesize=10000 maxentrycachesize=10000 dbchehits=1011415 dbcachetries=1043689 dbcachehitratio=96 dbcachepagein=32268 dbcachepageout=851 dbcacheroevict=20160 dbcacherwevict=0 dbfilename-0=wu. Attribute_1. db 2 dbfilecachehit-0=26 dbfilecachemiss-0=4 dbfilepagein-0=4 dbfilepageout-0=4 I 2 Annual Fall 2002 Conference Middleware: Directories 7

How To Gather Performance Metrics LDAP log processing • Read the log files looking

How To Gather Performance Metrics LDAP log processing • Read the log files looking for events • Calculate statistics Directory Probing • Ping • Query to directory service • Bind to directory service • SNMP Others? ? ? I 2 Annual Fall 2002 Conference Middleware: Directories 8

How To Monitor Performance Metrics NMS (Network Management System) HP Open. View CA/Uni. Center

How To Monitor Performance Metrics NMS (Network Management System) HP Open. View CA/Uni. Center TNG IBM Net. View others Operating System Tools Win NT Event Viewer Sun Solaris SE Toolkit I 2 Annual Fall 2002 Conference Middleware: Directories 9

Tools for Performance Monitoring @ ND Orca - http: //www. orcaware. com Orcallator (collector

Tools for Performance Monitoring @ ND Orca - http: //www. orcaware. com Orcallator (collector for Solaris statistics) Look – LDAP operational Orca “k”ollector I 2 Annual Fall 2002 Conference Middleware: Directories 10

Orca (http: //www. orcaware. com) About Orca: Generates web friendly performance graphs based on

Orca (http: //www. orcaware. com) About Orca: Generates web friendly performance graphs based on collected statistical data. Free (will take donations) Open Source Perl Used by Yahoo!/Geocities Used at Notre Dame on 100+ servers Hourly, Daily, Weekly, Monthly, Quarterly, Yearly, All Did I say free? I 2 Annual Fall 2002 Conference Middleware: Directories 11

ORCA @ Notre Dame CRON job runs every 15 minutes to regen graphs Orcallator

ORCA @ Notre Dame CRON job runs every 15 minutes to regen graphs Orcallator (Symb. EL script included with ORCA) Written to monitor web servers and Solaris stats Requires Sun Solaris SE Toolkit (free from http: //www. setoolkit. com) Runs on each directory server to collect statistics – 5 minute averages, 30 second peaks Data is consolidated on one server for ORCA processing Modifications by ND to read i. Planet Dir Server 4. 16 log I 2 Annual Fall 2002 Conference Middleware: Directories 12

ORCA @ Notre Dame ND Modifications -LDAP connection rate -LDAP Bind error rate -LDAP

ORCA @ Notre Dame ND Modifications -LDAP connection rate -LDAP Bind error rate -LDAP search results returned rate Picture is worth 1000 words: <http: //www. nd. edu/~eds/perfmon> I 2 Annual Fall 2002 Conference Middleware: Directories 13

Look – LDAP operational Orca "k"ollector LDAP supplement to Orca and/or Orcallator Perl script

Look – LDAP operational Orca "k"ollector LDAP supplement to Orca and/or Orcallator Perl script Produces Orca compatible output files Processes i. Planet 4. 16 log file Queries directory cn=monitor, cn=ldbm Beta 0. 90 version currently available at <http: //www. nd. edu/~bbellina/downloads/Look> I 2 Annual Fall 2002 Conference Middleware: Directories 14

Look – LDAP operational Orca "k"ollector Connection Rate Bind Error Rate Search Results Returned

Look – LDAP operational Orca "k"ollector Connection Rate Bind Error Rate Search Results Returned Rate Connections Operations Initiated Operations Completed Entries Sent Bytes Sent Entry Cache Hits Entry Cache Tries Cache Hit Ratio Database Cache Hits Database Cache Tries Database Cache Hit Ratio Peaks and Averages View live results at <http: //www. nd. edu/~eds/perfmon/Look> I 2 Annual Fall 2002 Conference Middleware: Directories 15

Links Notre Dame Enterprise Directory Service http: //www. nd. edu/~eds Notre Dame EDS Performance

Links Notre Dame Enterprise Directory Service http: //www. nd. edu/~eds Notre Dame EDS Performance Statistics - Orcallator http: //www. nd. edu/~eds/perfmon Notre Dame EDS Performance Statistics – Look http: //www. nd. edu/~eds/perfmon/Look ORCA software http: //www. orcaware. com Look software http: //www. nd. edu/~bellina/downloads/Look Brendan Bellina (mailto: Brendan. T. Bellina. 1@nd. edu) <http: //www 3. nd. edu/~eds/cgi-bin/nd_ldap_search. pl? ldapfilter=uid=bbellina> I 2 Annual Fall 2002 Conference Middleware: Directories 16

Copyright Statement Copyright © Brendan Bellina, 2002. This work is the intellectual property of

Copyright Statement Copyright © Brendan Bellina, 2002. This work is the intellectual property of the author. Permission is granted for this material to be shared for non-commercial, educational purposes, provided that this copyright statement appears on the reproduced materials and notice is given that the copying is by permission of the author. To disseminate otherwise or to republish requires written permission from the author. I 2 Annual Fall 2002 Conference Middleware: Directories 17