IBM Global Engineering Solutions Trouble Shooting IBM Blue

What are System Logs for Blue Gene/P § A System Admin needs to refer to these logs for troubleshooting or failure analysis. § Components of BG/P control system will store all output into the BG/P system log directory, /bgsys/logs/BGP. 4 bgpmaster 4 mcserver 4 mmcs_db_server 4 navigator 4 mpirund 4 IO node logs IBM Blue Gene/P System Administration

Naming of system logs except for IO node logs § Each system log except for IO node logs will be stored under /bgsys/logs/BGP whose name is based on the timestamp of its start time. A fine difference based on specification is explained below. 4 naming of past logs for bgpmaster and mcserver – <service node name>-<component name>-yyyy-mmdd-hh: mm: ss. log e. g. ibmsn-mcserver-2007 -0406 -11: 31: 52. log 4 naming convention of past logs for mmcs_db_server, navigator, and mpirund – <service node name>-bgdb 0 -<component name>-yyyy-mmdd-hh: mm: ss. log e. g. ibmsn-bgdb 0 -mmcs_db_server-2007 -04 -09 -10: 41: 21. log, § Each ongoing log file is linked by a file whose name is *-current. log in the same directory. e. g. ibmsn-bgpmaster-current. log, ibmsn-bgdb 0 -navigator-current. log IBM Blue Gene/P System Administration

Naming of IO node logs § Each IO node log will be stored under /bgsys/logs/BGP whose name is based on the location. 4 naming of logs for IO node – Rxx-My-Nzz-Jnn. log e. g. R 00 -M 0 -N 00 -J 00. log The following logs also exist in this directory. • diagnostics logs in /bgsys/logs/BGP/diags • installation logs ex. Verify. Cables-yyyy-mmdd-hh: mm: ss. log Install. Service. Action-yyyy-mmdd-hh: mm: ss. log • service action logs ex. Service. Node. Card-Rnn-Mn-Nnn-yyyy-mmdd-hh: mm: ss. log Service. Link. Card-Rnn-Mn-L 0 n-yyyy-mmdd-hh: mm: ss. log Service. Bulk. Power. Module-Rnn-B-P 0 n-yyyy-mmdd-hh: mm: ss. log IBM Blue Gene/P System Administration

Access to System Logs via command line § The system logs can be accessed from command line 4 only to go /bgsys/logs/BGP, and find the log of the time zone of the purpose target system component $ bgpadmin@bgpdd 1 sys 1: ~> cd /bgsys/logs/BGP/ $ bgpadmin@bgpdd 1 sys 1: ~> ls bgpdd 1 sys 1 -mcserver-2007 -1010 -14: 41: 46. log bgpdd 1 sys 1 -mmcs_db_server-2007 -1010 -14: 11: 51. log bgpdd 1 sys 1 -mpirund-2007 -1010 -14: 11: 51. log R 10 -M 1 -N 08 -J 00. log bgpdd 1 sys 1 -navigator-2007 -1010 -13: 45: 20. log bgpdd 1 sys 1 -bgdb 0 -mmcs_db_server-current. log@ bgpdd 1 sys 1 -bgpmaster-2007 -1010 -12: 11: 51. log bgpdd 1 sys 1 -bgdb 0 -mpirund-current. log@ bgpdd 1 sys 1 -bgdb 0 -navigator-current. log@ bgpdd 1 sys 1 -mcserver-current. log@ bgpdd 1 sys 1 -bgpmaster-2007 -1009 -15: 28: 18. log IBM Blue Gene/P System Administration

Access to System Logs via BG Navigator access to current system logs § The system logs can be also accessed from the BG Navigator 1 1. Click “System Logs” on the top page of BG Navigator 2. Click “Current”, or selected by default, on the System Logs home page, if you are looking for a current log • You can also chose the other tabs, for “All” or “Old” logs as following page 3. Click the log file name which you are looking for 2 3 e. g. mmcs_db_server current log 4. Display the log file via Log Viewer on a new pop-up window IBM Blue Gene/P System Administration 4

Access to System Logs via BG Navigator access to past system logs 1. Click “System Logs” on the top 2. 3. 4. 5. page of BG Navigator as above Click “All” or “Old” tab, on the System Logs home page, if you are looking for a past log If needed, expand the bullet of the filter option and enter the timestamp Click the log file name which you are looking for Display the log file via Log Viewer on a new pop-up window IBM Blue Gene/P System Administration 1 2 3 4 5

Viewing logs via Log Viewer § Log Viewer has these features which assist you in the following areas: 3 1 1. Movement: paging backwards and forwards, moving to a specific timestamp 2. Refresh: refreshing your log manually or automatically, in viewing a current log 3. Filtering: selecting only the specific log file lines, can be applied to the entire log file or to the lines that 4 -1 are currently being viewed. 4. Highlighting: 2 – auto highlighting, for example, error 4 -2 5 message in red character – manual highlighting particular word(s) 5. IBM Blue Gene/P System Administration Hints: Hover your mouse over any of the log file viewer icons, and the viewer provides a hint that describes that icon’s function