Enabling Grids for Escienc E Hints for DPM
Enabling Grids for E-scienc. E Hints for DPM Administration Luca Vaccarossa (Luca. Vaccarossa@mi. infn. it) EGEE tutorial for administrators – 7 June 2007 INFN-CNAF Bologna www. eu-egee. org EGEE-II INFSO-RI-031688 EGEE and g. Lite are registered trademarks
MONITORING DPM Enabling Grids for E-scienc. E The main monitoring tool for DPM is dpm-qryconf it displays the Disk Pool Manager conguration. For each pool, dpm-qryconf displays two lines. The first one gives: • the pool name; • the default amount of space reserved for a le; • the threshold (in %) at which the garbage collector is started; • the threshold (in %) at which the garbage collector is stopped; • the default lifetime; • the default pin time; EGEE-II INFSO-RI-031688 EGEE tutorial for administrators 2
MONITORING DPM Enabling Grids for E-scienc. E • • �� the maximum lifetime; �� the maximum pin time; �� the File System Selection policy name; �� the Garbage Collection policy name; �� the Request Selection policy name; �� the group id if the pool is restricted; �� the space type: V (for Volatile), D (for Durable) or P (for Permanent); • �� the Migration Policy name; • �� the retention policy: R (for Replica), O (for Output) or C (for Custodial). EGEE-II INFSO-RI-031688 EGEE tutorial for administrators 3
MONITORING DPM Enabling Grids for E-scienc. E The second one gives: • �� the capacity of the disk pool. • �� the amount of free space of the disk pool. After each pool description, the filesystems belonging to the pool are listed giving: • �� the server name; • �� the filesystem name; • �� the capacity; • �� the amount of free space; • �� the filesystem's status. EGEE-II INFSO-RI-031688 EGEE tutorial for administrators 4
MONITORING DPM Enabling Grids for E-scienc. E Another useful tool for retrive information is dpns-getacl. It gets the Access Control. List associated with a DPNS directory/file. For each path, it displays: • �� the fille name; • �� owner; • �� the group; • �� the Access Control List (ACL) if present. • If a directory has a default ACL, dpns-getacl also displays the default ACL. Regular files cannot have default ACLs. EGEE-II INFSO-RI-031688 EGEE tutorial for administrators 5
MONITORING DPM Enabling Grids for E-scienc. E The output looks like: # file: filename # owner: username # group: groupname user: : perm user: uid: perm group: gid: perm mask: perm other: perm default: user: uid: perm default: group: gid: perm default: mask: perm default: other: perm EGEE-II INFSO-RI-031688 EGEE tutorial for administrators 6
Further Informations (Requirements) Enabling Grids for E-scienc. E Performance and Status informations (Requirements): • capacity of the filesystems RDONLY; • amount of reserved space; • number of transfers for each file; • number of requests processed; • number of movements on each pool; • number of active users; • number of files per VO; • amount of occupied space per VO/role/user; • amount of occupied space for each directory/file; • max accesibility latency, i. e. maximal time it will take the system to get any fille ready for transfer. EGEE-II INFSO-RI-031688 EGEE tutorial for administrators 7
Answers on Requirements Enabling Grids for E-scienc. E • dpm-qryconf does not report the space in read-only pool since they are considered not managed by the system. It should be easy for a tool to add that space. • The problem reported about the handling of full file systems has been cured in DPM 1. 6. 4 now in production. Sites are encouraged to upgrade. • In DPM 1. 6. 5 (in certification) there is an option on dpmqryconf that reports explicit VOMS roles/groups and not virtual GID. Therefore the space reported can be accounted to specific VOMS roles/groups. • The space occupied by a single user can be reported. However this implies a schema change in the internal DPM DB. Therefore such a change can be implemented with DPM 1. 7. n. EGEE-II INFSO-RI-031688 EGEE tutorial for administrators 8
Answers on Requirements Enabling Grids for E-scienc. E • Max accessibility latency can be provided again with DPM 1. 7. n. • Amount of reserved space can be reported probably already with DPM 1. 6. 6. • Other sites have expressed no interest in having reported the number of files per VO. Is there a use case for such a request ? It could be made available with DPM 1. 7. n. • dpns-du is already available but not distributed since it is a quite expensive operation for the system and can degrade the performance. This could can be made available to sysadmins if needed. EGEE-II INFSO-RI-031688 EGEE tutorial for administrators 9
References Enabling Grids for E-scienc. E • https: //twiki. cern. ch/twiki/bin/view/LCG/Dpm. Admin. Guide • https: //twiki. cern. ch/twiki/bin/viewfile/LCG/GSSDSub. Groups? rev=2; filename=report_dpm. pdf EGEE-II INFSO-RI-031688 EGEE tutorial for administrators 10
- Slides: 10