Enabling Grids for Escienc E SRM 2 2
Enabling Grids for E-scienc. E SRM 2. 2 in DPM Jean-Philippe Baud SRM 2. 2 Deployment Workshop 13 November 2007
Outline Enabling Grids for E-scienc. E • DPM architecture • Current status – Methods defined in Mo. U – Other methods • Methods to be implemented • Administrator interface • Information providers SRM 2. 2 deployment workshop
DPM architecture Enabling Grids for E-scienc. E CLI, C API, SRM-enabled client, etc. • Default ports da ta tra ns DPM head node DPMCOPY node fe r • RFIO: 5001 • DPNS: 5010 • DPM: 5015 • SRM 1. 1: 8443 • SRP 2. 2: 8446 DPM disk servers SRM 2. 2 deployment workshop …
Current status (1) Enabling Grids for E-scienc. E • Provides support for all methods defined in the Mo. U except srm. Copy and srm. Change. Space. For. Files • Other supported methods: – srm. Update. Space, srm. Purge. From. Space – srm. Set. Permission, srm. Check. Permission, srm. Get. Permission – srm. Extend. File. Life. Time. In. Space • Non-Mo. U supported options: – Volatile files – Dynamic Space Reservation – Recursive Ls and Rmdir • Full VOMS support SRM 2. 2 deployment workshop
Current status (2) Enabling Grids for E-scienc. E • Retention policies – Given quality of disks, admin defines quality of service – Replica, Output, Custodial • Access latency – Online, Nearline – Nearline will be used for BIOMED DICOM integration • File storage type – Volatile, Permanent • File pinning – Set TURL lifetime (srm. Prepare. To. Get, srm. Prepare. To. Put) – Set file lifetime in space (srm. Bring. Online) SRM 2. 2 deployment workshop
Current status (3) Enabling Grids for E-scienc. E • DPM 1. 6. 7 under certification • Available on SLC 3, SLC 4 32 and 64 bits • DPM 1. 7. 0 will be available mid December SRM 2. 2 deployment workshop
Methods to be implemented Enabling Grids for E-scienc. E • Methods to be implemented by end 2007 – srm. Copy – srm. Change. Space. For. Files • Plan for 2008 – srm. Release. Files without request token – Streaming mode – Integration with LCAS (black listing of users) • Methods not planned – srm. Suspend. Request – srm. Resume. Request SRM 2. 2 deployment workshop
Test results Enabling Grids for E-scienc. E • • • Basic tests ok Cross tests not ok (no srm. Copy yet) Use case tests ok Stress tests ok (when run) gfal/lcg_util tests ok SRM 2. 2 deployment workshop
Handling of space tokens (1) Enabling Grids for E-scienc. E • Space tokens are honored in Prepare. To. Put • Space tokens are ignored in Prepare. To. Get/Bring. Online for files already online • Space tokens will be honored for Prepare. To. Get/Bring. Online when bringing a nearline file to online • Disk pool definitions: – Disk pools can offer the same type of Retention Policies as srm. Reserve. Space: Replica, Output and Custodial. Default is Replica. – Pool space type should normally be set to ‘-’ (hyphen) to say any • srm. Reserve. Space can be given a better Retention Policy than requested SRM 2. 2 deployment workshop
Handling of space tokens (2) Enabling Grids for E-scienc. E • Disk pools can be dedicated to a list of groups (VOMS FQAN) • Spaces can be dedicated to a user (DN) or to a single group (VOMS FQAN) • Files can be stored without specifying a space token (compatibility with SRM v 1) SRM 2. 2 deployment workshop
Administrator interface Enabling Grids for E-scienc. E • How to statically allocate a space to a given VO? – dpm-reservespace –gspace n –group g –lifetime l –poolname p –ret_policy r –token_desc t – For example: dpm-reservespace –gspace 1 T –group atlas –lifetime Inf --poolname atlas_pool –ret_policy R –token_desc atlas_esd SRM 2. 2 deployment workshop
Information providers Enabling Grids for E-scienc. E • Static Information Provider – Production version not yet available • Dynamic Information Provider – Thanks to Graeme Stewart SRM 2. 2 deployment workshop
- Slides: 12