SEEGRID Nis Training Session Handson V Standard Grid

SEE-GRID Nis Training Session Hands-on V: Standard Grid Usage Dušan Vudragović SCL and ATLAS group Institute of Physics, Belgrade Jan 31, 2006

Getting a proxy certificate n n Get onto a machine that understand grid commands To create proxy $ voms-proxy-init --voms <vo> AEGIS n To get information about proxy $ voms-proxy-info n To destroy proxy $ voms-proxy-destroy n To create long-term proxy $ myproxy-init -s <host_name> -d -n n To get information about a long-term $ myproxy-info -s <host_name> –d n Deleting a stored long-term proxy $ myproxy-destroy -s <host_name> -d Jan 31, 2006 SEE-GRID Nis Training Session

Data menagment n GUID Grid Unique Identifier guid: bbffd 56 a-eff 0 -4 b 59 -af 7 b-2 a 235986001 c n LFN Logical File Name lfn: Test. File. dat AEGIS n SURL Storage URL sfn: //castorgrid. cern. ch/castor/cern. ch n TURL Transport URL gsiftp: //castorgrid. cern. ch/castor/cern. ch Jan 31, 2006 SEE-GRID Nis Training Session

n Low Level Data Management Tools Checks the existence of a file or directory on a SE $ edg-gridftp-exists URL Lists a directory on a SE AEGIS $ edg-gridftp-ls URL Creates a directory on a SE $ edg-gridftp-mkdir URL Renames a file on a SE $ edg-gridftp-rename source. URL dest. URL Removes a file from a SE $ edg-gridftp-rm URL Removes a directory on a SE $ edg-gridftp-rmdir URL Copies files between SEs $ globus-url-copy source. URL dest. URL Jan 31, 2006 SEE-GRID Nis Training Session

n LCG Data Management Client Tools Copies a Grid file to a local destination lcg-cp --vo <vo> <lfn> <file> Copies a file to a SE and registers the file AEGIS lcg-cr --vo <vo> -d SURL –l <lnf> <file> Registers in the catalog lcg-rf --vo <vo> -l <lfn> <surl> Unregisters in the catalog lcg-uf --vo <vo> <guid> <surl> Gets the GUID for a given LFN or SURL. lcg-lg --vo <vo> <lfn> Lists the replicas for a given LFN, GUID or SURL. lcg-lr --vo <vo> <lfn> Jan 31, 2006 SEE-GRID Nis Training Session

Some JDL attributes n n AEGIS n n n Jan 31, 2006 Type for LCG 2 only “Job” type supported Job. Type values: “Normal”, “MPICH”, “Interactive”… Executable command name Arguments command line arguments Std. Output file where the job standard output goes Std. Error file where the job standard error goes Input. Sandbox files for transfer from UI to the WN Output. Sandbox files for transfer from WN to the UI SEE-GRID Nis Training Session

n Requirements to send a job to a particular CE Requirements = other. Glue. CEUnique. ID == “ce. phy. bg. ac. yu: 2119/jobmanager-pbs-seegrid”; job must run on a CE where a particular experiment software is installed AEGIS Requirements = Member("VO-atlas-release-11. 0. 2", other. Glue. Host. Application. Software. Run. Time. Environment); for MPI job Requirements = Member("MPICH", other. Glue. Host. Application. Software. Run. Time. Environment) n Simple JDL file Executable = "/bin/sh"; Arguments = "Hello. World. sh"; Stdoutput = "stdoutput"; Std. Error = "stderror"; Input. Sandbox={"Hello. World. c", "Hello. World. sh"}; Output. Sandbox={"stdoutput", "stderror"}; Requirements = other. Glue. CEUnique. ID == “ce. phy. bg. ac. yu: 2119/jobmanager-pbs-seegrid”; Jan 31, 2006 SEE-GRID Nis Training Session

Job submission n AEGIS To submit a job $ edg-job-submit <jdl_file> $ edg-job-submit –o <job_ID_file> <jdl_file> $ edg-job-submit –r <CE_ID> <jdl_file> n Retrieving status of a job $ edg-job-status <job_ID> $ edg-job-status –i <job_ID_file> n Retrieving the output of a job $ edg-job-get-output <job_ID> $ edg-job-get-output –i <job_ID_file> $ edg-job-get-output –dir <path> <job_ID> n Canceling a job $ edg-job-cancel <job_ID> $ edg-job-cancel –i <job_ID_file> n Listing CE that match a job description $ edg-job-list-match <jdl_file> Jan 31, 2006 SEE-GRID Nis Training Session

AEGIS Possible job states in the LCG-2 Jan 31, 2006 SEE-GRID Nis Training Session

Information Service n Way to get information relative to the computing resources for certain VO $ lcg-infosites --vo <vo> ce AEGIS n To know the status of the storage resources $ lcg-infosites --vo <vo> se $ lcg-infosites --vo <vo> close. SE n To retrieve the tags corresponding to the software installation of certain VO $ lcg-infosites --vo <vo> tag n To have a list of the supported attributes $ lcg-info --list-attrs to find CEs with OS SL or SLC and list Running. Jobs and Free. CPUs on them lcg-info --list-ce --query "OS=SC*" --attrs 'OS, Running. Jobs, Free. CPUs' Jan 31, 2006 SEE-GRID Nis Training Session