EGIIn SPIRE Grid Training for Power Users Institute

  • Slides: 7
Download presentation
EGI-In. SPIRE Grid Training for Power Users Institute of Physics Belgrade Hands on Session:

EGI-In. SPIRE Grid Training for Power Users Institute of Physics Belgrade Hands on Session: Job Collection Submission N GI AE G IS Nikola Grkic (ngrkic@ipb. ac. rs) Vladimir Slavnic (slavnic@ipb. ac. rs) SCL, Institute of Physics Belgrade Serbia 28/05/2012 EGI-In. SPIRE RI-261323 Grid Training for Power Users www. egi. eu

Overview • • • Job collection description JDL of a job collection Job collection

Overview • • • Job collection description JDL of a job collection Job collection folder Hands On example Links EGI-In. SPIRE RI-261323 Grid Training for Power Users www. egi. eu

Job collection description • A set of independent jobs • Can be managed as

Job collection description • A set of independent jobs • Can be managed as a single unit − Belong to the same experiment − Share common input files − Optimize network traffic • Sharing of sandboxes • Two ways to define job collection − Single JDL file or directory with JDL files EGI-In. SPIRE RI-261323 Grid Training for Power Users www. egi. eu

JDL of a job collection Type = "Collection"; Input. Sandbox = ("file. A"); Requirements

JDL of a job collection Type = "Collection"; Input. Sandbox = ("file. A"); Requirements = Reg. Exp("ce 64. ipb. ac. rs*", other. Glue. CEUnique. ID); nodes = { [ Job. Type = "normal"; Executable = "/bin/hostname"; Arguments = "-i"; Std. Output = "out"; Input. Sandbox = {root. Input. Sandbox, "file. B"}; Std. Error = "err"; Output. Sandbox ={"out", "err"}; ], [ Job. Type = "Normal"; Executable = "/bin/date"; Std. Output = "date"; Std. Error = "err"; Output. Sandbox= {"date"}; ] }; EGI-In. SPIRE RI-261323 Grid Training for Power Users www. egi. eu

Job collection folder [ngrkic@ui jdlcollection]$ ls jdlcollection total 380 4 drwxrwxr-x 2 ngrkic 4096

Job collection folder [ngrkic@ui jdlcollection]$ ls jdlcollection total 380 4 drwxrwxr-x 2 ngrkic 4096 Oct 4 2011. 4 drwxrwxr-x 15 ngrkic 4096 May 26 13: 06. . 4 -rw-rw-r-- 1 ngrkic 115 Oct 4 2011 job 100. jdl 4 -rw-rw-r-- 1 ngrkic 115 Oct 4 2011 job 11. jdl 4 -rw-rw-r-- 1 ngrkic 115 Oct 4 2011 job 12. jdl 4 -rw-rw-r-- 1 ngrkic 115 Oct 4 2011 job 13. jdl 4 -rw-rw-r-- 1 ngrkic 115 Oct 4 2011 job 14. jdl 4 -rw-rw-r-- 1 ngrkic 115 Oct 4 2011 job 15. jdl … … … [ngrkic@ui ]$ glite-wms-job-submit -a --collection jdlcollection EGI-In. SPIRE RI-261323 Grid Training for Power Users www. egi. eu

Hands On example • Navigate to following address: − http: //wiki. ipb. ac. rs/index.

Hands On example • Navigate to following address: − http: //wiki. ipb. ac. rs/index. php/Grid_examples • Choose Job collection example and follow the instructions for submitting job collection EGI-In. SPIRE RI-261323 Grid Training for Power Users www. egi. eu

Links • g. Lite user guide − https: //edms. cern. ch/file/722398//g. Lite-3 -User. Guide.

Links • g. Lite user guide − https: //edms. cern. ch/file/722398//g. Lite-3 -User. Guide. pdf • Quick user guide for submitting jobs − http: //wiki. egeesee. org/index. php/Quick_User_Guide_for_Submitting_Jobs EGI-In. SPIRE RI-261323 Grid Training for Power Users www. egi. eu