Workflow Template Generation Haw to Steps Hand Made

Workflow Template Generation Haw to

Steps • • • Hand Made Preparation Make proper set of WF examples on Portal Save it to a local directory Decompress it Make a Template Directory of it (TD) Define the Table of Actual Parameters TAP Apply the Macro Generator to gain Destination Directory MG( TD, TAP) -> DD • Apply the Directory Compress And Upload Program • Start the Submit All Command on the Portal

What should be parameter? Formal Parameter Name Explanation wf Source Workflow name wf_dest Name of workflow to be generated. Name must be defined in accordance with the automatic visualization system vo<jobseq> Virtual organization of the selected job <jobseq> is integer in the range 1. . 3 se Storage Element destination host r<jobseq> direct resource with jobmanager of the selected job <jobseq> is integer in the range 1. . 3 f<jobseq><portseq> Logical name of the eventual remote file belonging to the selected port of the selected job <jobseq> is integer in the range 1. . 3 <portseq> is integer in the range 1. . 2 e<jobseq> List of environment variables of the selected job It is just a string following the syntax in the JDL

Where are these Parameter? • <wf>_files. wrk -> <wf_dest>_files. wrk <wf_dest>, <ri>, <fi, j> • <JOB>. grid <voi> • . <JOB>. desc <voi>, <ri> • <JOB>/<JOB>. jdl <voi>, <ri>, <fi, j>, <ei>

Resource Remote. File <wf>_files. wrk workflow "<<wf_dest>>" {"Multip. LOC" 2 "Multip. Rem. Loc" 1 OFFLINE "Copyrem" 1 "Multip. LOC" 1 OFFLINE} {"Copyrem" SEQ_PORTAL (is_instrumented=false; monitor=off) "/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/Copyrem/Copy. And. Time" {""}"LINUX" {"<<r 1>>"} 0 "/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/Copyrem/0/INPUT" (file_type=local; original_path="D: A-TESTI 1") PERMANENT INPUT 1 "<<f 11>>" (file_type=remote; local_path="/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/OUTPUT") PERMANENT OUTPUT"Multip. LOC" SEQ_PORTAL (is_instrumented=false; monitor=off) "/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/Multip. LOC/multiply. exe" {""}"LINUX" {"<<r 2>>"} 0 "/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/Multip. LOC/0/INPUT 1" (file_type=local; original_path="D: A-TESTI 1") PERMANENT INPUT 1 "<<f 21>>" (file_type=remote; local_path="/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/INPUT 2") PERMANENT INPUT 2 "/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/Multip. LOC/2/OUTPUT" (file_type=local; original_path="OUTPUT") PERMANENT OUTPUT "Multip. Rem. Loc" SEQ_PORTAL (is_instrumented=false; monitor=off) "/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/Multip. Rem. Loc/multiply. exe" {""}"LINUX" {"<<r 3>>"} New FW 0 "<<f 31>>" (file_type=remote; local_path="/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/INPUT 1") name PERMANENT INPUT 1 "/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/Multip. Rem. Loc/1/INPUT 2" (file_type=local; original_path="") PERMANENT INPUT 2 "/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/Multip. Rem. Loc/2/OUTPUT" (file_type=local; original_path="OUTPUT") PERMANENT OUTPUT}

<JOB>. grid <<vo 1>>

<JOB>. desc hermann Indirect_REMOTE_Template Copyrem <<vo 1>> <<r 1>> false

<JOB>/<JOB>. jdl [ Virtual. Organisation = "<<vo 1>>"; Executable = "Copyrem. sh"; Job. Type = "Normal"; Std. Output = "std. out"; Std. Error = "std. err"; Input. Sandbox = {"Copy. And. Time", "Copyrem. sh", "0/INPUT", "info. tar. gz" }; Output. Sandbox = {"std. out", "std. err", "std. log"}; Output. Data = { [ Output. File = "OUTPUT"; Logical. File. Name = "<<f 11>>“ ] }; Environment = {<<e 1>>}; Retry. Count = 3; Requirements = other. Glue. CEInfo. Hostname == "<<r 1>>"; ]

Table of Actual Parameters wf wf_dest vo 1 r 1 f 11 seegrid_LCG_ 2_BROK ER gw 01. rogrid. pub. ro: /jobmanag er-lcgpbs-seegrid lfn: /grid/seegrid/hermann/Test _2006_03_29_17_00 ddd eee fff Indirect_REMOTE_Template seegrid_LCG_ 2_BROK ER gw 01. rogrid. pub. ro: /jobmanag er-lcgpbs-seegrid lfn: /grid/seegrid/hermann/Test _2006_03_29_17_00 U_B_C__N_Q seegrid_LCG_ 2_BROK ER gw 01. rogrid. pub. ro: /jobmanag er-lcgpbs-seegrid lfn: /grid/seegrid/hermann/Test _2006_03_29_17_00 "L U_B_C_grid 2. cs. bilkent. edu. tr_N_Q seegrid_LCG_ 2_BROK ER grid 2. cs. bilkent. edu. tr: /jobma nager-lcgpbs-seegrid lfn: /grid/seegrid/hermann/Test _2006_03_29_17_00 "L Indirect_REMOT E_Templa te T_CO_SEQ_REM aaa bbb Indirect_REMOT E_Templa te U_B_C__N_Q se ccc U_B_C__S__Q SE_SUBSTI TUTI ON U_B_C__S__Q U_B_C_grid 2. cs. bilkent. edu. tr_S_g rid 1. cs. bilkent. edu. tr _Q grid 1. cs. bilk ent. ed u. tr f 12 e 1 "L ggg hh "L

Haw To Generate Tab ? 1. Fill the Excell Table 2. When Save as, select Type : Text(Tab delimited)

Haw to call the Macro Generator ? public Workflow. Macro. Factory(String template. Dir. Path, String tap. Dir. Path, String destination. Dir, boolean to. UNIX) A test main program calls this by default parameters: new Workflow. Macro. Factory( "d: \A_A_Workflow. Repository\TEMPLATES\Decompressed. Templates", "d: \A_A_Workflow. Repository\TEMPLATES\TAP_new. Complex. txt", "d: \A_A_Workflow. Repository\TOM", false); External call: Java – Gener. jar <TD> <TAP> <DD>

Apply the Directory Compress And Upload Program • Under construction • Temporary problems: - Zip –Unzip sensitive to OS - Upload should bypass WF Editor, because SAVE operation of WE overwrites <JOB>/<JOB>. jdl files