CDF Requirements for RUNJob Or Determining the Requirements

CDF Requirements for RUNJob Or Determining the Requirements on a System we have never used and barely know anything about Rick St. Denis -- Glasgow July 29, 2004 Run. Job for CDF

Workflow for CDF processing All components in common with D 0 EXCEPT shaded Sam Dataset Definition Snapshot Nf Files Sam Stream M Files M< Nf, N=Nf/M jobs Uses Set Mechanism to get Differences (loop until Nf big enough) July 29, 2004 Run. Job for CDF Prod. Exe Process M files Sam Store: 2 X files for each of the M files; one metadata and one data

Comments on Effort: Executive Summary • Bottom line: Cdf. Run. Job (Evans) needs 4 hr of Dave or 2 weeks of Rick • A person with python ability can get the farms going within 4 mo. July 29, 2004 Run. Job for CDF

Comments on Effort • Dave Evans had task in Dec 03/Jan 04 to make Runjob work for CDF: Cdf. Run. Job, based on Shakar (at that time) • Needs update • Getting MC to run with JIM helps a long way with debugging. • Getting RCP params in SAM will be a big help. • Overlap with Peter Love on the “unshaded” boxes July 29, 2004 Run. Job for CDF

Expectations • Checkpoint of Runjob DAG: Can it start off where it left off when it crashed • Ability to generate separate processing depending on raw processing or reprocessing • Application programmer guide so we understand how to implement • Completed and running with CAF within 4 mo. Jim Later • Simplify input to take a frozen tcl, later with RCP • Monitoring of steps • Retry when failures: ie, core dump, retry 4 times then abort July 29, 2004 Run. Job for CDF