Push and Pullbased Workload Management Systems Pushbased WMS

Push- and Pull-based Workload Management Systems • Push-based WMS: Ress • Pull-based WMS: Glide. In Factory • Pros and Cons Gabriele Garzoglio, Computing Division, Fermilab 09 Aug 2007 Aug 09, 2007 Gabriele Garzoglio 1/5

Push- and Pull-based Workload Management Systems • Users express cluster requirements in the JDL • Jobs sit in the site batch system queue until execution • Re. SS can be queried and info passed to VO matchmaker VO / Grid Interface Re. SS: Pushing Jobs to Sites Re. SS job Grid Info Gatherer classads Condor Match Maker Gate 3 VO What Gate? Condor Scheduler job classads Site Grid / Site Interface Gate 1 CEMon jobs Gate 2 info CE job-managers GIP job-managers CLUSTER Aug 09, 2007 CEMon jobs Gate 3 info CE job-managers GIP job-managers CLUSTER Gabriele Garzoglio CEMon jobs info CE job-managers GIP job-managers CLUSTER 2/5

Push- and Pull-based Workload Management Systems Glide. In Factory Pulling Jobs to Sites Creating a condor pool for the VO using nodes from Grid sites Schedd Where do I submit User Jobs? Collector Negotiator Register User Jobs Queue User Job Site Glide G In a t e w a y How Many Glide. In Should I Submit? Glide. In Factory Glide. In Job Glide In Batch System Queue WN Startd User Job VO Site Aug 09, 2007 Gabriele Garzoglio 3/5

Push- and Pull-based Workload Management Systems Glide. In Factory …and Firewalls? Only outgoing connections to GCB relays connections. Site X, Use GCB Schedd User Jobs Queue Where do I submit User Jobs? User Job Collector Negotiator Can accept jobs via GCB Establish long-lived Outgoing connection GCB Site FIRE WALL Glide. In Factory G a t e w a y WN Startd Batch System Queue User Job VO Site Aug 09, 2007 Gabriele Garzoglio 4/5

Push- and Pull-based Workload Management Systems Pros and Cons Pull-based WMS Push-based WMS Pro • Simple Infrastructure, with almost no VO services • Uses standard cluster description (Glue Schema) Con • No Fair Share • No Priority Rearrangements • No Guarantee to land on desired WN Aug 09, 2007 Pro • Allows for complex fare share • If gateway misconfigured, only Glide. In’s fail • Glide. In can check WN environment before committing user job Con • Heavier Infrastructure, with many VO Services • Still some problems when going through firewalls • More complex site security configuration (user job should NOT run with Glide. In privileges) Gabriele Garzoglio 5/5