Condor Glidein Condor Daemons OnTheFly Dan Bradley Glidein

Condor Glidein: Condor Daemons On-The-Fly Dan Bradley Glidein TLC Provider, Condor Team Computer Sciences Department University of Wisconsin-Madison danb@cs. wisc. edu http: //www. cs. wisc. edu/condor/glidein

Why Glidein? › You have access to a cluster running › some other batch system. You want Condor features, such as hqueue management hmatchmaking hcheckpoint migration www. cs. wisc. edu/condor/glidein

What Does Glidein Do? › Installation and setup of Condor. h. May be done remotely. › Launching Condor. h. Through Condor-G submission to Globus. h. Or you run the startup script however you like. www. cs. wisc. edu/condor/glidein

Condor Startd in Flight www. cs. wisc. edu/condor/glidein

Example condor_glidein some. gatekeeper. edu › Eventually, a remote node appears in your Condor pool. condor_status Name Op. Sys Arch State Activity Load. Av Mem Actvty. Time 3412@somewhere. edu LINUX INTEL Unclaimed Idle 0. 01 500 0+00: 05: 01 www. cs. wisc. edu/condor/glidein

But it didn’t work!? › Some glidein gotchas h. Use condor_glidein from version 6. 7. 3+ h. Must allow glideins to join your pool. Check HOST_ALLOW settings. h. Must have inbound/outbound connectivity. (Stay tuned for availability of GCB, though. ) h. Jobs will probably need to use Condor file staging or remote i/o. www. cs. wisc. edu/condor/glidein

Glidein Lifespan › Glidein nodes automatically go away when there is no work for them to do. h. Use –idletime to customize. h. Use –runtime to set upper age limit. www. cs. wisc. edu/condor/glidein

Glidein Security › No authentication of daemons by default. h. May enable GSI authentication using -gsi options. › Default is to only run jobs from the user who submitted glidein. h. May use –anybody to open access to anyone in the Condor pool. www. cs. wisc. edu/condor/glidein

Who Runs Glidein? › Anyone, but… h. Admin must allow glideins to join pool. › For greater freedom, create separate glidein pool. h. Glideins join personal Condor pool. h. Use flocking to submit jobs to this personal pool plus any others. www. cs. wisc. edu/condor/glidein

Can I Configure It More? › Yes. Generate default configuration and edit it. condor_glidein –genconfig –genstartup … condor_glidein –useconfig X –usestartup X … › Use –forcesetup to overwrite existing installation. www. cs. wisc. edu/condor/glidein

Development Status › Condor 6. 7 series glidein features h. Support for easy GSI setup. h. Hassle-free access to tarballs. h. Greater flexibility to operate in other (e. g. non-Globus) environments. h. General hardening for life in the wild. www. cs. wisc. edu/condor/glidein

Future Directions › Integration with GCB so Firewalls are less › problematic. Glidein schedds. h. Heirarchical queue management ala Condor-C. › Glidein management. h. On-demand expansion of Glidein pool. h. See Edward Walker’s Grid. Shell work. www. cs. wisc. edu/condor/glidein

Any Questions? › Ask me now. . . › Or email condor-users@cs. wisc. edu. › Check the Glidein documentation at › http: //www. cs. wisc. edu/condor/glidein Thanks! www. cs. wisc. edu/condor/glidein