Dean Martin Cadwallader Dean of the Graduate School

Dean Martin Cadwallader Dean of the Graduate School Miron Livny Computer Sciences Department University of Wisconsin-Madison miron@cs. wisc. edu

Welcome!!! www. cs. wisc. edu/condor

The Condor Project (Established ‘ 85) Distributed Computing research performed by a team of ~40 faculty, full time staff and students who hface software/middleware engineering challenges in a UNIX/Linux/Windows/OS X environment, hinvolved in national and international collaborations, hinteract with users in academia and industry, hmaintain and support a distributed production environment (more than 2300 CPUs at UW), hand educate and train students. Funding – Do. E, NASA, NIH, NSF, EU, INTEL, Micron, Microsoft and the UW Graduate School www. cs. wisc. edu/condor

www. cs. wisc. edu/condor

S u p p o r t y t i l na o i t unc F Resea rch www. cs. wisc. edu/condor

~1 K Condor pools; ~38 K CPUs www. cs. wisc. edu/condor

“ … Since the early days of mankind the primary motivation for the establishment of communities has been the idea that by being part of an organized group the capabilities of an individual are improved. The great progress in the area of inter-computer communication led to the development of means by which stand-alone processing subsystems can be integrated into multicomputer ‘communities’. … “ Miron Livny, “ Study of Load Balancing Algorithms for Decentralized Distributed Processing Systems. ”, Ph. D thesis, July 1983. www. cs. wisc. edu/condor

Claims for “benefits” provided by Distributed Processing Systems h. High Availability and Reliability h. High System Performance h. Ease of Modular and Incremental Growth h. Automatic Load and Resource Sharing h. Good Response to Temporary Overloads h. Easy Expansion in Capacity and/or Function “What is a Distributed Data Processing System? ” , P. H. Enslow, Computer, January 1978 www. cs. wisc. edu/condor

Benefits to Science › Democratization of Computing – “you do not › › have to be a SUPER person to do SUPER computing. ” (accessibility) Speculative Science – “Since the resources are there, lets run it and see what we get. ” (unbounded computing power) Function shipping – “Find the image that has a red car in this 3 TB collection. ” (computational mobility) www. cs. wisc. edu/condor

www. cs. wisc. edu/condor

Client Server Master Worker www. cs. wisc. edu/condor

Customer requests: Place y = F(x) at L! Master delivers. www. cs. wisc. edu/condor

Good old Batch … › Dispatch and forget › Job Control Language (JCL) h. Job steps h. Advanced (eager) binding of date sets h. Resource requirements › Multiprogramming › Time Sharing www. cs. wisc. edu/condor

But, we have more … Jobs Uncertainties Resources Users Owners Errors Data Software layers Expectations Heterogeneity Opportunities www. cs. wisc. edu/condor

How can we accommodate an unbounded need for computing with an unbounded amount of resources? www. cs. wisc. edu/condor