Fermilab Grid Computing CDF D 0 and more
Fermilab Grid Computing – CDF, D 0 and more. . Victoria A. White Head, Computing Division, Fermilab white@fnal. gov
First - Apologies 1) For not being in Korea with you 2 DOE reviews in the US this week 2) For my substitute speaker, Don Petravick, having to cancel his trip at the last moment 3) For a poorly prepared, last-minute, talk as a result Vicky White ICFA-HEP Networking, Grids and Digital Divide 2
Fermilab Ongoing Scientific Program, 2005 › › › › CMS International Linear Collider LHC Mini. Boone MINOS Pierre Auger, CDMS Run II (CDF, D 0, Accelerator and potential upgrades) Simulation for Accelerators Sloan Digital Sky Survey Test Beams and MIPP Theory Programs and Lattice QCD computational program R&D for SNAP R&D for DES, Nova, Flare, Minerva R&D for Linear Collider detectors Vicky White * Grid related ICFA-HEP Networking, Grids and Digital Divide 3
Inclusive Worldwide Collaboration is essential for Particle Physics What are we doing at Fermilab to help this ? h Networks and Network research h Grids - for CMS, for Run II, SDSS, Lattice QCD h h h h • Leadership role in Open Science Grid • Lots of technical work with LCG Guest Scientist program Education and Outreach program Experiment sociology and leadership – changes Videoconferencing Virtual Control Rooms Physics Analysis Center for CMS Public Relations Vicky White ICFA-HEP Networking, Grids and Digital Divide 4
Grid Projects and Working groups Fermilab is involved in numerous Grid projects and coordination bodies h PPDG, Gri. Phy. N and i. VDGL - the Trillium US Grid projects h LHC Computing Grid bodies and working groups on Security, h h h h Operations Center, Grid Deployment, etc. SRM – storage systems standards Global Grid Forum – Physics Research Area Global Grid Forum – Security Research Area Open Science Grid Interoperability of Grids and Operations of Grids Ultralight Network research Ultranet/Lambda-Station Network and Storage project And probably some I forgot…. . Vicky White ICFA-HEP Networking, Grids and Digital Divide 5
Fermilab Grid Strategy › Strategy (from a Fermi-centric view) h Common approaches and technologies across our entire portfolio of experiments and projects h Fermi. Grid – so we can share all Fermilab resources › Strategy (from a global HEP view) h Work towards common standards and interoperability › At Fermilab we are working aggressively to put all of our Computational and Storage Fabric on “the Grid” and to contribute constructively to interoperability of various Grid infrastructures Vicky White ICFA-HEP Networking, Grids and Digital Divide 6
CDF and D 0 (and MINOS) › Running experiments with working Monte Carlo, › › Data Processing and Analysis systems, handling tens of TBs of data per day CDF and D 0 both now have global computing models All 3 experiments use SAM for Data Handling metadata, reliable file transfer, data delivery, bookkeeping D 0 use SAM-GRID (SAM + JIM workload manager) and have successfully reprocessed data offsite CDF use CAFs and d. CAFs and SAM and will be taking the next steps towards Grid job submission Vicky White ICFA-HEP Networking, Grids and Digital Divide 7
SAM-Grid › SAM-Grid is fully functional distributed computing › › › infrastructure in use by D 0, CDF and MINOS ~30 SAM stations worldwide active for D 0 ~20 SAM stations worldwide active for CDF D 0 successfully carried out reprocessing of data at 6 sites worldwide h http: //www. fnal. gov/pub/ferminews 04 -02 - 01/p 1. html Fermi. News article February h And in the latest reprocessing has already handled more events off-site › SAM-GRID uses many common (and evolving!) Grid standards, will evolve further, and will soon run routinely on top of LCG computing environment and Open Science Grid Vicky White ICFA-HEP Networking, Grids and Digital Divide 8
Vicky White ICFA-HEP Networking, Grids and Digital Divide 9
Vicky White ICFA-HEP Networking, Grids and Digital Divide 10
Vicky White ICFA-HEP Networking, Grids and Digital Divide 11
Vicky White ICFA-HEP Networking, Grids and Digital Divide 12
Vicky White ICFA-HEP Networking, Grids and Digital Divide 13
Vicky White ICFA-HEP Networking, Grids and Digital Divide 14
Vicky White ICFA-HEP Networking, Grids and Digital Divide 15
Vicky White ICFA-HEP Networking, Grids and Digital Divide 16
Vicky White ICFA-HEP Networking, Grids and Digital Divide 17
Vicky White ICFA-HEP Networking, Grids and Digital Divide 18
Vicky White ICFA-HEP Networking, Grids and Digital Divide 19
CDF approach to Grids Vicky White ICFA-HEP Networking, Grids and Digital Divide 20
CAF – successful and GUI popular Vicky White ICFA-HEP Networking, Grids and Digital Divide 21
Vicky White ICFA-HEP Networking, Grids and Digital Divide 22
Vicky White ICFA-HEP Networking, Grids and Digital Divide 23
Vicky White ICFA-HEP Networking, Grids and Digital Divide 24
Vicky White ICFA-HEP Networking, Grids and Digital Divide 25
Vicky White ICFA-HEP Networking, Grids and Digital Divide 26
Vicky White ICFA-HEP Networking, Grids and Digital Divide 27
“Dedicated” needs to go to “Grid” Vicky White ICFA-HEP Networking, Grids and Digital Divide 28
Vicky White ICFA-HEP Networking, Grids and Digital Divide 29
Global Grid Community Vicky White ICFA-HEP Networking, Grids and Digital Divide 30
Federating Grids As the US representative to the LHC Computing Grid Deployment Board (LCG GDB) I have repeatedly pushed the case for the LHC Computing Grid to be a “Grid of Grids” – not a distributed Computing center h Resources must be able to belong to >1 Grid • E. g. Nordu. Grid, UK Grid, Open Science Grid, Tera. Grid, Brazil Grid? , University ABC Grid and Fermi. Grid! h Grids infrastructures must learn to interoperate h Governance, policies, security, resource usage and service level agreements must be considered at many levels including at the level of a Federation of Grids › I recently called this a “Grid Bazaar” (ISGC 2005) Vicky White ICFA-HEP Networking, Grids and Digital Divide 31
Grid - its really about collaboration! 5 › It’s about sharing and building a vision for the future h And it’s about getting connected › It’s about the , n iwa y a M 0 20 a h s k r o d. W , T p o i r G al democratization of n o i science nat r e t In Vicky White ICFA-HEP Networking, Grids and Digital Divide 32
- Slides: 32