EGEE 3 rd parties Advanced Induction Course Athens

EGEE 3 rd parties Advanced Induction Course, Athens 20 -21/01/05 Project Overview and Update Fotis Karayannis EGEE Collaboration Board Chair SEE Federation Representative in PMB, GRNET Presentation is based on Fabrizio Gagliardi and Bob Jones EGEE presentations in Den Haag Conference, November 2004 EGEE is a project funded by the European Union

Outline • EGEE Overview • EGEE Figures and Organization • EGEE Activities • Service Activities • Middleware Activities • (Human) Networking Activities • Priorities through Athens conference (April 2005) INFSO-RI-508833 Athens, 20 -21/01/05 - 2

EGEE Overview (I) • Goal: • Create a world-wide production-quality Grid infrastructure for e-Science § on top of present and future EU Research Networking infrastructure • Build on: • • EU and EU member states major investments in Grid Technology International connections (US and AP) Several pioneering prototype results Large Grid development teams in EU require major EU funding effort • Approach • • • Applications Grid infrastructure Leverage current and planned national and regional Grid initiatives and infrastructures Work closely with relevant industrial Grid developers, NRENs and US-AP projects http: //www. eu-egee. org INFSO-RI-508833 Geant-NREN networks Athens, 20 -21/01/05 - 3

EGEE Figures & Organization • Coordinator: European Organization for Nuclear Research - CERN • 71 leading institutions in 27 countries, federated in 11 regional Grids (+networking federation) • 32 M € EU funding in 2004 -2005 - O(100 M) total budget INFSO-RI-508833 Athens, 20 -21/01/05 - 4

EGEE Activities 24% Joint Research 28% Networking JRA 1: Middleware Engineering and Integration JRA 2: Quality Assurance JRA 3: Security JRA 4: Network Services Development NA 1: Management NA 2: Dissemination and Outreach NA 3: User Training and Education NA 4: Application Identification and Support NA 5: Policy and International Cooperation 48% Services SA 1: Grid Operations, Support and Management SA 2: Network Resource Provision INFSO-RI-508833 Emphasis in EGEE is on operating a production-quality grid including end-users’ support Athens, 20 -21/01/05 - 5

SA 1 - EGEE Service Activity (I) • Create, operate, support and manage a production quality infrastructure • Offered services: • Middleware deployment and installation • Software and documentation repository • Grid monitoring and problem tracking • Bug reporting and knowledge database • VO services • Grid management services INFSO-RI-508833 Athens, 20 -21/01/05 - 6

SA 1 - EGEE Service Activity (II) • Resource Centers Region Month 1: 10 Month 15: 20 CPU nodes Disk (TB) CPU Nodes Month 15 Disk (TB) Month 15 CERN 900 140 1800 310 UK + Ireland 100 25 2200 300 France 400 15 895 50 Italy 553 60. 6 679 67. 2 North 200 20 2000 50 South West 250 10 Germany + Switzerland 100 2 400 67 South East 146 7 322 14 Central Europe 385 15 730 32 Russia 50 7 152 36 Totals 3084 302 8768 936 Currently: more than 8000 CPUs – 50 sites, ~5 PB! storage, 300 staff - 3000 users INFSO-RI-508833 Athens, 20 -21/01/05 - 7

SA 1 - EGEE Service Activity (III) • Production service • Main production service for production apps • MUST run reliably, runs only proven stable, debugged middleware and services – started with LCG 2 M/W + Redhat 7. 3 – Now LCG 2 + Scientific Linux 3. 03 • Full support – 24 x 7 as soon as possible • Start with 16 x(5 -7) – rotation of coverage between CICs • Pre-production service • • For testing purposes (ops, m/w, apps) Running next M/W version For year 1 pre-prod will run EGEE 1 When EGEE M/W ready – move to production and pre-prod service will be next EGEE candidate release • Initial resources from test-bed sites INFSO-RI-508833 Athens, 20 -21/01/05 - 8

SA 1 - Operations current status • Scale of the production service • April 2004: ~2000 CPUs over ~ 30 sites (LCG-1 → LCG-2) • December 2004: ~8000 CPUs over ~ 80 sites (Migrated to Scientific Linux) § This is far beyond the project milestones! • Continuous improvements to LCG-2 middleware • Set-up of CIC/ROCs • Roles/responsibilities defined in execution plans § documented and implemented • On-going: • Complete set-up of pre-production service • Deployment planning for g. Lite (EGEE 1 M/W version) • Deploy accounting infrastructure • In general On track INFSO-RI-508833 Athens, 20 -21/01/05 - 9

EGEE Middleware Activity • Re-engineering of existing middleware functionality, leveraging the experience of partners • Activity concentrated in few major centers • Key services: Resource Access • • Data Management (CERN) Information Collection and Accounting (UK) Resource Brokering (Italy) Quality Assurance (France) Grid Security (Northern Europe) Middleware Integration (CERN) Middleware Testing (CERN) INFSO-RI-508833 Athens, 20 -21/01/05 - 10

EGEE Middleware Activity (II) • • Middleware delivery to SA 1 Release management Deployment scenarios Middleware configuration • Configuration files and documentation with examples Platforms to be supported in JRA 1 • Primary platform: Red Hat Enterprise 3. 0, gcc 3. 2. 3 and icc 8 compilers (both 32 and 64 -bits) and binary compatible (Scientific Linux) • Secondary platform: Windows (XP/2003), vc++ 7. 1 compiler (both 32 and 64 -bits) Versions for compilers, libraries, third party software Programming languages Packaging and software distribution INFSO-RI-508833 Athens, 20 -21/01/05 - 11

JRA 1 - Middleware Status • Architecture and design of new middleware version called G. lite developed and reviewed • Successive prototypes produced on distributed testbed • Complete code mgmt and build system put in place • Integration and Testing teams working with g. Lite releases • Requests from HEP experiments for production usage • First component (g. Lite I/O) released to SA 1 • On-going : • Clarify sw for 1 st release § Agree with NA 4/SA 1 on component set • Test/Validate 1 st release • Produce 1 st release G. lite is on the late side INFSO-RI-508833 Athens, 20 -21/01/05 - 12

JRA 3 – Security Activity • EU Grid PMA established (lead by David Groep) • Joint Security Policy Group (JSPG) working across Europe and US for security policies, operational security procedures • With LCG, OSG (lead by Dave Kelsey - SA 1) VO AUP documented in NA 5 White paper • User requirements surveyed & security architecture defined • Closer integration with JRA 1 for mware issues • Links made to production service with operational procedures and incident handling • On-going • Define site access control architecture and investigate secure credential storage procedures INFSO-RI-508833 Athens, 20 -21/01/05 - 13

JRA 3 - EGEE Authentication Scheme. EUGrid. PMA • Policy Management Authority: “Club” of trusted Certification Authority managers www. eugridpma. org · Green: CA Accredited · Yellow: being discussed Other Accredited CAs: · · · · Do. EGrids (US) Grid. Canada ASCCG (Taiwan) CERN Russia (HEP) FNAL Service CA (US) Israel Pakistan Greece: Hellasgrid CA (AUTH) INFSO-RI-508833 Athens, 20 -21/01/05 - 14

EGEE (Human) Networking Activities • NA 2 - Dissemination and outreach • Lead by TERENA • NA 3 - User training and induction • Lead by Unv Edin. (Ne. SC) • NA 4 - Application identification and support • • Two pilot application centers (for high energy physics and biomedical grids) One more generic component dealing with longer term recruitment and support of other communities • NA 5 - Policy and International cooperation • • Established e. Infrastructure Reflection Group – produces white papers Coordinate relations with other projects (EU and beyond) map points indicate federations and are not geographically precise INFSO-RI-508833 Athens, 20 -21/01/05 - 15

EGEE Conferences - Training Conferences • 1 st project conference held at Cork- Ireland, April 18 -22, 2004 • 2 nd project conference: the Netherlands, 18 -26 November, 2004 • 3 rd project conference: Greece, 18 -22 April, 2005 • 4 th project conference: city to be selected next week, Fall 2005 Training Course Type Average Attendance Course Requirements Number per Year Induction 50 2 Day, Web Access ≥ 10 Application Developer Training 25 4 Day, Workstations ≥ 8 Advanced Courses 25 5 Day, Workstations ≥ 2 Technical Activity specific Retreats 30 2 Day ≥ 6 INFSO-RI-508833 Athens, 20 -21/01/05 - 16

NA 3 – User training and induction status • NA 3 has been involved in more than 35 training events across the world • • • (including the GGF grid school) ~500 people trained § induction; application developer; advanced; activity retreats Material archive online with ~80 presentations • Strong links made with GILDA testbed and use of GENIUS portal • Regularly used as part of tutorials • Essential element of the virtuous cycle for new communities • Training is one of the first things new communities need • Process for handling feedback defined • Helping to improve material and organisation • Roadmap for future event planned • • Open to new suggestions Produced status report and update training plan taking into account lessons learned • On-going • Plan for next EGEE M/W (g. Lite) training In general: on track INFSO-RI-508833 Athens, 20 -21/01/05 - 17

NA 4 - EGEE Applications status • EGEE Scope : ALL-Inclusive for academic • applications (open to industrial and socioeconomic research world as well) Two pilot applications already making heave use of the infrastructure : Physics & Bioinformatics • • Large scale usage of production service by LHC experiments for data challenges and initial deployment of 3 Bio applications: CDSS, GPS@, GATE 5 more Bio applications identified • Generic applications combined with GILDA training environment • • • GILDA testbed (running LCG-2 mware) has grown in size (14 sites) Gets new applications up and running, training tool and stepping-stone to production service Currently supporting geophysics (industry), computational chemistry, astro-particle physics with interest from astrophysics, hydrology seismology, grid search engines (GRACE Project), stock market simulators, digital video and ESA Application domains and timelines are for illustration only INFSO-RI-508833 Athens, 20 -21/01/05 - 18

NA 4 - EGEE Applications status (2) • EGEE Application Approval Panel (EGAAP): • Reviews new applications ready for production usage • Reviewed 4 application requests in June (now deployed on GILDA) and 7 more reviewed in November • Vasso Kotroni is an EGAAP member (first meeting in November) • On-going: • Expand deployment of Bio and generic applications • Set-up Bio and generic support groups • Produce application migration report • Continue to evaluate g. Lite and provide feedback INFSO-RI-508833 Application domains and timelines are for illustration only Athens, 20 -21/01/05 - 19

NA 5 – Policy and International Cooperation status • Team completed late • Helped organize EU Research Infrastructures concertation event in the Hague • Most RI projects participated: EGEE, GN 2, DEISA, SEEGRID, DILIGENT, GRIDCC, etc. • New draft version of the e. IRG white paper distributed in the Hague – November • GRNET leading white papers - Contributions by Aegean, AUEB • Synergy roadmap deliverable with DEISA & SEE-GRID ready • In general on track INFSO-RI-508833 Athens, 20 -21/01/05 - 20

GRNET involvement in EGEE • Resource provider: • GRNET cluster is currently used in EGEE – Hellasgrid clusters to be added this year! (Total ~700 CPUs / 10 TB partially provided to the project) • Representing South East Europe in the Executive Committee (Project Management Board-PMB) • SEE Federation: Bulgaria, Cyprus, Israel, Greece, Romania • Participates in Training (NA 3), Policies (NA 5), Operations • • • (SA 1 -main task) and Network provision activities (SA 2) Coordinating the SEE Regional Operations Centre (SEEROC) Coordinating training activities in the region Link with the NRENs - GEANT community and SEE-GRID Participating in multiple project committees and groups Hosting the 3 rd EGEE Conference in Athens • supported by Hellasgrid budget (http: //public. eu-egee. org/conferences/3 rd/) INFSO-RI-508833 Athens, 20 -21/01/05 - 21

Priorities through Athens conference Technical • Ensure deployment of applications • Must be able to show that EGEE can support a wide range of applications • We know how it works – now we must turn the handle • It must be better than LCG-2 • Turn the virtuous cycle into reality • Get g. Lite components ready for production deployment Reporting • Project month 9 deliverables, 3 rd quarterly report and periodic report (covering first 9 months) • Are being sent to the EU today! • Presentations and demonstrations § timetable of rehearsals established – these are important! Must go to the review proving that we have a large-scale production grid service that is of benefit to multiple scientific disciplines • Prepare for the EU review (9 -11 February) • • Produce the project month 12 deliverables • Significant work immediately after the review INFSO-RI-508833 Athens, 20 -21/01/05 - 22