EMI Release Management Highlights EMI 1 Updates EMI






















- Slides: 22
EMI Release Management Highlights EMI 1 Updates & EMI 2 Status Cristina Aiftimiei (INFN) - EMI Release Manager Andrea Ceccanti (INFN) – EMI SA 1 WP Leader EGI Community Forum 2012/EMI 2 nd Technical Conference 27 -30/03/2012 EMI is partially funded by the European Commission under Grant Agreement RI-261611
g. Lite ARC UNICORE d. Cache 20/05/2021 EGI/EMI Conference 2012 2 EMI INFSO-RI-261611 EMI
20/05/2021 EGI/EMI Conference 2012 3 EMI INFSO-RI-261611 EMI Releases Codenames
20/05/2021 EGI/EMI Conference 2012 4 EMI INFSO-RI-261611 EMI Major Releases Timelines
EMI Maintenance Schedule Full maintenance period – 12 months • Correct issues in the code and provide new features Standard maintenance period – 6 months • Correct issues in the code, but no new feature is introduced Security updates period – 6 months Are provided only updates targeting security vulnerabilities End-of-life period: • no updates or support is provided any more 20/05/2021 EGI/EMI Conference 2012 5 EMI INFSO-RI-261611 •
20/05/2021 EGI/EMI Conference 2012 6 EMI INFSO-RI-261611 EMI Maintenance process
20/05/2021 EGI/EMI Conference 2012 7 EMI INFSO-RI-261611 EMI 1 updates release cycle
20/05/2021 EGI/EMI Conference 2012 8 EMI INFSO-RI-261611 EMI 1 - Maintenance & Support
20/05/2021 EGI/EMI Conference 2012 9 EMI INFSO-RI-261611 EMI component releases
EMI 1 Updates - Highlights • ARC CE, Clients, Core, Gridftp server, Info. Sys – 2 revision updates solving more than 300 Rf. Cs • ARC incompatibilities with CERN VOMS server & ARC CE wrong user mapping • 2. 6 python bindings for RH 5 • BDII core, site, top – – Address BDII vulnerability Caching Top Level BDII Migrate Site BDII to Open. LDAP v 2. 4 BDII Performance improvements: disk and memory exhaustion issues – Support for (S)GE batch system – Fixed memory leak in bupdater for PBS/Torque and LSF – Solved some problems concerning the integration with Argus, happening with sub-CAs (e. g. CERN-TCA, UKe. Science. CA) & publication of version information 20/05/2021 EGI/EMI Conference 2012 10 EMI INFSO-RI-261611 • CREAM, BLAH, CEMon
EMI 1 Updates – Highlights (cont. ) • d. Cache – complete the transition to the new configuration system – faster and more robust implementation of the pin manager – HTTP support to third party srm. Copy transfers – proxy certificate and VOMS support to the HTTP/Web. DAV door – downgrade to Jetty 7. 2 -2 & restore compatibility with ARC • DPM/LFC – Support for SEmsg; log to syslog & GLUE 2 support – Improved scalability of all frontend daemons – Faster DPM drain & better balancing of data among disk nodes – Support FTS monitoring messages – Change FTS file overwrite logic – Support for gridftp endpoints – Oracle 11 g integration 20/05/2021 EGI/EMI Conference 2012 11 EMI INFSO-RI-261611 • FTS
EMI 1 Updates – Highlights (cont. ) • Sto. RM SE – Fixes memory leak on Back. End REST service calls – Sto. RM Back. End memory consumption grows indefinitely • UNICORE/X 6, Gateway 6, TSI, UCC, UVOS, XUUDB – Gateway - improved logging of connection errors & make the maximum SOAP header size configurable – GLUE 2 WS endpoint – UNICORE/X - support for manipulating default file system ACLs (umask); SCP is supported for data staging with username/password according to the "HPC file staging profile” – new Glue 2 schema used, service version is published – Condor vulnerability – Fixes major problems in ICE regarding proxy-renewal & proxy internal structure convention; authorization issues due to wrong “gacl” file setting and failures when submitting jobs using a proxy retrieved from Myproxy – Solves a problem with the proxy purger cron job which prevented, on ext 3, new delegations for a certain DN after its 31999 th submission – Glue 2 publication 20/05/2021 EGI/EMI Conference 2012 12 EMI INFSO-RI-261611 • WMS
EMI - Beta & Acceptance Testing • Early availability – once the code is ready: • beta phase - through participation in EMI Beta Testing activity, using the testing/ repository • release candidate phase- through participation in EMI Acceptance Testing activity, using the deployment/ repository 20/05/2021 EGI/EMI Conference 2012 13 EMI INFSO-RI-261611 –https: //twiki. cern. ch/twiki/bin/view/EMIBeta Acceptance. Testing –access to interested parties to earlier stages/phases of the software development:
EMI 1 Updates – General Links • EMI 1 Products & Updates – http: //www. eu-emi. eu/emi-1 -kebnekaise • EMI Announce – emi-announce@eu-emi. eu • EMI News RSS – http: //emisoft. web. cern. ch/emisoft/EMINews. rss. xml • EMI 1 planned products updates – http: //bit. ly/all_active_tasks – Near/next Update – EMI 1 products releases under preparation • http: //bit. ly/EMI 1 Updates. Open 20/05/2021 EGI/EMI Conference 2012 14 EMI INFSO-RI-261611 • http: //bit. ly/EMI 1 Updates. Ready
EMI 1 Products not yet in UMD • EMI 1 products not in UMD – Unverified- d. Cache, v. 1. 9. 12 -13 – Not planned for inclusion: • AMGA, LFC_oracle (E. A. found recently), VOMS_oracle, FTS 20/05/2021 EGI/EMI Conference 2012 15 EMI INFSO-RI-261611 • All EMI Products status Table
g. Lite Security updates • g. Lite Security Updates are supported until 30. 04. 2012 (EMI 2) – No updates foreseen for the moment • “[…] extended by the EMI project from April 30 2012 to September 30 2012. Purpose of this extension is allow more time to sites and VOs to fully assess the impact of the replacement of glite 3. 2 WN/UI with versions from EMI 1 or EMI 2. “ 20/05/2021 EGI/EMI Conference 2012 16 EMI INFSO-RI-261611 • EGI-BROADCAST, 15 Mar. 2012 – “extension of security support of g. Lite 3. 2 glite-WN and glite-UI”
20/05/2021 Change Me 17 EMI INFSO-RI-261611 EMI Matterhorn Status update
EMI 2 – Highlights • Major new features and services Extended back-end support for all EMI CEs to Torque, SGE, LSF, SLURM All the EMI services publish GLUE 2 conformant information A common service registry for all EMI services (EMIR) Comprehensive set of Nagios probes for every EMI service Encrypted storage on ordinary EMI Ses based on Hydra and the Pseudonymity service – A prototype for a common EMI security library (CANL) – ARGUS as the official EMI authorization solution via integration with all the SEs and CEs – Support for SL 6 and Debian 6 – – – – – Implementation of a common EMI interface for job management (EMI-ES) Storage Accounting record (St. AR) and Compute Accounting record (CAR) A common EMI SAML profile Industry standard protocols for accessing the EMI SEs • DPM and DCache ready for NFS 4. 1 • HTTPS access to DPM, Sto. RM, d. Cache • Web. DAV access to DPM and d. Cache 20/05/2021 EGI/EMI Conference 2012 18 EMI INFSO-RI-261611 • Technical Agreements and Standardization
EMI 2 Release Management • Release Candidate process: – 4 RCx – from Dec. 2011 to April 2012 – Continuous Integration Builds – using ETICS service • Increased successful build rates on SL 5/SL 6/Debian – Repositories • http: //emisoft. web. cern. ch/emisoft/dist/EMI/2/RCx • Populated after each code-freeze date • http: //tinyurl. com/emi 2 -tasks-open • continuously updated – Rf. Cs, Documentation, Release Notes 20/05/2021 EGI/EMI Conference 2012 19 EMI INFSO-RI-261611 – From „in-house“ deployment to deployment/testing on the EMI testbed campaigns – EMI 2 products releases tracker
EMI 2 porting to new “platforms” • Technical Objective of EMI Development plan – ongoing –“Port, release and support EMI components on identified platforms (full distribution on SL 6 and Debian 6, UI on SL 5/32 and latest Ubuntu)” • Status: – SL 5/x 85_64 - all EMI products • SL 5/i 386 – clients (UI, WN) • concentrate on clients (UI/WN) • Late products will be released through an EMI 2 update 20/05/2021 EGI/EMI Conference 2012 20 EMI INFSO-RI-261611 –SL 6/x 86_64 – all EMI products –Debian 6
20/05/2021 Change Me 21 EMI INFSO-RI-261611 Questions?
EMI is partially funded by the European Commission under Grant Agreement INFSO-RI-261611 20/05/2021 EGI/EMI Conference 2012 22 EMI INFSO-RI-261611 Thank you