IDGFSP International Desktop Grid Federation Support Project WP

IDGF-SP International Desktop Grid Federation - Support Project WP 4 – Addressing Scientific Organisations IDGF-SP Project 1 st Review Meeting 10 th January 2014, Brussels Tamas Kiss, University of Westminster, WP Leader IDGF-SP is to be supported by the FP 7 Capacities Programme under contract nr RI-312297. RI- 1

Work package objectives 1. Broaden scientific user communities of Desktop Grids on local (private grids), national (NGI) and European (EGI) level by • increasing awareness regarding the applicability of desktop grid computing in scientific research and industrial conduct, • providing success stories, participation in events, flyers and expanding the already established International Desktop Grid Federation, • promoting technologies developed by the EDGI, EDGe. S and DEGISCO projects extending the usability and increasing the quality of service provided by desktop grids • organising training events for scientific and industry endusers, applications developers and systems administrators 2 2

Work package objectives 2. 3. 4. 5. 6. Support scientific organisations in establishing local desktop grid infrastructures and in collaborating to utilise these infrastructures with best efficiency. Provide support for application developers for porting and deploying applications on desktop grid infrastructures, and support the certification of new Application Development Centres based on the IDGF Application Development Methodology. Provide application validation service, and support the establishment and certification of new Application Validation Centres based on the IDGF Application Validation Procedure. Support the operation of ported applications on the production infrastructure by operating a central IDGF helpdesk, and by supporting the establishment and accreditation of 2 nd tier helpdesks and expert groups. Collect and disseminate best practices in application development and user support within existing and potential new IDGF user communities 3 3

Results of year 1 – Task 4. 1 - Activities to increase the awareness and understanding of desktop grid technologies within scientific user communities • disseminating the latest results and technologies of desktop grid computing towards scientific user communities (success stories, workshops, conferences) • organising training courses - training the trainers • scientific organisations will be supported in setting up local desktop grid infrastructures Related deliverables: D 4. 1. 1 Report on scientific user community involvement - M 12 D 4. 1. 2 Report on scientific user community involvement (update) - M 24 4 4

Results of year 1 – Task 4. 1 Disseminating the latest results and technologies of desktop grid computing towards scientific user communities • Organising a Virtual Team within EGI (Virtual Team Promoting Desktop Grids) – participants from 11 countries, kicked off in November 2013, result expected in Year 2 • Several presentations at European level events (e. g. EGI Community and Technical Forum, Krakow Grid Workshop) • Directly targeting key user communities (e. g. participation on the Lubeck Auto. Dock workshop, raising awareness within the Bio. Ve. L, ag. INFRA, Dirac, CRISP, ELI and We-NMR user communities) • Supporting non-EU IDGF members (Russian Chapter, South-East Asian Chapter, participation on ISGC 2014) • Active contribution to the BOINC community (several IDGF-SP presentations on the annual BOINC Workshop) 5 5

Results of year 1 – Task 4. 1 Organising a Virtual Team within EGI (Virtual Team Promoting Desktop Grids) – participants from 11 countries, kicked off in November 2013, result expected in Year 2 • • • Promote and train the Desktop Grid related technologies in the EGI communities Utilize the available bridged Desktop Grid resources by more VOs Increase the number of heavily used EGI applications on the integrated (Desktop Grid) infrastructure with focus on widespread tools/solutions/approaches Improve documentation, e. g. Road maps, training materials, manuals Complete the final remaining steps for full integration concerning e. g. support tools Find joint EGI champion(s) - IDGF ambassador(s) 6 6

Results of year 1 – Task 4. 1 Organising training courses • IDGF session on Summer School on Grid and Cloud Workflows and Gateways, Budapest, Hungary (http: //www. lpds. sztaki. hu/summerschool 2013) Setting up local Desktop Grid Infrastructures • Supporting universities and research institutes in setting up local DG infrastructures: Brunel University, University of Portsmouth, Joint Institute for Nuclear Research Russia • Identifying and helping to solve challenges – both technical and organisational (“political”) 7 7

Results of year 1 – Task 4. 2 – Analysis of potential applications to be ported to desktop grid platforms • analysing the feasibility of applications of potential new user communities on IDGF supported platforms. • • • collect information about the applications analyse the feasibility of the porting identify user requirements. Related deliverables: • D 4. 2. 1 Report on IDGF application porting and user support activities - M 9 • D 4. 2. 2) Report on IDGF application porting and user support activities (update) – M 21 8 8

Results of year 1 – Task 4. 2 New applications identified analysed • Biome-BGC and Biome-BGC Mu. So (multilayer soil module) applications used and operated by the Bio. Vel (Biodiversity Virtual e -Laboratory) project • Riemann-Siegel Zeta Search - mathematical application for localizing the outliers of the Riemann-Siegel Zeta mathematical function by ELTE University • Dirac pilot job framework – enables the execution of various applications in diverse application domains • • We. NMR applications – CNS Arnold 3 D animations rendering for University of Portsmouth Low Energy BOINC – to support IDGF-SP WP 5 activities Charity Engine commercial applications (e. g. Acellera Cell. MD molecular modelling application, BOINC-enabled Bitcoin miner, Litecoin miner and CUDAminer, extreme weather simulation) 9 9

Results of year 1 – Task 4. 3 – Supporting application developers • Technical support for established and new application developers Related deliverables: • D 4. 2. 1 Report on IDGF application porting and user support activities - M 9 • D 4. 2. 2) Report on IDGF application porting and user support activities (update) – M 21 10 10

Results of year 1 – Task 4. 3 Generic support for established and new application developers: • • • an operational centre has been formed technical materials have been collected and published at http: //doc. desktopgrid. hu related to all supported DG components General first entry point for all application developers to access guides and documentation 11: 11

Results of year 1 – Task 4. 3 Application specific support for developers • Supporting the development of the BBGC and BBGC Muso applications of the Bio. Vel community • Supporting the developers of ELTE to develop the new DG enabled mathematical (Riemann-Siegel Zeta) algorithm • Required features have been added to the GBAC virtualization framework in order to host the DIRAC pilot software smoothly • Supporting the porting of We. NMR applications (CNS) • Significantly upgraded versions of three previously developed applications: Auto. Dock, Auto. Dock Vina, and Mental. Ray, to support gateway development activities of the SCIBUS project • Significantly upgraded version of the ABC Sieving Finder (Leiden) application • Development of the Low Energy BOINC application for WP 5 • Development of Charity Engine commercial applications (e. g. Acellera Cell. MD molecular modelling application, BOINC-enabled Bitcoin miner, Litecoin miner and CUDAminer, extreme weather simulation) 12: 12

Results of year 1 – Task 4. 3 IDGF supported applications in action – Zeta Search • • • Mathematical application aiming at locating as many large values of the zeta function as possible on the critical line for statistical analysis Runs at production on the SZTAKI Desktop Grid Major scientific results produced recently 13 13

Results of year 1 – Task 4. 3 IDGF supported applications in action – BBGC • • • A process-based biogeochemical model that can be used to simulate carbon, nitrogen and water pools and fluxes of different terrestrial ecosystems Used by the Bio. Vel European Project Runs on EDGe. S@home, accessible from the Bio. Vel Portal 14: 14

Results of year 1 – Task 4. 3 IDGF supported applications in action – BBGC • • Achievements reported in Bio. Vel newsletter IDGF listed as “Friends of Bio. Vel” 15

Results of year 1 – Task 4. 4 – Application validation service • central IDGF Application Validation Certification Service and local IDGF certified application validation centres Related deliverables: • D 4. 2. 1 Report on IDGF application porting and user support activities - M 9 • D 4. 2. 2) Report on IDGF application porting and user support activities (update) – M 21 16 16

Results of year 1 – Task 4. 4 • Application validation procedure reviewed • The IDGF Application Validation procedure (developed by EDGe. S and EDGI) has been reviewed • New procedure takes into consideration new application development and deployment models (GBAC virtualisation technology, production IDGF DGs) • Application validation infrastructure updated • New infrastructure hosted at Uo. W based on virtualisation technologies • 10 new applications validated and uploaded to the EDGI Application Repository • Mdrungbac, CNS, KOPI, BBGC 5, singlerenderergbac, singlechainmc 32000 gbac, BBGC-Muso, Public. Auto. Dock 423 Multiple. Dockings. Per. Client, Dirac, Zeta Search 17 17

Results of year 1 – Task 4. 4 • 10 new applications validated and uploaded to the EDGI Application Repository 18 18

Results of year 1 – Task 4. 5 – User support • central IDGF helpdesk and expert group • coordinates the establishment and operation of local helpdesks • 2 nd tier local helpdesks and user support centres • responsible for the day to day operation of the local infrastructure and user support Related deliverables: • D 4. 2. 1 Report on IDGF application porting and user support activities - M 9 • D 4. 2. 2 Report on IDGF application porting and user support activities (update) – M 21 19 19

Results of year 1 – Task 4. 5 IDGF Central Helpdesk • Request Tool: open source enterprise-grade issue tracking system (http: //desktopgridfederation. eu/helpdesk) 20 20

Results of year 1 – Task 4. 5 IDGF Central Helpdesk • Message board (user forum) - http: //desktopgridfederation. org/forum 21 21

Results of year 1 – Task 4. 5 User support for IDGF user communities User community Application Target desktop grid site Institute providing the support 1. SZTAKI DSD department KOPI SZTAKI Desktop Grid SZTAKI 2. ELTE university Numsys SZTAKI Desktop Grid SZTAKI 3. BIOVEL project BBGC EDGIDemo SZTAKI 4. DIRAC project Various DIRAC applications EDGIDemo SZTAKI 5. Autodock portal users Autodock, Autodock VINA EDGe. S@home SZTAKI 6. Molecular docking community Autodock, Autodock VINA University of Westminster Local Desktop Grid (WLDG) Uo. W 7. 3 D animation and games students Mental. Ray University of Westminster Local Desktop Grid (WLDG) Uo. W 8. Mathematical Institute of Leiden University ABC sieving finder ABC@home University of Leiden 22 22

Results of year 1 – Task 4. 6 – Best practices in application development and user support • elaborating and disseminating best practices for application developers and end-users who intend to utilise the IDGF related infrastructures • provide recommendations regarding application porting, validation and operational practices Related deliverables: • D 4. 2. 1 Report on IDGF application porting and user support activities - M 9 • D 4. 2. 2 Report on IDGF application porting and user support activities (update) – M 21 23 23

Results of year 1 – Task 4. 6 • Some of the latest best practices on the field of application development has been collected and presented by the doc. desktopgrid. hu documentation wiki site • Best practices in application validation has been collected and will be published in a document titled “IDGF Certification procedure” (in consultation phase currently) 24 24

Any questions? 25 25