Escience grid facility for Europe and Latin America

E-science grid facility for Europe and Latin America Developing e-Infrastructure services for e-Science applications: the EELA-2 experience Diego Scardaci INFN Catania (Italy) Roberto Barbera Francisco Brasileiro INFN Catania (Italy) Universidade Federal de Campina Grande (Brazil) 5 th EGEE USER FORUM Uppsala (Sweden), 12 -15. 04. 2010 www. eu-eela. eu

Outline • The EELA-2 Project: – Applications deployed in the EELA-2 infrastructure; – Distribution of EELA-2 Applications per Scientific Domain, Continent and Country. • e-Infrastructure services for e-Science applications the EELA-2 experience: – Increasing the reach of e-Infrastructure; – Increasing the usability of e-Infrastructure; • Software Repository; • Reference. www. eu-eela. eu Uppsala (Sweden), 5 th EGEE USER FORUM, 12 -15. 04. 2010 2

The EELA-2 Project EELA-2 (I 3 project under FP 7) • Provide an empowered Grid Facility with versatile services fulfilling application requirements • Ensure production quality services • Ensure the long term sustainability of the e-Infrastructure beyond the term of the project • Still Expand the current EELA e-Infrastructure • Look for new communities outside academia (Industry and Business) www. eu-eela. eu Uppsala (Sweden), 5 th EGEE USER FORUM, 12 -15. 04. 2010 3

The EELA-2 Tree Applications in production NA 2 Targets NA 3 (Application Support) JRA 1 (Services) SA 1 (Grid Infrastructure) NA 1 www. eu-eela. eu SA 2 (Network) Uppsala (Sweden), 5 th EGEE User Forum, 12 -15. 04. 2010 4

Applications deployed on EELA-2 infrastructure Application AERMOD Aero. VANT Aiuri Bi. G (Blast) Bio. MD bio. NMF BRAMS C/CATT-BRAMS CAM Cardio. Grid Portal CATIVIC Cinefilia CIS - Classification of Satellite Images with neural networks CROSS-Fire Dicom. Grid Dist-SOM-PORTRAIT Dist. Blast DKEs. G DRI/Mammogrid e. IMRT FAFNER 2 f. MRI G-HMMER G-Inter. Pro. Scan GAMOS g. CSMT www. eu-eela. eu Scientific Domain Environmental Sciences Engineering AI / Optimization Genomics Life Sciences Earth Sciences Weather and Climate Life Sciences Chemistry AI / Optimization Earth Sciences Civil Protection Life Sciences Genomics Physics Life Sciences Genomics Life Sciences Earth Sciences Country Cuba Argentina Brazil Spain Brazil Chile / Brazil Spain Argentina Venezuela Italy / Brazil Ecuador Portugal Brazil Spain Portugal Colombia Spain France Uppsala (Sweden), 5 th EGEE USER FORUM, 12 -15. 04. 2010 5

Applications deployed on EELA-2 infrastructure Application Genecodis. Grid Gr. EMBOSS Grid Bio Portal GRIP - Grid Image Processing for Biomedical Diagnosis GROMACS g. RREEMM g. SATyrus Heart Simulator He. Mo. Lab Industry@Grid Integra-EPI Inv. Cell LEMDist. FE MAVs-Study META-Dock Phylogenetics Phylo. Grid PILP Portal de Porticos Protozoa. DB PSAUPMP SATCA Seismic Sensor SEMUM 3 D WAM WRF www. eu-eela. eu Scientific Domain Genomics Life Sciences Chemistry Engineering AI / Optimization Life Sciences Engineering Life Sciences Remote instrumentation Engineering Genomics Life Sciences AI / Optimization Engineering Life Sciences Engineering Weather and Climate Earth Sciences Weather and Climate Country Spain Mexico Spain Chile Brazil Cuba Brazil Brazil Mexico Argentina Mexico Spain Portugal Venezuela Brazil Mexico France Ireland Spain Uppsala (Sweden), 5 th EGEE USER FORUM, 12 -15. 04. 2010 6

Distribution of EELA-2 Applications per Scientific Domain, Continent and Country www. eu-eela. eu Uppsala (Sweden), 5 th EGEE USER FORUM, 12 -15. 04. 2010 7

e-Infrastructure services for e-Science applications: the EELA-2 experience • Increase the REACH of the infrastructure. • Increase the USE of the infrastructure. www. eu-eela. eu Uppsala (Sweden), 5 th EGEE User Forum, 12 -15. 04. 2010 8

Increasing the reach of e-Infrastructure • Facilitate the installation and the management of the grid infrastructure: – more sites belonging to the grid infrastructure, with more resources being shared; – more users being served; – more diverse range of applications being supported. • EELA-2 Services: – Adoption of Our. Grid allowed non-dedicated resources to be added to the infrastructure; – Grid 2 Win: porting of the g. Lite Middleware to the Microsoft Windows platform to allow Windows Applications to use the infrastructure. www. eu-eela. eu Uppsala (Sweden), 5 th EGEE USER FORUM, 12 -15. 04. 2010 9

Our. Grid www. eu-eela. eu Uppsala (Sweden), 5 th EGEE USER FORUM, 12 -15. 04. 2010 10

Gridify a Windows Application – The Mavs. Study Use Case (1/2) Definition of micro-air-vehicle (performance requirements): • Maximum dimension of 15 cm; • Flight at low velocity; • Endurance: 20 to 30 minutes; • Lightweight (< 100 g); • High maneuverability. APPLICATIONS: • Atmospheric studies. • Fire detection. • Inspections of collapsed buildings. • Hazardous Spill Monitoring. • Inspections in places too dangerous for humans. • Planetary exploration. www. eu-eela. eu Uppsala (Sweden), 5 th EGEE USER FORUM, 12 -15. 04. 2010 11

Gridify a Windows Application – The Mavs. Study Use Case (2/2) MAVs-Study on the GRID JDL Start Script Type = "Job"; Job. Type = "Normal"; Executable = "uvlm. RF"; Std. Output = "uvlm. RF. out"; Std. Error = "uvlm. RF. err"; Input. Sandbox = {"uvlm. exe", "uvlm. RF", "CONFIG. DAT", "LS. DAT", " Rotation. Angle. DAT", "Stroke. Devi ation. DAT", "Stroke. Position. DAT"}; Output. Sandbox = {"uvlm. RF. err", "uvlm. RF. out"}; Retry. Count = 0; Shallow. Retry. Count=0; # Environment variables export PROD=prod. vo. eu-eela. eu export LFC_HOST=lfc. eela. ufrj. br export LCG_GFAL_INFOSYS=bdii. eela. ufrj. br: 2170 export PATH=$PATH: . # Execution date chmod u+x uvlm # Storage date FILE=results 03 -00. tar. gz /bin/tar -czf $FILE *. DAT *. Dat *. TEC std. out std. err lcg-cr --vo $PROD -l lfn: /grid/prod. vo. eueela. eu/MAVs-Study/test 03/$FILE -d lnx 097. eela. if. ufrj. br file: $PWD/$FILE # End date www. eu-eela. eu Uppsala (Sweden), 5 th EGEE USER FORUM, 12 -15. 04. 2010 12

Increasing the usability of e-Infrastructure • Addition of services that can ease the tasks of: – developing and deploying new applications; – installing, managing and deploying the core infrastructure. • EELA-2 Services: – GSAF: a Java Object Oriented Framework designed to access and manage Data Grid via APIs; – OPe. NDAP Meta-Finder: a tool to search geographical information data sets available at the Web through OPe. NDAP servers; – Secure Storage: a service providing users with a set of tools to store in a secure way and in an encrypted format confidential data on the grid storage elements. ; – Watchdog: a tool allowing users to watch the status of a running job tracing the evolution of produced files; – lcg-rec-*: tools allowing users to perform recursive grid file operations such as copies and deletion; – Dirac: an alternative to overcome an infrastructure limitation of not having many CEs able to support MPICH 2 jobs; www. eu-eela. eu Uppsala (Sweden), 5 th EGEE USER FORUM, 12 -15. 04. 2010 13

Applications using JRA 1 applicationoriented services Service Application using it Use description Digital Archives (GSAF) g. RREEMM Secure Storage Cardio. Grid Portal, He. Mo. Lab, Seismic Sensor, Aero. VANT BRAMS and other Seg. Hidro applications Tagging Provide g. RREEMM with a Java interface towards the g. Lite Data Management System. Applications use this service to manage their confidential data in a secure way inside the grid infrastructure. Help in searching shared data among researchers working on water resources management Workflow BRAMS and other Seg. Hidro applications Several Seg. Hidro applications use it implement their workflow, starting from the water precipitation prediction provided by BRAMS Watchdog CROSS-Fire, Interpro. Scan/HMMER, He. Mo. Lab, Aero. VANT, Bio. MD, Cinefilia Several applications use it to monitor their long running jobs. Lcg-rec CROSS-Fire, METADock CROSS-Fire and META-Dock use it to interact in a easier way with the LCG File Catalog. DIRAC Bio. MD, PSAUPMP Easy their execution in sites with different MPI ‘flavours’. www. eu-eela. eu Uppsala (Sweden), 5 th EGEE USER FORUM, 12 -15. 04. 2010 14

EELA-2 Software Repository www. eu-eela. eu Uppsala (Sweden), 5 th EGEE USER FORUM, 12 -15. 04. 2010 15

Pointers for more Information – EELA-2 web site § https: //www. eu-eela. eu/ – JRA 1 Wiki Site § Contains descriptions and links for each JRA 1 service § https: //grid. ct. infn. it/twiki/bin/view/EELA 2/JRA 1 Servi ces – EELA-Forge Site § All released software § https: //forge. eu-eela. eu/ – Contact us at § Francisco Brasileiro (fubica@dsc. ufcg. edu. br) § Diego Scardaci (diego. scardaci@ct. infn. it) www. eu-eela. eu Uppsala (Sweden), 5 th EGEE USER FORUM, 12 -15. 04. 2010 16

Questions … www. eu-eela. eu Uppsala (Sweden), 5 th EGEE USER FORUM, 12 -15. 04. 2010 17