Universit di Catania and INFN Catania Italy ILDG

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project Grid portal based data management for Lattice QCD data Giuseppe Andronico work in collaboration with A. Falzone and R. Barbera ACAT 03, CHEP 2000, Tsukuba, 10. 02. 200002. 12. 2003 1 Giuseppe Andronico

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project Outline Introduction Grid and GENIUS ILDG Metadata Workgroup GENIUS implementation Future developments ACAT 03, Tsukuba, 02. 12. 2003 2 Giuseppe Andronico Roberto Barbera

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project The Grid metaphor Mobile Access G R I D Workstation M I D D L E W A R E Supercomputer, PC-Cluster Data-storage, Sensors, Experiments Visualising Internet, networks ACAT 03, Tsukuba, 02. 12. 2003 3 Giuseppe Andronico

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project Data. Grid job work-flow nit UI JDL Input “sandbox” Data. Sets info y-i pr ox SE & ” x” er ok Br Jo + fo In Job Status Job Submission Service Compute Element Publish ox db s an o db tu “s an ta t pu “s b. S nfo ut t pu Expanded JDL idgr CE i O In Job Query Job Submit Event Globus RSL Job Status Logging & Book-keeping Information Service Output “sandbox” Resource Broker Author. &Authen. Replica Catalogue Storage Element Giuseppe Andronico

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project A web portal: why and how ? It can be accessed from everywhere and by “everything” (desktop, laptop, PDA, WAP phone). It can keep the same user interface to several back-ends (grid “dialects” command-line UI’s). It must be redundantly “secure” at all levels: 1) secure for web transactions, 2) secure for user credentials, 3) secure for user authentication, 4) secure at VO level. All available grid services must be incorporated in a logic way, just “one mouse click away”. Its layout must be easily understandable and user friendly. ACAT 03, Tsukuba, 02. 12. 2003 5 Giuseppe Andronico Roberto Barbera

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project GENIUS® (Grid Enabled web e. Nvironment for site Independent User job Submission) [https: //genius. ct. infn. it] INFN/NICE collaboration GENIUS web portal Applications’ specific layer Data. GRID architecture GLOBUS toolkit ALICE ATLAS CMS LHCb Other apps High level GRID middleware Basic Services OS & Net services ACAT 03, Tsukuba, 02. 12. 2003 6 Giuseppe Andronico

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project GENIUS: how it works https+java/xml+rfb GENIUS WEB Browser Engin. Frame 3 -tier model Loc al WS Apache EDG UI EDG+GSI the Grid 7 Giuseppe Andronico Roberto Barbera

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project Grid authentication with My. Proxy ED G UI WEB Browser Loc al WS My. Pro xy Server grid-proxy-init myproxy-init GENIU S Server (EDG UI) t u p ce i out v er s rid g any e el d t e g xy n io t a g o r p my exe cut io n the Grid 8 Giuseppe Andronico

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project ILDG International Lattice Data Group Upon initiative of Prof. Richard Kenway ILDG people Tomoteru Yoshie (Japan) Convener Chris Maynard (UK) Paul Coddington (Australia) Jim Simone (USA - Sci. DAC) Robert Edwards (USA - Sci. DAC) Giuseppe Andronico (Italy) Dirk Pleiter (Germany) Balint Joo (UK) http: //www. lqcd. org/ildg/tiki-index. php ACAT 03, Tsukuba, 02. 12. 2003 Giuseppe Andronico

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project ILDG Configurations as LQCD resources Different algorithms and implementations Different data file format Standardize metadata to describe configurations: Management Implementation Configuration ACAT 03, Tsukuba, 02. 12. 2003 Giuseppe Andronico

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project ILDG XML for metadata Last draft at Lattice 2003, Tsukuba (hep-lat/0309029) Evolving with LQCD people contribution ACAT 03, Tsukuba, 02. 12. 2003 Giuseppe Andronico

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project XML to SQL ACAT 03, Tsukuba, 02. 12. 2003 Giuseppe Andronico

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project Software PERL scripts DOM parser Storing procedure Several DB querying procedures All this is handles from GENIUS ACAT 03, Tsukuba, 02. 12. 2003 Giuseppe Andronico

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project GENIUS ACAT 03, Tsukuba, 02. 12. 2003 Giuseppe Andronico

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project Selecting VO ACAT 03, Tsukuba, 02. 12. 2003 Giuseppe Andronico

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project The VO page ACAT 03, Tsukuba, 02. 12. 2003 Giuseppe Andronico

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project Storing a configuration ACAT 03, Tsukuba, 02. 12. 2003 Giuseppe Andronico

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project Storing a configuration ACAT 03, Tsukuba, 02. 12. 2003 Giuseppe Andronico

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project A trial search ACAT 03, Tsukuba, 02. 12. 2003 Giuseppe Andronico

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project The result ACAT 03, Tsukuba, 02. 12. 2003 Giuseppe Andronico

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project Show metadata info ACAT 03, Tsukuba, 02. 12. 2003 Giuseppe Andronico

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project Summary and conclusions (1/2) ILDG is defining a metadata XML structure to help LQCD people to share their work The Grid offers a proper tool to physically sharing the files world wide in a secure way We implemented a trial service to: l l l Store configurations Search between configuration by querying XML informations Show the search result and, potentially, download the data GENIUS offers a quick and simple way to build a WEB interface to these services to simplify their use GENIUS is the targeted Grid-portal for Generic Applications in EGEE-NA 4 (kick-off meeting in Paris on Dec 18) 22 Giuseppe Andronico Roberto Barbera

Università di Catania and INFN Catania - Italy ILDG and Data. Grid Project Summary and conclusions (2/2) Future developments XML to SQL mapping XML database test Advanced search engine ACAT 03, Tsukuba, 02. 12. 2003 Giuseppe Andronico