Universit di Catania and INFN Catania Italy ALICE

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project The GENIUS grid portal Roberto Barbera(*) (*)work in collaboration with A. Falzone and A. Rodolico CHEP 2003, 10. 02. 2000 24 -28. 03. 2003 CHEP 2000, 1 Barbera Roberto

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project Outline Introduction Motivations Current status (through the real use made by the Experiments) Summary and conclusion CHEP 2003, 24 -28. 03. 2003 2 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project CHEP 2003, 24 -28. 03. 2003 3 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project The Grid metaphor Mobile Access G R I D Workstation M I D D L E W A R E Supercomputer, PC-Cluster Data-storage, Sensors, Experiments Visualising Internet, networks CHEP 2003, 24 -28. 03. 2003 4 Barbera Roberto

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project Data. Grid job submission work-flow nit UI JDL Replica Catalogue Input “sandbox” Data. Sets info pr ox y-i Output “sandbox” SE & s tu ta ” Jo Br er ok fo In Job Status Job Submission Service Compute Element Publish x bo nd ”+ b. S sa “ ut ox b nd Expanded JDL idgr nfo p ut sa t“ pu In Job Query Job Submit Event Globus RSL Job Status Logging & Book-keeping CE i O Resource Broker Author. &Authen. Information Service Storage Element Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project EDG m/w has been released but… EDG software (Globus, UI, JDL, WP 2, WP 3, etc. ) contains tens of commands/switches which also have their own logical sequences. Browsing Grid VO “directories” (users, RC’s, DB’s, etc. ) requires LDAP “speaking” and tomorrow could require SQL “speaking”. “User gridification” is a tough task for a “rookie” this does not fit with the claim that “grids” are for everybody and that grid computing will be as easy as surfing the Internet ? Furthermore, all this holds for Data. Grid. What will happen when other grids’ software (especially UI’s) will come up (PPDG, i. VDGL, etc. ) ? Will users have to learn tens of “grid dialects” ? Today “grid computing” is a rather complicated experience for unexperienced user only possible at selected machines (UI’s) this does not fit with the claim that one could do “grid computing” even from a PDA ? Is there any way to set-up a “user-friendly” grid ? CHEP 2003, 24 -28. 03. 2003 6 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project A web portal: why and how ? It can be accessed from everywhere and by “everything” (desktop, laptop, PDA, WAP phone). It can keep the same user interface to several back-ends (grid “dialects” command-line UI’s). It must be redundantly “secure” at all levels: 1) secure for web transactions, 2) secure for user credentials, 3) secure for user authentication, 4) secure at VO level. All available grid services must be incorporated in a logic way, just “one mouse click away”. Its layout must be easily understandable and user friendly. CHEP 2003, 24 -28. 03. 2003 7 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project A little bit of history 1998 -1999 l graphic interface to LSF (multi) clusters for ALICE jobs 2000 -2001 l simple but effective web portal to submit ALICE jobs to the grid using Engin. Frame and GLOBUS 2002 -now l official grant of the INFN Grid Project to collaborate with NICE srl to integrate in a web portal all services offered by the Data. Grid middleware; adoption/contributions by other experiments CHEP 2003, 24 -28. 03. 2003 8 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project GENIUS® (Grid Enabled web e. Nvironment for site Independent User job Submission) [https: //genius. ct. infn. it] INFN/NICE collaboration GENIUS web portal Applications’ specific layer Data. GRID architecture GLOBUS toolkit ALICE ATLAS CMS LHCb Other apps High level GRID middleware Basic Services OS & Net services CHEP 2003, 24 -28. 03. 2003 9 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project GENIUS: how it works https+java/xml+rfb GENIUS WEB Browser Engin. Frame 3 -tier model Loc al WS Apache EDG UI EDG+GSI the Grid 10 Barbera Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project Engin. Frame in brief Standards-based GRID portal l Java, Tomcat, Apache, XML/XSL → Grid. ML Solves back-end integration problems l Visual rendering for most Grid objects l l Multiple Grid technologies support l l jobs, job arrays, hosts, services, databases, etc. EDG, GLUE, Globus, Condor (soon) Authentication delegation (GSI, My. Proxy, NIS, NT, Kerberos V, . . . ) Data management: UL/DL + remote (multi-) file browsing Integration with interactive apps End-user oriented focus! l application integration 11 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project GENIUS show: the main page CHEP 2003, 24 -28. 03. 2003 12 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project GENIUS show: OS authentication CHEP 2003, 24 -28. 03. 2003 13 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project GENIUS show: file services CHEP 2003, 24 -28. 03. 2003 14 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project GENIUS show: grid authentication ! n io t a c i t n e h t u a y x ro P My CHEP 2003, 24 -28. 03. 2003 15 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project Grid authentication “à la My. Proxy” EDG UI GENIU S Server (EDG UI) WEB Browser Loc al WS My. Prox y Server grid-proxy-init myproxy-init t pu t u o s d i gr y an ce i v er e el d t- e g xy n io t a g o r p y m exe cut i on the Grid 16 Barbera Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project ALICE: graphic job description CHEP 2003, 24 -28. 03. 2003 17 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project ALICE: job submission CHEP 2003, 24 -28. 03. 2003 18 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project ALICE: job queue CHEP 2003, 24 -28. 03. 2003 19 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project ALICE: job output CHEP 2003, 24 -28. 03. 2003 20 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project ALICE: personal spooler CHEP 2003, 24 -28. 03. 2003 21 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project ALICE: grid file browsing CHEP 2003, 24 -28. 03. 2003 22 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project ALICE: grid file replication CHEP 2003, 24 -28. 03. 2003 23 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project ALICE: grid file inspection CHEP 2003, 24 -28. 03. 2003 24 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project ALICE: grid file downloading CHEP 2003, 24 -28. 03. 2003 25 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project ALICE: interactive analysis CHEP 2003, 24 -28. 03. 2003 26 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project (courtesy of L. Vaccarossa) ATLAS: “GLUE” job submission US EU CHEP 2003, 24 -28. 03. 2003 27 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project (courtesy of L. Vaccarossa) ATLAS: interactive analysis CHEP 2003, 24 -28. 03. 2003 28 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project (courtesy of M. Verlato) CMS grid integration schema CHEP 2003, 24 -28. 03. 2003 29 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project (courtesy of M. Verlato) CMS: GENIUS/Impala integration CHEP 2003, 24 -28. 03. 2003 30 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project (courtesy of M. Verlato) CMS: GENIUS/BOSS integration CHEP 2003, 24 -28. 03. 2003 31 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project GENIUS show: Earth Ob. app. CHEP 2003, 24 -28. 03. 2003 32 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project GENIUS show: Biomed. app. CHEP 2003, 24 -28. 03. 2003 33 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project Present status and perspectives Current implementation of GENIUS includes more than 100 services. Among them: l secure web transactions, user authentication and authorization; l grid authentication “à la My. Proxy” ! l remote interaction with the user’s and “grid” file system; l interfaces for job submission/control, data management, VO servers, and monitoring systems; l several Resource Brokers and VO’s available; l persistent (user level) book-keeping and spooler system; l secure interactive analysis with Tight. VNC l full support for “parallel” multi-jobs (“sequential” ones soon) l web guided job description (from DATAMAT) l CVS available ! Next future: l Participation to the GGF Grid Portal Manifesto and GCE Working Group. 34 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project FAQ’s…and answers (1) Q: I want to use GENIUS. Do I have to pay for it ? A: No. GENIUS is “open source” and the underlying portal framework Engin. Frame is free for the education and research communities. Q: I want to use GENIUS. Do I need any software running on my laptop ? A: No client software needs to be installed apart from the web browser. GENIUS can really be accessed from everywhere. Q: Do I have to be afraid about cached password sent over the web ? A: Access passwords are securely “streamed” only when needed and then destroyed. Only temporary sessions are possible. Q: Can new authentication methods implemented into GENIUS ? A: Of course. Kerberos V is a good example. Engin. Frame is already compliant with Kerberos authentication. 35 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project FAQ’s…and answers (2) Q: I want to add a new VO to GENIUS and customize new services for that VO. How can I do that ? A: A new VO can be added to GENIUS in just minutes. New VO specific services can be added just modifying only two files: an XML file and a shell script. Q: Can I use GENIUS to interface other m/w’s ? A: Yes. Although GENIUS is currently based on the Data. Grid middleware(w/ and w/o GLUE extensions), it can be very easily interfaced to others. A direct interface to the Globus Toolkit already exists and another one to Condor is in progress. Q: How can I start downloading/using GENIUS ? A: Go to the reference site https: //genius. ct. infn. it, click on “GENIUS CVS available” and follow the instructions. 36 Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project Summary and conclusion Computational grids could represent the “natural” environment for next generation high energy physics experiments, computational bio-medicine, Earth observation and many other inter-disciplinary applications. “Grid” could be the Internet “new age” where users can seamlessly and ubiquitously access not only information but also huge computing resources and mass storage systems distributed worldwide with their own applications. However, in order to turn dreams into reality, grid access must be ubiquitous, easy and intuitive especially for the vast majority of non-expert users and these are just the goals of GENIUS is also a good example of implementation of real use cases started in one experiment and followed by others. CHEP 2003, 24 -28. 03. 2003 37 Roberto Barbera