Grappa Grid access portal for physics applications Shava

Grappa: Grid access portal for physics applications Shava Smallen Extreme! Computing Laboratory Department of Physics Indiana University

Outline • Gri. Phy. N • Grappa – XCAT Science Portal project – Demo • Future Directions – Virtual Data Browser

Gri. Phy. N: Grid Physics Network • Many many participating people and institutions • Targets data-intensive applications – ATLAS, CMS, LIGO, and SDSS – 90% of data is derived • Provide a set of tools for collaborative data analysis – Virtual data - transparency with respect to location and materialization

Simplified View Applications Athena Information Services Planner Gri. Phy. N/Grid Services Executor Resources App 2 App 1 Replica Management Monitoring Reliable Transfer Service storage Catalog Services storage Policy/Security

Virtual Data Catalogs Transparency with respect to location Metadata Catalog Transparency with respect to materialization Derived Metadata Catalog Higgs particle, proton center of mass, etc Replica Catalog Data X orig Indiana Data X copy 1 Boston Data X copy 2 Oklahoma Derived Data Catalog Random seed, number of events Transformation Catalog Athena version, pythia, atlfast, application model, etc. Virtual Data Language

Motivation for Grappa • Lots of Gri. Phy. N/Grid services • Requires a good deal of expertise – more than what many users want to know • Common approach is a Grid portal • Provide a portal interface by which physicists can launch and manage applications and data over the Grid

XCAT Science Portal • Framework for building personal science portals • A science portal is an applicationspecific Grid portal • Active notebook – HTML pages to describe the features of the notebook and how to use it – HTML forms which can be used to launch parameterizable scripts (transformation) – Parameters stored in a sub-notebook (derivation)

Scripts • Very flexible • Jython - access to Java classes – Globus Java Co. G kit – XCAT – XMESSAGES • Not every user has to write scripts • Notebooks can be shared among users – Import/export capability

XCAT Science Portal Architecture User’s Web Browser Portal Web Server (tomcat server + java servlets) GSI Authentication Jython Intepreter Grid Notebook Database

Athena Notebook Demo Graphical way to submit job. Options file 1. Log in using GSI credential 2. Select athena notebook from desktop 3. Content pages describing athena and how to use the notebook 4. Resource management via “Add Resource” and “Check Resources” 5. Submit job options file via “Submit Athena Job”

Boston University IUPUI University of Oklahoma a) Stage directory b) Results directory BNL Indiana University 6. Monitor simple status of job (i. e. , pending, active, done)

Demo • Available via Pacman under grappa-demo > pacman –fetch –install grappa-demo • Further information and installation instructions available at: http: //iuatlas. physics. indiana. edu/grappa

Where next? • Interface to Gri. Phy. N and other Grid services (i. e. , Virtual Data Language, Magda, EDG, etc. ) • Only focused on execution management – (Still can make improvements here) – Centered around notebook abstraction • Is this an appropriate abstraction for data management too?

Grid

Virtual Data Browser • A browser interface which can be used to search and create virtual data • Functionality analogous to that of a web browser – Create virtual data (e. g. , Netscape composer) – Navigate virtual data (e. g. , point n’ click links) – Search virtual data (via search engines – Yong Zhao – U. of Chicago) – Bookmarks to virtual data (or transformations) – User profile – resource mgmt, credential mgmt, home

Next step • Write up design specification for VDB • Probably develop code from scratch – Jetspeed looks promising – Keep script functionality – Replace notebook database with virtual data catalogs • Interface to Virtual Data Language

More Information • Acknowledgements: – IU Physics • Rob Gardner, Lisa Ensman, Fred Leurhing – Extreme Computing Lab – US ATLAS testbed sites • Grappa web page: http: //iuatlas. physics. indiana. edu/grappa • Email: ssmallen@cs. indiana. edu