NUG 2004 Grid File Yanker Demo Shreyas Cholia

NUG 2004 Grid File Yanker Demo Shreyas Cholia Mass Storage Group, NERSC 06/24/2004

Grid File Yanker • Allows users to browse and transfer files, across filesystems served by Grid. FTP servers, directly from their web browser. • Includes a reliable file transfer mechanism, that attempts to restart failed transfer jobs. • Provides a convenient interface for submitting and monitoring background file transfer jobs.

GFY Components • GFY Server: Java Servlet that runs as a SOAP Service. Users can invoke this via – The GFY Client Applet – Command line tools – Their own SOAP clients that can call the GFY Server API

GFY Components (cont. ) • GFY Client: This is a Java applet that can run on any web browser that supports Java 1. 4. 2 (or higher). – The applet provides a convenient GUI filesystem interface to access Grid. FTP servers and transfer files between them. – Users do not have to carry Grid credentials on their client machines. The Applet supplies a username / password combination to the GFY Server which uses this to grab Grid credentials from a My. Proxy server.

GFY Screen Shot

How it Works … • GFY Client provides username/password combination to GFY Server • GFY Server uses combination to acquire a Grid Proxy Credential from a My. Proxy Server, and returns a session identifier to the Client. • GFY Client makes SOAP request to GFY Server to perform Filesystem operation / File Transfer using the session identifier.

How it Works … (cont. ) • GFY Server talks to desired Grid. FTP server(s) with the acquired credential and either – performs the filesystem operation, or – spawns off a background transfer thread to manage the reliable third party transfer between two Grid. FTP servers. • Client can query the server for the state of current transfer jobs

How it works …

Upcoming Features • Recursive directory copy • Multiple File Transfer / Bulk File operations • Integration with NERSC Portal, including common login and credential sharing • Command line tools to submit transfer jobs to GFY service

Acknowledgements • The GFY was made possible, thanks to the contributions of: – Matt Andrews (NERSC) – Nancy Johnston (NERSC) – Nancy Meyer (NERSC) – Steve Chan (NERSC) – Adam Megacz (XWT Foundation)

Additional Information • FSG Homepage: http: //www. nersc. gov/nusers/resources/HPSS • GFY Information: • Contact: – Shreyas Cholia (Mass Storage Group) • Email: scholia@lbl. gov • Phone: (510) 486 -6552