Open Science Grid Report from the OSG User

  • Slides: 11
Download presentation
Open Science Grid Report from the OSG User Group Chris Green, OSG User Support

Open Science Grid Report from the OSG User Group Chris Green, OSG User Support

Open Science Grid Trends in OSG use: WMS • "Pilot" WMS use on the

Open Science Grid Trends in OSG use: WMS • "Pilot" WMS use on the rise: – Allows VO priority and other policy enforcement by group / role without site intervention. – Can be plugged into Re. SS or other (maybe home-grown) site information / testing systems to send jobs automatically to multiple sites. 1/4/2022 2007/12/12 Site Administrators' Meeting: Chris Green 2

Open Science Grid Trends in OSG use: WMS – Can be used in conjunction

Open Science Grid Trends in OSG use: WMS – Can be used in conjunction with portals to limit applications submitted to OSG and simplify grid use for users. – Site concerns regarding personal accountability for jobs can be addressed by installing g. Lexec (now available as part of the OSG/VDT stack). 1/4/2022 2007/12/12 Site Administrators' Meeting: Chris Green 3

Open Science Grid Trends in OSG use: MPI • MPI use increasing: – Popular

Open Science Grid Trends in OSG use: MPI • MPI use increasing: – Popular among non-physics applications (molecular dynamics, climate science). – Can be used to obtain results that would not otherwise be possible on sites utilizing preemption or execution time limits. – No. of prospective users requiring low latency small but increasing; Gb ethernet MPI still a big help in many cases. 1/4/2022 2007/12/12 Site Administrators' Meeting: Chris Green 4

Open Science Grid Trends in OSG use: MPI & SRM – Efforts within OSG

Open Science Grid Trends in OSG use: MPI & SRM – Efforts within OSG to support configuration and advertisement of MPI resources progressing. • VOs looking with increasing interest at using SRM to solve data movement and storage issues. 1/4/2022 2007/12/12 Site Administrators' Meeting: Chris Green 5

Open Science Grid Trends in OSG use: Re. SS & SQUID • Increased reliance

Open Science Grid Trends in OSG use: Re. SS & SQUID • Increased reliance on Re. SS (and hence GIP) for site information. • Increased desire for SQUID: – Comes with OSG 0. 8. Please consider installing and providing a significant cache (>few Gi. B). – Eases strain on IO bandwidth from jobs requiring large (>few Mi. B) amounts of input data (eg shower tables, amino acid DBs). 1/4/2022 2007/12/12 Site Administrators' Meeting: Chris Green 6

Open Science Grid User issues: VO support • Support for non-sponsoring VOs – Often

Open Science Grid User issues: VO support • Support for non-sponsoring VOs – Often just a matter of creating the correct user accounts: please check $VDT_LOCATION/monitoring/osgundefined-accounts. txt today! – Please update your VO package regularly! Watch messages from GOC: OSG-operations list or RSS feed. – VOs have a test kit they can use to test your site with their VO credentials and produce a nice summary. 1/4/2022 2007/12/12 Site Administrators' Meeting: Chris Green 7

Open Science Grid User issues: VO support – Please consider supporting (at least): •

Open Science Grid User issues: VO support – Please consider supporting (at least): • mis: VORS test account; • gridex: GOC batch test account; • osg: "starter" and "umbrella" VO, encompassing several small experiments and independent researchers; • Engage: Official OSG engagement group chartered to attract and support non-physics activities on OSG; • Fermilab: encompasses several small experiments based at or associated with Fermilab; • As many other non-sponsoring VOs as you feel you can. 1/4/2022 2007/12/12 Site Administrators' Meeting: Chris Green 8

Open Science Grid User issues: information discovery • Please: – Consider configuring CEMon /

Open Science Grid User issues: information discovery • Please: – Consider configuring CEMon / GIP if you haven't already (installed by default in OSG 0. 6 / 0. 8 but requires configuration and HTTP certs); be as verbose and as accurate as you can. Check with $VDT_LOCATION/glite/etc/glite-ce-ceplugin/glite-ce-info. – Check your VORS entry to ensure you support the VOs you intend to support and that your site is working from the point of view of GOC's regular tests. – Work with GOC to resolve any issues of missing or incorrect information or site functionality problems. 1/4/2022 2007/12/12 Site Administrators' Meeting: Chris Green 9

Open Science Grid User issues: WN client apps • The, "big three: " –

Open Science Grid User issues: WN client apps • The, "big three: " – wget – globus-url-copy – srmcp (at least v 1, preferably v 2 also) • Please ensure these utilities are: – Present and in $PATH (should all be installed by default). – Operational on your site in (at least) passive mode if your site supports outgoing network access (add site rc files for proxies, etc); DNS is often a stumbling block to a working srmcp. 1/4/2022 2007/12/12 Site Administrators' Meeting: Chris Green 10

Open Science Grid Conclusions and progress • User experience improving due to continuing efforts

Open Science Grid Conclusions and progress • User experience improving due to continuing efforts from GOC, Troubleshooting VDT, Docs Team, Integration Team, Facilities Group and individual site admins: thank you! • Couple of niggling concerns that can be worked out with some coordinated effort and vigilance. 1/4/2022 2007/12/12 Site Administrators' Meeting: Chris Green 11