GAVO after one year H M Adorf the

  • Slides: 34
Download presentation
GAVO – after one year H. -M. Adorf & the GAVO team

GAVO – after one year H. -M. Adorf & the GAVO team

GAVO’s Pillars Publication and federation of datasets n including theoretical ones Spatial matching &

GAVO’s Pillars Publication and federation of datasets n including theoretical ones Spatial matching & classification & visualization (NGSE) Grid computing ADA III - 29 -04 -2004

The GAVO Team PI: Wolfgang Voges, MPE, Garching Co. I: Matthias Steinmetz, AIP, Potsdam

The GAVO Team PI: Wolfgang Voges, MPE, Garching Co. I: Matthias Steinmetz, AIP, Potsdam Hans-Martin Adorf, MPE Harry Enke, AIP Gerard Lemson, MPE ADA III - 29 -04 -2004

Collaborations MPE, Garching (Peter Schuecker) AIP Potsdam Canadian Virtual Obs. (CVO), Victoria Universitaetssternw. Muenchen

Collaborations MPE, Garching (Peter Schuecker) AIP Potsdam Canadian Virtual Obs. (CVO), Victoria Universitaetssternw. Muenchen (USM) MPA, Garching (Planck, …) ADA III - 29 -04 -2004

GAVO Work Areas Publication of ROSAT datasets n n REST-based SCS service (HTTP GET

GAVO Work Areas Publication of ROSAT datasets n n REST-based SCS service (HTTP GET in; XML, CSV, HTML out) SOAP-based SCS service MCMCS Download Manager Fuzzy spatial matcher Grid-based detection of galaxy clusters ROSAT matcher/classifier service ADA III - 29 -04 -2004

ROSAT All-Sky Survey (RASS) BSC, FSC & Photons VO-compatibility: n n Input: Simple cone

ROSAT All-Sky Survey (RASS) BSC, FSC & Photons VO-compatibility: n n Input: Simple cone search Output: VOTable, … New features n n n Exposure times Galactic & Cartesian coordinates Healpix indices ADA III - 29 -04 -2004

SCS ADA III - 29 -04 -2004

SCS ADA III - 29 -04 -2004

Result ADA III - 29 -04 -2004

Result ADA III - 29 -04 -2004

VOTable ADA III - 29 -04 -2004

VOTable ADA III - 29 -04 -2004

MCMCS Download Manager Tool … n … accesses registry at JHU User … n

MCMCS Download Manager Tool … n … accesses registry at JHU User … n n … selects up to 70 distributed catalogues … specifies one or more sky-locations Tool … n n … queries remote catalogues … retrieves datasets (VOTables) for further processing ADA III - 29 -04 -2004

MCMCS Download Manager ADA III - 29 -04 -2004

MCMCS Download Manager ADA III - 29 -04 -2004

MCMCS Download Manager ADA III - 29 -04 -2004

MCMCS Download Manager ADA III - 29 -04 -2004

Workflow ADA III - 29 -04 -2004

Workflow ADA III - 29 -04 -2004

Fuzzy spatial matcher Essential for data mining Prototype features w Performs “fuzzy” match between

Fuzzy spatial matcher Essential for data mining Prototype features w Performs “fuzzy” match between pairs of source lists from different catalogues w Computes probability of real match based on astrometric uncertainties Moving matcher into production use w Currently exported to Canadian Virtual Observatory w Feeding matches to Class. X classifier Long-term goal: assemble an SED ADA III - 29 -04 -2004

Fuzzy spatial matcher (ctd) ADA III - 29 -04 -2004

Fuzzy spatial matcher (ctd) ADA III - 29 -04 -2004

Grid computing What is Grid-computing? n n Globus Toolkit, SGE, EJBs Web. Services Detection

Grid computing What is Grid-computing? n n Globus Toolkit, SGE, EJBs Web. Services Detection of galaxy clusters n using RASS photons, SDSS RASS source classification n using RASS B/FSC, SUMSS, NVSS, USNO ADA III - 29 -04 -2004

Workflow ADA III - 29 -04 -2004

Workflow ADA III - 29 -04 -2004

Galaxy-cluster detection Search for galaxy clusters in heterogeneous databases n n RASS photons SDSS

Galaxy-cluster detection Search for galaxy clusters in heterogeneous databases n n RASS photons SDSS Software n n n FORTRAN 90 code (data analysis) Perl scripts (data/grid management) Globus Toolkit ADA III - 29 -04 -2004

Galaxy-cluster detection Components n Setup script w Sets up the directory structure w Distributes

Galaxy-cluster detection Components n Setup script w Sets up the directory structure w Distributes the software across the grid n Execution script w Triggers the parallel execution on the compute nodes n Data collection script w Retrieves the results from the compute nodes ADA III - 29 -04 -2004

GAVO Mini-GRID ADA III - 29 -04 -2004

GAVO Mini-GRID ADA III - 29 -04 -2004

Status Perl scripts Upgrading the RASS Photon DB Soon integrate the SDSS mirror copy

Status Perl scripts Upgrading the RASS Photon DB Soon integrate the SDSS mirror copy ADA III - 29 -04 -2004

RASS-source classifier Class. X: international collaboration w T. A. Mc. Glynn, A. A. Suchkov,

RASS-source classifier Class. X: international collaboration w T. A. Mc. Glynn, A. A. Suchkov, E. L. Winter, R. J. Hanisch, R. L. White, F. Ochsenbein, S. Derriere, W. Voges, M. F. Corcoran Requires data from several sky-surveys w w X-ray: ROSAT BSC+FSC Optical: USNO, (SDSS) Infrared: (2 MASS) Radio: FIRST, NVSS, SUMSS Distributed multi-wavelength VO-application ADA III - 29 -04 -2004

Data Flow ADA III - 29 -04 -2004

Data Flow ADA III - 29 -04 -2004

Pose. Query ADA III - 29 -04 -2004

Pose. Query ADA III - 29 -04 -2004

Display. Query. Result ADA III - 29 -04 -2004

Display. Query. Result ADA III - 29 -04 -2004

Display. Match. Result ADA III - 29 -04 -2004

Display. Match. Result ADA III - 29 -04 -2004

The matching problem ADA III - 29 -04 -2004

The matching problem ADA III - 29 -04 -2004

Display. XMatch. Result ADA III - 29 -04 -2004

Display. XMatch. Result ADA III - 29 -04 -2004

Display. Class. XResult ADA III - 29 -04 -2004

Display. Class. XResult ADA III - 29 -04 -2004

RASS-source classifier State & session management n n Using Java Servlet session mechanism Internal

RASS-source classifier State & session management n n Using Java Servlet session mechanism Internal abstract state machine Strong points n n n End-to-end VO-application Works with lists of objects / sky-coordinates Accesses several distributed databases Uses deterministic matcher (at Vizier and SDSS) Uses probabilistic matcher (at GAVO) Uses data analysis service (at NASA) ADA III - 29 -04 -2004

RASS-source classifier Future work n Use IVOA-standards or protocols w VOTable w WSDL, SOAP-based

RASS-source classifier Future work n Use IVOA-standards or protocols w VOTable w WSDL, SOAP-based Web Services w Add graphics n n Multi-threaded Modularize, generalize and make S/W configurable ADA III - 29 -04 -2004

RASS-source classifier Open questions n n n Is an HTML form-based GUI sufficiently powerful

RASS-source classifier Open questions n n n Is an HTML form-based GUI sufficiently powerful to control a complex grid application? What are the user expectations wrt the workflow? Is there a standard workflow that one could use / agree upon? ADA III - 29 -04 -2004

Conclusion GAVO is a small, but ambitious project Two Grid applications n Detection of

Conclusion GAVO is a small, but ambitious project Two Grid applications n Detection of galaxy clusters w Globus Toolkit n Classification of ROSAT sources w Based on Web. Services ADA III - 29 -04 -2004

References n n n GAVO Mid-Term Report, 90 pages, http: //www. g-vo. org (soon)

References n n n GAVO Mid-Term Report, 90 pages, http: //www. g-vo. org (soon) Detection of X-ray Clusters of Galaxies by Matching RASS Photons and SDSS Galaxies within GAVO, P. Schuecker, H. Boehringer, W. Voges, A&A (submitted) Automated classification of ROSAT sources using heterogeneous multiwavelength catalogs, T. A. Mc. Glynn et al. , Ap. J (submitted) ADA III - 29 -04 -2004