ESAVO Registry and Curation Utility Aurlien Stb Registry

ESAVO Registry and Curation Utility Aurélien Stébé Registry and Curation, Oct 2005, ESAC, Spain Aurélien Stébé European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN)

The ESAVO Registry q Full Searchable Registry implemented in Java with Sybase RDBMS q Resource Metadata schemas version 0. 10 (+ Open. Sky. Node v 0. 1) q Services accessible by Web Service, HTTP POST or GET q User Interface on Web Pages for Search and Insert/Update q Fully compliant OAI interface for harvesting q New Authority. IDs registration support IVOA Registry WG Release in July 2005 Publicly Released in September 2005 Registry and Curation, Oct 2005, ESAC, Spain Aurélien Stébé European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN)

The Website Interface q Search Interface fully accessible : • Quick Search box and Keyword. Search • Get. Resource and Type Menu Registry Search • ADQL/x and XPath. QL Registry Edit q Result display with toolbar options q Edit/Clone with complete XForms : • Handling of multiple elements • First level validation Registry Results http: //esavo. esa. int/registry/ Registry and Curation, Oct 2005, ESAC, Spain Aurélien Stébé European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN)

Implementation Details q Programming Languages used : • Java (main engine) and JSP/HTML/CSS (user interface) • XSD (resource schemas) and XSLT (data manipulations) • Sybase/SQL (data saving) and XForm (resource edition) q Java Libraries used : • Axis (web services) / Xerces (xml parser) / Xalan (xslt engine) • Jconn (jdbc/database) / Altova (database-xml interface) • Chiba (xforms engine) / Standard Java XML APIs q Applications used : • Altova XMLSpy & Map. Force for schemas manipulation and design, database creation and database-xml interface code generation. • Tomcat for deployment and Chiba for schemas to xforms mapping. Registry and Curation, Oct 2005, ESAC, Spain Aurélien Stébé European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN)

The ADQL Support Regex config XML file XSLT <Where xmlns=". . . /ADQL/v 0. ? ? " xmlns: xsi=". . . "> <Condition xsi: type="like. Pred. Type"> <Arg xsi: type="column. Reference. Type" xpath. Name="content/description"/> <Pattern> <Literal xsi: type="string. Type" Value="%esa%"/> </Pattern> </Condition> </Where> Stylesheets Xalan #content/description# LIKE '%esa%' XPath. QL regex Content. description LIKE '%esa%' SQL ADQL q Support ADQL v 0. 7. 4, v 0. 8, v 0. 9 and v 1. 0 with different stylesheets q XPath. QLSearch method branching after ADQL transformation q Broad regular expr. to offer large XPath support (no namespaces) Registry and Curation, Oct 2005, ESAC, Spain Aurélien Stébé European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN)

The Schemas Handling IVOA Resource XHTML XSLT ESAVO JAVA output Files Resource Code flat structure schema XForm Sybase RDBMS output Map. Force & Net. Beans XMLSpy & Map. Force q Extensive use of stylesheet transformations q Database interfacing ESAVO Resource schema Registry and Curation, Oct 2005, ESAC, Spain Aurélien Stébé European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN)

The Harvesting Interface q The OAI Implementation : • Metadata. Formats : ivo_vor, esa_vor and oai_dc • Sets : ivo_{Resource. Types}, ivo_standard and ivo_managed • Resumption Tokens / YYYY-MM-DD only granularity q Harvesting the following Registries : • Heasarc (ivo: //nvo. heasarc/registry) • Japan. VO (ivo: //jvo/publishingregistry) • NVO NCSA (ivo: //nvo. ncsa/registry) • CDS (http: //vizier. u-strasbg. fr) q Problems harvesting other Registries, should be fixed soon. Registry and Curation, Oct 2005, ESAC, Spain Aurélien Stébé European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN)

The Curation Utility q Testing Validation Levels sequentially q Extendable to different Resource types q Easily configurable by XML file Checking the service metadata. . . Calling URL : http: //pma. iso. vilspa. es: 8080/aio/jsp/siap. jsp? FORMAT=METADATA Welcome to the curation utility for the Virtual Observatory. . . This Content. Type doesn't look correct to me : text/html; charset=ISO-8859 -1 ! Starting curation of resource : ivo: //esavo/iso/siap. . . Checking the service Image Query. . . Getting the resource description. . . Calling URL : http: //pma. iso. vilspa. es: 8080/aio/jsp/siap. jsp? POS=0, 0&SIZE=0 Registry Endpoint : http: //esavo. esa. int/registry/services/Registry. Search Registry Portname : {http: //esavo. esa. int/wsdl/searchable. Registry. wsdl}ESARegistry. Search. Port. SOAP Registry Operation : {http: //www. ivoa. net/wsdl/Registry. Search/v 0. 1}Get. Resource Calling URL : http: //pma. iso. vilspa. es: 8080/aio/jsp/siap. jsp? POS=0, 0&SIZE=1 Calling URL : http: //pma. iso. vilspa. es: 8080/aio/jsp/siap. jsp? POS=0, 0&SIZE=361 Checking the service Image Retrieval. . . <-- LEVEL 0 PASSED --> No Image Access Reference found to test, passing. . . Checking the resource description. . . <!! LEVEL 2 NOT PASSED !!>. . . but lets try to keep going anyway. . . ** Error, line 10 The content of element 'vr: curation' is not complete. One of '{contact}' is expected. ** Error, line 19 The content of element 'vr: interface' is not complete. One of '{ result. Type}' is expected. <!! LEVEL 1 NOT PASSED !!>. . . but lets try to keep going anyway. . . Calling the resource type check. . . Checking a 'Simple. Image. Access' type resource. . . Checking the resource description. . . The resource contact name is missing from the description ! The resource contact email is missing from the description ! Checking the service Region Coverage. . . Checking Region : All. Sky Calling URL : http: //pma. iso. vilspa. esa. es: 8080/aio/jsp/siap. jsp? POS=203. 297, 144. 086&SIZE=0. 1 Calling URL : http: //pma. iso. vilspa. es: 8080/aio/jsp/siap. jsp? POS=203. 297, 144. 086&SIZE=1 Checking the service Image Retrieval. . . Calling URL : http: //pma. iso. vilspa. es: 8080/aio/jsp/product. jsp? obsno=40201422&protocol… Calling URL : http: //pma. iso. vilspa. es: 8080/aio/jsp/product. jsp? obsno=10701671&protocol=… <!! LEVEL 3 NOT PASSED !!>. . . please check the log output. . . This resource reference. URL is : http: //pma. iso. vilspa. es: 8080/aio/doc/ Registry and Curation, Oct 2005, ESAC, Spain Aurélien Stébé European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN)

The Curation Tests q Level 0 : a Resource entry exist • Get the Resource entry from the Registry q Level 1 : the Resource is valid • Validate the Resource using the VOResource schemas q Level 2 : the Service is valid • Extract the Resource type and call the specific sub-method • Check Resource content for minimum information Registry and Curation, Oct 2005, ESAC, Spain Aurélien Stébé European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN)

The Curation Tests q Level 2 : SIAP specific • Check the reference. URL validity • Call the METADATA method and validate the result • Call multiple Image Queries, both correct and bogus • Download image references we got, if any q Level 3 : SIAP specific • Extract the Region Coverage from the Resource • Call Image Queries on all regions using random coordinates and increasing SIZE • Download image references we got, if any Registry and Curation, Oct 2005, ESAC, Spain Aurélien Stébé European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN)

Future Plans q ESAVO Registry Future Evolutions : • Optimize the Keyword. Search algorithm • Optimize the database connection system • Upgrade the interface to the latest specifications • Upgrade the Resource schemas to future v 1. 0 • Implement the full Date. Time OAI granularity • Implement some “call forms” for services q Curation Utility Future Evolutions : • Implement Curation of other protocols (SSAP, Sky. Node, …) • Interface the utility with the Registry • One button Resource Curation • Fill in Validation. Level attribute Registry and Curation, Oct 2005, ESAC, Spain Aurélien Stébé European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN)