Euclid SAS concept Euclid SAS Archive building up
Euclid SAS concept Ø Euclid SAS Archive building up on Gaia and ESASky experience. Ø Quick and fast exploration and visualisation of the sky ● Hi. PS (Hierarchical Progressive Survey) with observation footprint and catalogue overlays. ● Level 2 images and MER mosaics download ● Image cut-out service Ø Catalogue and spectra queries in a web interface (Archive GUI) Ø But a command line interface is also required, a la HIPE (Herschel) Ø A scientific exploitation platform with Jupyter notebooks (Jupyter. Lab) was very well received by the Euclid Archive Users Group. ● integrated with the DPS (Data Processing System) archive. Bruno Altieri | July 2018 | Slide 1
Jupyter notebook Ø Python is the language used for scientific processing. Ø Allows to abstract off the complexity of the data model with some convenient scripts Ø Bringing the analysis to the data in a collaborative way Ø Easy sharing of notebooks in the future Ø Many archive use cases could be covered. ● E. g. : on-the-fly source or spectra extraction Ø Some limit in processing capabilities / storage obviously Bruno Altieri | July 2018 | Slide 2
A Euclid Interactive Environment Ø Interactive access & visualisation of the data. Ø Interactive processing Use Cases. ● Cutout service (pixel data) ● Customized source extraction ● Spectra extraction for a set of positions ● Cross-correlation of catalogues ● Re-running of the SGS pipeline with different parameters. ● Morphology analysis / classification of objects with machine learning ● … Bruno Altieri | July 2018 | Slide 3
Euclid archive access with Jupyter Ø Only simulated data so far for Euclid from the Scientific Challenges Consortium as well as Euclid Flagship simulations (2. 6 billions sources). Ø astroquery for Euclid (installed on a laptop): ● asynchronous ADQL queries Ø Technology exploration this with Apache Spark (cf S. Nieto presentation) ● Running on a dedicated test server, with Py. Spark and sparkfits Bruno Altieri | July 2018 | Slide 4
- Slides: 4