ESDC Jupyter Lab Workshop B Altieri R Alvarez

ESDC Jupyter. Lab Workshop B. Altieri, R. Alvarez, M. Armano, D. Baines, M. Bentley, J. Duran, M. Fernandez, R. Gil, F. Giordano, A. González, D. González, J. González, M. López-Caniego, B. López-Martí, V. Navarro, S. Nieto, J. Osinde, J. Salgado, P. Teodoro, E. Utrilla, I. Valtchanov. Issue/Revision: 1. 0 Reference: Jupyter. Lab Workshop Status: N/A ESA UNCLASSIFIED - Releasable to the Public

Workshop agenda 14: 00 -16: 20 Introduction + Demo Session 14: 00 -14: 15 Introduction to Jupyter, Jupytercon, Jupyter-based platforms [M. López-Caniego] 14: 15 -14: 35 ESDC Jupyter. Hub Platform [J. González, J. Osinde, S. Nieto] 14: 35 -14: 50 ESDC astroquery modules and py. ESASky demo [D. Baines] 14: 50 -15: 00 PSA demo [M. Bentley] 15: 00 -15: 10 Herschel demo [I. Valtchanov] 15: 10 -15: 20 Planck demo [M. López-Caniego] 15: 20 -15: 40 Coffee break 15: 40 -15: 50 Gaia demo [E. Utrilla] 15: 50 -16: 00 Euclid demo [B. Altieri] 16: 00 -16: 10 Galileo demo [V. Navarro] 16: 10 -16: 20 LPF/ACES demo [M. Armano] 16: 20 Wrap-up [M. López-Caniego] 16: 20 -17: 00 Hands-on Session M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 2 ESA UNCLASSIFIED - Releasable to the Public

Introduction Goals of this workshop ● Present Project Jupyter ● Learn who works with it ● Learn from each other experience ● Build up knowledge in the Department ● Get ready for the revolution that is coming M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 3 ESA UNCLASSIFIED - Releasable to the Public

Introduction: from Ipython to Jupyter. Lab A bit of history Ipython Notebook is an interactive computational environment, in which you can combine code execution, rich text, mathematics, plots and rich media. www. ipython. org M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 4 ESA UNCLASSIFIED - Releasable to the Public Credits: http: //www. jupyter. org/

Introduction: from Ipython to Jupyter. Lab A bit of history M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 5 ESA UNCLASSIFIED - Releasable to the Public Credits: http: //www. jupyter. org/

Introduction: Jupyter Project M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 6 ESA UNCLASSIFIED - Releasable to the Public Credits: http: //www. jupyter. org/

Introduction: Jupyter Notebook & Lab IDL, Matlab, C, Fortran, …. M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 7 ESA UNCLASSIFIED - Releasable to the Public Credits: http: //www. jupyter. org/

Introduction: Jupyter Notebook & Lab Share code used in publications M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 8 ESA UNCLASSIFIED - Releasable to the Public Credits: http: //www. jupyter. org/

Introduction: Jupyter Notebook & Lab M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 9 ESA UNCLASSIFIED - Releasable to the Public Credits: http: //www. jupyter. org/

Introduction: Jupyter Notebook M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 10 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter Notebook M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 11 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter Notebook M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 12 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter Notebook M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 13 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter Notebook M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 14 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter. Lab Launcher M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 15 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter. Lab Launcher M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 16 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter. Lab Launcher M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 17 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter. Lab Launcher M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 18 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter. Lab Launcher M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 19 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter. Lab Launcher M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 20 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter. Lab Notebook M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 21 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter. Lab Workspace M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 22 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter. Lab Workspace M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 23 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter. Lab Workspace M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 24 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter. Lab real-time interpreter M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 25 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter. Lab Kernels M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 26 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter. Lab Kernels M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 27 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter. Lab Documentation M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 28 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter. Lab Documentation M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 29 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter. Lab Widgets M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 30 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter Notebook & Juyter. Lab This is where we are Experimental ESDC Jupyter Platform + other initiatives Planck, Gaia, Euclid, etc. M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 31 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupyter. Lab Collaborative tool This is where we are Prototype ESDC Jupyter Platform + other initiatives Planck, Gaia, Euclid, PSA, etc. We are only scratching the surface of Jupyter… M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 32 ESA UNCLASSIFIED - Releasable to the Public there is a lot more!!

Introduction: Jupytercon Everyone is talking about how to analyze large datasets, how to bring the code to the data, scalability, collaborative research, reproducibility. M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 33 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupytercon M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 34 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupytercon M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 35 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Jupytercon Talks on youtube: https: //www. youtube. com/playlist? list=PL 055 Epbe 6 d 5 b 572 IRm. YAHk. Ugcq 3 y 6 K 3 Ae Slides: https: //conferences. oreilly. com/jupyter/jup-ny/public/schedule/proceedings M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 36 ESA UNCLASSIFIED - Releasable to the Public

Introduction: LIGO Open Science Center LIGO https: //www. youtube. com/watch? v=TLCCOu. Ldg. QQ&index=3&list=PL 055 Epbe 6 d 5 b 572 IRm. YAHk. Ugcq 3 y 6 K 3 Ae&t=0 s M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 37 ESA UNCLASSIFIED - Releasable to the Public Credits: W. Farr, LIGO Collaboration

Introduction: LIGO Binder and Azure Approach LIGO Binder Azure M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 38 ESA UNCLASSIFIED - Releasable to the Public Credits: LIGO Open Science Centre

Introduction: LSST https: //athornton. github. io/Jupyter. Con-2018 -talk/ M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 39 ESA UNCLASSIFIED - Releasable to the Public Credits: A. Thornton. LSST

Introduction: CERN SWAN Portal CERN https: //cdn. oreillystatic. com/en/assets/1/event/285/SWAN_%20 CERN_s%20 Jupyterbased%20 interactive%20 data%20 analysis%20 service%20 Presentation. pdf M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 40 ESA UNCLASSIFIED - Releasable to the Public Credits: D. Castro. CERN

Introduction: PANGEO Portal PANGEO M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 41 ESA UNCLASSIFIED - Releasable to the Public Credits: http: //pangeo. pydata. org/

Introduction: PANGEO Portal PANGEO M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 42 ESA UNCLASSIFIED - Releasable to the Public Credits: http: //pangeo. pydata. org/

Introduction: PANGEO Portal PANGEO M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 43 ESA UNCLASSIFIED - Releasable to the Public Credits: http: //pangeo. pydata. org/

Introduction: PANGEO Portal PANGEO M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 44 ESA UNCLASSIFIED - Releasable to the Public Credits: http: //pangeo. pydata. org/

Introduction: PANGEO Portal PANGEO M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 45 ESA UNCLASSIFIED - Releasable to the Public Credits: http: //pangeo. pydata. org/

Introduction: PANGEO Portal PANGEO https: //www. oreilly. com/ideas/the-future-of-data-driven-discovery-in-the-cloud Credits: R. P. Abernathey M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 46 ESA UNCLASSIFIED - Releasable to the Public

Introduction: Sci. Server SCISERVER M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 47 ESA UNCLASSIFIED - Releasable to the Public Credits: http: //www. sciserver. org/

Introduction: Sci. Server SCISERVER M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 48 ESA UNCLASSIFIED - Releasable to the Public Credits: http: //www. sciserver. org/

Introduction: Sci. Server SCISERVER M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 49 ESA UNCLASSIFIED - Releasable to the Public Credits: http: //www. sciserver. org/

Introduction: Sci. Server Python, R, Matlab SCISERVER M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 50 ESA UNCLASSIFIED - Releasable to the Public Credits: http: //www. sciserver. org/

Introduction M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 51 ESA UNCLASSIFIED - Releasable to the Public Credits: http: //www. 123 rf. com/

Workshop agenda 14: 00 -16: 20 Introduction + Demo Session 14: 00 -14: 15 Introduction to Jupyter, Jupytercon, Jupyter-based platforms [M. López-Caniego] 14: 15 -14: 30 ESDC Jupyter. Hub Platform [J. González, J. Osinde, S. Nieto] 14: 30 -14: 50 ESDC astroquery modules and py. ESASky on the ESDC platform [D. Baines] 14: 50 -15: 00 PSA demo on the ESDC platform [M. Bentley] 15: 00 -15: 10 Herschel demo on the ESDC platform [I. Valtchanov] 15: 10 -15: 20 Planck demo on ESDC platform [M. López-Caniego] 15: 20 -15: 40 Coffee break 15: 40 -15: 50 Gaia demo [E. Utrilla] 15: 50 -16: 00 Euclid demo [B. Altieri] 16: 00 -16: 10 Galileo demo [V. Navarro] 16: 10 -16: 20 LPF/ACES demo [M. Armano] 16: 20 Wrap-up [M. López-Caniego] 16: 20 -17: 00 Hands-on Session M. López-Caniego on behalf of ESDC | Jupyter. Lab Workshop | ESAC | 10/10/2018 | Slide 52 ESA UNCLASSIFIED - Releasable to the Public