GEO Knowledge Hub overview Why does GEO needs
GEO Knowledge Hub: overview • • • Why does GEO needs a Knowledge Hub? For whom is the Knowldege Hub ? Benefits of the Knowledge Hub ? GEO GLAM Etc. GEOCRI GEOBON GOS 4 M GEO KH GEO GLOWS GFOI GHSL • A practical example
GEO Knowledge Hub: overview GEOGLOWS – GEO Initiative Scientific Publications https: //onlinelibrary. wiley. com/doi/full/10. 1111/1752‐ 1688. 12434 Title: A High‐Resolution National‐Scale Hydrologic Forecast System from a Global Ensemble Land Surface Model DOI: https: //doi. org/10. 1111/1752‐ 1688. 12434 Tools and Method: https: //onlinelibrary. wiley. com/doi/full/10. 1111/1752‐ 1688. 12434#jawr 12434‐sec‐ 0002‐title The RAPID model was used to route the ECMWF runoff through the NHDPlus V 2 stream networks. RAPID is an open source model used to route runoff of surface and groundwater inflow to rivers downstream with any density stream network Link to Rapid Model: https: //www. researchgate. net/figure/Schematic‐of‐ECMWF‐RAPID‐Downscaling‐and‐Routing‐Process‐in‐Prediction‐ Mode_fig 11_304492304 The source code for RAPID is available under a Berkeley Software Distribution (BSD) 3‐clause license on the RAPID Git. Hub repository at https: //github. com/c‐h‐david/rapidand further information can be found on the RAPID website at http: //rapid‐hub. org. Software Esri's RAPID Toolbox is available under the Apache License Version 2. 0 and the source code is available on Git. Hub at the repository: https: //github. com/Esri/python‐toolbox‐for‐rapid. The code for automating the process of downscaling the ECMWF prediction datasets using Esri's RAPID toolbox and RAPID is available under the BSD 3‐Clause License and the source code is available on the Git. Hub repository: https: //github. com/erdc‐ cm/spt_ecmwf_autorapid_process. The Streamflow Prediction Tool app is available under the BSD 3‐Clause License and the source code is available on Git. Hub at the repository: https: //github. com/erdc‐cm/tethysapp‐streamflow_prediction_tool. The Streamflow Prediction Tool app was developed using Tethys Platform. The source code for Tethys Platform is distributed under the BSD 2‐Clause license and is available through Git. Hub at https: //github. com/tethysplatform/tethys. Documentation and a live demo of Tethys Platform can be accessed at http: //www. tethysplatform. org. The source code for RAPID is available under a Berkeley Software Distribution (BSD) 3‐clause license on the RAPID Git. Hub repository at https: //github. com/c‐h‐david/rapidand further information can be found on the RAPID website at http: //rapid‐hub. org.
GEO Knowledge Hub: overview Input data: GEOGLOWS – GEO Initiative The ECMWF global runoff forecast ensemble: https: //www. ecmwf. int/en/forecasts ERA‐Interim global reanalysis runoff dataset: https: //apps. ecmwf. int/datasets/data/interim‐full‐daily/levtype=sfc/ The NHDPlus V 2 dataset : http: //www. horizon‐systems. com/NHDPlus/V 2 Global. Data. php Watershed Boundary Dataset: https: //www. usgs. gov/core‐science‐systems/ngp/national‐hydrography/watershed‐boundary‐dataset? qt‐ science_support_page_related_con=4#qt‐science_support_page_related_con National Elevation Datasets (NED): https: //www. usgs. gov/core‐science‐systems/ngp/3 dep/about‐ 3 dep‐products‐services Output data/results: Streamflow Prediction Tool Web App The Streamflow Prediction Tool app is available under the BSD 3‐Clause License and the source code is available on Git. Hub at the repository: https: //github. com/erdc‐cm/tethysapp‐streamflow_prediction_tool
Etc. . GEO Glam GEO Knowledge Hub: overview GEOB ON GEO KH GEOCRI GEO GLOWS GOS 4 M GFOI This process will be done in close collaboration with GEO FS, IS, GEOSS Platform Operations Team coordinated by GEO Secretariat Engagement via periodic calls, tranining and workshops Users and Community Involvement Knowledge Building GHSL Knowledge Identification Knowledge Resources Collection Knowledge Resources curation Curation of the existing GEOSS Platform EO Resources Enrichment of GEOSS Platform EO Resources if not yet available Users Feedback’s Reproducibility Status Report Semi Authomatic Ingestion The Users via the KH will be able to: discover, access and re-use Knowldge resources and related EO datasets from Authoritative sources and community
GEO Knowledge Hub: Knowledge Identification Etc. . GEO Glam GEO KH GEOCRI GEO GLOWS GEOB ON GOS 4 M This process will be done in close collaboration with GEO FS, IS, GEOSS Platform Operations Team coordinated by GEO Secretariat Engagement via periodic calls, tranining and workshops Resource types Publications Scientific Journals and Reports provided by GEO Work Programme activities, with associated DOI (unique object identifier). Post-print copies will be stored in the Knowledge Hub. Software code, models and tools Open source software code provided by GEO Work Programme activities, preferably available in Github, with associated DOI. Backup copies stored in the Knowledge Hub. Remote sensing data Link provided by the GEOSS Platform (if available) and or with Data Provider (APIs) GFOI GHSL Knowledge Identification Knowledge Resources Identification In situ data Ancillary data Knowledge Resources Collection Sources Output data and products Link provided by the GEOSS Platform (if available) and or with Data Provider (APIs) Videos Directly stored in the Knowledge Hub (preferably).
GEO Knowledge Hub: Knowledge Building Screening the Scientific Publication to collect and curate Knowledge around it, identifiying all related essential resources, to create the related Knowledge Package. Knowledge Building Semi Authomatic Ingestion Knowledge Resources curation Curation of the existing GEOSS Platform EO Resources if available Enrichment of GEOSS Platform with identified EO Resources and Respective Data Provider if not yet available Inputs Data: RS / In situ Software Code, Models, Tools, Alghorythms GEOSS API Videos Output Data and Products
GEO Knowledge Hub: Knowledge Building Assessing the Reproducibility of Methods, Tools, Inputs Data, Outputs Data and Findings Knowledge Building Knowledge Resources curation Curation of the existing GEOSS Platform EO Resources if available Enrichment of GEOSS Platform with identified EO Resources and Respective Data Provider if not yet available Reproducibility Status Report Semi Authomatic Ingestion Fair / DM Principles Findable Accessible Interoperable Reusable
GEO Knowledge Hub: Users and Community Involvement Users Engagement via periodic calls, tranining and workshops is at the center of the development of GEO Knowldege Hub, in close collaboration with the Knowledge and Data Providers Community The Users via the GEO Knowledge Hub will be able to: discover, access and re-use Knowldge resources and related EO datasets from Authoritative sources and overall GEO community GEO Glam Etc. . GEOCRI GEO KH GEO GLOWS Users Feedback’s GEOB ON GOS 4 M GFOI GHSL
GEO Knowledge Hub: Technology exploration Full-text search Represent Resources Types in situ data repository
GEO Knowledge Hub: Technology exploration R 1. Support efficient text-based search. R 2. Link document sets with different components (web pages, PDFs, links to DOIs, videos, Jupyter Notebooks, R markdown, URLs to data, Git. Hub pages, videos…etc). R 3. Use descriptors compatible with current search engine technologies and emerging solutions. R 4. Be integrated with the GEO website and GEOSS Platform (see Section 10 for more details). R 5. Include curation services for data entry, based on contributions from the GEO community. R 6. Describe in detail big Earth observation data catalogues. R 7. Promote abstract description of methods used for cloud computing to facilitate interoperability. R 8. Support communities of practice to build packages that use open source scripting languages for big Earth observation data analysis in the cloud to promote application portability. R 9. Include applications that use models and support the open sharing of modelling software. R 10. Work with the GEOSS Platform and other dataset search engines such that they access and promote repositories of continuous in situ data collection. R 11. Ensure in situ data sets stored in accredited and recommended repositories are correctly indexed. R 12. Build an in situ data repository, managed by the Secretariat, to ensure long-term curation and preservation of data entrusted to GEO by its community. R 13. Provide links from the papers stored in the Knowledge Hub to the accredited long-term data repositories. R 14. Build a data repository for long-term archival, where needed, of Citizen Science data associated with in situ observations; otherwise link with existing Citizen Science repositories for seamless retrieval of data. R 15. Promote and disseminate open source software for building multi-satellite analysis ready data that work on EO cloud platforms.
GEO Knowledge Hub: INVENIO Invenio = an open source framework for building large ‐scale digital repositories Source: https: //inveniosoftware. org
GEO Knowledge Hub: INVENIO General Overview: ● Python ecosystem ● MIT License ● An active community. ● Flexible data model through JSON Schema. ● REST API with search capability through Elasticsearch. ● Authentication through ORCID and Git. Hub. ● Easily deployed through Docker. ● Serialisers to produce Bib. Te. X, CSL, Data. Cite, Dublin Core, JSON‐LD, or MARCXML.
GEO Knowledge Hub: Invenio – Infrastructure Architecture Source: CERN (2018)
Exploratory exercise. . .
GEO Knowledge Hub: Way Forward GEO FS / IS GEO KH GEOSS Platform Operations GEOSS Evolve GEO SEC
GEO Knowledge Hub: Technology exploration Free and Open Source Software for Digital Repositories
- Slides: 17