Trygve Falch trygve falchssb no Enterprise architect Statistics

Trygve Falch (trygve. falch@ssb. no) Enterprise architect, Statistics Norway (LDS) http: //bit. ly/lds-repository

Why? ● System and data silos across the statistical production line ● Product to process requires coherent data and metadata access (integrated data & metadata) ● Versioning and data lineage ● Reduce lock in and increase ability to adopt new technology fast ● Cloud native approach ● GSIM aligned ● Service oriented ● Part of a larger modernization effort

What is it? ● General purpose logical data layer for any type of structured data ● Provider API (Adapters) for any type of underlying storage technology ● Describe data layer schema using an extended RAML specification (Rest API modeling language) ● Distributed ● Open source

Some selections of features: ● Resource-oriented REST API configured at runtime based on the RAML specifications (done) ● Immutable, time based versioning (ongoing) ● Support for Graph. QL (https: //graphql. org/) - Advanced query API (ongoing) ● Data specific capabilities like streaming, filters and cursors (started) ● Possibility for automatic data migration between different type of store providers (future) ● API for near-data processing (future)

RAML Specification progress (not public yet!) ● Physical implementation of GSIM (via a logical model defined within SN) ● Will be open sourced ● RAML to JSON Schema tool ● Repository with examples