Open Search Standards ESIP Summer Meeting 2015 Doug

Open. Search Standards ESIP Summer Meeting 2015 Doug Newman (NASA Earthdata – Raytheon) Andrew Mitchell (NASA Earthdata) This work was supported by NASA/GSFC under Raytheon Co. contract number NNG 10 HP 02 C SESIP_0715_DN 1

Why standards are important ‘Would you like to help us fight global warming? ’ Charity ‘volunteer’, 06 -05 -15 5: 30 pm ET, 77 th & Lexington, NYC • • Make data discovery easier! Make data aggregation easier! ‘Science the s**t out of it’ Global warming defeated! – Mark Watney, The Martian 2 SESIP_0715_DN 1

What is Open. Search? From www. opensearch. org ‘Open. Search is a collection of simple formats for the sharing of search results’ 3 SESIP_0715_DN 1

Why we chose it • Lightweight and simple HTTP query in, ATOM feed out, small query palette • Standards-based HTTP query in, ATOM feed out • RESTful HTTP, HATEOAS • Low entry cost Use your browser! 4 SESIP_0715_DN 1

Why we messed with it We see the value of this standard and think we can apply it to our problem domain… …If we just tweak this and add that • Spatial • Temporal • Two step • Etc. 5 SESIP_0715_DN 1

WHAT WE HAVE TRIED TO DO SESIP_0715_DN 1

The ‘dream’ • All Earth data metadata repositories have an Open. Search API • Those APIs conform to a standard • I can apply the same search across multiple repositories • I can compare the results (apples to apples) • I can aggregate the results 7 SESIP_0715_DN 1

Steps taken to achieve this Determine our need Determine minimal set of requirements from that need Get it working (CWICSmart + IDN + CWIC) Iterate on the above Combine where possible (ESIP and CWIC) Advocate with bold, decisive (and sometimes unilateral) action 8 SESIP_0715_DN 1

Who is involved • ESIP • OGC • CEOS ESIP OGC 9 SESIP_0715_DN 1

WHAT WE HAVE FAILED TO DO SESIP_0715_DN 1

The reality • • No convergence of standards We have, somewhat ironically, added one We all have agendas Sometimes they coincide, sometimes they don’t • We don’t like to compromise • Being forceful, charismatic and British only gets you so far in this world 11 SESIP_0715_DN 1

Despite our best intentions OPENSEARCH Attribution: http: //imgs. xkcd. com/comics/standards. png Comic sans courtesy of ‘Watchmen’ and ‘Dark Knight Returns’ 12 SESIP_0715_DN 1

Sticking points • • Link relations Mandatory unique identifier clause Start index versus start page Succinct versus verbose 13 SESIP_0715_DN 1

We have this CEOS Developers Guide ESIP Best Practices CEOS Best Practices OGC 10 -032 r 8 – Geo and Time ext. OGC 13 -026 r 5 EO products ext. Open. Search Relevancy extension Open. Search Parameter extension Open. Search Geo extension Open. Search Time extension Open. Search Specification 1. 1 draft 5 14 SESIP_0715_DN 1

Open. Search compliance 15 SESIP_0715_DN 1

What we learnt (already knew) • Standards are fine if they are your standards • Legacy implementations trump good ideas • Basing your standard on a specification that no one curates can bite you • The only one following your standard is you 16 SESIP_0715_DN 1

How do we fix this? • Demonstrate the value of the ‘common’ standard* • Provide tools to enable compliance. For example, validation tools** • Lobby – unfortunately this has a political dimension • Evangelize – what I’m doing right now! * Today 5 pm ** Thursday 3: 30 pm 17 SESIP_0715_DN 1

GLOBAL OPENSEARCH 5 pm today in the Acacia Room YOU WILL LOVE IT 18 SESIP_0715_DN 1

Synopsis • Standards are HARD • There can be an unhealthy intersect between politics and engineering that needs to be handled • Getting this working on a ‘federation’ level was not easy but on a ‘global’ level it is really difficult • My solution? Keep pushing. Never give up, never surrender. But yield some ground if you can afford to occasionally 19 SESIP_0715_DN 1

QUESTIONS SESIP_0715_DN 1

This work was supported by NASA/GSFC under Raytheon Co. contract number NNG 10 HP 02 C 21 SESIP_0715_DN 1