Has the ETL run yet Microsoft Stream Insight

Has the ETL run yet?

Microsoft Stream. Insight CEP Application Development IDE Event sources Event targets CEP Application at Runtime Devices, Sensors CEP Engine Event Pagers & Monitoring devices Standing Queries Event Event Output Adapters Input Adapters Web servers . NET C# LINQ KPI Dashboards, Share. Point UI Event Trading stations Event stores & Databases C_ID C_NAME C_ZIP Stock tickers & News feeds Event stores & Databases Static reference data 27

Events expose different temporal characteristics Payload/ value Rich payloads capture all properties of an event b a t 1 t 2 d c t 3 Time t 4 e t 5

Event Types Events in Microsoft’s CEP platform use the. NET type system Events are structured and can have multiple fields Fields are typed using the. NET framework types CEP engine provisioned timestamp fields capture all the different temporal event characteristics Event sources populate time stamp fields Timestamps/Met adata … Long pump. ID … String Type String Location Double flow Double pressure … …

Event Streams & Adapters A stream is a possibly infinite sequence of events Stream characteristics: Adapters 31

LINQ Query Examples LINQ Example – JOIN, PROJECT, FILTER: from e 1 in My. Stream 1 join e 2 in My. Stream 2 on e 1. ID equals e 2. ID where e 1. f 2 == “foo” select new { e 1. f 1, e 2. f 4 }; Join Filter Project LINQ Example – GROUP&APPLY, WINDOW: from e 3 in My. Stream 3 group e 3 by e 3. i into Sub. Stream from win in Sub. Stream. Hopping. Window( Five. Minutes, Three. Seconds) select new { i = Sub. Stream. Key, a = win. Avg(e => e. f) }; Grouping Window Project & Aggregate

Tumbling Window

Hopping Window

Stream. Insight Hosting Models Hosted server mode In-process server mode CEP Server Application CEP explicit logic Application CEP in-process server (explicit model)

UI application Query Stream. Insight Server Output Adapter UI application Input Adapter

Query UI application Stream. Insight Server Output Adapter Input Adapter

Query UI application Stream. Insight Server Output Adapter Event tracking Input Adapter

Query Power. Pivot UI Stream. Insight Server Output Adapter Power. Pivot UI Event tracking Input Adapter

www. microsoft. com/teched www. microsoft. com/learning http: //microsoft. com/technet http: //microsoft. com/msdn

Sign up for Tech·Ed 2011 and save $500 starting June 8 – June 31 st http: //northamerica. msteched. com/registration You can also register at the North America 2011 kiosk located at registration Join us in Atlanta next year