Data Streams Continuous unbounded rapid timevarying streams of
Data Streams • Continuous, unbounded, rapid, time-varying streams of data elements • Occur in a variety of modern applications – – – Network monitoring and traffic engineering Sensor networks Telecom call records Financial applications Web logs and click-streams Manufacturing processes • DSMS = Data Stream Management System 1
DBMS versus DSMS 2
DBMS versus DSMS • Persistent relations • Transient streams (and persistent relations) 3
DBMS versus DSMS • Persistent relations • Transient streams (and persistent relations) • One-time queries • Continuous queries 4
The (Simplified) Big Picture Register Query Streamed Result Stored Result DSMS Input streams Archive Scratch Stored Relations 5
(Simplified) Network Monitoring Intrusion Warnings Online Performance Metrics Register Monitoring Queries DSMS Network measurements, Packet traces Scratch Store Archive Lookup Tables 6
Example Query Two streams, contrived for ease of examples: Orders (order. ID, customer, cost) Fulfillments (order. ID, clerk) 7
Example Query Two streams, contrived for ease of examples: Orders (order. ID, customer, cost) Fulfillments (order. ID, clerk) Total cost of orders fulfilled over the last day by clerk “Sue” for customer “Joe” Select Sum(O. cost) From Orders O, Fulfillments F [Range 1 Day] Where O. order. ID = F. order. ID And F. clerk = “Sue” And O. customer = “Joe” 8
Example Query Two streams, contrived for ease of examples: Orders (order. ID, customer, cost) Fulfillments (order. ID, clerk) Total cost of orders fulfilled over the last day by clerk “Sue” for customer “Joe” Select Sum(O. cost) From Orders O, Fulfillments F [Range 1 Day] Where O. order. ID = F. order. ID And F. clerk = “Sue” And O. customer = “Joe” 9
Example Query Two streams, contrived for ease of examples: Orders (order. ID, customer, cost) Fulfillments (order. ID, clerk) Total cost of orders fulfilled over the last day by clerk “Sue” for customer “Joe” Select Sum(O. cost) From Orders O, O Fulfillments F [Range 1 Day] Where O. order. ID = F. order. ID And F. clerk = “Sue” And O. customer = “Joe” 10
Example Query Two streams, contrived for ease of examples: Orders (order. ID, customer, cost) Fulfillments (order. ID, clerk) Total cost of orders fulfilled over the last day by clerk “Sue” for customer “Joe” Select Sum(O. cost) From Orders O, Fulfillments F [Range 1 Day] Where O. order. ID = F. order. ID And F. clerk = “Sue” And O. customer = “Joe” 11
Example Query Two streams, contrived for ease of examples: Orders (order. ID, customer, cost) Fulfillments (order. ID, clerk) Total cost of orders fulfilled over the last day by clerk “Sue” for customer “Joe” Select Sum(O. cost) From Orders O, Fulfillments F [Range 1 Day] Where O. order. ID = F. order. ID And F. clerk = “Sue” And O. customer = “Joe” 12
- Slides: 12