Geo Spatial Data Semi structured Geo Spatial Components

Geo. Spatial Data: Semi structured Geo. Spatial Components Data mining components Custom source Merges

Time (minutes) BULK INSERT into a Heap with and without Data Compression 35 30

Building a Work Queue System Create a work queue table. Create a loop to

Demo Results 1 Process finishes in 64 seconds 01: 10. 0 01: 01. 0

2 Processes finish in 36 seconds 01: 10. 0 01: 01. 0 00: 52.

4 Processes finish in 28 seconds 01: 10. 0 01: 01. 0 00: 52.

8 Processes finish in 27 seconds 01: 10. 0 01: 01. 0 00: 52.

Slides: 33

Download presentation

Geo. Spatial Data: Semi structured Geo. Spatial Components Data mining components Custom source Merges Warehouse Legacy data: binary files Standard sources Application database Mobile data Data-cleansing components SQL Server Integration Services Integration is a seamless, manageable operation Source, prepare, & load data in single, auditable process Scale to handle heavy and complex data requirements Reports Cube

Time (minutes) BULK INSERT into a Heap with and without Data Compression 35 30 25 20 15 10 5 0 6 5 4 3 2 1 NONE ROW Compression Type Time to BULK INSERT 50 M rows (min) PAGE Table Size after Load (GB) 0 Table Size after Load (GB) * Not official Microsoft results.

105 seconds 83 seconds

OLTP Change Tables Data Warehouse

Building a Work Queue System Create a work queue table. Create a loop to shift over the work queue constantly checking out work Spawn x times with a batch file

Demo Results 1 Process finishes in 64 seconds 01: 10. 0 01: 01. 0 00: 52. 0 Elapsed Time 00: 44. 0 00: 35. 0 00: 26. 0 00: 18. 0 00: 09. 0 00: 01. 0 Duration Start 1 00: 08. 0 00: 01. 0 2 00: 08. 0 3 00: 08. 0 00: 16. 0 4 00: 09. 0 00: 24. 0 5 00: 09. 0 00: 32. 0 6 00: 09. 0 00: 40. 0 7 00: 09. 0 00: 49. 0 8 00: 09. 0 00: 57. 0

2 Processes finish in 36 seconds 01: 10. 0 01: 01. 0 00: 52. 0 Elapsed Time 00: 44. 0 00: 35. 0 00: 26. 0 00: 18. 0 00: 09. 0 00: 01. 0 Duration Start 1 00: 09. 0 00: 01. 0 2 00: 09. 0 00: 01. 0 3 00: 09. 0 4 00: 09. 0 00: 10. 0 5 00: 10. 0 00: 18. 0 6 00: 10. 0 00: 18. 0 7 00: 10. 0 00: 28. 0 8 00: 10. 0 00: 28. 0

4 Processes finish in 28 seconds 01: 10. 0 01: 01. 0 00: 52. 0 Elapsed Time 00: 44. 0 00: 35. 0 00: 26. 0 00: 18. 0 00: 09. 0 00: 01. 0 Duration Start 1 00: 14. 0 00: 01. 0 2 00: 15. 0 00: 01. 0 3 00: 14. 0 00: 01. 0 4 00: 14. 0 00: 01. 0 5 00: 14. 0 6 00: 15. 0 00: 14. 0 7 00: 14. 0 00: 15. 0 8 00: 14. 0 00: 15. 0

8 Processes finish in 27 seconds 01: 10. 0 01: 01. 0 00: 52. 0 Elapsed Time 00: 44. 0 00: 35. 0 00: 26. 0 00: 18. 0 00: 09. 0 00: 01. 0 Duration Start 1 00: 27. 0 00: 01. 0 2 00: 27. 0 00: 01. 0 3 00: 27. 0 00: 01. 0 4 00: 28. 0 00: 01. 0 5 00: 25. 0 00: 01. 0 6 00: 27. 0 00: 01. 0 7 00: 27. 0 00: 01. 0 8 00: 28. 0 00: 01. 0

SQL Server 1 SQL Server 2 SSIS Server