Make Your Maintenance Plans Paresh Motiwala Make Your

  • Slides: 19
Download presentation
Make Your Maintenance Plans… Paresh Motiwala

Make Your Maintenance Plans… Paresh Motiwala

Make Your Maintenance Plans… My Contact Details • pareshmotiwala@gmail. com • /in/pareshmotiwala • @pareshmotiwala

Make Your Maintenance Plans… My Contact Details • pareshmotiwala@gmail. com • /in/pareshmotiwala • @pareshmotiwala • Leadership Team: @Boston_BI Boston -- Business Intelligence User Group @PASS_DBA_VC-- PASS DBA Virtual Chapter @NESQLServer – New England SQL Server User Group @PASS_Prof. Dev – PASS Prof Dev Virtual Chapter SQL Saturdays, Boston Azure Boot Camp, Boston Code Camp, Modernize Data Platform. – Circles of Growth – – –

Make Your Maintenance Plans… • Backups – Staggered Backups – Striped Backups – Parallel

Make Your Maintenance Plans… • Backups – Staggered Backups – Striped Backups – Parallel Backups with PS • Restores – Striped Restores • • • Copy Data Virtualization Checking Database Integrity Re-Indexing – Rebuilding – Reorganizing – Updating Statistics • • Timing Your Maintenance Third Party Job Schedulers Planning and Reassessing Q&A

Make Your Maintenance Plans… • Backups - Staggered Backups – Full Weekly – Differential

Make Your Maintenance Plans… • Backups - Staggered Backups – Full Weekly – Differential Daily – Transaction Logs

Make Your Maintenance Plans… • Backups- Striped Backups – other parameters • Size of

Make Your Maintenance Plans… • Backups- Striped Backups – other parameters • Size of DB- 3 TB, compressed-280 -GB • Backup Drives- RAID 5 4 Cores 8 GB Stripes Time CPU I/O MBPS Buffer Count Block Size Max. Transfer. Size Wait Types 8 72 97 634 500 65536 2097152 8 76 97 575 800 65536 2097152 Backup. Buffer, Async IO, Backup. IO 8 67 95 650 200 65536 4194304 4 71 70 615 400 65536 4194304

Make Your Maintenance Plans… • Striped Backups – More Powerful Machine • Size of

Make Your Maintenance Plans… • Striped Backups – More Powerful Machine • Size of DB- 3 TB, compressed-280 -GB • Backup Drives- RAID 5 16 Cores 64 GB Stripes Time CPU I/O MBPS Buffer Count Block Size Max. Transfer. Size Wait Types 8 30 65 310 800 65536 4194304 8 45 2 -5 800 - - - Backup. Buffer, Async IO, Backup. IO 2 59 2 -5 613 - - -

Make Your Maintenance Plans… • Striped Backups –With Defaults • Size of DB- 3

Make Your Maintenance Plans… • Striped Backups –With Defaults • Size of DB- 3 TB, compressed-280 -GB • Backup Drives- RAID 5 4 Cores 8 GB Stripes Time CPU I/O MBPS Wait Types 1 228 47 211 2 170 70 270 Backup. Buffer, Async IO, Backup. IO 3 150 65 310 4 137 70 336

Make Your Maintenance Plans… • Parallel Backups – Multiple SQL Jobs? – Can this

Make Your Maintenance Plans… • Parallel Backups – Multiple SQL Jobs? – Can this be portable? – Check the capacity of NIC • Power. Shell – https: //www. mssqltips. com/sqlservertip/4974/ba ckup-sql-server-databases-in-parallel-withpowershell/#comments

Make Your Maintenance Plans… • Database Integrity Checks – Frequency? • Daily • Weekly

Make Your Maintenance Plans… • Database Integrity Checks – Frequency? • Daily • Weekly – Against which database? • Prod • Reporting

Make Your Maintenance Plans…. • Striped Restores • Files Size of the database: 2.

Make Your Maintenance Plans…. • Striped Restores • Files Size of the database: 2. 8 TB: Instant File Initialization Enabled Read/W rite Time (Mins) Latency 1 Duration Latency 2 Duration 10 23 86 4 X/X drive 96 36 2 X/X drive 105 2173 8 X/X drive 109 370 2 4 1 X/X drive 115 1024 1 2600 2226 Latency Rest of the time Wait Types CPU I/O MBPS Backup. IO, Backup. Thread 5% 376 2470 30 Backup. IO, Backup. Thread <5% 361 12 50 28 Backup. IO, Backup. Thread <5% 372 1 30 - Backup. IO, Backup. Thread <5% 360

Make Your Maintenance Plans… • Copy Data Virtualization – Initial Full Ingest – Forever

Make Your Maintenance Plans… • Copy Data Virtualization – Initial Full Ingest – Forever Incremental – Time- < 5 minutes

Make Your Maintenance Plans… • Timing – Staggered Re-Indexing – Depends • >30% fragmentation,

Make Your Maintenance Plans… • Timing – Staggered Re-Indexing – Depends • >30% fragmentation, rebuild – Stagger over days – Weekends • <30% fragmentation, reorg – Stagger over days – Weekends – Rebuild statistics ? – Shrinking Database – Instant File Initialization – Cleaning After Yourself

Make Your Maintenance Plans… • Third Party Job Schedulers – No Programming Skills –

Make Your Maintenance Plans… • Third Party Job Schedulers – No Programming Skills – Flow and Error Handling – Even DBAs can use it – Interact with everything – Saves time and money – Extended logging – Eliminate humun arrores – Automate

Make Your Maintenance Plans…

Make Your Maintenance Plans…

Make Your Maintenance Plans… • Planning and Reassessing: Look For – Changes in environment

Make Your Maintenance Plans… • Planning and Reassessing: Look For – Changes in environment – Changes in business requirements – Newer technologies • Downstream • Upstream

Make Your Maintenance Plans… – DBA Data Warehouse • • Size of backups Time

Make Your Maintenance Plans… – DBA Data Warehouse • • Size of backups Time for re-indexing databases Growth of disc consumption Growth of database Versions of SQL Last backup completion

Make Your Maintenance Plans… • • Staggered Backups Striped Backups Database Integrity Checks Copy

Make Your Maintenance Plans… • • Staggered Backups Striped Backups Database Integrity Checks Copy Data Virtualization Striped Restores Staggered Re-Indexing Rebuilding Statistics

Make Your Maintenance Plans… • Q&A

Make Your Maintenance Plans… • Q&A

Make Your Maintenance Plans… • • Paresh Motiwala pareshmotiwala@gmail. com http: //www. linkedin. com/in/pareshmotiwala

Make Your Maintenance Plans… • • Paresh Motiwala pareshmotiwala@gmail. com http: //www. linkedin. com/in/pareshmotiwala Twitter: @pareshmotiwala • T H A N K Y O U