SRV 310 Efficient Storage Management and Simple SAN

SRV 310 Efficient Storage Management and Simple SAN Deployments with Windows Server 2003 R 2 Mario D’Silva National Technology Specialist Enterprise & Partner Group Microsoft Australia

Agenda Windows Server 2003 R 2 Storage Management Scope File Server Resource Manager Challenges, user scenarios and functionality for: Capacity management Policy management Quota management Storage Manager for SANs Challenges, user scenarios and functionality for: Disk provisioning Disk management Simplifying SAN solutions Bringing SANs to SMBs Partnering i. SCSI solutions Fibre Channel solutions QLogic Emulex

Storage and File Systems in Windows Network & Distribution DFS Namespaces DFS Replication Access-Based Enumeration Files & Folders Quotas, Policies, and Reports File Server Management Volume Physical Disk SAN management (VDS) Shadow copies (VSS)

Storage Management Scope Component Windows Tool Asset Management • Fibre Channel (FC) Information Tool • Virtual Disk Service (VDS) Manage, track and maintain physical (hardware) and logical (volumes, files, I/O etc) storage information Capacity Management • File Services Resource Manager (FSRM) Disk and volume space information Charge-Backs • Indirect support through FSRM Provides customer billing for storage costs Configuration Management Configures physical storage systems • VDS • Storage Manager for SAN • Storage tracing Data and Media Migration • File Server Migration Toolkit Allows data movement from different media types Event Management Administrator notification of storage problems • Microsoft Operations Manager (MOM)* • FC Information Tool Performance & Availability Management • MOM* Application, server, & subsystem information Policy Management • FSRM (file screening) Sets and enforces policies for systems and users Quota Management • FSRM Manages storage usage Media Management Provides information about removable media storage --

File Server Resource Manager (FSRM) A new Windows storage management component that integrates: Capacity management Policy management Quota management

FSRM: Capacity Management Administrator challenges Determining existing storage capacity usage across the organization Determining whether usage effectively supports organizational goals Defining and implementing storage policies Adjusting the policies as capacity needs grow and as organization needs change

FSRM: Capacity Management User scenarios and benefits Identify where storage capacity is used inefficiently Identify mechanisms to prevent future capacity misuse Monitor usage patterns and utilization levels

FSRM: Capacity Management Functionality Predefined and configurable storage capacity reporting Predefined reports for ease of use Configurable reports for fine tuning to specific server environments Predefined • Large files • Most/least recently used • Files by owner • Files by file group • Duplicate files • Quota usage • File screen audit • Export report Configurable • Multiple volumes • Multiple folders or shares

FSRM: Capacity Management Functionality (cont’d) Multiple report formats Generate reports at scheduled intervals (e. g. , off-hours) on-demand (e. g. , troubleshooting during a storage crisis, can trace problem to source) Save reports locally or send to users via e-mail Support for clustered configurations

FSRM: Policy Management File screening Administrator challenges: No easy way to control the type of data stored on file servers Unwanted content must be identified manually

FSRM: Policy Management File screening (cont’d) User scenarios and benefits: Eliminate non-business files and improve storage utilization while reducing management costs Implement policies to restrict unauthorized files in order to limit legal exposure Promote a culture of accountability

FSRM: Policy Management File Screening (cont’d) Functionality: Applies to a folder tree or volume Screening rules: Based on file groups Apply to all user files in the folder File screening settings can be saved in template Passive and active screening supported Screening events recorded in audit log Same set of notification as quotas

FSRM: Policy Management File Screening (cont’d) Functionality (cont’d): File system interoperability Only NTFS volumes are supported Usage is tracked in real time Only volumes with screening configuration are monitored Screening is based on file name patterns (*. mp 3, FY 04*) Self-consistent volume configuration Cluster support

FSRM: Policy Management File screen exceptions for fine-tuning Screening configurations can be nested Semantics similar to ACL permissions (subfolders inherit policies) File screen exceptions Explicitly allow files which match a set of file groups to be stored in a folder tree Usually configured on a subfolder under a more restrictive screening policy No notifications are raised when a file matches an allowed file group

FSRM: Quota Management Administrator challenges User home directories often grow quickly causing servers to run out of space Departmental shares can also grow unexpectedly Administrators are only aware of storage crises when the server is already out of space

FSRM: Quota Management User Scenarios and Benefits Control the amount of space used for a folder or share and limit its impact on server utilization Monitor disk space usage growth per: Volume Folder Share Slow down storage growth

FSRM: Quota Management Why not NTFS quotas? NTFS quotas since Windows 2000 Per volume Per user Based on logical file size NTFS quotas lack Scoping to a specific directory Accounting based on disk size Rich notification mechanisms

FSRM: Quota Management Functionality Quotas limit the size of a directory tree or a volume Quota applies to all users files in directory Limit can be soft or hard File system interoperability Only NTFS volumes are supported Usage is tracked in real time, failing I/Os at hard limit Only volumes with quota configuration are monitored Quota usage is charged based on disk size Support for special files Compressed, sparse, named streams, hard links, reparse points

FSRM: Quota Management Functionality (cont’d) Multiple notification thresholds at configurable quota utilization levels Self-consistent volume configuration Quota settings travel with volume (SAN, hot-pluggable disks) Cluster support

File Server Resource Manager

Storage Manager for SANs (SMf. S) A SAN application: Storage resource provisioning Disk configuration

SMf. S: A SAN Provisioning Application Administrator challenges Small-midsize market want SAN benefits, but: Existing tools are complex and expensive Sophisticated performance monitoring not required in the SMB market (usually only 10 -15 servers) Hardware support for tens of thousands of storage devices unnecessary Administrators have limited experience with SAN technologies Want basic functionality enabling the administrator to easily share storage among servers

SMf. S: A SAN Provisioning Application User scenarios and benefits Offers “just the basics” SAN management functionality, including: Device discovery LUN creation Storage allocation Enables Shared storage solutions Clustering

Storage Manager for SANs Basics Leverages Virtual Disk Service (VDS) infrastructure Allows Windows administrators to perform basic array and LUN management Target audience: small-scale SANs built from simplified hardware SMf. S is a MMC snap-in

Storage Manager for SANs Features Configure all SAN storage in one UI Focus on simplicity Auto-discover subsystems (arrays) Auto-discover servers on SAN (no 16 -digit hex #s) Simple wizard to provision storage Reduce complexity via easy tasks Grow volumes and underlying LUNs Move storage from server to server Configure i. SCSI security Link with local storage management

Storage Manager for SANs Virtual Disk Service 1. 1 Interface for storage management (Windows Server 2003) Local storage (volume management) External (SAN) storage via “hardware providers” from hardware vendors VDS 1. 1 (post-SP 1 Hotfix) adds support for MPIO and i. SCSI New WHQL logo program Ties in with Simple SAN program

Storage Manager for SANs Technical details Leverages VDS API to manage storage (hardware providers) r ide ov r ide i. SCSI Pr HBA API ov Also i. SCSI and HBA API connectivity and MPIO for path management VDS Pr Fibre Channel i. SCSI “PCI” RAID (DAS) Storage Manager for SANs MPIO (managed via VDS) Storage Hardware

Storage Manager for SANs

Storage Manager for SANs i. SCSI and MPIO integration i. SCSI UI Configures i. SCSI host, target, security, etc.

Storage Manager for SANs i. SCSI and MPIO integration Multipathing Enabling HBA ports for multipathing

SAN Adoption in SMB 30% of SMB polled in the US already have some sort of networked storage deployed Of the SMB who have not deployed, 53% are planning to do it in the medium time frame ESG Survey, Winter 05

Simplifying SAN Solutions Bringing SANs to SMBs Storage area networks (SANs) provide many benefits, including centralized, shared storage SAN adoption in SMBs has been low because of complexity, expense, and poor solution component interoperability

Simplifying SAN Solutions Bringing SANs to SMBs (cont’d) Microsoft is committed to helping to bring SANs to a wider range of customers through a number of approaches, including: i. SCSI SANs Enable SAN solutions by using existing IP infrastructure and knowledge base VDS Integration Partner applications are using the VDS framework for both i. SCSI and Fibre Channel simplified SAN solutions Simple SANs

Typical SAN Complex to Install SAN Bundle Installation Performed by Trained SAN Engineer

Packaging SMB Customers Like Home Theatre Systems in a Box Many boxes and manuals One box and set-up poster

Software SMB Customers Like Microsoft Small Business Server Multiple installations – manual configuration One installation – automatic configuration

Simplifying SAN Solutions Bringing SANs to SMBs Simple SAN for Windows Program For storage partners Provides the framework for simplification of SAN solutions on the Windows platform Goal is to develop simplified SAN solutions that are: Robust Serviceable Cost effective AND THEY JUST WORK Order 1 SKU Unpack Set-up

Simplifying SAN Solutions MSA 1000 Small Business SAN Complete SAN in a Box MSA 1000 SANbox 3050 SANblade QLA 200 SANsurfer Express

MSA 1000 Small Business SAN Wizard

Simplifying SAN Solutions i. SCSI and Fibre Channel partnering Working with i. SCSI and Fibre Channel vendors in all storage categories Building solutions that integrate with VDS, VSS, MPIO, i. SCSI, Storport Developing management applications that make deployment simple and easy

Simplified SAN Solutions for FC SANsurfer VDS Manager SAN Component discovery Intuitive console for simple array management Manage heterogeneous storage subsystems Configure and monitor storage resources Virtualization of hardware and software logical volumes Fault analysis Monitoring of SAN devices Volume status Performance monitoring Health

SANsurfer VDS Manager SAN Component Discovery Mapping of SAN resources Logical View Subsystem-LUN Server-LUN Physical Mapping Physical Connection LUN Mapping Discovery Servers and HBAs HW Providers Attached subsystems, Controllers, LUNs and Drives

SANsurfer VDS Manager Intuitive Console for Array Management Point and click GUI Detailed device information Topology view of SAN devices Simple wizards based configuration

SANsurfer VDS Manager Manage Heterogeneous Storage Subsystems Centralized Management Interface Reduced TCO Leverage existing storage Array Provider must be supplied by hardware vendor

Simplified SAN Solutions for FC: EZPilot Features Storage and SAN infrastructure (HBA, switch) management merged into one integrated solution VDS client/GUI with streamlined SAN infrastructure management built-in Streamlined, automated SAN deployment, end-to-end Single, coherent interface all the way through Handles all aspects of installation, maintenance and expansion Removes perceived complexity of setting up and managing unfamiliar components on an individual basis (HBA, switch, array) Safe, straight-forward installation

EZPilot SAN Wizard Install and setup phases HBA setup Storage setup Note that switch is plug and play: no setup necessary at this phase

EZPilot HBA Setup Wizard

EZPilot Storage Setup Wizard Configure disk type and size Create logical drive Assign to hosts

EZPilot Manager Storage View

EZPilot Manager Host View

Summary Windows Storage Server 2003 R 2 Solutions for Storage Management Challenges FSRM Capacity Management Policy Management File Screening SMf. S Quota Management Partner Solution Integration Configuration Management

Resources Windows Storage: http: //www. microsoft. com/windowsserversyst em/storage/default. mspx Windows Server 2003 R 2 Customer Preview Program: http: //www. microsoft. com/windowsserver 200 3/r 2/default. mspx

We invite you to participate in our online evaluation on Comm. Net, accessible Friday only If you choose to complete the evaluation online, there is no need to complete the paper evaluation

© 2005 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.