Extending Automatic Storage Management to Manage ALL Data































- Slides: 31
Extending Automatic Storage Management to Manage ALL Data Oracle Database 11 g Release 2 Ara Shakian Principal Product Manager Oracle Confidential
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
Table of Contents • Storage management challenges • ASM Overview • ASM in 11 g. R 2 takes it the next level • • What is it How does it work How do I manage it Benefits • How do I get from here to ASM • ASM reference customers Oracle Confidential
Challenges of Managing Data Explosion • Lack of a single optimal solution for all data • Lack of automation to reduce complexity • Managing multiple software layers • Complexity of managing performance • Eliminating hot spots • Multi-vendor support logistics and finger pointing • Reducing storage Total Cost of Ownership Oracle Confidential
ASM Is Most Popular Storage Manager • De-facto standard for RAC and grid deployments, >65% • De-facto standard for VLDB deployments • Large and growing adoption for single instance deployments, >20% • Thousands of customers using ASM • One of the most popular features in the database Oracle Confidential
ASM is Storage Management Platform of Choice An optimal storage management solution for database and general purpose files ASM Disk Group ASM Disk ASM Disk • • • Simplifies and automates storage management Integrated cluster and single node framework Storage pooling with easy provisioning Optimal performance by default Best availability and scalability Lowest TCO • Consolidates and eliminates waste • No additional cost • Manages ALL data Lowers the cost of storage management Oracle Confidential 11. 2
Dynamic Rebalancing • Simple provisioning • Add, drop or resize ASM Disk ASM Benefits: • On-line capacity management • Eliminates manual I/O tuning • Maintain optimal performance • Storage migration on line Oracle Confidential Disk Group ASM Disk
Enables Storage Consolidation Clustered Pool of Storage Local Area Network RAC ASM ERP FIN • Shared storage across several databases RDBMS ASM CRM RDBMS ASM • RAC and Single Instance HR • Benefits: ERP Database HR Database CRM Database FIN Database ASM Disk Group Oracle Confidential • Simplified and Centralized management • Higher storage utilization • Higher performance
Striping, Mirroring and Performance • Striping designed to meet • RDBMS I/O characteristics • General purpose files • Flexible file-based mirroring • External, Normal and High ASM • Optimal performance • No tuning Non-ASM Percentage relative to Baseline (TPS) Time Oracle Confidential
Why You Should Care • Reduced complexity thru automation • • Simplified solution stack • • Oracle Confidential No down-time for storage provisioning or migration Managing storage pool vs. islands Single vendor cross-platform integrated solution • • • No finger pointing, 3 rd party LVM/FS Increases utilization and database and application uptime • • • No I/O tuning, reshuffling data files Bundled and tested as one solution Same cross platform tools to install, configure and manage No additional cost!
Taking It To The Next Level With ASM in 11 g. R 2 Oracle Confidential
Oracle Grid Infrastructure (ASM + Oracle Clusterware) • ASM and Oracle Clusterware integrated and installed in a single ‘Grid Infrastructure’ home • Integrated installation, configuration and upgrade • Installed using Oracle Universal Installer (OUI) • Not a part of database install • Option to minimally configure ASM and ACFS • Automate creation of Oracle DB Homes on ACFS Oracle Confidential
ASM Configuration Assistant (ASMCA) • One tool to initialize & manage * Disk Groups * Dynamic Volumes * ACFS file systems Oracle Confidential • Manage ASM before db install • Upgrade previous versions of ASM to the current version (11 g R 2)
Extending ASM to Manage ALL Database RAC Application 3 rd Party FS Automatic Storage Management (ASM) ACFS Snapshot ASM Instance Managing Oracle DB Files ASM Disk Group Oracle Confidential Database Files DB Datafiles Database files OCR & Voting files ASM Cluster & Single Node File System (ACFS) Dynamic Volume Manager General Purpose Files Dynamic Volumes ACFS FS Oracle Bin 3 rd Party FS
What is ASM Dynamic Volume Manager OS /dev/asm/vol 1 -123 ASM DG +DATA/vol 1 • A new cluster (and single host) volume management service • Standard disk device interface to clients • Loadable kernel driver • Dynamic Volume is a volume file created in an ASM disk group (new file type ‘asmvol’) • An OS device file is created automatically when a dynamic volume is created • Managed by SQL/ASMCMD and EM Oracle Confidential
What is ASM Cluster File System (ACFS) • General purpose scalable file system • Journaling, extent based • Single node and cluster • POSIX, X/OPEN file system solution for UNIX/Linux • Windows file system solution for Windows platforms • • • Accessible through NAS protocols (NFS, CIFS) Leverages ASM technology for volume mgt Integrated with Oracle Clusterware for cluster support Multi OS platform (Linux and Windows at initial release) Integrated with Oracle system mgt tools • Oracle installation and configuration • Enterprise Manager and ASM Storage mgt tools • Native OS File System Management tools Oracle Confidential
What are ACFS Snapshots • Dynamic, fast, space efficient, “point in time” read-only copies of ACFS file system files • Captures ASM FS file block/extent updates • An enabler for: • On-line, disk-based, file backup model using snapshots • Individual file recoveries • Up to 64 snapshot images per ASM file system • Policy based snapshots: Schedule snapshots on an interval basis: every 5 seconds, every 30 minutes, daily, … • Create an ACFS snapshots • acfsutil snap create snap_name mountp Oracle Confidential
Leveraging the Power of ASM • Even distribution of data • Dynamic provisioning Dynamic volumes and ACFS FS may be resized leveraging ASM file resize features % asmcmd volresize dga vol 1 -s 50 G ACFS File System: /usr 1 ACFS file A ACFS file B Mirrored Linux: /dev/asm/vol 1 Win: \. asm_dgname_volname +DATA/dga/vol 1 • Can also use Enterprise Manager for management and threshold alerts 1 1 Primary ASM File Extent Mirrored ASM file Extents Oracle Confidential 3
Managing the Dymanic Volumes and ACFS File System Is Simple And Flexible 1. Native Linux, UNIX, and Windows OS file system commands and extensions 2. acfsutil platform independent commands 3. ASM Configuration Assistant (ASMCA) 4. Enterprise Manager Oracle Confidential
An Example: Creating an ACFS File System $ mkfs -t acfs -b 4 k /dev/asm/volume 1 -62 ; Create fs on ASM volume $ su - root # mount -t acfs /dev/asm/volume 1 -62 /tmp/images # su – oracle_usr $ acfsutil registry -a /dev/asm/volume 1 -62 /tmp/images $ mount –t acfs –o all none $ cd /tmp/images $ cp /home/my_images. Oracle Confidential ; Mount everything in the registry
ACFS Use Cases • Oracle Home • Shared or node-local • Not Grid Infrastructure home • External files • Application binaries • Not an OS boot FS Oracle Confidential
Managing Oracle Database Files ASM Core Enhancements Oracle Confidential
ASM 11 g Release 2 New Features for Database Files • All files on ASM • Oracle Cluster Registry, Voting Disk and SPFILE • Tunable Performance • Intelligent Data Placement (IDP) • Improved Management • Full Featured ASMCMD • ASM File Access Control • ASM Disk Group Rename • Datafile to Disk Mapping • Installation & Configuration mgt • ASM Install & Configuration Assistant (ASMCA) Oracle Confidential
OCR and Voting Disk on ASM • OCR is a regular ASM file • A new ASM file type • Voting Disk • Stored in selected ASM disks • ‘crsctl’ used to specify a disk group for Voting disks • ASM auto creates 1/3/5 Voting Disks based on Ext/Normal/High redundancy on Failure Groups • Quorum failure group • ASM determines redundancy for OCR and Voting Disk based on disk group redundancy level • ASM SPFILE is also supported on ASM now Oracle Confidential
Intelligent Data Placement (IDP) • Placement of files on high performance regions of disk Hot Files • 50% performance difference from outer to inner tracks • Classify or mark an ASM file to be HOT/COLD • Alter diskgroup dgname modify file ‘xxx’ attributes HOT/COLD or based on a templates at creation time • Rebalance to migrate the ‘file’ to HOT/COLD IDP region • IDP regions are dynamic • New V$ASMFILE recording IO stats • The IDP feature better leveraged when ASM disks are whole disks Oracle Confidential Disk Platter Cold Files
Complete ASMCMD Functionality A complete API for the system admin • Extending ASMCMD to manage: • ASM instance (startup/shutdown, init. ora, . ) • Disk group, disk and failure group (create, mount, add, drop, …) • Attribute (list, set) • User/Group (add user, change password, …) • Template (list, add, alter drop) • Iostat and df • lsof: list files that are open by ASM lsod: list disks that are open by ASM • Dynamic Volume Oracle Confidential
Other Features • ASM File Access Control (ACL) • Introducing 3 classes of permissions: • owner, group, and other • ASM Disk Group Rename • Oracle File Mapping support (OFM) • View mapping of datafiles to physical devices • 4 k sector size disk I/O support • Possible values are: 512 b or 4096 b (4 k) Oracle Confidential
In Summary… Oracle Confidential
One Integrated Solution for ALL Data Simple Low Cost High Performance Always On-Line Scalable Optimal Utilization ACFS Snapshot Un-structured Data Structured Data ASM Cluster FS ASM Database files & Dynamic Volumes Oracle Database & Oracle Clusterware RAC Cross Platform Linux, Windows, Solaris, HP-UX, AIX Oracle Confidential One Management Interface One Install and Configure One Clusterware Framework One Vendor for Support
Some ASM Reference Customers In Production Oracle Confidential