Archiwizacja danych przykady Hierarchical Storage Management Hierarchiczne zarzdzanie

Archiwizacja danych - przykłady Hierarchical Storage Management Hierarchiczne zarządzanie zasobami

Ograniczenia Backupu z Backup nie zabezpiecza ciągłości bezpieczeństwa danych z Najszybciej zużywające się nośniki z Taśmy nie są interaktywnym nośnikiem z Informacja rozłożona jest na wielu nośnikach (długi dostęp)

Co to jest HSM? z Hierarchical Storage Management System przechowywania danych, który automatycznie migruje je pomiędzy droższymi i tańszymi mediami. Koszt jednostkowy szybkich urządzeń pamięci masowej, jak np. dysków twardych jest dużo większy od wolniejszych jak napędy MO lub napędy taśmowe. Rozwiązanie ażeby wszystkie dane znajdowały się na szybkich i drogich urządzeniach nie jest do zaakceptowania przez wiele firm. HSM przechowuje dane na wolnych urządzeniach i stamtąd kopiuje je do szybkiej pamięci dyskowej, które pracuje jako cache. z Webopaedia

Konfiguracja bez HSM

Konfiguracja z HSM

HSM w sieci I: J: Serwer C: D: X:

Zasada pracy HSM Dysk Logiczny (np. X: ) Primary Storage Secondary Storage Cache Dane HDD RAID Biblioteka: - MO - CD - DVD

Rozwiązanie HSM Primary Storage Cache Secondary Storage Biblioteka MO HDD RAID Dane Cache Secondary Storage Biblioteka CD HDD RAID

Działanie cache Serwer Cache Do 20 MB/s sieć SCSI Cache pozwala użytkownikom szybciej przesłać dane Aktywne pliki są dostępne z wydajnością RAID CD/MO 70 – 700 k. B/s (1 napęd) SCSI

Systemy zarządzania danymi (podsumowanie) z Tworzenie zapasowych kopii bezpieczeństwa (backup) y strategie: xpełna xprzyrostowa xróżnicowa y schematy rotacji: x„ojciec-syn” x„dziadek-ojciec-syn” x„wieże Hanoi” y Przykłady systemów: x. HP Open. View Omni. Back II x. Legato Networker x. CA ARCserve. IT z Archiwizacja danych (archive) z Składowanie hierarchiczne (HSM) y dysk - cache dyskowy biblioteka y Przykłady systemów x. Uni. Tree Central File Manager x. HP Omni. Store x. Legato Networker x. Veritas Software

Przykładowe cechy Uni. Tree CFM z Opracowany w Lawrence Livermore National Lab. z Modele pracy ypodstawowy: jedna instancja zarządza pamięcią cache, robotem i systemem plików, zasoby alokowane na jednej/kilku maszynach yrozszerzony: wirtualny system plików - użytkownik nie posiada dostępu do plików innego użytkownika. y. Rozproszony system zasobów taśmowych - zasoby lokalne i zdalne z Przykładowe zastosowania: Centra Informatyczne ACK Cyfronet, TASK, PCSS, WCSS

Przykład zestawu oprogramowania VERITAS Software

Przegląd zastosowań z Veritas Solutions z Backing up Windows 2000 z Backup Management z Storage Area Networking (SAN) z Disaster Recovery

VERITAS Software z The industry’s largest independent application storage management software vendor y #1 company in $5. 5 Billion storage management software market y ~$48 Billion market capitalization y Analysts’ projections for 1999: x. Revenue: >$600 M Growth: >50% x. Actual : $700 M Growth : 80% x 2000 projection: $1. 2 B y Global company with ~ 3, 000 employees z A premier strategic partner to most major vendors z Customer-focused with enterprise-class, worldwide service and support

Współpraca System OEMs Strategic Software Disk Subsystems Tape Subsystems

Hewlett Packard Serving HP Customers’ Enterprise Storage Needs z VERITAS File System included in HP-UX (jfs) z VERITAS Volume Manager to be embedded in HP-UX 11. X y Available today as standalone product z HP resells VERITAS Net. Backup, Storage Migrator for UNIX, and Storage Edition for Oracle z VERITAS Cluster Server for HP available z VERITAS Foundation Suite for HP en route

Microsoft Providing Enterprise Storage for Windows NT® Server z VERITAS selected for four applets expected to ship in Windows 2000 y NTBackup (Backup Exec; also in NT 4, NT 3. 5, Win 98) y Remote Storage Service HSM applet y VERITAS Volume Manager (Logical Disk Manager) y Win. Install LE component y Disaster Recovery component z VERITAS enterprise solutions for Windows NT/2000 y Backup Exec, Net. Backup, Replication Exec, Cluster. X z z z Backup Exec used internally by Microsoft ITG worldwide First to deliver Windows 2000 backup Only fully certified Windows 2000 solution VERITAS VM GUI selected by Microsoft Developer of Microsoft Tape Format

VERITAS Solutions Solaris Windows 2000 FS WEB Linux FS WEB FS HP-UX Client/Server Basic Accounting WEB FS Basic Accounting Enterprise Applications Data Analysis WEB Client/Server Enterprise Applications Data Analysis Basic Accounting Client/Server Enterprise Applications • Voice/data integration • Wireless • Video-on-demand WEB • Voice/data integration • Wireless • Video-on-demand Data Analysis WEB • Voice/data integration • Wireless • Video-on-demand WEB Basic Accounting Client/Server Basic Accounting Enterprise Applications Client/Server Data Analysis Enterprise Applications WEB • Voice/data integration • Wireless • Video-on-demand Data Analysis WEB • Voice/data integration • Wireless • Video-on-demand

FS Replication • VM Replication • Disaster Recovery e-Commerce VCS • SAN • Cluster FS • Cluster VM • Clustering Mirrors • RAID-5 • File Snap Shots • Data Redundancy A V A I L A B I L I T Y Data Availability Index (DAI) On-line Admin • Backup • BLIB Backup • Basic Systems Messaging

VERITAS Technologies Pr of es vic SAN Management er Clustering & Replication l. S t or File & Volume Mgmt on ati uc Backup na sio es Ed pp Su Application Solutions

VERITAS Foundation Technologies Pr of es vic SAN Management er Clustering & Replication l. S t or File & Volume Mgmt on ati uc Backup na sio es Ed pp Su Application Solutions

VERITAS Volume Manager z High-performance, highavailability tool for maximizing availability of on-line storage. z On-line data movement and relayout z RAID configurations: 0, 1, 0+1, 1+0, 5 z Low-impact Oracle mirror resilvering z Dynamic multipathing for performance and availability z Simple Java interface /usr /ops Logical Storage Pool

VERITAS File System z High-performance, journaling file system for UNIX environments z Fast crash recovery z Easy manageability y. Online grow, shrink, move, etc. z Native throughput approximates raw z Robust error isolation y. No calls to panic

VERITAS Backup Technologies Pr of es vic SAN Management er Clustering & Replication l. S t or File & Volume Mgmt on ati uc Backup na sio es Ed pp Su Application Solutions

VERITAS Net. Backup z One solution for heterogeneous environments and all major databases y Oracle, Sybase, Exchange, SQL Server, SAP, DB 2 y UNIX, Windows NT/9 x, Net. App, VMS, Net. Ware, Linux, etc. Centralized Master Server z Centralized administration y Simple, low-cost management for large enterprises z Record-shattering performance z Scalable to terabyte-size systems, thousands of nodes z Advanced functionality z Bundled, resold, or OEMed by Sun, Bull, HP, NEC, Red Hat, sgi Distributed Media Servers Broad Client Support

VERITAS z Industry-leading solution for Windows 2000, Windows NT, and Novell Net. Ware z Used by Microsoft ITG and Novell internally z OEMed or bundled by Microsoft, Dell, Compaq, Quantum/ATL, NEC z Ease of use, great disaster recovery, and powerful functionality with a low entry price z Supports Microsoft MTF, COM, RSM standards z Agents/clients for Exchange, Databases, Notes, UNIX (including Linux), SAP R/3, Windows 9 x, Mac z Integrated open file backup, virus scanning z Exec. View for single-console management

Global Data Manager Enterprise Backup Management z Management of geographically dispersed backup master servers Net. Backup for NT Backup Exec NT Net. Backup for UNIX Backup Exec Net. Ware

Protection of all Storage Domains Desktop to Data Center Tele. Backup

BLIB Block Level Incremental Backup Breakthrough technology that redefines database backup t FAST - 10 -100 X faster than File Level backup t HIGH CAPACITY - Protects the largest multi-terabyte databases. t EFFICIENT - Backs up changed blocks only, min. disk I/O & server overhead. t SAFE - Non-disruptive. Tested and endorsed by Oracle. t EASY - Simple as file backup, only faster. Integrated with Oracle 8 recovery manager. t INEXPENSIVE - Fraction the cost of alternatives. Use any disks and less of them. New Data File Level Backup Block Level Backup

VERITAS Storage Migrator (Hierarchical Storage Management) z Automatic migration of stale data to secondary media, preserving access z Cuts out-of-space incidents, management effort z Cuts backup times z Transparent recall upon reference z Supports Solaris, NT, HP, SGI, Auspex z Embedded in Enigma PARS Migrator z Integrated with VERITAS backup solutions Optical disk, tape, or vault

VERITAS Clustering and Replication Technologies Pr of es vic SAN Management er Clustering & Replication l. S t or File & Volume Mgmt on ati uc Backup na sio es Ed pp Su Application Solutions

Clustering for High Availability CLUSTERING Network Heartbeat Links Multi-Ported Shared Disk z Heartbeats and application agents monitor services for problems z Service and network addresses can be restarted in place or failed over to alternate server z Users see little or no disruption to application

VERITAS Cluster Server z Application service oriented failover solution z Cost-effective scalability up to 32 nodes z Manage planned and unplanned downtime z Easy to install, configure and modify y Simple Java interface z SAN-ready today z High availability from the industry leader z For HP-UX or Solaris

VERITAS Cluster. X z Single-point cluster management for Windows NT environments z Versions for y. Microsoft Cluster Service (MSCS) y. Windows Load Balancing Service (WLBS) z Architected to support other clustering technologies z OEMed by Data General, Dell, Unisys

VERITAS Storage Replicators Stockholm London An automated way to keep the changing data states of distributed nodes continuously synchronized (NT & UNIX) SYNCHRONOUS Zurich ASYNCHRONOUS Madrid

VERITAS SAN Management Technologies Pr of es vic SAN Management er Clustering & Replication l. S t or File & Volume Mgmt on ati uc Backup na sio es Ed pp Su Application Solutions

VERITAS SAN Exploitation LAN SAN FS FS Corporate Data z VERITAS shipping SAN-aware products today z Further SAN exploitation en route z VERITAS built and demonstrated the world’s largest SAN (NY, September 98) z Partnerships with key SAN vendors

Some Key VERITAS SAN Partnerships

VERITAS Application Solutions Pr of es vic er SAN Management l. S Clustering & Replication on t or File & Volume Mgmt ati uc Backup na sio es Ed pp Su Application Solutions

VERITAS Editions z Application-optimized solutions z For Oracle, Sybase, SAP, and File Servers z File System and Volume Manager-based performance, availability, and simplicity of management z Special application-oriented performance accelerators z Exploitation of large memory sizes z Block-Level Incremental Backups (Oracle) y. The ultimate in low-utilization, online backups z High Availability options

The VERITAS Information Availability Index % VAI 99. 9999 99. 999 WAN Clustering LAN Clustering 99. 99 Synchronous Replication 99. 9 Asynchronous Replication 99. 5 Checkpoint Recovery 99. 0 Block Level Incremental Backups 98. 0 A V A I L A B I L I T Y Self-Healing 95. 0 Cold Backups Hot Backups Potential Savings ($)

Backing up Windows NT/2000

Windows 2000 Support z Windows 2000 Support y Automatic protection of all Windows 2000 components both local and remote (via Agent Accelerator) x. Encrypted Files x. Sparse Files x. Active directory y Special handling of: x. Mount Points and Links x. Remote Storage Services data x. Disk Quota data y Integration with Removable Storage Manager (RSM)

Mount Points and Links z Backup y Backup mount points which direct a file or directory to a local disk or directory path y Allows you to backup data that is linked to local files, but stored on another device without having to actually select the device. z Remote Storage Services (RSS) y Automatic protection of RSS database when system directory is selected for backup y Automatically protect RSS reparse points without generating a recall of data from secondary media y Option to back up data migrated from primary storage to secondary storage without recalling data to primary storage x. Data is backed up directly to backup media x. Provides complete backup of your entire system for disaster recovery purposes

Disk Quota z Disk Quota y Tracks and controls disk usage on a per user, per volume basis y Disk Quota data is automatically backed up when the root directory of the volume is selected for backup y Values can be restored to limits that were set before backup z Removable Storage Manager y Formerly known as NT Media Services (NTMS) y Being provided by High. Ground Systems y Allows different applications to share devices supported by RMS z Enhanced ADAMM y User can use ADAMM to manage devices and media without having to use RSM y User can have ADAMM work in conjunction with RSM to share devices and media with other applications

MS Cluster Support z Active/Passive server support y. Server A is Active, Sever B is Passive y. Server A fails, Server B: x Automatically detects Backup Exec failure from A x Automatically starts up its own Backup Exec Services x Automatically restarts the job that fails x Automatically takes over the rest of the jobs that A had A B

MS Cluster Support z Supported in 3 different configurations A B y. Backup Device on both servers A and B y. Backup Device shared between servers A and B via dedicated SCSI bus y. Backup Device shared between servers A and B via the Shared Storage Option A B

Backup Server Management • Network Storage Executive

NSE 8. 0 Key Features z Data-centric orientation (not backup server centric) z Centralized administration of backup, restore and device operations z An intuitive user interface based on the Microsoft Management Console (MMC) z Policy-based management offers a more scalable way to manage and automate backup z Backup server pooling permits load balancing across Backup Exec servers with greater fault tolerance z Microsoft SQL Server 7. 0 database integration provides a central database that stores all job, device, media and configuration information

Policy-based Job Management z Backup policies define how & when data will be backed up z Task list identifies the different types of jobs within a policy z. Each task defines the details of a specific job y Backup method y Device & media y Schedule y Advanced settings

Backup Server Pooling z Group backup servers using drive pools z Target policies and jobs to drive pools z. Load balancing y Jobs dispatch to first available backup server y Simplifies capacity planning z. Fault tolerance y Offline backup server will not prevent job execution

Centralized History & Logging z Results from all jobs are rolled up to the Master database z Job history details are available for viewing or reporting z Problem files (skipped or in use) are also stored in the database z History pruning controls depth of history and size of the database

Alerting & Notification z Flexible variety of notification methods y Email x. Exchange x. Lotus Notes x. SMTP y SNMP y Alpha-numeric pager y Event Log z Circuit Breaker stops alert overload

Consolidated Reporting z Over 20 new reports using Crystal Reports 7. 0 z All data stored in an ODBC-compliant database y Create custom reports if desired y Automate operations based on database states z Spot trends z Predict growth z Optimize performance z Manage media pools z Track service levels

Offsite Media Tracking z Track media location onsite and offsite z Reports direct operators to move proper media z Media discovered online will be moved automatically z Restore jobs will inform the user where the media is currently located z Create multiple offsite vaults to store media

Centralized Restore z Centralized catalog repository enables fast restore from any backup server z Not necessary to restore data using the original backup server z Dedicate restore tasks to a specific machine z This capability is impossible without a centralized catalog repository z Catalog partializing and pruning control catalog growth

NSE Benefits z Reduce Total Cost of Ownership by consolidating the administration of backup & restore tasks z Easily scales with you as your network grows z Pool storage resources for more efficient resource utilization & greater fault tolerance z Manage by exception with NSE’s rich variety of reporting and alerting capabilities z Integrate with other Windows management tools by taking advantage of NSE’s Microsoft component-based design (MMC & SQL) z Trust the leaders in NT storage management for the highest level of NT compatibility

Storage area networking SAN

Issues z Backups impact business productivity y Backups take too long x. LAN bandwidth insufficient x. Data grows exponentially (50 -100% per year) y Certain applications have little or no backup window and require greater availability z Widely dispersed backup systems are too costly for IT to maintain and manage effectively y Each backup system requires care & feeding y Difficult to automate

Traditional Approaches to Backup z Backup to locally attached tape devices y. High performance y. Does not require network bandwidth z Backup over the network y. Consolidated device hardware y. Centralized device and media management

Backup to Locally Attached Devices LAN Each Server has its own backup device Server Hard Drive SCSI Data Flow Tape Device Data Flow

Problems with this Approach z Hardware and media required for every server on the network z Cost of a library on every server is prohibitive z Considerable manual effort required to maintain many individual systems

Backup Over Network LAN Data Flow Tape Library Hard Drive

Problems with this Approach z Significant network bandwidth is required z Network performance is seriously degraded z Network users are severely affected z Does not meet the needs of “ 7 x 24” operations z Modern tape drive performance far exceeds network performance z The network becomes the bottleneck

The Ultimate Solution z Achieve speeds of local backup z Don’t utilize network bandwidth z Consolidate device hardware z Centralize device and media management

The Storage Area Network (SAN) z Replaces the conventional SCSI bus z Connects storage devices to a separate network on the “back end” of the server z Storage devices may be simultaneously connected to many servers at once z Usually implemented using Fibre Channel technology z Current SAN topologies use a “Fibre Channel. Arbitrated Loop” (FC-AL)

Shared Storage Option Architecture LAN Data Flow FC-to-SCSI Bridge Tape Libraries Fibre Channel Hub Storage devices

Backup Exec Shared Storage Option z Allows multiple Backup Exec servers to share backup devices directly attached across a “storage area network” or SAN y Consolidates storage to fewer centralized tape devices with greater capacity backup y Performance comparable to local speeds y Backup traffic removed from the main network z Support for Windows NT and Novell Net. Ware y Currently NT & Net. Ware servers must reside on separate loops

Disaster Recovery

What Happens IF. . . . Your Server 2/25/2021

The Recovery Problem z Without automated solution one has to y. Collect and install system configuration files y. Manually re-partition and format H/D y. Manually re-install profiles and drivers y. Manually re-install Backup program y. Identify last Backup Tape y. Re-catalog the backup tape y. The above is all prone to Human Error

How IDR works ? z Three Phases of Implementation y. Initial preparation of Disaster Disks x. On Installation of IDR creates four disks x. Three are modified Windows NT setup disks x. The fourth is the IDR disk that contains • Restore Engine for Backup Exec • And server specific configuration Information y. Automatic update of IDR information via regular backup x. IDR is integrated into Backup Exec all information about full / Incremental backup is stored any new server configuration changes is recorded. x. This ensures that current information will be available on a Recovery y. Recover after a Disaster

Recovery phase z First replace faulty HD or Server z Boot with IDR disks and NT CD z Disk partition sizing configuration and profile information is all restored with IDR z All applications and data is restored automatically off the most current backup tape z Can restore remote servers