MODULE 8 OBJECTBASED AND UNIFIED STORAGE EMC Proven

Module 8: Object-based and Unified Storage Upon completion of this module, you should be able to: • Describe the object‐based storage model • List the key components of object‐based storage • Describe the storage and retrieval process in object‐based storage • Describe content‐addressed storage • List the key components of unified storage • Describe the process of data access from unified storage EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 8: Object‐Based and Unified Storage 2

Module 8: Object-based and Unified Storage Lesson 1: Object‐based Storage During this lesson the following topics are covered: • Comparison of hierarchical file system and flat address space • Object‐based storage model • Key components of object‐based storage • Storage and retrieval process in object‐based storage devices • Content‐addressed storage EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 8: Object‐Based and Unified Storage 3

Drivers for Object-based Storage • More than 90% of the data being generated is unstructured • Traditional solutions are inefficient to handle the growth 4 High overhead on NAS due to managing large number of permissions and nested directories • These challenges demanded a smarter approach to manage unstructured data based on its content rather than metadata about its name, location, etc. Object-based storage is a way to store file data in the form of objects on flat address space based on its content and attributes rather than the name and location EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 8: Object‐Based and Unified Storage 4

Object-based Storage Device (OSD) • A device that organizes and stores unstructured data, such as movies, office documents, and graphics, as objects • Object‐based storage provides a scalable, self‐ managed, protected, and shared storage option. EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 8: Object‐Based and Unified Storage 5

Hierarchical File System Vs. Flat Address Space Filenames/inodes Object IDs Object ID Attributes • Hierarchical file system organizes Object Metadata Data Hierarchical File System Object Flat Address Space • Object‐based storage devices store the data in the form of files and directories EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. data in the form of objects 4 It uses flat address space that enables storage of large number of objects 4 An object contains user data, related metadata, and other attributes 4 Each object has a unique object ID, generated using specialized algorithm Module 8: Object‐Based and Unified Storage 6

Traditional Vs. Object-based Storage Model An I/O in the traditional block access method passes through various layers in the I/O path. The I/O generated by an application passes through the file system, the channel, or network and reaches the disk drive. Application System Call Interface File System User Component File System Storage Component Block Interface OSD Interface Network Block I/O OSD Storage Component Block I/O Storage Block‐Level Access Object‐Level Access EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. When an application accesses data stored in OSD, the request is sent to the file system user component. The file system user component communicates to the OSD interface. Module 8: Object‐Based and Unified Storage 7

Key Components of Object-based Storage Device Metadata Server Metadata Service IP Storage Server Storage Internal Network Service OSD Node Application Server OSD Nodes OSD System Storage • OSD system typically comprises 3 key components: 4 OSD nodes: A server that runs the OSD operating environment and provides services to store, retrieve, and manage data in the system 4 Internal network: Provides node‐to‐node connectivity and node‐to‐ storage connectivity 4 Storage: OSD typically uses low‐cost and high‐density disk drives to store the objects. As more capacity is required, more disk drives can be added to the system. EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 8: Object‐Based and Unified Storage 8

Process of Storing Object in OSD 2. OSD node divides the file into two parts, user data and metadata 1. Application server sends a file to OSD Metadata Server Metadata Service 6. Acknowledgment sent to the application server Storage Server Storage 3. OSD node generates object ID from the user data Service OSD Node Application Server OSD Node 5. OSD stores user data (object) using the storage service 4. OSD stores metadata and object ID using the metadata service Storage EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 8: Object‐Based and Unified Storage 9

Process of Retrieving Object from OSD 2. Metadata service locates the object ID for the requested file 1. Application server request file from OSD 3. Metadata service sends the object ID to the application server Metadata Server Metadata Service 4. Application server sends the object ID to the OSD storage service for object retrieval Storage Server Storage 6. Storage service sends the file to the application server OSD Node Application Server Service OSD Node 5. OSD storage service retrieves the object from the storage device Storage EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 8: Object‐Based and Unified Storage 10

Key Benefits of Object-based Storage Benefits Description • Unique object ID generated by specialized algorithms ensures data integrity and content authenticity • Request authentication is performed at storage device • Because objects are abstract containers of data, it enables sharing of objects across heterogeneous Platform platforms independence • This capability makes object‐based storage suitable for cloud computing environment • Both OSD nodes and storage can be independently Scalability scaled • Have inherent intelligence to manage objects • Have self‐healing capability – replicate objects Manageability • Policy based management capability enables OSD to handle routine jobs automatically Security and reliability EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 8: Object‐Based and Unified Storage 11

Use Case 1: Cloud-based Storage Web Application Thin clients Representational state transfer (REST) Simple object access protocol(SOAP) Content Management File Sharing Heterogeneous platforms or tenants accessing data from cloud storage HTTP/S (REST, SOAP), NFS, CIFS Global, Intelligent, Web‐based, and Self‐Service Site #1 Site #2 Site #3 Site #4 Cloud‐based Storage EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 8: Object‐Based and Unified Storage 12

Use Case 2: Content Address Storage (CAS) • Traditional archival solutions – CD, DVD‐ROM do not provide • • • scalability and performance OSD stores data as objects, associates them with a unique object ID, and ensures high data integrity OSD provides scalability and data protection, practical option for long term data archiving for fixed content CAS – a special type of object‐based storage device built for storing fixed content 4 Each object is assigned a globally unique identifier, known as content address (CA) 8 CA is derived from the binary representation of the data 4 CAS device can be accessed via the CAS API running on the application server EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 8: Object‐Based and Unified Storage 13

Key Features of CAS 1 Content authenticity and integrity It assures the genuineness of stored content and assures that the stored content has not been altered 2 Location independence The location from which the data is accesses is transparent to the application 4 Retention enforcement 5 Protecting and retaining data objects is a core requirement of an archive system The retention policies are enforced until the policies expire EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 3 Single instance storage (Si. S) The unique signature is used to guarantee the storage of only a single instance of an object Data protection All fixed content is stored in CAS once and is backed up with a protection scheme. This ensures that the content stored on the CAS system is available in the event of disk or node failure Module 8: Object‐Based and Unified Storage 14

Key Features of CAS (contd. ) 6 Fast record retrieval Stores all objects on disks – faster access compared to tapes and optical discs 9 7 Load balancing Distributes data objects on multiple nodes to provide maximum throughput, availability, and capacity utilization Self diagnosis and repair 8 Scalability Adding more nodes to the cluster without any interruption to data access and with minimum administrative overhead. 10 Audit trail and event Automatically detects and repairs corrupted objects and alert the administrator of any potential problem. EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. notification Enable documentation of management activity and any access and disposition of data Provides on‐demand reporting and event notification Module 8: Object‐Based and Unified Storage 15

Use Case 1: Healthcare Solution Hospital Patient Records Stored locally for short-term use (60 days) API Application Server Data moved to CAS (after 60 days) CAS System • Large healthcare centers examine hundreds of patients every • • • day and generate large volumes of medical records. Each X‐ray image size range from about 15 MB to over 1 GB Patient records are stored online for a specific period of time E. g. : Kept in the original format for 60 days, beyond 60 days patient records are archived to CAS EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 8: Object‐Based and Unified Storage 16

Use Case Bank 2: Financial Solution Stored locally for short-term use (60 days) API Data moved to CAS (after 60 days) CAS System Application Server • In a typical banking scenario, images of checks, each • • approximately 25 KB in size, are created and sent to archive services over an IP network Check imaging service provider might process around 90 million check images per month E. g. : Checks are stored online for a period of 60 days, beyond 60 days data is archived to CAS EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 8: Object‐Based and Unified Storage 17

Module 8: Object-based and Unified Storage Lesson 2: Unified Storage During this lesson the following topics are covered: • Key components of unified storage • Data access from unified storage EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 8: Object‐Based and Unified Storage 18

Drivers for Unified Storage • Deploying disparate (different) storage solutions (SAN, NAS, and OSD) adds management cost, complexity, and environmental overhead • Unified storage consolidates block, file, and object‐ based access within one unified platform 4 Supports multiple protocols for data access 4 Can be managed through single management interface EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 8: Object‐Based and Unified Storage 19

Components of Unified Storage Components of unified storage are: • Storage Controller • NAS head • OSD node • Storage Application Servers NAS Clients i. SCSI/FC/FCo. E CIFS/NFS Block Request Web Application Servers REST/SOAP/ API File Request NAS Head The storage controller provides block-level access to application servers through i. SCSI, FC, or FCo. E protocols. EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Object Request OSD Node Block I/O Storage Controller Unified Storage Module 8: Object‐Based and Unified Storage 20

Data Access from Unified Storage Application Servers NAS Clients i. SCSI/FC/FCo. E CIFS/NFS Web Application Servers Block, file, and object requests to the storage travel through different I/O paths. Block I/O request: • The application servers are connected to an FC, i. SCSI, or FCo. E port on the storage controller. • The server sends a block request over an FC, i. SCSI, or FCo. E connection. • The storage controller processes the I/O and responds to the application server. Block Request EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. REST/SOAP/ API File Request NAS Head Object Request OSD Node Block I/O Storage Controller Unified Storage Module 8: Object‐Based and Unified Storage 21

Module 8: Object-based and Unified Storage Concept in Practice • EMC Atmos • EMC VNX • EMC Centera EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 8: Object‐Based and Unified Storage 22

EMC Atmos • Massively scalable objects‐based storage • Can be deployed in two ways: purpose‐built hardware appliance • or virtual machine (VM) Key features 4 Enable policy‐based management 4 Provide protection with replication and parity 4 Provide services such as compression and deduplication 4 Support web service and legacy protocols 8 REST, SOAP, CIFS, NFS, and Installable File System 4 Enable automated system management 4 Supports multitenancy 4 Flexible administration EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 8: Object‐Based and Unified Storage 23

EMC Centera Access Nodes Storage Nodes Private LAN External LAN Client EMC Centera API Application Server EMC Centera is offered in three different models • EMC Centera Basic • EMC Centera Governance Edition • EMC Centera Compliance Edition Plus (CE+) EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 8: Object‐Based and Unified Storage 24

EMC VNX • Unified storage platform that consolidates block, file, and object accesses in one solution 4 Supports block access via storage processors 4 File access via X‐Blade 4 Object access via EMC Atmos VE • Components of VNX are: 4 Storage processor 4 X‐Blade 4 Control station 4 Disk‐array enclosures 4 Standby power supply EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 8: Object‐Based and Unified Storage 25

Module 8: Summary Key points covered in this module: • Object‐based storage model • Key components of object‐based storage • Process of storage and retrieval in object‐based storage • Content‐addressed storage • Key components of unified storage • Process of data access from unified storage EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 8: Object‐Based and Unified Storage 26