MODULE 2 DATA CENTER ENVIRONMENT EMC Proven Professional

Module 2: Data Center Environment Upon completion of this module, you should be able

Module 2: Data Center Environment Lesson 1: Application, DBMS, and Host (Compute) During this

Application • A software program that provides logic for computing operations • Commonly deployed

Application Virtualization It is the technique of presenting an application to an end user

Database Management System (DBMS) • Database is a structured way to store data in

Host (Compute) • Resource that runs applications with the help of underlying computing components

Operating Systems and Device Driver • In a traditional environment OS resides between the

Memory Virtualization • An OS feature that presents larger memory to Operating System the

Logical Volume Manager (LVM) • Responsible for creating and controlling host level logical storage

LVM Example: Partitioning and Concatenation Hosts Logical Volume Physical Volume Partitioning EMC Proven Professional.

File System Blocks Users File System Files 1 2 3 Creates/ Manages Reside in

Compute Virtualization It is a technique of masking or abstracting the physical compute hardware

Need for Compute Virtualization Layer (Hypervisor) x 86 Architecture CPU NIC Card Memory x

Desktop Virtualization It is a technology which enables detachment of the user state, the

Module 2: Data Center Environment Lesson 2: Connectivity During this lesson the following topics

Connectivity • Interconnection between hosts or between a host and • peripheral devices, such

IDE/ATA and Serial ATA • Integrated Device Electronics (IDE)/Advanced Technology Attachment (ATA) 4 Popular

SCSI and SAS • Parallel Small computer system interface (SCSI) 4 Popular standard for

Fibre Channel and IP • Fibre Channel (FC) 4 Widely used protocol for high

Module 2: Data Center Environment Lesson 3: Storage During this lesson the following topics

Storage Options • Magnetic Tape 4 Low cost solution for long term data storage

Storage Options (contd. ) • Optical discs 4 Popularly used as distribution medium in

Disk Drive Components Controller Board HDA Platter and Read/Write Head EMC Proven Professional. Copyright

Physical Disk Structure Spindle Sector Track Cylinder Track Platter EMC Proven Professional. Copyright ©

Logical Block Addressing Sector 8 Head 0 Block 0 (Upper Surface) Cylinder 1 Block

Disk Drive Performance • Electromechanical device 4 Impacts the overall performance of the storage

Seek Time • Time taken to position the read/write head • The lower the

Rotational Latency • The time taken by the platter • • to rotate and

Data Transfer Rate • Average amount of data per unit time that the drive

I/O Controller Utilization Vs. Response Time • Based on fundamental laws of disk drive

Storage Design Based on Application Requirements and Disk Drive Performance • Disks required to

Enterprise Flash Drives Conventional Hard Drives Flash Drives Mechanical delay due to seek time

Host Access to Storage Networking Options Compute Application File System Storage Network Block-level Request

Direct-Attached Storage (DAS) Internal Direct Connect EMC Proven Professional. Copyright © 2012 EMC Corporation.

Module 2: Data Center Environment Concept in Practice • VMware ESXi EMC Proven Professional.

VMware ESXi • Industry’s leading hypervisor 4 Enable virtualization of x 86 hardware platforms

Module 2: Summary Key points covered in this module: • Key data center elements

Exercise: Design Storage Solution for New Application • Scenario 4 Characteristics of new application:

Slides: 39

Download presentation

Module 2: Data Center Environment Upon completion of this module, you should be able to: • Describe the core elements of a data center • Describe virtualization at application and host layer • Describe disk drive components and performance • Describe host access to storage through DAS • Describe working and benefits of flash drives EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 2

Module 2: Data Center Environment Lesson 1: Application, DBMS, and Host (Compute) During this lesson the following topics are covered: • Application and application virtualization • DBMS • Components of host system • Compute and memory virtualization EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 3

Application • A software program that provides logic for computing operations • Commonly deployed applications in a data center 4 Business applications – email, enterprise resource planning (ERP), decision support system (DSS) 4 Management applications – resource management, performance tuning, virtualization 4 Data protection applications – backup, replication 4 Security applications – authentication, antivirus • Key I/O characteristics of an application 4 Read intensive vs. write intensive 4 Sequential vs. random 4 I/O size EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 4

Application Virtualization It is the technique of presenting an application to an end user without any installation, integration, or dependencies on the underlying computing platform. • Allows application to be delivered in an isolated environment 4 Aggregates Operating System (OS) resources and the application into a virtualized container 4 Ensures integrity of Operating System (OS) and applications 4 Avoids conflicts between different applications or different versions of the same application EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 5

Database Management System (DBMS) • Database is a structured way to store data in logically organized tables that are interrelated 4 Helps to optimize the storage and retrieval of data • DBMS controls the creation, maintenance, and use of databases 4 Processes an application’s request for data 4 Instructs the OS to retrieve the appropriate data from storage • Popular DBMS examples are My. SQL, Oracle RDBMS, SQL Server, etc. EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 6

Host (Compute) • Resource that runs applications with the help of underlying computing components 4 Example: Servers, mainframes, laptop, desktops, tablets, server clusters, etc. • Consists of hardware and software • components Hardware components 4 Include CPU, memory, and input/output (I/O) devices IP • Software components 4 Include OS, device driver, file system, volume manager, and so on EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 7

Operating Systems and Device Driver • In a traditional environment OS resides between the applications and the hardware 4 Responsible for controlling the environment • In a virtualized environment virtualization layer works between OS and hardware 4 Virtualization layer controls the environment 4 OS works as a guest and only controls the application environment 4 In some implementation OS is modified to communicate with virtualization layer • Device driver is a software that enables the OS to recognize the specific device EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 8

Memory Virtualization • An OS feature that presents larger memory to Operating System the application than physically available 4 Additional memory space comes from disk storage 4 Space used on the disk for virtual memory is called ‘swap space/swap file or page file’ 4 Inactive memory pages are moved from physical memory to the swap file 4 Provides efficient use of available physical memory 4 Data access from swap file is slower – use of flash drives for swap space gives best performance EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Memory Swap in Swap out Disk Drive Module 2: Data Center Environment 9

Logical Volume Manager (LVM) • Responsible for creating and controlling host level logical storage Logical Volume 4 Physical view of storage is converted to a logical view 4 Logical data blocks are mapped to physical data blocks Logical Volume Logical Disk Block Physical Vol. 2 Physical Vol. 3 • One or more Physical Volumes form a Volume Group 4 LVM manages Volume Groups as a single entity • Logical volumes are created from the volume group EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Physical Vol. 1 Volume Group Module 2: Data Center Environment 10

LVM Example: Partitioning and Concatenation Hosts Logical Volume Physical Volume Partitioning EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Concatenation Module 2: Data Center Environment 11

File System Blocks Users File System Files 1 2 3 Creates/ Manages Reside in Mapped to Disk Physical Extents Disk Sectors 6 Mapped to EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. LVM Logical Extents 5 4 Mapped to Module 2: Data Center Environment 12

Compute Virtualization It is a technique of masking or abstracting the physical compute hardware and enabling multiple operating systems (OSs) to run concurrently on a single or clustered physical machine(s). • Enables creation of multiple virtual machines (VMs), each running an OS and application 4 VM is a logical entity that looks and behaves like physical machine • Virtualization layer resides between Virtualization Layer (Hypervisor) hardware and VMs x 86 Architecture 4 Also known as hypervisor • VMs are provided with standardized hardware resources EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. CPU NIC Card Memory Hard Disk Module 2: Data Center Environment 13

Need for Compute Virtualization Layer (Hypervisor) x 86 Architecture CPU NIC Card Memory x 86 Architecture Hard Disk CPU NIC Card Memory Hard Disk Before Virtualization After Virtualization • Runs single operating system (OS) per machine at a time • Runs multiple operating systems (OSs) per physical machine concurrently • Couples s/w and h/w tightly • Makes OS and applications h/w independent • May create conflicts when multiple applications run on the same machine • Isolates VM from each other, hence, no conflict • Underutilizes resources • Offers flexible infrastructure at low cost • Improves resource utilization • Is inflexible and expensive EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 14

Desktop Virtualization It is a technology which enables detachment of the user state, the Operating System (OS), and the applications from endpoint devices. • Enables organizations to host and Pcs and thin clients centrally manage desktops 4 Desktops run as virtual machines within the data center and accessed over a network • Desktop virtualization benefits 4 Flexibility of access due to enablement of thin clients 4 Improved data security 4 Simplified data backup and PC maintenance EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. LAN/WAN Desktop VMs Module 2: Data Center Environment 15

Module 2: Data Center Environment Lesson 2: Connectivity During this lesson the following topics are covered: • Physical components of connectivity • Storage connectivity protocols EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 16

Connectivity • Interconnection between hosts or between a host and • peripheral devices, such as storage Physical Components of Connectivity are: 4 Host interface card, port, and cable • Protocol = a defined format for communication between sending and receiving devices 4 Popular storage interface protocols: IDE/ATA and SCSI Host Adapter Cable Disk Port EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 17

IDE/ATA and Serial ATA • Integrated Device Electronics (IDE)/Advanced Technology Attachment (ATA) 4 Popular interface used to connect hard disks or CD-ROM drives 4 Available with varity of standards and names • Serial Advanced Technology Attachment (SATA) 4 Serial version of the IDE/ATA specification that has replaced the parallel ATA 4 Inexpensive storage interconnect, typically used for internal connectivity 4 Provides data transfer rate up to 6 Gb/s (standard 3. 0) EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 18

SCSI and SAS • Parallel Small computer system interface (SCSI) 4 Popular standard for connecting host and peripheral devices 8 Commonly used for storage connectivity in servers 4 Higher cost than IDE/ATA, therefore not popular in PC environments 4 Available in wide variety of related technologies and standards 4 Support up to 16 devices on a single bus 4 Ultra-640 version provides data transfer speed up to 640 MB/s • Serial Attached SCSI (SAS) 4 Point-to-point serial protocol replacing parallel SCSI 4 Supports data transfer rate up to 6 Gb/s (SAS 2. 0) EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 19

Fibre Channel and IP • Fibre Channel (FC) 4 Widely used protocol for high speed communication to the storage device 4 Provides a serial data transmission that operates over copper wire and/or optical fiber 4 Latest version of the FC interface ‘ 16 FC’ allows transmission of data up to 16 Gb/s • Internet Protocol (IP) 4 Traditionally used to transfer host-to-host traffic 4 Provide opportunity to leverage existing IP based network for storage communication 8 Examples: i. SCSI and FCIP protocols EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 20

Module 2: Data Center Environment Lesson 3: Storage During this lesson the following topics are covered: • Various storage options • Disk drive components, addressing, and performance • Enterprise Flash drives • Host access to storage and direct-attached storage EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 21

Storage Options • Magnetic Tape 4 Low cost solution for long term data storage 8 Preferred option for backup destination in the past 4 Limitations 8 Sequential data access 8 Single application access at a time 8 Physical wear and tear 8 Storage/retrieval overheads EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 22

Storage Options (contd. ) • Optical discs 4 Popularly used as distribution medium in small, single-user computing environments 4 Limited in capacity and speed 4 Write once and read many (WORM): CD-ROM, DVD-ROM 4 Other variations: CD-RW, Blu-ray discs • Disk drive 4 Most popular storage medium 4 Large storage capacity 4 Random read/write access • Flash drives 4 Uses semiconductor media 4 Provide high performance and low power consumption EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 23

Disk Drive Components Controller Board HDA Platter and Read/Write Head EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Interface Power Connectors Module 2: Data Center Environment 24

Logical Block Addressing Sector 8 Head 0 Block 0 (Upper Surface) Cylinder 1 Block 32 (Lower Surface) Block 64 Block 128 Physical Address= CHS EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Logical Block Address= Block# Module 2: Data Center Environment 26

Disk Drive Performance • Electromechanical device 4 Impacts the overall performance of the storage system • Disk service time 4 Time taken by a disk to complete an I/O request, depends on: 8 Seek time 8 Rotational latency 8 Data transfer rate Disk service time = seek time + rotational latency + data transfer time EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 27

Seek Time • Time taken to position the read/write head • The lower the seek time, the faster the I/O • operation Seek time specifications include 4 Full stroke 4 Average 4 Track-to-track Radial Movement • The seek time of a disk is specified by the drive manufacturer EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 28

Rotational Latency • The time taken by the platter • • to rotate and position the data under the R/W head Depends on the rotation speed of the spindle Average rotational latency 4 One-half of the time taken for a full rotation 4 For ‘X’ rpm, drive latency is calculated in milliseconds as: EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environnent 29

Data Transfer Rate • Average amount of data per unit time that the drive can deliver to the HBA 4 Internal transfer rate : Speed at which data moves from a platter’s surface to the internal buffer of the disk 4 External transfer rate: Rate at which data move through the interface to the HBA External transfer rate measured here HBA Internal transfer rate measured here Interface Buffer Head Disk Assembly Disk Drive EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 30

I/O Controller Utilization Vs. Response Time • Based on fundamental laws of disk drive performance: 4 Service time is time taken by the controller to serve an I/O • For performance-sensitive applications disks are commonly Response time (msec) utilized below 70% of their I/O serving capability 0% Knee of curve: disks at about 70% utilization Low Queue Size Utilization EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. 70% 100% Module 2: Data Center Environnent 31

Storage Design Based on Application Requirements and Disk Drive Performance • Disks required to meet an application’s capacity need (DC): • Disks required to meet application’s performance need (DP): • IOPS serviced by a disk (S) depends upon disk service time (TS): 4 TS is time taken for an I/O to complete, therefore IOPS serviced by a disk (S) is equal to (1/TS) 8 For performance sensitive application (S)= Disk required for an application = max (DC, DP) EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environnent 32

Enterprise Flash Drives Conventional Hard Drives Flash Drives Mechanical delay due to seek time and rotational latency Highest possible throughput per drive due to no mechanical movement Limited performance and I/O serving capability Very low latency per I/O and consistent I/O performance More power consumption due to mechanical operations High Energy efficiency • Lower power requirement per GB • Lower power requirement per IOPS Low mean time between failure (MTBF) High reliability due to no moving parts Higher TCO due to more number of Overall less TCO disks, power, cooling, and management cost EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 33

Host Access to Storage Networking Options Compute Application File System Storage Network Block-level Request Storage Network File-level Request Block-level Request File System Storage Direct-Attached Storage Block-level Access File-level Access EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Storage System Module 2: Data Center Environment 34

VMware ESXi • Industry’s leading hypervisor 4 Enable virtualization of x 86 hardware platforms • Physical machine that houses ESXi is called ESXi host 4 ESXi host abstracts physical compute resources to run multiple VMs concurrently on same physical server • Two Components 4 VMKernel 8 Work similar to OS – responsible for process creation, resource scheduling, and so on 4 Virtual machine monitor 8 Performs binary translation for privileged OS instructions that can not be virtualized EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 37

Module 2: Summary Key points covered in this module: • Key data center elements • Application and compute virtualization • Disk drive components and performance • Enterprise flash drives • Host access to storage EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 38

Exercise: Design Storage Solution for New Application • Scenario 4 Characteristics of new application: 8 Require 1 TB of storage capacity 8 Peak I/O workload 4900 IOPS 8 Typical I/O size is 4 KB 4 Specifications of the available disk drives: 8 15 K rpm drive with storage capacity = 100 GB 8 Average seek time = 5 ms 8 Data transfer rate = 40 MB/sec 4 As it is business critical application, response time must be within acceptable range • Task 4 Calculate the number of disks required for the application EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 2: Data Center Environment 39