Innovating Software Defined Storage with ZFS Innovating Software

Innovating Software Defined Storage with ZFS

Innovating Software Defined Storage with ZFS About Steve Umbehocker is the founder and CEO of OSNEXUS, a software engineer, a 22 year enterprise storage industry veteran, and has over 20 patents granted in the areas of cloud and storage virtualization technologies. Steve started in the storage industry at Veritas Software in 1997 where he contributed to the development of the industry’s first software-defined-storage platform which was based on Solaris and Veritas Vx. FS/Vx. VM. company confidential www. osnexus. com info@osnexus. com 2

Storage System Evolution company confidential www. osnexus. com info@osnexus. com 3

Evolution of IT Deployments Central IT + Remote Office Co-Los / Datacenters / Hybrid Cloud / Public Cloud company confidential www. osnexus. com info@osnexus. com 4

Managing Data Flow, Security, Availability Co-Los / Datacenters / Hybrid Cloud / Public Cloud company confidential www. osnexus. com info@osnexus. com 5

Design & Planning / Quanta. Stor SDS • • • Must be Linux based so that it can leverage the latest hardware innovations Must have advanced security features so IT organizations can trust it. Must be completely API driven / Service Oriented Architecture Must scale-out without bounds across servers, racks and datacenters Must leverage, extend, and contribute to open-source storage technologies ext 3? btrfs? xfs? jfs? ZFS company confidential www. osnexus. com info@osnexus. com 6

Why ZFS? Filesystem Volume Manager Replication Reliability company confidential www. osnexus. com info@osnexus. com 7

Quanta. Stor SDS Overview What is Quantastor? : Quanta. Stor is OSNEXUS’s Linux based SDS platform which bare-metal installs on x 64 servers. Storage Grid Technology: Quanta. Stor’s unique grid technology links appliances together so that they are easily managed as a federated entity across sites and datacenters. Unified: NFSv 3 & v 4, SMB 2 & SMB 3, i. SCSI, i. SER, FC, S 3 Object company confidential www. osnexus. com info@osnexus. com 8

Scriptable QS CLI Scaling-out ZFS with Grid Technology QS REST API Quanta. Storage Grid DALLAS Datacenter LONDON Datacenter Quanta. Stor AMSTERDAM Datacenter Quanta. Stor VSAs Quanta. Stor ON-PREMISIS LOCATION Quanta. Stor’s control-plane technology combines systems into a federated storage grid which can span sites and datacenters. company confidential www. osnexus. com info@osnexus. com 9

Quanta. Stor ZFS based hyper-scale Storage Grids Storage Grid 2 GB/sec 120 GB/sec company confidential 100 TB 100 PB www. osnexus. com info@osnexus. com 10

Quanta. Stor SDS Overview End-to-end Encryption Scriptable QS CLI Backup Policies Complete REST API Active Directory Integrated VMware Certified VAAI Integrated Data Compression NFS & SMB Cloud Storage NFS & SMB File Storage i. SCSI / FC Block Storage S 3 & SWIFT Object Storage Integrations • VMware VAAI (migration) • Solar. Winds (backup) • Sophos AV (backup) • Commvault (backup) • Microsoft VSS (backup) • Docker (provisioning) • Open. Stack (provisioning) • Nagios (monitoring) • Splunk (monitoring) • IDERA (monitoring) • Librato (monitoring) • AVID (editing) • SNMP (call-home) • Pager. Duty (call-home) • SMTP / Email (call-home) • Slack (call-home) • Skype (call-home) Thin/Over Provisioning CEE Compliant Audit Logging Snapshots / Cloning Security Compliance NIST 800 -53, HIPAA, CJIS FIPS 140 -2 L 1* Quanta. Stor Qo. S Controls Quanta. Stor DR / Remote Replication Flash Accelerated company confidential www. osnexus. com info@osnexus. com 11

Quanta. Stor Grid Management / WUI company confidential www. osnexus. com info@osnexus. com 12

Quanta. Stor Grid Management / WUI company confidential www. osnexus. com info@osnexus. com 13

Certified Reference Configurations Deploy and expand your multi-rack, multi-site storage grid on a heterogenous mix of hardware from all major server vendors. HPE Certified on DL 380 & Apollo 4510 Dell OEM Certified on R 740 Cisco IVT Certified on S 3260 Supermicro X 9/X 10/X 11 company confidential www. osnexus. com info@osnexus. com 14

Multi-vendor Hardware Integrated company confidential www. osnexus. com info@osnexus. com 15

Case Studies Terra. Power is a Gates. Foundation funded company developing next generation clean nuclear reactors that will use spent fuel rods from older reactors to extract unused energy and reduce nuclear waste. Terra. Power has a large Windows based HPC cluster that uses Quanta. Stor highly-available storage appliances configured with multiple HPE SANs behind it. Quanta. Stor appliances aggregate capacity and performance to meet the high-performance SMB protocol requirements for their HPC cluster. Health-care provider with over 16 sites using mix of IBM AIX and Linux servers. Required next-gen storage option to replace aging Net. App systems for internal applications and disk-to-disk backup. Information Sciences Institute required flexible storage for cancer research R&D. Research applications produce millions of files stored in Quanta. Stor appliances to provide “google earth” style visibility into micro features, cancer cells. Quanta. Stor SDS has been rolled out for a broad spectrum of research projects at ISI. USC uses the OSNEXUS Cloud License Service so that they can redeploy and reassign storage assets to different researchers and research groups at will. Dynamic transcoding and processing of sports data streams to produce game highlights delivered directly to mobile phone platform. Quanta. Stor is an integral part of all the processing stages with the final output transferred up to a global cloud based content delivery network (CDN). company confidential www. osnexus. com info@osnexus. com 16

Quanta. Stor SDS Value Proposition Proprietary Pros: Fast deployment Low labor requirements Cons: Proprietary HW/SW lock-in High price per TB Fork-lift upgrades Short-term innovation • • Unified NAS, SAN & Object Grid Technology Fast deployment Low labor requirements Long-term innovation Automation / API driven Reduces costs by 50%+ company confidential Open Pros: Lower HW/SW Costs Long-term innovation Cons: High deployment complexity Difficult to operationalize High labor costs www. osnexus. com info@osnexus. com 17

Roadmap 2018 • General • Platform upgrades / 4. 4 kernel, Ceph Luminous upgrade, i. SER protocol support • Advanced Ceph CRUSH map management for multi-site object storage clusters • Data mover / Backup Policy enhancements for automated storage tiering • Security • FIPS 140 -2 Certification • Multi-factor Authentication • Active-Directory Single-Sign-On • KMIP integration for encryption key management • Analytics • Volume and Pool level real-time stats graphing of IOPS, MB/s, Latency • Remote replication real-time stats graphing of MB/s transfer speed • Object Storage cluster real-time stats graphing for MB/s • Grid Configuration Health Check • Performance • NVMe JBOF mode with i. SER • Multi-tenancy • Improved multi-tenancy features / LUN scoping to Resource Group / VLAN • Integrations • VMware VASA/VOL/SRM integration company confidential www. osnexus. com info@osnexus. com 18

Q&A company confidential www. osnexus. com info@osnexus. com 19