Jisc Tiered Storage Overview Status Initial interest for

Jisc Tiered Storage Overview

Status » Initial interest for storage expressed by SDC-North tenants » Concept explored with SDC-North tenants – workshop April › Leeds forecast they will require 46 Petabytes of data storage within 10 years - with an assumption that storage will 'move to the right' › Manchester will require 8 Petabytes within the next 3 -5 years (600 TB last year) » Informal discussions with NEI PDG, RDM, etc. » Informal vendor discussions » Formed Jisc POG (Project Oversite Group) » Draft Jisc Business Case » Requirements Workshop – November 2016 » Working Group – Feb 2017

Tiered Storage Proposal … ceph RDM Share Services Swift S 3 CIF https Applications NFS Customer Applications SMB i. SCSI Customer Infrastructure (e. g. VMWare Vsphere) Jisc Tiered Storage Service HSM Appliance • • HSM Data Policy Pool Prioritisation Replication Snapshots SLAs (e. g. retention, availability, security) Cloud Storage Pool Archival Storage Pool AWS Amazon Glacier Distributed Storage Pool Google Cloud 9 Arkivum 3

Tiered Storage - Proposal Pool Overview Class Copies Recovery Time Objective Recovery Point Objective Distributed Storage Pool Data stored near sites (based on SDC 1, SDC 2 and other locations e. g. national research e-infrastructure centres, other NRENs) to give onsitenearsite recovery times Use of erasure-encoding to give equivalence of 2 copies with ~1. 6 times storage capacity Reference model or “boxed solution” for campuses Lever Janet backbone to deliver Onsite equivalence Equivalent to 2 Copies including offsite Onsitenear site equivalent <1 Hour Cloud Storage Pool Managing data copies across multiple cloud providers Archive Equivalent to 2 Copies including offsite < 1 Hour 1 -24 Hour Archival Storage Pool Managing data copies across multiple cloud “vault” providers (i. e. 99% or 100% guaranteed data recovery) Vault Guaranteed recovery N/A

Matthew Dovey Jisc Technologies 02030 006 6016 Matthew. dovey@jisc. ac. uk Except where otherwise noted, this work is licensed under CC-BY-NC-ND