Kindura Project Pilot hybrid cloud storage solution for

Kindura Project Pilot hybrid cloud storage solution for research data. Objectives • Develop and pilot a hybrid cloud storage solution for research data at King’s and STFC • Study user requirements for large scale storage of research data. • Integrate multiple cloud services into Dura. Cloud application including • i. RODS • NGS cloud • Commercial cloud providers. • Private cloud (e. g. Based on Eucalyptus) • Develop brokerage services to provide mediation between storage providers. • Integrate digital repository to provide archival services for researchers. • Provide common services for such purposes as data replication, format conversion and digital preservation. • Provide integration with cloud compute services. Researcher Partners Centre for e-Research King’s College London Science and Technology Facilities Council Contacts simon. waddington @kcl. ac. uk Jens. jensen@stfc. ac. uk In partnership with enable durability and access to digital content. Dura. Cloud enables cloud storage across Dura. Cloud is an open multiple commercial and non technology developed by commercial providers. Dura. Space that makes it easy Kindura is the UK participant for organizations and end in the Dura. Cloud pilot users to use cloud services. programme. Dura. Cloud leverages existing cloud infrastructure to Storage System Architecture Kindura User interface Common services Generic storage services Storage and repository services Repository services Service broker Dura. Cloud Compute services i. RODS Pilot User Groups and Scenarios Kindura is determining user requirements based on studies with target user groups and disciplines. These include: • Environmental Science, including the monitoring and modelling of environmental change. This involves management of very large datasets, e. g. from remote sensing, real-time data feeds, and large scale simulations of environmental models. • Financial Mathematics. which uses dedicated high performance architectures such as grid. Mathematica or GPGPU methods to execute complex mathematical models, for scenarios such as contract pricings or risk computation. • Biomedical sciences, including crystallography (e. g. determination of protein structures from diffraction images), nanoimaging (e. g. microscopy techniques for cell biology), molecular neurobiology (e. g. determining factors influencing gene expression). • Humanities, in particular textual scholarship and manuscript studies. NGS Cloud AWS Private cloud Standards and Technology • Fedora Commons repository – used due to close integration with Dura. Cloud. • The project will monitor and evaluate emerging cloud standards including OGF Open Cloud Computing Interface (OCCI) SNIA Cloud Storage Initiative. • The projec t will use Eucalyptus as the basis of the private cloud infrastructure. • The project will develop an XML to express research data attributes that can be processed by the brokerage service. Supported by Flexible Services Delivery Programme