Procuring Open Compute Hardware Olof Brring CERN IT

Procuring Open Compute Hardware Olof Bärring CERN IT 13/4/2015 Procuring Open Compute Hardware 1

Agenda Open compute • What is it? • Why is it interesting? • How to buy? • Lessons learned 13/4/2015 Procuring Open Compute Hardware 2

History Started by Facebook in 2011 “…most efficient server, storage and data centre hardware designs for scalable computing” Foundation board Facebook, Intel, Microsoft Rackspace, Arista Networks Goldman Sachs opencompute. org 13/4/2015 Procuring Open Compute Hardware 3

Why • Hardware is designed for better ü ü • Interoperability Energy efficiency Cost Serviceability Open ü Not only hardware* * https: //code. facebook. com/posts/1601610310055392/introducing-openbmc-an-open-software-framework-for-next-generation-system-management/ 13/4/2015 Procuring Open Compute Hardware 4

First try • In 2013 • • Two Hyve OCP 1500 twins ~25% power gain 13/4/2015 Procuring Open Compute Hardware 5

Further motivation More power gains Ø Rack with DC distribution Ø Centralized AC/DC conversion Probe market Ø Supplier ecosystem Ø Large volume price comparison 13/4/2015 Procuring Open Compute Hardware 6

Who can supply? “Solution providers” Gold Membership + fee* @CERN : “country of origin” is member-state Ø Integrator + solution provider * opencompute. org/community/get-involved/tiered-membership/ 13/4/2015 Procuring Open Compute Hardware 7

What to buy? • 13/4/2015 Procuring Open Compute Hardware 8

How much q q q 40 k. HS 06* 12 x JBODs (~2 petabytes) 6 x racks • • • <7 k. W / rack Assembled and cabled Our network switches The rack is the unit! 13/4/2015 *HS 06 = HEP-SPEC 06 2 x E 5 -2630 v 3 ~360 HS 06 Procuring Open Compute Hardware 9

Relative price $/HS 06 Ø Compare to 250 k. HS 06 contracts in 2014 (E 5 -26 xx v 3 in both) Ø Ø Compute alone: x 1. 06 Compute in assembled rack: x 1. 30 $/TB Ø Compare to 25 PB contracts in 2014: ~x 1. 14 (6 TB vs 4 TB) Apples to apples: Compute: +6% for 6 x less volume Storage: +14% for 12 x less volume 13/4/2015 Procuring Open Compute Hardware 10

Lessons Open ≠ unique • Qualifying suppliers • Certification - early days • At the end of the tunnel Ø Saving cost & power Ø Standardization 13/4/2015 Procuring Open Compute Hardware 11