DPM efficient storage in diverse environments M Hellmich

DPM - efficient storage in diverse environments M. Hellmich, O. Keeble, F. Furano, A. Manzi, A. Ayllon, I. Calvet, R. Rocha, M. Regala CHEP 2013 Amsterdam IT-SDC : Support for Distributed Computing

Experiment with storage § Scaling the Architecture § Raspberry Pi § Virtual Machines § Bare Metal Servers § Evaluate the outcomes § Performance per Watt, Dollar IT-SDC CHEP 2013 15 Oct 2013 2

Storage IT-SDC CHEP 2013 15 Oct 2013 3

This talk is a reaction § Change in our software § Change in computing services § Change in available hardware IT-SDC CHEP 2013 15 Oct 2013 4

Our software: DPM MD Disk IT-SDC Disk CHEP 2013 DB Disk 15 Oct 2013 5

Our software: New DPM any. DB MD GW Disk IT-SDC S 3 Ceph CHEP 2013 GW HDFS 15 Oct 2013 6

Computing Services any. DB Metadata Reqs § network § CPU § memory MD Disk IT-SDC GW S 3 ceph CHEP 2013 Gateway Reqs § >> network § CPU § memory GW HDFS 15 Oct 2013 7

Available Hardware: ARM § Low power consumption § also when idle IT-SDC CHEP 2013 15 Oct 2013 8

So we focused on Metadata any. DB MD MD GW S 3 IT-SDC MD ceph CHEP 2013 15 Oct 2013 9

The Metric § requests/sec served, pure and simple § Stat requests for files § Deputy for other calls § Tested over http IT-SDC CHEP 2013 15 Oct 2013 10

The Setup t t client MD MD DB client MD Disk IT-SDC CHEP 2013 15 Oct 2013 11

Performance Comparison Raspi CERN Openstack VM EC 2 medium VM Bare metal 4 core 25. 8 394. 18 162. 27 1701. 23 3 x Raspi 3 x CERN Openstack VM Requests/sec 71. 30 1087. 0 Scaling 2. 76 2. 75 Requests/sec IT-SDC CHEP 2013 15 Oct 2013 12

Scaling up with Memcached Raspi 3 x Raspi Requests/sec direct 25. 8 71. 30 Requests/sec with Memcached 58. 47 152. 16 VM* 3 x VM* Requests/sec direct 394. 18 1087. 0 Requests/sec with Memcached 764. 02 *VMs are Open. Stack VMs IT-SDC CHEP 2013 15 Oct 2013 13

Total Cost of Ownership TCO = Cost Machines + Cost Running Machines = Cost Maintenance + Cost Replacement + Cost Power + Cost External Components Cost Software. Dev IT-SDC CHEP 2013 15 Oct 2013 14

Performance per Watt Raspi CERN Open. Stack VM Requests/sec 25. 8 394. 18 Consumption [W] 3. 5 30 Requests/sec/watt 7. 37 13. 1 IT-SDC CHEP 2013 15 Oct 2013 15

Performance per Euro Raspi VM EC 2 Medium Requests/sec 25. 8 394. 18 162. 27 Buying Price 25 4282 - Power Cost over 3 years 12 4. 89 Euros 41. 94 - Cost over 3 years 1 29. 89 Euros (+100) 469. 94 (+100) 1297. 2 500 Request/sec over 3 years 750 3891 Note Rasp 940 external equipment is much more expensive! 1 2 Buying Price + Power Costs or EC 2 Pricing (reserved instance) 12 VMs running on DELL Power. Edge M 620 24 core 16 GB RAM, price from website IT-SDC CHEP 2013 15 Oct 2013 16

Working with a Raspberry § Smallest possible machine § But very good for testing IT-SDC § Runs EPEL software* CHEP 2013 15 Oct 2013 17

Summary § Evaluation of a DPM metadata server § VMs do well § Especially with memcached § Raspberries work § Are even competitive § ARM may become very useful for storage IT-SDC CHEP 2013 15 Oct 2013 18

Questions? THANK YOU VERY MUCH IT-SDC CHEP 2013 15 Oct 2013 19