CMPE 252 A Computer Networks Chen Qian Computer

CMPE 252 A : Computer Networks Chen Qian Computer Science and Engineering UCSC Baskin Engineering 1

q Jupiter Rising: A Decade of Clos Topologies and Centralized Control in Google’s Datacenter Network v Arjun Singh, Joon Ong, Amit Agarwal, Glen Anderson, Ashby Armistead, Roy Bannon, Seb Boving, Gaurav Desai, Bob Felderman, Paulie Germano, Anand Kanagala, Hong Liu, Jeff Provost, Jason Simmons, Eiichi Tanda, Jim Wanderer, Urs Hölzle, Stephen Stuart, and Amin Vahdat (Google) 2

q Ten years ago, cost and operational complexity associated with datacenter network architectures was prohibitive. q Maximum network scale was limited by the cost and capacity of the highest-end switches 3

Traffic has increased 50 x in this time period, roughly doubling every year. 4

5

Google’s DCN in 2004 v 40 servers connected at 1 Gb/s to a To. R switch with approximately 10: 1 oversubscription in a cluster delivering 100 Mb/s (per host) among 20 k servers. v High bandwidth applications had to fit under a single To. R to avoid the heavily oversubscribed To. R uplinks. 6

v v Google realized that existing commercial solutions could not meet our scale, management, and cost requirements. Hence, they decided to build own custom data center network. 7

Clos topology 8

Firehose 1. 0 9

Firehose 1. 1 v v Firehose 1. 0 used server to house switch chips but with bad experience. Hence they built custom switch fabric 10

Watchtower and Saturn 11

Jupiter: A 40 G datacenterscale fabric 12

multiple clusters within the same building and multiple buildings on the same campus 5 -13