Engineering a Content Delivery Network Bruce Maggs Network
Engineering a Content Delivery Network Bruce Maggs
Network Deployment 175000+ 1300+ 100+ Servers Networks Countries Current Installations
Akamai Statistics • Peak bit rate: over 33 trillion bps (4 -14 -2015) • Peak IPv 4 HTTP daily requests: over 2. 7 trillion (5 -13 -15) • Peak IPv 6 HTTP daily requests: over 50 billion • 812 million unique IPv 4 addresses connected to Akamai in Q 1 2015
Part I: Services http: //www. microsoft. com (DNS) http: //www. facebook. com (images) http: //windowsupdate. microsoft. com http: //www. apple. com/quicktime/whatson http: //www. fbi. gov (DDo. S protection)
Design Themes • Redundancy • Self-assessment • Fail-over at multiple levels • Robust algorithms
First. Point – DNS (e. g. , Microsoft!) • Selects from among several mirror sites operated by content provider
Embedded Image Delivery (e. g. , Facebook) Embedded URLs are Converted to ARLs <html> <head> <title>Welcome to xyz. com!</title> </head> ak <body> <img src=“ http: //www. xyz. com/logos/logo. gif”> <img src=“ http: //www. xyz. com/jpgs/background. jpg”> <h 1>Welcome to our Web site!</h 1> <a href=“page 2. html”>Click here to enter</a> </body> </html>
Akamai DNS Resolution 4 xyz. com 510. 123. 5 xyz. com’s nameserver akamai. net 8 a 212. g. akamai. net 7 6 . com. net Root (Verisign) 9 15. 125. 6 ak. xyz. com 10 g. akamai. net 20. 123. 55 11 select cluster Akamai High-Level DNS Servers 12 a 212. g. akamai. net Local Name Server End User 16 Browser ’s Cache 14 3 1 2 15 OS 30. 123. 5 13 Akamai Low-Level DNS Servers select servers within cluster
Live Streaming Architecture 1 x 2 3 4 Satellite Downlink Satellite Uplink X 1 2 3 4 Encoding Entry Point 1 X 2 X 3 4 X X x 1 2 Top-level reflectors 3 4 Regions
Site. Shield (www. fbi. gov) A K A M A I Content provider’s website Hacker! A K A M A I Hacker!
Part II: Failures 1. Hardware 2. Network 3. Software 4. Configuration 5. Misperceptions 6. Attacks
Hardware / Server Failures Linux boxes with large RAM and disk capacity, Windows servers Sample Failures: 1. Memory SIMMS jumping out of their sockets 2. Network cards screwed down but not in slot 3. Etc.
Akamai Cluster Servers pool resources • RAM • Disk • Throughput
View of Clusters buddy suspended hardware failure odd man out suspended datacenter
Network Failures E. g. , congestion at public and private peering points, misconfigured routers, inaccessible networks, etc.
Core Points X 1 2 3 4 • Core point X is the first router at which all paths to nameservers 1, 2, 3, and 4 intersect. • X can be viewed as the straddling the core and the edge of the network.
Core Points 500, 000 nameservers reduced to 90, 000 core points 7, 000 account for 95% end-user load
Engineering Methodology • C programming language (gcc). • Reliance on open-source code. • Large distributed testing systems. • Burn-in on “invisible” system. • Staged rollout to production. • Backwards compatibility.
Perceived Failures Examples 1. 2. 3. 4. Personal firewalls Reporting tools Customer-side problems Third-party measurements
- Slides: 20