15 744 Computer Networking L14 Data Center Networking
- Slides: 43
15 -744: Computer Networking L-14 Data Center Networking III
Overview • Data Center Electric/Hybrid Networks • Data Center Transport • Data Center Scheduling 2
Design requirements Traffic demands Control plane: – Traffic demand estimation – Optical circuit configuration Data plane: – Dynamic traffic de-multiplexing – Optimizing circuit utilization (optional) 3
c-Through (a specific design) No modification to applications and switches Leverage endhosts for traffic management Centralized control for circuit configuration 4
c-Through - traffic demand estimation and traffic batching Applications Per-rack traffic demand vector Socket buffers 1. Transparent to applications. 2. Packets are buffered per-flow to avoid HOL blocking. Accomplish two requirements: – Traffic demand estimation – Pre-batch data to improve optical circuit utilization 5
c-Through - optical circuit configuration Traffic demand Controller configuration Use Edmonds’ algorithm to compute optimal configuration Many ways to reduce the control traffic overhead 6
c-Through - traffic de-multiplexing VLAN #1 VLAN-based network isolation: – No need to modify switches – Avoid the instability caused by circuit reconfiguration VLAN #2 traffic Traffic control on hosts: – Controller informs hosts about the circuit configuration Traffic de-multiplexer – End-hosts tag packets accordingly VLAN #1 7 VLAN #2
Overview • Data Center Electric/Hybrid Networks • Data Center Transport • Data Center Scheduling 8
Data Center Packet Transport • Large purpose-built DCs • Huge investment: R&D, business • Transport inside the DC • TCP rules (99. 9% of traffic) • How’s TCP doing? 9
TCP in the Data Center • We’ll see TCP does not meet demands of apps. • Suffers from bursty packet drops, Incast [SIGCOMM ‘ 09], . . . • Builds up large queues: Ø Adds significant latency. Ø Wastes precious buffers, esp. bad with shallow-buffered switches. • Operators work around TCP problems. ‒ Ad-hoc, inefficient, often expensive solutions ‒ No solid understanding of consequences, tradeoffs 10
Partition/Aggregate Application Structure 1. Picasso Art is… TLA …. . 2. Art is a lie… Deadline = 3. 250 ms Picasso • Time is money MLA ……… MLA 1. Ø Strict deadlines (SLAs) 2. The chief… 3. …. . • Missed deadline Deadline = 50 ms 1. Art is a lie… Ø Lower quality result “Everything “The “It“I'd is “Art “Computers “Inspiration your chief like “Bad isto you awork enemy lie live artists can that in as are does of imagine life acopy. makes useless. creativity poor that exist, man us is the real. ” is Deadline They but=can itwith ultimate Good must realize only good lots artists find give seduction. “ of the sense. “ you money. “ you truth. steal. ” working. ” answers. ” 10 ms Worker Nodes 11
Generality of Partition/Aggregate • The foundation for many large-scale web applications. • Web search, Social network composition, Ad selection, etc. Internet • Example: Facebook Web Servers Partition/Aggregate ~ Multiget • Aggregators: Web Servers • Workers: Memcached Servers Memcached Protocol Memcached Servers 12
Workloads • Partition/Aggregate (Query) • Short messages [50 KB-1 MB] (Coordination, Control state) • Large flows [1 MB-50 MB] (Data update) Delay-sensitive Throughput-sensitive 13
Incast: Cluster-based Storage Systems Synchronized Read 1 R R 2 Client 1 2 3 Switch 3 4 Client now sends next batch of requests 4 Storage Servers Data Block Server Request Unit (SRU)
Incast Worker 1 • Synchronized mice collide. Ø Caused by Partition/Aggregate. Aggregator Worker 2 Worker 3 RTOmin = 300 ms Worker 4 TCP timeout 15
Queue Buildup Sender 1 • Big flows buildup queues. Ø Increased latency for short flows. Receiver Sender 2 • Measurements in Bing cluster Ø For 90% packets: RTT < 1 ms Ø For 10% packets: 1 ms < RTT < 15 ms 16
Data Center Transport Requirements 1. High Burst Tolerance – Incast due to Partition/Aggregate is common. 2. Low Latency – Short flows, queries 3. High Throughput – Continuous data updates, large file transfers The challenge is to achieve these three together. 17
Tension Between Requirements High Throughput High Burst Tolerance Low Latency Deep Buffers: Ø Queuing Delays Increase Latency Shallow Buffers: Ø Bad for Bursts & Throughput Reduced RTOmin (SIGCOMM ‘ 09) Ø Doesn’t Help Latency AQM – RED: Ø Avg Queue Not Fast Enough for Incast Objective: Low Queue Occupancy & High Throughput 18
Review: The TCP/ECN Control Loop Sender 1 ECN = Explicit Congestion Notification ECN Mark (1 bit) Receiver Sender 2 19
Two Key Ideas 1. React in proportion to the extent of congestion, not its presence. ü Reduces variance in sending rates, lowering queuing requirements. ECN Marks TCP DCTCP 10111 Cut window by 50% Cut window by 40% 000001 Cut window by 50% Cut window by 5% 2. Mark based on instantaneous queue length. ü Fast feedback to better deal with bursts. 18
Data Center TCP Algorithm B Switch side: • Mark packets when Queue Length > K. Mark K Don’t Mark Sender side: – Maintain running average of fraction of packets marked (α). In each RTT: Ø Adaptive window decreases: – Note: decrease factor between 1 and 2. 19
(Kbytes) DCTCP in Action Setup: Win 7, Broadcom 1 Gbps Switch Scenario: 2 long-lived flows, K = 30 KB 20
Why it Works 1. High Burst Tolerance ü Large buffer headroom → bursts fit. ü Aggressive marking → sources react before packets are dropped. 2. Low Latency ü Small buffer occupancies → low queuing delay. 3. High Throughput ü ECN averaging → smooth rate adjustments, low variance. 21
Conclusions • DCTCP satisfies all our requirements for Data Center packet transport. ü Handles bursts well ü Keeps queuing delays low ü Achieves high throughput • Features: ü Very simple change to TCP and a single switch parameter. ü Based on mechanisms already available in Silicon. 27
Overview • Data Center Electric/Hybrid Networks • Data Center Transport • Data Center Scheduling 25
Datacenters and OLDIs § OLDI = On. Line Data Intensive applications § e. g. , Web search, retail, advertisements § An important class of datacenter applications § Vital to many Internet companies OLDIs are critical datacenter applications
OLDIs • Partition-aggregate • Tree-like structure • Root node sends query • Leaf nodes respond with data • Deadline budget split among nodes and network • E. g. , total = 300 ms, parents-leaf RPC = 50 ms • Missed deadlines incomplete responses affect user experience & revenue
Challenges Posed by OLDIs Two important properties: 1) Deadline bound (e. g. , 300 ms) • Missed deadlines affect revenue 2) Fan-in bursts § Large data, 1000 s of servers § Tree-like structure (high fan-in) § Fan-in bursts long “tail latency” § Network shared with many apps (OLDI and non-OLDI) Network must meet deadlines & handle fan-in bursts
Current Approaches TCP: deadline agnostic, long tail latency § Congestion timeouts (slow), ECN (coarse) Datacenter TCP (DCTCP) [SIGCOMM '10] § first to comprehensively address tail latency § Finely vary sending rate based on extent of congestion § shortens tail latency, but is not deadline aware § ~25% missed deadlines at high fan-in & tight deadlines DCTCP handles fan-in bursts, but is not deadline-aware
D 2 TCP Deadline-aware and handles fan-in bursts Key Idea: Vary sending rate based on both deadline and extent of congestion § Built on top of DCTCP § Distributed: uses per-flow state at end hosts § Reactive: senders react to congestion § no knowledge of other flows
D 2 TCP’s Contributions 1) Deadline-aware and handles fan-in bursts § Elegant gamma-correction for congestion avoidance § far-deadline back off more near-deadline back off less § Reactive, decentralized, state (end hosts) 2) Does not hinder long-lived (non-deadline) flows 3) Coexists with TCP incrementally deployable 4) No change to switch hardware deployable today D 2 TCP achieves 75% and 50% fewer missed deadlines than DCTCP and D 3
Coflow Definition
33
34
35
36
37
38
39
40
Data Center Summary • Topology • Easy deployment/costs • High bi-section bandwidth makes placement less critical • Augment on-demand to deal with hot-spots • Scheduling • • Delays are critical in the data center Can try to handle this in congestion control Can try to prioritize traffic in switches May need to consider dependencies across flows to improve scheduling 41
Review • Networking background • OSPF, RIP, TCP, etc. • Design principles and architecture • E 2 E and Clark • Routing/Topology • BGP 42
Review • Resource allocation • Congestion control and TCP performance • FQ/CSFQ/XCP • Network evolution • • Overlays and architectures Openflow and click SDN concepts NFV and middleboxes • Data centers • • Routing Topology TCP Scheduling 43
- 18 446 744 073 709 551 615
- Arm-744
- Ipx 744
- Cs 744
- Ley 16 744
- Flex data center
- Arista gartner
- Software defined networking vs traditional networking
- Poznan supercomputing and networking center
- Jacobson/karels algorithm
- How to calculate subnet mask
- Computer networking 101
- An engineering approach to computer networking
- Computer networking terms
- Evolution of computer networking
- Computer networking 8th edition
- Analog and digital signals in computer networking
- Kurose ross computer networking
- Computer networking
- "computer networking"
- An engineering approach to computer networking
- "computer networking"
- Backbone network components
- Business data communications and networking
- Jellyfish networking data centers randomly
- Computer networks assignment
- Introduction to data communications and networking
- Business data communications and networking
- Dns computer center
- Online computer library center
- Ocw
- Dns computer center
- Architecture of windowing system
- Cis.nctu.edu.tw webmail
- Computer center
- Iya abubakar abu zaria
- Qu firewall
- Hwlin
- Ntust oia
- Objective of computer system
- Difference between a computer and computer system
- Monitor printer speaker and projector are blank devices
- Structure of computers
- Computer organization and computer architecture difference