TUNDRA The Ultimate Netflow Data Realtime Analysis Jeffrey

  • Slides: 15
Download presentation
TUNDRA The Ultimate Netflow Data Realtime Analysis Jeffrey Papen Yahoo! Inc. Confidential

TUNDRA The Ultimate Netflow Data Realtime Analysis Jeffrey Papen Yahoo! Inc. Confidential

TUNDRA Features 1. Source and Destination AS 5. Analyze usage for local servers or

TUNDRA Features 1. Source and Destination AS 5. Analyze usage for local servers or services bandwidth analysis Charge Back Billing 2. Transit AS bandwidth 6. Symmetric Network analysis Performance Analysis: latency and packet loss 3. Custom AS macros: Bandwidth forecasting, 7. AS path hop count stats peering merit analysis 8. DOS attack detection 4. Billing Formulas for cost/ 9. All in Real Time benefit budget analysis Yahoo! Inc. Confidential - 2

Why should you care about TUNDRA? 1. Empirical Data • • • Prove that

Why should you care about TUNDRA? 1. Empirical Data • • • Prove that network performance increases Prove that network reliability increases as AS hops decrease Cost/Savings analysis for new peer or transit 2. Know how much bandwidth a peer will use before (or after) you turn link up – determine private vs. public peering need 3. Focus and Order peer hit list – who should you go after? 4. Business case to document support for peers that say No. Yahoo! Inc. Confidential 3

Why Call It TUNDRA? Yahoo! Inc. Confidential 4

Why Call It TUNDRA? Yahoo! Inc. Confidential 4

Continuously exporting flows Router 49, 000 subnets Zebra Server processed in 2 – 3

Continuously exporting flows Router 49, 000 subnets Zebra Server processed in 2 – 3 minutes SNMP Poller Collector/ Processor Polls Interfaces. Stores to local DB My. SQL Database 500 Mb/sec in + out in 15 minutes generates approx 5, 244, 216 flows (288 MB). Processed in 21 seconds @ 248, 724 flows/sec Flow % * SNMP stored in central DB Yahoo! Inc. Confidential 5

Flow Data TUNDRA Displays Inbound Outbound Transit AS Bandwidth X X X Port X

Flow Data TUNDRA Displays Inbound Outbound Transit AS Bandwidth X X X Port X X Protocol X X Server (IP) X X AS Path X Yahoo! Inc. Confidential 6

Port Out Yahoo! Inc. Confidential 7

Port Out Yahoo! Inc. Confidential 7

Protocol Out Yahoo! Inc. Confidential 8

Protocol Out Yahoo! Inc. Confidential 8

Bandwidth Out Yahoo! Inc. Confidential 9

Bandwidth Out Yahoo! Inc. Confidential 9

Transit Data All outbound flows have destination IP Each Destination Subnet learns AS path

Transit Data All outbound flows have destination IP Each Destination Subnet learns AS path from Zebra BGP table - AS padding removed Zebra BGP table is identical to actual routes used on local router(s) Local BGP data reflects immediate policy changes with no performance impact or security threat to production routers Yahoo! Inc. Confidential 10

Destination vs. Transit Traffic – UUNet Yahoo! Inc. Confidential 11

Destination vs. Transit Traffic – UUNet Yahoo! Inc. Confidential 11

AS Hop Count Table AS Path Hop Count Router #1 Router #2 0 (Yahoo!)

AS Hop Count Table AS Path Hop Count Router #1 Router #2 0 (Yahoo!) 0% 0% 1 (Peering ISP) 0. 34715% 0. 10148% 2 15. 54806% 12. 42353% 3 46. 64506% 45. 17018% 4 27. 75107% 31. 07077% 5 7. 69483% 8. 94431% 6 1. 88979% 2. 18044% 7 0. 12290% 0. 10870% 8 0. 00004% 0. 00000% 9 0. 00109% 0. 00061% Yahoo! Inc. Confidential 12

Performance Analysis • ICMP Ping vs. TCP packet with bogus SYN/ACK • Testing is

Performance Analysis • ICMP Ping vs. TCP packet with bogus SYN/ACK • Testing is done from your network’s perspective • Route-Maps on collector interface • Simultaneous testing of multiple paths to same target AS • No continuous IBGP flapping from /32 updates • No adding and removing /32 static routes • No 3 rd party remote applications logging onto routers • Looking Glass server (www) for troubleshooting Yahoo! Inc. Confidential 13

TUNDRA Next Steps 1. White Paper – No, I really mean it! 2. I’m

TUNDRA Next Steps 1. White Paper – No, I really mean it! 2. I’m looking for help – this is a hobby, not my job 3. Maintainers to finish baking code and configuration 4. Release to Internet community 5. Licensing is GPL + please peer with Yahoo! Inc. Confidential 14

Questions? Jeffrey Papen jpapen@yahoo-inc. com jeffrey@papen. com Yahoo! Inc. Confidential 15

Questions? Jeffrey Papen [email protected] com [email protected] com Yahoo! Inc. Confidential 15