Fiber Channel over Ethernet Il protocollo e le

• What • Why • Designs and applications © 2010 Cisco and/or its

• FCo. E is I/O consolidation of FC storage traffic over Ethernet FC traffic shares Ethernet links with other traffics Requires a lossless Ethernet fabric Ethernet Fibre Channel Traffic © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 3

Fiber Channel over Ethernet Protocol Mapping • From a Fibre Channel standpoint it’s FC connectivity over a new type of cable called… Ethernet • From an Ethernet standpoints it’s Yet another ULP (Upper Layer Protocol) to be transported FC-4 ULP Mapping FC-3 Generic Services FC-2 Framing & Flow Control FC-1 Encoding FCo. E Logical End Point FC-0 Physical Interface Ethernet Media Access Control Ethernet Physical Layer © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 4

FCo. E 1, 2, 4, 8, 10, 16, (32) Gbps © 2010 Cisco and/or

Why? • Fewer CNAs (Converged Network adapters) instead of NICs, HBAs and HCAs • Limited number of interfaces for Blade Servers FC HBA FC Traffic © 2010 Cisco and/or its affiliates. All rights reserved. NIC LAN Traffic NIC Mgmt Traffic NIC Backup Traffic HCA IPC Traffic CNA All traffic goes over 10 GE Cisco Confidential 6

Why? Ethernet Model has Proven Benefits Ethernet Economic Model FC Economic Model • Embedded on Motherboard § Always a Stand-Up Card • Integrated into O/S § Specialized Drivers • Many Suppliers § Few Suppliers • Mainstream Technology • Widely Understood • Interoperability by Design © 2010 Cisco and/or its affiliates. All rights reserved. § Specialized Technology § Special Expertise § Interoperability by Test Cisco Confidential 7

Ethernet Header FCo. E Header FC Header 12 bytes (MAC addresses) + 4 bytes (802. 1 Q tag) 16 bytes FC Payload 24 bytes Tota l: 21 80 b ytes Up to 2112 bytes 4 bytes 1 byte (EOF) + 3 bytes (padding) CRC EOF FCS © 2010 Cisco and/or its affiliates. All rights reserved. 4 bytes Cisco Confidential 8

Fibre Channel over Ethernet (FCo. E) FCo. E Frame Format Bit 0 Destination MAC Address § FCo. E is a standard - June 3 rd 2009, the FC-BB-5 working group of T 11 completed its work and unanimously approved a final standard for FCo. E Source MAC Address (IEEE 802. 1 Q Tag) ET = FCo. E Reserved • Lossless Ethernet Matches the lossless behavior guaranteed in FC by B 2 B credits SOF Encapsulated FC Frame (with CRC) EOF Reserved FCS Byte 0 FC Payload CRC EOF FCS FC Header Byte 2197 FCo. E Header Ethernet Header © 2010 Cisco and/or its affiliates. All rights reserved. Ver Reserved • 10 Gbps Ethernet • Ethernet jumbo frames Max FC frame payload = 2112 bytes Bit 31 Cisco Confidential 9

IEEE DCB § Developed by IEEE 802. 1 Data Center Bridging Task Group (DCB) § All technically stable § Final standards expected by mid 2010 Standard / Feature Status of the Standard IEEE 802. 1 Qbb Priority-based Flow Control (PFC) In Sponsor Ballot IEEE 802. 3 bd Frame Format for PFC In Sponsor Ballot IEEE 802. 1 Qaz Enhanced Transmission Selection (ETS) and Data Center Bridging e. Xchange (DCBX) Under recirculation in order to go to Sponsor Ballot after the May interim IEEE 802. 1 Qau Congestion Notification Done! IEEE 802. 1 Qbh Port Extender In its first task group ballot CEE (Converged Enhanced Ethernet) is an informal group of companies that submitted initial inputs to the DCB WGs. © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 10

FCo. E Building Blocks Converged Network Adapter 10 Gb. E Link Ethernet Fibre Channel FC Driver bound to FC HBA PCI address Ethernet Driver bound to Ethernet NIC PCI address PCIe § Replaces multiple adapters per server, consolidating both Ethernet and FC on a single interface § Appears to the operation system as individual interfaces (NICs and HBAs) © 2010 Cisco and/or its affiliates. All rights reserved. Fibre Channel Drivers Ethernet Drivers Operating System Cisco Confidential 11

Virtualization VM I/O Virtualization and Consolidation 10 Gb. E/FCo. E Eth FC QP FC Eth 3 127 Compatibility Existing Driver Stacks Cost “Free” SAN Access for Any Ethernet Equipped Host 10 Gb. E/FCo. E v. NICs 0 1 2 PCIe x 16 © 2010 Cisco and/or its affiliates. All rights reserved. 10 Gb. E FC Software FCo. E PCIe Bus Cisco Confidential 12

FCo. E Building Blocks U Expansion Module Unified Ports 8 ports 1/10 GE + 8 ports 1/2/4/8 G FC 32 x Fixed ports 1/10 GE or 1/2/4/8 FC © 2010 Cisco and/or its affiliates. All rights reserved. 16 ports 1/10 GE Expansion Module Cisco Confidential 13

Legacy SAN A LAN I/O Consolidation with FCo. E SAN B LAN 4 x

Single Hop Design Extending the FCo. E Edge – Nexus 2232 SAN A SAN B Nexus 5548 Nexus 5000 FCF-A Nexus 2232 © 2010 Cisco and/or its affiliates. All rights reserved. Nexus 2232 10 GE FEX Nexus 5000 FCF-B Nexus 2232 10 GE FEX Cisco Confidential 15

Multi-Tier FCo. E • The goals are: SAN A SAN B To expand I/O consolidation into the backbone To introduce the support for native FCo. E Storage array Backbone Native FCo. E Storage array © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 16

Director Class Solutions Fixed Solutions NEW Nexus 5596 UP NEW MDS 9500 Nexus 7000 NEW Nexus 5020 NEW Nexus 5548 UP F 1 32 -port FCo. E 8 -port Nexus 2232 Nexus 5010 Nexus 4000 NX-OS & DCNM 2010 Ciscoand/oritsitsaffiliates. All Allrightsreserved. ©© 2010 Cisco Confidential 17

A single network, instead of three! Memory I/O Subsystem LAN I/O IPC I/O Storage I/O LAN Memory IPC Processor Storage Processor IPC: Inter Process Communication © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 18

A single system to unify compute, network and storage resources access under a single management SAN A LAN SAN B y log gy o hn olo y ec chn log t o. E k te hno C F Lin tec X k FE Lin VN Unified Network Mgmt Chassis Mgmt Hypervisor OS © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 19

Thank you.