Infini Band HW Architecture Infini Band Unified Fabric

Infini. Band HW Architecture Infini. Band Unified Fabric Hosts Storage 1 Infini. Band Switch 2 Network 3. . Router n Infini. Band Architecture HCA Link Cntlr Mem n. CPU Cntlr HCA Link 3 CPUMem Switch x. CA Router ü Unified fabric for IPC, Networking, and Storage ü Channel based interconnect üClosely integrated with Mem Ctrlr ü Qo. S (Service Levels, Virtual Lanes) • Physical Layer Link • Fabric Transactions ü Automatic fail-over in switch ü Support for redundant fabrics Link 2 CPUMem Cntlr Link HCA ü 64 K nodes per sub-net ü Multiple subnets bridged w/routers ü IPv 6 addressing x-subnet • Reliability Storage Target TCA Mem 1 CPU Cntlr • Topology ü Switched Fabric (vs shared bus) Link TCA N/W Target ü Cost Effective Four wire link (2 pairs) üEnables volume deployments ü 2. 5 Gb/sec signaling rate ü Copper & Fiber support ü Multiple link widths ü 1 x 2. 5 Gbits/sec ü 4 x 10 Gb/sec ü 12 x 30 Gb/sec 1

2

3

Virtual Lane (VL) Packets De. Mux Packets z Multiplex multiple independent data streams onto a single physical link which provides: y. Differentiated services on a packet-boundary basis y. Increase fabric utilization in the face of head-of-line blocking on a given VL and via VL-based routing across multiple paths y. Support for up to 16 VLs with 1 VL reserved for fabric management y. Implementations shall support a minimum of 1 VL application usage and 1 VL for fabric management 4

Messages & Packets Transaction Message Packet Packet z Applications, drivers, devices, adapters, etc. execute transactions via logical units of work termed messages. z H/W-based memory / resource protection to prevent unauthorized access to messages z Message semantics supported are: y Memory - RDMA Read / Write y Channel - Send / Receive y Atomics (optional functionality) y Multicast (optional functionality) z Infini. Band technology H/W provides automatic message segmentation and re-assembly via packets y End-to-end fabric unit of transfer 5

6

7