HPMPI Changqing Tang Senior Engineer Apr 8 2008

HP-MPI Changqing Tang Senior Engineer Apr. 8, 2008 © 2006 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice

Agenda HP-MPI in general • OFED support and features • Wish list for OFED. • 2 12/19/2021 HP Confidential

HP-MPI: Industry’s Standard Commercial High Performance MPI • Portable, Robust, Fast, Supported, Available − vendor independent MPI optimized for all leading architectures, OSs, switches, applications (see below) • Ideal for Customers − freely distributed by >25 ISVs for industry-standard Linux clusters; for Window. CCS in 2007 − for developers on in-house applications, HP-MPI licenses are included in XC operating environment • Ideal for Independent Software Vendors (ISVs) − reduces platform test matrix; reduces customer complaints; supported by HP experts Supported Operating Systems ISVs Distributing HP-MPI on Industry-Standard Linux Clusters Supported Architectures Molpro University of Cardiff 3 Supported 12/19/2021 Switches HP Confidential

Interconnect Hardware Supported • Quadrics Qs. Net Myrinet 2 G/10 G • Infiniband • 10 Gigabit Ethernet • 4 12/19/2021 HP Confidential

Interconnect Protocol Supported • • • 5 SHM – Shared-Memory Communication Within Node TCP – TCP/IP On Every System, IPo. IB, etc. ELAN – Quadrics elan 3 & elan 4 GM – legacy message-passing system for Myrinet networks MX – Myrinet Express PSM – Pathscale Message on Qlogic IB hardware VAPI – Mellanox Infiniband Verbs API IBV – OFED Infiniband Verbs UDAPL – User Direct Access Programming Library ITAPI – Interconnect Transport API (HP-UX only) IBAL – Infiniband Access Layer (Windows only) 12/19/2021 HP Confidential

HP-MPI Infiniband History • 2. 0 -- IT-API Infiniband on HP-UX • 2. 1 -- VAPI/u. DAPL on Linux Infiniband • 2. 2. 5 – OFED 1. 0 and OFED 1. 1 • 2. 2. 5. 1 – OFED 1. 2 plus 1. 1 and 1. 0, work with 1. 2. 5 and 1. 3 • 2. 2. 7 – Come out this Apr. , Support all OFED releases and all major features. • 2. 3 – sync with OFED 1. 4 6 12/19/2021 HP Confidential

Message Transfer Protocols • RDMA Protocol Send/Receive Protocol • Shared-Receiving-Queue (SRQ) Protocol • 7 12/19/2021 HP Confidential

Misc. Features • Connection Fail[over] • Automatic Path Migration (APM) Message Striping • IB Partitioning • Message Coalescing in 2. 2. 7 • SHM/NIC/MIX mode within node • 8 12/19/2021 HP Confidential

Misc. Features (cont. ) • CPU Binding – Rank, Cyclic, … • XRC support in 2. 2. 7 u. DAPL 2. 0 support in 2. 2. 7 (1. 1 and 1. 2 as well) • i. WARP support via u. DAPL protocol • One-side operation using RDMA write/read • Distributed lock/unlock using IB atomic operations • 9 12/19/2021 HP Confidential

Misc. Features (cont. ) • Dynamic processes over OFED • Singleton MPI Process • HA HP-MPI, where no teardown if partial ranks exit 10 12/19/2021 HP Confidential

Features Available Soon in 2. 3 Release • Anyway, OFED 1. 4 • i. WARP support via rdma_cm + verbs On-demand connection • IPV 6 support • Multi-path IB • 11 12/19/2021 HP Confidential

Binary Compatible HP-MPI is not open source, and always dlopen() libibverbs. so • We already have 1. 0 and 1. 1 code compiled against each version of header file • We detect the version on system and use the appropriate code version • 12 12/19/2021 HP Confidential

Reliable Datagram (RD) UD with complicated logic to implement ondemand connection. • RD will simplify MPI code • RDS can benefit from it • Sure there are other wide-range usage. • 13 12/19/2021 HP Confidential

Reliable Multi-cast • Simplify MPI collective implementation • Improve MPI collective performance 14 12/19/2021 HP Confidential

SA/Open. SM feature A rank can query the port lid on remote node, with knowing the GUID of the remote HCA • Communication path query • Path Recovery Notification • Use to implement network recovery in MPI • 15 12/19/2021 HP Confidential

Multi-fabrics support • Used in non-stop system • HP-MPI needs different subnets • IP-bonding not work on two subnets ? SW 2 SW 1 n 0 16 12/19/2021 n 1 HP Confidential n 2 n 3 n 4 n 5 n 6 n 7

Thank You ! • http: //www. hp. com/go/mpi • Question ? 17 12/19/2021 HP Confidential

Back-up © 2006 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice