Shelf Management IPMI www samwayelectronic com Shelf Management

Shelf Management & IPMI www. samwayelectronic. com Shelf Management & IPMI SRS related activities Mihai Savu Samway Electronic Bucharest -ROMANIA mihai. savu@samwayelectronic. com

Shelf Management & IPMI PICMG and VITA Standards CPCI ATCA Micro. TCA CPCI-S VME VPX

Shelf Management & IPMI Evolution of PICMG Standards 40 Gb/s DATA RATE PICMG 3. 0 Micro TCA 10 Gb/s Advanced. TCA MTCA. 0 R 1. 0 CPCI S. 0 528 Mb/s 1 Gb/s Compact. PCI Serial PICMG 2. 16 Packet Switching PICMG 2. 0 Compact. PCI 1999 TIME 2001 2003 2006 2011

Shelf Management & IPMI Evolution challenges Together with data rate have increased also: Power consumption Cooling requirements Component density => The system monitoring and control becomes more important and more sophisticated 4

Shelf Management & IPMI System monitoring Traditional system monitoring: Monitor temperatures inside the system Controls fans speed based on temperatures Monitor power supply output voltages and currents Remote reset or shutdown Trigger alarms in case of failures (LEDs, buzzers) Limitations: No information about the boards present and their healthy Temperature on boards are not used for thermal management The boards may run hot even the temperatures inside the system are fine The limit comes from the fact that was no standard protocol to communicate with the cards

Shelf Management & IPMI System monitor example Example: System monitor used in VME crates on Linac 4 project at CERN Was developed custom software to monitor CERN's own boards over I 2 C

Shelf Management & IPMI Evolution of management specifications SAMWAY System Management based on IPMI 2000 2003 VITA 46. 11 System Management on VPX 2006 2015 2014 2005 PICMG 2. 9 Compact. PCI System Management CPCI S. 0 Compact. PCI Serial System Management PICMG 3. 0 Advanced. TCA VME 64 X MTCA. 0 R 1. 0 CPCI S. 0 Micro TCA Compact. PCI Serial PICMG 2. 16 VME VPX VITA 46 Packet Switching PICMG 2. 0 Compact. PCI TIME 1994 1997 1999 2001 2003 2006 2007 2009 2011

Shelf Management & IPMI Management on IPMI To overcome the system monitoring limitations PICMG has adopted a standard protocol (IPMI) for system management and monitoring IPMI (Intelligent Platform Management Interface) The protocol was initially developed by Intel, Hewlett-Packard, NEC and DELL for server management It is as a software protocol, a language, transported over I 2 C inside the chassis First implemented in CPCI and further developed for ATCA and MTCA With IPMI the cards could be discovered and the sensors they support are read There is no need to know in advance what sensors are implemented on a card, they will be discovered This requires every component (Card, PSU, Fan tray) to have a management controller capable of “speaking” IPMI An additional module, the shelf manager, centralizes the information it collects from cards and present it to the external System Management Software

Shelf Management & IPMI Management and Monitoring System Monitor Provides information about chassis health by reading temperatures, voltages, fan speeds, I/Os Shelf Manager Provides information about chassis and the cards present 9

Shelf Management & IPMI Shelf Manager Designed for multiple architectures: ATCA, AXIe, CPCI-S and VPX Monitors/controls cards supporting IPMI Monitors the chassis by reading: voltages, temperatures, currents and fans status Provides configurable digital I/Os 10/100 Mbps Ethernet interface supporting RMCP, HTTP (graphical WEP page), Telnet, SNMP v 3, DHCP, TFTP and Serial Over Lan Extended temperature range: -40. . 85 deg C Mounted as a mezzanine module on a card or on dedicated carrier board Dimensions 68 mmx 95 mm

Shelf Management & IPMI Shelf Manager features 8 Analog 6 Thermistors 3 Fan PWM 16 Digital Inputs 16 Digital Outputs Shelf Manager 12 Fan TACH RS 232 IPMB RTC I 2 C_2 I 2 C MUX

Shelf Management & IPMI System monitor example Integrated WEB Server Provides a simple and intuitive interface for reading management information Based on XML No additional software needed- just a WEB browser (could be accessed from a mobile phone or tablet) Information about a board is obtained with just a mouse click

Shelf Management & IPMI MCH In Micro. TCA the Micro. TCA Carrier Hub (MCH) is responsible for management and monitoring of the boards. Beside this it has also the switching functionality Features: Support for up to 12 AMCs, 12 u. RTMs, 2 CUs and 4 PMs MTCA. 4 Compliant 16 ports Gigabit Ethernet Switch PCIe Gen 3 switch, x 4 links to each AMC PCIe clock distribution Front panel 16 x PCIe optical link.

Shelf Management & IPMI software for cards IPMI Software for ATCA/MTCA cards (IPMC/MMC) Delivered on pre-programmed microcontrollers Fast development, low cost and minimum risk Reference schematic provided Graphical tools for configuring the sensors and board information (manufacturer name, part number, supported interfaces. . . )

SRS related activities

Optical mezzanine board Features Optical mezzanine board – collaboration with IFIN-HH in Romania Mezzanine board for ATCA SRS Two Virtex 7 FPGAs 6 TX and 6 RX Micro. Pod Avago optical modules (12 fibers each) Flexible clock distribution Management Controller (IPMI)

Optical mezzanine board Block diagram

FEC v 6 assembly Status FEC v 6 assembly status -SMD assembly for first batch done - Follows edge connector plus through hole components - Software for functional test under development

Shelf Management & IPMI www. samwayelectronic. com Thank You!