An IPMC for the PANDA Compute Node Development of an Intelligent - - PowerPoint PPT Presentation

▶

Mar 10, 2023 334 likes •480 views

An IPMC for the PANDA Compute Node Development of an Intelligent Platform Management Controller Thomas Geler JLU Gieen 15. April 2010 Thomas Geler (JLU Gieen) An IPMC for the PANDA Compute Node 15. April 2010 1 / 14 Motivation The

SLIDE 1

An IPMC for the PANDA Compute Node

Development of an Intelligent Platform Management Controller Thomas Geßler

JLU Gießen

15. April 2010

Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node

15. April 2010

1 / 14

SLIDE 2

Motivation

IPMC Connector The Compute Nodes are hosted in an ATCA Shelf. The components of an ATCA Shelf are managed via IPMI (Intelliget Platform Management Interface). Each “Intelligent Field Replaceable Unit” (FRU) inside the Shelf needs an IPM Controller to manage sensors, power etc.

Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node

15. April 2010

2 / 14

SLIDE 3

Outline

1

The IPMI Interface

2

The ATCA Architecture

3

The ATCA Shelf and the Compute Node

4

Development of the IPM Controller Functions Components Prototype Firmware Development

5

Outlook

Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node

15. April 2010

3 / 14

SLIDE 4

The Intelligent Platform Management Interface

Motherboard

System Event Log (SEL) Sensor Data Record (SDR) Repository Baseboard Field-Replacable Unit (FRU) Info

System Bus Non-volatile Storage LAN Motherboard Serial Controller Serial Port Sharing

Serial Connector

Modem

side-band interface to NIC, e.g. SMBus

System Interface

Baseboard Management Controller (BMC)

Serial Controller

Sensors & Control Circuitry

IPMI Messages

Voltages, T emperatures, Fans, Power & Reset control etc.

Network (LAN) Controller

LAN Connector

A System is monitored by a Baseboard Management Controller (BMC).

Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node

15. April 2010

4 / 14

SLIDE 5

The Intelligent Platform Management Interface

Motherboard

Processor Board Memory Board

System Event Log (SEL) Sensor Data Record (SDR) Repository Baseboard Field-Replacable Unit (FRU) Info FRU SEEPROM

System Bus Non-volatile Storage LAN Motherboard Serial Controller Serial Port Sharing

Serial Connector

Modem

side-band interface to NIC, e.g. SMBus

System Interface

Baseboard Management Controller (BMC)

Serial Controller

Sensors & Control Circuitry

IPMI Messages

Private Management Buses

Voltages, T emperatures, Fans, Power & Reset control etc. FRU SEEPROM T emperature Sensor

Network (LAN) Controller

LAN Connector

Extentible with Field Replacable Units (FRUs).

Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node

15. April 2010

5 / 14

SLIDE 6

The Intelligent Platform Management Interface

Motherboard

Processor Board Memory Board

System Event Log (SEL) Sensor Data Record (SDR) Repository Baseboard Field-Replacable Unit (FRU) Info FRU SEEPROM

System Bus Non-volatile Storage LAN Motherboard Serial Controller Serial Port Sharing

Serial Connector

Modem

side-band interface to NIC, e.g. SMBus

IPMB Chassis Board

Chassis Management (Satellite Controller)

System Interface

Baseboard Management Controller (BMC)

Serial Controller

Sensors & Control Circuitry Chassis Sensors Redundant Power Board

IPMI Messages

Private Management Buses

Voltages, T emperatures, Fans, Power & Reset control etc. FRU SEEPROM FRU SEEPROM FRU SEEPROM e.g. Fans, T emperatures, Power Supplies T emperature Sensor

Network (LAN) Controller

LAN Connector

Subsystems are managed by a Satellite Controller (→ IPMC).

Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node

15. April 2010

6 / 14

SLIDE 7

The Advanced Telecommunications Computing Architecture

ShMC Fan Tray Power Entry Module

Shelf-External System Manager

Shelf Manager (Active)

Key

ShMC Power Entry Module Shelf Manager (Backup) IPM Controller (IPMC) Shelf Management Controller (ShMC) Shelf Manager w/ Dedicated ShMC Other Field Replaceable Unit (FRU) AdvancedTCA Board Implementation Dependent Connection 2x Redundant, Bussed or Radial, IPMB-0 2x Redundant Radial Internet-Protocol-Capable Transport ATCA Board IPMC ATCA Board ATCA Board ATCA Board ATCA Board ATCA Board ATCA Board ATCA Board IPMC IPMC IPMC IPMC IPMC IPMC IPMC IPMC Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node

15. April 2010

7 / 14

SLIDE 8

The ATCA Shelf

Shelf Alarm Panel 3000 W Power Supply Shelf Manager 3 Fan Trays 2 Power Entry Modules Schroff 14-Slot AdvancedTCA Shelf with Full-Mesh Backplane Connectors. 3000 W power supply for up to 14 200 W Compute Nodes.

Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node

15. April 2010

8 / 14

SLIDE 9

The Compute Node in the ATCA Shelf

IPMC Connector FPGAs T emperature Sensors Power Supply Voltage Sensor

Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node

15. April 2010

9 / 14

SLIDE 10

Functions of the IPM Controller

Represent the Compute Node on the IPMB-0 (IPMB-address determined from Backplane hardware address). Receive and transmit mandatory IPMI commands. Perform Power Negotiations with the Shelf Manager and control the Compute Node’s power supply. Manage Hot-Swap events. Provide an interface for sensors on the Compute Node (read-out and setting of thresholds). Relay sensor alerts to the Shelf Manager (create IPMI events).

Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node

15. April 2010

10 / 14

SLIDE 11

Components of the IPM Controller

IPMC Compute Node

T emperature Sensor #2 Voltage Sensor #2 I²C Sensor Bus External I²C- Controller IPMB-0: dual-redundant I²C bus for IPMI UART Driver External I²C- Controller External I²C- Controller Microcontroller Atmel ATmega1280

Internal I²C-Controller

A T C A B a c k p l a n e

DC/DC Converter PC Serial Interface

48 V

Compute Node Supply Voltages +3.3 V Compute Node Power Enable Hardware Address Compute Node Interface T emperature Sensor #2 Voltage Sensor #2 FPGA #1 T emperature Sensor 1 FPGA #1 T emperature Sensor 2 FPGA #2 T emperature Sensor 1 FPGA #2 T emperature Sensor 2 Voltage Sensor (12 channel ADC)

Atmel ATmega1280 microcontroller. TI MAX3221 RS-232 Line Driver/Receiver. NXP PCA9665 Parallel bus to I2C-bus controller.

Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node

15. April 2010

11 / 14

SLIDE 12

Assembled IPM Controller Prototype

2 60-pin connectors Microcontroller and 8MHz quartz UART Driver Parallel-to-I²C Controller

Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node

15. April 2010

12 / 14

SLIDE 13

Status of the Firmware Development

Firmware is being developed in C++ for the avr-gcc compiler. The microcontroller is programmed via a JTAG interface. A “command shell” was written for the PC serial interface. The I2C interface controllers can be used. Temperature sensors on the Compute Node’s I2C bus can be read out and programmed.

Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node

15. April 2010

13 / 14

SLIDE 14

Outlook

Firmware development will be continued. IPMI commands will be implemented to allow communication with the Shelf Manager via IPMB-0. Function of the managed components of the Compute Node and communication with the Shelf Manager will be tested. A new version of the IPMC will be designed and built, eliminating minor hardware bugs.

Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node

15. April 2010

14 / 14