Hardware Platform Considerations R. Halsall, K. Manolopoulos, C. - - PowerPoint PPT Presentation

Hardware Platform Considerations

• R. Halsall, K. Manolopoulos, C. Shepherd-Themistocleous

Rutherford Appleton Laboratory

DUNE Hardware Requirements

• Minimum hardware requirements for a FPGA platform

– Be able to fit at least 1 APA onto a PCIe board – Ten 10Gbps links per APA – At least two NVMe drives per APA – At least 32GByte of RAM per APA ( better with 48GByte )

• Currently looks like we can fit one APA onto a ZU19.
• Should we look into the possibility of using commercially available FPGA

platforms?

Acknowledgement: used info provided by D. Cussans regarding boards that could be used while waiting for custom boards

2 Kostas Manolopoulos (RAL)

Fidus Sidewinder

• Features:

– Xilinx Zynq US+ XCZU19EG-2 – 2 M.2 interfaces to support onboard SSDs – Connectors to access off-board NVMe SSDs – Two 16GB DDR4* PC4-2400 memory modules – Two QSFP cages – PCIe x8 Gen3/4 Expansion Interface

• Fidus Sidewinder has almost enough fibres ( 2xQSFP ).

– Fidus would charge about US$80k in order to modify their design to have three QSFP and easy interface to 2 x NVMe drives ( via U.2 sockets )

Kostas Manolopoulos (RAL) TMTT 3

Bittware XUP-P3R PCIe FPGA Board

• Features:

– Can be fitted with Xilinx Virtex UltraScale+ VU7P/VU9P/VU11P – Up to two PCIe x16 interfaces – Four QSFP28 cages for 1x 400GbE, 4x 100GbE, 4x 40GbE, 16x 25GbE, or 16x 10GbE

– 4 DIMM sites, each supporting:

• Up to 128 GBytes DDR4 x72 with ECC
• Up to 576 Mbits dual QDR-II+ x18 (2 independent 288 Mbit banks)
• Much more logic than a ZU19.
• Already has enough input links for 1 APA & enough RAM.
• Could be fitted with QSFP-DD optical transceivers
• Price is ~US 8k per board for VU9P.

– Bristol is ordering one (might get one at RAL as well)

• Would need a transition board to couple two U.2 cables for NVMe

Kostas Manolopoulos (RAL) 4

Other considerations

• It should be clear that whatever choice we make, most likely

will not be the final solution.

• New generations cards will be available soon with much more

potential and within the same price range.

Kostas Manolopoulos (RAL) TMTT 5