FPGA Set up for NVMeTCP-IP Cloud Accelerator Demo

1 Introduction

This document provides a comprehensive guide for setting up an accelerator card to demonstrate a Storage Accelerator system for cloud solutions using the NVMe/TCP protocol over a 100G Ethernet connection. It includes step-by-step instructions for installing the FPGA Accelerator card into the host system and configuring it to connect to a storage system via a 100G Ethernet link.

Before initiating the test, ensure the following hardware components are prepared:

1) Accelerator card: Alveo U55C card

2) Host system required for connecting the Accelerator card. The demo results are based on the following host system specifications:

· Operating System: Oracle Linux 8.8 with a Kernel 4.18

· Motherboard: Gigabyte Z590 AORUN Master (rev 1.0)

· CPU: Intel i7-11700K (3.6 GHz)

· RAM: 64 GB DDR4

3) NVMe/TCP Target system serves as the system storage. The demo results are based on the following NVMe/TCP Target system specifications:

· Operating System: Ubuntu 22.04 LTS

· Motherboard: ASUS Z690M-PLUS D4

· CPU: Intel i5-12600K (3.6 GHz)

· RAM: 64 GB DDR4

4) NVMe SSD: Intel Optane SSD DC P5800X

5) 100G Ethernet Cable: 2xQSFP28 transceivers and MPO to MPO cable. An example cable set is as follows:

· 2xQSFP28 transceiver (100GBASE-SR): AMQ28-SR4-M1

https://www.sfpcables.com/100G-s-qsfp28-sr4-optical-transceiver-module-1499

· MPO to MPO cable: OM4-MPO-8MPO-1M

https://www.sfpcables.com/mpo-to-mpo-multimode-om4-50-125-m-8-core-4381

6) A micro-USB cable for programming Accelerator card.

7) Vivado Programmer for programming the Accelerator card, installed on the laptop or PC.

Figure 1 NVMeTCP25G-IP Demo on Alveo U55C

2 Accelerator Setup

This section outlines the steps to prepare the Host system with Accelerator card for running the demo.

1) Insert the Accelerator card into the PCIe slot of the Host system.

2) Connect the micro-USB cable to the Alveo U55C for FPGA programming.

3) Connect 100G Ethernet cable between the Accelerator card and the target system.

i) Insert a QSFP28 transceiver and MPO to MPO cable into the QSFP28 connector on the Accelerator card. There are two QSFP28 channels on the U55C card. Make sure to utilize the QSFP1 channel.

ii) Connect the other end of the MPO cable by inserting the QSFP28 transceiver to the 100G Ethernet card on the Storage system (NVMe/TCP Target).

Figure 2 QSFP28 and micro-USB Cable Connections on Alveo U55C

4) Open the Vivado Hardware Manager and program the Accelerator card with the required bit file as illustrated in Figure 3.

Figure 3 Program Accelerator Card by Vivado Tool

5) Perform a warm reboot of the system and use the “nfb-info” command to verify that the demo has been successfully configured on the Accelerator card. The demo system information must be displayed, as shown in Figure 4.

Figure 4 Result of nfb-info Command

3 Revision History

Revision	Date (D-M-Y)	Description
1.00	12-Mar-25	Initial version release