From 4f69b1cbe4e3edb2ca5d6f10d6dae2a0a1fadcb2 Mon Sep 17 00:00:00 2001 From: pmikus Date: Tue, 5 Sep 2023 08:26:26 +0000 Subject: feat(infra): Add new SPR servers Signed-off-by: pmikus Change-Id: Id90ca8323e6f49b51f19526e1089bf711e4e8182 --- .../infrastructure/fdio_csit_testbed_versioning.md | 8 ++ .../fdio_dc_testbed_specifications.md | 85 ++++++++++++++++++++-- .../infrastructure/fdio_dc_vexxhost_inventory.md | 32 ++++---- 3 files changed, 106 insertions(+), 19 deletions(-) (limited to 'docs/content') diff --git a/docs/content/infrastructure/fdio_csit_testbed_versioning.md b/docs/content/infrastructure/fdio_csit_testbed_versioning.md index feb611b61b..8e923f93e2 100644 --- a/docs/content/infrastructure/fdio_csit_testbed_versioning.md +++ b/docs/content/infrastructure/fdio_csit_testbed_versioning.md @@ -36,6 +36,14 @@ environment versioning include: Following is the list of CSIT versions to date: +- Ver. 13 associated with CSIT rls2310 branch ( + [HW](https://git.fd.io/csit/tree/docs/content/infrastructure/testbed_configuration?h=rls2310), + [CSIT](https://git.fd.io/csit/tree/?h=rls2310) + ). + - Intel NIC 700/800 series firmware upgrade based on DPDK compatibility + matrix. + - Mellanox 556A/CX6-DX/MCX713106AS-VEAT series firmware upgrade based on DPDK + compatibility matrix. - Ver. 12 associated with CSIT rls2306 branch ( [HW](https://git.fd.io/csit/tree/docs/content/infrastructure/testbed_configuration?h=rls2306), [CSIT](https://git.fd.io/csit/tree/?h=rls2306) diff --git a/docs/content/infrastructure/fdio_dc_testbed_specifications.md b/docs/content/infrastructure/fdio_dc_testbed_specifications.md index 0e9f8ba2b8..3df698ac0d 100644 --- a/docs/content/infrastructure/fdio_dc_testbed_specifications.md +++ b/docs/content/infrastructure/fdio_dc_testbed_specifications.md @@ -19,7 +19,6 @@ Each server has a LOM (Lights-Out-Management e.g. SM IPMI) and a Management port, which are connected to two different VLANs. #### LOM (IPMI) VLAN - - Subnet: 10.30.50.0/24 - Gateway: 10.30.50.1 - Broadcast: 10.30.50.255 @@ -54,8 +53,9 @@ To access these hosts, VPN connection is required. 11. 2-Node-Zen2 perf zn2 zn2 1 1 1 0 0 0 0 0 0 0 2 0 0 0 12. 3-Node-Icelake perf icx icx 2 4 2 0 0 0 0 0 0 0 0 6 0 0 13. 3-Node-SnowRidge perf snr icx 1 2 .5 0 0 0 0 0 0 0 0 .5 2 0 -13. 2-Node-SapphireRapids perf spr spr 4 4 4 0 0 0 0 0 0 0 0 0 0 8 - Totals: 28 35 18.5 7 1 2 1 2 4 7 2 15.5 2 8 +14. 2-Node-SapphireRapids perf spr spr 4 4 4 0 0 0 0 0 0 0 0 0 0 8 +15. 1-Node-SapphireRapids nomad spr na 4 4 0 0 0 0 0 0 0 0 0 0 0 4 + Totals: 32 39 18.5 7 1 2 1 2 4 7 2 15.5 2 12 ``` ### 1-Node-Skylake Xeon Intel (1n-skx) @@ -70,6 +70,12 @@ Each 1-Node-ThunderX2 testbed includes one SUT (Server-Type-E11) with NIC ports connected back-to-back ([Server Types](#server-types)). Used for FD.io VPP_Device functional driver tests. +### 1-Node-Skylake Xeon Intel (1n-spr) + +Each 1-Node-SapphireRapids testbed includes one SUT (Server-Type-H7) with NIC +ports connected back-to-back ([Server Types](#server-types)). +Used for FD.io VPP_Device functional driver tests. + ### 1-Node-Cascadelake Xeon Intel (1n-clx) Each 1-Node-Cascadelake testbed includes one SUT (Server-Type-C1) with @@ -215,8 +221,8 @@ FD.io CSIT lab contains following server types: - PCIe Slot4 3b:00.xx: x710-4p10GE Intel. - PCIe Slot9 5e:00.xx: empty. - Numa1: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot6 86:00.xx: empty. - - PCIe Slot8 af:00.xx: empty. + - PCIe Slot6 86:00.xx: e810-2CQDA2-2p100GE Intel. + - PCIe Slot8 af:00.xx: e810-2CQDA2-2p100GE Intel. - PCIe Slot10 d8:00.xx: empty. 3. **Server-Type-B7**: Purpose - Ixia PerfectStorm One Appliance TG for FD.io TCP/IP performance tests. @@ -740,6 +746,27 @@ FD.io CSIT lab contains following server types: - PCIe Slot9 af:00.xx: e810-2CQDA2-2p100GE Intel. - PCIe Slot11 d8:00.xx: empty. +30. **Server-Type-H7**: Purpose - SapphireRapids SUT for FD.io VPP_Device functional tests. + - Quantity: 2. + - Physical connectivity: + - IPMI and host management ports. + - NIC ports connected into 1-node topologies. + - Main HW configuration: + - Chassis: SuperMicro SYS-741GE-TNRT. + - Motherboard: Super X13DEG-QT-P. + - Processors: 2* Intel Platinum 8462Y+ 32 core 2.8 GHz 300W TDP. + - RAM Memory: 16* 32GB DDR5-4800. + - Disks: 2* 960GB SATA SSD. + - NICs configuration: + - Numa0: (x16, x16, x16 PCIe5.0 lanes) + - PCIe Slot2 18:00.xx: e810-2CQDA2-2p100GE Intel. + - PCIe Slot4 3b:00.xx: e810-2CQDA2-2p100GE Intel. + - PCIe Slot10 5e:00.xx: empty. + - Numa1: (x16, x16, x16 PCIe5.0 lanes) + - PCIe Slot7 86:00.xx: empty. + - PCIe Slot9 af:00.xx: empty. + - PCIe Slot11 d8:00.xx: empty. + ## Testbeds Configuration ### 1-Node-Skylake (1n-skx) @@ -759,6 +786,10 @@ FD.io CSIT lab contains following server types: - s1-t11-sut1-c4/p2 - 10GE-port2 x710-4p10GE. - s1-t11-sut1-c4/p3 - 10GE-port3 x710-4p10GE. - s1-t11-sut1-c4/p4 - 10GE-port4 x710-4p10GE. + - s1-t11-sut1-c5/p1 - 100GE-port1 e810-2p100GE. + - s1-t11-sut1-c5/p2 - 100GE-port2 e810-2p100GE. + - s1-t11-sut1-c6/p1 - 100GE-port1 e810-2p100GE. + - s1-t11-sut1-c6/p2 - 100GE-port2 e810-2p100GE. - SUT [Server-Type-B6]: - testbedname: testbed12. - hostname: s2-t12-sut1. @@ -773,6 +804,10 @@ FD.io CSIT lab contains following server types: - s2-t12-sut1-c4/p2 - 10GE-port2 x710-4p10GE. - s2-t12-sut1-c4/p3 - 10GE-port3 x710-4p10GE. - s2-t12-sut1-c4/p4 - 10GE-port4 x710-4p10GE. + - s2-t12-sut1-c5/p1 - 100GE-port1 e810-2p100GE. + - s2-t12-sut1-c5/p2 - 100GE-port2 e810-2p100GE. + - s2-t12-sut1-c6/p1 - 100GE-port1 e810-2p100GE. + - s2-t12-sut1-c6/p2 - 100GE-port2 e810-2p100GE. ``` ### 1-Node-ThunderX2 (1n-tx2) @@ -808,6 +843,31 @@ FD.io CSIT lab contains following server types: - s56-t14-sut1-c26/p2 - 40GE-port2 ConnectX5-2p10/25GE Mellanox. ``` +### 1-Node-SapphireRapids (1n-spr) + +``` +- SUT [Server-Type-H7]: + - testbedname: testbed15. + - hostname: s30-t15-sut1. + - IPMI IP: 10.30.50.30 + - Host IP: 10.30.51.31 + - portnames: + - s30-t15-sut1-c1/p1 - 100GE-port1 e810-2p100GE. + - s30-t15-sut1-c1/p2 - 100GE-port2 e810-2p100GE. + - s30-t15-sut1-c2/p1 - 100GE-port1 e810-2p100GE. + - s30-t15-sut1-c2/p2 - 100GE-port1 e810-2p100GE. +- SUT [Server-Type-H7]: + - testbedname: testbed16. + - hostname: s31-t16-sut1. + - IPMI IP: 10.30.50.31 + - Host IP: 10.30.51.31 + - portnames: + - s31-t16-sut1-c1/p1 - 100GE-port1 e810-2p100GE. + - s31-t16-sut1-c1/p2 - 100GE-port2 e810-2p100GE. + - s31-t16-sut1-c2/p1 - 100GE-port1 e810-2p100GE. + - s31-t16-sut1-c2/p2 - 100GE-port1 e810-2p100GE. +``` + ### 1-Node-Cascadelake (1n-clx) ``` @@ -1622,6 +1682,21 @@ Note: There is no IPMI. Serial console is accessible via VIRL2 and VIRL3 USB. - s56-t14-sut1-c8/p2 - s56-t14-sut1-c26/p2. ``` +### 1-Node-SapphireRapids (1n-spr) + +``` +- testbed15: + - ring1 100GE-ports e810-2p100GE: + - s30-t15-sut1-c1/p1 to s30-t15-sut1-c2/p1. + - ring2 100GE-ports e810-2p100GE: + - s30-t15-sut1-c1/p2 to s30-t15-sut1-c2/p2. +- testbed16: + - ring1 100GE-ports e810-2p100GE: + - s31-t16-sut1-c1/p1 to s31-t16-sut1-c2/p1. + - ring2 100GE-ports e810-2p100GE: + - s31-t16-sut1-c1/p2 to s31-t16-sut1-c2/p2. +``` + ### 2-Node-IxiaPS1L47 (2n-ps1) ``` diff --git a/docs/content/infrastructure/fdio_dc_vexxhost_inventory.md b/docs/content/infrastructure/fdio_dc_vexxhost_inventory.md index 140c74ffc4..a3e6d7538a 100644 --- a/docs/content/infrastructure/fdio_dc_vexxhost_inventory.md +++ b/docs/content/infrastructure/fdio_dc_vexxhost_inventory.md @@ -82,20 +82,24 @@ Captured inventory data: ### Rack YUL1-11 (3016.11) - **name** | **oper-status** | **testbed-id** | **role** | **model** | **s/n** | **mgmt-ip4** | **ipmi-ip4** | **rackid** | **rackunit** ------------------------|-----------------|----------------|------------|----------------|-----------------|--------------|--------------|------------|-------------- - yul1-11-lb6m | up | switch | arm-uplink | ? | ? | ? | ? | 3016.11 | u48 - yul1-11-lf-tor-switch | up | switch | uplink | ? | ? | ? | ? | 3016.11 | u47 - mtl1-6-7050QX-32 | up | switch | uplink | ? | ? | ? | ? | 3016.11 | u46 - fdio-marvell-dev | up | N/A | dev | ThunderX-88XX | N/A | 10.30.51.38 | 10.30.50.38 | 3016.11 | u45 - s56-t14-sut1 | up | t14 | 1n-tx2 | ThunderX2-9980 | N/A | 10.30.51.71 | 10.30.50.71 | 3016.11 | u41-u42 - s78-t38-sut1 | up | t38 | 3n-icx | SYS-740GP-TNRT | C7470KL03P50450 | 10.30.51.78 | 10.30.50.78 | 3016.11 | u31-u34 - s79-t38-sut2 | up | t38 | 3n-icx | SYS-740GP-TNRT | C7470KL07P50297 | 10.30.51.79 | 10.30.50.79 | 3016.11 | u27-u30 - s80-t38-tg1 | up | t38 | 3n-icx | SYS-740GP-TNRT | C7470KL03P50454 | 10.30.51.80 | 10.30.50.80 | 3016.11 | u23-u26 - s55-t13-sut1 | up | t13 | 1n-tx2 | ThunderX2-9980 | N/A | 10.30.51.70 | 10.30.50.70 | 3016.11 | u11-u12 - s62-t34-sut1 | up | t34 | 3n-alt | WIWYNN | 04000059N0SC | 10.30.51.72 | 10.30.50.72 | 3016.11 | u9-u10 - s63-t34-sut2 | up | t34 | 3n-alt | WIWYNN | 0390003EN0SC | 10.30.51.73 | 10.30.50.73 | 3016.11 | u7-u8 - s64-t34-tg1 | up | t34 | 3n-alt | SYS-740GP-TNRT | C7470KK40P50249 | 10.30.51.74 | 10.30.50.74 | 3016.11 | u3-u6 + **name** | **oper-status** | **testbed-id** | **role** | **model** | **s/n** | **mgmt-ip4** | **ipmi-ip4** | **rackid** | **rackunit** +-----------------------|-----------------|----------------|--------------|----------------|-----------------|--------------|--------------|------------|-------------- + yul1-11-lb6m | up | switch | arm-uplink | ? | ? | ? | ? | 3016.11 | u48 + yul1-11-lf-tor-switch | up | switch | uplink | ? | ? | ? | ? | 3016.11 | u47 + mtl1-6-7050QX-32 | up | switch | uplink | ? | ? | ? | ? | 3016.11 | u46 + fdio-marvell-dev | up | N/A | dev | ThunderX-88XX | N/A | 10.30.51.38 | 10.30.50.38 | 3016.11 | u45 + s21-nomad | up | nomad | nomad-client | SYS-741GE-TNRT | ?? | 10.30.51.21 | 10.30.50.21 | 3016.11 | u41-u44 + s22-nomad | up | nomad | nomad-client | SYS-741GE-TNRT | ?? | 10.30.51.22 | 10.30.50.22 | 3016.11 | u37-u40 + s78-t38-sut1 | up | t38 | 3n-icx | SYS-740GP-TNRT | C7470KL03P50450 | 10.30.51.78 | 10.30.50.78 | 3016.11 | u31-u34 + s79-t38-sut2 | up | t38 | 3n-icx | SYS-740GP-TNRT | C7470KL07P50297 | 10.30.51.79 | 10.30.50.79 | 3016.11 | u27-u30 + s80-t38-tg1 | up | t38 | 3n-icx | SYS-740GP-TNRT | C7470KL03P50454 | 10.30.51.80 | 10.30.50.80 | 3016.11 | u23-u26 + s30-t15-sut1 | up | nomad | nomad-client | SYS-741GE-TNRT | ?? | 10.30.51.30 | 10.30.50.30 | 3016.11 | u19-u22 + s31-t16-sut1 | up | nomad | nomad-client | SYS-741GE-TNRT | ?? | 10.30.51.31 | 10.30.50.31 | 3016.11 | u15-u18 + s56-t14-sut1 | up | t14 | 1n-tx2 | ThunderX2-9980 | N/A | 10.30.51.71 | 10.30.50.71 | 3016.11 | u13-u14 + s55-t13-sut1 | up | t13 | 1n-tx2 | ThunderX2-9980 | N/A | 10.30.51.70 | 10.30.50.70 | 3016.11 | u11-u12 + s62-t34-sut1 | up | t34 | 3n-alt | WIWYNN | 04000059N0SC | 10.30.51.72 | 10.30.50.72 | 3016.11 | u9-u10 + s63-t34-sut2 | up | t34 | 3n-alt | WIWYNN | 0390003EN0SC | 10.30.51.73 | 10.30.50.73 | 3016.11 | u7-u8 + s64-t34-tg1 | up | t34 | 3n-alt | SYS-740GP-TNRT | C7470KK40P50249 | 10.30.51.74 | 10.30.50.74 | 3016.11 | u3-u6 ### Rack YUL1-12 (3016.12) -- cgit 1.2.3-korg