diff options
Diffstat (limited to 'docs/lab')
| -rw-r--r-- | docs/lab/fdio-dc-physical.md | 131 | ||||
| -rw-r--r-- | docs/lab/fdio-dc-physical.yaml | 567 | ||||
| -rw-r--r-- | docs/lab/testbed_specifications.md | 2408 | ||||
| -rw-r--r-- | docs/lab/testbeds_sm_clx_hw_bios_cfg.md | 1452 | ||||
| -rw-r--r-- | docs/lab/testbeds_sm_dnv_hw_bios_cfg.md | 351 | ||||
| -rw-r--r-- | docs/lab/testbeds_sm_icx_hw_bios_cfg.md | 1256 | ||||
| -rw-r--r-- | docs/lab/testbeds_sm_skx_hw_bios_cfg.md | 578 | ||||
| -rw-r--r-- | docs/lab/testbeds_sm_zn2_hw_bios_cfg.md | 634 |
8 files changed, 0 insertions, 7377 deletions
diff --git a/docs/lab/fdio-dc-physical.md b/docs/lab/fdio-dc-physical.md deleted file mode 100644 index b049073379..0000000000 --- a/docs/lab/fdio-dc-physical.md +++ /dev/null @@ -1,131 +0,0 @@ -<!-- MarkdownTOC autolink="true" --> - -- [FD.io DC Vexxhost Inventory](#fdio-dc-vexxhost-inventory) - - [Missing Equipment Inventory](#missing-equipment-inventory) - - [YUL1 Inventory](#yul1-inventory) - - [Rack YUL1-8 (3016.8)](#rack-yul1-8-3016.8) - - [Rack YUL1-9 (3016.9)](#rack-yul1-9-3016.9) - - [Rack YUL1-10 (3016.10)](#rack-yul1-10-3016.10) - - [Rack YUL1-11 (3016.11)](#rack-yul1-11-3016.11) - - [Rack YUL1-12 (3016.12)](#rack-yul1-12-3016.12) - -<!-- /MarkdownTOC --> - -## FD.io DC Vexxhost Inventory - -- for each DC location, per rack .csv table with server inventory -- captured inventory data: name,oper-status,testbed-id,role,model,s/n,rackid,rackunit,mgmt-ip4,ipmi-ip4,new-rackid,new-rackunit,new-mgmt-ip4,new-ipmi-ip4 - - name: CSIT functional server name as tracked in [CSIT testbed specification](https://git.fd.io/csit/tree/docs/lab/testbed_specifications.md), followed by "/" and the actual configured hostname, unless it is the same as CSIT name. - - oper-status: operational status (up|down|ipmi). - - testbed-id: CSIT testbed identifier. - - role: 2n/3n-xxx performance testbed, nomad-client, nomad-server. - - role exceptions: decommission, repurpose, spare. - - model: server model. - - s/n: serial number. - - mgmt-ip4: current management IPv4 address on management VLAN. - - ipmi-ip4: current IPMI IPv4 address on LOM VLAN. - - rackid: new location rack id. - - rackunit: new location rack unit id. - -### Missing Equipment Inventory - -1. Ixia PerfectStorm One Appliance - - [Specification: Ixia PerfectStorm One Appliance TG for FD.io TCP/IP performance tests.](https://git.fd.io/csit/tree/docs/lab/testbed_specifications.md#n554) - - [Wiring: 2-Node-IxiaPS1L47 Servers (2n-ps1)](https://git.fd.io/csit/tree/docs/lab/testbed_specifications.md#n1017) - - [mgmt-ip4 10.30.51.62 s26-t25-tg1](https://git.fd.io/csit/tree/docs/lab/testbed_specifications.md#n374) - - [ipmi-ip4 10.30.50.59 s26-t25-tg1](https://git.fd.io/csit/tree/docs/lab/testbed_specifications.md#n281) - -### YUL1 Inventory - -#### Rack YUL1-8 (3016.8) -name,oper-status,testbed-id,role,model,s/n,mgmt-ip4,ipmi-ip4,rackid,rackunit -mtl1-8-lb4m,up,switch,uplink,?,?,?,?,3016.8,u47,?,? -s65-t37-sut1,up,t37,3n-icx,SYS-740GP-TNRT,C7470KK25P50098,10.30.51.75,10.30.50.75,3016.8,u42-u45 -s66-t37-sut2,up,t37,3n-icx,SYS-740GP-TNRT,C7470KK33P50247,10.30.51.76,10.30.50.76,3016.8,u38-u41 -s67-t37-tg1,up,t37,3n-icx,SYS-740GP-TNRT,C7470KK25P50076,10.30.51.77,10.30.50.77,3016.8,u34-u37 -s71-t212-sut1,up,t212,2n-icx,SYS-740GP-TNRT,C7470KK25P50173,10.30.51.81,10.30.50.81,3016.8,u30-u33 -s72-t212-tg1,up,t212,2n-icx,SYS-740GP-TNRT,C7470KK33P50220,10.30.51.82,10.30.50.82,3016.8,u26-u29 -s83-t213-sut1,up,t213,2n-icx,SYS-740GP-TNRT,C7470KL07P50300,10.30.51.83,10.30.50.83,3016.8,u22-u25 -s84-t213-tg1,up,t213,2n-icx,SYS-740GP-TNRT,C7470KL03P50187,10.30.51.84,10.30.50.84,3016.8,u18-u21 -s85-t214-sut1,up,t214,2n-icx,SYS-740GP-TNRT,C7470KK33P50219,10.30.51.85,10.30.50.85,3016.8,u14-u17 -s86-t214-tg1,up,t214,2n-icx,SYS-740GP-TNRT,C7470KL07P50312,10.30.51.86,10.30.50.86,3016.8,u10-u13 -s87-t215-sut1,up,t215,2n-icx,SYS-740GP-TNRT,C7470KL03P50171,10.30.51.87,10.30.50.87,3016.8,u6-u9 -s88-t215-tg1,up,t215,2n-icx,SYS-740GP-TNRT,C7470KL07P50301,10.30.51.88,10.30.50.88,3016.8,u2-u5 - -#### Rack YUL1-9 (3016.9) -name,oper-status,testbed-id,role,model,s/n,mgmt-ip4,ipmi-ip4,rackid,rackunit -mtl1-5-lb4m,up,switch,uplink,?,?,?,?,3016.9,u47,?,? -s11-t31-sut1,up,t31,3n-skx,SYS-7049GP-TRT,C7470KH06A20037,10.30.51.46,10.30.50.43,3016.9,u42-u45 -s12-t31-sut2,up,t31,3n-skx,SYS-7049GP-TRT,C7470KH06A20018,10.30.51.47,10.30.50.44,3016.9,u38-u41 -s13-t31-tg1,up,t31,3n-skx,SYS-7049GP-TRT,C7470KH06A20043,10.30.51.48,10.30.50.45,3016.9,u34-u37 -s14-t32-sut1,up,t31,3n-skx,SYS-7049GP-TRT,C7470KH06A20075,10.30.51.58,10.30.50.55,3016.9,u30-u33 -s15-t32-sut2,up,t31,3n-skx,SYS-7049GP-TRT,C7470KH06A20010,10.30.51.59,10.30.50.56,3016.9,u26-u29 -s16-t32-tg1,up,t31,3n-skx,SYS-7049GP-TRT,C7470KH06A20047,10.30.51.60,10.30.50.57,3016.9,u22-u25 -s25-t25-sut1,down,t25,2n-p1,SYS-7049GP-TRT,C7470KH06A20022,10.30.51.61,10.30.50.58,3016.9,u18-u21 -s19-t33t211-tg1,up,t33t211,3n-tsh/2n-tx2,SYS-7049GP-TRT,C7470KH06A20056,10.30.51.49,10.30.50.46,3016.9,u14-u17 -s27-t211-sut1,up,t211,2n-tx2,ThunderX2-9975,K61186073100003,10.30.51.69,10.30.50.69,3016.9,u13 -s18-t33-sut2,up,t33,3n-tsh,HUAWEI-TAISHAN-2280,N/A,10.30.51.37,10.30.50.37,3016.9,u11-u12 -s17-t33-sut1,up,t33,3n-tsh,HUAWEI-TAISHAN-2280,N/A,10.30.51.36,10.30.50.36,3016.9,u9-u10 -s79-t39t310-tg1,in-transit,t39t310,tbd,SYS-740GP-TNRT,???,10.30.51.89,10.30.50.89,3016.9,u5-u8 - -#### Rack YUL1-10 (3016.10) - -name,oper-status,testbed-id,role,model,s/n,mgmt-ip4,ipmi-ip4,rackid,rackunit -yul1-10-lb4m,up,switch,uplink,?,?,?,?,3016.10,u47,?,? -s2-t12-sut1,up,t12,1n-skx,SYS-7049GP-TRT,C7470KH06A20119,10.30.51.51,10.30.50.48,3016.10,u42-u45 -s1-t11-sut1,up,t11,1n-skx,SYS-7049GP-TRT,C7470KH06A20154,10.30.51.50,10.30.50.47,3016.10,u38-u41 -s3-t21-sut1,up,t21,2n-skx,SYS-7049GP-TRT,C7470KH06A20167,10.30.51.44,10.30.50.41,3016.10,u34-u37 -s4-t21-tg1,up,t21,2n-skx,SYS-7049GP-TRT,C7470KH06A20158,10.30.51.45,10.30.50.42,3016.10,u30-u33 -s5-t22-sut1,up,t22,2n-skx,SYS-7049GP-TRT,N/A,10.30.51.52,10.30.50.49,3016.10,u26-u29 -s6-t22-tg1,up,t22,2n-skx,SYS-7049GP-TRT,N/A,10.30.51.53,10.30.50.50,3016.10,u22-u25 -s7-t23-sut1,up,t23,2n-skx,SYS-7049GP-TRT,N/A,10.30.51.54,10.30.50.51,3016.10,u18-u21 -s8-t23-tg1,up,t23,2n-skx,SYS-7049GP-TRT,C7470KH06A20035,10.30.51.55,10.30.50.52,3016.10,u14-u17 -s93-t39-sut1,up,t39,3n-snr,?,?,10.30.51.93,10.30.50.93,3016.10,u10-u13 -s94-t39-sut2,up,t39,3n-snr,?,?,10.30.51.94,10.30.50.94,3016.10,u6-u9 -s89-t39t310-tg1,up,t39,3n-snr,?,?,10.30.51.89,10.30.50.89,3016.10,u2-u5 - -#### Rack YUL1-11 (3016.11) - -name,oper-status,testbed-id,role,model,s/n,mgmt-ip4,ipmi-ip4,rackid,rackunit -yul1-11-lb6m,up,switch,arm-uplink,?,?,?,?,3016.11,u48 -yul1-11-lf-tor-switch,up,switch,uplink,?,?,?,?,3016.11,u47 -mtl1-6-7050QX-32,up,switch,uplink,?,?,?,?,3016.11,u46 -fdio-marvell-dev,up,N/A,dev,ThunderX-88XX,N/A,10.30.51.38,10.30.50.38,3016.11,u45 -s56-t14-sut1,up,t14,1n-tx2,ThunderX2-9980,N/A,10.30.51.71,10.30.50.71,3016.11,u41-u42 -s20-nomad,up,nomad-cluster1,nomad-client,UCSC-C240-M4SX,FCH1950V1FQ,10.30.51.20,10.30.50.20,3016.11,u39-u40 -s22-nomad,up,nomad-cluster1,nomad-client,UCSC-C240-M4SX,FCH2013V0HZ,10.30.51.22,10.30.50.22,3016.11,u37-u38 -s21-nomad,up,nomad-cluster1,nomad-client,UCSC-C240-M4SX,FCH2013V0J2,10.30.51.21,10.30.50.21,3016.11,u35-u36 -s78-t38-sut1,up,t38,3n-icx,SYS-740GP-TNRT,C7470KL03P50450,10.30.51.78,10.30.50.78,3016.11,u31-u34 -s79-t38-sut2,up,t38,3n-icx,SYS-740GP-TNRT,C7470KL07P50297,10.30.51.79,10.30.50.79,3016.11,u27-u30 -s80-t38-tg1,up,t38,3n-icx,SYS-740GP-TNRT,C7470KL03P50454,10.30.51.80,10.30.50.80,3016.11,u23-u26 -s16-nomad,up,nomad-cluster1,nomad-client,UCSC-C240-M4SX,FCH1950V1FN,10.30.51.16,10.30.50.16,3016.11,u19-u20 -s17-nomad,up,nomad-cluster1,nomad-client,UCSC-C240-M4SX,FCH1950V1H5,10.30.51.17,10.30.50.17,3016.11,u17-u18 -s18-nomad,up,nomad-cluster1,nomad-client,UCSC-C240-M4SX,FCH1950V1FS,10.30.51.18,10.30.50.18,3016.11,u15-u16 -s19-nomad,up,nomad-cluster1,nomad-client,UCSC-C240-M4SX,FCH1950V1FL,10.30.51.19,10.30.50.19,3016.11,u13-u14 -s55-t13-sut1,up,t13,1n-tx2,ThunderX2-9980,N/A,10.30.51.70,10.30.50.70,3016.11,u11-u12 -s62-t34-sut1,up,t34,3n-alt,WIWYNN,04000059N0SC,10.30.51.72,10.30.50.72,3016.11,u9-u10 -s63-t34-sut2,up,t34,3n-alt,WIWYNN,0390003EN0SC,10.30.51.73,10.30.50.73,3016.11,u7-u8 -s64-t34-tg1,up,t34,3n-alt,SYS-740GP-TNRT,C7470KK40P50249,10.30.51.74,10.30.50.74,3016.11,u3-u6 - -#### Rack YUL1-12 (3016.12) - -name,oper-status,testbed-id,role,model,s/n,mgmt-ip4,ipmi-ip4,rackid,rackunit -yul1-12-lb4m,up,switch,uplink,?,?,?,?,3016.12,u47 -s31-t35-sut2/dnv3,up,t35,3n-dnv,SYS-E300-9A,CE300AG39040898,10.32.8.13,10.30.55.13,3016.12,u45 -s30-t35-sut1/dnv2,up,t35,3n-dnv,SYS-E300-9A,CE300AG39040866,10.32.8.12,10.30.55.12,3016.12,u44 -s29-t26-sut1/dnv1,up,t26,2n-dnv,SYS-E300-9A,CE300AG39040897,10.32.8.11,10.30.55.11,3016.12,u43 -s28-t26t35-tg1,up,t26t35,2n/3n-dnv,SYS-7049GP-TRT,C7470KH06A20137,10.32.8.10,10.30.55.10,3016.12,u39-u42 -s91-nomad,up,nomad-cluster1,nomad-client,R152-P30-00,GLG4P9912A0016,10.30.51.91,10.30.50.91,3016.12,u36 -s92-nomad,up,nomad-cluster1,nomad-client,R152-P30-00,GLG4P9912A0004,10.30.51.92,10.30.50.92,3016.12,u35 -s23-nomad,up,nomad-cluster1,nomad-server,SYS-1029P-WTRT,C1160LI12NM0256,10.30.51.23,10.30.51.23,3016.12,u34 -s24-nomad,up,nomad-cluster1,nomad-server,SYS-1029P-WTRT,C1160LI12NM0241,10.30.51.24,10.30.51.24,3016.12,u33 -s25-nomad,up,nomad-cluster1,nomad-server,SYS-1029P-WTRT,C1160LI12NM0540,10.30.51.25,10.30.51.25,3016.12,u32 -s61-t210-tg1,up,t210,2n-zn2,AS-1014S-WTRT,C8150LI50NS2689,10.32.8.25,10.30.55.25,3016.12,u31 -s60-t210-sut1,up,t210,2n-zn2,AS-1114S-WTRT,N/A,10.32.8.24,10.30.55.24,3016.12,u30 -s26-nomad,up,nomad-cluster1,nomad-server,SYS-7049GP-TRT,C7470KH37A30505,10.30.51.26,10.30.51.26,3016.12,u26-u29 -s33-t27-sut1,up,t27,2n-clx,SYS-7049GP-TRT,C7470KH37A30567,10.32.8.18,10.30.55.18,3016.12,u22-u25 -s34-t27-tg1,up,t27,2n-clx,SYS-7049GP-TRT,C7470KH37A30565,10.32.8.19,10.30.55.19,3016.12,u18-u21 -s35-t28-sut1,up,t28,2n-clx,SYS-7049GP-TRT,C7470KH37A30509,10.32.8.20,10.30.55.20,3016.12,u14-u17 -s36-t28-tg1,up,t28,2n-clx,SYS-7049GP-TRT,C7470KH37A30511,10.32.8.21,10.30.55.21,3016.12,u10-u13 -s37-t29-sut1,up,t29,2n-clx,SYS-7049GP-TRT,C7470KH37A30566,10.32.8.22,10.30.55.22,3016.12,u6-u9 -s38-t29-tg1,up,t29,2n-clx,SYS-7049GP-TRT,C7470KH37A30506,10.32.8.23,10.30.55.23,3016.12,u2-u5 diff --git a/docs/lab/fdio-dc-physical.yaml b/docs/lab/fdio-dc-physical.yaml deleted file mode 100644 index 2f973d1755..0000000000 --- a/docs/lab/fdio-dc-physical.yaml +++ /dev/null @@ -1,567 +0,0 @@ ---- -# file: fdio-dc-physical.yaml - -yul1: - rack: - name: yul1-8 - facility_id: 3016.8 - tenant: Linux Foundation - status: active - dimensions: - type: 4-post cabinet - width: 19 inches - height: 48U - - unit: 47 - name: mtl1-8-lb4m - oper_status: production - device_type: switch - serial_number: N/A - mgmt_ip4: N/A - lom_ip4: N/A - lom_type: N/A - - unit: 42..45 - name: s65-t37-sut1 - oper_status: production - device_type: SYS-740GP-TNRT - serial_number: C7470KK25P50098 - mgmt_ip4: 10.30.51.75 - lom_ip4: 10.30.50.75 - - unit: 38..41 - name: s66-t37-sut2 - oper_status: production - device_type: SYS-740GP-TNRT - serial_number: C7470KK33P50247 - mgmt_ip4: 10.30.51.76 - lom_ip4: 10.30.50.76 - - unit: 34..37 - name: s67-t37-tg1 - oper_status: production - device_type: SYS-740GP-TNRT - serial_number: C7470KK25P50076 - mgmt_ip4: 10.30.51.77 - lom_ip4: 10.30.50.77 - - unit: 30..33 - name: s71-t212-sut1 - oper_status: production - device_type: SYS-740GP-TNRT - serial_number: C7470KK25P50173 - mgmt_ip4: 10.30.51.81 - lom_ip4: 10.30.50.81 - - unit: 26..29 - name: s72-t212-tg1 - oper_status: production - device_type: SYS-740GP-TNRT - serial_number: C7470KK33P50220 - mgmt_ip4: 10.30.51.82 - lom_ip4: 10.30.50.82 - - unit: 22..25 - name: s83-t213-sut1 - oper_status: production - device_type: SYS-740GP-TNRT - serial_number: C7470KL07P50300 - mgmt_ip4: 10.30.51.83 - lom_ip4: 10.30.50.83 - - unit: 18..21 - name: s84-t213-tg1 - oper_status: production - device_type: SYS-740GP-TNRT - serial_number: C7470KL03P50187 - mgmt_ip4: 10.30.51.84 - lom_ip4: 10.30.50.84 - - unit: 14..17 - name: s85-t214-sut1 - oper_status: production - device_type: SYS-740GP-TNRT - serial_number: C7470KK33P50219 - mgmt_ip4: 10.30.51.85 - lom_ip4: 10.30.50.85 - - unit: 10..13 - name: s86-t214-tg1 - oper_status: production - device_type: SYS-740GP-TNRT - serial_number: C7470KL07P50312 - mgmt_ip4: 10.30.51.86 - lom_ip4: 10.30.50.86 - - unit: 6..9 - name: s87-t215-sut1 - oper_status: production - device_type: SYS-740GP-TNRT - serial_number: C7470KL03P50171 - mgmt_ip4: 10.30.51.87 - lom_ip4: 10.30.50.87 - - unit: 2..5 - name: s88-t215-tg1 - oper_status: production - device_type: SYS-740GP-TNRT - serial_number: C7470KL07P50301 - mgmt_ip4: 10.30.51.88 - lom_ip4: 10.30.50.88 - name: yul1-9 - facility_id: 3016.9 - tenant: Linux Foundation - status: active - dimensions: - type: 4-post cabinet - width: 19 inches - height: 48U - - unit: 47 - name: mtl1-5-lb4m - oper_status: production - device_type: switch - serial_number: N/A - mgmt_ip4: N/A - lom_ip4: N/A - lom_type: N/A - - unit: 42..45 - name: s11-t31-sut1 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: C7470KH06A20037 - mgmt_ip4: 10.30.51.46 - lom_ip4: 10.30.50.43 - - unit: 38..41 - name: s12-t31-sut2 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: C7470KH06A20018 - mgmt_ip4: 10.30.51.47 - lom_ip4: 10.30.50.44 - - unit: 34..37 - name: s13-t31-tg1 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: C7470KH06A20043 - mgmt_ip4: 10.30.51.48 - lom_ip4: 10.30.50.45 - - unit: 30..33 - name: s14-t32-sut1 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: C7470KH06A20075 - mgmt_ip4: 10.30.51.58 - lom_ip4: 10.30.50.55 - - unit: 26..29 - name: s15-t32-sut2 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: C7470KH06A20010 - mgmt_ip4: 10.30.51.59 - lom_ip4: 10.30.50.56 - - unit: 22..25 - name: s16-t32-tg1 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: C7470KH06A20047 - mgmt_ip4: 10.30.51.60 - lom_ip4: 10.30.50.57 - - unit: 18..21 - name: s25-t25-sut1 - oper_status: stage - device_type: SYS-7049GP-TRT - serial_number: C7470KH06A20022 - mgmt_ip4: 10.30.51.61 - lom_ip4: 10.30.50.58 - - unit: 14..17 - name: s19-t33t211-tg1 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: C7470KH06A20056 - mgmt_ip4: 10.30.51.49 - lom_ip4: 10.30.50.46 - - unit: 13 - name: s27-t211-sut1 - oper_status: production - device_type: ThunderX2-9975 - serial_number: K61186073100003 - mgmt_ip4: 10.30.51.69 - lom_ip4: 10.30.50.69 - - unit: 11..12 - name: s18-t33-sut2 - oper_status: production - device_type: HUAWEI-TAISHAN-2280 - serial_number: N/A - mgmt_ip4: 10.30.51.37 - lom_ip4: 10.30.50.37 - - unit: 9..10 - name: s17-t33-sut1 - oper_status: production - device_type: HUAWEI-TAISHAN-2280 - serial_number: N/A - mgmt_ip4: 10.30.51.36 - lom_ip4: 10.30.50.36 -yul1: - rack: - name: yul1-10 - facility_id: 3016.10 - tenant: Linux Foundation - status: active - dimensions: - type: 4-post cabinet - width: 19 inches - height: 48U - - unit: 47 - name: yul1-10-lb4m - oper_status: production - device_type: switch - serial_number: N/A - mgmt_ip4: N/A - lom_ip4: N/A - - unit: 42..45 - name: s2-t12-sut1 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: C7470KH06A20119 - mgmt_ip4: 10.30.51.51 - lom_ip4: 10.30.50.48 - - unit: 38..41 - name: s1-t11-sut1 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: C7470KH06A20154 - mgmt_ip4: 10.30.51.50 - lom_ip4: 10.30.50.47 - - unit: 34..37 - name: s3-t21-sut1 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: C7470KH06A20167 - mgmt_ip4: 10.30.51.44 - lom_ip4: 10.30.50.41 - - unit: 30..33 - name: s4-t21-tg1 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: C7470KH06A20158 - mgmt_ip4: 10.30.51.45 - lom_ip4: 10.30.50.42 - - unit: 26..29 - name: s5-t22-sut1 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: N/A - mgmt_ip4: 10.30.51.52 - lom_ip4: 10.30.50.49 - - unit: 22..25 - name: s6-t22-tg1 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: N/A - mgmt_ip4: 10.30.51.53 - lom_ip4: 10.30.50.50 - - unit: 18..21 - name: s7-t23-sut1 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: N/A - mgmt_ip4: 10.30.51.54 - lom_ip4: 10.30.50.51 - - unit: 14..17 - name: s8-t23-tg1 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: C7470KH06A20035 - mgmt_ip4: 10.30.51.55 - lom_ip4: 10.30.50.52 - - unit: 10..13 - name: s93-t39-sut1 - oper_status: production - device_type: ? - serial_number: ? - mgmt_ip4: 10.30.51.93 - lom_ip4: 10.30.50.93 - - unit: 6..9 - name: s94-t39-sut2 - oper_status: production - device_type: ? - serial_number: ? - mgmt_ip4: 10.30.51.94 - lom_ip4: 10.30.50.94 - - unit: 2..5 - name: s89-t39t310-tg1 - oper_status: production - device_type: ? - serial_number: ? - mgmt_ip4: 10.30.51.89 - lom_ip4: 10.30.50.89 - rack: - name: yul1-11 - facility_id: 3016.11 - tenant: Linux Foundation - status: active - dimensions: - type: 4-post cabinet - width: 19 inches - height: 48U - - unit: 48 - name: yul1-11-lb6m - oper_status: production - device_type: switch - serial_number: N/A - mgmt_ip4: N/A - lom_ip4: N/A - - unit: 47 - name: yul1-11-lf-tor-switch - oper_status: production - device_type: switch - serial_number: N/A - mgmt_ip4: N/A - lom_ip4: N/A - - unit: 46 - name: mtl1-6-7050QX-32 - oper_status: production - device_type: switch - serial_number: N/A - mgmt_ip4: N/A - lom_ip4: N/A - - unit: 45 - name: fdio-marvell-dev - oper_status: production - device_type: ThunderX-88XX - serial_number: N/A - mgmt_ip4: 10.30.51.38 - lom_ip4: 10.30.50.38 - - unit: 41..42 - name: s56-t14-sut1 - oper_status: production - device_type: ThunderX2-9980 - serial_number: N/A - mgmt_ip4: 10.30.51.71 - lom_ip4: 10.30.50.71 - - unit: 39..40 - name: s20-nomad - oper_status: production - device_type: UCSC-C240-M4SX - serial_number: FCH1950V1FQ - mgmt_ip4: 10.30.51.20 - lom_ip4: 10.30.50.20 - - unit: 37..38 - name: s22-nomad - oper_status: production - device_type: UCSC-C240-M4SX - serial_number: FCH2013V0HZ - mgmt_ip4: 10.30.51.22 - lom_ip4: 10.30.50.22 - - unit: 35..36 - name: s21-nomad - oper_status: production - device_type: UCSC-C240-M4SX - serial_number: FCH2013V0J2 - mgmt_ip4: 10.30.51.21 - lom_ip4: 10.30.50.21 - - unit: 31..34 - name: s78-t38-sut1 - oper_status: production - device_type: SYS-740GP-TNRT - serial_number: C7470KL03P50450 - mgmt_ip4: 10.30.51.78 - lom_ip4: 10.30.50.78 - - unit: 27..30 - name: s79-t38-sut2 - oper_status: production - device_type: SYS-740GP-TNRT - serial_number: C7470KL07P50297 - mgmt_ip4: 10.30.51.79 - lom_ip4: 10.30.50.79 - - unit: 23..26 - name: s80-t38-tg1 - oper_status: production - device_type: SYS-740GP-TNRT - serial_number: C7470KL03P50454 - mgmt_ip4: 10.30.51.80 - lom_ip4: 10.30.50.80 - - unit: 19..20 - name: s16-nomad - oper_status: production - device_type: UCSC-C240-M4S - serial_number: FCH1950V1FN - mgmt_ip4: 10.30.51.16 - lom_ip4: 10.30.50.16 - - unit: 17..18 - name: s17-nomad - oper_status: production - device_type: UCSC-C240-M4S - serial_number: FCH1950V1H5 - mgmt_ip4: 10.30.51.17 - lom_ip4: 10.30.50.17 - - unit: 15..16 - name: s18-nomad - oper_status: production - device_type: UCSC-C240-M4S - serial_number: FCH1950V1FS - mgmt_ip4: 10.30.51.18 - lom_ip4: 10.30.50.18 - - unit: 13..14 - name: s19-nomad - oper_status: production - device_type: UCSC-C240-M4S - serial_number: FCH1950V1FL - mgmt_ip4: 10.30.51.19 - lom_ip4: 10.30.50.19 - - unit: 11..12 - name: s55-t13-sut1 - oper_status: production - device_type: ThunderX2-9980 - serial_number: N/A - mgmt_ip4: 10.30.51.70 - lom_ip4: 10.30.50.70 - - unit: 9..10 - name: s62-t34-sut1 - oper_status: production - device_type: Mt.Jade Server System B81.030Z1.0007 - serial_number: 04000059N0SC - mgmt_ip4: 10.30.51.72 - lom_ip4: 10.30.50.72 - - unit: 7..8 - name: s63-t34-sut2 - oper_status: production - device_type: Mt.Jade Server System B81.030Z1.0007 - serial_number: 0390003EN0SC - mgmt_ip4: 10.30.51.73 - lom_ip4: 10.30.50.73 - - unit: 3..6 - name: s64-t34-tg1 - oper_status: production - device_type: SYS-740GP-TNRT - serial_number: C7470KK40P50249 - mgmt_ip4: 10.30.51.74 - lom_ip4: 10.30.50.74 - rack: - name: yul1-12 - facility_id: 3016.12 - tenant: Linux Foundation - status: active - dimensions: - type: 4-post cabinet - width: 19 inches - height: 48U - layout: - - unit: 47 - name: yul1-12-lb4m - oper_status: production - - unit: 45 - name: s31-t35-sut2 - oper_status: production - device_type: SYS-E300-9A - serial_number: CE300AG39040898 - mgmt_ip4: 10.32.8.13 - lom_ip4: 10.30.55.13 - - unit: 44 - name: s30-t35-sut1 - oper_status: production - device_type: SYS-E300-9A - serial_number: CE300AG39040866 - mgmt_ip4: 10.32.8.12 - lom_ip4: 10.30.55.12 - - unit: 43 - name: s29-t26-sut1 - oper_status: production - device_type: SYS-E300-9A - serial_number: CE300AG39040897 - mgmt_ip4: 10.32.8.11 - lom_ip4: 10.30.55.11 - - unit: 39..42 - name: s28-t26t35-tg1 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: C7470KH06A20137 - mgmt_ip4: 10.32.8.10 - lom_ip4: 10.30.55.10 - - unit: 36 - name: s58-nomad - oper_status: - device_type: R152-P30-00 - serial_number: GLG4P9912A0016 - mgmt_ip4: 10.30.51.91 - lom_ip4: 10.30.50.91 - - unit: 35 - name: s59-nomad - oper_status: - device_type: R152-P30-00 - serial_number: GLG4P9912A0004 - mgmt_ip4: 10.30.51.92 - lom_ip4: 10.30.50.92 - - unit: 34 - name: s23-nomad - oper_status: production - device_type: SYS-1029P-WTRT - serial_number: C1160LI12NM0256 - mgmt_ip4: 10.30.51.23 - lom_ip4: 10.30.51.23 - - unit: 33 - name: s24-nomad - oper_status: production - device_type: SYS-1029P-WTRT - serial_number: C1160LI12NM0241 - mgmt_ip4: 10.30.51.24 - lom_ip4: 10.30.51.24 - - unit: 32 - name: s25-nomad - oper_status: production - device_type: SYS-1029P-WTRT - serial_number: C1160LI12NM0540 - mgmt_ip4: 10.30.51.25 - lom_ip4: 10.30.51.25 - - unit: 31 - name: s61-t210-tg1 - oper_status: production - device_type: AS-1014S-WTRT - serial_number: C8150LI50NS2689 - mgmt_ip4: 10.32.8.25 - lom_ip4: 10.30.55.25 - - unit: 30 - name: s60-t210-sut1 - oper_status: production - device_type: AS-1114S-WTRT - serial_number: N/A - mgmt_ip4: 10.32.8.24 - lom_ip4: 10.30.55.24 - - unit: 26..29 - name: s26-nomad - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: C7470KH37A30505 - mgmt_ip4: 10.30.51.26 - lom_ip4: 10.30.51.26 - - unit: 22..25 - name: s33-t27-sut1 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: C7470KH37A30567 - mgmt_ip4: 10.32.8.18 - lom_ip4: 10.30.55.18 - - unit: 18..21 - name: s34-t27-tg1 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: C7470KH37A30565 - mgmt_ip4: 10.32.8.19 - lom_ip4: 10.30.55.19 - - unit: 14..17 - name: s35-t28-sut1 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: C7470KH37A30509 - mgmt_ip4: 10.32.8.20 - lom_ip4: 10.30.55.20 - - unit: 10..13 - name: s36-t28-tg1 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: C7470KH37A30511 - mgmt_ip4: 10.32.8.21 - lom_ip4: 10.30.55.21 - - unit: 6..9 - name: s37-t29-sut1 - oper_status: production - device_type: SYS-7049GP-TRT - serial_number: C7470KH37A30566 - mgmt_ip4: 10.32.8.22 - lom_ip4: 10.30.55.22 - lom_type: ipmi - - unit: 2..5 - name: s38-t29-tg1 - oper_status: production - model: SYS-7049GP-TRT - serial_number: C7470KH37A30506 - mgmt_ip4: 10.32.8.23 - ilo_ip4: 10.30.55.23
\ No newline at end of file diff --git a/docs/lab/testbed_specifications.md b/docs/lab/testbed_specifications.md deleted file mode 100644 index 47c41c23d3..0000000000 --- a/docs/lab/testbed_specifications.md +++ /dev/null @@ -1,2408 +0,0 @@ -# FD.io CSIT Testbed Specifications - -1. [Purpose](#purpose) -1. [Testbeds Overview](#testbeds-overview) - 1. [Summary List](#summary-list) - 1. [1-Node-Skylake Xeon Intel (1n-skx)](#1-node-skylake-xeon-intel-1n-skx) - 1. [1-Node-ThunderX2 Arm Marvell (1n-tx2)](#1-node-thunderx2-arm-marvell-1n-tx2) - 1. [1-Node-Cascadelake Xeon Intel (1n-clx)](#1-node-cascadelake-xeon-intel-1n-clx) - 1. [2-Node-Skylake Xeon Intel (2n-skx)](#2-node-skylake-xeon-intel-2n-skx) - 1. [2-Node-Denverton Atom Intel (2n-dnv)](#2-node-denverton-atom-intel-2n-dnv) - 1. [2-Node-IxiaPS1L47 Ixia PSOne L47 (2n-ps1)](#2-node-ixiaps1l47-ixia-psone-l47-2n-ps1) - 1. [2-Node-Cascadelake Xeon Intel (2n-clx)](#2-node-cascadelake-xeon-intel-2n-clx) - 1. [2-Node-Zen2 EPYC AMD (2n-zn2)](#2-node-zen2-epyc-amd-2n-zn) - 1. [2-Node-ThunderX2 Arm Marvell (2x-tx2)](#2-node-thunderx2-arm-marvell-2n-tx2) - 1. [2-Node-Icelake Xeon Intel (2n-icx)](#2-node-icelake-xeon-intel-2n-icx) - 1. [3-Node-Skylake Xeon Intel (3n-skx)](#3-node-skylake-xeon-intel-3n-skx) - 1. [3-Node-Rangeley Atom Testbeds](#3-node-rangeley-atom-testbeds) - 1. [3-Node-TaiShan Arm Huawei (3n-tsh)](#3-node-taishan-arm-huawei-3n-tsh) - 1. [3-Node-Altra Arm Ampere (3n-alt)](#3-node-altra-arm-armpere-3n-alt) - 1. [3-Node-Icelake Xeon Intel (3n-icx)](#3-node-icelake-xeon-intel-3n-icx) - 1. [3-Node-SnowRidge Atom Intel (3n-snr)](#3-node-snowridge-atom-intel-3n-snr) -1. [Server Management](#server-management) - 1. [Requirements](#requirements) - 1. [Addressing](#addressing) - 1. [LOM (IPMI) VLAN IP Addresses](#lom-ipmi-vlan-ip-addresses) - 1. [Management VLAN IP Addresses](#management-vlan-ip-addresses) -1. [Server Specifications](#server-specifications) - 1. [Server Types](#server-types) - 1. [Naming Convention](#naming-convention) -1. [Testbeds Configuration](#testbeds-configuration) - 1. [Per Testbed Server Allocation and Naming](#per-testbed-server-allocation-and-naming) - 1. [1-Node-Skylake Servers (1n-skx) PROD](#1-node-skylake-servers-1n-skx-prod) - 1. [1-Node-ThunderX2 Servers (1n-tx2) PROD](#1-node-thunderx2-servers-1n-tx2-prod) - 1. [1-Node-Cascadelake Servers (1n-clx) PROD](#1-node-cascadelake-servers-1n-clx-prod) - 1. [2-Node-Skylake Servers (2n-skx) PROD](#2-node-skylake-servers-2n-skx-prod) - 1. [2-Node-Denverton Servers (2n-dnv) PROD](#2-node-denverton-servers-2n-dnv-prod) - 1. [2-Node-IxiaPS1L47 Servers (2n-ps1) VERIFY](#2-node-ixiaps1l47-servers-2n-ps1-verify) - 1. [2-Node-Cascadelake Servers (2n-clx) PROD](#2-node-cascadelake-servers-2n-clx-prod) - 1. [2-Node-Zen2 Servers (2n-zn2) PROD](#2-node-zen2-servers-2n-zn2-prod]) - 1. [2-Node-ThunderX2 Servers (2n-tx2) PROD](#2-node-thunderx2-servers-2n-tx2-prod) - 1. [2-Node-Icelake Servers (2n-icx) PROD](#2-node-icelake-servers-2n-icx-prod) - 1. [3-Node-Skylake Servers (3n-skx) PROD](#3-node-skylake-servers-3n-skx-prod) - 1. [3-Node-Rangeley Servers (3n-rng) VERIFY](#3-node-rangeley-servers-3n-rng-verify) - 1. [3-Node-Taishan Servers (3n-tsh) PROD](#3-node-taishan-servers-3n-tsh-prod) - 1. [3-Node-Altra Servers (3n-alt) PROD](#3-node-altra-servers-3n-alt-prod) - 1. [3-Node-Icelake Servers (3n-icx) PROD](#3-node-icelake-servers-3n-icx-prod) - 1. [3-Node-SnowRidge Servers (3n-snr) PROD](#3-node-snowridge-servers-3n-snr-prod) - 1. [Per Testbed Wiring](#per-testbed-wiring) - 1. [1-Node-Skylake Wiring (1n-skx) PROD](#1-node-skylake-wiring-1n-skx-prod) - 1. [1-Node-ThunderX2 Wiring (1n-tx2) PROD](#1-node-thunderx2-wiring-1n-tx2-prod) - 1. [1-Node-Cascadelake Wiring (1n-clx) PROD](#1-node-cascadelake-wiring-1n-clx-prod) - 1. [2-Node-Skylake Wiring (2n-skx) PROD](#2-node-skylake-wiring-2n-skx-prod) - 1. [2-Node-Denverton Wiring (2n-dnv) PROD](#2-node-denverton-wiring-2n-dnv-prod) - 1. [2-Node-IxiaPS1L47 Wiring (2n-ps1) VERIFY](#2-node-ixiaps1l47-wiring-2n-ps1-verify) - 1. [2-Node-Cascadelake Wiring (2n-clx) PROD](#2-node-cascadelake-wiring-2n-clx-prod) - 1. [2-Node-Zen2 Wiring (2n-zn2) PROD](#2-node-zen2-wiring-2n-zn2-prod]) - 1. [2-Node-ThunderX2 Wiring (2n-tx2) PROD](#2-node-thunderx2-wiring-2n-tx2-prod) - 1. [2-Node-Icelake Servers (2n-icx) PROD](#2-node-icelake-servers-2n-icx-prod) - 1. [3-Node-Skylake Wiring (3n-skx) PROD](#3-node-skylake-wiring-3n-skx-prod) - 1. [3-Node-Rangeley Wiring (3n-rng) VERIFY](#3-node-rangeley-wiring-3n-rng-todo) - 1. [3-Node-Taishan Wiring (3n-tsh) PROD](#3-node-taishan-wiring-3n-tsh-prod) - 1. [3-Node-Altra Wiring (3n-alt) PROD](#3-node-altra-wiring-3n-alt-prod) - 1. [3-Node-Icelake Wiring (3n-icx) PROD](#3-node-icelake-wiring-3n-icx-prod) - 1. [3-Node-SnowRidge Wiring (3n-snr) PROD](#3-node-snowridge-wiring-3n-snr-prod) -1. [Inventory](#inventory) - 1. [Appliances](#appliances) - 1. [Arm Servers](#arm-servers) - 1. [Xeon and Atom Servers](#xeon-and-atom-servers) - 1. [Network Interface Cards](#network-interface-cards) - 1. [Pluggables and Cables](#pluggables-and-cables) - 1. [Other Parts](#other-parts) - -## Purpose - -This note includes specification of the physical testbed infrastructure -hosted by LFN FD.io CSIT project. - -## Testbeds Overview - -### Summary List - -``` - #. CSIT_tb Purpose SUT TG #TB #SUT #TG #hsw #skx #ps1 #rng #dnv #tx2 #tsh #alt #clx #zn2 #icx #snr - 1. 1-Node-Haswell nomad hsw na 4 4 0 4 0 0 0 0 0 0 0 0 0 0 0 - 2. 1-Node-Skylake dev skx na 2 2 0 0 2 0 0 0 0 0 0 0 0 0 0 - 3. 1-Node-ThunderX2 dev tx2 na 2 2 0 0 0 0 0 0 2 0 0 0 0 0 0 - 4. 1-Node-Cascadelake dev clx lcx 1 1 0 0 0 0 0 0 0 0 0 1 0 0 0 - 5. 1-Node-AmpereAltra nomad alt na 2 2 0 0 0 0 0 0 0 0 2 0 0 0 0 - 6. 2-Node-Skylake perf skx skx 3 3 3 0 6 0 0 0 0 0 0 0 0 0 0 - 7. 2-Node-Denverton perf dnv skx 1 1 1 0 .5 0 0 1 0 0 0 0 0 0 0 - 8. 2-Node-IxiaPS1L47 tcp skx ps1 1 1 1 0 1 1 0 0 0 0 0 0 0 0 0 - 9. 2-Node-Cascadelake perf clx clx 3 3 3 0 0 0 0 0 0 0 0 6 0 0 0 -10. 2-Node-ThunderX2 perf tx2 skx 1 1 .5 0 .5 0 0 0 1 0 0 0 0 0 0 -11. 2-Node-Icelake perf icx icx 4 4 4 0 0 0 0 0 0 0 0 0 0 8 0 -12. 3-Node-Skylake perf skx skx 2 4 2 0 6 0 0 0 0 0 0 0 0 0 0 -13. 3-Node-Rangeley perf rng skx 1 3 1 0 0 0 2 0 0 0 0 0 0 0 0 -14. 3-Node-Taishan perf tsh skx 1 2 .5 0 .5 0 0 0 0 2 0 0 0 0 0 -15. 3-Node-Altra perf alt icx 1 2 1 0 0 0 0 0 0 0 2 0 0 1 0 -16. 3-Node-Denverton perf dnv skx 1 2 1 0 .5 0 0 2 0 0 0 0 0 0 0 -17. 2-Node-Zen2 perf zn2 zn2 1 1 1 0 0 0 0 0 0 0 0 0 2 0 0 -18. 3-Node-Icelake perf icx icx 2 4 2 0 0 0 0 0 0 0 0 0 0 6 0 -19. 3-Node-SnowRidge perf snr icx 1 2 .5 0 0 0 0 0 0 0 0 0 0 .5 2 - Totals: 34 44 21.5 4 17 1 2 3 3 2 4 7 2 15.5 2 -``` - -### 1-Node-Skylake Xeon Intel (1n-skx) - -Each 1-Node-Skylake testbed includes one SUT (Server-Type-B6) with NIC -ports connected back-to-back ([Server Types](#server-types)). -Used for FD.io VPP_Device functional driver tests. - -### 1-Node-ThunderX2 Arm Marvell (1n-tx2) - -Each 1-Node-ThunderX2 testbed includes one SUT (Server-Type-E11) with NIC -ports connected back-to-back ([Server Types](#server-types)). -Used for FD.io VPP_Device functional driver tests. - -### 1-Node-Cascadelake Xeon Intel (1n-clx) - -Each 1-Node-Cascadelake testbed includes one SUT (Server-Type-C1) with -NIC ports connected back-to-back ([Server Types](#server-types)). - -Used for FD.io VPP_Device functional driver tests. - -### 2-Node-Skylake Xeon Intel (2n-skx) - -Each 2-Node-Skylake testbed includes one SUT (Server-Type-B1) and one TG -(Server-Type-B2) connected in a 2-node circular topology -([Server Types](#server-types)). -Used for FD.io performance tests. - -### 2-Node-Denverton Atom Intel (2n-dnv) - -Each 2-Node-Skylake testbed includes one SUT (Server-Type-B10) and one -TG (Server-Type-B2) connected in a 2-node circular topology -([Server Types](#server-types)). -Used for FD.io performance tests. - -### 2-Node-IxiaPS1L47 Ixia PSOne L47 (2n-ps1) - -Each 2-Node-IxiaPS1L47 testbed includes one SUT (Server-Type-B1) and one -TG (Ixia PSOne appliance) with 10GE interfaces connected in a 2-node -circular topology ([Server Types](#server-types)). -Used for FD.io TCP/IP and HTTP performance tests. - -### 2-Node-Cascadelake Xeon Intel (2n-clx) - -Each 2-Node-Cascadelake testbed includes one SUT (Server-Type-C2) and -one TG (Server-Type-C3) connected in a 2-node circular topology -([Server Types](#server-types)). -Used for FD.io performance tests. - -### 2-Node-Zen2 EPYC AMD (2n-zn2) - -Each 2-Node-Zen2 testbed includes one SUT (Server-Type-D1) and -one TG (Server-Type-D2) connected in a 2-node circular topology -([Server Types](#server-types)). -Used for FD.io performance tests. - -### 2-Node-ThunderX2 Arm Marvell (2x-tx2) - -Each 2-Node-ThunderX2 testbed includes one SUT (Server-Type-E22) and -one TG (Server-Type-E31) connected in a 2-node circular topology -([Server Types](#server-types)). -Used for FD.io performance tests. - -### 2-Node-Icelake Xeon Intel (2n-icx) - -Each 2-Node-Icelake testbed includes one SUT (Server-Type-F1) and -one TG (Server-Type-F2) connected in a 2-node circular topology -([Server Types](#server-types)). -Used for FD.io performance tests. - -### 3-Node-Haswell Xeon Intel (3n-hsw) - -Each 3-Node-Haswell testbed includes two SUTs (Server-Type-A1) and one -TG (Server-Type-A2) connected in a 3-node circular topology -([Server Types](#server-types)). -Used for FD.io performance tests. - -### 3-Node-Skylake Xeon Intel (3n-skx) - -Each 3-Node-Skylake testbed includes two SUTs (Server-Type-B1) and one -TG (Server-Type-B2) connected in a 3-node circular topology. -Used for FD.io performance tests. - -### 3-Node-Rangeley Atom Testbeds - -Each 3-Node-Rangeley testbed includes two SUTs (Server-Type-B5) and one -TG (Server-Type-2) connected in a 3-node circular topology -([Server Types](#server-types)). -Used for FD.io performance tests. - -### 3-Node-TaiShan Arm Huawei (3n-tsh) - -Each 3-Node-TaiShan testbed includes two SUTs (Server-Type-E21) and one -TG (Server-Type-E31) connected in a 3-node circular topology -([Server Types](#server-types)). -Used for FD.io performance tests. - -### 3-Node-Altra Arm Ampere (3n-alt) - -Each 3-Node-Altra testbed includes two SUTs (Server-Type-E23) and one -TG (Server-Type-F4) connected in a 3-node circular topology -([Server Types](#server-types)). -Used for FD.io performance tests. - -### 3-Node-Icelake Xeon Intel (3n-icx) - -Each 3-Node-Icelake testbed includes two SUTs (Server-Type-F1) and one -TG (Server-Type-F3) connected in a 3-node circular topology -([Server Types](#server-types)). -Used for FD.io performance tests. - -### 3-Node-SnowRidge Atom Intel (3n-snr) - -Each 3-Node-SnowRidge testbed includes two SUTs (Server-Type-G1) and one -TG (Server-Type-F4) connected in a 3-node circular topology -([Server Types](#server-types)). -Used for FD.io performance tests. - - -## Server Management - -### Requirements - -For management purposes, each server must have following two ports -connected to the management network: - -``` -- 1GE IPMI port - - IPMI - Intelligent Platform Management Interface. - - Required for access to embedded server management with WebUI, CLI, - SNMPv3, IPMIv2.0, for firmware (BIOS) and OS updates. -- 1GE/10GE/40GE management port - - hostOS management port for general system management. -``` - -### Addressing - -Each server has a LOM (Lights-Out-Management e.g. SM IPMI) and a -Management port, which are connected to two different VLANs. - -``` -1. LOM (IPMI) VLAN: - - Subnet: 10.30.50.0/24 - - Gateway: 10.30.50.1 - - Broadcast: 10.30.50.255 - - DNS1: 199.204.44.24 - - DNS2: 199.204.47.54 -2. Management Vlan: - - Subnet: 10.30.51.0/24 - - Gateway: 10.30.51.1 - - Broadcast: 10.30.51.255 - - DNS1: 199.204.44.24 - - DNS2: 199.204.47.54 -``` - -To access these hosts, VPN connection is required. - -### LOM (IPMI) VLAN IP Addresses - -Name | Comment ------------- | ------- -10.30.50.0 | network -10.30.51.1 | Router -10.30.50.2 | LF Reserved -10.30.50.3 | LF Reserved -10.30.50.4 | LF Reserved -10.30.50.5 | LF Reserved -10.30.50.6 | LF Reserved -10.30.50.7 | LF Reserved -10.30.50.8 | LF Reserved -10.30.50.9 | LF Reserved -10.30.50.10 | LF Reserved -10.30.50.11 | LF Reserved -10.30.50.12 | LF Reserved -10.30.50.13 | LF Reserved -10.30.50.14 | LF Reserved -10.30.50.15 | LF Reserved -10.30.50.16 | s16-nomad -10.30.50.17 | s17-nomad -10.30.50.18 | s18-nomad -10.30.50.19 | s19-nomad -10.30.50.20 | s20-nomad -10.30.50.21 | s21-nomad -10.30.50.22 | s22-nomad -10.30.50.23 | s23-nomad -10.30.50.24 | s24-nomad -10.30.50.25 | s25-nomad -10.30.50.26 | s26-nomad -10.30.50.36 | s17-t33-sut1 -10.30.50.37 | s18-t33-sut2 -10.30.50.38 | fdio-marvell-dev -10.30.50.41 | s3-t21-sut1 -10.30.50.42 | s4-t21-tg1 -10.30.50.43 | s11-t31-sut1 -10.30.50.44 | s12-t31-sut2 -10.30.50.45 | s13-t31-tg1 -10.30.50.46 | s19-t33t211-tg1 -10.30.50.47 | s1-t11-sut1 -10.30.50.48 | s2-t12-sut1 -10.30.50.49 | s5-t22-sut1 -10.30.50.50 | s6-t22-tg1 -10.30.50.51 | s7-t23-sut1 -10.30.50.52 | s8-t23-tg1 -10.30.50.53 | s9-t24-sut1 -10.30.50.54 | s10-t24-tg1 -10.30.50.55 | s14-t32-sut1 -10.30.50.56 | s15-t32-sut2 -10.30.50.57 | s16-t32-tg1 -10.30.50.58 | s25-t25-sut1 -10.30.50.59 | s26-t25-tg1 -10.30.50.69 | s27-t211-sut1 -10.30.50.70 | s55-t13-sut1 -10.30.50.71 | s56-t14-sut1 -10.30.50.72 | s62-t34-sut1 -10.30.50.73 | s63-t34-sut2 -10.30.50.74 | s64-t34-tg1 -10.30.50.75 | s65-t37-sut1 -10.30.50.76 | s66-t37-sut2 -10.30.50.77 | s67-t37-tg1 -10.30.50.78 | s78-t38-sut1 -10.30.50.79 | s79-t38-sut2 -10.30.50.80 | s80-t38-tg1 -10.30.50.81 | s71-t212-sut1 -10.30.50.82 | s72-t212-tg1 -10.30.50.83 | s83-t213-sut1 -10.30.50.84 | s84-t213-tg1 -10.30.50.85 | s85-t214-sut1 -10.30.50.86 | s86-t214-tg1 -10.30.50.87 | s87-t215-sut1 -10.30.50.88 | s88-t215-tg1 -10.30.50.89 | s89-t39t310-tg1 -10.30.50.90 | s90-t311t312-tg1 -10.30.50.91 | s91-nomad -10.30.50.92 | s92-nomad -10.30.50.93 | s93-t39-sut1 -10.30.50.94 | s94-t39-sut2 -10.30.50.255 | Broadcast -10.30.55.0 | network -10.30.55.1 | Router -10.30.55.10 | s28-t26t35-tg1 -10.30.55.11 | s29-t26-sut1 -10.30.55.12 | s30-t35-sut1 -10.30.55.13 | s31-t35-sut2 -10.30.55.18 | s33-t27-sut1 -10.30.55.19 | s34-t27-tg1 -10.30.55.20 | s35-t28-sut1 -10.30.55.21 | s36-t28-tg1 -10.30.55.22 | s37-t29-sut1 -10.30.55.23 | s38-t29-tg1 -10.30.55.24 | s60-t210-sut1 -10.30.55.25 | s61-t210-tg1 -10.30.55.255 | Broadcast - -### Management VLAN IP Addresses - -Name | Comment --------------| ------- -10.30.51.0 | network -10.30.51.1 | Router -10.30.51.2 | LF Reserved -10.30.51.3 | LF Reserved -10.30.51.4 | LF Reserved -10.30.51.5 | LF Reserved -10.30.51.6 | LF Reserved -10.30.51.7 | LF Reserved -10.30.51.8 | LF Reserved -10.30.51.15 | LF Reserved -10.30.51.16 | s16-nomad -10.30.51.17 | s17-nomad -10.30.51.18 | s18-nomad -10.30.51.19 | s19-nomad -10.30.51.20 | s20-nomad -10.30.51.21 | s21-nomad -10.30.51.22 | s22-nomad -10.30.51.23 | s23-nomad -10.30.51.24 | s24-nomad -10.30.51.25 | s25-nomad -10.30.51.26 | s26-nomad -10.30.51.36 | s17-t33-sut1 -10.30.51.37 | s18-t33-sut2 -10.30.51.38 | fdio-marvell-dev -10.30.51.44 | s3-t21-sut1 -10.30.51.45 | s4-t21-tg1 -10.30.51.46 | s11-t31-sut1 -10.30.51.47 | s12-t31-sut2 -10.30.51.48 | s13-t31-tg1 -10.30.51.49 | s19-t33t211-tg1 -10.30.51.50 | s1-t11-sut1 -10.30.51.51 | s2-t12-sut1 -10.30.51.52 | s5-t22-sut1 -10.30.51.53 | s6-t22-tg1 -10.30.51.54 | s7-t23-sut1 -10.30.51.55 | s8-t23-tg1 -10.30.51.56 | s9-t24-sut1 -10.30.51.57 | s10-t24-tg1 -10.30.51.58 | s14-t32-sut1 -10.30.51.59 | s15-t32-sut2 -10.30.51.60 | s16-t32-tg1 -10.30.51.61 | s25-t25-sut1 -10.30.51.62 | s26-t25-tg1 -10.30.51.69 | s27-t211-sut1 -10.30.51.70 | s55-t13-sut1 -10.30.51.71 | s56-t14-sut1 -10.30.51.72 | s62-t34-sut1 -10.30.51.73 | s63-t34-sut2 -10.30.51.74 | s64-t34-tg1 -10.30.51.75 | s65-t37-sut1 -10.30.51.76 | s66-t37-sut2 -10.30.51.77 | s67-t37-tg1 -10.30.51.78 | s78-t38-sut1 -10.30.51.79 | s79-t38-sut2 -10.30.51.80 | s80-t38-tg1 -10.30.51.81 | s71-t212-sut1 -10.30.51.82 | s72-t212-tg1 -10.30.51.83 | s83-t213-sut1 -10.30.51.84 | s84-t213-tg1 -10.30.51.85 | s85-t214-sut1 -10.30.51.86 | s86-t214-tg1 -10.30.51.87 | s87-t215-sut1 -10.30.51.88 | s88-t215-tg1 -10.30.51.89 | s89-t39t310-tg1 -10.30.51.90 | s90-t311t312-tg1 -10.30.51.91 | s91-nomad -10.30.51.92 | s92-nomad -10.30.51.93 | s93-t39-sut1 -10.30.51.94 | s94-t39-sut2 -10.30.51.255 | Broadcast -10.32.8.0 | network -10.32.8.1 | Router -10.32.8.10 | s28-t26t35-tg1 -10.32.8.11 | s29-t26-sut1 -10.32.8.12 | s30-t35-sut1 -10.32.8.13 | s31-t35-sut2 -10.32.8.18 | s33-t27-sut1 -10.32.8.19 | s34-t27-tg1 -10.32.8.20 | s35-t28-sut1 -10.32.8.21 | s36-t28-tg1 -10.32.8.22 | s37-t29-sut1 -10.32.8.23 | s38-t29-tg1 -10.32.8.24 | s60-t210-sut1 -10.32.8.25 | s61-t210-tg1 -10.32.8.255 | Broadcast - -## Server Specifications - -### Server Types - -FD.io CSIT lab contains following server types: -``` -1. Server-Type-A1: Purpose - Haswell Xeon SUT (Systems Under Test) for FD.io performance testing. - - Quantity: 6 servers. - - Physical connectivity: - - CIMC and host management ports. - - NIC ports connected in 3-node topologies. - - Main HW configuration: - - Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots. - - Processors: 2* E5-2699v3 2.3 GHz. - - RAM Memory: 16* 32GB DDR4-2133MHz. - - Disks: 2* 2TB 12G SAS 7.2K RPM SFF HDD. - - NICs configuration: - - Numa0: Right PCIe Riser Board (Riser 1) (x8, x8, x8 PCIe3.0 lanes) - - PCIe Slot1: empty. - - PCIe Slot2: empty. - - PCIe Slot3: empty. - - Numa1: Left PCIe Riser Board (Riser 2) (x8, x16, x8 PCIe3.0 lanes) - - PCIe Slot4: empty. - - PCIe Slot5: empty. - - PCIe Slot6: empty - - MLOM slot: Cisco VIC 1227 2p10GE (x8 PCIe2.0 lanes). -2. Server-Type-A2: Purpose - Haswell Xeon TG (Traffic Generators) for FD.io performance testing. - - Quantity: 3 servers. - - Physical connectivity: - - CIMC and host management ports. - - NIC ports connected in 3-node topologies. - - Main HW configuration: - - Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots. - - Processors: 2* E5-2699v3 2.3 GHz. - - RAM Memory: 16* 32GB DDR4-2133MHz. - - Disks: 2* 2TB 12G SAS 7.2K RPM SFF HDD. - - NICs configuration: - - Numa0: Right PCIe Riser Board (Riser 1) (x8, x8, x8 PCIe3.0 lanes) - - PCIe Slot1: empty. - - PCIe Slot2: empty. - - PCIe Slot3: empty. - - Numa1: Left PCIe Riser Board (Riser 2) (x8, x16, x8 PCIe3.0 lanes) - - PCIe Slot4: empty. - - PCIe Slot5: empty. - - PCIe Slot6: empty - - MLOM slot: empty. -3. Server-Type-A3: Purpose - Haswell Xeon VIRL hosts for FD.io functional testing. - - Quantity: 3 servers. - - Physical connectivity: - - CIMC and host management ports. - - no NIC ports, standalone setup. - - Main HW configuration: - - Chassis: UCSC-C240-M4SX with 6 PCIe3.0 slots. - - Processors: 2* E5-2699v3 2.3 GHz. - - RAM Memory: 16* 32GB DDR4-2133MHz. - - Disks: 2* 480 GB 2.5inch 6G SATA SSD. - - NICs configuration: - - Numa0: Right PCIe Riser Board (Riser 1) (x8, x8, x8 lanes) - - no cards. - - Numa1: Left PCIe Riser Board (Riser 2) (x8, x16, x8 lanes) - - no cards. - - MLOM slot: empty. -4. Server-Type-B1: Purpose - Skylake Xeon SUT for FD.io performance testing. - - Quantity: --- - - Physical connectivity: - - IPMI and host management ports. - - NIC ports connected into 2-node and 3-node topologies. - - Main HW configuration: - - Chassis: SuperMicro SYS-7049GP-TRT. - - Motherboard: SuperMicro X11DPG-QT. - - Processors: 2* Intel Platinum 8180 2.5 GHz. - - RAM Memory: 16* 16GB DDR4-2666MHz. - - Disks: 2* 1.6TB 6G SATA SSD. - - NICs configuration: - - Numa0: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot2 18:00.xx: x710-4p10GE Intel. - - PCIe Slot4 3b:00.xx: xxv710-DA2-2p25GE Intel. - - PCIe Slot9 5e:00.xx: empty. - - Numa1: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot6 86:00.xx: empty. - - PCIe Slot8 af:00.xx: empty. - - PCIe Slot10 d8:00.xx: empty. -5. Server-Type-B2: Purpose - Skylake Xeon TG for FD.io performance testing. - - Quantity: --- - - Physical connectivity: - - IPMI and host management ports. - - NIC ports connected into 2-node and 3-node topologies. - - Main HW configuration: - - Chassis: SuperMicro SYS-7049GP-TRT. - - Motherboard: SuperMicro X11DPG-QT. - - Processors: 2* Intel Platinum 8180 2.5 GHz. - - RAM Memory: 16* 16GB DDR4-2666MHz. - - Disks: 2* 1.6TB 6G SATA SSD. - - NICs configuration: - - Numa0: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot2 18:00.xx: x710-4p10GE Intel. - - PCIe Slot4 3b:00.xx: xxv710-DA2 2p25GE Intel. - - PCIe Slot9 5e:00.xx: empty. - - Numa1: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot6 86:00.xx: empty. - - PCIe Slot8 af:00.xx: empty. - - PCIe Slot10 d8:00.xx: x710-4p10GE Intel. -6. Server-Type-B5: Purpose - Rangeley Atom SUT for FD.io performance testing. - - Quantity: TBD based on testbed allocation. - - Physical connectivity: - - Management: serial Port (usb) for console - - NIC ports connected into 2-node. - - Main HW configuration: - - Chassis: Netgate XG-2758-1u - - Processors: 1* Rangeley (Atom) C2758 2.4 GHz - - RAM Memory: 16GB ECC - - Disks: 150 GB - - NICs configuration: - - 2x 10Gb Intel 82599ES - - 4x 1GB Intel I354 -7. Server-Type-B6: Purpose - Skylake Xeon SUT for FD.io VPP_Device functional tests. - - Quantity: 2. - - Physical connectivity: - - IPMI and host management ports. - - NIC ports connected into 1-node topologies. - - Main HW configuration: - - Chassis: SuperMicro SYS-7049GP-TRT. - - Motherboard: SuperMicro X11DPG-QT. - - Processors: 2* Intel Platinum 8180 2.5 GHz. - - RAM Memory: 16* 16GB DDR4-2666MHz. - - Disks: 2* 1.6TB 6G SATA SSD. - - NICs configuration: - - Numa0: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot2 18:00.xx: x710-4p10GE Intel. - - PCIe Slot4 3b:00.xx: x710-4p10GE Intel. - - PCIe Slot9 5e:00.xx: empty. - - Numa1: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot6 86:00.xx: empty. - - PCIe Slot8 af:00.xx: empty. - - PCIe Slot10 d8:00.xx: empty. -8. Server-Type-B7: Purpose - Ixia PerfectStorm One Appliance TG for FD.io TCP/IP performance tests. - - Quantity: 1. - - Physical connectivity: - - Host management interface: 10/100/1000-BaseT. - - 8-port 10GE SFP+ integrated NIC. - - Main HW configuration: - - Chassis: PS10GE4NG. - - Motherboard: SuperMicro X11DPG-QT. - - Processors: Quad-Core, Intel Processor. - - HW accelerators: FPGA offload. - - RAM Memory: 64GB. - - Disks: 1 * 1 TB, Enterprise Class, High MTBF. - - Physical Interfaces: 4 * 10GE SFP+. - - Operating System: Native IxOS. - - Interface configuration: - - Port-1: 10GE SFP+. - - Port-2: 10GE SFP+. - - Port-3: 10GE SFP+. - - Port-4: 10GE SFP+. -9. Server-Type-B8: Purpose - Skylake Xeon SUT for TCP/IP host stack tests. - - Quantity: 1. - - Physical connectivity: - - IPMI and host management ports. - - NIC ports. - - Main HW configuration: - - Chassis: SuperMicro SYS-7049GP-TRT. - - Motherboard: SuperMicro X11DPG-QT. - - Processors: 2* Intel Platinum 8180 2.5 GHz. - - RAM Memory: 16* 16GB DDR4-2666MHz. - - Disks: 2* 1.6TB 6G SATA SSD. - - NICs configuration: - - Numa0: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot2 18:00.xx: x710-4p10GE Intel. - - PCIe Slot4 3b:00.xx: empty. - - PCIe Slot9 5e:00.xx: empty. - - Numa1: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot6 86:00.xx: empty. - - PCIe Slot8 af:00.xx: empty. - - PCIe Slot10 d8:00.xx: empty. -10. Server-Type-B10: Purpose - Denverton Atom SUT for FD.io performance testing. - - Quantity: 4 - - Physical connectivity: - - IPMI and host management ports. - - NIC ports. - - Main HW configuration: - - Chassis: SuperMicro SYS-E300-9A - - Processors: 1* Intel(R) Atom(TM) CPU C3858 @ 2.00GHz - - RAM Memory: 32GB ECC - - Disks: 480 GB - - NICs configuration: - - 2x 10Gb Intel x553 fiber ports - - 2x 10Gb Intel x553 copper ports - - 4x 1GB Intel I350 ports -11. Server-Type-C1: Purpose - Cascadelake Xeon SUT for FD.io VPP_Device functional tests. - - Quantity: 1. - - Physical connectivity: - - IPMI and host management ports. - - NIC ports connected into 1-node testbed topologies. - - Main HW configuration: - - Chassis: SuperMicro SYS-7049GP-TRT. - - Motherboard: SuperMicro X11DPG-QT. - - Processors: 2* Intel Platinum 8280 2.7 GHz. - - RAM Memory: 12* 16GB DDR4-2933. - - Disks: 2* 1.92TB SATA SSD. - - NICs configuration: - - Numa0: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot2 18:00.xx: x710-4p10GE Intel. - - PCIe Slot4 3b:00.xx: x710-4p10GE Intel. - - PCIe Slot9 5e:00.xx: empty. - - Numa1: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot6 86:00.xx: empty. - - PCIe Slot8 af:00.xx: empty. - - PCIe Slot10 d8:00.xx: empty. -12. Server-Type-C2: Purpose - Cascadelake Xeon SUT for FD.io performance testing. - - Quantity: 3 - - Physical connectivity: - - IPMI and host management ports. - - NIC ports connected into 2-node testbed topologies. - - Main HW configuration: - - Chassis: SuperMicro SYS-7049GP-TRT. - - Motherboard: SuperMicro X11DPG-QT. - - Processors: 2* Intel Gold 6252N 2.3 GHz. - - RAM Memory: 12* 16GB DDR4-2933. - - Disks: 2* 1.92TB SATA SSD. - - NICs configuration: - - Numa0: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot2 18:00.xx: x710-4p10GE Intel. - - PCIe Slot4 3b:00.xx: xxv710-DA2-2p25GE Intel. - - PCIe Slot9 5e:00.xx: ConnectX5-2p100GE Mellanox. - - Numa1: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot6 86:00.xx: e810-2p100GE Intel. - - PCIe Slot8 af:00.xx: empty. - - PCIe Slot10 d8:00.xx: empty. -13. Server-Type-C3: Purpose - Cascadelake Xeon TG for FD.io performance testing. - - Quantity: 3. - - Physical connectivity: - - IPMI and host management ports. - - NIC ports connected into 2-node testbed topologies. - - Main HW configuration: - - Chassis: SuperMicro SYS-7049GP-TRT. - - Motherboard: SuperMicro X11DPG-QT. - - Processors: 2* Intel Platinum 8280 2.7 GHz. - - RAM Memory: 12* 16GB DDR4-2933. - - Disks: 2* 1.92TB SATA SSD. - - NICs configuration: - - Numa0: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot2 18:00.xx: x710-4p10GE Intel. - - PCIe Slot4 3b:00.xx: xxv710-DA2 2p25GE Intel. - - PCIe Slot9 5e:00.xx: ConnectX5-2p100GE Mellanox. - - Numa1: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot6 86:00.xx: ConnectX5-2p100GE Mellanox. - - PCIe Slot8 af:00.xx: ConnectX5-2p100GE Mellanox. - - PCIe Slot10 d8:00.xx: empty. -14. Server-Type-C4: Purpose - Cascadelake Xeon Backend hosts for FD.io builds and data processing. - - Quantity: 3. - - Physical connectivity: - - IPMI and host management ports. - - no NIC ports, standalone setup. - - Main HW configuration: - - Chassis: SuperMicro 1029P-WTRT. - - Motherboard: SuperMicro X11DDW-NT. - - Processors: 2* Intel Platinum 8280 2.7 GHz. - - RAM Memory: 12* 16GB DDR4-2933. - - Disks: 4* 1.92TB SATA SSD. - - NICs configuration: - - Numa0: - - no cards. - - Numa1: - - no cards. -15. Server-Type-D1: Purpose - Zen2 EPYC SUT for FD.io performance testing. - - Quantity: 1. - - Physical connectivity: - - IPMI and host management ports. - - NIC ports connected into 2-node testbed topologies. - - Main HW configuration: - - Chassis: SuperMicro AS-1114S-WTRT - - Processors: 1* AMD EPYC 7532 2.4 GHz. - - RAM Memory: 8* 32GB DDR4-2933. - - Disks: 1* 1TB SATA SSD. - - NICs configuration: - - Numa0: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot1 01:00.xx: x710-4p10GE Intel. - - PCIe Slot2 41:00.xx: xxv710-DA2-2p25GE Intel. - - PCIe Slot3 81:00.xx: mcx556a-edat ConnectX5-2p100GE Mellanox. -16. Server-Type-D2: Purpose - Zen2 EPYC TG for FD.io performance testing. - - Quantity: 1. - - Physical connectivity: - - IPMI and host management ports. - - NIC ports connected into 2-node testbed topologies. - - Main HW configuration: - - Chassis: SuperMicro AS-1114S-WTRT - - Processors: 1* AMD EPYC 7532 2.4 GHz. - - RAM Memory: 8* 32GB DDR4-2933. - - Disks: 1* 1TB SATA SSD. - - NICs configuration: - - Numa0: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot1 01:00.xx: mcx556a-edat ConnectX5-2p100GE Mellanox. - - PCIe Slot2 41:00.xx: x710-4p10GE Intel. - - PCIe Slot3 81:00.xx: xxv710-DA2 2p25GE Intel. -17. Server-Type-E11: Purpose - ThunderX2 Arm Marvell SUT for FD.io VPP_Device functional tests. - - Quantity: 2 - - Physical connectivity: - - IPMI and host management ports. - - NIC ports connected into 1-node topologies. - - Main HW configuration: - - Chassis: GIGABYTE Rack Mount - - Motherboard: MT91-FS4-00 - - Processors: 2 * ThunderX2 ARMv8 CN9980 2.20 GHz - - RAM Memory: 16 * 16GB DIMM - - Disks: 2 * 480GB 6G SATA SSD SAMSUNG MZ7LH480 - - NICs configuration: - - Numa0: - - PCIe Slot4 05:00.xx: XL710-QDA2-2p40GE Intel. - - PCIe Slot8 0b:00.xx: ConnectX5-2p10/25GE Mellanox. - - Numa1: - - PCIe Slot14 91:00.xx: XL710-QDA2-2p40GE Intel. - - PCIe Slot26 9a:00.xx: ConnectX5-2p10/25GE Mellanox. -18. Server-Type-E21: Purpose - TaiShan Arm Huawei SUT for FD.io performance testing. - - Quantity: 2 - - Physical connectivity: - - IPMI(?) and host management ports. - - NIC ports connected into 3-node topology. - - Main HW configuration: - - Chassis: Huawei TaiShan 2280. - - Processors: 2* hip07-d05 ~ 32* Arm Cortex-A72 - - RAM Memory: 8* 16GB DDR4-2400MT/s - - Disks: 1* 4TB SATA HDD - - NICs configuration: - - PCIe Slot4 e9:00.xx: connectx4-2p25GE Mellanox. - - PCIe Slot6 11:00.xx: x520-2p10GE Intel. -19. Server-Type-E22: Purpose - ThunderX2 Arm Marvell SUT for FD.io performance testing. - - Quantity: 1 - - Physical connectivity: - - IPMI and host management ports. - - NIC ports connected into 2-node topologies. - - Main HW configuration: - - Chassis: Gigabyte R181-T90 1U - - Motherboard: MT91-FS1 - - Processors: 2* ThunderX2 ARMv8 CN9975 2.0 GHz - - RAM Memory: 4* 32GB RDIMM - - Disks: 1* 480GB SSD Micron, 1* 1000GB HDD Seagate_25 - - NICs configuration: - - Numa0: - - no cards - - Numa1: - - PCIe Slot18 91:00.xx: XL710-QDA2-2p40GE Intel. -20. Server-Type-E23: Purpose - Altra Arm Ampere SUT for FD.io performance testing. - - Quantity: 2 - - Physical connectivity: - - IPMI and host management ports. - - NIC ports connected into 3-node topologies. - - Main HW configuration: - - Chassis: WIWYNN Mt.Jade Server System B81.030Z1.0007 2U - - Motherboard: Mt.Jade Motherboard - - Processors: 2* Ampere(R) Altra(R) Q80-30 Processor (Neoverse N1) - - Processor Signature: Implementor 0x41, Variant 0x3, Architecture 15, Part 0xd0c, Revision 1 - - RAM Memory: 16* 8GB DDR4-3200MT/s - - Disks: 2* 960GB SSD Samsung M.2 NVMe PM983 - - NICs configuration: - - Numa0: - - PCIe Slot1 0004:04:00.x: xl710-QDA2-2p40GE Intel. - - Numa1: - - no cards. -21. Server-Type-E24 : Purpose - Altra Arm Ampere for FD.io build. - - Quantity: 2. - - Physical connectivity: - - IPMI and host management ports. - - Main HW configuration: - - Chassis: Gigabyte R152-P30-00 1U - - Motherboard: MP32-AR1-00 - - Processors: 1* Ampere(R) Altra(R) Q80-30 Processor (Neoverse N1) - - Processor Signature: Implementor 0x0a, Variant 0x1, Architecture 6, Part 0x000, Revision 1 - - RAM Memory: 12* 16GB DDR4-3200MT/s - - Disks: 1* 960GB SSD Samsung M.2 NVMe PM983 -22. Server-Type-E31: Purpose - Skylake Xeon TG for FD.io performance testing. - - Quantity: 1 - - Physical connectivity: - - IPMI and host management ports. - - NIC ports connected into 2-node and 3-node topologies. - - Main HW configuration: - - Chassis: SuperMicro SYS-7049GP-TRT. - - Motherboard: SuperMicro X11DPG-QT. - - Processors: 2* Intel Platinum 8180 2.5 GHz. - - RAM Memory: 16* 16GB DDR4-2666MHz. - - Disks: 2* 1.6TB 6G SATA SSD. - - NICs configuration: - - Numa0: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot2 18:00.xx: x710-4p10GE Intel. - - PCIe Slot4 3b:00.xx: xxv710-DA2 2p25GE Intel. - - PCIe Slot9 5e:00.xx: empty. - - Numa1: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot6 86:00.xx: empty. - - PCIe Slot8 af:00.xx: XL710-QDA2-2p40GE Intel. - - PCIe Slot10 d8:00.xx: x710-4p10GE Intel. -23. Server-Type-F1: Purpose - Icelake Xeon SUT for FD.io performance testing. - - Quantity: 8. - - Physical connectivity: - - IPMI and host management ports. - - NIC ports connected into 2-node or 3-node testbed topologies. - - Main HW configuration: - - Chassis: SuperMicro SYS-740GP-TNRT. - - Motherboard: Super X12DPG-QT6. - - Processors: 2* Intel Platinum 8358 2.6 GHz. - - RAM Memory: 16* 16GB DDR4-3200. - - Disks: 2* 960GB SATA SSD. - - NICs configuration: - - Numa0: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot2 18:00.xx: xxv710-DA2-2p25GE Intel. - - PCIe Slot4 3b:00.xx: e810-XXVDA4-4p25GE Intel. - - PCIe Slot9 5e:00.xx: e810-2CQDA2-2p100GE Intel. - - Numa1: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot6 86:00.xx: empty. - - PCIe Slot8 af:00.xx: empty. - - PCIe Slot10 d8:00.xx: empty. -24. Server-Type-F2: Purpose - Icelake Xeon TG for FD.io performance testing. - - Quantity: 3. - - Physical connectivity: - - IPMI and host management ports. - - NIC ports connected into 2-node testbed topologies. - - Main HW configuration: - - Chassis: SuperMicro SYS-740GP-TNRT. - - Motherboard: Super X12DPG-QT6. - - Processors: 2* Intel Platinum 8358 2.6 GHz. - - RAM Memory: 16* 16GB DDR4-3200. - - Disks: 2* 960GB SATA SSD. - - NICs configuration: - - Numa0: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot2 18:00.xx: xxv710-DA2-2p25GE Intel. - - PCIe Slot4 3b:00.xx: e810-XXVDA4-4p25GE Intel. - - PCIe Slot9 5e:00.xx: e810-2CQDA2-2p100GE Intel. - - Numa1: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot6 86:00.xx: e810-2CQDA2-2p100GE Intel. - - PCIe Slot8 af:00.xx: empty. - - PCIe Slot10 d8:00.xx: empty. -25. Server-Type-F3: Purpose - Icelake Xeon TG for FD.io performance testing. - - Quantity: 3. - - Physical connectivity: - - IPMI and host management ports. - - NIC ports connected into 3-node testbed topologies. - - Main HW configuration: - - Chassis: SuperMicro SYS-740GP-TNRT. - - Motherboard: Super X12DPG-QT6. - - Processors: 2* Intel Platinum 8358 2.6 GHz. - - RAM Memory: 16* 16GB DDR4-3200. - - Disks: 2* 960GB SATA SSD. - - NICs configuration: - - Numa0: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot2 18:00.xx: xxv710-DA2-2p25GE Intel. - - PCIe Slot4 3b:00.xx: e810-XXVDA4-4p25GE Intel. - - PCIe Slot9 5e:00.xx: e810-2CQDA2-2p100GE Intel. - - Numa1: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot6 86:00.xx: empty. - - PCIe Slot8 af:00.xx: empty. - - PCIe Slot10 d8:00.xx: empty. -26. Server-Type-F4: Purpose - Icelake Xeon Shared TG for FD.io performance testing. - - Quantity: 3. - - Physical connectivity: - - IPMI and host management ports. - - NIC ports connected into 2-node and/or 3-node testbed topologies. - - Main HW configuration: - - Chassis: SuperMicro SYS-740GP-TNRT. - - Motherboard: Super X12DPG-QT6. - - Processors: 2* Intel Platinum 8358 2.6 GHz. - - RAM Memory: 16* 16GB DDR4-3200. - - Disks: 2* 960GB SATA SSD. - - NICs configuration: - - Numa0: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot2 18:00.xx: xxv710-DA2-2p25GE Intel. - - PCIe Slot4 3b:00.xx: empty. - - PCIe Slot9 5e:00.xx: empty. - - Numa1: (x16, x16, x16 PCIe3.0 lanes) - - PCIe Slot6 86:00.xx: e810-XXVDA4-4p25GE Intel. - - PCIe Slot8 af:00.xx: e810-2CQDA2-2p100GE Intel. - - PCIe Slot10 d8:00.xx: empty. -27. Server-Type-G1: Purpose - SnowRidge Atom SUT for FD.io performance testing. - - Quantity: 2 - - Physical connectivity: - - IPMI and host management ports. - - NIC ports connected into 3-node testbed topology. - - Main HW configuration: - - Chassis: Intel JACOBSVILLE SDP. - - Motherboard: Intel JACOBSVILLE E63448-400. - - Processors: 1* Intel Atom P5362B 2.2 GHz. - - RAM Memory: 2* 16GB DDR4-2933. - - Disks: ?* ? SATA SSD. - - NICs configuration: - - Numa0: (x16, PCIe3.0 lane) - - PCIe BuiltIn ec:00.xx: e810-XXVDA4-4p25GE Intel. -``` - -### Naming Convention - -Following naming convention is used within this page to specify physical -connectivity and wiring across defined CSIT testbeds: - -``` -- testbedname: testbedN. -- hostname: - - traffic-generator: tN-tgW. - - system-under-testX: tN-sutX. -- portnames: - - tN-tgW-cY/pZ. - - tN-sutX-cY/pZ. -- where: - - N - testbed number. - - tgW - server acts as traffic-generator with W index. - - sutX - server acts as system-under-test with X index. - - Y - PCIe slot number denoting a NIC card number within the host. - - Z - port number on the NIC card. -``` - -## Testbeds Configuration - -### Per Testbed Server Allocation and Naming - -#### 1-Node-Skylake Servers (1n-skx) PROD - -``` -- SUT [Server-Type-B6]: - - testbedname: testbed11. - - hostname: s1-t11-sut1. - - IPMI IP: 10.30.50.47 - - Host IP: 10.30.51.50 - - portnames: - - s1-t11-sut1-c2/p1 - 10GE-port1 x710-4p10GE. - - s1-t11-sut1-c2/p2 - 10GE-port2 x710-4p10GE. - - s1-t11-sut1-c2/p3 - 10GE-port3 x710-4p10GE. - - s1-t11-sut1-c2/p4 - 10GE-port4 x710-4p10GE. - - s1-t11-sut1-c4/p1 - 10GE-port1 x710-4p10GE. - - s1-t11-sut1-c4/p2 - 10GE-port2 x710-4p10GE. - - s1-t11-sut1-c4/p3 - 10GE-port3 x710-4p10GE. - - s1-t11-sut1-c4/p4 - 10GE-port4 x710-4p10GE. -- SUT [Server-Type-B6]: - - testbedname: testbed12. - - hostname: s2-t12-sut1. - - IPMI IP: 10.30.50.48 - - Host IP: 10.30.51.51 - - portnames: - - s2-t12-sut1-c2/p1 - 10GE-port1 x710-4p10GE. - - s2-t12-sut1-c2/p2 - 10GE-port2 x710-4p10GE. - - s2-t12-sut1-c2/p3 - 10GE-port3 x710-4p10GE. - - s2-t12-sut1-c2/p4 - 10GE-port4 x710-4p10GE. - - s2-t12-sut1-c4/p1 - 10GE-port1 x710-4p10GE. - - s2-t12-sut1-c4/p2 - 10GE-port2 x710-4p10GE. - - s2-t12-sut1-c4/p3 - 10GE-port3 x710-4p10GE. - - s2-t12-sut1-c4/p4 - 10GE-port4 x710-4p10GE. -``` - -#### 1-Node-ThunderX2 Servers (1n-tx2) PROD - -``` -- SUT [Server-Type-E11]: - - testbedname: testbed13 - - hostname: s55-t13-sut1 - - IPMI IP: 10.30.50.70 - - Host IP: 10.30.51.70 - - portnames: - - s55-t13-sut1-c4/p1 - 40GE-port1 XL710-QDA2-2p40GE. - - s55-t13-sut1-c4/p2 - 40GE-port2 XL710-QDA2-2p40GE. - - s55-t13-sut1-c8/p1 - 40GE-port1 ConnectX5-2p10/25GE Mellanox. - - s55-t13-sut1-c8/p2 - 40GE-port2 ConnectX5-2p10/25GE Mellanox. - - s55-t13-sut1-c14/p1 - 40GE-port1 XL710-QDA2-2p40GE. - - s55-t13-sut1-c14/p2 - 40GE-port2 XL710-QDA2-2p40GE. - - s55-t13-sut1-c26/p1 - 40GE-port1 ConnectX5-2p10/25GE Mellanox. - - s55-t13-sut1-c26/p2 - 40GE-port2 ConnectX5-2p10/25GE Mellanox. -- SUT [Server-Type-E11]: - - testbedname: testbed14 - - hostname: s56-t14-sut1 - - IPMI IP: 10.30.50.71 - - Host IP: 10.30.51.71 - - portnames: - - s56-t14-sut1-c4/p1 - 40GE-port1 XL710-QDA2-2p40GE. - - s56-t14-sut1-c4/p2 - 40GE-port2 XL710-QDA2-2p40GE. - - s56-t14-sut1-c8/p1 - 40GE-port1 ConnectX5-2p10/25GE Mellanox. - - s56-t14-sut1-c8/p2 - 40GE-port2 ConnectX5-2p10/25GE Mellanox. - - s56-t14-sut1-c14/p1 - 40GE-port1 XL710-QDA2-2p40GE. - - s56-t14-sut1-c14/p2 - 40GE-port2 XL710-QDA2-2p40GE. - - s56-t14-sut1-c26/p1 - 40GE-port1 ConnectX5-2p10/25GE Mellanox. - - s56-t14-sut1-c26/p2 - 40GE-port2 ConnectX5-2p10/25GE Mellanox. -``` - -#### 1-Node-Cascadelake Servers (1n-clx) PROD - -``` -- SUT [Server-Type-C1]: - - testbedname: testbed11. - - hostname: s32-t14-sut1. - - IPMI IP: 10.30.55.17 - - Host IP: 10.32.8.17 - - portnames: - - s32-t14-sut1-c2/p1 - 10GE-port1 x710-4p10GE. - - s32-t14-sut1-c2/p2 - 10GE-port2 x710-4p10GE. - - s32-t14-sut1-c2/p3 - 10GE-port3 x710-4p10GE. - - s32-t14-sut1-c2/p4 - 10GE-port4 x710-4p10GE. - - s32-t14-sut1-c4/p1 - 10GE-port1 x710-4p10GE. - - s32-t14-sut1-c4/p2 - 10GE-port2 x710-4p10GE. - - s32-t14-sut1-c4/p3 - 10GE-port3 x710-4p10GE. - - s32-t14-sut1-c4/p4 - 10GE-port4 x710-4p10GE. -``` - -#### 2-Node-Skylake Servers (2n-skx) PROD - -``` -- SUT [Server-Type-B1]: - - testbedname: testbed21. - - hostname: s3-t21-sut1. - - IPMI IP: 10.30.50.41 - - Host IP: 10.30.51.44 - - portnames: - - s3-t21-sut1-c2/p1 - 10GE-port1 x710-4p10GE. - - s3-t21-sut1-c2/p2 - 10GE-port2 x710-4p10GE. - - s3-t21-sut1-c2/p3 - 10GE-port3 x710-4p10GE. - - s3-t21-sut1-c2/p4 - 10GE-port4 x710-4p10GE. - - s3-t21-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s3-t21-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. -- TG [Server-Type-B2]: - - testbedname: testbed21. - - hostname: s4-t21-tg1. - - IPMI IP: 10.30.50.42 - - Host IP: 10.30.51.45 - - portnames: - - s4-t21-tg1-c2/p1 - 10GE-port1 x710-4p10GE. - - s4-t21-tg1-c2/p2 - 10GE-port2 x710-4p10GE. - - s4-t21-tg1-c2/p3 - 10GE-port3 x710-4p10GE. - - s4-t21-tg1-c2/p4 - 10GE-port4 x710-4p10GE. - - s4-t21-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s4-t21-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s3-t21-tg1-c10/p1 - 10GE-port1 x710-4p10GE. - - s3-t21-tg1-c10/p2 - 10GE-port2 x710-4p10GE. - - s3-t21-tg1-c10/p3 - 10GE-port3 x710-4p10GE. - - s3-t21-tg1-c10/p4 - 10GE-port4 x710-4p10GE. -- SUT [Server-Type-B1]: - - testbedname: testbed22. - - hostname: s5-t22-sut1. - - IPMI IP: 10.30.50.49 - - Host IP: 10.30.51.52 - - portnames: - - s5-t22-sut1-c2/p1 - 10GE-port1 x710-4p10GE. - - s5-t22-sut1-c2/p2 - 10GE-port2 x710-4p10GE. - - s5-t22-sut1-c2/p3 - 10GE-port3 x710-4p10GE. - - s5-t22-sut1-c2/p4 - 10GE-port4 x710-4p10GE. - - s5-t22-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s5-t22-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. -- TG [Server-Type-B2]: - - testbedname: testbed22. - - hostname: s6-t22-tg1. - - IPMI IP: 10.30.50.50 - - Host IP: 10.30.51.53 - - portnames: - - s6-t22-tg1-c2/p1 - 10GE-port1 x710-4p10GE. - - s6-t22-tg1-c2/p2 - 10GE-port2 x710-4p10GE. - - s6-t22-tg1-c2/p3 - 10GE-port3 x710-4p10GE. - - s6-t22-tg1-c2/p4 - 10GE-port4 x710-4p10GE. - - s6-t22-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s6-t22-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s6-t22-tg1-c10/p1 - 10GE-port1 x710-4p10GE. - - s6-t22-tg1-c10/p2 - 10GE-port2 x710-4p10GE. - - s6-t22-tg1-c10/p3 - 10GE-port3 x710-4p10GE. - - s6-t22-tg1-c10/p4 - 10GE-port4 x710-4p10GE. -- SUT [Server-Type-B1]: - - testbedname: testbed23. - - hostname: s7-t23-sut1. - - IPMI IP: 10.30.50.51 - - Host IP: 10.30.51.54 - - portnames: - - s7-t23-sut1-c2/p1 - 10GE-port1 x710-4p10GE. - - s7-t23-sut1-c2/p2 - 10GE-port2 x710-4p10GE. - - s7-t23-sut1-c2/p3 - 10GE-port3 x710-4p10GE. - - s7-t23-sut1-c2/p4 - 10GE-port4 x710-4p10GE. - - s7-t23-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s7-t23-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. -- TG [Server-Type-B2]: - - testbedname: testbed23. - - hostname: s8-t23-tg1. - - IPMI IP: 10.30.50.52 - - Host IP: 10.30.51.55 - - portnames: - - s8-t23-tg1-c2/p1 - 10GE-port1 x710-4p10GE. - - s8-t23-tg1-c2/p2 - 10GE-port2 x710-4p10GE. - - s8-t23-tg1-c2/p3 - 10GE-port3 x710-4p10GE. - - s8-t23-tg1-c2/p4 - 10GE-port4 x710-4p10GE. - - s8-t23-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s8-t23-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s8-t23-tg1-c10/p1 - 10GE-port1 x710-4p10GE. - - s8-t23-tg1-c10/p2 - 10GE-port2 x710-4p10GE. - - s8-t23-tg1-c10/p3 - 10GE-port3 x710-4p10GE. - - s8-t23-tg1-c10/p4 - 10GE-port4 x710-4p10GE. -- SUT [Server-Type-B1]: - - testbedname: testbed24. - - hostname: s9-t24-sut1. - - IPMI IP: 10.30.50.53 - - Host IP: 10.30.51.56 - - portnames: - - s9-t24-sut1-c2/p1 - 10GE-port1 x710-4p10GE. - - s9-t24-sut1-c2/p2 - 10GE-port2 x710-4p10GE. - - s9-t24-sut1-c2/p3 - 10GE-port3 x710-4p10GE. - - s9-t24-sut1-c2/p4 - 10GE-port4 x710-4p10GE. - - s9-t24-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s9-t24-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. -- TG [Server-Type-B2]: - - testbedname: testbed24. - - hostname: s10-t24-tg1. - - IPMI IP: 10.30.50.54 - - Host IP: 10.30.51.57 - - portnames: - - s10-t24-tg1-c2/p1 - 10GE-port1 x710-4p10GE. - - s10-t24-tg1-c2/p2 - 10GE-port2 x710-4p10GE. - - s10-t24-tg1-c2/p3 - 10GE-port3 x710-4p10GE. - - s10-t24-tg1-c2/p4 - 10GE-port4 x710-4p10GE. - - s10-t24-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s10-t24-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s10-t24-tg1-c10/p1 - 10GE-port1 x710-4p10GE. - - s10-t24-tg1-c10/p2 - 10GE-port2 x710-4p10GE. - - s10-t24-tg1-c10/p3 - 10GE-port3 x710-4p10GE. - - s10-t24-tg1-c10/p4 - 10GE-port4 x710-4p10GE. -``` - -#### 2-Node-Denverton Servers (2n-dnv) PROD - -Note: ServerB28 (TG) is shared between testbed26 & testbed35 - -``` -- TG [Server-Type-B2]: - - testbednames: testbed26 and testbed35. - - hostname: s28-t26t35-tg1. - - IPMI IP: 10.30.55.10 - - Host IP: 10.32.8.10 - - portnames: - - s28-t26t35-tg1-c2/p1 - 10GE-port1 x710da2-2p10GE. - - s28-t26t35-tg1-c2/p2 - 10GE-port2 x710da2-2p10GE. - - s28-t26t35-tg1-c4/p1 - 10GE-port1 x550t2-2p10GE. - - s28-t26t35-tg1-c4/p2 - 10GE-port2 x550t2-2p10GE. - - s28-t26t35-tg1-c9/p1 - 10GE-port1 x550t2-2p10GE. - - s28-t26t35-tg1-c9/p2 - 10GE-port2 x550t2-2p10GE. - - s28-t26t35-tg1-c6/p1 - 10GE-port1 x710da2-2p10GE. - - s28-t26t35-tg1-c6/p2 - 10GE-port2 x710da2-2p10GE. - - s28-t26t35-tg1-c8/p1 - 10GE-port1 x550t2-2p10GE. - - s28-t26t35-tg1-c8/p2 - 10GE-port2 x550t2-2p10GE. - - s28-t26t35-tg1-c10/p1 - 10GE-port1 x550t2-2p10GE. - - s28-t26t35-tg1-c10/p2 - 10GE-port2 x550t2-2p10GE. -- SUT [Server-Type-B10]: - - testbednames: testbed26. - - hostname: s29-t26-sut1. - - IPMI IP: 10.30.55.11 - - Host IP: 10.32.8.11 - - portnames: - - s29-t26-sut1-p1 - 10GE-port1 x553 copper port. - - s29-t26-sut1-p2 - 10GE-port2 x553 copper port. - - s29-t26-sut1-p3 - 10GE-port3 x553 fiber port. - - s29-t26-sut1-p4 - 10GE-port4 x553 fiber port. -``` - -#### 2-Node-IxiaPS1L47 Servers (2n-ps1) VERIFY - -``` -- SUT [Server-Type-B8]: - - testbedname: testbed25. - - hostname: s25-t25-sut1. - - IPMI IP: 10.30.50.58 - - Host IP: 10.30.51.61 - - portnames: - - s25-t25-sut1-c2/p1 - 10GE-port1 x710-4p10GE. - - s25-t25-sut1-c2/p2 - 10GE-port2 x710-4p10GE. - - s25-t25-sut1-c2/p3 - 10GE-port3 x710-4p10GE. - - s25-t25-sut1-c2/p4 - 10GE-port4 x710-4p10GE. -- TG [Server-Type-B7]: - - testbedname: testbed25. - - hostname: s26-t25-tg1. - - IPMI IP: 10.30.50.59 - - Host IP: 10.30.51.62 - - portnames: - - s26-t25-tg1-p1 - 10GE-port1. - - s26-t25-tg1-p2 - 10GE-port2. - - s26-t25-tg1-p3 - 10GE-port3. - - s26-t25-tg1-p4 - 10GE-port4. -``` - -#### 2-Node-Cascadelake Servers (2n-clx) PROD - -``` -- SUT [Server-Type-C2]: - - testbedname: testbed27. - - hostname: s33-t27-sut1. - - IPMI IP: 10.30.55.18 - - Host IP: 10.32.8.18 - - portnames: - - s33-t27-sut1-c2/p1 - 10GE-port1 x710-4p10GE. - - s33-t27-sut1-c2/p2 - 10GE-port2 x710-4p10GE. - - s33-t27-sut1-c2/p3 - 10GE-port3 x710-4p10GE. - - s33-t27-sut1-c2/p4 - 10GE-port4 x710-4p10GE. - - s33-t27-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s33-t27-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s33-t27-sut1-c6/p1 - 100GE-port1 e810-2p100GE. - - s33-t27-sut1-c6/p2 - 100GE-port2 e810-2p100GE. - - s33-t27-sut1-c9/p1 - 100GE-port1 ConnectX5-2p100GE. - - s33-t27-sut1-c9/p2 - 100GE-port2 ConnectX5-2p100GE. -- TG [Server-Type-C3]: - - testbedname: testbed27. - - hostname: s34-t27-tg1. - - IPMI IP: 10.30.55.19 - - Host IP: 10.32.8.19 - - portnames: - - s34-t27-tg1-c2/p1 - 10GE-port1 x710-4p10GE. - - s34-t27-tg1-c2/p2 - 10GE-port2 x710-4p10GE. - - s34-t27-tg1-c2/p3 - 10GE-port3 x710-4p10GE. - - s34-t27-tg1-c2/p4 - 10GE-port4 x710-4p10GE. - - s34-t27-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s34-t27-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s34-t27-tg1-c6/p1 - 100GE-port1 ConnectX5-2p100GE. - - s34-t27-tg1-c6/p2 - 100GE-port2 ConnectX5-2p100GE. - - s38-t27-tg1-c8/p1 - 100GE-port1 ConnectX5-2p100GE. - - s38-t27-tg1-c8/p2 - 100GE-port2 ConnectX5-2p100GE. - - s34-t27-tg1-c9/p1 - 100GE-port1 ConnectX5-2p100GE. - - s34-t27-tg1-c9/p2 - 100GE-port2 ConnectX5-2p100GE. -- SUT [Server-Type-C2]: - - testbedname: testbed28. - - hostname: s35-t28-sut1. - - IPMI IP: 10.30.55.20 - - Host IP: 10.32.8.20 - - portnames: - - s35-t28-sut1-c2/p1 - 10GE-port1 x710-4p10GE. - - s35-t28-sut1-c2/p2 - 10GE-port2 x710-4p10GE. - - s35-t28-sut1-c2/p3 - 10GE-port3 x710-4p10GE. - - s35-t28-sut1-c2/p4 - 10GE-port4 x710-4p10GE. - - s35-t28-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s35-t28-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s35-t28-sut1-c6/p1 - 100GE-port1 e810-2p100GE. - - s35-t28-sut1-c6/p2 - 100GE-port2 e810-2p100GE. - - s35-t28-sut1-c9/p1 - 100GE-port1 ConnectX5-2p100GE. - - s35-t28-sut1-c9/p2 - 100GE-port2 ConnectX5-2p100GE. -- TG [Server-Type-C3]: - - testbedname: testbed28. - - hostname: s36-t28-tg1. - - IPMI IP: 10.30.55.21 - - Host IP: 10.32.8.21 - - portnames: - - s36-t28-tg1-c2/p1 - 10GE-port1 x710-4p10GE. - - s36-t28-tg1-c2/p2 - 10GE-port2 x710-4p10GE. - - s36-t28-tg1-c2/p3 - 10GE-port3 x710-4p10GE. - - s36-t28-tg1-c2/p4 - 10GE-port4 x710-4p10GE. - - s36-t28-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s36-t28-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s36-t28-tg1-c6/p1 - 100GE-port1 ConnectX5-2p100GE. - - s36-t28-tg1-c6/p2 - 100GE-port2 ConnectX5-2p100GE. - - s38-t28-tg1-c8/p1 - 100GE-port1 ConnectX5-2p100GE. - - s38-t28-tg1-c8/p2 - 100GE-port2 ConnectX5-2p100GE. - - s36-t28-tg1-c9/p1 - 100GE-port1 ConnectX5-2p100GE. - - s36-t28-tg1-c9/p2 - 100GE-port2 ConnectX5-2p100GE. -- SUT [Server-Type-C2]: - - testbedname: testbed29. - - hostname: s37-t29-sut1. - - IPMI IP: 10.30.55.22 - - Host IP: 10.32.8.22 - - portnames: - - s37-t29-sut1-c2/p1 - 10GE-port1 x710-4p10GE. - - s37-t29-sut1-c2/p2 - 10GE-port2 x710-4p10GE. - - s37-t29-sut1-c2/p3 - 10GE-port3 x710-4p10GE. - - s37-t29-sut1-c2/p4 - 10GE-port4 x710-4p10GE. - - s37-t29-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s37-t29-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s37-t29-sut1-c6/p1 - 100GE-port1 e810-2p100GE. - - s37-t29-sut1-c6/p2 - 100GE-port2 e810-2p100GE. - - s37-t29-sut1-c9/p1 - 100GE-port1 ConnectX5-2p100GE. - - s37-t29-sut1-c9/p2 - 100GE-port2 ConnectX5-2p100GE. -- TG [Server-Type-C3]: - - testbedname: testbed29. - - hostname: s38-t29-tg1. - - IPMI IP: 10.30.55.23 - - Host IP: 10.32.8.23 - - portnames: - - s38-t29-tg1-c2/p1 - 10GE-port1 x710-4p10GE. - - s38-t29-tg1-c2/p2 - 10GE-port2 x710-4p10GE. - - s38-t29-tg1-c2/p3 - 10GE-port3 x710-4p10GE. - - s38-t29-tg1-c2/p4 - 10GE-port4 x710-4p10GE. - - s38-t29-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s38-t29-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s38-t29-tg1-c6/p1 - 100GE-port1 ConnectX5-2p100GE. - - s38-t29-tg1-c6/p2 - 100GE-port2 ConnectX5-2p100GE. - - s38-t29-tg1-c9/p1 - 100GE-port1 ConnectX5-2p100GE. - - s38-t29-tg1-c9/p2 - 100GE-port2 ConnectX5-2p100GE. -``` - -#### 2-Node-Zen2 Servers (2n-zn2) PROD - -``` -- SUT [Server-Type-D1]: - - testbedname: testbed210. - - hostname: s60-t210-sut1. - - IPMI IP: 10.30.55.24 - - Host IP: 10.32.8.24 - - portnames: - - s60-t210-sut1-c1/p1 - 10GE-port1 x710-4p10GE. - - s60-t210-sut1-c1/p2 - 10GE-port2 x710-4p10GE. - - s60-t210-sut1-c1/p3 - 10GE-port3 x710-4p10GE. - - s60-t210-sut1-c1/p4 - 10GE-port4 x710-4p10GE. - - s60-t210-sut1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s60-t210-sut1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s60-t210-sut1-c3/p1 - 100GE-port1 ConnectX5-2p100GE. - - s60-t210-sut1-c3/p2 - 100GE-port2 ConnectX5-2p100GE. -- TG [Server-Type-D2]: - - testbedname: testbed210. - - hostname: s61-t210-tg1. - - IPMI IP: 10.30.55.25 - - Host IP: 10.32.8.25 - - portnames: - - s61-t210-tg1-c1/p1 - 100GE-port1 ConnectX5-2p100GE. - - s61-t210-tg1-c1/p2 - 100GE-port2 ConnectX5-2p100GE. - - s61-t210-tg1-c2/p1 - 10GE-port1 x710-4p10GE. - - s61-t210-tg1-c2/p2 - 10GE-port2 x710-4p10GE. - - s61-t210-tg1-c2/p3 - 10GE-port3 x710-4p10GE. - - s61-t210-tg1-c2/p4 - 10GE-port4 x710-4p10GE. - - s61-t210-tg1-c3/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s61-t210-tg1-c3/p2 - 25GE-port2 xxv710-DA2-2p25GE. -``` - -#### 2-Node-ThunderX2 Servers (2x-tx2) PROD - -Note: Server19 (TG) is shared between testbed33 & testbed211 - -``` -- SUT [Server-Type-E22]: - - testbedname: testbed211. - - hostname: s27-t211-sut1. - - IPMI IP: 10.30.50.69 - - Host IP: 10.30.51.69 - - portnames: - - s27-t211-sut1-c18/p1 - 40GE-port1 XL710-QDA2-2p40GE. - - s27-t211-sut1-c18/p2 - 40GE-port2 XL710-QDA2-2p40GE. -- TG [Server-Type-E31]: - - testbedname: testbed33 and testbed211. - - hostname: s19-t33t211-tg1. - - IPMI IP: 10.30.50.46 - - Host IP: 10.30.51.49 - - portnames: - - s19-t33t211-tg1-c2/p1 - 10GE-port1 x710-4p10GE. - - s19-t33t211-tg1-c2/p2 - 10GE-port2 x710-4p10GE. - - s19-t33t211-tg1-c2/p3 - 10GE-port3 x710-4p10GE. - - s19-t33t211-tg1-c2/p4 - 10GE-port4 x710-4p10GE. - - s19-t33t211-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s19-t33t211-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s19-t33t211-tg1-c8/p1 - 40GE-port1 xl710-QDA2-2p40GE. - - s19-t33t211-tg1-c8/p2 - 40GE-port2 xl710-QDA2-2p40GE. - - s19-t33t211-tg1-c10/p1 - 10GE-port1 x710-4p10GE. - - s19-t33t211-tg1-c10/p2 - 10GE-port2 x710-4p10GE. - - s19-t33t211-tg1-c10/p3 - 10GE-port3 x710-4p10GE. - - s19-t33t211-tg1-c10/p4 - 10GE-port4 x710-4p10GE. -``` - -#### 2-Node-Icelake Servers (2n-icx) PROD - -``` -- SUT [Server-Type-F1]: - - testbedname: testbed212. - - hostname: s71-t212-sut1. - - IPMI IP: 10.30.51.81 - - Host IP: 10.30.50.81 - - portnames: - - s71-t212-sut1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s71-t212-sut1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s71-t212-sut1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s71-t212-sut1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s71-t212-sut1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s71-t212-sut1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s71-t212-sut1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s71-t212-sut1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. -- TG [Server-Type-F2]: - - testbedname: testbed212. - - hostname: s72-t212-tg1. - - IPMI IP: 10.30.51.82 - - Host IP: 10.30.50.82 - - portnames: - - s72-t212-tg1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s72-t212-tg1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s72-t212-tg1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s72-t212-tg1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s72-t212-tg1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s72-t212-tg1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s72-t212-tg1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s72-t212-tg1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. - - s72-t212-tg1-c6/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s72-t212-tg1-c6/p2 - 100GE-port2 e810-2CQDA2-2p100GE. -- SUT [Server-Type-F1]: - - testbedname: testbed213. - - hostname: s83-t213-sut1. - - IPMI IP: 10.30.51.83 - - Host IP: 10.30.50.83 - - portnames: - - s83-t213-sut1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s83-t213-sut1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s83-t213-sut1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s83-t213-sut1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s83-t213-sut1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s83-t213-sut1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s83-t213-sut1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s83-t213-sut1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. -- TG [Server-Type-F2]: - - testbedname: testbed213. - - hostname: s84-t213-tg1. - - IPMI IP: 10.30.51.84 - - Host IP: 10.30.50.84 - - portnames: - - s84-t213-tg1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s84-t213-tg1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s84-t213-tg1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s84-t213-tg1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s84-t213-tg1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s84-t213-tg1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s84-t213-tg1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s84-t213-tg1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. - - s84-t213-tg1-c6/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s84-t213-tg1-c6/p2 - 100GE-port2 e810-2CQDA2-2p100GE. -- SUT [Server-Type-F1]: - - testbedname: testbed214. - - hostname: s85-t214-sut1. - - IPMI IP: 10.30.51.85 - - Host IP: 10.30.50.85 - - portnames: - - s85-t214-sut1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s85-t214-sut1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s85-t214-sut1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s85-t214-sut1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s85-t214-sut1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s85-t214-sut1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s85-t214-sut1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s85-t214-sut1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. -- TG [Server-Type-F2]: - - testbedname: testbed214. - - hostname: s86-t214-tg1. - - IPMI IP: 10.30.51.86 - - Host IP: 10.30.50.86 - - portnames: - - s86-t214-tg1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s86-t214-tg1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s86-t214-tg1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s86-t214-tg1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s86-t214-tg1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s86-t214-tg1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s86-t214-tg1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s86-t214-tg1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. - - s86-t214-tg1-c6/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s86-t214-tg1-c6/p2 - 100GE-port2 e810-2CQDA2-2p100GE. -- SUT [Server-Type-F1]: - - testbedname: testbed215. - - hostname: s87-t215-sut1. - - IPMI IP: 10.30.51.87 - - Host IP: 10.30.50.87 - - portnames: - - s87-t215-sut1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s87-t215-sut1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s87-t215-sut1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s87-t215-sut1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s87-t215-sut1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s87-t215-sut1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s87-t215-sut1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s87-t215-sut1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. -- TG [Server-Type-F2]: - - testbedname: testbed215. - - hostname: s88-t215-tg1. - - IPMI IP: 10.30.51.88 - - Host IP: 10.30.50.88 - - portnames: - - s88-t215-tg1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s88-t215-tg1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s88-t215-tg1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s88-t215-tg1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s88-t215-tg1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s88-t215-tg1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s88-t215-tg1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s88-t215-tg1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. - - s88-t215-tg1-c6/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s88-t215-tg1-c6/p2 - 100GE-port2 e810-2CQDA2-2p100GE. -``` - -#### 3-Node-Skylake Servers (3n-skx) PROD - -``` -- ServerB11 [Server-Type-B1]: - - testbedname: testbed31. - - hostname: s11-t31-sut1. - - IPMI IP: 10.30.50.43 - - Host IP: 10.30.51.46 - - portnames: - - s11-t31-sut1-c2/p1 - 10GE-port1 x710-4p10GE. - - s11-t31-sut1-c2/p2 - 10GE-port2 x710-4p10GE. - - s11-t31-sut1-c2/p3 - 10GE-port3 x710-4p10GE. - - s11-t31-sut1-c2/p4 - 10GE-port4 x710-4p10GE. - - s11-t31-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s11-t31-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. -- ServerB12 [Server-Type-B1]: - - testbedname: testbed31. - - hostname: s12-t31-sut2. - - IPMI IP: 10.30.50.44 - - Host IP: 10.30.51.47 - - portnames: - - s12-t31-sut2-c2/p1 - 10GE-port1 x710-4p10GE. - - s12-t31-sut2-c2/p2 - 10GE-port2 x710-4p10GE. - - s12-t31-sut2-c2/p3 - 10GE-port3 x710-4p10GE. - - s12-t31-sut2-c2/p4 - 10GE-port4 x710-4p10GE. - - s12-t31-sut2-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s12-t31-sut2-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. -- ServerB13 [Server-Type-B2]: - - testbedname: testbed31. - - hostname: s13-t31-tg1. - - IPMI IP: 10.30.50.45 - - Host IP: 10.30.51.48 - - portnames: - - s13-t31-tg1-c2/p1 - 10GE-port1 x710-4p10GE. - - s13-t31-tg1-c2/p2 - 10GE-port2 x710-4p10GE. - - s13-t31-tg1-c2/p3 - 10GE-port3 x710-4p10GE. - - s13-t31-tg1-c2/p4 - 10GE-port4 x710-4p10GE. - - s13-t31-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s13-t31-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s13-t31-tg1-c10/p1 - 10GE-port1 x710-4p10GE. - - s13-t31-tg1-c10/p2 - 10GE-port2 x710-4p10GE. - - s13-t31-tg1-c10/p3 - 10GE-port3 x710-4p10GE. - - s13-t31-tg1-c10/p4 - 10GE-port4 x710-4p10GE. -- ServerB14 [Server-Type-B1]: - - testbedname: testbed32. - - hostname: s14-t32-sut1. - - IPMI IP: 10.30.50.55 - - Host IP: 10.30.51.58 - - portnames: - - s14-t32-sut1-c2/p1 - 10GE-port1 x710-4p10GE. - - s14-t32-sut1-c2/p2 - 10GE-port2 x710-4p10GE. - - s14-t32-sut1-c2/p3 - 10GE-port3 x710-4p10GE. - - s14-t32-sut1-c2/p4 - 10GE-port4 x710-4p10GE. - - s14-t32-sut1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s14-t32-sut1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. -- ServerB15 [Server-Type-B1]: - - testbedname: testbed32. - - hostname: s15-t32-sut2. - - IPMI IP: 10.30.50.56 - - Host IP: 10.30.51.59 - - portnames: - - s15-t32-sut2-c2/p1 - 10GE-port1 x710-4p10GE. - - s15-t32-sut2-c2/p2 - 10GE-port2 x710-4p10GE. - - s15-t32-sut2-c2/p3 - 10GE-port3 x710-4p10GE. - - s15-t32-sut2-c2/p4 - 10GE-port4 x710-4p10GE. - - s15-t32-sut2-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s15-t32-sut2-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. -- ServerB16 [Server-Type-B2]: - - testbedname: testbed32. - - hostname: s16-t32-tg1. - - IPMI IP: 10.30.50.57 - - Host IP: 10.30.51.60 - - portnames: - - s16-t32-tg1-c2/p1 - 10GE-port1 x710-4p10GE. - - s16-t32-tg1-c2/p2 - 10GE-port2 x710-4p10GE. - - s16-t32-tg1-c2/p3 - 10GE-port3 x710-4p10GE. - - s16-t32-tg1-c2/p4 - 10GE-port4 x710-4p10GE. - - s16-t32-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s16-t32-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s16-t32-tg1-c10/p1 - 10GE-port1 x710-4p10GE. - - s16-t32-tg1-c10/p2 - 10GE-port2 x710-4p10GE. - - s16-t32-tg1-c10/p3 - 10GE-port3 x710-4p10GE. - - s16-t32-tg1-c10/p4 - 10GE-port4 x710-4p10GE. -``` - -#### 3-Node-Rangeley Servers (3n-rng) VERIFY - -Note: There is no IPMI. Serial console is accessible via VIRL2 and VIRL3 USB. - -``` -- ServerB22 [Server-Type-B5]: - - testbedname: testbed35. - - hostname: s22-t35-sut1 (vex-yul-rot-netgate-1). - - IPMI IP: 10.30.51.29 - screen -r /dev/ttyUSB0 - - Host IP: 10.30.51.9 - - portnames: - - s22-t35-sut1-p1 - 10GE-port1 ix0 82599. - - s22-t35-sut1-p2 - 10GE-port2 ix1 82599. - - 1GB ports (tbd) -- ServerB23 [Server-Type-B5]: - - testbedname: testbed35. - - hostname: s23-t35-sut2 (vex-yul-rot-netgate-2). - - IPMI IP: 10.30.51.30 - screen -r /dev/ttyUSB1 - - Host IP: 10.30.51.10 - - portnames: - - s23-t35-sut1-p1 - 10GE-port1 ix0 82599. - - s23-t35-sut1-p2 - 10GE-port2 ix1 82599. - - 1GB ports (tbd) -- ServerB24 [Server-Type-B5]: - - testbedname: testbed35. - - hostname: s24-t35-sut3 (vex-yul-rot-netgate-3). - - IPMI IP: 10.30.51.30 - screen -r /dev/ttyUSB2 - - Host IP: 10.30.51.11 - - portnames: - - s24-t35-sut1-p1 - 10GE-port1 ix0 82599. - - s24-t35-sut1-p2 - 10GE-port2 ix1 82599. - - 1GB ports (tbd) -``` - -#### 3-Node-Taishan Servers (3n-tsh) PROD - -Note: Server19 (TG) is shared between testbed33 & testbed211 - -``` -- SUT [Server-Type-E21]: - - testbedname: testbed33. - - hostname: s17-t33-sut1. - - IPMI IP: 10.30.50.36 - - Host IP: 10.30.51.36 - - portnames: - - s17-t33-sut1-c6/p1 - 10GE-port1 x520-2p10GE. - - s17-t33-sut1-c6/p2 - 10GE-port2 x520-2p10GE. - - s17-t33-sut1-c4/p1 - 25GE-port1 cx4-2p25GE. - - s17-t33-sut1-c4/p2 - 25GE-port2 cx4-2p25GE. -- SUT [Server-Type-E21]: - - testbedname: testbed33. - - hostname: s18-t33-sut2. - - IPMI IP: 10.30.50.37 - - Host IP: 10.30.51.37 - - portnames: - - s18-t33-sut2-c6/p1 - 10GE-port1 x520-2p10GE. - - s18-t33-sut2-c6/p2 - 10GE-port2 x520-2p10GE. - - s18-t33-sut2-c4/p1 - 25GE-port1 cx4-2p25GE. - - s18-t33-sut2-c4/p2 - 25GE-port2 cx4-2p25GE. -- TG [Server-Type-E31]: - - testbedname: testbed33 and testbed211. - - hostname: s19-t33t211-tg1. - - IPMI IP: 10.30.50.46 - - Host IP: 10.30.51.49 - - portnames: - - s19-t33t211-tg1-c2/p1 - 10GE-port1 x710-4p10GE. - - s19-t33t211-tg1-c2/p2 - 10GE-port2 x710-4p10GE. - - s19-t33t211-tg1-c2/p3 - 10GE-port3 x710-4p10GE. - - s19-t33t211-tg1-c2/p4 - 10GE-port4 x710-4p10GE. - - s19-t33t211-tg1-c4/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s19-t33t211-tg1-c4/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s19-t33t211-tg1-c8/p1 - 40GE-port1 xl710-QDA2-2p40GE. - - s19-t33t211-tg1-c8/p2 - 40GE-port2 xl710-QDA2-2p40GE. - - s19-t33t211-tg1-c10/p1 - 10GE-port1 x710-4p10GE. - - s19-t33t211-tg1-c10/p2 - 10GE-port2 x710-4p10GE. - - s19-t33t211-tg1-c10/p3 - 10GE-port3 x710-4p10GE. - - s19-t33t211-tg1-c10/p4 - 10GE-port4 x710-4p10GE. -``` - -#### 3-Node-Altra Servers (3n-alt) PROD - -``` -- SUT [Server-Type-E23]: - - testbedname: testbed34. - - hostname: s62-t34-sut1. - - IPMI IP: 10.30.50.72 - - Host IP: 10.30.51.72 - - portnames: - - s62-t34-sut1-c1/p1 - 40GE-port1 xl710-QDA2-2p40GE. - - s62-t34-sut1-c1/p2 - 40GE-port2 xl710-QDA2-2p40GE. -- SUT [Server-Type-E23]: - - testbedname: testbed34. - - hostname: s63-t34-sut2. - - IPMI IP: 10.30.50.73 - - Host IP: 10.30.51.73 - - portnames: - - s63-t34-sut2-c1/p1 - 40GE-port1 xl710-QDA2-2p40GE. - - s63-t34-sut2-c1/p2 - 40GE-port2 xl710-QDA2-2p40GE. -- TG [Server-Type-F4]: - - testbedname: testbed34. - - hostname: s64-t34-tg1. - - IPMI IP: 10.30.50.74 - - Host IP: 10.30.51.74 - - portnames: - - s64-t34-tg1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s64-t34-tg1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s64-t34-tg1-c4/p1 - 40GE-port1 xl710-QDA2-2p40GE. - - s64-t34-tg1-c4/p2 - 40GE-port2 xl710-QDA2-2p40GE. - - s64-t34-tg1-c6/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s64-t34-tg1-c6/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s64-t34-tg1-c6/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s64-t34-tg1-c6/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s64-t34-tg1-c8/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s64-t34-tg1-c8/p2 - 100GE-port2 e810-2CQDA2-2p100GE. -``` - -#### 3-Node-Denverton Servers (3n-dnv) PROD - -``` -- ServerB30 [Server-Type-B10]: - - testbednames: testbed35. - - hostname: s30-t35-sut1. - - IPMI IP: 10.30.55.12 - - Host IP: 10.32.8.12 - - portnames: - - s30-t35-sut1-p1 - 10GE-port1 x553 copper port. - - s30-t35-sut1-p2 - 10GE-port2 x553 copper port. - - s30-t35-sut1-p3 - 10GE-port3 x553 fiber port. - - s30-t35-sut1-p4 - 10GE-port4 x553 fiber port. -- ServerB31 [Server-Type-B10]: - - testbednames: testbed35. - - hostname: s31-t35-sut2. - - IPMI IP: 10.30.55.13 - - Host IP: 10.32.8.13 - - portnames: - - s31-t35-sut2-p1 - 10GE-port1 x553 copper port. - - s31-t35-sut2-p2 - 10GE-port2 x553 copper port. - - s31-t35-sut2-p3 - 10GE-port3 x553 fiber port. - - s31-t35-sut2-p4 - 10GE-port4 x553 fiber port. -``` - -#### 3-Node-Icelake Servers (3n-icx) PROD - -``` -- ServerF1 [Server-Type-F1]: - - testbedname: testbed37. - - hostname: s65-t37-sut1. - - IPMI IP: 10.30.50.75 - - Host IP: 10.30.51.75 - - portnames: - - s65-t37-sut1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s65-t37-sut1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s65-t37-sut1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s65-t37-sut1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s65-t37-sut1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s65-t37-sut1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s65-t37-sut1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s65-t37-sut1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. -- ServerF1 [Server-Type-F1]: - - testbedname: testbed37. - - hostname: s66-t37-sut2. - - IPMI IP: 10.30.50.76 - - Host IP: 10.30.51.76 - - portnames: - - s66-t37-sut2-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s66-t37-sut2-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s66-t37-sut2-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s66-t37-sut2-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s66-t37-sut2-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s66-t37-sut2-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s66-t37-sut2-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s66-t37-sut2-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. -- ServerF3 [Server-Type-F3]: - - testbedname: testbed37. - - hostname: s67-t37-tg1. - - IPMI IP: 10.30.50.77 - - Host IP: 10.30.51.77 - - portnames: - - s67-t37-tg1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s67-t37-tg1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s67-t37-tg1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s67-t37-tg1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s67-t37-tg1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s67-t37-tg1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s67-t37-tg1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s67-t37-tg1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. -- ServerF1 [Server-Type-F1]: - - testbedname: testbed38. - - hostname: s78-t38-sut1. - - IPMI IP: 10.30.50.78 - - Host IP: 10.30.51.78 - - portnames: - - s78-t38-sut1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s78-t38-sut1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s78-t38-sut1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s78-t38-sut1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s78-t38-sut1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s78-t38-sut1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s78-t38-sut1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s78-t38-sut1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. -- ServerF1 [Server-Type-F1]: - - testbedname: testbed38. - - hostname: s79-t38-sut2. - - IPMI IP: 10.30.50.79 - - Host IP: 10.30.51.79 - - portnames: - - s79-t38-sut2-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s79-t38-sut2-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s79-t38-sut2-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s79-t38-sut2-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s79-t38-sut2-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s79-t38-sut2-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s79-t38-sut2-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s79-t38-sut2-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. -- ServerF3 [Server-Type-F3]: - - testbedname: testbed38. - - hostname: s80-t38-tg1. - - IPMI IP: 10.30.50.80 - - Host IP: 10.30.51.80 - - portnames: - - s80-t38-tg1-c2/p1 - 25GE-port1 xxv710-DA2-2p25GE. - - s80-t38-tg1-c2/p2 - 25GE-port2 xxv710-DA2-2p25GE. - - s80-t38-tg1-c4/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s80-t38-tg1-c4/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s80-t38-tg1-c4/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s80-t38-tg1-c4/p4 - 25GE-port4 e810-XXVDA4-4p25GE. - - s80-t38-tg1-c9/p1 - 100GE-port1 e810-2CQDA2-2p100GE. - - s80-t38-tg1-c9/p2 - 100GE-port2 e810-2CQDA2-2p100GE. -``` - -#### 3-Node-SnowRidge Servers (3n-snr) PROD - -``` -- ServerG1 [Server-Type-G1]: - - testbedname: testbed39. - - hostname: s93-t39-sut1. - - IPMI IP: 10.30.50.93 - - Host IP: 10.30.51.93 - - portnames: - - s93-t39-sut1-c1/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s93-t39-sut1-c1/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s93-t39-sut1-c1/p2 - 25GE-port3 e810-XXVDA4-4p25GE. - - s93-t39-sut1-c1/p2 - 25GE-port4 e810-XXVDA4-4p25GE. -- ServerG1 [Server-Type-G1]: - - testbedname: testbed39. - - hostname: s94-t39-sut2. - - IPMI IP: 10.30.50.94 - - Host IP: 10.30.51.94 - - portnames: - - s94-t39-sut2-c1/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s94-t39-sut2-c1/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s94-t39-sut2-c1/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s94-t39-sut2-c1/p4 - 25GE-port4 e810-XXVDA4-4p25GE. -- ServerF4 [Server-Type-F4]: - - testbedname: testbed39. - - hostname: s89-t39t310-tg1. - - IPMI IP: 10.30.50.89 - - Host IP: 10.30.51.89 - - portnames: - - s89-t39t310-tg1-c6/p1 - 25GE-port1 e810-XXVDA4-4p25GE. - - s89-t39t310-tg1-c6/p2 - 25GE-port2 e810-XXVDA4-4p25GE. - - s89-t39t310-tg1-c6/p3 - 25GE-port3 e810-XXVDA4-4p25GE. - - s89-t39t310-tg1-c6/p4 - 25GE-port4 e810-XXVDA4-4p25GE. -``` - -### Per Testbed Wiring - -#### 1-Node-Skylake Wiring (1n-skx) PROD - -``` -- testbed11: - - ring1 10GE-ports x710-4p10GE: - - s1-t11-sut1-c2/p1 to s1-t11-sut1-c4/p1. - - ring2 10GE-ports x710-4p10GE: - - s1-t11-sut1-c2/p2 to s1-t11-sut1-c4/p2. - - ring3 10GE-ports x710-4p10GE: - - s1-t11-sut1-c2/p3 to s1-t11-sut1-c4/p3. - - ring4 10GE-ports x710-4p10GE: - - s1-t11-sut1-c2/p4 to s1-t11-sut1-c4/p4. - - ring5 100GE-ports e810-2p100GE: - - s1-t11-sut1-c5/p1 to s1-t11-sut1-c6/p1. - - ring6 100GE-ports e810-2p100GE: - - s1-t11-sut1-c5/p2 to s1-t11-sut1-c6/p2. -- testbed12: - - ring1 10GE-ports x710-4p10GE: - - s2-t12-sut1-c2/p1 to s2-t12-sut1-c4/p1. - - ring2 10GE-ports x710-4p10GE: - - s2-t12-sut1-c2/p2 to s2-t12-sut1-c4/p2. - - ring3 10GE-ports x710-4p10GE: - - s2-t12-sut1-c2/p3 to s2-t12-sut1-c4/p3. - - ring4 10GE-ports x710-4p10GE: - - s2-t12-sut1-c2/p4 to s2-t12-sut1-c4/p4. - - ring5 100GE-ports e810-2p100GE: - - s2-t12-sut1-c5/p1 to s2-t12-sut1-c6/p1. - - ring6 100GE-ports e810-2p100GE: - - s2-t12-sut1-c5/p2 to s2-t12-sut1-c6/p2. -``` - -#### 1-Node-ThunderX2 Wiring (1n-tx2) PROD - -``` -- testbed13: - - ring1 40GE-ports XL710-QDA2-2p40GE on SUTs: - - s55-t13-sut1-c4/p1 - s55-t13-sut1-c14/p1. - - ring2 40GE-ports XL710-QDA2-2p40GE on SUTs: - - s55-t13-sut1-c4/p2 - s55-t13-sut1-c14/p2. - - ring3 10/25GE-ports ConnectX5-2p10/25GE on SUTs: - - s55-t13-sut1-c8/p1 - s55-t13-sut1-c26/p1. - - ring4 10/25GE-ports ConnectX5-2p10/25GE on SUTs: - - s55-t13-sut1-c8/p2 - s55-t13-sut1-c26/p2. - -- testbed14: - - ring1 40GE-ports XL710-QDA2-2p40GE on SUTs: - - s56-t14-sut1-c4/p1 - s56-t14-sut1-c14/p1. - - ring2 40GE-ports XL710-QDA2-2p40GE on SUTs: - - s56-t14-sut1-c4/p2 - s56-t14-sut1-c14/p2. - - ring3 10/25GE-ports ConnectX5-2p10/25GE on SUTs: - - s56-t14-sut1-c8/p1 - s56-t14-sut1-c26/p1. - - ring4 10/25GE-ports ConnectX5-2p10/25GE on SUTs: - - s56-t14-sut1-c8/p2 - s56-t14-sut1-c26/p2. -``` - -#### 2-Node-Skylake Wiring (2n-skx) PROD - -``` -- testbed21: - - ring1 10GE-ports x710-4p10GE on SUT: - - s4-t21-tg1-c2/p1 to s3-t21-sut1-c2/p1. - - s3-t21-sut1-c2/p2 to s4-t21-tg1-c2/p2. - - ring2 10GE-ports x710-4p10GE on SUT: - - s4-t21-tg1-c2/p3 to s3-t21-sut1-c2/p3. - - s3-t21-sut1-c2/p4 to s4-t21-tg1-c2/p4. - - ring3 25GE-ports xxv710-DA2-2p25GE on SUT - - s4-t21-tg1-c4/p1 to s3-t21-sut1-c4/p1. - - s3-t21-sut1-c4/p2 to s4-t21-tg1-c4/p2. - - ring4 10GE-ports x710-4p10GE loopbacks on TG for self-tests: - - s4-t21-tg1-c10/p1 to s4-t21-tg1-c10/p2. - - s4-t21-tg1-c10/p3 to s4-t21-tg1-c10/p4. -- testbed22: - - ring1 10GE-ports x710-4p10GE on SUT: - - s6-t22-tg1-c2/p1 to s5-t22-sut1-c2/p1. - - s5-t22-sut1-c2/p2 to s6-t22-tg1-c2/p2. - - ring2 10GE-ports x710-4p10GE on SUT: - - s6-t22-tg1-c2/p3 to s5-t22-sut1-c2/p3. - - s5-t22-sut1-c2/p4 to s6-t22-tg1-c2/p4. - - ring3 25GE-ports xxv710-DA2-2p25GE on SUT - - s6-t22-tg1-c4/p1 to s5-t22-sut1-c4/p1. - - s5-t22-sut1-c4/p2 to s6-t22-tg1-c4/p2. - - ring4 10GE-ports x710-4p10GE loopbacks on TG for self-tests: - - s6-t22-tg1-c10/p1 to s6-t22-tg1-c10/p2. - - s6-t22-tg1-c10/p3 to s6-t22-tg1-c10/p4. -- testbed23: - - ring1 10GE-ports x710-4p10GE on SUT: - - s8-t23-tg1-c2/p1 to s7-t23-sut1-c2/p1. - - s7-t23-sut1-c2/p2 to s8-t23-tg1-c2/p2. - - ring2 10GE-ports x710-4p10GE on SUT: - - s8-t23-tg1-c2/p3 to s7-t23-sut1-c2/p3. - - s7-t23-sut1-c2/p4 to s8-t23-tg1-c2/p4. - - ring3 25GE-ports xxv710-DA2-2p25GE on SUT - - s8-t23-tg1-c4/p1 to s7-t23-sut1-c4/p1. - - s7-t23-sut1-c4/p2 to s8-t23-tg1-c4/p2. - - ring4 10GE-ports x710-4p10GE loopbacks on TG for self-tests: - - s8-t23-tg1-c10/p1 to s8-t23-tg1-c10/p2. - - s8-t23-tg1-c10/p3 to s8-t23-tg1-c10/p4. -- testbed24: - - ring1 10GE-ports x710-4p10GE on SUT: - - s10-t24-tg1-c2/p1 to s9-t24-sut1-c2/p1. - - s9-t24-sut1-c2/p2 to s10-t24-tg1-c2/p2. - - ring2 10GE-ports x710-4p10GE on SUT: - - s10-t24-tg1-c2/p3 to s9-t24-sut1-c2/p3. - - s9-t24-sut1-c2/p4 to s10-t24-tg1-c2/p4. - - ring3 25GE-ports xxv710-DA2-2p25GE on SUT - - s10-t24-tg1-c4/p1 to s9-t24-sut1-c4/p1. - - s9-t24-sut1-c4/p2 to s10-t24-tg1-c4/p2. - - ring4 10GE-ports x710-4p10GE loopbacks on TG for self-tests: - - s10-t24-tg1-c10/p1 to s10-t24-tg1-c10/p2. - - s10-t24-tg1-c10/p3 to s10-t24-tg1-c10/p4. -``` - -#### 2-Node-Denverton Wiring (2n-dnv) PROD - -``` -- testbed26: - - ring1 10GE-ports x553 copper port on SUT: - - s28-t26t35-tg1-c4/p1 to s29-t26-sut1-p1. - - s28-t26t35-tg1-c9/p1 to s29-t26-sut1-p2. - - ring2 10GE-ports x553 fiber port on SUT: - - s28-t26t35-tg1-c2/p1 to s29-t26-sut1-p3. - - s28-t26t35-tg1-c2/p2 to s29-t26-sut1-p4. -``` - -#### 2-Node-IxiaPS1L47 Wiring (2n-ps1) VERIFY - -``` -- testbed25: - - link1 10GE-port x710-4p10GE on SUT: - - t25-tg1-p1 to t25-sut1-c2/p1. - - link2 10GE-port x710-4p10GE on SUT: - - t25-tg1-p2 to t25-sut1-c2/p2. - - link3 10GE-port x710-4p10GE on SUT: - - t25-tg1-p3 to t25-sut1-c2/p3. - - link4 10GE-port x710-4p10GE on SUT: - - t25-tg1-p4 to t25-sut1-c2/p4. -``` - -#### 2-Node-Cascadelake Wiring (2n-clx) PROD - -``` -- testbed27: - - ring1 10GE-ports x710-4p10GE on SUT: - - s34-t27-tg1-c2/p1 to s33-t27-sut1-c2/p1. - - s33-t27-sut1-c2/p2 to s34-t27-tg1-c2/p2. - - ring2 10GE-ports x710-4p10GE on SUT: - - s34-t27-tg1-c2/p3 to s33-t27-sut1-c2/p3. - - s33-t27-sut1-c2/p4 to s34-t27-tg1-c2/p4. - - ring3 25GE-ports xxv710-DA2-2p25GE on SUT - - s34-t27-tg1-c4/p1 to s33-t27-sut1-c4/p1. - - s33-t27-sut1-c4/p2 to s34-t27-tg1-c4/p2. - - ring4 100GE-ports ConnectX5-2p100GE on SUT: - - s34-t27-tg1-c9/p1 to s33-t27-sut1-c9/p1. - - s33-t27-sut1-c9/p2 to s34-t27-tg1-c9/p2. - - ring5 100GE-ports e810-2p100GE on SUT 100GE-ports ConnectX5-2p100GE on TG: - - s34-t27-tg1-c6/p1 to s33-t27-sut1-c6/p1. - - s33-t27-sut1-c6/p2 to s34-t27-tg1-c6/p2. - - ring6 100GE-ports e810-2p100GE on TG: - - s34-t27-tg1-c8/p1 to s34-t27-tg1-c8/p2. - - s34-t27-tg1-c8/p2 to s34-t27-tg1-c8/p1. -- testbed28: - - ring1 10GE-ports x710-4p10GE on SUT: - - s36-t28-tg1-c2/p1 to s35-t28-sut1-c2/p1. - - s35-t28-sut1-c2/p2 to s36-t28-tg1-c2/p2. - - ring2 10GE-ports x710-4p10GE on SUT: - - s36-t28-tg1-c2/p3 to s35-t28-sut1-c2/p3. - - s35-t28-sut1-c2/p4 to s36-t28-tg1-c2/p4. - - ring3 25GE-ports xxv710-DA2-2p25GE on SUT - - s36-t28-tg1-c4/p1 to s35-t28-sut1-c4/p1. - - s35-t28-sut1-c4/p2 to s36-t28-tg1-c4/p2. - - ring4 100GE-ports ConnectX5-2p100GE on SUT: - - s36-t28-tg1-c9/p1 to s35-t28-sut1-c9/p1. - - s35-t28-sut1-c9/p2 to s36-t28-tg1-c9/p2. - - ring5 100GE-ports e810-2p100GE on SUT 100GE-ports ConnectX5-2p100GE on TG: - - s36-t28-tg1-c6/p1 to s35-t28-sut1-c6/p1. - - s35-t28-sut1-c6/p2 to s36-t28-tg1-c6/p2. - - ring6 100GE-ports e810-2p100GE on TG: - - s36-t28-tg1-c8/p1 to s36-t28-tg1-c8/p2. - - s36-t28-tg1-c8/p2 to s36-t28-tg1-c8/p1. -- testbed29: - - ring1 10GE-ports x710-4p10GE on SUT: - - s38-t29-tg1-c2/p1 to s37-t29-sut1-c2/p1. - - s37-t29-sut1-c2/p2 to s38-t29-tg1-c2/p2. - - ring2 10GE-ports x710-4p10GE on SUT: - - s38-t29-tg1-c2/p3 to s37-t29-sut1-c2/p3. - - s37-t29-sut1-c2/p4 to s38-t29-tg1-c2/p4. - - ring3 25GE-ports xxv710-DA2-2p25GE on SUT - - s38-t29-tg1-c4/p1 to s37-t29-sut1-c4/p1. - - s37-t29-sut1-c4/p2 to s38-t29-tg1-c4/p2. - - ring4 100GE-ports ConnectX5-2p100GE on SUT: - - s38-t29-tg1-c9/p1 to s37-t29-sut1-c9/p1. - - s37-t29-sut1-c9/p2 to s38-t29-tg1-c9/p2. - - ring5 100GE-ports e810-2p100GE on SUT 100GE-ports ConnectX5-2p100GE on TG: - - s38-t29-tg1-c6/p1 to s37-t29-sut1-c6/p1. - - s37-t29-sut1-c6/p2 to s38-t29-tg1-c6/p2. -``` - -#### 2-Node-Zen2 Wiring (2n-zn2) PROD - -``` -- testbed210: - - ring1 10GE-ports x710-4p10GE on SUT: - - s61-t210-tg1-c2/p1 to s60-t210-sut1-c1/p1. - - s60-t210-sut1-c1/p2 to s61-t210-tg1-c2/p2. - - ring2 10GE-ports x710-4p10GE on SUT: - - s61-t210-tg1-c2/p3 to s60-t210-sut1-c1/p3. - - s60-t210-sut1-c1/p4 to s61-t210-tg1-c2/p4. - - ring3 25GE-ports xxv710-DA2-2p25GE on SUT - - s61-t210-tg1-c3/p1 to s60-t210-sut1-c2/p1. - - s60-t210-sut1-c2/p2 to s61-t210-tg1-c3/p2. - - ring4 100GE-ports ConnectX5-2p100GE on SUT: - - s61-t210-tg1-c1/p1 to s60-t210-sut1-c3/p1. - - s60-t210-sut1-c3/p2 to s61-t210-tg1-c1/p2. -``` - -#### 2-Node-ThunderX2 Wiring (2n-tx2) PROD - -``` -- testbed211: - - ring1 10GE-ports x520-2p10GE on SUTs: - - s27-t211-sut1-c18/p1 - s19-t33t211-tg1-c8/p1. - - s27-t211-sut1-c18/p2 - s19-t33t211-tg1-c8/p2. -``` - -#### 2-Node-Icelake Wiring (2n-icx) PROD - -``` -- testbed212: - - ring1 25GE-ports xxv710-DA2-2p25GE on SUT - - s72-t212-tg1-c2/p1 to s71-t212-sut1-c2/p1. - - s71-t212-sut1-c2/p2 to s72-t212-tg1-c2/p2. - - ring2 25GE-ports e810-XXVDA4-2p25GE on SUT: - - s72-t212-tg1-c4/p1 to s71-t212-sut1-c4/p1. - - s71-t212-sut1-c4/p2 to s72-t212-tg1-c4/p2. - - s72-t212-tg1-c4/p3 to s71-t212-sut1-c4/p3. - - s71-t212-sut1-c4/p4 to s72-t212-tg1-c4/p4. - - ring3 100GE-ports e810-2CQDA2-2p100GE on SUT: - - s72-t212-tg1-c9/p1 to s71-t212-sut1-c9/p1. - - s71-t212-sut1-c9/p2 to s72-t212-tg1-c9/p2. - - ring4 100GE-ports e810-2CQDA2-2p100GE on SUT: - - s72-t212-tg1-c6/p1 to s72-t212-tg1-c6/p2. - - s72-t212-tg1-c6/p2 to s72-t212-tg1-c6/p1. -- testbed213: - - ring1 25GE-ports xxv710-DA2-2p25GE on SUT - - s84-t213-tg1-c2/p1 to s83-t213-sut1-c2/p1. - - s83-t213-sut1-c2/p2 to s84-t213-tg1-c2/p2. - - ring2 25GE-ports e810-XXVDA4-2p25GE on SUT: - - s84-t213-tg1-c4/p1 to s83-t213-sut1-c4/p1. - - s83-t213-sut1-c4/p2 to s84-t213-tg1-c4/p2. - - s84-t213-tg1-c4/p3 to s83-t213-sut1-c4/p3. - - s83-t213-sut1-c4/p4 to s84-t213-tg1-c4/p4. - - ring3 100GE-ports e810-2CQDA2-2p100GE on SUT: - - s84-t213-tg1-c9/p1 to s83-t213-sut1-c9/p1. - - s83-t213-sut1-c9/p2 to s84-t213-tg1-c9/p2. - - ring4 100GE-ports e810-2CQDA2-2p100GE on SUT: - - s84-t213-tg1-c6/p1 to s84-t213-tg1-c6/p2. - - s84-t213-tg1-c6/p2 to s84-t213-tg1-c6/p1. -- testbed214: - - ring1 25GE-ports xxv710-DA2-2p25GE on SUT - - s86-t214-tg1-c2/p1 to s85-t214-sut1-c2/p1. - - s85-t214-sut1-c2/p2 to s86-t214-tg1-c2/p2. - - ring2 25GE-ports e810-XXVDA4-2p25GE on SUT: - - s86-t214-tg1-c4/p1 to s85-t214-sut1-c4/p1. - - s85-t214-sut1-c4/p2 to s86-t214-tg1-c4/p2. - - s86-t214-tg1-c4/p3 to s85-t214-sut1-c4/p3. - - s85-t214-sut1-c4/p4 to s86-t214-tg1-c4/p4. - - ring3 100GE-ports e810-2CQDA2-2p100GE on SUT: - - s86-t214-tg1-c9/p1 to s85-t214-sut1-c9/p1. - - s85-t214-sut1-c9/p2 to s86-t214-tg1-c9/p2. - - ring4 100GE-ports e810-2CQDA2-2p100GE on SUT: - - s86-t214-tg1-c6/p1 to s86-t214-tg1-c6/p2. - - s86-t214-tg1-c6/p2 to s86-t214-tg1-c6/p1. -- testbed215: - - ring1 25GE-ports xxv710-DA2-2p25GE on SUT - - s88-t215-tg1-c2/p1 to s87-t215-sut1-c2/p1. - - s87-t215-sut1-c2/p2 to s88-t215-tg1-c2/p2. - - ring2 25GE-ports e810-XXVDA4-2p25GE on SUT: - - s88-t215-tg1-c4/p1 to s87-t215-sut1-c4/p1. - - s87-t215-sut1-c4/p2 to s88-t215-tg1-c4/p2. - - s88-t215-tg1-c4/p3 to s87-t215-sut1-c4/p3. - - s87-t215-sut1-c4/p4 to s88-t215-tg1-c4/p4. - - ring3 100GE-ports e810-2CQDA2-2p100GE on SUT: - - s88-t215-tg1-c9/p1 to s87-t215-sut1-c9/p1. - - s87-t215-sut1-c9/p2 to s88-t215-tg1-c9/p2. - - ring4 100GE-ports e810-2CQDA2-2p100GE on SUT: - - s88-t215-tg1-c6/p1 to s88-t215-tg1-c6/p2. - - s88-t215-tg1-c6/p2 to s88-t215-tg1-c6/p1. -``` - -#### 3-Node-Skylake Wiring (3n-skx) PROD - -``` -- testbed31: - - ring1 10GE-ports x710-4p10GE on SUTs: - - s13-t31-tg1-c2/p1 to s11-t31-sut1-c2/p1. - - s11-t31-sut1-c2/p2 to s12-t31-sut2-c2/p2. - - s12-t31-sut2-c2/p1 to s13-t31-tg1-c2/p2. - - ring2 10GE-ports x710-4p10GE on SUT: - - s13-t31-tg1-c2/p3 to s11-t31-sut1-c2/p3. - - s11-t31-sut1-c2/p4 to s12-t31-sut2-c2/p4. - - s12-t31-sut2-c2/p3 to s13-t31-tg1-c2/p4. - - ring3 25GE-ports xxv710-DA2-2p25GE on SUT - - s13-t31-tg1-c4/p1 to s11-t31-sut1-c4/p1. - - s11-t31-sut1-c4/p2 to s12-t31-sut2-c4/p2. - - s12-t31-sut2-c4/p1 to s13-t31-tg1-c4/p2. - - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT: - - s13-t31-tg1-c9/p1 to s11-t31-sut1-c9/p1. - - s11-t31-sut1-c9/p2 to s12-t31-sut2-c9/p2. - - s12-t31-sut2-c9/p1 to s13-t31-tg1-c9/p2. - - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests: - - s13-t31-tg1-c10/p1 to s13-t31-tg1-c10/p2. - - s13-t31-tg1-c10/p3 to s13-t31-tg1-c10/p4. -- testbed32: - - ring1 10GE-ports x710-4p10GE on SUTs: - - s16-t32-tg1-c2/p1 to s14-t32-sut1-c2/p1. - - s14-t32-sut1-c2/p2 to s15-t32-sut2-c2/p2. - - s15-t32-sut2-c2/p1 to s16-t32-tg1-c2/p2. - - ring2 10GE-ports x710-4p10GE on SUT: - - s16-t32-tg1-c2/p3 to s14-t32-sut1-c2/p3. - - s14-t32-sut1-c2/p4 to s15-t32-sut2-c2/p4. - - s15-t32-sut2-c2/p3 to s16-t32-tg1-c2/p4. - - ring3 25GE-ports xxv710-DA2-2p25GE on SUT - - s16-t32-tg1-c4/p1 to s14-t32-sut1-c4/p1. - - s14-t32-sut1-c4/p2 to s15-t32-sut2-c4/p2. - - s15-t32-sut2-c4/p1 to s16-t32-tg1-c4/p2. - - FUTURE ring4 100GE-ports ConnectX5-2p100GE on SUT: - - s16-t32-tg1-c9/p1 to s14-t32-sut1-c9/p1. - - s14-t32-sut1-c9/p2 to s15-t32-sut2-c9/p2. - - s15-t32-sut2-c9/p1 to s16-t32-tg1-c9/p2. - - ring5 10GE-ports x710-4p10GE loopbacks on TG for self-tests: - - s16-t32-tg1-c10/p1 to s16-t32-tg1-c10/p2. - - s16-t32-tg1-c10/p3 to s16-t32-tg1-c10/p4. -``` - -#### 3-Node-Rangeley Wiring (3n-rng) VERIFY - -``` -To be completed. -``` - -#### 3-Node-Taishan Wiring (3n-tsh) PROD - -``` -- testbed33: - - ring1 10GE-ports x520-2p10GE on SUTs: - - s19-t33t211-tg1-c2/p2 - s17-t33-sut1-c6/p2. - - s17-t33-sut1-c6/p1 - s18-t33-sut2-c6/p2. - - s18-t33-sut2-c6/p1 - s19-t33t211-tg1-c2/p1. - - ring2 25GE-ports cx4-2p25GE on SUTs: - - s19-t33t211-tg1-c4/p2 - s17-t33-sut1-c4/p2. - - s17-t33-sut1-c4/p1 - s18-t33-sut2-c4/p2. - - s18-t33-sut2-c4/p1 - s19-t33t211-tg1-c4/p1. -``` - -#### 3-Node-Altra Wiring (3n-alt) PROD - -``` -- testbed34: - - ring1 40GE-ports xl710-QDA2-2p40GE on SUTs: - - s64-t34-tg1-c4/p1 - s62-t34-sut1-c1/p2. - - s62-t34-sut1-c1/p1 - s63-t34-sut2-c1/p2. - - s63-t34-sut2-c1/p1 - s64-t34-tg1-c4/p2. -``` - -#### 3-Node-Denverton Wiring (3n-dnv) PROD - -``` -- testbed35: - - ring1 10GE-ports x553 copper port on SUTs: - - s28-t26t35-tg1-c8/p1 to s30-t35-sut1-p2. - - s30-t35-sut1-p1 to s31-t35-sut2-p1. - - s28-t26t35-tg1-c10/p1 to s31-t35-sut2-p2. - - ring2 10GE-ports x553 fiber port on SUTs: - - s28-t26t35-tg1-c6/p1 to s30-t35-sut1-p4. - - s30-t35-sut1-p3 to s31-t35-sut2-p3. - - s28-t26t35-tg1-c6/p2 to s31-t35-sut2-p4. -``` - -#### 3-Node-Icelake Wiring (3n-icx) PROD - -``` -- testbed37: - - ring1 25GE-ports xxv710-DA2-2p25GE on SUTs: - - s67-t37-tg1-c2/p1 to s65-t37-sut1-c2/p1. - - s65-t37-sut1-c2/p2 to s66-t37-sut2-c2/p2. - - s66-t37-sut2-c2/p1 to s67-t37-tg1-c2/p2. - - ring2 25GE-ports e810-XXVDA4-4p25GE on SUT: - - s67-t37-tg1-c4/p1 to s65-t37-sut1-c4/p1. - - s65-t37-sut1-c4/p2 to s66-t37-sut2-c4/p2. - - s66-t37-sut2-c4/p1 to s67-t37-tg1-c4/p2. - - s67-t37-tg1-c4/p3 to s65-t37-sut1-c4/p3. - - s65-t37-sut1-c4/p4 to s66-t37-sut2-c4/p4. - - s66-t37-sut2-c4/p3 to s67-t37-tg1-c4/p4. - - ring3 100GE-ports e810-2CQDA2-2p100GE on SUT - - s67-t37-tg1-c9/p1 to s65-t37-sut1-c9/p1. - - s65-t37-sut1-c9/p2 to s66-t37-sut2-c9/p2. - - s66-t37-sut2-c9/p1 to s67-t37-tg1-c9/p2. -- testbed38: - - ring1 25GE-ports xxv710-DA2-2p25GE on SUTs: - - s80-t38-tg1-c2/p1 to s78-t38-sut1-c2/p1. - - s78-t38-sut1-c2/p2 to s79-t38-sut2-c2/p2. - - s79-t38-sut2-c2/p1 to s80-t38-tg1-c2/p2. - - ring2 25GE-ports e810-XXVDA4-4p25GE on SUT: - - s80-t38-tg1-c4/p1 to s78-t38-sut1-c4/p1. - - s78-t38-sut1-c4/p2 to s79-t38-sut2-c4/p2. - - s79-t38-sut2-c4/p1 to s80-t38-tg1-c4/p2. - - s80-t38-tg1-c4/p3 to s78-t38-sut1-c4/p3. - - s78-t38-sut1-c4/p4 to s79-t38-sut2-c4/p4. - - s79-t38-sut2-c4/p3 to s80-t38-tg1-c4/p4. - - ring3 100GE-ports e810-2CQDA2-2p100GE on SUT - - s80-t38-tg1-c9/p1 to s78-t38-sut1-c9/p1. - - s78-t38-sut1-c9/p2 to s79-t38-sut2-c9/p2. - - s79-t38-sut2-c9/p1 to s80-t38-tg1-c9/p2. -``` - -#### 3-Node-SnowRidge Wiring (3n-snr) PROD - -``` -- testbed39: - - ring1 25GE-ports e810-XXVDA4-4p25GE on SUTs and TG: - - s89-t39t310-tg1-c6/p1 to s93-t39-sut1-c1/p1. - - s93-t39-sut1-c1/p2 to s94-t39-sut2-c1/p2. - - s94-t39-sut2-c1/p1 to s89-t39t310-tg1-c6/p2. - - s89-t39t310-tg1-c6/p3 to s93-t39-sut1-c1/p3. - - s93-t39-sut1-c1/p4 to s94-t39-sut2-c1/p4. - - s94-t39-sut2-c1/p3 to s89-t39t310-tg1-c6/p4. -``` - -## Inventory - -### Appliances - -``` -1. Ixia PerfectStorm One Appliance - - 1 * PS10GE4NG - - Chassis: PS10GE4NG. - - Motherboard: SuperMicro X11DPG-QT. - - Processors: Quad-Core, Intel Processor. - - HW accelerators: FPGA offload. - - RAM Memory: 64GB. - - Disks: 1 * 1 TB, Enterprise Class, High MTBF. - - Physical Interfaces: 4 * 10GE SFP+. - - Operating System: Native IxOS. -``` - -### Arm Servers - -``` -1. Arm Cortex A-72 servers - - 2 * ThunderX2 (VPP Device) - - Chassis: GIGABYTE Rack Mount - - Processors: 2* ThunderX2 CN9980 ~ 32* ThunderX2 - - RAM Memory: 16* 16GB DIMM - - Disks: 2* 480GB 6G SATA SSD SAMSUNG MZ7LH480 - - 1 * ThunderX2 (Performance) - - Chassis: GIGABYTE Rack Mount - - Processors: 2* ThunderX2 CN9975 ~ 28* ThunderX2. - - RAM Memory: 4* 32GB RDIMM - - Disks: 1* 480GB SSD Micron, 1* 1000GB HDD Seagate_25 - - 2 * Huawei TaiShan 2280. - - Chassis: Huawei TaiShan 2280. - - Processors: 2* hip07-d05 ~ 32* Arm Cortex-A72. - - RAM Memory: 8* 16GB DDR4-2400MT/s. - - Disks: 1* 4TB SATA HDD. -2. Arm Neoverse N1 servers - - 2 * Ampere Altra (Performance) - - Chassis: WIWYNN Mt.Jade Server System B81.030Z1.0007 2U - - Processors: 2* Ampere(R) Altra(R) Q80-30 Processor (Neoverse N1) - - Processor Signature: Implementor 0x41, Variant 0x3, Architecture 15, Part 0xd0c, Revision 1 - - RAM Memory: 16* 8GB DDR4-3200MT/s - - Disks: 2* 960GB SSD Samsung M.2 NVMe PM983 - - 2 * Ampere Altra (Build) - - Chassis: Gigabyte R152-P30-00 1U - - Motherboard: MP32-AR1-00 - - Processors: 1* Ampere(R) Altra(R) Q80-30 Processor (Neoverse N1) - - Processor Signature: Implementor 0x0a, Variant 0x1, Architecture 6, Part 0x000, Revision 1 - - RAM Memory: 12* 16GB DDR4-3200MT/s - - Disks: 1* 960GB SSD Samsung M.2 NVMe PM983 -``` - -### Xeon and Atom Servers - -``` -1. Intel Xeon servers: - - 20 * SuperMicro SYS-7049GP-TRT with Xeon Skylake processors. - - Chassis: SuperMicro SYS-7049GP-TRT. - - Motherboard: SuperMicro X11DPG-QT. - - Processors: 2* Intel Platinum 8180 2.5 GHz. - - RAM Memory: 16* 16GB DDR4-2666MHz. - - Disks: 2* 1.6TB 6G SATA SSD. -2. Intel Atom servers with Rangely processors. - - 3 * Netgate XG-2758-1u - - Chassis: Netgate XG-2758-1u - - Processors: 1* Rangely (Atom) C2758 2.4 GHz - - RAM Memory: 16GB ECC - - Disks: 150 GB -``` - -### Network Interface Cards - -``` -1. 10GE NICs - - ? -2. 25GE NICs - - ? -3. 40GE NICs - - ? -4. 100GE NICs - - ? -``` - -### Pluggables and Cables - -Pluggables: - -``` -1. 10GE SFP+ - - ? -2. 25GE SFP28 - - ? -3. 40GE QSFP+ - - ? -4. 100GE - - ? -``` - -Standalone cables: - -``` -1. 10GE - - ? -2. 25GE - - ? -3. 40GE QSFP+ - - ? -4. 100GE - - ? -``` - -### Other Parts - -None. diff --git a/docs/lab/testbeds_sm_clx_hw_bios_cfg.md b/docs/lab/testbeds_sm_clx_hw_bios_cfg.md deleted file mode 100644 index c1f5e28034..0000000000 --- a/docs/lab/testbeds_sm_clx_hw_bios_cfg.md +++ /dev/null @@ -1,1452 +0,0 @@ -# SuperMicro Cascadelake Servers - HW and BIOS Configuration - -1. [Linux lscpu](#linux-lscpu) -1. [Linux dmidecode](#dmidecode) -1. [Linux dmidecode pci](#linux-dmidecode-pci) -1. [Linux dmidecode memory](#linux-dmidecode-memory) -1. [Xeon Clx Server BIOS Configuration](#xeon-clx-server-bios-configuration) - 1. [Boot Feature](#boot-feature) - 1. [CPU Configuration](#cpu-configuration) - 1. [Advanced Power Management Configuration](#advanced-power-management-configuration) - 1. [CPU P State Control](#cpu-p-state-control) - 1. [Hardware PM State Control](#hardware-pm-state-control) - 1. [CPU C State Control](#cpu-c-state-control) - 1. [Package C State Control](#package-c-state-control) - 1. [CPU T State Control](#cpu-t-state-control) - 1. [Chipset Configuration](#chipset-configuration) - 1. [North Bridge](#north-bridge) - 1. [UPI Configuration](#upi-configuration) - 1. [Memory Configuration](#memory-configuration) - 1. [IIO Configuration](#iio-configuration) - 1. [CPU1 Configuration](#cpu1-configuration) - 1. [CPU2 Configuration](#cpu2-configuration) - 1. [South Bridge](#south-bridge) - 1. [PCIe/PCI/PnP Configuration](#pciepcipnp-configuration) - 1. [ACPI Settings](#acpi-settings) -1. [Xeon Clx Server Firmware Inventory](#xeon-clx-server-firmware-inventory) - -## Linux lscpu - -``` -$ lscpu -Architecture: x86_64 -CPU op-mode(s): 32-bit, 64-bit -Byte Order: Little Endian -CPU(s): 112 -On-line CPU(s) list: 0-111 -Thread(s) per core: 2 -Core(s) per socket: 28 -Socket(s): 2 -NUMA node(s): 2 -Vendor ID: GenuineIntel -CPU family: 6 -Model: 85 -Model name: Intel(R) Xeon(R) Platinum 8280 CPU @ 2.70GHz -Stepping: 7 -CPU MHz: 3299.609 -BogoMIPS: 5400.00 -Virtualization: VT-x -L1d cache: 32K -L1i cache: 32K -L2 cache: 1024K -L3 cache: 39424K -NUMA node0 CPU(s): 0-27,56-83 -NUMA node1 CPU(s): 28-55,84-111 -Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca -cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx -pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology -nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est -tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt -tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch -cpuid_fault epb cat_l3 cdp_l3 invpcid_single ssbd mba ibrs ibpb stibp -ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 -hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx -smap clflushopt clwb intel_pt avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 -xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts -pku ospke avx512_vnni md_clear flush_l1d arch_capabilities -``` - -``` -$ lscpu -Architecture: x86_64 -CPU op-mode(s): 32-bit, 64-bit -Byte Order: Little Endian -CPU(s): 96 -On-line CPU(s) list: 0-95 -Thread(s) per core: 2 -Core(s) per socket: 24 -Socket(s): 2 -NUMA node(s): 2 -Vendor ID: GenuineIntel -CPU family: 6 -Model: 85 -Model name: Intel(R) Xeon(R) Gold 6252N CPU @ 2.30GHz -Stepping: 7 -CPU MHz: 3000.989 -BogoMIPS: 4600.00 -Virtualization: VT-x -L1d cache: 32K -L1i cache: 32K -L2 cache: 1024K -L3 cache: 36608K -NUMA node0 CPU(s): 0-23,48-71 -NUMA node1 CPU(s): 24-47,72-95 -Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca -cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx -pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology -nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 -ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt -tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch -cpuid_fault epb cat_l3 cdp_l3 invpcid_single ssbd mba ibrs ibpb stibp -ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle -avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap -clflushopt clwb intel_pt avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 -xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts -pku ospke avx512_vnni md_clear flush_l1d arch_capabilities -``` - -## Linux dmidecode - -``` - # dmidecode 3.1 - Getting SMBIOS data from sysfs. - SMBIOS 3.1.2 present. - Table at 0x6EB92000. - - Handle 0x0000, DMI type 0, 26 bytes - BIOS Information - Vendor: American Megatrends Inc. - Version: 3.0c - Release Date: 03/27/2019 - Address: 0xF0000 - Runtime Size: 64 kB - ROM Size: 32 MB - Characteristics: - PCI is supported - BIOS is upgradeable - BIOS shadowing is allowed - Boot from CD is supported - Selectable boot is supported - BIOS ROM is socketed - EDD is supported - 5.25"/1.2 MB floppy services are supported (int 13h) - 3.5"/720 kB floppy services are supported (int 13h) - 3.5"/2.88 MB floppy services are supported (int 13h) - Print screen service is supported (int 5h) - Serial services are supported (int 14h) - Printer services are supported (int 17h) - ACPI is supported - USB legacy is supported - BIOS boot specification is supported - Targeted content distribution is supported - UEFI is supported - BIOS Revision: 5.14 - - Handle 0x0001, DMI type 1, 27 bytes - System Information - Manufacturer: Supermicro - Product Name: SYS-7049GP-TRT - Version: 0123456789 - Serial Number: S291427X9525476 - UUID: 00000000-0000-0000-0000-AC1F6BACD7BA - Wake-up Type: Power Switch - SKU Number: To be filled by O.E.M. - Family: To be filled by O.E.M. - - Handle 0x0002, DMI type 2, 15 bytes - Base Board Information - Manufacturer: Supermicro - Product Name: X11DPG-QT - Version: 1.10A - Serial Number: VM189S007860 - Asset Tag: To be filled by O.E.M. - Features: - Board is a hosting board - Board is replaceable - Location In Chassis: To be filled by O.E.M. - Chassis Handle: 0x0003 - Type: Motherboard - Contained Object Handles: 0 - - Handle 0x0003, DMI type 3, 22 bytes - Chassis Information - Manufacturer: Supermicro - Type: Other - Lock: Not Present - Version: 0123456789 - Serial Number: C7470KH37A30566 - Asset Tag: To be filled by O.E.M. - Boot-up State: Safe - Power Supply State: Safe - Thermal State: Safe - Security Status: None - OEM Information: 0x00000000 - Height: Unspecified - Number Of Power Cords: 1 - Contained Elements: 0 - SKU Number: To be filled by O.E.M. - - Handle 0x0055, DMI type 4, 48 bytes - Processor Information - Socket Designation: CPU1 - Type: Central Processor - Family: Xeon - Manufacturer: Intel(R) Corporation - ID: 57 06 05 00 FF FB EB BF - Signature: Type 0, Family 6, Model 85, Stepping 7 - Flags: - FPU (Floating-point unit on-chip) - VME (Virtual mode extension) - DE (Debugging extension) - PSE (Page size extension) - TSC (Time stamp counter) - MSR (Model specific registers) - PAE (Physical address extension) - MCE (Machine check exception) - CX8 (CMPXCHG8 instruction supported) - APIC (On-chip APIC hardware supported) - SEP (Fast system call) - MTRR (Memory type range registers) - PGE (Page global enable) - MCA (Machine check architecture) - CMOV (Conditional move instruction supported) - PAT (Page attribute table) - PSE-36 (36-bit page size extension) - CLFSH (CLFLUSH instruction supported) - DS (Debug store) - ACPI (ACPI supported) - MMX (MMX technology supported) - FXSR (FXSAVE and FXSTOR instructions supported) - SSE (Streaming SIMD extensions) - SSE2 (Streaming SIMD extensions 2) - SS (Self-snoop) - HTT (Multi-threading) - TM (Thermal monitor supported) - PBE (Pending break enabled) - Version: Intel(R) Xeon(R) Gold 6252N CPU @ 2.30GHz - Voltage: 1.6 V - External Clock: 100 MHz - Max Speed: 4500 MHz - Current Speed: 2300 MHz - Status: Populated, Enabled - Upgrade: Socket LGA3647-1 - L1 Cache Handle: 0x0052 - L2 Cache Handle: 0x0053 - L3 Cache Handle: 0x0054 - Serial Number: Not Specified - Asset Tag: UNKNOWN - Part Number: Not Specified - Core Count: 24 - Core Enabled: 24 - Thread Count: 48 - Characteristics: - 64-bit capable - Multi-Core - Hardware Thread - Execute Protection - Enhanced Virtualization - Power/Performance Control - - Handle 0x0059, DMI type 4, 48 bytes - Processor Information - Socket Designation: CPU2 - Type: Central Processor - Family: Xeon - Manufacturer: Intel(R) Corporation - ID: 57 06 05 00 FF FB EB BF - Signature: Type 0, Family 6, Model 85, Stepping 7 - Flags: - FPU (Floating-point unit on-chip) - VME (Virtual mode extension) - DE (Debugging extension) - PSE (Page size extension) - TSC (Time stamp counter) - MSR (Model specific registers) - PAE (Physical address extension) - MCE (Machine check exception) - CX8 (CMPXCHG8 instruction supported) - APIC (On-chip APIC hardware supported) - SEP (Fast system call) - MTRR (Memory type range registers) - PGE (Page global enable) - MCA (Machine check architecture) - CMOV (Conditional move instruction supported) - PAT (Page attribute table) - PSE-36 (36-bit page size extension) - CLFSH (CLFLUSH instruction supported) - DS (Debug store) - ACPI (ACPI supported) - MMX (MMX technology supported) - FXSR (FXSAVE and FXSTOR instructions supported) - SSE (Streaming SIMD extensions) - SSE2 (Streaming SIMD extensions 2) - SS (Self-snoop) - HTT (Multi-threading) - TM (Thermal monitor supported) - PBE (Pending break enabled) - Version: Intel(R) Xeon(R) Gold 6252N CPU @ 2.30GHz - Voltage: 1.6 V - External Clock: 100 MHz - Max Speed: 4500 MHz - Current Speed: 2300 MHz - Status: Populated, Enabled - Upgrade: Socket LGA3647-1 - L1 Cache Handle: 0x0056 - L2 Cache Handle: 0x0057 - L3 Cache Handle: 0x0058 - Serial Number: Not Specified - Asset Tag: UNKNOWN - Part Number: Not Specified - Core Count: 24 - Core Enabled: 24 - Thread Count: 48 - Characteristics: - 64-bit capable - Multi-Core - Hardware Thread - Execute Protection - Enhanced Virtualization - Power/Performance Control -``` - -## Linux dmidecode pci - -``` - $ dmidecode -t slot - Handle 0x000B, DMI type 9, 17 bytes - System Slot Information - Designation: CPU1 SLOT2 PCI-E 3.0 X16 - Type: x16 PCI Express 3 x16 - Current Usage: In Use - Length: Long - ID: 2 - Characteristics: - 3.3 V is provided - Opening is shared - PME signal is supported - Bus Address: 0000:18:00.0 - - Handle 0x000C, DMI type 9, 17 bytes - System Slot Information - Designation: CPU1 SLOT4 PCI-E 3.0 X16 - Type: x16 PCI Express 3 x16 - Current Usage: In Use - Length: Short - ID: 4 - Characteristics: - 3.3 V is provided - Opening is shared - PME signal is supported - Bus Address: 0000:3b:00.0 - - Handle 0x000D, DMI type 9, 17 bytes - System Slot Information - Designation: CPU2 SLOT6 PCI-E 3.0 X16 - Type: x16 PCI Express 3 x16 - Current Usage: Available - Length: Short - ID: 6 - Characteristics: - 3.3 V is provided - Opening is shared - PME signal is supported - Bus Address: 0000:ff:00.0 - - Handle 0x000E, DMI type 9, 17 bytes - System Slot Information - Designation: CPU2 SLOT8 PCI-E 3.0 X16 - Type: x16 PCI Express 3 x16 - Current Usage: Available - Length: Short - ID: 8 - Characteristics: - 3.3 V is provided - Opening is shared - PME signal is supported - Bus Address: 0000:ff:00.0 - - Handle 0x000F, DMI type 9, 17 bytes - System Slot Information - Designation: CPU1 SLOT9 PCI-E 3.0 X16 - Type: x16 PCI Express 3 x16 - Current Usage: Available - Length: Short - ID: 9 - Characteristics: - 3.3 V is provided - Opening is shared - PME signal is supported - Bus Address: 0000:ff:00.0 - - Handle 0x0010, DMI type 9, 17 bytes - System Slot Information - Designation: CPU2 SLOT10 PCI-E 3.0 X16 - Type: x16 PCI Express 3 x16 - Current Usage: Available - Length: Short - ID: 10 - Characteristics: - 3.3 V is provided - Opening is shared - PME signal is supported - Bus Address: 0000:ff:00.0 - - Handle 0x0011, DMI type 9, 17 bytes - System Slot Information - Designation: CPU2 SLOT11 PCI-E 3.0 X4(IN X8) - Type: x4 PCI Express 3 x8 - Current Usage: Available - Length: Short - ID: 11 - Characteristics: - 3.3 V is provided - Opening is shared - PME signal is supported - Bus Address: 0000:ff:00.0 - - Handle 0x0012, DMI type 9, 17 bytes - System Slot Information - Designation: M.2 CONNECTOR - Type: x4 M.2 Socket 2 - Current Usage: Available - Length: Short - Characteristics: - 3.3 V is provided - Opening is shared - PME signal is supported - Bus Address: 0000:ff:00.0 -``` - -## Linux dmidecode memory - -``` - $ dmidecode -t memory - Handle 0x0021, DMI type 16, 23 bytes - Physical Memory Array - Location: System Board Or Motherboard - Use: System Memory - Error Correction Type: Single-bit ECC - Maximum Capacity: 2304 GB - Error Information Handle: Not Provided - Number Of Devices: 4 - - Handle 0x0023, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0021 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P1-DIMMA1 - Bank Locator: P0_Node0_Channel0_Dimm0 - Type: DDR4 - Type Detail: Synchronous - Speed: 2933 MT/s - Manufacturer: SK Hynix - Serial Number: 93275F0E - Asset Tag: P1-DIMMA1_AssetTag (date:19/22) - Part Number: HMA82GR7CJR8N-WM - Rank: 2 - Configured Clock Speed: 2934 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x0024, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0021 - Error Information Handle: Not Provided - Total Width: Unknown - Data Width: Unknown - Size: No Module Installed - Form Factor: DIMM - Set: None - Locator: P1-DIMMA2 - Bank Locator: P0_Node0_Channel0_Dimm1 - Type: Unknown - Type Detail: Unknown - Speed: Unknown - Manufacturer: NO DIMM - Serial Number: NO DIMM - Asset Tag: NO DIMM - Part Number: NO DIMM - Rank: Unknown - Configured Clock Speed: Unknown - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x0025, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0021 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P1-DIMMB1 - Bank Locator: P0_Node0_Channel1_Dimm0 - Type: DDR4 - Type Detail: Synchronous - Speed: 2933 MT/s - Manufacturer: SK Hynix - Serial Number: 93275F1F - Asset Tag: P1-DIMMB1_AssetTag (date:19/22) - Part Number: HMA82GR7CJR8N-WM - Rank: 2 - Configured Clock Speed: 2934 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x0027, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0021 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P1-DIMMC1 - Bank Locator: P0_Node0_Channel2_Dimm0 - Type: DDR4 - Type Detail: Synchronous - Speed: 2933 MT/s - Manufacturer: SK Hynix - Serial Number: 93275F07 - Asset Tag: P1-DIMMC1_AssetTag (date:19/22) - Part Number: HMA82GR7CJR8N-WM - Rank: 2 - Configured Clock Speed: 2934 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x002B, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0029 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P1-DIMMD1 - Bank Locator: P0_Node1_Channel0_Dimm0 - Type: DDR4 - Type Detail: Synchronous - Speed: 2933 MT/s - Manufacturer: SK Hynix - Serial Number: 93275F02 - Asset Tag: P1-DIMMD1_AssetTag (date:19/22) - Part Number: HMA82GR7CJR8N-WM - Rank: 2 - Configured Clock Speed: 2934 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x002C, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0029 - Error Information Handle: Not Provided - Total Width: Unknown - Data Width: Unknown - Size: No Module Installed - Form Factor: DIMM - Set: None - Locator: P1-DIMMD2 - Bank Locator: P0_Node1_Channel0_Dimm1 - Type: Unknown - Type Detail: Unknown - Speed: Unknown - Manufacturer: NO DIMM - Serial Number: NO DIMM - Asset Tag: NO DIMM - Part Number: NO DIMM - Rank: Unknown - Configured Clock Speed: Unknown - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x002D, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0029 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P1-DIMME1 - Bank Locator: P0_Node1_Channel1_Dimm0 - Type: DDR4 - Type Detail: Synchronous - Speed: 2933 MT/s - Manufacturer: SK Hynix - Serial Number: 93275F19 - Asset Tag: P1-DIMME1_AssetTag (date:19/22) - Part Number: HMA82GR7CJR8N-WM - Rank: 2 - Configured Clock Speed: 2934 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x002F, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0029 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P1-DIMMF1 - Bank Locator: P0_Node1_Channel2_Dimm0 - Type: DDR4 - Type Detail: Synchronous - Speed: 2933 MT/s - Manufacturer: SK Hynix - Serial Number: 93275FD3 - Asset Tag: P1-DIMMF1_AssetTag (date:19/22) - Part Number: HMA82GR7CJR8N-WM - Rank: 2 - Configured Clock Speed: 2934 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x0031, DMI type 16, 23 bytes - Physical Memory Array - Location: System Board Or Motherboard - Use: System Memory - Error Correction Type: Single-bit ECC - Maximum Capacity: 2304 GB - Error Information Handle: Not Provided - Number Of Devices: 4 - - Handle 0x0033, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0031 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P2-DIMMA1 - Bank Locator: P1_Node0_Channel0_Dimm0 - Type: DDR4 - Type Detail: Synchronous - Speed: 2933 MT/s - Manufacturer: SK Hynix - Serial Number: 93275FE2 - Asset Tag: P2-DIMMA1_AssetTag (date:19/22) - Part Number: HMA82GR7CJR8N-WM - Rank: 2 - Configured Clock Speed: 2934 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x0034, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0031 - Error Information Handle: Not Provided - Total Width: Unknown - Data Width: Unknown - Size: No Module Installed - Form Factor: DIMM - Set: None - Locator: P2-DIMMA2 - Bank Locator: P1_Node0_Channel0_Dimm1 - Type: Unknown - Type Detail: Unknown - Speed: Unknown - Manufacturer: NO DIMM - Serial Number: NO DIMM - Asset Tag: NO DIMM - Part Number: NO DIMM - Rank: Unknown - Configured Clock Speed: Unknown - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x0035, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0031 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P2-DIMMB1 - Bank Locator: P1_Node0_Channel1_Dimm0 - Type: DDR4 - Type Detail: Synchronous - Speed: 2933 MT/s - Manufacturer: SK Hynix - Serial Number: 93276001 - Asset Tag: P2-DIMMB1_AssetTag (date:19/22) - Part Number: HMA82GR7CJR8N-WM - Rank: 2 - Configured Clock Speed: 2934 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x0037, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0031 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P2-DIMMC1 - Bank Locator: P1_Node0_Channel2_Dimm0 - Type: DDR4 - Type Detail: Synchronous - Speed: 2933 MT/s - Manufacturer: SK Hynix - Serial Number: 93276005 - Asset Tag: P2-DIMMC1_AssetTag (date:19/22) - Part Number: HMA82GR7CJR8N-WM - Rank: 2 - Configured Clock Speed: 2934 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x0039, DMI type 16, 23 bytes - Physical Memory Array - Location: System Board Or Motherboard - Use: System Memory - Error Correction Type: Single-bit ECC - Maximum Capacity: 2304 GB - Error Information Handle: Not Provided - Number Of Devices: 4 - - Handle 0x003B, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0039 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P2-DIMMD1 - Bank Locator: P1_Node1_Channel0_Dimm0 - Type: DDR4 - Type Detail: Synchronous - Speed: 2933 MT/s - Manufacturer: SK Hynix - Serial Number: 93275F44 - Asset Tag: P2-DIMMD1_AssetTag (date:19/22) - Part Number: HMA82GR7CJR8N-WM - Rank: 2 - Configured Clock Speed: 2934 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x003C, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0039 - Error Information Handle: Not Provided - Total Width: Unknown - Data Width: Unknown - Size: No Module Installed - Form Factor: DIMM - Set: None - Locator: P2-DIMMD2 - Bank Locator: P1_Node1_Channel0_Dimm1 - Type: Unknown - Type Detail: Unknown - Speed: Unknown - Manufacturer: NO DIMM - Serial Number: NO DIMM - Asset Tag: NO DIMM - Part Number: NO DIMM - Rank: Unknown - Configured Clock Speed: Unknown - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x003D, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0039 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P2-DIMME1 - Bank Locator: P1_Node1_Channel1_Dimm0 - Type: DDR4 - Type Detail: Synchronous - Speed: 2933 MT/s - Manufacturer: SK Hynix - Serial Number: 93275FDF - Asset Tag: P2-DIMME1_AssetTag (date:19/22) - Part Number: HMA82GR7CJR8N-WM - Rank: 2 - Configured Clock Speed: 2934 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x003F, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0039 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P2-DIMMF1 - Bank Locator: P1_Node1_Channel2_Dimm0 - Type: DDR4 - Type Detail: Synchronous - Speed: 2933 MT/s - Manufacturer: SK Hynix - Serial Number: 93275FDD - Asset Tag: P2-DIMMF1_AssetTag (date:19/22) - Part Number: HMA82GR7CJR8N-WM - Rank: 2 - Configured Clock Speed: 2934 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V -``` - -## Xeon CLX Server BIOS Configuration - TG - -### Boot Feature - -``` - | Quiet Boot [Enabled] |Boot option | - | | | - | Option ROM Messages [Force BIOS] | | - | Bootup NumLock State [On] | | - | Wait For "F1" If Error [Enabled] | | - | INT19 Trap Response [Immediate] | | - | Re-try Boot [Disabled] | | - | Install Windows 7 USB support [Disabled] | | - | Port 61h Bit-4 Emulation [Disabled] | | - | | | - | Power Configuration | | - | Watch Dog Function [Disabled] | | - | Restore on AC Power Loss [Last State] | | - | Power Button Function [Instant Off] | | -``` - -### CPU Configuration - -``` - | Processor Configuration ^|Enables Hyper Threading | - | -------------------------------------------------- *|(Software Method to | - | Processor BSP Revision 50657 - CLX B1 *|Enable/Disable Logical | - | Processor Socket CPU1 | CPU2 *|Processor threads. | - | Processor ID 00050657* | 00050657 *| | - | Processor Frequency 2.700GHz | 2.700GHz *| | - | Processor Max Ratio 1BH | 1BH *| | - | Processor Min Ratio 0AH | 0AH *| | - | Microcode Revision 0500002C | 0500002C *| | - | L1 Cache RAM 64KB | 64KB *| | - | L2 Cache RAM 1024KB | 1024KB *| | - | L3 Cache RAM 39424KB | 39424KB *| | - | Processor 0 Version *| | - | Intel(R) Xeon(R) Platinum 8280 CPU @ 2.70GHz *| | - | Processor 1 Version *| | - | Intel(R) Xeon(R) Platinum 8280 CPU @ 2.70GHz *| | - | *|-----------------------------| - | Hyper-Threading [ALL] [Enable] *|><: Select Screen | - | Cores Enabled 0 *|^v: Select Item | - | Monitor/Mwait [Auto] *|Enter: Select | - | Execute Disable Bit [Enable] +|+/-: Change Opt. | - | Intel Virtualization Technology [Enable] +|F1: General Help | - | PPIN Control [Unlock/Enable] +|F2: Previous Values | - | Hardware Prefetcher [Enable] +|F3: Optimized Defaults | - | Adjacent Cache Prefetch [Enable] v|F4: Save & Exit | - | DCU Streamer Prefetcher [Enable] | | - | DCU IP Prefetcher [Enable] | | - | LLC Prefetch [Disable] | | - | Extended APIC [Disable] | | - | AES-NI [Enable] | | - |> Advanced Power Management Configuration | | -``` - -#### Advanced Power Management Configuration - -``` - | Advanced Power Management Configuration |Switch CPU Power Management | - | -------------------------------------------------- |profile | - | Power Technology [Custom] | | - | Power Performance Tuning [BIOS Controls EPB] | | - | ENERGY_PERF_BIAS_CFG mode [Maximum Performance] | | - |> CPU P State Control | | - |> Hardware PM State Control | | - |> CPU C State Control | | - |> Package C State Control | | - |> CPU T State Control | | -``` - -##### CPU P State Control - -``` - | CPU P State Control |EIST allows the processor | - | |to dynamically adjust | - | SpeedStep (P-States) [Disable] |frequency and voltage based | - | EIST PSD Function [HW_ALL] |on power versus performance | - | |needs. | - | | | -``` - -##### Hardware PM State Control - -``` - | Hardware PM State Control |If set to Disable, hardware ^| - | |will choose a P-state *| - | Hardware P-States [Disable] |setting for the system *| - | |based on an OS request. *| - | |If set to Native Mode, *| - | |hardware will choose a *| - | |P-state setting based on OS *| - | |guidance. *| - | |If set to Native Mode with *| - | |No Legacy Support, hardware *| - | |will choose a P-state *| - | |setting independently *| - | |without OS guidance. +| - | |If set to Out of Band Mode, +| - | |hardware autonomously v| -``` - -##### CPU C State Control - -``` - | CPU C State Control |Select Enable to support | - | |Autonomous Core C-State | - | Autonomous Core C-State [Disable] |control which will allow | - | CPU C6 report [Disable] |the processor core to | - | Enhanced Halt State (C1E) [Disable] |control its C-State setting | - | |automatically and | - | |independently. | -``` - -##### Package C State Control - -``` - | Package C State Control |Limit the lowest package | - | |level C-State to | - | Package C State [C0/C1 state] |processors. Lower package | - | |C-State lower processor | - | |power consumption upon idle. | -``` - -##### CPU T State Control - -``` - | CPU T State Control |Enable/Disable CPU | - | |throttling by OS. | - | Software Controlled T-States [Disable] |Throttling reduces power | - | |consumption | -``` - -#### Chipset Configuration - -``` - | WARNING: Setting wrong values in below sections may cause |North Bridge Parameters | - | system to malfunction. | | - |> North Bridge | | - |> South Bridge | | -``` - -##### North Bridge - -``` - |> UPI Configuration |Displays and provides | - |> Memory Configuration |option to change the UPI | - |> IIO Configuration |Settings | -``` - -##### UPI Configuration - -``` - | UPI Configuration |Use this feature to select | - | -------------------------------------------------- |the degrading precedence | - | Number of CPU 2 |option for Ultra Path | - | Number of Active UPI Link 3 |Interconnect connections. | - | Current UPI Link Speed Fast |Select Topology Precedent | - | Current UPI Link Frequency 10.4 GT/s |to degrade UPI features if | - | UPI Global MMIO Low Base / Limit 90000000 / FBFFFFFF |system options are in | - | UPI Global MMIO High Base / Limit 0000000000000000 / |conflict. Select Feature | - | 00000000FFFFFFFF |Precedent to degrade UPI | - | UPI Pci-e Configuration Base / Size 80000000 / 10000000 |topology if system options | - | Degrade Precedence [Topology Precedence] |are in conflict. | - | Link L0p Enable [Disable] | | - | Link L1 Enable [Disable] | | - | IO Directory Cache (IODC) [Auto] | | - | SNC [Disable] | | - | XPT Prefetch [Disable] | | - | KTI Prefetch [Enable] |-----------------------------| - | Local/Remote Threshold [Auto] |><: Select Screen | - | Stale AtoS [Auto] |^v: Select Item | - | LLC Dead Line Alloc [Enable] |Enter: Select | - | Isoc Mode [Auto] |+/-: Change Opt. | -``` - -##### Memory Configuration - -``` - | |Select POR to enforce POR | - | -------------------------------------------------- |restrictions for DDR4 | - | Integrated Memory Controller (iMC) |frequency and voltage | - | -------------------------------------------------- |programming | - | | | - | Enforce POR [POR] | | - | PPR Type [Hard PPR] | | - | Enhanced PPR [Disable] | | - | Operation Mode [Test and Repair] | | - | Memory Frequency [2933] | | - | Data Scrambling for DDR4 [Auto] | | - | tCCD_L Relaxation [Auto] | | - | tRWSR Relaxation [Disable] | | - | tRFC Optimization for 16Gb Based DIMM [Force 550ns] | | - | 2x Refresh [Auto] | | - | Page Policy [Auto] | | - | IMC Interleaving [2-way Interleave] |-----------------------------| - |> Memory Topology |><: Select Screen | - |> Memory RAS Configuration |^v: Select Item | -``` - -##### IIO Configuration - -``` - | IIO Configuration |Expose IIO DFX devices and | - | -------------------------------------------------- |other CPU devices like PMON | - | | | - | EV DFX Features [Disable] | | - |> CPU1 Configuration | | - |> CPU2 Configuration | | - |> IOAT Configuration | | - |> Intel. VT for Directed I/O (VT-d) | | - |> Intel. VMD technology | | - | | | - | IIO-PCIE Express Global Options | | - | ======================================== | | - | PCI-E Completion Timeout Disable [No] | | -``` - -##### CPU1 Configuration - -``` - | IOU0 (IIO PCIe Br1) [Auto] |Selects PCIe port | - | IOU1 (IIO PCIe Br2) [Auto] |Bifurcation for selected | - | IOU2 (IIO PCIe Br3) [Auto] |slot(s) | - |> CPU1 SLOT2 PCI-E 3.0 X16 | | - |> CPU1 SLOT4 PCI-E 3.0 X16 | | - |> CPU1 SLOT9 PCI-E 3.0 X16 | | -``` - -##### CPU2 Configuration - -``` - | IOU0 (IIO PCIe Br1) [Auto] |Selects PCIe port | - | IOU1 (IIO PCIe Br2) [Auto] |Bifurcation for selected | - | IOU2 (IIO PCIe Br3) [Auto] |slot(s) | - |> CPU2 SLOT6 PCI-E 3.0 X16 | | - |> CPU2 SLOT8 PCI-E 3.0 X16 | | - |> CPU2 SLOT10 PCI-E 3.0 X16 | | -``` - -#### South Bridge - -``` - | |Enables Legacy USB support. | - | USB Module Version 21 |AUTO option disables legacy | - | |support if no USB devices | - | USB Devices: |are connected. DISABLE | - | 1 Keyboard, 1 Mouse, 1 Hub |option will keep USB | - | |devices available only for | - | Legacy USB Support [Enabled] |EFI applications. | - | XHCI Hand-off [Enabled] | | - | Port 60/64 Emulation [Enabled] | | - | PCIe PLL SSC [Disable] | | - | Real USB Wake Up [Enabled] | | - | Front USB Wake Up [Enabled] | | - | | | - | Azalia [Auto] | | - | Azalia PME Enable [Disabled] | | -``` - -### PCIe/PCI/PnP Configuration - -``` - | PCI Bus Driver Version A5.01.18 ^|Enables or Disables 64bit | - | *|capable Devices to be | - | PCI Devices Common Settings: *|Decoded in Above 4G Address | - | Above 4G Decoding [Enabled] *|Space (Only if System | - | SR-IOV Support [Enabled] *|Supports 64 bit PCI | - | ARI Support [Enabled] *|Decoding). | - | MMIO High Base [56T] *| | - | MMIO High Granularity Size [256G] *| | - | Maximum Read Request [Auto] *| | - | MMCFG Base [2G] *| | - | NVMe Firmware Source [Vendor Defined *| | - | Firmware] *| | - | VGA Priority [Onboard] *| | - | CPU1 SLOT2 PCI-E 3.0 X16 OPROM [Legacy] *| | - | CPU1 SLOT4 PCI-E 3.0 X16 OPROM [Legacy] *| | - | CPU2 SLOT6 PCI-E 3.0 X16 OPROM [Legacy] *| | - | CPU2 SLOT8 PCI-E 3.0 X16 OPROM [Legacy] *|-----------------------------| - | CPU1 SLOT9 PCI-E 3.0 X16 OPROM [Legacy] *|><: Select Screen | - | CPU2 SLOT10 PCI-E 3.0 X16 OPROM [Legacy] *|^v: Select Item | - | CPU2 SLOT11 PCI-E 3.0 X4(IN X8) OPROM [Legacy] *|Enter: Select | - | M.2 CONNECTOR OPROM [Legacy] *|+/-: Change Opt. | - | Bus Master Enable [Enabled] +|F1: General Help | - | Onboard LAN1 Option ROM [Legacy] +|F2: Previous Values | - | Onboard LAN2 Option ROM [Disabled] +|F3: Optimized Defaults | - | Onboard Video Option ROM [Legacy] v|F4: Save & Exit | - |> Network Stack Configuration | | -``` - -### ACPI Settings - -``` - | ACPI Settings |Enable or Disable Non | - | |uniform Memory Access | - | NUMA [Enabled] |(NUMA). | - | WHEA Support [Enabled] | | - | High Precision Event Timer [Enabled] | | -``` - -## Xeon CLX Server BIOS Configuration - DUT - -### Boot Feature - -``` - | Quiet Boot [Enabled] |Boot option | - | | | - | Option ROM Messages [Force BIOS] | | - | Bootup NumLock State [On] | | - | Wait For "F1" If Error [Enabled] | | - | INT19 Trap Response [Immediate] | | - | Re-try Boot [Disabled] | | - | Install Windows 7 USB support [Disabled] | | - | Port 61h Bit-4 Emulation [Disabled] | | - | | | - | Power Configuration | | - | Watch Dog Function [Disabled] | | - | Restore on AC Power Loss [Last State] | | - | Power Button Function [Instant Off] | | -``` - -### CPU Configuration - -``` - |--------------------------------------------------------------------+-----------------------------\ - | Processor Configuration ^|Enables Hyper Threading | - | -------------------------------------------------- *|(Software Method to | - | Processor BSP Revision 50657 - CLX B1 *|Enable/Disable Logical | - | Processor Socket CPU1 | CPU2 *|Processor threads. | - | Processor ID 00050657* | 00050657 *| | - | Processor Frequency 2.300GHz | 2.300GHz *| | - | Processor Max Ratio 17H | 17H *| | - | Processor Min Ratio 0AH | 0AH *| | - | Microcode Revision 0500002C | 0500002C *| | - | L1 Cache RAM 64KB | 64KB *| | - | L2 Cache RAM 1024KB | 1024KB *| | - | L3 Cache RAM 36608KB | 36608KB *| | - | Processor 0 Version *| | - | Intel(R) Xeon(R) Gold 6252N CPU @ 2.30GHz *| | - | Processor 1 Version *| | - | Intel(R) Xeon(R) Gold 6252N CPU @ 2.30GHz *| | - | *|-----------------------------| - | Hyper-Threading [ALL] [Enable] *|><: Select Screen | - | Cores Enabled 0 *|^v: Select Item | - | Monitor/Mwait [Auto] *|Enter: Select | - | Execute Disable Bit [Enable] +|+/-: Change Opt. | - | Intel Virtualization Technology [Enable] +|F1: General Help | - | PPIN Control [Unlock/Enable] +|F2: Previous Values | - | Hardware Prefetcher [Enable] +|F3: Optimized Defaults | - | Adjacent Cache Prefetch [Enable] v|F4: Save & Exit | - | DCU Streamer Prefetcher [Enable] | | - | DCU IP Prefetcher [Enable] | | - | LLC Prefetch [Disable] | | - | Extended APIC [Disable] | | - | AES-NI [Enable] | | - |> Advanced Power Management Configuration | | -``` - -#### Advanced Power Management Configuration - -``` - | Advanced Power Management Configuration |Switch CPU Power Management | - | -------------------------------------------------- |profile | - | Power Technology [Custom] | | - | Power Performance Tuning [BIOS Controls EPB] | | - | ENERGY_PERF_BIAS_CFG mode [Maximum Performance] | | - |> CPU P State Control | | - |> Hardware PM State Control | | - |> CPU C State Control | | - |> Package C State Control | | - |> CPU T State Control | | -``` - -##### CPU P State Control - -``` - | CPU P State Control |EIST allows the processor | - | |to dynamically adjust | - | SpeedStep (P-States) [Disable] |frequency and voltage based | - | Activate PBF [Disable] |on power versus performance | - | Configure PBF [Enable] |needs. | - | EIST PSD Function [HW_ALL] | | -``` - -##### Hardware PM State Control - -``` - | Hardware PM State Control |If set to Disable, hardware ^| - | |will choose a P-state *| - | Hardware P-States [Disable] |setting for the system *| - | |based on an OS request. *| - | |If set to Native Mode, *| - | |hardware will choose a *| - | |P-state setting based on OS *| - | |guidance. *| - | |If set to Native Mode with *| - | |No Legacy Support, hardware *| - | |will choose a P-state *| - | |setting independently *| - | |without OS guidance. +| - | |If set to Out of Band Mode, +| - | |hardware autonomously v| -``` - -##### CPU C State Control - -``` - | CPU C State Control |Select Enable to support | - | |Autonomous Core C-State | - | Autonomous Core C-State [Disable] |control which will allow | - | CPU C6 report [Disable] |the processor core to | - | Enhanced Halt State (C1E) [Disable] |control its C-State setting | - | |automatically and | - | |independently. | -``` - -##### Package C State Control - -``` - | Package C State Control |Limit the lowest package | - | |level C-State to | - | Package C State [C0/C1 state] |processors. Lower package | - | |C-State lower processor | - | |power consumption upon idle. | -``` - -##### CPU T State Control - -``` - | CPU T State Control |Enable/Disable CPU | - | |throttling by OS. | - | Software Controlled T-States [Disable] |Throttling reduces power | - | |consumption | -``` - -#### Chipset Configuration - -``` - | WARNING: Setting wrong values in below sections may cause |North Bridge Parameters | - | system to malfunction. | | - |> North Bridge | | - |> South Bridge | | -``` - -##### North Bridge - -``` - |> UPI Configuration |Displays and provides | - |> Memory Configuration |option to change the UPI | - |> IIO Configuration |Settings | -``` - -##### UPI Configuration - -``` - | UPI Configuration |Use this feature to select | - | -------------------------------------------------- |the degrading precedence | - | Number of CPU 2 |option for Ultra Path | - | Number of Active UPI Link 3 |Interconnect connections. | - | Current UPI Link Speed Fast |Select Topology Precedent | - | Current UPI Link Frequency 10.4 GT/s |to degrade UPI features if | - | UPI Global MMIO Low Base / Limit 90000000 / FBFFFFFF |system options are in | - | UPI Global MMIO High Base / Limit 0000000000000000 / |conflict. Select Feature | - | 00000000FFFFFFFF |Precedent to degrade UPI | - | UPI Pci-e Configuration Base / Size 80000000 / 10000000 |topology if system options | - | Degrade Precedence [Topology Precedence] |are in conflict. | - | Link L0p Enable [Disable] | | - | Link L1 Enable [Disable] | | - | IO Directory Cache (IODC) [Auto] | | - | SNC [Disable] | | - | XPT Prefetch [Disable] | | - | KTI Prefetch [Enable] |-----------------------------| - | Local/Remote Threshold [Auto] |><: Select Screen | - | Stale AtoS [Auto] |^v: Select Item | - | LLC Dead Line Alloc [Enable] |Enter: Select | - | Isoc Mode [Auto] |+/-: Change Opt. | -``` - -##### Memory Configuration - -``` - | |Select POR to enforce POR | - | -------------------------------------------------- |restrictions for DDR4 | - | Integrated Memory Controller (iMC) |frequency and voltage | - | -------------------------------------------------- |programming | - | | | - | Enforce POR [POR] | | - | PPR Type [Hard PPR] | | - | Enhanced PPR [Disable] | | - | Operation Mode [Test and Repair] | | - | Memory Frequency [2933] | | - | Data Scrambling for DDR4 [Auto] | | - | tCCD_L Relaxation [Auto] | | - | tRWSR Relaxation [Disable] | | - | tRFC Optimization for 16Gb Based DIMM [Force 550ns] | | - | 2x Refresh [Auto] | | - | Page Policy [Auto] | | - | IMC Interleaving [2-way Interleave] |-----------------------------| - |> Memory Topology |><: Select Screen | - |> Memory RAS Configuration |^v: Select Item | -``` - -##### IIO Configuration - -``` - | IIO Configuration |Expose IIO DFX devices and | - | -------------------------------------------------- |other CPU devices like PMON | - | | | - | EV DFX Features [Disable] | | - |> CPU1 Configuration | | - |> CPU2 Configuration | | - |> IOAT Configuration | | - |> Intel. VT for Directed I/O (VT-d) | | - |> Intel. VMD technology | | - | | | - | IIO-PCIE Express Global Options | | - | ======================================== | | - | PCI-E Completion Timeout Disable [No] | | -``` - -##### CPU1 Configuration - -``` - | IOU0 (IIO PCIe Br1) [Auto] |Selects PCIe port | - | IOU1 (IIO PCIe Br2) [Auto] |Bifurcation for selected | - | IOU2 (IIO PCIe Br3) [Auto] |slot(s) | - |> CPU1 SLOT2 PCI-E 3.0 X16 | | - |> CPU1 SLOT4 PCI-E 3.0 X16 | | - |> CPU1 SLOT9 PCI-E 3.0 X16 | | -``` - -##### CPU2 Configuration - -``` - | IOU0 (IIO PCIe Br1) [Auto] |Selects PCIe port | - | IOU1 (IIO PCIe Br2) [Auto] |Bifurcation for selected | - | IOU2 (IIO PCIe Br3) [Auto] |slot(s) | - |> CPU2 SLOT6 PCI-E 3.0 X16 | | - |> CPU2 SLOT8 PCI-E 3.0 X16 | | - |> CPU2 SLOT10 PCI-E 3.0 X16 | | -``` - -#### South Bridge - -``` - | |Enables Legacy USB support. | - | USB Module Version 21 |AUTO option disables legacy | - | |support if no USB devices | - | USB Devices: |are connected. DISABLE | - | 1 Keyboard, 1 Mouse, 1 Hub |option will keep USB | - | |devices available only for | - | Legacy USB Support [Enabled] |EFI applications. | - | XHCI Hand-off [Enabled] | | - | Port 60/64 Emulation [Enabled] | | - | PCIe PLL SSC [Disable] | | - | Real USB Wake Up [Enabled] | | - | Front USB Wake Up [Enabled] | | - | | | - | Azalia [Auto] | | - | Azalia PME Enable [Disabled] | | -``` - -### PCIe/PCI/PnP Configuration - -``` - | PCI Bus Driver Version A5.01.18 ^|Enables or Disables 64bit | - | *|capable Devices to be | - | PCI Devices Common Settings: *|Decoded in Above 4G Address | - | Above 4G Decoding [Enabled] *|Space (Only if System | - | SR-IOV Support [Enabled] *|Supports 64 bit PCI | - | ARI Support [Enabled] *|Decoding). | - | MMIO High Base [56T] *| | - | MMIO High Granularity Size [256G] *| | - | Maximum Read Request [Auto] *| | - | MMCFG Base [2G] *| | - | NVMe Firmware Source [Vendor Defined *| | - | Firmware] *| | - | VGA Priority [Onboard] *| | - | CPU1 SLOT2 PCI-E 3.0 X16 OPROM [Legacy] *| | - | CPU1 SLOT4 PCI-E 3.0 X16 OPROM [Legacy] *| | - | CPU2 SLOT6 PCI-E 3.0 X16 OPROM [Legacy] *| | - | CPU2 SLOT8 PCI-E 3.0 X16 OPROM [Legacy] *|-----------------------------| - | CPU1 SLOT9 PCI-E 3.0 X16 OPROM [Legacy] *|><: Select Screen | - | CPU2 SLOT10 PCI-E 3.0 X16 OPROM [Legacy] *|^v: Select Item | - | CPU2 SLOT11 PCI-E 3.0 X4(IN X8) OPROM [Legacy] *|Enter: Select | - | M.2 CONNECTOR OPROM [Legacy] *|+/-: Change Opt. | - | Bus Master Enable [Enabled] +|F1: General Help | - | Onboard LAN1 Option ROM [Legacy] +|F2: Previous Values | - | Onboard LAN2 Option ROM [Disabled] +|F3: Optimized Defaults | - | Onboard Video Option ROM [Legacy] v|F4: Save & Exit | - |> Network Stack Configuration | | -``` - -### ACPI Settings - -``` - | ACPI Settings |Enable or Disable Non | - | |uniform Memory Access | - | NUMA [Enabled] |(NUMA). | - | WHEA Support [Enabled] | | - | High Precision Event Timer [Enabled] | | -``` - - -## Xeon Clx Server Firmware Inventory - -``` -Host. IPMI IP. BMC. BIOS. CPLD. CPU Microcode. PCI Bus. X710 Firmware. XXV710 Firmware. i40e. MLX5 Firmware. mlx5_core E810 Firmware. ice. -s33-t27-sut1. 10.30.55.18. 1.67. 3.2. 03.B1.05. 0500002C. A5.01.18. 8.30 0x8000a49d 1.2926.0. 8.30 0x8000a485 1.2926.0. 2.17.15. 16.32.1010. 5.3-1.0.5.0. 3.20 0x8000d83e 1.3146.0. 1.8.3. -s34-t27-tg1. 10.30.55.19. 1.67. 3.2. 03.B1.05. 0500002C. A5.01.18. 8.00 0x80008b82 1.2007.0. 8.00 0x80008c1a 1.2007.0. 2.14.13. 16.32.1010. 5.5-1.0.3.2. N/A. N/A. -s35-t28-sut1. 10.30.55.20. 1.67. 3.2. 03.B1.05. 0500002C. A5.01.18. 8.30 0x8000a49d 1.2926.0. 8.30 0x8000a485 1.2926.0. 2.17.15. 16.32.1010. 5.3-1.0.5.0. 3.20 0x8000d83e 1.3146.0. 1.8.3. -s36-t28-tg1. 10.30.55.21. 1.67. 3.2. 03.B1.05. 0500002C. A5.01.18. 8.00 0x80008b82 1.2007.0. 8.00 0x80008c1a 1.2007.0. 2.14.13. 16.32.1010. 5.5-1.0.3.2. N/A. N/A. -s37-t29-sut1. 10.30.55.22. 1.67. 3.2. 03.B1.05. 0500002C. A5.01.18. 8.30 0x8000a49d 1.2926.0. 8.30 0x8000a485 1.2926.0. 2.17.15. 16.32.1010. 5.3-1.0.5.0. 3.20 0x8000d83e 1.3146.0. 1.8.3. -s38-t29-tg1. 10.30.55.23. 1.67. 3.2. 03.B1.05. 0500002C. A5.01.18. 8.00 0x80008b82 1.2007.0. 8.00 0x80008c1a 1.2007.0. 2.14.13. 16.32.1010. 5.5-1.0.3.2. N/A. N/A. -``` diff --git a/docs/lab/testbeds_sm_dnv_hw_bios_cfg.md b/docs/lab/testbeds_sm_dnv_hw_bios_cfg.md deleted file mode 100644 index bdddd2f037..0000000000 --- a/docs/lab/testbeds_sm_dnv_hw_bios_cfg.md +++ /dev/null @@ -1,351 +0,0 @@ -# SuperMicro Denverton Servers - HW and BIOS Configuration - -1. [Linux lscpu](#linux-lscpu) -1. [Linux dmidecode](#dmidecode) -1. [Atom Dnv Server BIOS Configuration](#atom-dnv-server-bios-configuration) - 1. [Boot Feature](#boot-feature) - 1. [CPU Configuration](#cpu-configuration) - 1. [Chipset Configuration](#chipset-configuration) - 1. [North Bridge Configuration](#north-bridge-configuration) - 1. [South Bridge Configuration](#south-bridge-configuration) - 1. [PCIe/PCI/PnP Configuration](#pciepcipnp-configuration) - 1. [ACPI Settings](#acpi-settings) -1. [Atom Dnv Server Firmware Inventory](#atom-dnv-server-firmware-inventory) - -## Linux lscpu - -``` -$ lscpu -Architecture: x86_64 -CPU op-mode(s): 32-bit, 64-bit -Byte Order: Little Endian -CPU(s): 12 -On-line CPU(s) list: 0-11 -Thread(s) per core: 1 -Core(s) per socket: 12 -Socket(s): 1 -NUMA node(s): 1 -Vendor ID: GenuineIntel -CPU family: 6 -Model: 95 -Model name: Intel(R) Atom(TM) CPU C3858 @ 2.00GHz -Stepping: 1 -CPU MHz: 2000.000 -CPU max MHz: 2000.0000 -CPU min MHz: 800.0000 -BogoMIPS: 4000.00 -Virtualization: VT-x -L1d cache: 24K -L1i cache: 32K -L2 cache: 2048K -NUMA node0 CPU(s): 0-11 -Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca -cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx -pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology -nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl -vmx est tm2 ssse3 sdbg cx16 xtpr pdcm sse4_1 sse4_2 x2apic movbe popcnt -tsc_deadline_timer aes xsave rdrand lahf_lm 3dnowprefetch cpuid_fault epb cat_l2 -ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase -tsc_adjust smep erms mpx rdt_a rdseed smap clflushopt intel_pt sha_ni xsaveopt -xsavec xgetbv1 xsaves dtherm arat pln pts md_clear arch_capabilities - -``` - -### Linux dmidecode - -``` - # dmidecode 3.1 - Getting SMBIOS data from sysfs. - SMBIOS 3.0.0 present. - Table at 0x7F0C8000. - - Handle 0x0000, DMI type 0, 24 bytes - BIOS Information - Vendor: American Megatrends Inc. - Version: 1.0b - Release Date: 12/12/2017 - Address: 0xF0000 - Runtime Size: 64 kB - ROM Size: 16 MB - Characteristics: - PCI is supported - BIOS is upgradeable - BIOS shadowing is allowed - Boot from CD is supported - Selectable boot is supported - BIOS ROM is socketed - EDD is supported - 5.25"/1.2 MB floppy services are supported (int 13h) - 3.5"/720 kB floppy services are supported (int 13h) - 3.5"/2.88 MB floppy services are supported (int 13h) - Print screen service is supported (int 5h) - Serial services are supported (int 14h) - Printer services are supported (int 17h) - ACPI is supported - USB legacy is supported - BIOS boot specification is supported - Targeted content distribution is supported - UEFI is supported - BIOS Revision: 5.13 - - Handle 0x0001, DMI type 1, 27 bytes - System Information - Manufacturer: Supermicro - Product Name: SYS-E300-9A - Version: 0123456789 - Serial Number: S292431X8616427 - UUID: 03000200-0400-0500-0006-0CC47AFCCA92 - Wake-up Type: Power Switch - SKU Number: To be filled by O.E.M. - Family: To be filled by O.E.M. - - Handle 0x0002, DMI type 2, 15 bytes - Base Board Information - Manufacturer: Supermicro - Product Name: A2SDi-TP8F - Version: 1.10 - Serial Number: OM184S023953 - Asset Tag: To be filled by O.E.M. - Features: - Board is a hosting board - Board is replaceable - Location In Chassis: To be filled by O.E.M. - Chassis Handle: 0x0003 - Type: Motherboard - Contained Object Handles: 0 - - Handle 0x0003, DMI type 3, 22 bytes - Chassis Information - Manufacturer: Supermicro - Type: Other - Lock: Not Present - Version: 0123456789 - Serial Number: CE300AG39040925 - Asset Tag: To be filled by O.E.M. - Boot-up State: Safe - Power Supply State: Safe - Thermal State: Safe - Security Status: None - OEM Information: 0x00000000 - Height: Unspecified - Number Of Power Cords: 1 - Contained Elements: 0 - SKU Number: To be filled by O.E.M. - - Handle 0x0028, DMI type 4, 48 bytes - Processor Information - Socket Designation: CPU - Type: Central Processor - Family: Atom - Manufacturer: Intel(R) Corporation - ID: F1 06 05 00 FF FB EB BF - Signature: Type 0, Family 6, Model 95, Stepping 1 - Flags: - FPU (Floating-point unit on-chip) - VME (Virtual mode extension) - DE (Debugging extension) - PSE (Page size extension) - TSC (Time stamp counter) - MSR (Model specific registers) - PAE (Physical address extension) - MCE (Machine check exception) - CX8 (CMPXCHG8 instruction supported) - APIC (On-chip APIC hardware supported) - SEP (Fast system call) - MTRR (Memory type range registers) - PGE (Page global enable) - MCA (Machine check architecture) - CMOV (Conditional move instruction supported) - PAT (Page attribute table) - PSE-36 (36-bit page size extension) - CLFSH (CLFLUSH instruction supported) - DS (Debug store) - ACPI (ACPI supported) - MMX (MMX technology supported) - FXSR (FXSAVE and FXSTOR instructions supported) - SSE (Streaming SIMD extensions) - SSE2 (Streaming SIMD extensions 2) - SS (Self-snoop) - HTT (Multi-threading) - TM (Thermal monitor supported) - PBE (Pending break enabled) - Version: Intel(R) Atom(TM) CPU C3858 @ 2.00GHz - Voltage: 1.6 V - External Clock: 100 MHz - Max Speed: 3800 MHz - Current Speed: 2000 MHz - Status: Populated, Enabled - Upgrade: Other - L1 Cache Handle: 0x0026 - L2 Cache Handle: 0x0027 - L3 Cache Handle: Not Provided - Serial Number: Not Specified - Asset Tag: UNKNOWN - Part Number: Not Specified - Core Count: 12 - Core Enabled: 12 - Thread Count: 12 - Characteristics: - 64-bit capable - Multi-Core - Hardware Thread - Execute Protection - Enhanced Virtualization - Power/Performance Control -``` - -## Atom Dnv Server BIOS Configuration - -### Boot Feature - -``` - | Quiet Boot [Enabled] |Enable or disable to | - | |display graphic logo during | - | Bootup NumLock State [On] |POST | - | Wait For "F1" If Error [Enabled] | | - | | | - | Power Configuration | | - | Watch Dog Function [Disabled] | | - | Power Button Function [Instant Off] | | - | Restore on AC Power Loss [Power On] | | -``` - -### CPU Configuration - -``` - | CPU Configuration |Enable/Disable EIST. GV3 | - | |and TM1 must be enabled for | - | Intel(R) Atom(TM) CPU C3858 @ 2.00GHz |TM2 to be available. GV3 | - | Processor ID 000506F1 |must be enabled for Turbo. | - | Microcode Revision 00000020 |Auto - Enable for B0 CPU | - | Processor Frequency 2.000GHz |stepping, all others | - | CPU BCLK Frequency 100MHZ |disabled, change setting to | - | L1 Cache RAM 56KB |override. | - | L2 Cache RAM 12288KB | | - | | | - | EIST (GV3) [Enable] | | - | BIOS Request Frequency [Enable] | | - | TM1 [Enable] | | - | TM2 Mode [Adaptive Throttling] | | - | Dynamic Self Refresh [Disable] | | - | CPU C State [Disable] | | - | Package C State Limit [No Limit] | | - | Max Core C-State [C6] | | - | Enhanced Hait State (C1E) [Enable] | | - | Monitor/Mwait [Enable] | | - | L1 Prefetcher [Enable] | | - | L1 Prefetcher [Enable] | | - | ACPI 3.0 T-States [Disable] | | - | Max CPUID Value Limit [Disable] | | - | Execute Disable Bit [Enable] | | - | Virtualization Technology [Enable] | | - | Extended APIC [Enable] | | - | AES-NI [Enable] | | - | Lock PACKAGE_RAPL_LIMIT [Disable] | | - | PL1 Time Window 45 | | - | PL1 Power Level 25 | | - | PL2 Power Level 29 | | - | Active Processor Cores 0 | | -``` - -### Chipset Configuration - -``` - | WARNING: Setting wrong values in below sections may cause |North Bridge Parameters | - | system to malfunction. | | - |> North Bridge Configuration | | - |> South Bridge Configuration | | -``` - -#### North Bridge Configuration - -``` - | North Bridge Configuration |COption to Ebable / Disable | - | |VT-d | - | Memory Information | | - | MRC Version 0.149.4.43 | | - | Total Memory 32768 MB | | - | Memory Frequency DDR4 - 2400 MHZ | | - | | | - | VT-d [Enabled] | | - | VT-d Interrupt remapping [Enabled] | | - | | | - | Fast Boot [Enabled] | | - | Command Address Parity [Disabled] | | - | Memory Frequency [DDR-2400] | | - | MMIO Size / BMBOUND Base [Auto] | | - | TCL performance [Enabled] | | - | Memory Preservation [Disabled] | | - | Patrol scrub Enable [Enabled] | | - | Patrol scrub Period [24 hours] | | - | Demand Scrub Enable [Enabled] | | - | Write Data Early Enble [Disabled] | | - | Select Refresh Rate [1x/2x] | | - | CKE Power Down [Disabled] | | - | Memory Thermal Throttling [Disabled] | | - | Scrambler [Enabled] | | - | Slow Power Down Exit [Enabled] | | -``` - -#### South Bridge Configuration - -``` - | South Bridge Configuration |Enables Legacy USB support. | - | |AUTO option disables legacy | - | USB Module Version 19 |support if no USB devices | - | USB Controllers: |are connected. DISABLE | - | 1 XHCI |option will keep USB | - | USB Devices: |devices available only for | - | 2 Keyboards, 1 Mouse, 3 Hubs |EFI applications. | - | | | - | Legacy USB Support [Enabled] | | - | XHCI Hand-off [Enabled] | | - | Port 60/64 Emulation [Enabled] | | - -``` - -### PCIe/PCI/PnP Configuration - -``` - | PCI Bus Driver Version A5.01.12 |Enables or Disables 64bit | - | |capable Devices to be | - | PCI Devices Common Settings: |Decoded in Above 4G Address | - | Above 4G Decoding [Enabled] |Space (Only if System | - | SR-IOV Support [Enabled] |Supports 64 bit PCI | - | Maximum Payload [Auto] |Decoding). | - | Maximum Read Request [Auto] | | - | ASPM Support [Disabled] | | - | ARI Forwarding [Disabled] | | - | | | - | RSC-RR1U-E8 OPROM [EFI] | | - | M.2 PCI-E 3.0 X4 OPROM [EFI] | | - | Mini PCI-E OPROM [EFI] | | - | | | - | Onboard LAN OPROM Type [EFI] | | - | | | - | Onboard Video OPROM [EFI] | | - | VGA Priority [Onboard] | | - | | | - | Network Stack [Enabled] | | - | IPv4 PXE Support [Enabled] | | - | IPv6 PXE Support [Disabled] | | - | PXE boot wait time 0 | | - | Media detect count 1 | | -``` - -### ACPI Settings - -``` - | ACPI Settings |Enable/Disable WHEA ACPI | - | |support | - | WHEA Support [Enabled] | | -``` - -## Atom Dnv Server Firmware Inventory - -``` -Host. IPMI IP. BMC. BIOS. CPU Microcode. PCI Bus. ME Operation FW. X553 Firmware. ixgbe. -s29-t26-sut1. 10.30.55.11. 3.60. 1.0b. 0x2e. A5.01.12. 4.0.4.139. 0x8000083f 5.1.0-k -s30-t35-sut1. 10.30.55.12. 3.60. 1.0b. 0x2e. A5.01.12. 4.0.4.139. 0x8000083f 5.1.0-k -s31-t35-sut2. 10.30.55.13. 3.60. 1.0b. 0x2e. A5.01.12. 4.0.4.139. 0x8000083f 5.1.0-k -``` diff --git a/docs/lab/testbeds_sm_icx_hw_bios_cfg.md b/docs/lab/testbeds_sm_icx_hw_bios_cfg.md deleted file mode 100644 index b897d64593..0000000000 --- a/docs/lab/testbeds_sm_icx_hw_bios_cfg.md +++ /dev/null @@ -1,1256 +0,0 @@ -# SuperMicro Icelake Servers - HW and BIOS Configuration - -1. [Linux lscpu](#linux-lscpu) -1. [Linux dmidecode](#dmidecode) -1. [Linux dmidecode pci](#linux-dmidecode-pci) -1. [Linux dmidecode memory](#linux-dmidecode-memory) -1. [Xeon ICX Server BIOS Configuration](#xeon-icx-server-bios-configuration) - 1. [Boot Feature](#boot-feature) - 1. [CPU Configuration](#cpu-configuration) - 1. [Advanced Power Management Configuration](#advanced-power-management-configuration) - 1. [CPU P State Control](#cpu-p-state-control) - 1. [Hardware PM State Control](#hardware-pm-state-control) - 1. [CPU C State Control](#cpu-c-state-control) - 1. [Package C State Control](#package-c-state-control) - 1. [CPU T State Control](#cpu-t-state-control) - 1. [Chipset Configuration](#chipset-configuration) - 1. [North Bridge](#north-bridge) - 1. [UPI Configuration](#upi-configuration) - 1. [Memory Configuration](#memory-configuration) - 1. [IIO Configuration](#iio-configuration) - 1. [CPU1 Configuration](#cpu1-configuration) - 1. [CPU2 Configuration](#cpu2-configuration) - 1. [South Bridge](#south-bridge) - 1. [PCIe/PCI/PnP Configuration](#pciepcipnp-configuration) - 1. [ACPI Settings](#acpi-settings) -1. [Xeon ICX Server Firmware Inventory](#xeon-icx-server-firmware-inventory) - -## Linux lscpu - -``` -$ lscpu -Architecture: x86_64 -CPU op-mode(s): 32-bit, 64-bit -Byte Order: Little Endian -Address sizes: 46 bits physical, 57 bits virtual -CPU(s): 128 -On-line CPU(s) list: 0-127 -Thread(s) per core: 2 -Core(s) per socket: 32 -Socket(s): 2 -NUMA node(s): 2 -Vendor ID: GenuineIntel -CPU family: 6 -Model: 106 -Model name: Intel(R) Xeon(R) Platinum 8358 CPU @ 2.60GHz -Stepping: 6 -CPU MHz: 3283.980 -BogoMIPS: 5200.00 -Virtualization: VT-x -L1d cache: 3 MiB -L1i cache: 2 MiB -L2 cache: 80 MiB -L3 cache: 96 MiB -NUMA node0 CPU(s): 0-31,64-95 -NUMA node1 CPU(s): 32-63,96-127 -Vulnerability Itlb multihit: Not affected -Vulnerability L1tf: Not affected -Vulnerability Mds: Not affected -Vulnerability Meltdown: Not affected -Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl and seccomp -Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization -Vulnerability Spectre v2: Mitigation; Enhanced IBRS, IBPB conditional, RSB filling -Vulnerability Srbds: Not affected -Vulnerability Tsx async abort: Not affected -Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe sysca - ll nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmu - lqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadl - ine_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 invpcid_single ssbd mba ibrs ibpb stibp - ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm rdt_a avx - 512f avx512dq rdseed adx smap avx512ifma clflushopt clwb intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 x - saves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local wbnoinvd dtherm ida arat pln pts avx512vbmi umip pku ospke avx512_vbm - i2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg tme avx512_vpopcntdq rdpid md_clear pconfig flush_l1d arch_capabilities -``` - -## Linux dmidecode - -``` -# dmidecode 3.2 -Getting SMBIOS data from sysfs. -SMBIOS 3.3.0 present. -# SMBIOS implementations newer than version 3.2.0 are not -# fully supported by this version of dmidecode. -Table at 0x6BAEE000. - -Handle 0x0000, DMI type 0, 26 bytes -BIOS Information - Vendor: American Megatrends International, LLC. - Version: 1.1 - Release Date: 04/09/2021 - Address: 0xF0000 - Runtime Size: 64 kB - ROM Size: 32 MB - Characteristics: - PCI is supported - BIOS is upgradeable - BIOS shadowing is allowed - Boot from CD is supported - Selectable boot is supported - BIOS ROM is socketed - EDD is supported - Japanese floppy for NEC 9800 1.2 MB is supported (int 13h) - Japanese floppy for Toshiba 1.2 MB is supported (int 13h) - 5.25"/360 kB floppy services are supported (int 13h) - 5.25"/1.2 MB floppy services are supported (int 13h) - 3.5"/720 kB floppy services are supported (int 13h) - 3.5"/2.88 MB floppy services are supported (int 13h) - Print screen service is supported (int 5h) - Serial services are supported (int 14h) - Printer services are supported (int 17h) - CGA/mono video services are supported (int 10h) - USB legacy is supported - BIOS boot specification is supported - Targeted content distribution is supported - UEFI is supported - BIOS Revision: 5.22 - -Handle 0x0001, DMI type 1, 27 bytes -System Information - Manufacturer: Supermicro - Product Name: SYS-740GP-TNRT - Version: 0123456789 - Serial Number: S424016X1B00510 - UUID: 0698ae00-2383-11ec-8000-3cecefb9a6ba - Wake-up Type: Power Switch - SKU Number: To be filled by O.E.M. - Family: Family - -Handle 0x0002, DMI type 2, 15 bytes -Base Board Information - Manufacturer: Supermicro - Product Name: X12DPG-QT6 - Version: 1.00 - Serial Number: UM219S003392 - Asset Tag: Base Board Asset Tag - Features: - Board is a hosting board - Board is replaceable - Location In Chassis: Part Component - Chassis Handle: 0x0003 - Type: Motherboard - Contained Object Handles: 0 - -Handle 0x0003, DMI type 3, 22 bytes -Chassis Information - Manufacturer: Supermicro - Type: Other - Lock: Not Present - Version: 0123456789 - Serial Number: C7470KK25P50098 - Asset Tag: Chassis Asset Tag - Boot-up State: Safe - Power Supply State: Safe - Thermal State: Safe - Security Status: None - OEM Information: 0x00000000 - Height: Unspecified - Number Of Power Cords: 1 - Contained Elements: 0 - SKU Number: To be filled by O.E.M. - -Handle 0x001B, DMI type 38, 18 bytes -IPMI Device Information - Interface Type: KCS (Keyboard Control Style) - Specification Version: 2.0 - I2C Slave Address: 0x10 - NV Storage Device: Not Present - Base Address: 0x0000000000000CA2 (I/O) - Register Spacing: Successive Byte Boundaries - -Handle 0x002A, DMI type 4, 48 bytes -Processor Information - Socket Designation: CPU1 - Type: Central Processor - Family: Xeon - Manufacturer: Intel(R) Corporation - ID: A6 06 06 00 FF FB EB BF - Signature: Type 0, Family 6, Model 106, Stepping 6 - Flags: - FPU (Floating-point unit on-chip) - VME (Virtual mode extension) - DE (Debugging extension) - PSE (Page size extension) - TSC (Time stamp counter) - MSR (Model specific registers) - PAE (Physical address extension) - MCE (Machine check exception) - CX8 (CMPXCHG8 instruction supported) - APIC (On-chip APIC hardware supported) - SEP (Fast system call) - MTRR (Memory type range registers) - PGE (Page global enable) - MCA (Machine check architecture) - CMOV (Conditional move instruction supported) - PAT (Page attribute table) - PSE-36 (36-bit page size extension) - CLFSH (CLFLUSH instruction supported) - DS (Debug store) - ACPI (ACPI supported) - MMX (MMX technology supported) - FXSR (FXSAVE and FXSTOR instructions supported) - SSE (Streaming SIMD extensions) - SSE2 (Streaming SIMD extensions 2) - SS (Self-snoop) - HTT (Multi-threading) - TM (Thermal monitor supported) - PBE (Pending break enabled) - Version: Intel(R) Xeon(R) Platinum 8358 CPU @ 2.60GHz - Voltage: 1.6 V - External Clock: 100 MHz - Max Speed: 4500 MHz - Current Speed: 2600 MHz - Status: Populated, Enabled - Upgrade: <OUT OF SPEC> - L1 Cache Handle: 0x0027 - L2 Cache Handle: 0x0028 - L3 Cache Handle: 0x0029 - Serial Number: Not Specified - Asset Tag: UNKNOWN - Part Number: Not Specified - Core Count: 32 - Core Enabled: 32 - Thread Count: 64 - Characteristics: - 64-bit capable - Multi-Core - Hardware Thread - Execute Protection - Enhanced Virtualization - Power/Performance Control - -Handle 0x002E, DMI type 4, 48 bytes -Processor Information - Socket Designation: CPU2 - Type: Central Processor - Family: Xeon - Manufacturer: Intel(R) Corporation - ID: A6 06 06 00 FF FB EB BF - Signature: Type 0, Family 6, Model 106, Stepping 6 - Flags: - FPU (Floating-point unit on-chip) - VME (Virtual mode extension) - DE (Debugging extension) - PSE (Page size extension) - TSC (Time stamp counter) - MSR (Model specific registers) - PAE (Physical address extension) - MCE (Machine check exception) - CX8 (CMPXCHG8 instruction supported) - APIC (On-chip APIC hardware supported) - SEP (Fast system call) - MTRR (Memory type range registers) - PGE (Page global enable) - MCA (Machine check architecture) - CMOV (Conditional move instruction supported) - PAT (Page attribute table) - PSE-36 (36-bit page size extension) - CLFSH (CLFLUSH instruction supported) - DS (Debug store) - ACPI (ACPI supported) - MMX (MMX technology supported) - FXSR (FXSAVE and FXSTOR instructions supported) - SSE (Streaming SIMD extensions) - SSE2 (Streaming SIMD extensions 2) - SS (Self-snoop) - HTT (Multi-threading) - TM (Thermal monitor supported) - PBE (Pending break enabled) - Version: Intel(R) Xeon(R) Platinum 8358 CPU @ 2.60GHz - Voltage: 1.6 V - External Clock: 100 MHz - Max Speed: 4500 MHz - Current Speed: 2600 MHz - Status: Populated, Enabled - Upgrade: <OUT OF SPEC> - L1 Cache Handle: 0x002B - L2 Cache Handle: 0x002C - L3 Cache Handle: 0x002D - Serial Number: Not Specified - Asset Tag: UNKNOWN - Part Number: Not Specified - Core Count: 32 - Core Enabled: 32 - Thread Count: 64 - Characteristics: - 64-bit capable - Multi-Core - Hardware Thread - Execute Protection - Enhanced Virtualization - Power/Performance Control -``` - -## Linux dmidecode pci - -``` - $ dmidecode -t slot -Handle 0x000A, DMI type 9, 17 bytes -System Slot Information - Designation: CPU1 SLOT2 PCI-E 4.0 X16 - Type: x16 <OUT OF SPEC> - Current Usage: In Use - Length: Short - Characteristics: - 3.3 V is provided - Opening is shared - PME signal is supported - Bus Address: 0000:4b:00.0 - -Handle 0x000B, DMI type 9, 17 bytes -System Slot Information - Designation: CPU1 SlOT4 PCI-E 4.0 X16 - Type: x16 <OUT OF SPEC> - Current Usage: In Use - Length: Short - Characteristics: - 3.3 V is provided - Opening is shared - PME signal is supported - Bus Address: 0000:31:00.0 - -Handle 0x000C, DMI type 9, 17 bytes -System Slot Information - Designation: CPU2 SLOT6 PCI-E 4.0 X16 - Type: x16 <OUT OF SPEC> - Current Usage: Available - Length: Short - Characteristics: - 3.3 V is provided - Opening is shared - PME signal is supported - Bus Address: 0000:ff:00.0 - -Handle 0x000D, DMI type 9, 17 bytes -System Slot Information - Designation: CPU2 SLOT8 PCI-E 4.0 X16 - Type: x16 <OUT OF SPEC> - Current Usage: Available - Length: Short - Characteristics: - 3.3 V is provided - Opening is shared - PME signal is supported - Bus Address: 0000:ff:00.0 - -Handle 0x000E, DMI type 9, 17 bytes -System Slot Information - Designation: CPU1 SLOT9 PCI-E 4.0 X16 - Type: x16 <OUT OF SPEC> - Current Usage: In Use - Length: Short - Characteristics: - 3.3 V is provided - Opening is shared - PME signal is supported - Bus Address: 0000:17:00.0 - -Handle 0x000F, DMI type 9, 17 bytes -System Slot Information - Designation: CPU2 SLOT10 PCI-E 4.0 X16 - Type: x16 <OUT OF SPEC> - Current Usage: Available - Length: Short - Characteristics: - 3.3 V is provided - Opening is shared - PME signal is supported - Bus Address: 0000:ff:00.0 - -Handle 0x0010, DMI type 9, 17 bytes -System Slot Information - Designation: CPU2 SLOT11 PCI-E 4.0 X8 - Type: x8 <OUT OF SPEC> - Current Usage: Available - Length: Short - Characteristics: - 3.3 V is provided - Opening is shared - PME signal is supported - Bus Address: 0000:ff:00.0 - -Handle 0x0011, DMI type 9, 17 bytes -System Slot Information - Designation: M.2-HC1 - Type: x4 M.2 Socket 2 - Current Usage: Available - Length: Short - Characteristics: - 3.3 V is provided - Opening is shared - PME signal is supported - Bus Address: 0000:ff:00.0 - -Handle 0x0012, DMI type 9, 17 bytes -System Slot Information - Designation: M.2-HC2 - Type: x4 M.2 Socket 2 - Current Usage: Available - Length: Short - Characteristics: - 3.3 V is provided - Opening is shared - PME signal is supported - Bus Address: 0000:ff:00.0 -``` - -## Linux dmidecode memory - -``` - $ dmidecode -t memory -Handle 0x0033, DMI type 16, 23 bytes -Physical Memory Array - Location: System Board Or Motherboard - Use: System Memory - Error Correction Type: Single-bit ECC - Maximum Capacity: 12 TB - Error Information Handle: Not Provided - Number Of Devices: 16 - -Handle 0x0034, DMI type 17, 92 bytes -Memory Device - Array Handle: 0x0033 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P1-DIMMA1 - Bank Locator: P0_Node0_Channel0_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: Samsung - Serial Number: H0MK0001304705C2E3 - Asset Tag: P1-DIMMA1_AssetTag (date:21/30) - Part Number: M393A2K43DB3-CWE - Rank: 2 - Configured Memory Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - Memory Technology: DRAM - Memory Operating Mode Capability: Volatile memory - Firmware Version: 0000 - Module Manufacturer ID: Bank 1, Hex 0xCE - Module Product ID: Unknown - Memory Subsystem Controller Manufacturer ID: Unknown - Memory Subsystem Controller Product ID: Unknown - Non-Volatile Size: None - Volatile Size: 16 GB - Cache Size: None - Logical Size: None - -Handle 0x0036, DMI type 17, 92 bytes -Memory Device - Array Handle: 0x0033 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P1-DIMMB1 - Bank Locator: P0_Node0_Channel1_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: Samsung - Serial Number: H0MK0001304705CE60 - Asset Tag: P1-DIMMB1_AssetTag (date:21/30) - Part Number: M393A2K43DB3-CWE - Rank: 2 - Configured Memory Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - Memory Technology: DRAM - Memory Operating Mode Capability: Volatile memory - Firmware Version: 0000 - Module Manufacturer ID: Bank 1, Hex 0xCE - Module Product ID: Unknown - Memory Subsystem Controller Manufacturer ID: Unknown - Memory Subsystem Controller Product ID: Unknown - Non-Volatile Size: None - Volatile Size: 16 GB - Cache Size: None - Logical Size: None - -Handle 0x0038, DMI type 17, 92 bytes -Memory Device - Array Handle: 0x0033 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P1-DIMMC1 - Bank Locator: P0_Node0_Channel2_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: Samsung - Serial Number: H0MK0001304705C59E - Asset Tag: P1-DIMMC1_AssetTag (date:21/30) - Part Number: M393A2K43DB3-CWE - Rank: 2 - Configured Memory Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - Memory Technology: DRAM - Memory Operating Mode Capability: Volatile memory - Firmware Version: 0000 - Module Manufacturer ID: Bank 1, Hex 0xCE - Module Product ID: Unknown - Memory Subsystem Controller Manufacturer ID: Unknown - Memory Subsystem Controller Product ID: Unknown - Non-Volatile Size: None - Volatile Size: 16 GB - Cache Size: None - Logical Size: None - -Handle 0x003A, DMI type 17, 92 bytes -Memory Device - Array Handle: 0x0033 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P1-DIMMD1 - Bank Locator: P0_Node0_Channel3_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: Samsung - Serial Number: H0MK0001304705D12D - Asset Tag: P1-DIMMD1_AssetTag (date:21/30) - Part Number: M393A2K43DB3-CWE - Rank: 2 - Configured Memory Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - Memory Technology: DRAM - Memory Operating Mode Capability: Volatile memory - Firmware Version: 0000 - Module Manufacturer ID: Bank 1, Hex 0xCE - Module Product ID: Unknown - Memory Subsystem Controller Manufacturer ID: Unknown - Memory Subsystem Controller Product ID: Unknown - Non-Volatile Size: None - Volatile Size: 16 GB - Cache Size: None - Logical Size: None - -Handle 0x003C, DMI type 17, 92 bytes -Memory Device - Array Handle: 0x0033 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P1-DIMME1 - Bank Locator: P0_Node1_Channel0_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: Samsung - Serial Number: H0MK0001304705C69C - Asset Tag: P1-DIMME1_AssetTag (date:21/30) - Part Number: M393A2K43DB3-CWE - Rank: 2 - Configured Memory Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - Memory Technology: DRAM - Memory Operating Mode Capability: Volatile memory - Firmware Version: 0000 - Module Manufacturer ID: Bank 1, Hex 0xCE - Module Product ID: Unknown - Memory Subsystem Controller Manufacturer ID: Unknown - Memory Subsystem Controller Product ID: Unknown - Non-Volatile Size: None - Volatile Size: 16 GB - Cache Size: None - Logical Size: None - -Handle 0x003E, DMI type 17, 92 bytes -Memory Device - Array Handle: 0x0033 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P1-DIMMF1 - Bank Locator: P0_Node1_Channel1_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: Samsung - Serial Number: H0MK0001304705C33A - Asset Tag: P1-DIMMF1_AssetTag (date:21/30) - Part Number: M393A2K43DB3-CWE - Rank: 2 - Configured Memory Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - Memory Technology: DRAM - Memory Operating Mode Capability: Volatile memory - Firmware Version: 0000 - Module Manufacturer ID: Bank 1, Hex 0xCE - Module Product ID: Unknown - Memory Subsystem Controller Manufacturer ID: Unknown - Memory Subsystem Controller Product ID: Unknown - Non-Volatile Size: None - Volatile Size: 16 GB - Cache Size: None - Logical Size: None - -Handle 0x0040, DMI type 17, 92 bytes -Memory Device - Array Handle: 0x0033 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P1-DIMMG1 - Bank Locator: P0_Node1_Channel2_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: Samsung - Serial Number: H0MK0001304705C59F - Asset Tag: P1-DIMMG1_AssetTag (date:21/30) - Part Number: M393A2K43DB3-CWE - Rank: 2 - Configured Memory Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - Memory Technology: DRAM - Memory Operating Mode Capability: Volatile memory - Firmware Version: 0000 - Module Manufacturer ID: Bank 1, Hex 0xCE - Module Product ID: Unknown - Memory Subsystem Controller Manufacturer ID: Unknown - Memory Subsystem Controller Product ID: Unknown - Non-Volatile Size: None - Volatile Size: 16 GB - Cache Size: None - Logical Size: None - -Handle 0x0042, DMI type 17, 92 bytes -Memory Device - Array Handle: 0x0033 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P1-DIMMH1 - Bank Locator: P0_Node1_Channel3_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: Samsung - Serial Number: H0MK0001304705CA16 - Asset Tag: P1-DIMMH1_AssetTag (date:21/30) - Part Number: M393A2K43DB3-CWE - Rank: 2 - Configured Memory Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - Memory Technology: DRAM - Memory Operating Mode Capability: Volatile memory - Firmware Version: 0000 - Module Manufacturer ID: Bank 1, Hex 0xCE - Module Product ID: Unknown - Memory Subsystem Controller Manufacturer ID: Unknown - Memory Subsystem Controller Product ID: Unknown - Non-Volatile Size: None - Volatile Size: 16 GB - Cache Size: None - Logical Size: None - -Handle 0x0044, DMI type 17, 92 bytes -Memory Device - Array Handle: 0x0033 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P2-DIMMA1 - Bank Locator: P1_Node0_Channel0_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: Samsung - Serial Number: H0MK0001304705CBFE - Asset Tag: P2-DIMMA1_AssetTag (date:21/30) - Part Number: M393A2K43DB3-CWE - Rank: 2 - Configured Memory Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - Memory Technology: DRAM - Memory Operating Mode Capability: Volatile memory - Firmware Version: 0000 - Module Manufacturer ID: Bank 1, Hex 0xCE - Module Product ID: Unknown - Memory Subsystem Controller Manufacturer ID: Unknown - Memory Subsystem Controller Product ID: Unknown - Non-Volatile Size: None - Volatile Size: 16 GB - Cache Size: None - Logical Size: None - -Handle 0x0046, DMI type 17, 92 bytes -Memory Device - Array Handle: 0x0033 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P2-DIMMB1 - Bank Locator: P1_Node0_Channel1_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: Samsung - Serial Number: H0MK0001304705CFC8 - Asset Tag: P2-DIMMB1_AssetTag (date:21/30) - Part Number: M393A2K43DB3-CWE - Rank: 2 - Configured Memory Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - Memory Technology: DRAM - Memory Operating Mode Capability: Volatile memory - Firmware Version: 0000 - Module Manufacturer ID: Bank 1, Hex 0xCE - Module Product ID: Unknown - Memory Subsystem Controller Manufacturer ID: Unknown - Memory Subsystem Controller Product ID: Unknown - Non-Volatile Size: None - Volatile Size: 16 GB - Cache Size: None - Logical Size: None - -Handle 0x0048, DMI type 17, 92 bytes -Memory Device - Array Handle: 0x0033 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P2-DIMMC1 - Bank Locator: P1_Node0_Channel2_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: Samsung - Serial Number: H0MK0001304705CC02 - Asset Tag: P2-DIMMC1_AssetTag (date:21/30) - Part Number: M393A2K43DB3-CWE - Rank: 2 - Configured Memory Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - Memory Technology: DRAM - Memory Operating Mode Capability: Volatile memory - Firmware Version: 0000 - Module Manufacturer ID: Bank 1, Hex 0xCE - Module Product ID: Unknown - Memory Subsystem Controller Manufacturer ID: Unknown - Memory Subsystem Controller Product ID: Unknown - Non-Volatile Size: None - Volatile Size: 16 GB - Cache Size: None - Logical Size: None - -Handle 0x004A, DMI type 17, 92 bytes -Memory Device - Array Handle: 0x0033 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P2-DIMMD1 - Bank Locator: P1_Node0_Channel3_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: Samsung - Serial Number: H0MK0001304705CB5A - Asset Tag: P2-DIMMD1_AssetTag (date:21/30) - Part Number: M393A2K43DB3-CWE - Rank: 2 - Configured Memory Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - Memory Technology: DRAM - Memory Operating Mode Capability: Volatile memory - Firmware Version: 0000 - Module Manufacturer ID: Bank 1, Hex 0xCE - Module Product ID: Unknown - Memory Subsystem Controller Manufacturer ID: Unknown - Memory Subsystem Controller Product ID: Unknown - Non-Volatile Size: None - Volatile Size: 16 GB - Cache Size: None - Logical Size: None - -Handle 0x004C, DMI type 17, 92 bytes -Memory Device - Array Handle: 0x0033 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P2-DIMME1 - Bank Locator: P1_Node1_Channel0_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: Samsung - Serial Number: H0MK0001304705CB30 - Asset Tag: P2-DIMME1_AssetTag (date:21/30) - Part Number: M393A2K43DB3-CWE - Rank: 2 - Configured Memory Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - Memory Technology: DRAM - Memory Operating Mode Capability: Volatile memory - Firmware Version: 0000 - Module Manufacturer ID: Bank 1, Hex 0xCE - Module Product ID: Unknown - Memory Subsystem Controller Manufacturer ID: Unknown - Memory Subsystem Controller Product ID: Unknown - Non-Volatile Size: None - Volatile Size: 16 GB - Cache Size: None - Logical Size: None - -Handle 0x004E, DMI type 17, 92 bytes -Memory Device - Array Handle: 0x0033 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P2-DIMMF1 - Bank Locator: P1_Node1_Channel1_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: Samsung - Serial Number: H0MK0001304705CB87 - Asset Tag: P2-DIMMF1_AssetTag (date:21/30) - Part Number: M393A2K43DB3-CWE - Rank: 2 - Configured Memory Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - Memory Technology: DRAM - Memory Operating Mode Capability: Volatile memory - Firmware Version: 0000 - Module Manufacturer ID: Bank 1, Hex 0xCE - Module Product ID: Unknown - Memory Subsystem Controller Manufacturer ID: Unknown - Memory Subsystem Controller Product ID: Unknown - Non-Volatile Size: None - Volatile Size: 16 GB - Cache Size: None - Logical Size: None - -Handle 0x0050, DMI type 17, 92 bytes -Memory Device - Array Handle: 0x0033 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P2-DIMMG1 - Bank Locator: P1_Node1_Channel2_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: Samsung - Serial Number: H0MK0001304705CB08 - Asset Tag: P2-DIMMG1_AssetTag (date:21/30) - Part Number: M393A2K43DB3-CWE - Rank: 2 - Configured Memory Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - Memory Technology: DRAM - Memory Operating Mode Capability: Volatile memory - Firmware Version: 0000 - Module Manufacturer ID: Bank 1, Hex 0xCE - Module Product ID: Unknown - Memory Subsystem Controller Manufacturer ID: Unknown - Memory Subsystem Controller Product ID: Unknown - Non-Volatile Size: None - Volatile Size: 16 GB - Cache Size: None - Logical Size: None - -Handle 0x0052, DMI type 17, 92 bytes -Memory Device - Array Handle: 0x0033 - Error Information Handle: Not Provided - Total Width: 72 bits - Data Width: 64 bits - Size: 16384 MB - Form Factor: DIMM - Set: None - Locator: P2-DIMMH1 - Bank Locator: P1_Node1_Channel3_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: Samsung - Serial Number: H0MK0001304705CC01 - Asset Tag: P2-DIMMH1_AssetTag (date:21/30) - Part Number: M393A2K43DB3-CWE - Rank: 2 - Configured Memory Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - Memory Technology: DRAM - Memory Operating Mode Capability: Volatile memory - Firmware Version: 0000 - Module Manufacturer ID: Bank 1, Hex 0xCE - Module Product ID: Unknown - Memory Subsystem Controller Manufacturer ID: Unknown - Memory Subsystem Controller Product ID: Unknown - Non-Volatile Size: None - Volatile Size: 16 GB - Cache Size: None - Logical Size: None -``` - -## Xeon ICX Server BIOS Configuration - -### Boot Feature - -``` - | |Enables or disables Quiet | - | Quiet Boot [Enabled] |Boot option | - | | | - | Option ROM Messages [Force BIOS] | | - | Bootup NumLock State [On] | | - | Wait For "F1" If Error [Disabled] | | - | INT19 Trap Response [Immediate] | | - | Re-try Boot [Disabled] | | - | | | - | Power Configuration | | - | | | - | Watch Dog Function [Disabled] | | - | Restore on AC Power Loss [Last State] | | - | Power Button Function [Instant Off] | | - | Deep Sleep Mode [Disabled] | | -``` - -### CPU Configuration - -``` - | Processor Configuration ^|Enables Hyper Threading | - | -------------------------------------------------- *|(Software Method to | - | Processor BSP Revision 606A6 - ICX D2 *|Enable/Disable Logical | - | Processor Socket CPU1 CPU2 *|Processor threads. | - | Processor ID 000606A6* | 000606A6 *| | - | Processor Frequency 2.600GHz | 2.600GHz *| | - | Processor Max Ratio 1AH | 1AH *| | - | Processor Min Ratio 08H | 08H *| | - | Microcode Revision 0D000280 | 0D000280 *| | - | L1 Cache RAM(Per Core) 80KB | 80KB *| | - | L2 Cache RAM(Per Core) 1280KB | 1280KB *| | - | L3 Cache RAM(Per Package) 49152KB | 49152KB *| | - | Processor 0 Version Intel(R) Xeon(R) *| | - | Platinum 8358 CPU @ *| | - | 2.60GHz *| | - | Processor 1 Version Intel(R) Xeon(R) *| | - | Platinum 8358 CPU @ *| | - | 2.60GHz *| | - | +| | - |> CPU1 Core Disable Bitmap +| | - |> CPU2 Core Disable Bitmap +|-----------------------------| - | Hyper-Threading [ALL] [Enable] +|><: Select Screen | - | Hardware Prefetcher [Enable] +|^v: Select Item | - | Adjacent Cache Prefetch [Enable] +|Enter: Select | - | DCU Streamer Prefetcher [Enable] +|+/-: Change Opt. | - | DCU IP Prefetcher [Enable] +|F1: General Help | - | LLC Prefetch [Enable] +|F2: Previous Values | - | Extended APIC [Disable] +|F3: Optimized Defaults | - | VMX [Enable] v|F4: Save & Exit | - | Enable SMX [Disable] +| | - | PPIN Control [Unlock/Enable] *| | - | AES-NI [Enable] *| | - | -------------------------------------------------- *| | - | TME, TME-MT, TDX *| | - | -------------------------------------------------- *| | - | Total Memory Encryption (TME) [Disabled] *| | - | -------------------------------------------------- *|-----------------------------| - | Software Guard Extension (SGX) *|><: Select Screen | - | -------------------------------------------------- *|^v: Select Item | - | SGX Factory Reset [Disabled] *|Enter: Select | - | SW Guard Extensions (SGX) [Disabled] *|+/-: Change Opt. | - | SGX Package Info In-Band Access [Disabled] *|F1: General Help | - | -------------------------------------------------- *|F2: Previous Values | - | Limit CPU PA to 46 Bits [Enable] *|F3: Optimized Defaults | - |> Advanced Power Management Configuration v|F4: Save & Exit | -``` - -#### Advanced Power Management Configuration - -``` - | Advanced Power Management Configuration |Enable processor power | - | -------------------------------------------------- |management features. | - | Power Technology [Custom] | | - | Power Performance Tuning [BIOS Controls EPB] | | - | ENERGY_PERF_BIAS_CFG Mode [Maximum Performance] | | -``` - -##### CPU P State Control - -``` - | CPU P State Control |EIST allows the processor | - | |to dynamically adjust | - | SpeedStep (P-States) [Disable] |frequency and voltage based | - | Activate SST-BF [Disable] |on power versus performance | - | Configure SST-BF [Enable] |needs. | - | EIST PSD Function [HW_ALL] | | -``` - -##### Hardware PM State Control - -``` - | Hardware PM State Control |If set to Disable, hardware ^| - | |will choose a P-state *| - | Hardware P-States [Disable] |setting for the system *| - | |based on an OS request. *| - - | Frequency Prioritization |This knob controls whether | - | |RAPL balancer is enabled. | - | RAPL Prioritization [Disable] |When enabled it activates | -``` - -##### CPU C State Control - -``` - | CPU C State Control |Allows Monitor and MWAIT | - | |instructions. | - | Enable Monitor MWAIT [Enable] | | - | CPU C6 Report [Disable] | | - | Enhanced Halt State (C1E) [Disable] | | -``` - -##### Package C State Control - -``` - | Package C State Control |Limit the lowest package | - | |level C-State to | - | Package C State [C0/C1 state] |processors. Lower package | -``` - -##### CPU T State Control - -``` - | CPU T State Control |Enable/Disable CPU | - | |throttling by OS. | - | Software Controlled T-States [Disable] |Throttling reduces power | -``` - -##### UPI Configuration - -``` - | Uncore Configuration |Choose Topology Precedence | - | -------------------------------------------------- |to degrade features if | - | Number of CPU 2 |system options are in | - | Number of IIO 2 |conflict or choose Feature | - | Current UPI Link Speed Fast |Precedence to degrade | - | Current UPI Link Frequency 11.2 GT/s |topology if system options | - | Global MMIO Low Base / Limit 90000000 / FBFFFFFF |are in conflict. | - | Global MMIO High Base / Limit 0000200000000000 / | | - | 0000204FFFFFFFFF | | - | Pci-e Configuration Base / Size 80000000 / 10000000 | | - | Degrade Precedence [Topology Precedence] | | - | Link L0p Enable [Disable] | | - | Link L1 Enable [Disable] | | - | XPT Remote Prefetch [Auto] | | - | KTI Prefetch [Auto] |-----------------------------| - | Local/Remote Threshold [Auto] |><: Select Screen | - | IO Directory Cache (IODC) [Auto] |^v: Select Item | - | SNC (Sub NUMA) [Disable] |Enter: Select | - | XPT Prefetch [Auto] |+/-: Change Opt. | - | Snoop Throttle Configuration [Auto] |F1: General Help | - | PCIe Remote P2P Relaxed Ordering [Disable] |F2: Previous Values | - | Stale AtoS [Auto] |F3: Optimized Defaults | - | LLC Dead Line Alloc [Enable] |F4: Save & Exit | -``` - -##### Memory Configuration - -``` - | |Set Enable or Disable | - | -------------------------------------------------- |STEP(Samsung TestBIOS & | - | Integrated Memory Controller (iMC) |Enhanced PPR)function | - | -------------------------------------------------- | | - | | | - | STEP DRAM Test [Disable] | | - | Operation Mode [Test and Repair] | | - | Enforce POR [POR] | | - | PPR Type [Hard PPR] | | - | Memory Frequency [Auto] | | - | Data Scrambling for DDR4 [Enable] | | - | 2x Refresh Enable [Auto] | | -``` - -##### IIO Configuration - -``` - | IIO Configuration |Press <Enter> to bring up | - | -------------------------------------------------- |the Intel. Virtualization | - | |for Directed I/O (VT-d) | - |> CPU1 Configuration |Configuration menu. | - |> CPU2 Configuration | | - |> IOAT Configuration | | - |> Intel. VT for Directed I/O (VT-d) | | - |> Intel. VMD Technology | | - | PCI-E ASPM Support (Global) [Disable] | | - | IIO eDPC Support [Disable] | | -``` - -##### CPU1 Configuration - -``` - | IOU0 (IIO PCIe Port 1) [Auto] |Selects PCIe port | - | IOU1 (IIO PCIe Port 2) [Auto] |Bifurcation for selected | - | IOU3 (IIO PCIe Port 4) [Auto] |slot(s) | - | IOU4 (IIO PCIe Port 5) [Auto] | | -``` - -##### CPU2 Configuration - -``` - | IOU0 (IIO PCIe Port 1) [Auto] |Selects PCIe port | - | IOU1 (IIO PCIe Port 2) [Auto] |Bifurcation for selected | - | IOU3 (IIO PCIe Port 4) [Auto] |slot(s) | - | IOU4 (IIO PCIe Port 5) [Auto] | | -``` - -#### South Bridge - -``` - | USB Module Version 26 |AUTO option disables legacy | - | |support if no USB devices | - | USB Devices: |are connected. DISABLE | - | 1 Drive, 2 Keyboards, 2 Mice, 1 Hub |option will keep USB | - | |devices available only for | - | Legacy USB Support [Enabled] |EFI applications. | - | XHCI Hand-off [Enabled] | | - | Port 60/64 Emulation [Disabled] | | - | PCIe PLL SSC [Disabled] | | - | Port 61h Bit-4 Emulation [Disabled] | | -``` - -### PCIe/PCI/PnP Configuration - -``` - | PCI Bus Driver Version A5.01.24 ^|Enables or Disables 64bit | - | *|capable Devices to be | - | PCI Devices Common Settings: *|Decoded in Above 4G Address | - | Above 4G Decoding [Enabled] *|Space (Only if System | - | SR-IOV Support [Enabled] *|Supports 64 bit PCI | - | ARI Support [Enabled] *|Decoding). | - | Bus Master Enable [Enabled] *| | - | Consistent Device Name Support [Disabled] *| | - | MMIO High Base [32T] *| | - | MMIO High Granularity Size [64G] *| | - | Maximum Read Request [Auto] *| | - | MMCFG Base [Auto] *| | - | NVMe Firmware Source [Vendor Defined *| | - | Firmware] *| | - | VGA Priority [Onboard] *| | - | CPU1 SLOT2 PCI-E 3.0 X16 OPROM [EFI] *| | - | CPU1 SLOT4 PCI-E 3.0 X16 OPROM [EFI] *| | - | CPU2 SLOT6 PCI-E 3.0 X16 OPROM [EFI] *| | - | CPU2 SLOT8 PCI-E 3.0 X16 OPROM [EFI] *|-----------------------------| - | CPU1 SLOT9 PCI-E 3.0 X16 OPROM [EFI] *|><: Select Screen | - | CPU2 SLOT10 PCI-E 3.0 X16 OPROM [EFI] *|^v: Select Item | - | CPU2 SLOT11 PCI-E 3.0 X4(IN X8) OPROM [EFI] *|Enter: Select | - | M.2 CONNECTOR OPROM [EFI] *|+/-: Change Opt. | - | Bus Master Enable [Enabled] +|F1: General Help | - | Onboard LAN1 Option ROM [EFI] +|F2: Previous Values | - | Onboard LAN2 Option ROM [Disabled] +|F3: Optimized Defaults | - | Onboard Video Option ROM [EFI] v|F4: Save & Exit | - |> Network Stack Configuration | | -``` - -## Xeon ICX Server Firmware Inventory - -``` -Host. IPMI IP. BMC. BIOS. CPLD. CPU Microcode. PCI Bus. X710 Firmware. i40e. E810 Firmware. ice. -s65-t37-sut1. 10.30.50.75. 1.00.21. 1.1. F1.00.07. 0D000280. A5.01.24. 8.30 0x8000a49d 1.2926.0. 2.17.15. 3.20 0x8000d83e 1.3146.0. 1.8.3. -s66-t37-sut2. 10.30.50.76. 1.00.21. 1.1. F1.00.07. 0D000280. A5.01.24. 8.30 0x8000a49d 1.2926.0. 2.14.15. 3.20 0x8000d83e 1.3146.0. 1.8.3. -s67-t37-tg1. 10.30.50.77. 1.00.21. 1.1. F1.00.07. 0D000280. A5.01.24. 8.30 0x8000a49d 1.2926.0. 2.14.13. 3.20 0x8000d83e 1.3146.0. 1.8.3. -s78-t38-sut1. 10.30.50.78. 1.00.21. 1.1. F1.00.07. 0D000280. A5.01.24. 8.30 0x8000a49d 1.2926.0. 2.17.15. 3.20 0x8000d83e 1.3146.0. 1.8.3. -s79-t38-sut2. 10.30.50.79. 1.00.21. 1.1. F1.00.07. 0D000280. A5.01.24. 8.30 0x8000a49d 1.2926.0. 2.14.15. 3.20 0x8000d83e 1.3146.0. 1.8.3. -s80-t38-tg1. 10.30.50.80. 1.00.21. 1.1. F1.00.07. 0D000280. A5.01.24. 8.30 0x8000a49d 1.2926.0. 2.14.13. 3.20 0x8000d83e 1.3146.0. 1.8.3. -s71-t212-sut1. 10.30.50.81. 1.00.21. 1.1. F1.00.07. 0D000280. A5.01.24. 8.30 0x8000a49d 1.2926.0. 2.17.15. 3.20 0x8000d83e 1.3146.0. 1.8.3. -s72-t212-tg1. 10.30.50.82. 1.00.21. 1.1. F1.00.07. 0D000280. A5.01.24. 8.30 0x8000a49d 1.2926.0. 2.14.13. 3.20 0x8000d83e 1.3146.0. 1.8.3. -s83-t213-sut1. 10.30.50.83. 1.00.21. 1.1. F1.00.07. 0D000280. A5.01.24. 8.30 0x8000a49d 1.2926.0. 2.17.15. 3.20 0x8000d83e 1.3146.0. 1.8.3. -s84-t213-tg1. 10.30.50.84. 1.00.21. 1.1. F1.00.07. 0D000280. A5.01.24. 8.30 0x8000a49d 1.2926.0. 2.14.13. 3.20 0x8000d83e 1.3146.0. 1.8.3. -s85-t214-sut1. 10.30.50.85. 1.00.21. 1.1. F1.00.07. 0D000280. A5.01.24. 8.30 0x8000a49d 1.2926.0. 2.17.15. 3.20 0x8000d83e 1.3146.0. 1.8.3. -s86-t214-tg1. 10.30.50.86. 1.00.21. 1.1. F1.00.07. 0D000280. A5.01.24. 8.30 0x8000a49d 1.2926.0. 2.14.13. 3.20 0x8000d83e 1.3146.0. 1.8.3. -s87-t215-sut1. 10.30.50.87. 1.00.21. 1.1. F1.00.07. 0D000280. A5.01.24. 8.30 0x8000a49d 1.2926.0. 2.17.15. 3.20 0x8000d83e 1.3146.0. 1.8.3. -s88-t215-tg1. 10.30.50.88. 1.00.21. 1.1. F1.00.07. 0D000280. A5.01.24. 8.30 0x8000a49d 1.2926.0. 2.14.13. 3.20 0x8000d83e 1.3146.0. 1.8.3. -``` diff --git a/docs/lab/testbeds_sm_skx_hw_bios_cfg.md b/docs/lab/testbeds_sm_skx_hw_bios_cfg.md deleted file mode 100644 index b00ba370b6..0000000000 --- a/docs/lab/testbeds_sm_skx_hw_bios_cfg.md +++ /dev/null @@ -1,578 +0,0 @@ -# SuperMicro Skylake Servers - HW and BIOS Configuration - -1. [Linux lscpu](#linux-lscpu) -1. [Linux dmidecode](#dmidecode) -1. [Xeon Skx Server BIOS Configuration](#xeon-skx-server-bios-configuration) - 1. [Boot Feature](#boot-feature) - 1. [CPU Configuration](#cpu-configuration) - 1. [Advanced Power Management Configuration](#advanced-power-management-configuration) - 1. [CPU P State Control](#cpu-p-state-control) - 1. [Hardware PM State Control](#hardware-pm-state-control) - 1. [CPU C State Control](#cpu-c-state-control) - 1. [Package C State Control](#package-c-state-control) - 1. [CPU T State Control](#cpu-t-state-control) - 1. [Chipset Configuration](#chipset-configuration) - 1. [North Bridge](#north-bridge) - 1. [UPI Configuration](#upi-configuration) - 1. [Memory Configuration](#memory-configuration) - 1. [IIO Configuration](#iio-configuration) - 1. [CPU1 Configuration](#cpu1-configuration) - 1. [CPU2 Configuration](#cpu2-configuration) - 1. [South Bridge](#south-bridge) - 1. [PCIe/PCI/PnP Configuration](#pciepcipnp-configuration) - 1. [ACPI Settings](#acpi-settings) -1. [Xeon Skx Server Firmware Inventory](#xeon-skx-server-firmware-inventory) - -## Linux lscpu - -``` -$ lscpu -Architecture: x86_64 -CPU op-mode(s): 32-bit, 64-bit -Byte Order: Little Endian -CPU(s): 112 -On-line CPU(s) list: 0-111 -Thread(s) per core: 2 -Core(s) per socket: 28 -Socket(s): 2 -NUMA node(s): 2 -Vendor ID: GenuineIntel -CPU family: 6 -Model: 85 -Model name: Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz -Stepping: 4 -CPU MHz: 2500.550 -BogoMIPS: 5000.00 -Virtualization: VT-x -L1d cache: 32K -L1i cache: 32K -L2 cache: 1024K -L3 cache: 39424K -NUMA node0 CPU(s): 0-27,56-83 -NUMA node1 CPU(s): 28-55,84-111 -Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca -cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx -pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology -nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 -ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt -tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch -cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti ssbd mba ibrs ibpb stibp -tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjustbmi1 hle avx2 smep bmi2 -erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb -intel_pt avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves cqm_llc -cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts pku ospke -md_clear flush_l1d -``` - -### Linux dmidecode - -``` - $ dmidecode - # dmidecode 3.1 - Getting SMBIOS data from sysfs. - SMBIOS 3.2.1 present. - Table at 0x6F388000. - - Handle 0x0000, DMI type 0, 26 bytes - BIOS Information - Vendor: American Megatrends Inc. - Version: 3.2 - Release Date: 10/18/2019 - Address: 0xF0000 - Runtime Size: 64 kB - ROM Size: 64 MB - Characteristics: - PCI is supported - BIOS is upgradeable - BIOS shadowing is allowed - Boot from CD is supported - Selectable boot is supported - BIOS ROM is socketed - EDD is supported - 5.25"/1.2 MB floppy services are supported (int 13h) - 3.5"/720 kB floppy services are supported (int 13h) - 3.5"/2.88 MB floppy services are supported (int 13h) - Print screen service is supported (int 5h) - Serial services are supported (int 14h) - Printer services are supported (int 17h) - ACPI is supported - USB legacy is supported - BIOS boot specification is supported - Targeted content distribution is supported - UEFI is supported - BIOS Revision: 5.14 - - Handle 0x0001, DMI type 1, 27 bytes - System Information - Manufacturer: Supermicro - Product Name: SYS-7049GP-TRT - Version: 0123456789 - Serial Number: S291427X8332242 - UUID: 00000000-0000-0000-0000-AC1F6B8A8DB6 - Wake-up Type: Power Switch - SKU Number: To be filled by O.E.M. - Family: To be filled by O.E.M. - - Handle 0x0002, DMI type 2, 15 bytes - Base Board Information - Manufacturer: Supermicro - Product Name: X11DPG-QT - Version: 1.02 - Serial Number: VM183S014930 - Asset Tag: To be filled by O.E.M. - Features: - Board is a hosting board - Board is replaceable - Location In Chassis: To be filled by O.E.M. - Chassis Handle: 0x0003 - Type: Motherboard - Contained Object Handles: 0 - - Handle 0x0003, DMI type 3, 22 bytes - Chassis Information - Manufacturer: Supermicro - Type: Other - Lock: Not Present - Version: 0123456789 - Serial Number: C7470KH06A20167 - Asset Tag: To be filled by O.E.M. - Boot-up State: Safe - Power Supply State: Safe - Thermal State: Safe - Security Status: None - OEM Information: 0x00000000 - - Handle 0x0050, DMI type 4, 48 bytes - Processor Information - Socket Designation: CPU1 - Type: Central Processor - Family: Xeon - Manufacturer: Intel(R) Corporation - ID: 54 06 05 00 FF FB EB BF - Signature: Type 0, Family 6, Model 85, Stepping 4 - Flags: - FPU (Floating-point unit on-chip) - VME (Virtual mode extension) - DE (Debugging extension) - PSE (Page size extension) - TSC (Time stamp counter) - MSR (Model specific registers) - PAE (Physical address extension) - MCE (Machine check exception) - CX8 (CMPXCHG8 instruction supported) - APIC (On-chip APIC hardware supported) - SEP (Fast system call) - MTRR (Memory type range registers) - PGE (Page global enable) - MCA (Machine check architecture) - CMOV (Conditional move instruction supported) - PAT (Page attribute table) - PSE-36 (36-bit page size extension) - CLFSH (CLFLUSH instruction supported) - DS (Debug store) - ACPI (ACPI supported) - MMX (MMX technology supported) - FXSR (FXSAVE and FXSTOR instructions supported) - SSE (Streaming SIMD extensions) - SSE2 (Streaming SIMD extensions 2) - SS (Self-snoop) - HTT (Multi-threading) - TM (Thermal monitor supported) - PBE (Pending break enabled) - Version: Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz - Voltage: 1.6 V - External Clock: 100 MHz - Max Speed: 4000 MHz - Current Speed: 2500 MHz - Status: Populated, Enabled - Upgrade: Other - L1 Cache Handle: 0x004D - L2 Cache Handle: 0x004E - L3 Cache Handle: 0x004F - Serial Number: Not Specified - Asset Tag: UNKNOWN - Part Number: Not Specified - Core Count: 28 - Core Enabled: 28 - Thread Count: 56 - Characteristics: - 64-bit capable - Multi-Core - Hardware Thread - Execute Protection - Enhanced Virtualization - Power/Performance Control - - - Handle 0x0054, DMI type 4, 48 bytes - Processor Information - Socket Designation: CPU2 - Type: Central Processor - Family: Xeon - Manufacturer: Intel(R) Corporation - ID: 54 06 05 00 FF FB EB BF - Signature: Type 0, Family 6, Model 85, Stepping 4 - Flags: - FPU (Floating-point unit on-chip) - VME (Virtual mode extension) - DE (Debugging extension) - PSE (Page size extension) - TSC (Time stamp counter) - MSR (Model specific registers) - PAE (Physical address extension) - MCE (Machine check exception) - CX8 (CMPXCHG8 instruction supported) - APIC (On-chip APIC hardware supported) - SEP (Fast system call) - MTRR (Memory type range registers) - PGE (Page global enable) - MCA (Machine check architecture) - CMOV (Conditional move instruction supported) - PAT (Page attribute table) - PSE-36 (36-bit page size extension) - CLFSH (CLFLUSH instruction supported) - DS (Debug store) - ACPI (ACPI supported) - MMX (MMX technology supported) - FXSR (FXSAVE and FXSTOR instructions supported) - SSE (Streaming SIMD extensions) - SSE2 (Streaming SIMD extensions 2) - SS (Self-snoop) - HTT (Multi-threading) - TM (Thermal monitor supported) - PBE (Pending break enabled) - Version: Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz - Voltage: 1.6 V - External Clock: 100 MHz - Max Speed: 4000 MHz - Current Speed: 2500 MHz - Status: Populated, Enabled - Upgrade: Other - L1 Cache Handle: 0x0051 - L2 Cache Handle: 0x0052 - L3 Cache Handle: 0x0053 - Serial Number: Not Specified - Asset Tag: UNKNOWN - Part Number: Not Specified - Core Count: 28 - Core Enabled: 28 - Thread Count: 56 - Characteristics: - 64-bit capable - Multi-Core - Hardware Thread - Execute Protection - Enhanced Virtualization - Power/Performance Control -``` - -## Xeon Skx Server BIOS Configuration - -### Boot Feature - -``` - | Quiet Boot [Enabled] |Boot option | - | | | - | Option ROM Messages [Force BIOS] | | - | Bootup NumLock State [On] | | - | Wait For "F1" If Error [Enabled] | | - | INT19 Trap Response [Immediate] | | - | Re-try Boot [Disabled] | | - | Install Windows 7 USB support [Disabled] | | - | Port 61h Bit-4 Emulation [Disabled] | | - | | | - | Power Configuration | | - | Watch Dog Function [Disabled] | | - | Restore on AC Power Loss [Last State] | | - | Power Button Function [Instant Off] | | - | Throttle on Power Fail [Disabled] | | -``` - -### CPU Configuration - -``` - | Processor Configuration |Enables Hyper Threading | - | -------------------------------------------------- |(Software Method to | - | Processor BSP Revision 50654 - SKX H0 |Enable/Disable Logical | - | Processor Socket CPU1 | CPU2 |Processor threads. | - | Processor ID 00050654* | 000506... | | - | Processor Frequency 2.500GHz | 2.500GHz | | - | Processor Max Ratio 19H | 19H | | - | Processor Min Ratio 0AH | 0AH | | - | Microcode Revision 02000054 | 02000054 | | - | L1 Cache RAM 64KB | 64KB | | - | L2 Cache RAM 1024KB | 1024KB | | - | L3 Cache RAM 39424KB | 39424KB | | - | Processor 0 Version | | - | Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz | | - | Processor 1 Version | | - | Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz | | - | | | - | Hyper-Threading [ALL] [Enable] | | - | Core Enabled 0 | | - | Monitor/Mwait [Auto] | | - | Execute Disable Bit [Enable] | | - | Intel Virtualization Technology [Enable] | | - | PPIN Control [Unlock/Enable] | | - | Hardware Prefetcher [Enable] | | - | Adjacent Cache Prefetch [Enable] | | - | DCU Streamer Prefetcher [Enable] | | - | DCU IP Prefetcher [Enable] | | - | LLC Prefetch [Disable] | | - | Extended APIC [Disable] | | - | AES-NI [Enable] | | - |> Advanced Power Management Configuration | | -``` - -#### Advanced Power Management Configuration - -``` - | Advanced Power Management Configuration |Switch CPU Power Management | - | -------------------------------------------------- |profile | - | Power Technology [Custom] | | - | Power Performance Tuning [BIOS Controls EPB] | | - | ENERGY_PERF_BIAS_CFG mode [Maximum Performance] | | - |> CPU P State Control | | - |> Hardware PM State Control | | - |> CPU C State Control | | - |> Package C State Control | | - |> CPU T State Control | | -``` - -##### CPU P State Control - -``` - | CPU P State Control |Enable/Disable EIST | - | |(P-States) | - | SpeedStep (Pstates) [Disable] | | - | EIST PSD Function [HW_ALL] | | -``` - -##### Hardware PM State Control - -``` - | Hardware PM State Control |Disable: Hardware chooses a | - | |P-state based on OS Request | - | Hardware P-States [Disable] |(Legacy P-States) | - | |Native Mode:Hardware | - | |chooses a P-state based on | - | |OS guidance | - | |Out of Band Mode:Hardware | - | |autonomously chooses a | - | |P-state (no OS guidance) | -``` - -##### CPU C State Control - -``` - | CPU C State Control |Autonomous Core C-State | - | |Control | - | Autonomous Core C-State [Disable] | | - | CPU C6 report [Disable] | | - | Enhanced Halt State (C1E) [Disable] | | -``` - -##### Package C State Control - -``` - | Package C State Control |Package C State limit | - | | | - | Package C State [C0/C1 state] | | -``` - -##### CPU T State Control - -``` - | CPU T State Control |Enable/Disable Software | - | |Controlled T-States | - | Software Controlled T-States [Disable] | | -``` - -#### Chipset Configuration - -``` - | WARNING: Setting wrong values in below sections may cause |North Bridge Parameters | - | system to malfunction. | | - |> North Bridge | | - |> South Bridge | | -``` - -##### North Bridge - -``` - |> UPI Configuration |Displays and provides | - |> Memory Configuration |option to change the UPI | - |> IIO Configuration |Settings | -``` - -##### UPI Configuration - -``` - | UPI Configuration |Choose Topology Precedence | - | -------------------------------------------------- |to degrade features if | - | Number of CPU 2 |system options are in | - | Number of Active UPI Link 3 |conflict or choose Feature | - | Current UPI Link Speed Fast |Precedence to degrade | - | Current UPI Link Frequency 10.4 GT/s |topology if system options | - | UPI Global MMIO Low Base / Limit 90000000 / FBFFFFFF |are in conflict. | - | UPI Global MMIO High Base / Limit 0000000000000000 / ... | | - | UPI Pci-e Configuration Base / Size 80000000 / 10000000 | | - | Degrade Precedence [Topology Precedence] | | - | Link L0p Enable [Disable] | | - | Link L1 Enable [Disable] | | - | IO Directory Cache (IODC) [Auto] | | - | SNC [Disable] | | - | XPT Prefetch [Disable] | | - | KTI Prefetch [Enable] | | - | Local/Remote Threshold [Auto] | | - | Stale AtoS [Disable] | | - | LLC dead line alloc [Enable] | | - | Isoc Mode [Auto] | | -``` - -##### Memory Configuration - -``` - | |POR - Enforces Plan Of | - | -------------------------------------------------- |Record restrictions for | - | Integrated Memory Controller (iMC) |DDR4 frequency and voltage | - | -------------------------------------------------- |programming. Disable - | - | |Disables this feature. | - | Enforce POR [POR] | | - | PPR Type [Hard PPR] | | - | Enhanced PPR [Disable] | | - | Operation Mode [Test and Repair] | | - | Memory Frequency [2933] | | - | Data Scrambling for DDR4 [Auto] | | - | tCCD_L Relaxation [Auto] | | - | tRWSR Relaxation [Disable] | | - | tRFC Optimization for 16Gb Based DIMM [Force 550ns] | | - | 2x Refresh [Auto] | | - | Page Policy [Auto] | | - | IMC Interleaving [2-way Interleave] | | - |> Memory Topology | | - |> Memory RAS Configuration | | -``` - -##### IIO Configuration - -``` - | IIO Configuration |Expose IIO DFX devices and | - | -------------------------------------------------- |other CPU devices like PMON | - | | | - | EV DFX Features [Disable] | | - |> CPU1 Configuration | | - |> CPU2 Configuration | | - |> IOAT Configuration | | - |> Intel. VT for Directed I/O (VT-d) | | - |> Intel. VMD technology | | - | | | - | IIO-PCIE Express Global Options | | - | ======================================== | | - | PCI-E Completion Timeout Disable [No] | | -``` - -##### CPU1 Configuration - -``` - | IOU0 (IIO PCIe Br1) [Auto] |Selects PCIe port | - | IOU1 (IIO PCIe Br2) [Auto] |Bifurcation for selected | - | IOU2 (IIO PCIe Br3) [Auto] |slot(s) | - |> CPU1 SLOT2 PCI-E 3.0 X16 | | - |> CPU1 SLOT4 PCI-E 3.0 X16 | | - |> CPU1 SLOT9 PCI-E 3.0 X16 | | -``` - -##### CPU2 Configuration - -``` - | IOU0 (IIO PCIe Br1) [Auto] |Selects PCIe port | - | IOU1 (IIO PCIe Br2) [Auto] |Bifurcation for selected | - | IOU2 (IIO PCIe Br3) [Auto] |slot(s) | - |> CPU2 SLOT6 PCI-E 3.0 X16 | | - |> CPU2 SLOT8 PCI-E 3.0 X16 | | - |> CPU2 SLOT10 PCI-E 3.0 X16 | | -``` - -#### South Bridge - -``` - | |Enables Legacy USB support. | - | USB Module Version 21 |AUTO option disables legacy | - | |support if no USB devices | - | USB Devices: |are connected. DISABLE | - | 1 Keyboard, 1 Mouse, 1 Hub |option will keep USB | - | |devices available only for | - | Legacy USB Support [Enabled] |EFI applications. | - | XHCI Hand-off [Enabled] | | - | Port 60/64 Emulation [Enabled] | | - | PCIe PLL SSC [Disable] | | - | Real USB Wake Up [Enabled] | | - | Front USB Wake Up [Enabled] | | - | | | - | Azalia [Auto] | | - | Azalia PME Enable [Disabled] | | -``` - -### PCIe/PCI/PnP Configuration - -``` - | PCI Bus Driver Version A5.01.18 |Enables or Disables 64bit | - | |capable Devices to be | - | PCI Devices Common Settings: |Decoded in Above 4G Address | - | Above 4G Decoding [Enabled] |Space (Only if System | - | SR-IOV Support [Enabled] |Supports 64 bit PCI | - | ARI Support [Enabled] |Decoding). | - | MMIO High Base [56T] | | - | MMIO High Granularity Size [256G] | | - | Maximum Read Request [Auto] | | - | MMCFG Base [2G] | | - | NVMe Firmware Source [Vendor Defined Fi...] | | - | VGA Priority [Onboard] | | - | CPU1 SLOT2 PCI-E 3.0 X16 OPROM [Legacy] | | - | CPU1 SLOT4 PCI-E 3.0 X16 OPROM [Legacy] | | - | CPU2 SLOT6 PCI-E 3.0 X16 OPROM [Legacy] | | - | CPU2 SLOT8 PCI-E 3.0 X16 OPROM [Legacy] | | - | CPU1 SLOT9 PCI-E 3.0 X16 OPROM [Legacy] | | - | CPU2 SLOT10 PCI-E 3.0 X16 OPROM [Legacy] | | - | CPU2 SLOT11 PCI-E 3.0 X4(IN X8) OPROM [Legacy] | | - | M.2 CONNECTOR OPROM [Legacy] | | - | Onboard LAN1 Option ROM [Legacy] | | - | Onboard LAN2 Option ROM [Disabled] | | - | Onboard Video Option ROM [Legacy] | | - |> Network Stack Configuration | | -``` - -### ACPI Settings - -``` - | ACPI Settings |Enable or Disable Non | - | |uniform Memory Access | - | NUMA [Enabled] |(NUMA). | - | WHEA Support [Enabled] | | - | High Precision Event Timer [Enabled] | | -``` - -## Xeon Skx Server Firmware Inventory - -``` -Host. IPMI IP. BMC. BIOS. CPLD. Aptio SU. CPU Microcode. PCI Bus. ME Operation FW. X710 Firmware. XXV710 Firmware. i40e. -s1-t11-sut1. 10.30.50.47. 1.39. 2.1. 03.B1.03. 2.19.1268. 0200005e. A5.01.12. 4.0.4.294. 6.01 0x800034af 1.1747.0. N/A. 2.8.20-k. -s2-t12-sut1. 10.30.50.48. 1.39. 2.0b. 03.B1.03. 2.19.1268. 0200005e. A5.01.12. 4.0.4.294. 6.01 0x800034af 1.1747.0. N/A. 2.8.20-k. -s3-t21-sut1. 10.30.50.41. 1.39. 3.2. 03.B1.03. 2.19.1268. 02000065. A5.01.18. 4.0.4.294. 8.30 0x8000a49a 1.2926.0. 8.30 0x8000a485 1.2926.0. 2.17.15. -s4-t21-tg1. 10.30.50.42. 1.39. 3.2. 03.B1.03. 2.19.1268. 02000065. A5.01.18. 4.0.4.294. 8.00 0x80008b80 1.2007.0. 8.00 0x80008c1a 1.2007.0. 2.14.13. -s5-t22-sut1. 10.30.50.49. 1.53. 3.2. 03.B1.03. 2.19.1268. 02000065. A5.01.18. 4.0.4.294. 8.30 0x8000a49a 1.2926.0. 8.30 0x8000a485 1.2926.0. 2.17.15. -s6-t22-tg1. 10.30.50.50. 1.53. 3.2. 03.B1.03. 2.19.1268. 02000065. A5.01.18. 4.0.4.294. 8.00 0x80008b80 1.2007.0. 8.00 0x80008c1a 1.2007.0. 2.14.13. -s7-t23-sut1. 10.30.50.51. 1.53. 3.2. 03.B1.03. 2.19.1268. 02000065. A5.01.18. 4.0.4.294. 8.30 0x8000a49a 1.2926.0. 8.30 0x8000a485 1.2926.0. 2.17.15. -s8-t23-tg1. 10.30.50.52. 1.39. 3.2. 03.B1.03. 2.19.1268. 02000065. A5.01.18. 4.0.4.294. 8.00 0x80008b80 1.2007.0. 8.00 0x80008c1a 1.2007.0. 2.14.13. -s9-t24-sut1. 10.30.50.53. 1.39. 3.2. 03.B1.03. 2.19.1268. 02000065. A5.01.18. 4.0.4.294. 8.30 0x8000a49a 1.2926.0. 8.30 0x8000a485 1.2926.0. 2.17.15. -s10-t24-tg1. 10.30.50.54. 1.39. 3.2. 03.B1.03. 2.19.1268. 02000065. A5.01.18. 4.0.4.294. 8.00 0x80008b80 1.2007.0. 8.00 0x80008c1a 1.2007.0. 2.14.13. -s11-t31-sut1. 10.30.50.43. 1.39. 3.2. 03.B1.03. 2.19.1268. 02000065. A5.01.18. 4.0.4.294. 8.30 0x8000a49a 1.2926.0. 8.30 0x8000a485 1.2926.0. 2.17.15. -s12-t31-sut2. 10.30.50.44. 1.39. 3.2. 03.B1.03. 2.19.1268. 02000065. A5.01.18. 4.0.4.294. 8.30 0x8000a49a 1.2926.0. 8.30 0x8000a485 1.2926.0. 2.17.15. -s13-t31-tg1. 10.30.50.45. 1.39. 3.2. 03.B1.03. 2.19.1268. 02000065. A5.01.18. 4.0.4.294. 8.00 0x80008b80 1.2007.0. 8.00 0x80008c1a 1.2007.0. 2.14.13. -s14-t32-sut1. 10.30.50.55. 1.39. 3.2. 03.B1.03. 2.19.1268. 02000065. A5.01.18. 4.0.4.294. 8.30 0x8000a49a 1.2926.0. 8.30 0x8000a485 1.2926.0. 2.17.15. -s15-t32-sut2. 10.30.50.56. 1.39. 3.2. 03.B1.03. 2.19.1268. 02000065. A5.01.18. 4.0.4.294. 8.30 0x8000a49a 1.2926.0. 8.30 0x8000a485 1.2926.0. 2.17.15. -s16-t32-tg1. 10.30.50.57. 1.39. 3.2. 03.B1.03. 2.19.1268. 02000065. A5.01.18. 4.0.4.294. 8.00 0x80008b80 1.2007.0. 8.00 0x80008c1a 1.2007.0. 2.14.13. -s19-t33t211-sut1. 10.30.50.46. 1.39. 3.2. 03.B1.03. 2.19.1268. 02000065. A5.01.18. 4.0.4.294. 8.00 0x80008b80 1.2007.0. 8.00 0x80008c1a 1.2007.0. 2.17.15. -s28-t26t35-tg1. 10.30.55.10. 1.39. 3.2. 03.B1.03. 2.19.1268. 02000065. A5.01.18. 4.0.4.294. 8.00 0x80008b80 1.2007.0. N/A. 2.14.13. -``` diff --git a/docs/lab/testbeds_sm_zn2_hw_bios_cfg.md b/docs/lab/testbeds_sm_zn2_hw_bios_cfg.md deleted file mode 100644 index 9c2c4b9503..0000000000 --- a/docs/lab/testbeds_sm_zn2_hw_bios_cfg.md +++ /dev/null @@ -1,634 +0,0 @@ -# SuperMicro Cascadelake Servers - HW and BIOS Configuration - -1. [Linux lscpu](#linux-lscpu) -1. [Linux dmidecode](#dmidecode) -1. [Linux dmidecode pci](#linux-dmidecode-pci) -1. [Linux dmidecode memory](#linux-dmidecode-memory) -1. [EPYC zn2 Server BIOS Configuration](#epyc-zn2-server-bios-configuration) - 1. [Boot Feature](#boot-feature) - 1. [CPU Configuration](#cpu-configuration) - 1. [Advanced Power Management Configuration](#advanced-power-management-configuration) - 1. [CPU P State Control](#cpu-p-state-control) - 1. [Hardware PM State Control](#hardware-pm-state-control) - 1. [CPU C State Control](#cpu-c-state-control) - 1. [Package C State Control](#package-c-state-control) - 1. [CPU T State Control](#cpu-t-state-control) - 1. [Chipset Configuration](#chipset-configuration) - 1. [North Bridge](#north-bridge) - 1. [UPI Configuration](#upi-configuration) - 1. [Memory Configuration](#memory-configuration) - 1. [IIO Configuration](#iio-configuration) - 1. [CPU1 Configuration](#cpu1-configuration) - 1. [CPU2 Configuration](#cpu2-configuration) - 1. [South Bridge](#south-bridge) - 1. [PCIe/PCI/PnP Configuration](#pciepcipnp-configuration) - 1. [ACPI Settings](#acpi-settings) -1. [EPYC zn2 Server Firmware Inventory](#epyc-zn2-server-firmware-inventory) - -## Linux lscpu - -``` -$ lscpu -Architecture: x86_64 -CPU op-mode(s): 32-bit, 64-bit -Byte Order: Little Endian -CPU(s): 64 -On-line CPU(s) list: 0-63 -Thread(s) per core: 2 -Core(s) per socket: 32 -Socket(s): 1 -NUMA node(s): 2 -Vendor ID: AuthenticAMD -CPU family: 23 -Model: 49 -Model name: AMD EPYC 7532 32-Core Processor -Stepping: 0 -CPU MHz: 1981.470 -CPU max MHz: 2400.0000 -CPU min MHz: 1500.0000 -BogoMIPS: 4800.05 -Virtualization: AMD-V -L1d cache: 32K -L1i cache: 32K -L2 cache: 512K -L3 cache: 16384K -NUMA node0 CPU(s): 0-15,32-47 -NUMA node1 CPU(s): 16-31,48-63 -Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq monitor ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt tce topoext perfctr_core perfctr_nb bpext perfctr_llc mwaitx cpb cat_l3 cdp_l3 hw_pstate sme ssbd ibrs ibpb stibp vmmcall fsgsbase bmi1 avx2 smep bmi2 cqm rdt_a rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local clzero irperf xsaveerptr arat npt lbrv svm_lock nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold avic v_vmsave_vmload vgif umip rdpid overflow_recov succor smca -``` - -``` -$ lscpu -Architecture: x86_64 -CPU op-mode(s): 32-bit, 64-bit -Byte Order: Little Endian -CPU(s): 64 -On-line CPU(s) list: 0-63 -Thread(s) per core: 2 -Core(s) per socket: 32 -Socket(s): 1 -NUMA node(s): 2 -Vendor ID: AuthenticAMD -CPU family: 23 -Model: 49 -Model name: AMD EPYC 7532 32-Core Processor -Stepping: 0 -CPU MHz: 1981.470 -CPU max MHz: 2400.0000 -CPU min MHz: 1500.0000 -BogoMIPS: 4800.05 -Virtualization: AMD-V -L1d cache: 32K -L1i cache: 32K -L2 cache: 512K -L3 cache: 16384K -NUMA node0 CPU(s): 0-15,32-47 -NUMA node1 CPU(s): 16-31,48-63 -Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq monitor ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt tce topoext perfctr_core perfctr_nb bpext perfctr_llc mwaitx cpb cat_l3 cdp_l3 hw_pstate sme ssbd ibrs ibpb stibp vmmcall fsgsbase bmi1 avx2 smep bmi2 cqm rdt_a rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local clzero irperf xsaveerptr arat npt lbrv svm_lock nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold avic v_vmsave_vmload vgif umip rdpid overflow_recov succor smca -``` - -## Linux dmidecode - -``` - $ dmidecode -t slot - Handle 0x0026, DMI type 7, 27 bytes - Cache Information - Socket Designation: L1 Cache - Configuration: Enabled, Not Socketed, Level 1 - Operational Mode: Write Back - Location: Internal - Installed Size: 2048 kB - Maximum Size: 2048 kB - Supported SRAM Types: - Pipeline Burst - Installed SRAM Type: Pipeline Burst - Speed: 1 ns - Error Correction Type: Multi-bit ECC - System Type: Unified - Associativity: 8-way Set-associative - - Handle 0x0027, DMI type 7, 27 bytes - Cache Information - Socket Designation: L2 Cache - Configuration: Enabled, Not Socketed, Level 2 - Operational Mode: Write Back - Location: Internal - Installed Size: 16384 kB - Maximum Size: 16384 kB - Supported SRAM Types: - Pipeline Burst - Installed SRAM Type: Pipeline Burst - Speed: 1 ns - Error Correction Type: Multi-bit ECC - System Type: Unified - Associativity: 8-way Set-associative - - Handle 0x0028, DMI type 7, 27 bytes - Cache Information - Socket Designation: L3 Cache - Configuration: Enabled, Not Socketed, Level 3 - Operational Mode: Write Back - Location: Internal - Installed Size: 262144 kB - Maximum Size: 262144 kB - Supported SRAM Types: - Pipeline Burst - Installed SRAM Type: Pipeline Burst - Speed: 1 ns - Error Correction Type: Multi-bit ECC - System Type: Unified - Associativity: 16-way Set-associative - - Handle 0x0029, DMI type 4, 48 bytes - Processor Information - Socket Designation: CPU - Type: Central Processor - Family: Zen - Manufacturer: Advanced Micro Devices, Inc. - ID: 10 0F 83 00 FF FB 8B 17 - Signature: Family 23, Model 49, Stepping 0 - Flags: - FPU (Floating-point unit on-chip) - VME (Virtual mode extension) - DE (Debugging extension) - PSE (Page size extension) - TSC (Time stamp counter) - MSR (Model specific registers) - PAE (Physical address extension) - MCE (Machine check exception) - CX8 (CMPXCHG8 instruction supported) - APIC (On-chip APIC hardware supported) - SEP (Fast system call) - MTRR (Memory type range registers) - PGE (Page global enable) - MCA (Machine check architecture) - CMOV (Conditional move instruction supported) - PAT (Page attribute table) - PSE-36 (36-bit page size extension) - CLFSH (CLFLUSH instruction supported) - MMX (MMX technology supported) - FXSR (FXSAVE and FXSTOR instructions supported) - SSE (Streaming SIMD extensions) - SSE2 (Streaming SIMD extensions 2) - HTT (Multi-threading) - Version: AMD EPYC 7532 32-Core Processor - Voltage: 1.1 V - External Clock: 100 MHz - Max Speed: 3300 MHz - Current Speed: 2400 MHz - Status: Populated, Enabled - Upgrade: Socket SP3 - L1 Cache Handle: 0x0026 - L2 Cache Handle: 0x0027 - L3 Cache Handle: 0x0028 - Serial Number: Unknown - Asset Tag: Unknown - Part Number: Unknown - Core Count: 32 - Core Enabled: 32 - Thread Count: 64 - Characteristics: - 64-bit capable - Multi-Core - Hardware Thread - Execute Protection - Enhanced Virtualization - Power/Performance Control -``` - -## Linux dmidecode pci - -``` - $ dmidecode -t slot - Getting SMBIOS data from sysfs. - SMBIOS 3.2.0 present. - # SMBIOS implementations newer than version 3.1.1 are not - # fully supported by this version of dmidecode. - - Handle 0x000A, DMI type 9, 17 bytes - System Slot Information - Designation: M.2-HC1 CPU PCI-E 4.0 X4/X2 - Type: x4 PCI Express 3 x4 - Current Usage: Available - Length: Short - ID: 1 - Characteristics: - 3.3 V is provided - Opening is shared - PME signal is supported - Bus Address: 0000:ff:00.0 - - Handle 0x000B, DMI type 9, 17 bytes - System Slot Information - Designation: M.2-HC2 CPU PCI-E 4.0 X2 - Type: x2 PCI Express 3 x2 - Current Usage: Available - Length: Short - ID: 2 - Characteristics: - 3.3 V is provided - Opening is shared - PME signal is supported - Bus Address: 0000:ff:00.0 - - Handle 0x0042, DMI type 9, 17 bytes - System Slot Information - Designation: RSC-W-66G4 SLOT1 PCI-E 4.0 X16 - Type: x16 PCI Express 3 x16 - Current Usage: In Use - Length: Long - ID: 1 - Characteristics: - 3.3 V is provided - PME signal is supported - Bus Address: 0000:41:00.0 - - Handle 0x0043, DMI type 9, 17 bytes - System Slot Information - Designation: RSC-W-66G4 SLOT2 PCI-E 4.0 X16 - Type: x16 PCI Express 3 x16 - Current Usage: In Use - Length: Long - ID: 2 - Characteristics: - 3.3 V is provided - PME signal is supported - Bus Address: 0000:81:00.0 - - Handle 0x0045, DMI type 9, 17 bytes - System Slot Information - Designation: RSC-WR-6 SLOT1 PCI-E 4.0 X16 - Type: x16 PCI Express 3 x16 - Current Usage: In Use - Length: Long - ID: 1 - Characteristics: - 3.3 V is provided - PME signal is supported - Bus Address: 0000:01:00.0 - -``` - -## Linux dmidecode memory - -``` - $ dmidecode -t memory - # dmidecode 3.1 - Getting SMBIOS data from sysfs. - SMBIOS 3.2.0 present. - # SMBIOS implementations newer than version 3.1.1 are not - # fully supported by this version of dmidecode. - - Handle 0x0023, DMI type 16, 23 bytes - Physical Memory Array - Location: System Board Or Motherboard - Use: System Memory - Error Correction Type: Multi-bit ECC - Maximum Capacity: 2 TB - Error Information Handle: 0x0022 - Number Of Devices: 8 - - Handle 0x002B, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0023 - Error Information Handle: 0x002A - Total Width: 72 bits - Data Width: 64 bits - Size: 32 GB - Form Factor: DIMM - Set: None - Locator: DIMMA1 - Bank Locator: P0_Node0_Channel0_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: SK Hynix - Serial Number: 431E9216 - Asset Tag: P1-DIMMA1_AssetTag (date:19/00) - Part Number: HMA84GR7CJR4N-XN - Rank: 2 - Configured Clock Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x002E, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0023 - Error Information Handle: 0x002D - Total Width: 72 bits - Data Width: 64 bits - Size: 32 GB - Form Factor: DIMM - Set: None - Locator: DIMMB1 - Bank Locator: P0_Node0_Channel1_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: SK Hynix - Serial Number: 431E91D2 - Asset Tag: P1-DIMMB1_AssetTag (date:19/00) - Part Number: HMA84GR7CJR4N-XN - Rank: 2 - Configured Clock Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x0031, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0023 - Error Information Handle: 0x0030 - Total Width: 72 bits - Data Width: 64 bits - Size: 32 GB - Form Factor: DIMM - Set: None - Locator: DIMMC1 - Bank Locator: P0_Node0_Channel2_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: SK Hynix - Serial Number: 431E918A - Asset Tag: P1-DIMMC1_AssetTag (date:19/00) - Part Number: HMA84GR7CJR4N-XN - Rank: 2 - Configured Clock Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x0034, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0023 - Error Information Handle: 0x0033 - Total Width: 72 bits - Data Width: 64 bits - Size: 32 GB - Form Factor: DIMM - Set: None - Locator: DIMMD1 - Bank Locator: P0_Node0_Channel3_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: SK Hynix - Serial Number: 431E9187 - Asset Tag: P1-DIMMD1_AssetTag (date:19/00) - Part Number: HMA84GR7CJR4N-XN - Rank: 2 - Configured Clock Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x0037, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0023 - Error Information Handle: 0x0036 - Total Width: 72 bits - Data Width: 64 bits - Size: 32 GB - Form Factor: DIMM - Set: None - Locator: DIMME1 - Bank Locator: P0_Node0_Channel4_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: SK Hynix - Serial Number: 431E9178 - Asset Tag: P1-DIMME1_AssetTag (date:19/00) - Part Number: HMA84GR7CJR4N-XN - Rank: 2 - Configured Clock Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x003A, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0023 - Error Information Handle: 0x0039 - Total Width: 72 bits - Data Width: 64 bits - Size: 32 GB - Form Factor: DIMM - Set: None - Locator: DIMMF1 - Bank Locator: P0_Node0_Channel5_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: SK Hynix - Serial Number: 431E9206 - Asset Tag: P1-DIMMF1_AssetTag (date:19/00) - Part Number: HMA84GR7CJR4N-XN - Rank: 2 - Configured Clock Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x003D, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0023 - Error Information Handle: 0x003C - Total Width: 72 bits - Data Width: 64 bits - Size: 32 GB - Form Factor: DIMM - Set: None - Locator: DIMMG1 - Bank Locator: P0_Node0_Channel6_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: SK Hynix - Serial Number: 431E9207 - Asset Tag: P1-DIMMG1_AssetTag (date:19/00) - Part Number: HMA84GR7CJR4N-XN - Rank: 2 - Configured Clock Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V - - Handle 0x0040, DMI type 17, 84 bytes - Memory Device - Array Handle: 0x0023 - Error Information Handle: 0x003F - Total Width: 72 bits - Data Width: 64 bits - Size: 32 GB - Form Factor: DIMM - Set: None - Locator: DIMMH1 - Bank Locator: P0_Node0_Channel7_Dimm0 - Type: DDR4 - Type Detail: Synchronous Registered (Buffered) - Speed: 3200 MT/s - Manufacturer: SK Hynix - Serial Number: 431E9209 - Asset Tag: P1-DIMMH1_AssetTag (date:19/00) - Part Number: HMA84GR7CJR4N-XN - Rank: 2 - Configured Clock Speed: 3200 MT/s - Minimum Voltage: 1.2 V - Maximum Voltage: 1.2 V - Configured Voltage: 1.2 V -``` - -## EPYC zn2 Server BIOS Configuration - TG - -### Boot Feature - -``` - | Quiet Boot [Enabled] |Boot option | - | | | - | Option ROM Messages [Force BIOS] | | - | Bootup NumLock State [On] | | - | Wait For "F1" If Error [Enabled] | | - | INT19 Trap Response [Immediate] | | - | Re-try Boot [Disabled] | | - | | | - | Power Configuration | | - | Watch Dog Function [Disabled] | | - | Restore on AC Power Loss [Last State] | | - | Power Button Function [Instant Off] | | -``` - -### CPU Configuration - -``` - | ACPI Settings ^| | - | -------------------------------------------------- *| | - | PCI AER Support [Disabled] *| | - | High Precision Event Timer [Disabled] *| | - | NUMA Nodes Per Socket [NPS2] *| | - | ACPI SRAT L3 Cache As NUMA Domain [Auto] *| | - | *| | - | CPU Configuration ^| | - | -------------------------------------------------- *| | - | SMT Control [Auto] *| | - | Core Performance Boost [Auto] *| | - | Global C-state control [Disabled] *| | - | Local APIC Mode [Auto] *| | - | CCD Control [Auto] *| | - | Core Control [Auto] *| | - | Core Control [Auto] *| | - | L1 Stream HW Prefetcher [Enabled] *| | - | L2 Stream HW Prefetcher [Enabled] *| | - | SVM Mode [Enabled] *| | - | SMEE [Disabled] *| | - | *| | - |> CPU1 Information *| | - | *| | - | NB Configuration ^| | - | -------------------------------------------------- *| | - | Determinism Control [Manual] *| | - | Determinism Slider [Performance] *| | - | cTDP Control [Disabled] *| | - | IOMMU [Disabled] *| | - | ACS Enable [Auto] *| | - | Package Power Limit Control [Auto] *| | - | APBDIS [1] *| | - | Fixed SOC Pstate [P0] *| | - | DF Cstates [Enabled] *| | - | Preferred IO [Manual] *| | - | Preferred IO Bus [##] *| | - | *| | - | *|-----------------------------| - | *|><: Select Screen | - | *|^v: Select Item | - | *|Enter: Select | - | +|+/-: Change Opt. | - | +|F1: General Help | - | +|F2: Previous Values | - | +|F3: Optimized Defaults | - | v|F4: Save & Exit | - | | | -``` - - -## EPYC zn2 Server BIOS Configuration - DUT - -### Boot Feature - -``` - | Quiet Boot [Enabled] |Boot option | - | | | - | Option ROM Messages [Force BIOS] | | - | Bootup NumLock State [On] | | - | Wait For "F1" If Error [Enabled] | | - | INT19 Trap Response [Immediate] | | - | Re-try Boot [Disabled] | | - | | | - | Power Configuration | | - | Watch Dog Function [Disabled] | | - | Restore on AC Power Loss [Last State] | | - | Power Button Function [Instant Off] | | -``` - -### CPU Configuration - -``` - | ACPI Settings ^| | - | -------------------------------------------------- *| | - | PCI AER Support [Disabled] *| | - | High Precision Event Timer [Disabled] *| | - | NUMA Nodes Per Socket [NPS2] *| | - | ACPI SRAT L3 Cache As NUMA Domain [Auto] *| | - | *| | - | CPU Configuration ^| | - | -------------------------------------------------- *| | - | SMT Control [Auto] *| | - | Core Performance Boost [Auto] *| | - | Global C-state control [Disabled] *| | - | Local APIC Mode [Auto] *| | - | CCD Control [Auto] *| | - | Core Control [Auto] *| | - | Core Control [Auto] *| | - | L1 Stream HW Prefetcher [Enabled] *| | - | L2 Stream HW Prefetcher [Enabled] *| | - | SVM Mode [Enabled] *| | - | SMEE [Disabled] *| | - | *| | - |> CPU1 Information *| | - | *| | - | NB Configuration ^| | - | -------------------------------------------------- *| | - | Determinism Control [Manual] *| | - | Determinism Slider [Performance] *| | - | cTDP Control [Disabled] *| | - | IOMMU [Disabled] *| | - | ACS Enable [Auto] *| | - | Package Power Limit Control [Auto] *| | - | APBDIS [1] *| | - | Fixed SOC Pstate [P0] *| | - | DF Cstates [Enabled] *| | - | Preferred IO [Manual] *| | - | Preferred IO Bus [##] *| | - | *| | - | *|-----------------------------| - | *|><: Select Screen | - | *|^v: Select Item | - | *|Enter: Select | - | +|+/-: Change Opt. | - | +|F1: General Help | - | +|F2: Previous Values | - | +|F3: Optimized Defaults | - | v|F4: Save & Exit | - | | | -``` - - -## EPYC zn2 Server Firmware Inventory - -``` -Host. IPMI IP. BMC. BIOS. CPLD. CPU Microcode. PCI Bus. X710 Firmware. XXV710 Firmware. i40e. MLX5 Firmware. mlx5_core -s60-t210-sut1. 10.30.55.24. 03.10.04. 1.1a. 02.c2.00. 0x8301038. ?. 8.30 0x8000a4c7 1.2074.0. 8.30 0x8000a485 1.2926.0. 2.17.15. 16.32.1010. 5.3-1.0.5.0. -s61-t210-tg1. 10.30.55.25. 03.10.04. 1.1a. 02.c2.00. 0x8301038. ?. 8.00 0x80008c1a 1.2007.0. 8.00 0x80008ba1 1.2007.0. 2.14.13. 16.32.1010. 5.5-1.0.3.2. -```
\ No newline at end of file |