feat(ansible): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iecf76c75edccaccb7d4dcecbc5d47c3c036768e9
(cherry picked from commit 62c4aa14348c9a4e0c44ca01e71ef842760c1d73)

1 files changed, 1250 insertions, 0 deletions

diff --git a/docs/lab/testbeds_sm_icx_hw_bios_cfg.md b/docs/lab/testbeds_sm_icx_hw_bios_cfg.md
new file mode 100644
index 0000000000..d780a7c082
--- /dev/null
+++ b/docs/lab/testbeds_sm_icx_hw_bios_cfg.md
@@ -0,0 +1,1250 @@
+<<<<<<< HEAD   (41b698 feat(pxe): Add ICX)
+=======
+# SuperMicro Icelake Servers - HW and BIOS Configuration
+
+1. [Linux lscpu](#linux-lscpu)
+1. [Linux dmidecode](#dmidecode)
+1. [Linux dmidecode pci](#linux-dmidecode-pci)
+1. [Linux dmidecode memory](#linux-dmidecode-memory)
+1. [Xeon ICX Server BIOS Configuration](#xeon-icx-server-bios-configuration)
+   1. [Boot Feature](#boot-feature)
+   1. [CPU Configuration](#cpu-configuration)
+      1. [Advanced Power Management Configuration](#advanced-power-management-configuration)
+         1. [CPU P State Control](#cpu-p-state-control)
+         1. [Hardware PM State Control](#hardware-pm-state-control)
+         1. [CPU C State Control](#cpu-c-state-control)
+         1. [Package C State Control](#package-c-state-control)
+         1. [CPU T State Control](#cpu-t-state-control)
+      1. [Chipset Configuration](#chipset-configuration)
+         1. [North Bridge](#north-bridge)
+         1. [UPI Configuration](#upi-configuration)
+         1. [Memory Configuration](#memory-configuration)
+         1. [IIO Configuration](#iio-configuration)
+         1. [CPU1 Configuration](#cpu1-configuration)
+         1. [CPU2 Configuration](#cpu2-configuration)
+      1. [South Bridge](#south-bridge)
+   1. [PCIe/PCI/PnP Configuration](#pciepcipnp-configuration)
+   1. [ACPI Settings](#acpi-settings)
+1. [Xeon ICX Server Firmware Inventory](#xeon-icx-server-firmware-inventory)
+
+## Linux lscpu
+
+```
+$ lscpu
+Architecture:                    x86_64
+CPU op-mode(s):                  32-bit, 64-bit
+Byte Order:                      Little Endian
+Address sizes:                   46 bits physical, 57 bits virtual
+CPU(s):                          128
+On-line CPU(s) list:             0-127
+Thread(s) per core:              2
+Core(s) per socket:              32
+Socket(s):                       2
+NUMA node(s):                    2
+Vendor ID:                       GenuineIntel
+CPU family:                      6
+Model:                           106
+Model name:                      Intel(R) Xeon(R) Platinum 8358 CPU @ 2.60GHz
+Stepping:                        6
+CPU MHz:                         3283.980
+BogoMIPS:                        5200.00
+Virtualization:                  VT-x
+L1d cache:                       3 MiB
+L1i cache:                       2 MiB
+L2 cache:                        80 MiB
+L3 cache:                        96 MiB
+NUMA node0 CPU(s):               0-31,64-95
+NUMA node1 CPU(s):               32-63,96-127
+Vulnerability Itlb multihit:     Not affected
+Vulnerability L1tf:              Not affected
+Vulnerability Mds:               Not affected
+Vulnerability Meltdown:          Not affected
+Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl and seccomp
+Vulnerability Spectre v1:        Mitigation; usercopy/swapgs barriers and __user pointer sanitization
+Vulnerability Spectre v2:        Mitigation; Enhanced IBRS, IBPB conditional, RSB filling
+Vulnerability Srbds:             Not affected
+Vulnerability Tsx async abort:   Not affected
+Flags:                           fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe sysca
+                                 ll nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmu
+                                 lqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadl
+                                 ine_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 invpcid_single ssbd mba ibrs ibpb stibp
+                                 ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm rdt_a avx
+                                 512f avx512dq rdseed adx smap avx512ifma clflushopt clwb intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 x
+                                 saves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local wbnoinvd dtherm ida arat pln pts avx512vbmi umip pku ospke avx512_vbm
+                                 i2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg tme avx512_vpopcntdq rdpid md_clear pconfig flush_l1d arch_capabilities
+```
+
+## Linux dmidecode
+
+```
+# dmidecode 3.2
+Getting SMBIOS data from sysfs.
+SMBIOS 3.3.0 present.
+# SMBIOS implementations newer than version 3.2.0 are not
+# fully supported by this version of dmidecode.
+Table at 0x6BAEE000.
+
+Handle 0x0000, DMI type 0, 26 bytes
+BIOS Information
+        Vendor: American Megatrends International, LLC.
+        Version: 1.1
+        Release Date: 04/09/2021
+        Address: 0xF0000
+        Runtime Size: 64 kB
+        ROM Size: 32 MB
+        Characteristics:
+                PCI is supported
+                BIOS is upgradeable
+                BIOS shadowing is allowed
+                Boot from CD is supported
+                Selectable boot is supported
+                BIOS ROM is socketed
+                EDD is supported
+                Japanese floppy for NEC 9800 1.2 MB is supported (int 13h)
+                Japanese floppy for Toshiba 1.2 MB is supported (int 13h)
+                5.25"/360 kB floppy services are supported (int 13h)
+                5.25"/1.2 MB floppy services are supported (int 13h)
+                3.5"/720 kB floppy services are supported (int 13h)
+                3.5"/2.88 MB floppy services are supported (int 13h)
+                Print screen service is supported (int 5h)
+                Serial services are supported (int 14h)
+                Printer services are supported (int 17h)
+                CGA/mono video services are supported (int 10h)
+                USB legacy is supported
+                BIOS boot specification is supported
+                Targeted content distribution is supported
+                UEFI is supported
+        BIOS Revision: 5.22
+
+Handle 0x0001, DMI type 1, 27 bytes
+System Information
+        Manufacturer: Supermicro
+        Product Name: SYS-740GP-TNRT
+        Version: 0123456789
+        Serial Number: S424016X1B00510
+        UUID: 0698ae00-2383-11ec-8000-3cecefb9a6ba
+        Wake-up Type: Power Switch
+        SKU Number: To be filled by O.E.M.
+        Family: Family
+
+Handle 0x0002, DMI type 2, 15 bytes
+Base Board Information
+        Manufacturer: Supermicro
+        Product Name: X12DPG-QT6
+        Version: 1.00
+        Serial Number: UM219S003392
+        Asset Tag: Base Board Asset Tag
+        Features:
+                Board is a hosting board
+                Board is replaceable
+        Location In Chassis: Part Component
+        Chassis Handle: 0x0003
+        Type: Motherboard
+        Contained Object Handles: 0
+
+Handle 0x0003, DMI type 3, 22 bytes
+Chassis Information
+        Manufacturer: Supermicro
+        Type: Other
+        Lock: Not Present
+        Version: 0123456789
+        Serial Number: C7470KK25P50098
+        Asset Tag: Chassis Asset Tag
+        Boot-up State: Safe
+        Power Supply State: Safe
+        Thermal State: Safe
+        Security Status: None
+        OEM Information: 0x00000000
+        Height: Unspecified
+        Number Of Power Cords: 1
+        Contained Elements: 0
+        SKU Number: To be filled by O.E.M.
+
+Handle 0x001B, DMI type 38, 18 bytes
+IPMI Device Information
+        Interface Type: KCS (Keyboard Control Style)
+        Specification Version: 2.0
+        I2C Slave Address: 0x10
+        NV Storage Device: Not Present
+        Base Address: 0x0000000000000CA2 (I/O)
+        Register Spacing: Successive Byte Boundaries
+
+Handle 0x002A, DMI type 4, 48 bytes
+Processor Information
+        Socket Designation: CPU1
+        Type: Central Processor
+        Family: Xeon
+        Manufacturer: Intel(R) Corporation
+        ID: A6 06 06 00 FF FB EB BF
+        Signature: Type 0, Family 6, Model 106, Stepping 6
+        Flags:
+                FPU (Floating-point unit on-chip)
+                VME (Virtual mode extension)
+                DE (Debugging extension)
+                PSE (Page size extension)
+                TSC (Time stamp counter)
+                MSR (Model specific registers)
+                PAE (Physical address extension)
+                MCE (Machine check exception)
+                CX8 (CMPXCHG8 instruction supported)
+                APIC (On-chip APIC hardware supported)
+                SEP (Fast system call)
+                MTRR (Memory type range registers)
+                PGE (Page global enable)
+                MCA (Machine check architecture)
+                CMOV (Conditional move instruction supported)
+                PAT (Page attribute table)
+                PSE-36 (36-bit page size extension)
+                CLFSH (CLFLUSH instruction supported)
+                DS (Debug store)
+                ACPI (ACPI supported)
+                MMX (MMX technology supported)
+                FXSR (FXSAVE and FXSTOR instructions supported)
+                SSE (Streaming SIMD extensions)
+                SSE2 (Streaming SIMD extensions 2)
+                SS (Self-snoop)
+                HTT (Multi-threading)
+                TM (Thermal monitor supported)
+                PBE (Pending break enabled)
+        Version: Intel(R) Xeon(R) Platinum 8358 CPU @ 2.60GHz
+        Voltage: 1.6 V
+        External Clock: 100 MHz
+        Max Speed: 4500 MHz
+        Current Speed: 2600 MHz
+        Status: Populated, Enabled
+        Upgrade: <OUT OF SPEC>
+        L1 Cache Handle: 0x0027
+        L2 Cache Handle: 0x0028
+        L3 Cache Handle: 0x0029
+        Serial Number: Not Specified
+        Asset Tag: UNKNOWN
+        Part Number: Not Specified
+        Core Count: 32
+        Core Enabled: 32
+        Thread Count: 64
+        Characteristics:
+                64-bit capable
+                Multi-Core
+                Hardware Thread
+                Execute Protection
+                Enhanced Virtualization
+                Power/Performance Control
+
+Handle 0x002E, DMI type 4, 48 bytes
+Processor Information
+        Socket Designation: CPU2
+        Type: Central Processor
+        Family: Xeon
+        Manufacturer: Intel(R) Corporation
+        ID: A6 06 06 00 FF FB EB BF
+        Signature: Type 0, Family 6, Model 106, Stepping 6
+        Flags:
+                FPU (Floating-point unit on-chip)
+                VME (Virtual mode extension)
+                DE (Debugging extension)
+                PSE (Page size extension)
+                TSC (Time stamp counter)
+                MSR (Model specific registers)
+                PAE (Physical address extension)
+                MCE (Machine check exception)
+                CX8 (CMPXCHG8 instruction supported)
+                APIC (On-chip APIC hardware supported)
+                SEP (Fast system call)
+                MTRR (Memory type range registers)
+                PGE (Page global enable)
+                MCA (Machine check architecture)
+                CMOV (Conditional move instruction supported)
+                PAT (Page attribute table)
+                PSE-36 (36-bit page size extension)
+                CLFSH (CLFLUSH instruction supported)
+                DS (Debug store)
+                ACPI (ACPI supported)
+                MMX (MMX technology supported)
+                FXSR (FXSAVE and FXSTOR instructions supported)
+                SSE (Streaming SIMD extensions)
+                SSE2 (Streaming SIMD extensions 2)
+                SS (Self-snoop)
+                HTT (Multi-threading)
+                TM (Thermal monitor supported)
+                PBE (Pending break enabled)
+        Version: Intel(R) Xeon(R) Platinum 8358 CPU @ 2.60GHz
+        Voltage: 1.6 V
+        External Clock: 100 MHz
+        Max Speed: 4500 MHz
+        Current Speed: 2600 MHz
+        Status: Populated, Enabled
+        Upgrade: <OUT OF SPEC>
+        L1 Cache Handle: 0x002B
+        L2 Cache Handle: 0x002C
+        L3 Cache Handle: 0x002D
+        Serial Number: Not Specified
+        Asset Tag: UNKNOWN
+        Part Number: Not Specified
+        Core Count: 32
+        Core Enabled: 32
+        Thread Count: 64
+        Characteristics:
+                64-bit capable
+                Multi-Core
+                Hardware Thread
+                Execute Protection
+                Enhanced Virtualization
+                Power/Performance Control
+```
+
+## Linux dmidecode pci
+
+```
+  $ dmidecode -t slot
+Handle 0x000A, DMI type 9, 17 bytes
+System Slot Information
+        Designation: CPU1 SLOT2 PCI-E 4.0 X16
+        Type: x16 <OUT OF SPEC>
+        Current Usage: In Use
+        Length: Short
+        Characteristics:
+                3.3 V is provided
+                Opening is shared
+                PME signal is supported
+        Bus Address: 0000:4b:00.0
+
+Handle 0x000B, DMI type 9, 17 bytes
+System Slot Information
+        Designation: CPU1 SlOT4 PCI-E 4.0 X16
+        Type: x16 <OUT OF SPEC>
+        Current Usage: In Use
+        Length: Short
+        Characteristics:
+                3.3 V is provided
+                Opening is shared
+                PME signal is supported
+        Bus Address: 0000:31:00.0
+
+Handle 0x000C, DMI type 9, 17 bytes
+System Slot Information
+        Designation: CPU2 SLOT6 PCI-E 4.0 X16
+        Type: x16 <OUT OF SPEC>
+        Current Usage: Available
+        Length: Short
+        Characteristics:
+                3.3 V is provided
+                Opening is shared
+                PME signal is supported
+        Bus Address: 0000:ff:00.0
+
+Handle 0x000D, DMI type 9, 17 bytes
+System Slot Information
+        Designation: CPU2 SLOT8 PCI-E 4.0 X16
+        Type: x16 <OUT OF SPEC>
+        Current Usage: Available
+        Length: Short
+        Characteristics:
+                3.3 V is provided
+                Opening is shared
+                PME signal is supported
+        Bus Address: 0000:ff:00.0
+
+Handle 0x000E, DMI type 9, 17 bytes
+System Slot Information
+        Designation: CPU1 SLOT9 PCI-E 4.0 X16
+        Type: x16 <OUT OF SPEC>
+        Current Usage: In Use
+        Length: Short
+        Characteristics:
+                3.3 V is provided
+                Opening is shared
+                PME signal is supported
+        Bus Address: 0000:17:00.0
+
+Handle 0x000F, DMI type 9, 17 bytes
+System Slot Information
+        Designation: CPU2 SLOT10 PCI-E 4.0 X16
+        Type: x16 <OUT OF SPEC>
+        Current Usage: Available
+        Length: Short
+        Characteristics:
+                3.3 V is provided
+                Opening is shared
+                PME signal is supported
+        Bus Address: 0000:ff:00.0
+
+Handle 0x0010, DMI type 9, 17 bytes
+System Slot Information
+        Designation: CPU2 SLOT11 PCI-E 4.0 X8
+        Type: x8 <OUT OF SPEC>
+        Current Usage: Available
+        Length: Short
+        Characteristics:
+                3.3 V is provided
+                Opening is shared
+                PME signal is supported
+        Bus Address: 0000:ff:00.0
+
+Handle 0x0011, DMI type 9, 17 bytes
+System Slot Information
+        Designation: M.2-HC1
+        Type: x4 M.2 Socket 2
+        Current Usage: Available
+        Length: Short
+        Characteristics:
+                3.3 V is provided
+                Opening is shared
+                PME signal is supported
+        Bus Address: 0000:ff:00.0
+
+Handle 0x0012, DMI type 9, 17 bytes
+System Slot Information
+        Designation: M.2-HC2
+        Type: x4 M.2 Socket 2
+        Current Usage: Available
+        Length: Short
+        Characteristics:
+                3.3 V is provided
+                Opening is shared
+                PME signal is supported
+        Bus Address: 0000:ff:00.0
+```
+
+## Linux dmidecode memory
+
+```
+  $ dmidecode -t memory
+Handle 0x0033, DMI type 16, 23 bytes
+Physical Memory Array
+        Location: System Board Or Motherboard
+        Use: System Memory
+        Error Correction Type: Single-bit ECC
+        Maximum Capacity: 12 TB
+        Error Information Handle: Not Provided
+        Number Of Devices: 16
+
+Handle 0x0034, DMI type 17, 92 bytes
+Memory Device
+        Array Handle: 0x0033
+        Error Information Handle: Not Provided
+        Total Width: 72 bits
+        Data Width: 64 bits
+        Size: 16384 MB
+        Form Factor: DIMM
+        Set: None
+        Locator: P1-DIMMA1
+        Bank Locator: P0_Node0_Channel0_Dimm0
+        Type: DDR4
+        Type Detail: Synchronous Registered (Buffered)
+        Speed: 3200 MT/s
+        Manufacturer: Samsung
+        Serial Number: H0MK0001304705C2E3
+        Asset Tag: P1-DIMMA1_AssetTag (date:21/30)
+        Part Number: M393A2K43DB3-CWE
+        Rank: 2
+        Configured Memory Speed: 3200 MT/s
+        Minimum Voltage: 1.2 V
+        Maximum Voltage: 1.2 V
+        Configured Voltage: 1.2 V
+        Memory Technology: DRAM
+        Memory Operating Mode Capability: Volatile memory
+        Firmware Version: 0000
+        Module Manufacturer ID: Bank 1, Hex 0xCE
+        Module Product ID: Unknown
+        Memory Subsystem Controller Manufacturer ID: Unknown
+        Memory Subsystem Controller Product ID: Unknown
+        Non-Volatile Size: None
+        Volatile Size: 16 GB
+        Cache Size: None
+        Logical Size: None
+
+Handle 0x0036, DMI type 17, 92 bytes
+Memory Device
+        Array Handle: 0x0033
+        Error Information Handle: Not Provided
+        Total Width: 72 bits
+        Data Width: 64 bits
+        Size: 16384 MB
+        Form Factor: DIMM
+        Set: None
+        Locator: P1-DIMMB1
+        Bank Locator: P0_Node0_Channel1_Dimm0
+        Type: DDR4
+        Type Detail: Synchronous Registered (Buffered)
+        Speed: 3200 MT/s
+        Manufacturer: Samsung
+        Serial Number: H0MK0001304705CE60
+        Asset Tag: P1-DIMMB1_AssetTag (date:21/30)
+        Part Number: M393A2K43DB3-CWE
+        Rank: 2
+        Configured Memory Speed: 3200 MT/s
+        Minimum Voltage: 1.2 V
+        Maximum Voltage: 1.2 V
+        Configured Voltage: 1.2 V
+        Memory Technology: DRAM
+        Memory Operating Mode Capability: Volatile memory
+        Firmware Version: 0000
+        Module Manufacturer ID: Bank 1, Hex 0xCE
+        Module Product ID: Unknown
+        Memory Subsystem Controller Manufacturer ID: Unknown
+        Memory Subsystem Controller Product ID: Unknown
+        Non-Volatile Size: None
+        Volatile Size: 16 GB
+        Cache Size: None
+        Logical Size: None
+
+Handle 0x0038, DMI type 17, 92 bytes
+Memory Device
+        Array Handle: 0x0033
+        Error Information Handle: Not Provided
+        Total Width: 72 bits
+        Data Width: 64 bits
+        Size: 16384 MB
+        Form Factor: DIMM
+        Set: None
+        Locator: P1-DIMMC1
+        Bank Locator: P0_Node0_Channel2_Dimm0
+        Type: DDR4
+        Type Detail: Synchronous Registered (Buffered)
+        Speed: 3200 MT/s
+        Manufacturer: Samsung
+        Serial Number: H0MK0001304705C59E
+        Asset Tag: P1-DIMMC1_AssetTag (date:21/30)
+        Part Number: M393A2K43DB3-CWE
+        Rank: 2
+        Configured Memory Speed: 3200 MT/s
+        Minimum Voltage: 1.2 V
+        Maximum Voltage: 1.2 V
+        Configured Voltage: 1.2 V
+        Memory Technology: DRAM
+        Memory Operating Mode Capability: Volatile memory
+        Firmware Version: 0000
+        Module Manufacturer ID: Bank 1, Hex 0xCE
+        Module Product ID: Unknown
+        Memory Subsystem Controller Manufacturer ID: Unknown
+        Memory Subsystem Controller Product ID: Unknown
+        Non-Volatile Size: None
+        Volatile Size: 16 GB
+        Cache Size: None
+        Logical Size: None
+
+Handle 0x003A, DMI type 17, 92 bytes
+Memory Device
+        Array Handle: 0x0033
+        Error Information Handle: Not Provided
+        Total Width: 72 bits
+        Data Width: 64 bits
+        Size: 16384 MB
+        Form Factor: DIMM
+        Set: None
+        Locator: P1-DIMMD1
+        Bank Locator: P0_Node0_Channel3_Dimm0
+        Type: DDR4
+        Type Detail: Synchronous Registered (Buffered)
+        Speed: 3200 MT/s
+        Manufacturer: Samsung
+        Serial Number: H0MK0001304705D12D
+        Asset Tag: P1-DIMMD1_AssetTag (date:21/30)
+        Part Number: M393A2K43DB3-CWE
+        Rank: 2
+        Configured Memory Speed: 3200 MT/s
+        Minimum Voltage: 1.2 V
+        Maximum Voltage: 1.2 V
+        Configured Voltage: 1.2 V
+        Memory Technology: DRAM
+        Memory Operating Mode Capability: Volatile memory
+        Firmware Version: 0000
+        Module Manufacturer ID: Bank 1, Hex 0xCE
+        Module Product ID: Unknown
+        Memory Subsystem Controller Manufacturer ID: Unknown
+        Memory Subsystem Controller Product ID: Unknown
+        Non-Volatile Size: None
+        Volatile Size: 16 GB
+        Cache Size: None
+        Logical Size: None
+
+Handle 0x003C, DMI type 17, 92 bytes
+Memory Device
+        Array Handle: 0x0033
+        Error Information Handle: Not Provided
+        Total Width: 72 bits
+        Data Width: 64 bits
+        Size: 16384 MB
+        Form Factor: DIMM
+        Set: None
+        Locator: P1-DIMME1
+        Bank Locator: P0_Node1_Channel0_Dimm0
+        Type: DDR4
+        Type Detail: Synchronous Registered (Buffered)
+        Speed: 3200 MT/s
+        Manufacturer: Samsung
+        Serial Number: H0MK0001304705C69C
+        Asset Tag: P1-DIMME1_AssetTag (date:21/30)
+        Part Number: M393A2K43DB3-CWE
+        Rank: 2
+        Configured Memory Speed: 3200 MT/s
+        Minimum Voltage: 1.2 V
+        Maximum Voltage: 1.2 V
+        Configured Voltage: 1.2 V
+        Memory Technology: DRAM
+        Memory Operating Mode Capability: Volatile memory
+        Firmware Version: 0000
+        Module Manufacturer ID: Bank 1, Hex 0xCE
+        Module Product ID: Unknown
+        Memory Subsystem Controller Manufacturer ID: Unknown
+        Memory Subsystem Controller Product ID: Unknown
+        Non-Volatile Size: None
+        Volatile Size: 16 GB
+        Cache Size: None
+        Logical Size: None
+
+Handle 0x003E, DMI type 17, 92 bytes
+Memory Device
+        Array Handle: 0x0033
+        Error Information Handle: Not Provided
+        Total Width: 72 bits
+        Data Width: 64 bits
+        Size: 16384 MB
+        Form Factor: DIMM
+        Set: None
+        Locator: P1-DIMMF1
+        Bank Locator: P0_Node1_Channel1_Dimm0
+        Type: DDR4
+        Type Detail: Synchronous Registered (Buffered)
+        Speed: 3200 MT/s
+        Manufacturer: Samsung
+        Serial Number: H0MK0001304705C33A
+        Asset Tag: P1-DIMMF1_AssetTag (date:21/30)
+        Part Number: M393A2K43DB3-CWE
+        Rank: 2
+        Configured Memory Speed: 3200 MT/s
+        Minimum Voltage: 1.2 V
+        Maximum Voltage: 1.2 V
+        Configured Voltage: 1.2 V
+        Memory Technology: DRAM
+        Memory Operating Mode Capability: Volatile memory
+        Firmware Version: 0000
+        Module Manufacturer ID: Bank 1, Hex 0xCE
+        Module Product ID: Unknown
+        Memory Subsystem Controller Manufacturer ID: Unknown
+        Memory Subsystem Controller Product ID: Unknown
+        Non-Volatile Size: None
+        Volatile Size: 16 GB
+        Cache Size: None
+        Logical Size: None
+
+Handle 0x0040, DMI type 17, 92 bytes
+Memory Device
+        Array Handle: 0x0033
+        Error Information Handle: Not Provided
+        Total Width: 72 bits
+        Data Width: 64 bits
+        Size: 16384 MB
+        Form Factor: DIMM
+        Set: None
+        Locator: P1-DIMMG1
+        Bank Locator: P0_Node1_Channel2_Dimm0
+        Type: DDR4
+        Type Detail: Synchronous Registered (Buffered)
+        Speed: 3200 MT/s
+        Manufacturer: Samsung
+        Serial Number: H0MK0001304705C59F
+        Asset Tag: P1-DIMMG1_AssetTag (date:21/30)
+        Part Number: M393A2K43DB3-CWE
+        Rank: 2
+        Configured Memory Speed: 3200 MT/s
+        Minimum Voltage: 1.2 V
+        Maximum Voltage: 1.2 V
+        Configured Voltage: 1.2 V
+        Memory Technology: DRAM
+        Memory Operating Mode Capability: Volatile memory
+        Firmware Version: 0000
+        Module Manufacturer ID: Bank 1, Hex 0xCE
+        Module Product ID: Unknown
+        Memory Subsystem Controller Manufacturer ID: Unknown
+        Memory Subsystem Controller Product ID: Unknown
+        Non-Volatile Size: None
+        Volatile Size: 16 GB
+        Cache Size: None
+        Logical Size: None
+
+Handle 0x0042, DMI type 17, 92 bytes
+Memory Device
+        Array Handle: 0x0033
+        Error Information Handle: Not Provided
+        Total Width: 72 bits
+        Data Width: 64 bits
+        Size: 16384 MB
+        Form Factor: DIMM
+        Set: None
+        Locator: P1-DIMMH1
+        Bank Locator: P0_Node1_Channel3_Dimm0
+        Type: DDR4
+        Type Detail: Synchronous Registered (Buffered)
+        Speed: 3200 MT/s
+        Manufacturer: Samsung
+        Serial Number: H0MK0001304705CA16
+        Asset Tag: P1-DIMMH1_AssetTag (date:21/30)
+        Part Number: M393A2K43DB3-CWE
+        Rank: 2
+        Configured Memory Speed: 3200 MT/s
+        Minimum Voltage: 1.2 V
+        Maximum Voltage: 1.2 V
+        Configured Voltage: 1.2 V
+        Memory Technology: DRAM
+        Memory Operating Mode Capability: Volatile memory
+        Firmware Version: 0000
+        Module Manufacturer ID: Bank 1, Hex 0xCE
+        Module Product ID: Unknown
+        Memory Subsystem Controller Manufacturer ID: Unknown
+        Memory Subsystem Controller Product ID: Unknown
+        Non-Volatile Size: None
+        Volatile Size: 16 GB
+        Cache Size: None
+        Logical Size: None
+
+Handle 0x0044, DMI type 17, 92 bytes
+Memory Device
+        Array Handle: 0x0033
+        Error Information Handle: Not Provided
+        Total Width: 72 bits
+        Data Width: 64 bits
+        Size: 16384 MB
+        Form Factor: DIMM
+        Set: None
+        Locator: P2-DIMMA1
+        Bank Locator: P1_Node0_Channel0_Dimm0
+        Type: DDR4
+        Type Detail: Synchronous Registered (Buffered)
+        Speed: 3200 MT/s
+        Manufacturer: Samsung
+        Serial Number: H0MK0001304705CBFE
+        Asset Tag: P2-DIMMA1_AssetTag (date:21/30)
+        Part Number: M393A2K43DB3-CWE
+        Rank: 2
+        Configured Memory Speed: 3200 MT/s
+        Minimum Voltage: 1.2 V
+        Maximum Voltage: 1.2 V
+        Configured Voltage: 1.2 V
+        Memory Technology: DRAM
+        Memory Operating Mode Capability: Volatile memory
+        Firmware Version: 0000
+        Module Manufacturer ID: Bank 1, Hex 0xCE
+        Module Product ID: Unknown
+        Memory Subsystem Controller Manufacturer ID: Unknown
+        Memory Subsystem Controller Product ID: Unknown
+        Non-Volatile Size: None
+        Volatile Size: 16 GB
+        Cache Size: None
+        Logical Size: None
+
+Handle 0x0046, DMI type 17, 92 bytes
+Memory Device
+        Array Handle: 0x0033
+        Error Information Handle: Not Provided
+        Total Width: 72 bits
+        Data Width: 64 bits
+        Size: 16384 MB
+        Form Factor: DIMM
+        Set: None
+        Locator: P2-DIMMB1
+        Bank Locator: P1_Node0_Channel1_Dimm0
+        Type: DDR4
+        Type Detail: Synchronous Registered (Buffered)
+        Speed: 3200 MT/s
+        Manufacturer: Samsung
+        Serial Number: H0MK0001304705CFC8
+        Asset Tag: P2-DIMMB1_AssetTag (date:21/30)
+        Part Number: M393A2K43DB3-CWE
+        Rank: 2
+        Configured Memory Speed: 3200 MT/s
+        Minimum Voltage: 1.2 V
+        Maximum Voltage: 1.2 V
+        Configured Voltage: 1.2 V
+        Memory Technology: DRAM
+        Memory Operating Mode Capability: Volatile memory
+        Firmware Version: 0000
+        Module Manufacturer ID: Bank 1, Hex 0xCE
+        Module Product ID: Unknown
+        Memory Subsystem Controller Manufacturer ID: Unknown
+        Memory Subsystem Controller Product ID: Unknown
+        Non-Volatile Size: None
+        Volatile Size: 16 GB
+        Cache Size: None
+        Logical Size: None
+
+Handle 0x0048, DMI type 17, 92 bytes
+Memory Device
+        Array Handle: 0x0033
+        Error Information Handle: Not Provided
+        Total Width: 72 bits
+        Data Width: 64 bits
+        Size: 16384 MB
+        Form Factor: DIMM
+        Set: None
+        Locator: P2-DIMMC1
+        Bank Locator: P1_Node0_Channel2_Dimm0
+        Type: DDR4
+        Type Detail: Synchronous Registered (Buffered)
+        Speed: 3200 MT/s
+        Manufacturer: Samsung
+        Serial Number: H0MK0001304705CC02
+        Asset Tag: P2-DIMMC1_AssetTag (date:21/30)
+        Part Number: M393A2K43DB3-CWE
+        Rank: 2
+        Configured Memory Speed: 3200 MT/s
+        Minimum Voltage: 1.2 V
+        Maximum Voltage: 1.2 V
+        Configured Voltage: 1.2 V
+        Memory Technology: DRAM
+        Memory Operating Mode Capability: Volatile memory
+        Firmware Version: 0000
+        Module Manufacturer ID: Bank 1, Hex 0xCE
+        Module Product ID: Unknown
+        Memory Subsystem Controller Manufacturer ID: Unknown
+        Memory Subsystem Controller Product ID: Unknown
+        Non-Volatile Size: None
+        Volatile Size: 16 GB
+        Cache Size: None
+        Logical Size: None
+
+Handle 0x004A, DMI type 17, 92 bytes
+Memory Device
+        Array Handle: 0x0033
+        Error Information Handle: Not Provided
+        Total Width: 72 bits
+        Data Width: 64 bits
+        Size: 16384 MB
+        Form Factor: DIMM
+        Set: None
+        Locator: P2-DIMMD1
+        Bank Locator: P1_Node0_Channel3_Dimm0
+        Type: DDR4
+        Type Detail: Synchronous Registered (Buffered)
+        Speed: 3200 MT/s
+        Manufacturer: Samsung
+        Serial Number: H0MK0001304705CB5A
+        Asset Tag: P2-DIMMD1_AssetTag (date:21/30)
+        Part Number: M393A2K43DB3-CWE
+        Rank: 2
+        Configured Memory Speed: 3200 MT/s
+        Minimum Voltage: 1.2 V
+        Maximum Voltage: 1.2 V
+        Configured Voltage: 1.2 V
+        Memory Technology: DRAM
+        Memory Operating Mode Capability: Volatile memory
+        Firmware Version: 0000
+        Module Manufacturer ID: Bank 1, Hex 0xCE
+        Module Product ID: Unknown
+        Memory Subsystem Controller Manufacturer ID: Unknown
+        Memory Subsystem Controller Product ID: Unknown
+        Non-Volatile Size: None
+        Volatile Size: 16 GB
+        Cache Size: None
+        Logical Size: None
+
+Handle 0x004C, DMI type 17, 92 bytes
+Memory Device
+        Array Handle: 0x0033
+        Error Information Handle: Not Provided
+        Total Width: 72 bits
+        Data Width: 64 bits
+        Size: 16384 MB
+        Form Factor: DIMM
+        Set: None
+        Locator: P2-DIMME1
+        Bank Locator: P1_Node1_Channel0_Dimm0
+        Type: DDR4
+        Type Detail: Synchronous Registered (Buffered)
+        Speed: 3200 MT/s
+        Manufacturer: Samsung
+        Serial Number: H0MK0001304705CB30
+        Asset Tag: P2-DIMME1_AssetTag (date:21/30)
+        Part Number: M393A2K43DB3-CWE
+        Rank: 2
+        Configured Memory Speed: 3200 MT/s
+        Minimum Voltage: 1.2 V
+        Maximum Voltage: 1.2 V
+        Configured Voltage: 1.2 V
+        Memory Technology: DRAM
+        Memory Operating Mode Capability: Volatile memory
+        Firmware Version: 0000
+        Module Manufacturer ID: Bank 1, Hex 0xCE
+        Module Product ID: Unknown
+        Memory Subsystem Controller Manufacturer ID: Unknown
+        Memory Subsystem Controller Product ID: Unknown
+        Non-Volatile Size: None
+        Volatile Size: 16 GB
+        Cache Size: None
+        Logical Size: None
+
+Handle 0x004E, DMI type 17, 92 bytes
+Memory Device
+        Array Handle: 0x0033
+        Error Information Handle: Not Provided
+        Total Width: 72 bits
+        Data Width: 64 bits
+        Size: 16384 MB
+        Form Factor: DIMM
+        Set: None
+        Locator: P2-DIMMF1
+        Bank Locator: P1_Node1_Channel1_Dimm0
+        Type: DDR4
+        Type Detail: Synchronous Registered (Buffered)
+        Speed: 3200 MT/s
+        Manufacturer: Samsung
+        Serial Number: H0MK0001304705CB87
+        Asset Tag: P2-DIMMF1_AssetTag (date:21/30)
+        Part Number: M393A2K43DB3-CWE
+        Rank: 2
+        Configured Memory Speed: 3200 MT/s
+        Minimum Voltage: 1.2 V
+        Maximum Voltage: 1.2 V
+        Configured Voltage: 1.2 V
+        Memory Technology: DRAM
+        Memory Operating Mode Capability: Volatile memory
+        Firmware Version: 0000
+        Module Manufacturer ID: Bank 1, Hex 0xCE
+        Module Product ID: Unknown
+        Memory Subsystem Controller Manufacturer ID: Unknown
+        Memory Subsystem Controller Product ID: Unknown
+        Non-Volatile Size: None
+        Volatile Size: 16 GB
+        Cache Size: None
+        Logical Size: None
+
+Handle 0x0050, DMI type 17, 92 bytes
+Memory Device
+        Array Handle: 0x0033
+        Error Information Handle: Not Provided
+        Total Width: 72 bits
+        Data Width: 64 bits
+        Size: 16384 MB
+        Form Factor: DIMM
+        Set: None
+        Locator: P2-DIMMG1
+        Bank Locator: P1_Node1_Channel2_Dimm0
+        Type: DDR4
+        Type Detail: Synchronous Registered (Buffered)
+        Speed: 3200 MT/s
+        Manufacturer: Samsung
+        Serial Number: H0MK0001304705CB08
+        Asset Tag: P2-DIMMG1_AssetTag (date:21/30)
+        Part Number: M393A2K43DB3-CWE
+        Rank: 2
+        Configured Memory Speed: 3200 MT/s
+        Minimum Voltage: 1.2 V
+        Maximum Voltage: 1.2 V
+        Configured Voltage: 1.2 V
+        Memory Technology: DRAM
+        Memory Operating Mode Capability: Volatile memory
+        Firmware Version: 0000
+        Module Manufacturer ID: Bank 1, Hex 0xCE
+        Module Product ID: Unknown
+        Memory Subsystem Controller Manufacturer ID: Unknown
+        Memory Subsystem Controller Product ID: Unknown
+        Non-Volatile Size: None
+        Volatile Size: 16 GB
+        Cache Size: None
+        Logical Size: None
+
+Handle 0x0052, DMI type 17, 92 bytes
+Memory Device
+        Array Handle: 0x0033
+        Error Information Handle: Not Provided
+        Total Width: 72 bits
+        Data Width: 64 bits
+        Size: 16384 MB
+        Form Factor: DIMM
+        Set: None
+        Locator: P2-DIMMH1
+        Bank Locator: P1_Node1_Channel3_Dimm0
+        Type: DDR4
+        Type Detail: Synchronous Registered (Buffered)
+        Speed: 3200 MT/s
+        Manufacturer: Samsung
+        Serial Number: H0MK0001304705CC01
+        Asset Tag: P2-DIMMH1_AssetTag (date:21/30)
+        Part Number: M393A2K43DB3-CWE
+        Rank: 2
+        Configured Memory Speed: 3200 MT/s
+        Minimum Voltage: 1.2 V
+        Maximum Voltage: 1.2 V
+        Configured Voltage: 1.2 V
+        Memory Technology: DRAM
+        Memory Operating Mode Capability: Volatile memory
+        Firmware Version: 0000
+        Module Manufacturer ID: Bank 1, Hex 0xCE
+        Module Product ID: Unknown
+        Memory Subsystem Controller Manufacturer ID: Unknown
+        Memory Subsystem Controller Product ID: Unknown
+        Non-Volatile Size: None
+        Volatile Size: 16 GB
+        Cache Size: None
+        Logical Size: None
+```
+
+## Xeon ICX Server BIOS Configuration
+
+### Boot Feature
+
+```
+  |                                                                    |Enables or disables Quiet    |
+  |  Quiet Boot                                [Enabled]               |Boot option                  |
+  |                                                                    |                             |
+  |  Option ROM Messages                       [Force BIOS]            |                             |
+  |  Bootup NumLock State                      [On]                    |                             |
+  |  Wait For "F1" If Error                    [Disabled]              |                             |
+  |  INT19 Trap Response                       [Immediate]             |                             |
+  |  Re-try Boot                               [Disabled]              |                             |
+  |                                                                    |                             |
+  |  Power Configuration                                               |                             |
+  |                                                                    |                             |
+  |  Watch Dog Function                        [Disabled]              |                             |
+  |  Restore on AC Power Loss                  [Last State]            |                             |
+  |  Power Button Function                     [Instant Off]           |                             |
+  |  Deep Sleep Mode                           [Disabled]              |                             |
+```
+
+### CPU Configuration
+
+```
+  |  Processor Configuration                                          ^|Enables Hyper Threading      |
+  |  --------------------------------------------------               *|(Software Method to          |
+  |  Processor BSP Revision                    606A6 - ICX D2         *|Enable/Disable Logical       |
+  |  Processor Socket                          CPU1         CPU2      *|Processor threads.           |
+  |  Processor ID                              000606A6* |  000606A6  *|                             |
+  |  Processor Frequency                       2.600GHz  |  2.600GHz  *|                             |
+  |  Processor Max Ratio                            1AH  |       1AH  *|                             |
+  |  Processor Min Ratio                            08H  |       08H  *|                             |
+  |  Microcode Revision                        0D000280  |  0D000280  *|                             |
+  |  L1 Cache RAM(Per Core)                        80KB  |      80KB  *|                             |
+  |  L2 Cache RAM(Per Core)                      1280KB  |    1280KB  *|                             |
+  |  L3 Cache RAM(Per Package)                  49152KB  |   49152KB  *|                             |
+  |  Processor 0 Version                       Intel(R) Xeon(R)       *|                             |
+  |                                            Platinum 8358 CPU @    *|                             |
+  |                                            2.60GHz                *|                             |
+  |  Processor 1 Version                       Intel(R) Xeon(R)       *|                             |
+  |                                            Platinum 8358 CPU @    *|                             |
+  |                                            2.60GHz                *|                             |
+  |                                                                   +|                             |
+  |> CPU1 Core Disable Bitmap                                         +|                             |
+  |> CPU2 Core Disable Bitmap                                         +|-----------------------------|
+  |  Hyper-Threading [ALL]                     [Enable]               +|><: Select Screen            |
+  |  Hardware Prefetcher                       [Enable]               +|^v: Select Item              |
+  |  Adjacent Cache Prefetch                   [Enable]               +|Enter: Select                |
+  |  DCU Streamer Prefetcher                   [Enable]               +|+/-: Change Opt.             |
+  |  DCU IP Prefetcher                         [Enable]               +|F1: General Help             |
+  |  LLC Prefetch                              [Enable]               +|F2: Previous Values          |
+  |  Extended APIC                             [Disable]              +|F3: Optimized Defaults       |
+  |  VMX                                       [Enable]               v|F4: Save & Exit              |
+  |  Enable SMX                                [Disable]              +|                             |
+  |  PPIN Control                              [Unlock/Enable]        *|                             |
+  |  AES-NI                                    [Enable]               *|                             |
+  |  --------------------------------------------------               *|                             |
+  |  TME, TME-MT, TDX                                                 *|                             |
+  |  --------------------------------------------------               *|                             |
+  |  Total Memory Encryption (TME)             [Disabled]             *|                             |
+  |  --------------------------------------------------               *|-----------------------------|
+  |  Software Guard Extension (SGX)                                   *|><: Select Screen            |
+  |  --------------------------------------------------               *|^v: Select Item              |
+  |  SGX Factory Reset                         [Disabled]             *|Enter: Select                |
+  |  SW Guard Extensions (SGX)                 [Disabled]             *|+/-: Change Opt.             |
+  |  SGX Package Info In-Band Access           [Disabled]             *|F1: General Help             |
+  |  --------------------------------------------------               *|F2: Previous Values          |
+  |  Limit CPU PA to 46 Bits                   [Enable]               *|F3: Optimized Defaults       |
+  |> Advanced Power Management Configuration                          v|F4: Save & Exit              |
+```
+
+#### Advanced Power Management Configuration
+
+```
+  |  Advanced Power Management Configuration                           |Enable processor power       |
+  |  --------------------------------------------------                |management features.         |
+  |  Power Technology                          [Custom]                |                             |
+  |  Power Performance Tuning                  [BIOS Controls EPB]     |                             |
+  |  ENERGY_PERF_BIAS_CFG Mode                 [Maximum Performance]   |                             |
+```
+
+##### CPU P State Control
+
+```
+  |  CPU P State Control                                               |EIST allows the processor    |
+  |                                                                    |to dynamically adjust        |
+  |  SpeedStep (P-States)                      [Disable]               |frequency and voltage based  |
+  |  Activate SST-BF                           [Disable]               |on power versus performance  |
+  |  Configure SST-BF                          [Enable]                |needs.                       |
+  |  EIST PSD Function                         [HW_ALL]                |                             |
+```
+
+##### Hardware PM State Control
+
+```
+  |  Hardware PM State Control                                         |If set to Disable, hardware ^|
+  |                                                                    |will choose a P-state       *|
+  |  Hardware P-States                         [Disable]               |setting for the system      *|
+  |                                                                    |based on an OS request.     *|
+
+  |  Frequency Prioritization                                          |This knob controls whether   |
+  |                                                                    |RAPL balancer is enabled.    |
+  |  RAPL Prioritization                       [Disable]               |When enabled it activates    |
+```
+
+##### CPU C State Control
+
+```
+  |  CPU C State Control                                               |Allows Monitor and MWAIT     |
+  |                                                                    |instructions.                |
+  |  Enable Monitor MWAIT                      [Enable]                |                             |
+  |  CPU C6 Report                             [Disable]               |                             |
+  |  Enhanced Halt State (C1E)                 [Disable]               |                             |
+```
+
+##### Package C State Control
+
+```
+  |  Package C State Control                                           |Limit the lowest package     |
+  |                                                                    |level C-State to             |
+  |  Package C State                           [C0/C1 state]           |processors. Lower package    |
+```
+
+##### CPU T State Control
+
+```
+  |  CPU T State Control                                               |Enable/Disable CPU           |
+  |                                                                    |throttling by OS.            |
+  |  Software Controlled T-States              [Disable]               |Throttling reduces power     |
+```
+
+##### UPI Configuration
+
+```
+  |  Uncore Configuration                                              |Choose Topology Precedence   |
+  |  --------------------------------------------------                |to degrade features if       |
+  |  Number of CPU                             2                       |system options are in        |
+  |  Number of IIO                             2                       |conflict or choose Feature   |
+  |  Current UPI Link Speed                    Fast                    |Precedence to degrade        |
+  |  Current UPI Link Frequency                11.2 GT/s               |topology if system options   |
+  |  Global MMIO Low Base / Limit              90000000 / FBFFFFFF     |are in conflict.             |
+  |  Global MMIO High Base / Limit             0000200000000000 /      |                             |
+  |                                            0000204FFFFFFFFF        |                             |
+  |  Pci-e Configuration Base / Size           80000000 / 10000000     |                             |
+  |  Degrade Precedence                        [Topology Precedence]   |                             |
+  |  Link L0p Enable                           [Disable]               |                             |
+  |  Link L1 Enable                            [Disable]               |                             |
+  |  XPT Remote Prefetch                       [Auto]                  |                             |
+  |  KTI Prefetch                              [Auto]                  |-----------------------------|
+  |  Local/Remote Threshold                    [Auto]                  |><: Select Screen            |
+  |  IO Directory Cache (IODC)                 [Auto]                  |^v: Select Item              |
+  |  SNC (Sub NUMA)                            [Disable]               |Enter: Select                |
+  |  XPT Prefetch                              [Auto]                  |+/-: Change Opt.             |
+  |  Snoop Throttle Configuration              [Auto]                  |F1: General Help             |
+  |  PCIe Remote P2P Relaxed Ordering          [Disable]               |F2: Previous Values          |
+  |  Stale AtoS                                [Auto]                  |F3: Optimized Defaults       |
+  |  LLC Dead Line Alloc                       [Enable]                |F4: Save & Exit              |
+```
+
+##### Memory Configuration
+
+```
+  |                                                                    |Set Enable or Disable        |
+  |  --------------------------------------------------                |STEP(Samsung TestBIOS &      |
+  |  Integrated Memory Controller (iMC)                                |Enhanced PPR)function        |
+  |  --------------------------------------------------                |                             |
+  |                                                                    |                             |
+  |  STEP DRAM Test                            [Disable]               |                             |
+  |   Operation Mode                           [Test and Repair]       |                             |
+  |  Enforce POR                               [POR]                   |                             |
+  |  PPR Type                                  [Hard PPR]              |                             |
+  |  Memory Frequency                          [Auto]                  |                             |
+  |  Data Scrambling for DDR4                  [Enable]                |                             |
+  |  2x Refresh Enable                         [Auto]                  |                             |
+```
+
+##### IIO Configuration
+
+```
+  |  IIO Configuration                                                 |Press <Enter> to bring up    |
+  |  --------------------------------------------------                |the Intel. Virtualization    |
+  |                                                                    |for Directed I/O (VT-d)      |
+  |> CPU1 Configuration                                                |Configuration menu.          |
+  |> CPU2 Configuration                                                |                             |
+  |> IOAT Configuration                                                |                             |
+  |> Intel. VT for Directed I/O (VT-d)                                 |                             |
+  |> Intel. VMD Technology                                             |                             |
+  |  PCI-E ASPM Support (Global)               [Disable]               |                             |
+  |  IIO eDPC Support                          [Disable]               |                             |
+```
+
+##### CPU1 Configuration
+
+```
+  |  IOU0 (IIO PCIe Port 1)                    [Auto]                  |Selects PCIe port            |
+  |  IOU1 (IIO PCIe Port 2)                    [Auto]                  |Bifurcation for selected     |
+  |  IOU3 (IIO PCIe Port 4)                    [Auto]                  |slot(s)                      |
+  |  IOU4 (IIO PCIe Port 5)                    [Auto]                  |                             |
+```
+
+##### CPU2 Configuration
+
+```
+  |  IOU0 (IIO PCIe Port 1)                    [Auto]                  |Selects PCIe port            |
+  |  IOU1 (IIO PCIe Port 2)                    [Auto]                  |Bifurcation for selected     |
+  |  IOU3 (IIO PCIe Port 4)                    [Auto]                  |slot(s)                      |
+  |  IOU4 (IIO PCIe Port 5)                    [Auto]                  |                             |
+```
+
+#### South Bridge
+
+```
+  |  USB Module Version                        26                      |AUTO option disables legacy  |
+  |                                                                    |support if no USB devices    |
+  |  USB Devices:                                                      |are connected. DISABLE       |
+  |        1 Drive, 2 Keyboards, 2 Mice, 1 Hub                         |option will keep USB         |
+  |                                                                    |devices available only for   |
+  |  Legacy USB Support                        [Enabled]               |EFI applications.            |
+  |  XHCI Hand-off                             [Enabled]               |                             |
+  |  Port 60/64 Emulation                      [Disabled]              |                             |
+  |  PCIe PLL SSC                              [Disabled]              |                             |
+  |  Port 61h Bit-4 Emulation                  [Disabled]              |                             |
+```
+
+### PCIe/PCI/PnP Configuration
+
+```
+  |  PCI Bus Driver Version                    A5.01.24               ^|Enables or Disables 64bit    |
+  |                                                                   *|capable Devices to be        |
+  |  PCI Devices Common Settings:                                     *|Decoded in Above 4G Address  |
+  |  Above 4G Decoding                         [Enabled]              *|Space (Only if System        |
+  |  SR-IOV Support                            [Enabled]              *|Supports 64 bit PCI          |
+  |  ARI Support                               [Enabled]              *|Decoding).                   |
+  |  Bus Master Enable                         [Enabled]              *|                             |
+  |  Consistent Device Name Support            [Disabled]             *|                             |
+  |  MMIO High Base                            [32T]                  *|                             |
+  |  MMIO High Granularity Size                [64G]                  *|                             |
+  |  Maximum Read Request                      [Auto]                 *|                             |
+  |  MMCFG Base                                [Auto]                 *|                             |
+  |  NVMe Firmware Source                      [Vendor Defined        *|                             |
+  |                                            Firmware]              *|                             |
+  |  VGA Priority                              [Onboard]              *|                             |
+  |  CPU1 SLOT2 PCI-E 3.0 X16 OPROM            [EFI]                  *|                             |
+  |  CPU1 SLOT4 PCI-E 3.0 X16 OPROM            [EFI]                  *|                             |
+  |  CPU2 SLOT6 PCI-E 3.0 X16 OPROM            [EFI]                  *|                             |
+  |  CPU2 SLOT8 PCI-E 3.0 X16 OPROM            [EFI]                  *|-----------------------------|
+  |  CPU1 SLOT9 PCI-E 3.0 X16 OPROM            [EFI]                  *|><: Select Screen            |
+  |  CPU2 SLOT10 PCI-E 3.0 X16 OPROM           [EFI]                  *|^v: Select Item              |
+  |  CPU2 SLOT11 PCI-E 3.0 X4(IN X8) OPROM     [EFI]                  *|Enter: Select                |
+  |  M.2 CONNECTOR OPROM                       [EFI]                  *|+/-: Change Opt.             |
+  |  Bus Master Enable                         [Enabled]              +|F1: General Help             |
+  |  Onboard LAN1 Option ROM                   [EFI]                  +|F2: Previous Values          |
+  |  Onboard LAN2 Option ROM                   [Disabled]             +|F3: Optimized Defaults       |
+  |  Onboard Video Option ROM                  [EFI]                  v|F4: Save & Exit              |
+  |> Network Stack Configuration                                       |                             |
+```
+
+## Xeon ICX Server Firmware Inventory
+
+```
+Host.           IPMI IP.      BMC.      BIOS. CPLD.     CPU Microcode.  PCI Bus.   X710 Firmware.            i40e.   E810 Firmware.            ice.
+s65-t37-sut1.   10.30.50.75.  1.00.21.  1.1.  F1.00.07. 0D000280.       A5.01.24.  8.30 0x8000a49d 1.2926.0. 2.17.4. 3.10 0x8000ad67 1.3106.0. 1.7.16.
+s66-t37-sut2.   10.30.50.76.  1.00.21.  1.1.  F1.00.07. 0D000280.       A5.01.24.  8.30 0x8000a49d 1.2926.0. 2.17.4. 3.10 0x8000ad67 1.3106.0. 1.7.16.
+s67-t37-tg1.    10.30.50.77.  1.00.21.  1.1.  F1.00.07. 0D000280.       A5.01.24.  8.30 0x8000a49d 1.2926.0. 2.17.4. 3.10 0x8000ad67 1.3106.0. 1.7.16.
+s71-t212-sut1.  10.30.50.81.  1.00.21.  1.1.  F1.00.07. 0D000280.       A5.01.24.  8.30 0x8000a49d 1.2926.0. 2.17.4. 3.10 0x8000ad67 1.3106.0. 1.7.16.
+s72-t212-tg1.   10.30.50.82.  1.00.21.  1.1.  F1.00.07. 0D000280.       A5.01.24.  8.30 0x8000a49d 1.2926.0. 2.17.4. 3.10 0x8000ad67 1.3106.0. 1.7.16.
+```
+>>>>>>> CHANGE (62c4aa feat(ansible): Add ICX)