From 7f7f9e7bda96b8c1887a783082fd5651653b7e16 Mon Sep 17 00:00:00 2001 From: Tibor Frank Date: Mon, 10 Jul 2023 11:33:26 +0000 Subject: C-Docs: Release report Change-Id: I257e9ef513f163c48cd9dcb2d183bfada0c54fbb Signed-off-by: Tibor Frank --- .../infrastructure/fdio_csit_testbed_versioning.md | 134 ++++++++++----------- docs/content/release_notes/csit_rls2306/_index.md | 77 ++++++++++-- .../csit_rls2306/csit-2306-report-info.md | 88 -------------- 3 files changed, 132 insertions(+), 167 deletions(-) delete mode 100644 docs/content/release_notes/csit_rls2306/csit-2306-report-info.md diff --git a/docs/content/infrastructure/fdio_csit_testbed_versioning.md b/docs/content/infrastructure/fdio_csit_testbed_versioning.md index 6d7d358b8c..feb611b61b 100644 --- a/docs/content/infrastructure/fdio_csit_testbed_versioning.md +++ b/docs/content/infrastructure/fdio_csit_testbed_versioning.md @@ -36,64 +36,27 @@ environment versioning include: Following is the list of CSIT versions to date: -- Ver. 1 associated with CSIT rls1908 branch ( - [HW](https://git.fd.io/csit/tree/docs/lab?h=rls1908), - [Linux](https://docs.fd.io/csit/rls1908/report/vpp_performance_tests/test_environment.html#sut-settings-linux), - [TRex](https://docs.fd.io/csit/rls1908/report/vpp_performance_tests/test_environment.html#tg-settings-trex), - [CSIT](https://git.fd.io/csit/tree/?h=rls1908) - ). -- Ver. 2 associated with CSIT rls2001 branch ( - [HW](https://git.fd.io/csit/tree/docs/lab?h=rls2001), - [Linux](https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/test_environment.html#sut-settings-linux), - [TRex](https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/test_environment.html#tg-settings-trex), - [CSIT](https://git.fd.io/csit/tree/?h=rls2001) - ). -- Ver. 4 associated with CSIT rls2005 branch ( - [HW](https://git.fd.io/csit/tree/docs/lab?h=rls2005), - [Linux](https://docs.fd.io/csit/rls2005/report/vpp_performance_tests/test_environment.html#sut-settings-linux), - [TRex](https://docs.fd.io/csit/rls2005/report/vpp_performance_tests/test_environment.html#tg-settings-trex), - [CSIT](https://git.fd.io/csit/tree/?h=rls2005) - ). -- Ver. 5 associated with CSIT rls2009 branch ( - [HW](https://git.fd.io/csit/tree/docs/lab?h=rls2009), - [Linux](https://docs.fd.io/csit/rls2009/report/vpp_performance_tests/test_environment.html#sut-settings-linux), - [TRex](https://docs.fd.io/csit/rls2009/report/vpp_performance_tests/test_environment.html#tg-settings-trex), - [CSIT](https://git.fd.io/csit/tree/?h=rls2009) - ). - - The main change is TRex data-plane core resource adjustments: - [increase from 7 to 8 cores and pinning cores to interfaces](https://gerrit.fd.io/r/c/csit/+/28184) - for better TRex performance with symmetric traffic profiles. -- Ver. 6 associated with CSIT rls2101 branch ( - [HW](https://git.fd.io/csit/tree/docs/lab?h=rls2101), - [Linux](https://docs.fd.io/csit/rls2101/report/vpp_performance_tests/test_environment.html#sut-settings-linux), - [TRex](https://docs.fd.io/csit/rls2101/report/vpp_performance_tests/test_environment.html#tg-settings-trex), - [CSIT](https://git.fd.io/csit/tree/?h=rls2101) - ). - - The main change is TRex version upgrade: increase from 2.82 to 2.86. -- Ver. 7 associated with CSIT rls2106 branch ( - [HW](https://git.fd.io/csit/tree/docs/lab?h=rls2106), - [Linux](https://s3-docs.fd.io/csit/rls2106/report/vpp_performance_tests/test_environment.html#sut-settings-linux), - [TRex](https://s3-docs.fd.io/csit/rls2106/report/vpp_performance_tests/test_environment.html#tg-settings-trex), - [CSIT](https://git.fd.io/csit/tree/?h=rls2106) - ). - - TRex version upgrade: increase from 2.86 to 2.88. - - Ubuntu upgrade from 18.04 LTS to 20.04.2 LTS. -- Ver. 8 associated with CSIT rls2110 branch ( - [HW](https://git.fd.io/csit/tree/docs/lab?h=rls2110), - [Linux](https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/test_environment.html#sut-settings-linux), - [TRex](https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/test_environment.html#tg-settings-trex), - [CSIT](https://git.fd.io/csit/tree/?h=rls2110) +- Ver. 12 associated with CSIT rls2306 branch ( + [HW](https://git.fd.io/csit/tree/docs/content/infrastructure/testbed_configuration?h=rls2306), + [CSIT](https://git.fd.io/csit/tree/?h=rls2306) ). - Intel NIC 700/800 series firmware upgrade based on DPDK compatibility matrix. -- Ver. 9 associated with CSIT rls2202 branch ( - [HW](https://git.fd.io/csit/tree/docs/lab?h=rls2202), - [Linux](https://s3-docs.fd.io/csit/rls2202/report/vpp_performance_tests/test_environment.html#sut-settings-linux), - [TRex](https://s3-docs.fd.io/csit/rls2202/report/vpp_performance_tests/test_environment.html#tg-settings-trex), - [CSIT](https://git.fd.io/csit/tree/?h=rls2202) + - Mellanox 556A/CX6-DX/MCX713106AS-VEAT series firmware upgrade based on DPDK + compatibility matrix. + - TRex version upgrade: increase from 3.00 to 3.03. +- Ver. 11 associated with CSIT rls2210 branch ( + [HW](https://git.fd.io/csit/tree/docs/lab?h=rls2210), + [Linux](https://s3-docs.fd.io/csit/rls2210/report/vpp_performance_tests/test_environment.html#sut-settings-linux), + [TRex](https://s3-docs.fd.io/csit/rls2210/report/vpp_performance_tests/test_environment.html#tg-settings-trex), + [CSIT](https://git.fd.io/csit/tree/?h=rls2210) ). - Intel NIC 700/800 series firmware upgrade based on DPDK compatibility matrix. + - Mellanox 556A series firmware upgrade based on DPDK compatibility + matrix. + - Ubuntu upgrade from 20.04.2 LTS to 22.04.1 LTS. + - TRex version upgrade: increase from 2.97 to 3.00. - Ver. 10 associated with CSIT rls2206 branch ( [HW](https://git.fd.io/csit/tree/docs/lab?h=rls2206), [Linux](https://s3-docs.fd.io/csit/rls2206/report/vpp_performance_tests/test_environment.html#sut-settings-linux), @@ -107,24 +70,61 @@ Following is the list of CSIT versions to date: - Intel IceLake all core turbo frequency turned off. Current base frequency is 2.6GHz. - TRex version upgrade: increase from 2.88 to 2.97. -- Ver. 11 associated with CSIT rls2210 branch ( - [HW](https://git.fd.io/csit/tree/docs/lab?h=rls2210), - [Linux](https://s3-docs.fd.io/csit/rls2210/report/vpp_performance_tests/test_environment.html#sut-settings-linux), - [TRex](https://s3-docs.fd.io/csit/rls2210/report/vpp_performance_tests/test_environment.html#tg-settings-trex), - [CSIT](https://git.fd.io/csit/tree/?h=rls2210) +- Ver. 9 associated with CSIT rls2202 branch ( + [HW](https://git.fd.io/csit/tree/docs/lab?h=rls2202), + [Linux](https://s3-docs.fd.io/csit/rls2202/report/vpp_performance_tests/test_environment.html#sut-settings-linux), + [TRex](https://s3-docs.fd.io/csit/rls2202/report/vpp_performance_tests/test_environment.html#tg-settings-trex), + [CSIT](https://git.fd.io/csit/tree/?h=rls2202) ). - Intel NIC 700/800 series firmware upgrade based on DPDK compatibility matrix. - - Mellanox 556A series firmware upgrade based on DPDK compatibility - matrix. - - Ubuntu upgrade from 20.04.2 LTS to 22.04.1 LTS. - - TRex version upgrade: increase from 2.97 to 3.00. -- Ver. 12 associated with CSIT rls2306 branch ( - [HW](https://git.fd.io/csit/tree/docs/content/infrastructure/testbed_configuration?h=rls2306), - [CSIT](https://git.fd.io/csit/tree/?h=rls2306) +- Ver. 8 associated with CSIT rls2110 branch ( + [HW](https://git.fd.io/csit/tree/docs/lab?h=rls2110), + [Linux](https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/test_environment.html#sut-settings-linux), + [TRex](https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/test_environment.html#tg-settings-trex), + [CSIT](https://git.fd.io/csit/tree/?h=rls2110) ). - Intel NIC 700/800 series firmware upgrade based on DPDK compatibility matrix. - - Mellanox 556A/CX6-DX/MCX713106AS-VEAT series firmware upgrade based on DPDK - compatibility matrix. - - TRex version upgrade: increase from 3.00 to 3.03. +- Ver. 7 associated with CSIT rls2106 branch ( + [HW](https://git.fd.io/csit/tree/docs/lab?h=rls2106), + [Linux](https://s3-docs.fd.io/csit/rls2106/report/vpp_performance_tests/test_environment.html#sut-settings-linux), + [TRex](https://s3-docs.fd.io/csit/rls2106/report/vpp_performance_tests/test_environment.html#tg-settings-trex), + [CSIT](https://git.fd.io/csit/tree/?h=rls2106) + ). + - TRex version upgrade: increase from 2.86 to 2.88. + - Ubuntu upgrade from 18.04 LTS to 20.04.2 LTS. +- Ver. 6 associated with CSIT rls2101 branch ( + [HW](https://git.fd.io/csit/tree/docs/lab?h=rls2101), + [Linux](https://docs.fd.io/csit/rls2101/report/vpp_performance_tests/test_environment.html#sut-settings-linux), + [TRex](https://docs.fd.io/csit/rls2101/report/vpp_performance_tests/test_environment.html#tg-settings-trex), + [CSIT](https://git.fd.io/csit/tree/?h=rls2101) + ). + - The main change is TRex version upgrade: increase from 2.82 to 2.86. +- Ver. 5 associated with CSIT rls2009 branch ( + [HW](https://git.fd.io/csit/tree/docs/lab?h=rls2009), + [Linux](https://docs.fd.io/csit/rls2009/report/vpp_performance_tests/test_environment.html#sut-settings-linux), + [TRex](https://docs.fd.io/csit/rls2009/report/vpp_performance_tests/test_environment.html#tg-settings-trex), + [CSIT](https://git.fd.io/csit/tree/?h=rls2009) + ). + - The main change is TRex data-plane core resource adjustments: + [increase from 7 to 8 cores and pinning cores to interfaces](https://gerrit.fd.io/r/c/csit/+/28184) + for better TRex performance with symmetric traffic profiles. +- Ver. 4 associated with CSIT rls2005 branch ( + [HW](https://git.fd.io/csit/tree/docs/lab?h=rls2005), + [Linux](https://docs.fd.io/csit/rls2005/report/vpp_performance_tests/test_environment.html#sut-settings-linux), + [TRex](https://docs.fd.io/csit/rls2005/report/vpp_performance_tests/test_environment.html#tg-settings-trex), + [CSIT](https://git.fd.io/csit/tree/?h=rls2005) + ). +- Ver. 2 associated with CSIT rls2001 branch ( + [HW](https://git.fd.io/csit/tree/docs/lab?h=rls2001), + [Linux](https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/test_environment.html#sut-settings-linux), + [TRex](https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/test_environment.html#tg-settings-trex), + [CSIT](https://git.fd.io/csit/tree/?h=rls2001) + ). +- Ver. 1 associated with CSIT rls1908 branch ( + [HW](https://git.fd.io/csit/tree/docs/lab?h=rls1908), + [Linux](https://docs.fd.io/csit/rls1908/report/vpp_performance_tests/test_environment.html#sut-settings-linux), + [TRex](https://docs.fd.io/csit/rls1908/report/vpp_performance_tests/test_environment.html#tg-settings-trex), + [CSIT](https://git.fd.io/csit/tree/?h=rls1908) + ). diff --git a/docs/content/release_notes/csit_rls2306/_index.md b/docs/content/release_notes/csit_rls2306/_index.md index 17b10ad0da..6170d5e3dc 100644 --- a/docs/content/release_notes/csit_rls2306/_index.md +++ b/docs/content/release_notes/csit_rls2306/_index.md @@ -7,6 +7,12 @@ weight: 1 # CSIT-2306 Release Report +The format of FD.io CSIT reports has now changed. It is no longer available +in the static html format. + +Instead current CSIT release information can be found in csit.fd.io. +Previous CSIT releases are also linked from there. + ## CSIT-2306 Release Notes - [VPP Performance]({{< relref "/release_notes/csit_rls2306/vpp_performance" >}}) @@ -19,37 +25,84 @@ weight: 1 To access CSIT-2306 Release data please use following web resources: - [CSIT Per Release Performance](https://csit.fd.io/report/) -- [CSIT Per Release Comparisons](https://csit.fd.io/comparisons/) + - `CSIT Release` > `rls2306` + - `DUT` > `vpp` + - `DUT Version` > `23.06-release` + - `Infra` > `testbed-nic-driver of choice` + - `Area` > `IPv4 Routing` `IPv4 Tunnels` `IPv6 Routing` `Hoststack` ... + - `Test` > `test of chioce` + - `Frame Size` > `64B` `78B` + - `Number of Cores` > `1C` `2C` `4C` + - `Test Type` > `MRR` `NDR` `PDR` +- [CSIT Per Release Comparisons](https://csit.fd.io/comparisons/) for VPP + v23.06 vs v23.02 + - `REFERENCE VALUE` + - `DUT` > `vpp` + - `CSIT and DUT version` > `rls2306-23.02-release` + - `Infra` > `testbed-nic-driver of choice` + - `Frame Size` > `64B` `78B` + - `Number of Cores` > `1C` `2C` `4C` + - `Measurement` > `Latency` `MRR` `NDR` `PDR` + - `COMPARED VALUE` + - `Parameter` > `Release and Version` + - `Value` > `rls2306-23.06-release` - [CSIT Per Release Coverage Data](https://csit.fd.io/coverage/) + - `CSIT Release` > `rls2306` ## CSIT-2306 Selected Performance Tests CSIT-2306 VPP v23.06 Performance Tests: - ip4 - - [2n-aws c5n.4xl](http://cuts2.com/gFObL) - - [2n-icx](http://cuts2.com/CJmlu) - - [3n-icx](...) - - [2n-spr](http://cuts2.com/kGVeC) - - [3n-spr](http://cuts2.com/PxQLl) + - [2n-icx 100ge e810cq avf ip4scale20k](http://cuts2.com/zMwtS) + - [2n-spr 100ge e810cq avf ip4scale20k](http://cuts2.com/ahfvO) + - [2n-spr 100ge e810cq dpdk ip4scale20k](http://cuts2.com/yQCqU) + - [2n-spr 200ge cx7 dpdk ip4scale20k](http://cuts2.com/ZRERf) + - [2n-aws c5n.4xl 50ge ena dpdk ip4scale20k](http://cuts2.com/cwXOI) - ip6 + - [2n-icx 100ge e810cq avf ip6scale20k](http://cuts2.com/QjBlW) + - [2n-spr 100ge e810cq avf ip6scale20k](http://cuts2.com/OmkQy) + - [2n-spr 100ge e810cq dpdk ip6scale20k](http://cuts2.com/qbpWI) + - [2n-spr 200ge cx7 dpdk ip6scale20k](http://cuts2.com/OtOzQ) + - [2n-aws c5n.4xl 50ge ena dpdk ip6scale20k](http://cuts2.com/Uopiv) - ipsec -- hoststack + - [3n-icx 100ge e810cq avf 40tnlsw](http://cuts2.com/XFLrM) + - [3n-icx 100ge cx6 dpdk 40tnlsw](http://cuts2.com/gzpDB) + - [3n-spr 100ge e810cq avf 40tnlsw](http://cuts2.com/NJeBW) + - [3n-spr 200ge cx7 dpdk 40tnlsw](http://cuts2.com/fUiMC) +- hoststack quic + - [3n-icx 100ge e810cq dpdk ip4udpquic](http://cuts2.com/WTRoA) + - [3n-icx 100ge cx6 dpdk ip4udpquic](http://cuts2.com/ZGHEO) + - [3n-spr 100ge e810cq dpdk ip4udpquic](http://cuts2.com/LoBjd) + - [3n-spr 200ge cx7 dpdk ip4udpquic](http://cuts2.com/CODih) +- hoststack tcp udp + - [3n-icx 100ge e810cq dpdk ip4tcp ipudp](http://cuts2.com/jlSrJ) + - [3n-icx 100ge cx6 dpdk ip4tcp ipudp](http://cuts2.com/Pkqng) + - [3n-spr 100ge e810cq dpdk ip4tcp ipudp](http://cuts2.com/RMWmj) + - [3n-spr 200ge cx7 dpdk ip4tcp ipudp](http://cuts2.com/cRVdc) - nat44 + - [2n-icx 100ge e810cq avf ethip4tcp tput](http://cuts2.com/aLIBU) + - [2n-spr 100ge e810cq avf ethip4tcp-nat44ed tput](http://cuts2.com/loEKr) + - [2n-spr 100ge e810cq avf ethip4tcp-nat44ed cps](http://cuts2.com/boqsw) + - [2n-spr 200ge cx7 dpdk ethip4tcp-nat44ed tput](http://cuts2.com/QwXZd) - tunnels (gnv, vxlan, gtpu) + - [2n-icx 100ge e810cq avf ethip4udpgeneve](http://cuts2.com/VOrQr) + - [3n-icx 100ge cx6 dpdk gtpu sw](http://cuts2.com/uYTVT) + - [3n-spr 200ge cx7 dpdk vxlan](http://cuts2.com/iOYme) + - [3n-spr 200ge cx7 dpdk gtpu sw](http://cuts2.com/tZrfd) + - [3n-spr 200ge cx7 dpdk wireguard](http://cuts2.com/xKCia) - reassembly -- ... _add more references with links_ + - [3n-icx 100ge e810cq dpdk reassembly](http://cuts2.com/vBqTg) ## CSIT-2306 Selected Performance Comparisons -CSIT-2306 VPP v23.06 comparisons 23.06 vs 23.02 -- []() +Comparisons 23.06 vs 23.02 +- [2n-icx e810 2p100ge](http://cuts2.com/UBwMY) ## CSIT-2306 Selected Performance Coverage Data CSIT-2306 VPP v23.06 coverage data -- []() - +- [2n-icx 200ge cx7 dpdk ip4](http://cuts2.com/EfqNe) ## Further Information diff --git a/docs/content/release_notes/csit_rls2306/csit-2306-report-info.md b/docs/content/release_notes/csit_rls2306/csit-2306-report-info.md deleted file mode 100644 index 619b7acafb..0000000000 --- a/docs/content/release_notes/csit_rls2306/csit-2306-report-info.md +++ /dev/null @@ -1,88 +0,0 @@ ---- -bookHidden: true -title: "CSIT-2306 Release Report" ---- - -# CSIT-2306 Release Report - -The format of FD.io CSIT reports has now changed is no longer available -in the static html format. - -Instead current CSIT release information can be found in csit.fd.io. -Previous CSIT releases are also linked from there. - -## CSIT-2306 Release Data - -To access CSIT-2306 Release data please use following web resources: - -- [CSIT-2306 Release Notes](https://csit.fd.io/cdocs/release_notes/csit_rls2306/) -- [CSIT Documentation](https://csit.fd.io/cdocs/) -- [CSIT Per Release Performance](https://csit.fd.io/report/) - - `CSIT Release` > `rls2306` - - `DUT` > `vpp` - - `DUT Version` > `23.06-release` - - `Infra` > - - `Area` > `IPv4 Routing` `IPv4 Tunnels` `IPv6 Routing` `Hoststack` ... - - `Test` > ... - - `Frame Size` > `64B` `78B` - - `Number of Cores` > `1C` `2C` `4C` - - `Test Type` > `MRR` `NDR` `PDR` -- [CSIT Per Release Comparisons](https://csit.fd.io/comparisons/) for VPP v23.06 vs v23.02 - - `REFERENCE VALUE` - - `DUT` > `vpp` - - `CSIT and DUT version` > `rls2306-23.02-release` - - `Infra` > - - `Frame Size` > `64B` `78B` - - `Number of Cores` > `1C` `2C` `4C` - - `Measurement` > `Latency` `MRR` `NDR` `PDR` - - `COMPARED VALUE` - - `Parameter` > `Release and Version` - - `Value` > `rls2306-23.06-release` -- [CSIT Per Release Coverage Data](https://csit.fd.io/coverage/) - - `CSIT Release` > `rls2306` - -## CSIT-2306 Selected Performance Tests - -CSIT-2306 VPP v23.06 Performance Tests: - -- ip4 - - [2n-icx 100ge e810cq avf ip4scale20k](http://cuts2.com/sIfjo) - - [2n-spr 100ge e810cq avf ip4scale20k](http://cuts2.com/ExMRU) - - [2n-spr 100ge e810cq dpdk ip4scale20k](http://cuts2.com/snSJi) - - [2n-spr 200ge cx7 dpdk ip4scale20k](http://cuts2.com/bVpvF) - - [2n-aws c5n.4xl 50ge ena dpdk ip4scale20k](http://cuts2.com/HrpyC) -- ip6 - - [2n-icx 100ge e810cq avf ip6scale20k](http://cuts2.com/zgxlu) - - [2n-spr 100ge e810cq avf ip6scale20k](http://cuts2.com/HqEsk) - - [2n-spr 100ge e810cq dpdk ip6scale20k](http://cuts2.com/mLZWm) - - [2n-spr 200ge cx7 dpdk ip6scale20k](http://cuts2.com/eCVsx) - - [2n-aws c5n.4xl 50ge ena dpdk ip6scale20k](http://cuts2.com/gsExR) -- ipsec - - [3n-icx 100ge e810cq avf 40tnlsw](http://cuts2.com/weFIh) - - [3n-icx 100ge cx6 dpdk 40tnlsw](http://cuts2.com/zNVVn) - - [3n-spr 100ge e810cq avf 40tnlsw](http://cuts2.com/JFUvT) - - [3n-spr 200ge cx7 dpdk 40tnlsw](http://cuts2.com/ihwxD) -- hoststack quic - - [3n-icx 100ge e810cq dpdk ip4udpquic](http://cuts2.com/PRcZr) - - [3n-icx 100ge cx6 dpdk ip4udpquic](http://cuts2.com/JJKBv) - - [3n-spr 100ge e810cq dpdk ip4udpquic](http://cuts2.com/IqRxg) - - [3n-spr 200ge cx7 dpdk ip4udpquic](http://cuts2.com/Orzya) -- hoststack tcp udp - - [3n-icx 100ge e810cq dpdk ip4tcp ipudp](http://cuts2.com/cECAK) - - [3n-icx 100ge cx6 dpdk ip4tcp ipudp](http://cuts2.com/sCjKI) - - [3n-spr 100ge e810cq dpdk ip4tcp ipudp](http://cuts2.com/HvNmE) - - [3n-spr 200ge cx7 dpdk ip4tcp ipudp](http://cuts2.com/nAFDH) -- nat44 -- tunnels (gnv, vxlan, gtpu) -- reassembly - -## CSIT-2306 Selected Performance Comparisons - -Comparisons 23.06 vs 23.02 -- [2n-icx e810 2p100ge](http://cuts2.com/UBwMY) - -## Further Information - -For further information including instructions how to access the needed -information with user selectable options, please refer to csit.fd.io -documentation at this [link](https://csit.fd.io/cdocs/overview/c_dash/). -- cgit 1.2.3-korg