aboutsummaryrefslogtreecommitdiffstats
path: root/docs/job_specs/report_iterative
AgeCommit message (Collapse)AuthorFilesLines
2023-02-15update regression mrr for gtpu testYulong Pei1-5/+5
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I07f1938852eafe43801e2c1e9b0018ce5fd755f9 (cherry picked from commit e0858716c6c935a8267f2306bfc8ccaa780b40e7)
2023-02-13update regression for gtpu and wireguard testYulong Pei1-4/+4
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I241fbbf63050e8c05ece86e8dc8a6aed15a26677 (cherry picked from commit 1bf51093c8a9985a64f4c2bd0148e779a961348d)
2023-02-09fix(job_specs): Cleanup inconsistencies part 2pmikus7-0/+242
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ie264094631eaba74fffce983c40a9682f1a25b75 (cherry picked from commit c2b8bd4d4de91f6ac92e3535e2b0ab4c17328d7e)
2023-02-09doc: add job_specs for upcoming 2n-spr and 3vn-spr testbedsMaciek Konstantynowicz4-0/+1405
Only e810cq 100ge tests for now. Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Change-Id: If1cafc31f88f5248a77da00758066ebac2e15a9a Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 9dd6bb50480941e71f9867bd4c0bf97d46be2e7c)
2023-02-08job_specs: add e810cq 100ge tests to 2n-icx and 3n-icxMaciek Konstantynowicz6-5/+1263
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Change-Id: I71d69bb699d7691c3f1b25176bc58db81c77b1ca (cherry picked from commit 6b1cc64d927bb55317b859021aff07e5fb7e5d53)
2023-02-02fix(job_spec): Naming conventionspmikus28-67/+30
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Iccaa4f8945e5eb48272737338a52c9edbf1cb58b (cherry picked from commit 8bc3a1425ee60cc5035923e355373afb4d78e225)
2023-01-23fix(docs): Hoststack job_specspmikus1-4/+4
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ide227cfa0b02a92cbb89a5832d78e8d4996a0d24 (cherry picked from commit bf635b8d7cd582f38e1d0faefa246672b71b2567)
2023-01-23feat(docs): Job specs for hoststackpmikus3-39/+28
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Id116b1bef41e31a3527cd704106c25be59740cba (cherry picked from commit 9122d379d93af589d4e5c95147bc9ed7c819df0d)
2023-01-19feat(docs): Add mlx5_core job_specspmikus2-0/+186
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ibc691da995cf9e5ddbfea4227913ecb465525534 (cherry picked from commit 464eb6e9d244575b585e5b557044e152f6ef694f)
2023-01-19fix(docs): Cleanup job_specspmikus36-2158/+0
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Iccccda3b7909adb9fc330b2d3454a7c429e4cf8f (cherry picked from commit 5fe8f285dcebaa24ade6a2b4ef117e3a8e62a398)
2022-12-15feat(core): DNV decommissionpmikus8-492/+0
- Static content will be removed separately Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I0992e941e1c24552837eaf7e8d3f6564b3cb21c8
2022-12-14nginx: bump down to working 1_21_5 versionViliam Luc1-18/+18
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I9ff7abda9961d92c98ab08c77e79406644c115fc
2022-11-25nginx: new stable 1.22.1 versionViliam Luc1-18/+18
- removed old 1_15_0 - removed old 1_14_2 + updated job_specs Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: Ie75cde28f485b809fe08f808f4fa7d31d52c3929
2022-11-07job-spec: Add wireguard test to regressionYulong Pei4-0/+252
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I36f864b9ee36bf2d8107bd92101b639bc48a555e
2022-10-26fix(job_specs): T-Rex jobspmikus4-38/+62
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I1641dcd2bfcacec25af92b9b85c3dad3bdf2f0e0
2022-10-03job-spec: Run hoststack on 3n-icx e810xxTibor Frank1-9/+9
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I1bfbe49380abeccef160efc99b10082b476a1606
2022-09-23job-spec: Add trex 1n-awsTibor Frank4-62/+58
- iterative and coverage - mrr and ndrpdr - mlr weekly Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Icb19efc5c831a0fa2e0cf82065b74c4af5407082
2022-08-22fix(core): 3n-snr codePeter Mikus1-7/+7
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1ff6ce2eeaf074773f27ce0d4d414c4963a7a2de
2022-08-22fix(core): 3n-snr codePeter Mikus3-174/+173
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I3bc6b42d2135085ea9dfc5a1b2bb53495094428a
2022-08-08Revert "job-spec: Add VSAP and Hoststack to weekly and coverage"Peter Mikus4-41/+79
This reverts commit dc200e7f96297b3bccecb88b4e951b142617734b. Reason for revert: This is breaking results due to test_type variable set to vsap without supporting model and results itself. It makes the output not usable for trending. Change-Id: I1c4fee87e9bcaed6fc010ebbf570f65208519fad Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2022-08-02job-spec: Add VSAP and Hoststack to weekly and coverageTibor Frank4-79/+41
- VSAP: run on 2n-clx - Hoststack: run on 3n-icx Change-Id: I9fb54353b0cb61192769eb46e5e8e6849f6f8887 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-07-25feat(jobspec): improve tput selectionVratko Polak8-120/+96
+ Revert bad edit on 2n-dnv, add 1518b back. + Add 1c ip4base tput everywhere nat44ed tput is tested. + Both tcp and udp. + Use only 1c tests for ip4base tput. + Use the same selection in mrr as in mlr. - 2n-tx2 and 2n-zn2 still have no ASTF tests. - ASTF tests still only tested on xxv710, no 100ge tests yet. Change-Id: I0bfc1fa372c5020f1a6f2f4564c4b44f578ac328 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-07-20fix(jobspec): switch tcp tput back to 100bVratko Polak10-94/+94
Change-Id: Id16649044ac0385d55766197fb921c38009c0da8 Ticket: CSIT-1830 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-07-13feat(docs): Update 3n-snr job_specsPeter Mikus12-40/+271
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1c7ef573038514f1be08ddfc9220df94101c16fb
2022-06-30job-spec: Reduce number of iterative tests for 2n-clxTibor Frank2-16/+0
- For e810cq remove dpdk-vfio-pci L2 100k and 1M scale tests Change-Id: Icded4fdca2720fad7f51cd072ed72fc4a1b4742d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-30job_specs: add wireguard perf tests to regressionYulong Pei2-0/+8
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I9e499df973fd9990ab02fe7008d12e78b2ab089f
2022-06-30job_specs: add IPsec perf tests and GTPU perf tests to regressionYulong Pei2-0/+66
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: If70f910003d8208e08d4dc101ac70b33e7e4162b
2022-06-29job-spec: Reduce number of iterative tests for 2n-clxTibor Frank2-42/+2
- For e810cq use the same dpdk-vfio-pci tests as for xxv710 Change-Id: I5857332fa8f2256b293efd610902d30a015e716d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-15feat(jobspec): Avoid tests affected by CSIT-1830Vratko Polak10-58/+142
+ Replace TCP TPUT 100b tests on xxv710 NICs with 1518b ones. + Keep UDP TPUT tests at 100b for now. + Add both 100b and 1518b TCP TPUT tests to Denverton. + Its x553 NIC is not affected. + That gives us some comparison on how packet size affects performance. Ticket: CSIT-1830 Change-Id: I5544f7ba84d4813148bcad2f9d64634939492647 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-06-15feat(tests): Remove PPS tests.Vratko Polak2-16/+16
+ Delete nat44 pps suites. + Rename ip4base suites, testcases, suite tags (also tg) to -tput. + Also robot tags like UDP_PPS and TCP_PPS. - Keep traffic types and traffic profile names with pps. + They can be renamed in a different change if needed. + Update job specs. - Do not update methodology yet (avoid conflict with another Change). Ticket: CSIT-1829 Change-Id: Ic0dac441f6e8253edce88e057ab7fad1d3814c24 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-05-30feat(docs): Add e810 for 2n-clxPeter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I607ccd5d4b28dca576e40b79285bb2b31a65d76c
2022-05-26feat(docs): Add e810 for 2n-clxPeter Mikus10-37/+393
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I59f9df885907c7ce316e95a65fe98e9637820d01
2022-05-19fix(jobspec): use 100b for tput and pps testsVratko Polak8-116/+116
For TCP tests, 1518b is closer to what the real traffic would be, but as usual we want smaller sizes to stress VPP before filling line. CPS tests remain at 64b. Fixes: 1daa6fdc0bae284dee1b61f34534e59b60b7526a Change-Id: Id16056b63006bb569a600fa1d9e318fd2853a5c8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-04-04feat(core): update 3n-altJuraj Linkeš4-0/+540
Update ansible, topologies, bash scripts and job specs. Change-Id: I834b991f281e0b29b4af9dc37fe8028460298d83 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2022-02-11job-spec: Reduce qty of iterative tests for 2n-clx, 2n-icx, 2n-skxTibor Frank6-284/+6
Reason: - ndrpdr job execution time >> 24hrs Remove: - ip4 and ip6 scale200k tests for dpdk and rdma - ip4 and ip6 scale2m tests for dpdk and rdma - af_xdp tests from NICs other than xxv710 Change-Id: I32fce8f436ae5ebbac8da9a9c670bdcb60abb3d8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-24feat(core): Add ICXPeter Mikus15-965/+1463
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic676d00bd7d3d5d8c244bfd0eb7b10bc74498505
2021-11-19job_specs: update 2n-tx2 daily and reportJuraj Linkeš4-50/+50
Add newly added spd outbound tests with and without flowcache. These new test may result in too many mlr tests, so remove the least needed tests, which are 2m and 1m scale tests. This also unifies which scale tests we run between af_xdp and dpdk tests. Also cleanup all 2n-tx2 job specs. Change-Id: I99bedefcef86f4b921f359f1ebf6c42ebdd8c20f Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-11-03job_specs: add ipsec 40 tunnel sw tests for 3n-skx testbedsMaciek Konstantynowicz2-2/+44
Change-Id: I4bb79bf34f64b1096be9e81586d718dbe283b3cd Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-11-03job_specs: add report_iterative tests to 2n-icx and 3n-icx testbedsMaciek Konstantynowicz4-0/+1344
Assumed icx testbeds equipped only with Intel e810cq 2p100GbE NIC. 2n-icx test set based on 2n-clx job spec. 3n-icx test set based on 3n-skx job spec. Change-Id: I9305693b55008a6a626618122f238bb3e8700fdb Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-10-28fix(Autogen): VSAP driver combinationspmikus1-33/+8
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ieac8cd32009bebbd1a3324a81becfbf3abb814ab
2021-10-27job_specs: remove nat44ed udp and tcp scale 16m session testsMaciek Konstantynowicz4-116/+20
Tests removed from 2n-clx and 2n-skx testbeds for mrr_daily and mlr_weekly performance jobs. Tests are failing due to slower session setup rate and very long ramp up time, too long to be accommodated by CSIT resources. Change-Id: Idac6920d971256553c7c843056c410bf9393b4a3 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-10-27fix(docs): AWS job specspmikus4-8/+38
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I34b1475f0cabe8a6d9f260c77d5a3b10f7ead61c
2021-10-25job-specs: Reduce nr of tests to shorten execution timeTibor Frank10-1034/+18
Removed tests from iterative job-specs (vpp-mlr-00.md and vpp-mrr-00.md): - 2n-clx: - IPv4: af-xdp ip4scale-200k, nat44ed udir except 64512 sessions, - IPv6: af-xdp ip6scale-200k, - l2: af-xdp, - 2n-skx: - IPv4: af-xdp ip4scale-200k, nat44ed udir except 64512 sessions, - IPv6: af-xdp ip6scale-200k, - L2: af-xdp, - 2n-zn2: - ip4scale-(2m,200k), - ip6scale-(2m,200k), - l2bdscale-1m, - all af-xdp - 3n-skx: - container memif - all - ip4scale-(2m,200k,20k), - ip6scale-(2m,200k,20k), - l2bdscale-(1m,100k,10k), - 3n-tsh: - container memif - all - ip4scale-(2m,200k,20k), - ip6scale-(2m,200k,20k), - l2bdscale-(1m,100k,10k) Suggestion: Keep coverage job-specs as they are now. Change-Id: I777f2984b9547406c77d588f663891e9120cf594 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-10-20doc gen: fix doc generatorViliam Luc2-54/+54
Change-Id: I75e836ce728fd333764f17d69813093cb947ef4f Signed-off-by: Viliam Luc <vluc@cisco.com>
2021-10-18feat(job-specs): Adjust AWS executionpmikus4-48/+58
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I7cd62b7da0514b23c632a1f319c2ec6fe653bd9a
2021-10-13job-spec: Remove 3n TRex job specsTibor Frank2-62/+0
- These tests do not work and they are not needed. - Merge after 34036: CSIT: Remove 3n TRex jobs | https://gerrit.fd.io/r/c/ci-management/+/34036 Change-Id: Id94059626f17f346c92240e6ab29da12d427545a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-10-06Bash: Process job-specs without cores and driversTibor Frank4-69/+53
- job-spec for trex tests modified Change-Id: Id04d76648f30baacfa027b182a838d2f681afcec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-09-29job_specs: reduce number of ip4scale2m and driver combinations tested weeklyMaciek Konstantynowicz5-73/+1
Align with daily MRR executions and remove ip4scale2m weekly ndrpdr executions for following: - 2n-clx: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 2n-skx: x710-avf, xxv710-af_xdp - 3n-skx: x710-avf - 2n-tx2: xl710-af_xdp - 2n-zn2: x710-avf, xxv710-af_xdp, cx556a-rdma-core Change-Id: Idc863f763751cff58e715da411c4ce215d89e4b5 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-09-29job_specs: reduce number of ip6scale2m and driver combinations tested daily ↵Maciek Konstantynowicz10-154/+10
and weekly Remove ip6scale2m daily mrr and weekly ndrpdr executions for following: - 2n-clx: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 2n-skx: x710-avf, xxv710-af_xdp - 2n-tx2: xl710-af_xdp - 2n-zn2: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 3n-skx: x710-avf Change-Id: Ie5f335fffafce131e1ecaa6f769f4b110928e0f9 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-09-27job_specs: trex tests addedViliam Luc4-0/+140
Change-Id: I9d0f226d8de0b4ee4f69a14809c9010dc1fb91bb Signed-off-by: Viliam Luc <vluc@cisco.com>