aboutsummaryrefslogtreecommitdiffstats
path: root/docs/job_specs/report_iterative/2n-skx
AgeCommit message (Collapse)AuthorFilesLines
2023-01-19fix(docs): Cleanup job_specspmikus9-1362/+0
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Iccccda3b7909adb9fc330b2d3454a7c429e4cf8f
2022-09-23job-spec: Add trex 1n-awsTibor Frank2-62/+0
- iterative and coverage - mrr and ndrpdr - mlr weekly Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Icb19efc5c831a0fa2e0cf82065b74c4af5407082
2022-07-25feat(jobspec): improve tput selectionVratko Polak2-24/+24
+ Revert bad edit on 2n-dnv, add 1518b back. + Add 1c ip4base tput everywhere nat44ed tput is tested. + Both tcp and udp. + Use only 1c tests for ip4base tput. + Use the same selection in mrr as in mlr. - 2n-tx2 and 2n-zn2 still have no ASTF tests. - ASTF tests still only tested on xxv710, no 100ge tests yet. Change-Id: I0bfc1fa372c5020f1a6f2f4564c4b44f578ac328 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-07-20fix(jobspec): switch tcp tput back to 100bVratko Polak4-22/+22
Change-Id: Id16649044ac0385d55766197fb921c38009c0da8 Ticket: CSIT-1830 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-06-15feat(jobspec): Avoid tests affected by CSIT-1830Vratko Polak4-22/+22
+ Replace TCP TPUT 100b tests on xxv710 NICs with 1518b ones. + Keep UDP TPUT tests at 100b for now. + Add both 100b and 1518b TCP TPUT tests to Denverton. + Its x553 NIC is not affected. + That gives us some comparison on how packet size affects performance. Ticket: CSIT-1830 Change-Id: I5544f7ba84d4813148bcad2f9d64634939492647 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-06-15feat(tests): Remove PPS tests.Vratko Polak2-16/+16
+ Delete nat44 pps suites. + Rename ip4base suites, testcases, suite tags (also tg) to -tput. + Also robot tags like UDP_PPS and TCP_PPS. - Keep traffic types and traffic profile names with pps. + They can be renamed in a different change if needed. + Update job specs. - Do not update methodology yet (avoid conflict with another Change). Ticket: CSIT-1829 Change-Id: Ic0dac441f6e8253edce88e057ab7fad1d3814c24 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-05-19fix(jobspec): use 100b for tput and pps testsVratko Polak4-44/+44
For TCP tests, 1518b is closer to what the real traffic would be, but as usual we want smaller sizes to stress VPP before filling line. CPS tests remain at 64b. Fixes: 1daa6fdc0bae284dee1b61f34534e59b60b7526a Change-Id: Id16056b63006bb569a600fa1d9e318fd2853a5c8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-02-11job-spec: Reduce qty of iterative tests for 2n-clx, 2n-icx, 2n-skxTibor Frank2-94/+2
Reason: - ndrpdr job execution time >> 24hrs Remove: - ip4 and ip6 scale200k tests for dpdk and rdma - ip4 and ip6 scale2m tests for dpdk and rdma - af_xdp tests from NICs other than xxv710 Change-Id: I32fce8f436ae5ebbac8da9a9c670bdcb60abb3d8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-10-27job_specs: remove nat44ed udp and tcp scale 16m session testsMaciek Konstantynowicz2-58/+10
Tests removed from 2n-clx and 2n-skx testbeds for mrr_daily and mlr_weekly performance jobs. Tests are failing due to slower session setup rate and very long ramp up time, too long to be accommodated by CSIT resources. Change-Id: Idac6920d971256553c7c843056c410bf9393b4a3 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-10-25job-specs: Reduce nr of tests to shorten execution timeTibor Frank2-128/+2
Removed tests from iterative job-specs (vpp-mlr-00.md and vpp-mrr-00.md): - 2n-clx: - IPv4: af-xdp ip4scale-200k, nat44ed udir except 64512 sessions, - IPv6: af-xdp ip6scale-200k, - l2: af-xdp, - 2n-skx: - IPv4: af-xdp ip4scale-200k, nat44ed udir except 64512 sessions, - IPv6: af-xdp ip6scale-200k, - L2: af-xdp, - 2n-zn2: - ip4scale-(2m,200k), - ip6scale-(2m,200k), - l2bdscale-1m, - all af-xdp - 3n-skx: - container memif - all - ip4scale-(2m,200k,20k), - ip6scale-(2m,200k,20k), - l2bdscale-(1m,100k,10k), - 3n-tsh: - container memif - all - ip4scale-(2m,200k,20k), - ip6scale-(2m,200k,20k), - l2bdscale-(1m,100k,10k) Suggestion: Keep coverage job-specs as they are now. Change-Id: I777f2984b9547406c77d588f663891e9120cf594 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-10-06Bash: Process job-specs without cores and driversTibor Frank2-34/+26
- job-spec for trex tests modified Change-Id: Id04d76648f30baacfa027b182a838d2f681afcec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-09-29job_specs: reduce number of ip4scale2m and driver combinations tested weeklyMaciek Konstantynowicz1-16/+0
Align with daily MRR executions and remove ip4scale2m weekly ndrpdr executions for following: - 2n-clx: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 2n-skx: x710-avf, xxv710-af_xdp - 3n-skx: x710-avf - 2n-tx2: xl710-af_xdp - 2n-zn2: x710-avf, xxv710-af_xdp, cx556a-rdma-core Change-Id: Idc863f763751cff58e715da411c4ce215d89e4b5 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-09-29job_specs: reduce number of ip6scale2m and driver combinations tested daily ↵Maciek Konstantynowicz2-34/+2
and weekly Remove ip6scale2m daily mrr and weekly ndrpdr executions for following: - 2n-clx: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 2n-skx: x710-avf, xxv710-af_xdp - 2n-tx2: xl710-af_xdp - 2n-zn2: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 3n-skx: x710-avf Change-Id: Ie5f335fffafce131e1ecaa6f769f4b110928e0f9 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-09-27job_specs: trex tests addedViliam Luc2-0/+70
Change-Id: I9d0f226d8de0b4ee4f69a14809c9010dc1fb91bb Signed-off-by: Viliam Luc <vluc@cisco.com>
2021-09-23job_specs: reduce number of ip4scale2m and driver combinations tested dailyMaciek Konstantynowicz1-17/+1
Remove ip4scale2m daily executions for following: - 2n-clx: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 2n-skx: x710-avf, xxv710-af_xdp - 3n-skx: x710-avf - 2n-tx2: xl710-af_xdp - 2n-zn2: x710-avf, xxv710-af_xdp, cx556a-rdma-core Change-Id: I7d9466ce95f93d5a7b876360ec0357e50def1715 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-21job_specs: 2n-skx add af_xdp tests to report_iterative, daily and weekly jobsMaciek Konstantynowicz2-4/+200
- Testbeds covered: 2-node Skylake testbeds. - NICs covered: x710, xxv710. Change-Id: I7747b5680cef05dad92788652c55f180fd93a5d1 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-06-03job_specs: reduce number of weekly ndrpdr testsMaciek Konstantynowicz1-173/+3
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 tests - -pps tests, replaced by -tput tests. - h1-p1-s1 single session tests, unessential combination. - h4096-p63-s258048 tests, unessential scale combination. - ipsec tests - ethip4ipsectptlispgpe. - policy-aes128gcm. - policy-aes128cbc-hmac256sha. - policy-aes128cbc-hmac512sha. - int-aes128cbc-hmac256sha. - scale of - 400tnlsw. - 5000tnlsw. - 20000tnlsw. - 60000tnlsw. Change-Id: I269878218f1ff61e58f9a2d669ebdba7c8dffdbf Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-06-03job_specs: reduce number of daily mrr testsMaciek Konstantynowicz1-173/+3
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 tests - -pps tests, replaced by -tput tests. - h1-p1-s1 single session tests, unessential combination. - h4096-p63-s258048 tests, unessential scale combination. - ipsec tests - ethip4ipsectptlispgpe. - policy-aes128gcm. - policy-aes128cbc-hmac256sha. - policy-aes128cbc-hmac512sha. - int-aes128cbc-hmac256sha. - scale of - 400tnlsw. - 5000tnlsw. - 20000tnlsw. - 60000tnlsw. Change-Id: Iccce3e20299b4ac771228a6878b4f0961b0186de Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-03-03job-specs: Update durations of jobsTibor Frank5-20/+20
- coverage - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv - iterative - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv Change-Id: Ica79cb68a83bd7cd1f74044c0c464b345778476b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-19FIX: Use x710 for gso testspmikus1-13/+13
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I13892dda60a6e130ebe7c074ac0a3b429e08ef32
2021-02-19FIX: Naming convention compliancepmikus1-12/+12
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Idcee623abbc5568fc6ca49113bc2ff8add179046
2021-02-19Performance: Add GSO tests to report executionpmikus1-0/+28
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I35b2f786105103f19907d74c4f6cc77d7cd3a5bb
2021-02-11Job specs: Add -tput tests to iterativeTibor Frank2-4/+84
- Not touching coverage yet. + Trending stuff should be handled already by symlinks. + Adding to anywhere with -pps tests. + Only nat44ed version. + Because ip4base is stateless. + So -tput will have the same behavior and results as -pps. + Test counts and run duration estimates updated. Change-Id: I4e7ce7e9974c995ccf0a21300fa041031ca81cfc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-05Revert "Job specs: Add -tput tests to iterative"Tibor Frank2-84/+4
This reverts commit 7e70ee38f1debce33df1547c76f22c3fea7887c5. Reason for revert: Faulty tests, those which are running take too much time Change-Id: I690e23cdaf29e2a5b284d156a06b95aa9a689909 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-05Job specs: Add -tput tests to iterativeVratko Polak2-4/+84
- Not touching coverage yet. + Trending stuff should be handled already by symlinks. + Adding to anywhere with -pps tests. + Only nat44ed version. + Because ip4base is stateless. + So -tput will have the same behavior and results as -pps. + Test counts and run duration estimates updated. Change-Id: I8d240bb2e3ed329984a07e7e065881bd2a1fd3e4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-27job-specs: Add rnd testsTibor Frank2-4/+60
Change-Id: I877f46608853401c5226845737ace691e3f393b1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-20job_specs: add geneve testsJan Gelety2-6/+50
Geneve tests added to report_iterative and report_coverage job specifications. - tests with 1024 geneve tunnels added only to report_coverage jobs until fast PAPI is finished Change-Id: I11a12d3c626dd2daf6287440131795daa7f75e48 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-11-11job-spec: update the runs durationsTibor Frank1-4/+4
Change-Id: I6de49b81bd4b75d40c792b044dc46024279d6651 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-11-04job-spec: Split mrr daily from report iterativeTibor Frank2-119/+119
- enable all NAT44 tests for report iterative Change-Id: Ifc820c3d0b657637bb4569f59ddaecd9aefb8d1d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-11-02job-specs: Update the durationsTibor Frank2-8/+8
Change-Id: Ibed3ad934bc4fd03013404e18b5a0d6917499bf8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-10-29job-spec: Add all NAT44 testsTibor Frank2-10/+392
- the specs: - docs/job_specs/report_iterative/2n-clx/vpp-mlr-00.md - docs/job_specs/report_iterative/2n-clx/vpp-mrr-00.md - docs/job_specs/report_iterative/2n-skx/vpp-mlr-00.md - docs/job_specs/report_iterative/2n-skx/vpp-mrr-00.md take too long. We should consider to remove some tests. - the coverage specs were split to three parts Change-Id: I39e2032c76266e159a781d1225cff1a5119d4c85 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-10-19Tests: Remove GBPpmikus2-10/+2
- Specs - Tests - Library - TODO: PAL Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I8890940d56c7a9924d4a5f9365b6bb881610db14
2020-09-23Fix: use nat44 not snat44Jan Gelety2-24/+24
Change-Id: If141566f76d5b2f309953233e693c34fef8ee12f Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-09job_specs: use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44Jan Gelety2-16/+16
Change-Id: Idb7b415995f0a3474e379b0c023f64a96e886a55 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-25job-specs: nat44-deterministc test names changeTibor Frank2-8/+8
Change-Id: I3ff3f10c4c9795dc4d95b3a7d04f73f618e4a2d3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-28Doc: Update durations of test runsTibor Frank8-24/+32
Change-Id: I0652f4483a83954096649fbd92af1fecc4bf0a7d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-17job-specs: Align 2n-skx nfv tests with 2n-clxTibor Frank2-368/+4
Change-Id: I6c828ee146bab8ebdb24be6b03369f6e772d25c8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-10Docs: job-specs: dpdk and nfv-density test setsTibor Frank3-14/+327
+ synchronize iter dpdk test sets with coverage dpdk test sets + add iter nfv-density-mrr test sets Change-Id: I759025b6acf860aca9828f9fc1d82ab3a37ec98f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-02Trending and report alignmentTibor Frank2-0/+0
- use test sets defined in report-iterative also for mrr tests and for mrr_daily and mlr_weekly Change-Id: I47fba2997cddaca934bdebd5fca6936e25332afc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-01docs: added mrr tests for vpp and dpdk to job_specs/report_iterativeMaciek Konstantynowicz2-0/+416
Change-Id: Ie8fca17baa114fcdf5916e65311716a86e791709 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-06-11docs: update 2n-skx job_specs for report_iterativeMaciek Konstantynowicz2-373/+328
Changes in vpp-2n-skx.md: - all nfv_density moved to separate file vpp-2n-skx-nfv-density.md - removed intel-x710: dot1q - removed drv_vfio_pci: vts, dot1q - Rebased on https://gerrit.fd.io/r/c/csit/+/27495 - *.md files moved to docs/job_specs/report_iterative/2n-skx/ and renamed Change-Id: Iff16f6673ea3d829c44fbd04d892abb845fa4c1e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-06-11Update selection of report-iterative test setsTibor Frank4-0/+926
- Create the same directory structure for report-iterative as it is for report-coverage. - Move files from report-iterative directory to created sub-directories. - Rename the moved files to keep the convention defined in report-coverage. - Update the corresponding functionality in resources/libraries/bash/function/common.sh The patches: - https://gerrit.fd.io/r/c/csit/+/27486 - https://gerrit.fd.io/r/c/csit/+/27484 - https://gerrit.fd.io/r/c/csit/+/27485 must be updated. Change-Id: I1aaf22690e3df5abf56893bb1d2d380debc54ddd Signed-off-by: Tibor Frank <tifrank@cisco.com>