aboutsummaryrefslogtreecommitdiffstats
path: root/docs/job_specs/report_iterative/2n-skx
AgeCommit message (Collapse)AuthorFilesLines
2022-02-11job-spec: Reduce qty of iterative tests for 2n-clx, 2n-icx, 2n-skxTibor Frank2-94/+2
Reason: - ndrpdr job execution time >> 24hrs Remove: - ip4 and ip6 scale200k tests for dpdk and rdma - ip4 and ip6 scale2m tests for dpdk and rdma - af_xdp tests from NICs other than xxv710 Change-Id: I32fce8f436ae5ebbac8da9a9c670bdcb60abb3d8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9256923c6b890771ed17c53cd2896355e84987d0)
2021-10-27job_specs: remove nat44ed udp and tcp scale 16m session testsMaciek Konstantynowicz2-58/+10
Tests removed from 2n-clx and 2n-skx testbeds for mrr_daily and mlr_weekly performance jobs. Tests are failing due to slower session setup rate and very long ramp up time, too long to be accommodated by CSIT resources. Change-Id: Idac6920d971256553c7c843056c410bf9393b4a3 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-10-25job-specs: Reduce nr of tests to shorten execution timeTibor Frank2-128/+2
Removed tests from iterative job-specs (vpp-mlr-00.md and vpp-mrr-00.md): - 2n-clx: - IPv4: af-xdp ip4scale-200k, nat44ed udir except 64512 sessions, - IPv6: af-xdp ip6scale-200k, - l2: af-xdp, - 2n-skx: - IPv4: af-xdp ip4scale-200k, nat44ed udir except 64512 sessions, - IPv6: af-xdp ip6scale-200k, - L2: af-xdp, - 2n-zn2: - ip4scale-(2m,200k), - ip6scale-(2m,200k), - l2bdscale-1m, - all af-xdp - 3n-skx: - container memif - all - ip4scale-(2m,200k,20k), - ip6scale-(2m,200k,20k), - l2bdscale-(1m,100k,10k), - 3n-tsh: - container memif - all - ip4scale-(2m,200k,20k), - ip6scale-(2m,200k,20k), - l2bdscale-(1m,100k,10k) Suggestion: Keep coverage job-specs as they are now. Change-Id: I777f2984b9547406c77d588f663891e9120cf594 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-10-06Bash: Process job-specs without cores and driversTibor Frank2-34/+26
- job-spec for trex tests modified Change-Id: Id04d76648f30baacfa027b182a838d2f681afcec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-09-29job_specs: reduce number of ip4scale2m and driver combinations tested weeklyMaciek Konstantynowicz1-16/+0
Align with daily MRR executions and remove ip4scale2m weekly ndrpdr executions for following: - 2n-clx: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 2n-skx: x710-avf, xxv710-af_xdp - 3n-skx: x710-avf - 2n-tx2: xl710-af_xdp - 2n-zn2: x710-avf, xxv710-af_xdp, cx556a-rdma-core Change-Id: Idc863f763751cff58e715da411c4ce215d89e4b5 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-09-29job_specs: reduce number of ip6scale2m and driver combinations tested daily ↵Maciek Konstantynowicz2-34/+2
and weekly Remove ip6scale2m daily mrr and weekly ndrpdr executions for following: - 2n-clx: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 2n-skx: x710-avf, xxv710-af_xdp - 2n-tx2: xl710-af_xdp - 2n-zn2: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 3n-skx: x710-avf Change-Id: Ie5f335fffafce131e1ecaa6f769f4b110928e0f9 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-09-27job_specs: trex tests addedViliam Luc2-0/+70
Change-Id: I9d0f226d8de0b4ee4f69a14809c9010dc1fb91bb Signed-off-by: Viliam Luc <vluc@cisco.com>
2021-09-23job_specs: reduce number of ip4scale2m and driver combinations tested dailyMaciek Konstantynowicz1-17/+1
Remove ip4scale2m daily executions for following: - 2n-clx: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 2n-skx: x710-avf, xxv710-af_xdp - 3n-skx: x710-avf - 2n-tx2: xl710-af_xdp - 2n-zn2: x710-avf, xxv710-af_xdp, cx556a-rdma-core Change-Id: I7d9466ce95f93d5a7b876360ec0357e50def1715 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-21job_specs: 2n-skx add af_xdp tests to report_iterative, daily and weekly jobsMaciek Konstantynowicz2-4/+200
- Testbeds covered: 2-node Skylake testbeds. - NICs covered: x710, xxv710. Change-Id: I7747b5680cef05dad92788652c55f180fd93a5d1 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-06-03job_specs: reduce number of weekly ndrpdr testsMaciek Konstantynowicz1-173/+3
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 tests - -pps tests, replaced by -tput tests. - h1-p1-s1 single session tests, unessential combination. - h4096-p63-s258048 tests, unessential scale combination. - ipsec tests - ethip4ipsectptlispgpe. - policy-aes128gcm. - policy-aes128cbc-hmac256sha. - policy-aes128cbc-hmac512sha. - int-aes128cbc-hmac256sha. - scale of - 400tnlsw. - 5000tnlsw. - 20000tnlsw. - 60000tnlsw. Change-Id: I269878218f1ff61e58f9a2d669ebdba7c8dffdbf Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-06-03job_specs: reduce number of daily mrr testsMaciek Konstantynowicz1-173/+3
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 tests - -pps tests, replaced by -tput tests. - h1-p1-s1 single session tests, unessential combination. - h4096-p63-s258048 tests, unessential scale combination. - ipsec tests - ethip4ipsectptlispgpe. - policy-aes128gcm. - policy-aes128cbc-hmac256sha. - policy-aes128cbc-hmac512sha. - int-aes128cbc-hmac256sha. - scale of - 400tnlsw. - 5000tnlsw. - 20000tnlsw. - 60000tnlsw. Change-Id: Iccce3e20299b4ac771228a6878b4f0961b0186de Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-03-03job-specs: Update durations of jobsTibor Frank5-20/+20
- coverage - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv - iterative - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv Change-Id: Ica79cb68a83bd7cd1f74044c0c464b345778476b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-19FIX: Use x710 for gso testspmikus1-13/+13
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I13892dda60a6e130ebe7c074ac0a3b429e08ef32
2021-02-19FIX: Naming convention compliancepmikus1-12/+12
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Idcee623abbc5568fc6ca49113bc2ff8add179046
2021-02-19Performance: Add GSO tests to report executionpmikus1-0/+28
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I35b2f786105103f19907d74c4f6cc77d7cd3a5bb
2021-02-11Job specs: Add -tput tests to iterativeTibor Frank2-4/+84
- Not touching coverage yet. + Trending stuff should be handled already by symlinks. + Adding to anywhere with -pps tests. + Only nat44ed version. + Because ip4base is stateless. + So -tput will have the same behavior and results as -pps. + Test counts and run duration estimates updated. Change-Id: I4e7ce7e9974c995ccf0a21300fa041031ca81cfc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-05Revert "Job specs: Add -tput tests to iterative"Tibor Frank2-84/+4
This reverts commit 7e70ee38f1debce33df1547c76f22c3fea7887c5. Reason for revert: Faulty tests, those which are running take too much time Change-Id: I690e23cdaf29e2a5b284d156a06b95aa9a689909 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-05Job specs: Add -tput tests to iterativeVratko Polak2-4/+84
- Not touching coverage yet. + Trending stuff should be handled already by symlinks. + Adding to anywhere with -pps tests. + Only nat44ed version. + Because ip4base is stateless. + So -tput will have the same behavior and results as -pps. + Test counts and run duration estimates updated. Change-Id: I8d240bb2e3ed329984a07e7e065881bd2a1fd3e4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-27job-specs: Add rnd testsTibor Frank2-4/+60
Change-Id: I877f46608853401c5226845737ace691e3f393b1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-20job_specs: add geneve testsJan Gelety2-6/+50
Geneve tests added to report_iterative and report_coverage job specifications. - tests with 1024 geneve tunnels added only to report_coverage jobs until fast PAPI is finished Change-Id: I11a12d3c626dd2daf6287440131795daa7f75e48 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-11-11job-spec: update the runs durationsTibor Frank1-4/+4
Change-Id: I6de49b81bd4b75d40c792b044dc46024279d6651 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-11-04job-spec: Split mrr daily from report iterativeTibor Frank2-119/+119
- enable all NAT44 tests for report iterative Change-Id: Ifc820c3d0b657637bb4569f59ddaecd9aefb8d1d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-11-02job-specs: Update the durationsTibor Frank2-8/+8
Change-Id: Ibed3ad934bc4fd03013404e18b5a0d6917499bf8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-10-29job-spec: Add all NAT44 testsTibor Frank2-10/+392
- the specs: - docs/job_specs/report_iterative/2n-clx/vpp-mlr-00.md - docs/job_specs/report_iterative/2n-clx/vpp-mrr-00.md - docs/job_specs/report_iterative/2n-skx/vpp-mlr-00.md - docs/job_specs/report_iterative/2n-skx/vpp-mrr-00.md take too long. We should consider to remove some tests. - the coverage specs were split to three parts Change-Id: I39e2032c76266e159a781d1225cff1a5119d4c85 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-10-19Tests: Remove GBPpmikus2-10/+2
- Specs - Tests - Library - TODO: PAL Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I8890940d56c7a9924d4a5f9365b6bb881610db14
2020-09-23Fix: use nat44 not snat44Jan Gelety2-24/+24
Change-Id: If141566f76d5b2f309953233e693c34fef8ee12f Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-09job_specs: use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44Jan Gelety2-16/+16
Change-Id: Idb7b415995f0a3474e379b0c023f64a96e886a55 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-25job-specs: nat44-deterministc test names changeTibor Frank2-8/+8
Change-Id: I3ff3f10c4c9795dc4d95b3a7d04f73f618e4a2d3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-28Doc: Update durations of test runsTibor Frank8-24/+32
Change-Id: I0652f4483a83954096649fbd92af1fecc4bf0a7d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-17job-specs: Align 2n-skx nfv tests with 2n-clxTibor Frank2-368/+4
Change-Id: I6c828ee146bab8ebdb24be6b03369f6e772d25c8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-10Docs: job-specs: dpdk and nfv-density test setsTibor Frank3-14/+327
+ synchronize iter dpdk test sets with coverage dpdk test sets + add iter nfv-density-mrr test sets Change-Id: I759025b6acf860aca9828f9fc1d82ab3a37ec98f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-02Trending and report alignmentTibor Frank2-0/+0
- use test sets defined in report-iterative also for mrr tests and for mrr_daily and mlr_weekly Change-Id: I47fba2997cddaca934bdebd5fca6936e25332afc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-01docs: added mrr tests for vpp and dpdk to job_specs/report_iterativeMaciek Konstantynowicz2-0/+416
Change-Id: Ie8fca17baa114fcdf5916e65311716a86e791709 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-06-11docs: update 2n-skx job_specs for report_iterativeMaciek Konstantynowicz2-373/+328
Changes in vpp-2n-skx.md: - all nfv_density moved to separate file vpp-2n-skx-nfv-density.md - removed intel-x710: dot1q - removed drv_vfio_pci: vts, dot1q - Rebased on https://gerrit.fd.io/r/c/csit/+/27495 - *.md files moved to docs/job_specs/report_iterative/2n-skx/ and renamed Change-Id: Iff16f6673ea3d829c44fbd04d892abb845fa4c1e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-06-11Update selection of report-iterative test setsTibor Frank4-0/+926
- Create the same directory structure for report-iterative as it is for report-coverage. - Move files from report-iterative directory to created sub-directories. - Rename the moved files to keep the convention defined in report-coverage. - Update the corresponding functionality in resources/libraries/bash/function/common.sh The patches: - https://gerrit.fd.io/r/c/csit/+/27486 - https://gerrit.fd.io/r/c/csit/+/27484 - https://gerrit.fd.io/r/c/csit/+/27485 must be updated. Change-Id: I1aaf22690e3df5abf56893bb1d2d380debc54ddd Signed-off-by: Tibor Frank <tifrank@cisco.com>