aboutsummaryrefslogtreecommitdiffstats
path: root/docs/job_specs/report_iterative/2n-skx/vpp-mlr-00.md
AgeCommit message (Collapse)AuthorFilesLines
2022-02-11job-spec: Reduce qty of iterative tests for 2n-clx, 2n-icx, 2n-skxTibor Frank1-47/+1
Reason: - ndrpdr job execution time >> 24hrs Remove: - ip4 and ip6 scale200k tests for dpdk and rdma - ip4 and ip6 scale2m tests for dpdk and rdma - af_xdp tests from NICs other than xxv710 Change-Id: I32fce8f436ae5ebbac8da9a9c670bdcb60abb3d8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9256923c6b890771ed17c53cd2896355e84987d0)
2021-10-27job_specs: remove nat44ed udp and tcp scale 16m session testsMaciek Konstantynowicz1-29/+5
Tests removed from 2n-clx and 2n-skx testbeds for mrr_daily and mlr_weekly performance jobs. Tests are failing due to slower session setup rate and very long ramp up time, too long to be accommodated by CSIT resources. Change-Id: Idac6920d971256553c7c843056c410bf9393b4a3 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-10-25job-specs: Reduce nr of tests to shorten execution timeTibor Frank1-64/+1
Removed tests from iterative job-specs (vpp-mlr-00.md and vpp-mrr-00.md): - 2n-clx: - IPv4: af-xdp ip4scale-200k, nat44ed udir except 64512 sessions, - IPv6: af-xdp ip6scale-200k, - l2: af-xdp, - 2n-skx: - IPv4: af-xdp ip4scale-200k, nat44ed udir except 64512 sessions, - IPv6: af-xdp ip6scale-200k, - L2: af-xdp, - 2n-zn2: - ip4scale-(2m,200k), - ip6scale-(2m,200k), - l2bdscale-1m, - all af-xdp - 3n-skx: - container memif - all - ip4scale-(2m,200k,20k), - ip6scale-(2m,200k,20k), - l2bdscale-(1m,100k,10k), - 3n-tsh: - container memif - all - ip4scale-(2m,200k,20k), - ip6scale-(2m,200k,20k), - l2bdscale-(1m,100k,10k) Suggestion: Keep coverage job-specs as they are now. Change-Id: I777f2984b9547406c77d588f663891e9120cf594 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-09-29job_specs: reduce number of ip4scale2m and driver combinations tested weeklyMaciek Konstantynowicz1-16/+0
Align with daily MRR executions and remove ip4scale2m weekly ndrpdr executions for following: - 2n-clx: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 2n-skx: x710-avf, xxv710-af_xdp - 3n-skx: x710-avf - 2n-tx2: xl710-af_xdp - 2n-zn2: x710-avf, xxv710-af_xdp, cx556a-rdma-core Change-Id: Idc863f763751cff58e715da411c4ce215d89e4b5 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-09-29job_specs: reduce number of ip6scale2m and driver combinations tested daily ↵Maciek Konstantynowicz1-17/+1
and weekly Remove ip6scale2m daily mrr and weekly ndrpdr executions for following: - 2n-clx: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 2n-skx: x710-avf, xxv710-af_xdp - 2n-tx2: xl710-af_xdp - 2n-zn2: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 3n-skx: x710-avf Change-Id: Ie5f335fffafce131e1ecaa6f769f4b110928e0f9 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-21job_specs: 2n-skx add af_xdp tests to report_iterative, daily and weekly jobsMaciek Konstantynowicz1-2/+100
- Testbeds covered: 2-node Skylake testbeds. - NICs covered: x710, xxv710. Change-Id: I7747b5680cef05dad92788652c55f180fd93a5d1 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-06-03job_specs: reduce number of weekly ndrpdr testsMaciek Konstantynowicz1-173/+3
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 tests - -pps tests, replaced by -tput tests. - h1-p1-s1 single session tests, unessential combination. - h4096-p63-s258048 tests, unessential scale combination. - ipsec tests - ethip4ipsectptlispgpe. - policy-aes128gcm. - policy-aes128cbc-hmac256sha. - policy-aes128cbc-hmac512sha. - int-aes128cbc-hmac256sha. - scale of - 400tnlsw. - 5000tnlsw. - 20000tnlsw. - 60000tnlsw. Change-Id: I269878218f1ff61e58f9a2d669ebdba7c8dffdbf Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-03-03job-specs: Update durations of jobsTibor Frank1-4/+4
- coverage - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv - iterative - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv Change-Id: Ica79cb68a83bd7cd1f74044c0c464b345778476b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-11Job specs: Add -tput tests to iterativeTibor Frank1-2/+42
- Not touching coverage yet. + Trending stuff should be handled already by symlinks. + Adding to anywhere with -pps tests. + Only nat44ed version. + Because ip4base is stateless. + So -tput will have the same behavior and results as -pps. + Test counts and run duration estimates updated. Change-Id: I4e7ce7e9974c995ccf0a21300fa041031ca81cfc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-05Revert "Job specs: Add -tput tests to iterative"Tibor Frank1-42/+2
This reverts commit 7e70ee38f1debce33df1547c76f22c3fea7887c5. Reason for revert: Faulty tests, those which are running take too much time Change-Id: I690e23cdaf29e2a5b284d156a06b95aa9a689909 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-05Job specs: Add -tput tests to iterativeVratko Polak1-2/+42
- Not touching coverage yet. + Trending stuff should be handled already by symlinks. + Adding to anywhere with -pps tests. + Only nat44ed version. + Because ip4base is stateless. + So -tput will have the same behavior and results as -pps. + Test counts and run duration estimates updated. Change-Id: I8d240bb2e3ed329984a07e7e065881bd2a1fd3e4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-27job-specs: Add rnd testsTibor Frank1-2/+30
Change-Id: I877f46608853401c5226845737ace691e3f393b1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-20job_specs: add geneve testsJan Gelety1-2/+24
Geneve tests added to report_iterative and report_coverage job specifications. - tests with 1024 geneve tunnels added only to report_coverage jobs until fast PAPI is finished Change-Id: I11a12d3c626dd2daf6287440131795daa7f75e48 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-11-04job-spec: Split mrr daily from report iterativeTibor Frank1-59/+59
- enable all NAT44 tests for report iterative Change-Id: Ifc820c3d0b657637bb4569f59ddaecd9aefb8d1d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-10-29job-spec: Add all NAT44 testsTibor Frank1-5/+196
- the specs: - docs/job_specs/report_iterative/2n-clx/vpp-mlr-00.md - docs/job_specs/report_iterative/2n-clx/vpp-mrr-00.md - docs/job_specs/report_iterative/2n-skx/vpp-mlr-00.md - docs/job_specs/report_iterative/2n-skx/vpp-mrr-00.md take too long. We should consider to remove some tests. - the coverage specs were split to three parts Change-Id: I39e2032c76266e159a781d1225cff1a5119d4c85 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-10-19Tests: Remove GBPpmikus1-5/+1
- Specs - Tests - Library - TODO: PAL Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I8890940d56c7a9924d4a5f9365b6bb881610db14
2020-09-23Fix: use nat44 not snat44Jan Gelety1-12/+12
Change-Id: If141566f76d5b2f309953233e693c34fef8ee12f Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-09job_specs: use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44Jan Gelety1-8/+8
Change-Id: Idb7b415995f0a3474e379b0c023f64a96e886a55 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-25job-specs: nat44-deterministc test names changeTibor Frank1-4/+4
Change-Id: I3ff3f10c4c9795dc4d95b3a7d04f73f618e4a2d3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-28Doc: Update durations of test runsTibor Frank1-4/+4
Change-Id: I0652f4483a83954096649fbd92af1fecc4bf0a7d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-02Trending and report alignmentTibor Frank1-0/+390
- use test sets defined in report-iterative also for mrr tests and for mrr_daily and mlr_weekly Change-Id: I47fba2997cddaca934bdebd5fca6936e25332afc Signed-off-by: Tibor Frank <tifrank@cisco.com>