aboutsummaryrefslogtreecommitdiffstats
path: root/docs/job_specs
AgeCommit message (Collapse)AuthorFilesLines
2021-11-19job_specs: update 2n-tx2 daily and reportJuraj Linkeš18-106/+50
Add newly added spd outbound tests with and without flowcache. These new test may result in too many mlr tests, so remove the least needed tests, which are 2m and 1m scale tests. This also unifies which scale tests we run between af_xdp and dpdk tests. Also cleanup all 2n-tx2 job specs. Change-Id: I99bedefcef86f4b921f359f1ebf6c42ebdd8c20f Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-11-11"fix(job_specs): Remove flow based tests"Peter Mikus1-23/+23
Reason for revert: Fixed Change-Id: Idbafdb953964967276f4f5748c78398a33635e2b Signed-off-by: pmikus <pmikus@cisco.com>
2021-11-03job_specs: add ipsec 40 tunnel sw tests for 3n-skx testbedsMaciek Konstantynowicz2-2/+44
Change-Id: I4bb79bf34f64b1096be9e81586d718dbe283b3cd Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-11-03job_specs: add report_iterative tests to 2n-icx and 3n-icx testbedsMaciek Konstantynowicz4-0/+1344
Assumed icx testbeds equipped only with Intel e810cq 2p100GbE NIC. 2n-icx test set based on 2n-clx job spec. 3n-icx test set based on 3n-skx job spec. Change-Id: I9305693b55008a6a626618122f238bb3e8700fdb Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-10-28fix(Autogen): VSAP driver combinationspmikus1-33/+8
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ieac8cd32009bebbd1a3324a81becfbf3abb814ab
2021-10-27job_specs: remove nat44ed udp and tcp scale 16m session testsMaciek Konstantynowicz4-116/+20
Tests removed from 2n-clx and 2n-skx testbeds for mrr_daily and mlr_weekly performance jobs. Tests are failing due to slower session setup rate and very long ramp up time, too long to be accommodated by CSIT resources. Change-Id: Idac6920d971256553c7c843056c410bf9393b4a3 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-10-27fix(docs): AWS job specspmikus6-13/+58
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I34b1475f0cabe8a6d9f260c77d5a3b10f7ead61c
2021-10-25job-specs: Reduce nr of tests to shorten execution timeTibor Frank10-1034/+18
Removed tests from iterative job-specs (vpp-mlr-00.md and vpp-mrr-00.md): - 2n-clx: - IPv4: af-xdp ip4scale-200k, nat44ed udir except 64512 sessions, - IPv6: af-xdp ip6scale-200k, - l2: af-xdp, - 2n-skx: - IPv4: af-xdp ip4scale-200k, nat44ed udir except 64512 sessions, - IPv6: af-xdp ip6scale-200k, - L2: af-xdp, - 2n-zn2: - ip4scale-(2m,200k), - ip6scale-(2m,200k), - l2bdscale-1m, - all af-xdp - 3n-skx: - container memif - all - ip4scale-(2m,200k,20k), - ip6scale-(2m,200k,20k), - l2bdscale-(1m,100k,10k), - 3n-tsh: - container memif - all - ip4scale-(2m,200k,20k), - ip6scale-(2m,200k,20k), - l2bdscale-(1m,100k,10k) Suggestion: Keep coverage job-specs as they are now. Change-Id: I777f2984b9547406c77d588f663891e9120cf594 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-10-21job-specs: Fix 2n-skx trex coverage job specTibor Frank1-32/+28
Change-Id: I84e998b8dc80b1def40b765325956c6c43e1c6b1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-10-20doc gen: fix doc generatorViliam Luc2-54/+54
Change-Id: I75e836ce728fd333764f17d69813093cb947ef4f Signed-off-by: Viliam Luc <vluc@cisco.com>
2021-10-18fix(job_specs): Remove flow based testspmikus1-23/+23
+ Random tests starts to fail in vpp per patch jobs. + Investigation to take longer, so quick solution. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I4f48c4cdccfcdc81072dcc91af8dc0776cd1312c
2021-10-18feat(job-specs): Adjust AWS executionpmikus6-72/+87
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I7cd62b7da0514b23c632a1f319c2ec6fe653bd9a
2021-10-13job-spec: Remove 3n TRex job specsTibor Frank4-113/+0
- These tests do not work and they are not needed. - Merge after 34036: CSIT: Remove 3n TRex jobs | https://gerrit.fd.io/r/c/ci-management/+/34036 Change-Id: Id94059626f17f346c92240e6ab29da12d427545a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-10-08Add flow test suitesxinfeng zhao1-1/+51
The comms DDP package needs to be installed to support all flow protocols Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Change-Id: I6ab1bd8beb9edb8c9889a0ed9a999080ca3cef3d
2021-10-06Bash: Process job-specs without cores and driversTibor Frank4-69/+53
- job-spec for trex tests modified Change-Id: Id04d76648f30baacfa027b182a838d2f681afcec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-09-29job_specs: reduce number of ip4scale2m and driver combinations tested weeklyMaciek Konstantynowicz5-73/+1
Align with daily MRR executions and remove ip4scale2m weekly ndrpdr executions for following: - 2n-clx: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 2n-skx: x710-avf, xxv710-af_xdp - 3n-skx: x710-avf - 2n-tx2: xl710-af_xdp - 2n-zn2: x710-avf, xxv710-af_xdp, cx556a-rdma-core Change-Id: Idc863f763751cff58e715da411c4ce215d89e4b5 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-09-29job_specs: reduce number of ip6scale2m and driver combinations tested daily ↵Maciek Konstantynowicz10-154/+10
and weekly Remove ip6scale2m daily mrr and weekly ndrpdr executions for following: - 2n-clx: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 2n-skx: x710-avf, xxv710-af_xdp - 2n-tx2: xl710-af_xdp - 2n-zn2: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 3n-skx: x710-avf Change-Id: Ie5f335fffafce131e1ecaa6f769f4b110928e0f9 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-09-27job_specs: trex tests addedViliam Luc8-0/+242
Change-Id: I9d0f226d8de0b4ee4f69a14809c9010dc1fb91bb Signed-off-by: Viliam Luc <vluc@cisco.com>
2021-09-27fix(Job Specs): AWS test case specificationspmikus8-80/+112
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I5c1eea7bb897df957e253c677453ecc2e9c5f14e
2021-09-23job_specs: reduce number of ip4scale2m and driver combinations tested dailyMaciek Konstantynowicz5-77/+5
Remove ip4scale2m daily executions for following: - 2n-clx: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 2n-skx: x710-avf, xxv710-af_xdp - 3n-skx: x710-avf - 2n-tx2: xl710-af_xdp - 2n-zn2: x710-avf, xxv710-af_xdp, cx556a-rdma-core Change-Id: I7d9466ce95f93d5a7b876360ec0357e50def1715 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-09-13FIX: job specspmikus2-18/+8
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: If4f8315994f5374bd66ddad83d3f685e2d44cf53
2021-09-10docs: add mrr tests for weekly execution in 2n-aws and 3n-awsMaciek Konstantynowicz2-4/+30
- Tests: ip4base, ip4scale2m, l2xc. - Core,threads: 1c2t, 2c4t. - Frame sizes: 64B, 1518B. Change-Id: Ic1f1eac21780c834ad67457aa9721b82ad837785 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-08-20FIX: job specspmikus2-24/+24
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I190321b8758e87750f8ca684362bb84542bbdfac
2021-08-19vpp_device: Multiple NICs (suitegen)pmikus2-0/+316
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I81958fbf6ef240d53a0fb8708ca882baf02f606c
2021-08-11Infra: Add terraform no-color output.pmikus2-0/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I851e979c9b0db41c83facb92010c1b16885ee5a0
2021-08-09Move AWS jobs specs to mrr_weeklypmikus2-0/+0
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I80c49260dab44fb9a10cb2b93b076fa3b92f692b
2021-07-21job_specs: 2n-tx2 add af_xdp tests to report_iterative, daily and weekly jobsMaciek Konstantynowicz2-5/+123
- Testbeds covered: 2-node ThunderX2 testbeds. - NICs covered: xl710. Change-Id: Ibff19986168a2da87398709b8ec19b4b1f777fe7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-21job_specs: 2n-skx add af_xdp tests to report_iterative, daily and weekly jobsMaciek Konstantynowicz2-4/+200
- Testbeds covered: 2-node Skylake testbeds. - NICs covered: x710, xxv710. Change-Id: I7747b5680cef05dad92788652c55f180fd93a5d1 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-21job_specs: 2n-zn2 add af_xdp tests to report_iterative, daily and weekly jobsMaciek Konstantynowicz2-5/+200
- Testbeds covered: 2-node Zen2 testbeds. - NICs covered: x710, xxv710. Change-Id: Ie5cd2374dd81bc2fa59400bb8af91dcbf6efb9bf Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-19job-spec: Fix af-xdp mlr iterative job specTibor Frank1-69/+69
Change-Id: I012d504309eea97edac7f11bd22935bb8325f988 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-07-16job_specs: 2n-clx add af_xdp tests to report_iterative, daily and weekly jobsMaciek Konstantynowicz2-7/+201
- Testbeds covered: 2-node Cascadelake testbeds only. - NICs covered: x710, xxv710 only. Change-Id: I3548990a27e5a47b1749bf235da526b3fe2b4353 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-13job-spec: Add hoststack and vsapTibor Frank3-2/+127
+ hoststack + vsap (cps, rps) + add e810cq to common.sh Change-Id: I2e897597d13e488f7324a7b91826ca32fd93c84f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-07-08job_specs: 3n-tsh reduce number of report coverage testsMaciek Konstantynowicz18-480/+31
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - -100flows, -100kflows in all acl tests. Change-Id: Ib359c08366768f362c70c184707ab9fde46e1930 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-08job_specs: 3n-dnv reduce number of report coverage testsMaciek Konstantynowicz10-59/+9
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. Change-Id: Icd9aa0b0807b16efc26fc94d6633ab61a6c47d9a Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-08job_specs: 2n-zn2 reduce number of report coverage testsMaciek Konstantynowicz17-336/+15
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 -pps tests, replaced by -tput tests. - nat44 h1-p1-s1 single session tests, unessential combination. - nat44 h4096-p63-s258048 tests, non-essential scale combination. Change-Id: Ia67492b2fd132a64f05a1e8de4cfc136a015fef3 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-08job_specs: 3n-skx reduce number of report coverage testsMaciek Konstantynowicz37-1686/+60
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - -100flows, -100kflows in all acl tests. Change-Id: I3525987726c347be5ffca03dbb82c2b1cf675c2b Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-07job_specs: 2n-tx2 reduce number of report coverage testsMaciek Konstantynowicz14-311/+49
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 -pps tests, replaced by -tput tests. - nat44 h1-p1-s1 single session tests, unessential combination. - nat44 h4096-p63-s258048 tests, non-essential scale combination. Change-Id: Ia2187fa0ba9c8836840aa2fb7d0c335a3b0d91b1 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-07job_specs: 2n-skx reduce number of report coverage testsMaciek Konstantynowicz19-766/+89
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 -pps tests, replaced by -tput tests. - nat44 h1-p1-s1 single session tests, unessential combination. - nat44 h4096-p63-s258048 tests, non-essential scale combination. Change-Id: Iae8612bd09980350b0cf5eb90ea4833296c73fc8 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-07job_specs: 2n-dnv reduce number of report coverage testsMaciek Konstantynowicz6-39/+6
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. Change-Id: Ifb7d256ea0ff4afe18f80baf1e9058d3775e85d4 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-07job_specs: 2n-clx reduce number of report coverage testsMaciek Konstantynowicz19-727/+94
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 -pps tests, replaced by -tput tests. - nat44 h1-p1-s1 single session tests, unessential combination. - nat44 h4096-p63-s258048 tests, non-essential scale combination. Change-Id: I2e2ff96dd727977f55e38f7a388f1afe68096aa9 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-06-16job_specs: reduce number of report coverage tests for ipsecMaciek Konstantynowicz8-597/+23
Remove: - ipsec tests - ethip4ipsectptlispgpe. - policy-aes128gcm. - policy-aes128cbc-hmac256sha. - policy-aes128cbc-hmac512sha. - int-aes128cbc-hmac256sha. - scale of - 400tnlsw. - 5000tnlsw. - 20000tnlsw. - 60000tnlsw. Change-Id: I1443f35b7bf852fd665e8856d05bf04b9827913f Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-06-10Add gtpu sw performance test casesxinfeng zhao1-1/+9
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Reviewed-by: Yulong Pei <yulong.pei@intel.com> Change-Id: Ibe4420529192559a3cdbb84e0a67859750a9e0d5
2021-06-03job_specs: reduce number of weekly ndrpdr testsMaciek Konstantynowicz6-754/+108
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 tests - -pps tests, replaced by -tput tests. - h1-p1-s1 single session tests, unessential combination. - h4096-p63-s258048 tests, unessential scale combination. - ipsec tests - ethip4ipsectptlispgpe. - policy-aes128gcm. - policy-aes128cbc-hmac256sha. - policy-aes128cbc-hmac512sha. - int-aes128cbc-hmac256sha. - scale of - 400tnlsw. - 5000tnlsw. - 20000tnlsw. - 60000tnlsw. Change-Id: I269878218f1ff61e58f9a2d669ebdba7c8dffdbf Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-06-03job_specs: reduce number of daily mrr testsMaciek Konstantynowicz6-660/+18
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 tests - -pps tests, replaced by -tput tests. - h1-p1-s1 single session tests, unessential combination. - h4096-p63-s258048 tests, unessential scale combination. - ipsec tests - ethip4ipsectptlispgpe. - policy-aes128gcm. - policy-aes128cbc-hmac256sha. - policy-aes128cbc-hmac512sha. - int-aes128cbc-hmac256sha. - scale of - 400tnlsw. - 5000tnlsw. - 20000tnlsw. - 60000tnlsw. Change-Id: Iccce3e20299b4ac771228a6878b4f0961b0186de Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-06-02Hsw deprecation: Delete 3n-hsw job specsVratko Polak47-3803/+3
+ Verify jobs remain available for 3n-hsw. - PAL edits are independent, will be done elsewhere. - Autogen edits to come later. Change-Id: I2d0d1b15cbe49627fa9c5188c70f94156b438b77 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-04-15AWS: Add jobspecsTomas Alexy10-0/+178
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: I93c3d2a25bddc6623c131b5cd1742bb55b1ee7c3
2021-04-09job-spec: Fix job-specsTibor Frank3-6/+4
- remove redundant empty lines - fix the number of tests in job-spec and its duration Change-Id: I50fc0f151dedf7d2e9858ecc3959ab42a243bb1d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-04-07job-specs: Update durations of arm mrr jobsJuraj Linkeš2-4/+4
Update after new policy tests were enabled in iterative 2n-tx2 and 3n-tsh. Change-Id: I53986f8c7ba6cd83c73d7d615da07a32ad99c24b Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-04-01Job specs: add crypto tests to Arm perf jobsJuraj Linkeš4-8/+190
Increase coverage by adding aes128gcm protection mode and policy testcases. Change-Id: I6f9e7b89208397efe4e06a63d3e06caaf19f3b0a Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-03job-specs: Update durations of jobsTibor Frank176-695/+695
- coverage - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv - iterative - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv Change-Id: Ica79cb68a83bd7cd1f74044c0c464b345778476b Signed-off-by: Tibor Frank <tifrank@cisco.com>