aboutsummaryrefslogtreecommitdiffstats
path: root/docs/job_specs/report_iterative
AgeCommit message (Collapse)AuthorFilesLines
2021-09-29job_specs: reduce number of ip4scale2m and driver combinations tested weeklyMaciek Konstantynowicz5-73/+1
Align with daily MRR executions and remove ip4scale2m weekly ndrpdr executions for following: - 2n-clx: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 2n-skx: x710-avf, xxv710-af_xdp - 3n-skx: x710-avf - 2n-tx2: xl710-af_xdp - 2n-zn2: x710-avf, xxv710-af_xdp, cx556a-rdma-core Change-Id: Idc863f763751cff58e715da411c4ce215d89e4b5 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-09-29job_specs: reduce number of ip6scale2m and driver combinations tested daily ↵Maciek Konstantynowicz10-154/+10
and weekly Remove ip6scale2m daily mrr and weekly ndrpdr executions for following: - 2n-clx: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 2n-skx: x710-avf, xxv710-af_xdp - 2n-tx2: xl710-af_xdp - 2n-zn2: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 3n-skx: x710-avf Change-Id: Ie5f335fffafce131e1ecaa6f769f4b110928e0f9 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-09-27job_specs: trex tests addedViliam Luc4-0/+140
Change-Id: I9d0f226d8de0b4ee4f69a14809c9010dc1fb91bb Signed-off-by: Viliam Luc <vluc@cisco.com>
2021-09-27fix(Job Specs): AWS test case specificationspmikus4-22/+38
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I5c1eea7bb897df957e253c677453ecc2e9c5f14e
2021-09-23job_specs: reduce number of ip4scale2m and driver combinations tested dailyMaciek Konstantynowicz5-77/+5
Remove ip4scale2m daily executions for following: - 2n-clx: x710-avf, xxv710-af_xdp, cx556a-rdma-core - 2n-skx: x710-avf, xxv710-af_xdp - 3n-skx: x710-avf - 2n-tx2: xl710-af_xdp - 2n-zn2: x710-avf, xxv710-af_xdp, cx556a-rdma-core Change-Id: I7d9466ce95f93d5a7b876360ec0357e50def1715 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-09-13FIX: job specspmikus2-18/+8
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: If4f8315994f5374bd66ddad83d3f685e2d44cf53
2021-09-10docs: add mrr tests for weekly execution in 2n-aws and 3n-awsMaciek Konstantynowicz2-4/+30
- Tests: ip4base, ip4scale2m, l2xc. - Core,threads: 1c2t, 2c4t. - Frame sizes: 64B, 1518B. Change-Id: Ic1f1eac21780c834ad67457aa9721b82ad837785 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-21job_specs: 2n-tx2 add af_xdp tests to report_iterative, daily and weekly jobsMaciek Konstantynowicz2-5/+123
- Testbeds covered: 2-node ThunderX2 testbeds. - NICs covered: xl710. Change-Id: Ibff19986168a2da87398709b8ec19b4b1f777fe7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-21job_specs: 2n-skx add af_xdp tests to report_iterative, daily and weekly jobsMaciek Konstantynowicz2-4/+200
- Testbeds covered: 2-node Skylake testbeds. - NICs covered: x710, xxv710. Change-Id: I7747b5680cef05dad92788652c55f180fd93a5d1 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-21job_specs: 2n-zn2 add af_xdp tests to report_iterative, daily and weekly jobsMaciek Konstantynowicz2-5/+200
- Testbeds covered: 2-node Zen2 testbeds. - NICs covered: x710, xxv710. Change-Id: Ie5cd2374dd81bc2fa59400bb8af91dcbf6efb9bf Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-19job-spec: Fix af-xdp mlr iterative job specTibor Frank1-69/+69
Change-Id: I012d504309eea97edac7f11bd22935bb8325f988 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-07-16job_specs: 2n-clx add af_xdp tests to report_iterative, daily and weekly jobsMaciek Konstantynowicz2-7/+201
- Testbeds covered: 2-node Cascadelake testbeds only. - NICs covered: x710, xxv710 only. Change-Id: I3548990a27e5a47b1749bf235da526b3fe2b4353 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-13job-spec: Add hoststack and vsapTibor Frank3-2/+127
+ hoststack + vsap (cps, rps) + add e810cq to common.sh Change-Id: I2e897597d13e488f7324a7b91826ca32fd93c84f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-06-10Add gtpu sw performance test casesxinfeng zhao1-1/+9
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Reviewed-by: Yulong Pei <yulong.pei@intel.com> Change-Id: Ibe4420529192559a3cdbb84e0a67859750a9e0d5
2021-06-03job_specs: reduce number of weekly ndrpdr testsMaciek Konstantynowicz6-754/+108
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 tests - -pps tests, replaced by -tput tests. - h1-p1-s1 single session tests, unessential combination. - h4096-p63-s258048 tests, unessential scale combination. - ipsec tests - ethip4ipsectptlispgpe. - policy-aes128gcm. - policy-aes128cbc-hmac256sha. - policy-aes128cbc-hmac512sha. - int-aes128cbc-hmac256sha. - scale of - 400tnlsw. - 5000tnlsw. - 20000tnlsw. - 60000tnlsw. Change-Id: I269878218f1ff61e58f9a2d669ebdba7c8dffdbf Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-06-03job_specs: reduce number of daily mrr testsMaciek Konstantynowicz6-660/+18
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 tests - -pps tests, replaced by -tput tests. - h1-p1-s1 single session tests, unessential combination. - h4096-p63-s258048 tests, unessential scale combination. - ipsec tests - ethip4ipsectptlispgpe. - policy-aes128gcm. - policy-aes128cbc-hmac256sha. - policy-aes128cbc-hmac512sha. - int-aes128cbc-hmac256sha. - scale of - 400tnlsw. - 5000tnlsw. - 20000tnlsw. - 60000tnlsw. Change-Id: Iccce3e20299b4ac771228a6878b4f0961b0186de Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-06-02Hsw deprecation: Delete 3n-hsw job specsVratko Polak6-747/+0
+ Verify jobs remain available for 3n-hsw. - PAL edits are independent, will be done elsewhere. - Autogen edits to come later. Change-Id: I2d0d1b15cbe49627fa9c5188c70f94156b438b77 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-04-15AWS: Add jobspecsTomas Alexy4-0/+116
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: I93c3d2a25bddc6623c131b5cd1742bb55b1ee7c3
2021-04-09job-spec: Fix job-specsTibor Frank2-2/+0
- remove redundant empty lines - fix the number of tests in job-spec and its duration Change-Id: I50fc0f151dedf7d2e9858ecc3959ab42a243bb1d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-04-07job-specs: Update durations of arm mrr jobsJuraj Linkeš2-4/+4
Update after new policy tests were enabled in iterative 2n-tx2 and 3n-tsh. Change-Id: I53986f8c7ba6cd83c73d7d615da07a32ad99c24b Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-04-01Job specs: add crypto tests to Arm perf jobsJuraj Linkeš4-8/+190
Increase coverage by adding aes128gcm protection mode and policy testcases. Change-Id: I6f9e7b89208397efe4e06a63d3e06caaf19f3b0a Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-03job-specs: Update durations of jobsTibor Frank24-83/+83
- coverage - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv - iterative - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv Change-Id: Ica79cb68a83bd7cd1f74044c0c464b345778476b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-03Job specs: add 2n-tx2 crypto mrr-daily testsJuraj Linkeš2-3/+93
Iteratively increase coverage, but only of mrr-daily tests. Because of time constraints (i.e. we won't have enough time to run all of the tests), only add mrr-daily tests and not ndrpdr iterative/cov tests. For iter tests, add the tests commented out which documents which tests we're omitting from iter runs compared to mrr-daily. Change-Id: I35625a1f67004473305cb752a98a962dcb825e16 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-03job-specs: Fix ipsec schedulerTibor Frank6-56/+56
Change-Id: Ie2b624de84ea193ab744b27ed5eac190a0d5b153 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-24job-spec: Add test suites for crypto sw scheduler engineTibor Frank6-26/+222
Change-Id: I68af8c56f3bd33d0f122f56f1ae60993beb67969 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-22Job specs: add 2n-tx2 memif testsJuraj Linkeš2-6/+42
Iteratively increase coverage. Change-Id: Ia506232e68db70608b415003a031661b73023c03 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-02-19FIX: Use x710 for gso testspmikus3-39/+39
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I13892dda60a6e130ebe7c074ac0a3b429e08ef32
2021-02-19FIX: Naming convention compliancepmikus3-36/+36
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Idcee623abbc5568fc6ca49113bc2ff8add179046
2021-02-19Performance: Add GSO tests to report executionpmikus3-0/+84
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I35b2f786105103f19907d74c4f6cc77d7cd3a5bb
2021-02-11Job specs: Add -tput tests to iterativeTibor Frank4-8/+168
- Not touching coverage yet. + Trending stuff should be handled already by symlinks. + Adding to anywhere with -pps tests. + Only nat44ed version. + Because ip4base is stateless. + So -tput will have the same behavior and results as -pps. + Test counts and run duration estimates updated. Change-Id: I4e7ce7e9974c995ccf0a21300fa041031ca81cfc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-05Revert "Job specs: Add -tput tests to iterative"Tibor Frank4-168/+8
This reverts commit 7e70ee38f1debce33df1547c76f22c3fea7887c5. Reason for revert: Faulty tests, those which are running take too much time Change-Id: I690e23cdaf29e2a5b284d156a06b95aa9a689909 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-05Job specs: Add -tput tests to iterativeVratko Polak4-8/+168
- Not touching coverage yet. + Trending stuff should be handled already by symlinks. + Adding to anywhere with -pps tests. + Only nat44ed version. + Because ip4base is stateless. + So -tput will have the same behavior and results as -pps. + Test counts and run duration estimates updated. Change-Id: I8d240bb2e3ed329984a07e7e065881bd2a1fd3e4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-27job-specs: Add rnd testsTibor Frank12-32/+294
Change-Id: I877f46608853401c5226845737ace691e3f393b1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-20job_specs: add geneve testsJan Gelety6-20/+152
Geneve tests added to report_iterative and report_coverage job specifications. - tests with 1024 geneve tunnels added only to report_coverage jobs until fast PAPI is finished Change-Id: I11a12d3c626dd2daf6287440131795daa7f75e48 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2021-01-19Job specs: Add some ipsec reconf to iterativeVratko Polak1-0/+76
We now have more time for 3n-hsw testbeds. Added only scales of 4, 1000 and 60000 tunnels. Change-Id: I283a816e1440a9fe1f0dea13f954f92b457ea788 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-18job-specs: Fix hoststackTibor Frank1-8/+8
Change-Id: I1e450ec00621c7d0bd5a2fd91491c31eae3481f4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-13job_specs: fix 2n-tx2 ip6 iacldst job specsJuraj Linkeš2-6/+6
Change-Id: Id0f74dd289a05c84f6f0723adcd678f02c7464fa Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-13job_specs: update 2n-tx2 coverage specsJuraj Linkeš2-2/+2
Start out with l2, l3, classifier and acl tests. Change-Id: I0cd781f1858d5461b793f782f8bc6fcde5263b69 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-11tests: add 2n1l l2 acl tests, update 2n-tx2 specsJuraj Linkeš2-98/+26
Modify initialize L2BD ACL keywords to be usable for both 2-node and 3-node topologies and update testsuites accordingly. Add the missing macip T-rex profile. Add classifier tests to 2n-tx2 job specs. Change-Id: I17b84b8fc18ef9a6f275ae0238a0665ac2017f01 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-12-23job_specs: add 2x-tx2 job specsJuraj Linkeš4-0/+412
Add job specs for the new 2n-tx2 performance testbed. Change-Id: Ife1db4caba3ad17286727fed143e0c0556c4a2a4 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-11-11job-spec: update the runs durationsTibor Frank2-8/+8
Change-Id: I6de49b81bd4b75d40c792b044dc46024279d6651 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-11-04job-spec: Split mrr daily from report iterativeTibor Frank4-238/+238
- enable all NAT44 tests for report iterative Change-Id: Ifc820c3d0b657637bb4569f59ddaecd9aefb8d1d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-11-02job-specs: Update the durationsTibor Frank9-36/+36
Change-Id: Ibed3ad934bc4fd03013404e18b5a0d6917499bf8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-10-29job-spec: Add all NAT44 testsTibor Frank4-153/+696
- the specs: - docs/job_specs/report_iterative/2n-clx/vpp-mlr-00.md - docs/job_specs/report_iterative/2n-clx/vpp-mrr-00.md - docs/job_specs/report_iterative/2n-skx/vpp-mlr-00.md - docs/job_specs/report_iterative/2n-skx/vpp-mrr-00.md take too long. We should consider to remove some tests. - the coverage specs were split to three parts Change-Id: I39e2032c76266e159a781d1225cff1a5119d4c85 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-10-19Tests: Remove GBPpmikus6-45/+4
- Specs - Tests - Library - TODO: PAL Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I8890940d56c7a9924d4a5f9365b6bb881610db14
2020-10-02job-spec: Add report_iteratve/3n-hsw/hoststack-00.mdTibor Frank1-0/+41
Change-Id: I98ad76f5e1d1f9b4a7442aa9925ce68869123ac7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-10-02jop-spec: Add NAT44 testsTibor Frank2-16/+206
Add all which we want to run and disable those which are not ready. Change-Id: I649ab290a1deec5d1c7de34a7bbe367d78a1e3ff Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-23Fix: use nat44 not snat44Jan Gelety6-168/+168
Change-Id: If141566f76d5b2f309953233e693c34fef8ee12f Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-09-23Infra: Add 2n-xn2pmikus8-0/+1555
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I2ff6526b5209dabf70c6593f60162d9b8c147014
2020-09-10job-specs: Add NAT44Tibor Frank2-6/+38
Change-Id: If8fbcf6a7720eb75094966b352495d1435f44148 Signed-off-by: Tibor Frank <tifrank@cisco.com>