aboutsummaryrefslogtreecommitdiffstats
path: root/docs/job_specs
AgeCommit message (Collapse)AuthorFilesLines
2021-08-11Infra: Add terraform no-color output.pmikus2-0/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I851e979c9b0db41c83facb92010c1b16885ee5a0
2021-08-09Move AWS jobs specs to mrr_weeklypmikus2-0/+0
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I80c49260dab44fb9a10cb2b93b076fa3b92f692b
2021-07-21job_specs: 2n-tx2 add af_xdp tests to report_iterative, daily and weekly jobsMaciek Konstantynowicz2-5/+123
- Testbeds covered: 2-node ThunderX2 testbeds. - NICs covered: xl710. Change-Id: Ibff19986168a2da87398709b8ec19b4b1f777fe7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-21job_specs: 2n-skx add af_xdp tests to report_iterative, daily and weekly jobsMaciek Konstantynowicz2-4/+200
- Testbeds covered: 2-node Skylake testbeds. - NICs covered: x710, xxv710. Change-Id: I7747b5680cef05dad92788652c55f180fd93a5d1 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-21job_specs: 2n-zn2 add af_xdp tests to report_iterative, daily and weekly jobsMaciek Konstantynowicz2-5/+200
- Testbeds covered: 2-node Zen2 testbeds. - NICs covered: x710, xxv710. Change-Id: Ie5cd2374dd81bc2fa59400bb8af91dcbf6efb9bf Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-19job-spec: Fix af-xdp mlr iterative job specTibor Frank1-69/+69
Change-Id: I012d504309eea97edac7f11bd22935bb8325f988 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-07-16job_specs: 2n-clx add af_xdp tests to report_iterative, daily and weekly jobsMaciek Konstantynowicz2-7/+201
- Testbeds covered: 2-node Cascadelake testbeds only. - NICs covered: x710, xxv710 only. Change-Id: I3548990a27e5a47b1749bf235da526b3fe2b4353 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-13job-spec: Add hoststack and vsapTibor Frank3-2/+127
+ hoststack + vsap (cps, rps) + add e810cq to common.sh Change-Id: I2e897597d13e488f7324a7b91826ca32fd93c84f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-07-08job_specs: 3n-tsh reduce number of report coverage testsMaciek Konstantynowicz18-480/+31
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - -100flows, -100kflows in all acl tests. Change-Id: Ib359c08366768f362c70c184707ab9fde46e1930 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-08job_specs: 3n-dnv reduce number of report coverage testsMaciek Konstantynowicz10-59/+9
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. Change-Id: Icd9aa0b0807b16efc26fc94d6633ab61a6c47d9a Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-08job_specs: 2n-zn2 reduce number of report coverage testsMaciek Konstantynowicz17-336/+15
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 -pps tests, replaced by -tput tests. - nat44 h1-p1-s1 single session tests, unessential combination. - nat44 h4096-p63-s258048 tests, non-essential scale combination. Change-Id: Ia67492b2fd132a64f05a1e8de4cfc136a015fef3 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-08job_specs: 3n-skx reduce number of report coverage testsMaciek Konstantynowicz37-1686/+60
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - -100flows, -100kflows in all acl tests. Change-Id: I3525987726c347be5ffca03dbb82c2b1cf675c2b Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-07job_specs: 2n-tx2 reduce number of report coverage testsMaciek Konstantynowicz14-311/+49
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 -pps tests, replaced by -tput tests. - nat44 h1-p1-s1 single session tests, unessential combination. - nat44 h4096-p63-s258048 tests, non-essential scale combination. Change-Id: Ia2187fa0ba9c8836840aa2fb7d0c335a3b0d91b1 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-07job_specs: 2n-skx reduce number of report coverage testsMaciek Konstantynowicz19-766/+89
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 -pps tests, replaced by -tput tests. - nat44 h1-p1-s1 single session tests, unessential combination. - nat44 h4096-p63-s258048 tests, non-essential scale combination. Change-Id: Iae8612bd09980350b0cf5eb90ea4833296c73fc8 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-07job_specs: 2n-dnv reduce number of report coverage testsMaciek Konstantynowicz6-39/+6
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. Change-Id: Ifb7d256ea0ff4afe18f80baf1e9058d3775e85d4 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-07job_specs: 2n-clx reduce number of report coverage testsMaciek Konstantynowicz19-727/+94
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 -pps tests, replaced by -tput tests. - nat44 h1-p1-s1 single session tests, unessential combination. - nat44 h4096-p63-s258048 tests, non-essential scale combination. Change-Id: I2e2ff96dd727977f55e38f7a388f1afe68096aa9 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-06-16job_specs: reduce number of report coverage tests for ipsecMaciek Konstantynowicz8-597/+23
Remove: - ipsec tests - ethip4ipsectptlispgpe. - policy-aes128gcm. - policy-aes128cbc-hmac256sha. - policy-aes128cbc-hmac512sha. - int-aes128cbc-hmac256sha. - scale of - 400tnlsw. - 5000tnlsw. - 20000tnlsw. - 60000tnlsw. Change-Id: I1443f35b7bf852fd665e8856d05bf04b9827913f Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-06-10Add gtpu sw performance test casesxinfeng zhao1-1/+9
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Reviewed-by: Yulong Pei <yulong.pei@intel.com> Change-Id: Ibe4420529192559a3cdbb84e0a67859750a9e0d5
2021-06-03job_specs: reduce number of weekly ndrpdr testsMaciek Konstantynowicz6-754/+108
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 tests - -pps tests, replaced by -tput tests. - h1-p1-s1 single session tests, unessential combination. - h4096-p63-s258048 tests, unessential scale combination. - ipsec tests - ethip4ipsectptlispgpe. - policy-aes128gcm. - policy-aes128cbc-hmac256sha. - policy-aes128cbc-hmac512sha. - int-aes128cbc-hmac256sha. - scale of - 400tnlsw. - 5000tnlsw. - 20000tnlsw. - 60000tnlsw. Change-Id: I269878218f1ff61e58f9a2d669ebdba7c8dffdbf Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-06-03job_specs: reduce number of daily mrr testsMaciek Konstantynowicz6-660/+18
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 tests - -pps tests, replaced by -tput tests. - h1-p1-s1 single session tests, unessential combination. - h4096-p63-s258048 tests, unessential scale combination. - ipsec tests - ethip4ipsectptlispgpe. - policy-aes128gcm. - policy-aes128cbc-hmac256sha. - policy-aes128cbc-hmac512sha. - int-aes128cbc-hmac256sha. - scale of - 400tnlsw. - 5000tnlsw. - 20000tnlsw. - 60000tnlsw. Change-Id: Iccce3e20299b4ac771228a6878b4f0961b0186de Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-06-02Hsw deprecation: Delete 3n-hsw job specsVratko Polak47-3803/+3
+ Verify jobs remain available for 3n-hsw. - PAL edits are independent, will be done elsewhere. - Autogen edits to come later. Change-Id: I2d0d1b15cbe49627fa9c5188c70f94156b438b77 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-04-15AWS: Add jobspecsTomas Alexy10-0/+178
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: I93c3d2a25bddc6623c131b5cd1742bb55b1ee7c3
2021-04-09job-spec: Fix job-specsTibor Frank3-6/+4
- remove redundant empty lines - fix the number of tests in job-spec and its duration Change-Id: I50fc0f151dedf7d2e9858ecc3959ab42a243bb1d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-04-07job-specs: Update durations of arm mrr jobsJuraj Linkeš2-4/+4
Update after new policy tests were enabled in iterative 2n-tx2 and 3n-tsh. Change-Id: I53986f8c7ba6cd83c73d7d615da07a32ad99c24b Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-04-01Job specs: add crypto tests to Arm perf jobsJuraj Linkeš4-8/+190
Increase coverage by adding aes128gcm protection mode and policy testcases. Change-Id: I6f9e7b89208397efe4e06a63d3e06caaf19f3b0a Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-03job-specs: Update durations of jobsTibor Frank176-695/+695
- coverage - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv - iterative - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv Change-Id: Ica79cb68a83bd7cd1f74044c0c464b345778476b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-03Job specs: add 2n-tx2 crypto mrr-daily testsJuraj Linkeš2-3/+93
Iteratively increase coverage, but only of mrr-daily tests. Because of time constraints (i.e. we won't have enough time to run all of the tests), only add mrr-daily tests and not ndrpdr iterative/cov tests. For iter tests, add the tests commented out which documents which tests we're omitting from iter runs compared to mrr-daily. Change-Id: I35625a1f67004473305cb752a98a962dcb825e16 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-03job-specs: Fix ipsec schedulerTibor Frank6-56/+56
Change-Id: Ie2b624de84ea193ab744b27ed5eac190a0d5b153 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-24job-spec: Add test suites for crypto sw scheduler engineTibor Frank9-26/+874
Change-Id: I68af8c56f3bd33d0f122f56f1ae60993beb67969 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-22Job specs: add 2n-tx2 memif testsJuraj Linkeš2-6/+42
Iteratively increase coverage. Change-Id: Ia506232e68db70608b415003a031661b73023c03 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-02-19FIX: Use x710 for gso testspmikus6-78/+78
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I13892dda60a6e130ebe7c074ac0a3b429e08ef32
2021-02-19FIX: Naming convention compliancepmikus6-72/+72
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Idcee623abbc5568fc6ca49113bc2ff8add179046
2021-02-19Performance: Add GSO tests to report executionpmikus6-0/+219
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I35b2f786105103f19907d74c4f6cc77d7cd3a5bb
2021-02-11Job specs: Add -tput tests to iterativeTibor Frank4-8/+168
- Not touching coverage yet. + Trending stuff should be handled already by symlinks. + Adding to anywhere with -pps tests. + Only nat44ed version. + Because ip4base is stateless. + So -tput will have the same behavior and results as -pps. + Test counts and run duration estimates updated. Change-Id: I4e7ce7e9974c995ccf0a21300fa041031ca81cfc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-09Report: Hide nat44 tput testsTibor Frank1-62/+62
Change-Id: Ia01a4a7b0b70547655ab9c6e463040bc97f1727f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-08job-spec: fix report_coverage/2n-tx2/l2-04.mdTibor Frank1-13/+13
- replace eth-l2bdbasemaclrn-macip-iacl1sl-10kflows by eth-l2bdbasemaclrn-macip-iacl50sl-10kflows Change-Id: Ieaaea1e59533059ceaffe1e3c767d51b4ab7c8d0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-05Revert "Job specs: Add -tput tests to iterative"Tibor Frank4-168/+8
This reverts commit 7e70ee38f1debce33df1547c76f22c3fea7887c5. Reason for revert: Faulty tests, those which are running take too much time Change-Id: I690e23cdaf29e2a5b284d156a06b95aa9a689909 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-05Job specs: Add -tput tests to iterativeVratko Polak4-8/+168
- Not touching coverage yet. + Trending stuff should be handled already by symlinks. + Adding to anywhere with -pps tests. + Only nat44ed version. + Because ip4base is stateless. + So -tput will have the same behavior and results as -pps. + Test counts and run duration estimates updated. Change-Id: I8d240bb2e3ed329984a07e7e065881bd2a1fd3e4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-27job-specs: Add rnd testsTibor Frank22-1149/+783
Change-Id: I877f46608853401c5226845737ace691e3f393b1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-20job_specs: add geneve testsJan Gelety9-20/+407
Geneve tests added to report_iterative and report_coverage job specifications. - tests with 1024 geneve tunnels added only to report_coverage jobs until fast PAPI is finished Change-Id: I11a12d3c626dd2daf6287440131795daa7f75e48 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2021-01-19Job specs: Add some ipsec reconf to iterativeVratko Polak1-0/+76
We now have more time for 3n-hsw testbeds. Added only scales of 4, 1000 and 60000 tunnels. Change-Id: I283a816e1440a9fe1f0dea13f954f92b457ea788 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-18job-specs: Fix hoststackTibor Frank1-8/+8
Change-Id: I1e450ec00621c7d0bd5a2fd91491c31eae3481f4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-13job_specs: fix 2n-tx2 ip6 iacldst job specsJuraj Linkeš2-6/+6
Change-Id: Id0f74dd289a05c84f6f0723adcd678f02c7464fa Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-13job_specs: update 2n-tx2 coverage specsJuraj Linkeš16-344/+509
Start out with l2, l3, classifier and acl tests. Change-Id: I0cd781f1858d5461b793f782f8bc6fcde5263b69 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-11tests: add 2n1l l2 acl tests, update 2n-tx2 specsJuraj Linkeš2-98/+26
Modify initialize L2BD ACL keywords to be usable for both 2-node and 3-node topologies and update testsuites accordingly. Add the missing macip T-rex profile. Add classifier tests to 2n-tx2 job specs. Change-Id: I17b84b8fc18ef9a6f275ae0238a0665ac2017f01 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-04API: deprecated COP APIsTomas Alexy18-268/+268
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: Ifb97088a26f3c2ab2ecee28ed43e6e957a844c64
2020-12-23job_specs: add 2x-tx2 job specsJuraj Linkeš20-1/+1342
Add job specs for the new 2n-tx2 performance testbed. Change-Id: Ife1db4caba3ad17286727fed143e0c0556c4a2a4 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-11-11job-spec: update the runs durationsTibor Frank2-8/+8
Change-Id: I6de49b81bd4b75d40c792b044dc46024279d6651 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-11-09job-specs: Align mrr-daily with report iter for 2n-clx and 2n-skxTibor Frank2-1288/+2
Change-Id: I783f0f055462daa1e8047c6905a17495b8473135 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-11-04job-spec: Split mrr daily from report iterativeTibor Frank6-240/+1526
- enable all NAT44 tests for report iterative Change-Id: Ifc820c3d0b657637bb4569f59ddaecd9aefb8d1d Signed-off-by: Tibor Frank <tifrank@cisco.com>