aboutsummaryrefslogtreecommitdiffstats
path: root/docs/job_specs/report_coverage
AgeCommit message (Collapse)AuthorFilesLines
2021-07-08job_specs: 3n-dnv reduce number of report coverage testsMaciek Konstantynowicz10-59/+9
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. Change-Id: Icd9aa0b0807b16efc26fc94d6633ab61a6c47d9a Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-08job_specs: 2n-zn2 reduce number of report coverage testsMaciek Konstantynowicz17-336/+15
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 -pps tests, replaced by -tput tests. - nat44 h1-p1-s1 single session tests, unessential combination. - nat44 h4096-p63-s258048 tests, non-essential scale combination. Change-Id: Ia67492b2fd132a64f05a1e8de4cfc136a015fef3 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-08job_specs: 3n-skx reduce number of report coverage testsMaciek Konstantynowicz37-1686/+60
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - -100flows, -100kflows in all acl tests. Change-Id: I3525987726c347be5ffca03dbb82c2b1cf675c2b Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-07job_specs: 2n-tx2 reduce number of report coverage testsMaciek Konstantynowicz14-311/+49
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 -pps tests, replaced by -tput tests. - nat44 h1-p1-s1 single session tests, unessential combination. - nat44 h4096-p63-s258048 tests, non-essential scale combination. Change-Id: Ia2187fa0ba9c8836840aa2fb7d0c335a3b0d91b1 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-07job_specs: 2n-skx reduce number of report coverage testsMaciek Konstantynowicz19-766/+89
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 -pps tests, replaced by -tput tests. - nat44 h1-p1-s1 single session tests, unessential combination. - nat44 h4096-p63-s258048 tests, non-essential scale combination. Change-Id: Iae8612bd09980350b0cf5eb90ea4833296c73fc8 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-07job_specs: 2n-dnv reduce number of report coverage testsMaciek Konstantynowicz6-39/+6
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. Change-Id: Ifb7d256ea0ff4afe18f80baf1e9058d3775e85d4 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-07-07job_specs: 2n-clx reduce number of report coverage testsMaciek Konstantynowicz19-727/+94
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 -pps tests, replaced by -tput tests. - nat44 h1-p1-s1 single session tests, unessential combination. - nat44 h4096-p63-s258048 tests, non-essential scale combination. Change-Id: I2e2ff96dd727977f55e38f7a388f1afe68096aa9 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-06-16job_specs: reduce number of report coverage tests for ipsecMaciek Konstantynowicz8-597/+23
Remove: - ipsec tests - ethip4ipsectptlispgpe. - policy-aes128gcm. - policy-aes128cbc-hmac256sha. - policy-aes128cbc-hmac512sha. - int-aes128cbc-hmac256sha. - scale of - 400tnlsw. - 5000tnlsw. - 20000tnlsw. - 60000tnlsw. Change-Id: I1443f35b7bf852fd665e8856d05bf04b9827913f Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-06-02Hsw deprecation: Delete 3n-hsw job specsVratko Polak37-3013/+0
+ Verify jobs remain available for 3n-hsw. - PAL edits are independent, will be done elsewhere. - Autogen edits to come later. Change-Id: I2d0d1b15cbe49627fa9c5188c70f94156b438b77 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-04-15AWS: Add jobspecsTomas Alexy2-0/+58
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: I93c3d2a25bddc6623c131b5cd1742bb55b1ee7c3
2021-04-09job-spec: Fix job-specsTibor Frank1-4/+4
- remove redundant empty lines - fix the number of tests in job-spec and its duration Change-Id: I50fc0f151dedf7d2e9858ecc3959ab42a243bb1d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-03job-specs: Update durations of jobsTibor Frank152-612/+612
- coverage - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv - iterative - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv Change-Id: Ica79cb68a83bd7cd1f74044c0c464b345778476b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-24job-spec: Add test suites for crypto sw scheduler engineTibor Frank3-0/+652
Change-Id: I68af8c56f3bd33d0f122f56f1ae60993beb67969 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-19FIX: Use x710 for gso testspmikus3-39/+39
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I13892dda60a6e130ebe7c074ac0a3b429e08ef32
2021-02-19FIX: Naming convention compliancepmikus3-36/+36
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Idcee623abbc5568fc6ca49113bc2ff8add179046
2021-02-19Performance: Add GSO tests to report executionpmikus3-0/+135
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I35b2f786105103f19907d74c4f6cc77d7cd3a5bb
2021-02-09Report: Hide nat44 tput testsTibor Frank1-62/+62
Change-Id: Ia01a4a7b0b70547655ab9c6e463040bc97f1727f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-08job-spec: fix report_coverage/2n-tx2/l2-04.mdTibor Frank1-13/+13
- replace eth-l2bdbasemaclrn-macip-iacl1sl-10kflows by eth-l2bdbasemaclrn-macip-iacl50sl-10kflows Change-Id: Ieaaea1e59533059ceaffe1e3c767d51b4ab7c8d0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-27job-specs: Add rnd testsTibor Frank8-29/+487
Change-Id: I877f46608853401c5226845737ace691e3f393b1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-20job_specs: add geneve testsJan Gelety3-0/+255
Geneve tests added to report_iterative and report_coverage job specifications. - tests with 1024 geneve tunnels added only to report_coverage jobs until fast PAPI is finished Change-Id: I11a12d3c626dd2daf6287440131795daa7f75e48 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2021-01-13job_specs: update 2n-tx2 coverage specsJuraj Linkeš14-342/+507
Start out with l2, l3, classifier and acl tests. Change-Id: I0cd781f1858d5461b793f782f8bc6fcde5263b69 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-04API: deprecated COP APIsTomas Alexy18-268/+268
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: Ifb97088a26f3c2ab2ecee28ed43e6e957a844c64
2020-12-23job_specs: add 2x-tx2 job specsJuraj Linkeš13-1/+927
Add job specs for the new 2n-tx2 performance testbed. Change-Id: Ife1db4caba3ad17286727fed143e0c0556c4a2a4 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-11-02job-specs: Update the durationsTibor Frank7-28/+28
Change-Id: Ibed3ad934bc4fd03013404e18b5a0d6917499bf8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-10-29job-spec: Add all NAT44 testsTibor Frank6-305/+1095
- the specs: - docs/job_specs/report_iterative/2n-clx/vpp-mlr-00.md - docs/job_specs/report_iterative/2n-clx/vpp-mrr-00.md - docs/job_specs/report_iterative/2n-skx/vpp-mlr-00.md - docs/job_specs/report_iterative/2n-skx/vpp-mrr-00.md take too long. We should consider to remove some tests. - the coverage specs were split to three parts Change-Id: I39e2032c76266e159a781d1225cff1a5119d4c85 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-10-19Tests: Remove GBPpmikus4-74/+4
- Specs - Tests - Library - TODO: PAL Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I8890940d56c7a9924d4a5f9365b6bb881610db14
2020-10-02jop-spec: Add NAT44 testsTibor Frank1-63/+253
Add all which we want to run and disable those which are not ready. Change-Id: I649ab290a1deec5d1c7de34a7bbe367d78a1e3ff Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-23Fix: use nat44 not snat44Jan Gelety4-270/+270
Change-Id: If141566f76d5b2f309953233e693c34fef8ee12f Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-09-23Infra: Add 2n-xn2pmikus16-0/+1915
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I2ff6526b5209dabf70c6593f60162d9b8c147014
2020-09-10job-specs: Add NAT44Tibor Frank2-26/+106
Change-Id: If8fbcf6a7720eb75094966b352495d1435f44148 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-09job_specs: use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44Jan Gelety7-101/+50
Change-Id: Idb7b415995f0a3474e379b0c023f64a96e886a55 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-26job-specs: remove ip4-08.md from 3n-hsw and 3n-skxTibor Frank2-79/+0
- They duplicate specification which is in ip4-01.md files Change-Id: I818e1c165415b1f7d53ed28ffb345f07e6ac0576 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-25Job-specs: Fix the runs durationsTibor Frank2-6/+6
Change-Id: Ifeb5455140e911b804df55b4ceeda26575ae9da9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-25job-specs: nat44-deterministc test names changeTibor Frank4-208/+69
Change-Id: I3ff3f10c4c9795dc4d95b3a7d04f73f618e4a2d3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-28Doc: Update durations of test runsTibor Frank136-514/+514
Change-Id: I0652f4483a83954096649fbd92af1fecc4bf0a7d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-24job-specs: Fix tag l2bdsbasemaclrn --> l2bdbasemaclrnTibor Frank5-162/+162
Change-Id: Icfecc2b9576d1be32c78f6b0019b64d6f401745e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-10Docs: job-specs: dpdk and nfv-density test setsTibor Frank7-282/+7
+ synchronize iter dpdk test sets with coverage dpdk test sets + add iter nfv-density-mrr test sets Change-Id: I759025b6acf860aca9828f9fc1d82ab3a37ec98f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-06-10docs: update 3n-skx job_specs for report_coverageMaciek Konstantynowicz38-1419/+71
Removed tests: - crypto: 1518B 4c, ipsec-policy 2c 4c, ipsec-int-aes128cbc 2c 4c - all non-crypto: 9000B 4c, 9000B 2c, 1518B 4c Change-Id: I50de07ca6e12c3aa86832c1bdc83db4be48fe347 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-06-09docs: update 2n-dnv job_specs for report_coverageMaciek Konstantynowicz7-104/+14
Removed tests: 9000B 4c, 9000B 2c, 1518B 4c. Change-Id: Ica29eda359bfb72f536cbe0c731c1142e5f13125 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-06-09docs: update 3n-hsw job_specs for report_coverageMaciek Konstantynowicz37-1177/+89
Removed for all tests: all packet sizes 4c, 9000B 2c. Corrected NIC names: s/intel-vic1227/cisco-vic1227/, s/intel-vic1385/cisco-vic1385/ Change-Id: I9a5af4f689cbb2576d6f8fd090d13d50ad0b2f04 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-06-09docs: update 2n-skx job_specs for report_coverageMaciek Konstantynowicz16-428/+32
Removed tests: 9000B 4c, 9000B 2c, 1518B 4c. Change-Id: Ia824679e5d1a724a4944676df89ebacc2889b602 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-06-09docs: update 3n-dnv job_specs for report_coverageMaciek Konstantynowicz10-136/+20
Removed tests: 9000B 4c, 9000B 2c, 1518B 4c. Change-Id: I2af4aedc12aeccf6c860b2faf84721d6414b4b55 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-05-29docs: update 2n-clx job_specs for report_coverageMaciek Konstantynowicz16-455/+32
Removed tests: 9000B 4c, 9000B 2c, 1518B 4c. Change-Id: I676062f8ca4c6457f09165310d770d1e18fa59e3 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-05-26Add csit-vpp/dpdk-perf-report-coverage job and job specificationsJan Gelety143-0/+17482
- note: currently dpdk report-coverge test sets are equal to dpdk report-iterative test sets Change-Id: Ib9a718bfea4b24842742f49ee2eca022aa8a08e5 Signed-off-by: Jan Gelety <jgelety@cisco.com>