aboutsummaryrefslogtreecommitdiffstats
path: root/docs/job_specs
AgeCommit message (Collapse)AuthorFilesLines
2021-04-09job-spec: Fix job-specsTibor Frank3-6/+4
- remove redundant empty lines - fix the number of tests in job-spec and its duration Change-Id: I50fc0f151dedf7d2e9858ecc3959ab42a243bb1d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-04-07job-specs: Update durations of arm mrr jobsJuraj Linkeš2-4/+4
Update after new policy tests were enabled in iterative 2n-tx2 and 3n-tsh. Change-Id: I53986f8c7ba6cd83c73d7d615da07a32ad99c24b Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-04-01Job specs: add crypto tests to Arm perf jobsJuraj Linkeš4-8/+190
Increase coverage by adding aes128gcm protection mode and policy testcases. Change-Id: I6f9e7b89208397efe4e06a63d3e06caaf19f3b0a Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-03job-specs: Update durations of jobsTibor Frank176-695/+695
- coverage - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv - iterative - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv Change-Id: Ica79cb68a83bd7cd1f74044c0c464b345778476b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-03Job specs: add 2n-tx2 crypto mrr-daily testsJuraj Linkeš2-3/+93
Iteratively increase coverage, but only of mrr-daily tests. Because of time constraints (i.e. we won't have enough time to run all of the tests), only add mrr-daily tests and not ndrpdr iterative/cov tests. For iter tests, add the tests commented out which documents which tests we're omitting from iter runs compared to mrr-daily. Change-Id: I35625a1f67004473305cb752a98a962dcb825e16 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-03job-specs: Fix ipsec schedulerTibor Frank6-56/+56
Change-Id: Ie2b624de84ea193ab744b27ed5eac190a0d5b153 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-24job-spec: Add test suites for crypto sw scheduler engineTibor Frank9-26/+874
Change-Id: I68af8c56f3bd33d0f122f56f1ae60993beb67969 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-22Job specs: add 2n-tx2 memif testsJuraj Linkeš2-6/+42
Iteratively increase coverage. Change-Id: Ia506232e68db70608b415003a031661b73023c03 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-02-19FIX: Use x710 for gso testspmikus6-78/+78
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I13892dda60a6e130ebe7c074ac0a3b429e08ef32
2021-02-19FIX: Naming convention compliancepmikus6-72/+72
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Idcee623abbc5568fc6ca49113bc2ff8add179046
2021-02-19Performance: Add GSO tests to report executionpmikus6-0/+219
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I35b2f786105103f19907d74c4f6cc77d7cd3a5bb
2021-02-11Job specs: Add -tput tests to iterativeTibor Frank4-8/+168
- Not touching coverage yet. + Trending stuff should be handled already by symlinks. + Adding to anywhere with -pps tests. + Only nat44ed version. + Because ip4base is stateless. + So -tput will have the same behavior and results as -pps. + Test counts and run duration estimates updated. Change-Id: I4e7ce7e9974c995ccf0a21300fa041031ca81cfc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-09Report: Hide nat44 tput testsTibor Frank1-62/+62
Change-Id: Ia01a4a7b0b70547655ab9c6e463040bc97f1727f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-08job-spec: fix report_coverage/2n-tx2/l2-04.mdTibor Frank1-13/+13
- replace eth-l2bdbasemaclrn-macip-iacl1sl-10kflows by eth-l2bdbasemaclrn-macip-iacl50sl-10kflows Change-Id: Ieaaea1e59533059ceaffe1e3c767d51b4ab7c8d0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-05Revert "Job specs: Add -tput tests to iterative"Tibor Frank4-168/+8
This reverts commit 7e70ee38f1debce33df1547c76f22c3fea7887c5. Reason for revert: Faulty tests, those which are running take too much time Change-Id: I690e23cdaf29e2a5b284d156a06b95aa9a689909 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-05Job specs: Add -tput tests to iterativeVratko Polak4-8/+168
- Not touching coverage yet. + Trending stuff should be handled already by symlinks. + Adding to anywhere with -pps tests. + Only nat44ed version. + Because ip4base is stateless. + So -tput will have the same behavior and results as -pps. + Test counts and run duration estimates updated. Change-Id: I8d240bb2e3ed329984a07e7e065881bd2a1fd3e4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-27job-specs: Add rnd testsTibor Frank22-1149/+783
Change-Id: I877f46608853401c5226845737ace691e3f393b1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-20job_specs: add geneve testsJan Gelety9-20/+407
Geneve tests added to report_iterative and report_coverage job specifications. - tests with 1024 geneve tunnels added only to report_coverage jobs until fast PAPI is finished Change-Id: I11a12d3c626dd2daf6287440131795daa7f75e48 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2021-01-19Job specs: Add some ipsec reconf to iterativeVratko Polak1-0/+76
We now have more time for 3n-hsw testbeds. Added only scales of 4, 1000 and 60000 tunnels. Change-Id: I283a816e1440a9fe1f0dea13f954f92b457ea788 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-18job-specs: Fix hoststackTibor Frank1-8/+8
Change-Id: I1e450ec00621c7d0bd5a2fd91491c31eae3481f4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-13job_specs: fix 2n-tx2 ip6 iacldst job specsJuraj Linkeš2-6/+6
Change-Id: Id0f74dd289a05c84f6f0723adcd678f02c7464fa Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-13job_specs: update 2n-tx2 coverage specsJuraj Linkeš16-344/+509
Start out with l2, l3, classifier and acl tests. Change-Id: I0cd781f1858d5461b793f782f8bc6fcde5263b69 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-11tests: add 2n1l l2 acl tests, update 2n-tx2 specsJuraj Linkeš2-98/+26
Modify initialize L2BD ACL keywords to be usable for both 2-node and 3-node topologies and update testsuites accordingly. Add the missing macip T-rex profile. Add classifier tests to 2n-tx2 job specs. Change-Id: I17b84b8fc18ef9a6f275ae0238a0665ac2017f01 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-04API: deprecated COP APIsTomas Alexy18-268/+268
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: Ifb97088a26f3c2ab2ecee28ed43e6e957a844c64
2020-12-23job_specs: add 2x-tx2 job specsJuraj Linkeš20-1/+1342
Add job specs for the new 2n-tx2 performance testbed. Change-Id: Ife1db4caba3ad17286727fed143e0c0556c4a2a4 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-11-11job-spec: update the runs durationsTibor Frank2-8/+8
Change-Id: I6de49b81bd4b75d40c792b044dc46024279d6651 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-11-09job-specs: Align mrr-daily with report iter for 2n-clx and 2n-skxTibor Frank2-1288/+2
Change-Id: I783f0f055462daa1e8047c6905a17495b8473135 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-11-04job-spec: Split mrr daily from report iterativeTibor Frank6-240/+1526
- enable all NAT44 tests for report iterative Change-Id: Ifc820c3d0b657637bb4569f59ddaecd9aefb8d1d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-11-02job-specs: Update the durationsTibor Frank16-64/+64
Change-Id: Ibed3ad934bc4fd03013404e18b5a0d6917499bf8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-10-29job-spec: Add all NAT44 testsTibor Frank10-458/+1791
- the specs: - docs/job_specs/report_iterative/2n-clx/vpp-mlr-00.md - docs/job_specs/report_iterative/2n-clx/vpp-mrr-00.md - docs/job_specs/report_iterative/2n-skx/vpp-mlr-00.md - docs/job_specs/report_iterative/2n-skx/vpp-mrr-00.md take too long. We should consider to remove some tests. - the coverage specs were split to three parts Change-Id: I39e2032c76266e159a781d1225cff1a5119d4c85 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-10-19Tests: Remove GBPpmikus10-119/+8
- Specs - Tests - Library - TODO: PAL Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I8890940d56c7a9924d4a5f9365b6bb881610db14
2020-10-02job-spec: Add report_iteratve/3n-hsw/hoststack-00.mdTibor Frank1-0/+41
Change-Id: I98ad76f5e1d1f9b4a7442aa9925ce68869123ac7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-10-02jop-spec: Add NAT44 testsTibor Frank3-79/+459
Add all which we want to run and disable those which are not ready. Change-Id: I649ab290a1deec5d1c7de34a7bbe367d78a1e3ff Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-23Fix: use nat44 not snat44Jan Gelety12-510/+510
Change-Id: If141566f76d5b2f309953233e693c34fef8ee12f Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-09-23Infra: Add 2n-xn2pmikus27-0/+4584
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I2ff6526b5209dabf70c6593f60162d9b8c147014
2020-09-18job-specs: add 3n-tsh dpdk mrr weekly setJuraj Linkeš1-0/+1
Change-Id: I0cd41129538b5e4ec47f3876813f7df36da2977a Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-09-10job-specs: Add NAT44Tibor Frank4-32/+144
Change-Id: If8fbcf6a7720eb75094966b352495d1435f44148 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-09job_specs: use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44Jan Gelety13-149/+90
Change-Id: Idb7b415995f0a3474e379b0c023f64a96e886a55 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-26job-specs: remove ip4-08.md from 3n-hsw and 3n-skxTibor Frank2-79/+0
- They duplicate specification which is in ip4-01.md files Change-Id: I818e1c165415b1f7d53ed28ffb345f07e6ac0576 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-25Job-specs: Fix the runs durationsTibor Frank4-12/+12
Change-Id: Ifeb5455140e911b804df55b4ceeda26575ae9da9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-25job-specs: nat44-deterministc test names changeTibor Frank10-240/+93
Change-Id: I3ff3f10c4c9795dc4d95b3a7d04f73f618e4a2d3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-06job-specs: align mrr-weekly NFV tests with report-iterTibor Frank2-1085/+2
- 2n-skx - 2n-clx Change-Id: I8e96d335be2c26ffb03e210f6f658fba1825c597 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-28Doc: Update durations of test runsTibor Frank169-621/+638
Change-Id: I0652f4483a83954096649fbd92af1fecc4bf0a7d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-24job-specs: Fix tag l2bdsbasemaclrn --> l2bdbasemaclrnTibor Frank5-162/+162
Change-Id: Icfecc2b9576d1be32c78f6b0019b64d6f401745e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-17job-specs: Align 2n-skx nfv tests with 2n-clxTibor Frank2-368/+4
Change-Id: I6c828ee146bab8ebdb24be6b03369f6e772d25c8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-10Docs: job-specs: dpdk and nfv-density test setsTibor Frank17-362/+487
+ synchronize iter dpdk test sets with coverage dpdk test sets + add iter nfv-density-mrr test sets Change-Id: I759025b6acf860aca9828f9fc1d82ab3a37ec98f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-02Trending and report alignmentTibor Frank29-4046/+17
- use test sets defined in report-iterative also for mrr tests and for mrr_daily and mlr_weekly Change-Id: I47fba2997cddaca934bdebd5fca6936e25332afc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-01docs: added mrr tests for vpp and dpdk to job_specs/report_iterativeMaciek Konstantynowicz14-0/+2202
Change-Id: Ie8fca17baa114fcdf5916e65311716a86e791709 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-06-11docs: update 2n-skx job_specs for report_iterativeMaciek Konstantynowicz2-373/+328
Changes in vpp-2n-skx.md: - all nfv_density moved to separate file vpp-2n-skx-nfv-density.md - removed intel-x710: dot1q - removed drv_vfio_pci: vts, dot1q - Rebased on https://gerrit.fd.io/r/c/csit/+/27495 - *.md files moved to docs/job_specs/report_iterative/2n-skx/ and renamed Change-Id: Iff16f6673ea3d829c44fbd04d892abb845fa4c1e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-06-11docs: update 2n-clx job_specs for report_iterativeMaciek Konstantynowicz2-223/+146
Changes in vpp-2n-clx.md: - all nfv_density moved to separate file vpp-2n-clx-nfv-density.md - removed intel-x710: dot1q - removed drv_vfio_pci: vts, dot1q - Rebased on https://gerrit.fd.io/r/c/csit/+/27495 - *.md files moved to docs/job_specs/report_iterative/2n-clx/ and renamed Change-Id: I639abe794bde511d27cefa50db2860945dcc0050 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>