aboutsummaryrefslogtreecommitdiffstats
path: root/docs/job_specs/report_iterative
AgeCommit message (Collapse)AuthorFilesLines
2021-04-09job-spec: Fix job-specsTibor Frank2-2/+0
- remove redundant empty lines - fix the number of tests in job-spec and its duration Change-Id: I50fc0f151dedf7d2e9858ecc3959ab42a243bb1d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-04-07job-specs: Update durations of arm mrr jobsJuraj Linkeš2-4/+4
Update after new policy tests were enabled in iterative 2n-tx2 and 3n-tsh. Change-Id: I53986f8c7ba6cd83c73d7d615da07a32ad99c24b Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-04-01Job specs: add crypto tests to Arm perf jobsJuraj Linkeš4-8/+190
Increase coverage by adding aes128gcm protection mode and policy testcases. Change-Id: I6f9e7b89208397efe4e06a63d3e06caaf19f3b0a Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-03job-specs: Update durations of jobsTibor Frank24-83/+83
- coverage - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv - iterative - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv Change-Id: Ica79cb68a83bd7cd1f74044c0c464b345778476b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-03Job specs: add 2n-tx2 crypto mrr-daily testsJuraj Linkeš2-3/+93
Iteratively increase coverage, but only of mrr-daily tests. Because of time constraints (i.e. we won't have enough time to run all of the tests), only add mrr-daily tests and not ndrpdr iterative/cov tests. For iter tests, add the tests commented out which documents which tests we're omitting from iter runs compared to mrr-daily. Change-Id: I35625a1f67004473305cb752a98a962dcb825e16 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-03job-specs: Fix ipsec schedulerTibor Frank6-56/+56
Change-Id: Ie2b624de84ea193ab744b27ed5eac190a0d5b153 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-24job-spec: Add test suites for crypto sw scheduler engineTibor Frank6-26/+222
Change-Id: I68af8c56f3bd33d0f122f56f1ae60993beb67969 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-22Job specs: add 2n-tx2 memif testsJuraj Linkeš2-6/+42
Iteratively increase coverage. Change-Id: Ia506232e68db70608b415003a031661b73023c03 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-02-19FIX: Use x710 for gso testspmikus3-39/+39
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I13892dda60a6e130ebe7c074ac0a3b429e08ef32
2021-02-19FIX: Naming convention compliancepmikus3-36/+36
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Idcee623abbc5568fc6ca49113bc2ff8add179046
2021-02-19Performance: Add GSO tests to report executionpmikus3-0/+84
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I35b2f786105103f19907d74c4f6cc77d7cd3a5bb
2021-02-11Job specs: Add -tput tests to iterativeTibor Frank4-8/+168
- Not touching coverage yet. + Trending stuff should be handled already by symlinks. + Adding to anywhere with -pps tests. + Only nat44ed version. + Because ip4base is stateless. + So -tput will have the same behavior and results as -pps. + Test counts and run duration estimates updated. Change-Id: I4e7ce7e9974c995ccf0a21300fa041031ca81cfc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-05Revert "Job specs: Add -tput tests to iterative"Tibor Frank4-168/+8
This reverts commit 7e70ee38f1debce33df1547c76f22c3fea7887c5. Reason for revert: Faulty tests, those which are running take too much time Change-Id: I690e23cdaf29e2a5b284d156a06b95aa9a689909 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-05Job specs: Add -tput tests to iterativeVratko Polak4-8/+168
- Not touching coverage yet. + Trending stuff should be handled already by symlinks. + Adding to anywhere with -pps tests. + Only nat44ed version. + Because ip4base is stateless. + So -tput will have the same behavior and results as -pps. + Test counts and run duration estimates updated. Change-Id: I8d240bb2e3ed329984a07e7e065881bd2a1fd3e4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-27job-specs: Add rnd testsTibor Frank12-32/+294
Change-Id: I877f46608853401c5226845737ace691e3f393b1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-20job_specs: add geneve testsJan Gelety6-20/+152
Geneve tests added to report_iterative and report_coverage job specifications. - tests with 1024 geneve tunnels added only to report_coverage jobs until fast PAPI is finished Change-Id: I11a12d3c626dd2daf6287440131795daa7f75e48 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2021-01-19Job specs: Add some ipsec reconf to iterativeVratko Polak1-0/+76
We now have more time for 3n-hsw testbeds. Added only scales of 4, 1000 and 60000 tunnels. Change-Id: I283a816e1440a9fe1f0dea13f954f92b457ea788 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-18job-specs: Fix hoststackTibor Frank1-8/+8
Change-Id: I1e450ec00621c7d0bd5a2fd91491c31eae3481f4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-13job_specs: fix 2n-tx2 ip6 iacldst job specsJuraj Linkeš2-6/+6
Change-Id: Id0f74dd289a05c84f6f0723adcd678f02c7464fa Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-13job_specs: update 2n-tx2 coverage specsJuraj Linkeš2-2/+2
Start out with l2, l3, classifier and acl tests. Change-Id: I0cd781f1858d5461b793f782f8bc6fcde5263b69 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-11tests: add 2n1l l2 acl tests, update 2n-tx2 specsJuraj Linkeš2-98/+26
Modify initialize L2BD ACL keywords to be usable for both 2-node and 3-node topologies and update testsuites accordingly. Add the missing macip T-rex profile. Add classifier tests to 2n-tx2 job specs. Change-Id: I17b84b8fc18ef9a6f275ae0238a0665ac2017f01 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-12-23job_specs: add 2x-tx2 job specsJuraj Linkeš4-0/+412
Add job specs for the new 2n-tx2 performance testbed. Change-Id: Ife1db4caba3ad17286727fed143e0c0556c4a2a4 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-11-11job-spec: update the runs durationsTibor Frank2-8/+8
Change-Id: I6de49b81bd4b75d40c792b044dc46024279d6651 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-11-04job-spec: Split mrr daily from report iterativeTibor Frank4-238/+238
- enable all NAT44 tests for report iterative Change-Id: Ifc820c3d0b657637bb4569f59ddaecd9aefb8d1d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-11-02job-specs: Update the durationsTibor Frank9-36/+36
Change-Id: Ibed3ad934bc4fd03013404e18b5a0d6917499bf8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-10-29job-spec: Add all NAT44 testsTibor Frank4-153/+696
- the specs: - docs/job_specs/report_iterative/2n-clx/vpp-mlr-00.md - docs/job_specs/report_iterative/2n-clx/vpp-mrr-00.md - docs/job_specs/report_iterative/2n-skx/vpp-mlr-00.md - docs/job_specs/report_iterative/2n-skx/vpp-mrr-00.md take too long. We should consider to remove some tests. - the coverage specs were split to three parts Change-Id: I39e2032c76266e159a781d1225cff1a5119d4c85 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-10-19Tests: Remove GBPpmikus6-45/+4
- Specs - Tests - Library - TODO: PAL Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I8890940d56c7a9924d4a5f9365b6bb881610db14
2020-10-02job-spec: Add report_iteratve/3n-hsw/hoststack-00.mdTibor Frank1-0/+41
Change-Id: I98ad76f5e1d1f9b4a7442aa9925ce68869123ac7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-10-02jop-spec: Add NAT44 testsTibor Frank2-16/+206
Add all which we want to run and disable those which are not ready. Change-Id: I649ab290a1deec5d1c7de34a7bbe367d78a1e3ff Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-23Fix: use nat44 not snat44Jan Gelety6-168/+168
Change-Id: If141566f76d5b2f309953233e693c34fef8ee12f Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-09-23Infra: Add 2n-xn2pmikus8-0/+1555
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I2ff6526b5209dabf70c6593f60162d9b8c147014
2020-09-10job-specs: Add NAT44Tibor Frank2-6/+38
Change-Id: If8fbcf6a7720eb75094966b352495d1435f44148 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-09job_specs: use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44Jan Gelety6-48/+40
Change-Id: Idb7b415995f0a3474e379b0c023f64a96e886a55 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-25Job-specs: Fix the runs durationsTibor Frank2-6/+6
Change-Id: Ifeb5455140e911b804df55b4ceeda26575ae9da9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-25job-specs: nat44-deterministc test names changeTibor Frank6-32/+24
Change-Id: I3ff3f10c4c9795dc4d95b3a7d04f73f618e4a2d3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-28Doc: Update durations of test runsTibor Frank33-107/+124
Change-Id: I0652f4483a83954096649fbd92af1fecc4bf0a7d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-17job-specs: Align 2n-skx nfv tests with 2n-clxTibor Frank2-368/+4
Change-Id: I6c828ee146bab8ebdb24be6b03369f6e772d25c8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-10Docs: job-specs: dpdk and nfv-density test setsTibor Frank10-80/+480
+ synchronize iter dpdk test sets with coverage dpdk test sets + add iter nfv-density-mrr test sets Change-Id: I759025b6acf860aca9828f9fc1d82ab3a37ec98f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-02Trending and report alignmentTibor Frank15-3/+3
- use test sets defined in report-iterative also for mrr tests and for mrr_daily and mlr_weekly Change-Id: I47fba2997cddaca934bdebd5fca6936e25332afc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-01docs: added mrr tests for vpp and dpdk to job_specs/report_iterativeMaciek Konstantynowicz14-0/+2202
Change-Id: Ie8fca17baa114fcdf5916e65311716a86e791709 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-06-11docs: update 2n-skx job_specs for report_iterativeMaciek Konstantynowicz2-373/+328
Changes in vpp-2n-skx.md: - all nfv_density moved to separate file vpp-2n-skx-nfv-density.md - removed intel-x710: dot1q - removed drv_vfio_pci: vts, dot1q - Rebased on https://gerrit.fd.io/r/c/csit/+/27495 - *.md files moved to docs/job_specs/report_iterative/2n-skx/ and renamed Change-Id: Iff16f6673ea3d829c44fbd04d892abb845fa4c1e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-06-11docs: update 2n-clx job_specs for report_iterativeMaciek Konstantynowicz2-223/+146
Changes in vpp-2n-clx.md: - all nfv_density moved to separate file vpp-2n-clx-nfv-density.md - removed intel-x710: dot1q - removed drv_vfio_pci: vts, dot1q - Rebased on https://gerrit.fd.io/r/c/csit/+/27495 - *.md files moved to docs/job_specs/report_iterative/2n-clx/ and renamed Change-Id: I639abe794bde511d27cefa50db2860945dcc0050 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-06-11docs: update 3n-skx job_specs for report_iterativeMaciek Konstantynowicz2-142/+67
Changes in vpp-3n-skx.md: - all nfv_density moved to separate file vpp-3n-skx-nfv-density.md - removed intel-x710: dot1q (except "./vm_vhost") - removed drv_vfio_pci: dot1q, ipsec aes128cbc - removed nat44, iacl, oacl - Rebased on https://gerrit.fd.io/r/c/csit/+/27495 - *.md files moved to docs/job_specs/report_iterative/3n-skx/ and renamed Change-Id: I952aeee65036919e35a2d98aaa5bb83743992966 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-06-11Update selection of report-iterative test setsTibor Frank18-0/+200
- Create the same directory structure for report-iterative as it is for report-coverage. - Move files from report-iterative directory to created sub-directories. - Rename the moved files to keep the convention defined in report-coverage. - Update the corresponding functionality in resources/libraries/bash/function/common.sh The patches: - https://gerrit.fd.io/r/c/csit/+/27486 - https://gerrit.fd.io/r/c/csit/+/27484 - https://gerrit.fd.io/r/c/csit/+/27485 must be updated. Change-Id: I1aaf22690e3df5abf56893bb1d2d380debc54ddd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-05-26FIX: add dpdk mrr_weekly and report_iterative job specsJan Gelety14-0/+3130
- split job specs to directories Change-Id: I9a71621216ab0bdf85d147ce03f473e7cbb0b266 Signed-off-by: Jan Gelety <jgelety@cisco.com>