aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-03-03job-specs: Update durations of jobsTibor Frank176-695/+695
- coverage - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv - iterative - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv Change-Id: Ica79cb68a83bd7cd1f74044c0c464b345778476b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-03Job specs: add 2n-tx2 crypto mrr-daily testsJuraj Linkeš2-3/+93
Iteratively increase coverage, but only of mrr-daily tests. Because of time constraints (i.e. we won't have enough time to run all of the tests), only add mrr-daily tests and not ndrpdr iterative/cov tests. For iter tests, add the tests commented out which documents which tests we're omitting from iter runs compared to mrr-daily. Change-Id: I35625a1f67004473305cb752a98a962dcb825e16 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-03job-specs: Fix ipsec schedulerTibor Frank6-56/+56
Change-Id: Ie2b624de84ea193ab744b27ed5eac190a0d5b153 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-02Fix: Async scheduler tests are not hwVratko Polak12-12/+12
Suite name part is correct: swasync. This fixes the tag, from IPSECHW to IPSECSW. Change-Id: I13a5201dade7edf180d315416c82c15d69c1bfce Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-01Infra: Configurable CSIT SHIM imagepmikus6-73/+95
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I299ed8032f9210e20c304327abca3f62cd85ee81
2021-03-01Update VPP_STABLE_VER filesTibor Frank2-2/+2
Change-Id: I332decea2b783f7868e4a512d417c5c50990adae Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-26IPsec: add 2n crypto udir perf testsJuraj Linkeš108-0/+16997
Add unidirectional 2n crypto tests. Only one direction can be tested on a 2 node topology, since we can't use the same interface for both encrypted and unencrypted traffic. Add the following tests: * {n}tnlsw-ip4base-int ndrpdr tests * {n}tnlsw-1atnl-ip4base-int reconf tests * {n}tnlswasync-scheduler-ip4base-int ndrpdr tests Where n is the number of tunnels: 1, 4, 40, 400, 1000, 5000, 10000, 20000, 40000, 60000 for the first two 1, 2, 4, 8 for the async scheduler tests All of these with the following ecryption-auth algorithms: aes128gcm aes256gcm aes128cbc-hmac256sha aes128cbc-hmac512sha Also add the corresponding trex profiles: trex-stl-2n-ethip4-ip4dst{n}-udir.py Where n is the number of tunnels listed above. The profiles are shared among the tests. Change-Id: I22bb46e6ad59801581a78aa19310bee8a5293e56 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-02-25Report: Configure rls2101.09Tibor Frank3-3/+3
Change-Id: Ib61e7643c2072d9f0e8cdec3bb7e0328bd25d60a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-25Trending: Fix file names fro nat44 tput graphsTibor Frank8-36/+36
Change-Id: I7e722b268595e8b1de370b3dde9d2b00c566f143 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-24Infra: Azure - file cleanupTomas Alexy7-78/+84
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: I8b97123711a76bf8851f6c4997e819d79364b83b
2021-02-24job-spec: Add test suites for crypto sw scheduler engineTibor Frank9-26/+874
Change-Id: I68af8c56f3bd33d0f122f56f1ae60993beb67969 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-24Trending: Add nat44-tput testsTibor Frank17-1/+687
Change-Id: I0e670cfa4e0125856944656536f0d64d04bdbb6d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-24Report: Set .08 revision, fix GSO graphsTibor Frank6-26/+118
Change-Id: I5948dbaf69d183caddbefd16f2198b54a24ff904 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-22Ipsec: Always generate ikeyVratko Polak3-53/+77
Some tests use a crypto algorithm with no integrity algorithm. Generate empty binary strings as fake integrity keys to keep return values of low level methods consistent. + Add return_keys argument to avoid returning long lists. + Improve various docstrings. Change-Id: Idae1877bdde32d194ce4e3bb3053c8dba39d377a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-02-22ietf: renamed mlrsearch to bmwg adopted draftMaciek Konstantynowicz1-2/+2
Change-Id: I86401078e63c01a88b606f27bfbbd17491de99fd Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-02-22Update VPP_STABLE_VER filesTibor Frank2-2/+2
Change-Id: I3058879ed54a686eb596b2822ff943568d0d5405 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-22Job specs: add 2n-tx2 memif testsJuraj Linkeš2-6/+42
Iteratively increase coverage. Change-Id: Ia506232e68db70608b415003a031661b73023c03 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-02-22Report: Add gso testsTibor Frank9-5/+603
Change-Id: Ic21d43a104bdafe93600d8f5fd60d403d13285aa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-19Add test suites for crypto sw scheduler engineYulong Pei26-5/+3145
This patch is to add test suites for vpp plugin crypto_sw_scheduler, IPsec sync mode is to do crypto and packet forward work in same worker cores, crypto_sw_scheduler can schedule crypto work to other async crypto cores to improve whole crypto processing capability. This test suites configure fixed 1 rx queues per port, then measure IPsec performance with 1, 2, 3 crypto cores. This patchset include 1, 2, 4, 8 ipsec tunnels test cases. +Vratko help to change to count total physical cores instead of previous only count crypto cores in test cases. Change-Id: I0e67182e3d13273890a23703d838101900e25126 Signed-off-by: Yulong Pei <yulong.pei@intel.com> Signed-off-by: Vratko Polak <vrpolak@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2021-02-19FIX: Use x710 for gso testspmikus6-78/+78
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I13892dda60a6e130ebe7c074ac0a3b429e08ef32
2021-02-19FIX: Naming convention compliancepmikus11-89/+89
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Idcee623abbc5568fc6ca49113bc2ff8add179046
2021-02-19API: Use newer messagesVratko Polak3-15/+28
The mesages are the newest present in last common ancestor of master and rls2101 (so not yet ipsec_sad_entry_add_del_v3). Added a TODO for the RDMA create improvement, to be implemented in a separate change. Change-Id: I94bcd2f1bc109fb995c4dd6df44f8928865634f5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-02-19Performance: Add GSO tests to report executionpmikus10-4/+223
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I35b2f786105103f19907d74c4f6cc77d7cd3a5bb
2021-02-19Infra: Ansible Ubuntu Focalpmikus36-257/+388
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I6558938fe4bbdfb5add7a361adb4a12da6b0a6dc
2021-02-19Framework: GSO testpmikus6-5/+74
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I874568aebbe50c38e634438eb1201ca737bd18ad
2021-02-19Infra: AWS deployment - minor fixesTomas Alexy4-7/+7
Bump aws provider to 3.28 Code readability improvements Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: Iaa966f2795f228e31e90acf27ca9999a730a87f0
2021-02-18Infra: Fix AWS deploymentTomas Alexy23-932/+1456
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: Ie24f5fac5827e28b1ac7c22192a94994700b2910
2021-02-18Framework: SciPy upgradepmikus2-2/+2
+ 1.5.4 to solve python3.8 dependency. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I682bedc18b56d1fed3974f792a4d79656cbe97cb
2021-02-18Framework: Qemu 4.2 compatibility fixpmikus1-1/+0
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I8692b53c02773dbe5a5e02f959dfed8599cb8a4d
2021-02-17PAPI: Python 3.8 compatibilitypmikus1-5/+7
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I33fefddda9055524c1817b13b5c99bb1b97ebff4
2021-02-17Infra: Ansible docker images cleanuppmikus10-74/+188
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I8d67b8ad5db5c0a7c9b3fa892e1e66dab2f666d0
2021-02-17Report: Add dataTibor Frank1-0/+8
Change-Id: Idf8610d4502a3e0ff0ff0471c1fe6a75cd46a593 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-16report: fixed typo AMD 2n-tx2 to ArmMaciek Konstantynowicz2-2/+2
Change-Id: I8b5af0a2a8b7af287e0258f0465687f3574c1ead Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-02-16Infra: Ansible 2.10Peter Mikus11-5/+54
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I6b058ff30628c7e066372fec2141a8bcc18c3997
2021-02-16RCA: Link to NAT44ed performance regression bugVratko Polak1-2/+2
Change-Id: Iec30c261225d99acec5a12bcda9ffe1809eed251 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-02-16Report: Add dataTibor Frank1-0/+4
Change-Id: If25bfb368aebc6ac84062086f81f67a62b30c912 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-16Report: Add comp tables for 2n-clx with mellanox NICTibor Frank11-63/+1005
Change-Id: I64f1821877f749cfb44b886b4760faba577a2014 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-15Report: Add framework speedup to notesVratko Polak2-0/+8
Change-Id: If01c977a48bb64c53608f6b937a715fc11000446 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-02-15Release notes: Tput tests and jumbo ipsecVratko Polak1-27/+9
+ Also randomized profiles. Change-Id: I8eefedca65129d8ebbd6f08b68e5884c930b1dc4 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 1b6c4949b794b0efd091f101ff450a04944c21ba)
2021-02-15Report: Add 2n-clx cx556a Latency graphsTibor Frank14-6/+1032
Change-Id: I026ebb96874c55059e230d6e4db2424c341c04c6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-15Update VPP_STABLE_VER filesTibor Frank2-2/+2
Change-Id: I7baa8931325b16363b7d95c1bc17d82f75a109d6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-12Report: Fix spec for Latency by percentile: 2n-clx MLXTibor Frank1-2/+2
Change-Id: Ic782ef76d35b3349a04f57578c070b2f49e4ca7f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-12Report: re-group RND testsTibor Frank19-2097/+191
Change-Id: If45709086b850b6cccc44645ab195fd77296e5e3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-12Methodology: Added packet flow orderingVratko Polak3-38/+92
Change-Id: If0f0397c2ace9112490e017ec8d18cfbf1dffbc5 Signed-off-by: Vratko Polak <vrpolak@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-02-12Report: Add dataTibor Frank1-12/+37
Change-Id: Ia5c7e127c0063c4c1c8d265936361a68c4646f04 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-11Job specs: Add -tput tests to iterativeTibor Frank4-8/+168
- Not touching coverage yet. + Trending stuff should be handled already by symlinks. + Adding to anywhere with -pps tests. + Only nat44ed version. + Because ip4base is stateless. + So -tput will have the same behavior and results as -pps. + Test counts and run duration estimates updated. Change-Id: I4e7ce7e9974c995ccf0a21300fa041031ca81cfc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-11Report: Add 2n-clx Mellanox tests and graphsTibor Frank13-21/+239
Change-Id: Ib947d47b31138ac816acefee03429d454511dd05 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-10Report: vpp device i40e known issueJuraj Linkeš1-5/+7
Add the i40e PF/VF race condition known issue to the known issues list. Change-Id: I1eb4dcea118036dec3f3715f0d08d124f2a9ad1c Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-02-10Report: Add dataTibor Frank1-2/+2
Change-Id: I6803f9694c0260817d93258b4cb99cdd47dea9ef Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-10Methodology: Add NAT44ed tput testsVratko Polak1-14/+12
Change-Id: I22a38ca98cb0aa4bac9a03d3943e807c26ce4474 Signed-off-by: Vratko Polak <vrpolak@cisco.com>