aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-03-12PAL: Optimize specification of elementsTibor Frank5-21052/+6571
- plot_mrr_box_name - plot_ndrpdr_box_name - plot_perf_box_name - plot_tsa_name - plot_nf_reconf_box_name - plot_nf_heatmap - plot_cpta Change-Id: I28ff2ea0e4f610e5ce48ffd083bf9a37bdc2f62d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-11Infra: Minor ansible tweakspmikus2-18/+16
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I47de0b78ed64b2426d39c5edf22ec36866609e8e
2021-03-11Infra: Switch csit-shim to fdiotoolspmikus53-635/+638
+ use /u/fdiotools + use ubuntu 20.04 Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I091e63a0d9e50de203b1527c7500b3864a616af6
2021-03-10Infra: Do not strict check keys in Ansiblepmikus1-7/+9
- not until we migrate to SSH keys in ubuntu 2004 Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I796f86922c672ba053d64f317cf6adb46b845cac
2021-03-09API: Track options and versionVratko Polak1-9/+55
If options are not present in .api.json file (e.g. old PVP build), use an empty dict. If a message is used in CSIT, check its options. Tolerate vat_help, but print warning for others. This aims to discover in-progress and obsolete APIs. If .api.json version is not detected, or starts with "0.", add a "version" item to options, so they get reported. Change-Id: Ic5a9423157728a58f7ad306c7bd9eaef3bd92488 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-08Infra: AWS/Azure fix OOM issues on smaller instancesTomas Alexy4-8/+33
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: Ic799f5eeaf03f34386603421c1d9282167c25aa5
2021-03-08Infra: Add reschedule policypmikus8-95/+217
Add rechedule policy to jobs so in case of failure they will respawn in a endless loop Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I15698d9e147644e68bec549fc53474d421b25d9a
2021-03-08Update VPP_STABLE_VER filesTibor Frank2-2/+2
Change-Id: I6ebf0bb7eb831619140a4a556f9c24b95760774e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-07Infra: Docker DNS on Nomad hostspmikus7-5/+58
+ Make the host default resolver Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ifadb8901c66b65b2213878180c87370262ab22f0
2021-03-05Infra: Move nginx service closer to storagepmikus6-104/+80
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I3bbaa6c458e7994e964f7a07f69f9dab008a48fd
2021-03-05PAL: repeat the download if it fails 2Tibor Frank2-4/+9
Change-Id: I9bba50281bfe65f62a1cfab76364d834dc10d80c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-05PAL: repeat the download if it failsTibor Frank1-47/+57
Change-Id: I0a977009345ca5e46d23cc55405c6fd9b6e61c58 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-05FIX: JenkinsJob alert conditionpmikus3-91/+35
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I1b996d0ed6252ed2b790656879e9068ff9c52039
2021-03-05PAL: Fix: ignore verifying the SSL certificateTibor Frank1-5/+7
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ia39c9fcfc6240a30d48b492ec5e1451d8279c646 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-05PAL: download - ignore verifying the SSL certificateTibor Frank6-6/+12
- only for https://logs.nginx.service.consul/vex-yul-rot-jenkins-1 Change-Id: Ibdcc59a44d5aae331aeef22fad54c4e90b2eec6b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-05PAL: use http instead of https for S3Tibor Frank3-3/+3
Change-Id: Ie70f48142d182518d794e542052c31427d788849 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-05PAL: Add s3_storage as the data sourceTibor Frank5-8/+28
Priorities for download: 1. s3_storage 2. logs.fd.io 3. docs.fd.io release 4. docs.fd.io master 5. jenkins Change-Id: I7114715c3ec9a33acc8edf3c5c473f4eaffa639d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-04FIX: Methodology GSO headerspmikus1-8/+8
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I38f8b16ced2c5cfd0ea8b2b0e767f5a73f6a7dd7
2021-03-04Report: Hide 2c and 4c GSO testsTibor Frank3-78/+81
Change-Id: Ifab207f12b056a8c77911ed69590337cea4355af Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-04Report: GSO release notespmikus1-1/+7
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I369afd2c90d68078443436402a6224fa42ca646d
2021-03-04FIX: Ansible storage bugspmikus5-12/+20
- daily digest Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ifa2dc10831fde0a101c916f2b8abd26abb93cb7f
2021-03-03Methodology: GSOpmikus2-0/+137
- Report methodology Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I1726af15ab003ff6ee4411ca1ceace986d3ee42b Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-03-03job-specs: Update durations of jobsTibor Frank176-695/+695
- coverage - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv - iterative - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv Change-Id: Ica79cb68a83bd7cd1f74044c0c464b345778476b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-03Job specs: add 2n-tx2 crypto mrr-daily testsJuraj Linkeš2-3/+93
Iteratively increase coverage, but only of mrr-daily tests. Because of time constraints (i.e. we won't have enough time to run all of the tests), only add mrr-daily tests and not ndrpdr iterative/cov tests. For iter tests, add the tests commented out which documents which tests we're omitting from iter runs compared to mrr-daily. Change-Id: I35625a1f67004473305cb752a98a962dcb825e16 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-03job-specs: Fix ipsec schedulerTibor Frank6-56/+56
Change-Id: Ie2b624de84ea193ab744b27ed5eac190a0d5b153 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-02Fix: Async scheduler tests are not hwVratko Polak12-12/+12
Suite name part is correct: swasync. This fixes the tag, from IPSECHW to IPSECSW. Change-Id: I13a5201dade7edf180d315416c82c15d69c1bfce Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-01Infra: Configurable CSIT SHIM imagepmikus6-73/+95
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I299ed8032f9210e20c304327abca3f62cd85ee81
2021-03-01Update VPP_STABLE_VER filesTibor Frank2-2/+2
Change-Id: I332decea2b783f7868e4a512d417c5c50990adae Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-26IPsec: add 2n crypto udir perf testsJuraj Linkeš108-0/+16997
Add unidirectional 2n crypto tests. Only one direction can be tested on a 2 node topology, since we can't use the same interface for both encrypted and unencrypted traffic. Add the following tests: * {n}tnlsw-ip4base-int ndrpdr tests * {n}tnlsw-1atnl-ip4base-int reconf tests * {n}tnlswasync-scheduler-ip4base-int ndrpdr tests Where n is the number of tunnels: 1, 4, 40, 400, 1000, 5000, 10000, 20000, 40000, 60000 for the first two 1, 2, 4, 8 for the async scheduler tests All of these with the following ecryption-auth algorithms: aes128gcm aes256gcm aes128cbc-hmac256sha aes128cbc-hmac512sha Also add the corresponding trex profiles: trex-stl-2n-ethip4-ip4dst{n}-udir.py Where n is the number of tunnels listed above. The profiles are shared among the tests. Change-Id: I22bb46e6ad59801581a78aa19310bee8a5293e56 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-02-25Report: Configure rls2101.09Tibor Frank3-3/+3
Change-Id: Ib61e7643c2072d9f0e8cdec3bb7e0328bd25d60a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-25Trending: Fix file names fro nat44 tput graphsTibor Frank8-36/+36
Change-Id: I7e722b268595e8b1de370b3dde9d2b00c566f143 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-24Infra: Azure - file cleanupTomas Alexy7-78/+84
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: I8b97123711a76bf8851f6c4997e819d79364b83b
2021-02-24job-spec: Add test suites for crypto sw scheduler engineTibor Frank9-26/+874
Change-Id: I68af8c56f3bd33d0f122f56f1ae60993beb67969 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-24Trending: Add nat44-tput testsTibor Frank17-1/+687
Change-Id: I0e670cfa4e0125856944656536f0d64d04bdbb6d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-24Report: Set .08 revision, fix GSO graphsTibor Frank6-26/+118
Change-Id: I5948dbaf69d183caddbefd16f2198b54a24ff904 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-22Ipsec: Always generate ikeyVratko Polak3-53/+77
Some tests use a crypto algorithm with no integrity algorithm. Generate empty binary strings as fake integrity keys to keep return values of low level methods consistent. + Add return_keys argument to avoid returning long lists. + Improve various docstrings. Change-Id: Idae1877bdde32d194ce4e3bb3053c8dba39d377a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-02-22ietf: renamed mlrsearch to bmwg adopted draftMaciek Konstantynowicz1-2/+2
Change-Id: I86401078e63c01a88b606f27bfbbd17491de99fd Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-02-22Update VPP_STABLE_VER filesTibor Frank2-2/+2
Change-Id: I3058879ed54a686eb596b2822ff943568d0d5405 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-22Job specs: add 2n-tx2 memif testsJuraj Linkeš2-6/+42
Iteratively increase coverage. Change-Id: Ia506232e68db70608b415003a031661b73023c03 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-02-22Report: Add gso testsTibor Frank9-5/+603
Change-Id: Ic21d43a104bdafe93600d8f5fd60d403d13285aa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-19Add test suites for crypto sw scheduler engineYulong Pei26-5/+3145
This patch is to add test suites for vpp plugin crypto_sw_scheduler, IPsec sync mode is to do crypto and packet forward work in same worker cores, crypto_sw_scheduler can schedule crypto work to other async crypto cores to improve whole crypto processing capability. This test suites configure fixed 1 rx queues per port, then measure IPsec performance with 1, 2, 3 crypto cores. This patchset include 1, 2, 4, 8 ipsec tunnels test cases. +Vratko help to change to count total physical cores instead of previous only count crypto cores in test cases. Change-Id: I0e67182e3d13273890a23703d838101900e25126 Signed-off-by: Yulong Pei <yulong.pei@intel.com> Signed-off-by: Vratko Polak <vrpolak@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2021-02-19FIX: Use x710 for gso testspmikus6-78/+78
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I13892dda60a6e130ebe7c074ac0a3b429e08ef32
2021-02-19FIX: Naming convention compliancepmikus11-89/+89
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Idcee623abbc5568fc6ca49113bc2ff8add179046
2021-02-19API: Use newer messagesVratko Polak3-15/+28
The mesages are the newest present in last common ancestor of master and rls2101 (so not yet ipsec_sad_entry_add_del_v3). Added a TODO for the RDMA create improvement, to be implemented in a separate change. Change-Id: I94bcd2f1bc109fb995c4dd6df44f8928865634f5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-02-19Performance: Add GSO tests to report executionpmikus10-4/+223
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I35b2f786105103f19907d74c4f6cc77d7cd3a5bb
2021-02-19Infra: Ansible Ubuntu Focalpmikus36-257/+388
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I6558938fe4bbdfb5add7a361adb4a12da6b0a6dc
2021-02-19Framework: GSO testpmikus6-5/+74
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I874568aebbe50c38e634438eb1201ca737bd18ad
2021-02-19Infra: AWS deployment - minor fixesTomas Alexy4-7/+7
Bump aws provider to 3.28 Code readability improvements Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: Iaa966f2795f228e31e90acf27ca9999a730a87f0
2021-02-18Infra: Fix AWS deploymentTomas Alexy23-932/+1456
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: Ie24f5fac5827e28b1ac7c22192a94994700b2910
2021-02-18Framework: SciPy upgradepmikus2-2/+2
+ 1.5.4 to solve python3.8 dependency. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I682bedc18b56d1fed3974f792a4d79656cbe97cb