aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-03-22MLRsearch: Support other than just two ratiosVratko Polak13-654/+896
+ Change some method names and argument types: + Do not mention NDR and PDR, except as examples. + Return list of ReceiveRateInterval instead of NdrPdrResult. + The resulting intervals can be degenerate when hitting min/max rate. + Rename quantity name parts from "fraction" to "ratio". + Intervals are no longer tracked for each target ratio. + They are found dynamically from known results. + Add effective_loss_ratio field to avoid loss inversion effects. + Move some functions to separate files. + Bound search logic moved to MeasurementDatabase.py + ProgressState moved to its file. + WidthArithmetics.py holds small computation functions. + Use parameter expansion_coefficient instead of "doublings". + Do uneven bisect to save time when width is not power of two times goal. + Timeout now correctly tracked for the whole search, not just the current phase. + Make logging (debug) function pluggable. + Added debug log messages for initial phase. + Do not mark as subclass if contructor signature differs. + Avoid re-measure on scale-limited (ASTF) profiles. + Remove outdated comments. + Bump copyright years. Change-Id: I93f693b4f186f59030ee5ac21b78acc890109813 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-22FIX: LXC imagepmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I73f7a1095b7cee52fade8a31285e405727548394
2021-03-22Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I9649d4b7ed84e0dc7a0dafaf6aa78bc93c7fe5a6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-20Tox: Increase verbosityVratko Polak1-2/+3
CSIT is becoming stricter in avoiding downloads during run, as everything should be pre-cached in executor image. This change makes it easier for human to detect downloads. Change-Id: If7085f96ef1033f7f9405a86232a3d39a239d3e1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-19FrameworkSetup: Detect socket.timeoutVratko Polak1-2/+3
Otherwise setup "passes" leading to confusing errors later. Example: https://logs.fd.io/production/vex-yul-rot-jenkins-1/csit-vpp-perf-mrr-daily-master-2n-skx/1251/archives/log.html.gz#s1-s1-s1-k1-k2 Change-Id: I56b14e2eb75679c7c10b00b3f9c6bf07902e5166 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-18fix two issuesYulong Pei2-2/+2
1. wrong symbol link path for MLRsearch. 2. self._received force to integer in _parse_traffic_results function. Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: Ie86a549b222d28b8cecc889807044476975dffb1
2021-03-18Infra: Shared TG Ansible rulespmikus2-4/+6
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I7d505d99003c4ab48b191c1d534513768d03bc83
2021-03-18Revert "Ubuntu 20.04: Bump dill version."Peter Mikus1-1/+1
This reverts commit b6ab0f191ddc6b98b15c6629be34d3566b8d3992. Reason for revert: wrong procedure, must be updated on all testbed and all images Change-Id: I16e5d017d6b6413fe8474af90805970fb8832304 Signed-off-by: pmikus <pmikus@cisco.com>
2021-03-17Ubuntu 20.04: Bump dill version.Vratko Polak1-1/+1
This fixes the "an integer is required (got type bytes)" TypeError. Change-Id: I63e23f1261cdfd86338d2f37ec9dff99d130f175 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-17PAL: Remove instalation of system dependenciesTibor Frank3-20/+2
Change-Id: I66024f3110804499fa32628b0f72711413d741ac Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-17IPsec: fix SA policy cliJuraj Linkeš1-2/+2
The tunnel specification in "ipsec sa add" has changed. Update the cli the reflect this. Change-Id: I11d788798419b96b1289c53052eedb9767252df6 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-17ansible: arm perf TG updateJuraj Linkeš1-2/+3
Update TG to shared (docker) TG and add hugepages accordingly. Change-Id: I45ece9d1c8d6dbc3174661447ae46a7e28613313 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-17FIX: ARM VPP_DEVICE executorpmikus1-1/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I2a5554884d49ab8063d84c914e447b29d79c676b
2021-03-17Infra: csit-sut temporary buildpmikus28-287/+184
- Untill the issue with fdiotools will be solved Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I3c2b06f37014a0571487d527447d90ceafdf52a9
2021-03-16Infra: Upgrade csit-dut imagepmikus4-5/+4
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I0341a1564ba510acf46bda3e24225209abef2f82
2021-03-16Perf: Bump T-Rex to 2.88pmikus9-10/+10
+ Mellanox 4.6 is not for Ubuntu 20.04 + Mellanox for ubuntu 20.04 is 4.9+ + T-Rex 2.86 is not for Mellanox 4.6+ + T-Rex for Mellanox 5.2 is 2.88+ ================================== = Bump Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I902dfc2a43e6718b385e89f31a34260e09d61bd3
2021-03-16API options: Fix case when no options are presentVratko Polak1-2/+2
In that case we want to pass by returning an empty dict, as docstring already describes. Before this, the code failed when checking for included version. Change-Id: Ia0d6b81a64ad0e7027ac7daf15c72ace1f6982ce Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-15Infra: Ansible Ubuntu 20.04 follow-upspmikus6-12/+9
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I36a8b4a6cab976f51685df56c0dc2d95c00e248f
2021-03-15PAL: set DEBIAN_FRONTEND=noninteractive in run_report.shTibor Frank1-0/+1
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I30037a41019ca1071b1dad443a0d09054c09fb3e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-15Update VPP_STABLE_VER filesTibor Frank2-2/+2
Change-Id: Ic0ab23721178d8e8c7322806899bc36d33ae59ad Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-12Allow IPSECSW on 2node testbedsVratko Polak1-5/+5
Change-Id: I71d72699a7fa99749e2554fcb2252f8bd86bfdfa Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-12PAL: Optimize specification of elementsTibor Frank5-21052/+6571
- plot_mrr_box_name - plot_ndrpdr_box_name - plot_perf_box_name - plot_tsa_name - plot_nf_reconf_box_name - plot_nf_heatmap - plot_cpta Change-Id: I28ff2ea0e4f610e5ce48ffd083bf9a37bdc2f62d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-11Infra: Minor ansible tweakspmikus2-18/+16
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I47de0b78ed64b2426d39c5edf22ec36866609e8e
2021-03-11Infra: Switch csit-shim to fdiotoolspmikus53-635/+638
+ use /u/fdiotools + use ubuntu 20.04 Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I091e63a0d9e50de203b1527c7500b3864a616af6
2021-03-10Infra: Do not strict check keys in Ansiblepmikus1-7/+9
- not until we migrate to SSH keys in ubuntu 2004 Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I796f86922c672ba053d64f317cf6adb46b845cac
2021-03-09API: Track options and versionVratko Polak1-9/+55
If options are not present in .api.json file (e.g. old PVP build), use an empty dict. If a message is used in CSIT, check its options. Tolerate vat_help, but print warning for others. This aims to discover in-progress and obsolete APIs. If .api.json version is not detected, or starts with "0.", add a "version" item to options, so they get reported. Change-Id: Ic5a9423157728a58f7ad306c7bd9eaef3bd92488 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-08Infra: AWS/Azure fix OOM issues on smaller instancesTomas Alexy4-8/+33
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: Ic799f5eeaf03f34386603421c1d9282167c25aa5
2021-03-08Infra: Add reschedule policypmikus8-95/+217
Add rechedule policy to jobs so in case of failure they will respawn in a endless loop Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I15698d9e147644e68bec549fc53474d421b25d9a
2021-03-08Update VPP_STABLE_VER filesTibor Frank2-2/+2
Change-Id: I6ebf0bb7eb831619140a4a556f9c24b95760774e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-07Infra: Docker DNS on Nomad hostspmikus7-5/+58
+ Make the host default resolver Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ifadb8901c66b65b2213878180c87370262ab22f0
2021-03-05Infra: Move nginx service closer to storagepmikus6-104/+80
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I3bbaa6c458e7994e964f7a07f69f9dab008a48fd
2021-03-05PAL: repeat the download if it fails 2Tibor Frank2-4/+9
Change-Id: I9bba50281bfe65f62a1cfab76364d834dc10d80c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-05PAL: repeat the download if it failsTibor Frank1-47/+57
Change-Id: I0a977009345ca5e46d23cc55405c6fd9b6e61c58 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-05FIX: JenkinsJob alert conditionpmikus3-91/+35
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I1b996d0ed6252ed2b790656879e9068ff9c52039
2021-03-05PAL: Fix: ignore verifying the SSL certificateTibor Frank1-5/+7
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ia39c9fcfc6240a30d48b492ec5e1451d8279c646 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-05PAL: download - ignore verifying the SSL certificateTibor Frank6-6/+12
- only for https://logs.nginx.service.consul/vex-yul-rot-jenkins-1 Change-Id: Ibdcc59a44d5aae331aeef22fad54c4e90b2eec6b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-05PAL: use http instead of https for S3Tibor Frank3-3/+3
Change-Id: Ie70f48142d182518d794e542052c31427d788849 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-05PAL: Add s3_storage as the data sourceTibor Frank5-8/+28
Priorities for download: 1. s3_storage 2. logs.fd.io 3. docs.fd.io release 4. docs.fd.io master 5. jenkins Change-Id: I7114715c3ec9a33acc8edf3c5c473f4eaffa639d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-04FIX: Methodology GSO headerspmikus1-8/+8
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I38f8b16ced2c5cfd0ea8b2b0e767f5a73f6a7dd7
2021-03-04Report: Hide 2c and 4c GSO testsTibor Frank3-78/+81
Change-Id: Ifab207f12b056a8c77911ed69590337cea4355af Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-04Report: GSO release notespmikus1-1/+7
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I369afd2c90d68078443436402a6224fa42ca646d
2021-03-04FIX: Ansible storage bugspmikus5-12/+20
- daily digest Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ifa2dc10831fde0a101c916f2b8abd26abb93cb7f
2021-03-03Methodology: GSOpmikus2-0/+137
- Report methodology Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I1726af15ab003ff6ee4411ca1ceace986d3ee42b Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-03-03job-specs: Update durations of jobsTibor Frank176-695/+695
- coverage - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv - iterative - 2n-clx - 2n-skx - 2n-zn2 - 2n-tx2 - 2n-dnv - 3n-skx - 3n-hsw - 3n-tsh - 3n-dnv Change-Id: Ica79cb68a83bd7cd1f74044c0c464b345778476b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-03Job specs: add 2n-tx2 crypto mrr-daily testsJuraj Linkeš2-3/+93
Iteratively increase coverage, but only of mrr-daily tests. Because of time constraints (i.e. we won't have enough time to run all of the tests), only add mrr-daily tests and not ndrpdr iterative/cov tests. For iter tests, add the tests commented out which documents which tests we're omitting from iter runs compared to mrr-daily. Change-Id: I35625a1f67004473305cb752a98a962dcb825e16 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-03job-specs: Fix ipsec schedulerTibor Frank6-56/+56
Change-Id: Ie2b624de84ea193ab744b27ed5eac190a0d5b153 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-02Fix: Async scheduler tests are not hwVratko Polak12-12/+12
Suite name part is correct: swasync. This fixes the tag, from IPSECHW to IPSECSW. Change-Id: I13a5201dade7edf180d315416c82c15d69c1bfce Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-01Infra: Configurable CSIT SHIM imagepmikus6-73/+95
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I299ed8032f9210e20c304327abca3f62cd85ee81
2021-03-01Update VPP_STABLE_VER filesTibor Frank2-2/+2
Change-Id: I332decea2b783f7868e4a512d417c5c50990adae Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-26IPsec: add 2n crypto udir perf testsJuraj Linkeš108-0/+16997
Add unidirectional 2n crypto tests. Only one direction can be tested on a 2 node topology, since we can't use the same interface for both encrypted and unencrypted traffic. Add the following tests: * {n}tnlsw-ip4base-int ndrpdr tests * {n}tnlsw-1atnl-ip4base-int reconf tests * {n}tnlswasync-scheduler-ip4base-int ndrpdr tests Where n is the number of tunnels: 1, 4, 40, 400, 1000, 5000, 10000, 20000, 40000, 60000 for the first two 1, 2, 4, 8 for the async scheduler tests All of these with the following ecryption-auth algorithms: aes128gcm aes256gcm aes128cbc-hmac256sha aes128cbc-hmac512sha Also add the corresponding trex profiles: trex-stl-2n-ethip4-ip4dst{n}-udir.py Where n is the number of tunnels listed above. The profiles are shared among the tests. Change-Id: I22bb46e6ad59801581a78aa19310bee8a5293e56 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>