aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-04-07job-specs: Update durations of arm mrr jobsJuraj Linkeš2-4/+4
Update after new policy tests were enabled in iterative 2n-tx2 and 3n-tsh. Change-Id: I53986f8c7ba6cd83c73d7d615da07a32ad99c24b Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-04-07SetupFramework: Log env activation outputsVratko Polak1-3/+11
Useful for verifying how much is SUT ready for requirements.txt content. Change-Id: I1e8443f2f9391d646e79a451a88df961845700e4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-04-06DPDK buid: Fix sed commandVratko Polak1-1/+1
The previous way of concatenating strings would not work even in Python. Change-Id: Ice06f4a06fefbc4e42ee2572786244207dfefa11 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-04-06Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I8030b6efcb8c510bfdb82523ffe1610707fcc7c5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-04-01Job specs: add crypto tests to Arm perf jobsJuraj Linkeš4-8/+190
Increase coverage by adding aes128gcm protection mode and policy testcases. Change-Id: I6f9e7b89208397efe4e06a63d3e06caaf19f3b0a Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-04-01IPsec: add 4, 40 and 400 tunnel policy testsJuraj Linkeš25-0/+3854
Add more granularity test policy tests. Mirror the number of tunnels in other IPsec tests under 1000 tunnels. Change-Id: I9bde7447a5d809bab05db132bf6cb524e97e19b3 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-31MLRsearch: Update PyPI metadata for v0.4.0Vratko Polak2-4/+10
Change-Id: I8107097843a3bcddc28ac8a61f72614a3c3145ac Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-31TrafficGenerator: Less logging of unsentVratko Polak1-1/+2
When a trial has explicit stop instead of duration (e.g. for show run), the computation of unsent packets is wrong, so simply do not log the result. Change-Id: I7722c85b156f92e456eda212104abdb216e78b04 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-31IPsec: add 2n crypto policy udir perf testsJuraj Linkeš9-35/+1341
Add 2n1l udir 1 and 1000 tunnel sw policy IPsec tests to mirror the existing 3n tests. Add static ip neighbor mac entries which can't be retrieved in 2node setups. Change-Id: I13dd557cbeed7f907fa9b4c21e4e245d48916513 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-31Device: Add stats test with AVFVratko Polak4-22/+117
+ Extract the stats keyword into a library. Change-Id: Icfaaa32c2a97d479ba0339acf34b865006949a89 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-30PAPI stats: Use list as argument to lsVratko Polak1-2/+7
In the VPP PAPI stats code, the "ls" argument has always [0] been named "patterns", suggesting it expects a list of strings. In the CSIT utility we have always [1] been using it wrong (passing a single string), but it happened to work as VPP code had a workaround [2] for that. This workaround that got removed by accident in [3], and will be reintroduced in [4]. This change fixes occasional failures in CSIT (if merged sooner than [4]), mainly useful in aviding such failures during bisection. [0] https://gerrit.fd.io/r/c/vpp/+/14584/4/src/vpp-api/python/vpp_papi/vpp_stats.py#122 [1] https://gerrit.fd.io/r/c/csit/+/18419/13/resources/tools/papi/vpp_papi_provider.py#181 [2] https://gerrit.fd.io/r/c/vpp/+/14584/4/src/vpp-api/python/vpp_papi/vpp_stats.py#64 [3] https://gerrit.fd.io/r/c/vpp/+/31678 [4] https://gerrit.fd.io/r/c/vpp/+/31817 Change-Id: Ic0f9d906be064b386b67154ba738646c4362aa2b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-29doc: add fdio dc vexxhost server inventory across all locationsMaciek Konstantynowicz1-0/+267
Change-Id: I17ffb5912964bd0c2da59ad4843dfb411f9c3e0c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-03-29Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I696cb7687574faa5b8acc14c469a0861e1ed9294 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-29Infra: AWS deployment improvementsTomas Alexy4-19/+58
- Add checks where missing - Serialize instance deployment to prevent race conditions Deploy tg -> sut1 (-> sut2) then start ansible provisioning on all instances - Bump AWS provisioner version to 3.32 Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: I9a53b1de96574674f3608f19a8f5ac297eb1bd86
2021-03-29FIX: VPP version file name based on OSpmikus2-13/+13
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Icab8b87498e8487268857bb04c5ba7069d9297e3
2021-03-26STL traffic: Use the sleep+stop logicVratko Polak5-29/+71
+ PPS limit for AWS set to 1.2 Mpps. + The logic is very similar to that one in ASTF driver. + This helps for testbeds with high duration stretching (e.g. AWS). + Difference: No transaction scale, and we deal with floats. + Update loss counting to count unsent packets as lost. + Also count "unsent" transactions for other transaction types. + If nonzero, log the number of unsent packets/transactions. + Make STL and ASTF time overhead constant (called delay) configurable. + Subtract delay from approximated_duration, also for ASTF. Change-Id: I6ee6aa6fba4f110ba1636e1b0ff76cac64383e33 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-26Parametrize T-Rex rx/tx descriptors countTomas Alexy2-0/+23
Additional configuration can provide performance boosts when running in virtual environments If set to 0, uses default DPDK value By tuning this value it's also possible to run T-Rex 2.88 with ENA NICs on AWS Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: I43c86ea1d9aa854a1087f07fe544ac77a5b80397
2021-03-26ansible: update TX2 VPP Device hugepages and ifsJuraj Linkeš4-19/+7
These interfaces are not used, so remove them until we actually use them. Use less amount of hugepages since we don't need as much and the rest of the memory is more useful for build/host processes. Change-Id: I52b2d6e2812e5cadeab9e51a1bae3688794f414a Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-24FrameworkSetup: fix timeout in Arm setupJuraj Linkeš1-1/+1
Framework extraction in Arm jobs is taking longer than the current timeout. Increase the timeout to fix this. Change-Id: I436d3131fcd7c25fd1f9607095712b4a8aa2d28c Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-24FrameworkSetup: catch all exceptions in threadsJuraj Linkeš1-15/+32
Any uncaught exception in a thread running setup_node or cleanup_node will prevent the result of that thread's execution from being passed to the main thread. Since the main thread assumes there will be a result for each thread, this leads to false positives. Catch all exceptions in those background threads to fix this. Change-Id: I64013dfc671e576290c8376a58c754ed21b9ba3e Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-23Infra: fix NUMA count in Arm DPDK buildJuraj Linkeš1-3/+6
The default NUMA value for Taishan build is insufficient and results in failed test runs. Fix by increasing the amount to what's on the device. Change-Id: Ia7c761e81ee9063d7129472d9caa8cebbbb7e1cf Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-23Geneve: Re-write the creation of tunnels in pythonTibor Frank2-38/+75
Change-Id: I8b20134ad10abd9c021270b98c3110bd186946d5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-22MLRsearch: Support other than just two ratiosVratko Polak13-654/+896
+ Change some method names and argument types: + Do not mention NDR and PDR, except as examples. + Return list of ReceiveRateInterval instead of NdrPdrResult. + The resulting intervals can be degenerate when hitting min/max rate. + Rename quantity name parts from "fraction" to "ratio". + Intervals are no longer tracked for each target ratio. + They are found dynamically from known results. + Add effective_loss_ratio field to avoid loss inversion effects. + Move some functions to separate files. + Bound search logic moved to MeasurementDatabase.py + ProgressState moved to its file. + WidthArithmetics.py holds small computation functions. + Use parameter expansion_coefficient instead of "doublings". + Do uneven bisect to save time when width is not power of two times goal. + Timeout now correctly tracked for the whole search, not just the current phase. + Make logging (debug) function pluggable. + Added debug log messages for initial phase. + Do not mark as subclass if contructor signature differs. + Avoid re-measure on scale-limited (ASTF) profiles. + Remove outdated comments. + Bump copyright years. Change-Id: I93f693b4f186f59030ee5ac21b78acc890109813 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-22FIX: LXC imagepmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I73f7a1095b7cee52fade8a31285e405727548394
2021-03-22Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I9649d4b7ed84e0dc7a0dafaf6aa78bc93c7fe5a6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-20Tox: Increase verbosityVratko Polak1-2/+3
CSIT is becoming stricter in avoiding downloads during run, as everything should be pre-cached in executor image. This change makes it easier for human to detect downloads. Change-Id: If7085f96ef1033f7f9405a86232a3d39a239d3e1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-19FrameworkSetup: Detect socket.timeoutVratko Polak1-2/+3
Otherwise setup "passes" leading to confusing errors later. Example: https://logs.fd.io/production/vex-yul-rot-jenkins-1/csit-vpp-perf-mrr-daily-master-2n-skx/1251/archives/log.html.gz#s1-s1-s1-k1-k2 Change-Id: I56b14e2eb75679c7c10b00b3f9c6bf07902e5166 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-18fix two issuesYulong Pei2-2/+2
1. wrong symbol link path for MLRsearch. 2. self._received force to integer in _parse_traffic_results function. Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: Ie86a549b222d28b8cecc889807044476975dffb1
2021-03-18Infra: Shared TG Ansible rulespmikus2-4/+6
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I7d505d99003c4ab48b191c1d534513768d03bc83
2021-03-18Revert "Ubuntu 20.04: Bump dill version."Peter Mikus1-1/+1
This reverts commit b6ab0f191ddc6b98b15c6629be34d3566b8d3992. Reason for revert: wrong procedure, must be updated on all testbed and all images Change-Id: I16e5d017d6b6413fe8474af90805970fb8832304 Signed-off-by: pmikus <pmikus@cisco.com>
2021-03-17Ubuntu 20.04: Bump dill version.Vratko Polak1-1/+1
This fixes the "an integer is required (got type bytes)" TypeError. Change-Id: I63e23f1261cdfd86338d2f37ec9dff99d130f175 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-17PAL: Remove instalation of system dependenciesTibor Frank3-20/+2
Change-Id: I66024f3110804499fa32628b0f72711413d741ac Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-17IPsec: fix SA policy cliJuraj Linkeš1-2/+2
The tunnel specification in "ipsec sa add" has changed. Update the cli the reflect this. Change-Id: I11d788798419b96b1289c53052eedb9767252df6 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-17ansible: arm perf TG updateJuraj Linkeš1-2/+3
Update TG to shared (docker) TG and add hugepages accordingly. Change-Id: I45ece9d1c8d6dbc3174661447ae46a7e28613313 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-17FIX: ARM VPP_DEVICE executorpmikus1-1/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I2a5554884d49ab8063d84c914e447b29d79c676b
2021-03-17Infra: csit-sut temporary buildpmikus28-287/+184
- Untill the issue with fdiotools will be solved Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I3c2b06f37014a0571487d527447d90ceafdf52a9
2021-03-16Infra: Upgrade csit-dut imagepmikus4-5/+4
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I0341a1564ba510acf46bda3e24225209abef2f82
2021-03-16Perf: Bump T-Rex to 2.88pmikus9-10/+10
+ Mellanox 4.6 is not for Ubuntu 20.04 + Mellanox for ubuntu 20.04 is 4.9+ + T-Rex 2.86 is not for Mellanox 4.6+ + T-Rex for Mellanox 5.2 is 2.88+ ================================== = Bump Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I902dfc2a43e6718b385e89f31a34260e09d61bd3
2021-03-16API options: Fix case when no options are presentVratko Polak1-2/+2
In that case we want to pass by returning an empty dict, as docstring already describes. Before this, the code failed when checking for included version. Change-Id: Ia0d6b81a64ad0e7027ac7daf15c72ace1f6982ce Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-15Infra: Ansible Ubuntu 20.04 follow-upspmikus6-12/+9
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I36a8b4a6cab976f51685df56c0dc2d95c00e248f
2021-03-15PAL: set DEBIAN_FRONTEND=noninteractive in run_report.shTibor Frank1-0/+1
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I30037a41019ca1071b1dad443a0d09054c09fb3e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-15Update VPP_STABLE_VER filesTibor Frank2-2/+2
Change-Id: Ic0ab23721178d8e8c7322806899bc36d33ae59ad Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-12Allow IPSECSW on 2node testbedsVratko Polak1-5/+5
Change-Id: I71d72699a7fa99749e2554fcb2252f8bd86bfdfa Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-12PAL: Optimize specification of elementsTibor Frank5-21052/+6571
- plot_mrr_box_name - plot_ndrpdr_box_name - plot_perf_box_name - plot_tsa_name - plot_nf_reconf_box_name - plot_nf_heatmap - plot_cpta Change-Id: I28ff2ea0e4f610e5ce48ffd083bf9a37bdc2f62d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-11Infra: Minor ansible tweakspmikus2-18/+16
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I47de0b78ed64b2426d39c5edf22ec36866609e8e
2021-03-11Infra: Switch csit-shim to fdiotoolspmikus53-635/+638
+ use /u/fdiotools + use ubuntu 20.04 Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I091e63a0d9e50de203b1527c7500b3864a616af6
2021-03-10Infra: Do not strict check keys in Ansiblepmikus1-7/+9
- not until we migrate to SSH keys in ubuntu 2004 Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I796f86922c672ba053d64f317cf6adb46b845cac
2021-03-09API: Track options and versionVratko Polak1-9/+55
If options are not present in .api.json file (e.g. old PVP build), use an empty dict. If a message is used in CSIT, check its options. Tolerate vat_help, but print warning for others. This aims to discover in-progress and obsolete APIs. If .api.json version is not detected, or starts with "0.", add a "version" item to options, so they get reported. Change-Id: Ic5a9423157728a58f7ad306c7bd9eaef3bd92488 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-08Infra: AWS/Azure fix OOM issues on smaller instancesTomas Alexy4-8/+33
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: Ic799f5eeaf03f34386603421c1d9282167c25aa5
2021-03-08Infra: Add reschedule policypmikus8-95/+217
Add rechedule policy to jobs so in case of failure they will respawn in a endless loop Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I15698d9e147644e68bec549fc53474d421b25d9a