aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2021-03-24FrameworkSetup: catch all exceptions in threadsJuraj Linkeš1-15/+32
Any uncaught exception in a thread running setup_node or cleanup_node will prevent the result of that thread's execution from being passed to the main thread. Since the main thread assumes there will be a result for each thread, this leads to false positives. Catch all exceptions in those background threads to fix this. Change-Id: I64013dfc671e576290c8376a58c754ed21b9ba3e Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-23Infra: fix NUMA count in Arm DPDK buildJuraj Linkeš1-3/+6
The default NUMA value for Taishan build is insufficient and results in failed test runs. Fix by increasing the amount to what's on the device. Change-Id: Ia7c761e81ee9063d7129472d9caa8cebbbb7e1cf Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-23Geneve: Re-write the creation of tunnels in pythonTibor Frank2-38/+75
Change-Id: I8b20134ad10abd9c021270b98c3110bd186946d5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-22MLRsearch: Support other than just two ratiosVratko Polak13-654/+896
+ Change some method names and argument types: + Do not mention NDR and PDR, except as examples. + Return list of ReceiveRateInterval instead of NdrPdrResult. + The resulting intervals can be degenerate when hitting min/max rate. + Rename quantity name parts from "fraction" to "ratio". + Intervals are no longer tracked for each target ratio. + They are found dynamically from known results. + Add effective_loss_ratio field to avoid loss inversion effects. + Move some functions to separate files. + Bound search logic moved to MeasurementDatabase.py + ProgressState moved to its file. + WidthArithmetics.py holds small computation functions. + Use parameter expansion_coefficient instead of "doublings". + Do uneven bisect to save time when width is not power of two times goal. + Timeout now correctly tracked for the whole search, not just the current phase. + Make logging (debug) function pluggable. + Added debug log messages for initial phase. + Do not mark as subclass if contructor signature differs. + Avoid re-measure on scale-limited (ASTF) profiles. + Remove outdated comments. + Bump copyright years. Change-Id: I93f693b4f186f59030ee5ac21b78acc890109813 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-22FIX: LXC imagepmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I73f7a1095b7cee52fade8a31285e405727548394
2021-03-20Tox: Increase verbosityVratko Polak1-2/+3
CSIT is becoming stricter in avoiding downloads during run, as everything should be pre-cached in executor image. This change makes it easier for human to detect downloads. Change-Id: If7085f96ef1033f7f9405a86232a3d39a239d3e1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-19FrameworkSetup: Detect socket.timeoutVratko Polak1-2/+3
Otherwise setup "passes" leading to confusing errors later. Example: https://logs.fd.io/production/vex-yul-rot-jenkins-1/csit-vpp-perf-mrr-daily-master-2n-skx/1251/archives/log.html.gz#s1-s1-s1-k1-k2 Change-Id: I56b14e2eb75679c7c10b00b3f9c6bf07902e5166 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-18fix two issuesYulong Pei1-1/+1
1. wrong symbol link path for MLRsearch. 2. self._received force to integer in _parse_traffic_results function. Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: Ie86a549b222d28b8cecc889807044476975dffb1
2021-03-18Infra: Shared TG Ansible rulespmikus2-4/+6
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I7d505d99003c4ab48b191c1d534513768d03bc83
2021-03-17PAL: Remove instalation of system dependenciesTibor Frank3-20/+2
Change-Id: I66024f3110804499fa32628b0f72711413d741ac Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-17IPsec: fix SA policy cliJuraj Linkeš1-2/+2
The tunnel specification in "ipsec sa add" has changed. Update the cli the reflect this. Change-Id: I11d788798419b96b1289c53052eedb9767252df6 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-17ansible: arm perf TG updateJuraj Linkeš1-2/+3
Update TG to shared (docker) TG and add hugepages accordingly. Change-Id: I45ece9d1c8d6dbc3174661447ae46a7e28613313 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-17Infra: csit-sut temporary buildpmikus27-286/+184
- Untill the issue with fdiotools will be solved Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I3c2b06f37014a0571487d527447d90ceafdf52a9
2021-03-16Infra: Upgrade csit-dut imagepmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I0341a1564ba510acf46bda3e24225209abef2f82
2021-03-16Perf: Bump T-Rex to 2.88pmikus2-3/+3
+ Mellanox 4.6 is not for Ubuntu 20.04 + Mellanox for ubuntu 20.04 is 4.9+ + T-Rex 2.86 is not for Mellanox 4.6+ + T-Rex for Mellanox 5.2 is 2.88+ ================================== = Bump Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I902dfc2a43e6718b385e89f31a34260e09d61bd3
2021-03-16API options: Fix case when no options are presentVratko Polak1-2/+2
In that case we want to pass by returning an empty dict, as docstring already describes. Before this, the code failed when checking for included version. Change-Id: Ia0d6b81a64ad0e7027ac7daf15c72ace1f6982ce Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-15Infra: Ansible Ubuntu 20.04 follow-upspmikus6-12/+9
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I36a8b4a6cab976f51685df56c0dc2d95c00e248f
2021-03-15PAL: set DEBIAN_FRONTEND=noninteractive in run_report.shTibor Frank1-0/+1
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I30037a41019ca1071b1dad443a0d09054c09fb3e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-12Allow IPSECSW on 2node testbedsVratko Polak1-5/+5
Change-Id: I71d72699a7fa99749e2554fcb2252f8bd86bfdfa Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-12PAL: Optimize specification of elementsTibor Frank5-21052/+6571
- plot_mrr_box_name - plot_ndrpdr_box_name - plot_perf_box_name - plot_tsa_name - plot_nf_reconf_box_name - plot_nf_heatmap - plot_cpta Change-Id: I28ff2ea0e4f610e5ce48ffd083bf9a37bdc2f62d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-11Infra: Minor ansible tweakspmikus2-18/+16
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I47de0b78ed64b2426d39c5edf22ec36866609e8e
2021-03-10Infra: Do not strict check keys in Ansiblepmikus1-7/+9
- not until we migrate to SSH keys in ubuntu 2004 Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I796f86922c672ba053d64f317cf6adb46b845cac
2021-03-09API: Track options and versionVratko Polak1-9/+55
If options are not present in .api.json file (e.g. old PVP build), use an empty dict. If a message is used in CSIT, check its options. Tolerate vat_help, but print warning for others. This aims to discover in-progress and obsolete APIs. If .api.json version is not detected, or starts with "0.", add a "version" item to options, so they get reported. Change-Id: Ic5a9423157728a58f7ad306c7bd9eaef3bd92488 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-08Infra: AWS/Azure fix OOM issues on smaller instancesTomas Alexy2-8/+8
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: Ic799f5eeaf03f34386603421c1d9282167c25aa5
2021-03-07Infra: Docker DNS on Nomad hostspmikus7-5/+58
+ Make the host default resolver Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ifadb8901c66b65b2213878180c87370262ab22f0
2021-03-05PAL: repeat the download if it fails 2Tibor Frank2-4/+9
Change-Id: I9bba50281bfe65f62a1cfab76364d834dc10d80c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-05PAL: repeat the download if it failsTibor Frank1-47/+57
Change-Id: I0a977009345ca5e46d23cc55405c6fd9b6e61c58 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-05PAL: Fix: ignore verifying the SSL certificateTibor Frank1-5/+7
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ia39c9fcfc6240a30d48b492ec5e1451d8279c646 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-05PAL: download - ignore verifying the SSL certificateTibor Frank6-6/+12
- only for https://logs.nginx.service.consul/vex-yul-rot-jenkins-1 Change-Id: Ibdcc59a44d5aae331aeef22fad54c4e90b2eec6b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-05PAL: use http instead of https for S3Tibor Frank3-3/+3
Change-Id: Ie70f48142d182518d794e542052c31427d788849 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-05PAL: Add s3_storage as the data sourceTibor Frank5-8/+28
Priorities for download: 1. s3_storage 2. logs.fd.io 3. docs.fd.io release 4. docs.fd.io master 5. jenkins Change-Id: I7114715c3ec9a33acc8edf3c5c473f4eaffa639d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-04FIX: Ansible storage bugspmikus4-4/+12
- daily digest Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ifa2dc10831fde0a101c916f2b8abd26abb93cb7f
2021-02-25Report: Configure rls2101.09Tibor Frank2-2/+2
Change-Id: Ib61e7643c2072d9f0e8cdec3bb7e0328bd25d60a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-24Infra: Azure - file cleanupTomas Alexy6-72/+78
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: I8b97123711a76bf8851f6c4997e819d79364b83b
2021-02-24Trending: Add nat44-tput testsTibor Frank2-0/+334
Change-Id: I0e670cfa4e0125856944656536f0d64d04bdbb6d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-24Report: Set .08 revision, fix GSO graphsTibor Frank5-26/+115
Change-Id: I5948dbaf69d183caddbefd16f2198b54a24ff904 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-22Ipsec: Always generate ikeyVratko Polak1-43/+67
Some tests use a crypto algorithm with no integrity algorithm. Generate empty binary strings as fake integrity keys to keep return values of low level methods consistent. + Add return_keys argument to avoid returning long lists. + Improve various docstrings. Change-Id: Idae1877bdde32d194ce4e3bb3053c8dba39d377a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-02-22Report: Add gso testsTibor Frank3-5/+308
Change-Id: Ic21d43a104bdafe93600d8f5fd60d403d13285aa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-19Add test suites for crypto sw scheduler engineYulong Pei7-5/+167
This patch is to add test suites for vpp plugin crypto_sw_scheduler, IPsec sync mode is to do crypto and packet forward work in same worker cores, crypto_sw_scheduler can schedule crypto work to other async crypto cores to improve whole crypto processing capability. This test suites configure fixed 1 rx queues per port, then measure IPsec performance with 1, 2, 3 crypto cores. This patchset include 1, 2, 4, 8 ipsec tunnels test cases. +Vratko help to change to count total physical cores instead of previous only count crypto cores in test cases. Change-Id: I0e67182e3d13273890a23703d838101900e25126 Signed-off-by: Yulong Pei <yulong.pei@intel.com> Signed-off-by: Vratko Polak <vrpolak@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2021-02-19FIX: Naming convention compliancepmikus1-1/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Idcee623abbc5568fc6ca49113bc2ff8add179046
2021-02-19API: Use newer messagesVratko Polak3-15/+28
The mesages are the newest present in last common ancestor of master and rls2101 (so not yet ipsec_sad_entry_add_del_v3). Added a TODO for the RDMA create improvement, to be implemented in a separate change. Change-Id: I94bcd2f1bc109fb995c4dd6df44f8928865634f5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-02-19Infra: Ansible Ubuntu Focalpmikus36-257/+388
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I6558938fe4bbdfb5add7a361adb4a12da6b0a6dc
2021-02-19Framework: GSO testpmikus2-1/+70
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I874568aebbe50c38e634438eb1201ca737bd18ad
2021-02-18Infra: Fix AWS deploymentTomas Alexy10-101/+117
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: Ie24f5fac5827e28b1ac7c22192a94994700b2910
2021-02-18Framework: SciPy upgradepmikus1-1/+1
+ 1.5.4 to solve python3.8 dependency. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I682bedc18b56d1fed3974f792a4d79656cbe97cb
2021-02-18Framework: Qemu 4.2 compatibility fixpmikus1-1/+0
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I8692b53c02773dbe5a5e02f959dfed8599cb8a4d
2021-02-17PAPI: Python 3.8 compatibilitypmikus1-5/+7
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I33fefddda9055524c1817b13b5c99bb1b97ebff4
2021-02-17Infra: Ansible docker images cleanuppmikus10-74/+188
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I8d67b8ad5db5c0a7c9b3fa892e1e66dab2f666d0
2021-02-17Report: Add dataTibor Frank1-0/+8
Change-Id: Idf8610d4502a3e0ff0ff0471c1fe6a75cd46a593 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-02-16Infra: Ansible 2.10Peter Mikus10-3/+52
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I6b058ff30628c7e066372fec2141a8bcc18c3997