aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-12-16Perpatch compare: pylint fixes.Vratko Polak1-95/+92
+ Do not execute on import. + Replace hack() with sorted(). Change-Id: Ic439a799ab29d42ae21faf70b2aea6dce6e89510 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-16Do not execute crc check on importVratko Polak1-39/+57
Other guilty scripts already have open changes that fix them. Change-Id: Ife75e999d6d3f3f506b0f5dcdb679ce1f1e6bdbe Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-16FIX: NAT44 bugPeter Mikus1-1/+2
+ From trending ... Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I0ebb5429f0ad731d42aa43855cd99ae73b1461fc
2019-12-16FIX PIP requirement packagesPeter Mikus5-23/+6
+ CSIT will only use packages installed from master PIP requirement.txt file + All CSIT subsequent code must use single function and PIP list for virtualenv - Report/PAL/doc/trending will follow in next patch Change-Id: Ia9150fb05a144182a5a163178d553370ede55cdd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-12-16Remove supervisord dependency from containersPeter Mikus2-128/+35
+ Startup config stream-line Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia12e48202a5fc88461d3d24ac9b9599e7175b1d8
2019-12-13Reduce spam from device bootstrapVratko Polak1-0/+6
It uses "declare -f" to paste the complete common.sh file. Twice. The output from ssh remote side still remains visible, but avoiding the spam should ease scrolling to Robot console output. Change-Id: I746484ada7650a6dfa6794e76550757af5413a82 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-12API: Add collection for 22970/5Jan Gelety1-0/+237
Change-Id: If865526d833a267eba85e6ae4107e4d0da0dfd0b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-13Python3: refactor ':FOR' statementsDave Wallace3-3/+6
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I76835e3d3acf6955e328f30427f9dd0098947e41
2019-12-12CSIT-1597, CSIT-1647 API cleanup: gbpJan Gelety4-246/+9
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/23835 - update vpp stable to version 20.01-rc0~843 Change-Id: Idb1299cbbba578c09542c23858fb1fc55d090f26 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-12API: Add collection for 23835/1Jan Gelety3-14/+14
- update vpp stable to version 20.01-rc0~841 Change-Id: I05fc3878a606852c8348b61b40d8000411709d33 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-01API: Add collection for 23830/1Jan Gelety3-8/+8
- update vpp stable to version 20.01-rc0~839 Change-Id: Ic79bccf7cce384f5058218398bbef16cf1c9d40c Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-01API: Add collection for 23829/1Jan Gelety1-0/+237
Change-Id: I4b2a7bda48fba3050a35966f7a86c8dc7ba62d36 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-01CSIT-1597 API cleanup: vhostJan Gelety4-277/+6
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/22277 - update vpp stable to version 20.01-rc0~831 Change-Id: Icb3801d6a7bc738cf48bc5ecbb0767f115dde964 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-01CSIT-VPP-DEV: move tap tests back to critical poolJan Gelety3-3/+1
Change-Id: Ic99e828588d561a07c169502dff8ca19ac98400f Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-01API: Add collection for 22277/5Jan Gelety1-0/+239
Change-Id: Icd82e53ba5836302b036dbe41070d11b2ea4d401 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-11CSIT-1597 API cleanup: tapJan Gelety5-270/+40
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21706 - cover API cahnges in VPP: https://gerrit.fd.io/r/c/vpp/+/23887 - update vpp stable to version 20.01-rc0~828 Change-Id: I70d88741a02729421d4b31010910138838811518 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-11FIX: NF_Density pipeline ip4 profilePeter Mikus1-3/+3
- Because they are failing Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I55c51bd3e4673414e5394cc6ba990257574ab002
2019-12-11Introduce VPP-IPsec container tests.Ludovit Mikula87-847/+6962
Change-Id: Ie64d662e81879bd52785e0188450d998bf056bda Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
2019-11-30API: Add collection for 23887/2Jan Gelety1-6/+6
Change-Id: I3c2124aebbab8cac12a7fa661e75b68b70286240 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-10VPPD: Add L2patchPeter Mikus2-17/+103
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iebdc03e56cf9ecf0322ff5c2c8698e9e3daf4407
2019-12-10Trendig" Fix NFV graphTibor Frank1-2/+2
Change-Id: I92b2e6fb3ff095a16f2b8bf2b26770bb100d51ec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-10API: Add collection for 21706/17Jan Gelety1-0/+237
Change-Id: Ia4b278a48130426423f33a7cec1e586e8e552a00 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-10CSIT-1597 API cleanup: classifyJan Gelety8-267/+51
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21551 - move vpp stable build to 20.01-rc0~821 - tap tests tagged 'EXPECTED_FAILING' until necessary vpp api change https://gerrit.fd.io/r/c/vpp/+/21706 and csit code is adapted Change-Id: If4b9b7b5bc207612d08aa8aa4469a5361e058fc3 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-10Trending: Add more NFV testsTibor Frank8-167/+284
+ 10R2C, 6R4C + Tunnels Change-Id: I141fbb9cd9e975790af0e3d4dfa5f22da00fbfd9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-09Perpatch compare: avg_diff is not an intVratko Polak1-1/+1
Change-Id: I1d003cb517ef95c76002862e540497d8c40cb913 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-30FIX: ip route config for ipsec via VATJan Gelety1-13/+1
Change-Id: Ibf1979b87aeea0f4c195b97c8e6b59a4a23b1b77 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-09FIX: integer divisionsJan Gelety2-3/+3
Change-Id: I28caf62f418bf18601cd379603d03c307e3ba9c8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-09Trending: Use MppsTibor Frank4-9/+7
Change-Id: I63efaa244aa4931a8ab474bc64520e1f501ad57a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-09Trending: Fix AlertsTibor Frank3-31/+24
Change-Id: I963022c386928b7f29b176bfb4a4e2bfb0a55409 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-09Fixes: ReportTibor Frank1-4/+11
- show run Change-Id: Ife9e0faae467b39810c7bf6dec706ca0e09d24be Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-05Improve quoting of asterisksVratko Polak2-4/+4
When quoted, the asterisks are understood as literal characters. When unquoted, so they act as globs patterns. When used to match files already present in the filesystem, the asterisks should be unquoted. When used to match a package name (not a file), the asterisks should be quoted to prevent the bash expansion, as programs such as apt-get and yum do their own expasion afterwards. Unquoted asterisks for matching package names may happen to work when there are no files to match the bash expansion, but quoted asterisks are sure to avoid accidents. Also, we want an asterisk both before and after "vpp", due to package names such as libvppinfra-dev and python3-vpp-api. Change-Id: I657a24c24a71d865915aba201bd0d3276cb33281 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-05FIX: Some leftovers + csit_sut image syncPeter Mikus2-4/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I9b47f9a31c11f155ba5b4676ccf0fc4c413a3942
2019-12-05Use new gdb commands for core dump examinationVratko Polak2-7/+42
Change-Id: I96f40fa816055a656209cbbcae8259a74cc4bd80 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-05FIX: Deal with some "pylint: disable=" commentsPeter Mikus1-6/+3
Same rules for all Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iaf6b6313750d19132e2f2886e676100878719690
2019-12-05Deal with some "pylint: disable=" commentsVratko Polak13-38/+62
+ When possible, fix the violation. + Else, add a comment: + An explanation (if not already present) and keep disable. + A TODO (if not already present) and remove the disable. - This makes tox job report more pylint violations, but any such violation is fixable and should be fixed. - Although some need to be fixed in VPP, such as enum item long names. Change-Id: I48604b5eda070083d79dff1439620dbd9e798e1f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-05Python3: IPv4 FIB scale tests with random flowsBalaji Venkatraman6-0/+694
Signed-off-by: Balaji Venkatraman <balajiv@cisco.com> Change-Id: Iadd9e8da655f3ccbd36167c1bbee37a774c3bc1f Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>
2019-12-04Trending: Fix CLX plotsTibor Frank1-6/+6
Change-Id: Iea3181fcdf747bd6ca49f245f310a37498fcd801 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04Trending: Fix CLX data setTibor Frank1-0/+7
Change-Id: I027ded5ce3d36d55a8633c52c82effaf7c6b745a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04Trending: ReorganizationTibor Frank186-8130/+6987
+ use selection of tests by their full names + finalize trending_test_groups.md + modify static content + modify anchors + specifications: + container memif + ip4 + ip4 tunnels + ip6 + ipsec + l2 + srv6 + vhost + vts + dpdk + add 2n-clx + hyperlinks Change-Id: Ibe073330317539896c6fbfcbd4a7a279b58bdb95 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04Update CRC for 21551/27Vratko Polak0-0/+0
The previously prepared values for 21551/12 are not matching the newer patch sets. Change-Id: I2ddfcfc96f3f1573b20889dd52e142cf39465f65 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-04PAL: Add HDRHistogram graphs for latencyTibor Frank81-2115/+10790
Change-Id: I4d5cc369c341411a4a035dba47b945b3bf43014f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-11-29Change startup show pci to show verjuraj.linkes1-2/+2
When testing whether a socket is listetning, show pci results in a crash on the Taishan platform. Temporarily work around this by changing it to show ver. Change-Id: Id0f995373bc2f429d59de200e51959b2da408052 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-12-03Remove: VIRLPeter Mikus123-13217/+112
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I2b1672412e19f15cb46246fffa931351cd3d518b
2019-12-03FIX: Add ply also to global requirementsPeter Mikus1-0/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1fca2c05377f94e9df8c3df1d8d735c25a84e538
2019-12-03Python3: PALTibor Frank23-7531/+4994
- files renamed: - utils.py --> pal_utils.py - errors.py --> pal_errors.py - functions/methods renamed: - plot_service_density_reconf_box_name --> plot_nf_reconf_box_name - plot_performance_box_name --> plot_perf_box_name - plot_latency_error_bars_name --> plot_lat_err_bars_name - plot_throughput_speedup_analysis_name --> plot_tsa_name - plot_service_density_heatmap --> plot_nf_heatmap - table_performance_comparison --> table_perf_comparison - table_performance_comparison_nic --> table_perf_comparison_nic - table_performance_trending_dashboard_html --> table_perf_trending_dash_html - functions/methods removed: - plot_service_density_heatmap_compare - plot_throughput_speedup_analysis - plot_latency_error_bars - plot_soak_boxes - plot_soak_bars Change-Id: Icddc01d3ccb451abb92b9e5d912b642d01866033 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-11-29API: Add collection for 21551/27Jan Gelety1-2/+2
Change-Id: Id4b97a28013741d08d2293714e7d1a9034b0ceed Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-03FIX: vxlan+vlan perf testsJan Gelety1-5/+6
Change-Id: I7115456a1ef64a0b92113a77fba2949005208b07 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-03Python3: Vagrant updatePeter Mikus3-57/+62
+ Small styling Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ica8a4942b460b8534a9fbaf47bdb64dcfc9cbcde
2019-12-02Use Jumpavg 0.2.0 in PALVratko Polak8-38/+52
+ As a side effect, PAL is now part of "resource" package tree. - Testable only with 23558 (the rest of PAL Python 3 migration). Change-Id: Icbd90fd71458c07bced86f4bab9fa4e68282c38c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-02Refactor jumpavg to be more readable and usableVratko Polak24-789/+787
This is the python3 change, the python2 is still used for testing bisect. + New version is 0.2.0 due to amount o API changes. + Jumpavg is now part of CSIT resource package tree. + Perpatch migrated to new jumpavg. - PAL NOT updated (the update moved to a different Change). Change-Id: I7d7a8bf8a411196c20c2a40a8c64478d6709bc07 Signed-off-by: Vratko Polak <vrpolak@cisco.com>