aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2019-12-03Python3: PALTibor Frank23-7531/+4994
- files renamed: - utils.py --> pal_utils.py - errors.py --> pal_errors.py - functions/methods renamed: - plot_service_density_reconf_box_name --> plot_nf_reconf_box_name - plot_performance_box_name --> plot_perf_box_name - plot_latency_error_bars_name --> plot_lat_err_bars_name - plot_throughput_speedup_analysis_name --> plot_tsa_name - plot_service_density_heatmap --> plot_nf_heatmap - table_performance_comparison --> table_perf_comparison - table_performance_comparison_nic --> table_perf_comparison_nic - table_performance_trending_dashboard_html --> table_perf_trending_dash_html - functions/methods removed: - plot_service_density_heatmap_compare - plot_throughput_speedup_analysis - plot_latency_error_bars - plot_soak_boxes - plot_soak_bars Change-Id: Icddc01d3ccb451abb92b9e5d912b642d01866033 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-11-29API: Add collection for 21551/27Jan Gelety1-2/+2
Change-Id: Id4b97a28013741d08d2293714e7d1a9034b0ceed Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-03FIX: vxlan+vlan perf testsJan Gelety1-5/+6
Change-Id: I7115456a1ef64a0b92113a77fba2949005208b07 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-03Python3: Vagrant updatePeter Mikus3-57/+62
+ Small styling Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ica8a4942b460b8534a9fbaf47bdb64dcfc9cbcde
2019-12-02Use Jumpavg 0.2.0 in PALVratko Polak8-38/+52
+ As a side effect, PAL is now part of "resource" package tree. - Testable only with 23558 (the rest of PAL Python 3 migration). Change-Id: Icbd90fd71458c07bced86f4bab9fa4e68282c38c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-02Refactor jumpavg to be more readable and usableVratko Polak10-28/+771
This is the python3 change, the python2 is still used for testing bisect. + New version is 0.2.0 due to amount o API changes. + Jumpavg is now part of CSIT resource package tree. + Perpatch migrated to new jumpavg. - PAL NOT updated (the update moved to a different Change). Change-Id: I7d7a8bf8a411196c20c2a40a8c64478d6709bc07 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-02FIX: Perpatch PY3Peter Mikus3-3/+4
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iae97cf4490fea38f5f03bdaa120ee7ae48b941ab
2019-11-28FIX: SRV6 proxyJan Gelety1-1/+2
Change-Id: I4afbb0261c21c800bf24e423e505307f596c0045 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-11-28FIX: aclJan Gelety2-4/+5
Change-Id: Ieb1569a1dce9fd7c00041ba00f72c67142a581ed Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-01FIX: VAT terminalPeter Mikus1-6/+8
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I98fd62e6b5367b23694017d99a1dae7d893326c9
2019-11-30FIX: IPsec naming creationPeter Mikus1-8/+10
Change-Id: I066a8b85649654c1c575eb63722de6c51f3d4f78 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-11-28Python3: resources and librariesJan Gelety186-14196/+8043
Change-Id: I1392c06b1d64f62b141d24c0d42a8e36913b15e2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-11-29Python3: PIP requirementPeter Mikus11-41/+70
- Install via PIP3 - Use virtualenv Python3 interpret Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iad22b344b418a1d91774d23d5ea17bfd48d394b3
2019-11-21NSH_SFC: RemoveTibor Frank17-1193/+0
Change-Id: Ib7f9dff7bede4f8ec3148f234109132be920de82 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-11-19HONEYCOMB: RemovePeter Mikus122-19213/+0
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I60d80564050cb786c7b1e0a08f31f8292f82197e
2019-11-18Improve test tag string parsingVratko Polak1-21/+12
Instead of just adding the missing -clx, the new way aims to be forward compatible. The new implementation is quite permissive, ignoring all "word" chars sticking to the trigger word and returning everything after that and space up to the endline. + Unified perftest and devicetest handling. + Consequently, triggers like "devicetest-1n-skx GBP" will work now. Change-Id: I3bda6105195180d35a589a75318f569e36f03461 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-18FIX: Ansible remove vppPeter Mikus1-14/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I054d2b282f67a465bb0f7ceacfe23d6283c88409
2019-11-15FIX: LXC Container directory initializationPeter Mikus1-0/+2
Change-Id: I7d2f81e03316410073b2b3ff7d6d754f5ac90df7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-11-14CRC: Update comments after lb-nat4 testsVratko Polak1-9/+5
Change-Id: I5530421ab8b4dd6404d9a7d1939a890b408c0df9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-14FIX: Ipsec perfPeter Mikus1-0/+19
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I6e3ce086978c383303724d989702b1c1273c50c0
2019-11-13LIGATO: RemovePeter Mikus24-2028/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I0c9b8b07ed3a113e24a38faaddd5ed06fae67768
2019-11-12FIX: missing param in gbp_contract_add_delJan Gelety1-12/+20
Change-Id: I5c2354911505a9d7a95bef894eda8bf7b14b8dc8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-11-13FIX: Ansible container cleanupPeter Mikus1-8/+2
Change-Id: I233baca48a3f01d1a206fd004b0503b0f1fad5d9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-11-13FIX: Ansible cleanup permissionPeter Mikus1-0/+2
Change-Id: Ia79558b579e70aa666e8f84230f4bd2cafb33569 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-11-13Add vpp loadbalancer l3dsr/nat4 mode test suiteshaiyanx1.zhang2-14/+141
Change-Id: I03603108fe7128fb4bde4abddb6a0959dd5b5c73 Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>
2019-11-13Trending: Input dataTibor Frank1-206/+159
Change-Id: I9b1060cb6162521bfdfe4b875444dc09c109960d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-11-11New weekly mrr triggerJan Gelety2-433/+5
Change-Id: Iff21ad109e5f0a8ed06bd561e75c8a708e84c036 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-11-12FIX: Supervisor initializationPeter Mikus1-22/+21
- Next step: remove supervisor entirely Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I7ff5d76168d5d0f77e335975552638efac77cfc8
2019-11-11Remove the leftovers of the old testbed cleanupVratko Polak3-152/+2
Change-Id: I464db6fb6c220f23f2fe69df2c793175975d7b72 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-11FIX: do not use ping in vpp-device testsJan Gelety6-196/+201
Change-Id: Ic11f863e7ffad70d45e6e8dc39c70efc62cecc96 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-11-11FIX: Paths for new Docker imagesPeter Mikus2-10/+10
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia39ff6445e4029a78d008d5690661610a1e9ed50
2019-11-08Prevent many TC triggered by bad tag expressionsVratko Polak1-2/+8
Typical example: Use multiple perftest lines in a comment. Atypical example: Use perftest as an expression (without any ANDs). Fix: Die if "perftest" is found in the tag expression (before prefixing). Change-Id: I0230541b30557ce7a4e9d57c8303cd432f86747d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-07FIX: use correct NIC for mr-daily-master jobJan Gelety1-1/+1
Change-Id: I57bc8c7eda7ea959d92f7e35b7989d64b20743a0 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-11-08FIX: Small ansible fixesPeter Mikus3-2/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I55e0f8c28ea166464026b61e3fd2b18faf8744f2
2019-11-07Source ansible.sh for entry scripts using cleanupVratko Polak2-0/+4
Change-Id: Iee02577ee0c054feb61edee807182c6808f235b0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-05Cleanup via AnsiblePeter Mikus17-763/+320
+ Remove dependency on topo_ scripts that depends on custom SSH() that depends on framework itself. This way the cleanup is independent of failure in our SSH libs. + Simple ansible command can do cleanup of a machine: ansible-playbook --inventory inventories/lf_inventory/hosts site.yaml \ --limit '10.32.8.18' --tags 'cleanup' + Add vpp_device reset and cleanup. + Remove historical scripts. - Still in testing beta phase. - Need to add SRIOV cleanup. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I68e23304c7ad01041f51263c328c6e8d9b555cb7
2019-11-04Trending: Fix alertsTibor Frank1-1/+1
Change-Id: I0f54bbf34493cab927408aa1da7d855ce15db061 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-29New daily triggersJan Gelety6-12/+285
New daily triggers defined based on requirements defined in https://gerrit.fd.io/r/c/csit/+/22341/34/resources/tools/presentation/doc/trending_test_groups.md Change-Id: I95bff10d9a2e29c712a33f7c043933244b712fd0 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-31Regularize spaces in crc listVratko Polak1-12/+12
Two spaces before hash if after quote, single space otherwise (or 4 spaces if the hash is commenting out the whole line). Change-Id: Icee85996a00e4e31ce61ad5030f4cdbedeacd506 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-31Copy missing lines to second CRC collectionVratko Polak1-0/+4
Change-Id: If8fa609bf0c58ad0cc63a8320f298c026f8b7900 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-30Framework: Add show log as tear down actionPeter Mikus3-13/+26
+ We can see what is happening when debug level is increased + Big caveat of VPP is that it does not allow to configure default global level. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I5ea1a618161cdb3170cab022d7451e52271f83c0
2019-10-30Add: Use containers for shared TGPeter Mikus6-2/+104
+ Ansible + Service for auto load during restart + By default created 2 instances of Docker container + Small modification of Trex to use prefixes + DNV topology to use ssh port to connect to docker Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ibc2b2f0e509d920fc3e05d012b88abc388f5c3e7
2019-10-29API: Add collection for 21551/12Jan Gelety1-0/+235
Change-Id: Ia1232a71378f925110741ad9f914d8c5abd6941e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-28TrafficGenerator: Skip only the first equalsVratko Polak1-5/+5
HRDhistogram output contains essential trailing equals. Edit all fields even though we do not expect equals in others. Change-Id: I9f4f07fc4d6f4583989a9c0e45f68bc0cd9a65fe Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-28PAL: Add sortable html table for comparisonsTibor Frank1-17/+134
Change-Id: I2d690685c5728e5f36b09d542e0f6d1a08cd151a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-25FIX: Limitation for NICsPeter Mikus2-5/+20
Change-Id: I8e0a14f59e20d61096e069bb80a0e2c00977ac5c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-10-25ADD: Mellanox RDMA interface supportPeter Mikus5-11/+59
+ Add functions for creating rdma interface + Fix traffic generator Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I81787b72ff5ee926ed652d350888c4f86da766f1
2019-10-25Introduce pre-initialize driver layerPeter Mikus4-264/+188
+ This will help unify driver base differences between TCs. + Decrease amount of logic needed for suite generator. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1e84ba361dc1e829f0612c58a61096e2633ce0c5
2019-10-21CRCs: Update comments and improve CSIT checks.Vratko Polak2-77/+101
+ Restore alphabetic order in yaml. + Mark the lisp messages verified to be covered by dev instead of virl. + Mark the GBP messages verified by devicetest now. + Mark acl_add_replace as dev and create_subif as perf. + Mark ip_probe_neighbor as unused L1. + Improve loadbalancer comments. - Nat4 testcase is described, even if not merged yet. + Forget reported CRC after initial dir report, and report them again (once) in test cases (if hit). With this, single run (with fail on crc off) gives full info. + Small improvements to CRC library docstrings and messages. Change-Id: Ic1cfad45e10d437be827af2a89eac49e25267b59 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-19Tests: Introduce driver layerPeter Mikus2-11/+33
+ Small bugfixes in various suites Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I051af0a6da7340fe3f617400370c3846ca5241ab