aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools
AgeCommit message (Collapse)AuthorFilesLines
2019-12-09Perpatch compare: avg_diff is not an intVratko Polak1-1/+1
Change-Id: I1d003cb517ef95c76002862e540497d8c40cb913 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-09FIX: integer divisionsJan Gelety1-2/+2
Change-Id: I28caf62f418bf18601cd379603d03c307e3ba9c8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-09Trending: Use MppsTibor Frank4-9/+7
Change-Id: I63efaa244aa4931a8ab474bc64520e1f501ad57a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-09Trending: Fix AlertsTibor Frank3-31/+24
Change-Id: I963022c386928b7f29b176bfb4a4e2bfb0a55409 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-09Fixes: ReportTibor Frank1-4/+11
- show run Change-Id: Ife9e0faae467b39810c7bf6dec706ca0e09d24be Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-05FIX: Some leftovers + csit_sut image syncPeter Mikus1-0/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I9b47f9a31c11f155ba5b4676ccf0fc4c413a3942
2019-12-05Use new gdb commands for core dump examinationVratko Polak1-0/+35
Change-Id: I96f40fa816055a656209cbbcae8259a74cc4bd80 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-04Trending: Fix CLX plotsTibor Frank1-6/+6
Change-Id: Iea3181fcdf747bd6ca49f245f310a37498fcd801 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04Trending: Fix CLX data setTibor Frank1-0/+7
Change-Id: I027ded5ce3d36d55a8633c52c82effaf7c6b745a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04Trending: ReorganizationTibor Frank4-3065/+2947
+ use selection of tests by their full names + finalize trending_test_groups.md + modify static content + modify anchors + specifications: + container memif + ip4 + ip4 tunnels + ip6 + ipsec + l2 + srv6 + vhost + vts + dpdk + add 2n-clx + hyperlinks Change-Id: Ibe073330317539896c6fbfcbd4a7a279b58bdb95 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04PAL: Add HDRHistogram graphs for latencyTibor Frank5-16/+2822
Change-Id: I4d5cc369c341411a4a035dba47b945b3bf43014f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-03Remove: VIRLPeter Mikus113-11978/+112
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I2b1672412e19f15cb46246fffa931351cd3d518b
2019-12-03Python3: PALTibor Frank23-7531/+4994
- files renamed: - utils.py --> pal_utils.py - errors.py --> pal_errors.py - functions/methods renamed: - plot_service_density_reconf_box_name --> plot_nf_reconf_box_name - plot_performance_box_name --> plot_perf_box_name - plot_latency_error_bars_name --> plot_lat_err_bars_name - plot_throughput_speedup_analysis_name --> plot_tsa_name - plot_service_density_heatmap --> plot_nf_heatmap - table_performance_comparison --> table_perf_comparison - table_performance_comparison_nic --> table_perf_comparison_nic - table_performance_trending_dashboard_html --> table_perf_trending_dash_html - functions/methods removed: - plot_service_density_heatmap_compare - plot_throughput_speedup_analysis - plot_latency_error_bars - plot_soak_boxes - plot_soak_bars Change-Id: Icddc01d3ccb451abb92b9e5d912b642d01866033 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-03Python3: Vagrant updatePeter Mikus3-57/+62
+ Small styling Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ica8a4942b460b8534a9fbaf47bdb64dcfc9cbcde
2019-12-02Use Jumpavg 0.2.0 in PALVratko Polak8-38/+52
+ As a side effect, PAL is now part of "resource" package tree. - Testable only with 23558 (the rest of PAL Python 3 migration). Change-Id: Icbd90fd71458c07bced86f4bab9fa4e68282c38c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-02Refactor jumpavg to be more readable and usableVratko Polak3-25/+29
This is the python3 change, the python2 is still used for testing bisect. + New version is 0.2.0 due to amount o API changes. + Jumpavg is now part of CSIT resource package tree. + Perpatch migrated to new jumpavg. - PAL NOT updated (the update moved to a different Change). Change-Id: I7d7a8bf8a411196c20c2a40a8c64478d6709bc07 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-02FIX: Perpatch PY3Peter Mikus1-0/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iae97cf4490fea38f5f03bdaa120ee7ae48b941ab
2019-11-28Python3: resources and librariesJan Gelety17-550/+583
Change-Id: I1392c06b1d64f62b141d24c0d42a8e36913b15e2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-11-29Python3: PIP requirementPeter Mikus9-34/+61
- Install via PIP3 - Use virtualenv Python3 interpret Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iad22b344b418a1d91774d23d5ea17bfd48d394b3
2019-11-21NSH_SFC: RemoveTibor Frank6-80/+0
Change-Id: Ib7f9dff7bede4f8ec3148f234109132be920de82 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-11-19HONEYCOMB: RemovePeter Mikus15-739/+0
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I60d80564050cb786c7b1e0a08f31f8292f82197e
2019-11-18FIX: Ansible remove vppPeter Mikus1-14/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I054d2b282f67a465bb0f7ceacfe23d6283c88409
2019-11-13LIGATO: RemovePeter Mikus1-1/+0
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I0c9b8b07ed3a113e24a38faaddd5ed06fae67768
2019-11-13FIX: Ansible container cleanupPeter Mikus1-8/+2
Change-Id: I233baca48a3f01d1a206fd004b0503b0f1fad5d9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-11-13FIX: Ansible cleanup permissionPeter Mikus1-0/+2
Change-Id: Ia79558b579e70aa666e8f84230f4bd2cafb33569 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-11-13Trending: Input dataTibor Frank1-206/+159
Change-Id: I9b1060cb6162521bfdfe4b875444dc09c109960d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-11-11Remove the leftovers of the old testbed cleanupVratko Polak1-137/+0
Change-Id: I464db6fb6c220f23f2fe69df2c793175975d7b72 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-08FIX: Small ansible fixesPeter Mikus3-2/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I55e0f8c28ea166464026b61e3fd2b18faf8744f2
2019-11-05Cleanup via AnsiblePeter Mikus15-759/+317
+ Remove dependency on topo_ scripts that depends on custom SSH() that depends on framework itself. This way the cleanup is independent of failure in our SSH libs. + Simple ansible command can do cleanup of a machine: ansible-playbook --inventory inventories/lf_inventory/hosts site.yaml \ --limit '10.32.8.18' --tags 'cleanup' + Add vpp_device reset and cleanup. + Remove historical scripts. - Still in testing beta phase. - Need to add SRIOV cleanup. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I68e23304c7ad01041f51263c328c6e8d9b555cb7
2019-11-04Trending: Fix alertsTibor Frank1-1/+1
Change-Id: I0f54bbf34493cab927408aa1da7d855ce15db061 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-30Add: Use containers for shared TGPeter Mikus5-0/+102
+ Ansible + Service for auto load during restart + By default created 2 instances of Docker container + Small modification of Trex to use prefixes + DNV topology to use ssh port to connect to docker Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ibc2b2f0e509d920fc3e05d012b88abc388f5c3e7
2019-10-28PAL: Add sortable html table for comparisonsTibor Frank1-17/+134
Change-Id: I2d690685c5728e5f36b09d542e0f6d1a08cd151a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-25ADD: Mellanox RDMA interface supportPeter Mikus1-1/+1
+ Add functions for creating rdma interface + Fix traffic generator Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I81787b72ff5ee926ed652d350888c4f86da766f1
2019-10-18Trending: reduce input dataTibor Frank1-159/+159
Change-Id: I931c4140b3a6ced30030e4573fdd77e80987f972 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-17Ansible: Role cleanupPeter Mikus26-145/+216
+ Separate and reuse role (better naming) + Cleanup in naming + Introduce defaults that can be overriden Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iedaf7caba1d05a35a6f61cd21a483cdbc0073d32
2019-10-16Ansible: Clean Python requirementsPeter Mikus9-122/+99
+ minor cleanup Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iff9c643f6e9b52dc6a11b04624452f115f3a834e
2019-10-14Ansible: Mellanox installPeter Mikus6-41/+88
+ OFED + ibdev2netdev - aligning few naming conventions Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I0dff28b2cd4bbc4753597366d9b03b497fa336c4
2019-10-11Add: Parsing of show run over PAPIPeter Mikus1-53/+71
+ Add parsing of show run over PAPI STATS + Add missing outputs vs show run over CLI Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I88555ff4266d41ae1d9436181aad5c324ea9dab4
2019-10-11Trending: Reorganization of tests in graphsTibor Frank1-0/+951
Change-Id: I41ddcb65d099294c5ae510b2a5f237de973e27b7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-11Trending: Generate email body for regressions and progressionsTibor Frank3-16/+52
Change-Id: Iee652fc48b574b7866d5e7f0b7b927f96de3d25f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-09FIX: AnsiblePeter Mikus3-9/+9
+ Cover all CSIT devices with netplan to prevent DHCP usage + Move netplan to common role Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic3790f8ff770edf64b4066f8ddb99454643f5846
2019-10-09FIX: Add SRIOV cleanupPeter Mikus1-3/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I344cbab78e1491b1dc0b64598f1eae23c8d2cdcf
2019-10-07Trending: Send alerts when regression occursTibor Frank3-30/+53
Change-Id: I45d218ea323245199ad5093bd64c6a9bd862cad9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-07Report: Set the backgroud of graphsTibor Frank1-0/+12
Change-Id: Icd5f2ed496128b4cdc5f1113c778f66bbef5def3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-04FIX: Add SRIOV cleanupPeter Mikus1-11/+19
If Jenkins interrupt pybot during AVF tests (that is happening more frequently as coverage increased) the interfaces remains in link UP state. Next run VPP cannot grab interfaces as they are in UP state in and kernel driver. This results in testcase failing. Patch is supposed to do put interfaces in topology down so VPP can bind them back to vfio-pci. Change-Id: I2aa9e5944d39474965eac3c5f1b472f58e9aa8b5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-10-03Trending: Report also nr of passed tests in emailTibor Frank3-128/+172
Change-Id: I7ae188f5f684bd93352255d6b5c491b6d78c822c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-03PAL: Set plot.ly version to 4.1.1Tibor Frank3-16/+21
Change-Id: I137ee807a2802fa1f7b5b635e1162bf7fff07a57 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-02PAL: Accept reconf time in scientific notationVratko Polak1-5/+5
+ Otherwise "9.58828205237e-05" is understood as "9.58828205237". + Replace "[0-9]" with "\d". Change-Id: I7ecf6d0116fe704ecdba46f3a0e7975aba79aa62 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-27Report: Fix: Legend in reconf testsTibor Frank1-1/+1
Change-Id: I04806de7bf02af6c9b2119c45e75f8e0bc88bdd7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-26Report: Reconf tests: set autorange for y axisTibor Frank1-11/+1
Change-Id: Ie1ba26d3d76a8905698d0be33e9c5e61daff0e48 Signed-off-by: Tibor Frank <tifrank@cisco.com>