aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools/presentation
AgeCommit message (Collapse)AuthorFilesLines
2020-01-17Report: Remove 'avf' from TC name in plotsTibor Frank1-5/+7
Change-Id: Ie1d04347de123032a5d424747d216f90022bc813 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-17Report: Prepare data setsTibor Frank2-639/+517
Change-Id: Ice90ffe8563d6283050f2b229fc5e50ab64ac253 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-16Report: Latency by Percentile DistributionTibor Frank1-2/+7
- legend Change-Id: I35477ce5c2cabfdcef68424854a8574bd3655e55 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-16Report: Latency by Percentile DistributionTibor Frank2-5/+5
- Set X-axis Change-Id: Ica300c7b1352c824bf51ac26e7485c9295ac60dc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-15Report: Latency by Percentile DistributionTibor Frank1-1/+7
- Set the position of the Lagend Change-Id: I1bcea6002bd8beeba3300c9976d1603a234c3c14 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-15Report: Add Latency by Percentile DistributionTibor Frank2-4/+3299
Change-Id: I5291db8117da611497e910aa7cd2fbb2276bfe65 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-10Autogen: Generate also NIC drivers.Vratko Polak5-15/+15
+ Disallowed -avf- (or -rdma-) as "template" suites. + GBP suite switched to DPDK driver in repo. + Each NIC has its own list of supported drivers, in Constants. + Updated tag expressions for daily jobs: + Feature, ipsec, memif, scale, srv6, tunnels, vhost and vts are tested only with vfio-pci. + Other (base, dot1q, dot1ad) tested with all drivers. + Setup actions currently depend on driver, generated. - The performance_rdma action is trivial for now. - Several tests fail, to be fixed later, e.g. by performance_rdma. + Reconf tests are also supported. + Added DRV_VFIO_PCI tags missing, mainly in density tests. - Vhost suites (density, reconf) are failing, but suites look good. - TCP suites do not support NIC drivers yet. - DPDK obviously not supported. + Use Python 3 in regenerate scripts. + Fix typos binded => bound. + File open modes set either u"rt" or u"wt" everywhere. + Remove a trailing space in an environment variable name. Change-Id: I290470675dc5c9e88b2eaa5ab6285ecd9ed7827a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-15Report: Current vs. Previous Release - NFV TestsTibor Frank1-0/+172
Change-Id: I00cbde38b8f900efe3e3123a942de2288381ea3b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-14Report: Add VNF Service Chains TunnelsTibor Frank1-324/+512
Change-Id: Iafdcb543f6adc583567a05aa5a882dce17b58f03 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-13Report: Move VTS tests from 3n to 2nTibor Frank1-245/+24
Change-Id: Ie2faa6cb611d372c4a20584f7b40f3281660f2b1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-10Report: Add comparison tablesTibor Frank1-88/+811
CSIT-1654 Change-Id: I280195b295d4fc717cb355e78c5f1731bb1eabe5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-10Report: Add 2n-clxTibor Frank1-4/+2464
Change-Id: I34dc11c28d21f0b9fed87d76942fe8b8cdd86c88 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-09Report: Configure Report 2001Tibor Frank3-29/+19
Change-Id: I5ef3c37cf329b76a1a7f94d60c3563872eef3c5d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-09DMM: RemoveTibor Frank2-10/+7
Change-Id: Ibbfbed79e473c804390802ae1ecd737b50c06aa3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-08PAL: Set y-axis for HDRHistogramTibor Frank1-3/+4
Change-Id: Ibdee625d6d9215b18771a6348735dc6a07e9ae58 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-07Remove VIRL Func tests from ReportTibor Frank1-190/+0
Change-Id: Ic6edf1f6f6c12d8e76da76617dbf1c4e8e1e2952 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-07Trending: Move VTS tests from 3n to 2nTibor Frank1-327/+72
Change-Id: I420cef699d42973602f1290ccd0cc5e378d42492 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-18Trending: Fix input data processingTibor Frank1-1/+1
Change-Id: I79cecd07c933cc46beb09de1ee2b4a0db5dd8a79 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-17Telemetry: Add more operational dataPeter Mikus1-1/+2
+ Add both NDR and PDR telemetry capture + Speedup sockets + Adjust privileges Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia6fd5d405e6fb410651d8b705c921653753aea10
2019-12-17CTPA: Improve handling pps vs MppsVratko Polak1-22/+25
+ Jumpavg assumes precision is around 1, so gives wrong classifications when fed Mpps numbers, and the classification has to be done on pps values. + Hover should display Mpps values properly, e.g. as floats. + Decided to show 3 digits after decimal point. + Better distinguishing between keys and indices. Change-Id: I99bdad5b401839889463c7cf6f8b0930ec65b457 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-10Trending: Add more NFV testsTibor Frank2-141/+210
+ 10R2C, 6R4C + Tunnels Change-Id: I141fbb9cd9e975790af0e3d4dfa5f22da00fbfd9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-09Trending: Use MppsTibor Frank4-9/+7
Change-Id: I63efaa244aa4931a8ab474bc64520e1f501ad57a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-09Trending: Fix AlertsTibor Frank3-31/+24
Change-Id: I963022c386928b7f29b176bfb4a4e2bfb0a55409 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-09Fixes: ReportTibor Frank1-4/+11
- show run Change-Id: Ife9e0faae467b39810c7bf6dec706ca0e09d24be Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04Trending: Fix CLX plotsTibor Frank1-6/+6
Change-Id: Iea3181fcdf747bd6ca49f245f310a37498fcd801 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04Trending: Fix CLX data setTibor Frank1-0/+7
Change-Id: I027ded5ce3d36d55a8633c52c82effaf7c6b745a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04Trending: ReorganizationTibor Frank4-3065/+2947
+ use selection of tests by their full names + finalize trending_test_groups.md + modify static content + modify anchors + specifications: + container memif + ip4 + ip4 tunnels + ip6 + ipsec + l2 + srv6 + vhost + vts + dpdk + add 2n-clx + hyperlinks Change-Id: Ibe073330317539896c6fbfcbd4a7a279b58bdb95 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04PAL: Add HDRHistogram graphs for latencyTibor Frank5-16/+2822
Change-Id: I4d5cc369c341411a4a035dba47b945b3bf43014f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-03Python3: PALTibor Frank23-7531/+4994
- files renamed: - utils.py --> pal_utils.py - errors.py --> pal_errors.py - functions/methods renamed: - plot_service_density_reconf_box_name --> plot_nf_reconf_box_name - plot_performance_box_name --> plot_perf_box_name - plot_latency_error_bars_name --> plot_lat_err_bars_name - plot_throughput_speedup_analysis_name --> plot_tsa_name - plot_service_density_heatmap --> plot_nf_heatmap - table_performance_comparison --> table_perf_comparison - table_performance_comparison_nic --> table_perf_comparison_nic - table_performance_trending_dashboard_html --> table_perf_trending_dash_html - functions/methods removed: - plot_service_density_heatmap_compare - plot_throughput_speedup_analysis - plot_latency_error_bars - plot_soak_boxes - plot_soak_bars Change-Id: Icddc01d3ccb451abb92b9e5d912b642d01866033 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-02Use Jumpavg 0.2.0 in PALVratko Polak8-38/+52
+ As a side effect, PAL is now part of "resource" package tree. - Testable only with 23558 (the rest of PAL Python 3 migration). Change-Id: Icbd90fd71458c07bced86f4bab9fa4e68282c38c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-28Python3: resources and librariesJan Gelety4-4/+4
Change-Id: I1392c06b1d64f62b141d24c0d42a8e36913b15e2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-11-29Python3: PIP requirementPeter Mikus2-6/+6
- Install via PIP3 - Use virtualenv Python3 interpret Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iad22b344b418a1d91774d23d5ea17bfd48d394b3
2019-11-21NSH_SFC: RemoveTibor Frank3-11/+0
Change-Id: Ib7f9dff7bede4f8ec3148f234109132be920de82 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-11-19HONEYCOMB: RemovePeter Mikus3-5/+0
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I60d80564050cb786c7b1e0a08f31f8292f82197e
2019-11-13LIGATO: RemovePeter Mikus1-1/+0
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I0c9b8b07ed3a113e24a38faaddd5ed06fae67768
2019-11-13Trending: Input dataTibor Frank1-206/+159
Change-Id: I9b1060cb6162521bfdfe4b875444dc09c109960d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-11-04Trending: Fix alertsTibor Frank1-1/+1
Change-Id: I0f54bbf34493cab927408aa1da7d855ce15db061 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-28PAL: Add sortable html table for comparisonsTibor Frank1-17/+134
Change-Id: I2d690685c5728e5f36b09d542e0f6d1a08cd151a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-18Trending: reduce input dataTibor Frank1-159/+159
Change-Id: I931c4140b3a6ced30030e4573fdd77e80987f972 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-11Add: Parsing of show run over PAPIPeter Mikus1-53/+71
+ Add parsing of show run over PAPI STATS + Add missing outputs vs show run over CLI Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I88555ff4266d41ae1d9436181aad5c324ea9dab4
2019-10-11Trending: Reorganization of tests in graphsTibor Frank1-0/+951
Change-Id: I41ddcb65d099294c5ae510b2a5f237de973e27b7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-11Trending: Generate email body for regressions and progressionsTibor Frank3-16/+52
Change-Id: Iee652fc48b574b7866d5e7f0b7b927f96de3d25f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-07Trending: Send alerts when regression occursTibor Frank3-30/+53
Change-Id: I45d218ea323245199ad5093bd64c6a9bd862cad9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-07Report: Set the backgroud of graphsTibor Frank1-0/+12
Change-Id: Icd5f2ed496128b4cdc5f1113c778f66bbef5def3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-03Trending: Report also nr of passed tests in emailTibor Frank3-128/+172
Change-Id: I7ae188f5f684bd93352255d6b5c491b6d78c822c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-03PAL: Set plot.ly version to 4.1.1Tibor Frank3-16/+21
Change-Id: I137ee807a2802fa1f7b5b635e1162bf7fff07a57 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-02PAL: Accept reconf time in scientific notationVratko Polak1-5/+5
+ Otherwise "9.58828205237e-05" is understood as "9.58828205237". + Replace "[0-9]" with "\d". Change-Id: I7ecf6d0116fe704ecdba46f3a0e7975aba79aa62 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-27Report: Fix: Legend in reconf testsTibor Frank1-1/+1
Change-Id: I04806de7bf02af6c9b2119c45e75f8e0bc88bdd7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-26Report: Reconf tests: set autorange for y axisTibor Frank1-11/+1
Change-Id: Ie1ba26d3d76a8905698d0be33e9c5e61daff0e48 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-24Add support for HDRhistogramVratko Polak2-133/+45
+ Enable hdrh in trex server. + Append hdrh coded output after min/avg/max/. + Read (not show nor decode) hdrh value in PAL. + Also, remove old ndrpdrdisc code. Change-Id: I99d99f10386a621772b5419ca1f36080fa15aca7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>