aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools/presentation/generator_cpta.py
AgeCommit message (Collapse)AuthorFilesLines
2022-01-25trending: fix re-pro showing wrong dataViliam Luc1-18/+17
vpp-2n-zn2-mrr, CSIT build: https://jenkins.fd.io/view/csit/job/csit-vpp-perf-mrr-daily-master-2n-zn2/484, vpp version: 22.06-rc0~0-g017a67665~b2179 4t2c-avf-eth-l2bdbasemaclrn-mrr 10ge2p1x710 64B 29.6 1 -0.2 2t2c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr 10ge2p1x520 64B 1.14 1 -58.08 4t4c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr 10ge2p1x520 64B 1.98 1 -57.73 4t4c-ethip4-ip4base-mrr 10ge2p1x553 64B 2.97 1 -79.05 1t1c-eth-l2patch-mrr 10ge2p1x553 64B 2.98 1 -75.94 2t2c-eth-l2bdbasemaclrn-mrr 10ge2p1x553 64B 8.27 1 -11.0 2t1c-af-xdp-ethip4-ip4scale2m-mrr 25ge2p1xxv710 64B 6.21 1 -53.14 vpp-2n-tx2-mrr, CSIT build: https://jenkins.fd.io/view/csit/job/csit-vpp-perf-mrr-daily-master-2n-tx2/265, vpp version: 22.02-rc0~508-g88a9c0e02~b851 4t2c-avf-eth-l2bdbasemaclrn-mrr 10ge2p1x710 64B 29.6 1 -0.2 2t2c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr 10ge2p1x520 64B 1.14 1 -58.08 4t4c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr 10ge2p1x520 64B 1.98 1 -57.73 4t4c-ethip4-ip4base-mrr 10ge2p1x553 64B 2.97 1 -79.05 1t1c-eth-l2patch-mrr 10ge2p1x553 64B 2.98 1 -75.94 2t2c-eth-l2bdbasemaclrn-mrr 10ge2p1x553 64B 8.27 1 -11.0 2t1c-af-xdp-ethip4-ip4scale2m-mrr 25ge2p1xxv710 64B 6.21 1 -53.14 The same data for different TB. Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: Iefce9a7196bae6fde45ee1935184efab4735e6e0 (cherry picked from commit 8967c82701a5b4e66536db6baefccbcfe5f8dfaf)
2022-01-19trending: fix empty regressions and progressionsViliam Luc1-5/+5
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I1405c5d1dbf9e137afbc5fd5d9f83ea572613ea9
2022-01-18trending: new view in regressions and progressionsViliam Luc1-47/+138
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I8524319a215ff551cf67c30d0b08ddae69883f61
2021-12-17trending: hotfix failing trending emailsViliam Luc1-7/+0
Legend was showing for each job_name. When trying to fix it we broke the cpta with I/O operation. This fixes legend positioning and I/O operation error. Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I809daa3eabe6a728e5e183630fc7c6615dfef8bf
2021-12-15trending: legend positioningViliam Luc1-2/+2
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: If655d953eb8317f0cba6b3cb35bec232031df7dc
2021-12-14trending: fix broken trendingViliam Luc1-6/+20
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I1ecbfa48f3765884720f0490b9b9da1f69bd2b1a
2021-12-13trending: regression and progression add info to emailViliam Luc1-3/+41
adding trend in Mpps, runs for trend in #, trend change in % + dashboard - removed Short-Term change and added # of runs for trend Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: Ib02d2a2224fc52b79832560241b0530aa2eaaf77
2021-10-21Trending: Fix TRex graphs, remove VTSTibor Frank1-4/+15
Change-Id: I4c1ed83054d12b83f1a9a6a2d0081e7d037be2df Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-10-18Trending: Add TRex ndrpdr testsTibor Frank1-8/+9
Change-Id: I7b968a4747390224d89cdaf7407c10c9a4108deb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-08-04Trending: Add Latency trendingTibor Frank1-34/+110
Change-Id: I28c1f1cf113d2537f3e564cdca0fd61ef57737a9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-07-26Trending: Save latency data in csv filesTibor Frank1-1/+58
Change-Id: I397dc1711f52324c158c775522cfef3044724ad7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-07-23Trending: Add exception handling for anomalies classificationTibor Frank1-1/+6
Change-Id: I6f2ee7552c513ccf2fa453f143dd52ea880bd412 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-05-03PAL: Refactor the processing of spec and downloadTibor Frank1-7/+7
Change-Id: I204fdc3593a3702366727238f2b469d3d4320c2b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-12PAL: Optimize specification of elementsTibor Frank1-171/+197
- plot_mrr_box_name - plot_ndrpdr_box_name - plot_perf_box_name - plot_tsa_name - plot_nf_reconf_box_name - plot_nf_heatmap - plot_cpta Change-Id: I28ff2ea0e4f610e5ce48ffd083bf9a37bdc2f62d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-11-19Trending: Add NAT44 testsTibor Frank1-2/+7
Change-Id: I2601a786f58b1d89cc9a90cb16ff20e6331abbfe Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-13Trending: NFV TestsTibor Frank1-3/+0
- 2n-skx - 2n-clx Change-Id: I6dd55ed167dc4267b2a4e4c52ec0874ad0e4a4b6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-12Trending: NFV TestsTibor Frank1-0/+3
Change-Id: I882c0af852a9e556df3c748164360cdbc336d654 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-05-22PAL: Colors in graphs 2Tibor Frank1-6/+6
Change-Id: I69d341de8fde562d4d514954fa6b094ef1204489 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-05-21PAL: Colors in graphsTibor Frank1-14/+25
Change-Id: I23b792ab01dc433e31c7d5eb5c48a95e5a2ec210 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-05-15Trending: Add NDRPDR trending graphsTibor Frank1-13/+43
Change-Id: I57caf62b5084e36d8909330af68f766b50e3b748 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-05-07Trending: NDRPDR dashboardTibor Frank1-23/+29
Change-Id: I7f4c84dd47874c484f34f389b93de635c66a77c1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-05-05Trending: CSIT-1301: Display stdev in hover infoTibor Frank1-8/+20
+ make possible to use dashboard for ndrpdr tests + fixes in ndrpdr weekly comparison Change-Id: I846dc207ea620fad78424a445b32095160d4431d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-04-24PAL: Reverse download order for trendingTibor Frank1-37/+12
Change-Id: Idd6bf8b89ce0fb5ebf9734b39a8f6058861b8ec5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-04-02Trending: Update graphs - 2n-clxTibor Frank1-1/+1
Change-Id: I05a61b075c467681f2e05b17f0245a5e77a911b5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-02-18Trending: PlotsTibor Frank1-3/+8
- remove not needed params - i40e --> dpdk Change-Id: Ib63a66486b040b01a929f3ee0a4e80468c9d4e28 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-10Autogen: Generate also NIC drivers.Vratko Polak1-2/+2
+ Disallowed -avf- (or -rdma-) as "template" suites. + GBP suite switched to DPDK driver in repo. + Each NIC has its own list of supported drivers, in Constants. + Updated tag expressions for daily jobs: + Feature, ipsec, memif, scale, srv6, tunnels, vhost and vts are tested only with vfio-pci. + Other (base, dot1q, dot1ad) tested with all drivers. + Setup actions currently depend on driver, generated. - The performance_rdma action is trivial for now. - Several tests fail, to be fixed later, e.g. by performance_rdma. + Reconf tests are also supported. + Added DRV_VFIO_PCI tags missing, mainly in density tests. - Vhost suites (density, reconf) are failing, but suites look good. - TCP suites do not support NIC drivers yet. - DPDK obviously not supported. + Use Python 3 in regenerate scripts. + Fix typos binded => bound. + File open modes set either u"rt" or u"wt" everywhere. + Remove a trailing space in an environment variable name. Change-Id: I290470675dc5c9e88b2eaa5ab6285ecd9ed7827a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-17CTPA: Improve handling pps vs MppsVratko Polak1-22/+25
+ Jumpavg assumes precision is around 1, so gives wrong classifications when fed Mpps numbers, and the classification has to be done on pps values. + Hover should display Mpps values properly, e.g. as floats. + Decided to show 3 digits after decimal point. + Better distinguishing between keys and indices. Change-Id: I99bdad5b401839889463c7cf6f8b0930ec65b457 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-10Trending: Add more NFV testsTibor Frank1-5/+5
+ 10R2C, 6R4C + Tunnels Change-Id: I141fbb9cd9e975790af0e3d4dfa5f22da00fbfd9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-09Trending: Use MppsTibor Frank1-1/+1
Change-Id: I63efaa244aa4931a8ab474bc64520e1f501ad57a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04Trending: ReorganizationTibor Frank1-5/+12
+ use selection of tests by their full names + finalize trending_test_groups.md + modify static content + modify anchors + specifications: + container memif + ip4 + ip4 tunnels + ip6 + ipsec + l2 + srv6 + vhost + vts + dpdk + add 2n-clx + hyperlinks Change-Id: Ibe073330317539896c6fbfcbd4a7a279b58bdb95 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-03Python3: PALTibor Frank1-0/+633
- files renamed: - utils.py --> pal_utils.py - errors.py --> pal_errors.py - functions/methods renamed: - plot_service_density_reconf_box_name --> plot_nf_reconf_box_name - plot_performance_box_name --> plot_perf_box_name - plot_latency_error_bars_name --> plot_lat_err_bars_name - plot_throughput_speedup_analysis_name --> plot_tsa_name - plot_service_density_heatmap --> plot_nf_heatmap - table_performance_comparison --> table_perf_comparison - table_performance_comparison_nic --> table_perf_comparison_nic - table_performance_trending_dashboard_html --> table_perf_trending_dash_html - functions/methods removed: - plot_service_density_heatmap_compare - plot_throughput_speedup_analysis - plot_latency_error_bars - plot_soak_boxes - plot_soak_bars Change-Id: Icddc01d3ccb451abb92b9e5d912b642d01866033 Signed-off-by: Tibor Frank <tifrank@cisco.com>