aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools/presentation/generator_CPTA.py
AgeCommit message (Collapse)AuthorFilesLines
2019-12-03Python3: PALTibor Frank1-616/+0
- files renamed: - utils.py --> pal_utils.py - errors.py --> pal_errors.py - functions/methods renamed: - plot_service_density_reconf_box_name --> plot_nf_reconf_box_name - plot_performance_box_name --> plot_perf_box_name - plot_latency_error_bars_name --> plot_lat_err_bars_name - plot_throughput_speedup_analysis_name --> plot_tsa_name - plot_service_density_heatmap --> plot_nf_heatmap - table_performance_comparison --> table_perf_comparison - table_performance_comparison_nic --> table_perf_comparison_nic - table_performance_trending_dashboard_html --> table_perf_trending_dash_html - functions/methods removed: - plot_service_density_heatmap_compare - plot_throughput_speedup_analysis - plot_latency_error_bars - plot_soak_boxes - plot_soak_bars Change-Id: Icddc01d3ccb451abb92b9e5d912b642d01866033 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-02Use Jumpavg 0.2.0 in PALVratko Polak1-5/+4
+ As a side effect, PAL is now part of "resource" package tree. - Testable only with 23558 (the rest of PAL Python 3 migration). Change-Id: Icbd90fd71458c07bced86f4bab9fa4e68282c38c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-11Trending: Generate email body for regressions and progressionsTibor Frank1-0/+6
Change-Id: Iee652fc48b574b7866d5e7f0b7b927f96de3d25f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-07Trending: Send alerts when regression occursTibor Frank1-20/+28
Change-Id: I45d218ea323245199ad5093bd64c6a9bd862cad9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-02Trending: Implement retries to requestsTibor Frank1-2/+0
Change-Id: Ief9ab61a54cffb529ae3539096121d1f77ee0167 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-02Trending: Remove multiprocessing from cptaTibor Frank1-53/+17
Change-Id: If53c5a72abed11fda9b15d043b24027d2eb9d86e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-01Trending: Memory consumptionTibor Frank1-1/+2
Change-Id: I26a7d9e7ee0b1a64666c3ffbcfc424f04a52d046 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-01CSIT-1412: Create trending graphs for svc densityTibor Frank1-26/+110
- static content - plots Change-Id: If3d77f5415acfa2efe2bc7ca13e426747b027f8e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-20CSIT-1436: Add titles to plots in TrendingTibor Frank1-2/+2
CSIT-1435: Remove index from Trending Change-Id: I616b055d7ad12f241df5fa43fb121d20ef7d7e23 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-01-07Trending: Add latest changes to the "new" dirTibor Frank1-1/+1
Change-Id: Ib5d1c9561c5d21f2d72b5c1b643c114f37bacd1a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-01-04Trending: Remove unneeded tests from DashboardTibor Frank1-19/+26
Change-Id: I0f57735bcc578b42994721ca88dc1bb60af475de Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-12-13CSIT-1377: Implement systematic solution using defined time periodTibor Frank1-1/+2
Change-Id: I03d8a5fcf9e6392e238e04a06c0463c17b5a4a47 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-15Report: Change versioning and legend of graphsTibor Frank1-1/+1
Change-Id: I6381c916582509c45f12d4e6d1d63ffeffc1eaf5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-13PAL: Change date format according to iso8601Tibor Frank1-1/+1
Change-Id: I326d651feb9007684cb60b67dc8f30696cd58a4c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-07CSIT-1262: Add 2n/3n-skx to trendingTibor Frank1-0/+48
CSIT-1263: Edit Trending static content Change-Id: Ief60f3bea75fb9fd153f7abb0a5933f1a3e317aa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-08-22CSIT-944: PAL Extensions: Mapping tableTibor Frank1-1/+11
Change-Id: I3bebf9ad849c056d2bbac476d22ef5e077af05b3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-08-20FIX: PAL: Keep increasing index on errorVratko Polak1-0/+1
The previous fix has added KeyError reporting and recovery, but the reported index got stuck on value 15. Change-Id: I2cec0f678a79ba3e5ca425c92c605e00cf551a35 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-15PAL: Log and continue when out of colorsVratko Polak1-6/+14
Previously, IndexError happened in worker, getting the job stuck. Graphs should not need that many colors, so there is a bug to fix still. Change-Id: I1af415119cf06004be5febbd03636f847a7001be Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-23CSIT-1204: Make new TC names backward compatible (trending)Tibor Frank1-1/+1
Change-Id: I48976a21ed022f0f8d840903db4d2415be9365cd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-11CSIT-1183: Process the new and the old TC namesTibor Frank1-1/+0
Change-Id: I7fcecd7e23494e8fb0e70e7af00408eed16733e4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-29CSIT-1124: Support multi-sample testsTibor Frank1-17/+36
+ Store parsed MRR results as AvgStdevMetadata + Modify tables and plots to use AvgStdevMetadata Change-Id: I29bb1e492a664544e63a180055f66bb0eecfb957 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-20CSIT-1110: Replace old trending with the new oneVratko Polak1-41/+33
+ Remove /new/ folders in presentation and docs. Change-Id: I870002ba8509189196e778aa1292b93e83a3ec17 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-19CSIT-1133: Cosmetic improvements in trending plotsTibor Frank1-2/+4
- Remove "outlier" from the colorbar - Remove anomalies from the legend Change-Id: Idd3255d912c48c80347a773a6b19307e90a53926 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-08CSIT-1116: Add dpdk mrr tests to trendingTibor Frank1-64/+83
- Add static content - Add models to specification - Add plots - Add dpdk tests to dashboard - Add dpdk to csv and pretty ASCII tables - Get DPDK version from output.xml Change-Id: I2d9a911d882c205f82432125b601b125807f0ca0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-29CSIT-1106: Unify the anomaly detection (plots, dashboard)Tibor Frank1-94/+41
Change-Id: I27aaa5482224d1ff518aceb879cd889f2fc8d0f5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-25CSIT-1104: Trending: Speed-up plots generationTibor Frank1-164/+140
Change-Id: Ia3916523d4fc9e05ec864af2a858a03dea46c73c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-16Trending: menuTibor Frank1-3/+0
Change-Id: I8f6528f915c96b5aca8482d8b86db5285e9aa1c9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-16CSIT-1082: Trending: Display date on the x-axisTibor Frank1-18/+13
Change-Id: I3f5bdb11222446a5c6016ab4ff57d909514c3ddc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-16CSIT-1082: Trending: Display date on the x-axisTibor Frank1-30/+43
Change-Id: I6f7238e15545d46ded668b7e85f9e2cc58d43586 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-14CSIT-1078: Optimize input data files download and processingTibor Frank1-2/+2
Change-Id: Id1b0af996c4b77878621cfc8c262795f51e537fc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Trending: switch back to 3*stdevVratko Polak1-5/+5
Reporting many fake pro/regressions is worse then missing few of the real ones. Change-Id: I2b23ae14ac4462b993dff8d1b15fb1e472caf490 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-04-26Trending: use 2*stdevTibor Frank1-7/+7
Change-Id: I24ba8d268a25d5b5c249cde47a13468dfab57a4b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26CSIT-1041: Use TMM for trending lineVratko Polak1-39/+37
+ Make also pro/re-gression detection use TMM. + Update graphs. - Do not update dashboard tables yet. Change-Id: Iae526c846b329ad99549be61481532e197704fb0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-04-25CSIT-1041: Trending dashboardTibor Frank1-1/+1
Change-Id: Ib1307d542ddef1fb6c4ddc0f6204c549870a3c25 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-25FIX: Do not ignore zeros while creating csv fileTibor Frank1-1/+2
Change-Id: I0f1f63b9969399258c44176e6ed5a326fd0a5549 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-24CSIT-1041: Trending dashboardTibor Frank1-1/+1
Change-Id: Ida3dfcc4a7ae21424e7f6b6db597a80bc633b9da Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-23FIX: Use rolling window for outlier detectionVratko Polak1-2/+3
+ Rename find_outliers to split_outliers. + Make remove_ouliers call split_outliers internally. + Add "window" argument to both functions. + Add TODOs to call sites not setting window size explicitly. + Improve docstrings. Change-Id: I24961e2859ddbfa62b543031284517c7389a2abb Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-04-20CSIT-1041: Trending dashboardTibor Frank1-1/+1
Change-Id: I56437bdb0c0b7309e2bdf4a81fd9e9b20843b040 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-19CSIT-1041: Trending dashboardTibor Frank1-29/+22
Change-Id: I2b08c3c1859302437092456da4bb8f1ebe4756bf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-18CSIT-1041: Trending dashboardTibor Frank1-2/+4
Change-Id: I98db049e4a8a3fedce73290815cf84e7d281f6ec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-17Report, trendingTibor Frank1-2/+5
Change-Id: Ib71be16f2ddf172c381b43d289a9a0000dad10b6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-17CSIT-1041: Trending dashboardTibor Frank1-7/+9
Change-Id: I983c5cccd165fb32742d395cf7e8aa02c7f9394a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-16CSIT-1041: Trending dashboardTibor Frank1-16/+16
Change-Id: Ic706612218e0ac6b991a15abc4d67e16905e8087 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-15CSIT-1041: Trending dashboardTibor Frank1-1/+9
Change-Id: I4cedfaab7f6e5d854a5107c4ac69413eb89186d0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-15CSIT-1041: Trending dashboardTibor Frank1-2/+6
Change-Id: I1905039550283d7eb23d02b32bb5fb837215e37e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-15CSIT-1041: Trending dashboardTibor Frank1-8/+23
Change-Id: I18f06b67af7ce8894bfbddbd70d2a9c1f33435be Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-10Fix: PAL Trending csv and txt tablesTibor Frank1-2/+6
- Fix the problem with missing builds in the range of builds Change-Id: I17fbc083ad88ee7c1b30c05f4f05022a1c92683d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-09PAL Trending: Add build date to csv and txt tablesTibor Frank1-5/+17
Change-Id: I75e614b45bcf1b38709b551ba13bc6e54d2c978d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-09PAL: Static content - indexesTibor Frank1-0/+3
Change-Id: I5ebe1bc959e893fc617f69b9c3e01eee262651e0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-03CSIT Trending: Input filesTibor Frank1-2/+0
Change-Id: I4cfaaff8a372dbf807715ec47647fbe8760dbe6b Signed-off-by: Tibor Frank <tifrank@cisco.com>