aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools/presentation/specification_CPTA.yaml
AgeCommit message (Collapse)AuthorFilesLines
2020-10-19Trending: Remove GBP testsTibor Frank1-15/+0
merge after https://gerrit.fd.io/r/c/csit/+/28885 Change-Id: I657f4e219968a8d422af6f5d6fc4727facfafb20 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-10-15Trending: Add csit-dpdk-perf-mrr-weekly-master-3n-tshTibor Frank1-2/+26
Change-Id: Icce2fc809d3f72a6447cc07700df3c6f324af267 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-10-05Trending: Add NAT44Tibor Frank1-40/+320
Change-Id: I57d4b6f0ffa2ebfffbf95fc030bc8da70e46c8bc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-24Trending: Replace snat by natTibor Frank1-77/+77
Change-Id: Ifcb1311d46b7134502b142933fd1574eb94cc230 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-21Trending: Fix the name of csit-dpdk-perf-mrr-weekly-master-3n-tshTibor Frank1-1/+1
Change-Id: I98731ba17d5fbfc10e1b1b91ff3f4afc52566b8d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-18Trending: Add csit-dpdk-perf-mrr-weekly-master-3n-tshTibor Frank1-0/+28
- alerting only - todo: Graphs Change-Id: I369d5c1bbcd634b1b4ebfeb4c08c9ac4a5c058ab Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-16Trending: Add snat44det tests to trending graphsTibor Frank1-0/+62
Change-Id: I7fe24c05a4f7f17355c3bf5c4f635f412656d52f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-03Trending, Report: use test tag ethip4udp-snat44det-h1-p1-s1Tibor Frank1-28/+22
- use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44 Change-Id: Ie4897430c3b3074fdf3440d56cc1794a4c3046dd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-28Trending: Add identification of DUT to alerting emailTibor Frank1-33/+33
Change-Id: I2e63f16aef48e68b0e86e913431bed7df01f1b70 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-27Trending: Add DPDK tests to list of failed testsTibor Frank1-0/+72
Change-Id: I25e805125528d67a5eea277df6d88549f129d137 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-27Trending, Report: nat44-deterministc test names changeTibor Frank1-18/+18
Change-Id: I1956ccaff625f287995765a4c2b0b46cb00d0d65 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-17Trending: Fixes after reviewTibor Frank1-26/+48
Change-Id: Ia2fdd4d222c723c063f267a20e1a4f18b4e03d69 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-13Trending: NFV TestsTibor Frank1-29/+301
- 2n-skx - 2n-clx Change-Id: I6dd55ed167dc4267b2a4e4c52ec0874ad0e4a4b6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-04Trending: Set longer time periodTibor Frank1-21/+38
- daily: up to 180 sets, max 180 days - weekly: up to 26 sets, max 180 days Change-Id: I59c550e5728fcb83f247b0c958f21209d927ee98 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-04Trending: Implement the latest changes in job specsTibor Frank1-2199/+1018
Graphs: - MRR - 2n-clx - 2n-skx - 3n-skx - 3n-hsw - 3n-tsh - NDRPDR - 2n-skx - 3n-skx - 3n-hsw - 2n-clx Change-Id: Ieab26ba1d2ee56e66c5c8598c4dba240a14e53e9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-05-19Trending: CSIT-1717: Add links from dashboard to graphsTibor Frank1-23/+35
+ fix TB names in alerts Change-Id: Ia10e9b82b57e90f7ae4592bd6ecf8b71dea71cc8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-05-15Trending: Fix typosTibor Frank1-3/+3
Change-Id: If2ca4c859c89ad1fdfb9cf3980a7aaba6966c929 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-05-15Trending: Add alerts for NDRPDR weekly testsTibor Frank1-87/+246
Change-Id: I35a806f8dd61e2c6d6dca2cdcfa4f7131e061cea Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-05-15Trending: Add NDRPDR trending graphsTibor Frank1-8/+2808
Change-Id: I57caf62b5084e36d8909330af68f766b50e3b748 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-05-07Trending: NDRPDR dashboardTibor Frank1-0/+8
Change-Id: I7f4c84dd47874c484f34f389b93de635c66a77c1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-05-05Trending: CSIT-1301: Display stdev in hover infoTibor Frank1-65/+220
+ make possible to use dashboard for ndrpdr tests + fixes in ndrpdr weekly comparison Change-Id: I846dc207ea620fad78424a445b32095160d4431d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-04-28Trending: NDRPDR weekly comparisonTibor Frank1-18/+176
Change-Id: I6c5166e1fabfe7471af92a1423c0c89ca6b040a4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-04-24PAL: Reverse download order for trendingTibor Frank1-113/+30
Change-Id: Idd6bf8b89ce0fb5ebf9734b39a8f6058861b8ec5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-04-22Trending: Fixes in plots, dataTibor Frank1-105/+57
Change-Id: I91677a0f6e1c62633977c80fc8dec8019e580d0c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-04-20Trending: Update graphs - dnvTibor Frank1-276/+104
Change-Id: Ib965b768f725a4d4bc09cb1f995a452ed6e64653 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-04-03Trending: Update graphs - 3n-tshTibor Frank1-36/+79
Change-Id: I9b8377e336651f850d50d050471ebefd5647993d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-04-03Trending: Update graphs - 3n-hswTibor Frank1-6/+12
Change-Id: Iff28b68e4fb33b304433ada64ea6ef2d751e4c3f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-04-02Trending: Update graphs - 2n-clxTibor Frank1-85/+400
Change-Id: I05a61b075c467681f2e05b17f0245a5e77a911b5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-03-30Trending: Update graphs - 3n-skxTibor Frank1-278/+454
Change-Id: I0698e7fa48b7fa199b886407c2e9c1bc5094e746 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-03-26Trending: Update graphsTibor Frank1-105/+435
- 2n-skx Change-Id: I0b357d8ac4a20acdea14814bbb421b1007f851d3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-03-13PAL: Process local xml fileTibor Frank1-2/+1
Change-Id: I2d60b2c6616de6d6b2e1d742407ac392471883aa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-02-18Trending: PlotsTibor Frank1-1038/+399
- remove not needed params - i40e --> dpdk Change-Id: Ib63a66486b040b01a929f3ee0a4e80468c9d4e28 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-02-02Trending: Input dataTibor Frank1-0/+1
Change-Id: I27aa8d5a5934e1c60c6e71f8dc95d25e0217a7a0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-31Trending: Reduce input dataTibor Frank1-147/+124
Change-Id: Ic09061050e0e55e3beb5aaa13a8914ea4959efa2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-31Trending: Add mellanoxTibor Frank1-7/+424
Change-Id: Id6f621ee4d604da96cf65c7f1cb889ec055df9b1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-07Trending: Move VTS tests from 3n to 2nTibor Frank1-327/+72
Change-Id: I420cef699d42973602f1290ccd0cc5e378d42492 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-10Trending: Add more NFV testsTibor Frank1-136/+205
+ 10R2C, 6R4C + Tunnels Change-Id: I141fbb9cd9e975790af0e3d4dfa5f22da00fbfd9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-09Trending: Use MppsTibor Frank1-5/+4
Change-Id: I63efaa244aa4931a8ab474bc64520e1f501ad57a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-09Trending: Fix AlertsTibor Frank1-28/+19
Change-Id: I963022c386928b7f29b176bfb4a4e2bfb0a55409 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04Trending: Fix CLX plotsTibor Frank1-6/+6
Change-Id: Iea3181fcdf747bd6ca49f245f310a37498fcd801 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04Trending: Fix CLX data setTibor Frank1-0/+7
Change-Id: I027ded5ce3d36d55a8633c52c82effaf7c6b745a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04Trending: ReorganizationTibor Frank1-2812/+2731
+ use selection of tests by their full names + finalize trending_test_groups.md + modify static content + modify anchors + specifications: + container memif + ip4 + ip4 tunnels + ip6 + ipsec + l2 + srv6 + vhost + vts + dpdk + add 2n-clx + hyperlinks Change-Id: Ibe073330317539896c6fbfcbd4a7a279b58bdb95 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-03Python3: PALTibor Frank1-124/+93
- files renamed: - utils.py --> pal_utils.py - errors.py --> pal_errors.py - functions/methods renamed: - plot_service_density_reconf_box_name --> plot_nf_reconf_box_name - plot_performance_box_name --> plot_perf_box_name - plot_latency_error_bars_name --> plot_lat_err_bars_name - plot_throughput_speedup_analysis_name --> plot_tsa_name - plot_service_density_heatmap --> plot_nf_heatmap - table_performance_comparison --> table_perf_comparison - table_performance_comparison_nic --> table_perf_comparison_nic - table_performance_trending_dashboard_html --> table_perf_trending_dash_html - functions/methods removed: - plot_service_density_heatmap_compare - plot_throughput_speedup_analysis - plot_latency_error_bars - plot_soak_boxes - plot_soak_bars Change-Id: Icddc01d3ccb451abb92b9e5d912b642d01866033 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-11-13Trending: Input dataTibor Frank1-206/+159
Change-Id: I9b1060cb6162521bfdfe4b875444dc09c109960d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-18Trending: reduce input dataTibor Frank1-159/+159
Change-Id: I931c4140b3a6ced30030e4573fdd77e80987f972 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-11Trending: Generate email body for regressions and progressionsTibor Frank1-9/+9
Change-Id: Iee652fc48b574b7866d5e7f0b7b927f96de3d25f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-07Trending: Send alerts when regression occursTibor Frank1-9/+11
Change-Id: I45d218ea323245199ad5093bd64c6a9bd862cad9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-03Trending: Report also nr of passed tests in emailTibor Frank1-119/+147
Change-Id: I7ae188f5f684bd93352255d6b5c491b6d78c822c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-16Trending: Reduce input dataTibor Frank1-69/+106
Change-Id: I6b3bdac6941d85792987e2bc7e75cb8bc0be4f4a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-13Report: Download first from logs.fd.ioTibor Frank1-89/+16
Change-Id: I308d7a7f72e0ea2e23b96be7db1ba35920bae519 Signed-off-by: Tibor Frank <tifrank@cisco.com>