aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools/presentation/specification_CPTA.yaml
AgeCommit message (Collapse)AuthorFilesLines
2020-01-07Trending: Move VTS tests from 3n to 2nTibor Frank1-327/+72
Change-Id: I420cef699d42973602f1290ccd0cc5e378d42492 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-10Trending: Add more NFV testsTibor Frank1-136/+205
+ 10R2C, 6R4C + Tunnels Change-Id: I141fbb9cd9e975790af0e3d4dfa5f22da00fbfd9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-09Trending: Use MppsTibor Frank1-5/+4
Change-Id: I63efaa244aa4931a8ab474bc64520e1f501ad57a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-09Trending: Fix AlertsTibor Frank1-28/+19
Change-Id: I963022c386928b7f29b176bfb4a4e2bfb0a55409 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04Trending: Fix CLX plotsTibor Frank1-6/+6
Change-Id: Iea3181fcdf747bd6ca49f245f310a37498fcd801 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04Trending: Fix CLX data setTibor Frank1-0/+7
Change-Id: I027ded5ce3d36d55a8633c52c82effaf7c6b745a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04Trending: ReorganizationTibor Frank1-2812/+2731
+ use selection of tests by their full names + finalize trending_test_groups.md + modify static content + modify anchors + specifications: + container memif + ip4 + ip4 tunnels + ip6 + ipsec + l2 + srv6 + vhost + vts + dpdk + add 2n-clx + hyperlinks Change-Id: Ibe073330317539896c6fbfcbd4a7a279b58bdb95 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-03Python3: PALTibor Frank1-124/+93
- files renamed: - utils.py --> pal_utils.py - errors.py --> pal_errors.py - functions/methods renamed: - plot_service_density_reconf_box_name --> plot_nf_reconf_box_name - plot_performance_box_name --> plot_perf_box_name - plot_latency_error_bars_name --> plot_lat_err_bars_name - plot_throughput_speedup_analysis_name --> plot_tsa_name - plot_service_density_heatmap --> plot_nf_heatmap - table_performance_comparison --> table_perf_comparison - table_performance_comparison_nic --> table_perf_comparison_nic - table_performance_trending_dashboard_html --> table_perf_trending_dash_html - functions/methods removed: - plot_service_density_heatmap_compare - plot_throughput_speedup_analysis - plot_latency_error_bars - plot_soak_boxes - plot_soak_bars Change-Id: Icddc01d3ccb451abb92b9e5d912b642d01866033 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-11-13Trending: Input dataTibor Frank1-206/+159
Change-Id: I9b1060cb6162521bfdfe4b875444dc09c109960d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-18Trending: reduce input dataTibor Frank1-159/+159
Change-Id: I931c4140b3a6ced30030e4573fdd77e80987f972 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-11Trending: Generate email body for regressions and progressionsTibor Frank1-9/+9
Change-Id: Iee652fc48b574b7866d5e7f0b7b927f96de3d25f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-07Trending: Send alerts when regression occursTibor Frank1-9/+11
Change-Id: I45d218ea323245199ad5093bd64c6a9bd862cad9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-03Trending: Report also nr of passed tests in emailTibor Frank1-119/+147
Change-Id: I7ae188f5f684bd93352255d6b5c491b6d78c822c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-16Trending: Reduce input dataTibor Frank1-69/+106
Change-Id: I6b3bdac6941d85792987e2bc7e75cb8bc0be4f4a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-13Report: Download first from logs.fd.ioTibor Frank1-89/+16
Change-Id: I308d7a7f72e0ea2e23b96be7db1ba35920bae519 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-09Trending: Set 90 days periodTibor Frank1-10/+191
Change-Id: I56403c30142876501602fe06c0ad2665fa73cb7b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-09Trending: TSH ipsec testsTibor Frank1-10/+36
Change-Id: Ib9f867e2b55a61019b487c96b0a05e9fa175dd0f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-08Trending: Reduce ipsec testsTibor Frank1-18/+18
Change-Id: Ib164551d09ccf3ab5a95baade6d8b2744bc5ce16 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-08Trending: ipsecTibor Frank1-98/+201
Change-Id: I2fc623ac152b8559a230b340be2f1cc92c7e934a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-08Trending: Add dnv mrr testsTibor Frank1-2/+483
Change-Id: If0c0d6b346e64caf7af4432917a91468a1f0554a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-05Trending: Reduce input dataTibor Frank1-118/+10
Change-Id: Iab9e6686ef163eda04d836e4f355a310058e846e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-02Add 3n-tsh mrr data to trending docsjuraj.linkes1-0/+407
Change-Id: I82f074c0f7261bd1019ade1e01781278b063c0cd Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-08-02Trending: Add 8 big input filesTibor Frank1-24/+0
Change-Id: I9891c9589014be04fa69973e092fdf8b9926a56f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-01Trending: Add multiprocessing, remove archivingTibor Frank1-123/+117
Change-Id: I67cfde7dfc9b81fca3ae102b43f6defafe88f689 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-01Trending: Memory consumptionTibor Frank1-1/+56
Change-Id: I26a7d9e7ee0b1a64666c3ffbcfc424f04a52d046 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-31Trending: Reduce input dataTibor Frank1-2/+5
Change-Id: I8917e72717c672c44494a34aefce4039ac5efcc9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-31Trending: Set packages versionsTibor Frank1-49/+49
Change-Id: I8d9298733652f16dbfa0c183602060eb4f727dfe Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-31Trending: Reduce input dataTibor Frank1-1/+1
Change-Id: I6760f39e9438d1af97217f2fc28b933226b9cb2d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-31Trending: Reduce input dataTibor Frank1-48/+51
Change-Id: I8dc4fb23c07b1ab9cc0ecad852cc594ec9922055 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-30Trending: Reduce input dataTibor Frank1-77/+77
Change-Id: Idd87da996f25c7fd94cef828dee6967737b73ba8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-30Trending: Reduce input dataTibor Frank1-45/+61
Change-Id: Ifddbdc1f357a192af558079a92f4e4d1d2693efd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-30Trending: Reduce input dataTibor Frank1-0/+15
Change-Id: I31d4d7ceaf8969e28d86deac2995cd38cbff9fca Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-30Trending: Reduce input dataTibor Frank1-0/+36
Change-Id: Id0569dc7d882ad6b631b41c2e55ee12dc9d4b5ea Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-30Trending: Reduce input dataTibor Frank1-38/+328
Change-Id: Ice96d11d802dbc3d502b038ee8e328281551bc9d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-30Revert "PAL: Skip daily-master-3n-skx/540"Peter Mikus1-3/+0
This reverts commit fc7fbe37baaaa82f751757f75491e2a29db5176e. Change-Id: I2b7710f5d41006cfd2a39a55c86c81c3ae43f90e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-30Revert "Trending: Reduce the number of input files"Peter Mikus1-9/+27
This reverts commit 6e1de92cec9a0687ca82bcefaae3ef7dad5104b0. Change-Id: I04130c449905f93bdd82da36d2ff4de26005dfe4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-23Trending: Reduce the number of input filesVratko Polak1-27/+9
Another attempt to avoid memory error. Dailies trimmed to ~2 months. Not removed last "skip" item to simplify future editing. Change-Id: Id411eeed109079c4c3f8994d5d6cc296ffe621fc Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-19PAL: Skip daily-master-3n-skx/540Vratko Polak1-0/+3
Frequently, reconnect is needed to finish the download, that can lead to IOError. But, MemoryError has also been seen, so perhaps this is a wrong fix. Worth a try, though. Change-Id: Icac17757a1a0ae361faddfa24a818496f14d7340 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-18Trending: Reduce the number of input filesVratko Polak1-42/+6
Change-Id: Ie449aa820bc05d9fed285c04445a5cf715b8ebdf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-19Trending: Reduce the number of input filesTibor Frank1-165/+20
Change-Id: I37fdd6c01a8e25ecc0353118db3c8e18d848c890 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-17Trending: Reduce input dataTibor Frank1-27/+75
Change-Id: Ib540a687a0b8b27584f6d8c571cfd453122f0f91 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15Trending: Add IPSECSWTibor Frank1-3/+27
Change-Id: I5437d46759c3fcf9a8f44d02d43a70f3f3b2635d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-18CSIT-1482: Change trending graphsTibor Frank1-168/+168
- Change trending graphs to display results when using suite generator Change-Id: I4f822c180f9c206be19a9c75ce105c2225ad9171 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-17CSIT-1483: Add processing of output_info.xml as the first choiceTibor Frank1-19/+40
Change-Id: I27687ed6dda3a8717538653e75ad0d61c6516c7e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-15Alerts: Change the error messageTibor Frank1-9/+9
Change-Id: I0fcd6ffaf24de0f6ce95eaba3d591eddf3f16b33 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-10Trending: Reduce input dataTibor Frank1-9/+12
Change-Id: Ia787036e4a717b9693df09fc75738369d6d39b57 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-04Trending: Remove NF tests from alertsTibor Frank1-15/+0
Change-Id: Id8074a30f578af7df5bb15e9c127838d27cae8b0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-04Trending: AlertsTibor Frank1-13/+160
Change-Id: I1c744f4eeefe3082be02daa681bfc032d6db4d15 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-02Trending: Remove invalid builds (3n-skx 356-372)Tibor Frank1-1/+69
Change-Id: I8de833a87536b60382c54fa9be2f443ff8a7d900 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-01CSIT-1412: Create trending graphs for svc densityTibor Frank1-21/+251
- static content - plots Change-Id: If3d77f5415acfa2efe2bc7ca13e426747b027f8e Signed-off-by: Tibor Frank <tifrank@cisco.com>