aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools
AgeCommit message (Collapse)AuthorFilesLines
2018-07-31FIX: Report - plotsTibor Frank1-462/+462
Change-Id: Ia791d310e5942e10d62011cb879101828dfe7454 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-31Update report doc for rls1807Peter Mikus1-91/+101
Change-Id: I713fe9b4a1a2830d6267c1dfc9b0442bf08b8ab4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-30CSIT-1197: Add Comparison Across Testbeds to the ReportTibor Frank3-1126/+759
Change-Id: Ibf0c880926b87e781830d7b39438b5145144ef5b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-30HC Tests: remove trusty from download_hc_*.sh scriptsMarek Gradzki2-16/+4
Ubuntu 14.04 packages are not being published since 1710. Change-Id: I1372fe0eb4eab3c6c3e0f3a7ee435104f3c6f0fb Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-30HC Tests: do not use vpp-dbg in CSIT testsMarek Gradzki2-6/+6
Honeycomb package does not require VPP debug symbols and typical HC user does not have them installed. Change-Id: I2cae502cad3216304d6f7ee44913f30c97fb5a20 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-30CSIT-1219: Update job definitions in conf.pyTibor Frank3-6/+30
Change-Id: Ib7e76f43a8ef2d4729962ff5856c987747b0b953 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-27CSIT-1213: Add 2n/3n-skx to Test Oper DataTibor Frank2-109/+166
Change-Id: I217cc8dc6691c2a443460bd4e51ea96c4ec82806 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-27CSIT-1212: Add 2n/3n-skx to Test ConfigurationTibor Frank2-31/+128
Change-Id: I4be3e2072dbc1f1f27b840de1c04a2374944f724 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-27CSIT-1211: Add 2n/3n-skx to detailed resultsTibor Frank2-284/+562
Change-Id: Ibfe838b355fa15d0f89ea3122f2d042af989b51d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-26CSIT-1203: Add parsing of NDRPDR testTibor Frank5-740/+1087
Change-Id: I55be02df7f8979ad4c10b79d87f5065452a3e6e6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-25HC Tests: do not install vpp-dev in hc2vpp-csit-verifyMarek Gradzki1-3/+3
The download_hc_build_pkgs.sh is used by hc2vpp-csit-verify and hc2vpp-csit-verify-odl jobs. These jobs download latest VPP packages and unlike other HC CSIT jobs, build hc2vpp. This patch removes vpp-dev/vpp-devel packages from the list of installed VPP packages to unify the environment with the other HC CSIT jobs. Change-Id: I28742afda05cd85675619a92fbc10f4565bdb321 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-23HC Tests: remove vpp-dpdk-dkms dependencyMarek Gradzki2-12/+3
The vpp-dpdk-dkms is not needed for current VPP versions. Change-Id: I9c1a79fb940b2ba0f332792d4fc088f49f9ee191 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-23HC Tests: disable NSH pluginMarek Gradzki2-14/+18
Change-Id: Ic382b625e5e7201ecc2a2937c15646806c594c61 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-23CSIT-1204: Make new TC names backward compatible (trending)Tibor Frank3-6/+11
Change-Id: I48976a21ed022f0f8d840903db4d2415be9365cd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-19CSIT-1196: Add hsw/skx and 2n/3n to the report structureTibor Frank4-1279/+14732
Change-Id: I3a0cc2792b931798e466250e30bc30ad8a32b84e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-17CSIT-1094: Change menu styleTibor Frank4-10/+67
Change-Id: Idff59bc73d3444700937fc473681760a947f0f41 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-16CSIT-1190: Update report configuration for 18.07Tibor Frank1-7/+7
Change-Id: Ie7644fe3069ad37c15754a07e049f479903ca59a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-13Update skylake tesbed inventoryPeter Mikus4-25/+25
- Add missing topology files - Add missing topologies to bootstrap - Small fixes in ansible Change-Id: I3b9ad60a0adfae9e93e5e700279f7ade81174471 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-12FIX: PAL: input data processingTibor Frank1-0/+3
Change-Id: I295ca0a991dea8104e9794d7013be908f5461ea2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-11CSIT-1178: Prepare for bursty MRRVratko Polak1-1/+2
+ All suites and tests still refer to MRR instead of BMRR (or FRMOBL). + API change: Traffic should pass with maximum rate first argument got a default value, thus it needs to be moved towards the end of argument list. + Consequently, the value for it has been deleted from suites. + Test message is now compatible only with BMRR parsing. - Reporting of transmit rate is left as TODO. + Global test __init__ with new way of giving defaults to global variables. + The new keyword is put into robot_enhancements.robot resource. + Number of trials and trial duration are now configurable. - Bootstrap scripts have no support for overriding the defaults yet. Change-Id: I4b108cc9c256730e62c03fbacba0a1c314f8ae88 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-11CSIT-1183: Process the new and the old TC namesTibor Frank2-2/+28
Change-Id: I7fcecd7e23494e8fb0e70e7af00408eed16733e4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-10CSIT-1189: Add suite setup to source code documentationTibor Frank2-12/+33
Change-Id: I0cc435ecacaeb5f9e8fd5c67f495166a1abd2e91 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-10PAL: Treat the new and the old TC namesTibor Frank1-0/+6
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: If5999de81b4e062d38ce44871f0c4d4fa794b55c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-10Remove THIS tag and use unix endlinesVratko Polak14-607/+607
The THIS tag has sneaked in 10Ge2P1X520-Eth-L2Xcbase-Eth-1Memif-1Dcr-Mrr but usually it is only to be used in draft testing. Not sure about the way non-unix endlines crept in. Is not git supposed to perform endline conversions on text files? Or are .robot, .rst, .yaml and .vat not recognized as text? Change-Id: Ia78cf942c05c3029c340a8639782786f37e57469 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-09FIX: Implement changes required by Plot.ly 3.0.0Tibor Frank3-17/+6
- Scatter.xaxix.autotick - Scatter.yaxis.range[] Change-Id: I171e0c4a796f713985b69fae23bfb768590274b4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-06Add Skylake optimization to ansiblePeter Mikus2-2/+41
- Add kernel params - Add TurboBoost managing Change-Id: I9d9561290f8f6780ff41f3a418a1f335d935d843 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-29Add vfio-pci support on all TBPeter Mikus1-1/+5
- Add auto load of vfio-pci - Add iommu support Change-Id: I13611fab9db2813eeab7f90c8f961594349e561e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-29CSIT-1124: Support multi-sample testsTibor Frank5-262/+231
+ Store parsed MRR results as AvgStdevMetadata + Modify tables and plots to use AvgStdevMetadata Change-Id: I29bb1e492a664544e63a180055f66bb0eecfb957 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-28Jumpavg: Post 0.1.3 release editsVratko Polak1-1/+1
+ PyPI/jumpavg version bumped to 0.1.4. + presentation requirements bumped to 0.1.3. + Added stub for change log in readme. Change-Id: I21a606ed7d9aa2b9cc761ed20f94bda41963a1a8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-26Small update to PXE installation READMEPeter Mikus1-0/+4
Change-Id: I1766e3cd81cfe4ed049ed3e7034fff1e367396d4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-25Update PXE info about new Skylake machinesPeter Mikus4-35/+52
Change-Id: Ide828efb0e539ae7bf9c5cfd128f35d8117f3643 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-21CSIT-1136: Trending: Redirect "new" to the index.htmlTibor Frank19-200/+0
- remove the code which generated redirection Change-Id: Ia12ea1129724d92a6ac6e88782e562c23722ae48 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-21CSIT-1136: Trending: Redirect "new" to the index.htmlTibor Frank19-0/+200
Change-Id: I2480a59fb34af70d78bc7404cd380c4b4d3ea483 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-20FIX: PAL - list of failed testsTibor Frank1-11/+6
Change-Id: I03341283270e53df6bcb08b32f1787f61ebb601c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-20CSIT-1110: Replace old trending with the new oneVratko Polak28-14729/+117
+ Remove /new/ folders in presentation and docs. Change-Id: I870002ba8509189196e778aa1292b93e83a3ec17 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-19CSIT-1133: Cosmetic improvements in trending plotsTibor Frank2-17/+18
- Remove "outlier" from the colorbar - Remove anomalies from the legend Change-Id: Idd3255d912c48c80347a773a6b19307e90a53926 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-18CSIT-1126: Detection and reporting of failed MRR testsTibor Frank8-223/+603
Change-Id: Iafdd12a573b58ab3ba9c69699cd97c5a4e598601 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-18CSIT-1110: Update code after jumpavg 0.1.2 releaseTibor Frank2-2/+2
+ Use the released version in PAL. + Bump the jumpavg source to 0.1.3 for next release. + Add PyPI/owners.txt to track python package owner group. Change-Id: I29284a258b24f9991379719313f30cce0349c2bd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-15Update Ansible with new Skylake machinesPeter Mikus21-61/+131
Change-Id: Ia5d0b680deaf7da60696bf2d0260cf7fbea78322 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-15Revert "CSIT-1110: Update code after jumpavg 0.1.2 release"Tibor Frank2-2/+2
This reverts commit f7c46f067a8fb594d2460aaadbe1ca9282b657a8. Change-Id: I409335daac8f9e02bea4e12f2141ab9ceb338964 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-15CSIT-1110: Update code after jumpavg 0.1.2 releaseVratko Polak2-2/+2
+ Use the released version in PAL. + Bump the jumpavg source to 0.1.3 for next release. + Add PyPI/owners.txt to track python package owner group. Change-Id: I0146efcc7c0b7eefc068464739afa605eda2b2d8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-15CSIT-1110: Use jumpavg library from pipVratko Polak21-1054/+2
+ Move the jumpavg library code to separate directory. - Bump to 0.1.2 has to be done later. Change-Id: I9722ede48f00e99eeb68ca3f91e0bdeee2937973 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-15CSIT-1110: Add files for PyPI migrationVratko Polak7-1/+302
Change-Id: I3414d4391f339ee67066491382b59239a81db241 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-15CSIT-1110: Prepare for migrating the new detectionVratko Polak13-28/+90
+ Do not declare BitCountingClassifier.classify() as class method. + Make BitCountingGroupList subclass of list. + Inherit from abstract classes whenever possible. + Drop unneeded imports. + Add module docstrings and class docstrings anywhere. + Add TODOs hinting at possible improvements. Change-Id: Iccfff5c0e7be0607d6cfa74314083fcfe5a4d7d9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-13CSIT-942: RCA - Option 1: Analysing Archived VPP ResultsTibor Frank4-70/+260
- CSIT-953: LLD Change-Id: I0baefd8495f6ae8dc6f95f1cf29f5ccb8053d58d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-13CSIT-1110: Fix dashboard anomaly count rangeVratko Polak2-7/+10
+ Dashboard tables should now report anomalies from last week only. + Changed handling of Nan to report regression. Change-Id: I624b0bc84a93702a31fc79fd670bd645b963f1f7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-13link for start-testcase-DMMsharath1-0/+5
Change-Id: I2687f6408483cd88a2c820d6da03df511e087ba4 Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-06-12CSIT-1110 PAL: Fix warnings by moving new docsVratko Polak1-1/+1
Change-Id: Ie6483e9245872bc6991ed1f3c7aab60131e1eeb1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-12CSIT-1110 PAL: Use group averages for term changesVratko Polak1-41/+23
+ Apply only to trending dashboard tables. + Remove outlier column. - Dashboard description not updated yet. Change-Id: I30e5267c4621564cd4d3ae8bd969d2ef72531d81 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-11CSIT-1110: Cherry-pick edits into new detectionVratko Polak5-401/+651
+ Edit methodology documentation. Change-Id: I441e17862aba4a8572c7c532ed8995790111b4d4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>