aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools
AgeCommit message (Collapse)AuthorFilesLines
2018-07-11CSIT-1178: Prepare for bursty MRRVratko Polak1-1/+2
+ All suites and tests still refer to MRR instead of BMRR (or FRMOBL). + API change: Traffic should pass with maximum rate first argument got a default value, thus it needs to be moved towards the end of argument list. + Consequently, the value for it has been deleted from suites. + Test message is now compatible only with BMRR parsing. - Reporting of transmit rate is left as TODO. + Global test __init__ with new way of giving defaults to global variables. + The new keyword is put into robot_enhancements.robot resource. + Number of trials and trial duration are now configurable. - Bootstrap scripts have no support for overriding the defaults yet. Change-Id: I4b108cc9c256730e62c03fbacba0a1c314f8ae88 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-11CSIT-1183: Process the new and the old TC namesTibor Frank2-2/+28
Change-Id: I7fcecd7e23494e8fb0e70e7af00408eed16733e4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-10CSIT-1189: Add suite setup to source code documentationTibor Frank2-12/+33
Change-Id: I0cc435ecacaeb5f9e8fd5c67f495166a1abd2e91 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-10PAL: Treat the new and the old TC namesTibor Frank1-0/+6
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: If5999de81b4e062d38ce44871f0c4d4fa794b55c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-10Remove THIS tag and use unix endlinesVratko Polak14-607/+607
The THIS tag has sneaked in 10Ge2P1X520-Eth-L2Xcbase-Eth-1Memif-1Dcr-Mrr but usually it is only to be used in draft testing. Not sure about the way non-unix endlines crept in. Is not git supposed to perform endline conversions on text files? Or are .robot, .rst, .yaml and .vat not recognized as text? Change-Id: Ia78cf942c05c3029c340a8639782786f37e57469 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-09FIX: Implement changes required by Plot.ly 3.0.0Tibor Frank3-17/+6
- Scatter.xaxix.autotick - Scatter.yaxis.range[] Change-Id: I171e0c4a796f713985b69fae23bfb768590274b4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-06Add Skylake optimization to ansiblePeter Mikus2-2/+41
- Add kernel params - Add TurboBoost managing Change-Id: I9d9561290f8f6780ff41f3a418a1f335d935d843 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-29Add vfio-pci support on all TBPeter Mikus1-1/+5
- Add auto load of vfio-pci - Add iommu support Change-Id: I13611fab9db2813eeab7f90c8f961594349e561e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-29CSIT-1124: Support multi-sample testsTibor Frank5-262/+231
+ Store parsed MRR results as AvgStdevMetadata + Modify tables and plots to use AvgStdevMetadata Change-Id: I29bb1e492a664544e63a180055f66bb0eecfb957 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-28Jumpavg: Post 0.1.3 release editsVratko Polak1-1/+1
+ PyPI/jumpavg version bumped to 0.1.4. + presentation requirements bumped to 0.1.3. + Added stub for change log in readme. Change-Id: I21a606ed7d9aa2b9cc761ed20f94bda41963a1a8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-26Small update to PXE installation READMEPeter Mikus1-0/+4
Change-Id: I1766e3cd81cfe4ed049ed3e7034fff1e367396d4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-25Update PXE info about new Skylake machinesPeter Mikus4-35/+52
Change-Id: Ide828efb0e539ae7bf9c5cfd128f35d8117f3643 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-21CSIT-1136: Trending: Redirect "new" to the index.htmlTibor Frank19-200/+0
- remove the code which generated redirection Change-Id: Ia12ea1129724d92a6ac6e88782e562c23722ae48 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-21CSIT-1136: Trending: Redirect "new" to the index.htmlTibor Frank19-0/+200
Change-Id: I2480a59fb34af70d78bc7404cd380c4b4d3ea483 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-20FIX: PAL - list of failed testsTibor Frank1-11/+6
Change-Id: I03341283270e53df6bcb08b32f1787f61ebb601c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-20CSIT-1110: Replace old trending with the new oneVratko Polak28-14729/+117
+ Remove /new/ folders in presentation and docs. Change-Id: I870002ba8509189196e778aa1292b93e83a3ec17 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-19CSIT-1133: Cosmetic improvements in trending plotsTibor Frank2-17/+18
- Remove "outlier" from the colorbar - Remove anomalies from the legend Change-Id: Idd3255d912c48c80347a773a6b19307e90a53926 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-18CSIT-1126: Detection and reporting of failed MRR testsTibor Frank8-223/+603
Change-Id: Iafdd12a573b58ab3ba9c69699cd97c5a4e598601 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-18CSIT-1110: Update code after jumpavg 0.1.2 releaseTibor Frank2-2/+2
+ Use the released version in PAL. + Bump the jumpavg source to 0.1.3 for next release. + Add PyPI/owners.txt to track python package owner group. Change-Id: I29284a258b24f9991379719313f30cce0349c2bd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-15Update Ansible with new Skylake machinesPeter Mikus21-61/+131
Change-Id: Ia5d0b680deaf7da60696bf2d0260cf7fbea78322 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-15Revert "CSIT-1110: Update code after jumpavg 0.1.2 release"Tibor Frank2-2/+2
This reverts commit f7c46f067a8fb594d2460aaadbe1ca9282b657a8. Change-Id: I409335daac8f9e02bea4e12f2141ab9ceb338964 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-15CSIT-1110: Update code after jumpavg 0.1.2 releaseVratko Polak2-2/+2
+ Use the released version in PAL. + Bump the jumpavg source to 0.1.3 for next release. + Add PyPI/owners.txt to track python package owner group. Change-Id: I0146efcc7c0b7eefc068464739afa605eda2b2d8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-15CSIT-1110: Use jumpavg library from pipVratko Polak21-1054/+2
+ Move the jumpavg library code to separate directory. - Bump to 0.1.2 has to be done later. Change-Id: I9722ede48f00e99eeb68ca3f91e0bdeee2937973 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-15CSIT-1110: Add files for PyPI migrationVratko Polak7-1/+302
Change-Id: I3414d4391f339ee67066491382b59239a81db241 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-15CSIT-1110: Prepare for migrating the new detectionVratko Polak13-28/+90
+ Do not declare BitCountingClassifier.classify() as class method. + Make BitCountingGroupList subclass of list. + Inherit from abstract classes whenever possible. + Drop unneeded imports. + Add module docstrings and class docstrings anywhere. + Add TODOs hinting at possible improvements. Change-Id: Iccfff5c0e7be0607d6cfa74314083fcfe5a4d7d9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-13CSIT-942: RCA - Option 1: Analysing Archived VPP ResultsTibor Frank4-70/+260
- CSIT-953: LLD Change-Id: I0baefd8495f6ae8dc6f95f1cf29f5ccb8053d58d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-13CSIT-1110: Fix dashboard anomaly count rangeVratko Polak2-7/+10
+ Dashboard tables should now report anomalies from last week only. + Changed handling of Nan to report regression. Change-Id: I624b0bc84a93702a31fc79fd670bd645b963f1f7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-13link for start-testcase-DMMsharath1-0/+5
Change-Id: I2687f6408483cd88a2c820d6da03df511e087ba4 Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-06-12CSIT-1110 PAL: Fix warnings by moving new docsVratko Polak1-1/+1
Change-Id: Ie6483e9245872bc6991ed1f3c7aab60131e1eeb1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-12CSIT-1110 PAL: Use group averages for term changesVratko Polak1-41/+23
+ Apply only to trending dashboard tables. + Remove outlier column. - Dashboard description not updated yet. Change-Id: I30e5267c4621564cd4d3ae8bd969d2ef72531d81 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-11CSIT-1110: Cherry-pick edits into new detectionVratko Polak5-401/+651
+ Edit methodology documentation. Change-Id: I441e17862aba4a8572c7c532ed8995790111b4d4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-11CSIT-1110: Integrate anomaly detection into PALVratko Polak38-0/+14667
+ Keep the original detection, + add the new one as subdirectory (both in source and in rendered tree). - The new detection is not rebased over "Add dpdk mrr tests to trending". New detection features: + Do not remove (nor detect) outliers. + Trend line shows the constant average within a group. + Anomaly circles are placed at the changed average. + Small bias against too similar averages. + Should be ready for moving the detection library out to pip. Change-Id: I7ab1a92b79eeeed53ba65a071b1305e927816a89 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-08CSIT-1116: Add dpdk mrr tests to trendingTibor Frank4-354/+623
- Add static content - Add models to specification - Add plots - Add dpdk tests to dashboard - Add dpdk to csv and pretty ASCII tables - Get DPDK version from output.xml Change-Id: I2d9a911d882c205f82432125b601b125807f0ca0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-07CSIT-1122: Add link bonding tests for x710 to the TrendingTibor Frank1-0/+50
Change-Id: I199195bd771fcf9d363a91037cf98254b2d0b923 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-06HC Tests: reenable NSH plugin (CSIT-994)Marek Gradzki2-18/+14
Reverts https://gerrit.fd.io/r/#/c/12572/ Change-Id: Ic55016e3c257a81440332a212e4c0d83e1990668 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-06-05Trending: fixTibor Frank2-2/+2
Change-Id: Ia039b1bc15d52ab8e3bddfd2d09ea5cf4190c67c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-05Trending: FixTibor Frank1-1/+1
Change-Id: Ib9f8d20cb500bb6f485a5fa6211ce1fb00b260a9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-04CSIT-1110: Print NameError to reduce confusionVratko Polak3-9/+9
See https://gerrit.fd.io/r/12724 for an example mistake which also can cause NameError. Change-Id: I65c74744c027800a95014f3be48d0f522a10ce2b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-04CSIT-1112: Add link bonding tests to the TrendingTibor Frank2-31/+83
Change-Id: I3130904423b0e5b24e20d0c74d1b238d2de16f46 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-31CSIT-1055: Pkg download script to use package system not curlPeter Mikus2-95/+154
- Rework VPP package download script Change-Id: I51aca96fc3b834d8e17cf349a5a7b9d7105f2184 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-31Add s17-t33-tg1 into ansible/pxePeter Mikus3-6/+11
Change-Id: I1e44a17391b19aa09042d02e6f072a7ee3738bb8 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-30CSIT-1068 Update testbed-setup for new server onboardingPeter Mikus3-33/+113
Change-Id: I5e1588b432ebd5655a5451f8f19903f28d1fee2a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-30CSIT-1070 Update Ansible structurePeter Mikus83-334/+1047
Change-Id: I9adab174f0c15f4c05a93f61b17714fa6542ea5d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-29CSIT-1089: Add SRv6 MRR tests to trendingTibor Frank2-0/+53
Change-Id: Id7cf1fd41f10922bce35be97153661cdd41d071b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-29CSIT-1106: Unify the anomaly detection (plots, dashboard)Tibor Frank4-150/+130
Change-Id: I27aaa5482224d1ff518aceb879cd889f2fc8d0f5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-25CSIT-1104: Trending: Speed-up plots generationTibor Frank7-691/+305
Change-Id: Ia3916523d4fc9e05ec864af2a858a03dea46c73c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-24FIX: Trending dashboardTibor Frank1-26/+18
Change-Id: I7634a4074647ef226cd6fb3ac1b5e0ee5376c4d4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-24CSIT-1101: Optimize input data processingTibor Frank3-102/+255
- Add multiprocessing Change-Id: Iaeb9dcf0f4523de379ecb7f775b941d9deb080b2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-19start-testcase-DMM file additionsharath1-0/+542
Change-Id: I39945a5f649571267361018659108d107ffb5149 Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-05-16Trending: menuTibor Frank2-5/+4
Change-Id: I8f6528f915c96b5aca8482d8b86db5285e9aa1c9 Signed-off-by: Tibor Frank <tifrank@cisco.com>