aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools
AgeCommit message (Collapse)AuthorFilesLines
2018-06-19CSIT-1133: Cosmetic improvements in trending plotsTibor Frank2-17/+18
- Remove "outlier" from the colorbar - Remove anomalies from the legend Change-Id: Idd3255d912c48c80347a773a6b19307e90a53926 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-18CSIT-1126: Detection and reporting of failed MRR testsTibor Frank8-223/+603
Change-Id: Iafdd12a573b58ab3ba9c69699cd97c5a4e598601 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-18CSIT-1110: Update code after jumpavg 0.1.2 releaseTibor Frank2-2/+2
+ Use the released version in PAL. + Bump the jumpavg source to 0.1.3 for next release. + Add PyPI/owners.txt to track python package owner group. Change-Id: I29284a258b24f9991379719313f30cce0349c2bd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-15Update Ansible with new Skylake machinesPeter Mikus21-61/+131
Change-Id: Ia5d0b680deaf7da60696bf2d0260cf7fbea78322 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-15Revert "CSIT-1110: Update code after jumpavg 0.1.2 release"Tibor Frank2-2/+2
This reverts commit f7c46f067a8fb594d2460aaadbe1ca9282b657a8. Change-Id: I409335daac8f9e02bea4e12f2141ab9ceb338964 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-15CSIT-1110: Update code after jumpavg 0.1.2 releaseVratko Polak2-2/+2
+ Use the released version in PAL. + Bump the jumpavg source to 0.1.3 for next release. + Add PyPI/owners.txt to track python package owner group. Change-Id: I0146efcc7c0b7eefc068464739afa605eda2b2d8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-15CSIT-1110: Use jumpavg library from pipVratko Polak21-1054/+2
+ Move the jumpavg library code to separate directory. - Bump to 0.1.2 has to be done later. Change-Id: I9722ede48f00e99eeb68ca3f91e0bdeee2937973 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-15CSIT-1110: Add files for PyPI migrationVratko Polak7-1/+302
Change-Id: I3414d4391f339ee67066491382b59239a81db241 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-15CSIT-1110: Prepare for migrating the new detectionVratko Polak13-28/+90
+ Do not declare BitCountingClassifier.classify() as class method. + Make BitCountingGroupList subclass of list. + Inherit from abstract classes whenever possible. + Drop unneeded imports. + Add module docstrings and class docstrings anywhere. + Add TODOs hinting at possible improvements. Change-Id: Iccfff5c0e7be0607d6cfa74314083fcfe5a4d7d9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-13CSIT-942: RCA - Option 1: Analysing Archived VPP ResultsTibor Frank4-70/+260
- CSIT-953: LLD Change-Id: I0baefd8495f6ae8dc6f95f1cf29f5ccb8053d58d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-13CSIT-1110: Fix dashboard anomaly count rangeVratko Polak2-7/+10
+ Dashboard tables should now report anomalies from last week only. + Changed handling of Nan to report regression. Change-Id: I624b0bc84a93702a31fc79fd670bd645b963f1f7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-13link for start-testcase-DMMsharath1-0/+5
Change-Id: I2687f6408483cd88a2c820d6da03df511e087ba4 Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-06-12CSIT-1110 PAL: Fix warnings by moving new docsVratko Polak1-1/+1
Change-Id: Ie6483e9245872bc6991ed1f3c7aab60131e1eeb1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-12CSIT-1110 PAL: Use group averages for term changesVratko Polak1-41/+23
+ Apply only to trending dashboard tables. + Remove outlier column. - Dashboard description not updated yet. Change-Id: I30e5267c4621564cd4d3ae8bd969d2ef72531d81 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-11CSIT-1110: Cherry-pick edits into new detectionVratko Polak5-401/+651
+ Edit methodology documentation. Change-Id: I441e17862aba4a8572c7c532ed8995790111b4d4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-11CSIT-1110: Integrate anomaly detection into PALVratko Polak38-0/+14667
+ Keep the original detection, + add the new one as subdirectory (both in source and in rendered tree). - The new detection is not rebased over "Add dpdk mrr tests to trending". New detection features: + Do not remove (nor detect) outliers. + Trend line shows the constant average within a group. + Anomaly circles are placed at the changed average. + Small bias against too similar averages. + Should be ready for moving the detection library out to pip. Change-Id: I7ab1a92b79eeeed53ba65a071b1305e927816a89 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-08CSIT-1116: Add dpdk mrr tests to trendingTibor Frank4-354/+623
- Add static content - Add models to specification - Add plots - Add dpdk tests to dashboard - Add dpdk to csv and pretty ASCII tables - Get DPDK version from output.xml Change-Id: I2d9a911d882c205f82432125b601b125807f0ca0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-07CSIT-1122: Add link bonding tests for x710 to the TrendingTibor Frank1-0/+50
Change-Id: I199195bd771fcf9d363a91037cf98254b2d0b923 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-06HC Tests: reenable NSH plugin (CSIT-994)Marek Gradzki2-18/+14
Reverts https://gerrit.fd.io/r/#/c/12572/ Change-Id: Ic55016e3c257a81440332a212e4c0d83e1990668 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-06-05Trending: fixTibor Frank2-2/+2
Change-Id: Ia039b1bc15d52ab8e3bddfd2d09ea5cf4190c67c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-05Trending: FixTibor Frank1-1/+1
Change-Id: Ib9f8d20cb500bb6f485a5fa6211ce1fb00b260a9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-04CSIT-1110: Print NameError to reduce confusionVratko Polak3-9/+9
See https://gerrit.fd.io/r/12724 for an example mistake which also can cause NameError. Change-Id: I65c74744c027800a95014f3be48d0f522a10ce2b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-04CSIT-1112: Add link bonding tests to the TrendingTibor Frank2-31/+83
Change-Id: I3130904423b0e5b24e20d0c74d1b238d2de16f46 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-31CSIT-1055: Pkg download script to use package system not curlPeter Mikus2-95/+154
- Rework VPP package download script Change-Id: I51aca96fc3b834d8e17cf349a5a7b9d7105f2184 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-31Add s17-t33-tg1 into ansible/pxePeter Mikus3-6/+11
Change-Id: I1e44a17391b19aa09042d02e6f072a7ee3738bb8 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-30CSIT-1068 Update testbed-setup for new server onboardingPeter Mikus3-33/+113
Change-Id: I5e1588b432ebd5655a5451f8f19903f28d1fee2a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-30CSIT-1070 Update Ansible structurePeter Mikus83-334/+1047
Change-Id: I9adab174f0c15f4c05a93f61b17714fa6542ea5d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-29CSIT-1089: Add SRv6 MRR tests to trendingTibor Frank2-0/+53
Change-Id: Id7cf1fd41f10922bce35be97153661cdd41d071b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-29CSIT-1106: Unify the anomaly detection (plots, dashboard)Tibor Frank4-150/+130
Change-Id: I27aaa5482224d1ff518aceb879cd889f2fc8d0f5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-25CSIT-1104: Trending: Speed-up plots generationTibor Frank7-691/+305
Change-Id: Ia3916523d4fc9e05ec864af2a858a03dea46c73c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-24FIX: Trending dashboardTibor Frank1-26/+18
Change-Id: I7634a4074647ef226cd6fb3ac1b5e0ee5376c4d4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-24CSIT-1101: Optimize input data processingTibor Frank3-102/+255
- Add multiprocessing Change-Id: Iaeb9dcf0f4523de379ecb7f775b941d9deb080b2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-19start-testcase-DMM file additionsharath1-0/+542
Change-Id: I39945a5f649571267361018659108d107ffb5149 Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-05-16Trending: menuTibor Frank2-5/+4
Change-Id: I8f6528f915c96b5aca8482d8b86db5285e9aa1c9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-16CSIT-1082: Trending: Display date on the x-axisTibor Frank2-26/+64
Change-Id: I3f5bdb11222446a5c6016ab4ff57d909514c3ddc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-16CSIT-1082: Trending: Display date on the x-axisTibor Frank2-36/+63
Change-Id: I6f7238e15545d46ded668b7e85f9e2cc58d43586 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-15HC tests: disable NSH plugin (CSIT-994)Marek Gradzki2-14/+18
This reverts https://gerrit.fd.io/r/#/c/12209/ Change-Id: I1de4ce6e96644881aa14adf6765e8a67b286595d Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-05-14CSIT-1078: Optimize input data files download and processingTibor Frank13-2917/+14
Change-Id: I973238d98d549555c0d43c91f9fd96a9209065ac Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-14CSIT-1078: Optimize input data files download and processingTibor Frank1-2/+2
Change-Id: I3fa3c09bc485416e6d2be02fac296d83da16e0d7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-14CSIT-1078: Optimize input data files download and processingTibor Frank10-451/+256
Change-Id: Id1b0af996c4b77878621cfc8c262795f51e537fc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-10Updated testbed setup readmejuraj.linkes1-5/+9
The section describing PXE server setup contained incorrect paths for nginx server, which this patch fixes. Change-Id: Iea04c12baea88d6ef378826d4b4e2eab5648b36b Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2018-05-09Report: Data sourcesTibor Frank1-4/+4
Change-Id: I7b3b3451c71cf6912b760660f2af9856c576ecca Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-06Add data point to reportPeter Mikus1-22/+22
- MRR Sel, Perf FULL 4 Change-Id: Idc016488fd656726e54d6dbd661dd877d481fd59 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-05Report: SRv6 to TSATibor Frank1-2/+39
Change-Id: I23d7080db24ef579ad53420cbe1bacd10f2db873 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-05Report: Add SRv6, fix grepsTibor Frank1-282/+147
Change-Id: I55fea325dbc54bc6f2f2e42f0b6166d68f2e7300 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-04Report: data, figures descTibor Frank1-1/+1
Change-Id: I720376c377940a3497da8c33e7ee1f909d293fd4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-04Report 1804: Centos func testsJan Gelety1-1/+2
Change-Id: Ifc6febd239c0c3c5e2c29e26992120c2d6d1b0b4 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-05-04Report: data, figures descTibor Frank1-24/+27
Change-Id: I6751b6ae833610456e1dea938d5262c28b93439d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-04CSIT-992: Add libraries for optimized searchVratko Polak1-9/+9
+ Place the libraries into resources/libraries/python/search/. + Except OptimizedTrexSearch in TrafficGenerator.py + Change traffic generator to support floats for duration and warmup. + Remove explicit type conversions where not needed. + Add robot keywords to performance_utils.robot + for calling the optimized search. + for reporting the resulting values. + for checking the minimal performance has been reached. + for running five second "Traffic should pass with no loss" after the search. - Add methodology documentation in subsequent Change. - Add simulator for testing algorithm correctness in a subsequent Change. - Add tests using the libraries in subsequent Change. Change-Id: Ia041008382ee4c9a562172099aea794c854d5f2f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-04Report: Add TSA plotsTibor Frank1-408/+410
Change-Id: Ibb8da96518848fef2fc5b0002a84391dea81c573 Signed-off-by: Tibor Frank <tifrank@cisco.com>