aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools
AgeCommit message (Collapse)AuthorFilesLines
2018-06-13CSIT-1110: Fix dashboard anomaly count rangeVratko Polak2-7/+10
+ Dashboard tables should now report anomalies from last week only. + Changed handling of Nan to report regression. Change-Id: I624b0bc84a93702a31fc79fd670bd645b963f1f7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-13link for start-testcase-DMMsharath1-0/+5
Change-Id: I2687f6408483cd88a2c820d6da03df511e087ba4 Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-06-12CSIT-1110 PAL: Fix warnings by moving new docsVratko Polak1-1/+1
Change-Id: Ie6483e9245872bc6991ed1f3c7aab60131e1eeb1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-12CSIT-1110 PAL: Use group averages for term changesVratko Polak1-41/+23
+ Apply only to trending dashboard tables. + Remove outlier column. - Dashboard description not updated yet. Change-Id: I30e5267c4621564cd4d3ae8bd969d2ef72531d81 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-11CSIT-1110: Cherry-pick edits into new detectionVratko Polak5-401/+651
+ Edit methodology documentation. Change-Id: I441e17862aba4a8572c7c532ed8995790111b4d4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-11CSIT-1110: Integrate anomaly detection into PALVratko Polak38-0/+14667
+ Keep the original detection, + add the new one as subdirectory (both in source and in rendered tree). - The new detection is not rebased over "Add dpdk mrr tests to trending". New detection features: + Do not remove (nor detect) outliers. + Trend line shows the constant average within a group. + Anomaly circles are placed at the changed average. + Small bias against too similar averages. + Should be ready for moving the detection library out to pip. Change-Id: I7ab1a92b79eeeed53ba65a071b1305e927816a89 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-08CSIT-1116: Add dpdk mrr tests to trendingTibor Frank4-354/+623
- Add static content - Add models to specification - Add plots - Add dpdk tests to dashboard - Add dpdk to csv and pretty ASCII tables - Get DPDK version from output.xml Change-Id: I2d9a911d882c205f82432125b601b125807f0ca0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-07CSIT-1122: Add link bonding tests for x710 to the TrendingTibor Frank1-0/+50
Change-Id: I199195bd771fcf9d363a91037cf98254b2d0b923 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-06HC Tests: reenable NSH plugin (CSIT-994)Marek Gradzki2-18/+14
Reverts https://gerrit.fd.io/r/#/c/12572/ Change-Id: Ic55016e3c257a81440332a212e4c0d83e1990668 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-06-05Trending: fixTibor Frank2-2/+2
Change-Id: Ia039b1bc15d52ab8e3bddfd2d09ea5cf4190c67c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-05Trending: FixTibor Frank1-1/+1
Change-Id: Ib9f8d20cb500bb6f485a5fa6211ce1fb00b260a9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-04CSIT-1110: Print NameError to reduce confusionVratko Polak3-9/+9
See https://gerrit.fd.io/r/12724 for an example mistake which also can cause NameError. Change-Id: I65c74744c027800a95014f3be48d0f522a10ce2b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-06-04CSIT-1112: Add link bonding tests to the TrendingTibor Frank2-31/+83
Change-Id: I3130904423b0e5b24e20d0c74d1b238d2de16f46 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-31CSIT-1055: Pkg download script to use package system not curlPeter Mikus2-95/+154
- Rework VPP package download script Change-Id: I51aca96fc3b834d8e17cf349a5a7b9d7105f2184 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-31Add s17-t33-tg1 into ansible/pxePeter Mikus3-6/+11
Change-Id: I1e44a17391b19aa09042d02e6f072a7ee3738bb8 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-30CSIT-1068 Update testbed-setup for new server onboardingPeter Mikus3-33/+113
Change-Id: I5e1588b432ebd5655a5451f8f19903f28d1fee2a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-30CSIT-1070 Update Ansible structurePeter Mikus83-334/+1047
Change-Id: I9adab174f0c15f4c05a93f61b17714fa6542ea5d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-29CSIT-1089: Add SRv6 MRR tests to trendingTibor Frank2-0/+53
Change-Id: Id7cf1fd41f10922bce35be97153661cdd41d071b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-29CSIT-1106: Unify the anomaly detection (plots, dashboard)Tibor Frank4-150/+130
Change-Id: I27aaa5482224d1ff518aceb879cd889f2fc8d0f5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-25CSIT-1104: Trending: Speed-up plots generationTibor Frank7-691/+305
Change-Id: Ia3916523d4fc9e05ec864af2a858a03dea46c73c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-24FIX: Trending dashboardTibor Frank1-26/+18
Change-Id: I7634a4074647ef226cd6fb3ac1b5e0ee5376c4d4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-24CSIT-1101: Optimize input data processingTibor Frank3-102/+255
- Add multiprocessing Change-Id: Iaeb9dcf0f4523de379ecb7f775b941d9deb080b2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-19start-testcase-DMM file additionsharath1-0/+542
Change-Id: I39945a5f649571267361018659108d107ffb5149 Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-05-16Trending: menuTibor Frank2-5/+4
Change-Id: I8f6528f915c96b5aca8482d8b86db5285e9aa1c9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-16CSIT-1082: Trending: Display date on the x-axisTibor Frank2-26/+64
Change-Id: I3f5bdb11222446a5c6016ab4ff57d909514c3ddc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-16CSIT-1082: Trending: Display date on the x-axisTibor Frank2-36/+63
Change-Id: I6f7238e15545d46ded668b7e85f9e2cc58d43586 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-15HC tests: disable NSH plugin (CSIT-994)Marek Gradzki2-14/+18
This reverts https://gerrit.fd.io/r/#/c/12209/ Change-Id: I1de4ce6e96644881aa14adf6765e8a67b286595d Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-05-14CSIT-1078: Optimize input data files download and processingTibor Frank13-2917/+14
Change-Id: I973238d98d549555c0d43c91f9fd96a9209065ac Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-14CSIT-1078: Optimize input data files download and processingTibor Frank1-2/+2
Change-Id: I3fa3c09bc485416e6d2be02fac296d83da16e0d7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-14CSIT-1078: Optimize input data files download and processingTibor Frank10-451/+256
Change-Id: Id1b0af996c4b77878621cfc8c262795f51e537fc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-10Updated testbed setup readmejuraj.linkes1-5/+9
The section describing PXE server setup contained incorrect paths for nginx server, which this patch fixes. Change-Id: Iea04c12baea88d6ef378826d4b4e2eab5648b36b Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2018-05-09Report: Data sourcesTibor Frank1-4/+4
Change-Id: I7b3b3451c71cf6912b760660f2af9856c576ecca Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-06Add data point to reportPeter Mikus1-22/+22
- MRR Sel, Perf FULL 4 Change-Id: Idc016488fd656726e54d6dbd661dd877d481fd59 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-05Report: SRv6 to TSATibor Frank1-2/+39
Change-Id: I23d7080db24ef579ad53420cbe1bacd10f2db873 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-05Report: Add SRv6, fix grepsTibor Frank1-282/+147
Change-Id: I55fea325dbc54bc6f2f2e42f0b6166d68f2e7300 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-04Report: data, figures descTibor Frank1-1/+1
Change-Id: I720376c377940a3497da8c33e7ee1f909d293fd4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-04Report 1804: Centos func testsJan Gelety1-1/+2
Change-Id: Ifc6febd239c0c3c5e2c29e26992120c2d6d1b0b4 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-05-04Report: data, figures descTibor Frank1-24/+27
Change-Id: I6751b6ae833610456e1dea938d5262c28b93439d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-04CSIT-992: Add libraries for optimized searchVratko Polak1-9/+9
+ Place the libraries into resources/libraries/python/search/. + Except OptimizedTrexSearch in TrafficGenerator.py + Change traffic generator to support floats for duration and warmup. + Remove explicit type conversions where not needed. + Add robot keywords to performance_utils.robot + for calling the optimized search. + for reporting the resulting values. + for checking the minimal performance has been reached. + for running five second "Traffic should pass with no loss" after the search. - Add methodology documentation in subsequent Change. - Add simulator for testing algorithm correctness in a subsequent Change. - Add tests using the libraries in subsequent Change. Change-Id: Ia041008382ee4c9a562172099aea794c854d5f2f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-04Report: Add TSA plotsTibor Frank1-408/+410
Change-Id: Ibb8da96518848fef2fc5b0002a84391dea81c573 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-04Fix various pylint 1.5.4 warningsVratko Polak1-2/+0
+ DUTSetup.py:424 Else clause on loop without a break statement + InterfaceUtil.py:400 Else clause on loop without a break statement + QemuUtils.py:564 Wrong continued indentation + SetupDPDKTest.py: Locally enabling broad-except + VatExecutor.py: Catching too general exception Exception + ssh.py:95 No exception type(s) specified. + HTTPRequest.py: Tolerate HTTPCodes.OK + multiple: Drop ":returns: None" from docstrings. There are still several warnings present: - R0902(too-many-instance-attributes) - R0912(too-many-branches) - R0913(too-many-arguments) - R0914(too-many-locals) - R0915(too-many-statements) - R0401(cyclic-import) And there are multiple blocks of similar lines, mainly across various Setup*Test.py files: - R0801(duplicate-code) Change-Id: I582575cb52b85d69d268e6374852f6e74bb71052 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-04Report: Data, plots, datetimeTibor Frank2-173/+449
Change-Id: I941fd53fdfc35a88562689dacd08aa2ec28429fa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Report: Add time to the timestampTibor Frank1-4/+4
Change-Id: I323517fbac177ef31861be747feeb81968d2b330 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Report: Add time to the timestampTibor Frank1-2/+2
Change-Id: I5d48fb578195d584c3d51a2b8e0d9770ffe82182 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Report: Add time to the timestampTibor Frank1-1/+1
Change-Id: I1343e84353230329362848d1389ae41b169d2791 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Report: Add time to the timestampTibor Frank1-1/+1
Change-Id: I72379462b31455a03f461598cd4b0084b52c4b3e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Report: dataTibor Frank1-27/+32
- ligato Change-Id: I4c54d57e3364fa7cad63d7019e6daed8b6ef885b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Report: dataTibor Frank1-6/+56
Change-Id: I5330c643a3c8ec4115287bf341af1d07175b4e79 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Trending: ignore list for the dashboardTibor Frank1-3/+3
Change-Id: I93e09bd7655a39d1e873cc8c54032469be9cd573 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-02Report: Add MRR detailed resultsTibor Frank1-1/+1
Change-Id: Ia0a12da56b7873b3ec9f8555609828b71addccd0 Signed-off-by: Tibor Frank <tifrank@cisco.com>