aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools
AgeCommit message (Collapse)AuthorFilesLines
2018-05-04CSIT-992: Add libraries for optimized searchVratko Polak1-9/+9
+ Place the libraries into resources/libraries/python/search/. + Except OptimizedTrexSearch in TrafficGenerator.py + Change traffic generator to support floats for duration and warmup. + Remove explicit type conversions where not needed. + Add robot keywords to performance_utils.robot + for calling the optimized search. + for reporting the resulting values. + for checking the minimal performance has been reached. + for running five second "Traffic should pass with no loss" after the search. - Add methodology documentation in subsequent Change. - Add simulator for testing algorithm correctness in a subsequent Change. - Add tests using the libraries in subsequent Change. Change-Id: Ia041008382ee4c9a562172099aea794c854d5f2f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-04Report: Add TSA plotsTibor Frank1-408/+410
Change-Id: Ibb8da96518848fef2fc5b0002a84391dea81c573 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-04Fix various pylint 1.5.4 warningsVratko Polak1-2/+0
+ DUTSetup.py:424 Else clause on loop without a break statement + InterfaceUtil.py:400 Else clause on loop without a break statement + QemuUtils.py:564 Wrong continued indentation + SetupDPDKTest.py: Locally enabling broad-except + VatExecutor.py: Catching too general exception Exception + ssh.py:95 No exception type(s) specified. + HTTPRequest.py: Tolerate HTTPCodes.OK + multiple: Drop ":returns: None" from docstrings. There are still several warnings present: - R0902(too-many-instance-attributes) - R0912(too-many-branches) - R0913(too-many-arguments) - R0914(too-many-locals) - R0915(too-many-statements) - R0401(cyclic-import) And there are multiple blocks of similar lines, mainly across various Setup*Test.py files: - R0801(duplicate-code) Change-Id: I582575cb52b85d69d268e6374852f6e74bb71052 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-04Report: Data, plots, datetimeTibor Frank2-173/+449
Change-Id: I941fd53fdfc35a88562689dacd08aa2ec28429fa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Report: Add time to the timestampTibor Frank1-4/+4
Change-Id: I323517fbac177ef31861be747feeb81968d2b330 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Report: Add time to the timestampTibor Frank1-2/+2
Change-Id: I5d48fb578195d584c3d51a2b8e0d9770ffe82182 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Report: Add time to the timestampTibor Frank1-1/+1
Change-Id: I1343e84353230329362848d1389ae41b169d2791 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Report: Add time to the timestampTibor Frank1-1/+1
Change-Id: I72379462b31455a03f461598cd4b0084b52c4b3e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Report: dataTibor Frank1-27/+32
- ligato Change-Id: I4c54d57e3364fa7cad63d7019e6daed8b6ef885b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Report: dataTibor Frank1-6/+56
Change-Id: I5330c643a3c8ec4115287bf341af1d07175b4e79 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Trending: ignore list for the dashboardTibor Frank1-3/+3
Change-Id: I93e09bd7655a39d1e873cc8c54032469be9cd573 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-02Report: Add MRR detailed resultsTibor Frank1-1/+1
Change-Id: Ia0a12da56b7873b3ec9f8555609828b71addccd0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-02Trending: ignore list for the dashboardTibor Frank1-1/+1
Change-Id: Ibdb134517097bc9cacdcb75a11dda59290ab4e21 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-02Report: Delete xml file when parsedTibor Frank1-0/+11
Change-Id: Ie28c3f3fb58a76ada1cf292ba4c8a401d0ec7155 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-02Report: Add MRR detailed resultsTibor Frank1-0/+49
Change-Id: Ib34689d0a9560c2adc8f9c7e464f5fbf4a2ae1f0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-02Trending: Add 2vm testsTibor Frank2-18/+26
Change-Id: Ifc008ba50c4c84e781c12dc3080d3a361090efb6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-02Report: Replace copy with move while archiving input filesTibor Frank1-3/+3
Change-Id: Iea741cf3346574cc5def8c13e2660e2760157487 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-02Report: Add dataTibor Frank1-9/+15
Change-Id: Id860fe218da5fd608aba163588e92c28b4c8cb53 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-02Report: dataTibor Frank1-34/+64
Change-Id: If58c7bebaedc772fb7b8d7376f2118bad848b2cc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27Report: Add CentOS func testsTibor Frank1-2/+2
Change-Id: I2e993738306ee0a5435c0fda7e46de300fcc91fd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27Trend dashboard table header fixes adjustments.Maciek Konstantynowicz1-6/+6
Change-Id: I186e07a53c0de8722584af927ac3b84331e73609 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-04-27HC tests: reenable NSH plugin (CSIT-994)Marek Gradzki2-18/+14
Reverts https://gerrit.fd.io/r/#/c/11088/ Change-Id: Ib7b70d33f4a8110656dd39f25b7f5a67a2f52104 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-04-27Report: delete tmp dirTibor Frank3-43/+45
Change-Id: I6ab1eefa9a53419d47fda829c365ce9fab7db3c3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27Report: add dataTibor Frank1-8/+8
Change-Id: Ic1c072f41ed967855214570f7b7dbbcacc2a6295 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27CSIT-1041: Do not include last week for long termVratko Polak1-2/+3
Change-Id: Ib7682f24ce22e2e3dc3de74dcef6f70c1785d1c8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-04-27Report: Add CentOS func testsTibor Frank2-8/+91
Change-Id: Id8e08778f199535cec013d08c0b4ab51e51e5d27 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27Report: Add dataTibor Frank1-45/+49
Change-Id: I9bce23e0430f5b4b375cdc814251a95245897a53 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27CSIT-1041: Trending dashboard - coloursTibor Frank1-1/+13
Change-Id: I781e901e81f201d1335708c99eb52783f349725c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Trending: switch back to 3*stdevVratko Polak2-7/+7
Reporting many fake pro/regressions is worse then missing few of the real ones. Change-Id: I2b23ae14ac4462b993dff8d1b15fb1e472caf490 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-04-26Report: Add historical data to performance changes tableTibor Frank1-2/+2
Change-Id: Ia1e224ecade79c54b373ba3e8ac53c21c054f648 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Report: Add historical data to performance changes tableTibor Frank1-9/+12
Change-Id: I6ae8d3a36ada557a2119f6e7f46dde040e4db574 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Report: Add historical data to performance changes tableTibor Frank2-11/+10
Change-Id: If7bce2c86b2fb352368c433c5db81a4a4bc976ed Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26CSIT-1041: Trending dashboardTibor Frank2-13/+2
Change-Id: I7aa7f01738649fc3f3b10572d7e08af580293748 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Trending: use 2*stdevTibor Frank2-9/+9
Change-Id: I24ba8d268a25d5b5c249cde47a13468dfab57a4b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Report: Add dataTibor Frank2-4/+7
Change-Id: I043a50f9d55dd784039a483da034cfe4db65d003 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Report: Add historical data to performance changes tableTibor Frank2-2/+4
Change-Id: I9d6ff6021db4356c0b06555c79841b9ed602f671 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Report: Add historical data to performance changes tableTibor Frank2-25/+61
Change-Id: Ia29ff844e44575020e71fb3f613e77508bda8b24 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26CSIT-1041: Use TMM for trending lineVratko Polak2-40/+38
+ Make also pro/re-gression detection use TMM. + Update graphs. - Do not update dashboard tables yet. Change-Id: Iae526c846b329ad99549be61481532e197704fb0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-04-25CSIT-1041: Trending dashboardTibor Frank1-3/+3
Change-Id: If2e06d59fa8986ccf24abc118628b42d1deb6e39 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-25CSIT-1041: Trending dashboardTibor Frank2-14/+27
Change-Id: Ib1307d542ddef1fb6c4ddc0f6204c549870a3c25 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-25CSIT-1041: Trending dashboardTibor Frank1-142/+63
Change-Id: I1d6aae1839a9d6d44407c90ff257bc37495f0cfa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-25CSIT-1041: Do not treat positive jumps as outliersVratko Polak1-2/+2
Change-Id: If6e65faae3b5a31c56f942a7975b5a35f5f6d6a4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-04-25Report: add dataTibor Frank1-0/+9
- https://jenkins.fd.io/job/csit-vpp-perf-1804-all/17/ - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/18/ Change-Id: I3cfebb535c1c1806530ec16e86a5088a94ce3141 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-25FIX: Do not ignore zeros while creating csv fileTibor Frank1-1/+2
Change-Id: I0f1f63b9969399258c44176e6ed5a326fd0a5549 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-25FIX: Remove feature plots from base graphsTibor Frank1-6/+6
Change-Id: I4118a19bd6204858e96cbf8029aea045478efca7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-24Report: Add data sourcesTibor Frank1-22/+28
- https://jenkins.fd.io/job/csit-vpp-perf-1804-all/14/ - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/16/ Change-Id: I7603a41f797a6dd5438c3daa40e883b1643ae712 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-24CSIT-1041: Trending dashboardTibor Frank1-2/+6
Change-Id: I815e61432d418d0f741ed57f5450460951f7191f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-24CSIT-1041: Trending dashboardTibor Frank1-1/+1
Change-Id: I1e05f75545d97ab186fbc48df44bfe17472d6cfd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-24CSIT-1041: Trending dashboardTibor Frank3-22/+17
Change-Id: Ida3dfcc4a7ae21424e7f6b6db597a80bc633b9da Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-23CSIT-1041: Trending dashboardTibor Frank2-32/+58
Change-Id: I8d53c68643acb18bf2b5ab171672b0de02d2d135 Signed-off-by: Tibor Frank <tifrank@cisco.com>