aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2018-05-10HC2VPP-253 - Update routing csit jobsMichal Cmarada6-109/+124
this fixes test failures caused by HC2VPP routing models bump (https://gerrit.fd.io/r/#/c/10954) - updates tests for bgp routing - updates tests for routing - updates SLAAC test because of changes in rt-advertisements Change-Id: Iacc37b42e6523f440d77241c18ca8e61d1d01f23 Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
2018-05-10CSIT-1071 Add traffic evaluation criteria to MRRPeter Mikus2-3/+16
- Fail the testcase if there is no traffic pass. Change-Id: I162187073aafa286793ce488fda9fd065bb55213 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-09Report: Data sourcesTibor Frank1-4/+4
Change-Id: I7b3b3451c71cf6912b760660f2af9856c576ecca Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-09FIX: SSH connect issuePeter Mikus2-28/+19
error: [Errno 9] Bad file descriptor Change-Id: I4c5278d41e979f6af43054e3b5890fb154555494 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-06Add data point to reportPeter Mikus1-22/+22
- MRR Sel, Perf FULL 4 Change-Id: Idc016488fd656726e54d6dbd661dd877d481fd59 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-05Report: SRv6 to TSATibor Frank1-2/+39
Change-Id: I23d7080db24ef579ad53420cbe1bacd10f2db873 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-05Report: Add SRv6, fix grepsTibor Frank1-282/+147
Change-Id: I55fea325dbc54bc6f2f2e42f0b6166d68f2e7300 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-04Report: data, figures descTibor Frank1-1/+1
Change-Id: I720376c377940a3497da8c33e7ee1f909d293fd4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-04CSIT-992: Shorten MDR search test messageVratko Polak1-9/+6
Change-Id: I79c78d4d8ca1611a287bd117e480c4317d27e287 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-04Report 1804: Centos func testsJan Gelety1-1/+2
Change-Id: Ifc6febd239c0c3c5e2c29e26992120c2d6d1b0b4 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-05-04Report: data, figures descTibor Frank1-24/+27
Change-Id: I6751b6ae833610456e1dea938d5262c28b93439d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-04CSIT-992: Add libraries for optimized searchVratko Polak10-29/+1087
+ Place the libraries into resources/libraries/python/search/. + Except OptimizedTrexSearch in TrafficGenerator.py + Change traffic generator to support floats for duration and warmup. + Remove explicit type conversions where not needed. + Add robot keywords to performance_utils.robot + for calling the optimized search. + for reporting the resulting values. + for checking the minimal performance has been reached. + for running five second "Traffic should pass with no loss" after the search. - Add methodology documentation in subsequent Change. - Add simulator for testing algorithm correctness in a subsequent Change. - Add tests using the libraries in subsequent Change. Change-Id: Ia041008382ee4c9a562172099aea794c854d5f2f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-04Report: Add TSA plotsTibor Frank1-408/+410
Change-Id: Ibb8da96518848fef2fc5b0002a84391dea81c573 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-04Fix various pylint 1.5.4 warningsVratko Polak17-48/+43
+ DUTSetup.py:424 Else clause on loop without a break statement + InterfaceUtil.py:400 Else clause on loop without a break statement + QemuUtils.py:564 Wrong continued indentation + SetupDPDKTest.py: Locally enabling broad-except + VatExecutor.py: Catching too general exception Exception + ssh.py:95 No exception type(s) specified. + HTTPRequest.py: Tolerate HTTPCodes.OK + multiple: Drop ":returns: None" from docstrings. There are still several warnings present: - R0902(too-many-instance-attributes) - R0912(too-many-branches) - R0913(too-many-arguments) - R0914(too-many-locals) - R0915(too-many-statements) - R0401(cyclic-import) And there are multiple blocks of similar lines, mainly across various Setup*Test.py files: - R0801(duplicate-code) Change-Id: I582575cb52b85d69d268e6374852f6e74bb71052 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-04FIX: TCP perf testsTibor Frank2-0/+29
Change-Id: I59ad8ef70fc2bedce14b52359922a002f960ab7a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-04Report: Data, plots, datetimeTibor Frank2-173/+449
Change-Id: I941fd53fdfc35a88562689dacd08aa2ec28429fa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Report: Add time to the timestampTibor Frank1-4/+4
Change-Id: I323517fbac177ef31861be747feeb81968d2b330 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Report: Add time to the timestampTibor Frank1-2/+2
Change-Id: I5d48fb578195d584c3d51a2b8e0d9770ffe82182 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Report: Add time to the timestampTibor Frank1-1/+1
Change-Id: I1343e84353230329362848d1389ae41b169d2791 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Report: Add time to the timestampTibor Frank1-1/+1
Change-Id: I72379462b31455a03f461598cd4b0084b52c4b3e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Report: dataTibor Frank1-27/+32
- ligato Change-Id: I4c54d57e3364fa7cad63d7019e6daed8b6ef885b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Report: dataTibor Frank1-6/+56
Change-Id: I5330c643a3c8ec4115287bf341af1d07175b4e79 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-03Trending: ignore list for the dashboardTibor Frank1-3/+3
Change-Id: I93e09bd7655a39d1e873cc8c54032469be9cd573 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-02Report: Add MRR detailed resultsTibor Frank1-1/+1
Change-Id: Ia0a12da56b7873b3ec9f8555609828b71addccd0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-02Trending: ignore list for the dashboardTibor Frank1-1/+1
Change-Id: Ibdb134517097bc9cacdcb75a11dda59290ab4e21 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-02Report: Delete xml file when parsedTibor Frank1-0/+11
Change-Id: Ie28c3f3fb58a76ada1cf292ba4c8a401d0ec7155 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-02Report: Add MRR detailed resultsTibor Frank1-0/+49
Change-Id: Ib34689d0a9560c2adc8f9c7e464f5fbf4a2ae1f0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-02Trending: Add 2vm testsTibor Frank2-18/+26
Change-Id: Ifc008ba50c4c84e781c12dc3080d3a361090efb6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-02Report: Replace copy with move while archiving input filesTibor Frank1-3/+3
Change-Id: Iea741cf3346574cc5def8c13e2660e2760157487 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-02Report: Add dataTibor Frank1-9/+15
Change-Id: Id860fe218da5fd608aba163588e92c28b4c8cb53 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-02Report: dataTibor Frank1-34/+64
Change-Id: If58c7bebaedc772fb7b8d7376f2118bad848b2cc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27Report: Add CentOS func testsTibor Frank1-2/+2
Change-Id: I2e993738306ee0a5435c0fda7e46de300fcc91fd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27Trend dashboard table header fixes adjustments.Maciek Konstantynowicz1-6/+6
Change-Id: I186e07a53c0de8722584af927ac3b84331e73609 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-04-27HC tests: reenable NSH plugin (CSIT-994)Marek Gradzki2-18/+14
Reverts https://gerrit.fd.io/r/#/c/11088/ Change-Id: Ib7b70d33f4a8110656dd39f25b7f5a67a2f52104 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-04-27Report: delete tmp dirTibor Frank3-43/+45
Change-Id: I6ab1eefa9a53419d47fda829c365ce9fab7db3c3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27Report: add dataTibor Frank1-8/+8
Change-Id: Ic1c072f41ed967855214570f7b7dbbcacc2a6295 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27CSIT-1041: Do not include last week for long termVratko Polak1-2/+3
Change-Id: Ib7682f24ce22e2e3dc3de74dcef6f70c1785d1c8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-04-27Report: Add CentOS func testsTibor Frank2-8/+91
Change-Id: Id8e08778f199535cec013d08c0b4ab51e51e5d27 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27Report: Add dataTibor Frank1-45/+49
Change-Id: I9bce23e0430f5b4b375cdc814251a95245897a53 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27CSIT-1041: Trending dashboard - coloursTibor Frank1-1/+13
Change-Id: I781e901e81f201d1335708c99eb52783f349725c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Trending: switch back to 3*stdevVratko Polak2-7/+7
Reporting many fake pro/regressions is worse then missing few of the real ones. Change-Id: I2b23ae14ac4462b993dff8d1b15fb1e472caf490 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-04-26Report: Add historical data to performance changes tableTibor Frank1-2/+2
Change-Id: Ia1e224ecade79c54b373ba3e8ac53c21c054f648 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Report: Add historical data to performance changes tableTibor Frank1-9/+12
Change-Id: I6ae8d3a36ada557a2119f6e7f46dde040e4db574 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Report: Add historical data to performance changes tableTibor Frank2-11/+10
Change-Id: If7bce2c86b2fb352368c433c5db81a4a4bc976ed Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26CSIT-1041: Trending dashboardTibor Frank2-13/+2
Change-Id: I7aa7f01738649fc3f3b10572d7e08af580293748 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Trending: use 2*stdevTibor Frank2-9/+9
Change-Id: I24ba8d268a25d5b5c249cde47a13468dfab57a4b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Report: Add dataTibor Frank2-4/+7
Change-Id: I043a50f9d55dd784039a483da034cfe4db65d003 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Report: Add historical data to performance changes tableTibor Frank2-2/+4
Change-Id: I9d6ff6021db4356c0b06555c79841b9ed602f671 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26Report: Add historical data to performance changes tableTibor Frank2-25/+61
Change-Id: Ia29ff844e44575020e71fb3f613e77508bda8b24 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-26CSIT-1041: Use TMM for trending lineVratko Polak2-40/+38
+ Make also pro/re-gression detection use TMM. + Update graphs. - Do not update dashboard tables yet. Change-Id: Iae526c846b329ad99549be61481532e197704fb0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>