aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2019-09-19CSIT-1597 API cleanup: copJan Gelety2-44/+35
cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21458 Change-Id: I596cfcd192bf48b0d0a91b1953746a484e2c9793 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-18Fix errors found by pylintVratko Polak2-7/+6
Change-Id: I0c2bee5a1ff8ad29e47c4f947388e7b97dd17fff Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-17Report: Enable pdf versionTibor Frank1-2/+2
Change-Id: I2c88a8b5939cbe4498d5bc44de3618cb717a9a7f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-17Update CRC list and support 21997/7Vratko Polak5-138/+181
- Attempt to repair IPsec LispGpe perf suite. + Collection name to reflect the current stable vpp. + Add messages found in CSIT L1 keywords. - Uncommented (instead of deleted) untestable messages. Reasons: - Honeycomb. - Messages used by unused keywords. + Listed reasons. Honeycomb not mentioned if both reasons apply. + Delete CRC items for commands not found in keywords anymore. + Add CRCs from .json.api files (as teardown is hard to execute). + Define and restore alphabetical order. + Add hints to find used API commands (not entirely reliable). + Move used commands to "cmd = " form so hints find them. + Argument to run_cli_command changed from "cmd" to "cli_cmd". + Except also struct.error where IOError is excepted. Change-Id: I61058dbe1e33296908aabd0c13433bb16cfa6adf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-16Trending: Fix removing of old input filesTibor Frank1-18/+0
Change-Id: I67ff7944a1eb576bd6e739202a94eb12be9e0e1b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-16Trending: Reduce input dataTibor Frank2-70/+107
Change-Id: I6b3bdac6941d85792987e2bc7e75cb8bc0be4f4a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-15Report: Add dataTibor Frank1-0/+2
Change-Id: Ibef7599c5438624512d547af25b2026580e2bc92 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-13FIX: Pylint + Container mountPeter Mikus3-11/+15
- Mount is affecting only LXC container Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I84140ea5e48120792fc84182a97eb7d06c954a84
2019-09-13Report: FixesTibor Frank2-13/+13
Change-Id: Id14704f3c1526655adeaa51f0a4198b6309a64eb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-13CRC checker: Sort and indent dict outputVratko Polak1-15/+18
Also, use double quotes, so the dict is shown not only as a valid Python code, but also a valid JSON. This should make it easier to handle big CRC changes such as: https://logs.fd.io/production/vex-yul-rot-jenkins-1 /vpp-csit-verify-api-crc-master/646/console.log.gz + Log indented message about CRC conflict to console even on failure, as in the exception, endlines are escaped. Change-Id: If4fe3003f612d4b0c156004a0aa2dab088e50723 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-13Report: Add dataTibor Frank1-353/+438
Change-Id: I589a236919af913bb37d2db3b4079b16f1e64242 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12Support unidirection in all searchesVratko Polak4-116/+166
+ Rename bool unidirection to int traffic_directions. + Rename "untagged" to "initial" for bandwidth calculation. + Fix latency measurement for unidirectional traffic. + Remove duplicate colon in soak test message. + Edit PAL to accept both forms. + Fix minor documentation issues. Change-Id: I6c76f2dc090ae493f2fbd7e9ccd45229d2306dea Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-12CRC list: Compatible collection for 21997Vratko Polak1-0/+207
Change-Id: I749d0164e9397769fc178f20eefe88b952e295d4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-12Report: Add nfv reconfTibor Frank1-13384/+13212
Change-Id: If773f5d05c845b0d15bd8f60a44a36adcbf65b82 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12Skip CRC checking by defaultVratko Polak1-1/+1
During https://gerrit.fd.io/r/c/ci-management/+/21955 we decided this new default is more convenient for development. Change-Id: I07f10cbb586e79f6ac714ad635dda35561c07125 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-12PAL: Add NFV reconf testsTibor Frank4-13521/+13888
Change-Id: I6fe36f05423c3c43081872153adf0f1a899381b6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12Report: Temporarily remove pdf versionTibor Frank1-2/+2
Change-Id: Iab5909defc86ec31ba726eb2a1a4b6530cf7d63d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12TRex: 2.61Peter Mikus5-8/+6
- HDRhistogram can be rebased and used in separate patch. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic7ce752344c6e1791af7cf7b7effde65ac2be680
2019-09-12Topology: CascadelakePeter Mikus2-0/+12
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1533f00dd4b40f9dda82b1e9b5b15a81bbb9f7fb
2019-09-12Report: Configure 1908.38Tibor Frank2-2/+2
Change-Id: I0239e6c567c50c211ddabffa4b1bf22cdcec6462 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-11Revert "API cleanup: tap" and bump stable_vppVratko Polak2-37/+25
The VPP change got a temporary -1, as other change has higher priority. Bumping stable VPP version, so this passes verify right away. This reverts commit ae62a4348f7de53cfb91a5ae25a10723d5f9b398. Change-Id: If2813b0e41451a3a9e7f8b1512521cf508ac92c7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-11CSIT-1597 API cleanup: tapJan Gelety2-25/+37
cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21706 Change-Id: I16b3e3e29e7e7491cd19c067e8f3d8ced4947852 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-11CSIT-1597: API cleanup: bondJan Gelety2-50/+42
Change-Id: I7c2a29cfe48eee521cce5fcc3506cef39d51d37b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-11Ansible: Cascadelake includePeter Mikus13-17/+148
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iecb18e9d94ff715e40152564fb778650d43a48d3
2019-09-11Report: Remove NFV full dataTibor Frank1-2/+0
Change-Id: I51402892df91cfc5e8f2c18f18ef67bab634bcdf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-11Ansible: Trex installationPeter Mikus14-71/+94
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I5ab8fe05074a842301a511bbd3ab5e67f8d1a9f0
2019-09-11Report: Add dataTibor Frank2-3/+7
Change-Id: I2092c6420a40e1c3199183e580f00eaca37706c6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-10Report: Add pdf versionTibor Frank1-2/+2
Change-Id: I8897a6ef87b3813db0485fa081fdd44b4e501e41 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-10PAL: Add replacing of data in tablesTibor Frank5-528/+1040
+ vhost data Change-Id: I86fc97ba5c3b0feffec2dfb0ac11c5d3c9d53a81 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-10Refactor getting telemetryPeter Mikus11-285/+345
+ Ability to get stats from CNF via SocketPAPI - Remove obsolete functions Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I4d1b32a7279244592be96644e4f8a530c4f29a15
2019-09-04FIX: correct crc for sw_interface_slave_detailsJan Gelety1-1/+1
Change-Id: I4baae7da6f8fef8bd65f08e28fa1b55fb81857ce Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-04API cleanup: memifJan Gelety2-10/+13
Change-Id: I4a2d4719dfa7c993c54b278a0093ea833307bb87 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-09Update of VPP_STABLE_VER filesJan Gelety1-210/+2
- use new vpp ref build - ubuntu 16.04: 20.01-rc0~159-gb736e75~b7951 - use new vpp ref build - ubuntu 18.04: 20.01-rc0~159-gb736e75d5 - use new vpp ref build - centos7: 20.01-rc0~159_gb736e75~b7759 Change-Id: I4def341aad97cb039c11ec45be2846d0fb691435 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-09Report: Add dnv mrr dataTibor Frank1-2/+158
Change-Id: I3dcc813dce7b8938be6b2caaaf1e64ce9abb7fe9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-09Report: Fix tsh and dnv plotsTibor Frank1-317/+317
Change-Id: I1d40849bc15f4433117af91f71e951a61924d732 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-09Report: Add soak testsTibor Frank1-108/+107
Change-Id: I2161c8d8e54cfa35cd3febdda1cb47d6cec424a0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-06Support new sw_interface_slave_details CRCVratko Polak1-0/+208
Change-Id: I2f72a741ac7353ad36f6a2dada26eabb1a76cb2e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-06Read environment variables in Constants.pyVratko Polak8-81/+133
Instead of using EnsureGlobalVariable, which is clunky to use from Python. As a consequence, all caps variables from Constants.py are used directly and tests/__init__.robot and robot_enhancements.robot are deleted. + Rename the CRC global kill switch based on ci-man review. Change-Id: I10723792475bc83352bf8c3b7f7946ecf885a194 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-06Report: Add 3n-dnv plots and tablesTibor Frank1-40/+587
Change-Id: I6b65231f928b6168e0696f35fc253ce513163e50 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-05Report: Add 2n-dnv plots and tablesTibor Frank1-19/+304
Change-Id: Ibbd1775bec26817a4c193bc67ba03b29b8ddfff7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-05Report: Add DNV dataTibor Frank3-327/+295
Change-Id: I020373b1553300459654ded31d940b0a5562eb8a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-05Allow CRC checking to be controlled via env varVratko Polak1-2/+15
The plan is to override the default in some (but not all) jobs. The csit-vpp jobs shall do the checking, but vpp-csit jobs shall not (except api-crc job of course) in order to confirm benign changes. Change-Id: If59d17991de3fb0e847113a87e0533a8ee62af7f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-05Report: Fix listing order of new vs. see footnoteTibor Frank1-8/+56
Change-Id: I01426c3e4d40af0902e7776088e0489e141a2362 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-05Report: Fix hsw vs. skx comparison tableTibor Frank1-9/+9
Change-Id: Id16b161ad27102891a58d084185d17a2b8fcae6a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-05Report: Configure Report 1908.37Tibor Frank2-2/+4
Change-Id: I1d883dbb299ecef151c7d7a9c5612ae0330e3538 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-05FIX: Use vhost macs when testpmd_mac forwarding used in VMJan Gelety3-13/+71
Change-Id: I291c3dc852e7c1bde6fb6102a9168cfec9992682 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-04Clarify why 9000B tests are skipped for IPsecVratko Polak1-1/+2
Ticket: VPP-1207 Change-Id: I506b4a24dfa6b10578407b261926f37215a714f4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-04Hotfix: Bump version and CRCsVratko Polak1-7/+7
Naginator caused a false Verified+1, so a benign API change had been merged prematurely. Change-Id: I8852ca684cba4876d46049ca34204ebbccf96b2e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-04docs: added 3n-tsh testbed tests to report_test_groups.txtMaciek Konstantynowicz1-6/+42
Change-Id: Ib2249ce6c28f4c07878eb5fc2919c56dd8637376 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-09-04Report: ixgbe for tshTibor Frank1-313/+313
Change-Id: I707a654b8853926f4cb1b78f3c65b55925e95ac1 Signed-off-by: Tibor Frank <tifrank@cisco.com>