aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-09-19CSIT-1597 API cleanup: copJan Gelety2-44/+35
cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21458 Change-Id: I596cfcd192bf48b0d0a91b1953746a484e2c9793 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-18Report: Fix formating of static content for reconf testsTibor Frank1-9/+9
Change-Id: I5b93749b13af870955c1cf9eb8053c446356c329 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-18Fix errors found by pylintVratko Polak2-7/+6
Change-Id: I0c2bee5a1ff8ad29e47c4f947388e7b97dd17fff Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-18Report: Add disclaimer for reconf testsTibor Frank8-9/+44
+ Improve description for reconf tests Change-Id: Ib1f397eda88a6c1db79b7a3a518584420770fd5c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-17Report: Enable pdf versionTibor Frank1-2/+2
Change-Id: I2c88a8b5939cbe4498d5bc44de3618cb717a9a7f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-17Update CRC list and support 21997/7Vratko Polak6-138/+187
- Attempt to repair IPsec LispGpe perf suite. + Collection name to reflect the current stable vpp. + Add messages found in CSIT L1 keywords. - Uncommented (instead of deleted) untestable messages. Reasons: - Honeycomb. - Messages used by unused keywords. + Listed reasons. Honeycomb not mentioned if both reasons apply. + Delete CRC items for commands not found in keywords anymore. + Add CRCs from .json.api files (as teardown is hard to execute). + Define and restore alphabetical order. + Add hints to find used API commands (not entirely reliable). + Move used commands to "cmd = " form so hints find them. + Argument to run_cli_command changed from "cmd" to "cli_cmd". + Except also struct.error where IOError is excepted. Change-Id: I61058dbe1e33296908aabd0c13433bb16cfa6adf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-17Report: Fix Report HistoryTibor Frank1-1/+1
Change-Id: I654677ca9252e592e635eab28577bb3bb3b8bf85 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-17Report: Update Report HistoryTibor Frank1-0/+2
Change-Id: Ie16a2f2298eeaf0793171c7268a95abb6986246a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-16Report: Add methodology for reconf testsVratko Polak3-1/+79
Change-Id: I833d63f4e305ba60c94aa16cbb3a31a52ee3b3bb Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-16Trending: Fix removing of old input filesTibor Frank1-18/+0
Change-Id: I67ff7944a1eb576bd6e739202a94eb12be9e0e1b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-16Trending: Reduce input dataTibor Frank2-70/+107
Change-Id: I6b3bdac6941d85792987e2bc7e75cb8bc0be4f4a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-15Report: Add dataTibor Frank2-0/+10
Change-Id: Ibef7599c5438624512d547af25b2026580e2bc92 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-13Add: AVF IPv6Peter Mikus18-22/+1326
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I6cb4ef356047bdc341a70a4e7b8d0b3f54eb7f9d
2019-09-13FIX: Pylint + Container mountPeter Mikus3-11/+15
- Mount is affecting only LXC container Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I84140ea5e48120792fc84182a97eb7d06c954a84
2019-09-13Report: FixesTibor Frank11-70/+70
Change-Id: Id14704f3c1526655adeaa51f0a4198b6309a64eb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-13CRC checker: Sort and indent dict outputVratko Polak1-15/+18
Also, use double quotes, so the dict is shown not only as a valid Python code, but also a valid JSON. This should make it easier to handle big CRC changes such as: https://logs.fd.io/production/vex-yul-rot-jenkins-1 /vpp-csit-verify-api-crc-master/646/console.log.gz + Log indented message about CRC conflict to console even on failure, as in the exception, endlines are escaped. Change-Id: If4fe3003f612d4b0c156004a0aa2dab088e50723 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-13Report: Add dataTibor Frank5-353/+464
Change-Id: I589a236919af913bb37d2db3b4079b16f1e64242 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12Support unidirection in all searchesVratko Polak4-116/+166
+ Rename bool unidirection to int traffic_directions. + Rename "untagged" to "initial" for bandwidth calculation. + Fix latency measurement for unidirectional traffic. + Remove duplicate colon in soak test message. + Edit PAL to accept both forms. + Fix minor documentation issues. Change-Id: I6c76f2dc090ae493f2fbd7e9ccd45229d2306dea Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-12CRC list: Compatible collection for 21997Vratko Polak1-0/+207
Change-Id: I749d0164e9397769fc178f20eefe88b952e295d4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-12Report: Add nfv reconfTibor Frank1-13384/+13212
Change-Id: If773f5d05c845b0d15bd8f60a44a36adcbf65b82 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12Skip CRC checking by defaultVratko Polak1-1/+1
During https://gerrit.fd.io/r/c/ci-management/+/21955 we decided this new default is more convenient for development. Change-Id: I07f10cbb586e79f6ac714ad635dda35561c07125 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-12PAL: Add NFV reconf testsTibor Frank6-13521/+14021
Change-Id: I6fe36f05423c3c43081872153adf0f1a899381b6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12Report: Temporarily remove pdf versionTibor Frank1-2/+2
Change-Id: Iab5909defc86ec31ba726eb2a1a4b6530cf7d63d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12TRex: 2.61Peter Mikus5-8/+6
- HDRhistogram can be rebased and used in separate patch. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic7ce752344c6e1791af7cf7b7effde65ac2be680
2019-09-12Topology: CascadelakePeter Mikus5-0/+460
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1533f00dd4b40f9dda82b1e9b5b15a81bbb9f7fb
2019-09-12Report: Configure 1908.38Tibor Frank3-2/+5
Change-Id: I0239e6c567c50c211ddabffa4b1bf22cdcec6462 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-11Revert "API cleanup: tap" and bump stable_vppVratko Polak5-40/+28
The VPP change got a temporary -1, as other change has higher priority. Bumping stable VPP version, so this passes verify right away. This reverts commit ae62a4348f7de53cfb91a5ae25a10723d5f9b398. Change-Id: If2813b0e41451a3a9e7f8b1512521cf508ac92c7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-11CSIT-1597 API cleanup: tapJan Gelety2-25/+37
cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21706 Change-Id: I16b3e3e29e7e7491cd19c067e8f3d8ced4947852 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-11CSIT-1597: API cleanup: bondJan Gelety2-50/+42
Change-Id: I7c2a29cfe48eee521cce5fcc3506cef39d51d37b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-11Ansible: Cascadelake includePeter Mikus18-227/+1901
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iecb18e9d94ff715e40152564fb778650d43a48d3
2019-09-11Report: Remove NFV full dataTibor Frank1-2/+0
Change-Id: I51402892df91cfc5e8f2c18f18ef67bab634bcdf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-11Ansible: Trex installationPeter Mikus14-71/+94
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I5ab8fe05074a842301a511bbd3ab5e67f8d1a9f0
2019-09-11Report: Add dataTibor Frank2-3/+7
Change-Id: I2092c6420a40e1c3199183e580f00eaca37706c6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-10Report: Add pdf versionTibor Frank1-2/+2
Change-Id: I8897a6ef87b3813db0485fa081fdd44b4e501e41 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-10PAL: Add replacing of data in tablesTibor Frank20-606/+2039
+ vhost data Change-Id: I86fc97ba5c3b0feffec2dfb0ac11c5d3c9d53a81 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-10Refactor getting telemetryPeter Mikus11-285/+345
+ Ability to get stats from CNF via SocketPAPI - Remove obsolete functions Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I4d1b32a7279244592be96644e4f8a530c4f29a15
2019-09-04Update of VPP_STABLE_VER filesJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 20.01-rc0~163-g546f955~b7955 - use new vpp ref build - ubuntu 18.04: 20.01-rc0~163-g546f955b3 - use new vpp ref build - centos7: 20.01-rc0~163_g546f955~b7763 Change-Id: I69ed9d37d2786de923c93d1de8d78e0a5e248954 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-04FIX: correct crc for sw_interface_slave_detailsJan Gelety1-1/+1
Change-Id: I4baae7da6f8fef8bd65f08e28fa1b55fb81857ce Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-09Report: Report historyTibor Frank1-7/+4
Change-Id: Ib74a10ccd589111dd3c830adec9293ff2c698772 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-04API cleanup: memifJan Gelety2-10/+13
Change-Id: I4a2d4719dfa7c993c54b278a0093ea833307bb87 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-09Update of VPP_STABLE_VER filesJan Gelety4-213/+5
- use new vpp ref build - ubuntu 16.04: 20.01-rc0~159-gb736e75~b7951 - use new vpp ref build - ubuntu 18.04: 20.01-rc0~159-gb736e75d5 - use new vpp ref build - centos7: 20.01-rc0~159_gb736e75~b7759 Change-Id: I4def341aad97cb039c11ec45be2846d0fb691435 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-09Report: Add dnv mrr dataTibor Frank7-2/+210
Change-Id: I3dcc813dce7b8938be6b2caaaf1e64ce9abb7fe9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-09Report: Fix tsh and dnv plotsTibor Frank3-318/+320
Change-Id: I1d40849bc15f4433117af91f71e951a61924d732 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-09Report: Add soak testsTibor Frank4-114/+110
Change-Id: I2161c8d8e54cfa35cd3febdda1cb47d6cec424a0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-06Report: Fix2 - Add 3n-dnv plots and tablesTibor Frank3-0/+3
Change-Id: Ia182e6e52a37f9b3248eab60ffe4dd4746ed7fa6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-03docs: add select list of tests for report - tsh and dnvJan Gelety3-0/+191
Change-Id: I63a69d998c80029422bae9f90e186eb2286196d1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-06Support new sw_interface_slave_details CRCVratko Polak1-0/+208
Change-Id: I2f72a741ac7353ad36f6a2dada26eabb1a76cb2e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-06Read environment variables in Constants.pyVratko Polak9-121/+133
Instead of using EnsureGlobalVariable, which is clunky to use from Python. As a consequence, all caps variables from Constants.py are used directly and tests/__init__.robot and robot_enhancements.robot are deleted. + Rename the CRC global kill switch based on ci-man review. Change-Id: I10723792475bc83352bf8c3b7f7946ecf885a194 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-06Report: Fix - Add 3n-dnv plots and tablesTibor Frank4-3/+36
Change-Id: I5f09f1f20e532e71d6abde02111a90f5868035f3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-06Report: Add 3n-dnv plots and tablesTibor Frank25-40/+1969
Change-Id: I6b65231f928b6168e0696f35fc253ce513163e50 Signed-off-by: Tibor Frank <tifrank@cisco.com>