aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-09-27Update flag day documentVratko Polak1-16/+81
Prevent false -1 from api-crc job. Add more details on CSIT side of things. Minimize the breakage of trending jobs. Also: Add motivation section explaining why earlier solutions are not good enough. - Needs more polishing. - VPP/CSIT, Committer/Developer can be defined in a separate section. - VPP/CSIT trending and verify jobs can be defined in a separate section. - The main process section should list only steps. - Comments on which jobs are broken/fixed can be moved to a separate section. - Name phases, so progress can be described better than "step 9". - Emphasize that only one API change can be in the process. All other changes need to be rebased (to clear any previous +1) before next cycle starts. Change-Id: Ie64a20db3f4abad3c8cddbf13705ff006e5a6382 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-27Proposal to automate VPP-API "Flag Day"Dave Wallace1-0/+224
Change-Id: I7bfce00762017b1aa8fd91ce1c8e4c0b810ee7b7 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2019-09-27Report: Fix: Legend in reconf testsTibor Frank1-1/+1
Change-Id: I04806de7bf02af6c9b2119c45e75f8e0bc88bdd7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-26Report: Reconf tests: set autorange for y axisTibor Frank1-11/+1
Change-Id: Ie1ba26d3d76a8905698d0be33e9c5e61daff0e48 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-24Add support for HDRhistogramVratko Polak5-151/+65
+ Enable hdrh in trex server. + Append hdrh coded output after min/avg/max/. + Read (not show nor decode) hdrh value in PAL. + Also, remove old ndrpdrdisc code. Change-Id: I99d99f10386a621772b5419ca1f36080fa15aca7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-24Reconf tests: Fix async measurementsVratko Polak4-18/+78
TRex does not zero the server counters. It copies the values to use as reference, and subtracts them when asked for results. But the reference is stored in the client (not the server). And CSIT uses different scripts to start and stop async traffic, which means different clients. This patch introduces a workaround. Async start will return xstats objects to use as reference, and async stop will use the objects to compute the correct results. The xstats objects are stored in TrafficGenerator instance. Sync measurement does not export the counters, to shorten logs. Other improvements: + Make stop_traffic_on_tg return measurement results directly. + Rename --async to --async_start as "async" is reserved in Python 3.7 + Minor pylint, docstring and typo fixes. Change-Id: I5fc56a0763afb7d62cfa7c0651f96b6867de3e15 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-23PAL: Fix unit for packets lostVratko Polak2-6/+5
+ update the static content Change-Id: I8c4852195e09d7b00555ebb4a7378743c3df45f2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-21Fixing typo tag_documentation for LISPNidhy1-1/+1
Change-Id: Idd715cb0d3e6b60c660b95ac618e8e114419491b Signed-off-by: Nidhy <nidhyanandhan.a@hcl.com>
2019-09-20Bump stable_vpp and fix CRC listVratko Polak4-228/+7
+ Two API merges happened on VPP side, CSIT list was prepared wrong. + Removed the secondary collection, as no open change is supported. Change-Id: I2e2472c8a2fe50190c11c7441982aa2881e9b8a5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-19LISP: 3-node (func) to 2-node (dev) converstionNidhy20-584/+858
Change-Id: I0fbe4d9ef1b30a1ac1382ea43b5b52aeb8a7d39f Signed-off-by: Nidhy <nidhyanandhan.a@hcl.com>
2019-09-19CSIT-1597 API cleanup: copJan Gelety2-44/+35
cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21458 Change-Id: I596cfcd192bf48b0d0a91b1953746a484e2c9793 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-18Report: Fix formating of static content for reconf testsTibor Frank1-9/+9
Change-Id: I5b93749b13af870955c1cf9eb8053c446356c329 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-18Fix errors found by pylintVratko Polak2-7/+6
Change-Id: I0c2bee5a1ff8ad29e47c4f947388e7b97dd17fff Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-18Report: Add disclaimer for reconf testsTibor Frank8-9/+44
+ Improve description for reconf tests Change-Id: Ib1f397eda88a6c1db79b7a3a518584420770fd5c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-17Report: Enable pdf versionTibor Frank1-2/+2
Change-Id: I2c88a8b5939cbe4498d5bc44de3618cb717a9a7f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-17Update CRC list and support 21997/7Vratko Polak6-138/+187
- Attempt to repair IPsec LispGpe perf suite. + Collection name to reflect the current stable vpp. + Add messages found in CSIT L1 keywords. - Uncommented (instead of deleted) untestable messages. Reasons: - Honeycomb. - Messages used by unused keywords. + Listed reasons. Honeycomb not mentioned if both reasons apply. + Delete CRC items for commands not found in keywords anymore. + Add CRCs from .json.api files (as teardown is hard to execute). + Define and restore alphabetical order. + Add hints to find used API commands (not entirely reliable). + Move used commands to "cmd = " form so hints find them. + Argument to run_cli_command changed from "cmd" to "cli_cmd". + Except also struct.error where IOError is excepted. Change-Id: I61058dbe1e33296908aabd0c13433bb16cfa6adf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-17Report: Fix Report HistoryTibor Frank1-1/+1
Change-Id: I654677ca9252e592e635eab28577bb3bb3b8bf85 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-17Report: Update Report HistoryTibor Frank1-0/+2
Change-Id: Ie16a2f2298eeaf0793171c7268a95abb6986246a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-16Report: Add methodology for reconf testsVratko Polak3-1/+79
Change-Id: I833d63f4e305ba60c94aa16cbb3a31a52ee3b3bb Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-16Trending: Fix removing of old input filesTibor Frank1-18/+0
Change-Id: I67ff7944a1eb576bd6e739202a94eb12be9e0e1b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-16Trending: Reduce input dataTibor Frank2-70/+107
Change-Id: I6b3bdac6941d85792987e2bc7e75cb8bc0be4f4a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-15Report: Add dataTibor Frank2-0/+10
Change-Id: Ibef7599c5438624512d547af25b2026580e2bc92 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-13Add: AVF IPv6Peter Mikus18-22/+1326
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I6cb4ef356047bdc341a70a4e7b8d0b3f54eb7f9d
2019-09-13FIX: Pylint + Container mountPeter Mikus3-11/+15
- Mount is affecting only LXC container Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I84140ea5e48120792fc84182a97eb7d06c954a84
2019-09-13Report: FixesTibor Frank11-70/+70
Change-Id: Id14704f3c1526655adeaa51f0a4198b6309a64eb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-13CRC checker: Sort and indent dict outputVratko Polak1-15/+18
Also, use double quotes, so the dict is shown not only as a valid Python code, but also a valid JSON. This should make it easier to handle big CRC changes such as: https://logs.fd.io/production/vex-yul-rot-jenkins-1 /vpp-csit-verify-api-crc-master/646/console.log.gz + Log indented message about CRC conflict to console even on failure, as in the exception, endlines are escaped. Change-Id: If4fe3003f612d4b0c156004a0aa2dab088e50723 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-13Report: Add dataTibor Frank5-353/+464
Change-Id: I589a236919af913bb37d2db3b4079b16f1e64242 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12Support unidirection in all searchesVratko Polak4-116/+166
+ Rename bool unidirection to int traffic_directions. + Rename "untagged" to "initial" for bandwidth calculation. + Fix latency measurement for unidirectional traffic. + Remove duplicate colon in soak test message. + Edit PAL to accept both forms. + Fix minor documentation issues. Change-Id: I6c76f2dc090ae493f2fbd7e9ccd45229d2306dea Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-12CRC list: Compatible collection for 21997Vratko Polak1-0/+207
Change-Id: I749d0164e9397769fc178f20eefe88b952e295d4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-12Report: Add nfv reconfTibor Frank1-13384/+13212
Change-Id: If773f5d05c845b0d15bd8f60a44a36adcbf65b82 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12Skip CRC checking by defaultVratko Polak1-1/+1
During https://gerrit.fd.io/r/c/ci-management/+/21955 we decided this new default is more convenient for development. Change-Id: I07f10cbb586e79f6ac714ad635dda35561c07125 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-12PAL: Add NFV reconf testsTibor Frank6-13521/+14021
Change-Id: I6fe36f05423c3c43081872153adf0f1a899381b6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12Report: Temporarily remove pdf versionTibor Frank1-2/+2
Change-Id: Iab5909defc86ec31ba726eb2a1a4b6530cf7d63d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12TRex: 2.61Peter Mikus5-8/+6
- HDRhistogram can be rebased and used in separate patch. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic7ce752344c6e1791af7cf7b7effde65ac2be680
2019-09-12Topology: CascadelakePeter Mikus5-0/+460
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1533f00dd4b40f9dda82b1e9b5b15a81bbb9f7fb
2019-09-12Report: Configure 1908.38Tibor Frank3-2/+5
Change-Id: I0239e6c567c50c211ddabffa4b1bf22cdcec6462 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-11Revert "API cleanup: tap" and bump stable_vppVratko Polak5-40/+28
The VPP change got a temporary -1, as other change has higher priority. Bumping stable VPP version, so this passes verify right away. This reverts commit ae62a4348f7de53cfb91a5ae25a10723d5f9b398. Change-Id: If2813b0e41451a3a9e7f8b1512521cf508ac92c7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-11CSIT-1597 API cleanup: tapJan Gelety2-25/+37
cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21706 Change-Id: I16b3e3e29e7e7491cd19c067e8f3d8ced4947852 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-11CSIT-1597: API cleanup: bondJan Gelety2-50/+42
Change-Id: I7c2a29cfe48eee521cce5fcc3506cef39d51d37b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-11Ansible: Cascadelake includePeter Mikus18-227/+1901
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iecb18e9d94ff715e40152564fb778650d43a48d3
2019-09-11Report: Remove NFV full dataTibor Frank1-2/+0
Change-Id: I51402892df91cfc5e8f2c18f18ef67bab634bcdf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-11Ansible: Trex installationPeter Mikus14-71/+94
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I5ab8fe05074a842301a511bbd3ab5e67f8d1a9f0
2019-09-11Report: Add dataTibor Frank2-3/+7
Change-Id: I2092c6420a40e1c3199183e580f00eaca37706c6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-10Report: Add pdf versionTibor Frank1-2/+2
Change-Id: I8897a6ef87b3813db0485fa081fdd44b4e501e41 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-10PAL: Add replacing of data in tablesTibor Frank20-606/+2039
+ vhost data Change-Id: I86fc97ba5c3b0feffec2dfb0ac11c5d3c9d53a81 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-10Refactor getting telemetryPeter Mikus11-285/+345
+ Ability to get stats from CNF via SocketPAPI - Remove obsolete functions Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I4d1b32a7279244592be96644e4f8a530c4f29a15
2019-09-04Update of VPP_STABLE_VER filesJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 20.01-rc0~163-g546f955~b7955 - use new vpp ref build - ubuntu 18.04: 20.01-rc0~163-g546f955b3 - use new vpp ref build - centos7: 20.01-rc0~163_g546f955~b7763 Change-Id: I69ed9d37d2786de923c93d1de8d78e0a5e248954 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-04FIX: correct crc for sw_interface_slave_detailsJan Gelety1-1/+1
Change-Id: I4baae7da6f8fef8bd65f08e28fa1b55fb81857ce Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-09Report: Report historyTibor Frank1-7/+4
Change-Id: Ib74a10ccd589111dd3c830adec9293ff2c698772 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-04API cleanup: memifJan Gelety2-10/+13
Change-Id: I4a2d4719dfa7c993c54b278a0093ea833307bb87 Signed-off-by: Jan Gelety <jgelety@cisco.com>