aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-10-14Ansible: Mellanox installPeter Mikus8-105/+152
+ OFED + ibdev2netdev - aligning few naming conventions Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I0dff28b2cd4bbc4753597366d9b03b497fa336c4
2019-10-11Add: Parsing of show run over PAPIPeter Mikus1-53/+71
+ Add parsing of show run over PAPI STATS + Add missing outputs vs show run over CLI Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I88555ff4266d41ae1d9436181aad5c324ea9dab4
2019-10-11Trending: Reorganization of tests in graphsTibor Frank1-0/+951
Change-Id: I41ddcb65d099294c5ae510b2a5f237de973e27b7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-11Trending: Generate email body for regressions and progressionsTibor Frank3-16/+52
Change-Id: Iee652fc48b574b7866d5e7f0b7b927f96de3d25f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-09Update of VPP_STABLE_VER filesJan Gelety4-240/+5
- use new vpp ref build - ubuntu 16.04: 20.01-rc0~375-g3ae9f5a~b8172 - use new vpp ref build - ubuntu 18.04: 20.01-rc0~375-g3ae9f5a90 - use new vpp ref build - centos7: 20.01-rc0~375_g3ae9f5a~b7986 Change-Id: I16cf7e9db8f5b6c4f94786b089a1686c823cc1bd Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-09FIX: AnsiblePeter Mikus3-9/+9
+ Cover all CSIT devices with netplan to prevent DHCP usage + Move netplan to common role Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic3790f8ff770edf64b4066f8ddb99454643f5846
2019-10-09Add vpp loadbalancer maglev mode test suitehaiyanX1.zhang8-0/+514
Change-Id: I61555ba566efef0a2151db9a30bf7f5d9ccad1df Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>
2019-10-09FIX: Add SRIOV cleanupPeter Mikus1-3/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I344cbab78e1491b1dc0b64598f1eae23c8d2cdcf
2019-10-07Trending: Send alerts when regression occursTibor Frank3-30/+53
Change-Id: I45d218ea323245199ad5093bd64c6a9bd862cad9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-07FIX: LXC tmpfs mountPeter Mikus1-5/+11
- Should fix the read/write to socket for LXC Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I56a84145cf2fb95742423789681ca2e24ddf0c98
2019-10-04FIX: put back the correct value of FAIL_ON_CRC_MISMATCH constantJan Gelety1-2/+1
Change-Id: Ia395cfbc5325d292bf8c32bb24e9a1478c140780 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-04Update of VPP_STABLE_VER filesJan Gelety5-4/+9
- use new vpp ref build - ubuntu 16.04: 20.01-rc0~324-g66a332c~b8122 - use new vpp ref build - ubuntu 18.04: 20.01-rc0~324-g66a332cf1 - use new vpp ref build - centos7: 20.01-rc0~324_g66a332c~b7936 Change-Id: I82c6032742939417914f5210b1fba4464ab1e70d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-07Report: Set the backgroud of graphsTibor Frank1-0/+12
Change-Id: Icd5f2ed496128b4cdc5f1113c778f66bbef5def3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-04FIX: Add SRIOV cleanupPeter Mikus1-11/+19
If Jenkins interrupt pybot during AVF tests (that is happening more frequently as coverage increased) the interfaces remains in link UP state. Next run VPP cannot grab interfaces as they are in UP state in and kernel driver. This results in testcase failing. Patch is supposed to do put interfaces in topology down so VPP can bind them back to vfio-pci. Change-Id: I2aa9e5944d39474965eac3c5f1b472f58e9aa8b5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-10-04FIX: use int of sw_if_index in call of sw_interface_set_flags apiJan Gelety1-1/+1
- it will avoid situation that corresponding port is not up and its sw_if_index value in topology file is None that is interpreted as 0 in vpp api so it set flag for local0 interface Change-Id: I9145077d787ddde50a29bcd4091035e95077f946 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-04FIX: IPv6 AVF dot1qPeter Mikus2-2/+4
Change-Id: Id199eb774850153fb225434d4a3d194706fdfdb3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-10-03Trending: Report also nr of passed tests in emailTibor Frank3-128/+172
Change-Id: I7ae188f5f684bd93352255d6b5c491b6d78c822c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-03PAL: Set plot.ly version to 4.1.1Tibor Frank3-16/+21
Change-Id: I137ee807a2802fa1f7b5b635e1162bf7fff07a57 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-02PAL: Accept reconf time in scientific notationVratko Polak1-5/+5
+ Otherwise "9.58828205237e-05" is understood as "9.58828205237". + Replace "[0-9]" with "\d". Change-Id: I7ecf6d0116fe704ecdba46f3a0e7975aba79aa62 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-01sw_interface_details api updatedJan Gelety1-0/+226
- based on pending vpp api change: https://gerrit.fd.io/r/c/vpp/+/21490 Change-Id: I7d7425e8db3bf60ea3d9d7936ed3109c76247457 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-26CSIT-1471: Policer - VAT API to PAPIpremkumarv26-871/+444
Change-Id: I6c7eff8d9cbb196ccb684a45579ac59942351cfe Signed-off-by: premkumarv <preym17@gmail.com>
2019-09-27Update flag day documentVratko Polak1-16/+81
Prevent false -1 from api-crc job. Add more details on CSIT side of things. Minimize the breakage of trending jobs. Also: Add motivation section explaining why earlier solutions are not good enough. - Needs more polishing. - VPP/CSIT, Committer/Developer can be defined in a separate section. - VPP/CSIT trending and verify jobs can be defined in a separate section. - The main process section should list only steps. - Comments on which jobs are broken/fixed can be moved to a separate section. - Name phases, so progress can be described better than "step 9". - Emphasize that only one API change can be in the process. All other changes need to be rebased (to clear any previous +1) before next cycle starts. Change-Id: Ie64a20db3f4abad3c8cddbf13705ff006e5a6382 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-27Proposal to automate VPP-API "Flag Day"Dave Wallace1-0/+224
Change-Id: I7bfce00762017b1aa8fd91ce1c8e4c0b810ee7b7 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2019-09-27Report: Fix: Legend in reconf testsTibor Frank1-1/+1
Change-Id: I04806de7bf02af6c9b2119c45e75f8e0bc88bdd7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-26Report: Reconf tests: set autorange for y axisTibor Frank1-11/+1
Change-Id: Ie1ba26d3d76a8905698d0be33e9c5e61daff0e48 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-24Add support for HDRhistogramVratko Polak5-151/+65
+ Enable hdrh in trex server. + Append hdrh coded output after min/avg/max/. + Read (not show nor decode) hdrh value in PAL. + Also, remove old ndrpdrdisc code. Change-Id: I99d99f10386a621772b5419ca1f36080fa15aca7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-24Reconf tests: Fix async measurementsVratko Polak4-18/+78
TRex does not zero the server counters. It copies the values to use as reference, and subtracts them when asked for results. But the reference is stored in the client (not the server). And CSIT uses different scripts to start and stop async traffic, which means different clients. This patch introduces a workaround. Async start will return xstats objects to use as reference, and async stop will use the objects to compute the correct results. The xstats objects are stored in TrafficGenerator instance. Sync measurement does not export the counters, to shorten logs. Other improvements: + Make stop_traffic_on_tg return measurement results directly. + Rename --async to --async_start as "async" is reserved in Python 3.7 + Minor pylint, docstring and typo fixes. Change-Id: I5fc56a0763afb7d62cfa7c0651f96b6867de3e15 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-23PAL: Fix unit for packets lostVratko Polak2-6/+5
+ update the static content Change-Id: I8c4852195e09d7b00555ebb4a7378743c3df45f2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-21Fixing typo tag_documentation for LISPNidhy1-1/+1
Change-Id: Idd715cb0d3e6b60c660b95ac618e8e114419491b Signed-off-by: Nidhy <nidhyanandhan.a@hcl.com>
2019-09-20Bump stable_vpp and fix CRC listVratko Polak4-228/+7
+ Two API merges happened on VPP side, CSIT list was prepared wrong. + Removed the secondary collection, as no open change is supported. Change-Id: I2e2472c8a2fe50190c11c7441982aa2881e9b8a5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-19LISP: 3-node (func) to 2-node (dev) converstionNidhy20-584/+858
Change-Id: I0fbe4d9ef1b30a1ac1382ea43b5b52aeb8a7d39f Signed-off-by: Nidhy <nidhyanandhan.a@hcl.com>
2019-09-19CSIT-1597 API cleanup: copJan Gelety2-44/+35
cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21458 Change-Id: I596cfcd192bf48b0d0a91b1953746a484e2c9793 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-18Report: Fix formating of static content for reconf testsTibor Frank1-9/+9
Change-Id: I5b93749b13af870955c1cf9eb8053c446356c329 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-18Fix errors found by pylintVratko Polak2-7/+6
Change-Id: I0c2bee5a1ff8ad29e47c4f947388e7b97dd17fff Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-18Report: Add disclaimer for reconf testsTibor Frank8-9/+44
+ Improve description for reconf tests Change-Id: Ib1f397eda88a6c1db79b7a3a518584420770fd5c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-17Report: Enable pdf versionTibor Frank1-2/+2
Change-Id: I2c88a8b5939cbe4498d5bc44de3618cb717a9a7f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-17Update CRC list and support 21997/7Vratko Polak6-138/+187
- Attempt to repair IPsec LispGpe perf suite. + Collection name to reflect the current stable vpp. + Add messages found in CSIT L1 keywords. - Uncommented (instead of deleted) untestable messages. Reasons: - Honeycomb. - Messages used by unused keywords. + Listed reasons. Honeycomb not mentioned if both reasons apply. + Delete CRC items for commands not found in keywords anymore. + Add CRCs from .json.api files (as teardown is hard to execute). + Define and restore alphabetical order. + Add hints to find used API commands (not entirely reliable). + Move used commands to "cmd = " form so hints find them. + Argument to run_cli_command changed from "cmd" to "cli_cmd". + Except also struct.error where IOError is excepted. Change-Id: I61058dbe1e33296908aabd0c13433bb16cfa6adf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-17Report: Fix Report HistoryTibor Frank1-1/+1
Change-Id: I654677ca9252e592e635eab28577bb3bb3b8bf85 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-17Report: Update Report HistoryTibor Frank1-0/+2
Change-Id: Ie16a2f2298eeaf0793171c7268a95abb6986246a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-16Report: Add methodology for reconf testsVratko Polak3-1/+79
Change-Id: I833d63f4e305ba60c94aa16cbb3a31a52ee3b3bb Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-16Trending: Fix removing of old input filesTibor Frank1-18/+0
Change-Id: I67ff7944a1eb576bd6e739202a94eb12be9e0e1b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-16Trending: Reduce input dataTibor Frank2-70/+107
Change-Id: I6b3bdac6941d85792987e2bc7e75cb8bc0be4f4a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-15Report: Add dataTibor Frank2-0/+10
Change-Id: Ibef7599c5438624512d547af25b2026580e2bc92 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-13Add: AVF IPv6Peter Mikus18-22/+1326
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I6cb4ef356047bdc341a70a4e7b8d0b3f54eb7f9d
2019-09-13FIX: Pylint + Container mountPeter Mikus3-11/+15
- Mount is affecting only LXC container Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I84140ea5e48120792fc84182a97eb7d06c954a84
2019-09-13Report: FixesTibor Frank11-70/+70
Change-Id: Id14704f3c1526655adeaa51f0a4198b6309a64eb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-13CRC checker: Sort and indent dict outputVratko Polak1-15/+18
Also, use double quotes, so the dict is shown not only as a valid Python code, but also a valid JSON. This should make it easier to handle big CRC changes such as: https://logs.fd.io/production/vex-yul-rot-jenkins-1 /vpp-csit-verify-api-crc-master/646/console.log.gz + Log indented message about CRC conflict to console even on failure, as in the exception, endlines are escaped. Change-Id: If4fe3003f612d4b0c156004a0aa2dab088e50723 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-13Report: Add dataTibor Frank5-353/+464
Change-Id: I589a236919af913bb37d2db3b4079b16f1e64242 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12Support unidirection in all searchesVratko Polak4-116/+166
+ Rename bool unidirection to int traffic_directions. + Rename "untagged" to "initial" for bandwidth calculation. + Fix latency measurement for unidirectional traffic. + Remove duplicate colon in soak test message. + Edit PAL to accept both forms. + Fix minor documentation issues. Change-Id: I6c76f2dc090ae493f2fbd7e9ccd45229d2306dea Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-12CRC list: Compatible collection for 21997Vratko Polak1-0/+207
Change-Id: I749d0164e9397769fc178f20eefe88b952e295d4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>