aboutsummaryrefslogtreecommitdiffstats
path: root/resources/api
AgeCommit message (Collapse)AuthorFilesLines
2020-02-10FIX: set host physical interface mac address to rdma interfaceJan Gelety1-0/+2
Reason is that the traffic generator is initialized with MAC addresses of physical interfaces in the suite setup while rdma interfaces are created later. Change-Id: I2cf182cde20f14778624740a1f0467096c336306 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-01-31Update CRC commentsVratko Polak1-15/+18
+ Link to current stable build. + Remove policer comment (as it is already a devicetest). + Add nsim comment. + Include perftest tag pattern to run a drv-avf test. + Switch from 2n-skx to 2n-clx to test also rdma-core driver. + Add tag for vfio-pci driver for the rest of tag expressions. Change-Id: Id2f2ee0525e27437166431045a174b3097dff52b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-30perf: Add hoststack NSIM+LDPRELOAD+IPERF3 test suiteDave Wallace1-0/+4
Change-Id: Ia7a876b1aa240676e1f2d23618c1d4e09ead14f0 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-01-14Update comments in crc file.Vratko Polak1-5/+4
+ L2patch is already covered. + RDMA is not device testable yet. Change-Id: I1dcccfcb340a8fe61c20d3516340e26db293cfaa Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-13CSIT-1597 API cleanup: rdmaJan Gelety1-241/+4
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/24225 - update vpp stable to version 20.01-rc0~1011 Change-Id: Ibbfdbe867cf89715619efc5c5507859983025ece Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-01-08API: Add collection for 24225/3Jan Gelety1-8/+8
Change-Id: I5c4593d05dbcb4d918611dc7520432a446dbf664 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-12API: Add collection for 22970/5Jan Gelety1-0/+237
Change-Id: If865526d833a267eba85e6ae4107e4d0da0dfd0b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-12CSIT-1597, CSIT-1647 API cleanup: gbpJan Gelety1-241/+4
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/23835 - update vpp stable to version 20.01-rc0~843 Change-Id: Idb1299cbbba578c09542c23858fb1fc55d090f26 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-12API: Add collection for 23835/1Jan Gelety1-12/+12
- update vpp stable to version 20.01-rc0~841 Change-Id: I05fc3878a606852c8348b61b40d8000411709d33 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-01API: Add collection for 23830/1Jan Gelety1-6/+6
- update vpp stable to version 20.01-rc0~839 Change-Id: Ic79bccf7cce384f5058218398bbef16cf1c9d40c Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-01API: Add collection for 23829/1Jan Gelety1-0/+237
Change-Id: I4b2a7bda48fba3050a35966f7a86c8dc7ba62d36 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-01CSIT-1597 API cleanup: vhostJan Gelety1-241/+2
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/22277 - update vpp stable to version 20.01-rc0~831 Change-Id: Icb3801d6a7bc738cf48bc5ecbb0767f115dde964 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-01API: Add collection for 22277/5Jan Gelety1-0/+239
Change-Id: Icd82e53ba5836302b036dbe41070d11b2ea4d401 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-11CSIT-1597 API cleanup: tapJan Gelety1-241/+4
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21706 - cover API cahnges in VPP: https://gerrit.fd.io/r/c/vpp/+/23887 - update vpp stable to version 20.01-rc0~828 Change-Id: I70d88741a02729421d4b31010910138838811518 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-11-30API: Add collection for 23887/2Jan Gelety1-6/+6
Change-Id: I3c2124aebbab8cac12a7fa661e75b68b70286240 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-10API: Add collection for 21706/17Jan Gelety1-0/+237
Change-Id: Ia4b278a48130426423f33a7cec1e586e8e552a00 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-10CSIT-1597 API cleanup: classifyJan Gelety1-241/+4
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21551 - move vpp stable build to 20.01-rc0~821 - tap tests tagged 'EXPECTED_FAILING' until necessary vpp api change https://gerrit.fd.io/r/c/vpp/+/21706 and csit code is adapted Change-Id: If4b9b7b5bc207612d08aa8aa4469a5361e058fc3 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-11-29API: Add collection for 21551/27Jan Gelety1-2/+2
Change-Id: Id4b97a28013741d08d2293714e7d1a9034b0ceed Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-11-14CRC: Update comments after lb-nat4 testsVratko Polak1-9/+5
Change-Id: I5530421ab8b4dd6404d9a7d1939a890b408c0df9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-31Regularize spaces in crc listVratko Polak1-12/+12
Two spaces before hash if after quote, single space otherwise (or 4 spaces if the hash is commenting out the whole line). Change-Id: Icee85996a00e4e31ce61ad5030f4cdbedeacd506 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-31Copy missing lines to second CRC collectionVratko Polak1-0/+4
Change-Id: If8fa609bf0c58ad0cc63a8320f298c026f8b7900 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-29API: Add collection for 21551/12Jan Gelety1-0/+235
Change-Id: Ia1232a71378f925110741ad9f914d8c5abd6941e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-25ADD: Mellanox RDMA interface supportPeter Mikus1-0/+2
+ Add functions for creating rdma interface + Fix traffic generator Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I81787b72ff5ee926ed652d350888c4f86da766f1
2019-10-21CRCs: Update comments and improve CSIT checks.Vratko Polak1-63/+68
+ Restore alphabetic order in yaml. + Mark the lisp messages verified to be covered by dev instead of virl. + Mark the GBP messages verified by devicetest now. + Mark acl_add_replace as dev and create_subif as perf. + Mark ip_probe_neighbor as unused L1. + Improve loadbalancer comments. - Nat4 testcase is described, even if not merged yet. + Forget reported CRC after initial dir report, and report them again (once) in test cases (if hit). With this, single run (with fail on crc off) gives full info. + Small improvements to CRC library docstrings and messages. Change-Id: Ic1cfad45e10d437be827af2a89eac49e25267b59 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-09Update of VPP_STABLE_VER filesJan Gelety1-237/+2
- use new vpp ref build - ubuntu 16.04: 20.01-rc0~375-g3ae9f5a~b8172 - use new vpp ref build - ubuntu 18.04: 20.01-rc0~375-g3ae9f5a90 - use new vpp ref build - centos7: 20.01-rc0~375_g3ae9f5a~b7986 Change-Id: I16cf7e9db8f5b6c4f94786b089a1686c823cc1bd Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-09Add vpp loadbalancer maglev mode test suitehaiyanX1.zhang1-0/+18
Change-Id: I61555ba566efef0a2151db9a30bf7f5d9ccad1df Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>
2019-10-01sw_interface_details api updatedJan Gelety1-0/+226
- based on pending vpp api change: https://gerrit.fd.io/r/c/vpp/+/21490 Change-Id: I7d7425e8db3bf60ea3d9d7936ed3109c76247457 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-26CSIT-1471: Policer - VAT API to PAPIpremkumarv1-0/+5
Change-Id: I6c7eff8d9cbb196ccb684a45579ac59942351cfe Signed-off-by: premkumarv <preym17@gmail.com>
2019-09-20Bump stable_vpp and fix CRC listVratko Polak1-225/+4
+ Two API merges happened on VPP side, CSIT list was prepared wrong. + Removed the secondary collection, as no open change is supported. Change-Id: I2e2472c8a2fe50190c11c7441982aa2881e9b8a5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-19CSIT-1597 API cleanup: copJan Gelety1-4/+4
cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21458 Change-Id: I596cfcd192bf48b0d0a91b1953746a484e2c9793 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-17Update CRC list and support 21997/7Vratko Polak1-118/+155
- Attempt to repair IPsec LispGpe perf suite. + Collection name to reflect the current stable vpp. + Add messages found in CSIT L1 keywords. - Uncommented (instead of deleted) untestable messages. Reasons: - Honeycomb. - Messages used by unused keywords. + Listed reasons. Honeycomb not mentioned if both reasons apply. + Delete CRC items for commands not found in keywords anymore. + Add CRCs from .json.api files (as teardown is hard to execute). + Define and restore alphabetical order. + Add hints to find used API commands (not entirely reliable). + Move used commands to "cmd = " form so hints find them. + Argument to run_cli_command changed from "cmd" to "cli_cmd". + Except also struct.error where IOError is excepted. Change-Id: I61058dbe1e33296908aabd0c13433bb16cfa6adf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-12CRC list: Compatible collection for 21997Vratko Polak1-0/+207
Change-Id: I749d0164e9397769fc178f20eefe88b952e295d4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-11Revert "API cleanup: tap" and bump stable_vppVratko Polak1-3/+3
The VPP change got a temporary -1, as other change has higher priority. Bumping stable VPP version, so this passes verify right away. This reverts commit ae62a4348f7de53cfb91a5ae25a10723d5f9b398. Change-Id: If2813b0e41451a3a9e7f8b1512521cf508ac92c7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-11CSIT-1597 API cleanup: tapJan Gelety1-3/+3
cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21706 Change-Id: I16b3e3e29e7e7491cd19c067e8f3d8ced4947852 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-11CSIT-1597: API cleanup: bondJan Gelety1-6/+6
Change-Id: I7c2a29cfe48eee521cce5fcc3506cef39d51d37b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-04FIX: correct crc for sw_interface_slave_detailsJan Gelety1-1/+1
Change-Id: I4baae7da6f8fef8bd65f08e28fa1b55fb81857ce Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-04API cleanup: memifJan Gelety1-5/+5
Change-Id: I4a2d4719dfa7c993c54b278a0093ea833307bb87 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-09Update of VPP_STABLE_VER filesJan Gelety1-210/+2
- use new vpp ref build - ubuntu 16.04: 20.01-rc0~159-gb736e75~b7951 - use new vpp ref build - ubuntu 18.04: 20.01-rc0~159-gb736e75d5 - use new vpp ref build - centos7: 20.01-rc0~159_gb736e75~b7759 Change-Id: I4def341aad97cb039c11ec45be2846d0fb691435 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-06Support new sw_interface_slave_details CRCVratko Polak1-0/+208
Change-Id: I2f72a741ac7353ad36f6a2dada26eabb1a76cb2e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-04Hotfix: Bump version and CRCsVratko Polak1-7/+7
Naginator caused a false Verified+1, so a benign API change had been merged prematurely. Change-Id: I8852ca684cba4876d46049ca34204ebbccf96b2e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-27Delete unused SR keywordsVratko Polak1-5/+3
Trim both Python (L1) and Robot (L2) keywords, as no test performs SR related deletions. Change-Id: Ic76d870c3f58e927ea222b350e149d0770985072 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-23Update CRC list commentsVratko Polak1-15/+39
+ Add testcases and tag expressions for perf occurrences. + Add TNL_1 tag for single tunnel IPsec suites. - Some CRCs were missing before, but form a pair with a listed CRC. - Probably the other half of the pair is not used. - Will be fixed in subsequent Change. Change-Id: I5754210755c13c41226b71045813714a65a1cdf3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-20Bump stable vpp version to 20.01-rc0~68Vratko Polak1-0/+1
After API change. CSIT: https://gerrit.fd.io/r/c/csit/+/21245 VPP: https://gerrit.fd.io/r/c/vpp/+/18361 + Add ip_probe_neighbor_reply CRC, not sure how that got missing. Change-Id: I790875dab771981af3b9eceac5425d4d2f374984 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-20Interface API cleanupJan Gelety1-15/+43
CSIT code alignment with API changes in VPP introduced by patch https://gerrit.fd.io/r/c/vpp/+/18361 Change-Id: Ib0357bba79f55d297ef1086fbf3b760caca16cdb Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-07CSIT-1473: Migrate Tap library from VAT to PAPIJan Gelety1-0/+4
Change-Id: Ibf4a4839c2e8b799b03eebd9dffae891d8f00dd4 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-08-07Expand comment on API covering triggersVratko Polak1-1/+4
GBP tests were added, they are only covered by 2n perf test. Several tags used in the tag expression to proof against future suites. Change-Id: I9facd8c72b41284b6b838e99ce9d38047aa68f40 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-06Add: Dot1Q + L2BD + GBPPeter Mikus1-0/+14
Change-Id: I0050f715011ecfa92b3ee88b301809a56abb7946 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-08-05Fix CRCs, bump stable VPP versionVratko Polak1-0/+185
+ Migrate the data to a separate yaml file. + Improve some argument names. + Unify handling of unicode (to always utf-8 encode to str). Change-Id: Id0622b24202be796c1cd33ad52c3b8dca81cff50 Signed-off-by: Vratko Polak <vrpolak@cisco.com>