aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries
AgeCommit message (Collapse)AuthorFilesLines
2017-02-15HC Test: Add temporary workaround for VAT issues on Ubuntu14.04selias1-0/+18
Some VAT commands return "error:misc" in addition to their normal JSON output. This causes the JSON parser to complain about extra data. Change-Id: I0da9739f371998dd6e2e6d6f70c1e8a3d82b6350 Signed-off-by: selias <samelias@cisco.com>
2017-02-13Introduce simple VAT history per test caseJan Gelety3-3/+102
- print list of VAT commands executed per DUT node during the test case in the func test teardown Change-Id: I18a750ebfb7560eff9f5c4f0826ef84c3f64b4a8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-02-10CSIT-518: Add testpmd numa awarenessTibor Frank4-97/+162
Change-Id: I982834de1fbe71cf5303808ea58d4b58e530ffcb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-09Upgrade T-rex to newer versionPeter Mikus1-2/+2
Change-Id: I8b918a3c1d8109fb64bfdeec8e5c9afe45a86d21 Signed-off-by: pmikus <pmikus@cisco.com>
2017-02-07CSIT-517: DPDK initialization and teardownTibor Frank1-10/+14
Change-Id: Iff42549e3be610c88b7a7d5518ef2cbb88c75ed2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-03CSIT-516: Add keywords for 2-node topologyTibor Frank3-23/+156
Change-Id: Ib5a1e207f1dec99747329a755c3c365fef4bd64c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-30HC Test: Fix jvpp workaround for 17.04selias1-2/+2
- original commit at https://gerrit.fd.io/r/4683 Change-Id: I0b2d77f66830fbbc2d27e9015ec67ea9cd9a9885 Signed-off-by: selias <samelias@cisco.com>
2017-01-27CSIT-506: HC Test- Update and cleanup all suitesselias5-27/+26
- remove EXPECTED_FAILING tag from IPv4 neighbor, IPv6 address, MTU - fix bridge domain removal with interfaces assigned, it should fail - fix teardown of L2 FIB suite (bridge domain removal, see above) - disable vhost-user "server" test cases (VPP bug) - fix keyword verifying sub-interface state - update ACL test data (yang model changes) - remove EXPECTED_FAILING tag from ACL table removal test - update Jira IDs and comments in failing Lisp test case - remove EXPECTED_FAILING tag from Lisp removal test case - use vhost-user "client" instead of "server" in persistence tests Change-Id: I32eafb6013b4512090c0d9365e10c61029179d49 Signed-off-by: selias <samelias@cisco.com>
2017-01-27HC Test: Workaround for 17.04 jvpp version mismatchselias1-11/+54
- add workaround for mismatched jvpp versions in deb packages - disable NSH_SFC madule and test suite, it depends on outdated jvpp - cleanup package download script used in hc2vpp-csit-verify job Change-Id: I98526baa4de08bbbab2339c9e81f49cd189b57ac Signed-off-by: selias <samelias@cisco.com>
2017-01-26Fix: Display of PDR latencypmikus1-3/+7
Fix the string in PDR latency output Change-Id: I7f244e29015da4e71485e88f2988efa73b6f4853 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-26CSIT-512: Add x710, xl710 l2bd vhost testsTibor Frank1-24/+51
- 10ge2p1x710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc Change-Id: I99a70c8fcdfc0fffda96606033ba8752d6c07952 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-24CSIT-509: Add perf tests for vlan + l2 + vhostTibor Frank1-2/+82
Change-Id: I65e716b51dd35092c10574ac4580ee4b8bd3b24b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-19Add unified latency output for PDRDISC and NDRDISCpmikus1-5/+7
Add same latency formatting for PDR as for NDR search results. This will help us to parse the data in same way. Change-Id: I3be79cc7623f8c9d39fd44babd252ceec58c114b Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-17VIRL test: Replace IP probe for VXLAN testMatej Klotton2-2/+8
Change-Id: Ic16f91beabdc2ac2e19ccc65c04790d36c15d477 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-01-13VIRL test: VXLAN-L2BD-vhos_user test (CSIT-500)Jan Gelety2-19/+44
- Create test cases to test VXLAN+L2BD+vhost_user IPv4 and IPv6 scenarios Change-Id: I46d27f22ec2e2e35fd5067ba7eeda9a2ccff9f84 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-11 Add the DPDK l2fwd performance test cases.Fangyin Hu6-9/+517
Change-Id: I996847a4871ed994cd9b5edb459fb079ff39c86d Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-01-10CSIT-482: HC Test - NATselias3-0/+424
- add NAT test suite - add keywords and methods for configuring and reading NAT settings - add test data used in NAT suite Change-Id: Iaa2ac1eb156bc9bcff41ec242318f6a973210d38 Signed-off-by: selias <samelias@cisco.com>
2017-01-10HC Test: Fix log archiving in honeycomb testsselias1-0/+16
Change-Id: Iad743b3c0e2d1b57e7c6bcae521fe958fbb06ced Signed-off-by: selias <samelias@cisco.com>
2017-01-10CSIT-499: Perf Tests - VXLAN + L2BD + vhostTibor Frank1-0/+44
- Packet throughput L2BD test cases with VXLANoIPv4 and vhost Change-Id: I6373ef232e5ce7155f8dec80ffa576a6a6b69b81 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-04CSIT-498: Packet throughput L2BD with VXLANoIPv4Tibor Frank1-0/+23
- Add performance tests for packet throughput L2BD with VXLANoIPv4 Change-Id: Id0872e1847f5a0e0eb37ba352bf75f56c51c7a45 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-12-21Fix: Qemu wait_until_vm_bootpmikus1-1/+1
There is an issue that booting Nested VM is successful but QGA guest-ping or flush returns partial response. This fix suppose to do checking until an error or timeout occurs. In case of QGA returns correct response it is success. In case of partial response it will log an error and continue in checking. Change-Id: Idb2c5e5ea54bfc1e118ff62dd15696a1797dfdd9 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-17Pylint fixesPeter Mikus1-8/+8
- fix Map.py Change-Id: I0241e655df12f8135884e48d14c8eea43c501323 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-16CSIT-484: HC Test: Lispselias3-0/+607
- add Lisp test suite - add Lisp test data - add keywords and methods used in Lisp tests Change-Id: Ie7819e20cf48e7dac106d60cce316ce69ab75786 Signed-off-by: selias <samelias@cisco.com>
2016-12-16CSIT-424: HC Test: JSON comparison function reworkselias5-93/+64
When comparing multi-level JSON trees, the exceptions raised carry more useful information. Keys and values not present in reference data are ignored. No longer puts chunks of honeycomb's log file into robot report. The entire log file will be archived after https://gerrit.fd.io/r/4171 Change-Id: Ib597080fa3d9b2c43463c76ee0d52f317ea072e7 Signed-off-by: selias <samelias@cisco.com>
2016-12-16Pylint fixesTibor Frank32-180/+190
- Fix PyLint errors - Fix comments in touched python modules Change-Id: I26db2d292a41969cf38b9b0bdd49c4fb15349102 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-12-15HC Test: fix archiving artifacts in csit-hc2vpp jobsselias2-1/+28
Change-Id: I392eac7404d5e1793a7de9d7a44b9defb89e7b9d Signed-off-by: selias <samelias@cisco.com>
2016-12-14Fix: Qemu wait_until_vm_bootPeter Mikus1-9/+18
There is an issue that booting Nested VM is successful but QGA guest-ping returns partial response. This fix suppose to do checking until an error or timeout occurs. In case of QGA returns correct response it is success. In case of partial response it will log an error and continue in checking. Change-Id: I8a2469287abaa9398a9206988e579912840f20c4 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-14vhost perf testing with Qemu 5t5pcpmikus1-12/+10
Currently we were using 3t3pc for Qemu (2t2pc testpmd). This is not enough anymore as we are testing VPP with 4t4pc. This patch is supposed to increase the number of core used by testpmd. Change-Id: Id58634c050b51943679a1f7cb74c624a98d81a27 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-13CSIT-470 Add option to configure CFS scheduler priority for VPPpmikus2-8/+120
Add option to configure CFS scheduler priority for VPP Change-Id: Id358ebe41d7e868fd412d554d886567f81894b86 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-12CSIT-484: HC Test: Add scripts for new hc2vpp jobsselias1-1/+1
- add package download script that also installs jvpp .jar to maven local repo - add bootstrap scripts for the new jobs Related ci-management commit: https://gerrit.fd.io/r/4171 Change-Id: I11ec3d93d3b6f6d84c0c1c5e54f166dab96a05ee Signed-off-by: selias <samelias@cisco.com>
2016-12-08CSIT-494 Add multi-queue support for Qemupmikus1-5/+7
Add multi-queue support when starting qemu. Full implementation will be following in near future. Change-Id: I743bbde67254b26a4e4e98072bad57dde728845a Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-02Fix: Reading huge pages information during Qemu startpmikus1-13/+82
Reading information from sysfs or proc files is randomly failing returning empty string without any error. This fix suppose to add the retries to read the hugepages information multiple times and raise exception if reading failed. Change-Id: I7c88504765c39b11c81f7a8e77e5b0e32b7225fe Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-01CSIT-481: HC Test: Port mirroring (SPAN)selias4-5/+246
- add port mirroring test suite - add relevant keywords Change-Id: I4ff398dd2ab4323e2a53af2812bf07cbb7043252 Signed-off-by: selias <samelias@cisco.com>
2016-11-29CSIT-454: HC Test: Update module feature namesselias1-2/+2
- outdated due to HC project change - split to honeycomb and hc2vpp Change-Id: If9e3c9baf7787067eff6a759be1ad9aa386c6e0f Signed-off-by: selias <samelias@cisco.com>
2016-11-28CSIT-460: HC Test: Rework existing PBB testsselias2-75/+67
Rework PBB tests to account for changes in: https://gerrit.fd.io/r/2520 https://gerrit.fd.io/r/1833 Change-Id: Id18027c23e57180b76c8478b010a4e3a69a75e43 Signed-off-by: selias <samelias@cisco.com>
2016-11-28CSIT-474: CSIT doc auto-generationTibor Frank1-1/+4
- See resources/tools/doc_gen/README.rst for details Change-Id: Ie5704c93a41e456d65fcd6df2d9d8c96987deebb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-11-25CSIT-425: HC Test: NSH-SFC test suiteselias3-0/+367
- add keyword to enable optional modules in Honeycomb (including NSH) - update honeycomb __init__.robot with the new keyword - add python and robot libraries for NSH tests - add NSH test suite (CRUD operations) Change-Id: I869069a138a51d56d25522163c3a6deefb316f46 Signed-off-by: selias <samelias@cisco.com>
2016-11-25CSIT-457: HC Test: Document expected test failuresselias1-39/+13
- add EXPECTED_FAILING tag to all known test failures - document every use of EXPECTED_FAILING tag ,include Jira issue ID - minor fixes to interface, sub-interface and ACL test suites Change-Id: If6a535bdacc297c03e8cfade8896cdec23498bc2 Signed-off-by: selias <samelias@cisco.com>
2016-11-24Fix documentation and pylint errorspmikus2-59/+104
- Fix documentation to be comliant with sphinx - Fix pylint errors Change-Id: I64acaa6c330c5a3b2975efc4120260813a2b3a92 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-23FIX: Increase ip6 heapsizepmikus1-1/+1
Change-Id: I6ea568e15e5c5b3ec6d3fd1977fb5d4a5ce17484 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-22Remove workaround for ip_address_dumpselias1-2/+0
As of change https://gerrit.fd.io/r/3816, ip_address_dump returns IP addresses properly. Change-Id: If3b4a32e5166bd517beaa2ddb35262c406b1dcea Signed-off-by: selias <samelias@cisco.com>
2016-11-21CSIT:454 - HC Test: Increase timeout for Honeycomb startupselias1-1/+1
Change-Id: I44288ecd8664e75b9acfbd2d0e03d9712f4010b1 Signed-off-by: selias <samelias@cisco.com>
2016-11-16CSIT-470 Add option to configure CFS scheduler priority for QEMUpmikus2-0/+19
Add option to configure CFS scheduler priority for QEMU Change-Id: I76da7f536e70a23a57cf5215ab60002f95532b19 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-16CSIT-454: HC Test: Improve logging on test failureselias5-10/+94
- set Honeycomb log level to TRACE before running Honeycomb tests - on a failed restconf request, print the last few lines of the log - show saved configuration during persistence suite restarts Change-Id: I07ee37a5403cfca946fd7ef25a42861273248fbe Signed-off-by: selias <samelias@cisco.com>
2016-11-15Switch to nested image 1.5 in perfpmikus1-1/+1
Change-Id: I9116eac4a5377258b73b62214ca876161d9ef171 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-08CSIT-423: HC Test: delete VxLAN interfaceselias3-1/+99
Modify VxLAN test cases to account for changes in Honeycomb. Change-Id: If2db55548b5472350d128bdfbb5bdd5289e1deef Signed-off-by: selias <samelias@cisco.com>
2016-11-07CSIT-465: Common test setup and teardownTibor Frank3-0/+100
This test setup and teardown is aimed to be used with all functional tests. It does not include functionality to manipulate VMs (qemu). Test setup includes: - Setup all DUTs before test - Save VPP PIDs - Setup all TGs before traffic script - Update All Interface Data On All Nodes Test teardown includes: - Show Packet Trace on All DUTs - Show vpp trace dump on all DUTs - Vpp Show Errors On All DUTs - Check VPP PID in Teardown Change-Id: Ifee0bd58b7865442c5b510852908fd8363e3c543 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-11-07CSIT-468 Issue retrieving numa node of NICpmikus1-3/+17
Issue retrieving numa node of NIC Change-Id: Ia6f826c100a012b23e046e48fe1e505ed0c4c8e8 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-04CSIT-458 Use node aware config in all perf TCspmikus2-27/+3
- Use node aware config in all perf TCs Change-Id: Icbf92bf232efef49d07c1324c64ae55125e90fb2 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-04CSIT-457: Address Honeycomb test failuresselias9-115/+131
- tag all not-implemented features with EXPECTED_FAILING - add workarounds for known issues with VAT dump commands - replace hardcoded test data with parametrized - separate IP neighbor and IP address into two test cases - support unordered lists with compare_data_structures keyword Change-Id: I2c683162325cee720ba496489787fa50e9c72b8c Signed-off-by: selias <samelias@cisco.com>