aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries
AgeCommit message (Collapse)AuthorFilesLines
2017-01-13VIRL test: VXLAN-L2BD-vhos_user test (CSIT-500)Jan Gelety2-19/+44
- Create test cases to test VXLAN+L2BD+vhost_user IPv4 and IPv6 scenarios Change-Id: I46d27f22ec2e2e35fd5067ba7eeda9a2ccff9f84 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-11 Add the DPDK l2fwd performance test cases.Fangyin Hu6-9/+517
Change-Id: I996847a4871ed994cd9b5edb459fb079ff39c86d Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-01-10CSIT-482: HC Test - NATselias3-0/+424
- add NAT test suite - add keywords and methods for configuring and reading NAT settings - add test data used in NAT suite Change-Id: Iaa2ac1eb156bc9bcff41ec242318f6a973210d38 Signed-off-by: selias <samelias@cisco.com>
2017-01-10HC Test: Fix log archiving in honeycomb testsselias1-0/+16
Change-Id: Iad743b3c0e2d1b57e7c6bcae521fe958fbb06ced Signed-off-by: selias <samelias@cisco.com>
2017-01-10CSIT-499: Perf Tests - VXLAN + L2BD + vhostTibor Frank1-0/+44
- Packet throughput L2BD test cases with VXLANoIPv4 and vhost Change-Id: I6373ef232e5ce7155f8dec80ffa576a6a6b69b81 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-04CSIT-498: Packet throughput L2BD with VXLANoIPv4Tibor Frank1-0/+23
- Add performance tests for packet throughput L2BD with VXLANoIPv4 Change-Id: Id0872e1847f5a0e0eb37ba352bf75f56c51c7a45 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-12-21Fix: Qemu wait_until_vm_bootpmikus1-1/+1
There is an issue that booting Nested VM is successful but QGA guest-ping or flush returns partial response. This fix suppose to do checking until an error or timeout occurs. In case of QGA returns correct response it is success. In case of partial response it will log an error and continue in checking. Change-Id: Idb2c5e5ea54bfc1e118ff62dd15696a1797dfdd9 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-17Pylint fixesPeter Mikus1-8/+8
- fix Map.py Change-Id: I0241e655df12f8135884e48d14c8eea43c501323 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-16CSIT-484: HC Test: Lispselias3-0/+607
- add Lisp test suite - add Lisp test data - add keywords and methods used in Lisp tests Change-Id: Ie7819e20cf48e7dac106d60cce316ce69ab75786 Signed-off-by: selias <samelias@cisco.com>
2016-12-16CSIT-424: HC Test: JSON comparison function reworkselias5-93/+64
When comparing multi-level JSON trees, the exceptions raised carry more useful information. Keys and values not present in reference data are ignored. No longer puts chunks of honeycomb's log file into robot report. The entire log file will be archived after https://gerrit.fd.io/r/4171 Change-Id: Ib597080fa3d9b2c43463c76ee0d52f317ea072e7 Signed-off-by: selias <samelias@cisco.com>
2016-12-16Pylint fixesTibor Frank32-180/+190
- Fix PyLint errors - Fix comments in touched python modules Change-Id: I26db2d292a41969cf38b9b0bdd49c4fb15349102 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-12-15HC Test: fix archiving artifacts in csit-hc2vpp jobsselias2-1/+28
Change-Id: I392eac7404d5e1793a7de9d7a44b9defb89e7b9d Signed-off-by: selias <samelias@cisco.com>
2016-12-14Fix: Qemu wait_until_vm_bootPeter Mikus1-9/+18
There is an issue that booting Nested VM is successful but QGA guest-ping returns partial response. This fix suppose to do checking until an error or timeout occurs. In case of QGA returns correct response it is success. In case of partial response it will log an error and continue in checking. Change-Id: I8a2469287abaa9398a9206988e579912840f20c4 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-14vhost perf testing with Qemu 5t5pcpmikus1-12/+10
Currently we were using 3t3pc for Qemu (2t2pc testpmd). This is not enough anymore as we are testing VPP with 4t4pc. This patch is supposed to increase the number of core used by testpmd. Change-Id: Id58634c050b51943679a1f7cb74c624a98d81a27 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-13CSIT-470 Add option to configure CFS scheduler priority for VPPpmikus2-8/+120
Add option to configure CFS scheduler priority for VPP Change-Id: Id358ebe41d7e868fd412d554d886567f81894b86 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-12CSIT-484: HC Test: Add scripts for new hc2vpp jobsselias1-1/+1
- add package download script that also installs jvpp .jar to maven local repo - add bootstrap scripts for the new jobs Related ci-management commit: https://gerrit.fd.io/r/4171 Change-Id: I11ec3d93d3b6f6d84c0c1c5e54f166dab96a05ee Signed-off-by: selias <samelias@cisco.com>
2016-12-08CSIT-494 Add multi-queue support for Qemupmikus1-5/+7
Add multi-queue support when starting qemu. Full implementation will be following in near future. Change-Id: I743bbde67254b26a4e4e98072bad57dde728845a Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-02Fix: Reading huge pages information during Qemu startpmikus1-13/+82
Reading information from sysfs or proc files is randomly failing returning empty string without any error. This fix suppose to add the retries to read the hugepages information multiple times and raise exception if reading failed. Change-Id: I7c88504765c39b11c81f7a8e77e5b0e32b7225fe Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-01CSIT-481: HC Test: Port mirroring (SPAN)selias4-5/+246
- add port mirroring test suite - add relevant keywords Change-Id: I4ff398dd2ab4323e2a53af2812bf07cbb7043252 Signed-off-by: selias <samelias@cisco.com>
2016-11-29CSIT-454: HC Test: Update module feature namesselias1-2/+2
- outdated due to HC project change - split to honeycomb and hc2vpp Change-Id: If9e3c9baf7787067eff6a759be1ad9aa386c6e0f Signed-off-by: selias <samelias@cisco.com>
2016-11-28CSIT-460: HC Test: Rework existing PBB testsselias2-75/+67
Rework PBB tests to account for changes in: https://gerrit.fd.io/r/2520 https://gerrit.fd.io/r/1833 Change-Id: Id18027c23e57180b76c8478b010a4e3a69a75e43 Signed-off-by: selias <samelias@cisco.com>
2016-11-28CSIT-474: CSIT doc auto-generationTibor Frank1-1/+4
- See resources/tools/doc_gen/README.rst for details Change-Id: Ie5704c93a41e456d65fcd6df2d9d8c96987deebb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-11-25CSIT-425: HC Test: NSH-SFC test suiteselias3-0/+367
- add keyword to enable optional modules in Honeycomb (including NSH) - update honeycomb __init__.robot with the new keyword - add python and robot libraries for NSH tests - add NSH test suite (CRUD operations) Change-Id: I869069a138a51d56d25522163c3a6deefb316f46 Signed-off-by: selias <samelias@cisco.com>
2016-11-25CSIT-457: HC Test: Document expected test failuresselias1-39/+13
- add EXPECTED_FAILING tag to all known test failures - document every use of EXPECTED_FAILING tag ,include Jira issue ID - minor fixes to interface, sub-interface and ACL test suites Change-Id: If6a535bdacc297c03e8cfade8896cdec23498bc2 Signed-off-by: selias <samelias@cisco.com>
2016-11-24Fix documentation and pylint errorspmikus2-59/+104
- Fix documentation to be comliant with sphinx - Fix pylint errors Change-Id: I64acaa6c330c5a3b2975efc4120260813a2b3a92 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-23FIX: Increase ip6 heapsizepmikus1-1/+1
Change-Id: I6ea568e15e5c5b3ec6d3fd1977fb5d4a5ce17484 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-22Remove workaround for ip_address_dumpselias1-2/+0
As of change https://gerrit.fd.io/r/3816, ip_address_dump returns IP addresses properly. Change-Id: If3b4a32e5166bd517beaa2ddb35262c406b1dcea Signed-off-by: selias <samelias@cisco.com>
2016-11-21CSIT:454 - HC Test: Increase timeout for Honeycomb startupselias1-1/+1
Change-Id: I44288ecd8664e75b9acfbd2d0e03d9712f4010b1 Signed-off-by: selias <samelias@cisco.com>
2016-11-16CSIT-470 Add option to configure CFS scheduler priority for QEMUpmikus2-0/+19
Add option to configure CFS scheduler priority for QEMU Change-Id: I76da7f536e70a23a57cf5215ab60002f95532b19 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-16CSIT-454: HC Test: Improve logging on test failureselias5-10/+94
- set Honeycomb log level to TRACE before running Honeycomb tests - on a failed restconf request, print the last few lines of the log - show saved configuration during persistence suite restarts Change-Id: I07ee37a5403cfca946fd7ef25a42861273248fbe Signed-off-by: selias <samelias@cisco.com>
2016-11-15Switch to nested image 1.5 in perfpmikus1-1/+1
Change-Id: I9116eac4a5377258b73b62214ca876161d9ef171 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-08CSIT-423: HC Test: delete VxLAN interfaceselias3-1/+99
Modify VxLAN test cases to account for changes in Honeycomb. Change-Id: If2db55548b5472350d128bdfbb5bdd5289e1deef Signed-off-by: selias <samelias@cisco.com>
2016-11-07CSIT-465: Common test setup and teardownTibor Frank3-0/+100
This test setup and teardown is aimed to be used with all functional tests. It does not include functionality to manipulate VMs (qemu). Test setup includes: - Setup all DUTs before test - Save VPP PIDs - Setup all TGs before traffic script - Update All Interface Data On All Nodes Test teardown includes: - Show Packet Trace on All DUTs - Show vpp trace dump on all DUTs - Vpp Show Errors On All DUTs - Check VPP PID in Teardown Change-Id: Ifee0bd58b7865442c5b510852908fd8363e3c543 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-11-07CSIT-468 Issue retrieving numa node of NICpmikus1-3/+17
Issue retrieving numa node of NIC Change-Id: Ia6f826c100a012b23e046e48fe1e505ed0c4c8e8 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-04CSIT-458 Use node aware config in all perf TCspmikus2-27/+3
- Use node aware config in all perf TCs Change-Id: Icbf92bf232efef49d07c1324c64ae55125e90fb2 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-04CSIT-457: Address Honeycomb test failuresselias9-115/+131
- tag all not-implemented features with EXPECTED_FAILING - add workarounds for known issues with VAT dump commands - replace hardcoded test data with parametrized - separate IP neighbor and IP address into two test cases - support unordered lists with compare_data_structures keyword Change-Id: I2c683162325cee720ba496489787fa50e9c72b8c Signed-off-by: selias <samelias@cisco.com>
2016-11-03CSIT-245: IPv6 - ip4-lispgpe-ip6Zdeno Olsovsky1-6/+14
Change-Id: Ie88cadfc2eab31cd1f411b9648b1a3515e4baa89 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-10-31CSIT-385 CSIT-386 IPv4/IPv6 IPsec testsPatrik Hrnciar2-2/+50
- encryption/integrity key update tests Change-Id: Iddbe35e2f421b5048e60663bff2b0bf1968a9782 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-10-27Increase timeout for 'vpp restart' operationsMiroslav Miklus1-2/+2
Systemd first send SIGTERM and wait 90s (default value) to send SIGKILL to terminate the vpp service. Change-Id: Ia582cfdc4bebc5d3530e82692856fe733d0b001e Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-10-27Revert "Use 3 tries to prepare DUT for testing"Dave Wallace1-3/+1
This reverts commit d551ef4b72448c3ccb493559826b976a2d3d8649. Change-Id: Icff3a98b96298385a2e4789d40ef60d70f440492 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2016-10-26Use 3 tries to prepare DUT for testingJan Gelety1-1/+3
- workaround to deal with occasional vpp restart issue Change-Id: I74a9148045bf4f80c9ba943e9c74338e08b2a72e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-10-26CSIT-395 Update TRex version to v2.09pmikus1-7/+9
- Update TRex to v2.09 Change-Id: I53221aff346840e0438dd1385cedd1db57ca5f3b Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-25CSIT-453: Switch Nested VM to 1.4 in perfpmikus1-6/+2
Currently in performance testing we are using Nested VM v1.3 with DPDK16.07. This patch will change the Nested VM to version 1.4 which includes DPDK16.09. Change-Id: I7cf2edda09f677ad9ddd3cc882000b9537bcc74c Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-24Use only Qemu Kill on the teardown of double qemu setupJan Gelety1-7/+1
- do not use Qemu System Powerdown or Qemu Quit in the teardown of double qemu setup - use just Qemu Kill there Change-Id: I8dd1e4055e0adb5d306e3a9904090a271d17c3e5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-10-24CSIT-452: Switch Qemu binary to Ubuntu defaultpmikus1-1/+1
- Switch Qemu binary to default path and remove building qemu in performance jobs Change-Id: I5e8bb510beb672d034699192a7c454c56f2d2581 Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L4 and misc.selias5-31/+27
- add test cases for: L4 port range ACLs multiple classify rules L2 ACL on egress interface - add L4 configuration to mixed ACL test - add test variables for new test cases - update HTTPRequests to treat code 201 as a positive response Change-Id: If43007545fec174af12dab594f8a1b15b2e4a536 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - mixed layersselias2-11/+25
- add test cases for mixing L2 and L3 rules - update methods with mixed-acl functionality - update test variables Change-Id: I2aaa3033eede609627f751ea896e098548ffae98 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L3selias1-27/+36
- add test cases for layer 3 ACL - IPv4, IPv6, protocol/next-header - update methods with L3 functionality - update test variables Change-Id: Ia7ec03268845191021366621040dc411da0a2a93 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L2selias7-10/+298
- add keywords for accessing Honeycomb's ietf-acl node - add variable file with ietf-acl test data - add ietf-acl traffic test suite - modify bridge domain teardown keyword to unassign interfaces from the bridge domain before delete Change-Id: I6df1771f2fb9b42f30b5af8f54a384c6714f5949 Signed-off-by: selias <samelias@cisco.com>
2016-10-20Add topology method for generic handling of interface referencesselias1-1/+78
- add "convert_interface_reference" to topology.py This is a convenience method, mainly intended for Honeycomb tests which often require conversions between interface key, name and sw_if_index. Change-Id: I427736111f2a1dc07a581c9ccc25e181065bb6fd Signed-off-by: selias <samelias@cisco.com>