aboutsummaryrefslogtreecommitdiffstats
path: root/tests/func
AgeCommit message (Collapse)AuthorFilesLines
2017-02-15HC Test: ACL updatesselias2-375/+700
- update low level ACL based on yang model changes - remove ietf-ACL test suite and test data and keywords - add ACL-plugin test suite, test data and keywords The ietf model of ACLs is no longer supported in Honeycomb. It has been replaced by the ACL plugin. Change-Id: Ic2c2a3e11c9717d1d3885275f6b868a0098343f9 Signed-off-by: selias <samelias@cisco.com>
2017-02-13Introduce simple VAT history per test caseJan Gelety24-140/+57
- print list of VAT commands executed per DUT node during the test case in the func test teardown Change-Id: I18a750ebfb7560eff9f5c4f0826ef84c3f64b4a8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-02-02Mark ipv4 ipfix test as non-criticalMatej Klotton2-2/+2
Change-Id: I8998cbc08979340a680d872fab48bfeca8091365 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-01-27CSIT-506: HC Test- Update and cleanup all suitesselias15-82/+59
- remove EXPECTED_FAILING tag from IPv4 neighbor, IPv6 address, MTU - fix bridge domain removal with interfaces assigned, it should fail - fix teardown of L2 FIB suite (bridge domain removal, see above) - disable vhost-user "server" test cases (VPP bug) - fix keyword verifying sub-interface state - update ACL test data (yang model changes) - remove EXPECTED_FAILING tag from ACL table removal test - update Jira IDs and comments in failing Lisp test case - remove EXPECTED_FAILING tag from Lisp removal test case - use vhost-user "client" instead of "server" in persistence tests Change-Id: I32eafb6013b4512090c0d9365e10c61029179d49 Signed-off-by: selias <samelias@cisco.com>
2017-01-27HC Test: Workaround for 17.04 jvpp version mismatchselias2-1/+3
- add workaround for mismatched jvpp versions in deb packages - disable NSH_SFC madule and test suite, it depends on outdated jvpp - cleanup package download script used in hc2vpp-csit-verify job Change-Id: I98526baa4de08bbbab2339c9e81f49cd189b57ac Signed-off-by: selias <samelias@cisco.com>
2017-01-26csit-func-hc naming changeselias18-86/+86
- change test suite filenames - add numbering to all test cases more details at https://wiki.fd.io/view/CSIT/csit-perf-tc-naming-change Change-Id: I58e6c60f750c07e99c6949d8fe2510780fa9007a Signed-off-by: selias <samelias@cisco.com>
2017-01-25Remove _base from test suite dir namesJan Gelety21-0/+0
Change-Id: I2e495f99a88dedc47f64efcc14722bb629a25f02 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-24csit-func-tc-naming-change - phase 1Jan Gelety95-3395/+5494
- change of ts directories - change of ts file names - splitting of former files to more files when suitable - more details: https://wiki.fd.io/view/CSIT/csit-perf-tc-naming-change Change-Id: Ifda1038f8323735f86c1be7ba7f93e3fda183618 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-20Mark VXLAN test as non criticalMatej Klotton1-0/+1
Change-Id: I1a788de4106d7e71d8cad6b68759b9a01d21bb4a Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-01-17VIRL test: Replace IP probe for VXLAN testMatej Klotton1-0/+4
Change-Id: Ic16f91beabdc2ac2e19ccc65c04790d36c15d477 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-01-13VIRL test: VXLAN-L2BD-vhos_user test (CSIT-500)Jan Gelety1-8/+141
- Create test cases to test VXLAN+L2BD+vhost_user IPv4 and IPv6 scenarios Change-Id: I46d27f22ec2e2e35fd5067ba7eeda9a2ccff9f84 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-10CSIT-482: HC Test - NATselias1-0/+104
- add NAT test suite - add keywords and methods for configuring and reading NAT settings - add test data used in NAT suite Change-Id: Iaa2ac1eb156bc9bcff41ec242318f6a973210d38 Signed-off-by: selias <samelias@cisco.com>
2016-12-16HC Test: Add EXPECTED_FAILING tag to expected test faluresselias3-3/+6
Change-Id: Ic197001f2bb5ad5be9246025502d49e90e0c44aa Signed-off-by: selias <samelias@cisco.com>
2016-12-16CSIT-484: HC Test: Lispselias1-0/+159
- add Lisp test suite - add Lisp test data - add keywords and methods used in Lisp tests Change-Id: Ie7819e20cf48e7dac106d60cce316ce69ab75786 Signed-off-by: selias <samelias@cisco.com>
2016-12-15HC Test: fix archiving artifacts in csit-hc2vpp jobsselias1-1/+3
Change-Id: I392eac7404d5e1793a7de9d7a44b9defb89e7b9d Signed-off-by: selias <samelias@cisco.com>
2016-12-01CSIT-486: Remove interface stats check from ipv4 untagged TC05Dave Wallace1-12/+0
Change-Id: I72c7cac30e899962516636f550e36a8cd04ffa59 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2016-12-01CSIT-481: HC Test: Port mirroring (SPAN)selias1-0/+64
- add port mirroring test suite - add relevant keywords Change-Id: I4ff398dd2ab4323e2a53af2812bf07cbb7043252 Signed-off-by: selias <samelias@cisco.com>
2016-11-28CSIT-460: HC Test: Rework existing PBB testsselias1-73/+22
Rework PBB tests to account for changes in: https://gerrit.fd.io/r/2520 https://gerrit.fd.io/r/1833 Change-Id: Id18027c23e57180b76c8478b010a4e3a69a75e43 Signed-off-by: selias <samelias@cisco.com>
2016-11-25CSIT-425: HC Test: NSH-SFC test suiteselias2-0/+128
- add keyword to enable optional modules in Honeycomb (including NSH) - update honeycomb __init__.robot with the new keyword - add python and robot libraries for NSH tests - add NSH test suite (CRUD operations) Change-Id: I869069a138a51d56d25522163c3a6deefb316f46 Signed-off-by: selias <samelias@cisco.com>
2016-11-25CSIT-457: HC Test: Document expected test failuresselias5-42/+63
- add EXPECTED_FAILING tag to all known test failures - document every use of EXPECTED_FAILING tag ,include Jira issue ID - minor fixes to interface, sub-interface and ACL test suites Change-Id: If6a535bdacc297c03e8cfade8896cdec23498bc2 Signed-off-by: selias <samelias@cisco.com>
2016-11-24CSIT-426: HC Test: Netconf transaction revertselias1-0/+27
- add test cases for reverting Netconf transactions - minor fixes to existing Netconf test case Change-Id: Id6e5d26f815b14da29194181bf333e845f5b623c Signed-off-by: selias <samelias@cisco.com>
2016-11-16CSIT-454: HC Test: Improve logging on test failureselias1-0/+1
- set Honeycomb log level to TRACE before running Honeycomb tests - on a failed restconf request, print the last few lines of the log - show saved configuration during persistence suite restarts Change-Id: I07ee37a5403cfca946fd7ef25a42861273248fbe Signed-off-by: selias <samelias@cisco.com>
2016-11-11CSIT-471: Fix check of DHCPv6 message types.Jan Gelety1-1/+0
- use message typoe check for every DHCPv6 message - remove EXPECTED_FAILING tag from TC01: VPP proxies valid DHCPv6 request to DHCPv6 server Change-Id: Idf1d3feb0f445bb5b0acc03671344ca63acbf4f3 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-11-08CSIT-347: Remove EXPECTED_FAILING tag from TCMatej Klotton1-21/+29
Change-Id: Ic6780fc33ecbfaed12ed30e665ad3ab0a67d04fe Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-11-08CSIT-423: HC Test: delete VxLAN interfaceselias1-1/+12
Modify VxLAN test cases to account for changes in Honeycomb. Change-Id: If2db55548b5472350d128bdfbb5bdd5289e1deef Signed-off-by: selias <samelias@cisco.com>
2016-11-07CSIT-465: Common test setup and teardownTibor Frank56-359/+230
This test setup and teardown is aimed to be used with all functional tests. It does not include functionality to manipulate VMs (qemu). Test setup includes: - Setup all DUTs before test - Save VPP PIDs - Setup all TGs before traffic script - Update All Interface Data On All Nodes Test teardown includes: - Show Packet Trace on All DUTs - Show vpp trace dump on all DUTs - Vpp Show Errors On All DUTs - Check VPP PID in Teardown Change-Id: Ifee0bd58b7865442c5b510852908fd8363e3c543 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-11-07CSIT-456: IPv4 - ip4-ipsec-lispgpe-ip6 - main fib, vrf, phy2lisp, virt2lispZdeno Olsovsky1-0/+311
Change-Id: I844d7ef39f4c107ef1d363d8110ef6194b98dfe6 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-11-07CSIT-393 ip4-ipsec-lispgpe-ip4 virt2lispPatrik Hrnciar1-0/+131
Change-Id: I22f0e238c8b0cddbddca7f86bc18a0a916f7e3d3 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-11-04CSIT-451 LISP vrf tests reworkZdeno Olsovsky3-100/+128
Change-Id: I2dac2eaff828672c2d921e889356b70baed5f4da Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-11-04CSIT-457: Address Honeycomb test failuresselias4-76/+65
- tag all not-implemented features with EXPECTED_FAILING - add workarounds for known issues with VAT dump commands - replace hardcoded test data with parametrized - separate IP neighbor and IP address into two test cases - support unordered lists with compare_data_structures keyword Change-Id: I2c683162325cee720ba496489787fa50e9c72b8c Signed-off-by: selias <samelias@cisco.com>
2016-11-03CSIT-245: IPv6 - ip4-lispgpe-ip6Zdeno Olsovsky1-37/+176
Change-Id: Ie88cadfc2eab31cd1f411b9648b1a3515e4baa89 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-10-31CSIT-385 CSIT-386 IPv4/IPv6 IPsec testsPatrik Hrnciar4-13/+517
- encryption/integrity key update tests Change-Id: Iddbe35e2f421b5048e60663bff2b0bf1968a9782 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-10-28DHCPv6 Proxy test updatePatrik Hrnciar1-0/+1
Change-Id: I8206a652bfa31cda0f7120741a0479a10ad4b1a1 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-10-27Revert "Use 3 tries to prepare DUT for testing"Dave Wallace1-1/+1
This reverts commit d551ef4b72448c3ccb493559826b976a2d3d8649. Change-Id: Icff3a98b96298385a2e4789d40ef60d70f440492 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2016-10-26Use 3 tries to prepare DUT for testingJan Gelety1-1/+1
- workaround to deal with occasional vpp restart issue Change-Id: I74a9148045bf4f80c9ba943e9c74338e08b2a72e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-10-21CSIT-450: Refactor LISP filesZdeno Olsovsky10-366/+336
-change file names to appropriate -move tests to appropriate files Change-Id: Icadd7b8dcee503f4026d340bbfdba488145b8c9d Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L4 and misc.selias1-68/+158
- add test cases for: L4 port range ACLs multiple classify rules L2 ACL on egress interface - add L4 configuration to mixed ACL test - add test variables for new test cases - update HTTPRequests to treat code 201 as a positive response Change-Id: If43007545fec174af12dab594f8a1b15b2e4a536 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - mixed layersselias1-6/+81
- add test cases for mixing L2 and L3 rules - update methods with mixed-acl functionality - update test variables Change-Id: I2aaa3033eede609627f751ea896e098548ffae98 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L3selias1-10/+137
- add test cases for layer 3 ACL - IPv4, IPv6, protocol/next-header - update methods with L3 functionality - update test variables Change-Id: Ia7ec03268845191021366621040dc411da0a2a93 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L2selias3-2/+87
- add keywords for accessing Honeycomb's ietf-acl node - add variable file with ietf-acl test data - add ietf-acl traffic test suite - modify bridge domain teardown keyword to unassign interfaces from the bridge domain before delete Change-Id: I6df1771f2fb9b42f30b5af8f54a384c6714f5949 Signed-off-by: selias <samelias@cisco.com>
2016-10-10CSIT-392: ip4-lispgpe-ip4Tibor Frank1-18/+149
- ip4-lispgpe-ip4 - main fib, vrf, virt2lisp Change-Id: I28c81e91689021693ce76352878fa21e953a4ef6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-10-07CSIT-247: IPv6 - ip6-ipsec-lispgpe-ip6 - main fib, phy2lisp, virt2lispZdeno Olsovsky1-0/+293
Change-Id: I039e14b7c227318c70826068368430978f8f0a51 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-10-07CSIT-256: L2enc - l2-eth-lispgpe-ip6 - L2BDZdeno Olsovsky1-0/+101
Change-Id: I5523235aa7b48be673c9940323424b2dc1172312 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-10-07CSIT-257: L2enc - l2-eth-lispgpe-ip4 - L2BDZdeno Olsovsky1-0/+101
Change-Id: I0ee68f707c4175940538654f3a4bbd7d1a91bef1 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-10-07CSIT-233: IPFIX - fix issues in test casesselias2-46/+27
- fix and simplify configuration in IPv4 IPFIX tests - fix collector address in IPv6 IPFIX tests Change-Id: Ibe19a45516416a638955b6d7779e0ca9708edc47 Signed-off-by: selias <samelias@cisco.com>
2016-10-07CSIT-249: IPv6 - ip4-ipsec-lispgpe-ip6 - main fib, phy2lisp, virt2lispZdeno Olsovsky1-0/+262
Change-Id: I9c317de2fa837ab46c25d23f11449d623c9c86eb Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-10-04CSIT-227, CSIT-240 IPv4/IPv6 Multipath routing testsPatrik Hrnciar2-0/+157
- add IPv4 Equal-cost multipath routing test - add IPv6 Equal-cost multipath routing test Change-Id: I62eaf9983b7767e124f80af7d8c8652ffc460cf8 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-10-04CSIT-365: IPv6 encaps softwire - MAP-E part IIMatej Klotton1-74/+197
- check traffic with multiple domains configured. Generate given amount of random configurations. - add map-e hairpinning test. - add icmp test for map-e. - reformat map_e.robot, capitalize all KW. Change-Id: I94c4c9d6b186cc4a7c65cdb84ee795365dff5e82 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-10-04Update QoS documentationPatrik Hrnciar2-24/+24
Change-Id: I5b77aed98cf10a73abff9e70a69d95534ff2ff3e Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-10-03CSIT-253: Switched Port Analyzer Mirroring (SPAN) - IPv6selias1-0/+20
- add SPAN test case, mirroring IPv6 ICMP packets Change-Id: If01db8df698374f14a0fd2babde557b413461a06 Signed-off-by: selias <samelias@cisco.com>