aboutsummaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2017-01-26csit-func-hc naming changeselias18-86/+86
- change test suite filenames - add numbering to all test cases more details at https://wiki.fd.io/view/CSIT/csit-perf-tc-naming-change Change-Id: I58e6c60f750c07e99c6949d8fe2510780fa9007a Signed-off-by: selias <samelias@cisco.com> (cherry picked from commit 20a24b36a6fc172c209dcc154e138f6e06e85bd5)
2017-01-25Remove _base from test suite dir namesJan Gelety21-0/+0
Change-Id: I4168dc077d2d1a9a9ae9dce4bf17da1be9a1d61d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-25csit-func-tc-naming-change - phase 1Jan Gelety95-3262/+5494
- change of ts directories - change of ts file names - splitting of former files to more files when suitable - more details: https://wiki.fd.io/view/CSIT/csit-perf-tc-naming-change Change-Id: Ifda1038f8323735f86c1be7ba7f93e3fda183618 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-24CSIT-509: Add perf tests for vlan + l2 + vhostTibor Frank3-1/+1411
Change-Id: I65e716b51dd35092c10574ac4580ee4b8bd3b24b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c232d04e7a5bffb72063240ee7e15967f46c4873)
2017-01-20Mark VXLAN test as non criticalMatej Klotton1-0/+1
Change-Id: I1a788de4106d7e71d8cad6b68759b9a01d21bb4a Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-01-19Fix: Adjust NDRCHK threshold valuespmikus2-12/+12
Adjust treshold values in NDRCHK tests based on latest data. Change-Id: I10f39b9a1a071bf0b38c91f904361ad7f54ccc92 Signed-off-by: pmikus <pmikus@cisco.com> (cherry picked from commit 7661ed85d1080edf8d0c8711f1fffc5d484ebf06)
2017-01-19Renaming of all perf TCs.Tibor Frank54-937/+973
Change-Id: Id71abf4f52d7fc555ed9c3ec19563d54f5db9ec5 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1c9b487b0d3652e477490eb1237c5870296dc497)
2017-01-17VIRL test: Replace IP probe for VXLAN testMatej Klotton1-0/+4
Change-Id: Ic16f91beabdc2ac2e19ccc65c04790d36c15d477 Signed-off-by: Matej Klotton <mklotton@cisco.com> (cherry picked from commit eb4515115a69f5a3fe9b2fe178110cc5ff78b73a)
2017-01-12CSIT-501: Perf tests re-taggingTibor Frank54-904/+848
- Implement tags introduced by https://gerrit.fd.io/r/#/c/3856/ Change-Id: I59313f43f338e2b4a1ad5caf9521b1a0da84d1d3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-10CSIT-482: HC Test - NATselias1-0/+104
- add NAT test suite - add keywords and methods for configuring and reading NAT settings - add test data used in NAT suite Change-Id: Iaa2ac1eb156bc9bcff41ec242318f6a973210d38 Signed-off-by: selias <samelias@cisco.com>
2017-01-10CSIT-469 Rename performance suitespmikus54-3365/+3665
Rename performance suites and add more TAGS Change-Id: I6a5251bb6e380fe2a47a6ec1c1aeb4a9f70c5ce3 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-10CSIT-499: Perf Tests - VXLAN + L2BD + vhostTibor Frank1-0/+684
- Packet throughput L2BD test cases with VXLANoIPv4 and vhost Change-Id: I6373ef232e5ce7155f8dec80ffa576a6a6b69b81 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-04CSIT-498: Packet throughput L2BD with VXLANoIPv4Tibor Frank1-0/+475
- Add performance tests for packet throughput L2BD with VXLANoIPv4 Change-Id: Id0872e1847f5a0e0eb37ba352bf75f56c51c7a45 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-12-16HC Test: Add EXPECTED_FAILING tag to expected test faluresselias3-3/+6
Change-Id: Ic197001f2bb5ad5be9246025502d49e90e0c44aa Signed-off-by: selias <samelias@cisco.com>
2016-12-16CSIT-484: HC Test: Lispselias1-0/+159
- add Lisp test suite - add Lisp test data - add keywords and methods used in Lisp tests Change-Id: Ie7819e20cf48e7dac106d60cce316ce69ab75786 Signed-off-by: selias <samelias@cisco.com>
2016-12-15HC Test: fix archiving artifacts in csit-hc2vpp jobsselias1-1/+3
Change-Id: I392eac7404d5e1793a7de9d7a44b9defb89e7b9d Signed-off-by: selias <samelias@cisco.com>
2016-12-14vhost perf testing with Qemu 5t5pcpmikus3-11/+11
Currently we were using 3t3pc for Qemu (2t2pc testpmd). This is not enough anymore as we are testing VPP with 4t4pc. This patch is supposed to increase the number of core used by testpmd. Change-Id: Id58634c050b51943679a1f7cb74c624a98d81a27 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-13CSIT-470 Add option to configure CFS scheduler priority for VPPpmikus3-6/+57
Add option to configure CFS scheduler priority for VPP Change-Id: Id358ebe41d7e868fd412d554d886567f81894b86 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-01CSIT-486: Remove interface stats check from ipv4 untagged TC05Dave Wallace1-12/+0
Change-Id: I72c7cac30e899962516636f550e36a8cd04ffa59 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2016-12-01CSIT-481: HC Test: Port mirroring (SPAN)selias1-0/+64
- add port mirroring test suite - add relevant keywords Change-Id: I4ff398dd2ab4323e2a53af2812bf07cbb7043252 Signed-off-by: selias <samelias@cisco.com>
2016-11-28CSIT-460: HC Test: Rework existing PBB testsselias1-73/+22
Rework PBB tests to account for changes in: https://gerrit.fd.io/r/2520 https://gerrit.fd.io/r/1833 Change-Id: Id18027c23e57180b76c8478b010a4e3a69a75e43 Signed-off-by: selias <samelias@cisco.com>
2016-11-25CSIT-425: HC Test: NSH-SFC test suiteselias2-0/+128
- add keyword to enable optional modules in Honeycomb (including NSH) - update honeycomb __init__.robot with the new keyword - add python and robot libraries for NSH tests - add NSH test suite (CRUD operations) Change-Id: I869069a138a51d56d25522163c3a6deefb316f46 Signed-off-by: selias <samelias@cisco.com>
2016-11-25CSIT-457: HC Test: Document expected test failuresselias5-42/+63
- add EXPECTED_FAILING tag to all known test failures - document every use of EXPECTED_FAILING tag ,include Jira issue ID - minor fixes to interface, sub-interface and ACL test suites Change-Id: If6a535bdacc297c03e8cfade8896cdec23498bc2 Signed-off-by: selias <samelias@cisco.com>
2016-11-24CSIT-426: HC Test: Netconf transaction revertselias1-0/+27
- add test cases for reverting Netconf transactions - minor fixes to existing Netconf test case Change-Id: Id6e5d26f815b14da29194181bf333e845f5b623c Signed-off-by: selias <samelias@cisco.com>
2016-11-16CSIT-454: HC Test: Improve logging on test failureselias1-0/+1
- set Honeycomb log level to TRACE before running Honeycomb tests - on a failed restconf request, print the last few lines of the log - show saved configuration during persistence suite restarts Change-Id: I07ee37a5403cfca946fd7ef25a42861273248fbe Signed-off-by: selias <samelias@cisco.com>
2016-11-15CSIT-403 Data-Driven Performance Test Suite IIpmikus4-292/+414
- L2BD XL710 Change-Id: Ie8c0f0db6d8e10da194da9b0b8cc61388d50604c Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-11CSIT-471: Fix check of DHCPv6 message types.Jan Gelety1-1/+0
- use message typoe check for every DHCPv6 message - remove EXPECTED_FAILING tag from TC01: VPP proxies valid DHCPv6 request to DHCPv6 server Change-Id: Idf1d3feb0f445bb5b0acc03671344ca63acbf4f3 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-11-08CSIT-347: Remove EXPECTED_FAILING tag from TCMatej Klotton1-21/+29
Change-Id: Ic6780fc33ecbfaed12ed30e665ad3ab0a67d04fe Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-11-08CSIT-423: HC Test: delete VxLAN interfaceselias1-1/+12
Modify VxLAN test cases to account for changes in Honeycomb. Change-Id: If2db55548b5472350d128bdfbb5bdd5289e1deef Signed-off-by: selias <samelias@cisco.com>
2016-11-07CSIT-465: Common test setup and teardownTibor Frank56-359/+230
This test setup and teardown is aimed to be used with all functional tests. It does not include functionality to manipulate VMs (qemu). Test setup includes: - Setup all DUTs before test - Save VPP PIDs - Setup all TGs before traffic script - Update All Interface Data On All Nodes Test teardown includes: - Show Packet Trace on All DUTs - Show vpp trace dump on all DUTs - Vpp Show Errors On All DUTs - Check VPP PID in Teardown Change-Id: Ifee0bd58b7865442c5b510852908fd8363e3c543 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-11-07CSIT-456: IPv4 - ip4-ipsec-lispgpe-ip6 - main fib, vrf, phy2lisp, virt2lispZdeno Olsovsky1-0/+311
Change-Id: I844d7ef39f4c107ef1d363d8110ef6194b98dfe6 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-11-07CSIT-393 ip4-ipsec-lispgpe-ip4 virt2lispPatrik Hrnciar1-0/+131
Change-Id: I22f0e238c8b0cddbddca7f86bc18a0a916f7e3d3 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-11-04CSIT-458 Use node aware config in all perf TCspmikus41-640/+640
- Use node aware config in all perf TCs Change-Id: Icbf92bf232efef49d07c1324c64ae55125e90fb2 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-04CSIT-451 LISP vrf tests reworkZdeno Olsovsky3-100/+128
Change-Id: I2dac2eaff828672c2d921e889356b70baed5f4da Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-11-04CSIT-457: Address Honeycomb test failuresselias4-76/+65
- tag all not-implemented features with EXPECTED_FAILING - add workarounds for known issues with VAT dump commands - replace hardcoded test data with parametrized - separate IP neighbor and IP address into two test cases - support unordered lists with compare_data_structures keyword Change-Id: I2c683162325cee720ba496489787fa50e9c72b8c Signed-off-by: selias <samelias@cisco.com>
2016-11-04CSIT-466 Remove dpdk-vhost testspmikus2-133/+0
Remove dpdk-vhost tests Change-Id: Ia4dc0f1b6756475bd69857cb2a01870a24431df3 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-03CSIT-245: IPv6 - ip4-lispgpe-ip6Zdeno Olsovsky1-37/+176
Change-Id: Ie88cadfc2eab31cd1f411b9648b1a3515e4baa89 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-10-31CSIT-385 CSIT-386 IPv4/IPv6 IPsec testsPatrik Hrnciar4-13/+517
- encryption/integrity key update tests Change-Id: Iddbe35e2f421b5048e60663bff2b0bf1968a9782 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-10-28DHCPv6 Proxy test updatePatrik Hrnciar1-0/+1
Change-Id: I8206a652bfa31cda0f7120741a0479a10ad4b1a1 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-10-27Revert "Use 3 tries to prepare DUT for testing"Dave Wallace1-1/+1
This reverts commit d551ef4b72448c3ccb493559826b976a2d3d8649. Change-Id: Icff3a98b96298385a2e4789d40ef60d70f440492 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2016-10-26Use 3 tries to prepare DUT for testingJan Gelety1-1/+1
- workaround to deal with occasional vpp restart issue Change-Id: I74a9148045bf4f80c9ba943e9c74338e08b2a72e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-10-25TB1 X710 topology file, X710 BD Long testsMiroslav Miklus1-0/+196
Change-Id: Ib49dcd24be8e92ffb2bd1d12e3ea50cce125fb7e Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-10-24CSIT-452: Switch Qemu binary to Ubuntu defaultpmikus3-3/+0
- Switch Qemu binary to default path and remove building qemu in performance jobs Change-Id: I5e8bb510beb672d034699192a7c454c56f2d2581 Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-24CSIT-318 Long_IPv6_Intel-XL710Miroslav Miklus1-0/+187
Change-Id: If386a56491e98f642b97ebda34e290f782ec8de2 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-10-21CSIT-450: Refactor LISP filesZdeno Olsovsky10-366/+336
-change file names to appropriate -move tests to appropriate files Change-Id: Icadd7b8dcee503f4026d340bbfdba488145b8c9d Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L4 and misc.selias1-68/+158
- add test cases for: L4 port range ACLs multiple classify rules L2 ACL on egress interface - add L4 configuration to mixed ACL test - add test variables for new test cases - update HTTPRequests to treat code 201 as a positive response Change-Id: If43007545fec174af12dab594f8a1b15b2e4a536 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - mixed layersselias1-6/+81
- add test cases for mixing L2 and L3 rules - update methods with mixed-acl functionality - update test variables Change-Id: I2aaa3033eede609627f751ea896e098548ffae98 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L3selias1-10/+137
- add test cases for layer 3 ACL - IPv4, IPv6, protocol/next-header - update methods with L3 functionality - update test variables Change-Id: Ia7ec03268845191021366621040dc411da0a2a93 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L2selias3-2/+87
- add keywords for accessing Honeycomb's ietf-acl node - add variable file with ietf-acl test data - add ietf-acl traffic test suite - modify bridge domain teardown keyword to unassign interfaces from the bridge domain before delete Change-Id: I6df1771f2fb9b42f30b5af8f54a384c6714f5949 Signed-off-by: selias <samelias@cisco.com>
2016-10-13CSIT-403 Data-Driven Performance Test Suite Ipmikus2-511/+190
- Rewrite performance test suites to Data-Driven approach Change-Id: I3d6932dacbf002cc78917b7e1be21f5480056da4 Signed-off-by: pmikus <pmikus@cisco.com>