aboutsummaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2017-07-17FIX: remove previous QEMU build when needed to change qszJan Gelety28-27/+350
Change-Id: I949f8800b45354c205c5a5d36ab2abeeb93409dc Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-14Fix: Memif IMIX frame size test casePeter Mikus1-3/+2
Fix the variable for calculating the IMIX_v4_1 in traffic profile. Change-Id: Ia5e643c0ec2c9cd67d4506b081a919f836ac1b26 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-12CSIT-688 Create test cases for memifPeter Mikus1-0/+233
Change-Id: Ia95850af4883474a0929df8e5269b59b3de95087 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-06CSIT-622: Stateful Security Groups perf testsJan Gelety4-0/+1284
1. add L2BD iACL statefull and stateless tests with 1, 10 and 50 not-hitting ACEs in combination with 100, 10k and 100k flows per direction 2. add L2BD oACL statefull and stateless tests with 1, 10 and 50 not-hitting ACEs in combination with 100, 10k and 100k flows per direction Change-Id: Ia38589aa81b50c5ccdf2813ad6fadd22b46fffeb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-06CSIT-660: add vring1024 tuned CFS for vpp workers and guest-testpmdJan Gelety3-0/+998
- add vhost tests (L2XBD, L2XC and IP4BASE) with vring set to 1024 and tuned CFS setting Change-Id: Ief8b4b86cdecfa39bf8cf0ec90fb844edfc6f396 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-06CSIT-661: re-add vring256 tuned CFS for vpp workers and guest-testpmdJan Gelety10-62/+2141
1. add vhost tests (L2XBD, L2XC and IP4BASE) with vring set to 256 and tuned CFS setting 2. add vhost tests (L2XBD, L2XC and IP4BASE) with vring set to 256 and default CFS setting Change-Id: I25aae6839d3e621316d35f5c9525389a6faabd56 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-05 Change the bootstrap script file and test the CI-management.Fangyin Hu9-54/+201
Debug the NSH SFC functional test. Change the test cases and not use the tcpdump. Delete the unused code. Change the directory structure. Change-Id: I52486b9ba4b02e305f702ffc8cdb84e941cb18ff Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-07-04XL710 Configure rxd/txd 2048Peter Mikus13-74/+251
Configure RX-desc and TX-desc to 2048 for FVL XL710 cards. Change-Id: I1876f332bdc6100bf24f2b2317de33c0d1a4c9bf Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-06-30Remove vrf libTibor Frank10-10/+0
Change-Id: I38b8ddc7255602d71bec72dae704e69e8a3337f3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-30CSIT-619 HC Test: Honeycomb performance testing - initial commitselias4-0/+332
- keywords and scripts for HC performance testing setup - basic performance suite: operational data read - traffic script and keywords used in tests Change-Id: Ic0290be73a7c925ea2561f8cd2524c5cb83fcda2 Signed-off-by: selias <samelias@cisco.com>
2017-06-30HC Test: bugfix for SLAAC and ODL testsselias1-2/+2
Change-Id: I0a09482e8dc9ef2f9e6cd54a26c8d8492409f68c Signed-off-by: selias <samelias@cisco.com>
2017-06-29CSIT-687: Directory structure reorganizationTibor Frank257-746/+3701
Change-Id: I772c9e214be2461adf58124998d272e7d795220f Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-06-26HC Test: improve functional suite setup and teardownselias25-151/+186
Restart the whole stack (VPP+Honeycomb+-ODL) in between test suites. Add generic suite setup and suite teardown keywords for all func suites Re-enable NSH_SFC suite, cleanup test failures Change-Id: I71025b4ed3a7c4912dcd7b62aedef6082357990c Signed-off-by: selias <samelias@cisco.com>
2017-06-26CSIT-683: Re-organize L2 libraries - funcTibor Frank2-12/+13
Change-Id: I5444dfba68ea41d8190d6615e23505f3c08c377c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-23CSIT-689: Update PDR values in PDRCHK testsTibor Frank9-49/+49
Change-Id: I703952667a2f930de56baa2e755d70889fdea3a6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-23CSIT-614: Create PDRCHK testsTibor Frank3-9/+381
- CSIT-630: 10Ge2P1X520-Ethip4-Ip4Scale2M-pdrchk - CSIT-638: 10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-pdrchk Change-Id: I314d87acbd5906946acad97224f71c39a8cf1e04 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-23CSIT-614: Create PDRCHK testsTibor Frank4-0/+838
- CSIT-639: 10ge2p1x520-dot1q-l2bdbasemaclrn-eth-2vhost-1vm-pdrchk - CSIT-640: 10ge2p1x520-dot1q-l2xcbase-eth-2vhost-1vm-pdrchk - CSIT-641: 10ge2p1x520-ethip4-ip4base-eth-2vhost-1vm-pdrchk - CSIT-642: 10ge2p1x520-eth-l2xcbase-eth-2vhost-1vm-pdrchk Change-Id: Id676c69abe34e455ca298f7225fd065fc6cc8218 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-22HC Test: update ACL plugin test dataselias1-1/+1
Reflexive ACL name changed in https://gerrit.fd.io/r/7153 Change-Id: I59afa91a1e170eb05d643ae41d46d757f047bacb Signed-off-by: selias <samelias@cisco.com>
2017-06-20Rename 10ge2p1x520-ethip6lispip6-ip6Base-pdrchkTibor Frank1-0/+0
- 10ge2p1x520-ethip6lispip6-ip6base-pdrchk Change-Id: I7afb7b33b48813cc0d3c321dc60a42ce522cf318 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-20CSIT-678: Re-organize L2 libraries - performanceTibor Frank92-116/+116
Change-Id: Ic4e37df31fbc10f15351e3671b541e6f047405bc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-15Remove heapsize config from scale testsTibor Frank5-55/+0
Change-Id: I157c63a4c9011de9c6ac8d01171ea0604aa85d54 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-13CSIT-664: Refactor setups and teardownsTibor Frank119-954/+1207
- Add suite setup for performance IPSec tests - Add test teardown for performance SNAT tests - Add setups and teardowns for functional tests - Clean up the code Change-Id: Ia456e9f3ff0f0f2bb9a03f692f27c7f9a2817621 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-08CSIT-662: KWI - KW renamingTibor Frank204-7562/+7563
- plus: CSIT-656: Script to rename robot keywords. Change-Id: Ia69917e406a1b346b80e5ea742f6200c1c9e9d21 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-05CSIT-614: PDRCHK test for vpp-csit-verify-hw-perf jobTibor Frank10-0/+1884
Create PDRCHK test: a. vpp-verify-perf-l2 i. 10Ge2P1X520-Eth-L2Bdbasemaclrn-pdrchk ii. 10Ge2P1X520-Eth-L2Xcbase-pdrchk b. vpp-verify-perf-ip4 i. 10Ge2P1X520-Ethip4-Ip4Base-pdrchk c. vpp-verify-perf-ip6 i. 10Ge2P1X520-Ethip6-Ip6Base-pdrchk ii. 10Ge2P1X520-Ethip6-Ip6Scale2M-pdrchk d. vpp-verify-perf-lisp i. 10Ge2P1X520-Ethip4Lispip4-Ip4Base-pdrchk ii. 10Ge2P1X520-Ethip4Lispip6-Ip4Base-pdrchk iii. 10Ge2P1X520-Ethip6Lispip4-Ip6Base-pdrchk iv. 10Ge2P1X520-Ethip6Lispip6-Ip6Base-pdrchk e. vpp-verify-perf-vxlan i. 10ge2p1x520-ethip4vxlan-l2xcbase-pdrchk Change-Id: If232b0375140b884f1b65c380faf5bd77c5df5c3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-05CSIT-610 HC Test: add test cases for unnumbered interfaceselias3-4/+122
- add interface and sub-interface tests with unnumbered config - modify interface IPv4 address assignment to handle custom interfaces and sub-interfaces - pylint and style fixes Change-Id: Ic39df1655b4d44f0025a2acef9f7f968929aeff5 Signed-off-by: selias <samelias@cisco.com>
2017-06-05CSIT-524: Traffic generator using python profilesTibor Frank82-6346/+5730
Profile name structure: [trex|ixia]-[sl|sf]-[topo]-[packet structure]-[scale] - Traffic generator - T-rex (trex) or Ixia (ixia) - Stateless (sl) or statefull (sf) - Topology - 2-node topology (2n) or 3-node topology (3n) - Packet structure - eth | ip4/6 | udp - Scale - e.g. ip4dst1, ip6dst10000, 4000u15p Traffic types changed to stream profiles: - From: 2-node-bridge To: trex-sl-2n-ethip4-ip4src253 - From: 3-node-bridge To: trex-sl-3n-ethip4-ip4src254 - From: 3-node-IPv4-dst-1000000 To: trex-sl-3n-ethip4-ip4dst1000000 - From: 3-node-IPv4-dst-100000 To: trex-sl-3n-ethip4-ip4dst100000 - From: 3-node-IPv4-dst-10000 To: trex-sl-3n-ethip4-ip4dst10000 - From: 3-node-IPv4-dst-1000 To: trex-sl-3n-ethip4-ip4dst1000 - From: 3-node-IPv4-dst-100 To: trex-sl-3n-ethip4-ip4dst100 - From: 3-node-IPv4-dst-1 To: trex-sl-3n-ethip4-ip4dst1 - From: 3-node-IPv4 To: trex-sl-3n-ethip4-ip4src253 - From: 3-node-IPv6-dst-1000000 To: trex-sl-3n-ethip6-ip6dst1000000 - From: 3-node-IPv6-dst-100000 To: trex-sl-3n-ethip6-ip6dst100000 - From: 3-node-IPv6-dst-10000 To: trex-sl-3n-ethip6-ip6dst10000 - From: 3-node-IPv6 To: trex-sl-3n-ethip6-ip6src253 - From: 3-node-xconnect To: trex-sl-3n-ethip4-ip4src254 - From: 3-node-IPv4-SNAT-1000u-15p To: trex-sl-3n-ethip4udp-1000u15p - From: 3-node-IPv4-SNAT-100u-15p To: trex-sl-3n-ethip4udp-100u15p - From: 3-node-IPv4-SNAT-10u-15p To: trex-sl-3n-ethip4udp-10u15p - From: 3-node-IPv4-SNAT-1u-15p To: trex-sl-3n-ethip4udp-1u15p - From: 3-node-IPv4-SNAT-1u-1p To: trex-sl-3n-ethip4udp-1u1p - From: 3-node-IPv4-SNAT-2000u-15p To: trex-sl-3n-ethip4udp-2000u15p - From: 3-node-IPv4-SNAT-4000u-15p To: trex-sl-3n-ethip4udp-4000u15p Change-Id: If6a3cf204c93ff9f2cdccc5fd395e26b05483b58 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-05-23HC Test: update proxyARP test caseselias1-6/+8
- update to better reflect test in CSIT-functional Change-Id: I7412bfea34c867cd14ee95b857f30d6923998ff2 Signed-off-by: selias <samelias@cisco.com>
2017-05-17Func test reorg - decrease exec time per vpp patchJan Gelety40-57/+59
- remove tests covered by make test - remove some negative tests Change-Id: I35d641562ee85888f7d1dd60dd892689b1e9c52d Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-05-17CSIT-576 HC Test: Improve SPAN test coverageselias2-34/+172
- add test for multiple destination interfaces using one source interface - duplicate all existing cases using a sub-interface as the destination Change-Id: Ifabf78bca258247a19624b2b2a0474d21d1229d3 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-577 HC Test: Scripts for test jobs using ODL clientselias1-5/+12
ODL client can be used to translate Restconf requests into Netconf. This way Honeycomb's Netconf interface can be tested using existing test cases. - add bootstrap scripts for verify and integration job - update __init__.robot to handle new {HC_ODL} variable Change-Id: I7e156dab3d5434dff246bfd02090f3c6bea81b86 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-562 HC Test: Persistence suite rework, part1selias24-286/+346
- rename keywords that check operational data, to distinguish from keywords that check configuration data - modify existing persistence cases so that they don't affect each other - add feature-specific persistence tests for: Interface Management, L2 bridge - move Interface Management variables to separate file so they can be reused - add new tag HC_PERSIST to execute persistence tests separately - update existing Honeycomb tags to comply with CSIT conventions More feature-specific tests to be added in part2. Change-Id: I8657da4bb9e9a3d5261c04f5f1999b2572f605ef Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-563: HC Test: improved Lisp test coveragejan.hradil1-14/+60
added TC09-TC14 with following features: Map Resolver Map Server PETR configuration RLOC Probing Map Register Map Request mode Change-Id: I0e8a573e9a0f7ef3c688a014ff879e2b3d6b9b1e Signed-off-by: jan.hradil <jan.hradil@pantheon.tech> Signed-off-by: selias <samelias@cisco.com>
2017-05-16Add RA suppress to IPv6 Equal-cost multipath routing test caseJan Gelety1-0/+1
Change-Id: I9aa7220db01016d553cd389ad4827a3f86da9310 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-11CSIT-574: IPSec Scale File Splitsjan.hradil8-1164/+1448
split file into two separate files based on number of tunnels values 1 or 1000 corrected name errors - scale -> base Change-Id: I7114c777f3cc3d7f4951a1f59e54f3a7bbe404ec Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-05-10CSIT-573: Split SNAT scale tests to multiple filesjan.hradil7-919/+1249
split file with many test cases into mutliple files based on users and ports added SRC_USER tags removed empty lines at EOF Change-Id: I19c79cdf8d7de4147c98bc061559af1fde10ab8c Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-05-03HC Test: Update honeycomb suite setupselias1-1/+1
- remove workaround for jVPP version mismatch - increase Java API command timeout Change-Id: Ic6a61ff029cc7cdfec1f75890e18599e3b05f019 Signed-off-by: selias <samelias@cisco.com>
2017-05-03CSIT-566: Use RA suppress in LISP and VXLAN IPv6 related test casesJan Gelety19-0/+25
Change-Id: I788bf465242f5894c65b58f14d2355d29755eda5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-28Fix: VAT timeout in IPv6 scale 2MPeter Mikus2-0/+27
- Fix VAT timeout issue in IPv6 scale testing with 2M FIB entries by increasing heapsize to 3G Change-Id: Ie81619085fbd5a2a86848513d139932a12babf67 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-25Vhost testsMatej Klotton1-0/+231
Change-Id: I03722afe13722941e084bc01161f7c2af30e3cb1 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-04-25Improve doc in data driven perf testsTibor Frank6-63/+132
Change-Id: I1aed068cfd502d4064be194417e91e0459d25a88 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-04-25CSIT-534 HC Test: policer testsjan.hradil2-1/+129
Added empty lines where needed Repaired Phrasese "Given" --> "And" where necessary in mgmt-cfg-policer-apihc-func.robot Corrected English in mgmt-cfg-policer-apihc-func.robot - in TC07 Documentation Change-Id: Id99d7fd04d8f2dcae1820baa208ce338fad3a290 Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-04-24CSIT-557: Performance jobs reorganisation, part 3Tibor Frank8-8/+8
Add: - csit-vpp-perf-verify Change-Id: Ifc97228f5066f5a2ab3404b9b62d09b49af3f061 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-04-24Fix: tc02-64B-1t1c-eth-l2xcbase-eth-4vhost-2vm-pdrdiscPeter Mikus1-0/+1
- Fix missing keyword Change-Id: Iea1fa4e389f87113b205f53d0f57cbb05fcbff0a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-21Added Ethernet frame size tags for performance tests:Maciek Konstantynowicz73-1060/+1067
- 64B, 78B, IMIX, 1460B, 1480B, 1514B, 1518B, 9000B. Change-Id: I007928855ed05ac2e3aca02298b9436b9b6becdc Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-21HC Test: update plugin-ACL test suiteselias1-74/+56
- fix variables in routed icmpv6 test case - remove EXPECTED_FAILING tag from IPv6 and ICMPv6 cases - create and use keywords for test teardown Change-Id: I91792b5900015827bc2bcfd138192f972f92df28 Signed-off-by: selias <samelias@cisco.com>
2017-04-19Use QEMU virtio queue size 1024 for perf testsJan Gelety15-256/+4
- use Build QEMU KW to apply patch to increase default virtio queue size - remove Set Scheduler Policy Change-Id: I04a7febd6366abd324d42f781645a8a0b520b325 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-19Fix: IPSec+Lisp suite namingPeter Mikus1-0/+0
Change-Id: I9d5fbffbdfa257354104cd01818223ab2db229f8 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-18HC Test: update persistence suiteselias1-4/+7
- fix "enable persistence" is suite setup - update Jira links to persistence bug - log content of persistence file before each restart Change-Id: I68ad759ded5d6bee277cf946953c11f19628a9e7 Signed-off-by: selias <samelias@cisco.com>
2017-04-18Remove the tag THIS from SNAT perf testsTibor Frank2-2/+2
Change-Id: I54ac114b72763bbf1d2dd57956c0a6f99af82da1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-04-18CSIT-545: Performance tests for SNATTibor Frank2-0/+1165
- High level definition (HLD) - Low level definition (LLD) - Add keywords to set SNAT - Add tests according to HLD, LLD Change-Id: I7bf0b1870ac9c3adb36bb6590be9a3eb4ea8aa9a Signed-off-by: Tibor Frank <tifrank@cisco.com>