aboutsummaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2017-06-30Remove vrf libTibor Frank10-10/+0
Change-Id: I38b8ddc7255602d71bec72dae704e69e8a3337f3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-30CSIT-619 HC Test: Honeycomb performance testing - initial commitselias4-0/+332
- keywords and scripts for HC performance testing setup - basic performance suite: operational data read - traffic script and keywords used in tests Change-Id: Ic0290be73a7c925ea2561f8cd2524c5cb83fcda2 Signed-off-by: selias <samelias@cisco.com>
2017-06-30HC Test: bugfix for SLAAC and ODL testsselias1-2/+2
Change-Id: I0a09482e8dc9ef2f9e6cd54a26c8d8492409f68c Signed-off-by: selias <samelias@cisco.com>
2017-06-29CSIT-687: Directory structure reorganizationTibor Frank257-746/+3701
Change-Id: I772c9e214be2461adf58124998d272e7d795220f Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-06-26HC Test: improve functional suite setup and teardownselias25-151/+186
Restart the whole stack (VPP+Honeycomb+-ODL) in between test suites. Add generic suite setup and suite teardown keywords for all func suites Re-enable NSH_SFC suite, cleanup test failures Change-Id: I71025b4ed3a7c4912dcd7b62aedef6082357990c Signed-off-by: selias <samelias@cisco.com>
2017-06-26CSIT-683: Re-organize L2 libraries - funcTibor Frank2-12/+13
Change-Id: I5444dfba68ea41d8190d6615e23505f3c08c377c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-23CSIT-689: Update PDR values in PDRCHK testsTibor Frank9-49/+49
Change-Id: I703952667a2f930de56baa2e755d70889fdea3a6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-23CSIT-614: Create PDRCHK testsTibor Frank3-9/+381
- CSIT-630: 10Ge2P1X520-Ethip4-Ip4Scale2M-pdrchk - CSIT-638: 10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-pdrchk Change-Id: I314d87acbd5906946acad97224f71c39a8cf1e04 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-23CSIT-614: Create PDRCHK testsTibor Frank4-0/+838
- CSIT-639: 10ge2p1x520-dot1q-l2bdbasemaclrn-eth-2vhost-1vm-pdrchk - CSIT-640: 10ge2p1x520-dot1q-l2xcbase-eth-2vhost-1vm-pdrchk - CSIT-641: 10ge2p1x520-ethip4-ip4base-eth-2vhost-1vm-pdrchk - CSIT-642: 10ge2p1x520-eth-l2xcbase-eth-2vhost-1vm-pdrchk Change-Id: Id676c69abe34e455ca298f7225fd065fc6cc8218 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-22HC Test: update ACL plugin test dataselias1-1/+1
Reflexive ACL name changed in https://gerrit.fd.io/r/7153 Change-Id: I59afa91a1e170eb05d643ae41d46d757f047bacb Signed-off-by: selias <samelias@cisco.com>
2017-06-20Rename 10ge2p1x520-ethip6lispip6-ip6Base-pdrchkTibor Frank1-0/+0
- 10ge2p1x520-ethip6lispip6-ip6base-pdrchk Change-Id: I7afb7b33b48813cc0d3c321dc60a42ce522cf318 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-20CSIT-678: Re-organize L2 libraries - performanceTibor Frank92-116/+116
Change-Id: Ic4e37df31fbc10f15351e3671b541e6f047405bc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-15Remove heapsize config from scale testsTibor Frank5-55/+0
Change-Id: I157c63a4c9011de9c6ac8d01171ea0604aa85d54 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-13CSIT-664: Refactor setups and teardownsTibor Frank119-954/+1207
- Add suite setup for performance IPSec tests - Add test teardown for performance SNAT tests - Add setups and teardowns for functional tests - Clean up the code Change-Id: Ia456e9f3ff0f0f2bb9a03f692f27c7f9a2817621 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-08CSIT-662: KWI - KW renamingTibor Frank204-7562/+7563
- plus: CSIT-656: Script to rename robot keywords. Change-Id: Ia69917e406a1b346b80e5ea742f6200c1c9e9d21 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-05CSIT-614: PDRCHK test for vpp-csit-verify-hw-perf jobTibor Frank10-0/+1884
Create PDRCHK test: a. vpp-verify-perf-l2 i. 10Ge2P1X520-Eth-L2Bdbasemaclrn-pdrchk ii. 10Ge2P1X520-Eth-L2Xcbase-pdrchk b. vpp-verify-perf-ip4 i. 10Ge2P1X520-Ethip4-Ip4Base-pdrchk c. vpp-verify-perf-ip6 i. 10Ge2P1X520-Ethip6-Ip6Base-pdrchk ii. 10Ge2P1X520-Ethip6-Ip6Scale2M-pdrchk d. vpp-verify-perf-lisp i. 10Ge2P1X520-Ethip4Lispip4-Ip4Base-pdrchk ii. 10Ge2P1X520-Ethip4Lispip6-Ip4Base-pdrchk iii. 10Ge2P1X520-Ethip6Lispip4-Ip6Base-pdrchk iv. 10Ge2P1X520-Ethip6Lispip6-Ip6Base-pdrchk e. vpp-verify-perf-vxlan i. 10ge2p1x520-ethip4vxlan-l2xcbase-pdrchk Change-Id: If232b0375140b884f1b65c380faf5bd77c5df5c3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-05CSIT-610 HC Test: add test cases for unnumbered interfaceselias3-4/+122
- add interface and sub-interface tests with unnumbered config - modify interface IPv4 address assignment to handle custom interfaces and sub-interfaces - pylint and style fixes Change-Id: Ic39df1655b4d44f0025a2acef9f7f968929aeff5 Signed-off-by: selias <samelias@cisco.com>
2017-06-05CSIT-524: Traffic generator using python profilesTibor Frank82-6346/+5730
Profile name structure: [trex|ixia]-[sl|sf]-[topo]-[packet structure]-[scale] - Traffic generator - T-rex (trex) or Ixia (ixia) - Stateless (sl) or statefull (sf) - Topology - 2-node topology (2n) or 3-node topology (3n) - Packet structure - eth | ip4/6 | udp - Scale - e.g. ip4dst1, ip6dst10000, 4000u15p Traffic types changed to stream profiles: - From: 2-node-bridge To: trex-sl-2n-ethip4-ip4src253 - From: 3-node-bridge To: trex-sl-3n-ethip4-ip4src254 - From: 3-node-IPv4-dst-1000000 To: trex-sl-3n-ethip4-ip4dst1000000 - From: 3-node-IPv4-dst-100000 To: trex-sl-3n-ethip4-ip4dst100000 - From: 3-node-IPv4-dst-10000 To: trex-sl-3n-ethip4-ip4dst10000 - From: 3-node-IPv4-dst-1000 To: trex-sl-3n-ethip4-ip4dst1000 - From: 3-node-IPv4-dst-100 To: trex-sl-3n-ethip4-ip4dst100 - From: 3-node-IPv4-dst-1 To: trex-sl-3n-ethip4-ip4dst1 - From: 3-node-IPv4 To: trex-sl-3n-ethip4-ip4src253 - From: 3-node-IPv6-dst-1000000 To: trex-sl-3n-ethip6-ip6dst1000000 - From: 3-node-IPv6-dst-100000 To: trex-sl-3n-ethip6-ip6dst100000 - From: 3-node-IPv6-dst-10000 To: trex-sl-3n-ethip6-ip6dst10000 - From: 3-node-IPv6 To: trex-sl-3n-ethip6-ip6src253 - From: 3-node-xconnect To: trex-sl-3n-ethip4-ip4src254 - From: 3-node-IPv4-SNAT-1000u-15p To: trex-sl-3n-ethip4udp-1000u15p - From: 3-node-IPv4-SNAT-100u-15p To: trex-sl-3n-ethip4udp-100u15p - From: 3-node-IPv4-SNAT-10u-15p To: trex-sl-3n-ethip4udp-10u15p - From: 3-node-IPv4-SNAT-1u-15p To: trex-sl-3n-ethip4udp-1u15p - From: 3-node-IPv4-SNAT-1u-1p To: trex-sl-3n-ethip4udp-1u1p - From: 3-node-IPv4-SNAT-2000u-15p To: trex-sl-3n-ethip4udp-2000u15p - From: 3-node-IPv4-SNAT-4000u-15p To: trex-sl-3n-ethip4udp-4000u15p Change-Id: If6a3cf204c93ff9f2cdccc5fd395e26b05483b58 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-05-23HC Test: update proxyARP test caseselias1-6/+8
- update to better reflect test in CSIT-functional Change-Id: I7412bfea34c867cd14ee95b857f30d6923998ff2 Signed-off-by: selias <samelias@cisco.com>
2017-05-17Func test reorg - decrease exec time per vpp patchJan Gelety40-57/+59
- remove tests covered by make test - remove some negative tests Change-Id: I35d641562ee85888f7d1dd60dd892689b1e9c52d Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-05-17CSIT-576 HC Test: Improve SPAN test coverageselias2-34/+172
- add test for multiple destination interfaces using one source interface - duplicate all existing cases using a sub-interface as the destination Change-Id: Ifabf78bca258247a19624b2b2a0474d21d1229d3 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-577 HC Test: Scripts for test jobs using ODL clientselias1-5/+12
ODL client can be used to translate Restconf requests into Netconf. This way Honeycomb's Netconf interface can be tested using existing test cases. - add bootstrap scripts for verify and integration job - update __init__.robot to handle new {HC_ODL} variable Change-Id: I7e156dab3d5434dff246bfd02090f3c6bea81b86 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-562 HC Test: Persistence suite rework, part1selias24-286/+346
- rename keywords that check operational data, to distinguish from keywords that check configuration data - modify existing persistence cases so that they don't affect each other - add feature-specific persistence tests for: Interface Management, L2 bridge - move Interface Management variables to separate file so they can be reused - add new tag HC_PERSIST to execute persistence tests separately - update existing Honeycomb tags to comply with CSIT conventions More feature-specific tests to be added in part2. Change-Id: I8657da4bb9e9a3d5261c04f5f1999b2572f605ef Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-563: HC Test: improved Lisp test coveragejan.hradil1-14/+60
added TC09-TC14 with following features: Map Resolver Map Server PETR configuration RLOC Probing Map Register Map Request mode Change-Id: I0e8a573e9a0f7ef3c688a014ff879e2b3d6b9b1e Signed-off-by: jan.hradil <jan.hradil@pantheon.tech> Signed-off-by: selias <samelias@cisco.com>
2017-05-16Add RA suppress to IPv6 Equal-cost multipath routing test caseJan Gelety1-0/+1
Change-Id: I9aa7220db01016d553cd389ad4827a3f86da9310 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-11CSIT-574: IPSec Scale File Splitsjan.hradil8-1164/+1448
split file into two separate files based on number of tunnels values 1 or 1000 corrected name errors - scale -> base Change-Id: I7114c777f3cc3d7f4951a1f59e54f3a7bbe404ec Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-05-10CSIT-573: Split SNAT scale tests to multiple filesjan.hradil7-919/+1249
split file with many test cases into mutliple files based on users and ports added SRC_USER tags removed empty lines at EOF Change-Id: I19c79cdf8d7de4147c98bc061559af1fde10ab8c Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-05-03HC Test: Update honeycomb suite setupselias1-1/+1
- remove workaround for jVPP version mismatch - increase Java API command timeout Change-Id: Ic6a61ff029cc7cdfec1f75890e18599e3b05f019 Signed-off-by: selias <samelias@cisco.com>
2017-05-03CSIT-566: Use RA suppress in LISP and VXLAN IPv6 related test casesJan Gelety19-0/+25
Change-Id: I788bf465242f5894c65b58f14d2355d29755eda5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-28Fix: VAT timeout in IPv6 scale 2MPeter Mikus2-0/+27
- Fix VAT timeout issue in IPv6 scale testing with 2M FIB entries by increasing heapsize to 3G Change-Id: Ie81619085fbd5a2a86848513d139932a12babf67 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-25Vhost testsMatej Klotton1-0/+231
Change-Id: I03722afe13722941e084bc01161f7c2af30e3cb1 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-04-25Improve doc in data driven perf testsTibor Frank6-63/+132
Change-Id: I1aed068cfd502d4064be194417e91e0459d25a88 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-04-25CSIT-534 HC Test: policer testsjan.hradil2-1/+129
Added empty lines where needed Repaired Phrasese "Given" --> "And" where necessary in mgmt-cfg-policer-apihc-func.robot Corrected English in mgmt-cfg-policer-apihc-func.robot - in TC07 Documentation Change-Id: Id99d7fd04d8f2dcae1820baa208ce338fad3a290 Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-04-24CSIT-557: Performance jobs reorganisation, part 3Tibor Frank8-8/+8
Add: - csit-vpp-perf-verify Change-Id: Ifc97228f5066f5a2ab3404b9b62d09b49af3f061 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-04-24Fix: tc02-64B-1t1c-eth-l2xcbase-eth-4vhost-2vm-pdrdiscPeter Mikus1-0/+1
- Fix missing keyword Change-Id: Iea1fa4e389f87113b205f53d0f57cbb05fcbff0a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-21Added Ethernet frame size tags for performance tests:Maciek Konstantynowicz73-1060/+1067
- 64B, 78B, IMIX, 1460B, 1480B, 1514B, 1518B, 9000B. Change-Id: I007928855ed05ac2e3aca02298b9436b9b6becdc Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-21HC Test: update plugin-ACL test suiteselias1-74/+56
- fix variables in routed icmpv6 test case - remove EXPECTED_FAILING tag from IPv6 and ICMPv6 cases - create and use keywords for test teardown Change-Id: I91792b5900015827bc2bcfd138192f972f92df28 Signed-off-by: selias <samelias@cisco.com>
2017-04-19Use QEMU virtio queue size 1024 for perf testsJan Gelety15-256/+4
- use Build QEMU KW to apply patch to increase default virtio queue size - remove Set Scheduler Policy Change-Id: I04a7febd6366abd324d42f781645a8a0b520b325 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-19Fix: IPSec+Lisp suite namingPeter Mikus1-0/+0
Change-Id: I9d5fbffbdfa257354104cd01818223ab2db229f8 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-18HC Test: update persistence suiteselias1-4/+7
- fix "enable persistence" is suite setup - update Jira links to persistence bug - log content of persistence file before each restart Change-Id: I68ad759ded5d6bee277cf946953c11f19628a9e7 Signed-off-by: selias <samelias@cisco.com>
2017-04-18Remove the tag THIS from SNAT perf testsTibor Frank2-2/+2
Change-Id: I54ac114b72763bbf1d2dd57956c0a6f99af82da1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-04-18CSIT-545: Performance tests for SNATTibor Frank2-0/+1165
- High level definition (HLD) - Low level definition (LLD) - Add keywords to set SNAT - Add tests according to HLD, LLD Change-Id: I7bf0b1870ac9c3adb36bb6590be9a3eb4ea8aa9a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-04-12IPsectptLispGpe performance test suitepmikus7-24/+363
*[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes. *[Enc] Packet Encapsulations:* IPv4-IPSec-LISPGPE-IPv4. *[Cfg] DUT configuration:* Each DUT is configured with LISP and IPsec. IPsec is in transport mode. Tests cases are for IPsec configured both on RLOC interface. Change-Id: I7a95baf0305caac3d9f0702bbedb3feec27f1668 Signed-off-by: pmikus <pmikus@cisco.com>
2017-04-12HC Test: update URL paths with ODL mountpointselias2-2/+2
other minor fixes: - update teardown keyword in proxyARP suite - increase timeout for SLAAC traffic test Change-Id: Ia16d096c54ceac501a24d5d910dd18e33d900d2a Signed-off-by: selias <samelias@cisco.com>
2017-04-11CSIT-529 HC Test: SLAACjan.hradil1-0/+119
Change-Id: I14525a36d614372b7b418f1c10f95c371b7b8545 Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-04-10HC Test: Fix proxyARP test teardownselias1-2/+0
- interface assignment is removed automatically with proxyARP settings Change-Id: Id0c7e8fd9cbb263e547ac5e2534f3e650115cb81 Signed-off-by: selias <samelias@cisco.com>
2017-04-10IPsec Multi-Tunnel performance test suiteKirill Rybalchenko4-0/+2540
Change-Id: I4b0ba83960e50089f29cab9a30ab760241c6f566 Signed-off-by: Kirill Rybalchenko <kirill.rybalchenko@intel.com>
2017-04-07CSIT-553 Make QEMU bin configurablepmikus1-1/+5
Add option to set path for QEMU binary and make it configurable in perf testaces as global variable. Change-Id: I95f4b1ab790b576f1eca02ccdb86f7a6ced80630 Signed-off-by: pmikus <pmikus@cisco.com>
2017-04-07HC Test: update ACL-plugil test suiteselias1-4/+12
- add EXPECTED_FAILING tags to IPv6 cases, next-header 17 (UDP) does not hit the classify node - fix MAC address mixup in reflexive cases Change-Id: I3d2a6c73835e23b6755b033ac3a0cc3f28d932df Signed-off-by: selias <samelias@cisco.com>
2017-04-06CSIT-552: Add xl710 perf test with 2 VMs per DUTJan Gelety3-0/+1812
- 40ge2p1xl710-eth-l2bdbasemaclrn-eth-4vhost-2vm-ndrpdrdisc - 40ge2p1xl710-eth-l2xcbase-eth-4vhost-2vm-ndrpdrdisc - 40ge2p1xl710-ethip4-ip4base-eth-4vhost-2vm-ndrpdrdisc Change-Id: I2d2f8e9b8966bd6e19014cf7a234c3c02bb9251c Signed-off-by: Jan Gelety <jgelety@cisco.com>