aboutsummaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2018-06-29SetupFramework to detect failures, part IIPeter Mikus4-2/+9
- This patch is enforcing evaluation and aligning all __init__.robot files to use the same logic. Change-Id: I9e2bf5e904bb6d22f4e6a153c951c3b3c233e2fb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-21Fix TC02 test case in mgmt-cfg-int-subint-apihc-apivat-funcMichal Cmarada1-0/+2
Add wait for interface to be up, because it takes some time while the interface state changes. Change-Id: I895dea1017ac0ffd099e80d9edca0f1d127657dd Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
2018-06-21HC2VPP-331: Fix Honeycomb fails to assign VRF to interfaceMichal Cmarada2-31/+33
- add configuration for FIB table management to test suite - fix routing test suite HC2VPP-331 bugs - fix intip4-intip6 test suite HC2VPP-331 bugs Change-Id: I0b1e9ed787d9fb68e76a6d61c1eea2519a36a6c4 Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
2018-06-15CSIT-1085 eth-l2xcbase-eth-1memif-1dcrPeter Mikus4-0/+1160
Test case definitions Change-Id: I03736ef003d3839859dc450745323362b21aa75e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-13FIX: TAG processingPeter Mikus2-2/+2
- Improve TAG post processing Change-Id: I5a36f5874ea747cbcae2562fc58c9f5abe9bac02 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-08CSIT-1114 Add DPDK download to bootstrapPeter Mikus5-17/+13
- Add downloading artifacts to bootstrap to be able to use latest dpdk version Change-Id: I5f07e8207780b81ad85b6053db99639c47448409 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-08CSIT-1081 Container VPP configuration refactorPeter Mikus17-0/+17
Adopt code for various topology configurations. Change-Id: Iaf9d7995ab8cd06da0c56c5e5664d57d19e74d7c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-07CSIT-1121: Add "Get DPDK version" KW to DPDK testsTibor Frank1-2/+2
Change-Id: I6152b3b7d4895a376914166d03ee9ca15ea9eb32 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-05CSIT-1115: Add dpdk mrr testsTibor Frank4-0/+875
Change-Id: Ib9d060f7e0d476b79debc750409da5277478e5b4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-06-01VPP link bonding - lacp modeJan Gelety8-0/+2774
CSIT-1072 CSIT-1083 CSIT-1084 Change-Id: Icaf0e09af633d301306a84251f47822e95b411a2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-06-01HC Tests: disable failing ACL ODL tests (HC2VPP-337)Marek Gradzki1-0/+18
Change-Id: I1fa3e3876bcc0b4f5e9908cb4f6920d49eb6dd45 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-05-31DPDK link bonding: xor modeJan Gelety8-0/+2760
CSIT-1073 CSIT-1074 CSIT-1077 Change-Id: I248e079021c30988210fd792b32d5afdca71aadb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-05-25HC Tests: mark VRF assignment tests as failing (HC2VPP-331)Marek Gradzki2-0/+22
Failures might be related to: https://gerrit.fd.io/r/#/c/12643/ Change-Id: I0c60d51e27508f937a4b2d6c6b5e6f0703f793ab Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-05-25HC Tests: mark unnumbered interface tests as failing (HC2VPP-330)Marek Gradzki2-0/+16
Failures might be related to: https://gerrit.fd.io/r/#/c/12632/ and/or: https://gerrit.fd.io/r/#/c/12646/ Change-Id: I529582ef95b6cf752a3f0e98cd0326d4a01d15a8 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-05-23CSIT-1087: Add SRv6 MRR testsTibor Frank12-16/+1535
Change-Id: Ia90a9bff6791518ba08fa81e6167e96aea7714d5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-17HC tests: fix log archiveMarek Gradzki1-1/+1
Use 'Archive Honeycomb logs' instaed of Archive Honeycomb Logs. The keyword was renamed by https://gerrit.fd.io/r/#/c/12578/ Change-Id: Ic0e2759637ecd0056b7accc3cd96bd8510a2ed14 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-05-17HC Tests: fix CPU layout retrieval in the HC perf jobMarek Gradzki1-0/+1
Change-Id: Id99e41a28d01e41d6fb51190d4ab86b667f828af Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-05-16HC tests: archive ODL logs (CSIT-1031)Marek Gradzki1-1/+1
Change-Id: I444a5d6cd32cb9ee68575dfdb5a208de2c4eb72a Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-05-14CSIT-1036 Expose option to install DKMS in containerPeter Mikus14-0/+14
Expose DKMS installation as suite variable. This will allow to use DPDK driver for future tests. Change-Id: I38fd014c8cf6f4bf42881af2196cadc679fe53e0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-10Cleanup DPDK framework setupPeter Mikus1-2/+4
Moving installation of DPDK into KW instead of framework setup. This will unify the framework setup and allow future optimizations. Change-Id: I360ba95a2858e73e4bbb12020567d5d174ab69ca Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-10HC2VPP-253 - Update routing csit jobsMichal Cmarada1-1/+1
this fixes test failures caused by HC2VPP routing models bump (https://gerrit.fd.io/r/#/c/10954) - updates tests for bgp routing - updates tests for routing - updates SLAAC test because of changes in rt-advertisements Change-Id: Iacc37b42e6523f440d77241c18ca8e61d1d01f23 Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
2018-05-09Report: Fix grepsTibor Frank5-5/+5
Change-Id: I450d5e9fa1cbd4a40caec68f3fc4674f744f1168 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-04CSIT-992: Add two suites using optimized searchVratko Polak2-0/+314
+ Add 10ge2p1x520-ethip4-ip4base-ndrpdr.robot + Add 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-ndrpdr.robot + Make sure both IMIX and 9000B test cases are there. + Document NDRPDR test tag. + Execute some of NDRPDR tests daily. Change-Id: I66427d49cb6b8304fde4e8d91606de33b624186a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-04FIX: TCP perf testsTibor Frank1-2/+2
Change-Id: I59ad8ef70fc2bedce14b52359922a002f960ab7a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-02FIX: Docker container imagePeter Mikus3-3/+3
Change-Id: I127fe11b9095fb24a536dce7d6c26c7e7fd4be4e Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 64da7d69dfe8d8f89656dc3dba56b0eaef059020)
2018-05-02Remove obsolete NDRPDR checksPeter Mikus38-7886/+0
Change-Id: If495493f4dce8d2eecfb8c06bcd587f315b70b1d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-27FIX: Add api-segment conf to TCP testsTibor Frank1-1/+3
Change-Id: Idf778d8427c8dabf716090cdaeba189e8cccfb98 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27FIX: tc12-IMIX-4t4c-eth-l2bdbasemaclrn-mrrJan Gelety1-1/+1
Change-Id: I193411e97f069982fca8408e5e5a42cd577586ed Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-04-24Use /64 prefix for IPv6 subnet on vhost interfaceNeale Ranns1-1/+1
Change-Id: Iee512d6f5c107e7b2e5fdc7412e07d34a1c6bbd0 Signed-off-by: Neale Ranns <nranns@cisco.com>
2018-04-24FIX: TCP perf testsTibor Frank1-1/+1
Change-Id: I6424722641b0cefdf1945b57996bf2c48dc86a3b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-23CSIT-1009: SRv6 proxy testsJan Gelety3-0/+828
- SRv6 with endpoint to SR-unaware Service Function via static proxy - SRv6 with endpoint to SR-unaware Service Function via dynamic proxy - SRv6 with endpoint to SR-unaware Service Function via masquerading proxy Change-Id: I6a6062cb41d810bf9e27dacfd866181bfde4c693 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-04-20FIX: Restart VPP in container before each testPeter Mikus11-11/+33
Change-Id: Iec7045aadc0675e04b8c74cbe28f8b3f193bcf1f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-20FIX: Configure number of memif queus properlyPeter Mikus11-22/+22
Change-Id: I2dcb0300829bc961c80cc30d972d0563aeba9364 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-17Update of VPP_STABLE_VER filesJan Gelety2-0/+2
- use new vpp ref build - ubuntu 16.04: 18.07-rc0~49-gfe7d4a2~b4105_amd64 - use new vpp ref build - centos7: 18.07-rc0~49_gfe7d4a2~b4073.x86_64 - two IPSEC-LISP-GPE test suites tagged "EXPECTED_FAILING" as there is a bug in the test case - fix is under preparation and will be merged soon Change-Id: Ia8cffeb63a931cd089fba3c9b2ceec987f2ab347 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-04-16Make default driver configurablePeter Mikus2-0/+4
- Make UIO driver configurable from global variables. - Prepare code for uio_pci_generic to vfio-pci change Change-Id: I2b49201177a92f51673242a30e2fd8d4f7e59694 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-13FIX: CSIT-1044 Dpdk-testpmd 9000B tests failingPeter Mikus1-1/+1
Change-Id: If2b27912f2523e9e7d3c24dd8c310cfcb3e935b2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-12Add log-level 8 to DPDK init sequencePeter Mikus2-5/+7
- Add --log-level 8 for testpmd init - Fix txqflags parameter for testpmd 18.02 Change-Id: Icc687ffdd7cf3ab5fa8ece0f3ce2eb03996b22cf Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-11CSIT-1040: Static content improvementsTibor Frank2-24/+24
Change-Id: I8c9290cc93496794f30275ee23cc013146be94fd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-11CSIT-1037 K8s container extensionsPeter Mikus10-0/+3157
- Add new K8S topologies on i40 based nic Change-Id: Id20f1e15dab347edee128633230aa098b774e43d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-11Update DPDK to 18.02Peter Mikus5-6/+5
- Update DPDK version to 18.02 - Code cleanup. Change-Id: I33e2aa35cc80092561a4db99d75bdc7e4b62df3a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-11Cleanup perf bootstrapPeter Mikus3-4/+13
- Remove the DPDK_TEST variable and replace it by internal global variable - Unify all perf boostrap for merge in future. - Cleanup ligato perf bootstrap. Change-Id: Id47d6614c8dd18a701493e00056ef17d2e37fc5c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-10FIX: Crypto execution orderPeter Mikus18-0/+67
Currently, VAT history looks like this: sw_interface_set_flags sw_if_index 2 admin-up sw_interface_set_flags sw_if_index 1 admin-up sw_interface_dump sw_interface_set_flags sw_if_index 2 admin-up sw_interface_set_flags sw_if_index 1 admin-up sw_interface_add_del_address sw_if_index 2 192.168.10.1/24 sw_interface_add_del_address sw_if_index 1 172.168.1.1/24 ip_neighbor_add_del sw_if_index 2 dst 192.168.10.2 mac 68:05:ca:3a:af:40 ip_neighbor_add_del sw_if_index 1 dst 172.168.1.2 mac 68:05:ca:35:78:e9 ip_add_del_route 10.0.0.0/8 via 192.168.10.2 sw_if_index 2 resolve-attempts 10 count 1 exec exec /tmp/ipsec_create_tunnel_dut1.config It should be like this: sw_interface_add_del_address sw_if_index 2 192.168.10.1/24 sw_interface_add_del_address sw_if_index 1 172.168.1.1/24 ip_neighbor_add_del sw_if_index 2 dst 192.168.10.2 mac 68:05:ca:3a:af:40 ip_neighbor_add_del sw_if_index 1 dst 172.168.1.2 mac 68:05:ca:35:78:e9 ip_add_del_route 10.0.0.0/8 via 192.168.10.2 sw_if_index 2 resolve-attempts 10 count 1 exec exec /tmp/ipsec_create_tunnel_dut1.config sw_interface_set_flags sw_if_index 2 admin-up sw_interface_set_flags sw_if_index 1 admin-up Change-Id: I4e943436dee00166966b4f53d9d0a40440bbf1e4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-06FIX: Remove Niantic from x710 and xl710Tibor Frank3-3/+3
Change-Id: I3e41f30534870c2e4084f7fa81d5a757f08377ea Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-06FIX: Jumbo frames are not receivedTibor Frank2-2/+2
- 10ge2p1x710-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot - 10ge2p1x710-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot Change-Id: I69f6fcb7c7cae46a8061fd75db9be2933154c3f9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-06CSIT-1032: MRR Tests: IPv6, x710Tibor Frank6-0/+1350
─ 10ge2p1x710-ethip6-ip6base-copwhtlistbase-mrr.robot ─ 10ge2p1x710-ethip6-ip6base-iacldstbase-mrr.robot ─ 10ge2p1x710-ethip6-ip6base-mrr.robot ─ 10ge2p1x710-ethip6-ip6scale200k-mrr.robot ─ 10ge2p1x710-ethip6-ip6scale20k-mrr.robot ─ 10ge2p1x710-ethip6-ip6scale2m-mrr.robot Change-Id: I270c1e52e61fd9765f139983d133432a3058c722 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-06CSIT-1035: MRR Tests: container_memif, x710Tibor Frank3-0/+668
─ 10ge2p1x710-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot ─ 10ge2p1x710-eth-l2xcbase-eth-2memif-1dcr-mrr.robot ─ 10ge2p1x710-eth-l2xcbase-eth-2memif-1lxc-mrr.robot Change-Id: I1ad44fc2a7f27edb060953cb301fda4abcffe52b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-06CSIT-1033: MRR Tests: L2, x710Tibor Frank11-2/+2307
─ 10ge2p1x710-dot1q-l2bdbasemaclrn-mrr.robot ─ 10ge2p1x710-dot1q-l2xcbase-mrr.robot ─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl1sf-10kflows-mrr.robot ─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl1sl-10kflows-mrr.robot ─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl50sf-10kflows-mrr.robot ─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl50sl-10kflows-mrr.robot ─ 10ge2p1x710-eth-l2bdscale100kmaclrn-mrr.robot ─ 10ge2p1x710-eth-l2bdscale10kmaclrn-mrr.robot ─ 10ge2p1x710-eth-l2bdscale1mmaclrn-mrr.robot ─ 10ge2p1x710-eth-l2xcbase-mrr.robot Change-Id: Ic5d5cb377eca25daaeb22e8390632a6d6421c2e3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-06CSIT-1030: Add x710 MRR tests - vm_vhostVratko Polak11-0/+2721
+ 10ge2p1x710-dot1q-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot + 10ge2p1x710-dot1q-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot + 10ge2p1x710-eth-l2bdbasemaclrn-eth-2vhostvr256-1vm-mrr.robot + 10ge2p1x710-eth-l2bdbasemaclrn-eth-4vhostvr1024-2vm-mrr.robot + 10ge2p1x710-eth-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot + 10ge2p1x710-eth-l2xcbase-eth-2vhostvr256-1vm-mrr.robot + 10ge2p1x710-eth-l2xcbase-eth-4vhostvr1024-2vm-mrr.robot + 10ge2p1x710-ethip4-ip4base-eth-2vhostvr1024-1vm-mrr.robot + 10ge2p1x710-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot + 10ge2p1x710-ethip4-ip4base-eth-4vhostvr1024-2vm-mrr.robot + 10ge2p1x710-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot Copies of the respective x520 files, with each "X520-DA2" or "X520" replaced by "X710". Occurences of "Niantic" were removed. Change-Id: I15bce75b704072b26a908f868e90a42dc3ea7661 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-04-06CSIT-1020: MRR Day 2 - x710Jan Gelety17-1/+3745
- CSIT-1029: x710 MRR tests - IP4 - ip4 -10ge2p1x710-ethip4-ip4base-copwhtlistbase-mrr.robot -10ge2p1x710-ethip4-ip4base-iacldstbase-mrr.robot -10ge2p1x710-ethip4-ip4base-ipolicemarkbase-mrr.robot -10ge2p1x710-ethip4-ip4base-mrr.robot -10ge2p1x710-ethip4-ip4scale200k-mrr.robot -10ge2p1x710-ethip4-ip4scale20k-mrr.robot -10ge2p1x710-ethip4-ip4scale2m-mrr.robot -10ge2p1x710-ethip4udp-ip4base-iacl1sf-10kflows-mrr.robot -10ge2p1x710-ethip4udp-ip4base-iacl1sl-10kflows-mrr.robot -10ge2p1x710-ethip4udp-ip4base-iacl50sf-10kflows-mrr.robot -10ge2p1x710-ethip4udp-ip4base-iacl50sl-10kflows-mrr.robot -10ge2p1x710-ethip4udp-ip4base-nat44-mrr.robot - 10ge2p1x710-ethip4udp-ip4scale1000-udpsrcscale15-nat44-mrr.robot - ip4_tunnels -10ge2p1x710-ethip4lispip4-ip4base-mrr.robot -10ge2p1x710-ethip4vxlan-l2bdbasemaclrn-mrr.robot - 10ge2p1x710-ethip4vxlan-l2xcbase-mrr.robot Change-Id: I141bbd8039f4a5993c77758b1c410dcbd203ab97 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-04-06CSIT-1008: Fix 9000B VM Vhost performance testsTibor Frank6-2213/+803
Change-Id: I63105e8a4f11d740c38fc6123984005bcefa117b Signed-off-by: Tibor Frank <tifrank@cisco.com>