aboutsummaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2018-04-05FIX: Change plugin default behavior for Container testsPeter Mikus1-1/+1
Looks like disabling all plugins in container leaving only memif_plugin.so results into issue that could lead into lost of SSH connectivity to TB or in better case to not handling any traffic. This fix is supose to return previous behavior for Container instance of VPP. Change-Id: Ie8b3ce2e35a40c8f3498e490abb6967cd4dd912a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-03PAL Trending: download input filesTibor Frank1-12/+12
Change-Id: I407e3cdeb25547d46fafed702ee608f6c0e03091 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-30Change the default plugin behavior in perf testsPeter Mikus2-47/+3
Currently we are selectively disabling plugins by creating list of disabled plugins for performance tests. Thanks to the new API in VPP we can revert the logic to selectivly enable plugins. This is more stable for future onboarding of new plugins into VPP. Change-Id: Ibdd56d6097230d095a304bbb6984b565d9428f51 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-26Optimize Qemu installation to speed up vhost testsPeter Mikus46-422/+114
Currently Qemu is being installed if there is a change of qsz parameter between tests/suites. Qemu is installed always into the same directory. This patch changes the default behavior to install qemu over and install pathced version to separate directory. It also disables force install. Change-Id: I0d7493a02b026a6ae4a5ea8bacf54656de9db567 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-22CSIT-1005: Add ipsec MRR testsVratko Polak19-180/+1567
+ 40ge2p1xl710-ethip4ipsecbasetnl-ip4base-int-aes-gcm-mrr.robot + 40ge2p1xl710-ethip4ipsecbasetnl-ip4base-int-cbc-sha1-mrr.robot + 40ge2p1xl710-ethip4ipsecbasetnlsw-ip4base-int-aes-gcm-mrr.robot + 40ge2p1xl710-ethip4ipsecbasetnlsw-ip4base-int-cbc-sha1-mrr.robot + 40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-mrr.robot + 40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-int-cbc-sha1-mrr.robot Do not add test cases for 9000B framesize yet. Improve other suites to keep the style consistent. Change-Id: I03a58e8d6745083e267b9d53bb3b85efcb2ea827 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-03-21CSIT-998: MRR testsJan Gelety17-19/+3810
- CSIT-1001: MRR tests: IP4 - ip4 - 10ge2p1x520-ethip4-ip4base-copwhtlistbase-mrr.robot - 10ge2p1x520-ethip4-ip4base-iacldstbase-mrr.robot - 10ge2p1x520-ethip4-ip4base-ipolicemarkbase-mrr.robot - 10ge2p1x520-ethip4-ip4scale200k-mrr.robot - 10ge2p1x520-ethip4-ip4scale20k-mrr.robot - 10ge2p1x520-ethip4-ip4scale2m-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-iacl1sf-10kflows-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-iacl1sl-10kflows-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-iacl50sf-10kflows-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-iacl50sl-10kflows-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-nat44-mrr.robot - 10ge2p1x520-ethip4udp-ip4scale1000-udpsrcscale15-nat44-mrr.robot - 40ge2p1xl710-ethip4-ip4base-mrr.robot - ip4_tunnels - 10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-mrr.robot - 10ge2p1x520-ethip4vxlan-l2xcbase-mrr.robot - 10ge2p1x520-ethip4lispip4-ip4base-mrr.robot Change-Id: Ibfd03aea9b97d29a8fa05e2956f6df54603a2208 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-03-20Add max-pkt-len parameter to dpdk testpmd startTibor Frank15-3/+55
Change-Id: I114c187f007c10223502669c2ba85c63d09cd84a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-20HC Tests: move honeycomb tests out of vpp directoryMarek Gradzki32-2/+10
https://gerrit.fd.io/r/#/c/9257/ moved VPP instalation to vpp/func/__init__.robot, which is run before Honeycomb suite. Instalation process starts with removing all vpp packages, which fails because of honeycomb dependency installed by bootstrap script. This patch fixes HC func jobs by moving them to separate dir. The honeycomb/func/__init__.robot was updated to include previous content of vpp/func/__init__.robot. HC perf jobs were also moved, but they may require additional care (CSIT-1006). Change-Id: I99d94272c80a4c57c85ec5cf99cddfbeab7de663 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-03-20Update the list of disabled plugginsTibor Frank2-8/+46
Change-Id: I089416953f5c3292358e443c806987dddce1c0d3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-19CSIT-935: Add mrr 9000B and 4t4c testsTibor Frank20-330/+1250
CSIT-1002: container_memif - 10ge2p1x520-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot - 10ge2p1x520-eth-l2xcbase-eth-2memif-1dcr-mrr.robot - 10ge2p1x520-eth-l2xcbase-eth-2memif-1lxc-mrr.robot - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot - 40ge2p1xl710-eth-l2xcbase-eth-2memif-1lxc-mrr.robot CSIT-1003: vm vhost - 10ge2p1x520-dot1q-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot - 10ge2p1x520-dot1q-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr256-1vm-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-eth-4vhostvr1024-2vm-mrr.robot - 10ge2p1x520-eth-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot - 10ge2p1x520-eth-l2xcbase-eth-2vhostvr256-1vm-mrr.robot - 10ge2p1x520-eth-l2xcbase-eth-4vhostvr1024-2vm-mrr.robot - 10ge2p1x520-ethip4-ip4base-eth-2vhostvr1024-1vm-mrr.robot - 10ge2p1x520-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot - 10ge2p1x520-ethip4-ip4base-eth-4vhostvr1024-2vm-mrr.robot - 10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot - 40ge2p1x710-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-4vhostvr1024-2vm-mrr.robot Change-Id: Idd049db6134179f0f9ed603569ec8512faca1ab9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-19CSIT-998: MRR testsTibor Frank21-20/+4273
- CSIT-999: MRR tests: L2 - 10ge2p1x520-eth-l2xcbase-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-mrr.robot - 10ge2p1x520-dot1q-l2bdbasemaclrn-mrr.robot - 10ge2p1x520-dot1q-l2xcbase-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-iacl1sf-10kflows-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-iacl1sl-10kflows-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-iacl50sf-10kflows-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-iacl50sl-10kflows-mrr.robot - 10ge2p1x520-eth-l2bdscale100kmaclrn-mrr.robot - 10ge2p1x520-eth-l2bdscale10kmaclrn-mrr.robot - 10ge2p1x520-eth-l2bdscale1mmaclrn-mrr.robot - 10ge2p1x710-eth-l2bdbasemaclrn-ndrpdrdisc.robot - 40ge2p1xl710-eth-l2bdbasemaclrn-mrr.robot - 40ge2p1xl710-eth-l2xcbase-mrr.robot - CSIT-1000: MRR tests: IPv6 ─ 10ge2p1x520-ethip6-ip6base-copwhtlistbase-mrr.robot - 10ge2p1x520-ethip6-ip6base-iacldstbase-mrr.robot ─ 10ge2p1x520-ethip6-ip6scale200k-mrr.robot ─ 10ge2p1x520-ethip6-ip6scale20k-mrr.robot ─ 10ge2p1x520-ethip6-ip6scale2m-mrr.robot ─ 40ge2p1xl710-ethip6-ip6base-mrr.robot Change-Id: Ie42b08151b5da3ba32b972af8b6bedf313c6d29c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-16Add vhost and memif MRR suitePeter Mikus20-8/+3411
Change-Id: Iaded13af82383955c2ff093ddc96e09682d95776 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-16VPP install and verify in __init__.robotAndrej Kilvady1-3/+22
Move VPP installation to separate test in test suite setup phase to clearly indicate any issue with VPP installation. Added test to check VPP responsiveness after installation. Change-Id: Idc2c78152e23aa7301bb5dbf9b1b6f4b639c3e84 Signed-off-by: Andrej Kilvady <andrej.kilvady@pantheon.tech>
2018-03-08CSIT-989 Fix: Reflect latest memif API changesPeter Mikus3-0/+470
Change-Id: I0c9cb073a42a8b4b7e573023e784ab9e72d0ad55 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-07FIX: MRR IPv6 tagsPeter Mikus1-3/+3
Change-Id: I2ca83b4405cd537671bf16fc57500be91455eadc Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-05Convert behavior-driven to data-driven IPv4Peter Mikus9-2071/+577
- Align test cases to data driven style for IPv4 Change-Id: Ie8fafaf7ba585e89feee417af96aa95d7ba4b4f9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-23Raw results chk keywords and initial TCPeter Mikus4-0/+687
- Implementation of Display raw results - Implementation of Traffic should pass with maximum rate - Code optimizations - L2BD, L2XC, IP4, IP6 TC Change-Id: I0b50e995a853ed3c8f88323ccc650e47b8ed2496 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-23FIX: Qemu path overridePeter Mikus1-2/+1
Currently there is bug that Qemu path is not correctly composed and cannot be properly overriden due to race condition in code. This patch is fixing functions to properly work with path. Change-Id: I276458d2d23c7a14441a4de4a56eff6431242ab9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-19FIX: Ligato testsPeter Mikus11-240/+245
- update binary search - update VPP agent ver Change-Id: If93346f43fabc8afac28b1dcfa5c44433d53a1a4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-15FIX: 10ge2p1x520-eth-l2bdscale100kmaclrn-ndrpdrdisc.robotJan Gelety1-1/+1
- tc17-9000B-4t4c-eth-l2bdscale100kmaclrn-ndrdisc Change-Id: I605f4903deb07f3a29944348cb32ac0a6747cb09 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-02-12FIX: Missing KW in suite setupPeter Mikus44-0/+44
Change-Id: I278cb8a5381735694bad73031e534b080414305b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-09Disable all plugins except DPDK by defaultJan Gelety92-182/+326
- enable corresponding plugin for ACL, NAT, MEMIF tests Change-Id: Ie8bfdcbf1734283b6412ef3015215a00ce3ebdf6 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-02-09Update the binary steps for perf test cases.Peter Mikus145-2559/+2514
- Reduce binary step fof: 64B -> 50Kpps 1518B -> 50Kpps 9000B -> 10Kpps IMIX -> 50Kpps Change-Id: Id88bff7b1c37b2a03583dd27ca3db720ec7ae4a2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-01-23Set IPFIX IPv6 test TC01 non-criticalJan Gelety1-0/+1
- TC01: DUT reports packet flow for traffic by source address Change-Id: I80a8192abda1ee440f879ae68af1e796a05b0c23 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-01-22FIX: Set pkt_variable in init file of dpdk and ligato perf testsJan Gelety2-0/+2
Change-Id: I6b63ce03adc28dcab68f6791eae5158ab4305740 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-01-17CSIT-675: SRv6 performance testsJan Gelety4-0/+758
- update L1 KWs - update L2 KWs - tests with one SID (no SRH insertion) - tests with two SIDs (SRH inserted) and decapsulation - tests with two SIDs (SRH inserted) without decapsulation - enabled packet traces and logged packet traces in the test case tear down if test failed Change-Id: I3a0f4c350eed3f42509c6d49e832faa78fe64dbb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-01-17Rename Ligato testsPeter Mikus10-150/+130
- Rename Ligato tests - Change l2bdbasemacstat to l2bdbasemaclrn Change-Id: I8a24b04f1da285082ef6c3ac90c0be7f1d8588cc Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-01-16CSIT-898: WRK improvmentsTibor Frank1-7/+15
Change-Id: I92aafaaedce5891727a983b8cf024a0fb0db7524 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-01-15FIX: Naming of test casesPeter Mikus17-236/+237
- Fix naming of VM testcases Change-Id: I1bf78f5f4ee60dd061a63280624ada9d73b34518 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-01-13HC Tests: re-enable L2-fib update revert caseMarek Gradzki1-2/+0
Change-Id: Ida6bf3f0fff4941bfe5ee18ec29fa44aa3dafb4c Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-01-10add new topology parameter: archGabriel Ganne5-9/+67
if unset, arch variable will default to "x86_64" * Note on "arm64" vs "aarch64" debian-based uses arm64 rhel-based uses aarch64 qemu binaries of both distribs uses aarch64 dpdk uses arm64 vpp uses aarch64 python machine modules uses aarch64 => prefer aarch64 to use the same nomenclature as vpp * add ARCH argument to: init_dpdk.sh, install_dpdk.sh, run_l2fwd.sh, install_tldk.sh, run_tldk.sh. default to x86_64 converts "aarch64" if needed for dpdk naming convention * fixed terminal end detection to allow "~]# " add dut node arch as param to all robot set bin calls * add --target-list flag to qemu_build.sh defaults to x86_64-softmmu * add arch flag to all the topology files * topologies/available/ (and example file) * resources/tools/virl/topologies/ * set _qemu_bin path using node['arch'] in qemu_set_node() Change-Id: If46d88d064d213d3e4c6fc584bb8e0d4b6428cb8 Signed-off-by: Gabriel Ganne <gabriel.ganne@enea.com>
2018-01-10CSIT-866: wrk onboarding in CSITTibor Frank1-0/+127
- CSIT-867: Low Level Description - CSIT-868: wrk traffic profile - parsing - CSIT-869: wrk implementation into CSIT Change-Id: I65e1037f5ae05b3a5b2020e4a6c54462766ae1b4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-01-09Set IPFIX scaling func tests non-criticalJan Gelety2-2/+3
Change-Id: I688badc47f2a7231450e02c9b56cbeec4411c016 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-01-09Add static MAC entries to configurationPeter Mikus4-0/+24
- Add static MAC entries to sfc_controller configuration of all l2bdbase tests. Change-Id: I38ba32246ed20204c5be1f98b0454b71dcff2e00 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-01-08Update NDRCHK and PDRCHK ratesPeter Mikus10-20/+20
Change-Id: Ia51d29704d35e2c9f93dcbd1bccc355c9cf64419 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-01-04Fix doc in NAT44 tests.Tibor Frank7-82/+0
Change-Id: I2b4764c9da105564bd9e240bf92251007c0f9461 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-01-03Update DPDK to v17.11Peter Mikus5-5/+5
Change-Id: Ib6db506d2691369ac7371a6a678c9dbc04a269d4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-01-02CSIT-870 Kubernetes/Ligato integrationPeter Mikus11-129/+2053
- Update overall Kubernetes/Ligato integration - CSIT-871 Update infrastructure / images - CSIT-872 Update of KubernetesUtils.py Change-Id: I7833f56abd351c694d3d3e1c9c45e649aec892e1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-12-30FIX: COP White List test casesPeter Mikus2-10/+9
Change-Id: I78f798da2e4dc7b4c8ee10b6f920687a279301b0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-12-15CSIT-861: SW cryptodev perf testsJan Gelety5-193/+904
Change-Id: I687216ca43569542d38be681ca04c898010fc65d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-12-14Update NestedVM to 1.7 in perf tests.Peter Mikus1-1/+1
Change-Id: If77b30e4597d24d1d44f1f60627b6b21b572bcfd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-12-05HC Test: reenable TC12 from BGP suiteMarek Gradzki1-2/+0
Crash on adding recoursive routes was fixed on VPP side (VPP-1084). Change-Id: I7b104eb2324a16dc8c19addd295e32f718f5c9fa Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2017-11-29CSIT-859: KW to add crypto SW device to startup.confJan Gelety11-0/+1095
Change-Id: I8441d58a2d7f604b64fff358a3cef8d72289dcdc Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-11-29HC Test: disable TC12 from BGP suite untill HC2VPP-267 is resolvedMarek Gradzki1-0/+2
TC12 crashes VPP since https://gerrit.fd.io/r/#/c/9569 was merged to VPP. Change-Id: I38b79cc36d2ab1499197c1b2db6aadcd0b8a5d66 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2017-11-29CSIT-864: Add cleanup frameworkJan Gelety1-0/+2
- workaround to avoid disc space issue on nodes when running more test loops Change-Id: I0be2fe0304c80c717a29d6544502e139e69bcdfa Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-11-21HC Test: update routing suite to use compressed IPv6 addressesMarek Gradzki1-3/+1
HC reports IPv6 addresses using compressed form since https://gerrit.fd.io/r/#/c/9497/ Change-Id: I7771ce796a4ec4817e7ee4a68fdb8e6a95f5da37 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2017-11-16HC Tests: fix packet trace library settingsMarek Gradzki3-3/+3
Fixes failures in HC tests that use Trace library The failures started to occur after https://gerrit.fd.io/r/#/c/9401/ was merged. Change-Id: I982dbe37e682a6bd7befdcb9dc370f75999e87b4 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2017-11-16HC tests: mark selected ACL test cases as rest onlyMarek Gradzki1-0/+24
Workaround for CSIT-863. ODL consumes a lot of memory which may cause vpp crashes. Change-Id: Ia26418568b126c2d261eeffb009eaf710bd8dfcb Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2017-11-14FIX: Tear down FDS functional testJan Gelety2-8/+6
- use standard Tear down functional test as part of tear down for FDS tests Change-Id: I8540683cd9c817445461cc596821fe797c1636c5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-11-13Mark HC BGP test suite as HC_REST_ONLYMarek Gradzki1-1/+2
BGP configuration via ODL is currently not fully supported in HC. This patch would disable BGP tests for hc2vpp-csit-integration-odl until HONEYCOMB-409 is fixed. Change-Id: Ic6bb28f3b6b577fcba6e05a9c28d8ee759791d9b Signed-off-by: Marek Gradzki <mgradzki@cisco.com>