aboutsummaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2019-04-08Upgrade autogen to NICs and search typesVratko Polak909-92146/+8364
+ All perf suites updated, as autogen change is backward incompatible. + Only x710 -ndrpdr suites remain in git repository. + Removed retry feature of run_tests. + Renamed topology_type and traffic_type to traffic_profile. + Renamed framesize to frame_size; nic_model to nic_name. + Reordered Variables table to start with nic_name and overhead. + Fixed wrong overhead value in some cbc-sha1 suites. + Fixed some suite tags. ++ Introduced tags to distinguish suites, such as IPSECINT. + Bound crypto hardware to NIC name. + Implemented NIC limit hiding. + Also search and teardown related arguments are now hidden. + Main measurement keywords updated to new arg handling. + Max rate related keywords moved to performance_limits.robot + Teardowns unified. + Generated tests are archived. ++ Generated directory is .gitignore-d. + Regenerator raises an exception on seeing non-compatible suite. ++ Relatively helpful message should be seen in exception. + Suite and template Documentation has generated parts. +- With short NIC names only. + Autogen checker also upgraded. + Tag expressions replaced with long files to ensure analogous tests. Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-08Remove lbdpdk perf testsPeter Mikus8-1244/+0
- They are not used anywhere and failing all the time. Change-Id: Ib1aec32ffeac51a48f8eda64a1832a87f56d229b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-03Remove obsolete FDS testsJan Gelety2-666/+0
Change-Id: Ie161f7003cb33596ac7856783b332a75b5dbc14e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-04-06FIX: Operational issuesPeter Mikus43-152/+49
- FIX MSR package installation - FIX VTS - FIX sockets by removing from TCs Change-Id: I043c60f9e3e9c39cbeaee5e09b7a8351965efd35 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-05Fixes for Taishan testbedjuraj.linkes44-6021/+0
* rename NICs in Taishan testbed to Intel-X520-DA2 * fix testbed NIC selection * remove unnecessary 82599es tests * blacklist unsupported tests on Taishan testbed * lowercase previously created bash local variables Change-Id: I3b7f59e2edc00929fab2f5a0fce483f236f83075 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-04-01CSIT-1337: Migrate L2Util library from VAT to PAPIJan Gelety1-0/+5
Change-Id: I22879c7bdd100d00216b9528663bf17406169826 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-27FIX: change socket location for vhost-user interfaceJan Gelety36-72/+72
Change-Id: Icce908d274f9fcd92e7eaa731da094b63fd3ee0e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-28Add ipsec crypto test for Denverton platformYulong Pei42-18/+3964
add ipsec cryto test to support Denverton hardware crypto device C3xxx. replace HW_cryptodev keyword to HW_DH895xcc or HW_C3xxx, or add more other hardware crypto device type support in the future. Change-Id: I181bca4095757fde7ca45ab3856273ac5930d902 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-03-28Re-enabling Honeycomb two IPs same subnet testsMichal Cmarada1-35/+29
- reordering tests so unnumbered interface tests don't break following tests - removing EXPECTED_FAILING for fixed tests Change-Id: Ic24d878849ab4f451e2fb59856c222167cb35d8f Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-03-28Fix Tap failing testsMichal Cmarada2-18/+34
Due to migration to Tap-v2 the old Tap API was removed. This fixes failing tests where Tap interface was used. Change-Id: I2f90177d2d8ee914e3ddcd3e10f212f9d72b9ac2 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-03-26Fix virl ubuntu image + update ubuntu vpp buildsJan Gelety4-0/+10
Change-Id: Ifcb38f09a9a84c8dbae879ad34af11fe9be4a450 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-26FIX: Do not restart VPP immediately after VPP installationJan Gelety3-0/+3
Change-Id: Ib3ee517c850953fe87f3036702d2924cf41a9998 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-21Convert functional tests to statefull QemuUtilsPeter Mikus17-37/+21
Change-Id: Ia1b9120c45733db64dc2dc8b03cff5ef5f167548 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-20CSIT-1386 KernelVM - Part IIPeter Mikus38-0/+5053
- Implementation of KernelVM (ThinVM) - nf_density tests for KernelVM with VPP as VNF. Change-Id: Ife5c2e1ab419c55cbcd442792f940db3a41da471 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-18CSIT-1386 KernelVM - Part IPeter Mikus176-216/+25
- Refactor QemuUtils Full refactor of QemuUtils to prepare for thinner VMs. Change-Id: I171ba11a9e6e9faec582bd58df6819598b0ed0b5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-07FIX: Use correct MRR tagJan Gelety1-1/+1
Change-Id: I2ccb081dd99e13f94fe6e2bfc9cce068a555e12e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-06CSIT-1451: PapiHistoryTibor Frank6-12/+12
Change-Id: Idb51f377fe0c196fbe24aab21c294dad595adcd2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-06add vxlan perf test cases for Intel-X553 of Denverton platformYulong Pei2-0/+262
add below vxlan perf test cases for Intel-X553 of Denverton platform, 10ge2p1x553-ethip4vxlan-l2bdbasemaclrn-mrr.robot 10ge2p1x553-ethip4vxlan-l2bdbasemaclrn-ndrpdr.robot Change-Id: Ia0bbdd5d465bd1ac8d9930ac67099c63773a6cef Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-03-01Add ARM Taishan testbed33 perftestStanislav Chlebec44-0/+6021
Change-Id: Iaa0e7fbca7de26c7dce8b389cc3494f628a2ecd0 Signed-off-by: Stanislav Chlebec <stanislav.chlebec@pantheon.tech> Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-02-26FIX: ipsec + vpp stable version updateJan Gelety8-19/+50
- use exec ipsec sa add - use exec ipsec spd add - use exec set ipsec sa Change-Id: I69d59dd230b99d8efc9bcb5e3fbab79a8b11b18a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-02-19Adapt autogen for SFd testsVratko Polak78-33/+24
+ Make the skipping logic in autogen more flexible. + Do not emit 4c cases when there is too much VMs/containers. + Peter says the second -eth- should be renamed away from suites. + Regenerate suites so test case names match (new) suite names. Change-Id: I95ecc47ca07b8bae6693d5d4330811ff55672fc4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-09Remove VHOST 256qsize tests.Peter Mikus31-4325/+0
As per discussion, tests are not required anymore. From maintaining point of view, removing completely. Change-Id: Ic082fc6831fd46ae14b58140d20eadba8cd8f91f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-08CSIT-845 Capture VPP core-dump from vpp crash on DUTsPeter Mikus2-11/+14
Change-Id: I987dcd5092d8527c9aefbe093e1ed7ae144d191b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-06FIX: Set ipsec backend to dpdk backend when aes-gcm cipher usedJan Gelety12-0/+60
Change-Id: I008b9e0fd62cdc8e29136930762bd7412bd50181 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 2230a8ab108fa114752decfc69321ec5a47f36a6)
2019-01-30FIX: SRv6 container testsPeter Mikus6-6/+6
Change-Id: I9ec04608a9b6cf6a99c938b06261e23e58d290be Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-30FIX: Hardcode nf_density RXQ count to 1Peter Mikus76-76/+76
Change-Id: I7ca3b2ce4f4c9d8b452d9de63e7466482d15aa50 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-30Remove non-runable nf_density testsPeter Mikus18-279/+0
Remove tests that cannot run on target machines Change-Id: I2417d491e36afc9164c6981a9f5a3134529df251 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-30CSIT-1409 Implement pipeline configuration for l2bd with memif/ip4.Peter Mikus38-0/+5434
Change-Id: I7463d47a9d65069332eb2a288ff44f4499a8a467 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-29Add 2n1l-10ge2p1x710-eth-l2xcbase-eth-2vhostvr1024-1vm-soakTibor Frank1-0/+85
Change-Id: I6a045225b0ff3cc4cd9880ee05861fd7bf36c61a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-01-29PLRsearch: Initial implementation and suitesVratko Polak6-0/+454
Missing bits: - Add up-to-date .rst document (in child Change). - Prepare for releasing to PyPI.org (in child Change): -- Either copy dependencies from MLRsearch, or list in requirements. -- Perhaps move common dependencies to separate package for both search to depend on. -- All the other metadata stuff. Jira: CSIT-1276 Change-Id: I277efdb63dbb90b30e11f4e30a82e2130ac8efc3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-01-28FIX: CPU util for NFPeter Mikus1-1/+1
- Fix detecting total allocable CPUs for NFs Change-Id: If3345518befb887655d3e162551c49df3163ed92 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-28CSIT-1403 Implement multichain configuration for l2bd with memif/ip4.Peter Mikus88-50/+5484
Change-Id: Ia87156b2ba826eb0a9a93d756b9765c7373ca6ce Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-28FIX: skip tap tests due to changes APIJan Gelety4-4/+4
Change-Id: Icc703c7055047b81a8281776c78752f145d9d004 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-01-24CSIT-1407 FIX vpp install after VPP changesPeter Mikus3-21/+2
Change-Id: I9148f6de75c3100f827eedec48c4c0ccb343bc54 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-24FIX: correct call of vpp_add_routeJan Gelety39-255/+280
Change-Id: I63a2b5f484ac627c020e30c9f01a868c57aacf42 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-01-23Fix tag in 2n-10ge2p1x710-eth-l2bd-8vhost-1chain-4vm-l3fwdip4-mrrTibor Frank1-1/+1
Change-Id: Iaa268043c04a994647c5dcd704e4e61f4f83050c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-01-23NF density: added new TAGs, renamed test suites and test cases per final ↵Maciek Konstantynowicz38-618/+618
agreed scheme. Change-Id: Ia7bbfe5f7027c18a68408cc71445a2839b6b19a8 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-01-23VPP_Device - add baseline tests - part IIb)Jan Gelety4-0/+434
CSIT-1372 Add following baseline tests to VPP_Device: - ip4 eth2p-ethip4-ip4base-eth-2memif-1dcr-dev - ip6 eth2p-ethip6-ip6base-eth-2memif-1dcr-dev - l2bd eth2p-eth-l2bdbasemaclrn-eth-2memif-1dcr-dev - l2xc eth2p-eth-l2xcbase-eth-2memif-1dcr-dev Change-Id: Ic4a3a01b62d800c528a9c9371891dcc26b875220 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-01-21CSIT-1390 Implement multichain configuration for l2bd with vhost/l3fwd.Peter Mikus117-343/+5494
Change-Id: I36ab0bc7c9eada4c3f7bb5cb8f53de7d267ff910 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-17FIX SRv6 container tests after refactorPeter Mikus6-66/+36
Change-Id: I6b7961c9103587b752c6ffc2a56eb98ed1529edb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-10VPP_Device - add baseline tests - part IIa)Jan Gelety9-53/+482
CSIT-1372 Add following baseline tests to VPP_Device: - ip4 eth2p-ethip4-ip4base-eth-2vhost-1vm-dev - ip6 eth2p-ethip6-ip6base-eth-2vhost-1vm-dev - l2bd eth2p-eth-l2bdbasemaclrn-eth-2vhost-1vm-dev - l2xc eth2p-eth-l2xcbase-eth-2vhost-1vm-dev + fix doc strings in all vpp_device tests Change-Id: Icc5ed801f3e8f6dedaa611779bd86fc20102fa74 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-01-10CSIT-1389 Refactor current keywords for multichaining - CNF (II)Peter Mikus46-368/+276
Change-Id: Ic6af8ebf59589bea66322fc87a33218c7dc0c132 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-09CSIT-1389 Refactor current keywords for multichaining - CNFPeter Mikus46-460/+230
- Add ability to create matrix of containers (chains x nodeness) - Change default Docker image to csit-dut - Use new resource mapping function Change-Id: Iaac0f2efc99146fbaef0b33dc71b38770610023d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-12-19FIX: Avoid duplicated KW names in perf and func testsJan Gelety4-12/+12
Change-Id: I66c68edf6e26fa7baa7bdc5f5d60d4d4aa3af6b9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-12-18Adding DMM build artifactssharath1-0/+2
Change-Id: Ia5153d8e716d506c85ec8b723331438efd66ab6a Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-12-11Add missing = to all suite VariablesVratko Polak149-323/+323
Use the following if we ever decide '} =' is better than '}='. $ cd csit/tests $ find . -type f -print0 | xargs -0 sed -i -E 's/^\| \$\{(.*)\}= \|([^|])/\| \$\{\1\} = \|\2/g' FIXME: Add a corresponding check to https://gerrit.fd.io/r/13450 Change-Id: I73c516a0d7e475ff0986fd6515aaae10accd1a3a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-12-07VPP_Device - add baseline tests - part IJan Gelety4-12/+345
CSIT-1370 Add following baseline tests to VPP_Device: - ip4 eth2p-ethip4-ip4base-dev - ip6 eth2p-ethip6-ip6base-dev - l2bd eth2p-eth-l2bdbasemaclrn-dev Change-Id: Ic20000eb38c5511c27d020f3aa76b2620d7f7ef9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-30CSIT-1299: Revise the graphs in TrendingTibor Frank4-4/+4
Change-Id: Ie8cbc7bc8a58aca41c8cb35c14dbd8e80f027f5c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-29FIX: VPP_Device - use vpp bionic packagesJan Gelety2-1/+2
Because there is already used ubuntu bionic on VPP device testbed and used download script from pacakgecloud site donwloads packages based on host OS we need additional file to store vpp bionic stable version for VPP_Device tests. Change-Id: If834dc8af7dffa19b8ddeae013c3da9b37a5a81a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-29FIX: Exclude softwire func tests from executionJan Gelety3-2/+3
CSIT-1371 Map commands were remove from VAT by patch https://gerrit.fd.io/r/#/c/16115/. Excluding softwire functional tests from execution until corresponding csit KWs are fixed. Change-Id: I2adc580fb4770746c355f12f5ce7e7f8823255d8 Signed-off-by: Jan Gelety <jgelety@cisco.com>