aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-04-09Add vagrant setup for testing VPP device locallyLudovit Mikula14-180/+324
Fixed trailing whitespaces Fixed tabs vs. spaces Removed dead code Changed network interface naming Changed default number of retries for VPP startup to 120 Updated number of hugepages during provisioning Externalized CSIT related sysctl settings to 90-csit.conf Removed hardcoded local docker image name. Added new interface required for honeycomb device testing. Change-Id: I5eb38c8b1a4d96e4220dbd2e202e94f1d47e804e Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
2019-04-09Add support DHCP Server Support for DNVRay Kinsella1-0/+24
Adding DHCP Server support for 2-node and 3-node DNV setups Change-Id: If3d3517fd91ab46308c368910c1e79f5c25cc904 Signed-off-by: Ray Kinsella <ray.kinsella@intel.com>
2019-04-09Update of ubuntu VPP_STABLE_VERJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 19.04-rc0~640-g05f7ca1~b6800 - use new vpp ref build - ubuntu 18.04: 19.04-rc0~640-g05f7ca110 Change-Id: I940b044210d3a552fb2af75359f62795230cd2ad Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-04-09update tests after ODL bump to NeonMichal Cmarada5-32/+138
Change-Id: Ia733ad304c51b28f2a945e570120821254077189 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-04-09Fix l2 Honeycomb testsMichal Cmarada8-48/+50
Change-Id: Ic75a9279fffe3a5d11211f4e57fc635d7d33ee5f Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-04-08Upgrade autogen to NICs and search typesVratko Polak933-92827/+10548
+ All perf suites updated, as autogen change is backward incompatible. + Only x710 -ndrpdr suites remain in git repository. + Removed retry feature of run_tests. + Renamed topology_type and traffic_type to traffic_profile. + Renamed framesize to frame_size; nic_model to nic_name. + Reordered Variables table to start with nic_name and overhead. + Fixed wrong overhead value in some cbc-sha1 suites. + Fixed some suite tags. ++ Introduced tags to distinguish suites, such as IPSECINT. + Bound crypto hardware to NIC name. + Implemented NIC limit hiding. + Also search and teardown related arguments are now hidden. + Main measurement keywords updated to new arg handling. + Max rate related keywords moved to performance_limits.robot + Teardowns unified. + Generated tests are archived. ++ Generated directory is .gitignore-d. + Regenerator raises an exception on seeing non-compatible suite. ++ Relatively helpful message should be seen in exception. + Suite and template Documentation has generated parts. +- With short NIC names only. + Autogen checker also upgraded. + Tag expressions replaced with long files to ensure analogous tests. Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-08Remove lbdpdk perf testsPeter Mikus8-1244/+0
- They are not used anywhere and failing all the time. Change-Id: Ib1aec32ffeac51a48f8eda64a1832a87f56d229b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-03Remove obsolete FDS testsJan Gelety3-683/+0
Change-Id: Ie161f7003cb33596ac7856783b332a75b5dbc14e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-04-07FIX: Qemu set affinity bugPeter Mikus1-39/+30
Change-Id: If1df58628b2150b1ea3f2f56b1e3d442176b0750 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-06FIX: Operational issuesPeter Mikus46-200/+87
- FIX MSR package installation - FIX VTS - FIX sockets by removing from TCs Change-Id: I043c60f9e3e9c39cbeaee5e09b7a8351965efd35 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-05Fixes for Taishan testbedjuraj.linkes49-6051/+36
* rename NICs in Taishan testbed to Intel-X520-DA2 * fix testbed NIC selection * remove unnecessary 82599es tests * blacklist unsupported tests on Taishan testbed * lowercase previously created bash local variables Change-Id: I3b7f59e2edc00929fab2f5a0fce483f236f83075 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-04-05Add vpp-api-python for honeycomb testsMichal Cmarada2-9/+9
- Csit is migrating VAT scripts to PAPI, therefore python package for vpp is needed in honeycomb tests. Change-Id: I724cdd87e7ba899f9d9f95e08f5ce636435f7780 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-04-04Trending: Remove NF tests from alertsTibor Frank1-15/+0
Change-Id: Id8074a30f578af7df5bb15e9c127838d27cae8b0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-04Trending: AlertsTibor Frank5-84/+385
Change-Id: I1c744f4eeefe3082be02daa681bfc032d6db4d15 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-03Change 2 node Denverton testbed descriptionYulong Pei1-4/+5
Change-Id: I09c5ac3c4fe90b1fff46c4211b401daefe40ac31 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-04-02Update draft-vpolak-mkonstan-bmwg-mlrsearch-00->01.Maciek Konstantynowicz1-72/+74
Change-Id: I7345fdf63a1e7355812e5089e16e14f47cd6e890 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-04-02Trending: Remove invalid builds (3n-skx 356-372)Tibor Frank1-1/+69
Change-Id: I8de833a87536b60382c54fa9be2f443ff8a7d900 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-01CSIT-1412: Create trending graphs for svc densityTibor Frank8-55/+576
- static content - plots Change-Id: If3d77f5415acfa2efe2bc7ca13e426747b027f8e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-01CSIT-1337: Migrate L2Util library from VAT to PAPIJan Gelety6-180/+339
Change-Id: I22879c7bdd100d00216b9528663bf17406169826 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-27FIX: change socket location for vhost-user interfaceJan Gelety37-74/+74
Change-Id: Icce908d274f9fcd92e7eaa731da094b63fd3ee0e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-28Add ipsec crypto test for Denverton platformYulong Pei45-41/+4003
add ipsec cryto test to support Denverton hardware crypto device C3xxx. replace HW_cryptodev keyword to HW_DH895xcc or HW_C3xxx, or add more other hardware crypto device type support in the future. Change-Id: I181bca4095757fde7ca45ab3856273ac5930d902 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-03-28Re-enabling Honeycomb two IPs same subnet testsMichal Cmarada1-35/+29
- reordering tests so unnumbered interface tests don't break following tests - removing EXPECTED_FAILING for fixed tests Change-Id: Ic24d878849ab4f451e2fb59856c222167cb35d8f Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-03-28Report: Configure 1901.1.13Tibor Frank3-2/+5
Change-Id: I17c72ddb8bc5df364761c9e0453aeb128d7951e9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-28Fix Tap failing testsMichal Cmarada9-50/+85
Due to migration to Tap-v2 the old Tap API was removed. This fixes failing tests where Tap interface was used. Change-Id: I2f90177d2d8ee914e3ddcd3e10f212f9d72b9ac2 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-03-27CSIT-1460: Add VPP-stats to PAPI ProviderTibor Frank4-231/+380
Change-Id: I2665700a4948c481585d66c987f94af748f102c3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-26Fix virl ubuntu image + update ubuntu vpp buildsJan Gelety11-114/+129
Change-Id: Ifcb38f09a9a84c8dbae879ad34af11fe9be4a450 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-26Report: Update vpp perf tests release notesJan Gelety1-2/+2
Change-Id: I00bf6cf1d1c38a125be03a82853426e7980e088a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-26FIX: Do not restart VPP immediately after VPP installationJan Gelety4-1/+4
Change-Id: Ib3ee517c850953fe87f3036702d2924cf41a9998 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-25Trending: Set the last build for dpdk-3n-skxTibor Frank1-21/+21
- presentation_new Change-Id: I2764f6dd90b360ad778510e32d592a6295eb3236 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-25Trending: Set the last build for dpdk-3n-skxTibor Frank1-3/+3
Change-Id: Ic38ad46547c9a007cc8d59e44fcf5955956e663e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-25Trending: Fix vpp-refTibor Frank1-1/+1
Change-Id: Ie2da87f9afbe22229a35abcf8598923c888ab7ec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-25Trending: Reduce the amount of downloaded dataTibor Frank1-18/+18
Change-Id: I13aeccc993bbdd98c29845554da714ce10add5c0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-25Trending: Fix vpp-refTibor Frank1-1/+2
Change-Id: I3179175f681a99709445e6603711060e46fa8885 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-21Remove main.py as it is confusingPeter Mikus1-233/+0
People try to run main.py instead of Robot Change-Id: Ieff219c9df7586842f796c5fb17500327d71a7d1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-21Update and reorder tox.ini TODOsVratko Polak1-3/+3
Change-Id: Ieeb54f3e3cb413f15dfbf6595211fd7158aa1e1a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-03-21Convert functional tests to statefull QemuUtilsPeter Mikus20-78/+33
Change-Id: Ia1b9120c45733db64dc2dc8b03cff5ef5f167548 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-21Report: Add note about nr of test runsTibor Frank1-0/+7
Change-Id: If7a29bb268c422f788b418c597af8305e04847cf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-20CSIT-1386 KernelVM - Part IIPeter Mikus47-110/+5546
- Implementation of KernelVM (ThinVM) - nf_density tests for KernelVM with VPP as VNF. Change-Id: Ife5c2e1ab419c55cbcd442792f940db3a41da471 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-20ietf draft: nfv service density rev. -00Maciek Konstantynowicz1-0/+874
Change-Id: I0490db919b4da198545f4a332fd722855bac84a8 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-03-20Add tox checker for lengths of new lines onlyVratko Polak3-12/+67
- Still non-voting, but useful. Change-Id: Idd6f345f0f14fdbc237ff66f5e010801ea08dc5b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-03-19Update of VPP_STABLE_VERJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 19.04-rc0~214-gcae98b7~b6361 - use new vpp ref build - centos7: 19.04-rc0~214_gcae98b7~b6184 - use new vpp ref build - ubuntu 18.04: 19.04-rc0~214-gcae98b72c Change-Id: I5f8288278576fb28f5bf3754ac18b60cc21e3e6e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-19Report: Remove VNFTibor Frank8-19/+194
- add comparisons for dnv Change-Id: I123a925a3c91fba782f152b3cd73f1b63fe50c59 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-19Report: Configure 1901.1Tibor Frank3-3/+3
Change-Id: Ica2483bdaebe70b9d6668a36a1b855c52e4d7c86 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-18CSIT-1386 KernelVM - Part IPeter Mikus183-903/+484
- Refactor QemuUtils Full refactor of QemuUtils to prepare for thinner VMs. Change-Id: I171ba11a9e6e9faec582bd58df6819598b0ed0b5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-18PAPI Executor: Add more desciptive error messageTibor Frank1-1/+6
- Add more desciptive error message to the processing of replies. Change-Id: Ie43651370d5754aedf2515438c02ff4aa21bdc46 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-17Prepare image for KernelVM on machines.Peter Mikus2-2/+21
TASK [sut : Get kernel-kvm version] *************************************** changed: [10.30.51.52] TASK [sut : Download kernel-kvm] ****************************************** changed: [10.30.51.52] TASK [sut : Unpack kernel-kvm] ******************************************** changed: [10.30.51.52] PLAY RECAP **************************************************************** 10.30.51.52 : ok=4 changed=3 unreachable=0 failed=0 Change-Id: I452f35e12c94fc58374679de21e87e36b145f987 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-16FIX: Ansible warnings of deprecationPeter Mikus7-56/+50
[DEPRECATION WARNING]: Invoking "apt" only once while using a loop via squash_actions is deprecated. + aenum pip fix version + crypto dependencies Change-Id: I7ca4de48d68ec4d8a8f57fedf204fa6710a3e75f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-15Report: Fix the information about 2-Node Atom DenvertonTibor Frank2-3/+3
Change-Id: I137af7fd34d352c9ed2fba1ac5eca5a409c0ab92 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-15PAPI: Add verification of the responseTibor Frank2-39/+143
Change-Id: I86afcaeae865f0af076b8dd974386a83de07bf44 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-14Adding pip and apt packages - ubuntu16.04Jan Gelety5-2/+396
- add python3-cffi to apt list - add aenum to pip requirements Change-Id: Iac0f4f69752db7d34693e83dd14bf68ad8cdc8ee Signed-off-by: Jan Gelety <jgelety@cisco.com>