aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-04-08Upgrade autogen to NICs and search typesVratko Polak933-92827/+10548
+ All perf suites updated, as autogen change is backward incompatible. + Only x710 -ndrpdr suites remain in git repository. + Removed retry feature of run_tests. + Renamed topology_type and traffic_type to traffic_profile. + Renamed framesize to frame_size; nic_model to nic_name. + Reordered Variables table to start with nic_name and overhead. + Fixed wrong overhead value in some cbc-sha1 suites. + Fixed some suite tags. ++ Introduced tags to distinguish suites, such as IPSECINT. + Bound crypto hardware to NIC name. + Implemented NIC limit hiding. + Also search and teardown related arguments are now hidden. + Main measurement keywords updated to new arg handling. + Max rate related keywords moved to performance_limits.robot + Teardowns unified. + Generated tests are archived. ++ Generated directory is .gitignore-d. + Regenerator raises an exception on seeing non-compatible suite. ++ Relatively helpful message should be seen in exception. + Suite and template Documentation has generated parts. +- With short NIC names only. + Autogen checker also upgraded. + Tag expressions replaced with long files to ensure analogous tests. Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-08Remove lbdpdk perf testsPeter Mikus8-1244/+0
- They are not used anywhere and failing all the time. Change-Id: Ib1aec32ffeac51a48f8eda64a1832a87f56d229b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-03Remove obsolete FDS testsJan Gelety3-683/+0
Change-Id: Ie161f7003cb33596ac7856783b332a75b5dbc14e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-04-07FIX: Qemu set affinity bugPeter Mikus1-39/+30
Change-Id: If1df58628b2150b1ea3f2f56b1e3d442176b0750 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-06FIX: Operational issuesPeter Mikus46-200/+87
- FIX MSR package installation - FIX VTS - FIX sockets by removing from TCs Change-Id: I043c60f9e3e9c39cbeaee5e09b7a8351965efd35 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-05Fixes for Taishan testbedjuraj.linkes49-6051/+36
* rename NICs in Taishan testbed to Intel-X520-DA2 * fix testbed NIC selection * remove unnecessary 82599es tests * blacklist unsupported tests on Taishan testbed * lowercase previously created bash local variables Change-Id: I3b7f59e2edc00929fab2f5a0fce483f236f83075 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-04-05Add vpp-api-python for honeycomb testsMichal Cmarada2-9/+9
- Csit is migrating VAT scripts to PAPI, therefore python package for vpp is needed in honeycomb tests. Change-Id: I724cdd87e7ba899f9d9f95e08f5ce636435f7780 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-04-04Trending: Remove NF tests from alertsTibor Frank1-15/+0
Change-Id: Id8074a30f578af7df5bb15e9c127838d27cae8b0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-04Trending: AlertsTibor Frank5-84/+385
Change-Id: I1c744f4eeefe3082be02daa681bfc032d6db4d15 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-03Change 2 node Denverton testbed descriptionYulong Pei1-4/+5
Change-Id: I09c5ac3c4fe90b1fff46c4211b401daefe40ac31 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-04-02Update draft-vpolak-mkonstan-bmwg-mlrsearch-00->01.Maciek Konstantynowicz1-72/+74
Change-Id: I7345fdf63a1e7355812e5089e16e14f47cd6e890 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-04-02Trending: Remove invalid builds (3n-skx 356-372)Tibor Frank1-1/+69
Change-Id: I8de833a87536b60382c54fa9be2f443ff8a7d900 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-01CSIT-1412: Create trending graphs for svc densityTibor Frank8-55/+576
- static content - plots Change-Id: If3d77f5415acfa2efe2bc7ca13e426747b027f8e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-01CSIT-1337: Migrate L2Util library from VAT to PAPIJan Gelety6-180/+339
Change-Id: I22879c7bdd100d00216b9528663bf17406169826 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-27FIX: change socket location for vhost-user interfaceJan Gelety37-74/+74
Change-Id: Icce908d274f9fcd92e7eaa731da094b63fd3ee0e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-28Add ipsec crypto test for Denverton platformYulong Pei45-41/+4003
add ipsec cryto test to support Denverton hardware crypto device C3xxx. replace HW_cryptodev keyword to HW_DH895xcc or HW_C3xxx, or add more other hardware crypto device type support in the future. Change-Id: I181bca4095757fde7ca45ab3856273ac5930d902 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-03-28Re-enabling Honeycomb two IPs same subnet testsMichal Cmarada1-35/+29
- reordering tests so unnumbered interface tests don't break following tests - removing EXPECTED_FAILING for fixed tests Change-Id: Ic24d878849ab4f451e2fb59856c222167cb35d8f Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-03-28Report: Configure 1901.1.13Tibor Frank3-2/+5
Change-Id: I17c72ddb8bc5df364761c9e0453aeb128d7951e9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-28Fix Tap failing testsMichal Cmarada9-50/+85
Due to migration to Tap-v2 the old Tap API was removed. This fixes failing tests where Tap interface was used. Change-Id: I2f90177d2d8ee914e3ddcd3e10f212f9d72b9ac2 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-03-27CSIT-1460: Add VPP-stats to PAPI ProviderTibor Frank4-231/+380
Change-Id: I2665700a4948c481585d66c987f94af748f102c3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-26Fix virl ubuntu image + update ubuntu vpp buildsJan Gelety11-114/+129
Change-Id: Ifcb38f09a9a84c8dbae879ad34af11fe9be4a450 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-26Report: Update vpp perf tests release notesJan Gelety1-2/+2
Change-Id: I00bf6cf1d1c38a125be03a82853426e7980e088a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-26FIX: Do not restart VPP immediately after VPP installationJan Gelety4-1/+4
Change-Id: Ib3ee517c850953fe87f3036702d2924cf41a9998 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-25Trending: Set the last build for dpdk-3n-skxTibor Frank1-21/+21
- presentation_new Change-Id: I2764f6dd90b360ad778510e32d592a6295eb3236 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-25Trending: Set the last build for dpdk-3n-skxTibor Frank1-3/+3
Change-Id: Ic38ad46547c9a007cc8d59e44fcf5955956e663e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-25Trending: Fix vpp-refTibor Frank1-1/+1
Change-Id: Ie2da87f9afbe22229a35abcf8598923c888ab7ec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-25Trending: Reduce the amount of downloaded dataTibor Frank1-18/+18
Change-Id: I13aeccc993bbdd98c29845554da714ce10add5c0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-25Trending: Fix vpp-refTibor Frank1-1/+2
Change-Id: I3179175f681a99709445e6603711060e46fa8885 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-21Remove main.py as it is confusingPeter Mikus1-233/+0
People try to run main.py instead of Robot Change-Id: Ieff219c9df7586842f796c5fb17500327d71a7d1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-21Update and reorder tox.ini TODOsVratko Polak1-3/+3
Change-Id: Ieeb54f3e3cb413f15dfbf6595211fd7158aa1e1a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-03-21Convert functional tests to statefull QemuUtilsPeter Mikus20-78/+33
Change-Id: Ia1b9120c45733db64dc2dc8b03cff5ef5f167548 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-21Report: Add note about nr of test runsTibor Frank1-0/+7
Change-Id: If7a29bb268c422f788b418c597af8305e04847cf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-20CSIT-1386 KernelVM - Part IIPeter Mikus47-110/+5546
- Implementation of KernelVM (ThinVM) - nf_density tests for KernelVM with VPP as VNF. Change-Id: Ife5c2e1ab419c55cbcd442792f940db3a41da471 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-20ietf draft: nfv service density rev. -00Maciek Konstantynowicz1-0/+874
Change-Id: I0490db919b4da198545f4a332fd722855bac84a8 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-03-20Add tox checker for lengths of new lines onlyVratko Polak3-12/+67
- Still non-voting, but useful. Change-Id: Idd6f345f0f14fdbc237ff66f5e010801ea08dc5b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-03-19Update of VPP_STABLE_VERJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 19.04-rc0~214-gcae98b7~b6361 - use new vpp ref build - centos7: 19.04-rc0~214_gcae98b7~b6184 - use new vpp ref build - ubuntu 18.04: 19.04-rc0~214-gcae98b72c Change-Id: I5f8288278576fb28f5bf3754ac18b60cc21e3e6e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-19Report: Remove VNFTibor Frank8-19/+194
- add comparisons for dnv Change-Id: I123a925a3c91fba782f152b3cd73f1b63fe50c59 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-19Report: Configure 1901.1Tibor Frank3-3/+3
Change-Id: Ica2483bdaebe70b9d6668a36a1b855c52e4d7c86 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-18CSIT-1386 KernelVM - Part IPeter Mikus183-903/+484
- Refactor QemuUtils Full refactor of QemuUtils to prepare for thinner VMs. Change-Id: I171ba11a9e6e9faec582bd58df6819598b0ed0b5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-18PAPI Executor: Add more desciptive error messageTibor Frank1-1/+6
- Add more desciptive error message to the processing of replies. Change-Id: Ie43651370d5754aedf2515438c02ff4aa21bdc46 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-17Prepare image for KernelVM on machines.Peter Mikus2-2/+21
TASK [sut : Get kernel-kvm version] *************************************** changed: [10.30.51.52] TASK [sut : Download kernel-kvm] ****************************************** changed: [10.30.51.52] TASK [sut : Unpack kernel-kvm] ******************************************** changed: [10.30.51.52] PLAY RECAP **************************************************************** 10.30.51.52 : ok=4 changed=3 unreachable=0 failed=0 Change-Id: I452f35e12c94fc58374679de21e87e36b145f987 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-16FIX: Ansible warnings of deprecationPeter Mikus7-56/+50
[DEPRECATION WARNING]: Invoking "apt" only once while using a loop via squash_actions is deprecated. + aenum pip fix version + crypto dependencies Change-Id: I7ca4de48d68ec4d8a8f57fedf204fa6710a3e75f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-15Report: Fix the information about 2-Node Atom DenvertonTibor Frank2-3/+3
Change-Id: I137af7fd34d352c9ed2fba1ac5eca5a409c0ab92 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-15PAPI: Add verification of the responseTibor Frank2-39/+143
Change-Id: I86afcaeae865f0af076b8dd974386a83de07bf44 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-14Adding pip and apt packages - ubuntu16.04Jan Gelety5-2/+396
- add python3-cffi to apt list - add aenum to pip requirements Change-Id: Iac0f4f69752db7d34693e83dd14bf68ad8cdc8ee Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-14Papi: Back to python2, add aenumTibor Frank2-1/+2
Change-Id: I3939af7dc29edb58dab7febff400007d91961081 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-14CSIT-1461: Edit VPP Release notesTibor Frank1-12/+9
Change-Id: I794fe95df97834b889bf24fc142c5478ce7c0623 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-14Report: Add Denverton static contentTibor Frank15-29/+53
Change-Id: I0ba254c00f7aacb425034721fcaed73bfd4dbc01 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-14Report: Add Denverton dataTibor Frank1-1/+1
Change-Id: I18054949ca135f204a068ad1d4db1b7a7fa413d7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-14Trending: Reduce the amount of downloaded dataTibor Frank2-36/+36
Change-Id: Ifa3fd25c018731c156d3864845dfb2d001e6ceb2 Signed-off-by: Tibor Frank <tifrank@cisco.com>