aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2019-04-08Upgrade autogen to NICs and search typesVratko Polak21-678/+2149
+ All perf suites updated, as autogen change is backward incompatible. + Only x710 -ndrpdr suites remain in git repository. + Removed retry feature of run_tests. + Renamed topology_type and traffic_type to traffic_profile. + Renamed framesize to frame_size; nic_model to nic_name. + Reordered Variables table to start with nic_name and overhead. + Fixed wrong overhead value in some cbc-sha1 suites. + Fixed some suite tags. ++ Introduced tags to distinguish suites, such as IPSECINT. + Bound crypto hardware to NIC name. + Implemented NIC limit hiding. + Also search and teardown related arguments are now hidden. + Main measurement keywords updated to new arg handling. + Max rate related keywords moved to performance_limits.robot + Teardowns unified. + Generated tests are archived. ++ Generated directory is .gitignore-d. + Regenerator raises an exception on seeing non-compatible suite. ++ Relatively helpful message should be seen in exception. + Suite and template Documentation has generated parts. +- With short NIC names only. + Autogen checker also upgraded. + Tag expressions replaced with long files to ensure analogous tests. Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-03Remove obsolete FDS testsJan Gelety1-17/+0
Change-Id: Ie161f7003cb33596ac7856783b332a75b5dbc14e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-04-07FIX: Qemu set affinity bugPeter Mikus1-39/+30
Change-Id: If1df58628b2150b1ea3f2f56b1e3d442176b0750 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-06FIX: Operational issuesPeter Mikus3-48/+38
- FIX MSR package installation - FIX VTS - FIX sockets by removing from TCs Change-Id: I043c60f9e3e9c39cbeaee5e09b7a8351965efd35 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-05Fixes for Taishan testbedjuraj.linkes2-16/+26
* rename NICs in Taishan testbed to Intel-X520-DA2 * fix testbed NIC selection * remove unnecessary 82599es tests * blacklist unsupported tests on Taishan testbed * lowercase previously created bash local variables Change-Id: I3b7f59e2edc00929fab2f5a0fce483f236f83075 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-04-05Add vpp-api-python for honeycomb testsMichal Cmarada2-9/+9
- Csit is migrating VAT scripts to PAPI, therefore python package for vpp is needed in honeycomb tests. Change-Id: I724cdd87e7ba899f9d9f95e08f5ce636435f7780 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-04-04Trending: Remove NF tests from alertsTibor Frank1-15/+0
Change-Id: Id8074a30f578af7df5bb15e9c127838d27cae8b0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-04Trending: AlertsTibor Frank5-84/+385
Change-Id: I1c744f4eeefe3082be02daa681bfc032d6db4d15 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-02Trending: Remove invalid builds (3n-skx 356-372)Tibor Frank1-1/+69
Change-Id: I8de833a87536b60382c54fa9be2f443ff8a7d900 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-01CSIT-1412: Create trending graphs for svc densityTibor Frank3-55/+371
- static content - plots Change-Id: If3d77f5415acfa2efe2bc7ca13e426747b027f8e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-01CSIT-1337: Migrate L2Util library from VAT to PAPIJan Gelety5-180/+334
Change-Id: I22879c7bdd100d00216b9528663bf17406169826 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-27FIX: change socket location for vhost-user interfaceJan Gelety1-2/+2
Change-Id: Icce908d274f9fcd92e7eaa731da094b63fd3ee0e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-28Add ipsec crypto test for Denverton platformYulong Pei3-23/+39
add ipsec cryto test to support Denverton hardware crypto device C3xxx. replace HW_cryptodev keyword to HW_DH895xcc or HW_C3xxx, or add more other hardware crypto device type support in the future. Change-Id: I181bca4095757fde7ca45ab3856273ac5930d902 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-03-28Report: Configure 1901.1.13Tibor Frank2-2/+2
Change-Id: I17c72ddb8bc5df364761c9e0453aeb128d7951e9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-28Fix Tap failing testsMichal Cmarada7-32/+51
Due to migration to Tap-v2 the old Tap API was removed. This fixes failing tests where Tap interface was used. Change-Id: I2f90177d2d8ee914e3ddcd3e10f212f9d72b9ac2 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-03-27CSIT-1460: Add VPP-stats to PAPI ProviderTibor Frank4-231/+380
Change-Id: I2665700a4948c481585d66c987f94af748f102c3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-26Fix virl ubuntu image + update ubuntu vpp buildsJan Gelety4-111/+116
Change-Id: Ifcb38f09a9a84c8dbae879ad34af11fe9be4a450 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-25Trending: Set the last build for dpdk-3n-skxTibor Frank1-21/+21
- presentation_new Change-Id: I2764f6dd90b360ad778510e32d592a6295eb3236 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-25Trending: Set the last build for dpdk-3n-skxTibor Frank1-3/+3
Change-Id: Ic38ad46547c9a007cc8d59e44fcf5955956e663e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-25Trending: Fix vpp-refTibor Frank1-1/+1
Change-Id: Ie2da87f9afbe22229a35abcf8598923c888ab7ec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-25Trending: Reduce the amount of downloaded dataTibor Frank1-18/+18
Change-Id: I13aeccc993bbdd98c29845554da714ce10add5c0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-25Trending: Fix vpp-refTibor Frank1-1/+2
Change-Id: I3179175f681a99709445e6603711060e46fa8885 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-21Convert functional tests to statefull QemuUtilsPeter Mikus3-41/+12
Change-Id: Ia1b9120c45733db64dc2dc8b03cff5ef5f167548 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-20CSIT-1386 KernelVM - Part IIPeter Mikus9-110/+493
- Implementation of KernelVM (ThinVM) - nf_density tests for KernelVM with VPP as VNF. Change-Id: Ife5c2e1ab419c55cbcd442792f940db3a41da471 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-20Add tox checker for lengths of new lines onlyVratko Polak2-1/+53
- Still non-voting, but useful. Change-Id: Idd6f345f0f14fdbc237ff66f5e010801ea08dc5b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-03-19Report: Remove VNFTibor Frank3-5/+157
- add comparisons for dnv Change-Id: I123a925a3c91fba782f152b3cd73f1b63fe50c59 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-19Report: Configure 1901.1Tibor Frank2-2/+2
Change-Id: Ica2483bdaebe70b9d6668a36a1b855c52e4d7c86 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-18CSIT-1386 KernelVM - Part IPeter Mikus7-687/+459
- Refactor QemuUtils Full refactor of QemuUtils to prepare for thinner VMs. Change-Id: I171ba11a9e6e9faec582bd58df6819598b0ed0b5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-18PAPI Executor: Add more desciptive error messageTibor Frank1-1/+6
- Add more desciptive error message to the processing of replies. Change-Id: Ie43651370d5754aedf2515438c02ff4aa21bdc46 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-17Prepare image for KernelVM on machines.Peter Mikus2-2/+21
TASK [sut : Get kernel-kvm version] *************************************** changed: [10.30.51.52] TASK [sut : Download kernel-kvm] ****************************************** changed: [10.30.51.52] TASK [sut : Unpack kernel-kvm] ******************************************** changed: [10.30.51.52] PLAY RECAP **************************************************************** 10.30.51.52 : ok=4 changed=3 unreachable=0 failed=0 Change-Id: I452f35e12c94fc58374679de21e87e36b145f987 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-16FIX: Ansible warnings of deprecationPeter Mikus7-56/+50
[DEPRECATION WARNING]: Invoking "apt" only once while using a loop via squash_actions is deprecated. + aenum pip fix version + crypto dependencies Change-Id: I7ca4de48d68ec4d8a8f57fedf204fa6710a3e75f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-15PAPI: Add verification of the responseTibor Frank2-39/+143
Change-Id: I86afcaeae865f0af076b8dd974386a83de07bf44 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-14Adding pip and apt packages - ubuntu16.04Jan Gelety4-1/+395
- add python3-cffi to apt list - add aenum to pip requirements Change-Id: Iac0f4f69752db7d34693e83dd14bf68ad8cdc8ee Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-14Papi: Back to python2, add aenumTibor Frank1-1/+1
Change-Id: I3939af7dc29edb58dab7febff400007d91961081 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-14Report: Add Denverton static contentTibor Frank1-2/+2
Change-Id: I0ba254c00f7aacb425034721fcaed73bfd4dbc01 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-14Report: Add Denverton dataTibor Frank1-1/+1
Change-Id: I18054949ca135f204a068ad1d4db1b7a7fa413d7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-14Trending: Reduce the amount of downloaded dataTibor Frank2-36/+36
Change-Id: Ifa3fd25c018731c156d3864845dfb2d001e6ceb2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-14Add PAPI dependenciesPeter Mikus12-102/+57
+ Various small structure optmizations Change-Id: I1aac9353f72436de53797fc734bef498905c8189 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-13PAPI: Use Python3 for PapiProviderTibor Frank2-3/+3
Change-Id: I39e237db5cba8311ae11fd709b10a17297f3a729 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-11CSIT-1457: Report 1901.1 Add dataTibor Frank1-375/+437
Change-Id: Ic9a5361394f0648816b4745bbfb4d3338e3f7e9f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-11CSIT-1456: Report 1901.1 ConfigurationTibor Frank2-11/+11
Change-Id: Ic629722527e6db6c0594d9499a123b29dc8cf258 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-11add support for using custom jvpp commitMichal Cmarada1-4/+59
Change-Id: I492541a0a0d6cdc08f03e4c47fc86f22716cf065 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-03-08Convert clear [run|interfaces] command to PAPIPeter Mikus1-6/+23
Change-Id: I9aa9eed74a75c132f9e34ce50e9895db59f855c7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-08FIX: Do not set sriov_numvfs of QAT card to 0 in case of SW crypto testsJan Gelety1-2/+3
- when sriov_numvfs of QAT card is set to 0 for SW crypto tests and then back to 32 for subsequent HW crypto the dpdk backend is not running Change-Id: I9bc6b2549823e3318c31bda55a976199266e3535 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-08CSIT-1452: Make PAL use PapiHistory instead of VatHistoryTibor Frank3-46/+73
- First step: Add PapiHistory Change-Id: I499d64f951f17f04557a7ba793dcc1593f37a1bd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-07Simplify show_papi_historyVratko Polak1-5/+5
Change-Id: Id86f8630ff37e958d90011f421aeb8a75b3e4783 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-03-07Fix PYTHONPATH in activate_environmentVratko Polak1-1/+1
This affects jobs which install the virtual environment to a directory other than ${CSIT_DIR}. Change-Id: I1546043112f7504feb0452883b2ff57530dd2c9d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-03-07Papi: Rename methods argumentTibor Frank2-10/+18
The argument name 'csit_papi_command' must be unique enough as it cannot be repeated in kwargs. - PapiExecutor.add(self, csit_papi_command, **kwargs) - PapiHistory.add_to_papi_history(node, csit_papi_command, papi=True, **kwargs) Change-Id: I243a20d6f03befb149891c37a88e0e6359ea2940 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-06CSIT-1451: PapiHistoryTibor Frank6-119/+120
Change-Id: Idb51f377fe0c196fbe24aab21c294dad595adcd2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-06CSIT-1450: PAPI executorVratko Polak6-340/+334
Change-Id: I4c756cc4b29901184594a728f6184c30cadd9c1a Signed-off-by: Vratko Polak <vrpolak@cisco.com>