aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-04-18OptionString: Do not convert None to non-empty stringVratko Polak1-2/+3
Change-Id: I2947394a478bde3fe048aef99fd7b5a394764ae2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-18Report: Static contentTibor Frank3-6/+6
Change-Id: If8e2593dcaff368b2c7e191f70bab15e8974bb38 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-18CSIT-1487: Configure PAL for the Report 1904Tibor Frank7-3207/+2252
Change-Id: I4f112693a3b50665a9c53290de42d8e365c6d415 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-18Add perpatch info to cpta methodologyVratko Polak8-270/+360
Also, split methodology file into multiple, per section. Change-Id: I973b93d1a99205d7adb80996a3657215e05b8985 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-18CSIT-1482: Change trending graphsTibor Frank7-168/+179
- Change trending graphs to display results when using suite generator Change-Id: I4f822c180f9c206be19a9c75ce105c2225ad9171 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-18Centos 7.6-1810 image update.Thomas F Herbert9-26/+323
Add python36 and update qemu to 2.12. add boost-filesystem Change-Id: I89bba0b807be6d6c2d98b2f07faae9c31b3370e1 Signed-off-by: Thomas F Herbert <therbert@redhat.com>
2019-04-17Increase reliability of per patch perf jobVratko Polak2-30/+49
CSIT-1485 - Measurement results are inconsistent, creating false positives. - To avoid false positives, sensitivity has to be lowered. + Measurements are no more interleaved. + Measurement result are no longer filtered. + The job now runs faster. - Ip6base regressions smaller than 4% are tolerated. + Ip6base false positives can happen, but less than 10% of the time. - Part of job parameters is set on ci-management level. + Voter script output is improved. Change-Id: I0ec7d5df8b397daf7ff0277a1137ee9f36d8d866 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-17CSIT-1483: Add processing of output_info.xml as the first choiceTibor Frank5-79/+99
Change-Id: I27687ed6dda3a8717538653e75ad0d61c6516c7e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-17Clean up traffic_profile vs osi_layerVratko Polak7-110/+108
The two types were not well distinguished before. Error introduced in: https://gerrit.fd.io/r/#/c/17811/84/resources/libraries/robot/performance/performance_setup.robot@255 Error hotfixed in: https://gerrit.fd.io/r/#/c/18847/4/resources/libraries/robot/shared/default.robot@109 + Rename some arguments and improve method docstrings. Newly introduced argument name osi_layer should be dissimilar enough. Change-Id: Ie0f6f97dc010fc6477f09c54574970f1d15462e2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-17Introduce OptionString for handling command lineVratko Polak4-259/+561
+ Convert DpdkUtil to use it. ++ Rename args to kwargs where needed. ++ Fix errors in docstrings. + Also convert and QemuUtils to use it. ++ Minor formatting edits to save space. + Add disconnect parameter to some ssh.py functions. ++ ssh.SSH.disconnect() tries to work without argument. + Exec functions in ssh.py accept OptionString commands. Change-Id: I82da71c568d120c283544c90242993fc76e9e83a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-16Remove unused parameter in HoneycombSetupMichal Cmarada2-4/+2
Change-Id: Ief75fcdc2c3ab77b708d1c7e7aecf312ea852898 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-04-16Add 2n AVF testsPeter Mikus4-4/+354
- Side effect of other troubleshooting, but better to merge then throw away. Change-Id: Idc1a0ca66b35b61c1ffd11242cd7b7133ae4cbd7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-13Use package location for apt-cache show commandJan Gelety1-1/+3
Change-Id: I141baa77c78ec467a56fcafb86061efe198dca9d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-04-15Update of VPP_STABLE_VER filesJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 19.08-rc0~14-g4e08316~b6856 - use new vpp ref build - ubuntu 18.04: 19.08-rc0~14-g4e08316f3 - use new vpp ref build - centos7: 19.08-rc0~14_g4e08316~b6690 Change-Id: Id377e18b0d6bfaa55762b7088c284866f5749a5d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-04-15Remove obsolete QEMU installationPeter Mikus6-213/+14
+Unify QEMU parameter to Contants. Change-Id: I95adfc97dd7008c19e60ba3fa8668818b503bee8 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-15Add output.xml with only INFO logging levePeter Mikus3-1/+11
- Useful for post-processing. Change-Id: I6f71087f8c6f6d66fd86207d5df9abd10e94f855 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-15Alerts: Change the error messageTibor Frank3-24/+34
Change-Id: I0fcd6ffaf24de0f6ce95eaba3d591eddf3f16b33 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-15Fix pylint error in PapiExecutorVratko Polak1-52/+26
+ Remove ret_val as it cannot be nonzero outside _execute_papi. + Change indentation to save vertical space. + Return computed values without storing them to variable. + Add TODO to remove duplicated method. + Add missing fields to docstring. + Minor formatting changes. Change-Id: I8e8f41d139de8aff3b76a7fe27ee450e89e8d1de Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-12Add DPDK install to ansiblePeter Mikus4-18/+50
Change-Id: If838c2a008ffd5bdf458c76d729f57b47e225b41 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-12Convert existing nf_density testpmd-mac into KernelVMPeter Mikus25-188/+221
Change-Id: I9ec1701d9012de59cc42cc5f9a4744f01695ff9a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-11Add notes for traffic_type argumentVratko Polak2-0/+4
To make this gerrit comment permanently visible in code: https://gerrit.fd.io/r/#/c/17811/50/resources/libraries/python/InterfaceUtil.py@1335 Change-Id: I2b763d88fcc8186c9479a0f0c3336d8eeb8aed95 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-10Trending: Reduce input dataTibor Frank3-46/+27
Change-Id: Ia787036e4a717b9693df09fc75738369d6d39b57 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-10fix auth for newer ODL versionsMichal Cmarada1-3/+1
Since oxygen we need to add also "-p karaf" argument when starting karaf and because we are not using older versions anymore we can remove the if condition and use new authentication by default. Change-Id: I458fa35b7f26222dd5562349e6859844bfb7d05f Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-04-09Add vagrant setup for testing VPP device locallyLudovit Mikula14-180/+324
Fixed trailing whitespaces Fixed tabs vs. spaces Removed dead code Changed network interface naming Changed default number of retries for VPP startup to 120 Updated number of hugepages during provisioning Externalized CSIT related sysctl settings to 90-csit.conf Removed hardcoded local docker image name. Added new interface required for honeycomb device testing. Change-Id: I5eb38c8b1a4d96e4220dbd2e202e94f1d47e804e Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
2019-04-09Add support DHCP Server Support for DNVRay Kinsella1-0/+24
Adding DHCP Server support for 2-node and 3-node DNV setups Change-Id: If3d3517fd91ab46308c368910c1e79f5c25cc904 Signed-off-by: Ray Kinsella <ray.kinsella@intel.com>
2019-04-09Update of ubuntu VPP_STABLE_VERJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 19.04-rc0~640-g05f7ca1~b6800 - use new vpp ref build - ubuntu 18.04: 19.04-rc0~640-g05f7ca110 Change-Id: I940b044210d3a552fb2af75359f62795230cd2ad Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-04-09update tests after ODL bump to NeonMichal Cmarada5-32/+138
Change-Id: Ia733ad304c51b28f2a945e570120821254077189 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-04-09Fix l2 Honeycomb testsMichal Cmarada8-48/+50
Change-Id: Ic75a9279fffe3a5d11211f4e57fc635d7d33ee5f Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-04-08Upgrade autogen to NICs and search typesVratko Polak933-92827/+10548
+ All perf suites updated, as autogen change is backward incompatible. + Only x710 -ndrpdr suites remain in git repository. + Removed retry feature of run_tests. + Renamed topology_type and traffic_type to traffic_profile. + Renamed framesize to frame_size; nic_model to nic_name. + Reordered Variables table to start with nic_name and overhead. + Fixed wrong overhead value in some cbc-sha1 suites. + Fixed some suite tags. ++ Introduced tags to distinguish suites, such as IPSECINT. + Bound crypto hardware to NIC name. + Implemented NIC limit hiding. + Also search and teardown related arguments are now hidden. + Main measurement keywords updated to new arg handling. + Max rate related keywords moved to performance_limits.robot + Teardowns unified. + Generated tests are archived. ++ Generated directory is .gitignore-d. + Regenerator raises an exception on seeing non-compatible suite. ++ Relatively helpful message should be seen in exception. + Suite and template Documentation has generated parts. +- With short NIC names only. + Autogen checker also upgraded. + Tag expressions replaced with long files to ensure analogous tests. Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-08Remove lbdpdk perf testsPeter Mikus8-1244/+0
- They are not used anywhere and failing all the time. Change-Id: Ib1aec32ffeac51a48f8eda64a1832a87f56d229b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-03Remove obsolete FDS testsJan Gelety3-683/+0
Change-Id: Ie161f7003cb33596ac7856783b332a75b5dbc14e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-04-07FIX: Qemu set affinity bugPeter Mikus1-39/+30
Change-Id: If1df58628b2150b1ea3f2f56b1e3d442176b0750 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-06FIX: Operational issuesPeter Mikus46-200/+87
- FIX MSR package installation - FIX VTS - FIX sockets by removing from TCs Change-Id: I043c60f9e3e9c39cbeaee5e09b7a8351965efd35 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-05Fixes for Taishan testbedjuraj.linkes49-6051/+36
* rename NICs in Taishan testbed to Intel-X520-DA2 * fix testbed NIC selection * remove unnecessary 82599es tests * blacklist unsupported tests on Taishan testbed * lowercase previously created bash local variables Change-Id: I3b7f59e2edc00929fab2f5a0fce483f236f83075 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-04-05Add vpp-api-python for honeycomb testsMichal Cmarada2-9/+9
- Csit is migrating VAT scripts to PAPI, therefore python package for vpp is needed in honeycomb tests. Change-Id: I724cdd87e7ba899f9d9f95e08f5ce636435f7780 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-04-04Trending: Remove NF tests from alertsTibor Frank1-15/+0
Change-Id: Id8074a30f578af7df5bb15e9c127838d27cae8b0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-04Trending: AlertsTibor Frank5-84/+385
Change-Id: I1c744f4eeefe3082be02daa681bfc032d6db4d15 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-03Change 2 node Denverton testbed descriptionYulong Pei1-4/+5
Change-Id: I09c5ac3c4fe90b1fff46c4211b401daefe40ac31 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-04-02Update draft-vpolak-mkonstan-bmwg-mlrsearch-00->01.Maciek Konstantynowicz1-72/+74
Change-Id: I7345fdf63a1e7355812e5089e16e14f47cd6e890 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-04-02Trending: Remove invalid builds (3n-skx 356-372)Tibor Frank1-1/+69
Change-Id: I8de833a87536b60382c54fa9be2f443ff8a7d900 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-01CSIT-1412: Create trending graphs for svc densityTibor Frank8-55/+576
- static content - plots Change-Id: If3d77f5415acfa2efe2bc7ca13e426747b027f8e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-01CSIT-1337: Migrate L2Util library from VAT to PAPIJan Gelety6-180/+339
Change-Id: I22879c7bdd100d00216b9528663bf17406169826 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-27FIX: change socket location for vhost-user interfaceJan Gelety37-74/+74
Change-Id: Icce908d274f9fcd92e7eaa731da094b63fd3ee0e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-28Add ipsec crypto test for Denverton platformYulong Pei45-41/+4003
add ipsec cryto test to support Denverton hardware crypto device C3xxx. replace HW_cryptodev keyword to HW_DH895xcc or HW_C3xxx, or add more other hardware crypto device type support in the future. Change-Id: I181bca4095757fde7ca45ab3856273ac5930d902 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-03-28Re-enabling Honeycomb two IPs same subnet testsMichal Cmarada1-35/+29
- reordering tests so unnumbered interface tests don't break following tests - removing EXPECTED_FAILING for fixed tests Change-Id: Ic24d878849ab4f451e2fb59856c222167cb35d8f Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-03-28Report: Configure 1901.1.13Tibor Frank3-2/+5
Change-Id: I17c72ddb8bc5df364761c9e0453aeb128d7951e9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-28Fix Tap failing testsMichal Cmarada9-50/+85
Due to migration to Tap-v2 the old Tap API was removed. This fixes failing tests where Tap interface was used. Change-Id: I2f90177d2d8ee914e3ddcd3e10f212f9d72b9ac2 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-03-27CSIT-1460: Add VPP-stats to PAPI ProviderTibor Frank4-231/+380
Change-Id: I2665700a4948c481585d66c987f94af748f102c3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-26Fix virl ubuntu image + update ubuntu vpp buildsJan Gelety11-114/+129
Change-Id: Ifcb38f09a9a84c8dbae879ad34af11fe9be4a450 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-26Report: Update vpp perf tests release notesJan Gelety1-2/+2
Change-Id: I00bf6cf1d1c38a125be03a82853426e7980e088a Signed-off-by: Jan Gelety <jgelety@cisco.com>