aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-05-06CSIT-1492: Add new NF density tests to reportTibor Frank5-233/+1893
Change-Id: Ifdfac80f7fd25124cb08a467329d6c8c525ffc06 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-06CSIT-1493 VPP restart handling codePeter Mikus12-182/+173
Change-Id: Ibe52125089f39e0ff17ec607a3ed00c61d52ab8c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-06CSIT-1488: Add data to the Report 1904Tibor Frank1-56/+73
Change-Id: I49b1f3d9e2ac422ddae8382828756476a696a2c1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-06Report: Configure the versionTibor Frank3-3/+3
Change-Id: I29240b2286f48cc8027d97c9c1895c51b2a11ca5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-03report 1904: updated methodology (nfv density, startup.conf) and vpp perf ↵Maciek Konstantynowicz3-35/+36
rls notes Change-Id: If6d24511d5d29dcc25c21437364e0da15af3cca1 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-05-03Update KVM methodologyPeter Mikus2-17/+70
Change-Id: I8be9b9295b691a1ec4b810e3a1255ad1bc6947ab Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-03CSIT-1488: Add data to the Report 1904Peter Mikus1-8/+83
Change-Id: I7d63d16164e0cf54d74cc0b7286cde50a6e71404 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-30CSIT-1488: Add data to the Report 1904Tibor Frank1-49/+47
Change-Id: Ibf630b85f2e7b164847628efb9969edba753eb74 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-30Update report static contentPeter Mikus5-47/+40
Change-Id: I8aef71fb2cc09d2c7862884f7ca68c9786ad5165 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-29CSIT-1488: Add data to the Report 1904Tibor Frank1-49/+163
Change-Id: Iec3270ccff9db2d8532f6f0d11640bf65d7f9ddd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-29Report: Configure the versionTibor Frank3-3/+3
Change-Id: I064b16e0a2b7f96e4590622be340ab657d785f16 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-26NF density tests with dtc=0.5 and dtcr=2Peter Mikus145-3632/+9264
Change-Id: Icff556142280ad0b6261e0a2bfb71672ee6b3807 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-26fix removal of build packages for honeycombMichal Cmarada1-2/+2
Change-Id: I19be5008067067c2e7c78e7673a9ceaaf2f52c8f Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-04-26FIX: Change buffers per numa base on SMTPeter Mikus1-1/+3
Change-Id: I4955210e2c723d4b91d8829ac42e47937d17833f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-25CSIT-1488: Add data to the Report 1904Tibor Frank1-29/+16
Change-Id: I6f787445c0f4e91e4fbde7787c49d08d412347a6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-25CSIT-1489: Change graphs to display results by suite generatorTibor Frank30-1279/+3859
Change-Id: I00fdc7ce87be5cecf5883ed2c991a8e67efd2e2a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-24FIX: Crypto testsPeter Mikus7-12/+27
- By adding crypto_ipsecmb.so into the list of loaded plugins Change-Id: I52de9b410441422ad8e337208f40360fbdea264d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-24FIX: Large number of interfaces and worker threadsPeter Mikus3-18/+14
Add buffers-per-numa (previously num-mbuf) Change-Id: Iad0863668a65b1595630d49a047d591659c7bba5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-24Move generate_tests earlier in entry scriptsVratko Polak4-8/+8
The idea is to run test generation and archivation before testbed reservation, as during generation and archivation the testbed can be used by another job. The two steps are moved just before (physical or docker) reservation, as they currently take considerable time, so simpler steps are kept before to save time if they fail. Coincidentally, it is also just after activate_virtualenv, Python is needed for test generation. Change-Id: I8b41b91dba8118e89301e3fcf89d5cd14ac054a2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-23FIX: TAP tests fix 2Jan Gelety3-5/+5
Change-Id: Ie9591fe3d72f27be0b4cba21c7b0868ed5118de4 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit d0293114feed3b8d4badec6bc8cc1ace91a4d3e6)
2019-04-23FIX: Create TAP interface after API changeJan Gelety2-9/+7
Change-Id: Ib39671dcb808142037c2950b8b02b9aa64d72a3b Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 48b40a6789050e8f40405663cc0e437df26fc56a)
2019-04-23FIX: VTS pinning issue.Peter Mikus3-6/+6
Change-Id: I12a79605a925c00d9c41b7115bc7cbb7f2cd49c1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-23CSIT-1488: Add data to the Report 1904Tibor Frank2-2/+2
Change-Id: I2ba9eeedf5668b5a99acbe0d26add2aa0a836a9f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-23CSIT-1488: Add data to the Report 1904Tibor Frank1-497/+128
Change-Id: Idab323612b20ae06d92bd81310abdb1d44c6c9a7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-23CSIT-1487: Configure PAL for the Report 1904Tibor Frank3-6/+6
- change the week number - add pdf generation - change ubuntu and centos images Change-Id: Iadea2f3dd9cfd77b508bf16ffd154bbd4f1145bf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-18FIX: eth_peer parameter after introducing OptionParamsPeter Mikus1-2/+2
Change-Id: Ief72af680a6252faf749b06b5289b8033af99b2d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-18OptionString: Do not convert None to non-empty stringVratko Polak1-2/+3
Change-Id: I2947394a478bde3fe048aef99fd7b5a394764ae2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-18Report: Static contentTibor Frank3-6/+6
Change-Id: If8e2593dcaff368b2c7e191f70bab15e8974bb38 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-18CSIT-1487: Configure PAL for the Report 1904Tibor Frank7-3207/+2252
Change-Id: I4f112693a3b50665a9c53290de42d8e365c6d415 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-18Add perpatch info to cpta methodologyVratko Polak8-270/+360
Also, split methodology file into multiple, per section. Change-Id: I973b93d1a99205d7adb80996a3657215e05b8985 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-18CSIT-1482: Change trending graphsTibor Frank7-168/+179
- Change trending graphs to display results when using suite generator Change-Id: I4f822c180f9c206be19a9c75ce105c2225ad9171 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-18Centos 7.6-1810 image update.Thomas F Herbert9-26/+323
Add python36 and update qemu to 2.12. add boost-filesystem Change-Id: I89bba0b807be6d6c2d98b2f07faae9c31b3370e1 Signed-off-by: Thomas F Herbert <therbert@redhat.com>
2019-04-17Increase reliability of per patch perf jobVratko Polak2-30/+49
CSIT-1485 - Measurement results are inconsistent, creating false positives. - To avoid false positives, sensitivity has to be lowered. + Measurements are no more interleaved. + Measurement result are no longer filtered. + The job now runs faster. - Ip6base regressions smaller than 4% are tolerated. + Ip6base false positives can happen, but less than 10% of the time. - Part of job parameters is set on ci-management level. + Voter script output is improved. Change-Id: I0ec7d5df8b397daf7ff0277a1137ee9f36d8d866 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-17CSIT-1483: Add processing of output_info.xml as the first choiceTibor Frank5-79/+99
Change-Id: I27687ed6dda3a8717538653e75ad0d61c6516c7e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-17Clean up traffic_profile vs osi_layerVratko Polak7-110/+108
The two types were not well distinguished before. Error introduced in: https://gerrit.fd.io/r/#/c/17811/84/resources/libraries/robot/performance/performance_setup.robot@255 Error hotfixed in: https://gerrit.fd.io/r/#/c/18847/4/resources/libraries/robot/shared/default.robot@109 + Rename some arguments and improve method docstrings. Newly introduced argument name osi_layer should be dissimilar enough. Change-Id: Ie0f6f97dc010fc6477f09c54574970f1d15462e2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-17Introduce OptionString for handling command lineVratko Polak4-259/+561
+ Convert DpdkUtil to use it. ++ Rename args to kwargs where needed. ++ Fix errors in docstrings. + Also convert and QemuUtils to use it. ++ Minor formatting edits to save space. + Add disconnect parameter to some ssh.py functions. ++ ssh.SSH.disconnect() tries to work without argument. + Exec functions in ssh.py accept OptionString commands. Change-Id: I82da71c568d120c283544c90242993fc76e9e83a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-16Remove unused parameter in HoneycombSetupMichal Cmarada2-4/+2
Change-Id: Ief75fcdc2c3ab77b708d1c7e7aecf312ea852898 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-04-16Add 2n AVF testsPeter Mikus4-4/+354
- Side effect of other troubleshooting, but better to merge then throw away. Change-Id: Idc1a0ca66b35b61c1ffd11242cd7b7133ae4cbd7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-13Use package location for apt-cache show commandJan Gelety1-1/+3
Change-Id: I141baa77c78ec467a56fcafb86061efe198dca9d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-04-15Update of VPP_STABLE_VER filesJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 19.08-rc0~14-g4e08316~b6856 - use new vpp ref build - ubuntu 18.04: 19.08-rc0~14-g4e08316f3 - use new vpp ref build - centos7: 19.08-rc0~14_g4e08316~b6690 Change-Id: Id377e18b0d6bfaa55762b7088c284866f5749a5d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-04-15Remove obsolete QEMU installationPeter Mikus6-213/+14
+Unify QEMU parameter to Contants. Change-Id: I95adfc97dd7008c19e60ba3fa8668818b503bee8 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-15Add output.xml with only INFO logging levePeter Mikus3-1/+11
- Useful for post-processing. Change-Id: I6f71087f8c6f6d66fd86207d5df9abd10e94f855 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-15Alerts: Change the error messageTibor Frank3-24/+34
Change-Id: I0fcd6ffaf24de0f6ce95eaba3d591eddf3f16b33 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-15Fix pylint error in PapiExecutorVratko Polak1-52/+26
+ Remove ret_val as it cannot be nonzero outside _execute_papi. + Change indentation to save vertical space. + Return computed values without storing them to variable. + Add TODO to remove duplicated method. + Add missing fields to docstring. + Minor formatting changes. Change-Id: I8e8f41d139de8aff3b76a7fe27ee450e89e8d1de Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-12Add DPDK install to ansiblePeter Mikus4-18/+50
Change-Id: If838c2a008ffd5bdf458c76d729f57b47e225b41 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-12Convert existing nf_density testpmd-mac into KernelVMPeter Mikus25-188/+221
Change-Id: I9ec1701d9012de59cc42cc5f9a4744f01695ff9a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-11Add notes for traffic_type argumentVratko Polak2-0/+4
To make this gerrit comment permanently visible in code: https://gerrit.fd.io/r/#/c/17811/50/resources/libraries/python/InterfaceUtil.py@1335 Change-Id: I2b763d88fcc8186c9479a0f0c3336d8eeb8aed95 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-10Trending: Reduce input dataTibor Frank3-46/+27
Change-Id: Ia787036e4a717b9693df09fc75738369d6d39b57 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-10fix auth for newer ODL versionsMichal Cmarada1-3/+1
Since oxygen we need to add also "-p karaf" argument when starting karaf and because we are not using older versions anymore we can remove the if condition and use new authentication by default. Change-Id: I458fa35b7f26222dd5562349e6859844bfb7d05f Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-04-09Add vagrant setup for testing VPP device locallyLudovit Mikula14-180/+324
Fixed trailing whitespaces Fixed tabs vs. spaces Removed dead code Changed network interface naming Changed default number of retries for VPP startup to 120 Updated number of hugepages during provisioning Externalized CSIT related sysctl settings to 90-csit.conf Removed hardcoded local docker image name. Added new interface required for honeycomb device testing. Change-Id: I5eb38c8b1a4d96e4220dbd2e202e94f1d47e804e Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>