aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/python
AgeCommit message (Collapse)AuthorFilesLines
2019-10-24FIX: Start T-Rex with sudorls1904Jan Gelety1-5/+5
The reason is that later there was introduced change and T-Rex is started with sudo. Without this change the T-Rex cannot be started under csit 19.04 branch. Change-Id: Ia111d14bf5af4483d825f5433712a3865e5a9a48 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-07-17Add backward compatibility for kernel vm imagejuraj.linkes1-1/+1
https://gerrit.fd.io/r/#/c/20577/ replaced kvm kernel with custom build of generic kernel, which would be picked up with '/opt/boot/vmlinuz*' wildcard and which wouldn't work with this code. Fix this by adding '-kvm' to the wildcard so that the kvm image is used with this code. Change-Id: I9e9d978ad7c980d74f88f761b884eca599dee454 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-05-27FIX: do not generate 9000B perf test in case of vic1385 nicJan Gelety1-0/+3
Change-Id: I7b8e30903a8bc012a3bb43bfb33755e08b56dc1d Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 1fea09e6c0634ea7f02f9b94883a8261ff3769b1)
2019-05-16FIX: IPsec selection backend. Peter Mikus1-1/+1
Change-Id: Iba6f2beb4075f6dd317b0eeb32a1d0466ae9524c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-14Add new higher density NF testsPeter Mikus2-2/+7
Change-Id: Ib2f3f3f8dc3e202dc1db53c739d9309be2ed8a60 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 1ac36a9fd34043609b81901f2de37deb0a113ea5)
2019-05-10PLRsearch: Use stat trackers to shorten IntegratorVratko Polak4-406/+704
+ Extract several tracker classes and use them in Integrator. + Apply next_rate workarounds to focus more on critical region. + Rewrite stretch function, as the previous implementation was wrong. + Rework logging: ++ Use injected trace() function in Integrator. ++ Inject function that skips trace logging on default initialization. ++ Use the same multiprocessing-safe passing, but separate queue. + Set duration to 120m in Robot, but keep at 30m in Python. + Apply minor changes to make computations more reproducible: ++ Attempt to log everything needed by reproducibility in one line. ++ Log samples used, and make it settable as upper limit. ++ Use repr output in TRex scripts, to avoid rounding when copypasting. +- Numpy seems to be sharing PRNG between processes. +-- An edit to disable one thread is needed for full reproducibility. +-- Such an edit is prepared, but will not be merged anytime soon. Change-Id: Icf56429b34ab6de2d18a12e6c676e2d242b3ba4c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-30NF density tests with dtc=0.5 and dtcr=2Peter Mikus4-111/+140
Change-Id: Icff556142280ad0b6261e0a2bfb71672ee6b3807 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-24FIX: Large number of interfaces and worker threadsPeter Mikus2-10/+10
Add buffers-per-numa (previously num-mbuf) Change-Id: Iad0863668a65b1595630d49a047d591659c7bba5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-23FIX: Create TAP interface after API changeJan Gelety1-1/+1
Change-Id: Ib39671dcb808142037c2950b8b02b9aa64d72a3b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-04-15Remove obsolete QEMU installationPeter Mikus3-53/+14
+Unify QEMU parameter to Contants. Change-Id: I95adfc97dd7008c19e60ba3fa8668818b503bee8 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 0e0cf38fcd1ff704293c9dd2c7a05f8682e11de9)
2019-04-15Add output.xml with only INFO logging levePeter Mikus2-1/+3
- Useful for post-processing. Change-Id: I6f71087f8c6f6d66fd86207d5df9abd10e94f855 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit cc0c2870a18fb74a56410eca2d1870bddc945397)
2019-04-15Fix pylint error in PapiExecutorVratko Polak1-52/+26
+ Remove ret_val as it cannot be nonzero outside _execute_papi. + Change indentation to save vertical space. + Return computed values without storing them to variable. + Add TODO to remove duplicated method. + Add missing fields to docstring. + Minor formatting changes. Change-Id: I8e8f41d139de8aff3b76a7fe27ee450e89e8d1de Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 5899ac744eb5f722f53151c98e5acfdbdf678d0c)
2019-04-13Convert existing nf_density testpmd-mac into KernelVMPeter Mikus4-72/+160
Change-Id: I9ec1701d9012de59cc42cc5f9a4744f01695ff9a Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 96a3c5c7ace8357d26e833a46845486787aa75c3)
2019-04-10fix auth for newer ODL versionsMichal Cmarada1-3/+1
Since oxygen we need to add also "-p karaf" argument when starting karaf and because we are not using older versions anymore we can remove the if condition and use new authentication by default. Change-Id: I458fa35b7f26222dd5562349e6859844bfb7d05f Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-04-09Add vagrant setup for testing VPP device locallyLudovit Mikula1-1/+1
Fixed trailing whitespaces Fixed tabs vs. spaces Removed dead code Changed network interface naming Changed default number of retries for VPP startup to 120 Updated number of hugepages during provisioning Externalized CSIT related sysctl settings to 90-csit.conf Removed hardcoded local docker image name. Added new interface required for honeycomb device testing. Change-Id: I5eb38c8b1a4d96e4220dbd2e202e94f1d47e804e Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
2019-04-09update tests after ODL bump to NeonMichal Cmarada1-1/+2
Change-Id: Ia733ad304c51b28f2a945e570120821254077189 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-04-08Upgrade autogen to NICs and search typesVratko Polak6-75/+232
+ All perf suites updated, as autogen change is backward incompatible. + Only x710 -ndrpdr suites remain in git repository. + Removed retry feature of run_tests. + Renamed topology_type and traffic_type to traffic_profile. + Renamed framesize to frame_size; nic_model to nic_name. + Reordered Variables table to start with nic_name and overhead. + Fixed wrong overhead value in some cbc-sha1 suites. + Fixed some suite tags. ++ Introduced tags to distinguish suites, such as IPSECINT. + Bound crypto hardware to NIC name. + Implemented NIC limit hiding. + Also search and teardown related arguments are now hidden. + Main measurement keywords updated to new arg handling. + Max rate related keywords moved to performance_limits.robot + Teardowns unified. + Generated tests are archived. ++ Generated directory is .gitignore-d. + Regenerator raises an exception on seeing non-compatible suite. ++ Relatively helpful message should be seen in exception. + Suite and template Documentation has generated parts. +- With short NIC names only. + Autogen checker also upgraded. + Tag expressions replaced with long files to ensure analogous tests. Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-07FIX: Qemu set affinity bugPeter Mikus1-39/+30
Change-Id: If1df58628b2150b1ea3f2f56b1e3d442176b0750 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-01CSIT-1337: Migrate L2Util library from VAT to PAPIJan Gelety2-173/+257
Change-Id: I22879c7bdd100d00216b9528663bf17406169826 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-28Add ipsec crypto test for Denverton platformYulong Pei1-7/+21
add ipsec cryto test to support Denverton hardware crypto device C3xxx. replace HW_cryptodev keyword to HW_DH895xcc or HW_C3xxx, or add more other hardware crypto device type support in the future. Change-Id: I181bca4095757fde7ca45ab3856273ac5930d902 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-03-28Fix Tap failing testsMichal Cmarada1-9/+12
Due to migration to Tap-v2 the old Tap API was removed. This fixes failing tests where Tap interface was used. Change-Id: I2f90177d2d8ee914e3ddcd3e10f212f9d72b9ac2 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-03-27CSIT-1460: Add VPP-stats to PAPI ProviderTibor Frank3-111/+246
Change-Id: I2665700a4948c481585d66c987f94af748f102c3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-20CSIT-1386 KernelVM - Part IIPeter Mikus4-74/+370
- Implementation of KernelVM (ThinVM) - nf_density tests for KernelVM with VPP as VNF. Change-Id: Ife5c2e1ab419c55cbcd442792f940db3a41da471 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-18CSIT-1386 KernelVM - Part IPeter Mikus1-435/+330
- Refactor QemuUtils Full refactor of QemuUtils to prepare for thinner VMs. Change-Id: I171ba11a9e6e9faec582bd58df6819598b0ed0b5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-18PAPI Executor: Add more desciptive error messageTibor Frank1-1/+6
- Add more desciptive error message to the processing of replies. Change-Id: Ie43651370d5754aedf2515438c02ff4aa21bdc46 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-15PAPI: Add verification of the responseTibor Frank2-39/+143
Change-Id: I86afcaeae865f0af076b8dd974386a83de07bf44 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-13PAPI: Use Python3 for PapiProviderTibor Frank1-1/+1
Change-Id: I39e237db5cba8311ae11fd709b10a17297f3a729 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-08Convert clear [run|interfaces] command to PAPIPeter Mikus1-6/+23
Change-Id: I9aa9eed74a75c132f9e34ce50e9895db59f855c7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-07Simplify show_papi_historyVratko Polak1-5/+5
Change-Id: Id86f8630ff37e958d90011f421aeb8a75b3e4783 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-03-07Papi: Rename methods argumentTibor Frank2-10/+18
The argument name 'csit_papi_command' must be unique enough as it cannot be repeated in kwargs. - PapiExecutor.add(self, csit_papi_command, **kwargs) - PapiHistory.add_to_papi_history(node, csit_papi_command, papi=True, **kwargs) Change-Id: I243a20d6f03befb149891c37a88e0e6359ea2940 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-06CSIT-1451: PapiHistoryTibor Frank4-108/+109
Change-Id: Idb51f377fe0c196fbe24aab21c294dad595adcd2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-06CSIT-1450: PAPI executorVratko Polak5-319/+318
Change-Id: I4c756cc4b29901184594a728f6184c30cadd9c1a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-03-04Rename to Constants.pyVratko Polak25-25/+30
Motivation: Make the constants available also for Robot. Restraint: Robotframework user guide says: Because variable files are always imported using a file system path, creating them as classes has some restrictions: Python classes must have the same name as the module they are located. Change-Id: I638ef3fe045db132e366de2e2699638b8637e45e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-26FIX: ipsec + vpp stable version updateJan Gelety2-56/+56
- use exec ipsec sa add - use exec ipsec spd add - use exec set ipsec sa Change-Id: I69d59dd230b99d8efc9bcb5e3fbab79a8b11b18a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-02-27Add tox.ini and few checker scriptsVratko Polak2-35/+23
The plan is to change csit-validate-pylint-master job to fail if (and only if) tox fails. This will allow us to easily add checks, with or without the voting power. Each check produces log (ignored in .gitignore) the voting job can archive. + Made autogen quiet by default, to avoid spam in autogen checker. + Unified the way direct csit subdirectories are git-ignored. Change-Id: I6477b1ef7da6d3e30f68c5850d04900cc52f431e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-26De-duplicate unidirection supportVratko Polak1-125/+60
- Latency is now reported in both directions. -- For unidirection that means additional -1/-1/-1. + Changed function argument wrapping to save vertical space. + Changed trex command synthesys to save vertical space. + Fixed handling of command line arguments to avoid superfluous spaces. + More care distinguishing (0, 1) from (port_0, port_1). - Not renaming the original port arguments. Change-Id: I7b1736b594f6edea52eb07e5bc76ef52d0af92f8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-25FIX: VPP PIDs can also be separated by spaces not only by line breaksJan Gelety1-6/+4
Change-Id: I6a5e8732be224927aa965cdf6b93998aa8699639 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-02-19Adapt autogen for SFd testsVratko Polak1-12/+23
+ Make the skipping logic in autogen more flexible. + Do not emit 4c cases when there is too much VMs/containers. + Peter says the second -eth- should be renamed away from suites. + Regenerate suites so test case names match (new) suite names. Change-Id: I95ecc47ca07b8bae6693d5d4330811ff55672fc4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-13FIX: Coredump packing combinationPeter Mikus1-3/+4
- Remove DIR Change-Id: Iba1b03d407e93d4e60fb49f6b50747de87f82ac7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-13FIX: Apply revert routing in case interfaces are revertedPeter Mikus1-0/+1
Change-Id: Iecd4606f000aa49a16a07fb02ae1b6f1c52a52d8 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-12Fix argument order in unidirection related KWsVratko Polak1-19/+18
The original unidirection Chhange [0] has changed the order, breaking some call sites. Also, use different indentation to save some vertical space. [0] https://gerrit.fd.io/r/#/c/16696/3/resources/libraries/python/TrafficGenerator.py@551 Change-Id: Ife9bd994da73f0afcd24fc16794f822a831c4353 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-09FIX: Remove deprecated socket-mem paramPeter Mikus1-10/+1
Change-Id: I7178dacbd470c29e857b44942a62ccf7df53d0b5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-08CSIT-845 Capture VPP core-dump from vpp crash on DUTsPeter Mikus5-2/+314
Change-Id: I987dcd5092d8527c9aefbe093e1ed7ae144d191b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-08FIX: Memif APIPeter Mikus1-2/+8
Change-Id: If755c06935a525c7a312e63f32f6035f08fdb893 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-06FIX: Set ipsec backend to dpdk backend when aes-gcm cipher usedJan Gelety1-15/+121
Change-Id: I008b9e0fd62cdc8e29136930762bd7412bd50181 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 2230a8ab108fa114752decfc69321ec5a47f36a6)
2019-02-04CSIT-1416 Remove installation of vpp from containersPeter Mikus2-32/+41
Use parent system (Host, Container) installation of VPP. This will save the internet bandwith by skip installing of prerequisites packages. It will also skip dpkg install and simplify the process of initializing VPP inside container. Previosly initialization of VPP in container takes about 55s. With this patch it is reduced to 2-3s. This patch removes the bloated VOLUME creation between container sidecars (a.k.a nested container) and fixes the hugepage allocation. Change-Id: Ifa2be532edb77354657e1b84568bdc34993b00d0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-04CSIT-1411 Implement manual rx-placement override for bug in VPPPeter Mikus2-0/+142
Change-Id: Ie3d2b1f40a607ce5190ccfea6a372bc072d0a3b9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-30FIX: Put back sleep to wait for container to boot.Peter Mikus1-1/+1
Change-Id: Id63fc8670c7816cc71d8d6d8704ff7f1adf3db65 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-30CSIT-1409 Implement pipeline configuration for l2bd with memif/ip4.Peter Mikus1-61/+147
Change-Id: I7463d47a9d65069332eb2a288ff44f4499a8a467 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-29PLRsearch: Initial implementation and suitesVratko Polak7-1/+1129
Missing bits: - Add up-to-date .rst document (in child Change). - Prepare for releasing to PyPI.org (in child Change): -- Either copy dependencies from MLRsearch, or list in requirements. -- Perhaps move common dependencies to separate package for both search to depend on. -- All the other metadata stuff. Jira: CSIT-1276 Change-Id: I277efdb63dbb90b30e11f4e30a82e2130ac8efc3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>