Age | Commit message (Collapse) | Author | Files | Lines |
|
The next version of suite generator will avoid generating them,
for now we just exclude by a tag expression.
Change-Id: I68c80c412ea327c11366f539b10de19df50152c2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: Id43c7c299d2e112b6caf00a3d340e6051ab337b6
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: Id9beeed270b91a35108adef594f50105198225d6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- Useful for post-processing.
Change-Id: I6f71087f8c6f6d66fd86207d5df9abd10e94f855
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
+ All perf suites updated, as autogen change is backward incompatible.
+ Only x710 -ndrpdr suites remain in git repository.
+ Removed retry feature of run_tests.
+ Renamed topology_type and traffic_type to traffic_profile.
+ Renamed framesize to frame_size; nic_model to nic_name.
+ Reordered Variables table to start with nic_name and overhead.
+ Fixed wrong overhead value in some cbc-sha1 suites.
+ Fixed some suite tags.
++ Introduced tags to distinguish suites, such as IPSECINT.
+ Bound crypto hardware to NIC name.
+ Implemented NIC limit hiding.
+ Also search and teardown related arguments are now hidden.
+ Main measurement keywords updated to new arg handling.
+ Max rate related keywords moved to performance_limits.robot
+ Teardowns unified.
+ Generated tests are archived.
++ Generated directory is .gitignore-d.
+ Regenerator raises an exception on seeing non-compatible suite.
++ Relatively helpful message should be seen in exception.
+ Suite and template Documentation has generated parts.
+- With short NIC names only.
+ Autogen checker also upgraded.
+ Tag expressions replaced with long files to ensure analogous tests.
Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
* rename NICs in Taishan testbed to Intel-X520-DA2
* fix testbed NIC selection
* remove unnecessary 82599es tests
* blacklist unsupported tests on Taishan testbed
* lowercase previously created bash local variables
Change-Id: I3b7f59e2edc00929fab2f5a0fce483f236f83075
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
|
|
This affects jobs which install the virtual environment
to a directory other than ${CSIT_DIR}.
Change-Id: I1546043112f7504feb0452883b2ff57530dd2c9d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: Iaa0e7fbca7de26c7dce8b389cc3494f628a2ecd0
Signed-off-by: Stanislav Chlebec <stanislav.chlebec@pantheon.tech>
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
|
|
The plan is to change csit-validate-pylint-master job
to fail if (and only if) tox fails.
This will allow us to easily add checks,
with or without the voting power.
Each check produces log (ignored in .gitignore)
the voting job can archive.
+ Made autogen quiet by default, to avoid spam in autogen checker.
+ Unified the way direct csit subdirectories are git-ignored.
Change-Id: I6477b1ef7da6d3e30f68c5850d04900cc52f431e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
This is needed to support other TBs in perpatch job.
Change-Id: I9de70e818a32fa9990d90cb14498a26570b774a4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- also memif tests removed from graphs where they must not be.
Change-Id: I1cbb02ba2dcdcd3a286c9ac4489c946993ac4790
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I69a16b1baa5147f22b7c5742c2ccf6e030474937
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I214026c5df83778e87623770225e0fbb041ccc1c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I153d378849ea76444915b7fc219237db1b7bca1a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
This is to reduce sensitivity on testbed unstable performance.
Also add topo_cleanupbefore every pybot run
to avoid issues with VPP uninstall.
TRACE prints are left there to simplify investigation
of false positives if/when they happen.
Change-Id: I9b0cdcfbbe4aa0735a0596746ac32c9e93af0897
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I2f5ac334e09bc35bfaefc112cf0bb7f57290a732
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I7071abd6c4a52a86efea573a4f9bcb54547dc004
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
The issue is caused by python-crypto library in upstream Ubuntu 1804
repo. Unless there is permanent fix there is workaround to always
download fresh version, not preinstalled.
Change-Id: Ic2318eb532a6e7a910e4ffb209556c17e6070d3d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Mainly useful to reduce test set for per patch.
Change-Id: I55a5f2d268c3105ac32d25ae317e149d3c3b4e14
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I4c0c5afa8a8dff814382cb0ad6d9df0410179755
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
- Add option to override some tags per topology.
Change-Id: I4045ebbee1c5d32e29cdb6c5c84e0dcd9217b2cf
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I9dfb4bfba4d0650a42e34d0e1f97b60b031f0750
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
This fixes select_tags function in common.sh
to not include scale l2bd tests in default tag list.
This is needed because "L2BDBASE" tag selects also scale tests
(contrary to similar IP4BASE and IP6BASE tags).
(Line length over 80 characters is left there
as an indirect TODO to improve the tags.)
Change-Id: Ic1d4a046f327fdd1b8b08eb20f1cdb4b12f337c9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I978a056ffdfd6daa00a0a1c587774b4a7204b434
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I5c0be60a1819c5c46225b4468ba9c88068231f08
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
+ Scripts do not rely on (other) bootstraps.
+ Perf verify bootstrap is also the new style sript now.
+ Scripts are divided to functions for better re-use.
+ Functions are sourced from small number of large "library" files.
- Still using jumpavg from pipy.
- Perpatch has specific simplified parsing (instead of the PAL one).
- Bash style document is in a separate Change.
Change-Id: If88fa528ce155ea86b614e3d77c0550b91bbdf11
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|