Age | Commit message (Collapse) | Author | Files | Lines |
|
Change-Id: Ib30bc4697fcba93a6723ee492a59a0523425f623
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I9af632035a1415666b2470c62a41d1b6acbf33c8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
+ Include a script to add suite tags to many suites at once.
+ Add suite tags also to device tests (not covered by autogen).
Change-Id: I514ee6178e22999b43460028fe2696738b012f04
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
+ Disallowed -avf- (or -rdma-) as "template" suites.
+ GBP suite switched to DPDK driver in repo.
+ Each NIC has its own list of supported drivers, in Constants.
+ Updated tag expressions for daily jobs:
+ Feature, ipsec, memif, scale, srv6, tunnels, vhost and vts
are tested only with vfio-pci.
+ Other (base, dot1q, dot1ad) tested with all drivers.
+ Setup actions currently depend on driver, generated.
- The performance_rdma action is trivial for now.
- Several tests fail, to be fixed later, e.g. by performance_rdma.
+ Reconf tests are also supported.
+ Added DRV_VFIO_PCI tags missing, mainly in density tests.
- Vhost suites (density, reconf) are failing, but suites look good.
- TCP suites do not support NIC drivers yet.
- DPDK obviously not supported.
+ Use Python 3 in regenerate scripts.
+ Fix typos binded => bound.
+ File open modes set either u"rt" or u"wt" everywhere.
+ Remove a trailing space in an environment variable name.
Change-Id: I290470675dc5c9e88b2eaa5ab6285ecd9ed7827a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I1392c06b1d64f62b141d24c0d42a8e36913b15e2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
+ This will help unify driver base differences between TCs.
+ Decrease amount of logic needed for suite generator.
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1e84ba361dc1e829f0612c58a61096e2633ce0c5
|
|
+ Small bugfixes in various suites
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I051af0a6da7340fe3f617400370c3846ca5241ab
|
|
Change-Id: I786fe9f75777e1cd0daee70bc350185dd7fd17e1
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
+ Few fixes in doc
+ Align testcases
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5575db8255a74fd46f37d5cc2637b9b4448bcd7f
|
|
Change-Id: I90901c4ab14dfa76dc3e1f786a4b986479e0ba47
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
- Remove translate TC as they have no perf opposite
- Remove unused keywords
- Merge similar keywords / rename
- Move keywords from perf library to categories
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6433006136e2497ad8fb17193aa20c578d836999
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I3721900b91a9c8e9db8766bdcb9771b6bcf95bca
|
|
Change-Id: I0050f715011ecfa92b3ee88b301809a56abb7946
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
+ Phase II - aligning FUNC/PERF setup.
+ 2n/3n compatibility of suite setup.
+ Same structure of testcase for DEV/PERF.
+ DEVICE tests are now running VPP startup config in same
way as PERF.
+ DEVICE is using COREKEEPER!
- DEVICE tests are running topology compute twice for backward
compatibility. TODO to remove.
- Still phase III needed to align TAGS, LIBRARIES and remove OLD
setup phase.
Change-Id: Ib6e1b0ebf4abebf3cbe73b4fda5cac953c2a7270
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
See https://gerrit.fd.io/r/20148
Change-Id: I22856b14e3608348f2ccecb1d99d87209db2d776
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
+ Phase I - aligning FUNC/PERF
Change-Id: I46b1e43687ddb29f5ed3c6335fe1baf21ec02822
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
- Side effect of other troubleshooting, but better to
merge then throw away.
Change-Id: Idc1a0ca66b35b61c1ffd11242cd7b7133ae4cbd7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
+ All perf suites updated, as autogen change is backward incompatible.
+ Only x710 -ndrpdr suites remain in git repository.
+ Removed retry feature of run_tests.
+ Renamed topology_type and traffic_type to traffic_profile.
+ Renamed framesize to frame_size; nic_model to nic_name.
+ Reordered Variables table to start with nic_name and overhead.
+ Fixed wrong overhead value in some cbc-sha1 suites.
+ Fixed some suite tags.
++ Introduced tags to distinguish suites, such as IPSECINT.
+ Bound crypto hardware to NIC name.
+ Implemented NIC limit hiding.
+ Also search and teardown related arguments are now hidden.
+ Main measurement keywords updated to new arg handling.
+ Max rate related keywords moved to performance_limits.robot
+ Teardowns unified.
+ Generated tests are archived.
++ Generated directory is .gitignore-d.
+ Regenerator raises an exception on seeing non-compatible suite.
++ Relatively helpful message should be seen in exception.
+ Suite and template Documentation has generated parts.
+- With short NIC names only.
+ Autogen checker also upgraded.
+ Tag expressions replaced with long files to ensure analogous tests.
Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
* rename NICs in Taishan testbed to Intel-X520-DA2
* fix testbed NIC selection
* remove unnecessary 82599es tests
* blacklist unsupported tests on Taishan testbed
* lowercase previously created bash local variables
Change-Id: I3b7f59e2edc00929fab2f5a0fce483f236f83075
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
|
|
Change-Id: Iaa0e7fbca7de26c7dce8b389cc3494f628a2ecd0
Signed-off-by: Stanislav Chlebec <stanislav.chlebec@pantheon.tech>
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
|
|
Missing bits:
- Add up-to-date .rst document (in child Change).
- Prepare for releasing to PyPI.org (in child Change):
-- Either copy dependencies from MLRsearch, or list in requirements.
-- Perhaps move common dependencies to separate package
for both search to depend on.
-- All the other metadata stuff.
Jira: CSIT-1276
Change-Id: I277efdb63dbb90b30e11f4e30a82e2130ac8efc3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Use the following if we ever decide '} =' is better than '}='.
$ cd csit/tests
$ find . -type f -print0 | xargs -0 sed -i -E 's/^\| \$\{(.*)\}= \|([^|])/\| \$\{\1\} = \|\2/g'
FIXME: Add a corresponding check to https://gerrit.fd.io/r/13450
Change-Id: I73c516a0d7e475ff0986fd6515aaae10accd1a3a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
update the test suites to call
"Initialize L2 bridge domain in circular topology" since
"Initialize L2 bridge domain in 2-node circular topology" was replaced by it.
Change-Id: I6d5cb0868353228fbcf37b308ffa0b562649c57a
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
|
|
Change-Id: I0d2d2f16f7e0b710f432711d7e0eccf70fcfcc8f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Currently there is and issue when consecutive AVF suites are
trying to initialize AVF and bind VF to vfio-pci driver, there
seems to be race condition if VPP has already VFs allocated.
This patch should introduce safer contstrain to disable VPP prior
AVF init.
Change-Id: Id8839200f19d9e7a18d161b660cfb1e43a8ca379
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
+ "elif" instead of "else if".
+ Some suites had test cases reordered.
+ Some suites contained 9000B cases for avf.
Change-Id: I3bf8241c317f20dbf66b497a2c8be35ef71307f5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- Per trending.
Change-Id: I1e24b20bc774dae91df6fb81e3a9132ff79e3beb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: Ia74a87346fe2c0a170b881b510f1b0558a538f3c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Intel-X553 is Denverton (Intel Atom cpu based SOC) integrated NIC, add below
basic 2-node topology performance test suites for it, the test suites were
changed from the existing Intel-x710 test suites,
- eth-l2patch-mrr
- eth-l2patch-ndrpdr
- eth-l2xcbase-mrr
- eth-l2xcbase-ndrpdr
- eth-l2bdbasemaclrn-mrr
- eth-l2bdbasemaclrn-ndrpdr
- ethip4-ip4base-mrr
- ethip4-ip4base-ndrpdr
- ethip6-ip6base-mrr
- ethip6-ip6base-ndrpdr
Change-Id: Ib6d3655a6e14ae275c197fd7b39d59e17a233326
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
|
|
Jira: CSIT-1284
Change-Id: I8ce4ffc76adf55bf9a8423077b8639601c560c87
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Jira: CSIT-1278
Change-Id: I3cc929222d7fd58f38e33917e84675e9c0b55bbd
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Jira: CSIT-1268
Change-Id: I13bf2e570a7d7231ba19c2c41db2b44c0b8d215a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Four AVF suites had test cases in different order.
Change-Id: I12fbe3508016a79a2153cc004c654a21ee4279bf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- Add L1 KWs for SR-IOV handling (init Vfs, remove Vfs, ...)
- Cleanup L1 KWs for SR-IOV bind/unbind/pci_get/...
- Add L2 KWs for Test Setup/Teardown, L2patch, Create AVF interface
- Add sample L2patch test fox x710, xxv710
Change-Id: If17077877455a14043617d8ea0d06cbe47b469e3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
- Increase timeout when trying to check interface (this is useful if
there are multiple interfaces and dump command take more than
TIMEOUT/NR_IF which is happening quite often).
- Reverse the order of applying MTU and interface UP to try to prevent
API overload during interface initialization phase.
Change-Id: I4e8623963d15b3c0d202172b4c58c43a972bb9cb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 584345da4f7330f7517e5defd894b4995c2b57b0)
|
|
- Add ability to configure MTU on interfaces. Put the MTU into configuration
keywors for all perf testcases.
Change-Id: I364b4bc26b26f2f66f350949c0aaa2a2aa675682
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I738d1794f795e1225bc9709ea2ed2cf9b06d1cf4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- XL710, XXV710, X710
- 2n, 3n
- all pkt.size groups
- ndrpdr, mrr
Change-Id: Ibb36d734cd70a0a4d07e3d177fa2477bf9bfaacd
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
- CSIT-1161 Add 2-node L2XC tests
- CSIT-1160 Add 2-node L2BD tests
- CSIT-1157 Add 2-node IP4 tests
- CSIT-1153 Add 2-node IP6 KW
- CSIT-1158 Add 2-node IP6 tests
Change-Id: I7c8fed7018bb355c0de73f6a8bc3a8ec80366972
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
- Refactor Performance TCs due to changes in Hyperthreading and RXQ allocations.
- Simplify the structure of suite to avoid large refactors in future.
Change-Id: Ifb1b9719391f26745f075a900bd9fb39b6cb809c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
+ All suites and tests still refer to MRR instead of BMRR (or FRMOBL).
+ API change: Traffic should pass with maximum rate
first argument got a default value,
thus it needs to be moved towards the end of argument list.
+ Consequently, the value for it has been deleted from suites.
+ Test message is now compatible only with BMRR parsing.
- Reporting of transmit rate is left as TODO.
+ Global test __init__ with new way of giving defaults to global variables.
+ The new keyword is put into robot_enhancements.robot resource.
+ Number of trials and trial duration are now configurable.
- Bootstrap scripts have no support for overriding the defaults yet.
Change-Id: I4b108cc9c256730e62c03fbacba0a1c314f8ae88
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Due to automatization of SMT detection this change is suppose to
remove static thread/core tags in favor of dynamic one. Leaving the
static tags for number of physical cores to be able to select TCs.
Change-Id: I7f99f605821f363e45c333f46d1dea786693521b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
- Clean up of 2-node setup KWs
Change-Id: I59fc901fb57544eceb6a041b56b515cda8babf85
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I450d5e9fa1cbd4a40caec68f3fc4674f744f1168
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: If495493f4dce8d2eecfb8c06bcd587f315b70b1d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I193411e97f069982fca8408e5e5a42cd577586ed
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
─ 10ge2p1x710-dot1q-l2bdbasemaclrn-mrr.robot
─ 10ge2p1x710-dot1q-l2xcbase-mrr.robot
─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl1sf-10kflows-mrr.robot
─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl1sl-10kflows-mrr.robot
─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl50sf-10kflows-mrr.robot
─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl50sl-10kflows-mrr.robot
─ 10ge2p1x710-eth-l2bdscale100kmaclrn-mrr.robot
─ 10ge2p1x710-eth-l2bdscale10kmaclrn-mrr.robot
─ 10ge2p1x710-eth-l2bdscale1mmaclrn-mrr.robot
─ 10ge2p1x710-eth-l2xcbase-mrr.robot
Change-Id: Ic5d5cb377eca25daaeb22e8390632a6d6421c2e3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I407e3cdeb25547d46fafed702ee608f6c0e03091
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- CSIT-999: MRR tests: L2
- 10ge2p1x520-eth-l2xcbase-mrr.robot
- 10ge2p1x520-eth-l2bdbasemaclrn-mrr.robot
- 10ge2p1x520-dot1q-l2bdbasemaclrn-mrr.robot
- 10ge2p1x520-dot1q-l2xcbase-mrr.robot
- 10ge2p1x520-eth-l2bdbasemaclrn-iacl1sf-10kflows-mrr.robot
- 10ge2p1x520-eth-l2bdbasemaclrn-iacl1sl-10kflows-mrr.robot
- 10ge2p1x520-eth-l2bdbasemaclrn-iacl50sf-10kflows-mrr.robot
- 10ge2p1x520-eth-l2bdbasemaclrn-iacl50sl-10kflows-mrr.robot
- 10ge2p1x520-eth-l2bdscale100kmaclrn-mrr.robot
- 10ge2p1x520-eth-l2bdscale10kmaclrn-mrr.robot
- 10ge2p1x520-eth-l2bdscale1mmaclrn-mrr.robot
- 10ge2p1x710-eth-l2bdbasemaclrn-ndrpdrdisc.robot
- 40ge2p1xl710-eth-l2bdbasemaclrn-mrr.robot
- 40ge2p1xl710-eth-l2xcbase-mrr.robot
- CSIT-1000: MRR tests: IPv6
─ 10ge2p1x520-ethip6-ip6base-copwhtlistbase-mrr.robot
- 10ge2p1x520-ethip6-ip6base-iacldstbase-mrr.robot
─ 10ge2p1x520-ethip6-ip6scale200k-mrr.robot
─ 10ge2p1x520-ethip6-ip6scale20k-mrr.robot
─ 10ge2p1x520-ethip6-ip6scale2m-mrr.robot
─ 40ge2p1xl710-ethip6-ip6base-mrr.robot
Change-Id: Ie42b08151b5da3ba32b972af8b6bedf313c6d29c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- Implementation of Display raw results
- Implementation of Traffic should pass with maximum rate
- Code optimizations
- L2BD, L2XC, IP4, IP6 TC
Change-Id: I0b50e995a853ed3c8f88323ccc650e47b8ed2496
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|