Age | Commit message (Collapse) | Author | Files | Lines |
|
Change-Id: I291c3dc852e7c1bde6fb6102a9168cfec9992682
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 474034ac24ce89cdaa94a09ae4d9ebbd3fb0f219)
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id39667515e304f4d92f230f82d3f1dbc1e22ac32
(cherry picked from commit 8beb22fb0a13ccc69281bb4a68b62a733d1f20e2)
|
|
+ NF_density compatible
+ Baseline VM tests compatible
+ Scalability NxM
- 3n variant is missing in VXLAN and DOT1Q due to requests to have it
asymmetrical - TODO
Change-Id: Ia817d7be00622b594b451bc07756240d1a379e04
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
+ Phase II - aligning FUNC/PERF setup.
+ 2n/3n compatibility of suite setup.
+ Same structure of testcase for DEV/PERF.
+ DEVICE tests are now running VPP startup config in same
way as PERF.
+ DEVICE is using COREKEEPER!
- DEVICE tests are running topology compute twice for backward
compatibility. TODO to remove.
- Still phase III needed to align TAGS, LIBRARIES and remove OLD
setup phase.
Change-Id: Ib6e1b0ebf4abebf3cbe73b4fda5cac953c2a7270
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
+ Phase I - aligning FUNC/PERF
Change-Id: I46b1e43687ddb29f5ed3c6335fe1baf21ec02822
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: Ic493253dc29dad4fc7e6541e4b839ca5898a6a40
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
- Per agreed
Change-Id: Ie955ebfe19bff8c4a8671a0f62eea5be4407caa5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: Icff556142280ad0b6261e0a2bfb71672ee6b3807
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I9ec1701d9012de59cc42cc5f9a4744f01695ff9a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
+ All perf suites updated, as autogen change is backward incompatible.
+ Only x710 -ndrpdr suites remain in git repository.
+ Removed retry feature of run_tests.
+ Renamed topology_type and traffic_type to traffic_profile.
+ Renamed framesize to frame_size; nic_model to nic_name.
+ Reordered Variables table to start with nic_name and overhead.
+ Fixed wrong overhead value in some cbc-sha1 suites.
+ Fixed some suite tags.
++ Introduced tags to distinguish suites, such as IPSECINT.
+ Bound crypto hardware to NIC name.
+ Implemented NIC limit hiding.
+ Also search and teardown related arguments are now hidden.
+ Main measurement keywords updated to new arg handling.
+ Max rate related keywords moved to performance_limits.robot
+ Teardowns unified.
+ Generated tests are archived.
++ Generated directory is .gitignore-d.
+ Regenerator raises an exception on seeing non-compatible suite.
++ Relatively helpful message should be seen in exception.
+ Suite and template Documentation has generated parts.
+- With short NIC names only.
+ Autogen checker also upgraded.
+ Tag expressions replaced with long files to ensure analogous tests.
Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- They are not used anywhere and failing all the time.
Change-Id: Ib1aec32ffeac51a48f8eda64a1832a87f56d229b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
- FIX MSR package installation
- FIX VTS
- FIX sockets by removing from TCs
Change-Id: I043c60f9e3e9c39cbeaee5e09b7a8351965efd35
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: Icce908d274f9fcd92e7eaa731da094b63fd3ee0e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
- Implementation of KernelVM (ThinVM)
- nf_density tests for KernelVM with VPP as VNF.
Change-Id: Ife5c2e1ab419c55cbcd442792f940db3a41da471
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
- Refactor QemuUtils
Full refactor of QemuUtils to prepare for thinner VMs.
Change-Id: I171ba11a9e6e9faec582bd58df6819598b0ed0b5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
+ Make the skipping logic in autogen more flexible.
+ Do not emit 4c cases when there is too much VMs/containers.
+ Peter says the second -eth- should be renamed away from suites.
+ Regenerate suites so test case names match (new) suite names.
Change-Id: I95ecc47ca07b8bae6693d5d4330811ff55672fc4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
As per discussion, tests are not required anymore.
From maintaining point of view, removing completely.
Change-Id: Ic082fc6831fd46ae14b58140d20eadba8cd8f91f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Remove tests that cannot run on target machines
Change-Id: I2417d491e36afc9164c6981a9f5a3134529df251
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I6a045225b0ff3cc4cd9880ee05861fd7bf36c61a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Missing bits:
- Add up-to-date .rst document (in child Change).
- Prepare for releasing to PyPI.org (in child Change):
-- Either copy dependencies from MLRsearch, or list in requirements.
-- Perhaps move common dependencies to separate package
for both search to depend on.
-- All the other metadata stuff.
Jira: CSIT-1276
Change-Id: I277efdb63dbb90b30e11f4e30a82e2130ac8efc3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- Fix detecting total allocable CPUs for NFs
Change-Id: If3345518befb887655d3e162551c49df3163ed92
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: Iaa268043c04a994647c5dcd704e4e61f4f83050c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
agreed scheme.
Change-Id: Ia7bbfe5f7027c18a68408cc71445a2839b6b19a8
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
|
|
Change-Id: I36ab0bc7c9eada4c3f7bb5cb8f53de7d267ff910
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Use the following if we ever decide '} =' is better than '}='.
$ cd csit/tests
$ find . -type f -print0 | xargs -0 sed -i -E 's/^\| \$\{(.*)\}= \|([^|])/\| \$\{\1\} = \|\2/g'
FIXME: Add a corresponding check to https://gerrit.fd.io/r/13450
Change-Id: I73c516a0d7e475ff0986fd6515aaae10accd1a3a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: Ie8cbc7bc8a58aca41c8cb35c14dbd8e80f027f5c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Jira: CSIT-1286
Change-Id: Id51c7dbf15d846f1286e6efbc5240a2556ec9652
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Jira: CSIT-1247
Change-Id: Ia6a3f7682eb9a35040682913c0e33a1d61d1e6fa
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Change-Id: I955d3170da94cf35a2fda03259bcdc020ac2b652
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I68db0b0441ffc7d9b5e04048688711915ab24726
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
CSIT-1164 Create VM vhost tests for 2-node topology
CSIT-1173 Implement VM vhost KWs for 2-node topology
- Cleanup QemuUtils.py Library (PEP8, some TODOs, readability, multi queue,
ring size, qemu version detection)
- Cleanup VHOST KWs perf (Unify running QEMU on N-node topology)
- Add ability to configure Queues, Hyperthreading, automatically compute
number of CPU for VM/Testpmd and RXQ for Testpmd workload.
- Partial cleanup of configuration KWs (l2xc, l2bd) for 2-node
- Create IPv4 2-node KW
Change-Id: I8aae1355bafa651de715cd438fe706c443ea1d88
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
- Add ability to configure MTU on interfaces. Put the MTU into configuration
keywors for all perf testcases.
Change-Id: I364b4bc26b26f2f66f350949c0aaa2a2aa675682
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: Id5eb8fe46b219426803d3e7d135319ce5117738c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- Refactor Performance TCs due to changes in Hyperthreading and RXQ allocations.
- Simplify the structure of suite to avoid large refactors in future.
Change-Id: Ifb1b9719391f26745f075a900bd9fb39b6cb809c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
+ All suites and tests still refer to MRR instead of BMRR (or FRMOBL).
+ API change: Traffic should pass with maximum rate
first argument got a default value,
thus it needs to be moved towards the end of argument list.
+ Consequently, the value for it has been deleted from suites.
+ Test message is now compatible only with BMRR parsing.
- Reporting of transmit rate is left as TODO.
+ Global test __init__ with new way of giving defaults to global variables.
+ The new keyword is put into robot_enhancements.robot resource.
+ Number of trials and trial duration are now configurable.
- Bootstrap scripts have no support for overriding the defaults yet.
Change-Id: I4b108cc9c256730e62c03fbacba0a1c314f8ae88
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Due to automatization of SMT detection this change is suppose to
remove static thread/core tags in favor of dynamic one. Leaving the
static tags for number of physical cores to be able to select TCs.
Change-Id: I7f99f605821f363e45c333f46d1dea786693521b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
- Clean up of 2-node setup KWs
Change-Id: I59fc901fb57544eceb6a041b56b515cda8babf85
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
CSIT-1072
CSIT-1083
CSIT-1084
Change-Id: Icaf0e09af633d301306a84251f47822e95b411a2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
CSIT-1073
CSIT-1074
CSIT-1077
Change-Id: I248e079021c30988210fd792b32d5afdca71aadb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
+ Add 10ge2p1x520-ethip4-ip4base-ndrpdr.robot
+ Add 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-ndrpdr.robot
+ Make sure both IMIX and 9000B test cases are there.
+ Document NDRPDR test tag.
+ Execute some of NDRPDR tests daily.
Change-Id: I66427d49cb6b8304fde4e8d91606de33b624186a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: If495493f4dce8d2eecfb8c06bcd587f315b70b1d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I8c9290cc93496794f30275ee23cc013146be94fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- 10ge2p1x710-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot
- 10ge2p1x710-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot
Change-Id: I69f6fcb7c7cae46a8061fd75db9be2933154c3f9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
+ 10ge2p1x710-dot1q-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot
+ 10ge2p1x710-dot1q-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot
+ 10ge2p1x710-eth-l2bdbasemaclrn-eth-2vhostvr256-1vm-mrr.robot
+ 10ge2p1x710-eth-l2bdbasemaclrn-eth-4vhostvr1024-2vm-mrr.robot
+ 10ge2p1x710-eth-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot
+ 10ge2p1x710-eth-l2xcbase-eth-2vhostvr256-1vm-mrr.robot
+ 10ge2p1x710-eth-l2xcbase-eth-4vhostvr1024-2vm-mrr.robot
+ 10ge2p1x710-ethip4-ip4base-eth-2vhostvr1024-1vm-mrr.robot
+ 10ge2p1x710-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot
+ 10ge2p1x710-ethip4-ip4base-eth-4vhostvr1024-2vm-mrr.robot
+ 10ge2p1x710-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot
Copies of the respective x520 files,
with each "X520-DA2" or "X520" replaced by "X710".
Occurences of "Niantic" were removed.
Change-Id: I15bce75b704072b26a908f868e90a42dc3ea7661
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I63105e8a4f11d740c38fc6123984005bcefa117b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Currently Qemu is being installed if there is a change of qsz parameter
between tests/suites. Qemu is installed always into the same directory. This
patch changes the default behavior to install qemu over and install
pathced version to separate directory. It also disables force install.
Change-Id: I0d7493a02b026a6ae4a5ea8bacf54656de9db567
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I114c187f007c10223502669c2ba85c63d09cd84a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
CSIT-1002: container_memif
- 10ge2p1x520-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot
- 10ge2p1x520-eth-l2xcbase-eth-2memif-1dcr-mrr.robot
- 10ge2p1x520-eth-l2xcbase-eth-2memif-1lxc-mrr.robot
- 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot
- 40ge2p1xl710-eth-l2xcbase-eth-2memif-1lxc-mrr.robot
CSIT-1003: vm vhost
- 10ge2p1x520-dot1q-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot
- 10ge2p1x520-dot1q-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot
- 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot
- 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr256-1vm-mrr.robot
- 10ge2p1x520-eth-l2bdbasemaclrn-eth-4vhostvr1024-2vm-mrr.robot
- 10ge2p1x520-eth-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot
- 10ge2p1x520-eth-l2xcbase-eth-2vhostvr256-1vm-mrr.robot
- 10ge2p1x520-eth-l2xcbase-eth-4vhostvr1024-2vm-mrr.robot
- 10ge2p1x520-ethip4-ip4base-eth-2vhostvr1024-1vm-mrr.robot
- 10ge2p1x520-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot
- 10ge2p1x520-ethip4-ip4base-eth-4vhostvr1024-2vm-mrr.robot
- 10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot
- 40ge2p1x710-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot
- 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot
- 40ge2p1xl710-eth-l2bdbasemaclrn-eth-4vhostvr1024-2vm-mrr.robot
Change-Id: Idd049db6134179f0f9ed603569ec8512faca1ab9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Iaded13af82383955c2ff093ddc96e09682d95776
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
- Reduce binary step fof:
64B -> 50Kpps
1518B -> 50Kpps
9000B -> 10Kpps
IMIX -> 50Kpps
Change-Id: Id88bff7b1c37b2a03583dd27ca3db720ec7ae4a2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|