Age | Commit message (Collapse) | Author | Files | Lines |
|
Change-Id: I594d248c58dcdcdeceea57af2dd25e2b2e08247f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 100fee239bb1627e4d109f72e742cf7087315d31)
|
|
- use correct osi_layer=L2 (so L2 spoofing check is switched off
in case of avf driver)
- add pci address information to eth interface in topology file
- nfv_density chain_ipsec tests work only with DPDK
in current implementation
Change-Id: I233c6e5634a14581960c7459b87f11fcee8365bd
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit f31b70ee422ed0dc4e5d9b60061a1c2cfc904684)
|
|
Change-Id: Icff49fb31cce342a2a4ae799e844ec91f9e5e366
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
(cherry picked from commit 6518c73a0e5cdaf12ae01d247a65aec287d01625)
|
|
- Leftovers from kubernetes found, but not removed here.
Change-Id: If8cb9269d0f3e69f642d7fe02c59122e17925a4d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
New daily sets are prepared based on information in
https://gerrit.fd.io/r/c/csit/+/24073/1/docs/job_specs/perf_tests_job_specs.md
and previous test set definitions in
docs/job_specs/test_select_list_[2n|3n]_[clx|skx|hsw|tsh|dnv].md
files.
- mrr-daily-2n-clx: 510 TCs (incl. nfv_density), expected exec. time 8:50h
- mrr-daily-2n-skx: 525 TCs (incl. nfv_density), expected exec. time 7:55h
- mrr-daily-3n-skx: 393 TCs (incl. nfv_density), expected exec. time 11:00h
- mrr-daily-3n-hsw: 177 TCs (incl. nfv_density), expected exec. time 7:10h
- mrr-daily-3n-tsh: 204 TCs, expected exec. time 21:00h
- mrr-daily-2n-dnv: 84 TCs, expected exec. time 2:25h
- mrr-daily-3n-dnv: 144 TCs, expected exec. time 6:35h
+ add some missing test suites
+ add trex-sl-2n-ethip4udp-1000u15p.py T-Rex traffic profile
+ correction of TS and TC names and tags in directory
tests/vpp/perf/nfv_density/chain_ipsec
Change-Id: Icfc86e9af97ed8dd8ccd2a34355c99aad69a28c0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
+ Include a script to add suite tags to many suites at once.
+ Add suite tags also to device tests (not covered by autogen).
Change-Id: I514ee6178e22999b43460028fe2696738b012f04
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
+ Disallowed -avf- (or -rdma-) as "template" suites.
+ GBP suite switched to DPDK driver in repo.
+ Each NIC has its own list of supported drivers, in Constants.
+ Updated tag expressions for daily jobs:
+ Feature, ipsec, memif, scale, srv6, tunnels, vhost and vts
are tested only with vfio-pci.
+ Other (base, dot1q, dot1ad) tested with all drivers.
+ Setup actions currently depend on driver, generated.
- The performance_rdma action is trivial for now.
- Several tests fail, to be fixed later, e.g. by performance_rdma.
+ Reconf tests are also supported.
+ Added DRV_VFIO_PCI tags missing, mainly in density tests.
- Vhost suites (density, reconf) are failing, but suites look good.
- TCP suites do not support NIC drivers yet.
- DPDK obviously not supported.
+ Use Python 3 in regenerate scripts.
+ Fix typos binded => bound.
+ File open modes set either u"rt" or u"wt" everywhere.
+ Remove a trailing space in an environment variable name.
Change-Id: I290470675dc5c9e88b2eaa5ab6285ecd9ed7827a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- DUT only topology (hoststack test
apps are co-located with vpp)
- Make vpp app specific keywords generic
where applicable
- Add IP4 Prefix to topology file
- Support running wrk in linux namespace
- Refactor namespace cleanup
- Remove redundant namespace creation code
- Refactor test/keyword dirs: tcp -> hoststack
- Add hoststack utility keywords
- Refactor wrk suite setup/teardown
- Update tests with recent perf infra changes
Change-Id: Ia1cf07978d579393eef94923819a87c8c1f36f34
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
Change-Id: Ibbfbed79e473c804390802ae1ecd737b50c06aa3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- use new vpp ref build - ubuntu 18.04:
20.01-rc0~983-g78565f38e
- use new vpp ref build - centos7:
20.01-rc0~983_g78565f3~b8651
+ remove EXPECTED_FAILING tag from tc01-64B-ethip4-l2patch-dev test
Change-Id: Iab47a66003926024f87e028b1b1d9136b8fb4ec4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
This reverts commit 09c5a6b8e1c6efed8826ef34aa64809226e80edb.
Reason for revert: CSIT has not yet the latest VPP version
Change-Id: Ibaa2c00c639bacef1561898daf9485c3a68efec4
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie950370c47403872597f8857edd651df2552ccb2
|
|
- Converting to 2n as they were always 2n (with l2xc on 3rd node)
- Removing KW and converting to layered approach
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie349c50f72eb362815e7c5ede076d421ab386e76
|
|
+ From trending ...
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0ebb5429f0ad731d42aa43855cd99ae73b1461fc
|
|
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I76835e3d3acf6955e328f30427f9dd0098947e41
|
|
Change-Id: Ic99e828588d561a07c169502dff8ca19ac98400f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Change-Id: Ie64d662e81879bd52785e0188450d998bf056bda
Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iebdc03e56cf9ecf0322ff5c2c8698e9e3daf4407
|
|
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/21551
- move vpp stable build to 20.01-rc0~821
- tap tests tagged 'EXPECTED_FAILING' until necessary vpp api change
https://gerrit.fd.io/r/c/vpp/+/21706 and csit code is adapted
Change-Id: If4b9b7b5bc207612d08aa8aa4469a5361e058fc3
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>
Change-Id: Iadd9e8da655f3ccbd36167c1bbee37a774c3bc1f
Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2b1672412e19f15cb46246fffa931351cd3d518b
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7c948be40aaf2eb03434cec5548a89aaf0f1eca6
|
|
Change-Id: I1392c06b1d64f62b141d24c0d42a8e36913b15e2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Change-Id: Ib7f9dff7bede4f8ec3148f234109132be920de82
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I60d80564050cb786c7b1e0a08f31f8292f82197e
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibc3350acab54100f03f540397bfcbd6e7455ea2c
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0c9b8b07ed3a113e24a38faaddd5ed06fae67768
|
|
Change-Id: I03603108fe7128fb4bde4abddb6a0959dd5b5c73
Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>
|
|
One suite was missing "And Add NAT to all DUTs".
Change-Id: I6e9c3de9f236a080cfe829db2d155a6f6ba3b3f4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: Ic11f863e7ffad70d45e6e8dc39c70efc62cecc96
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
- These testcases are non standard so they need to be refactored
to be able to use the interface layers
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9400846ff04f1864babd6d7fa153f0c3708cb105
|
|
- IPsec proto is not for GCM
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: If6a9721574a72dacb4486c837100e4f2ed2bab19
|
|
+ This will help unify driver base differences between TCs.
+ Decrease amount of logic needed for suite generator.
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1e84ba361dc1e829f0612c58a61096e2633ce0c5
|
|
+ Small bugfixes in various suites
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I051af0a6da7340fe3f617400370c3846ca5241ab
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I020cdb6ced70a9c22773dfbe1662aecd2b744d2d
|
|
Change-Id: I61555ba566efef0a2151db9a30bf7f5d9ccad1df
Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>
|
|
Change-Id: Id199eb774850153fb225434d4a3d194706fdfdb3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I6c7eff8d9cbb196ccb684a45579ac59942351cfe
Signed-off-by: premkumarv <preym17@gmail.com>
|
|
Change-Id: I0fbe4d9ef1b30a1ac1382ea43b5b52aeb8a7d39f
Signed-off-by: Nidhy <nidhyanandhan.a@hcl.com>
|
|
- Attempt to repair IPsec LispGpe perf suite.
+ Collection name to reflect the current stable vpp.
+ Add messages found in CSIT L1 keywords.
- Uncommented (instead of deleted) untestable messages. Reasons:
- Honeycomb.
- Messages used by unused keywords.
+ Listed reasons. Honeycomb not mentioned if both reasons apply.
+ Delete CRC items for commands not found in keywords anymore.
+ Add CRCs from .json.api files (as teardown is hard to execute).
+ Define and restore alphabetical order.
+ Add hints to find used API commands (not entirely reliable).
+ Move used commands to "cmd = " form so hints find them.
+ Argument to run_cli_command changed from "cmd" to "cli_cmd".
+ Except also struct.error where IOError is excepted.
Change-Id: I61058dbe1e33296908aabd0c13433bb16cfa6adf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6cb4ef356047bdc341a70a4e7b8d0b3f54eb7f9d
|
|
Instead of using EnsureGlobalVariable,
which is clunky to use from Python.
As a consequence, all caps variables from Constants.py are used directly
and tests/__init__.robot and robot_enhancements.robot are deleted.
+ Rename the CRC global kill switch based on ci-man review.
Change-Id: I10723792475bc83352bf8c3b7f7946ecf885a194
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
The plan is to override the default in some (but not all) jobs.
The csit-vpp jobs shall do the checking, but vpp-csit jobs shall not
(except api-crc job of course) in order to confirm benign changes.
Change-Id: If59d17991de3fb0e847113a87e0533a8ee62af7f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I291c3dc852e7c1bde6fb6102a9168cfec9992682
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id39667515e304f4d92f230f82d3f1dbc1e22ac32
|
|
- Added new traffic profiles.
Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
Change-Id: Ie06b7a1cf4d9df403d098b7a495219fd95e5869e
|
|
2n-10ge2p1x710-eth-l2bd-6ch-48vh-24vm1t-vppip4-ndrpdr.robot
Change-Id: Ibe231547e26d9b379554eec8ca6a9b4d7bc1224b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Ticket: CSIT-1551
+ Config copied from other suites.
+ Layer keywords prepared for additional chains.
+ Renamed "create" argument to "vlan_per_chain".
+ TrafficGenerator result extraction improvements.
+ Also unified TG type and subtype checking.
+ Throughput estimated as PDR for zero PLR.
+ Actual Qemu start is skipped.
+ Parse xstats instead of stats in trex stop scipt.
- Because stats are unconditionally cleared on each script connect.
+ Remember start values to get better ReceiveMeasurementResult at stop.
+ Expose loss count and time as appropriate test message.
+ Autogen support.
+ Multiple chain amounts and core densities.
- Only 1 additional chain.
+ Proper TAGs. Documented.
+ Clarified min framesize tags are for TG-DUT.
+ Added a TODO concerning overhead values.
+ Added 118B tag.
+ Robot performance keywords improvements.
+ Added missing return value documentation.
+ Frame size as required test variable, not an explicit argument.
+ MLRsearch keyword to store result (not into test message).
- TODO: De-duplicate: main keyword to measure, minor to set test message.
- But implementation uses the fact default arguments are different.
+ Keywords for starting and stopping background traffic.
- No checks whether start-stop pair is complete.
+ Multiple minor indentation and logging improvements.
- Missing / TODOs:
- Support also vlan_per_chain=True?
- Support dot1q without vxlan?
- Support also deletion?
- How to package config steps so -reconf can be generated from -ndrpdr?
Change-Id: If0270697f9ffa837c34ef802917220a53f156703
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
+ Add testcases and tag expressions for perf occurrences.
+ Add TNL_1 tag for single tunnel IPsec suites.
- Some CRCs were missing before, but form a pair with a listed CRC.
- Probably the other half of the pair is not used.
- Will be fixed in subsequent Change.
Change-Id: I5754210755c13c41226b71045813714a65a1cdf3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I786fe9f75777e1cd0daee70bc350185dd7fd17e1
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|