Age | Commit message (Collapse) | Author | Files | Lines |
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I20e720302561f5f7d1f7a80a83548077a88025af
|
|
Previously, the Set up LDP or VCL Nginx on DUT node keyword
was wrongly documenting its "dut" argument as type string,
while using the value as a node dict instead.
As most of the code already used direct dut1 variables,
this patch eliminates the dut argument altogether
and puts DUT1 into the keyword name.
Change-Id: Ie29afc175b98c1b1cb554438da9178738662d108
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
If cleanup fails, we still want to examine robot logs
for any hints of why a node may have stopped working properly.
Bootstrapt scripts for device tests are doing that already,
so this patch only edits the perf verify bootstrap script.
Change-Id: I8b8ad7bcbbbbc26874068efe1b20e8053f0d5650
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I67eac5f0e68e9e84041816a8a6e6b8df3fdff664
|
|
Performance of adaptive mode is bad (different bug),
keep continuity of ipsec swasync tests (when VPP allows).
As 23.06-release does not have the new API message,
the new CSIT code needs to be more careful around CRC checking.
+ Add new crc collection with the new API call used.
+ Also keep the old collection so older VPP does not fail.
+ Document how papi executor works with VPP without a message.
+ Prevent CRC checker from raising bodus errors with old VPP.
Change-Id: I9ff933a8a9558289d22d55526905d63e7894378c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Previously, only BMRR results were recongnized.
Now also lower bounds for PDR (optionally NDR) and soak are recongnized.
This code expects all tests are of the same type,
e.g. when both MRR and NDRPDR tests are run,
only MRR result will get parsed.
If test or parsing fails, generate fake data based on overall pass or fail,
so at least passrate of unknown tests can be compared in theory.
Currently affects only per-patch job (vpp-csit-verify-perf-*),
but is useful mainly for the upcoming bisect job.
+ Do not force MRR test type in vpp-csit jobs.
- Some test results are still not recognized (e.g. hoststack).
+ Do not exit per-patch job early on robot failure.
+ Only changes that introduce a failure (not present in parent) get -1.
+ The same is true also for introducing unrecognized test results.
- The fake values from passrate can be misleading.
+ Add default nic tag only if NIC tag is missing.
+ In all jobs, not only in vpp-csit ones.
+ Do not add NIC tags for device jobs.
- No job supports NDR parsing yet.
+ Can be enabled in future from ci-management side.
Change-Id: Iee904116d1ffed69aec7e31821c67d8447f49ebe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ieb1576aa45e689dda8358c4ad4708b3b09b5216c
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I6768f65551deb335ba7b9fc07bca164bca9381fe
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I8d3e93f61ba7929b79da386fbfcece992fea7324
|
|
Change-Id: Iac742f0571b11e06662af6bf1b680d0b4e196ddd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Idc91da55ab0b5c6b8eb53e8b4ce4da18a1ae891c
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ia85c4a48155c1e760120a61b39bacbb9de1ab673
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Iafae1a1f538b928d3bb80bf9610a0bf7de646f8a
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I28af64b7d39a97bbb84f9d987a3f5d3a2d02701b
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I782b87190dbee6e0a12c97f616b80539cd6614bd
|
|
Robot already prints warnings when running tests,
but not many people are looking at robot console output.
This makes the warnings visible also in VPP API CRC job console log.
Change-Id: I9044a2970f46e132ec80ae0faa2e0adacc889447
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
The supported VPP code is 380c62d7040bf285d449f1d05692141c40089470
which is the latest commit before stable/2306 diverged from master.
+ Separate messages into blocks with paths to .api sources.
+ Prepare memif for use_dma (currently always false).
+ Use srv6 test teardown action in srv6 device tests.
- Do not use sr_policy_add_v2 from 37258 yet.
- Leave a TODO to do it eventually, for now inputs are too different.
- Do not use index based policer calls from 37873.
- The policer_add_del is not deprecated yet and inputs are different.
Change-Id: I350138f09542ec12ce4bec140203175940ccf9d4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I8127beeb6664aa51ef5cb313d658ab2e5638b581
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ie63b3d6c7ff376d808587e7c96f386946c939a81
|
|
This fix is mainly needed for bisection using PDR values.
The impact on trending is smaller but still beneficial,
as this fix should reduce the amount of false anomalies
for two-band and other unstable tests.
+ Update metadata for 0.4.1 release into PyPI.
Change-Id: Iabab4df50f4c4ad034362820904a237c507fa710
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I1528d7760228d50a4d89c0e413ad86aa882088ed
|
|
Add ipsec reassembly test cases to bring in line with 3n-icx.
Add ipsec policy test cases with flow cache enabled for both inbound and
outbound traffic.
Remove GTPU hardware tests as the NIC doesn't support GTPU offload RX.
Change-Id: I7b18914f983d5974b390f995ec638a64b9bbccbb
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Iad8e468200df4ab77f4ed44010b1b029e840714f
|
|
QAT_4xxx is integrated QAT device on SPR platform.
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: If1d4b3d72a2c66855ac8c1c42516f0cb78bdfab2
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I85de04e4a0ed1a642c40c8ca6840cbc1977b10be
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ie99c70ebda54153eb361954cbbd4f8191454a022
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ic13b8cd3f2976c66d8956f0cee0784c3bae12a65
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Iea4c536a6e421efdaf493fb3cba0dde5abad162d
|
|
Previously, Jumpavg was known to give wrong results
when the data contains values of order one or smaller.
This change introduces a new "unit" parameter,
which changes how the information content is calculated.
For example if the data values are mutiplies of 0.01,
the unit parameter should be set to 0.01 to compensate.
For callers not knowing their correct unit value,
another parameter is introduced, called "sbps"
(meaning Significant Bits Per Sample).
A binary integer number with this many ones
is how much units should the maximal sample be.
This way jumpavg computes the corresponding "unit" value to use.
If neither "unit" nor "sbps" are given,
the "sbps" value of 12 is applied.
+ Rename files to conform to snake_style naming.
+ Fix normalization for the "opposite triangle" distribution.
+ Simplify logic, all groups now start as "normal", not "unknown".
+ Minor style improvements as suggested by pylint.
+ From user perspective, this change should be backward compatible.
- The normalization fix is a behavior change,
but it is a bugfix and the new behavior should be better.
Change-Id: I5a5ca11757f087fff13faf1d0b8e34a741400258
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I14975b21e7f480c3bca5ba6a04514008af219039
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ib98b25bd3c98b5e6dbcb1bfe8478bd41bf37d71c
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I84b46e6a792d72cb56a9a42d40db8cc13866b836
|
|
Change-Id: I6ec27d787b59d4bc13b8c04f4217302cc3021581
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I198fe62ddba8910c6bd8256739cc2503b87dfc75
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I4c192210e1aef1275e8a9b56eab7956798aca15d
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ia13e920ef11d364893a51957778e60084f4ac0f9
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I58607f50e2889092e40ff831ed4f1515444e29f8
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I4924054b414dc450df14a02a29081549c8620787
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I881dda8b2fec32b8f489ec97df6592937f6193fa
|
|
Change-Id: Ibef272705ea889d58bb9c5b69a8566f6e38de1d1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Iccbe5f0cabe6fdd5274126cf970549673edd4f1c
|
|
In tunneling scenarios, VPP needs to reassembly packet fragments
before decapsulation. Conveniently, VPP also fragments the packets
after encapsulation (at least for some encapsulation protocols)
if they do not fit into MTU.
So this change adds few suites, adapted from existing 3-node ones
which additionally lower MTU on DUT1-DUT2 link.
The intended packet size is 1518B. 64B packets will fit,
and most of IMIX packets will also fit without fragmentation.
VPP refuses to reassembly 9000B packets as they have too many fragments.
+ Add a keyword so suites need only one additional line of code.
+ Add new test tag REASSEMBLY for the added suites.
+ Tell autogen the one soak test case for reaseembly should be 1518B.
- It is possible to increase fragment limit for 9000B, not done yet.
- Ipsec policy suites are added but they should not be used.
- VPP does fragmentation twice (before and after encapsulation).
- VPP does not perform reassembly (only last fragment is decrypted).
- TRex does not realize the packet from VPP is only a fragment.
- The result is false pass with unfairly good performance.
+ Suites still included, to simplify verifying VPP fixes for the above.
Change-Id: If33c60d767fea161d9e4ffabb8ded3d81c8f39ed
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I16defefa5edd01638bc382be4f5e8cbca4fe9453
|
|
The current invocation is deprecated:
WARNING: Running the setup command as `meson [options]` instead
of `meson setup [options]` is ambiguous and deprecated.
Change-Id: Ieffa7f295e4ea7634ee5e8f77e373c5e9314b3cf
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I1537f3383d44ace8e705e5c744713d0863ca67d0
|
|
When changing MTU on a running VPP, the interface has to be down.
- Other plugins (rdma, avf, af_xdp) need vastly different logic,
so support for them will be added later.
+ Mlx5-core does not need to set MTU on Linux interface.
+ MTU setting now does not happen at final setting path up,
it happens in driver initialization layer instead
E.g. AVF tests will not attempt to change MTU.
+ MTU edit removed from some non-hardware interfaces (including memif)
e.g. bond interfaces. MTU on parent hw interface seems to be enough.
+ The non-jumbo MTU value used is 1800,
so 1518B tests with additional encapsulation can still work.
+ When VPP MTU setting fails, the failure is now propagated.
Previously, the failure was just logged and ignored,
but now there is no reason to hide it.
Ticket: CSIT-1797
Change-Id: I3b853f1faf90001d544cbbb87b2affbb882ffba0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ifa3964f290d75ebae094d1d46ce27b5d133c2158
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I4e19d8fe38802652b25e6a1c577e816328cebd2d
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I45760143ae0ccb0cc0edf0931ad47f5cf48ec968
|
|
On 3n-tsh testbed, the vm sometimes times out when booting. Increasing
the timeout is harmless since it doesn't affect perfomance.
JIRA: CSIT-1877
Change-Id: I45eebdfba2fcd7c9a0be083ebb3515d37724e965
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|