Age | Commit message (Collapse) | Author | Files | Lines |
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I766fe7c0837ad2694645230e5fcc1d59bbf59898
|
|
Change-Id: I96616f6895c9a0c9fb7dc876b2e8b83eff379f16
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
|
|
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I7f0eee8b94f65550eae68edeacf343ff982dd85a
|
|
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I69ee305b25b9e05d2305cb82aba71ef6418780ab
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ib03e469da3e93944ae7fb612e7a71df36f711cdd
|
|
Change-Id: I0e4e4758b3abbfc2fe2e18200b85477293de218b
Signed-off-by: Naveen Joy <najoy@cisco.com>
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Idf4df372520d4a72c0738a89290d16710485f140
|
|
No effect on NDRPDR results, just different result packaging
between the MLRsearch library and the rest of CSIT.
- PyPI metadata still to be updated in a separate Change.
Change-Id: I547134da189d1d7761594e92f36cc7c1c232ee32
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I35230692241a5f54420ece3340530f6c608828bb
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Hopefully, with CSIT config values, PDR lower than NDR will not happen.
+ Bump duration_sum default to an odd number,
so users are not surprised by not seeing standard median behavior.
For CSIT this should not matter, overheads hide ties
and number of trials (at least for STL) should stay the same.
Change-Id: Id7130f978c31e71227499612424007c473bcfac2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Replaces MLRv2, suitable for "big bang" upgrade across CSIT.
PyPI metadata updated only partially (full edits will come separately).
Pylint wants less complexity, but the differences are only minor.
+ Use the same (new CSIT) defaults everywhere, also in Python library.
+ Update also PLRsearch to use the new result class.
+ Make upper bound optional in UTI.
+ Fix ASTF approximate duration detection.
+ Do not keep approximated_receive_rate (for MRR) in result structure.
Change-Id: I03406f32d5c93f56b527cb3f93791b61955dfd74
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Id646ab09ae51d3153446f1ae334f62ba7710be14
|
|
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ibe13acbd104e780f42e104755db026dcdd478f62
|
|
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I9e4eac451578c0f6b86b1dde237512184c163def
|
|
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I9f579385299e69e4d5679ed451ae0b4c30406733
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I8635e5731260bf0daecf87c852bc2dfb867fe650
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I02468203f3eb4545b6662bad2ce9aa72ecd5a5f6
|
|
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I36c5d175a34555ad9ce88d69a824f366b54dbc81
|
|
Change-Id: I4277f23d94fa191890041bb43e2fcd4eb5e42019
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Id72bbee0f5623f82cb097a5169c60fda3584d83e
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I8945daffd500f689b3eb630f1ce7e1dc4f05aca8
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I684be7f41772b96d918b5f009d2052139f7219cf
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I4db3fc1b70469a966e51afe3bfa93cb4bcffa654
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I8d168979ab9722e0056e97edb228f29cbfa245e3
|
|
Remove 4 tunnel flow cache test cases, as those don't benefit from flow
cache much.
Add mrr ipsec test cases for the XL710 Intel NIC to increase coverage.
Don't add ndrpdr for XL710, only add commented out counterparts to
align with the mrr list.
Also modify the existing flow cache configuration by adding the fast
path config as well. These are independent features, but the fast path
code added this dependency.
Change-Id: Ide88fd8c1abe96c577a86925dcc2dc4e63f897d4
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
Also add IPsec 10000tnlhwasync int mode and 4tnlhwasync policy mode
test suites, in order to compare sw crypto and QAT crypto and IPsec
int mode and policy mode performance.
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Change-Id: I0aed06a0c75c1a545720649d3561a0aa5a861db2
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Icf68d2f244432f49f6b8fb0876807d694a1e8e31
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ia8067fb1683295fb711bbba81a35b0e6d18b084f
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I38aeb3d75793addafb44f407fabf6bac6705b682
|
|
+ Use test names in output.
- Methodology updated in subsequent change.
Change-Id: I6a62f87249ea79262778f68d00f9bb81134f0b02
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I3aad4fc5a56a1c02e975f664449a6f9d50fc300e
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I20e720302561f5f7d1f7a80a83548077a88025af
|
|
Previously, the Set up LDP or VCL Nginx on DUT node keyword
was wrongly documenting its "dut" argument as type string,
while using the value as a node dict instead.
As most of the code already used direct dut1 variables,
this patch eliminates the dut argument altogether
and puts DUT1 into the keyword name.
Change-Id: Ie29afc175b98c1b1cb554438da9178738662d108
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
If cleanup fails, we still want to examine robot logs
for any hints of why a node may have stopped working properly.
Bootstrapt scripts for device tests are doing that already,
so this patch only edits the perf verify bootstrap script.
Change-Id: I8b8ad7bcbbbbc26874068efe1b20e8053f0d5650
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I67eac5f0e68e9e84041816a8a6e6b8df3fdff664
|
|
Performance of adaptive mode is bad (different bug),
keep continuity of ipsec swasync tests (when VPP allows).
As 23.06-release does not have the new API message,
the new CSIT code needs to be more careful around CRC checking.
+ Add new crc collection with the new API call used.
+ Also keep the old collection so older VPP does not fail.
+ Document how papi executor works with VPP without a message.
+ Prevent CRC checker from raising bodus errors with old VPP.
Change-Id: I9ff933a8a9558289d22d55526905d63e7894378c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Previously, only BMRR results were recongnized.
Now also lower bounds for PDR (optionally NDR) and soak are recongnized.
This code expects all tests are of the same type,
e.g. when both MRR and NDRPDR tests are run,
only MRR result will get parsed.
If test or parsing fails, generate fake data based on overall pass or fail,
so at least passrate of unknown tests can be compared in theory.
Currently affects only per-patch job (vpp-csit-verify-perf-*),
but is useful mainly for the upcoming bisect job.
+ Do not force MRR test type in vpp-csit jobs.
- Some test results are still not recognized (e.g. hoststack).
+ Do not exit per-patch job early on robot failure.
+ Only changes that introduce a failure (not present in parent) get -1.
+ The same is true also for introducing unrecognized test results.
- The fake values from passrate can be misleading.
+ Add default nic tag only if NIC tag is missing.
+ In all jobs, not only in vpp-csit ones.
+ Do not add NIC tags for device jobs.
- No job supports NDR parsing yet.
+ Can be enabled in future from ci-management side.
Change-Id: Iee904116d1ffed69aec7e31821c67d8447f49ebe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ieb1576aa45e689dda8358c4ad4708b3b09b5216c
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I6768f65551deb335ba7b9fc07bca164bca9381fe
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I8d3e93f61ba7929b79da386fbfcece992fea7324
|
|
Change-Id: Iac742f0571b11e06662af6bf1b680d0b4e196ddd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Idc91da55ab0b5c6b8eb53e8b4ce4da18a1ae891c
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ia85c4a48155c1e760120a61b39bacbb9de1ab673
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Iafae1a1f538b928d3bb80bf9610a0bf7de646f8a
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I28af64b7d39a97bbb84f9d987a3f5d3a2d02701b
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I782b87190dbee6e0a12c97f616b80539cd6614bd
|
|
Robot already prints warnings when running tests,
but not many people are looking at robot console output.
This makes the warnings visible also in VPP API CRC job console log.
Change-Id: I9044a2970f46e132ec80ae0faa2e0adacc889447
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
The supported VPP code is 380c62d7040bf285d449f1d05692141c40089470
which is the latest commit before stable/2306 diverged from master.
+ Separate messages into blocks with paths to .api sources.
+ Prepare memif for use_dma (currently always false).
+ Use srv6 test teardown action in srv6 device tests.
- Do not use sr_policy_add_v2 from 37258 yet.
- Leave a TODO to do it eventually, for now inputs are too different.
- Do not use index based policer calls from 37873.
- The policer_add_del is not deprecated yet and inputs are different.
Change-Id: I350138f09542ec12ce4bec140203175940ccf9d4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I8127beeb6664aa51ef5cb313d658ab2e5638b581
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ie63b3d6c7ff376d808587e7c96f386946c939a81
|