Age | Commit message (Collapse) | Author | Files | Lines |
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I766fe7c0837ad2694645230e5fcc1d59bbf59898
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ib03e469da3e93944ae7fb612e7a71df36f711cdd
|
|
Change-Id: I0e4e4758b3abbfc2fe2e18200b85477293de218b
Signed-off-by: Naveen Joy <najoy@cisco.com>
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
Also add IPsec 10000tnlhwasync int mode and 4tnlhwasync policy mode
test suites, in order to compare sw crypto and QAT crypto and IPsec
int mode and policy mode performance.
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Change-Id: I0aed06a0c75c1a545720649d3561a0aa5a861db2
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I20e720302561f5f7d1f7a80a83548077a88025af
|
|
Previously, only BMRR results were recongnized.
Now also lower bounds for PDR (optionally NDR) and soak are recongnized.
This code expects all tests are of the same type,
e.g. when both MRR and NDRPDR tests are run,
only MRR result will get parsed.
If test or parsing fails, generate fake data based on overall pass or fail,
so at least passrate of unknown tests can be compared in theory.
Currently affects only per-patch job (vpp-csit-verify-perf-*),
but is useful mainly for the upcoming bisect job.
+ Do not force MRR test type in vpp-csit jobs.
- Some test results are still not recognized (e.g. hoststack).
+ Do not exit per-patch job early on robot failure.
+ Only changes that introduce a failure (not present in parent) get -1.
+ The same is true also for introducing unrecognized test results.
- The fake values from passrate can be misleading.
+ Add default nic tag only if NIC tag is missing.
+ In all jobs, not only in vpp-csit ones.
+ Do not add NIC tags for device jobs.
- No job supports NDR parsing yet.
+ Can be enabled in future from ci-management side.
Change-Id: Iee904116d1ffed69aec7e31821c67d8447f49ebe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ie63b3d6c7ff376d808587e7c96f386946c939a81
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I1528d7760228d50a4d89c0e413ad86aa882088ed
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ic13b8cd3f2976c66d8956f0cee0784c3bae12a65
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Iea4c536a6e421efdaf493fb3cba0dde5abad162d
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I14975b21e7f480c3bca5ba6a04514008af219039
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Iccbe5f0cabe6fdd5274126cf970549673edd4f1c
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I4e19d8fe38802652b25e6a1c577e816328cebd2d
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I2e0feccef5c5b15b035490dfaf521c8c9a1795f8
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I3f7efcbfc82f683e7afc986d00fa71ae7413d93d
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ia9f5b1c9036b9f09c4d9bb041a41e9b49d2ead7f
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Iee0ded1f2fb43a09a7a1d61f593f4e92ead3dbb3
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I3308f12046dfeed7db872a3a901806acf81cdb15
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ied301e8fcca22af8420364f2e158dfdd49bdc58d
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Iccaa4f8945e5eb48272737338a52c9edbf1cb58b
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Iab5e8c21e4defb92e257459a64101a6f19609917
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I1c7df34cfb78cf767081acea435dc205b3f44a15
|
|
- Static content will be removed separately
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I0992e941e1c24552837eaf7e8d3f6564b3cb21c8
|
|
- Due to divergence from original design path the RAW was never
consumed. It adds too much code complexity and requires processing
on both storage and compute. Removing entirely to make modeling
efficient.
- log (apparently SSH) section will never be consumed in the way it is
coded in model. This section is also not part of model schema itself
due to the point above.
- Introducing telemetry section that is going to carry telemetry
items required for CDash.
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I7e0256c6c9715de8ee559eed29dce96329aac97d
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2a7e35bc3671cafaf696e5200d22e531e251b1ba
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic646f555855b1a13a86711ce4ce01ddfc2b44b1f
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1ff6ce2eeaf074773f27ce0d4d414c4963a7a2de
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id4b8f033c5a6e30ed0d64d3306858d0f06991017
|
|
Due to some integration changes with upcoming Ubuntu
22.04 (and mainly python) bump, upgrading the full
pip package list to latest version.
Keyword 'BuiltIn.Run Keyword Unless' is deprecated
- will be part of subsequent change
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie3bdc424c7c0efb4fe4f1fa7c73137b916c17116
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2ff6393aa885f03ba52a2cf79d49dac1815e2a86
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ife55633c620a3c762f4d939013a7f6fafb640aa6
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id4d84aa7268080843b099fd7ab9851234612968b
|
|
Update ansible, topologies, bash scripts and job specs.
Change-Id: I834b991f281e0b29b4af9dc37fe8028460298d83
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I12d2d58de01693b18628cd73b5d8c36467506f32
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5f68fd84a9ea034c5d8ff175807033aa0b60d5a2
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic676d00bd7d3d5d8c244bfd0eb7b10bc74498505
|
|
Part of fixing chain
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie423ccf5a51751e605d906dd1214f5174bb364ac
|
|
Part of fixing chain after early merge.
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I06e19def003575993bc3d97c0dc7fbedd3e5ff7a
|
|
Part of fixing chain after early merge.
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I983b3036a388656bbad91aba71cf14b503f875bd
|
|
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Change-Id: I1590d438216e4c886aae03f83364837153623dbc
|
|
+ Model version 1.0.0.
- Only some result types are exported.
+ MRR, NDRPDR and SOAK.
- Other result types to be added later.
+ In contrast, all test types are detected.
+ Convert custom classes to JSON-serializable equivalents.
+ Sort dict keys before converting to JSON.
+ Override the order for some known keys.
+ Export sets as sorted arrays.
+ Convert to info content from serialized raw content.
+ Also export outputs for suite setups and teardowns.
+ Info files for setup/teardown exist only temporarily.
+ The data is merged into suite.info.json file.
+ This simplifies presentation of total suite duration.
+ Define model via JSON schema:
- Just test case, suite setup/teardown/suite to be added later.
- Just info, raw to be added later.
+ Proper descriptions.
+ Json is generated from yaml.
+ This is a convenience for maintainers.
+ The officially used schema is the .json one.
+ TODOs written into a separate .txt file.
+ Validate exported instance against the schema.
+ Include format checking.
+ Update CSIT requirements for validation dependencies.
+ This needs python-dateutil==2.8.2, only a patch bump.
+ Compute bandwidth also for soak tests.
+ This unifies with NDRPDR to simplify schema definition.
- PAL may need an update for parsing soak test message.
+ Include SSH log items, raw output only.
+ Generate all outputs in a single filesystem tree.
+ Move raw outputs into test_output_raw.tar.xz.
+ Rename existing tar with suites to generated_robot_files.tar.xz.
Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I19c160e40e01bd7f69c08188f61d2bcbc3fd4bcb
(cherry picked from commit 8be983ad917cd47fa8da4256fa8ada14ecfcd425)
|
|
The comms DDP package needs to be installed to support all flow protocols
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Change-Id: I6ab1bd8beb9edb8c9889a0ed9a999080ca3cef3d
|
|
- job-spec for trex tests modified
Change-Id: Id04d76648f30baacfa027b182a838d2f681afcec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I82819c924012c966ba91fdf39ffba500ee0ce6b0
|
|
It uses different bootstrap than csit-vpp.
Just cherry-pick the edits from
https://gerrit.fd.io/r/c/csit/+/33513/15/resources/libraries/bash/entry/bootstrap_vpp_device.sh
+ Match just *device* when reading testplan.
+ Do not prepend MRR for vpp device jobs.
Change-Id: I13e171551ebc87af0ac3e3a1a1bcfae7cad8326c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I81958fbf6ef240d53a0fb8708ca882baf02f606c
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie8662b6a485374b5df68dec9c82065cf59f28c8f
|
|
When I make a typo in GERRIT_EVENT,
old code starts many ASTF tests.
Change-Id: Iac1c2cc620919d33b0e77bd28b145f3fd38d28ff
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I9c81563c904b02c5ca6ede5dc3d0922851c11ae4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|