Age | Commit message (Collapse) | Author | Files | Lines |
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ic7f24767b60eef5ddb7cdf5f933d82930c625f5c
|
|
+ Model version 1.0.0.
- Only some result types are exported.
+ MRR, NDRPDR and SOAK.
- Other result types to be added later.
+ In contrast, all test types are detected.
+ Convert custom classes to JSON-serializable equivalents.
+ Sort dict keys before converting to JSON.
+ Override the order for some known keys.
+ Export sets as sorted arrays.
+ Convert to info content from serialized raw content.
+ Also export outputs for suite setups and teardowns.
+ Info files for setup/teardown exist only temporarily.
+ The data is merged into suite.info.json file.
+ This simplifies presentation of total suite duration.
+ Define model via JSON schema:
- Just test case, suite setup/teardown/suite to be added later.
- Just info, raw to be added later.
+ Proper descriptions.
+ Json is generated from yaml.
+ This is a convenience for maintainers.
+ The officially used schema is the .json one.
+ TODOs written into a separate .txt file.
+ Validate exported instance against the schema.
+ Include format checking.
+ Update CSIT requirements for validation dependencies.
+ This needs python-dateutil==2.8.2, only a patch bump.
+ Compute bandwidth also for soak tests.
+ This unifies with NDRPDR to simplify schema definition.
- PAL may need an update for parsing soak test message.
+ Include SSH log items, raw output only.
+ Generate all outputs in a single filesystem tree.
+ Move raw outputs into test_output_raw.tar.xz.
+ Rename existing tar with suites to generated_robot_files.tar.xz.
Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
+ Implementation stub so checker can check already.
+ Also add documentation stub for the implemented model.
+ Checker checks also for bumps in documentation version.
- Not comparing implementation and documentation version yet.
Change-Id: I4d19c00315a1c171de325c4494c28f5210635f32
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
He is no longer active on the project.
Change-Id: Ic7621fb3dc4148ba41760f227e39bc52256b7463
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: If655d953eb8317f0cba6b3cb35bec232031df7dc
|
|
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Ib0a853f7bd8cdbb0dee747e4f601bc4e54d006e9
|
|
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I1ecbfa48f3765884720f0490b9b9da1f69bd2b1a
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I29d53bdb20675a814e94ab6ceeda850147e3cb98
|
|
adding trend in Mpps, runs for trend in #, trend change in %
+ dashboard - removed Short-Term change and added # of runs for trend
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Ib02d2a2224fc52b79832560241b0530aa2eaaf77
|
|
When building documentation using sphinx we see ~1200 similar warnings [0]
[0] - https://s3-logs.fd.io/vex-yul-rot-jenkins-1/csit-verify-tox-master-ubuntu2004-x86_64/3289/doc_verify.log.gz
These warning are harmless and can be fixed later
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I1ac1099d38935971d47491dde905715345d3935c
|
|
Change-Id: I460247c30a19adb41e6c9ccd5f8c9c914791d219
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I56868d2e62cea8e3bbc6c53c989bb8a8968bc6fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Iec8aba498b5b771bf5b85431a70390cea26c3582
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I130405cd96630e8384d67da02a8bfd1449ff4c85
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Ic9a90274f5e9791c34560725aaf29266c2a89ce4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Previous code changes updated code comments, but not docstring.
Change-Id: I5be3fd07620cc97c9088efceb72c2f68ab103915
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I31046025e88ee0e7a13b8d7dd4d40574687a1bd8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Iec877a74701409c87f941b540494e1f313b32911
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I97bba8f2092bc0554702a3acac10594426bd79c3
|
|
Change-Id: I798cf16af363d1035c816873a2ef6ec59824a17e
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
+ Add ability to switch between hugepages.
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I84d8eae28ed414a32e5ba82e6c9ed10d7f0ef9cb
|
|
Change-Id: I1cba1060d2d773d1209feb884ab46bbb7b1ada56
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
If ./{filename} does not execute, {filename} should not be flagged as executable.
No .robot file is executable.
Change-Id: I7add9d223ad0e587bc041a4cca6bac222a89e078
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: Ia7a75e03c7e5a1c8009ea04e2f515e495b516de0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I59315e7ab10b6773cc17c72bae7e73774755efb5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I9340f4a34d95320e833c209fdec4bff7649522f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
This helps to distinguish different symptoms for PAL failure alerting.
Change-Id: Idd8e8f4b427641fa055516bdf17715f6b967ca72
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Some testbeds occasionally miss one session with the previous value.
+ Increase ramp-up duration proportionally.
Change-Id: I5300127d7e8fbc670c37ae392ab514b077b3c9b1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I291e83e4f8e4d9798b2868425b7a1fb6b63d8639
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Iaa369a5243b9c77760549f6dae3dd16d8139509a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I9cc4424bb4d0dfa3949321349267d190c939f4e3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I258891f482d87d930d5df8f2dc93b0507f798b8f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- seems to be corrupted
Change-Id: I7f7cb780c0a94601a2c2808d4ef384cb24c3fd99
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Ic316149bab15c6fe1efccb53df0afa1cc78b3672
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Add newly added spd outbound tests with and without flowcache. These new
test may result in too many mlr tests, so remove the least needed tests,
which are 2m and 1m scale tests. This also unifies which scale tests we
run between af_xdp and dpdk tests.
Also cleanup all 2n-tx2 job specs.
Change-Id: I99bedefcef86f4b921f359f1ebf6c42ebdd8c20f
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
Change-Id: I0ed346ff30c61d28b5a2232ef2f9d32d26c1ae2c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I1dcddef704898cfa4ff9a84934fd11b8cf7b139a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- enabled only for aws throughput and soak
Change-Id: I3c4266e35d98d8319ef1e5c365734338195a40d9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Idaeba305747863178a5eebc1d42f389a14d6084e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
The existing condition is missing parentheses and doesn't work as
expected.
Change-Id: I3c45f5764b95bc8dcfbdd8ee6e2698bfb022dfb6
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
Change-Id: I2d5ff51cc5410ff1bcb12b44a22a7bd314b05f12
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Ie384ab9db8f3ba909ec0b6eaf39a04c5c7f3157a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I119fa64da4b178cb6a8abe63fb16e0bc7f18fd70
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I4acbe6b20054881f95bf4bab03958ad2dab60629
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Ifc2fdd04270628053646a6b3d8b15bc730325eb6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I2ee6005d499c4d93cca72cffd3373ced16d7c994
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Ifea5d3b84dbc0df4d8365ed1c1b4dfdd4c49f140
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I0c763ae0371515955037f0aaa867251b5aaec604
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Reason for revert: Fixed
Change-Id: Idbafdb953964967276f4f5748c78398a33635e2b
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I80ec9854b311af7a8da9363cf569598e1eb667f4
|