Age | Commit message (Collapse) | Author | Files | Lines |
|
Change-Id: Ice668fa21f0f634cbd749365c9e6f0ffc440346c
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 0189b942c60c000917639178f390fdc3bbcd574d)
|
|
Change-Id: I8c280b231babf00438f97afae2bdbbe731c012fe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 43028ac5bdcf014c94cb62702765dd62980994bd)
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic85ac52301a057e9efdc04478a2fe8a56c38d69d
(cherry picked from commit fcedfd41d4b6a3236b78503dca16c687adc349bb)
|
|
Change-Id: Ia933d6719c41100524fd1e64990b38e03604c5ec
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 26a677d37ed095e9a876b8a916d4c967ecfbbea1)
|
|
Change-Id: I00fdec38ab6e8a1bc61f2852bac3e49a90ca30af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 51e49d62566faaaa652837ad9cf7766d2810fc61)
|
|
- VPP
- DPDK
- TRex
Change-Id: I0f0c45fe0727a2819f2c092585184e79942f2eaa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 323037ecbec7442d90e74b1f6fdf90633026b447)
|
|
- VPP
- DPDK
- TRex
Change-Id: I2a65829d7c6421b7a824cd169b3f273dc9c141c2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4d408591dd5869fec2bdf20ca91feb54f0719748)
|
|
Change-Id: Ica6de877b954ed09026d16610a3c8ee44fca8627
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 29451403aaa6e6a8ad0be7f756dfb6abb168d3bf)
|
|
Change-Id: I2d3773add4bc57e944a8c174a4bc774a13956fa9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b1d6ce040bc6d2df008836cda435ee9f6f6c7d51)
|
|
Change-Id: I2bb089720fda87f28c17c64bc664ae79343360fb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit aea0d8658de598d5cb4603bb2b5a2583ccbe4b19)
|
|
Change-Id: I1c9f58a27f1e881cca3e639d084547dfac88af91
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1f7bfaf0f94fe68aadf41fde09b57c2f3171dea9)
|
|
Reason:
- ndrpdr job execution time >> 24hrs
Remove:
- ip4 and ip6 scale200k tests for dpdk and rdma
- ip4 and ip6 scale2m tests for dpdk and rdma
- af_xdp tests from NICs other than xxv710
Change-Id: I32fce8f436ae5ebbac8da9a9c670bdcb60abb3d8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9256923c6b890771ed17c53cd2896355e84987d0)
|
|
Change-Id: I171980a4ec67b85c3d0f2a680ebff29a2e6afcf2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 113ff4499daceefec04a3a25e594ee5554e80738)
|
|
Change-Id: I96e59e75c0bb877e0aa68c2d9eccd73959358350
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1ec63f657dff7ce76eefa7787089866e9b99717c)
|
|
Change-Id: Ib2cb94c747168b773409c18e3e366ebf3400ab99
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e7197f5428b5eb836a6fa636ff4ec9f14a65deca)
|
|
Change-Id: I75dc5fa2e0f8d92651ec22293875c8b3568a2159
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 54fcebc6cdab6a2bff1e88bb07970ef3fe112508)
|
|
Change-Id: I77b3bf9d77224221cafac1c8825e9f8c397c8e41
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c1b75945e67f1673afd5b2979636d22d861226bc)
|
|
Change-Id: Idcab4424a1439f22e4708abc1c88fbd1125ca439
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c194cb7c8eebee1482f1c95c01252c35cfc26905)
|
|
- Tables
- data
- dashboard
- failed tests
- last failed tests
- weekly comparison tables
- graphs
- stats
- dpdk_mrr
- vpp_ndrpdr
- DPDK MRR
- VPP NDRPDR
Change-Id: I371ba97992a0fcc1906d96c5020c9e2b13c396ce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e5796ad7fac33f70942e4fd0f126a9c97e9fe9be)
|
|
Change-Id: I79f1d70a3395551cfff872bd1d66ee900b9129b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9af72734b4ff4cc239e69e8f787228e68d02501c)
|
|
- Stats
- DPDK
- comparisom tables
- detailed results
- graphs
- tput
- speedup
- VPP
- detailed results
- graphs
- tput
- speedup
Change-Id: Ic0b10247ee376262ee61487bdd4b4b461dcf5308
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f4c31f23462c376e442b35242b2502541baccb83)
|
|
Change-Id: Id836184c0eca10b5b1d353e1783764ff5119ffea
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d3d4f9989b2fa7977bb545e0fb847bb3e785e8ba)
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1cdd628be1d358fcca4bf05c9357c195ee3a8288
(cherry picked from commit ed72f828240f6184b38c38f8ccd078308c9cdfb9)
|
|
Change-Id: I80ddeb6174c180e90c7e4b63378f08e430e452ce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 87ad7ca7db9581990effa792a55a8a9bc9cac58a)
|
|
Change-Id: I2d71c557f6b3c4d93466c096c9d5c0fabc36f486
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3d629c4e670186a8506bfd9f50c85453c4fa7acd)
|
|
- DPDK: 2n-tx2, 3n-tsh
- VPP: 2n-aws, 3n-aws
Change-Id: I9f78fec4f87eef389278b81103fb2cab647f7923
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6e5cf8806c8c30bc58a5e6ad2e7dff1932c0d7d8)
|
|
Change-Id: Ib571aef30424b84cf7c7abd7a8fee7b78f977b48
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6c0c46585063c486867200e92b35b1e782a8d36e)
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic676d00bd7d3d5d8c244bfd0eb7b10bc74498505
(cherry picked from commit 75351e349449d6c397cb830828dc4f55883511a3)
(cherry picked from commit 8eb5cc75ca7c756e5d8dfb9f018dc8250dfe2fd3)
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I46b2198d94f21b25061f0bd9bed42ca15bc00aa0
(cherry picked from commit 6844308e3c8db8612d572fdb4f39f7eea02867e9)
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iecf76c75edccaccb7d4dcecbc5d47c3c036768e9
(cherry picked from commit 62c4aa14348c9a4e0c44ca01e71ef842760c1d73)
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9628089bae7d9690f75807beb4321eadf84f9c79
(cherry picked from commit e310defb66f8b66ebd505c3e04c62ae57f8fe447)
|
|
Change-Id: I1068048590ff797b608f7578655fb9ce13f2ffe9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
+ Define currently used compliance metrics (e.g. no short term change),
+ Clarify that (and why) column names in Dashboard and Alerting
are somewhat different from the ones in the methodology document.
Change-Id: Ie091b1981d7578245ca3e700820fab9ac93bbd17
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
The most recent update merged was related to alerting,
so this Change uses the new column names defined there
also in Dashboard tables and legend.
Change-Id: I548bc4b42af8237c4251433f3a46e98427898ea8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- throughput
- speedup
- todo: latency
Change-Id: I01db52ce8283b1ac5ba724149f590817ab92b7a2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Ia8de38cd20c9882727708686764f19c96d664eaf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Part of fixing chain after early merge.
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie8f50fb84212c63ac9e225dfcb9bbc74fb2dd624
|
|
+ Model version 1.0.0.
- Only some result types are exported.
+ MRR, NDRPDR and SOAK.
- Other result types to be added later.
+ In contrast, all test types are detected.
+ Convert custom classes to JSON-serializable equivalents.
+ Sort dict keys before converting to JSON.
+ Override the order for some known keys.
+ Export sets as sorted arrays.
+ Convert to info content from serialized raw content.
+ Also export outputs for suite setups and teardowns.
+ Info files for setup/teardown exist only temporarily.
+ The data is merged into suite.info.json file.
+ This simplifies presentation of total suite duration.
+ Define model via JSON schema:
- Just test case, suite setup/teardown/suite to be added later.
- Just info, raw to be added later.
+ Proper descriptions.
+ Json is generated from yaml.
+ This is a convenience for maintainers.
+ The officially used schema is the .json one.
+ TODOs written into a separate .txt file.
+ Validate exported instance against the schema.
+ Include format checking.
+ Update CSIT requirements for validation dependencies.
+ This needs python-dateutil==2.8.2, only a patch bump.
+ Compute bandwidth also for soak tests.
+ This unifies with NDRPDR to simplify schema definition.
- PAL may need an update for parsing soak test message.
+ Include SSH log items, raw output only.
+ Generate all outputs in a single filesystem tree.
+ Move raw outputs into test_output_raw.tar.xz.
+ Rename existing tar with suites to generated_robot_files.tar.xz.
Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
+ Implementation stub so checker can check already.
+ Also add documentation stub for the implemented model.
+ Checker checks also for bumps in documentation version.
- Not comparing implementation and documentation version yet.
Change-Id: I4d19c00315a1c171de325c4494c28f5210635f32
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I29d53bdb20675a814e94ab6ceeda850147e3cb98
|
|
Change-Id: I56868d2e62cea8e3bbc6c53c989bb8a8968bc6fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Iec8aba498b5b771bf5b85431a70390cea26c3582
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I130405cd96630e8384d67da02a8bfd1449ff4c85
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Ic9a90274f5e9791c34560725aaf29266c2a89ce4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Iec877a74701409c87f941b540494e1f313b32911
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I798cf16af363d1035c816873a2ef6ec59824a17e
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
Change-Id: I1cba1060d2d773d1209feb884ab46bbb7b1ada56
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I59315e7ab10b6773cc17c72bae7e73774755efb5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I291e83e4f8e4d9798b2868425b7a1fb6b63d8639
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Iaa369a5243b9c77760549f6dae3dd16d8139509a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|