aboutsummaryrefslogtreecommitdiffstats
path: root/docs
AgeCommit message (Collapse)AuthorFilesLines
2022-03-09Report: Add rls dataTibor Frank1-1/+3
Change-Id: If6cc2ce71592c98ea645e15d1a382f37de110c33 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit fd11957f8ae43a892b5452b969dd08c316ecdd72)
2022-03-08report: 2 new issues added to release notesViliam Luc1-0/+6
Change-Id: I46f4797dd244382e6cef611d99096a198c1f9131 Signed-off-by: Viliam Luc <vluc@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 22b17b22dc8245d1c649f7cd56fae946b49c9665)
2022-03-08report: edit failed test list in known issues in vpp rls notesMaciek Konstantynowicz1-5/+5
Change-Id: Ice668fa21f0f634cbd749365c9e6f0ffc440346c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 0189b942c60c000917639178f390fdc3bbcd574d)
2022-03-08Report: Small fixes in LatencyTibor Frank3-138/+43
Change-Id: I8c280b231babf00438f97afae2bdbbe731c012fe Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 43028ac5bdcf014c94cb62702765dd62980994bd)
2022-03-08docs(report): Update release notes sections.Peter Mikus1-19/+16
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic85ac52301a057e9efdc04478a2fe8a56c38d69d (cherry picked from commit fcedfd41d4b6a3236b78503dca16c687adc349bb)
2022-03-08report: update vpp performance rls notesMaciek Konstantynowicz2-19/+81
Change-Id: Ia933d6719c41100524fd1e64990b38e03604c5ec Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 26a677d37ed095e9a876b8a916d4c967ecfbbea1)
2022-03-07Report: Static content: Speedup and the restTibor Frank6-166/+162
Change-Id: I00fdec38ab6e8a1bc61f2852bac3e49a90ca30af Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 51e49d62566faaaa652837ad9cf7766d2810fc61)
2022-03-07Report: Static content: TputTibor Frank5-154/+157
- VPP - DPDK - TRex Change-Id: I0f0c45fe0727a2819f2c092585184e79942f2eaa Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 323037ecbec7442d90e74b1f6fdf90633026b447)
2022-03-07Report: Static content: LatencyTibor Frank13-1140/+84
- VPP - DPDK - TRex Change-Id: I2a65829d7c6421b7a824cd169b3f273dc9c141c2 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4d408591dd5869fec2bdf20ca91feb54f0719748)
2022-03-03report: updated phy testbed diagrams 2n-icx 3n-icxMaciek Konstantynowicz2-4628/+4678
Change-Id: Ica6de877b954ed09026d16610a3c8ee44fca8627 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 29451403aaa6e6a8ad0be7f756dfb6abb168d3bf)
2022-02-28Report: Add nics to titles for comparisonsTibor Frank2-75/+28
Change-Id: I2d3773add4bc57e944a8c174a4bc774a13956fa9 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b1d6ce040bc6d2df008836cda435ee9f6f6c7d51)
2022-02-18Trending: FixesTibor Frank4-4/+12
Change-Id: I2bb089720fda87f28c17c64bc664ae79343360fb Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit aea0d8658de598d5cb4603bb2b5a2583ccbe4b19)
2022-02-17Report: Add dataTibor Frank1-2/+2
Change-Id: I1c9f58a27f1e881cca3e639d084547dfac88af91 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1f7bfaf0f94fe68aadf41fde09b57c2f3171dea9)
2022-02-11job-spec: Reduce qty of iterative tests for 2n-clx, 2n-icx, 2n-skxTibor Frank6-284/+6
Reason: - ndrpdr job execution time >> 24hrs Remove: - ip4 and ip6 scale200k tests for dpdk and rdma - ip4 and ip6 scale2m tests for dpdk and rdma - af_xdp tests from NICs other than xxv710 Change-Id: I32fce8f436ae5ebbac8da9a9c670bdcb60abb3d8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9256923c6b890771ed17c53cd2896355e84987d0)
2022-02-10Report: Add 2n-icx GSOTibor Frank2-0/+97
Change-Id: I171980a4ec67b85c3d0f2a680ebff29a2e6afcf2 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 113ff4499daceefec04a3a25e594ee5554e80738)
2022-02-10Report: Add icx soak, reconf, nfvTibor Frank7-0/+953
Change-Id: I96e59e75c0bb877e0aa68c2d9eccd73959358350 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1ec63f657dff7ce76eefa7787089866e9b99717c)
2022-02-07Report: Small fixesTibor Frank80-184/+347
Change-Id: Ib2cb94c747168b773409c18e3e366ebf3400ab99 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e7197f5428b5eb836a6fa636ff4ec9f14a65deca)
2022-02-07Trending: Add icx latency trending graphsTibor Frank22-0/+343
Change-Id: I75dc5fa2e0f8d92651ec22293875c8b3568a2159 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 54fcebc6cdab6a2bff1e88bb07970ef3fe112508)
2022-02-07Trending: Add icx nfvTibor Frank8-0/+180
Change-Id: I77b3bf9d77224221cafac1c8825e9f8c397c8e41 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c1b75945e67f1673afd5b2979636d22d861226bc)
2022-02-07Report: Add icx latenciesTibor Frank32-1811/+1554
Change-Id: Idcab4424a1439f22e4708abc1c88fbd1125ca439 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c194cb7c8eebee1482f1c95c01252c35cfc26905)
2022-02-07Trending: Add icx weeklyTibor Frank42-4/+1347
- Tables - data - dashboard - failed tests - last failed tests - weekly comparison tables - graphs - stats - dpdk_mrr - vpp_ndrpdr - DPDK MRR - VPP NDRPDR Change-Id: I371ba97992a0fcc1906d96c5020c9e2b13c396ce Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e5796ad7fac33f70942e4fd0f126a9c97e9fe9be)
2022-02-03Report: Add dpdk icx static contentTibor Frank8-24/+59
Change-Id: I79f1d70a3395551cfff872bd1d66ee900b9129b8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9af72734b4ff4cc239e69e8f787228e68d02501c)
2022-02-02Report: Add ICXTibor Frank80-1041/+2021
- Stats - DPDK - comparisom tables - detailed results - graphs - tput - speedup - VPP - detailed results - graphs - tput - speedup Change-Id: Ic0b10247ee376262ee61487bdd4b4b461dcf5308 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f4c31f23462c376e442b35242b2502541baccb83)
2022-01-31Trending: Add 3n-icxTibor Frank19-18/+806
Change-Id: Id836184c0eca10b5b1d353e1783764ff5119ffea Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d3d4f9989b2fa7977bb545e0fb847bb3e785e8ba)
2022-01-31feat(docs): Static content updatePeter Mikus12-235/+240
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1cdd628be1d358fcca4bf05c9357c195ee3a8288 (cherry picked from commit ed72f828240f6184b38c38f8ccd078308c9cdfb9)
2022-01-31Trending: Remove HSWTibor Frank31-907/+0
Change-Id: I80ddeb6174c180e90c7e4b63378f08e430e452ce Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 87ad7ca7db9581990effa792a55a8a9bc9cac58a)
2022-01-31Trending: Add 2n-icxTibor Frank26-0/+880
Change-Id: I2d71c557f6b3c4d93466c096c9d5c0fabc36f486 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3d629c4e670186a8506bfd9f50c85453c4fa7acd)
2022-01-25Report: Add Comparison tablesTibor Frank6-48/+140
- DPDK: 2n-tx2, 3n-tsh - VPP: 2n-aws, 3n-aws Change-Id: I9f78fec4f87eef389278b81103fb2cab647f7923 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6e5cf8806c8c30bc58a5e6ad2e7dff1932c0d7d8)
2022-01-24Trending: Add awsTibor Frank4-0/+169
Change-Id: Ib571aef30424b84cf7c7abd7a8fee7b78f977b48 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6c0c46585063c486867200e92b35b1e782a8d36e)
2022-01-24feat(core): Add ICXPeter Mikus77-966/+5721
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic676d00bd7d3d5d8c244bfd0eb7b10bc74498505 (cherry picked from commit 75351e349449d6c397cb830828dc4f55883511a3) (cherry picked from commit 8eb5cc75ca7c756e5d8dfb9f018dc8250dfe2fd3)
2022-01-21feat(doc): Add ICXPeter Mikus3-13/+57
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I46b2198d94f21b25061f0bd9bed42ca15bc00aa0 (cherry picked from commit 6844308e3c8db8612d572fdb4f39f7eea02867e9)
2022-01-21feat(ansible): Add ICXPeter Mikus1-0/+1250
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iecf76c75edccaccb7d4dcecbc5d47c3c036768e9 (cherry picked from commit 62c4aa14348c9a4e0c44ca01e71ef842760c1d73)
2022-01-20feat(ansible): Compatibility matrix bumpPeter Mikus3-12/+12
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I9628089bae7d9690f75807beb4321eadf84f9c79 (cherry picked from commit e310defb66f8b66ebd505c3e04c62ae57f8fe447)
2022-01-19Trending: Add NAT44Det tests for 2n-zn2Tibor Frank18-32/+80
Change-Id: I1068048590ff797b608f7578655fb9ce13f2ffe9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-18Doc: Update anomaly methodology documentationVratko Polak1-20/+32
+ Define currently used compliance metrics (e.g. no short term change), + Clarify that (and why) column names in Dashboard and Alerting are somewhat different from the ones in the methodology document. Change-Id: Ie091b1981d7578245ca3e700820fab9ac93bbd17 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-01-18Trending: Unify anomaly related column namesVratko Polak1-6/+9
The most recent update merged was related to alerting, so this Change uses the new column names defined there also in Dashboard tables and legend. Change-Id: I548bc4b42af8237c4251433f3a46e98427898ea8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-01-17Report: Add 2n-tx2 ipsec testsTibor Frank4-0/+574
- throughput - speedup - todo: latency Change-Id: I01db52ce8283b1ac5ba724149f590817ab92b7a2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-10Doc: Tweak trend analysis documentVratko Polak2-39/+75
Change-Id: Ia8de38cd20c9882727708686764f19c96d664eaf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-22fix(uti): Fixing broken code part Ipmikus3-4/+3
Part of fixing chain after early merge. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ie8f50fb84212c63ac9e225dfcb9bbc74fb2dd624
2021-12-15UTI: Export resultsVratko Polak5-4/+1292
+ Model version 1.0.0. - Only some result types are exported. + MRR, NDRPDR and SOAK. - Other result types to be added later. + In contrast, all test types are detected. + Convert custom classes to JSON-serializable equivalents. + Sort dict keys before converting to JSON. + Override the order for some known keys. + Export sets as sorted arrays. + Convert to info content from serialized raw content. + Also export outputs for suite setups and teardowns. + Info files for setup/teardown exist only temporarily. + The data is merged into suite.info.json file. + This simplifies presentation of total suite duration. + Define model via JSON schema: - Just test case, suite setup/teardown/suite to be added later. - Just info, raw to be added later. + Proper descriptions. + Json is generated from yaml. + This is a convenience for maintainers. + The officially used schema is the .json one. + TODOs written into a separate .txt file. + Validate exported instance against the schema. + Include format checking. + Update CSIT requirements for validation dependencies. + This needs python-dateutil==2.8.2, only a patch bump. + Compute bandwidth also for soak tests. + This unifies with NDRPDR to simplify schema definition. - PAL may need an update for parsing soak test message. + Include SSH log items, raw output only. + Generate all outputs in a single filesystem tree. + Move raw outputs into test_output_raw.tar.xz. + Rename existing tar with suites to generated_robot_files.tar.xz. Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-15Tox: Add checker for CSIT model versionVratko Polak1-0/+48
+ Implementation stub so checker can check already. + Also add documentation stub for the implemented model. + Checker checks also for bumps in documentation version. - Not comparing implementation and documentation version yet. Change-Id: I4d19c00315a1c171de325c4494c28f5210635f32 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-14docs(lab): Intel Icelakepmikus2-119/+577
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I29d53bdb20675a814e94ab6ceeda850147e3cb98
2021-12-13Report: Hide empty latency graph(s) for 3n-icxTibor Frank1-14/+15
Change-Id: I56868d2e62cea8e3bbc6c53c989bb8a8968bc6fa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-10Report: Add Latency graphs for 3n-icxTibor Frank12-93/+430
Change-Id: Iec8aba498b5b771bf5b85431a70390cea26c3582 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-10Report: Add 3n-icx - fixesTibor Frank2-82/+83
Change-Id: I130405cd96630e8384d67da02a8bfd1449ff4c85 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-09Report: Add 3n-icxTibor Frank27-500/+767
Change-Id: Ic9a90274f5e9791c34560725aaf29266c2a89ce4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-03Trending: Fix 3n-tsh-x520-64b-memif-base-ixgbe graphsTibor Frank1-12/+5
Change-Id: Iec877a74701409c87f941b540494e1f313b32911 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-02lab WIP: add new 3n-alt Arm testbedJuraj Linkeš3-18/+131
Change-Id: I798cf16af363d1035c816873a2ef6ec59824a17e Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-11-30Trending: Fix ethip4ipsecNspe tests for 2n-tx2Tibor Frank1-2/+2
Change-Id: I1cba1060d2d773d1209feb884ab46bbb7b1ada56 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-29Trending: Add ethip4ipsecNspe tests for 2n-tx2Tibor Frank1-8/+58
Change-Id: I59315e7ab10b6773cc17c72bae7e73774755efb5 Signed-off-by: Tibor Frank <tifrank@cisco.com>