aboutsummaryrefslogtreecommitdiffstats
path: root/docs
AgeCommit message (Collapse)AuthorFilesLines
2022-02-18Trending: FixesTibor Frank4-4/+12
Change-Id: I2bb089720fda87f28c17c64bc664ae79343360fb Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit aea0d8658de598d5cb4603bb2b5a2583ccbe4b19)
2022-02-17Report: Add dataTibor Frank1-2/+2
Change-Id: I1c9f58a27f1e881cca3e639d084547dfac88af91 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1f7bfaf0f94fe68aadf41fde09b57c2f3171dea9)
2022-02-11job-spec: Reduce qty of iterative tests for 2n-clx, 2n-icx, 2n-skxTibor Frank6-284/+6
Reason: - ndrpdr job execution time >> 24hrs Remove: - ip4 and ip6 scale200k tests for dpdk and rdma - ip4 and ip6 scale2m tests for dpdk and rdma - af_xdp tests from NICs other than xxv710 Change-Id: I32fce8f436ae5ebbac8da9a9c670bdcb60abb3d8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9256923c6b890771ed17c53cd2896355e84987d0)
2022-02-10Report: Add 2n-icx GSOTibor Frank2-0/+97
Change-Id: I171980a4ec67b85c3d0f2a680ebff29a2e6afcf2 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 113ff4499daceefec04a3a25e594ee5554e80738)
2022-02-10Report: Add icx soak, reconf, nfvTibor Frank7-0/+953
Change-Id: I96e59e75c0bb877e0aa68c2d9eccd73959358350 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1ec63f657dff7ce76eefa7787089866e9b99717c)
2022-02-07Report: Small fixesTibor Frank80-184/+347
Change-Id: Ib2cb94c747168b773409c18e3e366ebf3400ab99 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e7197f5428b5eb836a6fa636ff4ec9f14a65deca)
2022-02-07Trending: Add icx latency trending graphsTibor Frank22-0/+343
Change-Id: I75dc5fa2e0f8d92651ec22293875c8b3568a2159 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 54fcebc6cdab6a2bff1e88bb07970ef3fe112508)
2022-02-07Trending: Add icx nfvTibor Frank8-0/+180
Change-Id: I77b3bf9d77224221cafac1c8825e9f8c397c8e41 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c1b75945e67f1673afd5b2979636d22d861226bc)
2022-02-07Report: Add icx latenciesTibor Frank32-1811/+1554
Change-Id: Idcab4424a1439f22e4708abc1c88fbd1125ca439 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c194cb7c8eebee1482f1c95c01252c35cfc26905)
2022-02-07Trending: Add icx weeklyTibor Frank42-4/+1347
- Tables - data - dashboard - failed tests - last failed tests - weekly comparison tables - graphs - stats - dpdk_mrr - vpp_ndrpdr - DPDK MRR - VPP NDRPDR Change-Id: I371ba97992a0fcc1906d96c5020c9e2b13c396ce Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e5796ad7fac33f70942e4fd0f126a9c97e9fe9be)
2022-02-03Report: Add dpdk icx static contentTibor Frank8-24/+59
Change-Id: I79f1d70a3395551cfff872bd1d66ee900b9129b8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9af72734b4ff4cc239e69e8f787228e68d02501c)
2022-02-02Report: Add ICXTibor Frank80-1041/+2021
- Stats - DPDK - comparisom tables - detailed results - graphs - tput - speedup - VPP - detailed results - graphs - tput - speedup Change-Id: Ic0b10247ee376262ee61487bdd4b4b461dcf5308 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f4c31f23462c376e442b35242b2502541baccb83)
2022-01-31Trending: Add 3n-icxTibor Frank19-18/+806
Change-Id: Id836184c0eca10b5b1d353e1783764ff5119ffea Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d3d4f9989b2fa7977bb545e0fb847bb3e785e8ba)
2022-01-31feat(docs): Static content updatePeter Mikus12-235/+240
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1cdd628be1d358fcca4bf05c9357c195ee3a8288 (cherry picked from commit ed72f828240f6184b38c38f8ccd078308c9cdfb9)
2022-01-31Trending: Remove HSWTibor Frank31-907/+0
Change-Id: I80ddeb6174c180e90c7e4b63378f08e430e452ce Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 87ad7ca7db9581990effa792a55a8a9bc9cac58a)
2022-01-31Trending: Add 2n-icxTibor Frank26-0/+880
Change-Id: I2d71c557f6b3c4d93466c096c9d5c0fabc36f486 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3d629c4e670186a8506bfd9f50c85453c4fa7acd)
2022-01-25Report: Add Comparison tablesTibor Frank6-48/+140
- DPDK: 2n-tx2, 3n-tsh - VPP: 2n-aws, 3n-aws Change-Id: I9f78fec4f87eef389278b81103fb2cab647f7923 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6e5cf8806c8c30bc58a5e6ad2e7dff1932c0d7d8)
2022-01-24Trending: Add awsTibor Frank4-0/+169
Change-Id: Ib571aef30424b84cf7c7abd7a8fee7b78f977b48 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6c0c46585063c486867200e92b35b1e782a8d36e)
2022-01-24feat(core): Add ICXPeter Mikus77-966/+5721
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic676d00bd7d3d5d8c244bfd0eb7b10bc74498505 (cherry picked from commit 75351e349449d6c397cb830828dc4f55883511a3) (cherry picked from commit 8eb5cc75ca7c756e5d8dfb9f018dc8250dfe2fd3)
2022-01-21feat(doc): Add ICXPeter Mikus3-13/+57
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I46b2198d94f21b25061f0bd9bed42ca15bc00aa0 (cherry picked from commit 6844308e3c8db8612d572fdb4f39f7eea02867e9)
2022-01-21feat(ansible): Add ICXPeter Mikus1-0/+1250
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iecf76c75edccaccb7d4dcecbc5d47c3c036768e9 (cherry picked from commit 62c4aa14348c9a4e0c44ca01e71ef842760c1d73)
2022-01-20feat(ansible): Compatibility matrix bumpPeter Mikus3-12/+12
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I9628089bae7d9690f75807beb4321eadf84f9c79 (cherry picked from commit e310defb66f8b66ebd505c3e04c62ae57f8fe447)
2022-01-19Trending: Add NAT44Det tests for 2n-zn2Tibor Frank18-32/+80
Change-Id: I1068048590ff797b608f7578655fb9ce13f2ffe9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-18Doc: Update anomaly methodology documentationVratko Polak1-20/+32
+ Define currently used compliance metrics (e.g. no short term change), + Clarify that (and why) column names in Dashboard and Alerting are somewhat different from the ones in the methodology document. Change-Id: Ie091b1981d7578245ca3e700820fab9ac93bbd17 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-01-18Trending: Unify anomaly related column namesVratko Polak1-6/+9
The most recent update merged was related to alerting, so this Change uses the new column names defined there also in Dashboard tables and legend. Change-Id: I548bc4b42af8237c4251433f3a46e98427898ea8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-01-17Report: Add 2n-tx2 ipsec testsTibor Frank4-0/+574
- throughput - speedup - todo: latency Change-Id: I01db52ce8283b1ac5ba724149f590817ab92b7a2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-10Doc: Tweak trend analysis documentVratko Polak2-39/+75
Change-Id: Ia8de38cd20c9882727708686764f19c96d664eaf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-22fix(uti): Fixing broken code part Ipmikus3-4/+3
Part of fixing chain after early merge. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ie8f50fb84212c63ac9e225dfcb9bbc74fb2dd624
2021-12-15UTI: Export resultsVratko Polak5-4/+1292
+ Model version 1.0.0. - Only some result types are exported. + MRR, NDRPDR and SOAK. - Other result types to be added later. + In contrast, all test types are detected. + Convert custom classes to JSON-serializable equivalents. + Sort dict keys before converting to JSON. + Override the order for some known keys. + Export sets as sorted arrays. + Convert to info content from serialized raw content. + Also export outputs for suite setups and teardowns. + Info files for setup/teardown exist only temporarily. + The data is merged into suite.info.json file. + This simplifies presentation of total suite duration. + Define model via JSON schema: - Just test case, suite setup/teardown/suite to be added later. - Just info, raw to be added later. + Proper descriptions. + Json is generated from yaml. + This is a convenience for maintainers. + The officially used schema is the .json one. + TODOs written into a separate .txt file. + Validate exported instance against the schema. + Include format checking. + Update CSIT requirements for validation dependencies. + This needs python-dateutil==2.8.2, only a patch bump. + Compute bandwidth also for soak tests. + This unifies with NDRPDR to simplify schema definition. - PAL may need an update for parsing soak test message. + Include SSH log items, raw output only. + Generate all outputs in a single filesystem tree. + Move raw outputs into test_output_raw.tar.xz. + Rename existing tar with suites to generated_robot_files.tar.xz. Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-15Tox: Add checker for CSIT model versionVratko Polak1-0/+48
+ Implementation stub so checker can check already. + Also add documentation stub for the implemented model. + Checker checks also for bumps in documentation version. - Not comparing implementation and documentation version yet. Change-Id: I4d19c00315a1c171de325c4494c28f5210635f32 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-14docs(lab): Intel Icelakepmikus2-119/+577
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I29d53bdb20675a814e94ab6ceeda850147e3cb98
2021-12-13Report: Hide empty latency graph(s) for 3n-icxTibor Frank1-14/+15
Change-Id: I56868d2e62cea8e3bbc6c53c989bb8a8968bc6fa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-10Report: Add Latency graphs for 3n-icxTibor Frank12-93/+430
Change-Id: Iec8aba498b5b771bf5b85431a70390cea26c3582 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-10Report: Add 3n-icx - fixesTibor Frank2-82/+83
Change-Id: I130405cd96630e8384d67da02a8bfd1449ff4c85 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-09Report: Add 3n-icxTibor Frank27-500/+767
Change-Id: Ic9a90274f5e9791c34560725aaf29266c2a89ce4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-03Trending: Fix 3n-tsh-x520-64b-memif-base-ixgbe graphsTibor Frank1-12/+5
Change-Id: Iec877a74701409c87f941b540494e1f313b32911 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-02lab WIP: add new 3n-alt Arm testbedJuraj Linkeš3-18/+131
Change-Id: I798cf16af363d1035c816873a2ef6ec59824a17e Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-11-30Trending: Fix ethip4ipsecNspe tests for 2n-tx2Tibor Frank1-2/+2
Change-Id: I1cba1060d2d773d1209feb884ab46bbb7b1ada56 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-29Trending: Add ethip4ipsecNspe tests for 2n-tx2Tibor Frank1-8/+58
Change-Id: I59315e7ab10b6773cc17c72bae7e73774755efb5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-23Report: Small fixes in static contentTibor Frank10-36/+37
Change-Id: I291e83e4f8e4d9798b2868425b7a1fb6b63d8639 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-22Report: Add 2n-icx dataTibor Frank6-15/+6
Change-Id: Iaa369a5243b9c77760549f6dae3dd16d8139509a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-22Report: Hide 2n-icx empty graphsTibor Frank6-6/+16
Change-Id: I258891f482d87d930d5df8f2dc93b0507f798b8f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-19PAL: Add boxpoints to all box graphsTibor Frank7-17/+12
Change-Id: Ic316149bab15c6fe1efccb53df0afa1cc78b3672 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-19job_specs: update 2n-tx2 daily and reportJuraj Linkeš18-106/+50
Add newly added spd outbound tests with and without flowcache. These new test may result in too many mlr tests, so remove the least needed tests, which are 2m and 1m scale tests. This also unifies which scale tests we run between af_xdp and dpdk tests. Also cleanup all 2n-tx2 job specs. Change-Id: I99bedefcef86f4b921f359f1ebf6c42ebdd8c20f Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-11-18Report: Improve docs related to TRexVratko Polak4-9/+15
Change-Id: I0ed346ff30c61d28b5a2232ef2f9d32d26c1ae2c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-11-15Report: Add dataTibor Frank1-3/+4
Change-Id: Ie384ab9db8f3ba909ec0b6eaf39a04c5c7f3157a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-12Report: Add dataTibor Frank5-32/+32
Change-Id: I2ee6005d499c4d93cca72cffd3373ced16d7c994 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-11Report: Add DPDK speedup graphsTibor Frank15-5/+849
Change-Id: I0c763ae0371515955037f0aaa867251b5aaec604 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-11"fix(job_specs): Remove flow based tests"Peter Mikus1-23/+23
Reason for revert: Fixed Change-Id: Idbafdb953964967276f4f5748c78398a33635e2b Signed-off-by: pmikus <pmikus@cisco.com>
2021-11-11Report: Add 4t2c graphs for awsTibor Frank5-0/+356
Change-Id: I4fd625bc5139ebcb8430a4228986eafe39672532 Signed-off-by: Tibor Frank <tifrank@cisco.com>