aboutsummaryrefslogtreecommitdiffstats
path: root/docs
AgeCommit message (Collapse)AuthorFilesLines
2022-01-20feat(ansible): Compatibility matrix bumpPeter Mikus3-12/+12
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I9628089bae7d9690f75807beb4321eadf84f9c79
2022-01-19Trending: Add NAT44Det tests for 2n-zn2Tibor Frank18-32/+80
Change-Id: I1068048590ff797b608f7578655fb9ce13f2ffe9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-18Doc: Update anomaly methodology documentationVratko Polak1-20/+32
+ Define currently used compliance metrics (e.g. no short term change), + Clarify that (and why) column names in Dashboard and Alerting are somewhat different from the ones in the methodology document. Change-Id: Ie091b1981d7578245ca3e700820fab9ac93bbd17 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-01-18Trending: Unify anomaly related column namesVratko Polak1-6/+9
The most recent update merged was related to alerting, so this Change uses the new column names defined there also in Dashboard tables and legend. Change-Id: I548bc4b42af8237c4251433f3a46e98427898ea8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-01-17Report: Add 2n-tx2 ipsec testsTibor Frank4-0/+574
- throughput - speedup - todo: latency Change-Id: I01db52ce8283b1ac5ba724149f590817ab92b7a2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-10Doc: Tweak trend analysis documentVratko Polak2-39/+75
Change-Id: Ia8de38cd20c9882727708686764f19c96d664eaf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-22fix(uti): Fixing broken code part Ipmikus3-4/+3
Part of fixing chain after early merge. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ie8f50fb84212c63ac9e225dfcb9bbc74fb2dd624
2021-12-15UTI: Export resultsVratko Polak5-4/+1292
+ Model version 1.0.0. - Only some result types are exported. + MRR, NDRPDR and SOAK. - Other result types to be added later. + In contrast, all test types are detected. + Convert custom classes to JSON-serializable equivalents. + Sort dict keys before converting to JSON. + Override the order for some known keys. + Export sets as sorted arrays. + Convert to info content from serialized raw content. + Also export outputs for suite setups and teardowns. + Info files for setup/teardown exist only temporarily. + The data is merged into suite.info.json file. + This simplifies presentation of total suite duration. + Define model via JSON schema: - Just test case, suite setup/teardown/suite to be added later. - Just info, raw to be added later. + Proper descriptions. + Json is generated from yaml. + This is a convenience for maintainers. + The officially used schema is the .json one. + TODOs written into a separate .txt file. + Validate exported instance against the schema. + Include format checking. + Update CSIT requirements for validation dependencies. + This needs python-dateutil==2.8.2, only a patch bump. + Compute bandwidth also for soak tests. + This unifies with NDRPDR to simplify schema definition. - PAL may need an update for parsing soak test message. + Include SSH log items, raw output only. + Generate all outputs in a single filesystem tree. + Move raw outputs into test_output_raw.tar.xz. + Rename existing tar with suites to generated_robot_files.tar.xz. Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-15Tox: Add checker for CSIT model versionVratko Polak1-0/+48
+ Implementation stub so checker can check already. + Also add documentation stub for the implemented model. + Checker checks also for bumps in documentation version. - Not comparing implementation and documentation version yet. Change-Id: I4d19c00315a1c171de325c4494c28f5210635f32 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-14docs(lab): Intel Icelakepmikus2-119/+577
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I29d53bdb20675a814e94ab6ceeda850147e3cb98
2021-12-13Report: Hide empty latency graph(s) for 3n-icxTibor Frank1-14/+15
Change-Id: I56868d2e62cea8e3bbc6c53c989bb8a8968bc6fa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-10Report: Add Latency graphs for 3n-icxTibor Frank12-93/+430
Change-Id: Iec8aba498b5b771bf5b85431a70390cea26c3582 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-10Report: Add 3n-icx - fixesTibor Frank2-82/+83
Change-Id: I130405cd96630e8384d67da02a8bfd1449ff4c85 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-09Report: Add 3n-icxTibor Frank27-500/+767
Change-Id: Ic9a90274f5e9791c34560725aaf29266c2a89ce4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-03Trending: Fix 3n-tsh-x520-64b-memif-base-ixgbe graphsTibor Frank1-12/+5
Change-Id: Iec877a74701409c87f941b540494e1f313b32911 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-12-02lab WIP: add new 3n-alt Arm testbedJuraj Linkeš3-18/+131
Change-Id: I798cf16af363d1035c816873a2ef6ec59824a17e Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-11-30Trending: Fix ethip4ipsecNspe tests for 2n-tx2Tibor Frank1-2/+2
Change-Id: I1cba1060d2d773d1209feb884ab46bbb7b1ada56 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-29Trending: Add ethip4ipsecNspe tests for 2n-tx2Tibor Frank1-8/+58
Change-Id: I59315e7ab10b6773cc17c72bae7e73774755efb5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-23Report: Small fixes in static contentTibor Frank10-36/+37
Change-Id: I291e83e4f8e4d9798b2868425b7a1fb6b63d8639 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-22Report: Add 2n-icx dataTibor Frank6-15/+6
Change-Id: Iaa369a5243b9c77760549f6dae3dd16d8139509a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-22Report: Hide 2n-icx empty graphsTibor Frank6-6/+16
Change-Id: I258891f482d87d930d5df8f2dc93b0507f798b8f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-19PAL: Add boxpoints to all box graphsTibor Frank7-17/+12
Change-Id: Ic316149bab15c6fe1efccb53df0afa1cc78b3672 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-19job_specs: update 2n-tx2 daily and reportJuraj Linkeš18-106/+50
Add newly added spd outbound tests with and without flowcache. These new test may result in too many mlr tests, so remove the least needed tests, which are 2m and 1m scale tests. This also unifies which scale tests we run between af_xdp and dpdk tests. Also cleanup all 2n-tx2 job specs. Change-Id: I99bedefcef86f4b921f359f1ebf6c42ebdd8c20f Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-11-18Report: Improve docs related to TRexVratko Polak4-9/+15
Change-Id: I0ed346ff30c61d28b5a2232ef2f9d32d26c1ae2c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-11-15Report: Add dataTibor Frank1-3/+4
Change-Id: Ie384ab9db8f3ba909ec0b6eaf39a04c5c7f3157a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-12Report: Add dataTibor Frank5-32/+32
Change-Id: I2ee6005d499c4d93cca72cffd3373ced16d7c994 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-11Report: Add DPDK speedup graphsTibor Frank15-5/+849
Change-Id: I0c763ae0371515955037f0aaa867251b5aaec604 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-11"fix(job_specs): Remove flow based tests"Peter Mikus1-23/+23
Reason for revert: Fixed Change-Id: Idbafdb953964967276f4f5748c78398a33635e2b Signed-off-by: pmikus <pmikus@cisco.com>
2021-11-11Report: Add 4t2c graphs for awsTibor Frank5-0/+356
Change-Id: I4fd625bc5139ebcb8430a4228986eafe39672532 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-10Report: Add stats tables, aws testsTibor Frank1-0/+39
Change-Id: I212b0e6e70008e15ced0167ab34e613cc0a1aea4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-10Report: Update known issuesVratko Polak1-26/+47
+ Remove MLRsearch comment, it happened a release before. + Separated known issues to fixed, old and new. + RCA section present, but empty yet. Change-Id: Ic713319017d6c2eb7ba2750de7c27de5237ee2c7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-11-10Report: Fixes in dynamic contentTibor Frank23-846/+748
Change-Id: If90ba8c66427061341888dcfc946450efe66010b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-10report: update to vpp performance release notesMaciek Konstantynowicz1-44/+17
Change-Id: I170d14555b21e91d0ce1f11ea3f2911e8b01341c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-11-09Report: Add 2n-icx, part 2Tibor Frank63-248/+3274
- packet throughput - speedup - latency Change-Id: If871dcc1888e7a49ac2fd2ba8e3632a87fa035bc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-09report: edits in aws methodology sectionMaciek Konstantynowicz4-119/+150
Edits include: - add description of used testbed topologies. - cleaned up references. - other editing nits. Change-Id: I43069541f3da8e844529a00a127fb1a360197647 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-11-09Report: Hide aws latencyTibor Frank3-4/+4
- it is not measured Change-Id: I1c3d2f629d8ed07a208c37a20642b0e6b336242e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-08Report: Add aws latencyTibor Frank6-7/+71
Change-Id: I0780ddabce015cf1809ea178bf53ab9fc6e18f2d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-08Report: Add 2n-icx, part 1Tibor Frank1-3/+1
Change-Id: Idf1e56231afa14648d7c3db661eb9a04ef7a5c85 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-08Report: Remove tests removed by 34207Tibor Frank63-3861/+238
Change-Id: Ibe960b8dd4340c2c5b8a01fc490cab906dc330fd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-08Report: Add dataTibor Frank1-1/+1
Change-Id: I76a36cb19d6c121b1d668d1ff8f71085baa2ed2e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-05Report: Small edits in static content.Tibor Frank2-3/+9
Change-Id: I621e9818cb929c9558c38d41cb4804a19ed2a468 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-03fix(Docs): Report section updatespmikus7-32/+23
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Icd04b75d320f067bd66402d5bb499070ee2768f3
2021-11-03Report: Add rls dataTibor Frank4-31/+29
Change-Id: I7868b419fa47c6130826948bbdfbb288abb8d1e4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-11-03job_specs: add ipsec 40 tunnel sw tests for 3n-skx testbedsMaciek Konstantynowicz2-2/+44
Change-Id: I4bb79bf34f64b1096be9e81586d718dbe283b3cd Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-11-03job_specs: add report_iterative tests to 2n-icx and 3n-icx testbedsMaciek Konstantynowicz4-0/+1344
Assumed icx testbeds equipped only with Intel e810cq 2p100GbE NIC. 2n-icx test set based on 2n-clx job spec. 3n-icx test set based on 3n-skx job spec. Change-Id: I9305693b55008a6a626618122f238bb3e8700fdb Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-10-28fix(Autogen): VSAP driver combinationspmikus1-33/+8
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ieac8cd32009bebbd1a3324a81becfbf3abb814ab
2021-10-27job_specs: remove nat44ed udp and tcp scale 16m session testsMaciek Konstantynowicz4-116/+20
Tests removed from 2n-clx and 2n-skx testbeds for mrr_daily and mlr_weekly performance jobs. Tests are failing due to slower session setup rate and very long ramp up time, too long to be accommodated by CSIT resources. Change-Id: Idac6920d971256553c7c843056c410bf9393b4a3 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2021-10-27fix(docs): AWS job specspmikus6-13/+58
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I34b1475f0cabe8a6d9f260c77d5a3b10f7ead61c
2021-10-27Report: Add dataTibor Frank6-7/+3
Change-Id: I51e809322d652e1f410c5674883bdd86e730af41 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-10-27feat(Docs): Add AWS methodologypmikus5-0/+290
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I766c1b8ce85e174946503a3d65f8239d8fec1bcd