aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-01-25Hdrh latency graphs: Do not skip the last valueVratko Polak1-5/+7
Linear x axis does not need any skipping. For logarithmic axis, descrease from 100% to avoid infinity. Currently using a fixed PERCENTILE_MAX value. Added a comment on when to change that value. Change-Id: Ic10a19532455e597272efdb4542e43d09ce49d5c Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit d4f12e6931c7fdf84043d8fb2f71e2f38965f26b)
2021-01-22Report: add geneve to perf release notesJan Gelety3-0/+79
Change-Id: I0473bda59edf874119a474fb2e84177e19f58d02 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 67d3b2a44d49dd2c4a1b2f722849f57432787137)
2021-01-22Report: Add dataTibor Frank4-15/+471
Change-Id: I1d5031780b1bef169509058233e02624d7afecb7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0c489b1767a031837f320c1fb5e45947ac82ea4d)
2021-01-22Report: vpp-device release notesJan Gelety2-3/+18
Change-Id: Ieacb9e4fac471cbe5cd28288341695352426c134 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 7b9b65a3af83267a4e6a36fc98996aaa05060a87)
2021-01-21Reconf: Fix bidir/unidir mismatchVratko Polak53-170/+119
Results if NDR search is in TPS (so unidir) since https://gerrit.fd.io/r/c/csit/+/28208 The bug was causing all reconf tests report zero loss, as they used half of NDR load during reconfiguration. + Small improvements to descriptions of other traffic keywords. Change-Id: Ib9af5861cc09e698eb762feb3f0a019571d17962 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 293a88b56179094f655178b838b84844a672390d)
2021-01-21Trending: Fix bugs in 2n-tx2Tibor Frank1-1/+1
Change-Id: I5522e2cb37b9e319bfde009297525179da2e50f7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7f7f2fd7363637d0da626a28bb8a0b357d314a9d)
2021-01-21Report: Add dataTibor Frank1-0/+22
Change-Id: I09a695d9c747d4bb6826d27283ab0aa172fc0d30 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9e08f1dfb125d092a48f92c764f52ae97f8a9995)
2021-01-21Trending: Add 2n-tx2Tibor Frank13-1/+758
Change-Id: Id2d0248128eee6a5b0969c7f27aae946ed47bbaa Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3fc6ce9f08f0a1c1293dfc032fdddfe5e3f7eb16)
2021-01-20acl: add L2BD dev testsMartin Balaz5-0/+491
Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech> Change-Id: I70127d8dd2241b70511f31842eb8a9e3cbafdc4b Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 0f3baca2366f969de6b5d3b889c1b05f72995ec2)
2021-01-20job_specs: add geneve testsJan Gelety9-20/+407
Geneve tests added to report_iterative and report_coverage job specifications. - tests with 1024 geneve tunnels added only to report_coverage jobs until fast PAPI is finished Change-Id: I11a12d3c626dd2daf6287440131795daa7f75e48 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 3d0d137bf45e1cd3c7aa06480f5ea08175a6df01)
2021-01-20Tox: Improve tox.iniVratko Polak1-15/+26
Just stylistic improvements, no functional change. + Use "ignore_outcome = true" instead of "|| true". + Document and apply recommended ordering within testenv definition. + Fix some typos. Change-Id: I004f12fbdf6dbeb555daa7cd111938b7eeef20b3 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 52a39f861bb645831130ef109a14e629be9bde7a)
2021-01-20Report: Add dataTibor Frank3-1013/+41
Change-Id: Ie7450076891e1041b5635f8ea714f94909b6d407 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 216c68cc8b010642c4de21673b7d8e18006767e2)
2021-01-19Report: Add ip6 latency graphsTibor Frank1-4/+2
Change-Id: Ic53214b0a0360bdb6d62d100fc7b9c8e15fb8397 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5e0fe5a28969dfc9fe36415a065122a668d5a273)
2021-01-19Report: Add data, 2n-tx2 latency graphsTibor Frank6-469/+1190
Change-Id: Idd9396c0f260355e3b7b90839bd4b1f64d8b0644 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4bc1e70ad02b198a7b9ea32b72da3ae98978e8c5)
2021-01-19Job specs: Add some ipsec reconf to iterativeVratko Polak1-0/+76
We now have more time for 3n-hsw testbeds. Added only scales of 4, 1000 and 60000 tunnels. Change-Id: I283a816e1440a9fe1f0dea13f954f92b457ea788 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit be5833232791a24921e7e9695e53efcbd7ff248e)
2021-01-19Report: Add dataTibor Frank1-416/+416
Change-Id: I1b7314affd08d12b67212affb2ef89f64d1347ee Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f5863d6213bf0066b9647a7dde10d56bd7260f80)
2021-01-18Random flows: Use seeds again and increase limit.Vratko Polak3-45/+54
TRex does mix seeds when distributing over workers, but it is multiplicative [0], so zero is the only bad value. Limit restricts the cycle length of PRNG (by resetting [1] the seed). We want the cycle as long as possible. [0] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.73/src/stx/stl/trex_stl_stream_vm.h#L1616 [1] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.73/src/stx/stl/trex_stl_stream_vm.h#L313-L314 Change-Id: I33a29496f0853ef60d592c988f81a9d1109b5878 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit eedb7dff222d2590ac2cb5a5e67dc7d90317f05c)
2021-01-182101: Update VPP_STABLE_VER_ filesTibor Frank2-2/+2
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ica196e6a309e4dc2fdfb51b7faed72a627311991
2021-01-18Report: Remove slider for Latency graphsTibor Frank1-2/+0
Change-Id: I86b9af8e2ebbf27cd8d93c9a04901dce874fa9d6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 69264aed8d43f3c4a8342dd7584f80336108c879)
2021-01-18Report: Fix specificationTibor Frank1-2/+6
Change-Id: Ida7035fd130f566215f222d9cd7e98beb583af94 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4d04d11497eb87f94d6ac4982e4b17ae0f48d811)
2021-01-18job-specs: Fix hoststackTibor Frank1-8/+8
Change-Id: I1e450ec00621c7d0bd5a2fd91491c31eae3481f4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e4d7b3b4d4185e97443830e7e9fb0f570031a376)
2021-01-18Report: Add data, add 2n-tx2Tibor Frank16-1146/+2528
Change-Id: Ic2f8e03c16c432479139648cad7982a962193bc4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit caef25a1412689fc0906e024e9b26c547ecfc5bd)
2021-01-18Report: add 2n-tx2 static contentJuraj Linkeš34-10/+316
Change-Id: I476ac52d64999f6d3ca3ee726f018f36693ac921 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech> (cherry picked from commit 7f0abbb8f56342fc09b09beb47661f4d55b7eb62)
2021-01-18PAL: Improve latency graphsVratko Polak1-6/+31
Previously, they used sloped lines connecting reported points. But HdrHistogram reports only the upper bound of percentile. Example: If all samples are 10us, HdrHistogram reports a single value at 100%. This change attempts to show the whole intervals (0%-100% for the example) as a series (vertically connected) of horizontal lines. Hover also shows percentiles as intervals. Change-Id: Id7bbff7b1c29d7f62472041340fde88903363cfa Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 826d80373dbd20bc1feac2403e9cade9e5633336)
2021-01-14Add 3n ip4-rnd testsVratko Polak9-13/+430
+ Rename traffic profiles to avoid mentioning number of nodes. + Improve 2n rnd suite documentation slightly. This is a manual cherry-pick of https://gerrit.fd.io/r/c/csit/+/27679 Change-Id: I82d6fb6a99133163a58d56f2acf8a7b9568ee77c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-14License: Update block replacerVratko Polak2-1/+24
... so it replaces also long (older) form of GPL license. This way replacing to apache and back ensures GPL has (newer) short form. Change-Id: I34efd83a91e54b2b2bbb3c4429d1b82397a1e8f8 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 193fc1732fdacf424d36bbb979037ba261457cb4)
2021-01-14License: Wrap GPL block to 80 charactersVratko Polak185-367/+552
The original license block was adapted from https://wiki.fd.io/view/TSC/Proposed_Header_Python_Test_Scripts resulting in a line longer than 80 chars, but those are reported (although not blocked) by tox verify job. As the text from wiki was not used in verbatim (it uses c-style comment block), minor formatting change like this should not be a big deal. + Bump copyright year. Change-Id: I55e3a0232639b448b1a6d7b1f3af84d903a8d0a5 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 624e580159dc056035d7e962582e86a000f8c3d6)
2021-01-09perf: GENEVE tunnel test, l3 modeJan Gelety17-18/+2361
Jira: CSIT-1768 Change-Id: I888ae1a5754fa07297d4cdf65c2be0e3e49d89a5 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 6962831a1f1905e50a3d663c0cf3ce8c2873ecc9) Change-Id: I6496ae773b176b2abfedab843110d6f870c62888 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2021-01-142101: Update the stable ver files to rc2Tibor Frank2-2/+2
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ibec19f45e307af8b6c92d76ed0da126650973c3b
2021-01-14Report: Add dataTibor Frank2-9/+14
Change-Id: I3ac0e892ef3f2b0a23b42465565d28f5d5027dae Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ef5c30213bb28824a55f4ebbcade6410ee8d2461)
2021-01-13job_specs: fix 2n-tx2 ip6 iacldst job specsJuraj Linkeš2-6/+6
Change-Id: Id0f74dd289a05c84f6f0723adcd678f02c7464fa Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech> (cherry picked from commit 55eb33d7469ec635755d0942c74ff798f9f3d498)
2021-01-13Report: Fix plotsTibor Frank1-1/+2
Change-Id: I70a7929400d7fba144a3669fc9d8aff003695f55 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 81958d4bc5ec4803be0726d94564680e2a0f9a5c)
2021-01-13job_specs: update 2n-tx2 coverage specsJuraj Linkeš15-5/+955
Start out with l2, l3, classifier and acl tests. Change-Id: I8fc390c77e410e4f4832b4412114253dd34a5fbb Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-13Report: Add dataTibor Frank2-29/+192
Change-Id: Ia6f46cd9dbf83e6376f635b3e250708bdfba80be Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 98a94315dae63bd19c7bc16ce50b3219386aa34c)
2021-01-13Report: Add dataTibor Frank1-54/+35
Change-Id: I23dd384edd107facdc8e54275c1acded5a9935fd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7a26d43c4f71869695ba19ce58f9afac9a1d176d)
2021-01-12Report: Add dataTibor Frank1-0/+16
Change-Id: I70153753ccc69597dc2c69133b3828cd76174468 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1899cf849e938512df8bac9ea7cb6479732dda42)
2021-01-12Add 2n-tx2 job specsTibor Frank2-0/+50
Change-Id: I992c1466b2226337a043b46e1bdba82de2dc2368 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-12Report: Add dataTibor Frank1-22/+36
Change-Id: I648732e98941b562c31a9db735332bd215d65870 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1b141f8090e9b067dce9d182a81aa530213d4a66)
2021-01-11tests: add 2n1l l2 acl tests, update 2n-tx2 specsJuraj Linkeš57-103/+1334
Modify initialize L2BD ACL keywords to be usable for both 2-node and 3-node topologies and update testsuites accordingly. Add the missing macip T-rex profile. Add classifier tests to 2n-tx2 job specs. Change-Id: I17b84b8fc18ef9a6f275ae0238a0665ac2017f01 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech> (cherry picked from commit 9d510d595f73d26e3f7c6646fa6530e8f252f790)
2021-01-11Infra: Increase shm-sizepmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ib9dfb8623757fd23fd8b49b5e04ed86e202ada66 (cherry picked from commit 2f4b14bc83437afcc242190a121ba47a6d10bd09)
2021-01-11Report: Fix plot layoutTibor Frank1-1/+1
Change-Id: Ia2c448a6b9bed2095710c04fde606649385e408e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit fa0e6315e4db3d96b281fb7467a9416150c0bc9f)
2021-01-11Report: Add dataTibor Frank2-13/+521
Change-Id: Ic584b2340bbaebf5699213358292159518546334 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e7c71f5e3de89d0e9f0b6d5d0ee099e1ee97c2db)
2021-01-11FIX: Backward compatibility include selectionpmikus1-2/+9
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ieff60a44d42d66acee8ba1680e7e285d6cd01bc9 (cherry picked from commit e62ade12b7c9918cda2d363387ed0f517aa9840d)
2021-01-11Report: Add Latency graphs with logaritmic x-axisTibor Frank2-15/+527
Change-Id: Ic41b8761aed4256cb3f8ab9d14831e9d2be1598c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b370b24ad548c2caba20fcfd1c4796416d829c7a)
2021-01-11Report: ConfigurationTibor Frank49-49/+49
Change-Id: Ia1d95d610ede86127797eecd89eb68091d15d54c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5dd28c508cf6f04dee46580c73272c2cb31f5831)
2021-01-11Report: Configure reportTibor Frank64-10150/+1953
Change-Id: I1c64758f937c34a8f3956a5aa6512bb16a9dfe62 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit fc3f7fa58880d2327c3364bbcf8338d2256fb8f0)
2021-01-07PAPI: Cache connected client instancesVratko Polak11-103/+492
Disconnect+connect cycle is expensive and slow. This change tracks connected client instances so later "connect" to the same target uses it. Explicit disconnects are allowed (and executed before VPP ends), but once again disconnected instances are cached and reused, as creating a new instance is more expensive than just connect. + Add missing checks on interfaces being up to appropriate keyword. + Use appropriate keywords. + Add a comment explaining why a simpler keyword is not appropriate. + Improve VPP checks in containers. + Fix the vppctl check to actually work. + Add PAPI check to ensure VPP is really ready. + Delay/reorder checks to make them faster with multiple containers. + Leave some TODOs to improve various lifecycles later. + As we do not stop VPP in test/suite teardown: + One final disconnect is needed, added to __init__.robot teardowns. - Import of the final disconnect keyword is ugly, but it works. - We could use a hashable class for distinguishing node+socket pairs. - Are we connecting to VPP inside VMs? Change-Id: I49cd726740c3e8cae1591c7c84b85a447241228f Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit a33b52ae0f255021d89307ebc694f6e907906151)
2021-01-07Set DPDK version to 20.11Tibor Frank1-1/+1
Change-Id: I6f95ad79c891def175dcbc778d26ced0ec84f799 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4e2347f3996290fbc2386938791c2f272d052c63)
2021-01-05Infra: Ansible syncpmikus3-12/+34
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ida73c8acab94ad334fe57bb52f4dab33c40dded6
2021-01-04fix: geneveJan Gelety2-5/+5
Change-Id: I23541e1c07a42b4baa560c343ffeed3b963fe694 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit d7a3262b58c86868a18c29244f29196203e1eb39)