aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-01-19Job specs: Add some ipsec reconf to iterativeVratko Polak1-0/+76
We now have more time for 3n-hsw testbeds. Added only scales of 4, 1000 and 60000 tunnels. Change-Id: I283a816e1440a9fe1f0dea13f954f92b457ea788 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-19Report: Add dataTibor Frank1-416/+416
Change-Id: I1b7314affd08d12b67212affb2ef89f64d1347ee Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-18Master: Update VPP_STABLE_VER_ filesTibor Frank2-2/+2
Change-Id: I8766254c5cb67afe913facec0477e5ba7550fba0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-18Random flows: Use seeds again and increase limit.Vratko Polak3-45/+54
TRex does mix seeds when distributing over workers, but it is multiplicative [0], so zero is the only bad value. Limit restricts the cycle length of PRNG (by resetting [1] the seed). We want the cycle as long as possible. [0] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.73/src/stx/stl/trex_stl_stream_vm.h#L1616 [1] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.73/src/stx/stl/trex_stl_stream_vm.h#L313-L314 Change-Id: I33a29496f0853ef60d592c988f81a9d1109b5878 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-18Report: Remove slider for Latency graphsTibor Frank1-2/+0
Change-Id: I86b9af8e2ebbf27cd8d93c9a04901dce874fa9d6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-18Report: Fix specificationTibor Frank1-2/+6
Change-Id: Ida7035fd130f566215f222d9cd7e98beb583af94 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-18job-specs: Fix hoststackTibor Frank1-8/+8
Change-Id: I1e450ec00621c7d0bd5a2fd91491c31eae3481f4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-18Report: Add data, add 2n-tx2Tibor Frank16-1146/+2528
Change-Id: Ic2f8e03c16c432479139648cad7982a962193bc4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-18PAL: Improve latency graphsVratko Polak1-6/+31
Previously, they used sloped lines connecting reported points. But HdrHistogram reports only the upper bound of percentile. Example: If all samples are 10us, HdrHistogram reports a single value at 100%. This change attempts to show the whole intervals (0%-100% for the example) as a series (vertically connected) of horizontal lines. Hover also shows percentiles as intervals. Change-Id: Id7bbff7b1c29d7f62472041340fde88903363cfa Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-15Report: add 2n-tx2 static contentJuraj Linkeš34-10/+316
Change-Id: I476ac52d64999f6d3ca3ee726f018f36693ac921 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-14perf: GENEVE tunnel test, l3 modeJan Gelety17-17/+2360
Jira: CSIT-1768 Change-Id: I888ae1a5754fa07297d4cdf65c2be0e3e49d89a5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2021-01-14Report: Add dataTibor Frank2-9/+14
Change-Id: I3ac0e892ef3f2b0a23b42465565d28f5d5027dae Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-13Add 3n ip4-rnd testsVratko Polak9-13/+430
+ Rename traffic profiles to avoid mentioning number of nodes. + Improve 2n rnd suite documentation slightly. Change-Id: I82d6fb6a99133163a58d56f2acf8a7b9568ee77c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-13job_specs: fix 2n-tx2 ip6 iacldst job specsJuraj Linkeš2-6/+6
Change-Id: Id0f74dd289a05c84f6f0723adcd678f02c7464fa Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-13Report: Fix plotsTibor Frank1-1/+2
Change-Id: I70a7929400d7fba144a3669fc9d8aff003695f55 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-13job_specs: update 2n-tx2 coverage specsJuraj Linkeš16-344/+509
Start out with l2, l3, classifier and acl tests. Change-Id: I0cd781f1858d5461b793f782f8bc6fcde5263b69 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-13Docs: TOI - How to create branchesTibor Frank1-0/+191
Change-Id: I7588d7ac7a0200df5b660ffbc31f7c2496496d06 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-13Report: Add dataTibor Frank2-29/+192
Change-Id: Ia6f46cd9dbf83e6376f635b3e250708bdfba80be Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-13License: Update block replacerVratko Polak2-1/+24
... so it replaces also long (older) form of GPL license. This way replacing to apache and back ensures GPL has (newer) short form. Change-Id: I34efd83a91e54b2b2bbb3c4429d1b82397a1e8f8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-13Report: Add dataTibor Frank1-54/+35
Change-Id: I23dd384edd107facdc8e54275c1acded5a9935fd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-12License: Wrap GPL block to 80 charactersVratko Polak185-368/+553
The original license block was adapted from https://wiki.fd.io/view/TSC/Proposed_Header_Python_Test_Scripts resulting in a line longer than 80 chars, but those are reported (although not blocked) by tox verify job. As the text from wiki was not used in verbatim (it uses c-style comment block), minor formatting change like this should not be a big deal. + Bump copyright year. Change-Id: I55e3a0232639b448b1a6d7b1f3af84d903a8d0a5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-01-12Report: Add dataTibor Frank1-0/+16
Change-Id: I70153753ccc69597dc2c69133b3828cd76174468 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-12Report: Add dataTibor Frank1-22/+36
Change-Id: I648732e98941b562c31a9db735332bd215d65870 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-12Master: Update of VPP_STABLE_VER filesTibor Frank2-2/+2
Change-Id: I87fc785ad934066a6dfa21334f38b16587261c61 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-11tests: add 2n1l l2 acl tests, update 2n-tx2 specsJuraj Linkeš57-201/+1070
Modify initialize L2BD ACL keywords to be usable for both 2-node and 3-node topologies and update testsuites accordingly. Add the missing macip T-rex profile. Add classifier tests to 2n-tx2 job specs. Change-Id: I17b84b8fc18ef9a6f275ae0238a0665ac2017f01 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-01-11Infra: Increase shm-sizepmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ib9dfb8623757fd23fd8b49b5e04ed86e202ada66
2021-01-11Report: Fix plot layoutTibor Frank1-1/+1
Change-Id: Ia2c448a6b9bed2095710c04fde606649385e408e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-11Report: Add dataTibor Frank2-13/+521
Change-Id: Ic584b2340bbaebf5699213358292159518546334 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-11Report: Add Latency graphs with logaritmic x-axisTibor Frank2-15/+527
Change-Id: Ic41b8761aed4256cb3f8ab9d14831e9d2be1598c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-11jumpavg: fix setup.pyPaul Vinciguerra1-1/+1
Fix typo introduced in https://gerrit.fd.io/r/c/csit/+/23465 Signed-off-by: Paul Vinciguerra <pvinci@vinciconsulting.com> Change-Id: Ie581fd612e7849500e061ac6f56f56b6eb322553
2021-01-11Report: ConfigurationTibor Frank49-49/+49
Change-Id: Ia1d95d610ede86127797eecd89eb68091d15d54c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-11Report: Configure reportTibor Frank64-10150/+1953
Change-Id: I1c64758f937c34a8f3956a5aa6512bb16a9dfe62 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-07ansible: remove unused old ARM nomad hostsDave Wallace3-64/+1
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: Ie2a653fa46119b5971c58478e306920376a8f874
2021-01-07fix: use csit lts branch in vpp-csit lts jobsJan Gelety1-1/+5
Change-Id: Iebd62fd6b0c798f7b4dd1f3b093c156e533b3900 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2021-01-07Set DPDK version to 20.11Tibor Frank1-1/+1
Change-Id: I6f95ad79c891def175dcbc778d26ced0ec84f799 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-12-21fix: geneveJan Gelety2-5/+5
Change-Id: I23541e1c07a42b4baa560c343ffeed3b963fe694 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2021-01-04API: deprecated COP APIsTomas Alexy33-416/+416
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: Ifb97088a26f3c2ab2ecee28ed43e6e957a844c64
2021-01-04GSO: TAP/VHOST use casepmikus21-65/+1676
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ibafaaca4438587284d1e255c764f0701002941e8
2021-01-04Update of VPP_STABLE_VER filesTibor Frank2-2/+2
- use new vpp ref build - ubuntu 18.04: 21.06-rc0~40-g17672aa49 - use new vpp ref build - centos8: 21.06-rc0~40_g17672aa49~b505 Change-Id: I025b906b730fe3f3c8fbbd5455bc2ca8a58f721f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-01-04FIX: AWK NIC replace in case of x520pmikus1-1/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I7d83ba048e0609d6b8623fab5c2960e48a37c023
2021-01-04Report: Remove GBP testsTibor Frank1-20/+0
- only in master Change-Id: I111c7d425d8693e8baf54892c3ecd384c99477c6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-12-23job_specs: add 2x-tx2 job specsJuraj Linkeš20-1/+1342
Add job specs for the new 2n-tx2 performance testbed. Change-Id: Ife1db4caba3ad17286727fed143e0c0556c4a2a4 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-12-21Framework: add 2n-tx2 perf testbedJuraj Linkeš2-1/+76
Add testbed file and make code changes in common.sh. Change-Id: I493bb92db3c66358afa81ec81bcd99b296f49c03 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-12-18Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 18.04: 21.06-rc0~14-gac9a585c6 - use new vpp ref build - centos8: 21.06-rc0~14_gac9a585c6~b240 Change-Id: Ic82d57625de00fb89390150683284aa68ca905ce Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-12-18Framework: 3n-tsh topology file updateJuraj Linkeš1-2/+2
The TG is now shared, update port and user accordingly. Change-Id: I8be4f41887498ae42935b7ab22a7f22dc21e6b50 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-12-18Keep robot example lines shortVratko Polak1-12/+12
Do not expand argument expressions into actual verbose values. Change-Id: I3d86cd826e9cd03cefefe2e197250f76414ac101 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-12-18API: deprecated bond APIsJan Gelety6-71/+57
Jira: CSIT-1597 Change-Id: I77b746584851331d46eca1caafd4468d18f1e78d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-12-18FIX: Backward compatibility include selectionpmikus1-2/+9
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ieff60a44d42d66acee8ba1680e7e285d6cd01bc9
2020-12-17PAPI: Cache connected client instancesVratko Polak11-103/+492
Disconnect+connect cycle is expensive and slow. This change tracks connected client instances so later "connect" to the same target uses it. Explicit disconnects are allowed (and executed before VPP ends), but once again disconnected instances are cached and reused, as creating a new instance is more expensive than just connect. + Add missing checks on interfaces being up to appropriate keyword. + Use appropriate keywords. + Add a comment explaining why a simpler keyword is not appropriate. + Improve VPP checks in containers. + Fix the vppctl check to actually work. + Add PAPI check to ensure VPP is really ready. + Delay/reorder checks to make them faster with multiple containers. + Leave some TODOs to improve various lifecycles later. + As we do not stop VPP in test/suite teardown: + One final disconnect is needed, added to __init__.robot teardowns. - Import of the final disconnect keyword is ugly, but it works. - We could use a hashable class for distinguishing node+socket pairs. - Are we connecting to VPP inside VMs? Change-Id: I49cd726740c3e8cae1591c7c84b85a447241228f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-12-17Switch include to testpmikus1-22/+36
+ Reduce time overhead when parsing --include vs --test + Input files will remain the same + 3n-hsw 150include ~24min, 150test ~5min + 2n-clx 489include ~61min, 489test ~9min Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I7e5957c32385aecbc4551bd124da41afa5bc63c9