aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-01-28Fix two auth_alg valuesVratko Polak2-2/+2
Change-Id: I0e85fc958779df3d5dbacf1ad1e3898268a832ec Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 0c6d1142326b6953b972733c4fa3bddf078ec802)
2020-01-28Update overheads for IPsec CBC testsVratko Polak32-64/+64
Updated to the values as seen in packet trace. Even if VPP creates wrongly sized packets (compared to RFCs), the overhead should correspond to the actual packet size present, in order to correctly prevent linerate on DUT-DUT link. The new overhead values are 62 (256SHA) and 78 (512SHA). The GCM value is already correct, at 54 bytes, so density tests are ok. - The lispgpe test is not updated, as it currently fails. We will update overhead there in (or after) 24578. Change-Id: I5cc6920205f37ddc80e76804fabd90b67174addf Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 13eec694e7a5eaeb9fe385a06d54565ea76eb974)
2020-01-28Check interval validity in reconf testsVratko Polak1-0/+2
Without this, if the search part returns min_rate, then reconf part reports few seconds with a small loss count. But min_rate means there is a bug or misconfiguration, so the tests should fail, instead of returning misleading results. Change-Id: I566608b40ae11d6aaa3fe022a32da97901e1999c Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 6ac704e7388409c6aa719e50f83d0e08ebd671a0)
2020-01-28Perform some cleanup discovered by GPL workVratko Polak90-35/+23
+ Remove one __init__.robot file with no function. + Remove executable flags from traffic profiles. + Improve indentation in some traffic profiles. Change-Id: I099e63069003fba788976a9470a909ccff51a88c Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit ceaa2959217752716496b6257595d12cbcb0c657)
2020-01-28FIX: dot1qip4vxlan testsPeter Mikus31-52/+80
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ieb6e6010108987f99f55730149e3e4b7f1a7fc21 (cherry picked from commit 97dbe2feecc6d592db7427c4f1a72c1ac31990d1)
2020-01-28Report: Add RC2 dataTibor Frank1-74/+59
Change-Id: I29dc3e34293d8bcc940e2adc3034e32b3806c71c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a4882cb1547e2abf424bb53f424439989fc3b6e7)
2020-01-28PAL: Add latency by percentile graphTibor Frank4-4/+245
Change-Id: I38c03e089fd709afc848ecec55474d5c6925a58e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6716e51e3a27cfd2850a399c9ccc2818c2038eaf)
2020-01-27Increase min_rate for NDRPDR testsVratko Polak1-2/+4
Latency measurements break for loads less than 9 kpps per direction. Setting min_rate to 90 kpps prevents 10% latency trial from breaking. 90 kpps should be enough for any type of test. When some test finds a lower value, this patch will make the fail with a message saying the loss rate at minimal load is too high (instead of a cryptic error from 10% measurement without this patch). Change-Id: I97b8428aa5044da23343b86447857b3a101f6baa Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit f7452e826cd83fc5ded28c1268f6f4aab252ca2d)
2020-01-27FIX: t29 yaml fileJan Gelety1-1/+1
Change-Id: I20e01457b492ddb9f23cc31f5eab8388f3ea2405 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit ae904eb12cde28fd21bf154fd300970fcfbe48eb)
2020-01-27Report: Add RC1 dataTibor Frank1-0/+21
Change-Id: I3d6d9c56456a12435096f7c61f744519279a850b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit cdb023e3eb911ad3367fccec8ba1a2935a18c7fd)
2020-01-27Report: Add RC1 dataTibor Frank1-7/+0
Change-Id: I7ebbabd1f56b892b6f88a6a183632cb11fc2bc3c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9afeffb373c05a5853cbfc5a61456c69af423d9e)
2020-01-27Add t29 Mellanox NIC into topologyPeter Mikus1-0/+32
Change-Id: I1361595b2a7bda78f45b1379c29a293f863728a8 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 03ce6e3c1a942b040a5a35008d0d382de39c473f)
2020-01-27Report: Add RC1 dataTibor Frank1-500/+399
Change-Id: I7ab49f6a910b9273b78e89096e06761ff7537ec9 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2221396d9ebacf7a5333d63ed329a38f9507838b)
2020-01-19Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 18.04: 20.01-rc2~3-g9af7a98cf - use new vpp ref build - centos7: 20.01-rc2~3_g9af7a98~b8 Signed-off-by: Jan Gelety <jgelety@cisco.com> Change-Id: I40e1aa17f7cd5e6ef7d5736b1623a4063ec04f07
2020-01-24Attempt to fix journalctlPeter Mikus1-3/+3
- AWK - ECHO - pipe + Much simpler Change-Id: I4876f4eae68c96571dc38fd21e53ba269f5f888e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2020-01-23FIX: VTS testsJan Gelety3-6/+6
Change-Id: I594d248c58dcdcdeceea57af2dd25e2b2e08247f Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 100fee239bb1627e4d109f72e742cf7087315d31)
2020-01-23FIX: nfv_densityJan Gelety187-406/+408
- use correct osi_layer=L2 (so L2 spoofing check is switched off in case of avf driver) - add pci address information to eth interface in topology file - nfv_density chain_ipsec tests work only with DPDK in current implementation Change-Id: I233c6e5634a14581960c7459b87f11fcee8365bd Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit f31b70ee422ed0dc4e5d9b60061a1c2cfc904684)
2020-01-23FIX: Various issuesPeter Mikus5-81/+15
- TrafficProfile - IPsec jumbo - TDLK leftover - Trex scapy server Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I0601ea75ed6e7318c46124fb02e9c61066089791 (cherry picked from commit 6ccc6d6811a173b8cc3816c51a2dbef8934b3ffd)
2020-01-18Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 18.04: 20.01-rc2~1-g20398a368 - use new vpp ref build - centos7: 20.01-rc2~1_g20398a3~b6 Signed-off-by: Jan Gelety <jgelety@cisco.com> Change-Id: I5b6b95ece0bbd2c90eddf78bd6f194f7b8b921c2
2020-01-23Report: Add diagrams for testbedsTibor Frank7-12/+4412
- Diagrams for testbeds: - 3n-dnv - 3n-tsh - 2n-clx - Replace s/Cascadelake/Cascade Lake Change-Id: I77e7659a0aba4766a28577f940b7e44e60cbd82d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 25a8fe0aa594ca010b7f1aad449a2af2b6625bd7)
2020-01-22PAL: Process HDRH LatencyTibor Frank1-16/+76
Change-Id: Ifc48869ccb6c05f4b5af6cd97e05f009c7632dc7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 654bfa4c33dca6d6eeba6636199de0ff80f75652)
2020-01-21Ndrpdr: Add latency trials for smaller loadsVratko Polak2-11/+82
Change-Id: I46bd4b58bdd02a3deed38c158214e1e9977dde05 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 8840972e7bbc45735f6e82e41ad369728c1b370e)
2020-01-20reduce test cases for 2n-dnv and 3n-dnv mrr daily testYulong Pei2-202/+2
since dnv platform is to use by low end market product, no need care more about too much flows performance test. Change-Id: Id7204b0353cbf968e641f14ed980f01af75971b2 Signed-off-by: Yulong Pei <yulong.pei@intel.com> (cherry picked from commit b693dedec9077ddb08f50ebefc9d84addcdc047a)
2020-01-20revert "Report: Remove 'avf' from TC name in plots"Tibor Frank1-9/+6
Change-Id: I9b10b8f2f84daad543ac9b84671753785dfb23ad Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 87f81f123c054908df6770f11a947b9fe6ab0e93)
2020-01-17perf: add TCP Iperf3+LDPRELOAD test suiteDave Wallace10-55/+355
Change-Id: Icff49fb31cce342a2a4ae799e844ec91f9e5e366 Signed-off-by: Dave Wallace <dwallacelf@gmail.com> (cherry picked from commit 6518c73a0e5cdaf12ae01d247a65aec287d01625)
2020-01-17Fix unreservationVratko Polak1-2/+3
It got broken by the previous reservation fix. Change-Id: I5d9091b7fa4fcc37148c0223fe8eb83f7e5b6770 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit ac33ed374cb82c9258e4cf57e150f77750362bbc)
2020-01-17Report: Remove 'avf' from TC name in plotsTibor Frank1-5/+7
Change-Id: Ie1d04347de123032a5d424747d216f90022bc813 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c26ab619b300e6bf38c447c0600a5739ca46e27b) (cherry picked from commit 21591b3ec26ce457f8374acb970b0504cd373b55)
2020-01-17FIX: remove 4drc nfv_density chain ipsec tests from 3n-hsw daily jobJan Gelety1-12/+0
- not enough cpu cores reported Change-Id: If3ddbbf4f5af741f328c45ac6b8c874e61d348ab Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 8b64d3f942a28a01df1daac3ccee42828021a410)
2020-01-17FIX: missing write of mac_dst for direction 0 --> 1 in cnf trex profilesJan Gelety34-1/+137
Change-Id: I3acf5220c24f77bc4bfc451919bf9b5345a988ef Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 9159c81f65c71cf77e9f1d59241e9ebcbbe9abc4)
2020-01-17Fix reservation if connect failsVratko Polak1-4/+8
Change-Id: I136cc51cbd5a01451e04a39c5d8e5554d6d39305 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 1b9d4210b9b466fedab3a5891ec16a34e67a78ee)
2020-01-17Report: Prepare data setsTibor Frank2-639/+517
Change-Id: Ice90ffe8563d6283050f2b229fc5e50ab64ac253 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e864945ddfd65b99b3311fddc9260dba3a02b1bc)
2020-01-17FIX: L2XC with vhost and VLANJan Gelety1-0/+3
Change-Id: Ia87abadba431099eeacd8b50ce5d116597a1f393 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 633e1f40e5adcb38458fbd6d1209afc1240244a5)
2020-01-16Update of VPP_REPO_URL and VPP_STABLE_VER filesJan Gelety4-4/+4
- use vpp builds from vpp stable/2001 branch - use new vpp ref build - ubuntu 18.04: 20.01-rc1 - use new vpp ref build - centos7: 20.01-rc1~b2 Signed-off-by: Jan Gelety <jgelety@cisco.com> Change-Id: Ice08e71fe825ef722776a487a300d3972835ff9f
2020-01-16Python3: Migration of files under traffic-profiles/trexBalaji Venkatraman130-4745/+10715
Change-Id: Iae16225d3d3daa4e1e9b177228fb89efe4aa5405 Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>
2020-01-16Report: Latency by Percentile DistributionTibor Frank1-2/+7
- legend Change-Id: I35477ce5c2cabfdcef68424854a8574bd3655e55 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-16Report: Latency by Percentile DistributionTibor Frank2-5/+5
- Set X-axis Change-Id: Ica300c7b1352c824bf51ac26e7485c9295ac60dc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-16Report: Add placeholders for new TBsTibor Frank4-3/+247
Change-Id: I92cb693343c4f96503b45a15211e0dadd6fcde5f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-16Remove leftovers from previous removalsVratko Polak1-6/+5
- Except KubernetesUtils and its bash dependencies. It is a dead code currently, but we hope new tests will resurrect it. + Mention device tests instead of functional in Readme. Change-Id: I6bdbea13ea9f995a06a0fb7cb5e98ae4fce29581 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-15Report: Latency by Percentile DistributionTibor Frank1-1/+7
- Set the position of the Lagend Change-Id: I1bcea6002bd8beeba3300c9976d1603a234c3c14 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-15Report: Add Latency by Percentile DistributionTibor Frank59-4/+10313
Change-Id: I5291db8117da611497e910aa7cd2fbb2276bfe65 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-15Docs: Update report sectionsPeter Mikus16-394/+277
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ib6e9ac003c1d91673984c52baf2f3eec30c9d21d
2020-01-15Ansible: Increase TG hugepagesPeter Mikus20-57/+17
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ifa87e372ed45f6dfc883723acbb325e34fb814a8
2020-01-15Remove everything related to TLDKVratko Polak28-1157/+0
- Leftovers from kubernetes found, but not removed here. Change-Id: If8cb9269d0f3e69f642d7fe02c59122e17925a4d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-10Trending: new daily setJan Gelety57-619/+3935
New daily sets are prepared based on information in https://gerrit.fd.io/r/c/csit/+/24073/1/docs/job_specs/perf_tests_job_specs.md and previous test set definitions in docs/job_specs/test_select_list_[2n|3n]_[clx|skx|hsw|tsh|dnv].md files. - mrr-daily-2n-clx: 510 TCs (incl. nfv_density), expected exec. time 8:50h - mrr-daily-2n-skx: 525 TCs (incl. nfv_density), expected exec. time 7:55h - mrr-daily-3n-skx: 393 TCs (incl. nfv_density), expected exec. time 11:00h - mrr-daily-3n-hsw: 177 TCs (incl. nfv_density), expected exec. time 7:10h - mrr-daily-3n-tsh: 204 TCs, expected exec. time 21:00h - mrr-daily-2n-dnv: 84 TCs, expected exec. time 2:25h - mrr-daily-3n-dnv: 144 TCs, expected exec. time 6:35h + add some missing test suites + add trex-sl-2n-ethip4udp-1000u15p.py T-Rex traffic profile + correction of TS and TC names and tags in directory tests/vpp/perf/nfv_density/chain_ipsec Change-Id: Icfc86e9af97ed8dd8ccd2a34355c99aad69a28c0 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-01-10Support suite tags in autogenVratko Polak501-23/+674
+ Include a script to add suite tags to many suites at once. + Add suite tags also to device tests (not covered by autogen). Change-Id: I514ee6178e22999b43460028fe2696738b012f04 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-10Autogen: Generate also NIC drivers.Vratko Polak223-4089/+465
+ Disallowed -avf- (or -rdma-) as "template" suites. + GBP suite switched to DPDK driver in repo. + Each NIC has its own list of supported drivers, in Constants. + Updated tag expressions for daily jobs: + Feature, ipsec, memif, scale, srv6, tunnels, vhost and vts are tested only with vfio-pci. + Other (base, dot1q, dot1ad) tested with all drivers. + Setup actions currently depend on driver, generated. - The performance_rdma action is trivial for now. - Several tests fail, to be fixed later, e.g. by performance_rdma. + Reconf tests are also supported. + Added DRV_VFIO_PCI tags missing, mainly in density tests. - Vhost suites (density, reconf) are failing, but suites look good. - TCP suites do not support NIC drivers yet. - DPDK obviously not supported. + Use Python 3 in regenerate scripts. + Fix typos binded => bound. + File open modes set either u"rt" or u"wt" everywhere. + Remove a trailing space in an environment variable name. Change-Id: I290470675dc5c9e88b2eaa5ab6285ecd9ed7827a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-15Report: Current vs. Previous Release - NFV TestsTibor Frank2-0/+202
Change-Id: I00cbde38b8f900efe3e3123a942de2288381ea3b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-15Hoststack perf infrastructure refactoringDave Wallace19-80/+1067
- DUT only topology (hoststack test apps are co-located with vpp) - Make vpp app specific keywords generic where applicable - Add IP4 Prefix to topology file - Support running wrk in linux namespace - Refactor namespace cleanup - Remove redundant namespace creation code - Refactor test/keyword dirs: tcp -> hoststack - Add hoststack utility keywords - Refactor wrk suite setup/teardown - Update tests with recent perf infra changes Change-Id: Ia1cf07978d579393eef94923819a87c8c1f36f34 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-01-14FIX: VXLAN scalePeter Mikus1-3/+5
+ Another stupid arp -> neighbor rename Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia873d6c2a485659033f71cdf546782db74787d13
2020-01-14FIX: NF_density testsPeter Mikus1-2/+2
+ ARP -> Neighbor Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I74044bd7db6cb4b1bd3648a424e9c8f1473be8d1