aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-02-05Report: Remove data from 2n-skx TB23Tibor Frank1-17/+2
Change-Id: Ibd8ccb2ebc5d158abb4fe295e8b514ab7a7c5422 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5d8cbe573c3781663e134187def17360a4fa923e)
2020-02-05Report: Add dataTibor Frank3-138/+1864
Change-Id: I58c85e6dccca28d402e6a54cf49ce5eebcdd5b1b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d639b4d35441078219c77a887d222d26d42ebeff)
2020-02-05FIX: nat44 scaleJan Gelety1-0/+1
+ missing ip_min for vm1 Change-Id: I8a30eaa36f6e417a88a6888b70f72d74183c9141 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 630dc7475e92aaa828512930d93bda7c568bd1f0)
2020-02-04T-Rex: CPU pinningPeter Mikus8-111/+90
+ Detect NUMA + Pin based on numa location Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ife350f8c70e5437ac7c1413c7753f2a2f62777d9 (cherry picked from commit 6bcf4d40d83bbf026f9fd0105bebf579423c65a6) (cherry picked from commit 6cb55db44f4c9817395d5fe5d8391c88412a6d59)
2020-02-04Add more reconf tests, for IPsecVratko Polak43-101/+6222
- Not adding nf_density tests. - Not adding hardware ipsec tests. - Not adding -policy- tests. - Using old crypto_ia32_plugin.so plugin name. + Suitable for cherry-picking to rls2001. Change-Id: Ibf44d6d91e2afa2320637ecd9eb69d5d5dc364aa Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-02-04Report: Add dataTibor Frank1-44/+90
Change-Id: I8377704590e7278d0faab5497b538300e26fd0ba Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 70f49a035f459358bb9209d06bb50f51716a0776)
2020-02-04Report: Remove cx556a from DPDKTibor Frank9-608/+0
Change-Id: I19f87dc6608dab684663174d541dfcee47e045da Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c16b1af983a3408dedb3da8a568ded1b8c804d37)
2020-02-03Report: Fix specTibor Frank1-1/+1
Change-Id: Ia86a1542b69aa07d9d26a4aea3c5ccda6dd69862 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f4468158296209fe591a14e95ee7e57fef9dc208)
2020-02-03Report: Add VPP 2n-clx cx556aTibor Frank51-79/+5189
Change-Id: I95e713f1e1d41eb886261b802f711fbb6ad6d27f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 8da14b3b1d12f48a405ad23cf8ef49a3f6d26b1e)
2020-02-03Autogen: Fix typo affecting DPDKVratko Polak1-1/+1
With the typo, only the first type+nic combination is generated. With fix, all combinations are generated. Change-Id: Ieb2db31cebed4940b063505b70f4d12a30da489c Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 7a035831fc06de7849876b782bf6f97136a39208)
2020-02-03Report: Add DPDK 2n-clxTibor Frank29-67/+1609
Change-Id: I4cd0fb5169a8ce571cce23bf8c3b9709afe8dc9b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 27fbd8171dcc2a3982274224ccb4979e56a22e87)
2020-01-30perf: Add hoststack NSIM+LDPRELOAD+IPERF3 test suiteDave Wallace6-15/+95
Change-Id: Ia7a876b1aa240676e1f2d23618c1d4e09ead14f0 Signed-off-by: Dave Wallace <dwallacelf@gmail.com> (cherry picked from commit d79b753c1fde3cd831f60ac5cc0034f613c44b43)
2020-01-20Use vpp 20.01-release pacakgesJan Gelety4-8/+11
Signed-off-by: Jan Gelety <jgelety@cisco.com> Change-Id: Ibd1b78fd5bb9424564f27497a19176527c604be4
2020-01-30PAL: Latency processingTibor Frank1-16/+44
Very ugly solution for now. It will be replaced by using JSON structure for test results soon. Change-Id: If5b63de94bf02e7fc2a518c1f6a94f42dcec9e07 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 20e972ce413e727b0a3d89d04460534cb454f107)
2020-01-29Display target_tr for ndr/pdr resultsVratko Polak1-5/+5
Small differences in Tx packet counts can cause the previous way (which used transmit_rate, computed from packets sent and nominal duration) to report lower bounds as higher than upper bounds. Also, reconf tests need the target (not actual) rate. Change-Id: If5222dabd9762b8d9c2e22d875c12ad355bc6838 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 401c24914d84058d06ef9b7a4f893662dfeb0dcb)
2020-01-29Ndrpdr: Remove unused latency measurementsVratko Polak1-23/+14
+ Improve keyword Documentation. + Reorder measurements, higher loads first. Change-Id: I1aeab1c8ada268422e9f421e075aff2ac9eec23f Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 703d013c83c9a4ce2283f1a0c16fe1511f1144d3)
2020-01-29Restore PDR stat run for NDRPDRVratko Polak1-2/+6
Before [0], the NDRPDR test ended with two measurements that perform runtime stats collection, each 2 seconds long. [0] then decreased that duration to one second, and removed the PDR measurement. This change re-adds the PDR measurement, while keeping the duration at 1 second. [0] https://gerrit.fd.io/r/c/csit/+/24427 Change-Id: I76828f11863a9e278cdd0cf60f2792d5b614ce43 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit f7699715f37ee6846bceb1fa7baf51366a683737)
2020-01-29perf: QUIC transport hoststack test suiteDave Wallace4-14/+117
Change-Id: I73f4be7ea315c7a5dcce46e1bd3034bcb0a97ee2 Signed-off-by: Dave Wallace <dwallacelf@gmail.com> (cherry picked from commit 074ae9732d06f962a65d91147b55abf86b42b6d9)
2020-01-29perf: hoststack iperf3 test tuningDave Wallace12-80/+146
Change-Id: I53425f57fe9ecef9cff2c94642cc7cb24537a961 Signed-off-by: Dave Wallace <dwallacelf@gmail.com> (cherry picked from commit b340b5c9925b43869b91197850504760757a0bfe)
2020-01-29Report: Fix: Add new NFV dataTibor Frank1-1/+1
Change-Id: Iae3557db30c5a95cb26d2e9b5acf24df2f64e429 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3bc72c6e268474a6bed725e5371d66f0e369ab16)
2020-01-29Report: Add new NFV dataTibor Frank6-112/+2651
Change-Id: Ic5a20940466545611150cfceaed58cee702636c4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 8f6b774bfb9d5728ce1b1dafc11ff1d00a05d90c)
2020-01-29Report: Add NFV data for existing elementsTibor Frank1-81/+57
Change-Id: Ib76dbf36f6eb0234f6947fc43bd6c31e12a1d8e9 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 33741e9e4d961c7ca805ef635982cd210a44a3b4)
2020-01-29Ipsec: Unify first line of Local Template docVratko Polak62-94/+90
Seeing differences when diff-ing between suites is distracting. + Bump copyright year, even for files with no change. Change-Id: Iaca79647821dd8233bdbe6b0ac8b14fdb04060a8 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 286a1db6861bca96155eb0c282277e225883ed54)
2020-01-28Fix two auth_alg valuesVratko Polak2-2/+2
Change-Id: I0e85fc958779df3d5dbacf1ad1e3898268a832ec Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 0c6d1142326b6953b972733c4fa3bddf078ec802)
2020-01-28Update overheads for IPsec CBC testsVratko Polak32-64/+64
Updated to the values as seen in packet trace. Even if VPP creates wrongly sized packets (compared to RFCs), the overhead should correspond to the actual packet size present, in order to correctly prevent linerate on DUT-DUT link. The new overhead values are 62 (256SHA) and 78 (512SHA). The GCM value is already correct, at 54 bytes, so density tests are ok. - The lispgpe test is not updated, as it currently fails. We will update overhead there in (or after) 24578. Change-Id: I5cc6920205f37ddc80e76804fabd90b67174addf Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 13eec694e7a5eaeb9fe385a06d54565ea76eb974)
2020-01-28Check interval validity in reconf testsVratko Polak1-0/+2
Without this, if the search part returns min_rate, then reconf part reports few seconds with a small loss count. But min_rate means there is a bug or misconfiguration, so the tests should fail, instead of returning misleading results. Change-Id: I566608b40ae11d6aaa3fe022a32da97901e1999c Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 6ac704e7388409c6aa719e50f83d0e08ebd671a0)
2020-01-28Perform some cleanup discovered by GPL workVratko Polak90-35/+23
+ Remove one __init__.robot file with no function. + Remove executable flags from traffic profiles. + Improve indentation in some traffic profiles. Change-Id: I099e63069003fba788976a9470a909ccff51a88c Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit ceaa2959217752716496b6257595d12cbcb0c657)
2020-01-28FIX: dot1qip4vxlan testsPeter Mikus31-52/+80
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ieb6e6010108987f99f55730149e3e4b7f1a7fc21 (cherry picked from commit 97dbe2feecc6d592db7427c4f1a72c1ac31990d1)
2020-01-28Report: Add RC2 dataTibor Frank1-74/+59
Change-Id: I29dc3e34293d8bcc940e2adc3034e32b3806c71c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a4882cb1547e2abf424bb53f424439989fc3b6e7)
2020-01-28PAL: Add latency by percentile graphTibor Frank4-4/+245
Change-Id: I38c03e089fd709afc848ecec55474d5c6925a58e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6716e51e3a27cfd2850a399c9ccc2818c2038eaf)
2020-01-27Increase min_rate for NDRPDR testsVratko Polak1-2/+4
Latency measurements break for loads less than 9 kpps per direction. Setting min_rate to 90 kpps prevents 10% latency trial from breaking. 90 kpps should be enough for any type of test. When some test finds a lower value, this patch will make the fail with a message saying the loss rate at minimal load is too high (instead of a cryptic error from 10% measurement without this patch). Change-Id: I97b8428aa5044da23343b86447857b3a101f6baa Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit f7452e826cd83fc5ded28c1268f6f4aab252ca2d)
2020-01-27FIX: t29 yaml fileJan Gelety1-1/+1
Change-Id: I20e01457b492ddb9f23cc31f5eab8388f3ea2405 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit ae904eb12cde28fd21bf154fd300970fcfbe48eb)
2020-01-27Report: Add RC1 dataTibor Frank1-0/+21
Change-Id: I3d6d9c56456a12435096f7c61f744519279a850b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit cdb023e3eb911ad3367fccec8ba1a2935a18c7fd)
2020-01-27Report: Add RC1 dataTibor Frank1-7/+0
Change-Id: I7ebbabd1f56b892b6f88a6a183632cb11fc2bc3c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9afeffb373c05a5853cbfc5a61456c69af423d9e)
2020-01-27Add t29 Mellanox NIC into topologyPeter Mikus1-0/+32
Change-Id: I1361595b2a7bda78f45b1379c29a293f863728a8 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 03ce6e3c1a942b040a5a35008d0d382de39c473f)
2020-01-27Report: Add RC1 dataTibor Frank1-500/+399
Change-Id: I7ab49f6a910b9273b78e89096e06761ff7537ec9 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2221396d9ebacf7a5333d63ed329a38f9507838b)
2020-01-19Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 18.04: 20.01-rc2~3-g9af7a98cf - use new vpp ref build - centos7: 20.01-rc2~3_g9af7a98~b8 Signed-off-by: Jan Gelety <jgelety@cisco.com> Change-Id: I40e1aa17f7cd5e6ef7d5736b1623a4063ec04f07
2020-01-24Attempt to fix journalctlPeter Mikus1-3/+3
- AWK - ECHO - pipe + Much simpler Change-Id: I4876f4eae68c96571dc38fd21e53ba269f5f888e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2020-01-23FIX: VTS testsJan Gelety3-6/+6
Change-Id: I594d248c58dcdcdeceea57af2dd25e2b2e08247f Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 100fee239bb1627e4d109f72e742cf7087315d31)
2020-01-23FIX: nfv_densityJan Gelety187-406/+408
- use correct osi_layer=L2 (so L2 spoofing check is switched off in case of avf driver) - add pci address information to eth interface in topology file - nfv_density chain_ipsec tests work only with DPDK in current implementation Change-Id: I233c6e5634a14581960c7459b87f11fcee8365bd Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit f31b70ee422ed0dc4e5d9b60061a1c2cfc904684)
2020-01-23FIX: Various issuesPeter Mikus5-81/+15
- TrafficProfile - IPsec jumbo - TDLK leftover - Trex scapy server Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I0601ea75ed6e7318c46124fb02e9c61066089791 (cherry picked from commit 6ccc6d6811a173b8cc3816c51a2dbef8934b3ffd)
2020-01-18Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 18.04: 20.01-rc2~1-g20398a368 - use new vpp ref build - centos7: 20.01-rc2~1_g20398a3~b6 Signed-off-by: Jan Gelety <jgelety@cisco.com> Change-Id: I5b6b95ece0bbd2c90eddf78bd6f194f7b8b921c2
2020-01-23Report: Add diagrams for testbedsTibor Frank7-12/+4412
- Diagrams for testbeds: - 3n-dnv - 3n-tsh - 2n-clx - Replace s/Cascadelake/Cascade Lake Change-Id: I77e7659a0aba4766a28577f940b7e44e60cbd82d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 25a8fe0aa594ca010b7f1aad449a2af2b6625bd7)
2020-01-22PAL: Process HDRH LatencyTibor Frank1-16/+76
Change-Id: Ifc48869ccb6c05f4b5af6cd97e05f009c7632dc7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 654bfa4c33dca6d6eeba6636199de0ff80f75652)
2020-01-21Ndrpdr: Add latency trials for smaller loadsVratko Polak2-11/+82
Change-Id: I46bd4b58bdd02a3deed38c158214e1e9977dde05 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 8840972e7bbc45735f6e82e41ad369728c1b370e)
2020-01-20reduce test cases for 2n-dnv and 3n-dnv mrr daily testYulong Pei2-202/+2
since dnv platform is to use by low end market product, no need care more about too much flows performance test. Change-Id: Id7204b0353cbf968e641f14ed980f01af75971b2 Signed-off-by: Yulong Pei <yulong.pei@intel.com> (cherry picked from commit b693dedec9077ddb08f50ebefc9d84addcdc047a)
2020-01-20revert "Report: Remove 'avf' from TC name in plots"Tibor Frank1-9/+6
Change-Id: I9b10b8f2f84daad543ac9b84671753785dfb23ad Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 87f81f123c054908df6770f11a947b9fe6ab0e93)
2020-01-17perf: add TCP Iperf3+LDPRELOAD test suiteDave Wallace10-55/+355
Change-Id: Icff49fb31cce342a2a4ae799e844ec91f9e5e366 Signed-off-by: Dave Wallace <dwallacelf@gmail.com> (cherry picked from commit 6518c73a0e5cdaf12ae01d247a65aec287d01625)
2020-01-17Fix unreservationVratko Polak1-2/+3
It got broken by the previous reservation fix. Change-Id: I5d9091b7fa4fcc37148c0223fe8eb83f7e5b6770 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit ac33ed374cb82c9258e4cf57e150f77750362bbc)
2020-01-17Report: Remove 'avf' from TC name in plotsTibor Frank1-5/+7
Change-Id: Ie1d04347de123032a5d424747d216f90022bc813 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c26ab619b300e6bf38c447c0600a5739ca46e27b) (cherry picked from commit 21591b3ec26ce457f8374acb970b0504cd373b55)