aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-02-11Report: Filter data for Latency graphsTibor Frank3-5/+5
Change-Id: I7d0354086c7d63bc79f2b2f97345d84842d6a911 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0ba8b76dc5ac35b39b1a9200c1c81410d632d8aa)
2020-02-11Report: Add ucode comparisomTibor Frank4-1/+417
Change-Id: If918806ba5bcda4d87aa2ea2ab4d2c676dc9670a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7dc45304cd2e4e877c7c5b1885d242c3977e9245)
2020-02-10FIX: set host physical interface mac address to rdma interfaceJan Gelety2-0/+26
Reason is that the traffic generator is initialized with MAC addresses of physical interfaces in the suite setup while rdma interfaces are created later. Change-Id: I2cf182cde20f14778624740a1f0467096c336306 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-02-10Report: Latency only 1C and prim NICTibor Frank2-20/+26
Change-Id: Ibb9f6ed27047ac2beca25d9462dc321cf73f7546 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d7ef5191ec1a7561d6109723980d48b85953a9c7)
2020-02-10Report: Add dataTibor Frank1-2/+0
Change-Id: Ieef4cba0077e0ba5076d82ff1bdb6293abe91c3b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 574397e8d5e606ebeff4656d75829c494af418a9)
2020-02-10FIX: Detection if l2fwd/l3fwd is up/downJan Gelety6-15/+11
Change-Id: Ide5de222e8314a0ea0be59f9a478f8d59147f722 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit b968e370fe2737233f138ffd67a5bff75a6de091)
2020-02-10Report: Add dataTibor Frank1-2/+0
Change-Id: I58831fb795cd300d31306d040e8239c2a1b9a7fa Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c34b584bec20a3239b204d9bb4e8b8e5ccfad6f2)
2020-02-10Report: Add dataTibor Frank2-165/+192
Change-Id: I57b4f1cdb6d4467f8a93b466a5173e00d493b9a8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 704f231f80444be4b28eb565465c8ad76ab55be6)
2020-02-10PAL: Latency by percentileTibor Frank11-90/+165
Change-Id: I413271f4b1fad801463fb7f8f16112aedc0d058b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c1335b81c08aeeb5d45af39d45ce02dc1a7d4235)
2020-02-07FIX: policerJan Gelety3-6/+15
Change-Id: I23910b74c8720245b43067ac8c68880291b4b1c2 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit d7e14a0a93e7e06047daeaf6a5575f227aeb925a)
2020-02-07FIX: Detection if testpmd/l3fwd is upPeter Mikus3-102/+122
Change-Id: Ibd2e038332fe2bdf0e5bd69bf7376a2a7357e901 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit b9ffc1b5eb6bf80c95171d0496cef07d70bcfa5c)
2020-02-07PAL: Process NDRPDR test msgTibor Frank1-21/+25
Change-Id: I4098fa52cfa2feb2fca507ffe203c2a325c1d140 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 707562eb45f21c89014c667aaef788d869f9b215)
2020-02-07Report: Configure 2001-07Tibor Frank3-4/+4
Change-Id: I6323a3cf86bdebb6f1dc41a10fc840b5c80fab01 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2dd05d1daafcc5a4985a9593350aa2c0b290efa4)
2020-02-07PAL: Operational dataTibor Frank5-263/+532
Change-Id: I43eb12117ddc9b6df447f0303881bf7ec6153900 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2c06090c7b919783a91d3ca9ca8c8319b5c35b07)
2020-02-07Report: Placeholder for LD preload testsTibor Frank10-14/+110
- methodology - test results Change-Id: I0d102875045ab295d9b44fa7bc328f2a728803d7 Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: Dave Wallace <dwallacelf@gmail.com> (cherry picked from commit 107438e93a51eefc61dc171cfa9b959007ccc739)
2020-01-22FIX: use correct xRyC tags in nfv_density chain_ipsec testsJan Gelety26-26/+26
Signed-off-by: Jan Gelety <jgelety@cisco.com> Change-Id: I2cc27c012faeb93ca4a302fffb0ddbe9b1fb0e9c
2020-02-05Report: Remove data from 2n-skx TB23Tibor Frank1-17/+2
Change-Id: Ibd8ccb2ebc5d158abb4fe295e8b514ab7a7c5422 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5d8cbe573c3781663e134187def17360a4fa923e)
2020-02-05Report: Add dataTibor Frank3-138/+1864
Change-Id: I58c85e6dccca28d402e6a54cf49ce5eebcdd5b1b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d639b4d35441078219c77a887d222d26d42ebeff)
2020-02-05FIX: nat44 scaleJan Gelety1-0/+1
+ missing ip_min for vm1 Change-Id: I8a30eaa36f6e417a88a6888b70f72d74183c9141 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 630dc7475e92aaa828512930d93bda7c568bd1f0)
2020-02-04T-Rex: CPU pinningPeter Mikus8-111/+90
+ Detect NUMA + Pin based on numa location Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ife350f8c70e5437ac7c1413c7753f2a2f62777d9 (cherry picked from commit 6bcf4d40d83bbf026f9fd0105bebf579423c65a6) (cherry picked from commit 6cb55db44f4c9817395d5fe5d8391c88412a6d59)
2020-02-04Add more reconf tests, for IPsecVratko Polak43-101/+6222
- Not adding nf_density tests. - Not adding hardware ipsec tests. - Not adding -policy- tests. - Using old crypto_ia32_plugin.so plugin name. + Suitable for cherry-picking to rls2001. Change-Id: Ibf44d6d91e2afa2320637ecd9eb69d5d5dc364aa Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-02-04Report: Add dataTibor Frank1-44/+90
Change-Id: I8377704590e7278d0faab5497b538300e26fd0ba Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 70f49a035f459358bb9209d06bb50f51716a0776)
2020-02-04Report: Remove cx556a from DPDKTibor Frank9-608/+0
Change-Id: I19f87dc6608dab684663174d541dfcee47e045da Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c16b1af983a3408dedb3da8a568ded1b8c804d37)
2020-02-03Report: Fix specTibor Frank1-1/+1
Change-Id: Ia86a1542b69aa07d9d26a4aea3c5ccda6dd69862 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f4468158296209fe591a14e95ee7e57fef9dc208)
2020-02-03Report: Add VPP 2n-clx cx556aTibor Frank51-79/+5189
Change-Id: I95e713f1e1d41eb886261b802f711fbb6ad6d27f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 8da14b3b1d12f48a405ad23cf8ef49a3f6d26b1e)
2020-02-03Autogen: Fix typo affecting DPDKVratko Polak1-1/+1
With the typo, only the first type+nic combination is generated. With fix, all combinations are generated. Change-Id: Ieb2db31cebed4940b063505b70f4d12a30da489c Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 7a035831fc06de7849876b782bf6f97136a39208)
2020-02-03Report: Add DPDK 2n-clxTibor Frank29-67/+1609
Change-Id: I4cd0fb5169a8ce571cce23bf8c3b9709afe8dc9b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 27fbd8171dcc2a3982274224ccb4979e56a22e87)
2020-01-30perf: Add hoststack NSIM+LDPRELOAD+IPERF3 test suiteDave Wallace6-15/+95
Change-Id: Ia7a876b1aa240676e1f2d23618c1d4e09ead14f0 Signed-off-by: Dave Wallace <dwallacelf@gmail.com> (cherry picked from commit d79b753c1fde3cd831f60ac5cc0034f613c44b43)
2020-01-20Use vpp 20.01-release pacakgesJan Gelety4-8/+11
Signed-off-by: Jan Gelety <jgelety@cisco.com> Change-Id: Ibd1b78fd5bb9424564f27497a19176527c604be4
2020-01-30PAL: Latency processingTibor Frank1-16/+44
Very ugly solution for now. It will be replaced by using JSON structure for test results soon. Change-Id: If5b63de94bf02e7fc2a518c1f6a94f42dcec9e07 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 20e972ce413e727b0a3d89d04460534cb454f107)
2020-01-29Display target_tr for ndr/pdr resultsVratko Polak1-5/+5
Small differences in Tx packet counts can cause the previous way (which used transmit_rate, computed from packets sent and nominal duration) to report lower bounds as higher than upper bounds. Also, reconf tests need the target (not actual) rate. Change-Id: If5222dabd9762b8d9c2e22d875c12ad355bc6838 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 401c24914d84058d06ef9b7a4f893662dfeb0dcb)
2020-01-29Ndrpdr: Remove unused latency measurementsVratko Polak1-23/+14
+ Improve keyword Documentation. + Reorder measurements, higher loads first. Change-Id: I1aeab1c8ada268422e9f421e075aff2ac9eec23f Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 703d013c83c9a4ce2283f1a0c16fe1511f1144d3)
2020-01-29Restore PDR stat run for NDRPDRVratko Polak1-2/+6
Before [0], the NDRPDR test ended with two measurements that perform runtime stats collection, each 2 seconds long. [0] then decreased that duration to one second, and removed the PDR measurement. This change re-adds the PDR measurement, while keeping the duration at 1 second. [0] https://gerrit.fd.io/r/c/csit/+/24427 Change-Id: I76828f11863a9e278cdd0cf60f2792d5b614ce43 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit f7699715f37ee6846bceb1fa7baf51366a683737)
2020-01-29perf: QUIC transport hoststack test suiteDave Wallace4-14/+117
Change-Id: I73f4be7ea315c7a5dcce46e1bd3034bcb0a97ee2 Signed-off-by: Dave Wallace <dwallacelf@gmail.com> (cherry picked from commit 074ae9732d06f962a65d91147b55abf86b42b6d9)
2020-01-29perf: hoststack iperf3 test tuningDave Wallace12-80/+146
Change-Id: I53425f57fe9ecef9cff2c94642cc7cb24537a961 Signed-off-by: Dave Wallace <dwallacelf@gmail.com> (cherry picked from commit b340b5c9925b43869b91197850504760757a0bfe)
2020-01-29Report: Fix: Add new NFV dataTibor Frank1-1/+1
Change-Id: Iae3557db30c5a95cb26d2e9b5acf24df2f64e429 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3bc72c6e268474a6bed725e5371d66f0e369ab16)
2020-01-29Report: Add new NFV dataTibor Frank6-112/+2651
Change-Id: Ic5a20940466545611150cfceaed58cee702636c4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 8f6b774bfb9d5728ce1b1dafc11ff1d00a05d90c)
2020-01-29Report: Add NFV data for existing elementsTibor Frank1-81/+57
Change-Id: Ib76dbf36f6eb0234f6947fc43bd6c31e12a1d8e9 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 33741e9e4d961c7ca805ef635982cd210a44a3b4)
2020-01-29Ipsec: Unify first line of Local Template docVratko Polak62-94/+90
Seeing differences when diff-ing between suites is distracting. + Bump copyright year, even for files with no change. Change-Id: Iaca79647821dd8233bdbe6b0ac8b14fdb04060a8 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 286a1db6861bca96155eb0c282277e225883ed54)
2020-01-28Fix two auth_alg valuesVratko Polak2-2/+2
Change-Id: I0e85fc958779df3d5dbacf1ad1e3898268a832ec Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 0c6d1142326b6953b972733c4fa3bddf078ec802)
2020-01-28Update overheads for IPsec CBC testsVratko Polak32-64/+64
Updated to the values as seen in packet trace. Even if VPP creates wrongly sized packets (compared to RFCs), the overhead should correspond to the actual packet size present, in order to correctly prevent linerate on DUT-DUT link. The new overhead values are 62 (256SHA) and 78 (512SHA). The GCM value is already correct, at 54 bytes, so density tests are ok. - The lispgpe test is not updated, as it currently fails. We will update overhead there in (or after) 24578. Change-Id: I5cc6920205f37ddc80e76804fabd90b67174addf Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 13eec694e7a5eaeb9fe385a06d54565ea76eb974)
2020-01-28Check interval validity in reconf testsVratko Polak1-0/+2
Without this, if the search part returns min_rate, then reconf part reports few seconds with a small loss count. But min_rate means there is a bug or misconfiguration, so the tests should fail, instead of returning misleading results. Change-Id: I566608b40ae11d6aaa3fe022a32da97901e1999c Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 6ac704e7388409c6aa719e50f83d0e08ebd671a0)
2020-01-28Perform some cleanup discovered by GPL workVratko Polak90-35/+23
+ Remove one __init__.robot file with no function. + Remove executable flags from traffic profiles. + Improve indentation in some traffic profiles. Change-Id: I099e63069003fba788976a9470a909ccff51a88c Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit ceaa2959217752716496b6257595d12cbcb0c657)
2020-01-28FIX: dot1qip4vxlan testsPeter Mikus31-52/+80
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ieb6e6010108987f99f55730149e3e4b7f1a7fc21 (cherry picked from commit 97dbe2feecc6d592db7427c4f1a72c1ac31990d1)
2020-01-28Report: Add RC2 dataTibor Frank1-74/+59
Change-Id: I29dc3e34293d8bcc940e2adc3034e32b3806c71c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a4882cb1547e2abf424bb53f424439989fc3b6e7)
2020-01-28PAL: Add latency by percentile graphTibor Frank4-4/+245
Change-Id: I38c03e089fd709afc848ecec55474d5c6925a58e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6716e51e3a27cfd2850a399c9ccc2818c2038eaf)
2020-01-27Increase min_rate for NDRPDR testsVratko Polak1-2/+4
Latency measurements break for loads less than 9 kpps per direction. Setting min_rate to 90 kpps prevents 10% latency trial from breaking. 90 kpps should be enough for any type of test. When some test finds a lower value, this patch will make the fail with a message saying the loss rate at minimal load is too high (instead of a cryptic error from 10% measurement without this patch). Change-Id: I97b8428aa5044da23343b86447857b3a101f6baa Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit f7452e826cd83fc5ded28c1268f6f4aab252ca2d)
2020-01-27FIX: t29 yaml fileJan Gelety1-1/+1
Change-Id: I20e01457b492ddb9f23cc31f5eab8388f3ea2405 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit ae904eb12cde28fd21bf154fd300970fcfbe48eb)
2020-01-27Report: Add RC1 dataTibor Frank1-0/+21
Change-Id: I3d6d9c56456a12435096f7c61f744519279a850b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit cdb023e3eb911ad3367fccec8ba1a2935a18c7fd)
2020-01-27Report: Add RC1 dataTibor Frank1-7/+0
Change-Id: I7ebbabd1f56b892b6f88a6a183632cb11fc2bc3c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9afeffb373c05a5853cbfc5a61456c69af423d9e)