aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-09-24Reconf tests: Fix async measurementsVratko Polak4-17/+76
TRex does not zero the server counters. It copies the values to use as reference, and subtracts them when asked for results. But the reference is stored in the client (not the server). And CSIT uses different scripts to start and stop async traffic, which means different clients. This patch introduces a workaround. Async start will return xstats objects to use as reference, and async stop will use the objects to compute the correct results. The xstats objects are stored in TrafficGenerator instance. Sync measurement does not export the counters, to shorten logs. Other improvements: + Make stop_traffic_on_tg return measurement results directly. + Rename --async to --async_start as "async" is reserved in Python 3.7 + Minor pylint, docstring and typo fixes. Change-Id: I5fc56a0763afb7d62cfa7c0651f96b6867de3e15 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-19Use vpp 19.08.1-release buildsJan Gelety4-4/+4
Signed-off-by: Jan Gelety <jgelety@cisco.com> Change-Id: I3a35176e72e5805b39df03576c9d5b96a3875794
2019-09-18Report: Fix formating of static content for reconf testsTibor Frank1-9/+9
Change-Id: I5b93749b13af870955c1cf9eb8053c446356c329 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0608915e1a87f9a5f33e61c9c7cb93c98e9fc5ba)
2019-09-18Report: Add disclaimer for reconf testsTibor Frank8-9/+44
+ Improve description for reconf tests Change-Id: Ib1f397eda88a6c1db79b7a3a518584420770fd5c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2fc48e8d0a4712ec99dd2bb3a814ec9cb2bc12cf)
2019-09-17Report: Enable pdf versionTibor Frank1-2/+2
Change-Id: I2c88a8b5939cbe4498d5bc44de3618cb717a9a7f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 73cabdc86a0dd86755cfa921379fc3c63142ed6e)
2019-09-17Report: Fix Report HistoryTibor Frank1-1/+1
Change-Id: I654677ca9252e592e635eab28577bb3bb3b8bf85 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b61e34657e58cbe6c8476f6708d62168ffd80775)
2019-09-17Report: Update Report HistoryTibor Frank1-0/+2
Change-Id: Ie16a2f2298eeaf0793171c7268a95abb6986246a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2007221103d73be24c6d547ebaf6c86dd6dff1bf)
2019-09-17Report: Add methodology for reconf testsVratko Polak3-1/+79
Change-Id: I833d63f4e305ba60c94aa16cbb3a31a52ee3b3bb Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit abca97bfc198c4f947571462cc57732d187c3c20)
2019-09-15Report: Add dataTibor Frank2-0/+10
Change-Id: Ibef7599c5438624512d547af25b2026580e2bc92 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 48b37104e999ce75069672e5b901afeb06b9312b)
2019-09-13Report: FixesTibor Frank11-70/+70
Change-Id: Id14704f3c1526655adeaa51f0a4198b6309a64eb Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e2d15edc355f0c70df578dde0495f8ffd85d8c12)
2019-09-13Report: Add dataTibor Frank5-353/+464
Change-Id: I589a236919af913bb37d2db3b4079b16f1e64242 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 17220bfce36c723a3ca6fdd1ef757709ab50f4eb)
2019-09-12Report: Add nfv reconfTibor Frank1-13384/+13212
Change-Id: If773f5d05c845b0d15bd8f60a44a36adcbf65b82 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 8f03b515387df1ebb7e5a7231a287f7816e57726)
2019-09-12PAL: Add NFV reconf testsTibor Frank6-13521/+14021
Change-Id: I6fe36f05423c3c43081872153adf0f1a899381b6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5979e1020d4e41e08f1fe4e6d195a0a5bc020bb1)
2019-09-12Report: Temporarily remove pdf versionTibor Frank1-2/+2
Change-Id: Iab5909defc86ec31ba726eb2a1a4b6530cf7d63d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c77230ed462b0a79ca0200fabdba41b78e8d7923)
2019-09-12Report: Configure 1908.38Tibor Frank3-2/+5
Change-Id: I0239e6c567c50c211ddabffa4b1bf22cdcec6462 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e248c3fd06b4126b780eca85c5aae282cf872524)
2019-09-11Report: Remove NFV full dataTibor Frank1-2/+0
Change-Id: I51402892df91cfc5e8f2c18f18ef67bab634bcdf Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2fe2a2c140bffa10678e3e217c8a5cba0fd4dbd0)
2019-09-11Report: Add dataTibor Frank2-3/+7
Change-Id: I2092c6420a40e1c3199183e580f00eaca37706c6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 27cff25483728d50e0215b895c680fb88f6ffe99)
2019-09-11Report: Add pdf versionTibor Frank1-2/+2
Change-Id: I8897a6ef87b3813db0485fa081fdd44b4e501e41 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d44bf1d08991f9698b8d02d72ecbc88fbfff9515)
2019-09-10PAL: Add replacing of data in tablesTibor Frank20-606/+2039
+ vhost data Change-Id: I86fc97ba5c3b0feffec2dfb0ac11c5d3c9d53a81 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4dc7d6cc7b695c21ef1e37fa6b754958fc50e484)
2019-09-09Report: Report historyTibor Frank1-7/+4
Change-Id: Ib74a10ccd589111dd3c830adec9293ff2c698772 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit fa6124e5a9ce40348a4113b7da009e99d231d437)
2019-09-09Report: Add dnv mrr dataTibor Frank7-2/+210
Change-Id: I3dcc813dce7b8938be6b2caaaf1e64ce9abb7fe9 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 80fd7db87eb177b2369cd01716662c63a642a513)
2019-09-09Report: Fix tsh and dnv plotsTibor Frank3-318/+320
Change-Id: I1d40849bc15f4433117af91f71e951a61924d732 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 620774fdc9a0fa2703fcaa8e18915d65cb2b1ed3)
2019-09-09Report: Add soak testsTibor Frank4-114/+110
Change-Id: I2161c8d8e54cfa35cd3febdda1cb47d6cec424a0 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ba14f2b0ac026e537c79a61e800176b3404bde4d)
2019-09-06Report: Fix2 - Add 3n-dnv plots and tablesTibor Frank3-0/+3
Change-Id: Ia182e6e52a37f9b3248eab60ffe4dd4746ed7fa6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 81907979cdf2ca6ca991410e8151170deb380bc1)
2019-09-06docs: add select list of tests for report - tsh and dnvJan Gelety3-0/+191
Change-Id: I63a69d998c80029422bae9f90e186eb2286196d1 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit a3da59a916817208f69cb718d00a5017d0e5c0e2)
2019-09-06Report: Fix - Add 3n-dnv plots and tablesTibor Frank4-3/+36
Change-Id: I5f09f1f20e532e71d6abde02111a90f5868035f3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1c77031813057a50781784fc8e34019805d222b8)
2019-09-06Report: Add 3n-dnv plots and tablesTibor Frank25-40/+1969
Change-Id: I6b65231f928b6168e0696f35fc253ce513163e50 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1082d79a51e3caf60586e6176ee89ac3aadf04fc)
2019-09-05Report: Add 2n-dnv plots and tablesTibor Frank61-103/+1130
Change-Id: Ibbd1775bec26817a4c193bc67ba03b29b8ddfff7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 99219815466588419bd6705ff2ad8a9d9fc90dff)
2019-09-05Report: Add DNV dataTibor Frank3-327/+295
Change-Id: I020373b1553300459654ded31d940b0a5562eb8a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3eb09745cc7a936dc91a68a4a723867c2311f3a1)
2019-09-05Report: Fix listing order of new vs. see footnoteTibor Frank1-8/+56
Change-Id: I01426c3e4d40af0902e7776088e0489e141a2362 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4751baad9a204c27b0566e4faf00bf0b30f7e170)
2019-09-05Report: Fix hsw vs. skx comparison tableTibor Frank1-9/+9
Change-Id: Id16b161ad27102891a58d084185d17a2b8fcae6a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ac02e01bd4b0625e91a8eb3fa0f13f6f32f74527)
2019-09-05Report: Fix fonts in release notes tableTibor Frank1-2/+2
Change-Id: I4a3486c313c4aa4754c455389b8ebb363ead469a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1a330e122eba0526960a581b32c0d7031c72f394)
2019-09-05Report: Configure Report 1908.37Tibor Frank3-2/+16
Change-Id: I1d883dbb299ecef151c7d7a9c5612ae0330e3538 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d7813d33fef48421377c7eb6f24cd3998d8b0594)
2019-09-05FIX: Use vhost macs when testpmd_mac forwarding used in VMJan Gelety5-15/+73
Change-Id: I291c3dc852e7c1bde6fb6102a9168cfec9992682 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 474034ac24ce89cdaa94a09ae4d9ebbd3fb0f219)
2019-09-04docs: report vpp performance rls notes update.Maciek Konstantynowicz1-24/+68
Change-Id: Ie4a7a80cad9ff92b9f30953096cca8a029edc687 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 1abf61ca0224226e3f39ac491b2b84e49ac6092f)
2019-09-04Report methodology: PLRsearch update with graphsVratko Polak3-20198/+9391
Change-Id: Ib73a64c93bdba3945b8237783a24134b47d4eb99 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 55a8e9aa3a8583b46192ffdad9ef7265fa63d537)
2019-09-04docs: report packet_throughput_graphs text formatting fixes.Maciek Konstantynowicz1-11/+32
Change-Id: Ibea6e70e2fcf9cfeb7627ee1cbcfa6e177c0b2c6 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 32605fc1b4ff207776b6ff3f6a1975f77d8e4629)
2019-09-04Doc: Report release notes (perf)Peter Mikus1-0/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I8c1667efec67febd375818bc1dfe1d9bebc70708 (cherry picked from commit b8ae239848d484cd0660fe406ae2c4a34c0551e0)
2019-09-04docs: added methodology terminology section to report.Maciek Konstantynowicz2-0/+79
Change-Id: Id787d12b577165a1081dba84b610c32df57a7c44 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 622726926fc12522e439455ade436f6dfcc0da06)
2019-09-04docs: report updates in physical_testbeds section.Maciek Konstantynowicz1-86/+163
Change-Id: Id31e6ed294dc80619a108296be580925509bb7d7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit a10342c5b6d989f64bd1fe49f0edd0c7585e54ea)
2019-09-04docs: updated report intro in packet_throughput_graphsMaciek Konstantynowicz1-5/+68
Change-Id: I3bf70cc7e48ef2134841bc4bf9300cda6a118cb3 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 6898a7671b00c5e5c48c58fdfaeb47bb7148d4bb)
2019-09-04docs: added 3n-tsh testbed tests to report_test_groups.txtMaciek Konstantynowicz1-6/+42
Change-Id: Ib2249ce6c28f4c07878eb5fc2919c56dd8637376 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 7d7d7ff65943fa370c515c5d350b141a0515a074)
2019-09-04Report: ixgbe for tshTibor Frank35-806/+834
Change-Id: I707a654b8853926f4cb1b78f3c65b55925e95ac1 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d53a4da7e088fa8330e851cee3c6309ef13c8360)
2019-09-04Report: Add dataTibor Frank2-162/+50
Change-Id: I6a32e0bdd1a693550214e7bea49b76313449f24d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4be26a2f7f0cf0539e198864d69bd34bd278dda4)
2019-09-03Report: Comparison tablesTibor Frank1-10/+14
Change-Id: I108e1292c5de8024060c220b877b668b8843c68f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6a5bc78e5fca4f43619c9199ef05ecbe2bc5d356)
2019-09-03Report: Comparison tablesTibor Frank1-6/+6
Change-Id: I90f635f62573154e37a319ca1cbb760401d17c05 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 92d09115493a50599ed5bea9126be28229b4211f)
2019-09-03Report: Comparison tablesTibor Frank2-62/+98
Change-Id: Ib4132c4d25f6a7c936793f403877a5819a6dd55a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ac688f80adb649bd04ecbe1daa79748a439a9e19)
2019-09-03Report: add dataTibor Frank2-45/+208
Change-Id: I51fd0b9e07d09224452f842689925d1166246f19 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 54b25e85bf3efd1709043ded2d6a525fa0c73962)
2019-09-03CSIT-1590: Performance comparison analysisTibor Frank1-4/+6
Change-Id: I802b5b9cbeb486587f395aeca76cbe3df68b40c4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 259620ea6ca1c5864d4864f0f04d260e89ecb72a)
2019-09-03CSIT-1590: Performance comparison analysisTibor Frank2-77/+81
Change-Id: I09d502fcd7b286e41b141e43933bcf09262a8749 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3e5dbfab796da168865ba787382224b1b04b83a4)