aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-10-24FIX: Start T-Rex with sudorls1904Jan Gelety1-5/+5
The reason is that later there was introduced change and T-Rex is started with sudo. Without this change the T-Rex cannot be started under csit 19.04 branch. Change-Id: Ia111d14bf5af4483d825f5433712a3865e5a9a48 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-07-22Increase reliability of per patch perf jobVratko Polak2-30/+49
CSIT-1485 - Measurement results are inconsistent, creating false positives. - To avoid false positives, sensitivity has to be lowered. + Measurements are no more interleaved. + Measurement result are no longer filtered. + The job now runs faster. - Ip6base regressions smaller than 4% are tolerated. + Ip6base false positives can happen, but less than 10% of the time. - Part of job parameters is set on ci-management level. + Voter script output is improved. Change-Id: I0ec7d5df8b397daf7ff0277a1137ee9f36d8d866 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-17Add backward compatibility for kernel vm imagejuraj.linkes1-1/+1
https://gerrit.fd.io/r/#/c/20577/ replaced kvm kernel with custom build of generic kernel, which would be picked up with '/opt/boot/vmlinuz*' wildcard and which wouldn't work with this code. Fix this by adding '-kvm' to the wildcard so that the kvm image is used with this code. Change-Id: I9e9d978ad7c980d74f88f761b884eca599dee454 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-06-17CSIT-1488: Add data to the Report 1904Tibor Frank1-2/+2
Change-Id: Ieb6537c1e1c1b7e0ca4f7ec490a9f0bd379030e9 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b5e271f31768c06fb35e77ab7f10e43d114bbac2)
2019-06-17Report 1904: Configure rls 1904.25Tibor Frank3-2/+7
Change-Id: I44bfc2247d4d2def131d89e1d97d8cad7522ccd1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-12CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+2
Change-Id: If0e75e4bb4623eea913d433affa42a6bb03454b8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 79cd32123c26e91e12f59f0c25faa3c5465eb0c0)
2019-06-10CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+4
Change-Id: Ia75675d6e89902c3370feaa2e8eb468cdd0fdba1 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2c6e0991f266b1cc08fe69ab4ff051e11b0c1afc)
2019-06-10Report: Configure report 1904.24Tibor Frank3-2/+7
Change-Id: I4d6d913f0139fe0fab00668ec16081c04cc6bc0e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-05CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+2
Change-Id: I54b2f02745497ea4cd90d485834b1aa42389f57d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 060fbf1805a02ec546b238867250d2f19782da55)
2019-06-04CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+4
Change-Id: I8609ecd45a634fccf3e721beac5a0ec640f704db Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ee7c9ed2829ff45151934c2558a93de40b4cf608)
2019-06-03CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+2
Change-Id: I514dbd61dc22736fb3925d6d3cec767d0f4f84a8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1c0948c3615cbb32be51716da1978e609371dc48)
2019-06-03Report: Configure Report 1904.23Tibor Frank3-2/+7
Change-Id: I0f19d4e3bdafbdf1a435436a2f25945c2b45e06e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-28CSIT-1488: Add data to the Report 1904Tibor Frank1-6/+6
- remove 'NIC_Cisco-VIC-1385' and '9000B' from vpp perf full Change-Id: Ic3d6a035945eddf6a5f5c73a62ca872a59c18b46 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 09877682a9a10d6d3a94c4c63bd05424ec95293c)
2019-05-27FIX: do not generate 9000B perf test in case of vic1385 nicJan Gelety1-0/+3
Change-Id: I7b8e30903a8bc012a3bb43bfb33755e08b56dc1d Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 1fea09e6c0634ea7f02f9b94883a8261ff3769b1)
2019-05-27CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+4
Change-Id: If23ed1d2a8b716a2c145a8b13ebc91c9925284d8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0a244598ba87a339fd7590f2e42dcc507e9a098c)
2019-05-24Report: Configure Report 1904.22Tibor Frank3-9/+14
Change-Id: Ic8d5a9a856658a2a2661cae8abd8d3b1127b4ff8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 260238857d4b9f3aabb474bd78dfeff0e4a37fbc)
2019-05-24CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+2
Change-Id: I23224cba405ad905b65799682f59de126d88bc2b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 66aba4cf89feb73f5b2e6ba89041dcd835fc3c84)
2019-05-22Report: Update report historyTibor Frank1-0/+5
Change-Id: I790f5d658472d087cd33b6a08a55620e3e5906e3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c7726da44e7ab1cb7d1b1083e02ba54a98ca7b42)
2019-05-22Report: Fix missing func and vpp_device dataTibor Frank1-2/+2
Change-Id: Id21e52262904baa9a940e5680a413a1f5ae06b8b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 24b2f2f282e4ad2daabebea6baef8b569a9656bc)
2019-05-22CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+2
Change-Id: I3af37de91450a4ac11eb6e6e8cd271de41e985bf Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c6cd03e08d9429168b0e183b8dcbce991112f279)
2019-05-21CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+2
Change-Id: I6c6f478a0dc54a10e4b7568dc86aa883e896e28a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3037096794d81ce0e9c4e696b817ca5f21753bf1)
2019-05-20FIX2: VTS cpu listJan Gelety3-3/+3
Change-Id: Ibd0f719585d6482a65ae6cea516a4da017281ef5 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 383da9e809ac61fcf79167bea4826318490cdb2b)
2019-05-20FIX: VTS cpu listJan Gelety3-9/+9
Change-Id: Ic3ac22642e443f30a46914c18cd9a9b54064286b Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 131215060166cb18c4fc4c7168fd3d51ce552998)
2019-05-20Report: Remove (IPSECHW and x520) tests from reportTibor Frank1-6/+6
Change-Id: I1481cd889aab7cc1f8d6b7c3a3cd5e96e955bb8a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2c9d0ff82b8fa197fcd0cb4223a3d5f18e7a24c2)
2019-05-20CSIT-1488: Add data to the Report 1904Tibor Frank1-8/+4
Change-Id: I632ed9e00feb26b734f86bfe75dca9e14ac57f0c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4522d56d507ad9bfc139e15e40577d48c5cbf27d)
2019-05-17Report: Fix internal links to PLRsearch methodologyVratko Polak3-3/+3
Change-Id: I87b334e9c89b1469112dac4327faaf430c6f846a Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit b297d7fca14caa89c24ff3e34cbe58f40aba7c88)
2019-05-17Report: table_soak_vs_ndrTibor Frank1-3/+4
Change-Id: Ia313fb43c315990212501b4139f3f1f7bc9d67f5 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7960d8258471725aa9eee40101abf4030b3bb5e1)
2019-05-17Trending: Reduce input dataTibor Frank2-45/+93
Change-Id: Ib540a687a0b8b27584f6d8c571cfd453122f0f91 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 89657c4198cf3c35fa9f594228f3902f0ee90298)
2019-05-17CSIT-1488: Add data to the Report 1904Tibor Frank1-8/+27
Change-Id: Ic693d6750007727b6e773e17f8f2fba2f96c2c86 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0ca4a9ec1a8fc53a679b1c635a6e1b6afae0299d)
2019-05-17Report soak comparison: Add stdev for deltaVratko Polak2-3/+36
Change-Id: Ibbff3c123afac2e68caf33f3ccd5fc4909509917 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 081c29c91b7e5f78345cfdefd75625b27b5b4812)
2019-05-16Tests: Add IPSEC SW scale testsTibor Frank4-0/+648
Change-Id: I4339059a0cf67acce668abe42aab59bbb17916d9 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5a6c1a5a75c76e8e63f799f5c758567c1dd75b4f)
2019-05-16FIX: IPsec selection backend. Peter Mikus1-1/+1
Change-Id: Iba6f2beb4075f6dd317b0eeb32a1d0466ae9524c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-16Improve soak graphs and contentVratko Polak3-21/+23
+ Fix duration, mention number of tests and runs. - Hover information still feels wrong. + Mention "critical rate" instead of "throughput" where possible. + Mention lower bounds are displayed. + Rename "plrsearch_algorithm" label to "PLRsearch". + Because the previous link did not work. Due to underscore? + Rename "SOAK" to "soak" or "Soak" (except when it is a tag). Change-Id: I9c079f8c2e93d96249d4b60893469c9257d4f3db Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 9a6b6ed77705147032abee3fc98a2f7d370427c0)
2019-05-16CSIT-1488: Add data to the Report 1904Tibor Frank2-2/+13
Change-Id: I7484eeb872cd8fa736421a0ded2fcfffe733051e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b659ab3d2638652de0357d29be1ec7704df97555)
2019-05-16Report: Configure 1904.21Tibor Frank3-2/+5
Change-Id: Ib65580067d9c41137293036bbd786e31c2bdf503 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c653499009183a8431350733df81c4162406f3ab)
2019-05-15Report: Add pdf versionTibor Frank2-9/+11
Change-Id: Idc6936262a968e213f2fafa52adacfee65ad345c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 619cbff63ab7570bb904acccd627d65f328a1e9a)
2019-05-15PLRsearch methodology: Add graphs with descriptions.Vratko Polak5-6976/+22451
Change-Id: I1acb74c6edb966dcdbbdaf88c05bfde1192bf74b Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit c29fa202d2ce4e4c28c41ab4b6ba2353acf42c92)
2019-05-15CSIT-1504: Soak tests - graphTibor Frank2-2/+2
Change-Id: I1e39a995565cbda2184378268e2da2b465b147cd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c69a9c629cdc4a8021fd048922826af907e13a05)
2019-05-15Report: update known perf issuesJan Gelety1-0/+6
Change-Id: I83863b6a32a1f4d079e126458ba50a358e8de447 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit d6756e397a108f971622890b5132cc29ff9e5f65)
2019-05-15Fix teardown keyword for wrk testVratko Polak1-1/+1
Change-Id: Ib0a86cdb250f4eb7a5a08d205c0b17c7bf9fd851 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit eb8de8ecc03b0141dffc2ae13329a7687c5e9401)
2019-05-15CSIT-1504: Soak tests - graphTibor Frank1-2/+7
Change-Id: If31eb363680a3cd81c38f078c9ad28a569d321da Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 8d3e946d85e53469cbffcdbe18a9878f4687a059)
2019-05-15CSIT-1504: Soak tests - box plotsTibor Frank1-0/+3
Change-Id: I29a25dad1fee07c0a387dc985718eae858abb2f4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1cdffc39203589d5da2588927760762129ce2976)
2019-05-15CSIT-1504: Soak tests - box plotsTibor Frank1-0/+8
Change-Id: Id066787f4445b675ef0691a405d0f403b45d6fc2 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6d4268a223982256d6c4ebc9be54f43664f42875)
2019-05-15Report: clean-up ipsec testsTibor Frank1-28/+4
Change-Id: I3fd52fdeccc73332a85f695442cbe86fcf94b489 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 75fc33f31bc71418107bc0932a22b3b31b041528)
2019-05-15Trending: Add IPSECSWTibor Frank5-5/+78
Change-Id: I5437d46759c3fcf9a8f44d02d43a70f3f3b2635d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5ec0a299c5f9ad2f4843478db69bc6bbc697b0a2)
2019-05-15CSIT-1504: Soak tests - box plotsTibor Frank3-19/+18
- table: stdev, round deltas to 2 dec places Change-Id: I29cd1f7c9ba8ef73a8281d42ac9f6a06ed30bbdf Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit fce7b4b339f7a79b80143bbd796460720489d694)
2019-05-14Add new higher density NF testsPeter Mikus19-3/+2048
Change-Id: Ib2f3f3f8dc3e202dc1db53c739d9309be2ed8a60 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 1ac36a9fd34043609b81901f2de37deb0a113ea5)
2019-05-14CSIT-1504: Soak tests - graphTibor Frank4-37/+55
Change-Id: I8416e28a27c16da76c0ebb94f847539f662229fa Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0c0cf8698e0852e87feaff3a312916cce68fc482)
2019-05-14Report: Remove CFS_OPT from 2n/3n-skx ndrpdr fullTibor Frank1-12/+12
Change-Id: If82e9c19e9d2035e62c7e455458ebdef20659adb Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6cdd959d5e28e9ec4e8f0f71a1459a02a9362c89)
2019-05-14CSIT-1500: Add comparison table for SOAK vs NDRPDRTibor Frank2-73/+44
- clean-up Change-Id: I020837a89415fdb891ffbb094c9a5edf50946dd2 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6f0d055b4bd4a6cbd4d60d9f4ce422c996ebd153)