aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools
AgeCommit message (Collapse)AuthorFilesLines
2019-09-09Report: Fix tsh and dnv plotsTibor Frank1-317/+317
Change-Id: I1d40849bc15f4433117af91f71e951a61924d732 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 620774fdc9a0fa2703fcaa8e18915d65cb2b1ed3)
2019-09-09Report: Add soak testsTibor Frank1-108/+107
Change-Id: I2161c8d8e54cfa35cd3febdda1cb47d6cec424a0 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ba14f2b0ac026e537c79a61e800176b3404bde4d)
2019-09-06Report: Add 3n-dnv plots and tablesTibor Frank1-40/+587
Change-Id: I6b65231f928b6168e0696f35fc253ce513163e50 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1082d79a51e3caf60586e6176ee89ac3aadf04fc)
2019-09-05Report: Add 2n-dnv plots and tablesTibor Frank1-19/+304
Change-Id: Ibbd1775bec26817a4c193bc67ba03b29b8ddfff7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 99219815466588419bd6705ff2ad8a9d9fc90dff)
2019-09-05Report: Add DNV dataTibor Frank3-327/+295
Change-Id: I020373b1553300459654ded31d940b0a5562eb8a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3eb09745cc7a936dc91a68a4a723867c2311f3a1)
2019-09-05Report: Fix listing order of new vs. see footnoteTibor Frank1-8/+56
Change-Id: I01426c3e4d40af0902e7776088e0489e141a2362 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4751baad9a204c27b0566e4faf00bf0b30f7e170)
2019-09-05Report: Fix hsw vs. skx comparison tableTibor Frank1-9/+9
Change-Id: Id16b161ad27102891a58d084185d17a2b8fcae6a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ac02e01bd4b0625e91a8eb3fa0f13f6f32f74527)
2019-09-05Report: Configure Report 1908.37Tibor Frank2-2/+4
Change-Id: I1d883dbb299ecef151c7d7a9c5612ae0330e3538 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d7813d33fef48421377c7eb6f24cd3998d8b0594)
2019-09-04docs: added 3n-tsh testbed tests to report_test_groups.txtMaciek Konstantynowicz1-6/+42
Change-Id: Ib2249ce6c28f4c07878eb5fc2919c56dd8637376 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 7d7d7ff65943fa370c515c5d350b141a0515a074)
2019-09-04Report: ixgbe for tshTibor Frank1-313/+313
Change-Id: I707a654b8853926f4cb1b78f3c65b55925e95ac1 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d53a4da7e088fa8330e851cee3c6309ef13c8360)
2019-09-04Report: Add dataTibor Frank2-162/+50
Change-Id: I6a32e0bdd1a693550214e7bea49b76313449f24d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4be26a2f7f0cf0539e198864d69bd34bd278dda4)
2019-09-03Report: Comparison tablesTibor Frank1-10/+14
Change-Id: I108e1292c5de8024060c220b877b668b8843c68f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6a5bc78e5fca4f43619c9199ef05ecbe2bc5d356)
2019-09-03Report: Comparison tablesTibor Frank1-6/+6
Change-Id: I90f635f62573154e37a319ca1cbb760401d17c05 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 92d09115493a50599ed5bea9126be28229b4211f)
2019-09-03Report: Comparison tablesTibor Frank2-62/+98
Change-Id: Ib4132c4d25f6a7c936793f403877a5819a6dd55a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ac688f80adb649bd04ecbe1daa79748a439a9e19)
2019-09-03Report: add dataTibor Frank2-45/+208
Change-Id: I51fd0b9e07d09224452f842689925d1166246f19 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 54b25e85bf3efd1709043ded2d6a525fa0c73962)
2019-09-03CSIT-1590: Performance comparison analysisTibor Frank1-4/+6
Change-Id: I802b5b9cbeb486587f395aeca76cbe3df68b40c4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 259620ea6ca1c5864d4864f0f04d260e89ecb72a)
2019-09-03CSIT-1590: Performance comparison analysisTibor Frank2-77/+81
Change-Id: I09d502fcd7b286e41b141e43933bcf09262a8749 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3e5dbfab796da168865ba787382224b1b04b83a4)
2019-09-02PAL: list all sel tests in table_performance_comparisonTibor Frank1-3/+17
Change-Id: I99ccbca3e56a58a662c569d195ecdef20d3ea348 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ff3201774cf904bad6c64adf11f1fae92d5f8588)
2019-09-02PAL: list all sel tests in table_performance_comparison_nicTibor Frank2-51/+18
Change-Id: I21bb76aab4a1e627a13057f896ea7bfc34c03463 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0a67083bea6b5e740c89fcc6c9143e0f035eadd1)
2019-09-02Report: Add dataTibor Frank1-667/+657
Change-Id: If799a7a1d1b8f6ea59ebfba3dd4724b09e7680f2 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6d981f513fba8cbec434f5c10f83081034372f20)
2019-09-02Report: functional tests static contentJan Gelety1-2/+2
Change-Id: I17238ff6d1760f6a956459e072ba0303abef3199 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 97881b4e0142f98bbb8e1d54828bbc3c1b34d4ac)
2019-09-02Report: Add 3n-tshTibor Frank2-126/+1512
Change-Id: I6027b635191c7e64397915df8944699bb320daf3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a7886e481f492d996643fad5ab48944f1cd4f725)
2019-08-30Report: Add dataTibor Frank1-0/+28
Change-Id: Ie9350530879fef7d2ae8c0b58f6fd799fde9fff8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 603931f00dab6e4375f1ca9dff9f5877c7ed5135)
2019-08-29presentation: fixed suite names 10ge>25ge, 10ge>40ge based on nic model.Maciek Konstantynowicz1-229/+229
Change-Id: I90dd569ce42fe6bf29751ca29086fe458d40a095 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 25827ae5d147343408da1eb1e74bef3e2c1a8812)
2019-08-28Report: Add dataTibor Frank1-0/+28
Change-Id: I5ae5fa7cb40ddc31e3fe3fd0d6182bf54c84ad00 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a907de589b3f49368b81394b4faf6f4202c1f404)
2019-08-28Report: Add dataJan Gelety1-7/+44
Change-Id: I66c91e083138b50a575cbbd32d309d0c198e6a71 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit f18bab9daaa9ac4108cc7bc04213db9051c96567)
2019-08-27Report: Add dataTibor Frank1-0/+13
Change-Id: I534cbb4141b60609387f894e51c429e368520a23 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 823e79aca6d19531f3abb080ab6510418f6af94d)
2019-08-26Report: tablesTibor Frank1-3/+3
Change-Id: Ideec743ae10909d91625ea5cfc7901624459f455 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 479b30c17e28e30b7c2e01e616e96b67d6ac1779)
2019-08-26Report: NFVTibor Frank1-108/+108
Change-Id: Idf369766cb9acf82475b1d86860d72077b88dc35 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 320f82cc987dbc6d9c4ab1632de1005ac4c0077f)
2019-08-26Report: TablesTibor Frank2-37/+304
Change-Id: I5084163758c5f15f482c6c8e08ee70c4a4f50431 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit af4d3ba04cddbfb198af47b2d1d74c0655e35a08)
2019-08-26Report: Modify comparison tables, add dataTibor Frank1-1159/+1007
Change-Id: I6d5e7cc0618a5b1889ab54c020fd98c661d20989 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit db49a120f90f59f5277a5c812544ea0ad1592eb8)
2019-08-26Report: Select tests by name, specificationsTibor Frank2-18533/+3243
Change-Id: Ibcc5e67d49fba9c02b07af462a74d2a062412979 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 33cfe1217cb2d6bc9655b01f200b0ec8d5ccb466)
2019-08-23Introduce reconfig suites, for dot1q+ip4+vxlanVratko Polak1-13/+26
Ticket: CSIT-1551 + Config copied from other suites. + Layer keywords prepared for additional chains. + Renamed "create" argument to "vlan_per_chain". + TrafficGenerator result extraction improvements. + Also unified TG type and subtype checking. + Throughput estimated as PDR for zero PLR. + Actual Qemu start is skipped. + Parse xstats instead of stats in trex stop scipt. - Because stats are unconditionally cleared on each script connect. + Remember start values to get better ReceiveMeasurementResult at stop. + Expose loss count and time as appropriate test message. + Autogen support. + Multiple chain amounts and core densities. - Only 1 additional chain. + Proper TAGs. Documented. + Clarified min framesize tags are for TG-DUT. + Added a TODO concerning overhead values. + Added 118B tag. + Robot performance keywords improvements. + Added missing return value documentation. + Frame size as required test variable, not an explicit argument. + MLRsearch keyword to store result (not into test message). - TODO: De-duplicate: main keyword to measure, minor to set test message. - But implementation uses the fact default arguments are different. + Keywords for starting and stopping background traffic. - No checks whether start-stop pair is complete. + Multiple minor indentation and logging improvements. - Missing / TODOs: - Support also vlan_per_chain=True? - Support dot1q without vxlan? - Support also deletion? - How to package config steps so -reconf can be generated from -ndrpdr? Change-Id: If0270697f9ffa837c34ef802917220a53f156703 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit ff820e3d53434889aacde2373314c3be8d00f765)
2019-08-23Report: Specify groups of tests for graphsTibor Frank1-0/+432
Groups of tests for graphs: - Packet Throughput - Packet Latency - Speedup Multi-Core Change-Id: Ib37c1231abb63c234fb1e98d059bb3338133da0c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 719a84662ad1482f09224543c07053d27d7b94ea)
2019-08-19PAL: Select tests by name, functionsTibor Frank3-0/+751
- throughput - latency - speedup Change-Id: Ia8b33815f5bbb7b0fb50b23e7655068928733832 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 144ebec26ff0a32000283eddfac393e497e01164)
2019-08-19Report: Add dataTibor Frank1-28/+130
- DPDK Change-Id: Ibc45c49e34b2b0abe0f0a9f3304ee478c174c01e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 42c64b70e6cdc0ba1466ca0919d5d0377f4c227d)
2019-08-19PAL: Get DPDK version from output_info.xmlTibor Frank1-2/+2
Change-Id: I922c8143df39025cc0a78047f3cef7b9f5673b4b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 039a71a97592cfb864dff8fc56ec04b33f8f92bb)
2019-08-16PAL: Process show runtime output 3Tibor Frank1-2/+4
- format the table Change-Id: I871251a8329e5d52c527c93afe35d875bddaed0c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 859a3f724c077f9db9a2f40f76b6dad27f199003)
2019-08-16PAL: Process show runtime output 2Tibor Frank1-3/+2
- format the tables Change-Id: I31f786d53b79fa14c5d2dc21ff65d0465fde1d4f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7da9d215fc0867e19160d38b0096e58c78381bf8)
2019-08-15PAL: Process show runtime outputTibor Frank1-5/+42
Change-Id: If7eac41cd33837eea7291f87129e2c176fbe6aea Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3e58c2f916288c5ed22ce11f01fa56a4d19689d2)
2019-08-15VAT-to-PAPI: Fix HTTP/TCP testsDave Wallace2-4/+4
Change-Id: Ie728bc73eb7429d246e82dd195fc63191c3ac51d Signed-off-by: Dave Wallace <dwallacelf@gmail.com> (cherry picked from commit 6da7266754c28754c04cf37d1974e39766a261f6)
2019-08-14Move: WRK installation into ansiblePeter Mikus8-83/+70
- Remove ability to install from framework. - Control via ansible with other dependencies. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I5fd0ca18b4f76c30b6c28b4dcd15e538e01cb315 (cherry picked from commit 37a9451377f7239365b5af778b8072d1585a2d2a)
2019-08-14Report: Add dataTibor Frank1-4/+12
- Dry runs - fix table 'VPP Soak vs NDR 2n-skx' Change-Id: I1fb101ab1b7cc40de49e8bb564818a730d3853a4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b0592824b3b8394f25577481533c406145136dcf)
2019-08-14Report: Add dataTibor Frank1-319/+99
- Dry runs Change-Id: Ib6e50853b5b4638dc0f4bc93a98b3818f5079658 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 72614c322675f63958ca668404f081d738660e42)
2019-08-14PAL: Archiving of input dataTibor Frank1-8/+24
Change-Id: I0902613047d7543378a4b7d46811fc67776c6ad9 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9e476b274acf41b5ac358bc4dba3a0f1e16f04b2)
2019-08-13Report: Download first from logs.fd.ioTibor Frank4-161/+150
Change-Id: I308d7a7f72e0ea2e23b96be7db1ba35920bae519 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit cd2a57aba61553f36c638dc6e8d949e1739fb6bf)
2019-08-13PAL: Get DPDK VersionTibor Frank1-5/+4
- Needed for trending Change-Id: I3d576e39d6e3b91821050fbd4a8a95380275797b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9e1bb28404a23f6d4c62fb945a3ee6dba42f1c47)
2019-08-13PAL: Get TG IP address from output_info.xmlTibor Frank1-7/+5
Change-Id: I566c0e436fbe50e5e72da35be6a2afc81e8a33b6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b763901692e207a8f07386bb3bcba254cdeaa790)
2019-08-12Report: dataTibor Frank1-1/+1
Change-Id: Id51e073d23d7bb54864eb5fd1c3c320077e6abb8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f187d0b4f9cfa3b980a94b1f56e828b183367c15)
2019-08-12Report: DataTibor Frank1-274/+219
Change-Id: Ibd1a5dc6e451d992eb85b223973734c876e37fe7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f7037acce33b11dbbbb87ad079750525e6b95eb4)