aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-09-03CSIT-1590: Performance comparison analysisTibor Frank2-77/+81
Change-Id: I09d502fcd7b286e41b141e43933bcf09262a8749 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3e5dbfab796da168865ba787382224b1b04b83a4)
2019-09-02PAL: list all sel tests in table_performance_comparisonTibor Frank1-3/+17
Change-Id: I99ccbca3e56a58a662c569d195ecdef20d3ea348 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ff3201774cf904bad6c64adf11f1fae92d5f8588)
2019-09-02PAL: list all sel tests in table_performance_comparison_nicTibor Frank2-51/+18
Change-Id: I21bb76aab4a1e627a13057f896ea7bfc34c03463 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0a67083bea6b5e740c89fcc6c9143e0f035eadd1)
2019-09-02Report: Add dataTibor Frank4-946/+933
Change-Id: If799a7a1d1b8f6ea59ebfba3dd4724b09e7680f2 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6d981f513fba8cbec434f5c10f83081034372f20)
2019-09-02Add: Testpmd VM testPeter Mikus28-36/+2033
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Id39667515e304f4d92f230f82d3f1dbc1e22ac32 (cherry picked from commit 8beb22fb0a13ccc69281bb4a68b62a733d1f20e2)
2019-09-02Report: functional tests static contentJan Gelety3-99/+72
Change-Id: I17238ff6d1760f6a956459e072ba0303abef3199 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 97881b4e0142f98bbb8e1d54828bbc3c1b34d4ac)
2019-09-02Report: Add 3n-tshTibor Frank69-188/+4912
Change-Id: I6027b635191c7e64397915df8944699bb320daf3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a7886e481f492d996643fad5ab48944f1cd4f725)
2019-08-30Report: Add dataTibor Frank1-0/+28
Change-Id: Ie9350530879fef7d2ae8c0b58f6fd799fde9fff8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 603931f00dab6e4375f1ca9dff9f5877c7ed5135)
2019-08-29presentation: fixed suite names 10ge>25ge, 10ge>40ge based on nic model.Maciek Konstantynowicz1-229/+229
Change-Id: I90dd569ce42fe6bf29751ca29086fe458d40a095 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 25827ae5d147343408da1eb1e74bef3e2c1a8812)
2019-08-28Report: Add dataTibor Frank1-0/+28
Change-Id: I5ae5fa7cb40ddc31e3fe3fd0d6182bf54c84ad00 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a907de589b3f49368b81394b4faf6f4202c1f404)
2019-08-28Report: Add dataJan Gelety1-7/+44
Change-Id: I66c91e083138b50a575cbbd32d309d0c198e6a71 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit f18bab9daaa9ac4108cc7bc04213db9051c96567)
2019-08-28docs: created full list of tests for report detailed results.Maciek Konstantynowicz3-0/+673
Change-Id: I82d298399b5899736c8e5ebb7204dbbddace79f4 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 97ff6490bbd4656e15422576556aeba8aa799345)
2019-08-28docs: created select list of tests for report and trending.Maciek Konstantynowicz3-0/+335
Change-Id: I2ad255c35490e52d9a55e24e64539549e6bdd36b Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 218572c4932c47f08cb0b64b5e493ac939ce73ae)
2019-08-28NEW: Added trex profiles for 60k ip4 destinations.Ludovit Mikula4-0/+412
Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech> Change-Id: Ib9e42914ad5ab6bf0febea3edbeea8d09c8918b1 (cherry picked from commit e895f7fad03c2d805c3b16ee490b51cb304f49c0)
2019-08-28DOC: 1908rls release notes for VPP Hoststack TCP performance tests.Dave Wallace1-0/+4
Change-Id: I56d0519b5cbdfb8a60aab85a9a4d721fdfe022ce Signed-off-by: Dave Wallace <dwallacelf@gmail.com> (cherry picked from commit f4952736d2f356cd3423c55891e133536ddc9552)
2019-08-27docs: added csit tests job specs.Maciek Konstantynowicz1-0/+141
Change-Id: I271b1c700f72204dcf03bee6f2cd30b25ca5663e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit a0465dc55b2f7edfa86e7803704bdb1415fd2b8e)
2019-08-27Report: Add dataTibor Frank1-0/+13
Change-Id: I534cbb4141b60609387f894e51c429e368520a23 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 823e79aca6d19531f3abb080ab6510418f6af94d)
2019-08-27- Removed 9000B test cases from ipsec test suites.Ludovit Mikula97-780/+3196
- Added new traffic profiles. Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech> Change-Id: Ie06b7a1cf4d9df403d098b7a495219fd95e5869e (cherry picked from commit ac37499ef8754d7ac8f6350ab80d389727bbcd03)
2019-08-26Report: Comp TablesTibor Frank1-30/+30
Change-Id: I2cedef4dc274dc45ebc82911d53f3d5d14ffa381 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7186f868f6fd24f8727e088301c4411c2a8e8a8c)
2019-08-26Report: tablesTibor Frank1-3/+3
Change-Id: Ideec743ae10909d91625ea5cfc7901624459f455 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 479b30c17e28e30b7c2e01e616e96b67d6ac1779)
2019-08-26Report: NFVTibor Frank7-297/+293
Change-Id: Idf369766cb9acf82475b1d86860d72077b88dc35 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 320f82cc987dbc6d9c4ab1632de1005ac4c0077f)
2019-08-26Report: TablesTibor Frank2-37/+304
Change-Id: I5084163758c5f15f482c6c8e08ee70c4a4f50431 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit af4d3ba04cddbfb198af47b2d1d74c0655e35a08)
2019-08-26Report: Modify comparison tables, add dataTibor Frank9-1481/+1298
Change-Id: I6d5e7cc0618a5b1889ab54c020fd98c661d20989 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit db49a120f90f59f5277a5c812544ea0ad1592eb8)
2019-08-26FIX: Copy-paste typo in ↵Jan Gelety1-1/+1
2n-10ge2p1x710-eth-l2bd-6ch-48vh-24vm1t-vppip4-ndrpdr.robot Change-Id: Ibe231547e26d9b379554eec8ca6a9b4d7bc1224b Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit d8271912d325ca9d4dc57f0d667c26b51f70e2fd)
2019-08-26Report: Select tests by name, specificationsTibor Frank184-32279/+8271
Change-Id: Ibcc5e67d49fba9c02b07af462a74d2a062412979 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 33cfe1217cb2d6bc9655b01f200b0ec8d5ccb466)
2019-08-25Oper: TB31 back in operationJan Gelety1-0/+0
Signed-off-by: Jan Gelety <jgelety@cisco.com> Change-Id: I8a65efa632bfb095cd9ed8716ea2496288a88d0d
2019-08-23Introduce reconfig suites, for dot1q+ip4+vxlanVratko Polak33-187/+2392
Ticket: CSIT-1551 + Config copied from other suites. + Layer keywords prepared for additional chains. + Renamed "create" argument to "vlan_per_chain". + TrafficGenerator result extraction improvements. + Also unified TG type and subtype checking. + Throughput estimated as PDR for zero PLR. + Actual Qemu start is skipped. + Parse xstats instead of stats in trex stop scipt. - Because stats are unconditionally cleared on each script connect. + Remember start values to get better ReceiveMeasurementResult at stop. + Expose loss count and time as appropriate test message. + Autogen support. + Multiple chain amounts and core densities. - Only 1 additional chain. + Proper TAGs. Documented. + Clarified min framesize tags are for TG-DUT. + Added a TODO concerning overhead values. + Added 118B tag. + Robot performance keywords improvements. + Added missing return value documentation. + Frame size as required test variable, not an explicit argument. + MLRsearch keyword to store result (not into test message). - TODO: De-duplicate: main keyword to measure, minor to set test message. - But implementation uses the fact default arguments are different. + Keywords for starting and stopping background traffic. - No checks whether start-stop pair is complete. + Multiple minor indentation and logging improvements. - Missing / TODOs: - Support also vlan_per_chain=True? - Support dot1q without vxlan? - Support also deletion? - How to package config steps so -reconf can be generated from -ndrpdr? Change-Id: If0270697f9ffa837c34ef802917220a53f156703 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit ff820e3d53434889aacde2373314c3be8d00f765)
2019-08-23Improve PLRsearch yet againVratko Polak6-51/+167
Logic improvements for rls1908 and post-pylint fixes: + Reduce search time to 30 minutes. + Use average instead alternating loads. + Rework log/exp avg/stdev from two estimates. + Introduce and use pessimistic variance of dual trackers. + Introduce safe_exp to use when None does not skip code. + Use dot relative imports (instead of disabling pylint). + Complete docstrings for simpler functions. + Append docstrings to named tuples. + Somewhat unify docstrings related to the same arguments. + Slightly improve intentation. + State named tuples as rtype where used. + Add returns and rtype to __repr__ where missing. + Return what docstring say (or update them). + Explicit copying for vector and matrix values. Change-Id: I884c68b4839c5df5e8bef95e463666599603a0ff Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit fbbc47359e3f7b59bbd5a84d85c673374933a50a)
2019-08-23Framework: Refactor complex functions in PLRSearchMiroslav Los2-49/+68
Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech> Change-Id: Ie2f19a2e3b37e8d85656ab31ece59b89c76bea25 (cherry picked from commit 281b230ba982f9f6ad589fb6e44f121a6a46531f)
2019-08-23Report: Specify groups of tests for graphsTibor Frank1-0/+432
Groups of tests for graphs: - Packet Throughput - Packet Latency - Speedup Multi-Core Change-Id: Ib37c1231abb63c234fb1e98d059bb3338133da0c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 719a84662ad1482f09224543c07053d27d7b94ea)
2019-08-22Use vpp 19.08-release buildsJan Gelety4-4/+4
- vpp repo updated to release branch - vpp stable builds updated to 19.08-release Signed-off-by: Jan Gelety <jgelety@cisco.com> Change-Id: I47cdb90d2a9714d49b84648b8e3979815e4d4439
2019-08-22Add: 2-node ip4 oacl testsJan Gelety78-12/+372
Change-Id: I786fe9f75777e1cd0daee70bc350185dd7fd17e1 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 01be3c2278c79d83ae36290868ab66f3741abc38)
2019-08-21Autogen: Create NICs for TCP suites.Vratko Polak7-275/+299
+ Put Regenerator internal functions ourside class. + Duplicate into _default_ and _tcp_ functions. + Rework Testcase to be a single class with two factories. + Improve suite and testcase naming. Change-Id: I1f835b576c476c1a40c8c52469b1876695f9ae73 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit ae7dc0011f376861ba9259b7cb5166777520799c)
2019-08-21Add: avf-dot1q testcasesPeter Mikus13-71/+595
+ Few fixes in doc + Align testcases Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I5575db8255a74fd46f37d5cc2637b9b4448bcd7f (cherry picked from commit a0a1bdba6245c685898bab5007de28452bbd2d27)
2019-08-21Fix Initialize layer dot1q on nodeVratko Polak1-8/+4
By using Get Variable Value keyword. Change-Id: I3a9650b6f802d60422ffa6b6b00d444ebb050d89 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit b6cd8aba14026ee89178714171d2890a2796ca31)
2019-08-20Align NF_denisty testsPeter Mikus88-185/+537
+ Apply layer approach for interfaces Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I6c1898b9833f9f42b8912f1b521e30093360d7ea (cherry picked from commit 329e0acee1cf31c6524883e15560993af76f0fad)
2019-08-20Add: NF_density combinationsPeter Mikus12-6/+894
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I9ba859cf8ecb2d65c90ec7c6f75dc3e353e74de9 (cherry picked from commit baa47eee42b9b1f5fd4d19f0d4549f3baeac8354)
2019-08-19PAL: Select tests by name, functionsTibor Frank3-0/+751
- throughput - latency - speedup Change-Id: Ia8b33815f5bbb7b0fb50b23e7655068928733832 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 144ebec26ff0a32000283eddfac393e497e01164)
2019-08-19Report: Add dataTibor Frank1-28/+130
- DPDK Change-Id: Ibc45c49e34b2b0abe0f0a9f3304ee478c174c01e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 42c64b70e6cdc0ba1466ca0919d5d0377f4c227d)
2019-08-19PAL: Get DPDK version from output_info.xmlTibor Frank1-2/+2
Change-Id: I922c8143df39025cc0a78047f3cef7b9f5673b4b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 039a71a97592cfb864dff8fc56ec04b33f8f92bb)
2019-08-19FIX: Missing ACL libraryPeter Mikus1-0/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1497a9b031603d09d69a29ed7167686848d4b7c5 (cherry picked from commit 00b3327cf9df8ac078bde5f936bd2ac9fe666f03)
2019-08-19Write DPDK version to logTibor Frank1-1/+1
Change-Id: Ia9ec0d420c8db9e71234f74e4013c21d039931b2 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f893de60bb36c3e241a992cb389697997a1cd0f2)
2019-08-16PAL: Process show runtime output 3Tibor Frank1-2/+4
- format the table Change-Id: I871251a8329e5d52c527c93afe35d875bddaed0c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 859a3f724c077f9db9a2f40f76b6dad27f199003)
2019-08-16PAL: Process show runtime output 2Tibor Frank1-3/+2
- format the tables Change-Id: I31f786d53b79fa14c5d2dc21ff65d0465fde1d4f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7da9d215fc0867e19160d38b0096e58c78381bf8)
2019-08-15PAL: Process show runtime outputTibor Frank1-5/+42
Change-Id: If7eac41cd33837eea7291f87129e2c176fbe6aea Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3e58c2f916288c5ed22ce11f01fa56a4d19689d2)
2019-08-14Update of VPP_STABLE_VER files to RC2Jan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 19.08-rc2~b26 - use new vpp ref build - ubuntu 18.04: 19.08-rc2 - use new vpp ref build - centos7: 19.08-rc2~b26 Signed-off-by: Jan Gelety <jgelety@cisco.com> Change-Id: Iccd5ba08559e202c1c39ffceceeab1ee8c0d9f36
2019-08-14FIX: Remove eth_avf and portX_vifY interfaces from topo in TC/TS tear downJan Gelety19-19/+55
Change-Id: I90901c4ab14dfa76dc3e1f786a4b986479e0ba47 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-08-15Add testbed info to output_info.xmlTibor Frank1-2/+3
Change-Id: I2ff45926a754647c1be6263cf8e5e0c7cbfedfef Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 16226fd221af3345c02de6d685c90ee6bf7cf9f9)
2019-08-15VAT-to-PAPI: Fix HTTP/TCP testsDave Wallace14-127/+190
Change-Id: Ie728bc73eb7429d246e82dd195fc63191c3ac51d Signed-off-by: Dave Wallace <dwallacelf@gmail.com> (cherry picked from commit 6da7266754c28754c04cf37d1974e39766a261f6)
2019-08-14Move: WRK installation into ansiblePeter Mikus9-84/+71
- Remove ability to install from framework. - Control via ansible with other dependencies. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I5fd0ca18b4f76c30b6c28b4dcd15e538e01cb315 (cherry picked from commit 37a9451377f7239365b5af778b8072d1585a2d2a)