aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-05-03Update to csit rls1704 report - perf changes tables - based on increased ↵Maciek Konstantynowicz1-12/+12
number of test job executions. Change-Id: I659f7f3da2464081be540c80cb2d71c107455a5e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit ab519403ae4b7c2db19d7199b4b7bee4df682f78)
2017-05-03Updates to csit rls1704 report related to increased number of test job ↵Maciek Konstantynowicz21-395/+134
executions. Change-Id: If16e312eeb377cabc96fe1a671d9bdfedf5e87b0 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit a6644da0fb0bcd9513995c5d2aecdefb4bbdaf25)
2017-05-03Fix Honeycomb source data path for report.Peter Mikus1-1/+1
Change-Id: Ifcae7625dd2325461f70382439a52d9091d7121c Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 56e9f4c10d975cf68972a1110d2fdf5b202acb9a)
2017-05-03Update links with source data for rls reportPeter Mikus1-65/+65
Change-Id: Ic105fb63f5314da2a30aa1c562e4b98a1bb67788 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit ce400b20b0f95dd017060793ba26ff6cf66c13d5)
2017-05-03Update data points for rls1704 reportPeter Mikus1-3/+3
Change-Id: Iae8b0833d88d0331f0b8296c79f5267e3a32f53c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-28Revert "Vhost tests"Peter Mikus8-462/+42
This reverts commit 955047a8483e6c795a561ecfb7f78d01885b1aa3. Change-Id: I7b02bb249822b59dd47035700e02fc5f122ffac9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-28Update of VPP_STABLE_VER_UBUNTUPeter Mikus2-2/+2
Update of VPP_STABLE_VER_UBUNTU in rls1704 Change-Id: I0f2201463e28693d378a9e2c4f8d8243c8f3463c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-28csit rls1704: updates to /testpmd_performance_tests/packet_*_graphs files.Maciek Konstantynowicz4-15/+21
Change-Id: I7c9fefd93e768368ac1093ffd4589dcf63a6375c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-27csit rls1704 report: final update to csit_release_notes.rst, ↵Maciek Konstantynowicz15-53/+95
packet_*_graphs.rst files. Change-Id: I531706f87716a3db8c5417be6ce4933e02e2a622 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-27Report-gen updatePeter Mikus4-42/+46
- fix header in IPsec sections - fix IP4 regexp to include SNAT - update source data for perf trending - fix rendering of Trex section Change-Id: I20660eb997a33cdca89490f2ef1cd1dcd339ff15 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-27csit rls1704 report: updates to csit_release_notes.rst files.Maciek Konstantynowicz2-84/+86
Change-Id: I672beb5e710bcec7aba738efe75e508e9394fafe Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 38850b1710c99c2d981cd9ccd6a474c0a017b91f)
2017-04-26update to csit rls1704 report: vpp_unittest_results.rstMaciek Konstantynowicz1-51/+291
Change-Id: I3af10e3caeaa4150b35a118899e233e33877c673 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 43c34a7ba751495f2bc5f9d6eb9740dedd689f2b)
2017-04-26CSIT rls1704 report - small updatesJan Gelety5-22/+31
Change-Id: I80b5aaf2bab77a6131fca8cf4e903ef6aecd1195 Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26Edits to csit rls1704 report: vpp_unit_tests sections.Maciek Konstantynowicz2-4/+8
Change-Id: I1eceb766f53c7bd25c791c16b8fbc027009df3f0 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 647afd5d647dcc69d0cb04aa61d2a4d964f6bc6a)
2017-04-26Edits to csit rls1704 report: csit_tag_description.rst.Maciek Konstantynowicz1-2/+5
Change-Id: Iee1b6fd98b73be1821068f08fa469222eb938a32 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 075acff52cbcb84456f93aad9e58aa3a82a9011b)
2017-04-26CSIT rls1704 report - update of functional csit_release_notes.rstJan Gelety1-49/+48
Change-Id: I4c6526ffdfeacdfaa02cd77d862e52cf1ed12714 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-26CSIT doc gen: Use html <pre> tag for data from teardown.Jan Gelety1-6/+16
Change-Id: Ie8d856d0a7b90eeecffcb38cd8e8b0647a534d8d Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 66435e950bb418da98c4371a259fc4a19addda7e)
2017-04-26csit rls1704 report - updated csit_release_notes.rst and overview.rst files.Maciek Konstantynowicz6-33/+110
Change-Id: I0b5005a4c8dc566e559638d981fb0e8a7b079499 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26Update run_report.sh script for generating reportPeter Mikus11-120/+538
Change-Id: I8ba216fd90285ffef34d255b7a672a4d944caff3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-26Vhost testsMatej Klotton8-42/+462
Change-Id: I03722afe13722941e084bc01161f7c2af30e3cb1 Signed-off-by: Matej Klotton <mklotton@cisco.com> (cherry picked from commit 0fc813b1694a6ae70b759e7ca96741f21f81b051)
2017-04-26CSIT rls1704 report - update of vpp_functional_tests/csit_release_notes.rstJan Gelety1-7/+6
Change-Id: I09a0041de447f18c291163ef26c5cce0f1c94645 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-26rls1704 report - updated sections:Maciek Konstantynowicz7-163/+193
- vpp_performance_tests/overview.rst - vpp_performance_tests/csit_release_notes - vpp_performance_tests/test_environment - honeycomb_functional_tests/csit_release_notes Change-Id: I047c4934f0de18b3adb5e8ae4b6eb1a270b75cc7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-25Fix: CSIT report gen for policerJan Gelety1-1/+1
Change-Id: I45bd6e8099b702965e0d20b44b6e99971f25af53 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25CSIT rls1704 report - update to handcrafted sections:Maciek Konstantynowicz22-1294/+1429
- index.rst - vpp_performance_tests/csit_release_notes - vpp_performance_tests/overview.rst - vpp_performance_tests/packet_throughput_graphs/... - testpmd_performance_tests/csit_release_notes.rst - vpp_functional_tests/csit_release_notes.rst - testpmd_performance_tests/packet_latency_graphs/... - testpmd_performance_tests/packet_throughput_graphs/... Change-Id: I06bd27bc30d06d69873da74756ca586e12e55643 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 02f2a2176ec92efdf63399fb7dba1eb586465f38)
2017-04-25Improve doc in data driven perf testsTibor Frank6-63/+132
Change-Id: I1aed068cfd502d4064be194417e91e0459d25a88 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f496b8dd088f9ba89710b8b6f8d0fb380740458f)
2017-04-25Fix: CSIT report gen - teardown data + run_report.shJan Gelety2-21/+27
Change-Id: Ie846ff0503d14f861738b2753328bb6a64ac8216 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25CSIT doc gen: Add configurations and operational data.Jan Gelety6-3/+269
- vpp perf configurations and operational data - vpp func configurations Change-Id: I634682e55a2862b927546e2657aabb242c730be1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25CSIT doc gen: Script to get data from teardown.Jan Gelety1-0/+619
- generate rst/html/md/wiki file with required data from teardown per TC - implemented: - VAT command history of all DUTs per TC - ouptup of CLI command "Show Runtime" (VPP operational data) Change-Id: I0771f3e0c20dfff9d00df62bdcc6013a32ef9001 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 589601a406783d90ba0668428f1a96da1ec9fecb)
2017-04-251704 report - fix mistake in honeycomb sectionselias1-1/+1
Change-Id: I6517ea48a6df95cc855596843d736658471486ea Signed-off-by: selias <samelias@cisco.com>
2017-04-251704 Report - Honeycomb sectionselias3-28/+62
Change-Id: I8006cf8187f943b8d880c8193b6b1bde25ad343c Signed-off-by: selias <samelias@cisco.com>
2017-04-25HC Test: add expected_failing tag to "disable_lisp" caseselias1-0/+2
Change-Id: I614dea8d830e8bf97ac4b4ad24d21d3b707fae8a Signed-off-by: selias <samelias@cisco.com>
2017-04-24Download the latest VPP build for *NIGHTLY and *DAILY jobsTibor Frank1-1/+3
Change-Id: I15755c9fc5f95497c84a20d83c3dabddf53c2225 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e96838cfbc9a742a7c543a1b88a2d4d2eaf5d08b)
2017-04-24Fix: Report vhost and testpmd plotsPeter Mikus4-227/+256
Change-Id: Iaf41d9132a52e1d4e199bba31abedba66143bfc7 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 77053a6017391491dcd3a41ca7a9451ab3d5944a)
2017-04-24Fix: Report generationPeter Mikus18-59/+275
- Add IPsec plots - Fix plots rendering Change-Id: Ie8f5d2fa6724268ac05ed4f6ea53bb7c593f676e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-24CSIT-554: Performance jobs reorganisation, part 4Tibor Frank1-0/+48
Add: - vpp-csit-verify-hw-perf Change-Id: Ia6b4773256b78ce26c0ef29e70964966f3b901ca Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit bc26996dcd0e92af29e5208cbcecd8d347cf1210)
2017-04-24CSIT-557: Performance jobs reorganisation, part 3Tibor Frank10-8/+76
Add: - csit-vpp-perf-verify Change-Id: Ifc97228f5066f5a2ab3404b9b62d09b49af3f061 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7a52c16bc35b6abfd0cfacbc6be79b38ee467367)
2017-04-24Fix: tc02-64B-1t1c-eth-l2xcbase-eth-4vhost-2vm-pdrdiscPeter Mikus1-0/+1
- Fix missing keyword Change-Id: Iea1fa4e389f87113b205f53d0f57cbb05fcbff0a Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 3305d93551d0cc861558da09a26c8103453d9d6c)
2017-04-23Fix typo in run_reportPeter Mikus1-1/+1
Change-Id: Ide358bf67fd70717b7545bdf2a56562169cdef8a Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 4f569f553c9cd30922292b644f4c2bab40e9dd5c)
2017-04-23Fix LISPGPE+IPSEC after cherry picksPeter Mikus1-16/+62
Change-Id: Iacf4412f97092faf791854afb7fb726838febb2b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-22Fix run_report.shPeter Mikus1-8/+8
- fix sed delimiter to eliminate / Change-Id: I4d6253d7845937ee452da342819d1c390ca28054 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 00a0cdaeb8cd186f5bd0f7ead5b60c6d49a4929f)
2017-04-22Report generation script updatespmikus12-4862/+590
- Add new type of throughput plots - Update Sphinx, Sphinx-rtd-theme and Plotly packages - Add auto generation of detailed test results - Small fixes Change-Id: I706777160a7f166e0a335c64428d10cb546fa854 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 5b702673375a2a098311c23ab83487d3e1e02e72)
2017-04-21Added Ethernet frame size tags for performance tests:Maciek Konstantynowicz73-1060/+1067
- 64B, 78B, IMIX, 1460B, 1480B, 1514B, 1518B, 9000B. Change-Id: I007928855ed05ac2e3aca02298b9436b9b6becdc Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-21tag_documentation.rst - added:Maciek Konstantynowicz1-0/+16
- Ethernet frame size tags for performance tests: 78B, 1460B, 1480B, 1514B. Change-Id: Ifed47794cac3f7cf9d0d6315901fe47233ffc46e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 60ea1ed962e27f0043509747407a61ec817d4760)
2017-04-21tag_documentation.rst - added: Ethernet frame size tags for performance testsMaciek Konstantynowicz1-4/+22
Change-Id: I65c967d0daf87a6a21e7000d2aea24f278fe5281 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 2c1706d69455d8479b0b0318d4c2fa8b4ab806cb)
2017-04-21CSIT rls1704 report - update to handcraftec sections:Maciek Konstantynowicz28-813/+224
- introduction /overview /general_notes /csit_test_naming - vpp_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs - vpp_functional_tests /overview /csit_release_notes /documentation - testpmd_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs Change-Id: I10593d4155edc663ca07ae5cd29eb679c5f5d85f Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 5d294b7d4c501d971d67c4e3fe192a9dc504d76e)
2017-04-21CSIT-561: Add release and version to the headerTibor Frank1-1/+2
Change-Id: I73ca0e924b74a8cc523c00b00a80598e09c8ef43 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit bc2036f4ce9b8aa705161ee1c8566b134fc6570c)
2017-04-20HC Test: update persistence suiteselias3-5/+46
- fix "enable persistence" is suite setup - update Jira links to persistence bug - log content of persistence file before each restart Change-Id: I68ad759ded5d6bee277cf946953c11f19628a9e7 Signed-off-by: selias <samelias@cisco.com> (cherry picked from commit 6a4018c9d8b356bc55af135d68803a08729d0ae1)
2017-04-19CSIT-561: Add filtering of testsuits to report generationTibor Frank1-6/+30
Change-Id: I751600f7ea9937bc8bfde7d6062eeaadf3ee68dd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c46911d3ee7b11af9b88cf235ce06f8fb24554fc)
2017-04-19CSIT-559: Performance jobs reorganisation, part 3Tibor Frank1-0/+8
Add: - csit-vpp-perf-ndrchk-daily Change-Id: I4edfa86810744168307d9cbeb979d40dc5e21eb0 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 25b577d61445aa0607725a0172b72b5c01582b73)
2017-04-19CSIT-558: Performance jobs reorganization, part 2Tibor Frank1-2/+26
Add: - csit-vpp-perf-check Change-Id: I31e40d37e38d27d3be15a40f6044ce5d907067be Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 47a843ce28984d752dff064afb78c91f18741611)