aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-05-24Add RA suppress to IPv6 Equal-cost multipath routing test caserls1704Jan Gelety2-0/+1
Change-Id: I9aa7220db01016d553cd389ad4827a3f86da9310 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 2900b5ab54b4c10e400369ef80f115f42baaa3da)
2017-05-24CSIT-566: Use RA suppress in LISP and VXLAN IPv6 related test casesJan Gelety19-0/+25
Change-Id: I788bf465242f5894c65b58f14d2355d29755eda5 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 631b366985355cbe41a243a87b06eda75cdd2c42)
2017-05-23CSIT-577 HC Test: Scripts for test jobs using ODL clientselias6-40/+512
ODL client can be used to translate Restconf requests into Netconf. This way Honeycomb's Netconf interface can be tested using existing test cases. - add bootstrap scripts for verify and integration job - update __init__.robot to handle new {HC_ODL} variable Change-Id: I410d3e56b8d4f18e672b4886f4f025456bf00655 Signed-off-by: selias <samelias@cisco.com>
2017-05-10csit report - fixed table format in vpp_performance_tests/csit_release_notes.rstMaciek Konstantynowicz1-1/+1
Change-Id: Ie9d4a9ba373c0e6131f0a2d3e49f20a315da3b9a Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 49197759c5107700ce470202b3650e9eabde53c9)
2017-05-05Func vhost tests with needed changes in perf testsJan Gelety9-46/+466
Change-Id: I8c44448ca77f0fbd7ce074b8eef10b5ba491747d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-03Update to csit rls1704 report - perf changes tables - based on increased ↵Maciek Konstantynowicz1-12/+12
number of test job executions. Change-Id: I659f7f3da2464081be540c80cb2d71c107455a5e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit ab519403ae4b7c2db19d7199b4b7bee4df682f78)
2017-05-03Updates to csit rls1704 report related to increased number of test job ↵Maciek Konstantynowicz21-395/+134
executions. Change-Id: If16e312eeb377cabc96fe1a671d9bdfedf5e87b0 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit a6644da0fb0bcd9513995c5d2aecdefb4bbdaf25)
2017-05-03Fix Honeycomb source data path for report.Peter Mikus1-1/+1
Change-Id: Ifcae7625dd2325461f70382439a52d9091d7121c Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 56e9f4c10d975cf68972a1110d2fdf5b202acb9a)
2017-05-03Update links with source data for rls reportPeter Mikus1-65/+65
Change-Id: Ic105fb63f5314da2a30aa1c562e4b98a1bb67788 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit ce400b20b0f95dd017060793ba26ff6cf66c13d5)
2017-05-03Update data points for rls1704 reportPeter Mikus1-3/+3
Change-Id: Iae8b0833d88d0331f0b8296c79f5267e3a32f53c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-28Revert "Vhost tests"Peter Mikus8-462/+42
This reverts commit 955047a8483e6c795a561ecfb7f78d01885b1aa3. Change-Id: I7b02bb249822b59dd47035700e02fc5f122ffac9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-28Update of VPP_STABLE_VER_UBUNTUPeter Mikus2-2/+2
Update of VPP_STABLE_VER_UBUNTU in rls1704 Change-Id: I0f2201463e28693d378a9e2c4f8d8243c8f3463c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-28csit rls1704: updates to /testpmd_performance_tests/packet_*_graphs files.Maciek Konstantynowicz4-15/+21
Change-Id: I7c9fefd93e768368ac1093ffd4589dcf63a6375c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-27csit rls1704 report: final update to csit_release_notes.rst, ↵Maciek Konstantynowicz15-53/+95
packet_*_graphs.rst files. Change-Id: I531706f87716a3db8c5417be6ce4933e02e2a622 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-27Report-gen updatePeter Mikus4-42/+46
- fix header in IPsec sections - fix IP4 regexp to include SNAT - update source data for perf trending - fix rendering of Trex section Change-Id: I20660eb997a33cdca89490f2ef1cd1dcd339ff15 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-27csit rls1704 report: updates to csit_release_notes.rst files.Maciek Konstantynowicz2-84/+86
Change-Id: I672beb5e710bcec7aba738efe75e508e9394fafe Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 38850b1710c99c2d981cd9ccd6a474c0a017b91f)
2017-04-26update to csit rls1704 report: vpp_unittest_results.rstMaciek Konstantynowicz1-51/+291
Change-Id: I3af10e3caeaa4150b35a118899e233e33877c673 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 43c34a7ba751495f2bc5f9d6eb9740dedd689f2b)
2017-04-26CSIT rls1704 report - small updatesJan Gelety5-22/+31
Change-Id: I80b5aaf2bab77a6131fca8cf4e903ef6aecd1195 Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26Edits to csit rls1704 report: vpp_unit_tests sections.Maciek Konstantynowicz2-4/+8
Change-Id: I1eceb766f53c7bd25c791c16b8fbc027009df3f0 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 647afd5d647dcc69d0cb04aa61d2a4d964f6bc6a)
2017-04-26Edits to csit rls1704 report: csit_tag_description.rst.Maciek Konstantynowicz1-2/+5
Change-Id: Iee1b6fd98b73be1821068f08fa469222eb938a32 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 075acff52cbcb84456f93aad9e58aa3a82a9011b)
2017-04-26CSIT rls1704 report - update of functional csit_release_notes.rstJan Gelety1-49/+48
Change-Id: I4c6526ffdfeacdfaa02cd77d862e52cf1ed12714 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-26CSIT doc gen: Use html <pre> tag for data from teardown.Jan Gelety1-6/+16
Change-Id: Ie8d856d0a7b90eeecffcb38cd8e8b0647a534d8d Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 66435e950bb418da98c4371a259fc4a19addda7e)
2017-04-26csit rls1704 report - updated csit_release_notes.rst and overview.rst files.Maciek Konstantynowicz6-33/+110
Change-Id: I0b5005a4c8dc566e559638d981fb0e8a7b079499 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26Update run_report.sh script for generating reportPeter Mikus11-120/+538
Change-Id: I8ba216fd90285ffef34d255b7a672a4d944caff3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-26Vhost testsMatej Klotton8-42/+462
Change-Id: I03722afe13722941e084bc01161f7c2af30e3cb1 Signed-off-by: Matej Klotton <mklotton@cisco.com> (cherry picked from commit 0fc813b1694a6ae70b759e7ca96741f21f81b051)
2017-04-26CSIT rls1704 report - update of vpp_functional_tests/csit_release_notes.rstJan Gelety1-7/+6
Change-Id: I09a0041de447f18c291163ef26c5cce0f1c94645 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-26rls1704 report - updated sections:Maciek Konstantynowicz7-163/+193
- vpp_performance_tests/overview.rst - vpp_performance_tests/csit_release_notes - vpp_performance_tests/test_environment - honeycomb_functional_tests/csit_release_notes Change-Id: I047c4934f0de18b3adb5e8ae4b6eb1a270b75cc7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-25Fix: CSIT report gen for policerJan Gelety1-1/+1
Change-Id: I45bd6e8099b702965e0d20b44b6e99971f25af53 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25CSIT rls1704 report - update to handcrafted sections:Maciek Konstantynowicz22-1294/+1429
- index.rst - vpp_performance_tests/csit_release_notes - vpp_performance_tests/overview.rst - vpp_performance_tests/packet_throughput_graphs/... - testpmd_performance_tests/csit_release_notes.rst - vpp_functional_tests/csit_release_notes.rst - testpmd_performance_tests/packet_latency_graphs/... - testpmd_performance_tests/packet_throughput_graphs/... Change-Id: I06bd27bc30d06d69873da74756ca586e12e55643 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 02f2a2176ec92efdf63399fb7dba1eb586465f38)
2017-04-25Improve doc in data driven perf testsTibor Frank6-63/+132
Change-Id: I1aed068cfd502d4064be194417e91e0459d25a88 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f496b8dd088f9ba89710b8b6f8d0fb380740458f)
2017-04-25Fix: CSIT report gen - teardown data + run_report.shJan Gelety2-21/+27
Change-Id: Ie846ff0503d14f861738b2753328bb6a64ac8216 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25CSIT doc gen: Add configurations and operational data.Jan Gelety6-3/+269
- vpp perf configurations and operational data - vpp func configurations Change-Id: I634682e55a2862b927546e2657aabb242c730be1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25CSIT doc gen: Script to get data from teardown.Jan Gelety1-0/+619
- generate rst/html/md/wiki file with required data from teardown per TC - implemented: - VAT command history of all DUTs per TC - ouptup of CLI command "Show Runtime" (VPP operational data) Change-Id: I0771f3e0c20dfff9d00df62bdcc6013a32ef9001 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 589601a406783d90ba0668428f1a96da1ec9fecb)
2017-04-251704 report - fix mistake in honeycomb sectionselias1-1/+1
Change-Id: I6517ea48a6df95cc855596843d736658471486ea Signed-off-by: selias <samelias@cisco.com>
2017-04-251704 Report - Honeycomb sectionselias3-28/+62
Change-Id: I8006cf8187f943b8d880c8193b6b1bde25ad343c Signed-off-by: selias <samelias@cisco.com>
2017-04-25HC Test: add expected_failing tag to "disable_lisp" caseselias1-0/+2
Change-Id: I614dea8d830e8bf97ac4b4ad24d21d3b707fae8a Signed-off-by: selias <samelias@cisco.com>
2017-04-24Download the latest VPP build for *NIGHTLY and *DAILY jobsTibor Frank1-1/+3
Change-Id: I15755c9fc5f95497c84a20d83c3dabddf53c2225 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e96838cfbc9a742a7c543a1b88a2d4d2eaf5d08b)
2017-04-24Fix: Report vhost and testpmd plotsPeter Mikus4-227/+256
Change-Id: Iaf41d9132a52e1d4e199bba31abedba66143bfc7 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 77053a6017391491dcd3a41ca7a9451ab3d5944a)
2017-04-24Fix: Report generationPeter Mikus18-59/+275
- Add IPsec plots - Fix plots rendering Change-Id: Ie8f5d2fa6724268ac05ed4f6ea53bb7c593f676e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-24CSIT-554: Performance jobs reorganisation, part 4Tibor Frank1-0/+48
Add: - vpp-csit-verify-hw-perf Change-Id: Ia6b4773256b78ce26c0ef29e70964966f3b901ca Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit bc26996dcd0e92af29e5208cbcecd8d347cf1210)
2017-04-24CSIT-557: Performance jobs reorganisation, part 3Tibor Frank10-8/+76
Add: - csit-vpp-perf-verify Change-Id: Ifc97228f5066f5a2ab3404b9b62d09b49af3f061 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7a52c16bc35b6abfd0cfacbc6be79b38ee467367)
2017-04-24Fix: tc02-64B-1t1c-eth-l2xcbase-eth-4vhost-2vm-pdrdiscPeter Mikus1-0/+1
- Fix missing keyword Change-Id: Iea1fa4e389f87113b205f53d0f57cbb05fcbff0a Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 3305d93551d0cc861558da09a26c8103453d9d6c)
2017-04-23Fix typo in run_reportPeter Mikus1-1/+1
Change-Id: Ide358bf67fd70717b7545bdf2a56562169cdef8a Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 4f569f553c9cd30922292b644f4c2bab40e9dd5c)
2017-04-23Fix LISPGPE+IPSEC after cherry picksPeter Mikus1-16/+62
Change-Id: Iacf4412f97092faf791854afb7fb726838febb2b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-22Fix run_report.shPeter Mikus1-8/+8
- fix sed delimiter to eliminate / Change-Id: I4d6253d7845937ee452da342819d1c390ca28054 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 00a0cdaeb8cd186f5bd0f7ead5b60c6d49a4929f)
2017-04-22Report generation script updatespmikus12-4862/+590
- Add new type of throughput plots - Update Sphinx, Sphinx-rtd-theme and Plotly packages - Add auto generation of detailed test results - Small fixes Change-Id: I706777160a7f166e0a335c64428d10cb546fa854 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 5b702673375a2a098311c23ab83487d3e1e02e72)
2017-04-21Added Ethernet frame size tags for performance tests:Maciek Konstantynowicz73-1060/+1067
- 64B, 78B, IMIX, 1460B, 1480B, 1514B, 1518B, 9000B. Change-Id: I007928855ed05ac2e3aca02298b9436b9b6becdc Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-21tag_documentation.rst - added:Maciek Konstantynowicz1-0/+16
- Ethernet frame size tags for performance tests: 78B, 1460B, 1480B, 1514B. Change-Id: Ifed47794cac3f7cf9d0d6315901fe47233ffc46e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 60ea1ed962e27f0043509747407a61ec817d4760)
2017-04-21tag_documentation.rst - added: Ethernet frame size tags for performance testsMaciek Konstantynowicz1-4/+22
Change-Id: I65c967d0daf87a6a21e7000d2aea24f278fe5281 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 2c1706d69455d8479b0b0318d4c2fa8b4ab806cb)
2017-04-21CSIT rls1704 report - update to handcraftec sections:Maciek Konstantynowicz28-813/+224
- introduction /overview /general_notes /csit_test_naming - vpp_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs - vpp_functional_tests /overview /csit_release_notes /documentation - testpmd_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs Change-Id: I10593d4155edc663ca07ae5cd29eb679c5f5d85f Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 5d294b7d4c501d971d67c4e3fe192a9dc504d76e)