aboutsummaryrefslogtreecommitdiffstats
path: root/docs/report/vpp_functional_tests
AgeCommit message (Collapse)AuthorFilesLines
2019-07-17Use PapiSocketProvider for most PAPI callsVratko Polak1-0/+3
Ticket: CSIT-1541 Ticket: VPP-1722 Ticket: CSIT-1546 + Increase timeout to hide x520 slownes of show hardware detail. - Install sshpass and update ssh client in virl bootstrap. + Added TODOs to remove when CSIT-1546 is fixed. + Enable default socksvr on any startup conf. + Improve OptionString init and repr. - The non-socket executor still kept for stats. + Remove everything unrelated to stats from non-socket executor. - Remove some debug-loooking calls to avoid failures. TODO: Introduce proper parsing to the affected keywords. + Reduce logging from PAPI code to level INFO. - Needs https://gerrit.fd.io/r/20660 to fully work. + Change default values for LocalExecution.run() + Return code check enabled by default. Code is more readable when rc!=0 is allowed explicitly, and the test code will now detect unexpected failures. + Logging disabled by default. Output XML is large already. Important logging can be enabled explicitly. + Restore alphabetical order in common.sh functions. Change-Id: I05882cb6b620ad14638f7404b5ad38c7a5de9e6c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-10Report: VPP_func update 2Jan Gelety1-2/+1
Change-Id: I840f61211bd01e26862ae7af40522a82ce8cfb25 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-10Report: VPP_func updateJan Gelety1-239/+81
Change-Id: I7d551e4d62b1678347c8c5c08a42201567a497cf Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-02-13Report: VPP_Device and VPP_func updateJan Gelety2-97/+114
Change-Id: Ied18cef4519aff5ce56cb7548e3f97d89856de27 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-12Fix: Report: Titles formatTibor Frank1-0/+2
Change-Id: Iaa7f5d87cecd377d60be5da8c011b07518829cce Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-07report: updates static content - func testsJan Gelety1-45/+43
Change-Id: I9e81bdb064c1f31aff8387fe0c59391be740a95d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-07Report: VPP func, updated chagnes in rls and list of known issues.Tibor Frank1-9/+18
Change-Id: Iea0bbe5ba81b3c63579edcc15eb728a5b0fe2876 Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-11-05CSIT-1342: Edit the static content for CSIT-1810 reportTibor Frank1-1/+1
Change-Id: I547ccc1a40acbf1adac385f56d388406a5102bde Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-08-18report 18.07: final final editorial nit picking in v0.9.Maciek Konstantynowicz1-4/+3
Formatting and removing excessive white space in static content. Change-Id: I7400f4ba6386b85b59b667db026558685ec0d1a1 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-17report 18.07: draft v0.9 editorial nit-picking, take-2.Maciek Konstantynowicz1-3/+3
Change-Id: Id2a627b1e48275f505a3ea50004285516a47897e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-17report 18.07: draft v0.9 editorial nit-picking.Maciek Konstantynowicz1-2/+2
Change-Id: I7fb9dff8f5ebce0ac03ef99c74b14b02638042ac Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-17report 18.07: reformatted known issues tables in rls notes sections.Maciek Konstantynowicz1-26/+26
Change-Id: I2e6c6910542ec06ffd68a95d66c427fe2589c833 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-16report 1807: list and table formatting fixes.Maciek Konstantynowicz1-7/+7
Change-Id: I1233e903a9590d12ae0cf0032e33a017fea07b3e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-15report 1807: editorial nit-picking and formatting all release_notes sections.Maciek Konstantynowicz1-8/+9
Change-Id: If4678dca08139febfbbcad929dfde322a7008ff9 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-151807 report: updated virtual topologies for all functional tests.Maciek Konstantynowicz4-99/+1989
Change-Id: I3053c7a9733ca7c03df993698472ad8d031dba96 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-14rls1807: updated environment sections for all functional tests.Maciek Konstantynowicz1-51/+63
Change-Id: I8f0a2a49ee6e75990ee4638543259c40d1fb5d67 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-07CSIT-1226: Fix bugs in pdf versionTibor Frank2-12/+25
Change-Id: I9c7abca28f98a581a8efb390c6ccf4f8937a958b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-08-02Report 1807 - Functional overviewPeter Mikus1-85/+88
Change-Id: I1c3254c10dd699f1288fc753cbfb09bbb1bc24f7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-01rls1807 report: functional test static contentJan Gelety2-44/+50
Change-Id: Iac120c650b8667c589e387666c28732aa14872b4 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-07-30CSIT-1197: Add Comparison Across Testbeds to the ReportTibor Frank1-1/+1
Change-Id: Ibf0c880926b87e781830d7b39438b5145144ef5b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-27CSIT-1213: Add 2n/3n-skx to Test Oper DataTibor Frank2-4/+4
Change-Id: I217cc8dc6691c2a443460bd4e51ea96c4ec82806 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-27CSIT-1211: Add 2n/3n-skx to detailed resultsTibor Frank1-1/+1
Change-Id: Ibfe838b355fa15d0f89ea3122f2d042af989b51d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-19CSIT-1196: Add hsw/skx and 2n/3n to the report structureTibor Frank1-2/+2
Change-Id: I3a0cc2792b931798e466250e30bc30ad8a32b84e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-17CSIT-1094: Change menu styleTibor Frank1-10/+0
Change-Id: Idff59bc73d3444700937fc473681760a947f0f41 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-10Remove THIS tag and use unix endlinesVratko Polak3-777/+777
The THIS tag has sneaked in 10Ge2P1X520-Eth-L2Xcbase-Eth-1Memif-1Dcr-Mrr but usually it is only to be used in draft testing. Not sure about the way non-unix endlines crept in. Is not git supposed to perform endline conversions on text files? Or are .robot, .rst, .yaml and .vat not recognized as text? Change-Id: Ia78cf942c05c3029c340a8639782786f37e57469 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-09Report 1804: VPP functional test framework changes - centosJan Gelety1-0/+5
Change-Id: I9ada32945c87cb2bb6ef4fd1ef6e5c1cb54f6f32 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-05-07FIX: Small inconsistencies in report sectionsPeter Mikus1-5/+4
Change-Id: I0c27300678414bd3baecccd8e51ca0dc15af73d5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-05Report: func rls_notes formatting fixes.Maciek Konstantynowicz1-9/+9
Change-Id: Ib138227a02335c67513bdb85ceb6200d1dcc9eff Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-05-04Report 1804: Centos func testsJan Gelety2-9/+111
Change-Id: Ifc6febd239c0c3c5e2c29e26992120c2d6d1b0b4 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-05-02Report 1804: SRv6 adn func part updateJan Gelety2-21/+91
Change-Id: I3091299269c84ba2a7487cf5a5e8145df26e78e4 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-01-25CSIT 1801 report updateJan Gelety2-16/+8
- func csit release notes - func test environment - perf csit release notes Change-Id: I2cfd56585c646bc4553fe80afd8208dd7a01be30 Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-10-26Update static report content - functional testsJan Gelety1-23/+5
Change-Id: Ieded0a5d4fd7e15dce10bea3bcc023710ebe872c Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-02CSIT-744 Update report content for proper parsingPeter Mikus2-27/+23
Follow the good practices for formatting. Update the content of release report RST files to use the proper directives like :cite:, :footnote:, :abbr:, :captions: etc.With these markings we will be able to format output in proper way and style it in various sphinx output builders. Change-Id: Ibbb538d43c3bd364a6acdcc990097a477f49de00 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-25CSIT-618 Release report update VIIIPeter Mikus2-55/+44
Change-Id: Idec390861aa5ac8a1a485d5996fbfef444ac8a29 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-24CSIT-618 Release report update VIIPeter Mikus1-1/+1
Change-Id: Ide7771b59cc3ee7619502a6805c8401528a8c874 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-21rls1707 report: edits of vpp_functional_tests/rls_notesJan Gelety2-22/+22
- updated section "Changes in CSIT" - updated section "Known Issues" Change-Id: I32e014889d4846f1a915e302a1c8fe93146444b8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-20CSIT-618 CSIT rls1707 Report - Update IVPeter Mikus1-2/+17
Change-Id: Iff48d515ebdae40920660627b4b3b2e35351b3a1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-14CSIT-618 CSIT rls1707 Report - Update IPeter Mikus3-45/+46
Change-Id: I7c3af55db6cc89f03004db6ddf6fcf67965132a7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-25CSIT-612 Report: Minimization of hand-crafted content.Peter Mikus3-23/+21
- replace dynamic text content and links by variables. Change-Id: I1a7ec371fc80af3c9dd416bf91dd2c639097cf1e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-27csit rls1704 report: updates to csit_release_notes.rst files.Maciek Konstantynowicz1-10/+10
Change-Id: I672beb5e710bcec7aba738efe75e508e9394fafe Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26CSIT rls1704 report - small updatesJan Gelety1-15/+17
Change-Id: I80b5aaf2bab77a6131fca8cf4e903ef6aecd1195 Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26csit rls1704 report - updated csit_release_notes.rst and overview.rst files.Maciek Konstantynowicz1-5/+12
Change-Id: I0b5005a4c8dc566e559638d981fb0e8a7b079499 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26CSIT rls1704 report - update of functional csit_release_notes.rstJan Gelety1-46/+44
Change-Id: I4c6526ffdfeacdfaa02cd77d862e52cf1ed12714 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25CSIT rls1704 report - update of vpp_functional_tests/csit_release_notes.rstJan Gelety1-4/+8
Change-Id: I09a0041de447f18c291163ef26c5cce0f1c94645 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25CSIT rls1704 report - update to vpp_functional_tests/csit_release_notes.rstJan Gelety1-17/+25
Change-Id: I400f49ab5399a83b925fbbe2b52e37fd97f464f0 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25rls1704 report - updated sections:Maciek Konstantynowicz1-1/+1
- vpp_performance_tests/overview.rst - vpp_performance_tests/csit_release_notes - vpp_performance_tests/test_environment - honeycomb_functional_tests/csit_release_notes Change-Id: I047c4934f0de18b3adb5e8ae4b6eb1a270b75cc7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-25CSIT rls1704 report - update to handcrafted sections:Maciek Konstantynowicz1-6/+6
- index.rst - vpp_performance_tests/csit_release_notes - vpp_performance_tests/overview.rst - vpp_performance_tests/packet_throughput_graphs/... - testpmd_performance_tests/csit_release_notes.rst - vpp_functional_tests/csit_release_notes.rst - testpmd_performance_tests/packet_latency_graphs/... - testpmd_performance_tests/packet_throughput_graphs/... Change-Id: I06bd27bc30d06d69873da74756ca586e12e55643 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-21CSIT rls1704 report - update to handcraftec sections:Maciek Konstantynowicz3-36/+7
- introduction /overview /general_notes /csit_test_naming - vpp_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs - vpp_functional_tests /overview /csit_release_notes /documentation - testpmd_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs Change-Id: I10593d4155edc663ca07ae5cd29eb679c5f5d85f Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-02-06csit rls1701 report edits:Maciek Konstantynowicz5-0/+697
- simplified section structure for clarity and readability, - updated overview sections, - moved not rls related content from rls_notes to overview sections, - removed section title suffixes: HW, VIRL. - completed vpp_unit_tests and vpp_unittest_results sections. - updated all documentation sections. - updated rls_notes sections for vpp performance and vpp functional. Change-Id: Id2c2abbf9d3531ec9f63ecd353f385a0b55ae1ba Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>