aboutsummaryrefslogtreecommitdiffstats
path: root/docs/report/vpp_functional_tests
AgeCommit message (Collapse)AuthorFilesLines
2019-08-30Report: functional tests static contentJan Gelety2-97/+70
Change-Id: I17238ff6d1760f6a956459e072ba0303abef3199 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-08-09Bump VPP stable version: socksvrVratko Polak1-1/+1
VPP changed the default socket path in: https://gerrit.fd.io/r/c/vpp/+/21100 Instead of "default", explicit value is used now. It coincides with VPP default one, and is stored in Constants.py (except documentation). The file name for robot side forwarded socket remains, as the path leading to is is different anyway. Change-Id: I0058d16794a3cd04411640c2c8d5fd4ee8cb997d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-09DOC: rls1908 static contentPeter Mikus2-81/+8
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia0778acc543a51fe85b8a75162f12905badaa382
2019-07-17Use PapiSocketProvider for most PAPI callsVratko Polak1-0/+3
Ticket: CSIT-1541 Ticket: VPP-1722 Ticket: CSIT-1546 + Increase timeout to hide x520 slownes of show hardware detail. - Install sshpass and update ssh client in virl bootstrap. + Added TODOs to remove when CSIT-1546 is fixed. + Enable default socksvr on any startup conf. + Improve OptionString init and repr. - The non-socket executor still kept for stats. + Remove everything unrelated to stats from non-socket executor. - Remove some debug-loooking calls to avoid failures. TODO: Introduce proper parsing to the affected keywords. + Reduce logging from PAPI code to level INFO. - Needs https://gerrit.fd.io/r/20660 to fully work. + Change default values for LocalExecution.run() + Return code check enabled by default. Code is more readable when rc!=0 is allowed explicitly, and the test code will now detect unexpected failures. + Logging disabled by default. Output XML is large already. Important logging can be enabled explicitly. + Restore alphabetical order in common.sh functions. Change-Id: I05882cb6b620ad14638f7404b5ad38c7a5de9e6c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-10Report: VPP_func update 2Jan Gelety1-2/+1
Change-Id: I840f61211bd01e26862ae7af40522a82ce8cfb25 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-10Report: VPP_func updateJan Gelety1-239/+81
Change-Id: I7d551e4d62b1678347c8c5c08a42201567a497cf Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-02-13Report: VPP_Device and VPP_func updateJan Gelety2-97/+114
Change-Id: Ied18cef4519aff5ce56cb7548e3f97d89856de27 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-12Fix: Report: Titles formatTibor Frank1-0/+2
Change-Id: Iaa7f5d87cecd377d60be5da8c011b07518829cce Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-07report: updates static content - func testsJan Gelety1-45/+43
Change-Id: I9e81bdb064c1f31aff8387fe0c59391be740a95d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-07Report: VPP func, updated chagnes in rls and list of known issues.Tibor Frank1-9/+18
Change-Id: Iea0bbe5ba81b3c63579edcc15eb728a5b0fe2876 Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-11-05CSIT-1342: Edit the static content for CSIT-1810 reportTibor Frank1-1/+1
Change-Id: I547ccc1a40acbf1adac385f56d388406a5102bde Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-08-18report 18.07: final final editorial nit picking in v0.9.Maciek Konstantynowicz1-4/+3
Formatting and removing excessive white space in static content. Change-Id: I7400f4ba6386b85b59b667db026558685ec0d1a1 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-17report 18.07: draft v0.9 editorial nit-picking, take-2.Maciek Konstantynowicz1-3/+3
Change-Id: Id2a627b1e48275f505a3ea50004285516a47897e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-17report 18.07: draft v0.9 editorial nit-picking.Maciek Konstantynowicz1-2/+2
Change-Id: I7fb9dff8f5ebce0ac03ef99c74b14b02638042ac Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-17report 18.07: reformatted known issues tables in rls notes sections.Maciek Konstantynowicz1-26/+26
Change-Id: I2e6c6910542ec06ffd68a95d66c427fe2589c833 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-16report 1807: list and table formatting fixes.Maciek Konstantynowicz1-7/+7
Change-Id: I1233e903a9590d12ae0cf0032e33a017fea07b3e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-15report 1807: editorial nit-picking and formatting all release_notes sections.Maciek Konstantynowicz1-8/+9
Change-Id: If4678dca08139febfbbcad929dfde322a7008ff9 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-151807 report: updated virtual topologies for all functional tests.Maciek Konstantynowicz4-99/+1989
Change-Id: I3053c7a9733ca7c03df993698472ad8d031dba96 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-14rls1807: updated environment sections for all functional tests.Maciek Konstantynowicz1-51/+63
Change-Id: I8f0a2a49ee6e75990ee4638543259c40d1fb5d67 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-07CSIT-1226: Fix bugs in pdf versionTibor Frank2-12/+25
Change-Id: I9c7abca28f98a581a8efb390c6ccf4f8937a958b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-08-02Report 1807 - Functional overviewPeter Mikus1-85/+88
Change-Id: I1c3254c10dd699f1288fc753cbfb09bbb1bc24f7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-01rls1807 report: functional test static contentJan Gelety2-44/+50
Change-Id: Iac120c650b8667c589e387666c28732aa14872b4 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-07-30CSIT-1197: Add Comparison Across Testbeds to the ReportTibor Frank1-1/+1
Change-Id: Ibf0c880926b87e781830d7b39438b5145144ef5b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-27CSIT-1213: Add 2n/3n-skx to Test Oper DataTibor Frank2-4/+4
Change-Id: I217cc8dc6691c2a443460bd4e51ea96c4ec82806 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-27CSIT-1211: Add 2n/3n-skx to detailed resultsTibor Frank1-1/+1
Change-Id: Ibfe838b355fa15d0f89ea3122f2d042af989b51d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-19CSIT-1196: Add hsw/skx and 2n/3n to the report structureTibor Frank1-2/+2
Change-Id: I3a0cc2792b931798e466250e30bc30ad8a32b84e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-17CSIT-1094: Change menu styleTibor Frank1-10/+0
Change-Id: Idff59bc73d3444700937fc473681760a947f0f41 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-10Remove THIS tag and use unix endlinesVratko Polak3-777/+777
The THIS tag has sneaked in 10Ge2P1X520-Eth-L2Xcbase-Eth-1Memif-1Dcr-Mrr but usually it is only to be used in draft testing. Not sure about the way non-unix endlines crept in. Is not git supposed to perform endline conversions on text files? Or are .robot, .rst, .yaml and .vat not recognized as text? Change-Id: Ia78cf942c05c3029c340a8639782786f37e57469 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-09Report 1804: VPP functional test framework changes - centosJan Gelety1-0/+5
Change-Id: I9ada32945c87cb2bb6ef4fd1ef6e5c1cb54f6f32 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-05-07FIX: Small inconsistencies in report sectionsPeter Mikus1-5/+4
Change-Id: I0c27300678414bd3baecccd8e51ca0dc15af73d5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-05Report: func rls_notes formatting fixes.Maciek Konstantynowicz1-9/+9
Change-Id: Ib138227a02335c67513bdb85ceb6200d1dcc9eff Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-05-04Report 1804: Centos func testsJan Gelety2-9/+111
Change-Id: Ifc6febd239c0c3c5e2c29e26992120c2d6d1b0b4 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-05-02Report 1804: SRv6 adn func part updateJan Gelety2-21/+91
Change-Id: I3091299269c84ba2a7487cf5a5e8145df26e78e4 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-01-25CSIT 1801 report updateJan Gelety2-16/+8
- func csit release notes - func test environment - perf csit release notes Change-Id: I2cfd56585c646bc4553fe80afd8208dd7a01be30 Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-10-26Update static report content - functional testsJan Gelety1-23/+5
Change-Id: Ieded0a5d4fd7e15dce10bea3bcc023710ebe872c Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-02CSIT-744 Update report content for proper parsingPeter Mikus2-27/+23
Follow the good practices for formatting. Update the content of release report RST files to use the proper directives like :cite:, :footnote:, :abbr:, :captions: etc.With these markings we will be able to format output in proper way and style it in various sphinx output builders. Change-Id: Ibbb538d43c3bd364a6acdcc990097a477f49de00 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-25CSIT-618 Release report update VIIIPeter Mikus2-55/+44
Change-Id: Idec390861aa5ac8a1a485d5996fbfef444ac8a29 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-24CSIT-618 Release report update VIIPeter Mikus1-1/+1
Change-Id: Ide7771b59cc3ee7619502a6805c8401528a8c874 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-21rls1707 report: edits of vpp_functional_tests/rls_notesJan Gelety2-22/+22
- updated section "Changes in CSIT" - updated section "Known Issues" Change-Id: I32e014889d4846f1a915e302a1c8fe93146444b8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-20CSIT-618 CSIT rls1707 Report - Update IVPeter Mikus1-2/+17
Change-Id: Iff48d515ebdae40920660627b4b3b2e35351b3a1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-14CSIT-618 CSIT rls1707 Report - Update IPeter Mikus3-45/+46
Change-Id: I7c3af55db6cc89f03004db6ddf6fcf67965132a7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-25CSIT-612 Report: Minimization of hand-crafted content.Peter Mikus3-23/+21
- replace dynamic text content and links by variables. Change-Id: I1a7ec371fc80af3c9dd416bf91dd2c639097cf1e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-27csit rls1704 report: updates to csit_release_notes.rst files.Maciek Konstantynowicz1-10/+10
Change-Id: I672beb5e710bcec7aba738efe75e508e9394fafe Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26CSIT rls1704 report - small updatesJan Gelety1-15/+17
Change-Id: I80b5aaf2bab77a6131fca8cf4e903ef6aecd1195 Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26csit rls1704 report - updated csit_release_notes.rst and overview.rst files.Maciek Konstantynowicz1-5/+12
Change-Id: I0b5005a4c8dc566e559638d981fb0e8a7b079499 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26CSIT rls1704 report - update of functional csit_release_notes.rstJan Gelety1-46/+44
Change-Id: I4c6526ffdfeacdfaa02cd77d862e52cf1ed12714 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25CSIT rls1704 report - update of vpp_functional_tests/csit_release_notes.rstJan Gelety1-4/+8
Change-Id: I09a0041de447f18c291163ef26c5cce0f1c94645 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25CSIT rls1704 report - update to vpp_functional_tests/csit_release_notes.rstJan Gelety1-17/+25
Change-Id: I400f49ab5399a83b925fbbe2b52e37fd97f464f0 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25rls1704 report - updated sections:Maciek Konstantynowicz1-1/+1
- vpp_performance_tests/overview.rst - vpp_performance_tests/csit_release_notes - vpp_performance_tests/test_environment - honeycomb_functional_tests/csit_release_notes Change-Id: I047c4934f0de18b3adb5e8ae4b6eb1a270b75cc7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-25CSIT rls1704 report - update to handcrafted sections:Maciek Konstantynowicz1-6/+6
- index.rst - vpp_performance_tests/csit_release_notes - vpp_performance_tests/overview.rst - vpp_performance_tests/packet_throughput_graphs/... - testpmd_performance_tests/csit_release_notes.rst - vpp_functional_tests/csit_release_notes.rst - testpmd_performance_tests/packet_latency_graphs/... - testpmd_performance_tests/packet_throughput_graphs/... Change-Id: I06bd27bc30d06d69873da74756ca586e12e55643 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>