diff options
| author |   Tibor Frank <tifrank@cisco.com> | 2019-02-20 14:57:51 +0100 |
|---|---|---|
| committer | Tibor Frank <tifrank@cisco.com> | 2019-02-20 16:02:17 +0000 |
| commit | b51bf736871d006f4f6884be7f0daeac250faa15 (patch) | |
| tree | 9e54692c0c091b631a2e587e76f972369c303ae1 | |
| parent | 81a7445fff1c7d6dcf8474b8e12ae2c7f9ceaf79 (diff) | |
Report: add data
Change-Id: I7387bdea66f8ddc58740908b2c69fc6b27b2b01c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit feec48e01c729f4c719c1947429e1d0c3b0fcccb)
| -rw-r--r-- | docs/report/introduction/introduction.rst | 22 | ||||
| -rw-r--r-- | docs/report/introduction/report_history.rst | 12 | ||||
| -rw-r--r-- | docs/report/introduction/test_scenarios_overview.rst | 10 | ||||
| -rw-r--r-- | resources/tools/presentation/specification.yaml | 6 |
4 files changed, 28 insertions, 22 deletions
diff --git a/docs/report/introduction/introduction.rst b/docs/report/introduction/introduction.rst index 7ccc270c76..c5f37a68e7 100644 --- a/docs/report/introduction/introduction.rst +++ b/docs/report/introduction/introduction.rst @@ -96,17 +96,6 @@ available for download. - **Documentation**: Pointers to CSIT source code documentation for Honeycomb functional tests. -.. - #. NSH_SFC FUNCTIONAL: NSH_SFC functional tests executed in - virtual FD.io testbeds. - - - **Overview**: Tested virtual topologies, test coverage and naming - specifics; - - **Release Notes**: Changes in |csit-release|, known issues. - - **Test Environment**: Functional test environment configuration. - - **Documentation**: Pointers to CSIT source code documentation for - NSH_SFC functional tests. - #. DMM FUNCTIONAL: DMM functional tests executed in virtual FD.io testbeds. @@ -155,3 +144,14 @@ available for download. analytics module. - **CSIT RF Tags Descriptions**: CSIT RF Tags used for test suite and test case grouping and selection. + +.. + #. NSH_SFC FUNCTIONAL: NSH_SFC functional tests executed in + virtual FD.io testbeds. + + - **Overview**: Tested virtual topologies, test coverage and naming + specifics; + - **Release Notes**: Changes in |csit-release|, known issues. + - **Test Environment**: Functional test environment configuration. + - **Documentation**: Pointers to CSIT source code documentation for + NSH_SFC functional tests. diff --git a/docs/report/introduction/report_history.rst b/docs/report/introduction/report_history.rst index eb16e9fd49..62b0e7f4f4 100644 --- a/docs/report/introduction/report_history.rst +++ b/docs/report/introduction/report_history.rst @@ -11,17 +11,19 @@ FD.io CSIT-1901 Report history and per .[ww] revision changes are listed below. | | a. VPP on 3n-hsw testbed, | | | b. VPP on 3n-skx testbed, | | | c. VPP on 2n-skx testbed, | -| | d. DPDK on 3n-hsw testbed, | -| | e. DPDK on 3n-skx testbed, | -| | f. DPDK on 2n-skx testbed, | -| | g. VPP K8s Container Memif on 3n-hsw testbed, | -| | h. NFV VPP tests on 2n-skx testbed. | +| | d. VPP functional, | +| | e. DPDK on 3n-hsw testbed, | +| | f. DPDK on 3n-skx testbed, | +| | g. DPDK on 2n-skx testbed, | +| | h. VPP K8s Container Memif on 3n-hsw testbed, | +| | i. NFV VPP tests on 2n-skx testbed. | | | | | | 2. Methodology updated: | | | | | | a. :ref:`PLRsearch algorithm` | | | | | | 3. Removed Denverton. | +| | 4. Removed NSH_SFC. | | | | +----------------+------------------------------------------------------------+ | .07 | Initial version | diff --git a/docs/report/introduction/test_scenarios_overview.rst b/docs/report/introduction/test_scenarios_overview.rst index 02eff7de9f..2bf066e829 100644 --- a/docs/report/introduction/test_scenarios_overview.rst +++ b/docs/report/introduction/test_scenarios_overview.rst @@ -60,16 +60,16 @@ Brief overview of test scenarios covered in this report: programming functionality of VPP. Tests cover a range of CRUD operations executed against VPP. -.. - #. **NSH_SFC Functional**: NSH_SFC functional tests are executed in - virtual FD.io testbeds focusing on VPP nsh-plugin data plane - functionality. Scapy is used as a traffic generator. - #. **DMM Functional**: DMM functional tests are executed in virtual FD.io testbeds demonstrating a single server (DUT1) and single client (DUT2) scenario using DMM framework and Linux kernel TCP/IP stack. +.. + #. **NSH_SFC Functional**: NSH_SFC functional tests are executed in + virtual FD.io testbeds focusing on VPP nsh-plugin data plane + functionality. Scapy is used as a traffic generator. + All CSIT test data included in this report is auto- generated from :abbr:`RF (Robot Framework)` :file:`output.xml` files produced by :abbr:`LF (Linux Foundation)` FD.io Jenkins jobs executed diff --git a/resources/tools/presentation/specification.yaml b/resources/tools/presentation/specification.yaml index 36e40814bf..ac9583cbe6 100644 --- a/resources/tools/presentation/specification.yaml +++ b/resources/tools/presentation/specification.yaml @@ -181,6 +181,7 @@ - 12 # NDRPDR sel - 13 # NDRPDR sel - 14 # NDRPDR sel + - 16 # NDRPDR sel plot-ligato-throughput-speedup-analysis-3n-hsw: # TODO: Add new data @@ -191,6 +192,7 @@ - 12 # NDRPDR sel - 13 # NDRPDR sel - 14 # NDRPDR sel + - 16 # NDRPDR sel plot-dpdk-throughput-latency-3n-hsw: csit-dpdk-perf-verify-1901-3n-hsw: @@ -376,11 +378,11 @@ # Results vpp-perf-results-3n-hsw: - # TODO: Add FULL data csit-vpp-perf-verify-1901-3n-hsw: - 38 # NDRPDR full - 43 # NDRPDR full - 45 # NDRPDR full + - 49 # NDRPDR full vpp-perf-results-3n-skx: csit-vpp-perf-verify-1901-3n-skx: @@ -1366,6 +1368,7 @@ - 38 # NDRPDR full - 43 # NDRPDR full - 45 # NDRPDR full + - 49 # NDRPDR full - 10 # NDRPDR sel - 19 # NDRPDR sel - 31 # NDRPDR sel @@ -1509,6 +1512,7 @@ - 12 # NDRPDR sel - 13 # NDRPDR sel - 14 # NDRPDR sel + - 16 # NDRPDR sel csit-dpdk-perf-verify-1807-3n-hsw: - 11 - 12 # full |