aboutsummaryrefslogtreecommitdiffstats
diff options
context:
space:
mode:
-rw-r--r--docs/report/testpmd_performance_tests/csit_release_notes.rst2
-rw-r--r--docs/report/vpp_functional_tests/csit_release_notes.rst32
-rw-r--r--docs/report/vpp_performance_tests/csit_release_notes.rst4
-rw-r--r--docs/report/vpp_unit_tests/overview.rst2
-rwxr-xr-xresources/tools/report_gen/run_report.sh2
5 files changed, 22 insertions, 20 deletions
diff --git a/docs/report/testpmd_performance_tests/csit_release_notes.rst b/docs/report/testpmd_performance_tests/csit_release_notes.rst
index 7f87d247c9..72bef87ce4 100644
--- a/docs/report/testpmd_performance_tests/csit_release_notes.rst
+++ b/docs/report/testpmd_performance_tests/csit_release_notes.rst
@@ -20,6 +20,6 @@ Here is the list of known issues in CSIT |release| for Testpmd performance tests
| | of discovered NDR throughput values across | | throughput. Applies to XL710 and X710 NICs, no issues observed |
| | multiple test runs with xl710 and x710 NICs. | | on x520 NICs. |
+---+---------------------------------------------------+------------+-----------------------------------------------------------------+
-| 2 | Lower than expected NDR throughput with xl710 | CSIT-? | Suspected NIC firmware or DPDK driver issue affecting NDR |
+| 2 | Lower than expected NDR throughput with xl710 | CSIT-571 | Suspected NIC firmware or DPDK driver issue affecting NDR |
| | and x710 NICs, compared to x520 NICs. | | throughput. Applies to XL710 and X710 NICs. |
+---+---------------------------------------------------+------------+-----------------------------------------------------------------+ \ No newline at end of file
diff --git a/docs/report/vpp_functional_tests/csit_release_notes.rst b/docs/report/vpp_functional_tests/csit_release_notes.rst
index 8f63b8ed01..25ca27c03f 100644
--- a/docs/report/vpp_functional_tests/csit_release_notes.rst
+++ b/docs/report/vpp_functional_tests/csit_release_notes.rst
@@ -6,11 +6,10 @@ Changes in CSIT |release|
#. VPP functional test environment changes
-#. Implemented VAT command history collection for every test case as part of teardown
-
+ - Implemented VAT command history collection for every test case as part of teardown.
- Introduction of Centos7 tests in VIRL environment.
-#. VPP performance test framework changes
+#. VPP functional test framework changes
- Added VAT command history collection for every test case as part of teardown.
@@ -21,7 +20,6 @@ Changes in CSIT |release|
- IPv4 routed-forwarding with vhost-user interfaces to VM.
- Vhost-user interface re-connect tests.
->>>>>>> csit rls1704 report - updated csit_release_notes.rst and overview.rst files.
Known Issues
------------
@@ -55,17 +53,21 @@ Here is the list of known issues in CSIT |release| for VPP functional tests in V
| | | | destination address is reported. |
+---+-------------------------------------------------+----------+------------------------------------------------------+
| 6 | IPv4 + VLAN: Processing of tagged frame doesn't | CSIT-564 | Dot1q tagged packets are thrown away in case of IPv4 |
-| | work with virtio driver | | routing on interface binded to virtio driver. |
+| | work with virtio driver | | routing on interface binded to virtio driver. Issue |
+| | | | with VIRL test simulation environment |
+---+-------------------------------------------------+----------+------------------------------------------------------+
-| 7 | VHOST-user: QEMU re-connect doesn't work | CSIT-565 | Used QEMU 2.5.0 doesn't support re-connection. Usage |
-| | | | of QEMU 2.7.0 is not recommended by vpp-dev team at |
-| | | | the moment. |
+| 7 | Vhost-user: QEMU reconnect doesn't work | CSIT-565 | Using QEMU 2.5.0 that does not support vhost-user |
+| | | | reconnect. It requires moving CSIT VIRL environment |
+| | | | to QEMU 2.7.0. |
+---+-------------------------------------------------+----------+------------------------------------------------------+
-| 8 | Centos7: LISP and VXLAN test failures | CSIT-566 | We can observe crash of SUT1 VM during LISP tests |
-| | | | execution, that leads to failure of all other tests |
-| | | | (sometimes observed during VXLAN tests execution |
-| | | | too). NOTE: Possible root cause identified after |
-| | | | upgrade of one of VIRL servers. When fix is |
-| | | | confirmed in a short time it will be merged to CSIT |
-| | | | rls1704 branch. |
+| 8 | Centos7: LISP and VXLAN sporadic test failures | CSIT-566 | Observing sporadic crashes of DUT1 VM during LISP |
+| | | | and VXLAN test executions, what leads to failure of |
+| | | | all other tests in the suite. NOTE: After upgrading |
+| | | | one of the VIRL servers host from Ubuntu14.04 to |
+| | | | 16.04, DUT1 VM stops crashing, but tests keep |
+| | | | failing sporadically 1-in-100. Possible root cause |
+| | | | identified - unexpected IPv6 RA packets upsetting |
+| | | | some test component. Currently suspecting |
+| | | | environment or CSIT issue, but can not exclude VPP, |
+| | | | further troubleshooting in progress. |
+---+-------------------------------------------------+----------+------------------------------------------------------+
diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst
index 7c17e0f448..b4fc9de3c9 100644
--- a/docs/report/vpp_performance_tests/csit_release_notes.rst
+++ b/docs/report/vpp_performance_tests/csit_release_notes.rst
@@ -215,14 +215,14 @@ Here is the list of known issues in CSIT |release| for VPP performance tests:
| | routes - 2M in this case. ip6scale2kk works. | | |
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+
| 3 | Vic1385 and Vic1227 low performance | VPP-664 | Low NDR performance. |
-| | | | . |
+| | | | |
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+
| 4 | Sporadic NDR discovery test failures on x520 | CSIT-750 | Suspected issue with HW settings (BIOS, FW) in LF |
| | | | infrastructure. Issue can't be replicated outside LF. |
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+
| 5 | VPP in 2t2c setups - large variation | CSIT-568 | Suspected NIC firmware or DPDK driver issue affecting NDR |
| | of discovered NDR throughput values across | | throughput. Applies to XL710 and X710 NICs, x520 NICs are fine. |
-| | multiple test runs with xl710 and x710 NICs. | | . |
+| | multiple test runs with xl710 and x710 NICs. | | |
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+
| 6 | Lower than expected NDR and PDR throughput with | CSIT-569 | Suspected NIC firmware or DPDK driver issue affecting NDR and |
| | xl710 and x710 NICs, compared to x520 NICs. | | PDR throughput. Applies to XL710 and X710 NICs. |
diff --git a/docs/report/vpp_unit_tests/overview.rst b/docs/report/vpp_unit_tests/overview.rst
index 2848db7ddc..4ef50f53c0 100644
--- a/docs/report/vpp_unit_tests/overview.rst
+++ b/docs/report/vpp_unit_tests/overview.rst
@@ -33,7 +33,7 @@ Unit Tests Coverage
-------------------
Following VPP functional test areas are covered in VPP unit test code included
-in VPP rls1701 with results listed in this report:
+in VPP rls1704 with results listed in this report:
- CRUD Loopback - create, read, update, delete Loopback interfaces.
- Flow-per-packet plugin - collect and report L2 and IP4 flow statistics.
diff --git a/resources/tools/report_gen/run_report.sh b/resources/tools/report_gen/run_report.sh
index 00fbdfd63d..4aa15b7e17 100755
--- a/resources/tools/report_gen/run_report.sh
+++ b/resources/tools/report_gen/run_report.sh
@@ -238,7 +238,7 @@ sed -i -e "s@###LINK###@${JEN_URL}\/${JEN_JOB}\/${JEN_BUILD[-1]}@g" \
### FUNCTIONAL SOURCE DATA
JEN_JOB='csit-vpp-functional-1704-ubuntu1604-virl'
-JEN_BUILD=57
+JEN_BUILD=63
if [[ ${DEBUG} -eq 1 ]] ;
then