aboutsummaryrefslogtreecommitdiffstats
diff options
context:
space:
mode:
authorJan Gelety <jgelety@cisco.com>2017-07-20 16:54:48 +0200
committerPeter Mikus <pmikus@cisco.com>2017-07-21 11:14:12 +0000
commit052a9815b3487d3d2827b7651ac8a22f4b163d7c (patch)
treeb7cfd8aead1c843dace8d32cadaa0d23b22730e7
parent2266bd1ae66cb688fd7786c22d8b1770e02fd838 (diff)
rls1707 report: edits of vpp_functional_tests/rls_notes
- updated section "Changes in CSIT" - updated section "Known Issues" Change-Id: I32e014889d4846f1a915e302a1c8fe93146444b8 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit b6872c6baf0cb9d7cee3bba633c2cf851d2419b4)
-rw-r--r--docs/report/vpp_functional_tests/csit_release_notes.rst42
-rw-r--r--docs/report/vpp_functional_tests/test_environment.rst2
2 files changed, 22 insertions, 22 deletions
diff --git a/docs/report/vpp_functional_tests/csit_release_notes.rst b/docs/report/vpp_functional_tests/csit_release_notes.rst
index afd2a68cfa..fd71d78f40 100644
--- a/docs/report/vpp_functional_tests/csit_release_notes.rst
+++ b/docs/report/vpp_functional_tests/csit_release_notes.rst
@@ -4,21 +4,27 @@ CSIT Release Notes
Changes in CSIT |release|
-------------------------
-#. VPP functional test environment changes
+#. VPP functional test framework changes:
- - Implemented VAT command history collection for every test case as part of teardown.
- - Introduction of Centos7 tests in VIRL environment.
+ - Upgrade of tb4-virl1 and tb4-virl2 hosts;
-#. VPP functional test framework changes
+ - OS version to Ubuntu 16.04.02;
- - Added VAT command history collection for every test case as part of teardown.
+ - VIRL version to Mitaka;
-#. Added VPP functional tests
+ - Implemented load balance mechanism for VIRL hosts;
- - IPv4 routed-forwarding with dot1q VLAN sub-interfaces.
- - L2BD switched-forwarding with dot1q VLAN sub-interfaces and vhost-user to VM.
- - IPv4 routed-forwarding with vhost-user interfaces to VM.
- - Vhost-user interface re-connect tests.
+ - Implemented waiting mechanism on VIRL host if there is not enough resources
+ available to successfully start simulation;
+
+#. Code updates and optimizations in CSIT functional framework:
+
+ - Complete CSIT framework code revision and optimizations as descried
+ on CSIT wiki page
+ _`Design_Optimizations <https://wiki.fd.io/view/CSIT/Design_Optimizations>`_;
+
+ - For more detail see the CSIT Framework Design section in this
+ report;
Known Issues
------------
@@ -47,20 +53,11 @@ Here is the list of known issues in CSIT |release| for VPP functional tests in V
| | | | response to received ICMPv6 Router Solicitation |
| | | | packet. |
+---+-------------------------------------------------+----------+------------------------------------------------------+
-| 5 | IPFIX: IPv6_src key name reported instead of | CSIT-402 | The report contains IPv6_src key name instead of |
-| | IPv6_dst. | | IPv6_dst when classify session is configured with |
-| | | | IPv6 destination address. Anyhow the correct IPv6 |
-| | | | destination address is reported. |
-+---+-------------------------------------------------+----------+------------------------------------------------------+
-| 6 | IPv4 + VLAN: Processing of tagged frame does | CSIT-564 | Dot1q tagged packets are thrown away in case of IPv4 |
-| | not work with virtio driver. | | routing on interface binded to virtio driver. Issue |
-| | | | with VIRL test simulation environment. |
-+---+-------------------------------------------------+----------+------------------------------------------------------+
-| 7 | Vhost-user: QEMU reconnect does not work. | CSIT-565 | Using QEMU 2.5.0 that does not support vhost-user |
+| 5 | Vhost-user: QEMU reconnect does not work. | CSIT-565 | Using QEMU 2.5.0 that does not support vhost-user |
| | | | reconnect. It requires moving CSIT VIRL environment |
| | | | to QEMU 2.7.0. |
+---+-------------------------------------------------+----------+------------------------------------------------------+
-| 8 | Centos7: LISP and VXLAN sporadic test failures. | CSIT-566 | Observing sporadic crashes of DUT1 VM during LISP |
+| 6 | Centos7: LISP and VXLAN sporadic test failures. | CSIT-566 | Observing sporadic crashes of DUT1 VM during LISP |
| | | | and VXLAN test executions, what leads to failure of |
| | | | all other tests in the suite. NOTE: After upgrading |
| | | | one of the VIRL servers host from Ubuntu14.04 to |
@@ -71,3 +68,6 @@ Here is the list of known issues in CSIT |release| for VPP functional tests in V
| | | | environment or CSIT issue, but can not exclude VPP, |
| | | | further troubleshooting in progress. |
+---+-------------------------------------------------+----------+------------------------------------------------------+
+| 7 | IPSEC: Tests cover old crypto code path | -- | There are used default conf settings so IPSEC tests |
+| | | | use old security code not the new Crypto SW code. |
++---+-------------------------------------------------+----------+------------------------------------------------------+
diff --git a/docs/report/vpp_functional_tests/test_environment.rst b/docs/report/vpp_functional_tests/test_environment.rst
index ba9b0f01d1..93e3955f6f 100644
--- a/docs/report/vpp_functional_tests/test_environment.rst
+++ b/docs/report/vpp_functional_tests/test_environment.rst
@@ -2,7 +2,7 @@ Test Environment
================
CSIT functional tests are currently executed in FD.IO VIRL testbed. The physical
-VIRL testbed infrastructure consists of three identical VIRL hosts:
+VIRL testbed infrastructure consists of three VIRL hosts:
- All hosts are Cisco UCS C240-M4 (2x Intel(R) Xeon(R) CPU E5-2699 v3 @2.30GHz,
18c, 512GB RAM)