aboutsummaryrefslogtreecommitdiffstats
path: root/docs/report/vpp_functional_tests/csit_release_notes.rst
blob: fd71d78f409fe216c9557598d452dafef9858b1a (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
CSIT Release Notes
==================

Changes in CSIT |release|
-------------------------

#. VPP functional test framework changes:

   - Upgrade of tb4-virl1 and tb4-virl2 hosts;

     - OS version to Ubuntu 16.04.02;

     - VIRL version to Mitaka;

   - Implemented load balance mechanism for VIRL hosts;

   - Implemented waiting mechanism on VIRL host if there is not enough resources
     available to successfully start simulation;

#. Code updates and optimizations in CSIT functional framework:

   - Complete CSIT framework code revision and optimizations as descried
     on CSIT wiki page
     _`Design_Optimizations <https://wiki.fd.io/view/CSIT/Design_Optimizations>`_;

   - For more detail see the CSIT Framework Design section in this
     report;

Known Issues
------------

Here is the list of known issues in CSIT |release| for VPP functional tests in VIRL:

+---+-------------------------------------------------+----------+------------------------------------------------------+
| # | Issue                                           | Jira ID  | Description                                          |
+---+-------------------------------------------------+----------+------------------------------------------------------+
| 1 | DHCPv4 client: Client responses to DHCPv4 OFFER | CSIT-129 | Client replies with DHCPv4 REQUEST message when      |
|   | sent with different XID.                        |          | received DHCPv4 OFFER message with different (wrong) |
|   |                                                 |          | XID.                                                 |
+---+-------------------------------------------------+----------+------------------------------------------------------+
| 2 | Softwire - MAP-E: Incorrect calculation of IPv6 | CSIT-398 | IPv6 destination address is wrongly calculated in    |
|   | destination address when IPv4 prefix is 0.      |          | case that IPv4 prefix is equal to 0 and IPv6 prefix  |
|   |                                                 |          | is less than 40.                                     |
+---+-------------------------------------------------+----------+------------------------------------------------------+
| 3 | Softwire - MAP-E: Map domain is created when    | CSIT-399 | Map domain is created in case that the sum of suffix |
|   | incorrect parameters provided.                  |          | length of IPv4 prefix and PSID length is greater     |
|   |                                                 |          | than EA bits length. IPv6 destination address        |
|   |                                                 |          | contains bits writen with PSID over the EA-bit       |
|   |                                                 |          | length when IPv4 packet is sent.                     |
+---+-------------------------------------------------+----------+------------------------------------------------------+
| 4 | IPv6 RA: Incorrect IPv6 destination address in  | CSIT-409 | Wrong IPv6 destination address (ff02::1) is used in  |
|   | response to ICMPv6 Router Solicitation.         |          | ICMPv6 Router Advertisement packet sent as a         |
|   |                                                 |          | response to received  ICMPv6 Router Solicitation     |
|   |                                                 |          | packet.                                              |
+---+-------------------------------------------------+----------+------------------------------------------------------+
| 5 | Vhost-user: QEMU reconnect does not work.       | CSIT-565 | Using QEMU 2.5.0 that does not support vhost-user    |
|   |                                                 |          | reconnect. It requires moving CSIT VIRL environment  |
|   |                                                 |          | to QEMU 2.7.0.                                       |
+---+-------------------------------------------------+----------+------------------------------------------------------+
| 6 | Centos7: LISP and VXLAN sporadic test failures. | CSIT-566 | Observing sporadic crashes of DUT1 VM during LISP    |
|   |                                                 |          | and VXLAN test executions, what leads to failure of  |
|   |                                                 |          | all other tests in the suite. NOTE: After upgrading  |
|   |                                                 |          | one of the VIRL servers host from Ubuntu14.04 to     |
|   |                                                 |          | 16.04, DUT1 VM stops crashing, but tests keep        |
|   |                                                 |          | failing sporadically 1-in-100. Possible root cause   |
|   |                                                 |          | identified - unexpected IPv6 RA packets upsetting    |
|   |                                                 |          | some test component. Currently suspecting            |
|   |                                                 |          | environment or CSIT issue, but can not exclude VPP,  |
|   |                                                 |          | further troubleshooting in progress.                 |
+---+-------------------------------------------------+----------+------------------------------------------------------+
| 7 | IPSEC: Tests cover old crypto code path         |    --    | There are used default conf settings so IPSEC tests  |
|   |                                                 |          | use old security code not the new Crypto SW code.    |
+---+-------------------------------------------------+----------+------------------------------------------------------+