1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
|
Release Notes
=============
Changes in |csit-release|
-------------------------
#. VPP PERFORMANCE TESTS
- **Service density 2n-skx tests**: Added higher NF density tests with
802.1q (vlan) and 802.1ad (vxlan) encapsulation from Traffic Generator.
- **GBP tests**: Added GBP routing test cases with 802.1q (vlan) external
traffic.
- **AVF IPv4 scale tests**: Increased coverage of AVF IPv4 base and scale
test cases.
- **2n-skx tests**: Increased coverage of selected (COP, iACL, Policer)
test cases.
- **IPsec scale tests**: Added IPsec interface mode scale tests with
1, 40, 400, 1000, 5000, 10000, 20000, 40000, 60000 tunnels. Removed DPDK
backend dependency.
- **Hoststack TCP tests**: Added Hoststack TCP performance tests
using WRK to the HTTP static server plugin measuring connections
per second and requests per second.
- **Changed methodology of dot1q 2n tests**: dot1q encapsulation is now used
on both links of SUT. Previously dot1q was used only on a single link with
the other link carrying untagged Ethernet frames. This change results in
slightly lower throughput in CSIT-1908 for these tests.
#. TEST FRAMEWORK
- **CSIT PAPI Support**: Finished conversion of CSIT VAT L1 keywords to
PAPI L1 KWs in CSIT using VPP Python bindings. Redesign of key components
of PAPI Executor and PAPI history. Currently the only exception is
usage of VAT command for scale configuration.
- **General Code Housekeeping**: Ongoing RF keywords optimizations,
removal of redundant RF keywords and aligning of suite/test
setup/teardowns.
#. PRESENTATION AND ANALYTICS LAYER
- **Graphs Layout Improvements**: Improved performance graphs layout
for better readibility and maintenance: test grouping, axis
labels, descriptions, other informative decoration.
.. raw:: latex
\clearpage
.. _vpp_known_issues:
Known Issues
------------
List of known issues in |csit-release| for VPP performance tests:
+----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+
| # | JiraID | Issue Description |
+====+=========================================+==========================================================================================================+
| 1 | `CSIT-570 | Sporadic (1 in 200) NDR discovery test failures on x520. DPDK reporting rx-errors, indicating L1 issue. |
| | <https://jira.fd.io/browse/CSIT-570>`_ | Suspected issue with HW combination of X710-X520 in LF testbeds. Not observed outside of LF testbeds. |
+----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+
| 2 | `CSIT-1503 | [`TRex-519 <https://trex-tgn.cisco.com/youtrack/issue/trex-519>`_] XL710/XXV710 with FW 6.0.1 will have |
| | <https://jira.fd.io/browse/CSIT-1503>`_ | Rx drop rate of 27MPPS. |
+----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+
| 3 | `CSIT-1499 | AVF tests are sporadically failing on initialization of AVF interface. |
| | <https://jira.fd.io/browse/CSIT-1499>`_ | |
+----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+
|
