blob: 6cf529e78681fb65f7adb155d0ef56eb095e9495 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
|
Release Notes
=============
..
Changes in |csit-release|
-------------------------
#. VPP PERFORMANCE TESTS
- **Service density 2n-skx tests**: Network Function Virtualization (NFV)
service density tests focus on measuring total per server throughput at
varied NFV service *packing* densities with vswitch providing host
dataplane. The goal is to compare and contrast performance of a shared
vswitch for different network topologies and virtualization technologies,
and their impact on vswitch performance and efficiency in a range of NFV
service configurations.
- **Experimental Soak Tests**: Added performamce soak tests framework
code for extended time duration tests and throughput discovery
at given PLR and at give total test time e.g. minutes, hours,
days, weeks, months, years. See updated
:ref:`test_methodology` section for more details.
#. TEST FRAMEWORK
- **Container code optimizations**: Optimized container library allows to
run containre_memif tests faster.
- **CSIT PAPI Support**: Continue converting existing VAT L1 keywords to
PAPI L1 KWs in CSIT using VPP Python bindings. Required for migrating away
from VAT.
- **General Code Housekeeping**: Ongoing RF keywords optimizations,
removal of redundant RF keywords.
#. PRESENTATION AND ANALYTICS LAYER
- **Graphs Layout Improvements**: Improved performance graphs layout
for better readibility and maintenance: test grouping, axis
labels, descriptions, other informative decoration.
#. MISCELLANEOUS
- **3n-dnv Tests (3rd Party)**: Published performance tests for 3n-
dnv (3-Node Atom Denverton) from 3rd party testbeds running FD.io
|csit-release| automated testing code.
Only graphs for Packet Throughput and Speedup Multi-core and not
for Packet Latency were published as there are no results for Packet
Latency available.
.. note::
|csit-release| report was generated with a single run of selected
64B frame performance tests on 3n-hsw and 3n-skx test beds
in order to spot-check the main data plane paths.
NFV service density and soak tests were not run and do not feature in
this report.
.. _vpp_known_issues:
Known Issues
------------
List of known issues in |csit-release| for VPP performance tests:
+----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
| # | JiraID | Issue Description |
+====+=========================================+=================================================================================================================================+
| 1 | `CSIT-570 | Sporadic (1 in 200) NDR discovery test failures on x520. DPDK reporting rx-errors, indicating L1 issue. |
| | <https://jira.fd.io/browse/CSIT-570>`_ | Suspected issue with HW combination of X710-X520 in LF testbeds. Not observed outside of LF testbeds. |
+----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
| 2 | `VPP-1563 | AVF L2patch tests are failing for all packet size and core combination. Reason: null-node blackholed packets in show error. |
| | <https://jira.fd.io/browse/VPP-1563>`_ | |
+----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
| 3 | `CSIT-1465 | 4c VPP VM vhost tests failiing on 3n-skx |
| | <https://jira.fd.io/browse/CSIT-1465>`_ | |
+----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+
|
