1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
|
# CSIT progressions.
64b-2t1c-avf-1lbvpplacp-dot1q-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc: 7
64b-2t1c-avf-1lbvpplacp-dot1q-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc: 7
64b-2t1c-avf-dot1q-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc: 5
64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc: 5
64b-2t1c-avf-eth-l2xcbase: 4
64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc: 5
64b-2t1c-avf-ethip4-ip4base-eth-2vhostvr1024-1vm-vppip4: 5
64b-2t1c-ethip4-ip4base-eth-2vhostvr1024-1vm: 7
# CSIT regressions.
64b-2t1c-avf-eth-l2bdscale1mmaclrn: 7
64b-2t1c-avf-ethip4-ip4scale2m: 7
64b-2t1c-ethip4-ip4scale2m: 7
imix-2t1c-avf-ethip4ipsec4tnlsw-ip4base-int-aes256gcm: 6
imix-2t1c-avf-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm: 6
imix-2t1c-avf-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm: 6
imix-2t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm: 6
imix-2t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm: 6
# Multiline string, empty lines (or \n) are required,
# see https://yaml-multiline.info/
footnote: "
[4] DONE Progression in high performance tests, caused by
TRex setting improvement, Gerrit 26445. [CSIT-1740]
[5] DONE Progression in performance of tests running VPP (l2xc) inside VM.
Consequence of a fix making worker placement deterministic, Gerrit 25309.
[CSIT-1738]
[6] OPEN Regression in CSIT, one specific test showing too small stdev
to be considered noise. Tentatively marking also other ipsec anomalies
with this, although their stdev are high enough to be explained
as maybe just noise. [CSIT-1742]
[7] POSTPONED Possible anomaly, but stdev of results is high.
Currently, the performance differences are considered to probably be just noise.
[8] DONE Regressions in some tests with VPP in VM.
Tests using l2xcbase as vswitch have small enough stdev for bisect.
The switch to clang-9 compiler, Gerrit 26744, has been identified as the cause.
[CSIT-1741]
[9] OPEN Progression in ip6 scale tests. Multiple candidate changes may have
affect code efficiency, but they have also caused the tests to fail
for a period of time. [CSIT-1735]
[10] OPEN Progression in ip6 base tests with dot1q. [CSIT-1746]
[11] OPEN Progression in memif tests, mainly in avf-eth-l2xcbase-eth-2memif-1dcr.
Not sure whether all memif tests are affected, nor what the cause is.
[CSIT-1744]
[12] OPEN Progression in some l2bdscale tests. [CSIT-1745]
[16] OPEN Progression in IPsec tests, only for aes128cbc-hmac512sha. [CSIT-1748]
[17] OPEN Progression in some vhost tests (dpdk in VM). [CSIT-1749]
"
|
