blob: 2531c0242f8392103656764676a2231bd1734aa1 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
|
# Copyright (c) 2016 Cisco and/or its affiliates.
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at:
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
Documentation for tags used to select and identify test cases.
List of TAGs and their descriptions
===================================
Topology TAGs
-------------
3_NODE_DOUBLE_LINK_TOPO
3 nodes connected in a circular topology with two links interconnecting
the devices.
3_NODE_SINGLE_LINK_TOPO
3 nodes connected in a circular topology with at least one link
interconnecting devices.
Objective TAGs
--------------
SKIP_PATCH
Test case(s) marked to not run in case of vpp-csit-verify (i.e. VPP patch)
and csit-vpp-verify jobs (i.e. CSIT patch).
Environment TAGs
----------------
HW_ENV
DUTs and TGs are running on bare metal.
VM_ENV
DUTs and TGs are running in virtual environment.
VPP_VM_ENV
DUTs with VPP and capable of running Virtual Machine.
DUT Setup TAGs
--------------
1_THREAD_NOHTT_RSS_1
1 worker thread pinned to dedicated core without use of Hyper-threading
technology with 1 thread per interface. Main thread pinned to core 0.
2_THREAD_NOHTT_RSS_1
2 worker threads each pinned to dedicated core without use of Hyper-threading
technology with 1 thread per interface. Main thread pinned to core 0.
4_THREAD_NOHTT_RSS_2
4 worker threads each pinned to dedicated core without use of Hyper-threading
technology with 2 threads per interface. Main thread pinned to core 0.
6_THREAD_NOHTT_RSS_3
6 worker threads each pinned to dedicated core without use of Hyper-threading
technology with 3 threads per interface. Main thread pinned to core 0.
8_THREAD_HTT_RSS_4
8 worker threads each pinned to dedicated core without use of Hyper-threading
technology with 4 threads per interface. Main thread pinned to core 0.
SINGLE_THREAD
All single threaded test cases.
MULTI_THREAD
All test cases with more then one thread.
Performance testing TAGs
------------------------
PERFTEST
All performance test cases.
PERFTEST_VHOST
All performance test cases that include testing of VHOST with VM.
PERFTEST_SHORT
Performance of DUT should pass specific value. Each test case run is
executed for 10 seconds.
PERFTEST_LONG
Find performance of DUT based on RFC2544 with linear/binary/combined
search. Each test case run is executed for 60 seconds.
PDR
Partial Drop Rate evaluation of single run result. Loss acceptance of
dropped packets from number of sent packet is set as variable in frames or
percentage.
NDR
Non Drop Rate evaluation of results. Loss acceptance of dropped packets is
set to zero lost packets.
Scaling TAGs
------------
FIB_20K
2x10,000 entries in single fib table
FIB_200K
2x100,000 entries in single fib table
FIB_2M
2x1,000,000 entries in single fib table
LISP TAGs
---------
LISP_IPv4
Test Lisp in IPv4 topology
LISP_IPv6
Test Lisp in IPv6 topology
LISP_IPv4oIPv6
Test IPv4 over IPv6 topology
LISP_IPv6oIPv4
Test IPv6 over IPv4 topology
|