path: root/docs/tag_documentation.rst

.. |copy| unicode:: 0xA9 .. copyright sign

| Copyright |copy| 2016 Cisco and/or its affiliates.
| Licensed under the Apache License, Version 2.0 (the "License");
| you may not use this file except in compliance with the License.
| You may obtain a copy of the License at:
|
|     http://www.apache.org/licenses/LICENSE-2.0
|
| Unless required by applicable law or agreed to in writing, software
| distributed under the License is distributed on an "AS IS" BASIS,
| WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
| See the License for the specific language governing permissions and
| limitations under the License.


.. contents:: Table of Contents
    :depth: 2


TAGs and their descriptions
===========================

Documentation for tags used to select and identify test cases.


Topology TAGs
-------------

.. topic:: 3_NODE_DOUBLE_LINK_TOPO

    3 nodes connected in a circular topology with two links interconnecting
    the devices.

.. topic:: 3_NODE_SINGLE_LINK_TOPO

    3 nodes connected in a circular topology with at least one link
    interconnecting devices.

Objective TAGs
--------------

.. topic:: SKIP_PATCH

    Test case(s) marked to not run in case of vpp-csit-verify (i.e. VPP patch)
    and csit-vpp-verify jobs (i.e. CSIT patch).


Environment TAGs
----------------

.. topic:: HW_ENV

    DUTs and TGs are running on bare metal.

.. topic:: VM_ENV

    DUTs and TGs are running in virtual environment.

.. topic:: VPP_VM_ENV

    DUTs with VPP and capable of running Virtual Machine.


NIC model tags
--------------

.. topic:: NIC_Intel-X520-DA2

    Intel X520-DA2 NIC.

.. topic:: NIC_Intel-XL710

    Intel XL710 NIC.

.. topic:: NIC_Intel-X710

    Intel X710 NIC.


Scaling TAGs
------------

.. topic:: FIB_20K

    2x10,000 entries in single fib table

.. topic:: FIB_200K

    2x100,000 entries in single fib table

.. topic:: FIB_2M

    2x1,000,000 entries in single fib table


Tags marking the kinds of tags
------------------------------

.. topic:: FUNCTEST

    All functional test cases.

.. topic:: PERFTEST

    All performance test cases.


Performance testing tags
------------------------

.. topic:: PDRDISC

    Partial Drop Rate evaluation of single run result, with non-zero packet
    loss tolerance (LT) expressed in percentage of packets transmitted.

.. topic:: NDRDISC

    Non Drop Rate evaluation of results. Loss acceptance of dropped packets is
    set to zero lost packets.

.. topic:: NDRCHK

    Performance tests where TG verifies DUTs' throughput at ref-NDR (reference
    Non Drop Rate) with zero packet loss tolerance.

.. topic:: NDRPDRDISC

    Find performance of DUT based on RFC2544 with linear / binary / combined
    search. (Previous LONG tests.)


Test type tags
--------------

.. topic:: BASE

    Baseline test cases, no encapsulation, no feature(s) configured in tests.

.. topic:: SCALE

    Scale test cases.

.. topic:: ENCAP

    Test cases where encapsulation is used. Use also encapsulation tag(s).

.. topic:: FEATURE

    At least one feature is configured in test cases. Use also feature tag(s).


Forwarding mode tags
--------------------

.. topic:: L2BDMACSTAT

    VPP L2 bridge-domain, L2 MAC static.

.. topic:: L2BDMACLRN

    VPP L2 bridge-domain, L2 MAC learning.

.. topic:: L2XCFWD

    VPP L2 point-to-point cross-connect.

.. topic:: IP4FWD

    VPP IPv4 routed forwarding.

.. topic:: IP6FWD

    VPP IPv6 routed forwarding.


Underlay tags
----------

.. topic:: IP4UNRLAY

    IPv4 underlay.

.. topic:: IP6UNRLAY

    IPv6 underlay.

.. topic:: MPLSUNRLAY

    MPLS underlay.


Overlay tags
----------

.. topic:: L2OVRLAY

    L2 overlay.

.. topic:: IP4OVRLAY

    IPv4 overlay (IPv4 payload).

.. topic:: IP6OVRLAY

    IPv6 overlay (IPv6 payload).


Encapsulation tags
------------------

.. topic:: ETH

    All test cases with base Ethernet (no encapsulation).

.. topic:: DOT1Q

    All test cases with dot1q.

.. topic:: DOT1AD

    All test cases with dot1ad.

.. topic:: LISP

    All test cases with LISP.

.. topic:: LISPGPE

    All test cases with LISP-GPE.

.. topic:: VXLAN

    All test cases with Vxlan.

.. topic:: VXLANGPE

    All test cases with VXLAN-GPE.

.. topic:: GRE

    All test cases with GRE.

.. topic:: IPSEC

    All test cases with IPSEC.


Interface tags
--------------

.. topic:: PHY

    All test cases which use physical interface(s).

.. topic:: VHOST

    All test cases which uses VHOST.

.. topic:: TUNTAP

    All test cases which uses TUN and TAP.

.. topic:: AFPKT

    All test cases which uses AFPKT.

.. topic:: NETMAP

    All test cases which uses Netmap.


Feature tags
------------

.. topic:: IACLDST

    iACL destination.

.. topic:: COPWHLIST

    COP whitelist.


Encryption tags
---------------

.. topic:: IPSECSW

    Crypto in software.

.. topic:: IPSECHW

    Crypto in hardware.

.. topic:: IPSECTRAN

    IPSec in transport mode.

.. topic:: IPSECTUN

    IPSec in tunnel mode.


Client-workload tags
--------------------

.. topic:: VM

    All test cases which use at least one virtual machine.

.. topic:: LXC

    All test cases which use Linux container.

.. topic:: APP

    All test cases with specific APP use.


Multi-threading tags
--------------------

.. topic:: STHREAD

    All test cases using single poll mode thread.

.. topic:: MTHREAD

    All test cases using more then one poll mode driver thread.

.. topic:: 1NUMA

    All test cases with packet processing on single socket.

.. topic:: 2NUMA

    All test cases with packet processing on two sockets.

.. topic:: SMT

    All test cases with symmetric Multi-Threading (HyperThreading) enabled.

.. topic:: NOSMT

    All test cases with symmetric Multi-Threading (HyperThreading) disabled.

.. topic:: 1T1C

    1 worker thread pinned to 1 dedicated physical core. 1 receive queue per
    interface. Main thread pinned to core 0.

.. topic:: 2T2C

    2 worker threads pinned to 2 dedicated physical cores. 1 receive queue per
    interface. Main thread pinned to core 0.

.. topic:: 4T4C

    4 worker threads pinned to 4 dedicated physical cores. 2 receive queues per
    interface. Main thread pinned to core 0.

.. topic:: 6T6C

    6 worker threads pinned to 6 dedicated physical cores. 3 receive queues per
    interface. Main thread pinned to core 0.

.. topic:: 8T8C

    8 worker threads pinned to 8 dedicated physical cores. 4 receive queues per
    interface. Main thread pinned to core 0.