aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools/doc_gen/src/overview.rst
blob: f9cc4e4ed432a23d056868ffb024184f23777002 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
.. |csit| replace:: Continuous System Integration and Testing

CSIT Description
================

#. Development of software code for fully automated VPP code testing,
   functionality, performance, regression and new functions.

#. Execution of CSIT test suites on VPP code running on LF FD.io virtual and
   physical compute environments.

#. Integration with FD.io continuous integration systems (Gerrit, Jenkins and
   such).

#. Identified existing FD.io project dependencies and interactions:

    - vpp - Vector Packet Processing.
    - honeycomb - Honeycomb Agent for management plane testing.
    - ci-management - Management repo for Jenkins Job Builder, script and
      management related to the Jenkins CI configuration.

Project Scope
-------------

#. Automated regression testing of VPP code changes

    - Functionality of VPP data plane, network control plane, management plane
      against functional specifications.
    - Performance of VPP data plane including non-drop-rate packet throughput
      and delay, against established reference benchmarks.
    - Performance of network control plane against established reference
      benchmarks.
    - Performance of management plane against established reference benchmarks.

#. Test case definitions driven by supported and planned VPP functionality,
   interfaces and performance:

    - Uni-dimensional tests: Data plane, (Network) Control plane, Management
      plane.
    - Multi-dimensional tests: Use case driven.

#. Integration with FD.io Continuous Integration system including FD.io Gerrit
   and Jenkins

    - Automated test execution triggered by VPP-VERIFY jobs other VPP and CSIT
      project jobs.

#. Integration with LF VPP test execution environment

    - Functional tests execution on LF hosted VM environment.
    - Performance and functional tests execution on LF hosted physical compute
      environment.
    - Subset of tests executed on LF hosted physical compute running VIRL
      (Virtual Internet Routing Lab).