blob: b92ecd6bd414a6b35b4312f25183a6e738688e24 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
|
.. |csit| replace:: Continuous System Integration and Testing
|csit| Description
==================
#. Development of software code for fully automated VPP code testing, functionality, performance, regression and new functions.
#. Execution of CSIT test suites on VPP code running on LF FD.io virtual and physical compute environments.
#. Integration with FD.io continuous integration systems (Gerrit, Jenkins and such).
#. Identified existing FD.io project dependencies and interactions:
- vpp - Vector Packet Processing.
- honeycomb - Honeycomb Agent for management plane testing.
- ci-management - Management repo for Jenkins Job Builder, script and management related to the Jenkins CI configuration.
Project Scope
-------------
#. Automated regression testing of VPP code changes
- Functionality of VPP data plane, network control plane, management plane against functional specifications.
- Performance of VPP data plane including non-drop-rate packet throughput and delay, against established reference benchmarks.
- Performance of network control plane against established reference benchmarks.
- Performance of management plane against established reference benchmarks.
#. Test case definitions driven by supported and planned VPP functionality, interfaces and performance:
- Uni-dimensional tests: Data plane, (Network) Control plane, Management plane.
- Multi-dimensional tests: Use case driven.
#. Integration with FD.io Continuous Integration system including FD.io Gerrit and Jenkins
- Automated test execution triggered by VPP-VERIFY jobs other VPP and CSIT project jobs.
#. Integration with LF VPP test execution environment
- Functional tests execution on LF hosted VM environment.
- Performance and functional tests execution on LF hosted physical compute environment.
- Subset of tests executed on LF hosted physical compute running VIRL (Virtual Internet Routing Lab).
|csit| Documentation
--------------------
Python Library
##############
.. toctree::
:maxdepth: 2
:glob:
resources.libraries.python
Robot Library
#############
.. toctree::
:maxdepth: 2
:glob:
resources.libraries.robot
Functional Tests
################
.. toctree::
:maxdepth: 3
:glob:
tests.func
Performance Tests
#################
.. toctree::
:maxdepth: 2
:glob:
tests.perf
Indices and tables
==================
* :ref:`genindex`
* :ref:`modindex`
* :ref:`search`
|
