diff options
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/honeycomb_url_files.rst | 22 | ||||
| -rw-r--r-- | docs/report/detailed_test_results/honeycomb_functional_results/index.rst | 13 | ||||
| -rw-r--r-- | docs/report/honeycomb_functional_tests/csit_release_notes.rst | 23 | ||||
| -rw-r--r-- | docs/report/honeycomb_functional_tests/documentation.rst | 5 | ||||
| -rw-r--r-- | docs/report/honeycomb_functional_tests/index.rst | 9 | ||||
| -rw-r--r-- | docs/report/honeycomb_functional_tests/overview.rst | 237 | ||||
| -rw-r--r-- | docs/report/honeycomb_functional_tests/test_environment.rst | 7 | ||||
| -rw-r--r-- | docs/report/index.html.template | 11 | ||||
| -rw-r--r-- | docs/report/introduction/introduction.rst | 10 |
9 files changed, 0 insertions, 337 deletions
diff --git a/docs/honeycomb_url_files.rst b/docs/honeycomb_url_files.rst deleted file mode 100644 index 4dfa10c516..0000000000 --- a/docs/honeycomb_url_files.rst +++ /dev/null @@ -1,22 +0,0 @@ -# Copyright (c) 2016 Cisco and/or its affiliates. -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not use this file except in compliance with the License. -# You may obtain a copy of the License at: -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - -Documentation to files used to store URLs to resources in Honeycomb. -==================================================================== - -A URL file is a text file encoded in utf-8 with a path to a resource in -Honeycomb. There is only one line in each file. - -The URL is stored without host and port with leading slash. There is no slash at -the end, e.g.: - /restconf/config/v3po:vpp/bridge-domains diff --git a/docs/report/detailed_test_results/honeycomb_functional_results/index.rst b/docs/report/detailed_test_results/honeycomb_functional_results/index.rst deleted file mode 100644 index ea31695619..0000000000 --- a/docs/report/detailed_test_results/honeycomb_functional_results/index.rst +++ /dev/null @@ -1,13 +0,0 @@ -HoneyComb Functional -==================== - -.. note:: - - Data sources for reported test results: i) `FD.io test executor Honeycomb - functional jobs`_, ii) archived FD.io jobs test result `output files - <../../_static/archive/>`_. - -.. toctree:: - - honeycomb_functional_results - diff --git a/docs/report/honeycomb_functional_tests/csit_release_notes.rst b/docs/report/honeycomb_functional_tests/csit_release_notes.rst deleted file mode 100644 index ec0bb75b31..0000000000 --- a/docs/report/honeycomb_functional_tests/csit_release_notes.rst +++ /dev/null @@ -1,23 +0,0 @@ -Release Notes -============= - -Changes in |csit-release| -------------------------- - -No changes. - -Known Issues ------------- - -Here is the list of known issues in |csit-release| for Honeycomb functional -tests in VIRL: - -+---+----------------------------------------------+--------------------------------------------------------------------------------------------------------+ -| # | JiraID | Issue Description | -+===+==============================================+========================================================================================================+ -| 1 | `HC2VPP-263 | LISP PITR feature configuration. | -| | <https://jira.fd.io/browse/HC2VPP-263>`_ | Locator set reference in operational data is incorrect. | -+---+----------------------------------------------+--------------------------------------------------------------------------------------------------------+ -| 2 | `CSIT-1210 | Unnumbered interface configuration. | -| | <https://jira.fd.io/browse/CSIT-1210>`_ | VPP does not send IP addresses for unnumbered interfaces anymore. HC CSIT tests were relying on that. | -+---+----------------------------------------------+--------------------------------------------------------------------------------------------------------+ diff --git a/docs/report/honeycomb_functional_tests/documentation.rst b/docs/report/honeycomb_functional_tests/documentation.rst deleted file mode 100644 index 354c4062f6..0000000000 --- a/docs/report/honeycomb_functional_tests/documentation.rst +++ /dev/null @@ -1,5 +0,0 @@ -Documentation -============= - -`CSIT Honeycomb Functional Tests Documentation`_ contains detailed -functional description and input parameters for each test case. diff --git a/docs/report/honeycomb_functional_tests/index.rst b/docs/report/honeycomb_functional_tests/index.rst deleted file mode 100644 index ba0b8a0c19..0000000000 --- a/docs/report/honeycomb_functional_tests/index.rst +++ /dev/null @@ -1,9 +0,0 @@ -HoneyComb Functional -==================== - -.. toctree:: - - overview - csit_release_notes - test_environment - documentation diff --git a/docs/report/honeycomb_functional_tests/overview.rst b/docs/report/honeycomb_functional_tests/overview.rst deleted file mode 100644 index 2332169729..0000000000 --- a/docs/report/honeycomb_functional_tests/overview.rst +++ /dev/null @@ -1,237 +0,0 @@ -Overview -======== - -Virtual Topologies ------------------- - -CSIT HoneyComb functional tests are executed in VM-based virtual topologies -created on demand using :abbr:`VIRL (Virtual Internet Routing Lab)` -simulation platform contributed by Cisco. VIRL runs on physical -baremetal servers hosted by LF FD.io project. - -All tests are executed in two-node virtual test topology shown in the -figure below. - -.. only:: latex - - .. raw:: latex - - \begin{figure}[H] - \centering - \graphicspath{{../_tmp/src/vpp_functional_tests/}} - \includegraphics[width=0.90\textwidth]{virtual-2n-nic2nic} - \label{fig:virtual-2n-nic2nic} - \end{figure} - -.. only:: html - - .. figure:: ../vpp_functional_tests/virtual-2n-nic2nic.svg - :alt: virtual-2n-nic2nic - :align: center - -SUT (System Under Test) is a VM running Ubuntu Linux (or Centos, -depending on the test suite), TG (Traffic Generator) is another VM -running Ubuntu Linux. SUT VMs run HoneyComb management agent and VPP in -Linux user-mode as a combined DUT (Device Under Test). TG runs Scapy -application as a packet Traffic Generator. Virtual connectivity between -SUT and TG is provided using virtual NICs using VMs' virtio drivers. - -Functional Tests Coverage -------------------------- - -|csit-release| includes following HoneyComb functionality tested in -virtual VM environment: - -+-----------------------+----------------------------------------------+ -| Functionality | Description | -+=======================+==============================================+ -| ACL | - CRD for low-level classifiers: table and | -| | session management, interface assignment. | -| | - Configure up to 2 classify tables. | -| | - Configure up to 2 classify sessions on one | -| | table. | -| | - Assign classify session to a physical | -| | interface. | -| | - Remove tables, sessions, interface | -| | assignments. | -| | - Test case count: 9. | -+-----------------------+----------------------------------------------+ -| ACL-PLUGIN | - CRD for high-level classifier. | -| | - MAC + IP address classification. | -| | - IPv4, IPv6 address classification. | -| | - TCP, UDP, ICMP, ICMPv6 protocol and | -| | next-header classification. | -| | - port number classification. | -| | - ICMP, ICMPv6 code and type classification. | -| | - Test case count: 15. | -+-----------------------+----------------------------------------------+ -| Basic interface | - CRUD for interface state. | -| management | - ipv4/ipv6 address, ipv4 neighbor, MTU | -| | value. | -| | - Test case count: 14. | -+-----------------------+----------------------------------------------+ -| Border Gateway | - CRUD and functional tests for BGP. | -| Protocol | - Configure peers and routes | -| | - Check interactions with another BGP peer. | -| | - Test case count: 13. | -+-----------------------+----------------------------------------------+ -| DHCP Relay | - CRD for DHCP relay feature. | -| | - Configure DHCP Relays. | -| | - IPv4 and IPv6 variants. | -| | - Test case count: 4. | -+-----------------------+----------------------------------------------+ -| Honeycomb | - Configuration persistence. | -| Infractructure | - Netconf notifications for interface | -| | events. | -| | - Netconf negative tests aimed at specific | -| | issues. | -| | - Netconf/Restconf northbound over IPv6. | -| | - Test case count: 14. | -+-----------------------+----------------------------------------------+ -| L2BD | - CRUD for L2 Bridge-Domain, interface | -| | assignment. | -| | - Create up to two bridge domains with all | -| | implemented functions turned on: | -| | flooding, unknown-unicast flooding, | -| | forwarding, learning, arp-termination. | -| | - Assign up to two physical interfaces to a | -| | single bridge domain. | -| | - Remove interface assignments, remove | -| | bridge domains. | -| | - Test case count: 5. | -+-----------------------+----------------------------------------------+ -| L2FIB | - CRD for L2-FIB entries. | -| | - Create 4 FIB entries: | -| | one of each for filter/forward, | -| | static/dynamic combinations. | -| | - Remove FIB entries. | -| | - Test case count: 7. | -+-----------------------+----------------------------------------------+ -| LISP | - CRD for Lisp: mapping, locator set, | -| | adjacency, mapresolver. | -| | - Toggle Lisp feature status. | -| | - Configure and delete Lisp mapping as local | -| | and remote. | -| | - Configure and delete Lisp adjacency | -| | mapping. | -| | - Configure and delete Lisp map resolver, | -| | proxy ITR. | -| | - Test case count: 18. | -+-----------------------+----------------------------------------------+ -| LISP GPE | - CRUD for LISP GPE mappings. | -| | - Toggle Lisp GPE feature status. | -| | - Configure Lisp GPE mappings. | -| | - Traffic test verifying encapsulation. | -| | - Test case count: 12. | -+-----------------------+----------------------------------------------+ -| NAT | - CRD for NAT entries, interface assignment. | -| | - Configure and delete up to two NAT | -| | entries. | -| | - Assign NAT entries to a physical | -| | interface. | -| | - Test case count: 6. | -+-----------------------+----------------------------------------------+ -| NSH_SFC (excluded) | - CRD for NSH maps and entries, using | -| | NSH_SFC plugin. | -| | - Configure up to 2 NSH entries. | -| | - Configure up to 2 NSH maps. | -| | - Modify and delete NSH maps and entries. | -| | - Test case count: 8. | -+-----------------------+----------------------------------------------+ -| PBB | - CRD for provider backbone bridge | -| | sub-interface. | -| | - Configure, modify and remove a PBB | -| | sub-interface over a physical interface. | -| | - Test case count: 8. | -+-----------------------+----------------------------------------------+ -| Policer | - CRD for traffic policing feature. | -| | - Configure Policing rules. | -| | - Assign to interface. | -| | - Test case count: 6. | -+-----------------------+----------------------------------------------+ -| Port mirroring | - CRD for SPAN port mirroring, interface | -| | assignment. | -| | - Configure SPAN port mirroring on a | -| | physical interface, mirroring. | -| | - up to 2 interfaces. | -| | - Remove SPAN configuration from interfaces. | -| | - Test case count: 14. | -+-----------------------+----------------------------------------------+ -| ProxyARP | - CRD for proxyARP feature. | -| | - Configure proxyARP. | -| | - Assign to interface. | -| | - Test case count: 3. | -+-----------------------+----------------------------------------------+ -| ProxyND6 | - CRD for Neighbor Discovery Proxy. | -| | - Configure ProxyND6 feature on interface. | -| | - Test case count: 4. | -+-----------------------+----------------------------------------------+ -| Routing | - CRD for routing. | -| | - Configure single-hop route. | -| | - Configure multi-hop routes. | -| | - Configure blackhole route. | -| | - IPv4 and IPv6 variants. | -| | - Test case count: 6. | -+-----------------------+----------------------------------------------+ -| SLAAC | - CRD for Stateless Address | -| | AutoConfiguration. | -| | - Configure SLAAC feature on interfaces. | -| | - Test case count: 7. | -+-----------------------+----------------------------------------------+ -| Vhost-user | - CRUD for Vhost-user interfaces. | -| | - Create, modify and delete Vhost-user | -| | interface, as client and server. | -| | - Test case count: 8. | -+-----------------------+----------------------------------------------+ -| VLAN | - CRUD for VLAN sub-interface management. | -| | - Create VLAN sub-interface over a physical | -| | interface. | -| | - Toggle interface state separately for | -| | super-interface and sub-interface. | -| | - Configure IP address and bridge domain | -| | assignment on sub-interface. | -| | - Configure VLAN tag rewrite on | -| | sub-interface. | -| | - Test case count: 24. | -+-----------------------+----------------------------------------------+ -| VxLAN | - CRD for VxLAN tunnels. | -| | - Create VxLAN interface. | -| | - Disable VxLAN interface. | -| | - Re-create a disabled VxLAN interface. | -| | - Test case count: 6. | -+-----------------------+----------------------------------------------+ -| VxLAN-GPE | - CRD for VxLAN GPE tunnels. | -| | - Create VxLAN GPE interface. | -| | - Disable VxLAN interface. | -| | - Re-create a disabled VxLAN interface. | -| | - Test case count: 7. | -+-----------------------+----------------------------------------------+ -| TAP | - CRUD for Tap interface management. | -| | - Create, modify and delete TAP interface. | -| | - Test case count: 3. | -+-----------------------+----------------------------------------------+ - -Total 213 Honeycomb functional tests in the |csit-release|. - -Operational data in Honeycomb should mirror configuration data at all -times. Because of this, test cases follow this general pattern: - -#. read operational data of the feature using restconf. -#. read status of the feature using VPP API dump. -#. modify configuration of the feature using restconf. -#. verify changes to operational data using restconf. -#. verify changes using VPP API dump, OR -#. send a packet to VPP node and observe behaviour to verify configuration. - -Test cases involving network interfaces utilize the first two interfaces -on the DUT node. - -Functional Tests Naming ------------------------ - -|csit-release| follows a common structured naming convention for all -performance and system functional tests, introduced in CSIT-17.01. - -The naming should be intuitive for majority of the tests. Complete -description of CSIT test naming convention is provided on -:ref:`csit_test_naming`. diff --git a/docs/report/honeycomb_functional_tests/test_environment.rst b/docs/report/honeycomb_functional_tests/test_environment.rst deleted file mode 100644 index c0e13b5423..0000000000 --- a/docs/report/honeycomb_functional_tests/test_environment.rst +++ /dev/null @@ -1,7 +0,0 @@ -Test Environment -================ - -FD.io CSIT HoneyComb functional tests are executed in the same FD.io -virtual environment as used CSIT VPP functional tests. See description -in `VPP Functional Tests Environment -<../vpp_functional_tests/test_environment.html>`_. diff --git a/docs/report/index.html.template b/docs/report/index.html.template index a5e57e9617..141ffbf370 100644 --- a/docs/report/index.html.template +++ b/docs/report/index.html.template @@ -63,16 +63,6 @@ CSIT-1908 .. .. toctree:: :maxdepth: 2 - :caption: HoneyComb Functional - - honeycomb_functional_tests/overview - honeycomb_functional_tests/csit_release_notes - honeycomb_functional_tests/test_environment - honeycomb_functional_tests/documentation - -.. - .. toctree:: - :maxdepth: 2 :caption: NSH_SFC Functional nsh_sfc_functional_tests/overview @@ -101,7 +91,6 @@ CSIT-1908 detailed_test_results/vpp_device_results_ubuntu/index .. - detailed_test_results/honeycomb_functional_results/index detailed_test_results/dmm_functional_results/index detailed_test_results/nshsfc_functional_results/index diff --git a/docs/report/introduction/introduction.rst b/docs/report/introduction/introduction.rst index 5470cca4e9..be63cf5c1e 100644 --- a/docs/report/introduction/introduction.rst +++ b/docs/report/introduction/introduction.rst @@ -83,16 +83,6 @@ available for download. - **Documentation**: Pointers to CSIT source code documentation for VPP functional tests. -#. HONEYCOMB FUNCTIONAL: Honeycomb functional tests executed in - virtual FD.io testbeds. - - - **Overview**: Tested virtual topologies, test coverage and naming - specifics; - - **Release Notes**: Changes in |csit-release|, known issues. - - **Test Environment**: Functional test environment configuration. - - **Documentation**: Pointers to CSIT source code documentation for - Honeycomb functional tests. - #. DETAILED RESULTS: Detailed result tables auto-generated from CSIT test job executions using RF (Robot Framework) output files as sources. |