diff options
3 files changed, 118 insertions, 51 deletions
diff --git a/docs/report/vpp_functional_tests/csit_release_notes.rst b/docs/report/vpp_functional_tests/csit_release_notes.rst index 1eb3b9705f..e8fb102d05 100644 --- a/docs/report/vpp_functional_tests/csit_release_notes.rst +++ b/docs/report/vpp_functional_tests/csit_release_notes.rst @@ -4,14 +4,12 @@ CSIT Release Notes Changes in CSIT |release| ------------------------- -#. VPP functional test framework changes: - - - improved stability of tests with nested-VM and QEMU; - #. Code updates and optimizations in CSIT functional framework: - - IPSecSW tests - Software based IPSec encryption with CBC-SHA1 and - CBC-SHA ciphers, in combination with IPv4 routed-forwarding; + - VPP install test - VPP installation have been moved to separate test in + test suite setup phase to clearly indicate any issue with VPP installation; + + - VPP verify test - test to check VPP responsiveness after installation; Known Issues ------------ diff --git a/docs/report/vpp_functional_tests/test_environment.rst b/docs/report/vpp_functional_tests/test_environment.rst index 5b29b2d80b..6a70336a25 100644 --- a/docs/report/vpp_functional_tests/test_environment.rst +++ b/docs/report/vpp_functional_tests/test_environment.rst @@ -240,30 +240,47 @@ Example of DUT nodes configuration::: | Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name Version Architecture Description
- +++-==============-=============-============-=============================================
- ii vpp 17.07-release amd64 Vector Packet Processing--executables
- ii vpp-dbg 17.07-release amd64 Vector Packet Processing--debug symbols
- ii vpp-dev 17.07-release amd64 Vector Packet Processing--development support
- ii vpp-dpdk-dev 17.07-release amd64 Vector Packet Processing--development support
- ii vpp-dpdk-dkms 17.07-release amd64 DPDK 2.1 igb_uio_driver
- ii vpp-lib 17.07-release amd64 Vector Packet Processing--runtime libraries
- ii vpp-plugins 17.07-release amd64 Vector Packet Processing--runtime plugins
+ +++-==============-=============-============-=================================================
+ ii vpp 18.04-release amd64 Vector Packet Processing--executables
+ ii vpp-dbg 18.04-release amd64 Vector Packet Processing--debug symbols
+ ii vpp-dev 18.04-release amd64 Vector Packet Processing--development support
+ ii vpp-dpdk-dkms 18.02-vpp1 amd64 DPDK Development Package for VPP - Kernel Modules
+ ii vpp-lib 18.04-release amd64 Vector Packet Processing--runtime libraries
+ ii vpp-plugins 18.04-release amd64 Vector Packet Processing--runtime plugins
**VPP Startup Configuration**
-VPP startup configuration is common for all test cases.
+VPP startup configuration is common for all test cases except test cases related
+to SW Crypto device.
+
+**Default**
::
$ cat /etc/vpp/startup.conf
unix {
nodaemon
- log /tmp/vpp.log
+ log /var/log/vpp/vpp.log
full-coredump
+ cli-listen /run/vpp/cli.sock
+ gid vpp
}
api-trace {
+ ## This stanza controls binary API tracing. Unless there is a very strong reason,
+ ## please leave this feature enabled.
on
+ ## Additional parameters:
+ ##
+ ## To set the number of binary API trace records in the circular buffer, configure nitems
+ ##
+ ## nitems <nnn>
+ ##
+ ## To save the api message table decode tables, configure a filename. Results in /tmp/<filename>
+ ## Very handy for understanding api message changes between versions, identifying missing
+ ## plugins, and so forth.
+ ##
+ ## save-api-table <filename>
}
api-segment {
@@ -306,7 +323,7 @@ VPP startup configuration is common for all test cases. # scheduler-priority 50
}
- dpdk {
+ # dpdk {
## Change default settings for all intefaces
# dev default {
## Number of receive queues, enables RSS
@@ -337,9 +354,19 @@ VPP startup configuration is common for all test cases. # num-rx-queues 2
# }
- ## Change UIO driver used by VPP, Options are: uio_pci_generic, vfio-pci
- ## and igb_uio (default)
- # uio-driver uio_pci_generic
+ ## Specify bonded interface and its slaves via PCI addresses
+ ##
+ ## Bonded interface in XOR load balance mode (mode 2) with L3 and L4 headers
+ # vdev eth_bond0,mode=2,slave=0000:02:00.0,slave=0000:03:00.0,xmit_policy=l34
+ # vdev eth_bond1,mode=2,slave=0000:02:00.1,slave=0000:03:00.1,xmit_policy=l34
+ ##
+ ## Bonded interface in Active-Back up mode (mode 1)
+ # vdev eth_bond0,mode=1,slave=0000:02:00.0,slave=0000:03:00.0
+ # vdev eth_bond1,mode=1,slave=0000:02:00.1,slave=0000:03:00.1
+
+ ## Change UIO driver used by VPP, Options are: igb_uio, vfio-pci,
+ ## uio_pci_generic or auto (default)
+ # uio-driver vfio-pci
## Disable mutli-segment buffers, improves performance but
## disables Jumbo MTU support
@@ -347,12 +374,57 @@ VPP startup configuration is common for all test cases. ## Increase number of buffers allocated, needed only in scenarios with
## large number of interfaces and worker threads. Value is per CPU socket.
- ## Default is 32768
+ ## Default is 16384
# num-mbufs 128000
## Change hugepages allocation per-socket, needed only if there is need for
## larger number of mbufs. Default is 256M on each detected CPU socket
# socket-mem 2048,2048
+
+ ## Disables UDP / TCP TX checksum offload. Typically needed for use
+ ## faster vector PMDs (together with no-multi-seg)
+ # no-tx-checksum-offload
+ # }
+
+
+ # plugins {
+ ## Adjusting the plugin path depending on where the VPP plugins are
+ # path /home/bms/vpp/build-root/install-vpp-native/vpp/lib64/vpp_plugins
+
+ ## Disable all plugins by default and then selectively enable specific plugins
+ # plugin default { disable }
+ # plugin dpdk_plugin.so { enable }
+ # plugin acl_plugin.so { enable }
+
+ ## Enable all plugins by default and then selectively disable specific plugins
+ # plugin dpdk_plugin.so { disable }
+ # plugin acl_plugin.so { disable }
+ # }
+
+ ## Alternate syntax to choose plugin path
+ # plugin_path /home/bms/vpp/build-root/install-vpp-native/vpp/lib64/vpp_plugins
+
+**SW Crypto Device**
+
+::
+
+ $ cat /etc/vpp/startup.conf
+ unix
+ {
+ cli-listen /run/vpp/cli.sock
+ gid vpp
+ nodaemon
+ full-coredump
+ log /tmp/vpp.log
+ }
+ api-segment
+ {
+ gid vpp
+ }
+ dpdk
+ {
+ vdev cryptodev_aesni_gcm_pmd,socket_id=0
+ vdev cryptodev_aesni_mb_pmd,socket_id=0
}
TG Configuration
diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst index 8fd8a3b634..f4036ebd4d 100644 --- a/docs/report/vpp_performance_tests/csit_release_notes.rst +++ b/docs/report/vpp_performance_tests/csit_release_notes.rst @@ -4,43 +4,38 @@ CSIT Release Notes Changes in CSIT |release|
-------------------------
-#. Added VPP performance tests
+#. **Added VPP performance tests**
- - **Container Service Chain Topologies Orchestrated by K8s with VPP Memif**
+ - **MRR tests** : New MRR tests measure the packet forwarding rate
+ under the maximum load offered by traffic generator over a set
+ trial duration, regardless of packet loss. Maximum load for
+ specified Ethernet frame size is set to the bi-directional link
+ rate. MRR tests are used for continuous performance trending and
+ for comparison between releases.
- - Added tests with VPP vswitch in container connecting a number of VPP-
- in-container service chain topologies with L2 Cross-Connect and L2
- Bridge-Domain configurations, orchestrated by Kubernetes. Added
- following forwarding topologies: i) "Parallel" with packets flowing from
- NIC via VPP to container and back to VPP and NIC; ii) "Chained" (a.k.a.
- "Snake") with packets flowing via VPP to container, back to VPP, to next
- container, back to VPP and so on until the last container in a chain,
- then back to VPP and NIC; iii) "Horizontal" with packets flowing via VPP
- to container, then via "horizontal" memif to next container, and so on
- until the last container, then back to VPP and NIC;
+ - **Service Chaining with SRv6** : SRv6 (Segment Routing IPv6) proxy tests
+ verifying performance of Endpoint to SR-unaware appliance via
+ masquerading (End.AM), dynamic proxy (End.AD) or static proxy (End.AS)
+ functions.
- - **MRR tests**
+#. **Presentation and Analytics Layer (PAL)**
- - <placeholder>;
+ - Added continuous performance measuring, trending and anomaly
+ detection. Includes new PAL code and Jenkins jobs for Performance
+ Trending (PT) and Performance Analysis (PA) producing performance
+ trending dashboard and trendline graphs with summary and drill-
+ down views across all specified tests that can be reviewed and
+ inspected regularly by FD.io developers and users community.
- - **SRv6**
+#. **Test Framework Optimizations**
- - Initial SRv6 (Segment Routing IPv6) tests verifying performance of
- IPv6 and SRH (Segment Routing Header) encapsulation, decapsulation,
- lookups and rewrites based on configured End and End.DX6 SRv6 egress
- functions;
+ - **Performance tests efficiency** : Qemu build/install
+ optimizations, warmup phase handling, vpp restart handling.
+ Resulted in improved stability and reduced total execution time by
+ 30% for single pkt size e.g. 64B/78B.
-#. Presentation and Analytics Layer
-
- - Added throughput speedup analysis for multi-core and multi-thread
- VPP tests into Presentation and Analytics Layer (PAL) for automated
- CSIT test results analysis;
-
-#. Other changes
-
- - **Framework optimizations**
-
- - Performance test duration improvements and stability;
+ - **General code housekeeping** : ongoing RF keywords
+ optimizations, removal of redundant RF keywords.
Performance Changes
-------------------
@@ -98,6 +93,8 @@ pretty ASCII formats: Known Issues
------------
+<to be updated before rls1804 release>
+
Here is the list of known issues in CSIT |release| for VPP performance tests:
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+
|