diff options
| author |   Maciek Konstantynowicz <mkonstan@cisco.com> | 2018-02-08 14:02:47 +0000 |
|---|---|---|
| committer |   Tibor Frank <tifrank@cisco.com> | 2018-02-08 14:44:10 +0000 |
| commit | 21bdc576dd9310acc6c3020a42aaf8a8cb4d68e3 (patch) | |
| tree | 7b44df56d22ea2ede8e4bef6ff75d93fd98e89bc /docs | |
| parent | 8df63286b6c126b82b858a484ac4b39e53b1cd0f (diff) | |
rls18.01.1 report: updated make test unittest content.
Change-Id: Ic57148795df2459010f908b196acfc8de7c7b50f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 5cd30be240b965c17e84b3441ead277eaed6a8c7)
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/report/detailed_test_results/vpp_unittest_results/vpp_unittest_results.rst | 1328 | ||||
| -rw-r--r-- | docs/report/vpp_unit_tests/overview.rst | 69 |
2 files changed, 836 insertions, 561 deletions
diff --git a/docs/report/detailed_test_results/vpp_unittest_results/vpp_unittest_results.rst b/docs/report/detailed_test_results/vpp_unittest_results/vpp_unittest_results.rst index f20bb98055..3e1fd5ac57 100644 --- a/docs/report/detailed_test_results/vpp_unittest_results/vpp_unittest_results.rst +++ b/docs/report/detailed_test_results/vpp_unittest_results/vpp_unittest_results.rst @@ -1,147 +1,224 @@ -CRUD Loopback
-`````````````
+ACL Security Groups
+```````````````````
::
==============================================================================
- CRUD Loopback
+ ACL plugin Test Case
==============================================================================
- test_crud (test_interface_crud.TestLoopbackInterfaceCRUD) OK
- test_down (test_interface_crud.TestLoopbackInterfaceCRUD) OK
-
-Flowprobe feature
-`````````````````
-::
+ ACL plugin version check; learn MACs OK
+ ACL create/delete test OK
+ permit ACL apply test OK
+ deny ACL apply test OK
+ VPP_624 permit ICMPv4 OK
+ VPP_624 permit ICMPv6 OK
+ VPP_624 deny ICMPv4 OK
+ VPP_624 deny ICMPv6 OK
+ permit TCPv4 OK
+ permit TCPv6 OK
+ permit UDPv4 OK
+ permit UDPv6 OK
+ deny TCPv4/v6 OK
+ deny UDPv4/v6 OK
+ verify add/dump acls OK
+ permit single TCPv4 OK
+ permit single UDPv4 OK
+ permit single TCPv6 OK
+ permit single UPPv6 OK
+ deny single TCPv4/v6 OK
+ deny single UDPv4/v6 OK
+ deny single UDPv4/v6, permit ip any, verify non-initial fragment blocked OK
+ VPP-687 zero length udp ipv4 packet OK
+ VPP-687 zero length udp ipv6 packet OK
+ permit TCPv4 + non-match range OK
+ permit TCPv6 + non-match range OK
+ permit UDPv4 + non-match range OK
+ permit UDPv6 + non-match range OK
+ deny TCPv4/v6 + non-match range OK
+ deny UDPv4/v6 + non-match range OK
==============================================================================
- Re-enable Flowprobe feature
+ IRB Test Case
==============================================================================
- disable flowprobe feature after first packets and re-enable SKIP
+ ACL plugin prepare OK
+ ACL IPv6 routed -> bridged, L2 ACL deny OK
+ ACL IPv6 routed -> bridged, L3 ACL deny OK
+ ACL IPv4 routed -> bridged, L2 ACL deny OK
+ ACL IPv4 routed -> bridged, L3 ACL deny OK
+ ACL IPv6 bridged -> routed, L2 ACL deny OK
+ ACL IPv6 bridged -> routed, L3 ACL deny OK
+ ACL IPv4 bridged -> routed, L2 ACL deny OK
+ ACL IPv4 bridged -> routed, L3 ACL deny OK
+ ACL IPv6 routed -> bridged, L2 ACL permit+reflect OK
+ ACL IPv6 bridged -> routed, L2 ACL permit+reflect OK
+ ACL IPv4 routed -> bridged, L2 ACL permit+reflect OK
+ ACL IPv4 bridged -> routed, L2 ACL permit+reflect OK
+ ACL IPv6 routed -> bridged, L3 ACL permit+reflect OK
+ ACL IPv6 bridged -> routed, L3 ACL permit+reflect OK
+ ACL IPv4 routed -> bridged, L3 ACL permit+reflect OK
+ ACL IPv4 bridged -> routed, L3 ACL permit+reflect OK
+ ACL IPv6+EH routed -> bridged, L2 ACL deny OK
+ ACL IPv6+EH routed -> bridged, L3 ACL deny OK
+ ACL IPv6+EH bridged -> routed, L2 ACL deny OK
+ ACL IPv6+EH bridged -> routed, L3 ACL deny OK
+ ACL IPv6+EH routed -> bridged, L2 ACL permit+reflect OK
+ ACL IPv6+EH bridged -> routed, L2 ACL permit+reflect OK
+ ACL IPv6+EH routed -> bridged, L3 ACL permit+reflect OK
+ ACL IPv6+EH bridged -> routed, L3 ACL permit+reflect OK
+ ACL IPv4+MF routed -> bridged, L2 ACL deny OK
+ ACL IPv4+MF routed -> bridged, L3 ACL deny OK
+ ACL IPv4+MF bridged -> routed, L2 ACL deny OK
+ ACL IPv4+MF bridged -> routed, L3 ACL deny OK
+ ACL IPv4+MF routed -> bridged, L2 ACL permit+reflect OK
+ ACL IPv4+MF bridged -> routed, L2 ACL permit+reflect OK
+ ACL IPv4+MF routed -> bridged, L3 ACL permit+reflect OK
+ ACL IPv4+MF bridged -> routed, L3 ACL permit+reflect OK
+
==============================================================================
- collect information on Ethernet, IP4 and IP6 datapath (no timers)
+ ACL plugin connection-oriented extended testcases
==============================================================================
- no timers, one CFLOW packet, 9 Flows inside OK
- no timers, two CFLOW packets (mtu=256), 3 Flows in each OK
- L2 data on IP4 datapath OK
- L2 data on IP6 datapath OK
- L2 data on L2 datapath OK
- L3 data on IP4 datapath OK
- L3 data on IP6 datapath OK
- L3 data on L2 datapath OK
- L4 data on IP4 datapath OK
- L4 data on IP6 datapath OK
- L4 data on L2 datapath OK
- verify templates on IP6 datapath OK
- verify templates on IP4 datapath OK
- verify template on L2 datapath OK
+ Prepare the settings SKIP
+ IPv4: Basic conn timeout test reflect on ingress SKIP
+ IPv4: Basic conn timeout test reflect on egress SKIP
+ IPv4: reflect egress, clear conn SKIP
+ IPv4: reflect ingress, clear conn SKIP
+ IPv4: Idle conn behind active conn, reflect on ingress SKIP
+ IPv4: Idle conn behind active conn, reflect on egress SKIP
+ IPv6: Basic conn timeout test reflect on ingress SKIP
+ IPv6: Basic conn timeout test reflect on egress SKIP
+ IPv6: reflect egress, clear conn SKIP
+ IPv6: reflect ingress, clear conn SKIP
+ IPv6: Idle conn behind active conn, reflect on ingress SKIP
+ IPv6: Idle conn behind active conn, reflect on egress SKIP
+ Prepare for TCP session tests SKIP
+ IPv4: transient TCP session (incomplete 3WHS), ref. on ingress SKIP
+ IPv4: transient TCP session (incomplete 3WHS), ref. on egress SKIP
+ IPv4: established TCP session (complete 3WHS), ref. on ingress SKIP
+ IPv4: established TCP session (complete 3WHS), ref. on egress SKIP
+ IPv4: transient TCP session (3WHS,ACK,FINACK), ref. on ingress SKIP
+ IPv4: transient TCP session (3WHS,ACK,FINACK), ref. on egress SKIP
+ IPv6: transient TCP session (incomplete 3WHS), ref. on ingress SKIP
+ IPv6: transient TCP session (incomplete 3WHS), ref. on egress SKIP
+ IPv6: established TCP session (complete 3WHS), ref. on ingress SKIP
+ IPv6: established TCP session (complete 3WHS), ref. on egress SKIP
+ IPv6: transient TCP session (3WHS,ACK,FINACK), ref. on ingress SKIP
+ IPv6: transient TCP session (3WHS,ACK,FINACK), ref. on egress SKIP
+
==============================================================================
- Disable Flowprobe feature
+ ACL on dot1q bridged subinterfaces Tests
==============================================================================
- disable flowprobe feature after first packets SKIP
+ IP4 ACL SubIf Dot1Q bridged traffic OK
+ IP6 ACL SubIf Dot1Q bridged traffic OK
+
==============================================================================
- Re-enable IPFIX
+ ACL on dot1ad bridged subinterfaces Tests
==============================================================================
- disable IPFIX after first packets and re-enable after few packets SKIP
+ IP4 ACL SubIf Dot1AD bridged traffic OK
+ IP6 ACL SubIf Dot1AD bridged traffic OK
+
==============================================================================
- Disable IPFIX
+ ACL on dot1ad routed subinterfaces Tests
==============================================================================
- disable IPFIX after first packets SKIP
-
-DHCP
-````
-::
+ IP4 ACL SubIf Dot1AD routed traffic OK
+ IP4 ACL SubIf wrong tags Dot1AD routed traffic OK
+ IP6 ACL SubIf Dot1AD routed traffic OK
+ IP6 ACL SubIf wrong tags Dot1AD routed traffic OK
==============================================================================
- DHCP Test Case
+ ACL on dot1q routed subinterfaces Tests
==============================================================================
- DHCPv6 Proxy OK
- DHCP Client OK
- DHCPv4 Proxy OK
+ IP4 ACL SubIf Dot1Q routed traffic OK
+ IP4 ACL SubIf wrong tags Dot1Q routed traffic OK
+ IP6 ACL SubIf Dot1Q routed traffic OK
+ IP6 ACL SubIf wrong tags Dot1Q routed traffic OK
-IPv4 VRF Multi-instance
-```````````````````````
+APIs
+````
::
==============================================================================
- IP4 VRF Multi-instance Test Case
+ VAPI test
==============================================================================
- IP4 VRF Multi-instance test 1 - create 5 BDs OK
- IP4 VRF Multi-instance test 2 - delete 2 VRFs OK
- IP4 VRF Multi-instance 3 - add 2 VRFs OK
- IP4 VRF Multi-instance test 4 - delete 4 VRFs OK
-
-Load Balancer
-`````````````
-::
+ run C VAPI tests SKIP
+ run C++ VAPI tests SKIP
==============================================================================
- Load Balancer Test Case
+ VPP Object Model Test
==============================================================================
- Load Balancer IP4 GRE4 OK
- Load Balancer IP4 GRE6 OK
- Load Balancer IP6 GRE4 OK
- Load Balancer IP6 GRE6 OK
-
-FIB Tests
-`````````
-::
+ run C++ VOM tests SKIP
==============================================================================
- FIB Test Case
+ PAPI Test Case
==============================================================================
- FIB Unit Tests OK
-
-BFD IPv6
-````````
-::
+ show version OK
+ show version - invalid parameters OK
+ u8 array OK
==============================================================================
- Bidirectional Forwarding Detection (BFD) (IPv6)
+ PAPI Message parsing Test Case
==============================================================================
- echo function used SKIP
- echo packets looped back SKIP
- hold BFD session up SKIP
- interface with bfd session deleted SKIP
- bring BFD session up SKIP
- bring BFD session up - first frame looked up by address pair SKIP
+ New compound type with array OK
+ Add new types OK
+ Add new types 2 OK
+ Add new message object OK
+ New message with array OK
+ Argument name OK
+ VLA with aribtrary length field placement OK
+ Message to byte encoding OK
+ Nested array type OK
+ Old style VLA array OK
+ Old VLA compound type OK
+ Old VLA array arbitrary placement OK
+ Old VLA u32 OK
+ Simple array OK
+
==============================================================================
- BFD-FIB interactions (IPv6)
+ JVPP Core Test Case
==============================================================================
- BFD-FIB interactions SKIP
+ JVPP Acl Callback Api Test Case OK
+ JVPP Acl Future Api Test Case OK
+ JVPP Core Callback Api Test Case OK
+ JVPP Core Future Api Test Case OK
+ JVPP Ioamexport Callback Api Test Case OK
+ JVPP Ioamexport Future Api Test Case OK
+ JVPP Ioampot Callback Api Test Case OK
+ JVPP Ioampot Future Api Test Case OK
+ JVPP Ioamtrace Callback Api Test Case OK
+ JVPP Ioamtrace Future Api Test Case OK
+ JVPP Snat Callback Api Test Case OK
+ JVPP Snat Future Api Test Case OK
-BFD authentication
-``````````````````
+ARP
+```
::
==============================================================================
- Bidirectional Forwarding Detection (BFD) (SHA1 auth)
+ ARP Test Case
==============================================================================
- hold BFD session up SKIP
- hold BFD session up - meticulous auth SKIP
- session is not brought down by unauthenticated msg SKIP
- session is not brought down by msg with non-existent key-id SKIP
- session is not brought down by msg with wrong auth type SKIP
- simulate remote peer restart and resynchronization SKIP
- session is not kept alive by msgs with bad sequence numbers SKIP
- bring BFD session up SKIP
-
-BFD CLI
-````````
-::
+ ARP OK
+ ARP Duplicates OK
+ ARP Static OK
+ ARP reply with VRRP virtual src hw addr OK
+ MPLS OK
+ Proxy ARP OK
+ Interface Mirror Proxy ARP OK
==============================================================================
- Bidirectional Forwarding Detection (BFD) (CLI)
+ L2BD arp termination Test Case
==============================================================================
- create/modify/delete IPv4 BFD UDP session SKIP
- create/modify/delete IPv6 BFD UDP session SKIP
- create/modify/delete IPv6 BFD UDP session (authenticated) SKIP
- create/modify/delete IPv4 BFD UDP session (authenticated) SKIP
- put session admin-up and admin-down SKIP
- turn authentication on and off SKIP
- turn authentication on and off (delayed) SKIP
- set/delete meticulous SHA1 auth key SKIP
- set/delete SHA1 auth key SKIP
- set/del udp echo source SKIP
- show commands SKIP
+ L2BD arp term - add 5 hosts, verify arp responses OK
+ L2BD arp term - delete 3 hosts, verify arp responses OK
+ L2BD arp term - recreate BD1, readd 3 hosts, verify arp responses OK
+ L2BD arp term - 2 IP4 addrs per host OK
+ L2BD arp term - create and update 10 IP4-mac pairs OK
+ L2BD arp/ND term - hosts with both ip4/ip6 OK
+ L2BD ND term - Add and Del hosts, verify ND replies OK
+ L2BD ND term - Add and update IP+mac, verify ND replies OK
+ L2BD arp term - send garps, verify arp event reports OK
+ L2BD arp term - send duplicate garps, verify suppression OK
+ L2BD arp term - disable ip4 arp events,send garps, verify no events OK
+ L2BD ND term - send NS packets verify reports OK
+ L2BD ND term - send duplicate ns, verify suppression OK
+ L2BD ND term - disable ip4 arp events,send ns, verify no events OK
BFD API
````````
@@ -163,7 +240,23 @@ BFD API modify BFD session parameters SKIP
share single SHA1 key between multiple BFD sessions SKIP
-BFD authentication change
+BFD Authentication
+``````````````````
+::
+
+ ==============================================================================
+ Bidirectional Forwarding Detection (BFD) (SHA1 auth)
+ ==============================================================================
+ hold BFD session up SKIP
+ hold BFD session up - meticulous auth SKIP
+ session is not brought down by unauthenticated msg SKIP
+ session is not brought down by msg with non-existent key-id SKIP
+ session is not brought down by msg with wrong auth type SKIP
+ simulate remote peer restart and resynchronization SKIP
+ session is not kept alive by msgs with bad sequence numbers SKIP
+ bring BFD session up SKIP
+
+BFD Authentication Change
`````````````````````````
::
@@ -177,9 +270,27 @@ BFD authentication change turn auth on without disturbing session state (delayed) SKIP
turn auth on without disturbing session state (immediate) SKIP
-BFD IPv4
+BFD CLI
````````
+::
+
+ ==============================================================================
+ Bidirectional Forwarding Detection (BFD) (CLI)
+ ==============================================================================
+ create/modify/delete IPv4 BFD UDP session SKIP
+ create/modify/delete IPv6 BFD UDP session SKIP
+ create/modify/delete IPv6 BFD UDP session (authenticated) SKIP
+ create/modify/delete IPv4 BFD UDP session (authenticated) SKIP
+ put session admin-up and admin-down SKIP
+ turn authentication on and off SKIP
+ turn authentication on and off (delayed) SKIP
+ set/delete meticulous SHA1 auth key SKIP
+ set/delete SHA1 auth key SKIP
+ set/del udp echo source SKIP
+ show commands SKIP
+BFD IPv4
+````````
::
==============================================================================
@@ -195,6 +306,7 @@ BFD IPv4 echo function stops if peer sets required min echo rx zero SKIP
hold BFD session up SKIP
immediately honor remote required min rx reduction SKIP
+ interface with bfd session deleted SKIP
echo packets with invalid checksum don't keep a session up SKIP
large remote required min rx interval SKIP
modify detect multiplier SKIP
@@ -210,362 +322,352 @@ BFD IPv4 stale echo packets don't keep a session up SKIP
no packets when zero remote required min rx interval SKIP
+BFD IPv6
+````````
+::
+ ==============================================================================
+ Bidirectional Forwarding Detection (BFD) (IPv6)
+ ==============================================================================
+ echo function used SKIP
+ echo packets looped back SKIP
+ hold BFD session up SKIP
+ interface with bfd session deleted SKIP
+ bring BFD session up SKIP
+ bring BFD session up - first frame looked up by address pair SKIP
-IPv6 Tests
-``````````
+ ==============================================================================
+ BFD-FIB interactions (IPv6)
+ ==============================================================================
+ BFD-FIB interactions SKIP
+
+BIER - Bit Indexed Explicit Replication
+```````````````````````````````````````
::
==============================================================================
- IPv6 Test Case
+ BIER Test Case
==============================================================================
- IPv6 FIB test OK
- IPv6 Neighbour Solicitation Exceptions OK
- ND Duplicates OK
- IPv6 Router Solicitation Exceptions OK
+ BIER end-to-end OK
+ BIER head OK
+ BIER head over UDP OK
+ BIER midpoint OK
+ BIER Tail OK
+ BIER Tail over UDP OK
+
==============================================================================
- IPv6 disabled
+ BIER FIB Test Case
==============================================================================
- IP Disabled OK
+ BFIB Unit Tests OK
+
+Classifier
+``````````
+::
+
==============================================================================
- IPv6 ND ProxyTest Case
+ Classifier Test Case
==============================================================================
- IPv6 Proxy ND OK
+ IP ACL test OK
+ MAC ACL test OK
+ IP PBR test OK
+
+Container Integration
+`````````````````````
+::
+
==============================================================================
- IPv6 Load-Balancing
+ Container integration extended testcases
==============================================================================
- IPv6 Load-Balancing OK
+ IPv4 basic connectivity test SKIP
+ IPv6 basic connectivity test SKIP
+ Create loopbacks overlapping with remote addresses SKIP
+ IPv4 local-spoof connectivity test SKIP
+ IPv6 local-spoof connectivity test SKIP
+ Configure container commands SKIP
+ IPv4 test after configuring container SKIP
+ IPv6 test after configuring container SKIP
+ Unconfigure container commands SKIP
+ IPv4 local-spoof after unconfig test SKIP
+ IPv6 local-spoof after unconfig test SKIP
+
+CRUD Loopback
+`````````````
+::
+
==============================================================================
- IPv6 routes via NULL
+ CRUD Loopback
==============================================================================
- IP NULL route OK
+ test_crud (test_interface_crud.TestLoopbackInterfaceCRUD) OK
+ test_down (test_interface_crud.TestLoopbackInterfaceCRUD) OK
-SPAN Tests
-``````````
+DHCP
+````
::
==============================================================================
- SPAN Test Case
+ DHCP Test Case
==============================================================================
- SPAN device rx mirror test OK
- SPAN l2 tx mirror test OK
- SPAN l2 rx mirror test OK
- SPAN l2 rx mirror into gre-subif+vtr OK
- SPAN l2 rx mirror into subif+vtr OK
- SPAN l2 rx mirror into vxlan test OK
+ DHCPv6 Proxy OK
+ DHCP Client OK
+ DHCPv4 Proxy OK
-GRE Tests
-`````````
+Distributed Virtual Router
+``````````````````````````
::
==============================================================================
- GRE Test Case
+ Distributed Virtual Router
==============================================================================
- GRE IPv4 tunnel Tests OK
- GRE IPv6 tunnel Tests OK
- GRE tunnel L2 Tests OK
- GRE tunnel VRF Tests OK
+ Distributed Virtual Router OK
+ L2 Emulation OK
-L2BD Multi-instance
-```````````````````
+DS-Lite Softwire
+````````````````
::
==============================================================================
- L2BD Multi-instance Test Case
+ DS-Lite Test Cases
==============================================================================
- L2BD Multi-instance test 1 - create 5 BDs SKIP
- L2BD Multi-instance test 2 - update data of 5 BDs SKIP
- L2BD Multi-instance 3 - delete 2 BDs SKIP
- L2BD Multi-instance test 4 - add 2 BDs SKIP
- L2BD Multi-instance 5 - delete 5 BDs SKIP
+ Test DS-Lite OK
+
+FIB
+```
+::
-MAP Tests
+ ==============================================================================
+ FIB Test Case
+ ==============================================================================
+ FIB Unit Tests OK
+
+Flowprobe
`````````
::
==============================================================================
- MAP Test Case
+ Re-enable Flowprobe feature
==============================================================================
- MAP-E OK
+ disable flowprobe feature after first packets and re-enable SKIP
-LISP tests
-``````````
+ ==============================================================================
+ collect information on Ethernet, IP4 and IP6 datapath (no timers)
+ ==============================================================================
+ no timers, one CFLOW packet, 9 Flows inside OK
+ no timers, two CFLOW packets (mtu=256), 3 Flows in each OK
+ L2 data on IP4 datapath OK
+ L2 data on IP6 datapath OK
+ L2 data on L2 datapath OK
+ L3 data on IP4 datapath OK
+ L3 data on IP6 datapath OK
+ L3 data on L2 datapath OK
+ L4 data on IP4 datapath OK
+ L4 data on IP6 datapath OK
+ L4 data on L2 datapath OK
+ verify templates on IP6 datapath OK
+ verify templates on IP4 datapath OK
+ verify template on L2 datapath OK
+
+ ==============================================================================
+ Disable Flowprobe feature
+ ==============================================================================
+ disable flowprobe feature after first packets SKIP
+
+ ==============================================================================
+ Re-enable IPFIX
+ ==============================================================================
+ disable IPFIX after first packets and re-enable after few packets SKIP
+
+ ==============================================================================
+ Disable IPFIX
+ ==============================================================================
+ disable IPFIX after first packets SKIP
+
+Geneve Tunnels
+``````````````
::
==============================================================================
- Basic LISP test
+ GENEVE Test Case
==============================================================================
- Test case for basic encapsulation OK
+ Decapsulation test OK
+ Encapsulation test OK
+ Multicast flood test OK
+ Multicast receive test OK
+ Unicast flood test OK
-NAT44 Test Cases
-````````````````
+GRE Tunnels
+```````````
::
==============================================================================
- NAT44 Test Cases
+ GRE Test Case
==============================================================================
- NAT44 dynamic translation test OK
- NAT44 handling of client packets with TTL=1 OK
- NAT44 handling of error responses to client packets with TTL=2 OK
- NAT44 handling of server packets with TTL=1 OK
- NAT44 handling of error responses to server packets with TTL=2 OK
- NAT44 interfaces without configured IP address OK
- NAT44 hairpinning - 1:1 NAPT OK
- NAT44 hairpinning - 1:1 NAT OK
- 1:1 NAT translate packet with unknown protocol - hairpinning OK
- NAT44 translate packet with unknown protocol - hairpinning OK
- NAT44 multiple inside interfaces with overlapping address space OK
- Acquire NAT44 addresses from interface OK
- Static mapping with addresses from interface OK
- IPFIX logging NAT addresses exhausted OK
- IPFIX logging NAT44 session created/delted OK
- MAX translations per user - recycle the least recently used OK
- NAT44 multiple non-overlapping address space inside interfaces OK
- NAT44 interface output feature (in2out postrouting) OK
- NAT44 interface output feature hairpinning (in2out postrouting) OK
- NAT44 interface output feature VRF aware (in2out postrouting) OK
- Ping internal host from outside network OK
- Ping NAT44 out interface from outside network OK
- NAT44 add pool addresses to FIB OK
- 1:1 NAT initialized from inside network OK
- NAT44 interfaces without configured IP address - 1:1 NAT OK
- NAT44 local service load balancing OK
- 1:1 NAT initialized from outside network OK
- 1:1 NAT translate packet with unknown protocol OK
- 1:1 NAT VRF awareness OK
- 1:1 NAPT initialized from inside network OK
- NAT44 interfaces without configured IP address - 1:1 NAPT OK
- 1:1 NAPT initialized from outside network OK
- NAT44 translate packet with unknown protocol OK
- NAT44 tenant VRF independent address pool mode OK
- NAT44 tenant VRF aware address pool mode OK
+ GRE IPv4 tunnel Tests OK
+ GRE IPv6 tunnel Tests OK
+ GRE tunnel L2 Tests OK
+ GRE tunnel VRF Tests OK
+
+GTPU Tunnels
+````````````
+::
+
==============================================================================
- Deterministic NAT Test Cases
+ GTPU Test Case
==============================================================================
- Deterministic NAT translation test (TCP, UDP, ICMP) OK
- NAT plugin run deterministic mode OK
- Deterministic NAT multiple users OK
- Deterministic NAT maximum sessions per user limit SKIP
- Deterministic NAT session timeouts SKIP
- Set deterministic NAT timeouts OK
- Deterministic NAT TCP session close from inside network OK
- Deterministic NAT TCP session close from outside network OK
+ Decapsulation test OK
+ Encapsulation test OK
+ Multicast flood test OK
+ Multicast receive test OK
+ Unicast flood test OK
-NAT64 Test Cases
-````````````````
+IP Multicast Routing
+````````````````````
::
==============================================================================
- NAT64 Test Cases
+ IP Multicast Test Case
==============================================================================
- NAT64 dynamic translation test OK
- NAT64 hairpinning OK
- NAT64 translate packet with unknown protocol - hairpinning OK
- NAT64 ICMP Error message translation OK
- Enable/disable NAT64 feature on the interface OK
- Add/delete address to NAT64 pool OK
- NAT64 Network-Specific Prefix OK
- NAT64 session timeout SKIP
- Set NAT64 timeouts OK
- NAT64 static translation test OK
- Add/delete static BIB entry OK
- NAT64 translate packet with unknown protocol OK
+ IP Multicast Bi-directional OK
+ IPv6 Multicast Replication OK
+ IPv6 Multicast Replication in non-default table OK
+ IP Multicast Replication OK
+ IP Multicast Connected Source check OK
+ IP Multicast Signal OK
+ IP Multicast Replication in non-default table OK
-L2XC Multi-instance
-```````````````````
+IPSec
+`````
::
==============================================================================
- L2XC Multi-instance Test Case
+ Basic test for IPSEC using AH transport and Tunnel mode
==============================================================================
- L2XC Multi-instance test 1 - create 10 cross-connects OK
- L2XC Multi-instance test 2 - delete 4 cross-connects OK
- L2BD Multi-instance 3 - add new 4 cross-connects OK
- L2XC Multi-instance test 4 - delete 10 cross-connects OK
+ ipsec ah v4 transport basic test OK
+ ipsec ah v4 transport burst test OK
+ ipsec ah 4o4 tunnel basic test OK
+ ipsec ah 4o4 tunnel burst test OK
-IPv4 Tests
-``````````
+ ==============================================================================
+ Basic test for ipsec esp sanity - tunnel and transport modes.
+ ==============================================================================
+ ipsec esp v4 transport basic test OK
+ ipsec esp v4 transport burst test OK
+ ipsec esp 4o4 tunnel basic test OK
+ ipsec esp 4o4 tunnel burst test OK
+
+IPv4 FIB CRUD
+`````````````
+::
+
+ ==============================================================================
+ FIB - add/update/delete - ip4 routes
+ ==============================================================================
+ Add 1k routes OK
+ Delete 100 routes OK
+ Add 1k routes OK
+ Delete 1.5k routes OK
+
+IPv4 Routing
+````````````
::
==============================================================================
IPv4 Test Case
==============================================================================
IPv4 FIB test OK
+
==============================================================================
IPv4 routes via NULL
==============================================================================
IP NULL route OK
+
==============================================================================
IPv4 disabled
==============================================================================
IP Disabled OK
+
==============================================================================
IPv4 Subnets
==============================================================================
IP Sub Nets OK
+
==============================================================================
IPv4 VLAN-0
==============================================================================
IP VLAN-0 OK
+
==============================================================================
IPv4 Load-Balancing
==============================================================================
IP Load-Balancing OK
-IPv4 FIB CRUD
-`````````````
-::
+ ==============================================================================
+ IPv4 Deaggregate Routes
+ ==============================================================================
+ IP Deag Routes OK
==============================================================================
- FIB - add/update/delete - ip4 routes
+ IPv4 Input Exceptions
==============================================================================
- Add 1k routes OK
- Delete 100 routes OK
- Add 1k routes OK
- Delete 1.5k routes OK
+ IP Input Exceptions OK
-IRB Tests
-`````````
+ ==============================================================================
+ IPv4 Punt Police/Redirect
+ ==============================================================================
+ IP punt police and redirect OK
+
+IPv4 VRF Multi-instance
+```````````````````````
::
==============================================================================
- IRB Test Case
+ IP4 VRF Multi-instance Test Case
==============================================================================
- ACL plugin prepare OK
- ACL IPv6 routed -> bridged, L2 ACL deny OK
- ACL IPv6 routed -> bridged, L3 ACL deny OK
- ACL IPv4 routed -> bridged, L2 ACL deny OK
- ACL IPv4 routed -> bridged, L3 ACL deny OK
- ACL IPv6 bridged -> routed, L2 ACL deny OK
- ACL IPv6 bridged -> routed, L3 ACL deny OK
- ACL IPv4 bridged -> routed, L2 ACL deny OK
- ACL IPv4 bridged -> routed, L3 ACL deny OK
- ACL IPv6 routed -> bridged, L2 ACL permit+reflect OK
- ACL IPv6 bridged -> routed, L2 ACL permit+reflect OK
- ACL IPv4 routed -> bridged, L2 ACL permit+reflect OK
- ACL IPv4 bridged -> routed, L2 ACL permit+reflect OK
- ACL IPv6 routed -> bridged, L3 ACL permit+reflect OK
- ACL IPv6 bridged -> routed, L3 ACL permit+reflect OK
- ACL IPv4 routed -> bridged, L3 ACL permit+reflect OK
- ACL IPv4 bridged -> routed, L3 ACL permit+reflect OK
- ACL IPv6+EH routed -> bridged, L2 ACL deny OK
- ACL IPv6+EH routed -> bridged, L3 ACL deny OK
- ACL IPv6+EH bridged -> routed, L2 ACL deny OK
- ACL IPv6+EH bridged -> routed, L3 ACL deny OK
- ACL IPv6+EH routed -> bridged, L2 ACL permit+reflect OK
- ACL IPv6+EH bridged -> routed, L2 ACL permit+reflect OK
- ACL IPv6+EH routed -> bridged, L3 ACL permit+reflect OK
- ACL IPv6+EH bridged -> routed, L3 ACL permit+reflect OK
- ACL IPv4+MF routed -> bridged, L2 ACL deny OK
- ACL IPv4+MF routed -> bridged, L3 ACL deny OK
- ACL IPv4+MF bridged -> routed, L2 ACL deny OK
- ACL IPv4+MF bridged -> routed, L3 ACL deny OK
- ACL IPv4+MF routed -> bridged, L2 ACL permit+reflect OK
- ACL IPv4+MF bridged -> routed, L2 ACL permit+reflect OK
- ACL IPv4+MF routed -> bridged, L3 ACL permit+reflect OK
- ACL IPv4+MF bridged -> routed, L3 ACL permit+reflect OK
+ IP4 VRF Multi-instance test 1 - create 5 BDs OK
+ IP4 VRF Multi-instance test 2 - delete 2 VRFs OK
+ IP4 VRF Multi-instance 3 - add 2 VRFs OK
+ IP4 VRF Multi-instance test 4 - delete 4 VRFs OK
-ACL Security Groups
-```````````````````
+IPv6 Routing
+````````````
::
==============================================================================
- ACL plugin Test Case
+ IPv6 Test Case
==============================================================================
- ACL plugin version check; learn MACs OK
- ACL create/delete test OK
- permit ACL apply test OK
- deny ACL apply test OK
- VPP_624 permit ICMPv4 OK
- VPP_624 permit ICMPv6 OK
- VPP_624 deny ICMPv4 OK
- VPP_624 deny ICMPv6 OK
- permit TCPv4 OK
- permit TCPv6 OK
- permit UDPv4 OK
- permit UDPv6 OK
- deny TCPv4/v6 OK
- deny UDPv4/v6 OK
- verify add/dump acls OK
- permit single TCPv4 OK
- permit single UDPv4 OK
- permit single TCPv6 OK
- permit single UPPv6 OK
- deny single TCPv4/v6 OK
- deny single UDPv4/v6 OK
- deny single UDPv4/v6, permit ip any, verify non-initial fragment blocked OK
- VPP-687 zero length udp ipv4 packet OK
- VPP-687 zero length udp ipv6 packet OK
- permit TCPv4 + non-match range OK
- permit TCPv6 + non-match range OK
- permit UDPv4 + non-match range OK
- permit UDPv6 + non-match range OK
- deny TCPv4/v6 + non-match range OK
- deny UDPv4/v6 + non-match range OK
+ IPv6 FIB test OK
+ IPv6 Neighbour Solicitation Exceptions OK
+ ND Duplicates OK
+ IPv6 Router Solicitation Exceptions OK
+
==============================================================================
- ACL plugin connection-oriented extended testcases
+ IPv6 Punt Police/Redirect
==============================================================================
- Prepare the settings SKIP
- IPv4: Basic conn timeout test reflect on ingress SKIP
- IPv4: Basic conn timeout test reflect on egress SKIP
- IPv4: reflect egress, clear conn SKIP
- IPv4: reflect ingress, clear conn SKIP
- IPv4: Idle conn behind active conn, reflect on ingress SKIP
- IPv4: Idle conn behind active conn, reflect on egress SKIP
- IPv6: Basic conn timeout test reflect on ingress SKIP
- IPv6: Basic conn timeout test reflect on egress SKIP
- IPv6: reflect egress, clear conn SKIP
- IPv6: reflect ingress, clear conn SKIP
- IPv6: Idle conn behind active conn, reflect on ingress SKIP
- IPv6: Idle conn behind active conn, reflect on egress SKIP
- Prepare for TCP session tests SKIP
- IPv4: transient TCP session (incomplete 3WHS), ref. on ingress SKIP
- IPv4: transient TCP session (incomplete 3WHS), ref. on egress SKIP
- IPv4: established TCP session (complete 3WHS), ref. on ingress SKIP
- IPv4: established TCP session (complete 3WHS), ref. on egress SKIP
- IPv4: transient TCP session (3WHS,ACK,FINACK), ref. on ingress SKIP
- IPv4: transient TCP session (3WHS,ACK,FINACK), ref. on egress SKIP
- IPv6: transient TCP session (incomplete 3WHS), ref. on ingress SKIP
- IPv6: transient TCP session (incomplete 3WHS), ref. on egress SKIP
- IPv6: established TCP session (complete 3WHS), ref. on ingress SKIP
- IPv6: established TCP session (complete 3WHS), ref. on egress SKIP
- IPv6: transient TCP session (3WHS,ACK,FINACK), ref. on ingress SKIP
- IPv6: transient TCP session (3WHS,ACK,FINACK), ref. on egress SKIP
+ IP6 punt police and redirect OK
-MPLS Tests
-``````````
-::
+ ==============================================================================
+ IPv6 disabled
+ ==============================================================================
+ IP Disabled OK
==============================================================================
- MPLS-L2
+ IPv6 ND ProxyTest Case
==============================================================================
- Virtual Private LAN Service OK
- Virtual Private Wire Service OK
+ IPv6 Proxy ND OK
+
==============================================================================
- MPLS Test Case
+ IPv6 Load-Balancing
==============================================================================
- MPLS Local Label Binding test OK
- MPLS Deagg OK
- MPLS label imposition test OK
- MPLS Interface Receive OK
- MPLS Multicast Head-end OK
- MPLS IPv4 Multicast Tail OK
- MPLS IPv6 Multicast Tail OK
- MPLS Multicast Mid Point OK
- MPLS label swap tests OK
- MPLS Tunnel Tests OK
- MPLS V4 Explicit NULL test OK
- MPLS V6 Explicit NULL test OK
+ IPv6 Load-Balancing OK
+
==============================================================================
- MPLS PIC edge convergence
+ IPv6 routes via NULL
==============================================================================
- MPLS eBGP PIC edge convergence OK
- MPLS iBGP PIC edge convergence OK
- MPLSv6 eBGP PIC edge convergence OK
+ IP NULL route OK
+
==============================================================================
- MPLS disabled
+ IPv6 Input Exceptions
==============================================================================
- MPLS Disabled OK
+ IP6 Input Exceptions OK
IPv6 VRF Multi-instance
```````````````````````
@@ -579,122 +681,118 @@ IPv6 VRF Multi-instance IP6 VRF Multi-instance 3 - add 2 VRFs OK
IP6 VRF Multi-instance test 4 - reset 4 VRFs OK
-L2XC Tests
-``````````
+IRB Integrated Routing-Bridging
+```````````````````````````````
::
==============================================================================
- L2XC Test Case
+ IRB Test Case
==============================================================================
- L2XC dual-loop test OK
- L2XC single-loop test OK
+ IPv4 IRB test 1 OK
+ IPv4 IRB test 2 OK
-MFIB Tests
+Kube-proxy
``````````
::
==============================================================================
- MFIB Test Case
+ Kube-proxy Test Case
==============================================================================
- MFIB Unit Tests OK
+ Kube-proxy NAT44 OK
+ Kube-proxy NAT46 SKIP
+ Kube-proxy NAT64 SKIP
+ Kube-proxy NAT66 SKIP
-IP Multicast Tests
-``````````````````
+L2 FIB CRUD
+```````````
::
==============================================================================
- IP Multicast Test Case
+ L2 FIB Test Case
==============================================================================
- IPv6 Multicast Replication OK
- IPv6 Multicast Replication in non-default table OK
- IP Multicast Replication OK
- IP Multicast Connected Source check OK
- IP Multicast Signal OK
- IP Multicast Replication in non-default table OK
+ L2 FIB - program 100 + 100 MACs OK
+ L2 FIB - program 100 + delete 12 MACs OK
+ L2 FIB - flush all OK
+ L2 FIB - flush BD OK
+ L2 FIB - flush interface OK
+ L2 FIB - mac learning events OK
+ L2 FIB - mac learning max macs in event OK
+ L2 FIB - program 100 MACs OK
+ L2 FIB - Program 10 MACs, learn 10 OK
-Classifier
-``````````
+L2BD Multi-instance
+```````````````````
::
-#######
+
==============================================================================
- Classifier Test Case
+ L2BD Multi-instance Test Case
==============================================================================
- IP ACL test OK
- MAC ACL test OK
- IP PBR test OK
+ L2BD Multi-instance test 1 - create 5 BDs OK
+ L2BD Multi-instance test 2 - update data of 5 BDs OK
+ L2BD Multi-instance test 3 - delete 2 BDs OK
+ L2BD Multi-instance test 4 - add 2 BDs OK
+ L2BD Multi-instance test 5 - delete 5 BDs SKIP
-VXLAN Tests
-```````````
+L2BD Switching
+``````````````
::
==============================================================================
- VXLAN Test Case
+ L2BD Test Case
==============================================================================
- Decapsulation test OK
- Encapsulation test OK
- Multicast flood test OK
- Multicast receive test OK
- Unicast flood test OK
+ L2BD MAC learning dual-loop test OK
+ L2BD MAC learning single-loop test OK
-VXLAN-GPE Tests
-```````````
+L2XC Multi-instance
+```````````````````
::
==============================================================================
- VXLAN-GPE Test Case
+ L2XC Multi-instance Test Case
==============================================================================
- Decapsulation test SKIP
- Encapsulation test SKIP
- Multicast flood test SKIP
- Multicast receive test SKIP
- Unicast flood test SKIP
+ L2XC Multi-instance test 1 - create 10 cross-connects OK
+ L2XC Multi-instance test 2 - delete 4 cross-connects OK
+ L2BD Multi-instance 3 - add new 4 cross-connects OK
+ L2XC Multi-instance test 4 - delete 10 cross-connects OK
-L2 FIB CRUD
-```````````
+L2XC Switching
+``````````````
::
==============================================================================
- L2 FIB Test Case
+ L2XC Test Case
==============================================================================
- L2 FIB test 1 - program 100 MAC addresses OK
- L2 FIB test 2 - delete 12 MAC entries OK
- L2 FIB test 3 - program new 100 MAC addresses OK
- L2 FIB test 4 - delete 160 MAC entries OK
- L2 FIB test 5 - Program 10 new MAC entries, learn 10 OK
- L2 FIB test 6 - flush first interface OK
- L2 FIB test 7 - flush bd_id OK
- L2 FIB test 8 - flush all OK
- L2 FIB test 9 - mac learning events OK
-
-ARP Tests
-`````````
+ L2XC dual-loop test OK
+ L2XC single-loop test OK
+
+LISP Tunnels
+````````````
::
==============================================================================
- ARP Test Case
+ Basic LISP test
==============================================================================
- ARP OK
- MPLS OK
- Proxy ARP OK
+ Test case for basic encapsulation OK
-L2BD Tests
-``````````
+Load Balancer
+`````````````
::
==============================================================================
- L2BD Test Case
+ Load Balancer Test Case
==============================================================================
- L2BD MAC learning dual-loop test OK
- L2BD MAC learning single-loop test OK
+ Load Balancer IP4 GRE4 OK
+ Load Balancer IP4 GRE6 OK
+ Load Balancer IP6 GRE4 OK
+ Load Balancer IP6 GRE6 OK
-MACIP Access Control Tests
-``````````
+MACIP Access Control
+````````````````````
::
==============================================================================
- MACIP Test Case
+ MACIP Tests
==============================================================================
- IP4 MACIP wildcardMAC|exactIP ACL bridged traffic OK
MACIP 10 ACLs each with 100+ entries OK
MACIP 10 ACLs each with 100+ entries with IP4 traffic OK
MACIP 10 ACLs each with 100+ entries with IP6 traffic OK
@@ -705,14 +803,12 @@ MACIP Access Control Tests MACIP ACL with 5 entries OK
MACIP ACL with 50 entries OK
MACIP 2 ACLs each with 100+ entries OK
- IP4 MACIP exactMAC|exactIP ACL bridged traffic OK
- IP4 MACIP exactMAC|subnetIP ACL bridged traffic OK
- IP4 MACIP exactMAC|wildIP ACL bridged traffic OK
- IP4 MACIP ouiMAC|exactIP ACL bridged traffic OK
- IP4 MACIP ouiMAC|subnetIP ACL bridged traffic OK
- IP4 MACIP ouiMAC|wildIP ACL bridged traffic OK
- IP4 MACIP wildcardMAC|subnetIP ACL bridged traffic OK
- IP4 MACIP wildcardMAC|wildIP ACL bridged traffic OK
+ MACIP replace ACL OK
+ MACIP ACL delete intf with acl OK
+
+ ==============================================================================
+ MACIP with IP6 traffic
+ ==============================================================================
IP6 MACIP exactMAC|exactIP ACL bridged traffic OK
IP6 MACIP exactMAC|subnetIP ACL bridged traffic OK
IP6 MACIP exactMAC|wildIP ACL bridged traffic OK
@@ -722,18 +818,7 @@ MACIP Access Control Tests IP6 MACIP wildcardMAC|exactIP ACL bridged traffic OK
IP6 MACIP wildcardMAC|subnetIP ACL bridged traffic OK
IP6 MACIP wildcardMAC|wildIP ACL bridged traffic OK
- MACIP replace ACL OK
- MACIP replace ACL with IP4 traffic OK
MACIP replace ACL with IP6 traffic OK
- IP4 MACIP exactMAC|exactIP ACL routed traffic OK
- IP4 MACIP exactMAC|subnetIP ACL routed traffic OK
- IP4 MACIP exactMAC|wildIP ACL routed traffic OK
- IP4 MACIP ouiMAC|exactIP ACL routed traffic OK
- IP4 MACIP ouiMAC|subnetIP ACL routed traffic OK
- IP4 MACIP ouiMAC|wildIP ACL routed traffic OK
- IP4 MACIP wildcardMAC|exactIP ACL routed traffic OK
- IP4 MACIP wildcardMAC|subnetIP ACL routed traffic OK
- IP4 MACIP wildcardMAC|wildIP ACL OK
IP6 MACIP exactMAC|exactIP ACL routed traffic OK
IP6 MACIP exactMAC|subnetIP ACL routed traffic OK
IP6 MACIP exactMAC|wildIP ACL routed traffic OK
@@ -743,10 +828,240 @@ MACIP Access Control Tests IP6 MACIP wildcardMAC|exactIP ACL routed traffic OK
IP6 MACIP wildcardMAC|subnetIP ACL routed traffic OK
IP6 MACIP wildcardMAC|wildIP ACL OK
- MACIP ACL delete intf with acl OK
-SRv6 Tests
-``````````
+ ==============================================================================
+ MACIP with IP4 traffic
+ ==============================================================================
+ IP4 MACIP wildcardMAC|exactIP ACL bridged traffic OK
+ IP4 MACIP exactMAC|exactIP ACL bridged traffic OK
+ IP4 MACIP exactMAC|subnetIP ACL bridged traffic OK
+ IP4 MACIP exactMAC|wildIP ACL bridged traffic OK
+ IP4 MACIP ouiMAC|exactIP ACL bridged traffic OK
+ IP4 MACIP ouiMAC|subnetIP ACL bridged traffic OK
+ IP4 MACIP ouiMAC|wildIP ACL bridged traffic OK
+ IP4 MACIP wildcardMAC|subnetIP ACL bridged traffic OK
+ IP4 MACIP wildcardMAC|wildIP ACL bridged traffic OK
+ MACIP replace ACL with IP4 traffic OK
+ IP4 MACIP exactMAC|exactIP ACL routed traffic OK
+ IP4 MACIP exactMAC|subnetIP ACL routed traffic OK
+ IP4 MACIP exactMAC|wildIP ACL routed traffic OK
+ IP4 MACIP ouiMAC|exactIP ACL routed traffic OK
+ IP4 MACIP ouiMAC|subnetIP ACL routed traffic OK
+ IP4 MACIP ouiMAC|wildIP ACL routed traffic OK
+ IP4 MACIP wildcardMAC|exactIP ACL routed traffic OK
+ IP4 MACIP wildcardMAC|subnetIP ACL routed traffic OK
+ IP4 MACIP wildcardMAC|wildIP ACL OK
+
+MAP Softwires
+`````````````
+::
+
+ ==============================================================================
+ MAP Test Case
+ ==============================================================================
+ MAP-E OK
+
+MFIB Multicast FIB
+``````````````````
+::
+
+ ==============================================================================
+ MFIB Test Case
+ ==============================================================================
+ MFIB Unit Tests OK
+
+MPLS Switching
+``````````````
+::
+
+ ==============================================================================
+ MPLS-L2
+ ==============================================================================
+ Virtual Private LAN Service OK
+ Virtual Private Wire Service OK
+
+ ==============================================================================
+ MPLS Test Case
+ ==============================================================================
+ MPLS Local Label Binding test OK
+ MPLS Deagg OK
+ MPLS label imposition test OK
+ MPLS Interface Receive OK
+ MPLS Multicast Head-end OK
+ MPLS IPv4 Multicast Tail OK
+ MPLS IPv6 Multicast Tail OK
+ MPLS Multicast Mid Point OK
+ MPLS label swap tests OK
+ MPLS Tunnel Tests OK
+ MPLS V4 Explicit NULL test OK
+ MPLS V6 Explicit NULL test OK
+
+ ==============================================================================
+ MPLS PIC edge convergence
+ ==============================================================================
+ MPLS eBGP PIC edge convergence OK
+ MPLS iBGP PIC edge convergence OK
+ MPLSv6 eBGP PIC edge convergence OK
+
+ ==============================================================================
+ MPLS disabled
+ ==============================================================================
+ MPLS Disabled OK
+
+NAT44
+`````
+::
+
+ ==============================================================================
+ NAT44 Test Cases
+ ==============================================================================
+ Delete NAT44 session OK
+ NAT44 dynamic translation test OK
+ NAT44 handling of client packets with TTL=1 OK
+ NAT44 handling of error responses to client packets with TTL=2 OK
+ NAT44 handling of server packets with TTL=1 OK
+ NAT44 handling of error responses to server packets with TTL=2 OK
+ NAT44 interfaces without configured IP address OK
+ NAT44 forwarding test OK
+ NAT44 translate fragments arriving in order OK
+ NAT44 translate fragments arriving out of order OK
+ NAT44 hairpinning - 1:1 NAPT OK
+ NAT44 hairpinning - 1:1 NAT OK
+ 1:1 NAT translate packet with unknown protocol - hairpinning OK
+ NAT44 translate packet with unknown protocol - hairpinning OK
+ Identity NAT OK
+ NAT44 multiple inside interfaces with overlapping address space OK
+ Acquire NAT44 addresses from interface OK
+ Identity NAT with addresses from interface OK
+ Static mapping with addresses from interface OK
+ IPFIX logging NAT addresses exhausted OK
+ IPFIX logging NAT44 session created/delted OK
+ MAX translations per user - recycle the least recently used OK
+ NAT44 multiple non-overlapping address space inside interfaces OK
+ One armed NAT44 OK
+ NAT44 interface output feature (in2out postrouting) OK
+ NAT44 interface output feature hairpinning (in2out postrouting) OK
+ NAT44 interface output feature VRF aware (in2out postrouting) OK
+ Ping internal host from outside network OK
+ Ping NAT44 out interface from outside network OK
+ NAT44 add pool addresses to FIB OK
+ Port restricted NAT44 (MAP-E CE) OK
+ NAT44 fragments hairpinning OK
+ NAT44 set/get virtual fragmentation reassembly OK
+ 1:1 NAT initialized from inside network OK
+ NAT44 interfaces without configured IP address - 1:1 NAT OK
+ NAT44 local service load balancing OK
+ 1:1 NAT initialized from outside network OK
+ 1:1 NAT translate packet with unknown protocol OK
+ 1:1 NAT VRF awareness OK
+ 1:1 NAPT initialized from inside network OK
+ NAT44 interfaces without configured IP address - 1:1 NAPT OK
+ 1:1 NAPT initialized from outside network OK
+ Twice NAT44 OK
+ Acquire twice NAT44 addresses from interface OK
+ Twice NAT44 local service load balancing OK
+ NAT44 translate packet with unknown protocol OK
+ NAT44 tenant VRF independent address pool mode OK
+ NAT44 tenant VRF aware address pool mode OK
+
+ ==============================================================================
+ Deterministic NAT Test Cases
+ ==============================================================================
+ Deterministic NAT translation test (TCP, UDP, ICMP) OK
+ NAT plugin run deterministic mode OK
+ Deterministic NAT multiple users OK
+ Deterministic NAT maximum sessions per user limit SKIP
+ Deterministic NAT session timeouts SKIP
+ Set deterministic NAT timeouts OK
+ Deterministic NAT TCP session close from inside network OK
+ Deterministic NAT TCP session close from outside network OK
+
+NAT64
+`````
+::
+
+ ==============================================================================
+ NAT64 Test Cases
+ ==============================================================================
+ NAT64 dynamic translation test OK
+ NAT64 translate fragments arriving in order OK
+ NAT64 translate fragments arriving out of order OK
+ NAT64 hairpinning OK
+ NAT64 translate packet with unknown protocol - hairpinning OK
+ NAT64 ICMP Error message translation OK
+ Enable/disable NAT64 feature on the interface OK
+ Acquire NAT64 pool addresses from interface OK
+ One armed NAT64 OK
+ Add/delete address to NAT64 pool OK
+ NAT64 Network-Specific Prefix OK
+ NAT64 fragments hairpinning OK
+ NAT64 session timeout SKIP
+ Set NAT64 timeouts OK
+ NAT64 static translation test OK
+ Add/delete static BIB entry OK
+ NAT64 translate packet with unknown protocol OK
+
+P2P Ethernet Subinterface
+`````````````````````````
+::
+
+ ==============================================================================
+ P2P Ethernet tests
+ ==============================================================================
+ delete/create p2p subif OK
+ create 1k of p2p subifs OK
+
+ ==============================================================================
+ P2P Ethernet IPv4 tests
+ ==============================================================================
+ receive ipv4 packet via p2p subinterface OK
+ route rx packet not matching p2p subinterface OK
+ send ip4 packet via p2p subinterface OK
+ drop tx ip4 packet not matching p2p subinterface OK
+
+ ==============================================================================
+ P2P Ethernet IPv6 tests
+ ==============================================================================
+ receive ipv6 packet via p2p subinterface OK
+ drop rx packet not matching p2p subinterface OK
+ route rx ip6 packet not matching p2p subinterface OK
+ send packet via p2p subinterface OK
+ drop tx ip6 packet not matching p2p subinterface OK
+ standard routing without p2p subinterfaces OK
+
+PPPoE Encapsulation
+```````````````````
+::
+
+ ==============================================================================
+ PPPoE Test Case
+ ==============================================================================
+ PPPoE Add Same Session Twice Test OK
+ PPPoE Decap Test OK
+ PPPoE Decap Multiple Sessions Test OK
+ PPPoE Delete Same Session Twice Test OK
+ PPPoE Encap Test OK
+ PPPoE Encap Multiple Sessions Test OK
+
+SPAN Switch Port Analyzer
+`````````````````````````
+::
+
+ ==============================================================================
+ SPAN Test Case
+ ==============================================================================
+ SPAN device rx mirror OK
+ SPAN l2 broadcast mirror OK
+ SPAN l2 rx tx mirror OK
+ SPAN l2 tx mirror OK
+ SPAN l2 rx mirror OK
+ SPAN l2 rx mirror into 1ad subif+vtr OK
+ SPAN l2 rx mirror into 1q subif+vtr OK
+ SPAN l2 rx mirror into gre-subif+vtr OK
+ SPAN l2 rx mirror into vxlan OK
+
+SRv6 Routing
+````````````
::
==============================================================================
@@ -765,23 +1080,29 @@ SRv6 Tests Test SRv6 Transit.Encaps behavior for IPv4. OK
Test SRv6 Transit.Encaps behavior for L2. SKIP
Test SRv6 Transit.Insert behavior (IPv6 only). OK
+ Test SRv6 Transit.Insert behavior (IPv6 only). OK
-PPPoE Tests
-```````````
+TCP/IP Stack
+````````````
::
==============================================================================
- PPPoE Test Case
+ TCP Test Case
==============================================================================
- PPPoE Add Same Session Twice Test OK
- PPPoE Decap Test OK
- PPPoE Decap Multiple Sessions Test OK
- PPPoE Delete Same Session Twice Test OK
- PPPoE Encap Test OK
- PPPoE Encap Multiple Sessions Test OK
+ TCP builtin client/server transfer OK
+ TCP Unit Tests OK
-VTR VLAN Tag Rewrite Tests
-``````````````````````````
+UDP Stack
+`````````
+::
+
+ ==============================================================================
+ UDP Encap Test Case
+ ==============================================================================
+ UDP Encap test OK
+
+VTR VLAN Tag Rewrites
+`````````````````````
::
==============================================================================
@@ -807,71 +1128,12 @@ VTR VLAN Tag Rewrite Tests 1Q VTR translate 1 -> 1 test OK
1Q VTR translate 1 -> 2 test OK
-ARP Tests
-`````````
-::
-
- ==============================================================================
- ARP Test Case
- ==============================================================================
- ARP OK
- ARP Duplicates OK
- ARP Static OK
- ARP reply with VRRP virtual src hw addr OK
- MPLS OK
- Proxy ARP OK
- Interface Mirror Proxy ARP OK
- ==============================================================================
- L2BD arp termination Test Case
- ==============================================================================
- L2BD arp term - add 5 hosts, verify arp responses OK
- L2BD arp term - delete 3 hosts, verify arp responses OK
- L2BD arp term - recreate BD1, readd 3 hosts, verify arp responses OK
- L2BD arp term - 2 IP4 addrs per host OK
- L2BD arp term - create and update 10 IP4-mac pairs OK
- L2BD arp/ND term - hosts with both ip4/ip6 OK
- L2BD ND term - Add and Del hosts, verify ND replies OK
- L2BD ND term - Add and update IP+mac, verify ND replies OK
- L2BD arp term - send garps, verify arp event reports OK
- L2BD arp term - send duplicate garps, verify suppression OK
- L2BD arp term - disable ip4 arp events,send garps, verify no events OK
- L2BD ND term - send NS packets verify reports OK
- L2BD ND term - send duplicate ns, verify suppression OK
- L2BD ND term - disable ip4 arp events,send ns, verify no events OK
-
-P2P Ethernet Subinterface ests
-``````````````````````````````
-::
-
- ==============================================================================
- P2P Ethernet tests
- ==============================================================================
- delete/create p2p subif OK
- create 100k of p2p subifs SKIP
- create 1k of p2p subifs OK
- ==============================================================================
- P2P Ethernet IPv4 tests
- ==============================================================================
- receive ipv4 packet via p2p subinterface OK
- route rx packet not matching p2p subinterface OK
- send ip4 packet via p2p subinterface OK
- drop tx ip4 packet not matching p2p subinterface OK
- ==============================================================================
- P2P Ethernet IPv6 tests
- ==============================================================================
- receive ipv6 packet via p2p subinterface OK
- drop rx packet not matching p2p subinterface OK
- route rx ip6 packet not matching p2p subinterface OK
- send packet via p2p subinterface OK
- drop tx ip6 packet not matching p2p subinterface OK
- standard routing without p2p subinterfaces OK
-
-GTPU Test Case
-``````````````
+VXLAN Tunnels
+`````````````
::
==============================================================================
- GTPU Test Case
+ VXLAN Test Case
==============================================================================
Decapsulation test OK
Encapsulation test OK
@@ -879,38 +1141,38 @@ GTPU Test Case Multicast receive test OK
Unicast flood test OK
-Other Tests
-```````````
+VXLAN-GPE Tunnels
+`````````````````
::
==============================================================================
- VAPI test
+ VXLAN-GPE Test Case
==============================================================================
- run C VAPI tests SKIP
- run C++ VAPI tests SKIP
+ Decapsulation test SKIP
+ Encapsulation test SKIP
+ Multicast flood test SKIP
+ Multicast receive test SKIP
+ Unicast flood test SKIP
+
+Other Tests
+```````````
+::
+
==============================================================================
Ping Test Case
==============================================================================
basic ping test OK
burst ping test OK
+
+ ==============================================================================
+ Session Test Case
+ ==============================================================================
+ Session Unit Tests OK
+
==============================================================================
Template verification, timer tests
==============================================================================
timer less than template timeout OK
timer greater than template timeout OK
verify cflow packet fields OK
- ==============================================================================
- JVPP Core Test Case
- ==============================================================================
- JVPP Acl Callback Api Test Case OK
- JVPP Acl Future Api Test Case OK
- JVPP Core Callback Api Test Case OK
- JVPP Core Future Api Test Case OK
- JVPP Ioamexport Callback Api Test Case OK
- JVPP Ioamexport Future Api Test Case OK
- JVPP Ioampot Callback Api Test Case OK
- JVPP Ioampot Future Api Test Case OK
- JVPP Ioamtrace Callback Api Test Case OK
- JVPP Ioamtrace Future Api Test Case OK
- JVPP Snat Callback Api Test Case OK
- JVPP Snat Future Api Test Case OK
\ No newline at end of file +
diff --git a/docs/report/vpp_unit_tests/overview.rst b/docs/report/vpp_unit_tests/overview.rst index 90c582c943..9472680aa5 100644 --- a/docs/report/vpp_unit_tests/overview.rst +++ b/docs/report/vpp_unit_tests/overview.rst @@ -35,40 +35,53 @@ Unit Tests Coverage Following VPP functional test areas are covered in VPP unit test code included
in VPP rls1710 with results listed in this report:
-- ARP - ARP, Proxy ARP.
-- ACL plugin - stateful and stateless security-groups access-control-lists.
-- BFD IPv4 - Bidirectional Forwarding Detection - baseline, APIs, authorization, authentication.
-- BFD IPv6 - Bidirectional Forwarding Detection - baseline, APIs, authorization, authentication.
+- ACL Security - stateful and stateless security-groups access-control-lists.
+- APIs - VAPI, VOM, PAPI, JVPP.
+- ARP - ARP, proxy ARP, static arp.
+- BFD - API, Authentication, Authentication Change, CLI.
+- BFD IPv4 - sessions operation.
+- BFD IPv6 - sessions operation.
+- BIER - Bit Indexed Explicit Replication.
- Classifier - classification with IP ACL, MAC ACL, IP PBR.
+- Container Integration - IPv4, IPv6 local-spoof connectivity tests.
- CRUD Loopback - create, read, update, delete Loopback interfaces.
-- Deterministic NAT - Carrier Grade NAT tests.
-- DHCP - DHCPv4 and DHCPv6 Proxy.
+- DHCP - DHCPv4/v6 Client and Proxy.
+- Distributed Virtual Router.
+- DS-Lite Softwire - softwire termination.
- FIB - baseline and scale tests.
-- Flow-per-packet plugin - collect and report L2 and IP4 flow statistics.
-- Flowprobe tests.
-- GRE - GRE IPv4/IPv6 tunnel, L2, VRF tests.
-- GTPU - baseline GTPU tests.
-- IP Multicast - IPv4/IPv6 multicast replication, connected source check.
+- Flowprobe.
+- Geneve Tunnels.
+- GRE Tunnels - GRE IPv4/IPv6 tunnel, L2, VRF tests.
+- GTPU Tunnels - baseline GTPU tests.
+- IP Multicast Routing - IPv4/IPv6 multicast replication, connected source check.
+- IPSec - baseline IPSec sanity tests.
+- IPv4 FIB CRUD - add/update/delete IPv4 routes.
+- IPv4 Routing.
- IP4 VRF Multi-instance - create, read, update, delete and verify IPv4 VRFs.
+- IPv6 Routing - baseline FIB operations, NS/RS exception handling.
- IP6 VRF Multi-instance - create, read, update, delete and verify IPv6 VRFs.
-- IPv4 - baseline FIB tests.
-- IPv4 FIB CRUD - add/update/delete IPv4 routes.
-- IPv6 - baseline FIB operations, NS/RS exception handling.
-- IRB - Integrated Routing and Bridging tests.
+- IRB Integrated Routing-Bridging.
+- Kube-proxy - data plane NAT tests.
- L2 FIB CRUD - add/update/delete L2 MAC entries.
-- L2BD - L2 Bridge-Domain baseline tests incl. single- and dual-loop.
-- L2XC - L2 cross-connect baseline tests incl. single- and dual-loop.
+- L2BD Multi-instance.
+- L2BD Switching - L2 Bridge-Domain baseline tests incl. single- and dual-loop.
- L2XC Multi-instance - L2 cross-connect multi-instance tests.
-- LISP - basic LISP tests.
+- L2XC Switching - L2 cross-connect baseline tests incl. single- and dual-loop.
+- LISP Tunnels - basic LISP tests.
- Load Balancer - IP4 GRE4, IP4 GRE6, IP6 GRE4, IP6 GRE6.
-- MACIP - ingress access control for IPv4, IPv6 with L2BDP and IP routing.
-- MFIB Unit.
-- MPLS - MPLS baseline tests.
-- MPLS PIC edge convergence - prefix independent convergence tests for MPLS PE.
-- NAT44 - NAT44 tests, IPFIX logging, VRF awareness.
+- MACIP Access Control - ingress access control for IPv4, IPv6 with L2BDP and IP routing.
+- MAP Softwires - softwire termination.
+- MFIB Multicast FIB.
+- MPLS Switching - MPLS baseline, prefix independent convergence for MPLS PE.
+- NAT44 - NAT44 tests, IPFIX logging, VRF awareness, deterministic CGNAT.
- NAT64 - NAT64 static and dynamic translation tests.
-- SPAN - Switched Port Analyzer packet mirroring.
-- SRv6 - Segment Routing IPv6 tests.
-- VTR Test Case - VLAN tag manipulation tests.
-- VXLAN - baseline VXLAN tunneling.
-- VXLAN-GPE - baseline VXLAN-GPE tunneling tests including multicast.
+- P2P Ethernet Subinterface.
+- PPPoE Encapsulation.
+- SPAN Switch Port Analyzer - packet mirroring.
+- SRv6 Routing - Segment Routing IPv6 tests.
+- TCP/IP Stack - unit tests, builtin client/server transfers.
+- UDP Stack - unit tests.
+- VTR VLAN Tag Rewrites - VLAN tag rewrite tests.
+- VXLAN Tunnels - baseline VXLAN tests including multicast.
+- VXLAN-GPE Tunnels - baseline VXLAN-GPE tunneling including multicast.
+- Other Tests - ping, session, template verification, timer tests.
|