diff options
Diffstat (limited to 'tests/suites/performance')
12 files changed, 97 insertions, 88 deletions
diff --git a/tests/suites/performance/Long_Xconnect_Dot1ad_Intel-X520-DA2.robot b/tests/suites/performance/Long_Xconnect_Dot1ad_Intel-X520-DA2.robot index 07b8468606..09d93983fe 100644 --- a/tests/suites/performance/Long_Xconnect_Dot1ad_Intel-X520-DA2.robot +++ b/tests/suites/performance/Long_Xconnect_Dot1ad_Intel-X520-DA2.robot @@ -22,12 +22,12 @@ | Test Setup | Setup all DUTs before test | Test Teardown | Run Keywords | Remove startup configuration of VPP from all DUTs | ... | AND | Show vpp trace dump on all DUTs -| Documentation | *RFC2544: Pkt throughput L2XC with dot1ad test cases* +| Documentation | *RFC2544: Pkt throughput L2XC with 802.1ad test cases* | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology | ... | with single links between nodes. -| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 switching of IPv4. -| ... | Dot1ad tagging is applied on link between DUT1 and DUT2 with inner 4B +| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 xconnect. +| ... | 802.1ad tagging is applied on link between DUT1 and DUT2 with inner 4B | ... | vlan tag (id=100) and outer 4B vlan tag (id=200). | ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with L2 cross- | ... | connect. DUT1 and DUT2 tested with 2p10GE NIC X520 Niantic by Intel. @@ -53,7 +53,7 @@ | ${tag_rewrite}= | pop-2 *** Test Cases *** -| TC01: 64B NDR binary search - DUT L2XC with dot1ad - 1thread 1core 1rxq +| TC01: 64B NDR binary search - DUT L2XC with 802.1ad - 1thread 1core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC forwarding config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 64 Byte frames @@ -84,7 +84,7 @@ | | ... | ${min_rate} | ${max_rate} | | ... | ${threshold} -| TC02: 64B PDR binary search - DUT L2XC with dot1ad - 1thread 1core 1rxq +| TC02: 64B PDR binary search - DUT L2XC with 802.1ad - 1thread 1core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC forwarding config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames @@ -117,7 +117,7 @@ | | ... | ${glob_loss_acceptance} | | ... | ${glob_loss_acceptance_type} -| TC03: 1514B NDR binary search - DUT L2XC with dot1ad - 1thread 1core 1rxq +| TC03: 1514B NDR binary search - DUT L2XC with 802.1ad - 1thread 1core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC forwarding config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 1514 Byte frames @@ -148,7 +148,7 @@ | | ... | ${min_rate} | ${max_rate} | | ... | ${threshold} -| TC04: 1514B PDR binary search - DUT L2XC with dot1ad - 1thread 1core 1rxq +| TC04: 1514B PDR binary search - DUT L2XC with 802.1ad - 1thread 1core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC forwarding config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 1514 Byte frames @@ -181,7 +181,7 @@ | | ... | ${glob_loss_acceptance} | | ... | ${glob_loss_acceptance_type} -| TC05: 9000B NDR binary search - DUT L2XC with dot1ad - 1thread 1core 1rxq +| TC05: 9000B NDR binary search - DUT L2XC with 802.1ad - 1thread 1core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC forwarding config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 9000 Byte frames @@ -211,7 +211,7 @@ | | ... | ${min_rate} | ${max_rate} | | ... | ${threshold} -| TC06: 9000B PDR binary search - DUT L2XC with dot1ad - 1thread 1core 1rxq +| TC06: 9000B PDR binary search - DUT L2XC with 802.1ad - 1thread 1core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC forwarding config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 9000 Byte frames @@ -243,7 +243,7 @@ | | ... | ${glob_loss_acceptance} | | ... | ${glob_loss_acceptance_type} -| TC07: 64B NDR binary search - DUT L2XC with dot1ad - 2threads 2cores 1rxq +| TC07: 64B NDR binary search - DUT L2XC with 802.1ad - 2threads 2cores 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC forwarding config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 64 Byte frames @@ -274,7 +274,7 @@ | | ... | ${min_rate} | ${max_rate} | | ... | ${threshold} -| TC08: 64B PDR binary search - DUT L2XC with dot1ad - 2threads 2cores 1rxq +| TC08: 64B PDR binary search - DUT L2XC with 802.1ad - 2threads 2cores 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC forwarding config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames @@ -307,7 +307,7 @@ | | ... | ${glob_loss_acceptance} | | ... | ${glob_loss_acceptance_type} -| TC09: 1514B NDR binary search - DUT L2XC with dot1ad - 2threads 2cores 1rxq +| TC09: 1514B NDR binary search - DUT L2XC with 802.1ad - 2threads 2cores 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC forwarding config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 1514 Byte frames @@ -338,7 +338,7 @@ | | ... | ${min_rate} | ${max_rate} | | ... | ${threshold} -| TC10: 1514B PDR binary search - DUT L2XC with dot1ad - 2threads 2cores 1rxq +| TC10: 1514B PDR binary search - DUT L2XC with 802.1ad - 2threads 2cores 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC forwarding config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 1514 Byte frames @@ -371,7 +371,7 @@ | | ... | ${glob_loss_acceptance} | | ... | ${glob_loss_acceptance_type} -| TC11: 9000B NDR binary search - DUT L2XC with dot1ad - 2threads 2cores 1rxq +| TC11: 9000B NDR binary search - DUT L2XC with 802.1ad - 2threads 2cores 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC forwarding config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 9000 Byte frames @@ -401,7 +401,7 @@ | | ... | ${min_rate} | ${max_rate} | | ... | ${threshold} -| TC12: 9000B PDR binary search - DUT L2XC with dot1ad - 2threads 2cores 1rxq +| TC12: 9000B PDR binary search - DUT L2XC with 802.1ad - 2threads 2cores 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC forwarding config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 9000 Byte frames @@ -433,7 +433,7 @@ | | ... | ${glob_loss_acceptance} | | ... | ${glob_loss_acceptance_type} -| TC13: 64B NDR binary search - DUT L2XC with dot1ad - 4threads 4cores 2rxq +| TC13: 64B NDR binary search - DUT L2XC with 802.1ad - 4threads 4cores 2rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC forwarding config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 64 Byte frames @@ -464,7 +464,7 @@ | | ... | ${min_rate} | ${max_rate} | | ... | ${threshold} -| TC14: 64B PDR binary search - DUT L2XC with dot1ad - 4threads 4cores 2rxq +| TC14: 64B PDR binary search - DUT L2XC with 802.1ad - 4threads 4cores 2rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC forwarding config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 64 Byte frames @@ -497,7 +497,7 @@ | | ... | ${glob_loss_acceptance} | | ... | ${glob_loss_acceptance_type} -| TC15: 1514B NDR binary search - DUT L2XC with dot1ad - 4threads 4cores 2rxq +| TC15: 1514B NDR binary search - DUT L2XC with 802.1ad - 4threads 4cores 2rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC forwarding config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 1514 Byte frames @@ -528,7 +528,7 @@ | | ... | ${min_rate} | ${max_rate} | | ... | ${threshold} -| TC16: 1514B PDR binary search - DUT L2XC with dot1ad - 4threads 4cores 2rxq +| TC16: 1514B PDR binary search - DUT L2XC with 802.1ad - 4threads 4cores 2rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC forwarding config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 1514 Byte frames @@ -561,7 +561,7 @@ | | ... | ${glob_loss_acceptance} | | ... | ${glob_loss_acceptance_type} -| TC17: 9000B NDR binary search - DUT L2XC with dot1ad - 4threads 4cores 2rxq +| TC17: 9000B NDR binary search - DUT L2XC with 802.1ad - 4threads 4cores 2rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC forwarding config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 9000 Byte frames @@ -591,7 +591,7 @@ | | ... | ${min_rate} | ${max_rate} | | ... | ${threshold} -| TC18: 9000B PDR binary search - DUT L2XC with dot1ad - 4threads 4cores 2rxq +| TC18: 9000B PDR binary search - DUT L2XC with 802.1ad - 4threads 4cores 2rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC forwarding config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 9000 Byte frames diff --git a/tests/suites/performance/Long_Xconnect_Dot1q_Intel-X520-DA2.robot b/tests/suites/performance/Long_Xconnect_Dot1q_Intel-X520-DA2.robot index 814621f32d..86716f460d 100644 --- a/tests/suites/performance/Long_Xconnect_Dot1q_Intel-X520-DA2.robot +++ b/tests/suites/performance/Long_Xconnect_Dot1q_Intel-X520-DA2.robot @@ -22,11 +22,12 @@ | Test Setup | Setup all DUTs before test | Test Teardown | Run Keywords | Remove startup configuration of VPP from all DUTs | ... | AND | Show vpp trace dump on all DUTs -| Documentation | *RFC2544: Pkt throughput L2XC test cases* +| Documentation | *RFC2544: Pkt throughput L2XC with 802.1q test cases* | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology | ... | with single links between nodes. -| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 switching of IPv4. +| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 cross connect. 802.1q +| ... | tagging is applied on link between DUT1 and DUT2. | ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with L2 cross- | ... | connect. DUT1 and DUT2 tested with 2p10GE NIC X520 Niantic by Intel. | ... | *[Ver] TG verification:* TG finds and reports throughput NDR (Non Drop @@ -48,7 +49,7 @@ | ${tag_rewrite}= | pop-1 *** Test Cases *** -| TC01: 64B NDR binary search - DUT L2XC with dot1q - 1thread 1core 1rxq +| TC01: 64B NDR binary search - DUT L2XC with 802.1q - 1thread 1core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 64 Byte frames @@ -78,7 +79,7 @@ | | ... | ${min_rate} | ${max_rate} | | ... | ${threshold} -| TC02: 64B PDR binary search - DUT L2XC with dot1q - 1thread 1core 1rxq +| TC02: 64B PDR binary search - DUT L2XC with 802.1q - 1thread 1core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames @@ -110,7 +111,7 @@ | | ... | ${glob_loss_acceptance} | | ... | ${glob_loss_acceptance_type} -| TC03: 1518B NDR binary search - DUT L2XC with dot1q - 1thread 1core 1rxq +| TC03: 1518B NDR binary search - DUT L2XC with 802.1q - 1thread 1core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 1518 Byte frames @@ -140,7 +141,7 @@ | | ... | ${min_rate} | ${max_rate} | | ... | ${threshold} -| TC04: 1518B PDR binary search - DUT L2XC with dot1q - 1thread 1core 1rxq +| TC04: 1518B PDR binary search - DUT L2XC with 802.1q - 1thread 1core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 1518 Byte frames @@ -172,7 +173,7 @@ | | ... | ${glob_loss_acceptance} | | ... | ${glob_loss_acceptance_type} -| TC05: 9000B NDR binary search - DUT L2XC with dot1q - 1thread 1core 1rxq +| TC05: 9000B NDR binary search - DUT L2XC with 802.1q - 1thread 1core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 9000 Byte frames @@ -201,7 +202,7 @@ | | ... | ${min_rate} | ${max_rate} | | ... | ${threshold} -| TC06: 9000B PDR binary search - DUT L2XC with dot1q - 1thread 1core 1rxq +| TC06: 9000B PDR binary search - DUT L2XC with 802.1q - 1thread 1core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 9000 Byte frames @@ -232,7 +233,7 @@ | | ... | ${glob_loss_acceptance} | | ... | ${glob_loss_acceptance_type} -| TC07: 64B NDR binary search - DUT L2XC with dot1q - 2threads 2cores 1rxq +| TC07: 64B NDR binary search - DUT L2XC with 802.1q - 2threads 2cores 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 64 Byte frames @@ -262,7 +263,7 @@ | | ... | ${min_rate} | ${max_rate} | | ... | ${threshold} -| TC08: 64B PDR binary search - DUT L2XC with dot1q - 2threads 2cores 1rxq +| TC08: 64B PDR binary search - DUT L2XC with 802.1q - 2threads 2cores 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames @@ -294,7 +295,7 @@ | | ... | ${glob_loss_acceptance} | | ... | ${glob_loss_acceptance_type} -| TC09: 1518B NDR binary search - DUT L2XC with dot1q - 2threads 2cores 1rxq +| TC09: 1518B NDR binary search - DUT L2XC with 802.1q - 2threads 2cores 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 1518 Byte frames @@ -324,7 +325,7 @@ | | ... | ${min_rate} | ${max_rate} | | ... | ${threshold} -| TC10: 1518B PDR binary search - DUT L2XC with dot1q - 2threads 2cores 1rxq +| TC10: 1518B PDR binary search - DUT L2XC with 802.1q - 2threads 2cores 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 1518 Byte frames @@ -356,7 +357,7 @@ | | ... | ${glob_loss_acceptance} | | ... | ${glob_loss_acceptance_type} -| TC11: 9000B NDR binary search - DUT L2XC with dot1q - 2threads 2cores 1rxq +| TC11: 9000B NDR binary search - DUT L2XC with 802.1q - 2threads 2cores 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Find NDR for 9000 Byte frames @@ -385,7 +386,7 @@ | | ... | ${min_rate} | ${max_rate} | | ... | ${threshold} -| TC12: 9000B PDR binary search - DUT L2XC with dot1q - 2threads 2cores 1rxq +| TC12: 9000B PDR binary search - DUT L2XC with 802.1q - 2threads 2cores 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 9000 Byte frames @@ -416,7 +417,7 @@ | | ... | ${glob_loss_acceptance} | | ... | ${glob_loss_acceptance_type} -| TC13: 64B NDR binary search - DUT L2XC with dot1q - 4threads 4cores 2rxq +| TC13: 64B NDR binary search - DUT L2XC with 802.1q - 4threads 4cores 2rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 64 Byte frames @@ -446,7 +447,7 @@ | | ... | ${min_rate} | ${max_rate} | | ... | ${threshold} -| TC14: 64B PDR binary search - DUT L2XC with dot1q - 4threads 4cores 2rxq +| TC14: 64B PDR binary search - DUT L2XC with 802.1q - 4threads 4cores 2rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 64 Byte frames @@ -478,7 +479,7 @@ | | ... | ${glob_loss_acceptance} | | ... | ${glob_loss_acceptance_type} -| TC15: 1518B NDR binary search - DUT L2XC with dot1q - 4threads 4cores 2rxq +| TC15: 1518B NDR binary search - DUT L2XC with 802.1q - 4threads 4cores 2rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 1518 Byte frames @@ -508,7 +509,7 @@ | | ... | ${min_rate} | ${max_rate} | | ... | ${threshold} -| TC16: 1518B PDR binary search - DUT L2XC with dot1q - 4threads 4cores 2rxq +| TC16: 1518B PDR binary search - DUT L2XC with 802.1q - 4threads 4cores 2rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 1518 Byte frames @@ -540,7 +541,7 @@ | | ... | ${glob_loss_acceptance} | | ... | ${glob_loss_acceptance_type} -| TC17: 9000B NDR binary search - DUT L2XC with dot1q - 4threads 4cores 2rxq +| TC17: 9000B NDR binary search - DUT L2XC with 802.1q - 4threads 4cores 2rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Find NDR for 9000 Byte frames @@ -569,7 +570,7 @@ | | ... | ${min_rate} | ${max_rate} | | ... | ${threshold} -| TC18: 9000B PDR binary search - DUT L2XC with dot1q - 4threads 4cores 2rxq +| TC18: 9000B PDR binary search - DUT L2XC with 802.1q - 4threads 4cores 2rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Find PDR for 9000 Byte frames diff --git a/tests/suites/performance/Long_Xconnect_Intel-X520-DA2.robot b/tests/suites/performance/Long_Xconnect_Intel-X520-DA2.robot index 2a964430c6..01f692db9e 100644 --- a/tests/suites/performance/Long_Xconnect_Intel-X520-DA2.robot +++ b/tests/suites/performance/Long_Xconnect_Intel-X520-DA2.robot @@ -27,7 +27,7 @@ | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology | ... | with single links between nodes. -| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 switching of IPv4. +| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 cross connect. | ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with L2 cross- | ... | connect. DUT1 and DUT2 tested with 2p10GE NIC X520 Niantic by Intel. | ... | *[Ver] TG verification:* TG finds and reports throughput NDR (Non Drop diff --git a/tests/suites/performance/Short_Bridge_Domain_Intel-X520-DA2.robot b/tests/suites/performance/Short_Bridge_Domain_Intel-X520-DA2.robot index 21e1451496..0a0755b958 100644 --- a/tests/suites/performance/Short_Bridge_Domain_Intel-X520-DA2.robot +++ b/tests/suites/performance/Short_Bridge_Domain_Intel-X520-DA2.robot @@ -34,11 +34,12 @@ | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet | ... | loss tolerance. Ref-NDR value is periodically updated acording to | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long -| ... | performance tests for the same DUT confiiguration. Test packets are +| ... | performance tests for the same DUT configuration. Test packets are | ... | generated by TG on links to DUTs. TG traffic profile contains two L3 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61 -| ... | and generated payload. +| ... | and generated payload. MAC addresses are matching MAC addresses of the +| ... | TG node interfaces. | ... | *[Ref] Applicable standard specifications:* RFC2544. *** Test Cases *** diff --git a/tests/suites/performance/Short_IPv4_Cop_Intel-X520-DA2.robot b/tests/suites/performance/Short_IPv4_Cop_Intel-X520-DA2.robot index 45ded08b97..1861d5150e 100644 --- a/tests/suites/performance/Short_IPv4_Cop_Intel-X520-DA2.robot +++ b/tests/suites/performance/Short_IPv4_Cop_Intel-X520-DA2.robot @@ -37,11 +37,12 @@ | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet | ... | loss tolerance. Ref-NDR value is periodically updated acording to | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long -| ... | performance tests for the same DUT confiiguration. Test packets are +| ... | performance tests for the same DUT configuration. Test packets are | ... | generated by TG on links to DUTs. TG traffic profile contains two L3 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61 -| ... | and generated payload. +| ... | and generated payload. MAC addresses are matching MAC addresses of the +| ... | TG node interfaces. | ... | *[Ref] Applicable standard specifications:* RFC2544. *** Test Cases *** diff --git a/tests/suites/performance/Short_IPv4_Intel-X520-DA2.robot b/tests/suites/performance/Short_IPv4_Intel-X520-DA2.robot index 698197fef0..9e60561656 100644 --- a/tests/suites/performance/Short_IPv4_Intel-X520-DA2.robot +++ b/tests/suites/performance/Short_IPv4_Intel-X520-DA2.robot @@ -38,11 +38,12 @@ | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet | ... | loss tolerance. Ref-NDR value is periodically updated acording to | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long -| ... | performance tests for the same DUT confiiguration. Test packets are +| ... | performance tests for the same DUT configuration. Test packets are | ... | generated by TG on links to DUTs. TG traffic profile contains two L3 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61 -| ... | and generated payload. +| ... | and generated payload. MAC addresses are matching MAC addresses of the +| ... | TG node interfaces. | ... | *[Ref] Applicable standard specifications:* RFC2544. *** Test Cases *** diff --git a/tests/suites/performance/Short_IPv4_iAcl_Intel-X520-DA2.robot b/tests/suites/performance/Short_IPv4_iAcl_Intel-X520-DA2.robot index 6f6ec3a79d..ea4a0871d1 100644 --- a/tests/suites/performance/Short_IPv4_iAcl_Intel-X520-DA2.robot +++ b/tests/suites/performance/Short_IPv4_iAcl_Intel-X520-DA2.robot @@ -28,7 +28,7 @@ | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology | ... | with single links between nodes. -| ... | *[Enc] Packet Encapsulations:* Eth-IPv4-ICMPv4 for IPv4 routing. +| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for IPv4 routing. | ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with IPv4 | ... | routing, two static IPv4 /24 routes and IPv4 iAcl security whitelist | ... | ingress /24 filter entries applied on links TG - DUT1 and DUT2 - TG. @@ -37,11 +37,12 @@ | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet | ... | loss tolerance. Ref-NDR value is periodically updated acording to | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long -| ... | performance tests for the same DUT confiiguration. Test packets are +| ... | performance tests for the same DUT configuration. Test packets are | ... | generated by TG on links to DUTs. TG traffic profile contains two L3 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61 -| ... | and generated payload. +| ... | and generated payload. MAC addresses are matching MAC addresses of the +| ... | TG node interfaces. | ... | *[Ref] Applicable standard specifications:* RFC2544. *** Test Cases *** diff --git a/tests/suites/performance/Short_IPv6_Cop_Intel-X520-DA2.robot b/tests/suites/performance/Short_IPv6_Cop_Intel-X520-DA2.robot index 9e3c659a38..5ef42c5a86 100644 --- a/tests/suites/performance/Short_IPv6_Cop_Intel-X520-DA2.robot +++ b/tests/suites/performance/Short_IPv6_Cop_Intel-X520-DA2.robot @@ -35,11 +35,12 @@ | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet | ... | loss tolerance. Ref-NDR value is periodically updated acording to | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long -| ... | performance tests for the same DUT confiiguration. Test packets are +| ... | performance tests for the same DUT configuration. Test packets are | ... | generated by TG on links to DUTs. TG traffic profile contains two L3 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with | ... | all packets containing Ethernet header, IPv6 header and generated -| ... | payload. +| ... | payload. MAC addresses are matching MAC addresses of the TG node +| ... | interfaces. | ... | *[Ref] Applicable standard specifications:* RFC2544. *** Test Cases *** diff --git a/tests/suites/performance/Short_IPv6_Intel-X520-DA2.robot b/tests/suites/performance/Short_IPv6_Intel-X520-DA2.robot index febc25ed97..cf163a9e44 100644 --- a/tests/suites/performance/Short_IPv6_Intel-X520-DA2.robot +++ b/tests/suites/performance/Short_IPv6_Intel-X520-DA2.robot @@ -34,11 +34,12 @@ | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet | ... | loss tolerance. Ref-NDR value is periodically updated acording to | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long -| ... | performance tests for the same DUT confiiguration. Test packets are +| ... | performance tests for the same DUT configuration. Test packets are | ... | generated by TG on links to DUTs. TG traffic profile contains two L3 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with | ... | all packets containing Ethernet header, IPv6 header and generated -| ... | payload. +| ... | payload. MAC addresses are matching MAC addresses of the TG node +| ... | interfaces. | ... | *[Ref] Applicable standard specifications:* RFC2544. *** Test Cases *** diff --git a/tests/suites/performance/Short_Xconnect_Dot1ad_Intel-X520-DA2.robot b/tests/suites/performance/Short_Xconnect_Dot1ad_Intel-X520-DA2.robot index 028eb1bbc2..5779dc54f4 100644 --- a/tests/suites/performance/Short_Xconnect_Dot1ad_Intel-X520-DA2.robot +++ b/tests/suites/performance/Short_Xconnect_Dot1ad_Intel-X520-DA2.robot @@ -22,12 +22,12 @@ | Test Setup | Setup all DUTs before test | Test Teardown | Run Keywords | Remove startup configuration of VPP from all DUTs | ... | AND | Show vpp trace dump on all DUTs -| Documentation | *Reference NDR throughput L2XC with dot1ad verify test cases* +| Documentation | *Reference NDR throughput L2XC with 802.1ad verify test cases* | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology | ... | with single links between nodes. -| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 switching of IPv4. -| ... | Dot1ad tagging is applied on link between DUT1 and DUT2 with inner 4B +| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 xconnect. +| ... | 802.1ad tagging is applied on link between DUT1 and DUT2 with inner 4B | ... | vlan tag (id=100) and outer 4B vlan tag (id=200). | ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with L2 cross- | ... | connect. DUT1 and DUT2 tested with 2p10GE NIC X520 Niantic by Intel. @@ -35,11 +35,12 @@ | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet | ... | loss tolerance. Ref-NDR value is periodically updated acording to | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long -| ... | performance tests for the same DUT confiiguration. Test packets are +| ... | performance tests for the same DUT configuration. Test packets are | ... | generated by TG on links to DUTs. TG traffic profile contains two L3 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61 -| ... | and generated payload. +| ... | and generated payload. MAC addresses are matching MAC addresses of the +| ... | TG node interfaces. | ... | *[Ref] Applicable standard specifications:* RFC2544. *** Variables *** @@ -50,7 +51,7 @@ | ${tag_rewrite}= | pop-2 *** Test Cases *** -| TC01: Verify 64B ref-NDR at 2x 2.9Mpps - DUT L2XC with dot1ad - 1thread 1core 1rxq +| TC01: Verify 64B ref-NDR at 2x 2.9Mpps - DUT L2XC with 802.1ad - 1thread 1core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 64 Byte @@ -76,7 +77,7 @@ | | Then Traffic should pass with no loss | ${duration} | ${rate} | | ... | ${framesize} | 3-node-xconnect -| TC02: Verify 1514B ref-NDR at 2x 810.635kpps - DUT L2XC with dot1ad - 1thread 1core 1rxq +| TC02: Verify 1514B ref-NDR at 2x 810.635kpps - DUT L2XC with 802.1ad - 1thread 1core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 1514 Byte @@ -102,7 +103,7 @@ | | Then Traffic should pass with no loss | ${duration} | ${rate} | | ... | ${framesize} | 3-node-xconnect -| TC03: Verify 9000B ref-NDR at 2x 138.458kpps - DUT L2XC with dot1ad - 1thread 1core 1rxq +| TC03: Verify 9000B ref-NDR at 2x 138.458kpps - DUT L2XC with 802.1ad - 1thread 1core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 9000 Byte @@ -127,7 +128,7 @@ | | Then Traffic should pass with no loss | ${duration} | ${rate} | | ... | ${framesize} | 3-node-xconnect -| TC04: Verify 64B ref-NDR at 2x 7Mpps - DUT L2XC with dot1ad - 2thread 2core 1rxq +| TC04: Verify 64B ref-NDR at 2x 7Mpps - DUT L2XC with 802.1ad - 2thread 2core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 2 thread, 2 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames @@ -153,7 +154,7 @@ | | Then Traffic should pass with no loss | ${duration} | ${rate} | | ... | ${framesize} | 3-node-xconnect -| TC05: Verify 1514B ref-NDR at 2x 810.635kpps - DUT L2XC with dot1ad - 2thread 2core 1rxq +| TC05: Verify 1514B ref-NDR at 2x 810.635kpps - DUT L2XC with 802.1ad - 2thread 2core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 2 thread, 2 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 1514 Byte frames @@ -179,7 +180,7 @@ | | Then Traffic should pass with no loss | ${duration} | ${rate} | | ... | ${framesize} | 3-node-xconnect -| TC06: Verify 9000B ref-NDR at 2x 138.458kpps - DUT L2XC with dot1ad - 2thread 2core 1rxq +| TC06: Verify 9000B ref-NDR at 2x 138.458kpps - DUT L2XC with 802.1ad - 2thread 2core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 2 thread, 2 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Find PDR for 9000 Byte frames @@ -204,7 +205,7 @@ | | Then Traffic should pass with no loss | ${duration} | ${rate} | | ... | ${framesize} | 3-node-xconnect -| TC07: Verify 64B ref-NDR at 2x 8Mpps - DUT L2XC with dot1ad - 4thread 4core 2rxq +| TC07: Verify 64B ref-NDR at 2x 8Mpps - DUT L2XC with 802.1ad - 4thread 4core 2rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 4 thread, 4 phy core, \ | | ... | 2 receive queue per NIC port. [Ver] Find PDR for 64 Byte frames @@ -230,7 +231,7 @@ | | Then Traffic should pass with no loss | ${duration} | ${rate} | | ... | ${framesize} | 3-node-xconnect -| TC08: Verify 1514B ref-NDR at 2x 810.635kpps - DUT L2XC with dot1ad - 4thread 4core 2rxq +| TC08: Verify 1514B ref-NDR at 2x 810.635kpps - DUT L2XC with 802.1ad - 4thread 4core 2rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 4 thread, 4 phy core, \ | | ... | 2 receive queue per NIC port. [Ver] Find PDR for 1514 Byte frames @@ -256,7 +257,7 @@ | | Then Traffic should pass with no loss | ${duration} | ${rate} | | ... | ${framesize} | 3-node-xconnect -| TC09: Verify 9000B ref-NDR at 2x 138.458kpps - DUT L2XC with dot1ad - 4thread 4core 2rxq +| TC09: Verify 9000B ref-NDR at 2x 138.458kpps - DUT L2XC with 802.1ad - 4thread 4core 2rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC switching config with 4 thread, 4 phy core, \ | | ... | 2 receive queue per NIC port. [Ver] Find PDR for 9000 Byte frames diff --git a/tests/suites/performance/Short_Xconnect_Dot1q_Intel-X520-DA2.robot b/tests/suites/performance/Short_Xconnect_Dot1q_Intel-X520-DA2.robot index 1057a7022b..b2eb1ad9a5 100644 --- a/tests/suites/performance/Short_Xconnect_Dot1q_Intel-X520-DA2.robot +++ b/tests/suites/performance/Short_Xconnect_Dot1q_Intel-X520-DA2.robot @@ -22,11 +22,11 @@ | Test Setup | Setup all DUTs before test | Test Teardown | Run Keywords | Remove startup configuration of VPP from all DUTs | ... | AND | Show vpp trace dump on all DUTs -| Documentation | *Reference NDR throughput L2XC verify test cases* +| Documentation | *Reference NDR throughput L2XC with 802.1q verify test cases* | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology | ... | with single links between nodes. -| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 switching of IPv4. Dot1q +| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 cross connect. 802.1q | ... | tagging is applied on link between DUT1 and DUT2. | ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with L2 cross- | ... | connect. DUT1 and DUT2 tested with 2p10GE NIC X520 Niantic by Intel. @@ -34,11 +34,12 @@ | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet | ... | loss tolerance. Ref-NDR value is periodically updated acording to | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long -| ... | performance tests for the same DUT confiiguration. Test packets are +| ... | performance tests for the same DUT configuration. Test packets are | ... | generated by TG on links to DUTs. TG traffic profile contains two L3 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61 -| ... | and generated payload. +| ... | and generated payload. MAC addresses are matching MAC addresses of the +| ... | TG node interfaces. | ... | *[Ref] Applicable standard specifications:* RFC2544. *** Variables *** @@ -46,7 +47,7 @@ | ${tag_rewrite}= | pop-1 *** Test Cases *** -| TC01: Verify 64B ref-NDR at 2x 2.9Mpps - DUT dot1q - 1thread 1core 1rxq +| TC01: Verify 64B ref-NDR at 2x 2.9Mpps - DUT 802.1q - 1thread 1core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 64 Byte @@ -71,7 +72,7 @@ | | Then Traffic should pass with no loss | ${duration} | ${rate} | | ... | ${framesize} | 3-node-xconnect -| TC02: Verify 1518B ref-NDR at 2x 720kpps - DUT dot1q - 1thread 1core 1rxq +| TC02: Verify 1518B ref-NDR at 2x 720kpps - DUT 802.1q - 1thread 1core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 1518 Byte @@ -96,7 +97,7 @@ | | Then Traffic should pass with no loss | ${duration} | ${rate} | | ... | ${framesize} | 3-node-xconnect -| TC03: Verify 9000B ref-NDR at 2x 120kpps - DUT dot1q - 1thread 1core 1rxq +| TC03: Verify 9000B ref-NDR at 2x 120kpps - DUT 802.1q - 1thread 1core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC config with 1 thread, 1 phy core, \ | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 9000 Byte @@ -120,7 +121,7 @@ | | Then Traffic should pass with no loss | ${duration} | ${rate} | | ... | ${framesize} | 3-node-xconnect -| TC04: Verify 64B ref-NDR at 2x 7Mpps - DUT dot1q - 2thread 2core 1rxq +| TC04: Verify 64B ref-NDR at 2x 7Mpps - DUT 802.1q - 2thread 2core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 64 Byte @@ -145,7 +146,7 @@ | | Then Traffic should pass with no loss | ${duration} | ${rate} | | ... | ${framesize} | 3-node-xconnect -| TC05: Verify 1518B ref-NDR at 2x 720kpps - DUT dot1q - 2thread 2core 1rxq +| TC05: Verify 1518B ref-NDR at 2x 720kpps - DUT 802.1q - 2thread 2core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 1518 Byte @@ -170,7 +171,7 @@ | | Then Traffic should pass with no loss | ${duration} | ${rate} | | ... | ${framesize} | 3-node-xconnect -| TC06: Verify 9000B ref-NDR at 2x 120kpps - DUT dot1q - 2thread 2core 1rxq +| TC06: Verify 9000B ref-NDR at 2x 120kpps - DUT 802.1q - 2thread 2core 1rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC config with 2 threads, 2 phy cores, \ | | ... | 1 receive queue per NIC port. [Ver] Verify ref-NDR for 9000 Byte @@ -194,7 +195,7 @@ | | Then Traffic should pass with no loss | ${duration} | ${rate} | | ... | ${framesize} | 3-node-xconnect -| TC07: Verify 64B ref-NDR at 2x 11Mpps - DUT dot1q - 4thread 4core 2rxq +| TC07: Verify 64B ref-NDR at 2x 11Mpps - DUT 802.1q - 4thread 4core 2rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Verify ref-NDR for 64 Byte @@ -219,7 +220,7 @@ | | Then Traffic should pass with no loss | ${duration} | ${rate} | | ... | ${framesize} | 3-node-xconnect -| TC08: Verify 1518B ref-NDR at 2x 720kpps - DUT dot1q - 4thread 4core 2rxq +| TC08: Verify 1518B ref-NDR at 2x 720kpps - DUT 802.1q - 4thread 4core 2rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Verify ref-NDR for 1518 Byte @@ -244,7 +245,7 @@ | | Then Traffic should pass with no loss | ${duration} | ${rate} | | ... | ${framesize} | 3-node-xconnect -| TC09: Verify 9000B ref-NDR at 2x 120kpps - DUT dot1q - 4thread 4core 2rxq +| TC09: Verify 9000B ref-NDR at 2x 120kpps - DUT 802.1q - 4thread 4core 2rxq | | [Documentation] | | ... | [Cfg] DUT runs L2XC config with 4 threads, 4 phy cores, \ | | ... | 2 receive queues per NIC port. [Ver] Verify ref-NDR for 9000 Byte diff --git a/tests/suites/performance/Short_Xconnect_Intel-X520-DA2.robot b/tests/suites/performance/Short_Xconnect_Intel-X520-DA2.robot index 8011e0bd56..56df7a4ead 100644 --- a/tests/suites/performance/Short_Xconnect_Intel-X520-DA2.robot +++ b/tests/suites/performance/Short_Xconnect_Intel-X520-DA2.robot @@ -27,19 +27,19 @@ | ... | ... | *[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology | ... | with single links between nodes. -| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for IPv4 routing. -| ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with IPv4 -| ... | routing and two static IPv4 /24 route entries. DUT1 and DUT2 tested with -| ... | 2p10GE NIC X520 Niantic by Intel. +| ... | *[Enc] Packet Encapsulations:* Eth-IPv4 for L2 cross connect. +| ... | *[Cfg] DUT configuration:* DUT1 and DUT2 are configured with L2 cross- +| ... | connect. DUT1 and DUT2 tested with 2p10GE NIC X520 Niantic by Intel. | ... | *[Ver] TG verification:* In short performance tests, TG verifies | ... | DUTs' throughput at ref-NDR (reference Non Drop Rate) with zero packet | ... | loss tolerance. Ref-NDR value is periodically updated acording to | ... | formula: ref-NDR = 0.9x NDR, where NDR is found in RFC2544 long -| ... | performance tests for the same DUT confiiguration. Test packets are +| ... | performance tests for the same DUT configuration. Test packets are | ... | generated by TG on links to DUTs. TG traffic profile contains two L3 | ... | flow-groups (flow-group per direction, 253 flows per flow-group) with | ... | all packets containing Ethernet header, IPv4 header with IP protocol=61 -| ... | and generated payload. +| ... | and generated payload. MAC addresses are matching MAC addresses of the +| ... | TG node interfaces. | ... | *[Ref] Applicable standard specifications:* RFC2544. *** Test Cases *** |