diff options
author | Tibor Frank <tifrank@cisco.com> | 2021-10-22 13:58:32 +0200 |
---|---|---|
committer | Tibor Frank <tifrank@cisco.com> | 2021-10-25 09:54:05 +0000 |
commit | c2d22f7a05067a402caef272dca5e1aabae882cd (patch) | |
tree | 211917da2dc39e375db642ff5aabf46c85789f5d /docs/job_specs/report_iterative/3n-tsh | |
parent | 9cf45e6a3462e7eadca4845ec9f583ce434c674e (diff) |
job-specs: Reduce nr of tests to shorten execution time
Removed tests from iterative job-specs (vpp-mlr-00.md and vpp-mrr-00.md):
- 2n-clx:
- IPv4: af-xdp ip4scale-200k, nat44ed udir except 64512 sessions,
- IPv6: af-xdp ip6scale-200k,
- l2: af-xdp,
- 2n-skx:
- IPv4: af-xdp ip4scale-200k, nat44ed udir except 64512 sessions,
- IPv6: af-xdp ip6scale-200k,
- L2: af-xdp,
- 2n-zn2:
- ip4scale-(2m,200k),
- ip6scale-(2m,200k),
- l2bdscale-1m,
- all af-xdp
- 3n-skx:
- container memif - all
- ip4scale-(2m,200k,20k),
- ip6scale-(2m,200k,20k),
- l2bdscale-(1m,100k,10k),
- 3n-tsh:
- container memif - all
- ip4scale-(2m,200k,20k),
- ip6scale-(2m,200k,20k),
- l2bdscale-(1m,100k,10k)
Suggestion: Keep coverage job-specs as they are now.
Change-Id: I777f2984b9547406c77d588f663891e9120cf594
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 367b37eb0c0c846d21fb21da1c925f0d5762807c)
Diffstat (limited to 'docs/job_specs/report_iterative/3n-tsh')
-rw-r--r-- | docs/job_specs/report_iterative/3n-tsh/vpp-mlr-00.md | 61 | ||||
-rw-r--r-- | docs/job_specs/report_iterative/3n-tsh/vpp-mrr-00.md | 61 |
2 files changed, 2 insertions, 120 deletions
diff --git a/docs/job_specs/report_iterative/3n-tsh/vpp-mlr-00.md b/docs/job_specs/report_iterative/3n-tsh/vpp-mlr-00.md index 2e4e6b6bee..8dc8e9b8ee 100644 --- a/docs/job_specs/report_iterative/3n-tsh/vpp-mlr-00.md +++ b/docs/job_specs/report_iterative/3n-tsh/vpp-mlr-00.md @@ -1,28 +1,6 @@ # 3n-tsh -### tests 195 -### job hrs est. 23.0 -### job hrs real ??.? -### test mins est. 7.07 -### test mins real 7.07 +### tests 156 ## ./container_memif -### intel-x520-da2 -#### dpdk-vfio-pci -##### eth-l2bdbasemaclrn-eth-2memif-1lxc -1c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2bdbasemaclrn-eth-2memif-1lxc -2c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2bdbasemaclrn-eth-2memif-1lxc -4c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2bdbasemaclrn-eth-2memif-1lxc -##### eth-l2xcbase-eth-2memif-1dcr -1c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2xcbase-eth-2memif-1dcr -2c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2xcbase-eth-2memif-1dcr -4c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2xcbase-eth-2memif-1dcr -##### eth-l2xcbase-eth-2memif-1lxc -1c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2xcbase-eth-2memif-1lxc -2c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2xcbase-eth-2memif-1lxc -4c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2xcbase-eth-2memif-1lxc -##### ethip4-ip4base-eth-2memif-1dcr -1c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4base-eth-2memif-1dcr -2c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4base-eth-2memif-1dcr -4c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4base-eth-2memif-1dcr ## ./crypto ### intel-x520-da2 #### dpdk-vfio-pci @@ -108,18 +86,6 @@ 1c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4base 2c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4base 4c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4base -##### ethip4-ip4scale20k -1c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4scale20k -2c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4scale20k -4c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4scale20k -##### ethip4-ip4scale200k -1c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4scale200k -2c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4scale200k -4c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4scale200k -##### ethip4-ip4scale2m -1c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4scale2m -2c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4scale2m -4c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4scale2m ##### ethip4udp-ip4base-iacl50sf-10kflows 1c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip4udp-ip4base-iacl50sf-10kflows 2c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip4udp-ip4base-iacl50sf-10kflows @@ -154,18 +120,6 @@ 1c AND 78b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6base 2c AND 78b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6base 4c AND 78b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6base -##### ethip6-ip6scale20k -1c AND 78b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6scale20k -2c AND 78b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6scale20k -4c AND 78b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6scale20k -##### ethip6-ip6scale200k -1c AND 78b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6scale200k -2c AND 78b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6scale200k -4c AND 78b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6scale200k -##### ethip6-ip6scale2m -1c AND 78b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6scale2m -2c AND 78b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6scale2m -4c AND 78b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6scale2m ## ./ip6_tunnels ## ./l2 ### intel-x520-da2 @@ -174,18 +128,6 @@ 1c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2bdbasemaclrn 2c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2bdbasemaclrn 4c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2bdbasemaclrn -##### eth-l2bdscale10kmaclrn -1c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2bdscale10kmaclrn -2c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2bdscale10kmaclrn -4c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2bdscale10kmaclrn -##### eth-l2bdscale100kmaclrn -1c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2bdscale100kmaclrn -2c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2bdscale100kmaclrn -4c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2bdscale100kmaclrn -##### eth-l2bdscale1mmaclrn -1c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2bdscale1mmaclrn -2c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2bdscale1mmaclrn -4c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND eth-l2bdscale1mmaclrn ##### dot1q-l2bdbasemaclrn 1c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND dot1q-l2bdbasemaclrn 2c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND dot1q-l2bdbasemaclrn @@ -287,4 +229,3 @@ 1c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc 2c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc 4c AND 64b AND ndrpdr AND x520-da2 AND drv_vfio_pci AND ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc -## ./vts diff --git a/docs/job_specs/report_iterative/3n-tsh/vpp-mrr-00.md b/docs/job_specs/report_iterative/3n-tsh/vpp-mrr-00.md index 435f9c2b61..0d967da440 100644 --- a/docs/job_specs/report_iterative/3n-tsh/vpp-mrr-00.md +++ b/docs/job_specs/report_iterative/3n-tsh/vpp-mrr-00.md @@ -1,28 +1,6 @@ # 3n-tsh -### tests 195 -### job hrs est. 6.14 -### job hrs real ?.?? -### test mins est. 1.89 -### test mins real 1.52 +### tests 156 ## ./container_memif -### intel-x520-da2 -#### dpdk-vfio-pci -##### eth-l2bdbasemaclrn-eth-2memif-1lxc -1c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2bdbasemaclrn-eth-2memif-1lxc -2c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2bdbasemaclrn-eth-2memif-1lxc -4c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2bdbasemaclrn-eth-2memif-1lxc -##### eth-l2xcbase-eth-2memif-1dcr -1c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2xcbase-eth-2memif-1dcr -2c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2xcbase-eth-2memif-1dcr -4c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2xcbase-eth-2memif-1dcr -##### eth-l2xcbase-eth-2memif-1lxc -1c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2xcbase-eth-2memif-1lxc -2c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2xcbase-eth-2memif-1lxc -4c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2xcbase-eth-2memif-1lxc -##### ethip4-ip4base-eth-2memif-1dcr -1c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4base-eth-2memif-1dcr -2c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4base-eth-2memif-1dcr -4c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4base-eth-2memif-1dcr ## ./crypto ### intel-x520-da2 #### dpdk-vfio-pci @@ -108,18 +86,6 @@ 1c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4base 2c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4base 4c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4base -##### ethip4-ip4scale20k -1c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4scale20k -2c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4scale20k -4c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4scale20k -##### ethip4-ip4scale200k -1c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4scale200k -2c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4scale200k -4c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4scale200k -##### ethip4-ip4scale2m -1c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4scale2m -2c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4scale2m -4c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip4-ip4scale2m ##### ethip4udp-ip4base-iacl50sf-10kflows 1c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip4udp-ip4base-iacl50sf-10kflows 2c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip4udp-ip4base-iacl50sf-10kflows @@ -154,18 +120,6 @@ 1c AND 78b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6base 2c AND 78b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6base 4c AND 78b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6base -##### ethip6-ip6scale20k -1c AND 78b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6scale20k -2c AND 78b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6scale20k -4c AND 78b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6scale20k -##### ethip6-ip6scale200k -1c AND 78b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6scale200k -2c AND 78b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6scale200k -4c AND 78b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6scale200k -##### ethip6-ip6scale2m -1c AND 78b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6scale2m -2c AND 78b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6scale2m -4c AND 78b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip6-ip6scale2m ## ./ip6_tunnels ## ./l2 ### intel-x520-da2 @@ -174,18 +128,6 @@ 1c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2bdbasemaclrn 2c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2bdbasemaclrn 4c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2bdbasemaclrn -##### eth-l2bdscale10kmaclrn -1c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2bdscale10kmaclrn -2c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2bdscale10kmaclrn -4c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2bdscale10kmaclrn -##### eth-l2bdscale100kmaclrn -1c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2bdscale100kmaclrn -2c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2bdscale100kmaclrn -4c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2bdscale100kmaclrn -##### eth-l2bdscale1mmaclrn -1c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2bdscale1mmaclrn -2c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2bdscale1mmaclrn -4c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND eth-l2bdscale1mmaclrn ##### dot1q-l2bdbasemaclrn 1c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND dot1q-l2bdbasemaclrn 2c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND dot1q-l2bdbasemaclrn @@ -287,4 +229,3 @@ 1c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc 2c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc 4c AND 64b AND mrr AND x520-da2 AND drv_vfio_pci AND ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc -## ./vts |