tests: refactor asf framework code

- Make framework.py classes a subset of asfframework.py classes
- Remove all packet related code from asfframework.py
- Add test class and test case set up debug output to log
- Repatriate packet tests from asf to test directory
- Remove non-packet related code from framework.py and
  inherit them from asfframework.py classes
- Clean up unused import variables
- Re-enable BFD tests on Ubuntu 22.04 and fix
  intermittent test failures in echo_looped_back
  testcases (where # control packets verified but
  not guaranteed to be received during test)
- Re-enable Wireguard tests on Ubuntu 22.04 and fix
  intermittent test failures in handshake ratelimiting
  testcases and event testcase
- Run Wiregard testcase suites solo
- Improve debug output in log.txt
- Increase VCL/LDP post sleep timeout to allow iperf server
  to finish cleanly.
- Fix pcap history files to be sorted by suite and testcase
  and ensure order/timestamp is correct based on creation
  in the testcase.
- Decode pcap files for each suite and testcase for all
  errors or if configured via comandline option / env var
- Improve vpp corefile detection to allow complete corefile
  generation
- Disable vm vpp interfaces testcases on debian11
- Clean up failed unittest dir when retrying failed testcases
  and unify testname directory and failed linknames into
  framwork functions

Type: test

Change-Id: I0764f79ea5bb639d278bf635ed2408d4d5220e1e
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

1 files changed, 6 insertions, 1 deletions

diff --git a/test/test_vm_vpp_interfaces.py b/test/test_vm_vpp_interfaces.py
index b86c51980e4..917b95006c4 100644
--- a/test/test_vm_vpp_interfaces.py
+++ b/test/test_vm_vpp_interfaces.py
@@ -11,7 +11,8 @@ from vpp_qemu_utils import (
     add_namespace_route,
 )
 from vpp_iperf import start_iperf, stop_iperf
-from framework import VppTestCase, VppTestRunner
+from framework import VppTestCase
+from asfframework import VppTestRunner, tag_fixme_debian11, is_distro_debian11
 from config import config
 from vpp_papi import VppEnum
 import time
@@ -64,6 +65,9 @@ def create_test(test_name, test, ip_version, mtu):
     """Create and return a unittest method for a test."""
 
     @unittest.skipIf(
+        is_distro_debian11, "FIXME intermittent test failures on debian11 distro"
+    )
+    @unittest.skipIf(
         config.skip_netns_tests, "netns not available or disabled from cli"
     )
     def test_func(self):
@@ -126,6 +130,7 @@ def generate_vpp_interface_tests():
                 setattr(TestVPPInterfacesQemu, test_name, test_func)
 
 
+@tag_fixme_debian11
 class TestVPPInterfacesQemu(VppTestCase):
     """Test VPP interfaces inside a QEMU VM for IPv4/v6.