From 01d8f262afc567c3d49a23c3cb2cdeaced8a6887 Mon Sep 17 00:00:00 2001 From: Vratko Polak Date: Wed, 15 Dec 2021 17:14:36 +0100 Subject: UTI: Export results + Model version 1.0.0. - Only some result types are exported. + MRR, NDRPDR and SOAK. - Other result types to be added later. + In contrast, all test types are detected. + Convert custom classes to JSON-serializable equivalents. + Sort dict keys before converting to JSON. + Override the order for some known keys. + Export sets as sorted arrays. + Convert to info content from serialized raw content. + Also export outputs for suite setups and teardowns. + Info files for setup/teardown exist only temporarily. + The data is merged into suite.info.json file. + This simplifies presentation of total suite duration. + Define model via JSON schema: - Just test case, suite setup/teardown/suite to be added later. - Just info, raw to be added later. + Proper descriptions. + Json is generated from yaml. + This is a convenience for maintainers. + The officially used schema is the .json one. + TODOs written into a separate .txt file. + Validate exported instance against the schema. + Include format checking. + Update CSIT requirements for validation dependencies. + This needs python-dateutil==2.8.2, only a patch bump. + Compute bandwidth also for soak tests. + This unifies with NDRPDR to simplify schema definition. - PAL may need an update for parsing soak test message. + Include SSH log items, raw output only. + Generate all outputs in a single filesystem tree. + Move raw outputs into test_output_raw.tar.xz. + Rename existing tar with suites to generated_robot_files.tar.xz. Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c Signed-off-by: Vratko Polak --- fdio.infra.ansible/roles/csit_sut_image/files/Dockerfile | 2 +- fdio.infra.ansible/roles/python_env/tasks/main.yaml | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) (limited to 'fdio.infra.ansible') diff --git a/fdio.infra.ansible/roles/csit_sut_image/files/Dockerfile b/fdio.infra.ansible/roles/csit_sut_image/files/Dockerfile index 73ff5c5e86..a955799b63 100644 --- a/fdio.infra.ansible/roles/csit_sut_image/files/Dockerfile +++ b/fdio.infra.ansible/roles/csit_sut_image/files/Dockerfile @@ -135,7 +135,7 @@ RUN pip3 install \ Pygments==2.4.2 \ PyNaCl==1.3.0 \ pyparsing==2.4.4 \ - python-dateutil==2.8.1 \ + python-dateutil==2.8.2 \ pytz==2019.3 \ retrying==1.3.3 \ six==1.13.0 \ diff --git a/fdio.infra.ansible/roles/python_env/tasks/main.yaml b/fdio.infra.ansible/roles/python_env/tasks/main.yaml index 7df8008a27..4e4cfb447c 100644 --- a/fdio.infra.ansible/roles/python_env/tasks/main.yaml +++ b/fdio.infra.ansible/roles/python_env/tasks/main.yaml @@ -59,7 +59,7 @@ - "Pygments==2.8.1" - "PyNaCl==1.3.0" - "pyparsing==2.4.7" - - "python-dateutil==2.8.1" + - "python-dateutil==2.8.2" - "pytz==2021.1" - "retrying==1.3.3" - "six==1.15.0" -- cgit 1.2.3-korg