aboutsummaryrefslogtreecommitdiffstats
path: root/resources/model_schema/test_case.schema.yaml
diff options
context:
space:
mode:
authorVratko Polak <vrpolak@cisco.com>2023-10-17 16:31:35 +0200
committerVratko Polak <vrpolak@cisco.com>2023-10-18 08:10:06 +0000
commite5dbe10d9599b9a53fa07e6fadfaf427ba6d69e3 (patch)
tree147b7972bea35a093f6644e63c5f1fb4e4b2c9a0 /resources/model_schema/test_case.schema.yaml
parentc6dfb6c09c5dafd1d522f96b4b86c5ec5efc1c83 (diff)
feat(MLRsearch): MLRsearch v7
Replaces MLRv2, suitable for "big bang" upgrade across CSIT. PyPI metadata updated only partially (full edits will come separately). Pylint wants less complexity, but the differences are only minor. + Use the same (new CSIT) defaults everywhere, also in Python library. + Update also PLRsearch to use the new result class. + Make upper bound optional in UTI. + Fix ASTF approximate duration detection. + Do not keep approximated_receive_rate (for MRR) in result structure. Change-Id: I03406f32d5c93f56b527cb3f93791b61955dfd74 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Diffstat (limited to 'resources/model_schema/test_case.schema.yaml')
-rw-r--r--resources/model_schema/test_case.schema.yaml31
1 files changed, 16 insertions, 15 deletions
diff --git a/resources/model_schema/test_case.schema.yaml b/resources/model_schema/test_case.schema.yaml
index 5c7cf305fb..b657906667 100644
--- a/resources/model_schema/test_case.schema.yaml
+++ b/resources/model_schema/test_case.schema.yaml
@@ -13,7 +13,7 @@
---
-$id: https://fd.io/FIXME/CSIT/UTI/test_case/info/1.4.0
+$id: https://fd.io/FIXME/CSIT/UTI/test_case/info/1.5.0
$schema: https://json-schema.org/draft/2020-12/schema
description: >-
Schema for output of test case.
@@ -141,25 +141,27 @@ allOf:
ndr:
description: >-
The results refer to search for NDR
- (Non Drop Rate). For PPS, this is aggregate
- (bidirectional) rate.
- Each bound was used as the target load value
- in a full-duration trial measurement.
+ For PPS, lowerbound is aggregate
+ (bidirectional) conditional throughput
+ (forwarding rate across good long trials),
+ upperbound is missing.
The accepted loss ratio for NDR is exact zero.
+ Exceed ratio is 50%.
Note that packets the Traffic Generator
did not send are also counted as lost packets.
- $ref: "#/$defs/macros/lower_and_upper_rate"
+ $ref: "#/$defs/macros/lower_and_maybe_upper_rate"
pdr:
description: >-
- The results refer to search for PDR
- (Partial Drop Rate). For PPS, this is aggregate
- (bidirectional) rate.
- Each bound was used as the target load value
- in a full-duration trial measurement.
+ The results refer to search for PDR.
+ For PPS, lowerbound is aggregate
+ (bidirectional) conditional throughput
+ (forwarding rate across good long trials),
+ upperbound is missing.
The accepted loss ratio for PDR is 0.5%.
+ Exceed ratio is 50%.
Note that packets the Traffic Generator
did not send are also counted as lost packets.
- $ref: "#/$defs/macros/lower_and_upper_rate"
+ $ref: "#/$defs/macros/lower_and_maybe_upper_rate"
latency_forward:
description: >-
Object with results related to latency part
@@ -209,7 +211,7 @@ allOf:
but are not equal to any target load used.
Note that packets the Traffic Generator
did not send are also counted as lost packets.
- $ref: "#/$defs/macros/lower_and_upper_rate"
+ $ref: "#/$defs/macros/lower_and_maybe_upper_rate"
required:
- type
- critical_rate
@@ -657,7 +659,7 @@ $defs:
required:
- rate
macros:
- lower_and_upper_rate:
+ lower_and_maybe_upper_rate:
type: object
additionalProperties: false
properties:
@@ -673,7 +675,6 @@ $defs:
$ref: "#/$defs/types/rate_with_bandwidth"
required:
- lower
- - upper
latency_numbers:
type: object
additionalProperties: false