diff options
| author |   Vratko Polak <vrpolak@cisco.com> | 2023-10-17 16:31:35 +0200 |
|---|---|---|
| committer | Vratko Polak <vrpolak@cisco.com> | 2023-10-18 08:10:06 +0000 |
| commit | e5dbe10d9599b9a53fa07e6fadfaf427ba6d69e3 (patch) | |
| tree | 147b7972bea35a093f6644e63c5f1fb4e4b2c9a0 /resources/model_schema/test_case.schema.yaml | |
| parent | c6dfb6c09c5dafd1d522f96b4b86c5ec5efc1c83 (diff) | |
feat(MLRsearch): MLRsearch v7
Replaces MLRv2, suitable for "big bang" upgrade across CSIT.
PyPI metadata updated only partially (full edits will come separately).
Pylint wants less complexity, but the differences are only minor.
+ Use the same (new CSIT) defaults everywhere, also in Python library.
+ Update also PLRsearch to use the new result class.
+ Make upper bound optional in UTI.
+ Fix ASTF approximate duration detection.
+ Do not keep approximated_receive_rate (for MRR) in result structure.
Change-Id: I03406f32d5c93f56b527cb3f93791b61955dfd74
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Diffstat (limited to 'resources/model_schema/test_case.schema.yaml')
| -rw-r--r-- | resources/model_schema/test_case.schema.yaml | 31 |
1 files changed, 16 insertions, 15 deletions
diff --git a/resources/model_schema/test_case.schema.yaml b/resources/model_schema/test_case.schema.yaml index 5c7cf305fb..b657906667 100644 --- a/resources/model_schema/test_case.schema.yaml +++ b/resources/model_schema/test_case.schema.yaml @@ -13,7 +13,7 @@ --- -$id: https://fd.io/FIXME/CSIT/UTI/test_case/info/1.4.0 +$id: https://fd.io/FIXME/CSIT/UTI/test_case/info/1.5.0 $schema: https://json-schema.org/draft/2020-12/schema description: >- Schema for output of test case. @@ -141,25 +141,27 @@ allOf: ndr: description: >- The results refer to search for NDR - (Non Drop Rate). For PPS, this is aggregate - (bidirectional) rate. - Each bound was used as the target load value - in a full-duration trial measurement. + For PPS, lowerbound is aggregate + (bidirectional) conditional throughput + (forwarding rate across good long trials), + upperbound is missing. The accepted loss ratio for NDR is exact zero. + Exceed ratio is 50%. Note that packets the Traffic Generator did not send are also counted as lost packets. - $ref: "#/$defs/macros/lower_and_upper_rate" + $ref: "#/$defs/macros/lower_and_maybe_upper_rate" pdr: description: >- - The results refer to search for PDR - (Partial Drop Rate). For PPS, this is aggregate - (bidirectional) rate. - Each bound was used as the target load value - in a full-duration trial measurement. + The results refer to search for PDR. + For PPS, lowerbound is aggregate + (bidirectional) conditional throughput + (forwarding rate across good long trials), + upperbound is missing. The accepted loss ratio for PDR is 0.5%. + Exceed ratio is 50%. Note that packets the Traffic Generator did not send are also counted as lost packets. - $ref: "#/$defs/macros/lower_and_upper_rate" + $ref: "#/$defs/macros/lower_and_maybe_upper_rate" latency_forward: description: >- Object with results related to latency part @@ -209,7 +211,7 @@ allOf: but are not equal to any target load used. Note that packets the Traffic Generator did not send are also counted as lost packets. - $ref: "#/$defs/macros/lower_and_upper_rate" + $ref: "#/$defs/macros/lower_and_maybe_upper_rate" required: - type - critical_rate @@ -657,7 +659,7 @@ $defs: required: - rate macros: - lower_and_upper_rate: + lower_and_maybe_upper_rate: type: object additionalProperties: false properties: @@ -673,7 +675,6 @@ $defs: $ref: "#/$defs/types/rate_with_bandwidth" required: - lower - - upper latency_numbers: type: object additionalProperties: false |