diff options
author | Vratko Polak <vrpolak@cisco.com> | 2020-02-03 18:51:14 +0100 |
---|---|---|
committer | Peter Mikus <pmikus@cisco.com> | 2020-02-22 11:47:04 +0000 |
commit | 3c23979e8770e5d5e6dc104d36f20ea5697f3fcc (patch) | |
tree | 04ea5139ad3eccba15b12b513a6767a1d4748672 /docs/report/introduction/methodology_data_plane_throughput | |
parent | 815cbb45dff3fd759f2bd4608bb45ee7949dfc55 (diff) |
Report: Edit minor details in methodology docs
Change-Id: I9bbb97e635b6ef438dcb8bed3f69617bb98e9779
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Diffstat (limited to 'docs/report/introduction/methodology_data_plane_throughput')
4 files changed, 16 insertions, 17 deletions
diff --git a/docs/report/introduction/methodology_data_plane_throughput/methodology_data_plane_throughput.rst b/docs/report/introduction/methodology_data_plane_throughput/methodology_data_plane_throughput.rst index 202b4281b7..764e198d0f 100644 --- a/docs/report/introduction/methodology_data_plane_throughput/methodology_data_plane_throughput.rst +++ b/docs/report/introduction/methodology_data_plane_throughput/methodology_data_plane_throughput.rst @@ -111,7 +111,7 @@ PLRsearch are run to discover a sustained throughput for PLR=10^-7 frame sizes (64b/78B) are presented in packet throughput graphs (Box Plots) for a small subset of baseline tests. -Each soak test lasts 2hrs and is executed at least twice. Results are +Each soak test lasts 30 minutes and is executed at least twice. Results are compared against NDR and PDR rates discovered with MLRsearch. Details diff --git a/docs/report/introduction/methodology_data_plane_throughput/methodology_mlrsearch_tests.rst b/docs/report/introduction/methodology_data_plane_throughput/methodology_mlrsearch_tests.rst index acc974841d..1209697195 100644 --- a/docs/report/introduction/methodology_data_plane_throughput/methodology_mlrsearch_tests.rst +++ b/docs/report/introduction/methodology_data_plane_throughput/methodology_mlrsearch_tests.rst @@ -16,15 +16,15 @@ with zero packet loss, PLR=0) and Partial Drop Rate (PDR, with packet loss rate not greater than the configured non-zero PLR). MLRsearch discovers NDR and PDR in a single pass reducing required time -duration compared to separate binary searches for NDR and PDR. Overall +duration compared to separate `binary search`_es for NDR and PDR. Overall search time is reduced even further by relying on shorter trial durations of intermediate steps, with only the final measurements conducted at the specified final trial duration. This results in the shorter overall execution time when compared to standard NDR/PDR binary search, while guaranteeing similar results. -If needed, MLRsearch can be easily adopted to discover more throughput -rates with different pre-defined PLRs. +If needed, next version of MLRsearch can be easily adopted +to discover more throughput rates with different pre-defined PLRs. .. Note:: All throughput rates are *always* bi-directional aggregates of two equal (symmetric) uni-directional packet rates @@ -45,11 +45,8 @@ MLRsearch is also available as a `PyPI (Python Package Index) library Implementation Deviations ~~~~~~~~~~~~~~~~~~~~~~~~~ -FD.io CSIT implementation of MLRsearch so far is fully based on the -01 -version of the `draft-vpolak-mkonstan-mlrsearch-01 -<https://tools.ietf.org/html/draft-vpolak-mkonstan-bmwg-mlrsearch-01>`_. +FD.io CSIT implementation of MLRsearch so far is fully based on the -02 +version of the `draft-vpolak-mkonstan-mlrsearch-02 +<https://tools.ietf.org/html/draft-vpolak-mkonstan-bmwg-mlrsearch-02>`_. .. _binary search: https://en.wikipedia.org/wiki/Binary_search -.. _exponential search: https://en.wikipedia.org/wiki/Exponential_search -.. _estimation of standard deviation: https://en.wikipedia.org/wiki/Unbiased_estimation_of_standard_deviation -.. _simplified error propagation formula: https://en.wikipedia.org/wiki/Propagation_of_uncertainty#Simplification diff --git a/docs/report/introduction/methodology_data_plane_throughput/methodology_mrr_throughput.rst b/docs/report/introduction/methodology_data_plane_throughput/methodology_mrr_throughput.rst index fd4baca2f3..4e8000b161 100644 --- a/docs/report/introduction/methodology_data_plane_throughput/methodology_mrr_throughput.rst +++ b/docs/report/introduction/methodology_data_plane_throughput/methodology_mrr_throughput.rst @@ -14,7 +14,7 @@ MRR tests are currently used for following test jobs: - Report performance comparison: 64B, IMIX for vhost, memif. - Daily performance trending: 64B, IMIX for vhost, memif. - Per-patch performance verification: 64B. -- PLRsearch soaking tests: 64B. +- Initial iterations of MLRsearch and PLRsearch: 64B. Maximum offered load for specific L2 Ethernet frame size is set to either the maximum bi-directional link rate or tested NIC model @@ -42,11 +42,13 @@ Burst parameter settings vary between different tests using MRR: - Report performance comparison: 1 sec. - Daily performance trending: 1 sec. - Per-patch performance verification: 10 sec. - - PLRsearch soaking tests: 5.2 sec. + - Initial iteration for MLRsearch: 1 sec. + - Initial iteration for PLRsearch: 5.2 sec. - Number of MRR trials per burst: - Report performance comparison: 10. - Daily performance trending: 10. - Per-patch performance verification: 5. - - PLRsearch soaking tests: 1.
\ No newline at end of file + - Initial iteration for MLRsearch: 1. + - Initial iteration for PLRsearch: 1. diff --git a/docs/report/introduction/methodology_data_plane_throughput/methodology_plrsearch.rst b/docs/report/introduction/methodology_data_plane_throughput/methodology_plrsearch.rst index 65165b31c7..68f30bc562 100644 --- a/docs/report/introduction/methodology_data_plane_throughput/methodology_plrsearch.rst +++ b/docs/report/introduction/methodology_data_plane_throughput/methodology_plrsearch.rst @@ -102,7 +102,7 @@ of sum of exponentials") are defined to handle None correctly. Fitting Functions ````````````````` -Current implementation uses two fitting functions. +Current implementation uses two fitting functions, called "stretch" and "erf". In general, their estimates for critical rate differ, which adds a simple source of systematic error, on top of randomness error reported by integrator. @@ -113,7 +113,7 @@ Both functions are not only increasing, but also convex (meaning the rate of increase is also increasing). Both fitting functions have several mathematically equivalent formulas, -each can lead to an overflow or underflow in different sub-terms. +each can lead to an arithmetic overflow or underflow in different sub-terms. Overflows can be eliminated by using different exact formulas for different argument ranges. Underflows can be avoided by using approximate formulas @@ -128,7 +128,7 @@ Prior Distributions The numeric integrator expects all the parameters to be distributed (independently and) uniformly on an interval (-1, 1). -As both "mrr" and "spread" parameters are positive and not not dimensionless, +As both "mrr" and "spread" parameters are positive and not dimensionless, a transformation is needed. Dimentionality is inherited from max_rate value. The "mrr" parameter follows a `Lomax distribution`_ @@ -303,7 +303,7 @@ The following analysis will rely on frequency of zero loss measurements and magnitude of loss ratio if nonzero. The offered load selection strategy used implies zero loss measurements -can be gleamed from the graph by looking at offered load points. +can be gleaned from the graph by looking at offered load points. When the points move up farther from lower estimate, it means the previous measurement had zero loss. After non-zero loss, the offered load starts again right between (the previous values of) |