aboutsummaryrefslogtreecommitdiffstats
path: root/docs/report/honeycomb_performance_tests/test_result_data.rst
diff options
context:
space:
mode:
authorselias <samelias@cisco.com>2017-07-20 09:50:58 +0200
committerPeter Mikus <pmikus@cisco.com>2017-07-24 13:30:11 +0000
commit85d80de9fd2df257e6b01f75bfe99c9d318a47b6 (patch)
treef1be51d711df9a9e679c84abe039cfe94d9aab47 /docs/report/honeycomb_performance_tests/test_result_data.rst
parent2ce10467f9a032a3df7128a2e360227527f66194 (diff)
Static report content - Honeycomb
Change-Id: I39899747f99684b932bb9c88268391e55b6fc779 Signed-off-by: selias <samelias@cisco.com> (cherry picked from commit cd8d4dc1498a69b4f9541fb4405fd31fd61d81d9)
Diffstat (limited to 'docs/report/honeycomb_performance_tests/test_result_data.rst')
-rw-r--r--docs/report/honeycomb_performance_tests/test_result_data.rst101
1 files changed, 101 insertions, 0 deletions
diff --git a/docs/report/honeycomb_performance_tests/test_result_data.rst b/docs/report/honeycomb_performance_tests/test_result_data.rst
new file mode 100644
index 0000000000..563e93ea5f
--- /dev/null
+++ b/docs/report/honeycomb_performance_tests/test_result_data.rst
@@ -0,0 +1,101 @@
+Test Result Data
+================
+
+This section includes summary of Netconf read operation performance.
+Performance is reported for Honeycomb running in multiple configurations of
+netconf thread(s) and their physical CPU core(s) placement, and for different
+read operation targets.
+
+.. note::
+
+ Test results have been generated by
+ `FD.io test executor honeycomb performance jobs`_ with Robot Framework
+ result files csit-vpp-perf-\*.zip `archived here <../../_static/archive/>`_.
+
+Honeycomb + Netconf
+===================
+
+Performs read operations from Honeycomb's operational data store. Honeycomb
+does not contact VPP to obtain the most up-to-date value. Operations are
+performed synchronously per client, varying the number of clients from 1 to 16.
+
+netconf-netty-threads: 16
+
++----------------+----------------------------------+----------------+
+| # clients | TCP performance (reads/sec) | Total requests |
++================+==================================+================+
+| 1 | 6630 | 100K |
++----------------+----------------------------------+----------------+
+| 2 | 14598 | 100K |
++----------------+----------------------------------+----------------+
+| 4 | 28309 | 100K |
++----------------+----------------------------------+----------------+
+| 8 | 46715 | 100K |
++----------------+----------------------------------+----------------+
+| 16 | 458141 | 100K |
++----------------+----------------------------------+----------------+
+
+netconf-netty-threads: 1
+
++----------------+----------------------------------+----------------+
+| # clients | TCP performance (reads/sec) | Total requests |
++================+==================================+================+
+| 1 | 6563 | 100K |
++----------------+----------------------------------+----------------+
+| 2 | 7601 | 100K |
++----------------+----------------------------------+----------------+
+| 4 | 8212 | 100K |
++----------------+----------------------------------+----------------+
+| 8 | 8595 | 100K |
++----------------+----------------------------------+----------------+
+| 16 | 8699 | 100K |
++----------------+----------------------------------+----------------+
+
+Data source:
+https://jenkins.fd.io/view/hc2vpp/job/hc2vpp-csit-perf-master-ubuntu1604/4/
+
+Note: At 46K/s we are likely hitting the limits of the Netconf interface,
+according to https://wiki.opendaylight.org/view/NETCONF:Testing#Results_3
+
+Honeycomb + Netconf + VPP
+=========================
+
+Performs read operations from Honeycomb's operational data store. Honeycomb
+uses VPP API to obtain the value from VPP before responding. Operations are
+performed synchronously per client, varying the number of clients from 1 to 16.
+
+netconf-netty-threads: 16
+# Results pending
+
++----------------+----------------------------------+----------------+
+| # clients | TCP performance (reads/sec) | Total requests |
++================+==================================+================+
+| 1 | | 100K |
++----------------+----------------------------------+----------------+
+| 2 | | 100K |
++----------------+----------------------------------+----------------+
+| 4 | | 100K |
++----------------+----------------------------------+----------------+
+| 8 | | 100K |
++----------------+----------------------------------+----------------+
+| 16 | | 100K |
++----------------+----------------------------------+----------------+
+
+netconf-netty-threads: 1
+
++----------------+----------------------------------+----------------+
+| # clients | TCP performance (reads/sec) | Total requests |
++================+==================================+================+
+| 1 | | 100K |
++----------------+----------------------------------+----------------+
+| 2 | | 100K |
++----------------+----------------------------------+----------------+
+| 4 | | 100K |
++----------------+----------------------------------+----------------+
+| 8 | | 100K |
++----------------+----------------------------------+----------------+
+| 16 | | 100K |
++----------------+----------------------------------+----------------+
+
+Data source:
+# TODO