aboutsummaryrefslogtreecommitdiffstats
path: root/tests/honeycomb/perf/localhostp1-tcp-netconf1t-crud-read.robot
blob: d46fdf795b621b876d9d9a790460e4842af1df1b (plain)
1
2
3
4
5
6
7
8
9
10
11
12
.highlight .hll { background-color: #ffffcc }
.highlight .c { color: #888888 } /* Comment */
.highlight .err { color: #a61717; background-color: #e3d2d2 } /* Error */
.highlight .k { color: #008800; font-weight: bold } /* Keyword */
.highlight .ch { color: #888888 } /* Comment.Hashbang */
.highlight .cm { color: #888888 } /* Comment.Multiline */
.highlight .cp { color: #cc0000; font-weight: bold } /* Comment.Preproc */
.highlight .cpf { color: #888888 } /* Comment.PreprocFile */
.highlight .c1 { color: #888888 } /* Comment.Single */
.highlight .cs { color: #cc0000; font-weight: bold; background-color: #fff0f0 } /* Comment.Special */
.highlight .gd { color: #000000; background-color: #ffdddd } /* Generic.Deleted */
.highlight .ge { font-style: italic } /* Generic.Emph */
.highlight .gr { color: #aa0000 } /* Generic.Error */
.highlight .gh { color: #333333 } /* Generic.Heading */
.highlight .gi { color: #000000; background-color: #ddffdd } /* Generic.Inserted */
.highlight .go { color: #888888 } /* Generic.Output */
.highlight .gp { color: #555555 } /* Generic.Prompt */
.highlight .gs { font-weight: bold } /* Generic.Strong */
.highlight .gu { color: #666666 } /* Generic.Subheading */
.highlight .gt { color: #aa0000 } /* Generic.Traceback */
.highlight .kc { color: #008800; font-weight: bold } /* Keyword.Constant */
.highlight .kd { color: #008800; font-weight: bold } /* Keyword.Declaration */
.highlight .kn { color: #008800; font-weight: bold } /* Keyword.Namespace */
.highlight .kp { color: #008800 } /* Keyword.Pseudo */
.highlight .kr { color: #008800; font-weight: bold } /* Keyword.Reserved */
.highlight .kt { color: #888888; font-weight: bold } /* Keyword.Type */
.highlight .m { color: #0000DD; font-weight: bold } /* Literal.Number */
.highlight .s { color: #dd2200; background-color: #fff0f0 } /* Literal.String */
.highlight .na { color: #336699 } /* Name.Attribute */
.highlight .nb { color: #003388 } /* Name.Builtin */
.highlight .nc { color: #bb0066; font-weight: bold } /* Name.Class */
.highlight .no { color: #003366; font-weight: bold } /* Name.Constant */
.highlight .nd { color: #555555 } /* Name.Decorator */
.highlight .ne { color: #bb0066; font-weight: bold } /* Name.Exception */
.highlight .nf { color: #0066bb; font-weight: bold } /* Name.Function */
.highlight .nl { color: #336699; font-style: 
# Copyright (c) 2017 Cisco and/or its affiliates.
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at:
#
#     http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

*** Settings ***
| Resource | resources/libraries/robot/honeycomb/performance.robot
| ...
| Suite Setup | Run Keywords
| ... | Configure Honeycomb Netconf threads | ${node} | ${1}
| ... | AND | Honeycomb Performance Suite Setup Generic | ${node}
| ...
| Suite Teardown | Honeycomb Performance Suite Teardown Generic | ${node}
| ...
| Force Tags | HC_PERF
| ...
| Documentation | *Base Netconf operational read test suite with one Netconf
| ... | thread.*
| ...
| ... | *[Top] Network Topologies:* DUT1 single-node topology.
| ... | *[Enc] Packet Encapsulations:* Eth-IPv4-TCP.
| ... | *[Cfg] DUT configuration:* Default
| ... | *[Ver] verification:* DUT verifies Honeycomb's response times with zero
| ... | error or loss tolerance. Test packets are generated by DUT1 on localhost
| ... | loopback interface.
| ... | Traffic profile contains flow-groups containing REST requests
| ... | for operational reads.
| ... | *[Ref] Applicable standard specifications:* RFC6241.

*** Test Cases ***
| TC01: Base operational read with 1 TG thread
| | [Documentation]
| | ... | [Ver] Measure response time using single trial throughput test
| | ... | with 100K requests generated in a single thread.
| | ${cycles}= | Set Variable | ${1}
| | ${threads}= | Set Variable | ${1}
| | ${entries}= | Set Variable | ${100000}
| | Run base operational read performance trial
| | ... | ${node} | ${cores} | ${cycles} | ${threads} | ${entries}

| TC02: Base operational read with 2 TG threads
| | [Documentation]
| | ... | [Ver] Measure response time using single trial throughput test
| | ... | with 100K requests generated in two threads.
| | ${cycles}= | Set Variable | ${1}
| | ${threads}= | Set Variable | ${2}
| | ${entries}= | Set Variable | ${50000}
| | Run base operational read performance trial
| | ... | ${node} | ${cores} | ${cycles} | ${threads} | ${entries}

| TC03: Base operational read with 4 TG threads
| | [Documentation]
| | ... | [Ver] Measure response time using single trial throughput test
| | ... | with 100K requests generated in four threads.
| | ${cycles}= | Set Variable | ${1}
| | ${threads}= | Set Variable | ${4}
| | ${entries}= | Set Variable | ${25000}
| | Run base operational read performance trial
| | ... | ${node} | ${cores} | ${cycles} | ${threads} | ${entries}

| TC04: Base operational read with 8 TG threads
| | [Documentation]
| | ... | [Ver] Measure response time using single trial throughput test
| | ... | with 100K requests generated in eigth threads.
| | ${cycles}= | Set Variable | ${1}
| | ${threads}= | Set Variable | ${8}
| | ${entries}= | Set Variable | ${12500}
| | Run base operational read performance trial
| | ... | ${node} | ${cores} | ${cycles} | ${threads} | ${entries}

| TC05: Base operational read with 16 TG threads
| | [Documentation]
| | ... | [Ver] Measure response time using single trial throughput test
| | ... | with 100K requests generated in sixteen threads.
| | ${cycles}= | Set Variable | ${1}
| | ${threads}= | Set Variable | ${16}
| | ${entries}= | Set Variable | ${6250}
| | Run base operational read performance trial
| | ... | ${node} | ${cores} | ${cycles} | ${threads} | ${entries}