blob: d46fdf795b621b876d9d9a790460e4842af1df1b (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
|
# Copyright (c) 2017 Cisco and/or its affiliates.
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at:
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
*** Settings ***
| Resource | resources/libraries/robot/honeycomb/performance.robot
| ...
| Suite Setup | Run Keywords
| ... | Configure Honeycomb Netconf threads | ${node} | ${1}
| ... | AND | Honeycomb Performance Suite Setup Generic | ${node}
| ...
| Suite Teardown | Honeycomb Performance Suite Teardown Generic | ${node}
| ...
| Force Tags | HC_PERF
| ...
| Documentation | *Base Netconf operational read test suite with one Netconf
| ... | thread.*
| ...
| ... | *[Top] Network Topologies:* DUT1 single-node topology.
| ... | *[Enc] Packet Encapsulations:* Eth-IPv4-TCP.
| ... | *[Cfg] DUT configuration:* Default
| ... | *[Ver] verification:* DUT verifies Honeycomb's response times with zero
| ... | error or loss tolerance. Test packets are generated by DUT1 on localhost
| ... | loopback interface.
| ... | Traffic profile contains flow-groups containing REST requests
| ... | for operational reads.
| ... | *[Ref] Applicable standard specifications:* RFC6241.
*** Test Cases ***
| TC01: Base operational read with 1 TG thread
| | [Documentation]
| | ... | [Ver] Measure response time using single trial throughput test
| | ... | with 100K requests generated in a single thread.
| | ${cycles}= | Set Variable | ${1}
| | ${threads}= | Set Variable | ${1}
| | ${entries}= | Set Variable | ${100000}
| | Run base operational read performance trial
| | ... | ${node} | ${cores} | ${cycles} | ${threads} | ${entries}
| TC02: Base operational read with 2 TG threads
| | [Documentation]
| | ... | [Ver] Measure response time using single trial throughput test
| | ... | with 100K requests generated in two threads.
| | ${cycles}= | Set Variable | ${1}
| | ${threads}= | Set Variable | ${2}
| | ${entries}= | Set Variable | ${50000}
| | Run base operational read performance trial
| | ... | ${node} | ${cores} | ${cycles} | ${threads} | ${entries}
| TC03: Base operational read with 4 TG threads
| | [Documentation]
| | ... | [Ver] Measure response time using single trial throughput test
| | ... | with 100K requests generated in four threads.
| | ${cycles}= | Set Variable | ${1}
| | ${threads}= | Set Variable | ${4}
| | ${entries}= | Set Variable | ${25000}
| | Run base operational read performance trial
| | ... | ${node} | ${cores} | ${cycles} | ${threads} | ${entries}
| TC04: Base operational read with 8 TG threads
| | [Documentation]
| | ... | [Ver] Measure response time using single trial throughput test
| | ... | with 100K requests generated in eigth threads.
| | ${cycles}= | Set Variable | ${1}
| | ${threads}= | Set Variable | ${8}
| | ${entries}= | Set Variable | ${12500}
| | Run base operational read performance trial
| | ... | ${node} | ${cores} | ${cycles} | ${threads} | ${entries}
| TC05: Base operational read with 16 TG threads
| | [Documentation]
| | ... | [Ver] Measure response time using single trial throughput test
| | ... | with 100K requests generated in sixteen threads.
| | ${cycles}= | Set Variable | ${1}
| | ${threads}= | Set Variable | ${16}
| | ${entries}= | Set Variable | ${6250}
| | Run base operational read performance trial
| | ... | ${node} | ${cores} | ${cycles} | ${threads} | ${entries}
|
