aboutsummaryrefslogtreecommitdiffstats
path: root/docs/content/methodology/measurements/telemetry.md
blob: aed32d9e178ba52508e687e2b0a3c792533eba85 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
---
title: "Telemetry"
weight: 3
---

# Telemetry

OpenMetrics specifies the de-facto standard for transmitting cloud-native
metrics at scale, with support for both text representation and Protocol
Buffers.

## RFC

- RFC2119
- RFC5234
- RFC8174
- draft-richih-opsawg-openmetrics-00

## Reference

[OpenMetrics](https://github.com/OpenObservability/OpenMetrics/blob/master/specification/OpenMetrics.md)

## Metric Types

- Gauge
- Counter
- StateSet
- Info
- Histogram
- GaugeHistogram
- Summary
- Unknown

Telemetry module in CSIT currently support only Gauge, Counter and Info.

## Anatomy of CSIT telemetry implementation

Existing implementation consists of several measurment building blocks:
the main measuring block running search algorithms (MLR, PLR, SOAK, MRR, ...),
the latency measuring block and the several telemetry blocks with or without
traffic running on a background.

The main measuring block must not be interrupted by any read operation that can
impact data plane traffic processing during throughput search algorithm. Thus
operational reads are done before (pre-stat) and after (post-stat) that block.

Some operational reads must be done while traffic is running and usually
consists of two reads (pre-run-stat, post-run-stat) with defined delay between
them.

## MRR measurement

    traffic_start(r=mrr)             traffic_stop  |<   measure   >|
    |                                |             |    (r=mrr)    |
    |   pre_run_stat   post_run_stat |   pre_stat  |               |  post_stat
    |        |               |       |      |      |               |      |
    o--------o---------------o-------o------o------+---------------+------o------>
                                                                                t
    Legend:
    - pre_run_stat
      - vpp-clear-runtime
    - post_run_stat
      - vpp-show-runtime
      - bash-perf-stat            // if extended_debug == True
    - pre_stat
      - vpp-clear-stats
      - vpp-enable-packettrace    // if extended_debug == True
      - vpp-enable-elog
    - post_stat
      - vpp-show-stats
      - vpp-show-packettrace      // if extended_debug == True
      - vpp-show-elog

    |<                               measure                                 >|
    |                                (r=mrr)                                  |
    |                                                                         |
    |<   traffic_trial0    >|<    traffic_trial1    >|<    traffic_trialN    >|
    |   (i=0,t=duration)    |    (i=1,t=duration)    |    (i=N,t=duration)    |
    |                       |                        |                        |
    o-----------------------o------------------------o------------------------o--->
                                                                                 t


## MLR measurement

    |<  measure  >|   traffic_start(r=pdr)             traffic_stop  traffic_start(r=ndr)             traffic_stop |< [   latency   ] >|
    |   (r=mlr)   |   |                                |             |                                |            |    .9/.5/.1/.0    |
    |             |   |  pre_run_stat   post_run_stat  |             |  pre_run_stat   post_run_stat  |            |                   |
    |             |   |       |               |        |             |       |               |        |            |                   |
    +-------------+---o-------o---------------o--------o-------------o-------o---------------o--------o------------[-------------------]--->
                                                                                                                                          t
    Legend:
    - pre_run_stat
      - vpp-clear-runtime
    - post_run_stat
      - vpp-show-runtime
      - bash-perf-stat          // if extended_debug == True
    - pre_stat
      - vpp-clear-stats
      - vpp-enable-packettrace  // if extended_debug == True
      - vpp-enable-elog
    - post_stat
      - vpp-show-stats
      - vpp-show-packettrace    // if extended_debug == True
      - vpp-show-elog

## MRR measurement

    traffic_start(r=mrr)       traffic_stop        |<  measure  >|
    |                          |                   |   (r=mrr)   |
    |   |<  stat_runtime  >|   |   stat_pre_trial  |             |  stat_post_trial
    |   |                  |   |      |            |             |    |
    o---+------------------+---o------o------------+-------------+----o------------>
                                                                                  t
    Legend:
    - stat_runtime
      - vpp-runtime
    - stat_pre_trial
      - vpp-clear-stats
      - vpp-enable-packettrace  // if extended_debug == True
    - stat_post_trial
      - vpp-show-stats
      - vpp-show-packettrace    // if extended_debug == True

    |<                                measure                                 >|
    |                                 (r=mrr)                                  |
    |                                                                          |
    |<    traffic_trial0    >|<    traffic_trial1    >|<    traffic_trialN    >|
    |    (i=0,t=duration)    |    (i=1,t=duration)    |    (i=N,t=duration)    |
    |                        |                        |                        |
    o------------------------o------------------------o------------------------o--->
                                                                                  t

    |<                              stat_runtime                              >|
    |                                                                          |
    |<       program0       >|<       program1       >|<       programN       >|
    |       (@=params)       |       (@=params)       |       (@=params)       |
    |                        |                        |                        |
    o------------------------o------------------------o------------------------o--->
                                                                                  t

## MLR measurement

    |<  measure  >|   traffic_start(r=pdr)       traffic_stop   traffic_start(r=ndr)     traffic_stop  |< [  latency  ] >|
    |   (r=mlr)   |   |                          |              |                          |           |   .9/.5/.1/.0   |
    |             |   |   |<  stat_runtime  >|   |              |   |<  stat_runtime  >|   |           |                 |
    |             |   |   |                  |   |              |   |                  |   |           |                 |
    +-------------+---o---+------------------+---o--------------o---+------------------+---o-----------[-----------------]--->
                                                                                                                            t
    Legend:
    - stat_runtime
      - vpp-runtime
    - stat_pre_trial
      - vpp-clear-stats
      - vpp-enable-packettrace  // if extended_debug == True
    - stat_post_trial
      - vpp-show-stats
      - vpp-show-packettrace    // if extended_debug == True