Skip to content

Commit dbd66a7

Browse files
committed
NFR Test Results for NGF version edge
1 parent 9a47b6d commit dbd66a7

File tree

2 files changed

+223
-186
lines changed

2 files changed

+223
-186
lines changed

tests/results/reconfig/edge/edge-oss.md

Lines changed: 106 additions & 88 deletions
Original file line numberDiff line numberDiff line change
@@ -6,16 +6,16 @@ NGINX Plus: false
66

77
NGINX Gateway Fabric:
88

9-
- Commit: e7d217a8f01fb3c8fc4507ef6f0e7feead667f20
10-
- Date: 2024-11-14T18:42:55Z
9+
- Commit: 9a47b6d33e6c5e0568af0bfc367e5f1190354b05
10+
- Date: 2025-01-03T19:08:47Z
1111
- Dirty: false
1212

1313
GKE Cluster:
1414

1515
- Node count: 12
16-
- k8s version: v1.30.5-gke.1443001
16+
- k8s version: v1.30.6-gke.1125000
1717
- vCPUs per node: 16
18-
- RAM per node: 65853972Ki
18+
- RAM per node: 65853984Ki
1919
- Max pods per node: 110
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
@@ -27,163 +27,181 @@ GKE Cluster:
2727
- TimeToReadyTotal: 3s
2828
- TimeToReadyAvgSingle: < 1s
2929
- NGINX Reloads: 2
30-
- NGINX Reload Average Time: 126ms
30+
- NGINX Reload Average Time: 127ms
3131
- Reload distribution:
32-
- 500ms: 2
33-
- 1000ms: 2
34-
- 5000ms: 2
35-
- 10000ms: 2
36-
- 30000ms: 2
32+
- 500.0ms: 2
33+
- 1000.0ms: 2
34+
- 5000.0ms: 2
35+
- 10000.0ms: 2
36+
- 30000.0ms: 2
3737
- +Infms: 2
3838

3939
### Event Batch Processing
4040

4141
- Event Batch Total: 5
42-
- Event Batch Processing Average Time: 60ms
42+
- Event Batch Processing Average Time: 59ms
4343
- Event Batch Processing distribution:
44-
- 500ms: 5
45-
- 1000ms: 5
46-
- 5000ms: 5
47-
- 10000ms: 5
48-
- 30000ms: 5
44+
- 500.0ms: 5
45+
- 1000.0ms: 5
46+
- 5000.0ms: 5
47+
- 10000.0ms: 5
48+
- 30000.0ms: 5
4949
- +Infms: 5
5050

51+
### NGINX Error Logs
52+
53+
5154
## Test 1: Resources exist before startup - NumResources 150
5255

5356
### Reloads and Time to Ready
5457

55-
- TimeToReadyTotal: 2s
58+
- TimeToReadyTotal: 3s
5659
- TimeToReadyAvgSingle: < 1s
5760
- NGINX Reloads: 2
5861
- NGINX Reload Average Time: 126ms
5962
- Reload distribution:
60-
- 500ms: 2
61-
- 1000ms: 2
62-
- 5000ms: 2
63-
- 10000ms: 2
64-
- 30000ms: 2
63+
- 500.0ms: 2
64+
- 1000.0ms: 2
65+
- 5000.0ms: 2
66+
- 10000.0ms: 2
67+
- 30000.0ms: 2
6568
- +Infms: 2
6669

6770
### Event Batch Processing
6871

6972
- Event Batch Total: 6
7073
- Event Batch Processing Average Time: 50ms
7174
- Event Batch Processing distribution:
72-
- 500ms: 6
73-
- 1000ms: 6
74-
- 5000ms: 6
75-
- 10000ms: 6
76-
- 30000ms: 6
75+
- 500.0ms: 6
76+
- 1000.0ms: 6
77+
- 5000.0ms: 6
78+
- 10000.0ms: 6
79+
- 30000.0ms: 6
7780
- +Infms: 6
7881

82+
### NGINX Error Logs
83+
84+
7985
## Test 2: Start NGF, deploy Gateway, create many resources attached to GW - NumResources 30
8086

8187
### Reloads and Time to Ready
8288

8389
- TimeToReadyTotal: 8s
8490
- TimeToReadyAvgSingle: < 1s
85-
- NGINX Reloads: 52
86-
- NGINX Reload Average Time: 151ms
91+
- NGINX Reloads: 53
92+
- NGINX Reload Average Time: 150ms
8793
- Reload distribution:
88-
- 500ms: 52
89-
- 1000ms: 52
90-
- 5000ms: 52
91-
- 10000ms: 52
92-
- 30000ms: 52
93-
- +Infms: 52
94+
- 500.0ms: 53
95+
- 1000.0ms: 53
96+
- 5000.0ms: 53
97+
- 10000.0ms: 53
98+
- 30000.0ms: 53
99+
- +Infms: 53
94100

95101
### Event Batch Processing
96102

97-
- Event Batch Total: 326
103+
- Event Batch Total: 329
98104
- Event Batch Processing Average Time: 24ms
99105
- Event Batch Processing distribution:
100-
- 500ms: 326
101-
- 1000ms: 326
102-
- 5000ms: 326
103-
- 10000ms: 326
104-
- 30000ms: 326
105-
- +Infms: 326
106+
- 500.0ms: 329
107+
- 1000.0ms: 329
108+
- 5000.0ms: 329
109+
- 10000.0ms: 329
110+
- 30000.0ms: 329
111+
- +Infms: 329
112+
113+
### NGINX Error Logs
114+
106115

107116
## Test 2: Start NGF, deploy Gateway, create many resources attached to GW - NumResources 150
108117

109118
### Reloads and Time to Ready
110119

111120
- TimeToReadyTotal: 43s
112121
- TimeToReadyAvgSingle: < 1s
113-
- NGINX Reloads: 283
114-
- NGINX Reload Average Time: 152ms
122+
- NGINX Reloads: 287
123+
- NGINX Reload Average Time: 151ms
115124
- Reload distribution:
116-
- 500ms: 283
117-
- 1000ms: 283
118-
- 5000ms: 283
119-
- 10000ms: 283
120-
- 30000ms: 283
121-
- +Infms: 283
125+
- 500.0ms: 287
126+
- 1000.0ms: 287
127+
- 5000.0ms: 287
128+
- 10000.0ms: 287
129+
- 30000.0ms: 287
130+
- +Infms: 287
122131

123132
### Event Batch Processing
124133

125-
- Event Batch Total: 1633
134+
- Event Batch Total: 1640
126135
- Event Batch Processing Average Time: 26ms
127136
- Event Batch Processing distribution:
128-
- 500ms: 1633
129-
- 1000ms: 1633
130-
- 5000ms: 1633
131-
- 10000ms: 1633
132-
- 30000ms: 1633
133-
- +Infms: 1633
137+
- 500.0ms: 1640
138+
- 1000.0ms: 1640
139+
- 5000.0ms: 1640
140+
- 10000.0ms: 1640
141+
- 30000.0ms: 1640
142+
- +Infms: 1640
143+
144+
### NGINX Error Logs
145+
134146

135147
## Test 3: Start NGF, create many resources attached to a Gateway, deploy the Gateway - NumResources 30
136148

137149
### Reloads and Time to Ready
138150

139151
- TimeToReadyTotal: < 1s
140152
- TimeToReadyAvgSingle: < 1s
141-
- NGINX Reloads: 55
142-
- NGINX Reload Average Time: 148ms
153+
- NGINX Reloads: 58
154+
- NGINX Reload Average Time: 139ms
143155
- Reload distribution:
144-
- 500ms: 55
145-
- 1000ms: 55
146-
- 5000ms: 55
147-
- 10000ms: 55
148-
- 30000ms: 55
149-
- +Infms: 55
156+
- 500.0ms: 58
157+
- 1000.0ms: 58
158+
- 5000.0ms: 58
159+
- 10000.0ms: 58
160+
- 30000.0ms: 58
161+
- +Infms: 58
150162

151163
### Event Batch Processing
152164

153-
- Event Batch Total: 296
165+
- Event Batch Total: 300
154166
- Event Batch Processing Average Time: 27ms
155167
- Event Batch Processing distribution:
156-
- 500ms: 296
157-
- 1000ms: 296
158-
- 5000ms: 296
159-
- 10000ms: 296
160-
- 30000ms: 296
161-
- +Infms: 296
168+
- 500.0ms: 300
169+
- 1000.0ms: 300
170+
- 5000.0ms: 300
171+
- 10000.0ms: 300
172+
- 30000.0ms: 300
173+
- +Infms: 300
174+
175+
### NGINX Error Logs
176+
162177

163178
## Test 3: Start NGF, create many resources attached to a Gateway, deploy the Gateway - NumResources 150
164179

165180
### Reloads and Time to Ready
166181

167182
- TimeToReadyTotal: < 1s
168183
- TimeToReadyAvgSingle: < 1s
169-
- NGINX Reloads: 294
170-
- NGINX Reload Average Time: 148ms
184+
- NGINX Reloads: 324
185+
- NGINX Reload Average Time: 134ms
171186
- Reload distribution:
172-
- 500ms: 294
173-
- 1000ms: 294
174-
- 5000ms: 294
175-
- 10000ms: 294
176-
- 30000ms: 294
177-
- +Infms: 294
187+
- 500.0ms: 324
188+
- 1000.0ms: 324
189+
- 5000.0ms: 324
190+
- 10000.0ms: 324
191+
- 30000.0ms: 324
192+
- +Infms: 324
178193

179194
### Event Batch Processing
180195

181-
- Event Batch Total: 1506
182-
- Event Batch Processing Average Time: 29ms
196+
- Event Batch Total: 1520
197+
- Event Batch Processing Average Time: 28ms
183198
- Event Batch Processing distribution:
184-
- 500ms: 1506
185-
- 1000ms: 1506
186-
- 5000ms: 1506
187-
- 10000ms: 1506
188-
- 30000ms: 1506
189-
- +Infms: 1506
199+
- 500.0ms: 1520
200+
- 1000.0ms: 1520
201+
- 5000.0ms: 1520
202+
- 10000.0ms: 1520
203+
- 30000.0ms: 1520
204+
- +Infms: 1520
205+
206+
### NGINX Error Logs
207+

0 commit comments

Comments
 (0)