Skip to content

Commit 55be967

Browse files
committed
Add test results
1 parent 2ba7288 commit 55be967

File tree

13 files changed

+252
-0
lines changed

13 files changed

+252
-0
lines changed
Loading
Loading
Loading
Loading
Loading
Loading
Loading
Loading
Loading
Loading
Loading

tests/results/scale/edge/edge.md

+194
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,194 @@
1+
# Results
2+
3+
## Test environment
4+
5+
NGINX Plus: false
6+
7+
GKE Cluster:
8+
9+
- Node count: 12
10+
- k8s version: v1.28.7-gke.1026000
11+
- vCPUs per node: 16
12+
- RAM per node: 65855096Ki
13+
- Max pods per node: 110
14+
- Zone: us-central1-c
15+
- Instance Type: n2d-standard-16
16+
17+
## Test TestScale_Listeners
18+
19+
### Reloads
20+
21+
- Total: 152
22+
- Total Errors: 0
23+
- Average Time: 148ms
24+
- Reload distribution:
25+
- 500ms: 152
26+
- 1000ms: 152
27+
- 5000ms: 152
28+
- 10000ms: 152
29+
- 30000ms: 152
30+
- +Infms: 152
31+
32+
### Event Batch Processing
33+
34+
- Total: 410
35+
- Average Time: 145ms
36+
- Event Batch Processing distribution:
37+
- 500ms: 366
38+
- 1000ms: 405
39+
- 5000ms: 410
40+
- 10000ms: 410
41+
- 30000ms: 410
42+
- +Infms: 410
43+
44+
### Errors
45+
46+
- NGF errors: 0
47+
- NGF container restarts: 0
48+
- NGINX errors: 0
49+
- NGINX container restarts: 0
50+
51+
### Graphs and Logs
52+
53+
See [output directory](./TestScale_Listeners) for more details.
54+
The logs are attached only if there are errors.
55+
56+
## Test TestScale_HTTPSListeners
57+
58+
### Reloads
59+
60+
- Total: 152
61+
- Total Errors: 0
62+
- Average Time: 162ms
63+
- Reload distribution:
64+
- 500ms: 152
65+
- 1000ms: 152
66+
- 5000ms: 152
67+
- 10000ms: 152
68+
- 30000ms: 152
69+
- +Infms: 152
70+
71+
### Event Batch Processing
72+
73+
- Total: 474
74+
- Average Time: 137ms
75+
- Event Batch Processing distribution:
76+
- 500ms: 423
77+
- 1000ms: 466
78+
- 5000ms: 474
79+
- 10000ms: 474
80+
- 30000ms: 474
81+
- +Infms: 474
82+
83+
### Errors
84+
85+
- NGF errors: 0
86+
- NGF container restarts: 0
87+
- NGINX errors: 0
88+
- NGINX container restarts: 0
89+
90+
### Graphs and Logs
91+
92+
See [output directory](./TestScale_HTTPSListeners) for more details.
93+
The logs are attached only if there are errors.
94+
95+
## Test TestScale_HTTPRoutes
96+
97+
### Reloads
98+
99+
- Total: 1145
100+
- Total Errors: 0
101+
- Average Time: 336ms
102+
- Reload distribution:
103+
- 500ms: 918
104+
- 1000ms: 1145
105+
- 5000ms: 1145
106+
- 10000ms: 1145
107+
- 30000ms: 1145
108+
- +Infms: 1145
109+
110+
### Event Batch Processing
111+
112+
- Total: 1151
113+
- Average Time: 403ms
114+
- Event Batch Processing distribution:
115+
- 500ms: 824
116+
- 1000ms: 1150
117+
- 5000ms: 1150
118+
- 10000ms: 1150
119+
- 30000ms: 1150
120+
- +Infms: 1151
121+
122+
### Errors
123+
124+
- NGF errors: 0
125+
- NGF container restarts: 0
126+
- NGINX errors: 0
127+
- NGINX container restarts: 0
128+
129+
### Graphs and Logs
130+
131+
See [output directory](./TestScale_HTTPRoutes) for more details.
132+
The logs are attached only if there are errors.
133+
134+
## Test TestScale_UpstreamServers
135+
136+
### Reloads
137+
138+
- Total: 6
139+
- Total Errors: 0
140+
- Average Time: 126ms
141+
- Reload distribution:
142+
- 500ms: 6
143+
- 1000ms: 6
144+
- 5000ms: 6
145+
- 10000ms: 6
146+
- 30000ms: 6
147+
- +Infms: 6
148+
149+
### Event Batch Processing
150+
151+
- Total: 9
152+
- Average Time: 94ms
153+
- Event Batch Processing distribution:
154+
- 500ms: 9
155+
- 1000ms: 9
156+
- 5000ms: 9
157+
- 10000ms: 9
158+
- 30000ms: 9
159+
- +Infms: 9
160+
161+
### Errors
162+
163+
- NGF errors: 0
164+
- NGF container restarts: 0
165+
- NGINX errors: 0
166+
- NGINX container restarts: 0
167+
168+
### Graphs and Logs
169+
170+
See [output directory](./TestScale_UpstreamServers) for more details.
171+
The logs are attached only if there are errors.
172+
173+
## Test TestScale_HTTPMatches
174+
175+
```text
176+
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
177+
Duration [total, attack, wait] 30s, 29.999s, 845.744µs
178+
Latencies [min, mean, 50, 90, 95, 99, max] 556.146µs, 883.288µs, 841.635µs, 1.007ms, 1.062ms, 1.214ms, 21.097ms
179+
Bytes In [total, mean] 4800000, 160.00
180+
Bytes Out [total, mean] 0, 0.00
181+
Success [ratio] 100.00%
182+
Status Codes [code:count] 200:30000
183+
Error Set:
184+
```
185+
```text
186+
Requests [total, rate, throughput] 30000, 1000.05, 1000.02
187+
Duration [total, attack, wait] 29.999s, 29.998s, 922.12µs
188+
Latencies [min, mean, 50, 90, 95, 99, max] 654.605µs, 965.039µs, 942.255µs, 1.128ms, 1.201ms, 1.338ms, 4.468ms
189+
Bytes In [total, mean] 4800000, 160.00
190+
Bytes Out [total, mean] 0, 0.00
191+
Success [ratio] 100.00%
192+
Status Codes [code:count] 200:30000
193+
Error Set:
194+
```

tests/results/scale/edge/output.md

+58
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,58 @@
1+
# Test Output
2+
3+
> Note: this file was added manually, not by the test run
4+
> This is to help review the PR
5+
6+
```text
7+
make nfr-test
8+
NFR=true bash scripts/run-tests-gcp-vm.sh
9+
vars.env 100% 945 13.4KB/s 00:00
10+
go run github.com/onsi/ginkgo/v2/ginkgo --randomize-all --randomize-suites --keep-going --fail-on-pending --trace -r -v \
11+
--label-filter "nfr" --label-filter "scale" ./suite -- --gateway-api-version=1.0.0 \
12+
--gateway-api-prev-version=1.0.0 --image-tag=edge --version-under-test= \
13+
--plus-enabled=false --ngf-image-repo=gcr.io/<REDACTED>/michael/scale/nginx-gateway-fabric --nginx-image-repo=gcr.io/<REDACTED>/michael/scale/nginx-gateway-fabric/nginx --nginx-plus-image-repo=gcr.io/<REDACTED>/michael/scale/nginx-gateway-fabric/nginx \
14+
--pull-policy=Always --k8s-version=latest --service-type=LoadBalancer \
15+
--is-gke-internal-lb=true
16+
Running Suite: NGF System Tests - /home/username/nginx-gateway-fabric/tests/suite
17+
=================================================================================
18+
Random Seed: 1714674847 - will randomize all specs
19+
20+
Will run 5 of 15 specs
21+
------------------------------
22+
[BeforeSuite]
23+
/home/username/nginx-gateway-fabric/tests/suite/system_suite_test.go:246
24+
[BeforeSuite] PASSED [2.492 seconds]
25+
------------------------------
26+
S
27+
------------------------------
28+
Scale test scales HTTP listeners to 64 [nfr, scale]
29+
/home/username/nginx-gateway-fabric/tests/suite/scale_test.go:575
30+
• [298.329 seconds]
31+
------------------------------
32+
Scale test scales HTTPS listeners to 64 [nfr, scale]
33+
/home/username/nginx-gateway-fabric/tests/suite/scale_test.go:603
34+
• [263.231 seconds]
35+
------------------------------
36+
Scale test scales HTTP routes to 1000 [nfr, scale]
37+
/home/username/nginx-gateway-fabric/tests/suite/scale_test.go:631
38+
• [670.689 seconds]
39+
------------------------------
40+
Scale test scales upstream servers to 648 [nfr, scale]
41+
/home/username/nginx-gateway-fabric/tests/suite/scale_test.go:659
42+
• [166.598 seconds]
43+
------------------------------
44+
Scale test scale HTTP matches [nfr, scale]
45+
/home/username/nginx-gateway-fabric/tests/suite/scale_test.go:674
46+
• [261.064 seconds]
47+
------------------------------
48+
SSSSSSSSS
49+
------------------------------
50+
[AfterSuite]
51+
/home/username/nginx-gateway-fabric/tests/suite/system_suite_test.go:275
52+
[AfterSuite] PASSED [60.536 seconds]
53+
------------------------------
54+
55+
Ran 5 of 15 Specs in 1722.941 seconds
56+
SUCCESS! -- 5 Passed | 0 Failed | 0 Pending | 10 Skipped
57+
PASS
58+
```

0 commit comments

Comments
 (0)