-
Notifications
You must be signed in to change notification settings - Fork 9
Update actions/checkout digest to 8e8c483 #889
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
💻 Website PreviewThe latest changes are available as preview in: https://8c66a7a5.federation-gateway-benchmark.pages.dev |
Overview for:
|
| Gateway | RPS ⬇️ | Requests | Duration | Notes |
|---|---|---|---|---|
| hive-router | 1981 | 122857 total, 0 failed | avg: 113ms, p95: 278ms | ✅ |
| grafbase | 1463 | 92522 total, 0 failed | avg: 150ms, p95: 352ms | ✅ |
| cosmo | 692 | 44141 total, 0 failed | avg: 318ms, p95: 706ms | ✅ |
| hive-gateway-router-runtime | 614 | 40546 total, 0 failed | avg: 346ms, p95: 710ms | ❌ non-compatible response structure (1) |
| apollo-router | 391 | 26258 total, 0 failed | avg: 537ms, p95: 1207ms | ❌ 21 unexpected GraphQL errors |
| hive-gateway | 257 | 17922 total, 0 failed | avg: 781ms, p95: 1768ms | ✅ |
| apollo-gateway | 161 | 11029 total, 0 failed | avg: 1190ms, p95: 2585ms | ✅ |
Summary for: hive-router
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 365571 ✗ 0
data_received..................: 11 GB 174 MB/s
data_sent......................: 143 MB 2.3 MB/s
http_req_blocked...............: avg=323.96µs min=927ns med=2.38µs max=285.62ms p(90)=3.78µs p(95)=4.37µs p(99.9)=124.59ms
http_req_connecting............: avg=319.77µs min=0s med=0s max=285.4ms p(90)=0s p(95)=0s p(99.9)=123.64ms
http_req_duration..............: avg=113.43ms min=1.63ms med=99.45ms max=479.7ms p(90)=235.79ms p(95)=277.72ms p(99.9)=405.45ms
{ expected_response:true }...: avg=113.43ms min=1.63ms med=99.45ms max=479.7ms p(90)=235.79ms p(95)=277.72ms p(99.9)=405.45ms
http_req_failed................: 0.00% ✓ 0 ✗ 122857
http_req_receiving.............: avg=415.64µs min=19.12µs med=40.25µs max=163.57ms p(90)=125.39µs p(95)=373.8µs p(99.9)=66.17ms
http_req_sending...............: avg=341.38µs min=3.91µs med=8.84µs max=172.53ms p(90)=19.52µs p(95)=121.7µs p(99.9)=61.3ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=112.67ms min=1.58ms med=98.81ms max=479.65ms p(90)=234.1ms p(95)=275.94ms p(99.9)=404.87ms
http_reqs......................: 122857 1981.85219/s
iteration_duration.............: avg=114.96ms min=1.77ms med=100.68ms max=663.27ms p(90)=237.85ms p(95)=279.87ms p(99.9)=421.81ms
iterations.....................: 121857 1965.720816/s
success_rate...................: 100.00% ✓ 121857 ✗ 0
vus............................: 61 min=0 max=497
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: grafbase
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 274566 ✗ 0
data_received..................: 8.1 GB 129 MB/s
data_sent......................: 108 MB 1.7 MB/s
http_req_blocked...............: avg=751.49µs min=1.26µs med=3.11µs max=391.9ms p(90)=4.84µs p(95)=6.12µs p(99.9)=231.88ms
http_req_connecting............: avg=746.83µs min=0s med=0s max=391.84ms p(90)=0s p(95)=0s p(99.9)=231.82ms
http_req_duration..............: avg=150.33ms min=2.55ms med=137.24ms max=536.24ms p(90)=299.21ms p(95)=352.39ms p(99.9)=442.31ms
{ expected_response:true }...: avg=150.33ms min=2.55ms med=137.24ms max=536.24ms p(90)=299.21ms p(95)=352.39ms p(99.9)=442.31ms
http_req_failed................: 0.00% ✓ 0 ✗ 92522
http_req_receiving.............: avg=720.21µs min=26.16µs med=49.02µs max=162.18ms p(90)=127.54µs p(95)=473.15µs p(99.9)=97.06ms
http_req_sending...............: avg=650.64µs min=5.43µs med=11.86µs max=227.52ms p(90)=32.64µs p(95)=150.68µs p(99.9)=93.42ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=148.95ms min=2.51ms med=135.75ms max=475.76ms p(90)=296.03ms p(95)=350.04ms p(99.9)=435.25ms
http_reqs......................: 92522 1463.408573/s
iteration_duration.............: avg=153.15ms min=2.82ms med=139.54ms max=955.06ms p(90)=303.07ms p(95)=355.72ms p(99.9)=551.65ms
iterations.....................: 91522 1447.591701/s
success_rate...................: 100.00% ✓ 91522 ✗ 0
vus............................: 71 min=0 max=494
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: cosmo
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 129423 ✗ 0
data_received..................: 3.9 GB 61 MB/s
data_sent......................: 51 MB 806 kB/s
http_req_blocked...............: avg=109.75µs min=1.31µs med=2.83µs max=173.62ms p(90)=4.37µs p(95)=6.19µs p(99.9)=30.49ms
http_req_connecting............: avg=105.46µs min=0s med=0s max=173.56ms p(90)=0s p(95)=0s p(99.9)=30.44ms
http_req_duration..............: avg=318.04ms min=2.81ms med=299.99ms max=1.21s p(90)=621.13ms p(95)=705.62ms p(99.9)=1.01s
{ expected_response:true }...: avg=318.04ms min=2.81ms med=299.99ms max=1.21s p(90)=621.13ms p(95)=705.62ms p(99.9)=1.01s
http_req_failed................: 0.00% ✓ 0 ✗ 44141
http_req_receiving.............: avg=598.02µs min=26.49µs med=59.51µs max=232.26ms p(90)=168.41µs p(95)=468.97µs p(99.9)=81.6ms
http_req_sending...............: avg=181.14µs min=5.51µs med=11.04µs max=123.62ms p(90)=29.37µs p(95)=127.13µs p(99.9)=39.37ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=317.26ms min=2.73ms med=299.32ms max=1.21s p(90)=620.27ms p(95)=704.36ms p(99.9)=1.01s
http_reqs......................: 44141 692.309122/s
iteration_duration.............: avg=325.96ms min=3.07ms med=308.33ms max=1.21s p(90)=625.16ms p(95)=709.44ms p(99.9)=1.02s
iterations.....................: 43141 676.625084/s
success_rate...................: 100.00% ✓ 43141 ✗ 0
vus............................: 95 min=0 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: hive-gateway-router-runtime
K6 Output
✓ response code was 200
✓ no graphql errors
✗ valid response structure
↳ 99% — ✓ 39545 / ✗ 1
checks.........................: 99.99% ✓ 118637 ✗ 1
data_received..................: 3.6 GB 54 MB/s
data_sent......................: 47 MB 716 kB/s
http_req_blocked...............: avg=179.47µs min=1.23µs med=2.89µs max=202.05ms p(90)=4.48µs p(95)=6.21µs p(99.9)=55.06ms
http_req_connecting............: avg=174.07µs min=0s med=0s max=201.89ms p(90)=0s p(95)=0s p(99.9)=55ms
http_req_duration..............: avg=346.3ms min=4.74ms med=340ms max=1.26s p(90)=639.19ms p(95)=710.32ms p(99.9)=943.53ms
{ expected_response:true }...: avg=346.3ms min=4.74ms med=340ms max=1.26s p(90)=639.19ms p(95)=710.32ms p(99.9)=943.53ms
http_req_failed................: 0.00% ✓ 0 ✗ 40546
http_req_receiving.............: avg=213µs min=26.95µs med=45.38µs max=142.03ms p(90)=95.76µs p(95)=384.38µs p(99.9)=31.91ms
http_req_sending...............: avg=286.96µs min=5.56µs med=11.07µs max=165.5ms p(90)=31.38µs p(95)=136.04µs p(99.9)=49.3ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=345.8ms min=4.69ms med=339.41ms max=1.23s p(90)=638.4ms p(95)=709.36ms p(99.9)=942.81ms
http_reqs......................: 40546 614.82623/s
iteration_duration.............: avg=355.7ms min=5.06ms med=349.71ms max=1.34s p(90)=642.77ms p(95)=717.08ms p(99.9)=948.33ms
iterations.....................: 39546 599.662558/s
success_rate...................: 99.99% ✓ 39545 ✗ 1
vus............................: 60 min=0 max=498
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: apollo-router
K6 Output
✓ response code was 200
✗ no graphql errors
↳ 99% — ✓ 25237 / ✗ 21
✓ valid response structure
checks.........................: 99.97% ✓ 75753 ✗ 21
data_received..................: 2.3 GB 34 MB/s
data_sent......................: 31 MB 456 kB/s
http_req_blocked...............: avg=84.51µs min=1.36µs med=3.06µs max=131.77ms p(90)=4.7µs p(95)=6.35µs p(99.9)=24.77ms
http_req_connecting............: avg=79.04µs min=0s med=0s max=131.73ms p(90)=0s p(95)=0s p(99.9)=24.72ms
http_req_duration..............: avg=536.81ms min=6.15ms med=501.37ms max=1.89s p(90)=1.08s p(95)=1.2s p(99.9)=1.62s
{ expected_response:true }...: avg=536.81ms min=6.15ms med=501.37ms max=1.89s p(90)=1.08s p(95)=1.2s p(99.9)=1.62s
http_req_failed................: 0.00% ✓ 0 ✗ 26258
http_req_receiving.............: avg=124.82µs min=30.72µs med=52.92µs max=110.63ms p(90)=106.15µs p(95)=191.11µs p(99.9)=10.41ms
http_req_sending...............: avg=111.59µs min=5.94µs med=11.55µs max=135.09ms p(90)=30.48µs p(95)=118.53µs p(99.9)=22.36ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=536.57ms min=6.1ms med=501.03ms max=1.89s p(90)=1.08s p(95)=1.2s p(99.9)=1.62s
http_reqs......................: 26258 391.201915/s
iteration_duration.............: avg=558.53ms min=6.28ms med=523.01ms max=1.89s p(90)=1.09s p(95)=1.21s p(99.9)=1.62s
iterations.....................: 25258 376.303526/s
success_rate...................: 99.91% ✓ 25237 ✗ 21
vus............................: 73 min=0 max=496
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: hive-gateway
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 50766 ✗ 0
data_received..................: 1.6 GB 23 MB/s
data_sent......................: 21 MB 302 kB/s
http_req_blocked...............: avg=97.4µs min=1.26µs med=2.79µs max=79.84ms p(90)=4.9µs p(95)=7.54µs p(99.9)=22.83ms
http_req_connecting............: avg=91.8µs min=0s med=0s max=79.79ms p(90)=0s p(95)=0s p(99.9)=22.78ms
http_req_duration..............: avg=781.08ms min=7ms med=714.58ms max=5.23s p(90)=1.55s p(95)=1.76s p(99.9)=4.36s
{ expected_response:true }...: avg=781.08ms min=7ms med=714.58ms max=5.23s p(90)=1.55s p(95)=1.76s p(99.9)=4.36s
http_req_failed................: 0.00% ✓ 0 ✗ 17922
http_req_receiving.............: avg=176.41µs min=27.29µs med=45.64µs max=120.65ms p(90)=92.92µs p(95)=152.26µs p(99.9)=24.95ms
http_req_sending...............: avg=169.8µs min=5.98µs med=11.04µs max=109.86ms p(90)=29.29µs p(95)=99.06µs p(99.9)=28.92ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=780.73ms min=6.94ms med=714.18ms max=5.23s p(90)=1.55s p(95)=1.76s p(99.9)=4.36s
http_reqs......................: 17922 257.108137/s
iteration_duration.............: avg=827.5ms min=8.25ms med=772.93ms max=5.26s p(90)=1.58s p(95)=1.77s p(99.9)=4.51s
iterations.....................: 16922 242.762186/s
success_rate...................: 100.00% ✓ 16922 ✗ 0
vus............................: 99 min=0 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: apollo-gateway
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 30087 ✗ 0
data_received..................: 969 MB 14 MB/s
data_sent......................: 13 MB 192 kB/s
http_req_blocked...............: avg=35.77µs min=1.22µs med=3.11µs max=47.42ms p(90)=5.32µs p(95)=11.34µs p(99.9)=6.08ms
http_req_connecting............: avg=29.91µs min=0s med=0s max=47.36ms p(90)=0s p(95)=0s p(99.9)=5.75ms
http_req_duration..............: avg=1.18s min=7.21ms med=1.12s max=14.76s p(90)=2.16s p(95)=2.58s p(99.9)=13.84s
{ expected_response:true }...: avg=1.18s min=7.21ms med=1.12s max=14.76s p(90)=2.16s p(95)=2.58s p(99.9)=13.84s
http_req_failed................: 0.00% ✓ 0 ✗ 11029
http_req_receiving.............: avg=76.09µs min=25.2µs med=53.5µs max=23.17ms p(90)=101.87µs p(95)=124.12µs p(99.9)=1.24ms
http_req_sending...............: avg=43.66µs min=5.86µs med=12.23µs max=29.98ms p(90)=30.12µs p(95)=48.1µs p(99.9)=7.24ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=1.18s min=7.17ms med=1.12s max=14.76s p(90)=2.16s p(95)=2.58s p(99.9)=13.84s
http_reqs......................: 11029 161.309244/s
iteration_duration.............: avg=1.3s min=7.97ms med=1.26s max=14.77s p(90)=2.21s p(95)=2.67s p(99.9)=13.93s
iterations.....................: 10029 146.683327/s
success_rate...................: 100.00% ✓ 10029 ✗ 0
vus............................: 88 min=0 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
This PR contains the following updates:
1af3b93->8e8c483Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Enabled.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR was generated by Mend Renovate. View the repository job log.