Skip to content

Update ghcr.io/grafbase/gateway Docker tag to v0.39.0 #704

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
May 28, 2025

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented May 28, 2025

This PR contains the following updates:

Package Type Update Change
ghcr.io/grafbase/gateway (source) final minor 0.38.0 -> 0.39.0

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label May 28, 2025
Copy link

Overview for: federation/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 175 5424 total, 0 failed avg: 828ms, p95: 2500ms
grafbase 169 5211 total, 0 failed avg: 907ms, p95: 2571ms
apollo-router 156 4837 total, 0 failed avg: 898ms, p95: 2466ms
hive-gateway-bun 93 3040 total, 0 failed avg: 3008ms, p95: 4741ms
hive-gateway 86 2892 total, 0 failed avg: 3239ms, p95: 16525ms
apollo-server 85 2859 total, 0 failed avg: 3285ms, p95: 28271ms
mercurius 77 2462 total, 0 failed avg: 3729ms, p95: 5377ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16212      ✗ 0    
     data_received..................: 476 MB  15 MB/s
     data_sent......................: 6.4 MB  209 kB/s
     http_req_blocked...............: avg=2.03ms   min=1.5µs   med=3.64µs   max=2.94s  p(90)=6.32µs   p(95)=616.97µs
     http_req_connecting............: avg=1.53ms   min=0s      med=0s       max=2.94s  p(90)=0s       p(95)=413.05µs
     http_req_duration..............: avg=828.18ms min=3.28ms  med=615.58ms max=7.56s  p(90)=1.73s    p(95)=2.5s    
       { expected_response:true }...: avg=828.18ms min=3.28ms  med=615.58ms max=7.56s  p(90)=1.73s    p(95)=2.5s    
     http_req_failed................: 0.00%   ✓ 0          ✗ 5424 
     http_req_receiving.............: avg=274.93ms min=38.47µs med=90.54µs  max=5.81s  p(90)=1.15s    p(95)=1.86s   
     http_req_sending...............: avg=18.24ms  min=8.76µs  med=16.77µs  max=3.57s  p(90)=341.52µs p(95)=14.11ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=535ms    min=3.18ms  med=495.76ms max=2.89s  p(90)=984.46ms p(95)=1.16s   
     http_reqs......................: 5424    175.710634/s
     iteration_duration.............: avg=1.67s    min=21.36ms med=1.27s    max=10.97s p(90)=3.6s     p(95)=4.53s   
     iterations.....................: 5404    175.062733/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15573      ✗ 0    
     data_received..................: 458 MB  15 MB/s
     data_sent......................: 6.2 MB  201 kB/s
     http_req_blocked...............: avg=1.74ms   min=1.5µs   med=3.74µs   max=541.67ms p(90)=6.4µs    p(95)=7.19ms
     http_req_connecting............: avg=1.59ms   min=0s      med=0s       max=408.39ms p(90)=0s       p(95)=5.64ms
     http_req_duration..............: avg=906.81ms min=2.96ms  med=723.71ms max=6.14s    p(90)=2s       p(95)=2.57s 
       { expected_response:true }...: avg=906.81ms min=2.96ms  med=723.71ms max=6.14s    p(90)=2s       p(95)=2.57s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 5211 
     http_req_receiving.............: avg=326.79ms min=32.79µs med=93.33µs  max=5.31s    p(90)=1.21s    p(95)=1.86s 
     http_req_sending...............: avg=14.8ms   min=8.16µs  med=17.66µs  max=2.98s    p(90)=204.92µs p(95)=7.77ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=565.2ms  min=2.89ms  med=541.28ms max=2.39s    p(90)=1s       p(95)=1.11s 
     http_reqs......................: 5211    169.174715/s
     iteration_duration.............: avg=1.74s    min=19.19ms med=1.45s    max=7.76s    p(90)=3.6s     p(95)=4.36s 
     iterations.....................: 5191    168.525417/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14451      ✗ 0    
     data_received..................: 424 MB  14 MB/s
     data_sent......................: 5.7 MB  186 kB/s
     http_req_blocked...............: avg=2.13ms   min=1.49µs  med=3.69µs   max=1.88s p(90)=6.56µs   p(95)=4.57ms
     http_req_connecting............: avg=1.79ms   min=0s      med=0s       max=1.88s p(90)=0s       p(95)=4.33ms
     http_req_duration..............: avg=898.08ms min=6.51ms  med=732.44ms max=5.9s  p(90)=2.05s    p(95)=2.46s 
       { expected_response:true }...: avg=898.08ms min=6.51ms  med=732.44ms max=5.9s  p(90)=2.05s    p(95)=2.46s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 4837 
     http_req_receiving.............: avg=305.95ms min=33.51µs med=89.1µs   max=5.4s  p(90)=1.33s    p(95)=1.98s 
     http_req_sending...............: avg=21.25ms  min=7.78µs  med=17.38µs  max=3.99s p(90)=239.09µs p(95)=5.06ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=570.86ms min=6.46ms  med=523.75ms max=2.59s p(90)=1.09s    p(95)=1.22s 
     http_reqs......................: 4837    156.336503/s
     iteration_duration.............: avg=1.88s    min=40.03ms med=1.63s    max=9.73s p(90)=3.84s    p(95)=4.67s 
     iterations.....................: 4817    155.690083/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9060      ✗ 0    
     data_received..................: 267 MB  8.2 MB/s
     data_sent......................: 3.6 MB  111 kB/s
     http_req_blocked...............: avg=653.69µs min=1.72µs  med=3.6µs    max=43.46ms  p(90)=105.5µs p(95)=6.92ms 
     http_req_connecting............: avg=613.23µs min=0s      med=0s       max=17.93ms  p(90)=0s      p(95)=6.67ms 
     http_req_duration..............: avg=3s       min=14.23ms med=2.81s    max=7.07s    p(90)=4.23s   p(95)=4.74s  
       { expected_response:true }...: avg=3s       min=14.23ms med=2.81s    max=7.07s    p(90)=4.23s   p(95)=4.74s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 3040 
     http_req_receiving.............: avg=63.56ms  min=40.96µs med=123.37µs max=1.87s    p(90)=64.14ms p(95)=545.7ms
     http_req_sending...............: avg=765.45µs min=9.7µs   med=18.85µs  max=215.67ms p(90)=258µs   p(95)=2.42ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=2.94s    min=13.36ms med=2.77s    max=7.07s    p(90)=4.18s   p(95)=4.73s  
     http_reqs......................: 3040    93.186989/s
     iteration_duration.............: avg=3.09s    min=96.64ms med=2.88s    max=7.1s     p(90)=4.39s   p(95)=4.82s  
     iterations.....................: 3020    92.573916/s
     vus............................: 95      min=95      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8616      ✗ 0    
     data_received..................: 254 MB  7.6 MB/s
     data_sent......................: 3.4 MB  103 kB/s
     http_req_blocked...............: avg=3.57ms   min=1.7µs    med=4.4µs    max=85.03ms  p(90)=516.59µs p(95)=25.56ms
     http_req_connecting............: avg=3.45ms   min=0s       med=0s       max=84.99ms  p(90)=242.4µs  p(95)=25.1ms 
     http_req_duration..............: avg=3.23s    min=15.72ms  med=1.73s    max=32.85s   p(90)=2.93s    p(95)=16.52s 
       { expected_response:true }...: avg=3.23s    min=15.72ms  med=1.73s    max=32.85s   p(90)=2.93s    p(95)=16.52s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 2892 
     http_req_receiving.............: avg=781.45µs min=45.18µs  med=104.44µs max=112.59ms p(90)=435.59µs p(95)=1.39ms 
     http_req_sending...............: avg=526.41µs min=9.45µs   med=24.12µs  max=50.51ms  p(90)=318.42µs p(95)=3.44ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=3.23s    min=15.58ms  med=1.72s    max=32.85s   p(90)=2.93s    p(95)=16.52s 
     http_reqs......................: 2892    86.602428/s
     iteration_duration.............: avg=3.29s    min=282.35ms med=1.77s    max=32.92s   p(90)=2.95s    p(95)=16.86s 
     iterations.....................: 2872    86.003518/s
     vus............................: 39      min=39      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8517      ✗ 0    
     data_received..................: 251 MB  7.6 MB/s
     data_sent......................: 3.4 MB  102 kB/s
     http_req_blocked...............: avg=1.21ms   min=1.6µs    med=3.59µs  max=43.65ms p(90)=221.72µs p(95)=9.75ms  
     http_req_connecting............: avg=554.21µs min=0s       med=0s      max=32.47ms p(90)=91.01µs  p(95)=4.64ms  
     http_req_duration..............: avg=3.28s    min=10.99ms  med=1.38s   max=32.77s  p(90)=2.31s    p(95)=28.27s  
       { expected_response:true }...: avg=3.28s    min=10.99ms  med=1.38s   max=32.77s  p(90)=2.31s    p(95)=28.27s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2859 
     http_req_receiving.............: avg=214.15µs min=45.2µs   med=107.9µs max=23.46ms p(90)=211.1µs  p(95)=314.45µs
     http_req_sending...............: avg=707.73µs min=9.48µs   med=18.8µs  max=44.27ms p(90)=131.68µs p(95)=612.78µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.28s    min=10.86ms  med=1.38s   max=32.77s  p(90)=2.31s    p(95)=28.27s  
     http_reqs......................: 2859    85.956699/s
     iteration_duration.............: avg=3.32s    min=218.83ms med=1.39s   max=32.82s  p(90)=2.34s    p(95)=28.64s  
     iterations.....................: 2839    85.355393/s
     vus............................: 29      min=29      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7326      ✗ 0    
     data_received..................: 216 MB  6.8 MB/s
     data_sent......................: 2.9 MB  92 kB/s
     http_req_blocked...............: avg=2.21ms min=1.8µs    med=3.57µs  max=58.54ms  p(90)=6.01ms   p(95)=20.93ms 
     http_req_connecting............: avg=1.66ms min=0s       med=0s      max=58.51ms  p(90)=2.65ms   p(95)=13.05ms 
     http_req_duration..............: avg=3.72s  min=11.75ms  med=3.66s   max=8.06s    p(90)=4.71s    p(95)=5.37s   
       { expected_response:true }...: avg=3.72s  min=11.75ms  med=3.66s   max=8.06s    p(90)=4.71s    p(95)=5.37s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2462 
     http_req_receiving.............: avg=8.52ms min=40.63µs  med=97.35µs max=824.33ms p(90)=267.13µs p(95)=934.51µs
     http_req_sending...............: avg=1.31ms min=9.7µs    med=18.79µs max=71.5ms   p(90)=183.77µs p(95)=4.72ms  
     http_req_tls_handshaking.......: avg=0s     min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.71s  min=11.68ms  med=3.66s   max=8.06s    p(90)=4.71s    p(95)=5.37s   
     http_reqs......................: 2462    77.163308/s
     iteration_duration.............: avg=3.79s  min=398.52ms med=3.69s   max=8.09s    p(90)=4.73s    p(95)=5.4s    
     iterations.....................: 2442    76.536474/s
     vus............................: 228     min=228     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: federation/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 176 5461 total, 0 failed avg: 785ms, p95: 1976ms
grafbase 172 5297 total, 0 failed avg: 942ms, p95: 2434ms
apollo-router 159 4949 total, 0 failed avg: 1012ms, p95: 2657ms
apollo-server 87 2902 total, 0 failed avg: 3232ms, p95: 21259ms
hive-gateway-bun 87 2927 total, 0 failed avg: 3174ms, p95: 5134ms
hive-gateway 86 2892 total, 0 failed avg: 3250ms, p95: 17185ms
mercurius 77 2482 total, 0 failed avg: 3696ms, p95: 5412ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16323      ✗ 0    
     data_received..................: 479 MB  16 MB/s
     data_sent......................: 6.5 MB  209 kB/s
     http_req_blocked...............: avg=2.06ms   min=1.61µs  med=3.68µs   max=1.63s p(90)=6.49µs   p(95)=1.22ms  
     http_req_connecting............: avg=1.53ms   min=0s      med=0s       max=1.63s p(90)=0s       p(95)=565.84µs
     http_req_duration..............: avg=784.98ms min=3.32ms  med=654.44ms max=3.91s p(90)=1.6s     p(95)=1.97s   
       { expected_response:true }...: avg=784.98ms min=3.32ms  med=654.44ms max=3.91s p(90)=1.6s     p(95)=1.97s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5461 
     http_req_receiving.............: avg=244.3ms  min=35.06µs med=93.78µs  max=3.61s p(90)=1.03s    p(95)=1.34s   
     http_req_sending...............: avg=12.55ms  min=8.54µs  med=16.66µs  max=2.5s  p(90)=148.97µs p(95)=10.2ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=528.12ms min=3.23ms  med=492.22ms max=3.01s p(90)=932.27ms p(95)=1.25s   
     http_reqs......................: 5461    176.119981/s
     iteration_duration.............: avg=1.64s    min=24.17ms med=1.39s    max=7.35s p(90)=3.42s    p(95)=4.16s   
     iterations.....................: 5441    175.474971/s
     vus............................: 20      min=20       max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15831      ✗ 0    
     data_received..................: 466 MB  15 MB/s
     data_sent......................: 6.3 MB  205 kB/s
     http_req_blocked...............: avg=1.57ms   min=1.42µs  med=3.1µs    max=1.85s p(90)=4.82µs   p(95)=1.79ms
     http_req_connecting............: avg=1.4ms    min=0s      med=0s       max=1.85s p(90)=0s       p(95)=1.37ms
     http_req_duration..............: avg=942.35ms min=3.12ms  med=777.84ms max=6.66s p(90)=1.91s    p(95)=2.43s 
       { expected_response:true }...: avg=942.35ms min=3.12ms  med=777.84ms max=6.66s p(90)=1.91s    p(95)=2.43s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 5297 
     http_req_receiving.............: avg=336.16ms min=33.77µs med=87.85µs  max=5.55s p(90)=1.24s    p(95)=1.86s 
     http_req_sending...............: avg=15.3ms   min=7.92µs  med=14.28µs  max=2.43s p(90)=146.26µs p(95)=3.45ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=590.89ms min=3.04ms  med=567.22ms max=3.91s p(90)=1.1s     p(95)=1.2s  
     http_reqs......................: 5297    172.42897/s
     iteration_duration.............: avg=1.71s    min=18.52ms med=1.45s    max=9.53s p(90)=3.58s    p(95)=4.21s 
     iterations.....................: 5277    171.777927/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14787      ✗ 0    
     data_received..................: 434 MB  14 MB/s
     data_sent......................: 5.9 MB  190 kB/s
     http_req_blocked...............: avg=3.1ms    min=1.56µs  med=3.43µs   max=2.29s  p(90)=6.13µs   p(95)=3.18ms 
     http_req_connecting............: avg=2.24ms   min=0s      med=0s       max=1.56s  p(90)=0s       p(95)=912.6µs
     http_req_duration..............: avg=1.01s    min=6.97ms  med=817.59ms max=5.8s   p(90)=2.11s    p(95)=2.65s  
       { expected_response:true }...: avg=1.01s    min=6.97ms  med=817.59ms max=5.8s   p(90)=2.11s    p(95)=2.65s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 4949 
     http_req_receiving.............: avg=379.03ms min=33.37µs med=89.66µs  max=5.41s  p(90)=1.57s    p(95)=2.2s   
     http_req_sending...............: avg=23.04ms  min=7.78µs  med=15.54µs  max=3.77s  p(90)=316.61µs p(95)=4.59ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=610.36ms min=6.9ms   med=546.18ms max=2.99s  p(90)=1.15s    p(95)=1.31s  
     http_reqs......................: 4949    159.93008/s
     iteration_duration.............: avg=1.84s    min=36.21ms med=1.6s     max=11.06s p(90)=3.74s    p(95)=4.5s   
     iterations.....................: 4929    159.283768/s
     vus............................: 275     min=275      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8646      ✗ 0    
     data_received..................: 255 MB  7.7 MB/s
     data_sent......................: 3.4 MB  104 kB/s
     http_req_blocked...............: avg=753.62µs min=1.55µs   med=3.07µs   max=20.86ms p(90)=149.72µs p(95)=6.26ms  
     http_req_connecting............: avg=728.12µs min=0s       med=0s       max=20.58ms p(90)=112.23µs p(95)=5.84ms  
     http_req_duration..............: avg=3.23s    min=11.42ms  med=1.54s    max=32.74s  p(90)=2.14s    p(95)=21.25s  
       { expected_response:true }...: avg=3.23s    min=11.42ms  med=1.54s    max=32.74s  p(90)=2.14s    p(95)=21.25s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2902 
     http_req_receiving.............: avg=238.58µs min=42.96µs  med=100.46µs max=50.09ms p(90)=203.73µs p(95)=327.23µs
     http_req_sending...............: avg=176.7µs  min=9.08µs   med=15.66µs  max=48.31ms p(90)=105.56µs p(95)=584.42µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.23s    min=11.35ms  med=1.54s    max=32.74s  p(90)=2.14s    p(95)=21.25s  
     http_reqs......................: 2902    87.437338/s
     iteration_duration.............: avg=3.26s    min=392.54ms med=1.56s    max=32.75s  p(90)=2.16s    p(95)=21.86s  
     iterations.....................: 2882    86.834738/s
     vus............................: 25      min=25      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8721      ✗ 0    
     data_received..................: 257 MB  7.7 MB/s
     data_sent......................: 3.5 MB  104 kB/s
     http_req_blocked...............: avg=2.88ms  min=1.98µs   med=4.53µs   max=64.61ms  p(90)=1.25ms   p(95)=33.72ms
     http_req_connecting............: avg=2.78ms  min=0s       med=0s       max=60.18ms  p(90)=787.1µs  p(95)=32.36ms
     http_req_duration..............: avg=3.17s   min=15.53ms  med=2.9s     max=6.68s    p(90)=4.72s    p(95)=5.13s  
       { expected_response:true }...: avg=3.17s   min=15.53ms  med=2.9s     max=6.68s    p(90)=4.72s    p(95)=5.13s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2927 
     http_req_receiving.............: avg=69.46ms min=41.19µs  med=172.57µs max=1.79s    p(90)=110.02ms p(95)=632.5ms
     http_req_sending...............: avg=2.3ms   min=8.88µs   med=25.87µs  max=482.99ms p(90)=3.89ms   p(95)=12.55ms
     http_req_tls_handshaking.......: avg=0s      min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=3.1s    min=15.23ms  med=2.86s    max=6.68s    p(90)=4.68s    p(95)=5.12s  
     http_reqs......................: 2927    87.960503/s
     iteration_duration.............: avg=3.28s   min=166.74ms med=2.94s    max=6.7s     p(90)=4.99s    p(95)=5.28s  
     iterations.....................: 2907    87.359474/s
     vus............................: 43      min=43      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8616      ✗ 0    
     data_received..................: 254 MB  7.6 MB/s
     data_sent......................: 3.4 MB  103 kB/s
     http_req_blocked...............: avg=500.04µs min=1.92µs  med=3.87µs   max=24.13ms  p(90)=135.56µs p(95)=5.38ms
     http_req_connecting............: avg=479.6µs  min=0s      med=0s       max=13.56ms  p(90)=101.12µs p(95)=5.27ms
     http_req_duration..............: avg=3.25s    min=13.63ms med=1.71s    max=33s      p(90)=2.78s    p(95)=17.18s
       { expected_response:true }...: avg=3.25s    min=13.63ms med=1.71s    max=33s      p(90)=2.78s    p(95)=17.18s
     http_req_failed................: 0.00%   ✓ 0         ✗ 2892 
     http_req_receiving.............: avg=1.4ms    min=44.96µs med=104.32µs max=378.35ms p(90)=492.1µs  p(95)=1.57ms
     http_req_sending...............: avg=329.65µs min=9.51µs  med=21.74µs  max=46.87ms  p(90)=170.74µs p(95)=1.52ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=3.24s    min=13.49ms med=1.71s    max=33s      p(90)=2.78s    p(95)=17.18s
     http_reqs......................: 2892    86.409024/s
     iteration_duration.............: avg=3.3s     min=92.2ms  med=1.75s    max=33.01s   p(90)=2.86s    p(95)=17.36s
     iterations.....................: 2872    85.811451/s
     vus............................: 50      min=50      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7386      ✗ 0    
     data_received..................: 218 MB  6.8 MB/s
     data_sent......................: 2.9 MB  92 kB/s
     http_req_blocked...............: avg=701.6µs  min=1.76µs  med=3.94µs  max=14.23ms  p(90)=609.4µs  p(95)=6.44ms  
     http_req_connecting............: avg=678.27µs min=0s      med=0s      max=13.52ms  p(90)=504.47µs p(95)=6.29ms  
     http_req_duration..............: avg=3.69s    min=10.81ms med=3.71s   max=8.07s    p(90)=4.46s    p(95)=5.41s   
       { expected_response:true }...: avg=3.69s    min=10.81ms med=3.71s   max=8.07s    p(90)=4.46s    p(95)=5.41s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2482 
     http_req_receiving.............: avg=1.04ms   min=39.83µs med=101.3µs max=360.17ms p(90)=248.37µs p(95)=456.91µs
     http_req_sending...............: avg=181.83µs min=9.94µs  med=21.59µs max=19.98ms  p(90)=264.5µs  p(95)=998.83µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.69s    min=10.71ms med=3.71s   max=8.07s    p(90)=4.46s    p(95)=5.4s    
     http_reqs......................: 2482    77.744002/s
     iteration_duration.............: avg=3.75s    min=366.7ms med=3.73s   max=8.08s    p(90)=4.49s    p(95)=5.44s   
     iterations.....................: 2462    77.117539/s
     vus............................: 207     min=207     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: federation/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 175 5513 total, 0 failed avg: 1367ms, p95: 3445ms
grafbase 170 5330 total, 0 failed avg: 1271ms, p95: 2852ms
apollo-router 157 4936 total, 9 failed avg: 1504ms, p95: 3478ms ❌ 9 failed requests, 9 non-200 responses, 9 unexpected GraphQL errors
hive-gateway-bun 90 3113 total, 0 failed avg: 5026ms, p95: 8281ms
apollo-server 88 3083 total, 0 failed avg: 5200ms, p95: 33055ms
hive-gateway 75 2701 total, 0 failed avg: 5980ms, p95: 33707ms
mercurius 75 2493 total, 0 failed avg: 6269ms, p95: 10808ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16479      ✗ 0    
     data_received..................: 484 MB  15 MB/s
     data_sent......................: 6.5 MB  208 kB/s
     http_req_blocked...............: avg=3.53ms   min=1.56µs  med=4.14µs  max=3.56s  p(90)=23.59µs  p(95)=17.19ms
     http_req_connecting............: avg=3.44ms   min=0s      med=0s      max=3.56s  p(90)=0s       p(95)=16.61ms
     http_req_duration..............: avg=1.36s    min=3.22ms  med=1.13s   max=6.47s  p(90)=2.55s    p(95)=3.44s  
       { expected_response:true }...: avg=1.36s    min=3.22ms  med=1.13s   max=6.47s  p(90)=2.55s    p(95)=3.44s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5513 
     http_req_receiving.............: avg=362.76ms min=34.24µs med=96.28µs max=4.46s  p(90)=1.49s    p(95)=2.35s  
     http_req_sending...............: avg=26.69ms  min=8.79µs  med=20.47µs max=4.34s  p(90)=489.96µs p(95)=2.45ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=977.38ms min=3.08ms  med=933ms   max=4.01s  p(90)=1.7s     p(95)=1.89s  
     http_reqs......................: 5513    175.318358/s
     iteration_duration.............: avg=2.76s    min=27.35ms med=2.38s   max=14.21s p(90)=5.38s    p(95)=6.31s  
     iterations.....................: 5493    174.68234/s
     vus............................: 158     min=158      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15930      ✗ 0    
     data_received..................: 468 MB  15 MB/s
     data_sent......................: 6.3 MB  202 kB/s
     http_req_blocked...............: avg=3.75ms   min=1.45µs  med=3.63µs   max=2.12s  p(90)=32.6µs p(95)=17.36ms
     http_req_connecting............: avg=2.83ms   min=0s      med=0s       max=1.55s  p(90)=0s     p(95)=16.94ms
     http_req_duration..............: avg=1.27s    min=3.19ms  med=1.08s    max=7.03s  p(90)=2.53s  p(95)=2.85s  
       { expected_response:true }...: avg=1.27s    min=3.19ms  med=1.08s    max=7.03s  p(90)=2.53s  p(95)=2.85s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5330 
     http_req_receiving.............: avg=238.42ms min=32.96µs med=75.71µs  max=3.47s  p(90)=1.15s  p(95)=1.38s  
     http_req_sending...............: avg=23.08ms  min=7.65µs  med=17.16µs  max=4.39s  p(90)=1.09ms p(95)=9.97ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s     p(95)=0s     
     http_req_waiting...............: avg=1s       min=3.12ms  med=923.66ms max=3.44s  p(90)=1.79s  p(95)=2.23s  
     http_reqs......................: 5330    170.113456/s
     iteration_duration.............: avg=2.78s    min=29ms    med=2.52s    max=13.29s p(90)=4.92s  p(95)=5.71s  
     iterations.....................: 5310    169.475132/s
     vus............................: 163     min=163      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  99% — ✓ 4907 / ✗ 9
     ✗ no graphql errors
      ↳  99% — ✓ 4907 / ✗ 9
     ✓ valid response structure

     █ setup

     checks.........................: 99.87% ✓ 14721      ✗ 18   
     data_received..................: 432 MB 14 MB/s
     data_sent......................: 5.9 MB 187 kB/s
     http_req_blocked...............: avg=8.51ms   min=1.68µs  med=3.72µs  max=2.59s  p(90)=2.08ms   p(95)=18.23ms
     http_req_connecting............: avg=7.36ms   min=0s      med=0s      max=2.48s  p(90)=1.05ms   p(95)=16.98ms
     http_req_duration..............: avg=1.5s     min=7.09ms  med=1.24s   max=10.21s p(90)=2.81s    p(95)=3.47s  
       { expected_response:true }...: avg=1.5s     min=7.09ms  med=1.24s   max=10.21s p(90)=2.81s    p(95)=3.47s  
     http_req_failed................: 0.18%  ✓ 9          ✗ 4927 
     http_req_receiving.............: avg=332.78ms min=0s      med=83.79µs max=6.05s  p(90)=1.51s    p(95)=2.09s  
     http_req_sending...............: avg=23.02ms  min=8.16µs  med=17.72µs max=2.84s  p(90)=966.35µs p(95)=9.46ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=1.14s    min=6.98ms  med=1.07s   max=3.55s  p(90)=2.01s    p(95)=2.28s  
     http_reqs......................: 4936   157.211728/s
     iteration_duration.............: avg=3.09s    min=45.61ms med=2.74s   max=15.39s p(90)=5.67s    p(95)=6.78s  
     iterations.....................: 4916   156.574728/s
     vus............................: 200    min=200      max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9279      ✗ 0    
     data_received..................: 273 MB  7.9 MB/s
     data_sent......................: 3.7 MB  107 kB/s
     http_req_blocked...............: avg=1.38ms  min=1.89µs   med=3.78µs  max=64.67ms  p(90)=4.14ms   p(95)=10.94ms 
     http_req_connecting............: avg=1.32ms  min=0s       med=0s      max=31.39ms  p(90)=3.89ms   p(95)=10.83ms 
     http_req_duration..............: avg=5.02s   min=16.04ms  med=4.67s   max=12.34s   p(90)=7.6s     p(95)=8.28s   
       { expected_response:true }...: avg=5.02s   min=16.04ms  med=4.67s   max=12.34s   p(90)=7.6s     p(95)=8.28s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 3113 
     http_req_receiving.............: avg=97.78ms min=37.18µs  med=98.8µs  max=3.74s    p(90)=156.51ms p(95)=667.68ms
     http_req_sending...............: avg=1.88ms  min=9.21µs   med=19.14µs max=761.58ms p(90)=1.06ms   p(95)=3.9ms   
     http_req_tls_handshaking.......: avg=0s      min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=4.92s   min=15.85ms  med=4.57s   max=12.34s   p(90)=7.49s    p(95)=8.24s   
     http_reqs......................: 3113    90.37709/s
     iteration_duration.............: avg=5.19s   min=213.82ms med=4.82s   max=12.58s   p(90)=7.75s    p(95)=8.45s   
     iterations.....................: 3093    89.796447/s
     vus............................: 95      min=95      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9189      ✗ 0    
     data_received..................: 271 MB  7.7 MB/s
     data_sent......................: 3.7 MB  105 kB/s
     http_req_blocked...............: avg=4.65ms   min=1.44µs   med=2.99µs   max=69.71ms  p(90)=27.1ms   p(95)=35.32ms 
     http_req_connecting............: avg=4.55ms   min=0s       med=0s       max=59.39ms  p(90)=26.84ms  p(95)=35.21ms 
     http_req_duration..............: avg=5.19s    min=10.76ms  med=1.64s    max=34.52s   p(90)=31.46s   p(95)=33.05s  
       { expected_response:true }...: avg=5.19s    min=10.76ms  med=1.64s    max=34.52s   p(90)=31.46s   p(95)=33.05s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 3083 
     http_req_receiving.............: avg=671.22µs min=42.1µs   med=102.14µs max=208.92ms p(90)=244.52µs p(95)=528.42µs
     http_req_sending...............: avg=657.68µs min=8.13µs   med=15.73µs  max=70.66ms  p(90)=853.16µs p(95)=5.66ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=5.19s    min=10.66ms  med=1.63s    max=34.52s   p(90)=31.46s   p(95)=33.05s  
     http_reqs......................: 3083    88.14989/s
     iteration_duration.............: avg=5.25s    min=206.84ms med=1.67s    max=34.58s   p(90)=31.52s   p(95)=33.12s  
     iterations.....................: 3063    87.578046/s
     vus............................: 5       min=5       max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8043      ✗ 0    
     data_received..................: 237 MB  6.6 MB/s
     data_sent......................: 3.2 MB  89 kB/s
     http_req_blocked...............: avg=2.65ms   min=2.44µs   med=5.42µs   max=40.08ms  p(90)=15.14ms  p(95)=23.28ms
     http_req_connecting............: avg=2.58ms   min=0s       med=0s       max=40.04ms  p(90)=14.85ms  p(95)=22.98ms
     http_req_duration..............: avg=5.98s    min=16.96ms  med=2.46s    max=35.35s   p(90)=25.43s   p(95)=33.7s  
       { expected_response:true }...: avg=5.98s    min=16.96ms  med=2.46s    max=35.35s   p(90)=25.43s   p(95)=33.7s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2701 
     http_req_receiving.............: avg=2.85ms   min=46.4µs   med=119.93µs max=303.94ms p(90)=817.69µs p(95)=3.75ms 
     http_req_sending...............: avg=456.41µs min=10.67µs  med=30.97µs  max=62.25ms  p(90)=889.04µs p(95)=1.68ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=5.97s    min=16.84ms  med=2.45s    max=35.35s   p(90)=25.43s   p(95)=33.7s  
     http_reqs......................: 2701    75.165439/s
     iteration_duration.............: avg=6.07s    min=274.19ms med=2.51s    max=35.36s   p(90)=25.84s   p(95)=33.75s 
     iterations.....................: 2681    74.608864/s
     vus............................: 2       min=2       max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7419      ✗ 0    
     data_received..................: 219 MB  6.7 MB/s
     data_sent......................: 3.0 MB  90 kB/s
     http_req_blocked...............: avg=2.27ms   min=1.6µs    med=3.93µs  max=40.37ms p(90)=13ms     p(95)=18.88ms 
     http_req_connecting............: avg=2.21ms   min=0s       med=0s      max=28.4ms  p(90)=10.84ms  p(95)=18.62ms 
     http_req_duration..............: avg=6.26s    min=11.46ms  med=6.21s   max=12.63s  p(90)=7.74s    p(95)=10.8s   
       { expected_response:true }...: avg=6.26s    min=11.46ms  med=6.21s   max=12.63s  p(90)=7.74s    p(95)=10.8s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2493 
     http_req_receiving.............: avg=56.57ms  min=42.91µs  med=103.9µs max=1.83s   p(90)=932.87µs p(95)=661.84ms
     http_req_sending...............: avg=790.52µs min=9.57µs   med=22.59µs max=13.38ms p(90)=1.34ms   p(95)=8.21ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=6.21s    min=11.37ms  med=6.21s   max=12.63s  p(90)=7.74s    p(95)=10.79s  
     http_reqs......................: 2493    75.803982/s
     iteration_duration.............: avg=6.37s    min=418.16ms med=6.25s   max=12.65s  p(90)=7.76s    p(95)=10.82s  
     iterations.....................: 2473    75.195847/s
     vus............................: 299     min=299     max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: federation/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 2000 concurrent VUs over 60s

Comparison

Comparison

Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 4892ms 181 12707 total, 0 failed avg: 2097ms, p95: 4892ms, max: 8859ms, med: 1859ms
grafbase 6141ms 169 11952 total, 0 failed avg: 2834ms, p95: 6141ms, max: 16195ms, med: 2509ms
apollo-router 7117ms 162 11398 total, 496 failed avg: 2797ms, p95: 7118ms, max: 14714ms, med: 2526ms ❌ 496 failed requests, 496 non-200 responses, 496 unexpected GraphQL errors
hive-gateway-bun 28577ms 89 7311 total, 0 failed avg: 11775ms, p95: 28577ms, max: 36521ms, med: 10626ms
mercurius 48674ms 42 3989 total, 610 failed avg: 18557ms, p95: 48674ms, max: 55319ms, med: 14386ms ❌ 610 failed requests, 602 non-200 responses, 602 unexpected GraphQL errors
hive-gateway 51740ms 86 7566 total, 0 failed avg: 12224ms, p95: 51740ms, max: 58291ms, med: 3422ms
apollo-server 60000ms 83 7703 total, 526 failed avg: 11989ms, p95: 60000ms, max: 60041ms, med: 2229ms ❌ 526 failed requests, 526 non-200 responses, 526 unexpected GraphQL errors
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 38061      ✗ 0     
     data_received..................: 1.1 GB  16 MB/s
     data_sent......................: 15 MB   215 kB/s
     http_req_blocked...............: avg=221.52ms min=1.51µs  med=3.29µs  max=7.06s  p(90)=871.22ms p(95)=1.65s   
     http_req_connecting............: avg=218.72ms min=0s      med=0s      max=7.06s  p(90)=862.62ms p(95)=1.65s   
     http_req_duration..............: avg=2.09s    min=3.15ms  med=1.85s   max=8.85s  p(90)=4.24s    p(95)=4.89s   
       { expected_response:true }...: avg=2.09s    min=3.15ms  med=1.85s   max=8.85s  p(90)=4.24s    p(95)=4.89s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 12707 
     http_req_receiving.............: avg=142.53ms min=32.33µs med=69.42µs max=5.65s  p(90)=170.53ms p(95)=896.93ms
     http_req_sending...............: avg=105.75ms min=8µs     med=15.2µs  max=6.85s  p(90)=223.78ms p(95)=751.04ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.84s    min=3.02ms  med=1.56s   max=8.72s  p(90)=3.85s    p(95)=4.73s   
     http_reqs......................: 12707   181.300968/s
     iteration_duration.............: avg=5.47s    min=8.77ms  med=4.66s   max=24.57s p(90)=11.36s   p(95)=13.35s  
     iterations.....................: 12687   181.015612/s
     vus............................: 4       min=4        max=1953
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 35796      ✗ 0     
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 14 MB   201 kB/s
     http_req_blocked...............: avg=380.65ms min=1.39µs  med=3.67µs  max=9.35s  p(90)=1.46s    p(95)=3.51s   
     http_req_connecting............: avg=377.12ms min=0s      med=0s      max=9.35s  p(90)=1.45s    p(95)=3.47s   
     http_req_duration..............: avg=2.83s    min=2.99ms  med=2.5s    max=16.19s p(90)=5.31s    p(95)=6.14s   
       { expected_response:true }...: avg=2.83s    min=2.99ms  med=2.5s    max=16.19s p(90)=5.31s    p(95)=6.14s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 11952 
     http_req_receiving.............: avg=282.19ms min=32.41µs med=80.55µs max=11.03s p(90)=954.43ms p(95)=2.05s   
     http_req_sending...............: avg=123.91ms min=8.06µs  med=17.64µs max=10.01s p(90)=341.28ms p(95)=864.99ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.42s    min=2.93ms  med=2.12s   max=13.91s p(90)=4.8s     p(95)=5.24s   
     http_reqs......................: 11952   169.130816/s
     iteration_duration.............: avg=6.06s    min=16.42ms med=5.17s   max=29.99s p(90)=12.25s   p(95)=14.93s  
     iterations.....................: 11932   168.847799/s
     vus............................: 448     min=70       max=1906
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  95% — ✓ 10882 / ✗ 496
     ✗ no graphql errors
      ↳  95% — ✓ 10882 / ✗ 496
     ✓ valid response structure

     █ setup

     checks.........................: 97.05% ✓ 32646      ✗ 992   
     data_received..................: 957 MB 14 MB/s
     data_sent......................: 14 MB  193 kB/s
     http_req_blocked...............: avg=491.53ms min=1.54µs  med=4.44µs  max=11.97s p(90)=2.44s    p(95)=3.53s
     http_req_connecting............: avg=475.02ms min=0s      med=0s      max=9.57s  p(90)=2.41s    p(95)=3.4s 
     http_req_duration..............: avg=2.79s    min=6.95ms  med=2.52s   max=14.71s p(90)=5.41s    p(95)=7.11s
       { expected_response:true }...: avg=2.78s    min=6.95ms  med=2.52s   max=14.71s p(90)=5.41s    p(95)=7.09s
     http_req_failed................: 4.35%  ✓ 496        ✗ 10902 
     http_req_receiving.............: avg=508.76ms min=0s      med=96.54µs max=10.61s p(90)=1.98s    p(95)=3.16s
     http_req_sending...............: avg=269.94ms min=8.38µs  med=24.61µs max=11.62s p(90)=629.43ms p(95)=1.33s
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s   
     http_req_waiting...............: avg=2.01s    min=6.86ms  med=1.55s   max=9.56s  p(90)=4.15s    p(95)=4.6s 
     http_reqs......................: 11398  162.422476/s
     iteration_duration.............: avg=6.22s    min=13.62ms med=5.69s   max=27.44s p(90)=12.14s   p(95)=14.3s
     iterations.....................: 11378  162.137474/s
     vus............................: 221    min=64       max=1983
     vus_max........................: 2000   min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 21873     ✗ 0     
     data_received..................: 642 MB  7.9 MB/s
     data_sent......................: 8.7 MB  106 kB/s
     http_req_blocked...............: avg=24.09ms  min=2.04µs   med=4.69µs   max=1.68s  p(90)=37.3ms  p(95)=167.81ms
     http_req_connecting............: avg=23.66ms  min=0s       med=0s       max=1.68s  p(90)=36.52ms p(95)=165.7ms 
     http_req_duration..............: avg=11.77s   min=15.64ms  med=10.62s   max=36.52s p(90)=25.12s  p(95)=28.57s  
       { expected_response:true }...: avg=11.77s   min=15.64ms  med=10.62s   max=36.52s p(90)=25.12s  p(95)=28.57s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 7311  
     http_req_receiving.............: avg=134.99ms min=40.3µs   med=110.81µs max=8.32s  p(90)=10.14ms p(95)=439.81ms
     http_req_sending...............: avg=14.44ms  min=9.4µs    med=27.53µs  max=1.28s  p(90)=20.36ms p(95)=73.6ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s     p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=11.62s   min=15.44ms  med=10.55s   max=36.52s p(90)=25.07s  p(95)=28.49s  
     http_reqs......................: 7311    89.561294/s
     iteration_duration.............: avg=12.07s   min=160.22ms med=10.83s   max=37.78s p(90)=25.32s  p(95)=28.9s   
     iterations.....................: 7291    89.31629/s
     vus............................: 117     min=52      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✗ response code was 200
      ↳  84% — ✓ 3359 / ✗ 602
     ✗ no graphql errors
      ↳  84% — ✓ 3359 / ✗ 602
     ✓ valid response structure

     █ setup

     checks.........................: 89.32% ✓ 10077     ✗ 1204  
     data_received..................: 297 MB 3.2 MB/s
     data_sent......................: 6.0 MB 64 kB/s
     http_req_blocked...............: avg=213.71µs min=1.58µs  med=4.45µs   max=12.19ms p(90)=474.46µs p(95)=727.13µs
     http_req_connecting............: avg=179.35µs min=0s      med=0s       max=8.97ms  p(90)=396.88µs p(95)=582.69µs
     http_req_duration..............: avg=18.55s   min=12.38ms med=14.38s   max=55.31s  p(90)=43.36s   p(95)=48.67s  
       { expected_response:true }...: avg=14.05s   min=12.38ms med=11.6s    max=46.41s  p(90)=28.81s   p(95)=34.43s  
     http_req_failed................: 15.29% ✓ 610       ✗ 3379  
     http_req_receiving.............: avg=174.48µs min=0s      med=101.74µs max=7.74ms  p(90)=260.36µs p(95)=453.54µs
     http_req_sending...............: avg=72.59µs  min=9.27µs  med=25.3µs   max=23.74ms p(90)=64.99µs  p(95)=98.02µs 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=18.55s   min=12.3ms  med=14.38s   max=55.31s  p(90)=43.36s   p(95)=48.67s  
     http_reqs......................: 3989   42.500163/s
     iteration_duration.............: avg=18.64s   min=219.5ms med=14.42s   max=55.43s  p(90)=43.48s   p(95)=48.79s  
     iterations.....................: 3961   42.201841/s
     vus............................: 502    min=59      max=2000
     vus_max........................: 2000   min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 22638     ✗ 0     
     data_received..................: 665 MB  7.6 MB/s
     data_sent......................: 9.0 MB  103 kB/s
     http_req_blocked...............: avg=5.29ms min=1.84µs  med=4.98µs   max=259.89ms p(90)=7.94ms   p(95)=38.44ms
     http_req_connecting............: avg=5.21ms min=0s      med=0s       max=259.8ms  p(90)=7.73ms   p(95)=38.18ms
     http_req_duration..............: avg=12.22s min=15.5ms  med=3.42s    max=58.29s   p(90)=44.69s   p(95)=51.74s 
       { expected_response:true }...: avg=12.22s min=15.5ms  med=3.42s    max=58.29s   p(90)=44.69s   p(95)=51.74s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 7566  
     http_req_receiving.............: avg=2.24ms min=43.1µs  med=105.77µs max=439.8ms  p(90)=909.19µs p(95)=3.38ms 
     http_req_sending...............: avg=2.48ms min=9.76µs  med=29.05µs  max=178.36ms p(90)=1.45ms   p(95)=16.37ms
     http_req_tls_handshaking.......: avg=0s     min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=12.21s min=15.38ms med=3.41s    max=58.29s   p(90)=44.62s   p(95)=51.74s 
     http_reqs......................: 7566    86.616244/s
     iteration_duration.............: avg=12.33s min=91.07ms med=3.48s    max=58.46s   p(90)=44.96s   p(95)=51.99s 
     iterations.....................: 7546    86.387283/s
     vus............................: 67      min=59      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✗ response code was 200
      ↳  93% — ✓ 7157 / ✗ 526
     ✗ no graphql errors
      ↳  93% — ✓ 7157 / ✗ 526
     ✓ valid response structure

     █ setup

     checks.........................: 95.32% ✓ 21471     ✗ 1052  
     data_received..................: 631 MB 6.8 MB/s
     data_sent......................: 9.2 MB 99 kB/s
     http_req_blocked...............: avg=666.6µs  min=1.55µs  med=3.68µs   max=109.33ms p(90)=375.69µs p(95)=671.95µs
     http_req_connecting............: avg=637.7µs  min=0s      med=0s       max=109.26ms p(90)=300.6µs  p(95)=547.76µs
     http_req_duration..............: avg=11.98s   min=10.34ms med=2.22s    max=1m0s     p(90)=55.68s   p(95)=1m0s    
       { expected_response:true }...: avg=8.47s    min=10.34ms med=2.12s    max=59.98s   p(90)=36.88s   p(95)=44.75s  
     http_req_failed................: 6.82%  ✓ 526       ✗ 7177  
     http_req_receiving.............: avg=245.91µs min=0s      med=109.85µs max=134.18ms p(90)=227.16µs p(95)=361.13µs
     http_req_sending...............: avg=252.34µs min=8.75µs  med=20.36µs  max=78.48ms  p(90)=67.37µs  p(95)=136.2µs 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=11.98s   min=10.19ms med=2.22s    max=1m0s     p(90)=55.68s   p(95)=59.99s  
     http_reqs......................: 7703   83.113383/s
     iteration_duration.............: avg=12.03s   min=60.95ms med=2.24s    max=1m0s     p(90)=55.72s   p(95)=1m0s    
     iterations.....................: 7683   82.897588/s
     vus............................: 65     min=62      max=2000
     vus_max........................: 2000   min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

@ardatan ardatan merged commit 30f320b into main May 28, 2025
34 checks passed
@ardatan ardatan deleted the renovate/ghcr.io-grafbase-gateway-0.x branch May 28, 2025 22:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant