Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update ghcr.io/graphql-hive/gateway Docker tag to v1.7.8 #588

Merged
merged 1 commit into from
Jan 8, 2025

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Jan 6, 2025

This PR contains the following updates:

Package Update Change
ghcr.io/graphql-hive/gateway patch 1.7.6 -> 1.7.8
ghcr.io/graphql-hive/gateway patch 1.7.6-bun -> 1.7.8-bun

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about these updates again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

Copy link

github-actions bot commented Jan 6, 2025

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 170 5306 total, 0 failed avg: 959ms, p95: 2677ms
apollo-router 169 5292 total, 0 failed avg: 960ms, p95: 2602ms
cosmo 167 5182 total, 0 failed avg: 789ms, p95: 2358ms
hive-gateway-bun 90 3001 total, 0 failed avg: 3066ms, p95: 5319ms
hive-gateway 81 2701 total, 0 failed avg: 3482ms, p95: 21564ms
apollo-server 76 2576 total, 0 failed avg: 3660ms, p95: 31585ms
mercurius 62 2043 total, 0 failed avg: 4518ms, p95: 7892ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15858      ✗ 0    
     data_received..................: 466 MB  15 MB/s
     data_sent......................: 6.3 MB  202 kB/s
     http_req_blocked...............: avg=2.82ms   min=1.45µs  med=3.3µs    max=3.02s    p(90)=5.44µs   p(95)=7.43ms
     http_req_connecting............: avg=1.88ms   min=0s      med=0s       max=653.33ms p(90)=0s       p(95)=6.4ms 
     http_req_duration..............: avg=959.3ms  min=3.72ms  med=687.23ms max=7.07s    p(90)=2.14s    p(95)=2.67s 
       { expected_response:true }...: avg=959.3ms  min=3.72ms  med=687.23ms max=7.07s    p(90)=2.14s    p(95)=2.67s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 5306 
     http_req_receiving.............: avg=464.44ms min=33.92µs med=110.06µs max=5.07s    p(90)=1.62s    p(95)=2.06s 
     http_req_sending...............: avg=17.35ms  min=8.36µs  med=14.88µs  max=3.61s    p(90)=142.52µs p(95)=5.44ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=477.5ms  min=3.63ms  med=406.91ms max=2.7s     p(90)=957.57ms p(95)=1.21s 
     http_reqs......................: 5306    170.385862/s
     iteration_duration.............: avg=1.72s    min=20.51ms med=1.33s    max=13.84s   p(90)=3.74s    p(95)=4.55s 
     iterations.....................: 5286    169.743623/s
     vus............................: 129     min=129      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15816      ✗ 0    
     data_received..................: 464 MB  15 MB/s
     data_sent......................: 6.3 MB  202 kB/s
     http_req_blocked...............: avg=875.64µs min=1.49µs  med=3.4µs    max=919.34ms p(90)=5.85µs   p(95)=1.31ms  
     http_req_connecting............: avg=727.21µs min=0s      med=0s       max=919.28ms p(90)=0s       p(95)=677.05µs
     http_req_duration..............: avg=959.99ms min=6.61ms  med=640.8ms  max=7.17s    p(90)=2.21s    p(95)=2.6s    
       { expected_response:true }...: avg=959.99ms min=6.61ms  med=640.8ms  max=7.17s    p(90)=2.21s    p(95)=2.6s    
     http_req_failed................: 0.00%   ✓ 0          ✗ 5292 
     http_req_receiving.............: avg=451.82ms min=35.68µs med=132.1µs  max=7.08s    p(90)=1.7s     p(95)=2.03s   
     http_req_sending...............: avg=18.17ms  min=8.23µs  med=15.7µs   max=3.22s    p(90)=175.47µs p(95)=2.14ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=489.99ms min=6.55ms  med=448.41ms max=1.8s     p(90)=905.84ms p(95)=1.03s   
     http_reqs......................: 5292    169.834878/s
     iteration_duration.............: avg=1.73s    min=35.51ms med=1.41s    max=12.77s   p(90)=3.65s    p(95)=4.66s   
     iterations.....................: 5272    169.193023/s
     vus............................: 96      min=96       max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15486      ✗ 0    
     data_received..................: 455 MB  15 MB/s
     data_sent......................: 6.2 MB  199 kB/s
     http_req_blocked...............: avg=2.59ms   min=1.6µs   med=3.6µs    max=2.58s p(90)=6.71µs   p(95)=1.06ms  
     http_req_connecting............: avg=1.7ms    min=0s      med=0s       max=1.49s p(90)=0s       p(95)=844.85µs
     http_req_duration..............: avg=789.42ms min=3.98ms  med=501.05ms max=6.44s p(90)=1.95s    p(95)=2.35s   
       { expected_response:true }...: avg=789.42ms min=3.98ms  med=501.05ms max=6.44s p(90)=1.95s    p(95)=2.35s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5182 
     http_req_receiving.............: avg=358.85ms min=34.98µs med=99.79µs  max=5.65s p(90)=1.33s    p(95)=1.79s   
     http_req_sending...............: avg=27.63ms  min=8.09µs  med=16.12µs  max=3.38s p(90)=526.41µs p(95)=11.68ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=402.92ms min=3.87ms  med=346.89ms max=1.78s p(90)=791.66ms p(95)=940.52ms
     http_reqs......................: 5182    167.288458/s
     iteration_duration.............: avg=1.76s    min=19.66ms med=1.34s    max=9.24s p(90)=4.02s    p(95)=4.98s   
     iterations.....................: 5162    166.642806/s
     vus............................: 1       min=1        max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8943      ✗ 0    
     data_received..................: 263 MB  8.0 MB/s
     data_sent......................: 3.6 MB  108 kB/s
     http_req_blocked...............: avg=1.11ms min=1.65µs   med=4.02µs   max=38.38ms  p(90)=168.06µs p(95)=6.72ms  
     http_req_connecting............: avg=1.08ms min=0s       med=0s       max=38.35ms  p(90)=71.46µs  p(95)=6.38ms  
     http_req_duration..............: avg=3.06s  min=14.64ms  med=2.84s    max=9.14s    p(90)=4.72s    p(95)=5.31s   
       { expected_response:true }...: avg=3.06s  min=14.64ms  med=2.84s    max=9.14s    p(90)=4.72s    p(95)=5.31s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 3001 
     http_req_receiving.............: avg=45.6ms min=36.87µs  med=103.19µs max=2.39s    p(90)=37.37ms  p(95)=333.62ms
     http_req_sending...............: avg=1.47ms min=8.99µs   med=21.3µs   max=870.31ms p(90)=317.98µs p(95)=698.04µs
     http_req_tls_handshaking.......: avg=0s     min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.01s  min=14.47ms  med=2.78s    max=8.93s    p(90)=4.66s    p(95)=5.31s   
     http_reqs......................: 3001    90.833846/s
     iteration_duration.............: avg=3.16s  min=146.02ms med=2.9s     max=9.15s    p(90)=4.82s    p(95)=5.46s   
     iterations.....................: 2981    90.228489/s
     vus............................: 13      min=13      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8043      ✗ 0    
     data_received..................: 237 MB  7.1 MB/s
     data_sent......................: 3.2 MB  96 kB/s
     http_req_blocked...............: avg=799.07µs min=1.6µs    med=3.98µs   max=40.01ms  p(90)=758.38µs p(95)=7.18ms 
     http_req_connecting............: avg=758.4µs  min=0s       med=0s       max=27.5ms   p(90)=512.12µs p(95)=7.04ms 
     http_req_duration..............: avg=3.48s    min=12.97ms  med=1.73s    max=32.84s   p(90)=3.08s    p(95)=21.56s 
       { expected_response:true }...: avg=3.48s    min=12.97ms  med=1.73s    max=32.84s   p(90)=3.08s    p(95)=21.56s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 2701 
     http_req_receiving.............: avg=577.26µs min=43.42µs  med=105.93µs max=136.35ms p(90)=339.34µs p(95)=602.2µs
     http_req_sending...............: avg=332.38µs min=8.15µs   med=21.6µs   max=23.72ms  p(90)=518.62µs p(95)=1.39ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=3.48s    min=12.89ms  med=1.73s    max=32.84s   p(90)=3.08s    p(95)=21.55s 
     http_reqs......................: 2701    81.000381/s
     iteration_duration.............: avg=3.52s    min=171.15ms med=1.75s    max=32.87s   p(90)=3.1s     p(95)=21.64s 
     iterations.....................: 2681    80.4006/s
     vus............................: 32      min=32      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7668      ✗ 0    
     data_received..................: 226 MB  6.7 MB/s
     data_sent......................: 3.1 MB  91 kB/s
     http_req_blocked...............: avg=719.16µs min=1.54µs   med=3.57µs   max=33.03ms  p(90)=1.09ms   p(95)=6.07ms  
     http_req_connecting............: avg=706.03µs min=0s       med=0s       max=32.93ms  p(90)=939.18µs p(95)=5.9ms   
     http_req_duration..............: avg=3.66s    min=12.58ms  med=1.48s    max=33.15s   p(90)=2.94s    p(95)=31.58s  
       { expected_response:true }...: avg=3.66s    min=12.58ms  med=1.48s    max=33.15s   p(90)=2.94s    p(95)=31.58s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2576 
     http_req_receiving.............: avg=393.78µs min=48.83µs  med=120.39µs max=323.22ms p(90)=183.13µs p(95)=216.17µs
     http_req_sending...............: avg=744.62µs min=9.07µs   med=18.4µs   max=39.68ms  p(90)=180.83µs p(95)=1.28ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.65s    min=12.45ms  med=1.48s    max=33.14s   p(90)=2.94s    p(95)=31.58s  
     http_reqs......................: 2576    76.434273/s
     iteration_duration.............: avg=3.7s     min=206.97ms med=1.49s    max=33.16s   p(90)=3.29s    p(95)=31.6s   
     iterations.....................: 2556    75.840839/s
     vus............................: 69      min=69      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 6069      ✗ 0    
     data_received..................: 179 MB  5.5 MB/s
     data_sent......................: 2.4 MB  75 kB/s
     http_req_blocked...............: avg=5.36ms   min=2µs      med=4.71µs   max=67.11ms  p(90)=33.2ms  p(95)=44.39ms
     http_req_connecting............: avg=5.28ms   min=0s       med=0s       max=67.09ms  p(90)=33.04ms p(95)=44.23ms
     http_req_duration..............: avg=4.51s    min=16.29ms  med=4.56s    max=10.31s   p(90)=5.42s   p(95)=7.89s  
       { expected_response:true }...: avg=4.51s    min=16.29ms  med=4.56s    max=10.31s   p(90)=5.42s   p(95)=7.89s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2043 
     http_req_receiving.............: avg=13.04ms  min=43.1µs   med=119.74µs max=595.49ms p(90)=249.6µs p(95)=1.04ms 
     http_req_sending...............: avg=566.15µs min=9.55µs   med=28.6µs   max=16.99ms  p(90)=1.02ms  p(95)=2.22ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=4.5s     min=16.17ms  med=4.56s    max=10.3s    p(90)=5.42s   p(95)=7.89s  
     http_reqs......................: 2043    62.978756/s
     iteration_duration.............: avg=4.59s    min=148.23ms med=4.59s    max=10.36s   p(90)=5.45s   p(95)=7.93s  
     iterations.....................: 2023    62.362224/s
     vus............................: 139     min=139     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Jan 6, 2025

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 182 5699 total, 0 failed avg: 1240ms, p95: 3535ms
apollo-router 158 5012 total, 0 failed avg: 1645ms, p95: 4972ms
grafbase 155 4907 total, 0 failed avg: 1648ms, p95: 4587ms
hive-gateway-bun 97 3377 total, 0 failed avg: 4636ms, p95: 7592ms
hive-gateway 80 2827 total, 0 failed avg: 5681ms, p95: 33133ms
apollo-server 77 2808 total, 0 failed avg: 5849ms, p95: 34074ms
mercurius 64 2137 total, 0 failed avg: 7295ms, p95: 13393ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 17037      ✗ 0    
     data_received..................: 500 MB  16 MB/s
     data_sent......................: 6.8 MB  216 kB/s
     http_req_blocked...............: avg=2.09ms   min=1.52µs  med=3.79µs   max=2.34s  p(90)=13.46µs  p(95)=8.4ms 
     http_req_connecting............: avg=1.78ms   min=0s      med=0s       max=2.34s  p(90)=0s       p(95)=7.95ms
     http_req_duration..............: avg=1.24s    min=3.79ms  med=890.58ms max=7.62s  p(90)=2.93s    p(95)=3.53s 
       { expected_response:true }...: avg=1.24s    min=3.79ms  med=890.58ms max=7.62s  p(90)=2.93s    p(95)=3.53s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 5699 
     http_req_receiving.............: avg=602.3ms  min=32.88µs med=358.25µs max=6.85s  p(90)=2.19s    p(95)=2.92s 
     http_req_sending...............: avg=24.36ms  min=7.55µs  med=16.95µs  max=7.51s  p(90)=538.65µs p(95)=1.55ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=613.63ms min=3.65ms  med=571.87ms max=2.05s  p(90)=1.14s    p(95)=1.31s 
     http_reqs......................: 5699    182.214024/s
     iteration_duration.............: avg=2.66s    min=22.86ms med=2.23s    max=14.84s p(90)=5.74s    p(95)=7s    
     iterations.....................: 5679    181.574564/s
     vus............................: 147     min=147      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14976      ✗ 0    
     data_received..................: 440 MB  14 MB/s
     data_sent......................: 5.9 MB  188 kB/s
     http_req_blocked...............: avg=3.6ms    min=1.57µs  med=3.77µs   max=2.29s  p(90)=111.74µs p(95)=34.44ms
     http_req_connecting............: avg=3.23ms   min=0s      med=0s       max=2.29s  p(90)=70.1µs   p(95)=31.1ms 
     http_req_duration..............: avg=1.64s    min=7.37ms  med=1.18s    max=9.74s  p(90)=3.7s     p(95)=4.97s  
       { expected_response:true }...: avg=1.64s    min=7.37ms  med=1.18s    max=9.74s  p(90)=3.7s     p(95)=4.97s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5012 
     http_req_receiving.............: avg=744.25ms min=35.03µs med=111.57µs max=8.89s  p(90)=2.75s    p(95)=4.09s  
     http_req_sending...............: avg=25.92ms  min=7.7µs   med=19.09µs  max=4.94s  p(90)=4.82ms   p(95)=25.66ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=874.79ms min=7.25ms  med=737.49ms max=3.87s  p(90)=1.68s    p(95)=2.21s  
     http_reqs......................: 5012    158.564642/s
     iteration_duration.............: avg=3.05s    min=48.26ms med=2.52s    max=14.98s p(90)=6.73s    p(95)=8.05s  
     iterations.....................: 4992    157.931902/s
     vus............................: 270     min=270      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14661      ✗ 0    
     data_received..................: 431 MB  14 MB/s
     data_sent......................: 5.8 MB  185 kB/s
     http_req_blocked...............: avg=7.24ms   min=1.79µs  med=4.57µs   max=4.58s  p(90)=429.96µs p(95)=24.85ms
     http_req_connecting............: avg=6.13ms   min=0s      med=0s       max=4.58s  p(90)=234.22µs p(95)=22.59ms
     http_req_duration..............: avg=1.64s    min=3.54ms  med=1.17s    max=11.76s p(90)=4.4s     p(95)=4.58s  
       { expected_response:true }...: avg=1.64s    min=3.54ms  med=1.17s    max=11.76s p(90)=4.4s     p(95)=4.58s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 4907 
     http_req_receiving.............: avg=653.37ms min=33.84µs med=113.42µs max=10.63s p(90)=2.28s    p(95)=3.51s  
     http_req_sending...............: avg=48.88ms  min=8.02µs  med=25.3µs   max=6.58s  p(90)=12.86ms  p(95)=63.87ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=945.3ms  min=3.44ms  med=866.92ms max=3.67s  p(90)=1.92s    p(95)=2.17s  
     http_reqs......................: 4907    155.977996/s
     iteration_duration.............: avg=3.12s    min=24.18ms med=2.44s    max=16.76s p(90)=6.83s    p(95)=8.03s  
     iterations.....................: 4887    155.342259/s
     vus............................: 223     min=223      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 10071     ✗ 0    
     data_received..................: 296 MB  8.6 MB/s
     data_sent......................: 4.0 MB  116 kB/s
     http_req_blocked...............: avg=1.65ms  min=1.67µs  med=4.05µs   max=101.75ms p(90)=7.23ms   p(95)=12.04ms 
     http_req_connecting............: avg=1.54ms  min=0s      med=0s       max=86.15ms  p(90)=7.05ms   p(95)=11.82ms 
     http_req_duration..............: avg=4.63s   min=10.83ms med=4.34s    max=13.01s   p(90)=6.78s    p(95)=7.59s   
       { expected_response:true }...: avg=4.63s   min=10.83ms med=4.34s    max=13.01s   p(90)=6.78s    p(95)=7.59s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 3377 
     http_req_receiving.............: avg=99.93ms min=37.48µs med=114.83µs max=2.9s     p(90)=174.85ms p(95)=774.37ms
     http_req_sending...............: avg=3.49ms  min=9.21µs  med=20.23µs  max=1.88s    p(90)=372.32µs p(95)=827.31µs
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=4.53s   min=10.64ms med=4.24s    max=13.01s   p(90)=6.69s    p(95)=7.58s   
     http_reqs......................: 3377    97.899096/s
     iteration_duration.............: avg=4.79s   min=121.2ms med=4.52s    max=13.48s   p(90)=7.03s    p(95)=7.67s   
     iterations.....................: 3357    97.319296/s
     vus............................: 137     min=137     max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8421      ✗ 0    
     data_received..................: 248 MB  7.1 MB/s
     data_sent......................: 3.4 MB  96 kB/s
     http_req_blocked...............: avg=3.66ms   min=1.69µs   med=4.37µs   max=95.62ms  p(90)=14.65ms  p(95)=30.4ms 
     http_req_connecting............: avg=3.56ms   min=0s       med=0s       max=57.39ms  p(90)=14.23ms  p(95)=30.22ms
     http_req_duration..............: avg=5.68s    min=13.42ms  med=2.59s    max=34.58s   p(90)=18.56s   p(95)=33.13s 
       { expected_response:true }...: avg=5.68s    min=13.42ms  med=2.59s    max=34.58s   p(90)=18.56s   p(95)=33.13s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 2827 
     http_req_receiving.............: avg=1.24ms   min=44.69µs  med=105.93µs max=176.96ms p(90)=659.01µs p(95)=5.1ms  
     http_req_sending...............: avg=560.62µs min=9.86µs   med=23.93µs  max=54.88ms  p(90)=686.69µs p(95)=1.2ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=5.67s    min=13.32ms  med=2.58s    max=34.58s   p(90)=18.55s   p(95)=33.12s 
     http_reqs......................: 2827    80.472943/s
     iteration_duration.............: avg=5.75s    min=431.53ms med=2.63s    max=34.62s   p(90)=18.92s   p(95)=33.16s 
     iterations.....................: 2807    79.903626/s
     vus............................: 24      min=24      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8364      ✗ 0    
     data_received..................: 247 MB  6.8 MB/s
     data_sent......................: 3.3 MB  92 kB/s
     http_req_blocked...............: avg=3.65ms   min=1.46µs   med=2.91µs   max=51.19ms p(90)=17.66ms  p(95)=28.88ms 
     http_req_connecting............: avg=3.55ms   min=0s       med=0s       max=48.84ms p(90)=17.18ms  p(95)=28.7ms  
     http_req_duration..............: avg=5.84s    min=13.56ms  med=1.53s    max=35.77s  p(90)=32.47s   p(95)=34.07s  
       { expected_response:true }...: avg=5.84s    min=13.56ms  med=1.53s    max=35.77s  p(90)=32.47s   p(95)=34.07s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2808 
     http_req_receiving.............: avg=222.07µs min=42.37µs  med=109.35µs max=43.56ms p(90)=176.72µs p(95)=216.54µs
     http_req_sending...............: avg=296.67µs min=8.82µs   med=14.91µs  max=22.98ms p(90)=993.92µs p(95)=1.5ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=5.84s    min=13.47ms  med=1.53s    max=35.77s  p(90)=32.47s   p(95)=34.07s  
     http_reqs......................: 2808    77.247028/s
     iteration_duration.............: avg=5.9s     min=417.52ms med=1.55s    max=35.79s  p(90)=32.55s   p(95)=34.15s  
     iterations.....................: 2788    76.696835/s
     vus............................: 39      min=39      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 6351      ✗ 0    
     data_received..................: 188 MB  5.7 MB/s
     data_sent......................: 2.5 MB  77 kB/s
     http_req_blocked...............: avg=4.89ms   min=1.83µs   med=3.98µs   max=54.7ms   p(90)=31.07ms p(95)=35.22ms 
     http_req_connecting............: avg=4.81ms   min=0s       med=0s       max=51.37ms  p(90)=31.01ms p(95)=34.87ms 
     http_req_duration..............: avg=7.29s    min=13.16ms  med=7.89s    max=15.43s   p(90)=10.25s  p(95)=13.39s  
       { expected_response:true }...: avg=7.29s    min=13.16ms  med=7.89s    max=15.43s   p(90)=10.25s  p(95)=13.39s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2137 
     http_req_receiving.............: avg=5.54ms   min=38.61µs  med=110.36µs max=639.34ms p(90)=244µs   p(95)=405.15µs
     http_req_sending...............: avg=458.21µs min=8.69µs   med=23.81µs  max=15.7ms   p(90)=1.09ms  p(95)=1.97ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=7.28s    min=13.07ms  med=7.89s    max=15.43s   p(90)=10.24s  p(95)=13.38s  
     http_reqs......................: 2137    64.511686/s
     iteration_duration.............: avg=7.39s    min=580.26ms med=7.98s    max=15.44s   p(90)=10.39s  p(95)=13.42s  
     iterations.....................: 2117    63.907927/s
     vus............................: 2       min=2       max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Jan 6, 2025

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 181 5592 total, 0 failed avg: 774ms, p95: 2459ms
grafbase 174 5379 total, 0 failed avg: 848ms, p95: 2557ms
apollo-router 166 5157 total, 0 failed avg: 966ms, p95: 2628ms
hive-gateway-bun 87 2863 total, 0 failed avg: 3201ms, p95: 5657ms
hive-gateway 79 2653 total, 0 failed avg: 3542ms, p95: 22829ms
apollo-server 75 2554 total, 0 failed avg: 3710ms, p95: 31816ms
mercurius 67 2192 total, 0 failed avg: 4210ms, p95: 7235ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16716      ✗ 0    
     data_received..................: 491 MB  16 MB/s
     data_sent......................: 6.6 MB  215 kB/s
     http_req_blocked...............: avg=1.71ms   min=1.68µs  med=4.33µs   max=2.87s  p(90)=7µs      p(95)=275.63µs
     http_req_connecting............: avg=856.68µs min=0s      med=0s       max=1.76s  p(90)=0s       p(95)=160.33µs
     http_req_duration..............: avg=773.86ms min=4.16ms  med=530.57ms max=6.68s  p(90)=1.94s    p(95)=2.45s   
       { expected_response:true }...: avg=773.86ms min=4.16ms  med=530.57ms max=6.68s  p(90)=1.94s    p(95)=2.45s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5592 
     http_req_receiving.............: avg=333.43ms min=35.52µs med=104.63µs max=5.7s   p(90)=1.17s    p(95)=1.99s   
     http_req_sending...............: avg=34.7ms   min=8.16µs  med=23.93µs  max=3.4s   p(90)=813.9µs  p(95)=54.36ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=405.72ms min=4.02ms  med=342.6ms  max=2.07s  p(90)=830.61ms p(95)=952.01ms
     http_reqs......................: 5592    181.052451/s
     iteration_duration.............: avg=1.62s    min=21.78ms med=1.17s    max=11.27s p(90)=3.69s    p(95)=4.44s   
     iterations.....................: 5572    180.40491/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16077      ✗ 0    
     data_received..................: 473 MB  15 MB/s
     data_sent......................: 6.4 MB  207 kB/s
     http_req_blocked...............: avg=1.01ms   min=1.43µs  med=3.2µs    max=1.81s  p(90)=5.03µs   p(95)=288.97µs
     http_req_connecting............: avg=801.67µs min=0s      med=0s       max=1.81s  p(90)=0s       p(95)=234.33µs
     http_req_duration..............: avg=848.17ms min=3.58ms  med=555ms    max=6.55s  p(90)=2.14s    p(95)=2.55s   
       { expected_response:true }...: avg=848.17ms min=3.58ms  med=555ms    max=6.55s  p(90)=2.14s    p(95)=2.55s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5379 
     http_req_receiving.............: avg=377.48ms min=33.37µs med=81.75µs  max=5.83s  p(90)=1.56s    p(95)=2.09s   
     http_req_sending...............: avg=16.22ms  min=7.6µs   med=14.39µs  max=2.65s  p(90)=131.49µs p(95)=1.11ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=454.47ms min=3.51ms  med=299.12ms max=2.89s  p(90)=1.07s    p(95)=1.4s    
     http_reqs......................: 5379    174.198411/s
     iteration_duration.............: avg=1.69s    min=22.67ms med=1.3s     max=10.71s p(90)=3.87s    p(95)=4.64s   
     iterations.....................: 5359    173.550713/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15411      ✗ 0    
     data_received..................: 453 MB  15 MB/s
     data_sent......................: 6.1 MB  197 kB/s
     http_req_blocked...............: avg=1.13ms   min=1.46µs  med=3.27µs   max=1.88s    p(90)=5.73µs   p(95)=2.85ms 
     http_req_connecting............: avg=668.06µs min=0s      med=0s       max=764.81ms p(90)=0s       p(95)=2.42ms 
     http_req_duration..............: avg=965.71ms min=6.99ms  med=701.29ms max=6s       p(90)=2.28s    p(95)=2.62s  
       { expected_response:true }...: avg=965.71ms min=6.99ms  med=701.29ms max=6s       p(90)=2.28s    p(95)=2.62s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5157 
     http_req_receiving.............: avg=398.68ms min=33.49µs med=89.74µs  max=5.05s    p(90)=1.75s    p(95)=2.17s  
     http_req_sending...............: avg=20.73ms  min=8.16µs  med=14.7µs   max=3.4s     p(90)=394.69µs p(95)=10.34ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=546.29ms min=6.92ms  med=469.65ms max=2.58s    p(90)=1.06s    p(95)=1.37s  
     http_reqs......................: 5157    166.014043/s
     iteration_duration.............: avg=1.77s    min=35.37ms med=1.51s    max=9.2s     p(90)=3.63s    p(95)=4.48s  
     iterations.....................: 5137    165.370204/s
     vus............................: 60      min=60       max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8529      ✗ 0    
     data_received..................: 251 MB  7.7 MB/s
     data_sent......................: 3.4 MB  104 kB/s
     http_req_blocked...............: avg=689.82µs min=1.69µs   med=4.25µs  max=48.31ms  p(90)=187.23µs p(95)=5.75ms  
     http_req_connecting............: avg=612.17µs min=0s       med=0s      max=27.9ms   p(90)=91.81µs  p(95)=5.18ms  
     http_req_duration..............: avg=3.2s     min=15.3ms   med=3s      max=8.92s    p(90)=4.79s    p(95)=5.65s   
       { expected_response:true }...: avg=3.2s     min=15.3ms   med=3s      max=8.92s    p(90)=4.79s    p(95)=5.65s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2863 
     http_req_receiving.............: avg=41.43ms  min=40.47µs  med=123.2µs max=2.48s    p(90)=26.5ms   p(95)=276.91ms
     http_req_sending...............: avg=1.12ms   min=8.55µs   med=22.78µs max=263.41ms p(90)=223.06µs p(95)=1.56ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.15s    min=15.06ms  med=2.98s   max=8.92s    p(90)=4.75s    p(95)=5.61s   
     http_reqs......................: 2863    87.761515/s
     iteration_duration.............: avg=3.28s    min=114.94ms med=3.04s   max=8.93s    p(90)=4.88s    p(95)=5.69s   
     iterations.....................: 2843    87.148441/s
     vus............................: 107     min=107     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7899      ✗ 0    
     data_received..................: 233 MB  7.0 MB/s
     data_sent......................: 3.1 MB  94 kB/s
     http_req_blocked...............: avg=434.92µs min=1.63µs  med=4.34µs   max=26.9ms  p(90)=200.39µs p(95)=3.16ms  
     http_req_connecting............: avg=412.49µs min=0s      med=0s       max=26.87ms p(90)=159.99µs p(95)=2.91ms  
     http_req_duration..............: avg=3.54s    min=15.21ms med=1.71s    max=32.85s  p(90)=3.13s    p(95)=22.82s  
       { expected_response:true }...: avg=3.54s    min=15.21ms med=1.71s    max=32.85s  p(90)=3.13s    p(95)=22.82s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2653 
     http_req_receiving.............: avg=536.3µs  min=46.41µs med=111.43µs max=127.8ms p(90)=352.43µs p(95)=564.71µs
     http_req_sending...............: avg=125.16µs min=9.23µs  med=24.38µs  max=34.24ms p(90)=147.67µs p(95)=498.84µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.54s    min=15.07ms med=1.71s    max=32.85s  p(90)=3.13s    p(95)=22.82s  
     http_reqs......................: 2653    79.540251/s
     iteration_duration.............: avg=3.58s    min=147.5ms med=1.73s    max=32.86s  p(90)=3.18s    p(95)=23.11s  
     iterations.....................: 2633    78.940626/s
     vus............................: 34      min=34      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7602      ✗ 0    
     data_received..................: 225 MB  6.7 MB/s
     data_sent......................: 3.0 MB  90 kB/s
     http_req_blocked...............: avg=567.91µs min=1.51µs   med=3.14µs   max=34.09ms p(90)=637.48µs p(95)=4.88ms  
     http_req_connecting............: avg=530.61µs min=0s       med=0s       max=21.71ms p(90)=566.78µs p(95)=4.7ms   
     http_req_duration..............: avg=3.71s    min=13.49ms  med=1.58s    max=33.23s  p(90)=3.34s    p(95)=31.81s  
       { expected_response:true }...: avg=3.71s    min=13.49ms  med=1.58s    max=33.23s  p(90)=3.34s    p(95)=31.81s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2554 
     http_req_receiving.............: avg=148.09µs min=47.09µs  med=108.11µs max=14ms    p(90)=167.52µs p(95)=194.69µs
     http_req_sending...............: avg=193.22µs min=8.77µs   med=16.47µs  max=28.15ms p(90)=140.76µs p(95)=910.35µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.7s     min=13.39ms  med=1.58s    max=33.23s  p(90)=3.34s    p(95)=31.81s  
     http_reqs......................: 2554    75.712101/s
     iteration_duration.............: avg=3.75s    min=267.08ms med=1.61s    max=33.24s  p(90)=3.59s    p(95)=31.83s  
     iterations.....................: 2534    75.11921/s
     vus............................: 70      min=70      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 6516      ✗ 0    
     data_received..................: 192 MB  5.9 MB/s
     data_sent......................: 2.6 MB  80 kB/s
     http_req_blocked...............: avg=575.54µs min=1.48µs   med=3.67µs   max=49.34ms  p(90)=1.05ms   p(95)=4.03ms  
     http_req_connecting............: avg=527.18µs min=0s       med=0s       max=37.84ms  p(90)=899.33µs p(95)=3.77ms  
     http_req_duration..............: avg=4.2s     min=16.25ms  med=4.13s    max=9.64s    p(90)=5.12s    p(95)=7.23s   
       { expected_response:true }...: avg=4.2s     min=16.25ms  med=4.13s    max=9.64s    p(90)=5.12s    p(95)=7.23s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2192 
     http_req_receiving.............: avg=11.55ms  min=40.62µs  med=107.92µs max=587.18ms p(90)=226.07µs p(95)=581.43µs
     http_req_sending...............: avg=212.17µs min=9.34µs   med=19.48µs  max=16.35ms  p(90)=342.02µs p(95)=1.22ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=4.19s    min=16.13ms  med=4.13s    max=9.64s    p(90)=5.12s    p(95)=7.23s   
     http_reqs......................: 2192    67.717512/s
     iteration_duration.............: avg=4.27s    min=147.46ms med=4.15s    max=9.65s    p(90)=5.14s    p(95)=7.26s   
     iterations.....................: 2172    67.099651/s
     vus............................: 128     min=128     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Jan 6, 2025

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 2000 concurrent VUs over 60s

Comparison

Comparison

Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 7665ms 183 12938 total, 0 failed avg: 2558ms, p95: 7666ms, max: 19267ms, med: 1942ms
apollo-router 8031ms 165 11864 total, 0 failed avg: 2898ms, p95: 8032ms, max: 17652ms, med: 2352ms
grafbase 8475ms 170 12276 total, 0 failed avg: 3039ms, p95: 8476ms, max: 17502ms, med: 2441ms
hive-gateway-bun 26842ms 97 7770 total, 0 failed avg: 10880ms, p95: 26843ms, max: 40077ms, med: 9580ms
mercurius 39933ms 50 4612 total, 0 failed avg: 23207ms, p95: 39934ms, max: 41944ms, med: 25225ms
hive-gateway 50692ms 82 7238 total, 0 failed avg: 12793ms, p95: 50692ms, max: 57763ms, med: 3908ms
apollo-server 60000ms 77 7228 total, 559 failed avg: 12873ms, p95: 60000ms, max: 60089ms, med: 2322ms ❌ 559 failed requests, 559 non-200 responses, 559 unexpected GraphQL errors
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 38754      ✗ 0     
     data_received..................: 1.1 GB  16 MB/s
     data_sent......................: 15 MB   218 kB/s
     http_req_blocked...............: avg=234.8ms  min=1.52µs  med=3.45µs  max=10.83s p(90)=221.33ms p(95)=2.08s   
     http_req_connecting............: avg=231.35ms min=0s      med=0s      max=9.5s   p(90)=206.64ms p(95)=2.08s   
     http_req_duration..............: avg=2.55s    min=3.59ms  med=1.94s   max=19.26s p(90)=5.64s    p(95)=7.66s   
       { expected_response:true }...: avg=2.55s    min=3.59ms  med=1.94s   max=19.26s p(90)=5.64s    p(95)=7.66s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 12938 
     http_req_receiving.............: avg=489.9ms  min=34.15µs med=82.7µs  max=12.27s p(90)=1.15s    p(95)=3.2s    
     http_req_sending...............: avg=161.88ms min=7.4µs   med=15.85µs max=12.31s p(90)=235.98ms p(95)=891.17ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.9s     min=3.49ms  med=1.26s   max=10.24s p(90)=4.86s    p(95)=5.54s   
     http_reqs......................: 12938   183.873461/s
     iteration_duration.............: avg=5.53s    min=17.86ms med=4.64s   max=32.39s p(90)=11.7s    p(95)=13.72s  
     iterations.....................: 12918   183.589223/s
     vus............................: 374     min=69       max=1971
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 35532      ✗ 0     
     data_received..................: 1.0 GB  15 MB/s
     data_sent......................: 14 MB   197 kB/s
     http_req_blocked...............: avg=304.05ms min=1.57µs  med=3.64µs  max=9.03s  p(90)=579.89ms p(95)=2.84s   
     http_req_connecting............: avg=301.44ms min=0s      med=0s      max=9.03s  p(90)=565.48ms p(95)=2.83s   
     http_req_duration..............: avg=2.89s    min=6.92ms  med=2.35s   max=17.65s p(90)=6.56s    p(95)=8.03s   
       { expected_response:true }...: avg=2.89s    min=6.92ms  med=2.35s   max=17.65s p(90)=6.56s    p(95)=8.03s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 11864 
     http_req_receiving.............: avg=790.86ms min=33.79µs med=93.69µs max=11.69s p(90)=3.48s    p(95)=4.67s   
     http_req_sending...............: avg=110.94ms min=7.96µs  med=17.35µs max=9.43s  p(90)=132.57ms p(95)=570.69ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.99s    min=6.84ms  med=1.7s    max=11.08s p(90)=4.25s    p(95)=4.66s   
     http_reqs......................: 11864   165.834956/s
     iteration_duration.............: avg=6.3s     min=26.66ms med=4.71s   max=32.17s p(90)=14.09s   p(95)=18.09s  
     iterations.....................: 11844   165.555396/s
     vus............................: 463     min=67       max=1981
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 36768      ✗ 0     
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   203 kB/s
     http_req_blocked...............: avg=361.68ms min=1.66µs  med=3.5µs   max=10.46s p(90)=742.42ms p(95)=2.84s   
     http_req_connecting............: avg=357.63ms min=0s      med=0s      max=10.45s p(90)=740.62ms p(95)=2.8s    
     http_req_duration..............: avg=3.03s    min=3.52ms  med=2.44s   max=17.5s  p(90)=6.92s    p(95)=8.47s   
       { expected_response:true }...: avg=3.03s    min=3.52ms  med=2.44s   max=17.5s  p(90)=6.92s    p(95)=8.47s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 12276 
     http_req_receiving.............: avg=750.37ms min=33.09µs med=92.69µs max=14.82s p(90)=2.53s    p(95)=5.41s   
     http_req_sending...............: avg=100.3ms  min=8.1µs   med=15.99µs max=7.39s  p(90)=129.85ms p(95)=636.92ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.18s    min=3.45ms  med=1.61s   max=13.53s p(90)=4.76s    p(95)=5.6s    
     http_reqs......................: 12276   170.992844/s
     iteration_duration.............: avg=6.08s    min=28.36ms med=4.96s   max=31.19s p(90)=12.69s   p(95)=14.99s  
     iterations.....................: 12256   170.714264/s
     vus............................: 70      min=64       max=1956
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 23250     ✗ 0     
     data_received..................: 682 MB  8.5 MB/s
     data_sent......................: 9.2 MB  115 kB/s
     http_req_blocked...............: avg=10.63ms  min=1.82µs  med=5.21µs   max=618.38ms p(90)=10.15ms p(95)=67.06ms
     http_req_connecting............: avg=10.18ms  min=0s      med=0s       max=605.54ms p(90)=9.85ms  p(95)=66.32ms
     http_req_duration..............: avg=10.88s   min=16.63ms med=9.57s    max=40.07s   p(90)=22.77s  p(95)=26.84s 
       { expected_response:true }...: avg=10.88s   min=16.63ms med=9.57s    max=40.07s   p(90)=22.77s  p(95)=26.84s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 7770  
     http_req_receiving.............: avg=160.49ms min=39.17µs med=137.87µs max=7.53s    p(90)=97.97ms p(95)=1.19s  
     http_req_sending...............: avg=8.22ms   min=9.38µs  med=28.99µs  max=1.52s    p(90)=3.2ms   p(95)=28.31ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=10.71s   min=16.44ms med=9.18s    max=37.12s   p(90)=22.62s  p(95)=26.76s 
     http_reqs......................: 7770    97.160437/s
     iteration_duration.............: avg=11.29s   min=91.01ms med=9.85s    max=40.76s   p(90)=23.34s  p(95)=27.85s 
     iterations.....................: 7750    96.910346/s
     vus............................: 172     min=55      max=1999
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 13756     ✗ 0     
     data_received..................: 405 MB  4.5 MB/s
     data_sent......................: 5.5 MB  60 kB/s
     http_req_blocked...............: avg=225.26µs min=2.03µs   med=5.96µs   max=24.12ms p(90)=516.68µs p(95)=569.93µs
     http_req_connecting............: avg=188.42µs min=0s       med=0s       max=24.03ms p(90)=438.51µs p(95)=487.05µs
     http_req_duration..............: avg=23.2s    min=15.01ms  med=25.22s   max=41.94s  p(90)=38.18s   p(95)=39.93s  
       { expected_response:true }...: avg=23.2s    min=15.01ms  med=25.22s   max=41.94s  p(90)=38.18s   p(95)=39.93s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 4612  
     http_req_receiving.............: avg=49.98ms  min=38.27µs  med=143.58µs max=1.36s   p(90)=9.08ms   p(95)=538.13ms
     http_req_sending...............: avg=59.39µs  min=9.13µs   med=37.69µs  max=12.76ms p(90)=78.89µs  p(95)=93.93µs 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=23.15s   min=14.86ms  med=25.22s   max=41.94s  p(90)=38.14s   p(95)=39.93s  
     http_reqs......................: 4612    50.76521/s
     iteration_duration.............: avg=23.37s   min=155.76ms med=25.29s   max=41.95s  p(90)=38.49s   p(95)=40.04s  
     iterations.....................: 4584    50.457009/s
     vus............................: 101     min=53      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 21654     ✗ 0     
     data_received..................: 636 MB  7.2 MB/s
     data_sent......................: 8.6 MB  98 kB/s
     http_req_blocked...............: avg=2.63ms min=2.14µs   med=5.4µs    max=351.73ms p(90)=631.67µs p(95)=9.91ms  
     http_req_connecting............: avg=2.57ms min=0s       med=0s       max=317.78ms p(90)=539.51µs p(95)=9.47ms  
     http_req_duration..............: avg=12.79s min=13.64ms  med=3.9s     max=57.76s   p(90)=44.34s   p(95)=50.69s  
       { expected_response:true }...: avg=12.79s min=13.64ms  med=3.9s     max=57.76s   p(90)=44.34s   p(95)=50.69s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 7238  
     http_req_receiving.............: avg=1.44ms min=42.56µs  med=123.85µs max=281.51ms p(90)=946.92µs p(95)=6.2ms   
     http_req_sending...............: avg=1.17ms min=10µs     med=29.85µs  max=194.16ms p(90)=136.92µs p(95)=915.02µs
     http_req_tls_handshaking.......: avg=0s     min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=12.79s min=13.5ms   med=3.9s     max=57.76s   p(90)=44.34s   p(95)=50.69s  
     http_reqs......................: 7238    82.480977/s
     iteration_duration.............: avg=12.86s min=146.92ms med=3.95s    max=57.77s   p(90)=44.48s   p(95)=50.71s  
     iterations.....................: 7218    82.253066/s
     vus............................: 14      min=14      max=1999
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✗ response code was 200
      ↳  92% — ✓ 6649 / ✗ 559
     ✗ no graphql errors
      ↳  92% — ✓ 6649 / ✗ 559
     ✓ valid response structure

     █ setup

     checks.........................: 94.69% ✓ 19947     ✗ 1118  
     data_received..................: 586 MB 6.3 MB/s
     data_sent......................: 8.6 MB 93 kB/s
     http_req_blocked...............: avg=349.59µs min=1.42µs  med=3.23µs   max=87.05ms p(90)=333.3µs  p(95)=427.64µs
     http_req_connecting............: avg=324.07µs min=0s      med=0s       max=86.68ms p(90)=271.41µs p(95)=360.49µs
     http_req_duration..............: avg=12.87s   min=12.82ms med=2.32s    max=1m0s    p(90)=57.09s   p(95)=1m0s    
       { expected_response:true }...: avg=8.92s    min=12.82ms med=2.2s     max=59.98s  p(90)=38.28s   p(95)=46.44s  
     http_req_failed................: 7.73%  ✓ 559       ✗ 6669  
     http_req_receiving.............: avg=161.65µs min=0s      med=112.68µs max=91.18ms p(90)=183.68µs p(95)=245.71µs
     http_req_sending...............: avg=140.74µs min=8.4µs   med=15.56µs  max=59.98ms p(90)=60.5µs   p(95)=80.79µs 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=12.87s   min=12.71ms med=2.32s    max=1m0s    p(90)=57.09s   p(95)=1m0s    
     http_reqs......................: 7228   77.882993/s
     iteration_duration.............: avg=12.91s   min=58.92ms med=2.33s    max=1m0s    p(90)=57.15s   p(95)=1m0s    
     iterations.....................: 7208   77.66749/s
     vus............................: 22     min=22      max=2000
     vus_max........................: 2000   min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

@renovate renovate bot changed the title Update ghcr.io/graphql-hive/gateway Docker tag to v1.7.7 Update ghcr.io/graphql-hive/gateway Docker tag to v1.7.8 Jan 8, 2025
@renovate renovate bot force-pushed the renovate/ghcr.io-graphql-hive-gateway-1.x branch from ac4dbae to 4f3eb18 Compare January 8, 2025 13:35
@ardatan ardatan merged commit fee9086 into main Jan 8, 2025
34 checks passed
@renovate renovate bot deleted the renovate/ghcr.io-graphql-hive-gateway-1.x branch January 8, 2025 14:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant