Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Inigo Gateway #515

Open
wants to merge 8 commits into
base: main
Choose a base branch
from
Open

Add Inigo Gateway #515

wants to merge 8 commits into from

Conversation

kamilkisiela
Copy link
Contributor

@kamilkisiela kamilkisiela commented Nov 6, 2024

Inigo fails to resolve queries, returns null with no error.

Copy link

github-actions bot commented Nov 6, 2024

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 189 5864 total, 0 failed avg: 786ms, p95: 2310ms
inigo 180 5666 total, 0 failed avg: 1623ms, p95: 5466ms ❌ non-compatible response structure (5646)
apollo-router 179 5596 total, 0 failed avg: 871ms, p95: 2283ms
grafbase 174 5384 total, 0 failed avg: 870ms, p95: 2149ms
apollo-server 75 2543 total, 0 failed avg: 3696ms, p95: 31568ms
hive-gateway 74 2469 total, 0 failed avg: 3796ms, p95: 14281ms
mercurius 64 2076 total, 0 failed avg: 4435ms, p95: 7900ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 17532      ✗ 0    
     data_received..................: 515 MB  17 MB/s
     data_sent......................: 7.0 MB  225 kB/s
     http_req_blocked...............: avg=1.66ms   min=1.41µs  med=2.99µs   max=1.19s  p(90)=4.72µs   p(95)=101.06µs
     http_req_connecting............: avg=1.28ms   min=0s      med=0s       max=1.19s  p(90)=0s       p(95)=67.62µs 
     http_req_duration..............: avg=786.08ms min=3.71ms  med=605.55ms max=8.82s  p(90)=1.61s    p(95)=2.31s   
       { expected_response:true }...: avg=786.08ms min=3.71ms  med=605.55ms max=8.82s  p(90)=1.61s    p(95)=2.31s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5864 
     http_req_receiving.............: avg=317.77ms min=33.77µs med=84.16µs  max=8.06s  p(90)=1.05s    p(95)=1.64s   
     http_req_sending...............: avg=20.31ms  min=7.61µs  med=13.61µs  max=4.59s  p(90)=138.81µs p(95)=24.5ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=447.99ms min=3.59ms  med=435.54ms max=1.47s  p(90)=777.94ms p(95)=912.41ms
     http_reqs......................: 5864    189.892237/s
     iteration_duration.............: avg=1.54s    min=23.68ms med=1.15s    max=10.43s p(90)=3.36s    p(95)=4.17s   
     iterations.....................: 5844    189.244582/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `inigo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✗ valid response structure
      ↳  0% — ✓ 0 / ✗ 5646

     █ setup

     checks.........................: 66.66% ✓ 11292      ✗ 5646 
     data_received..................: 856 kB 27 kB/s
     data_sent......................: 6.7 MB 214 kB/s
     http_req_blocked...............: avg=277.02µs min=1.08µs  med=2.57µs  max=35.3ms  p(90)=4.89µs  p(95)=388.84µs
     http_req_connecting............: avg=266.48µs min=0s      med=0s      max=35.27ms p(90)=0s      p(95)=286.39µs
     http_req_duration..............: avg=1.62s    min=5.01ms  med=1.04s   max=14.89s  p(90)=4.24s   p(95)=5.46s   
       { expected_response:true }...: avg=1.62s    min=5.01ms  med=1.04s   max=14.89s  p(90)=4.24s   p(95)=5.46s   
     http_req_failed................: 0.00%  ✓ 0          ✗ 5666 
     http_req_receiving.............: avg=66.19µs  min=18.94µs med=44.22µs max=15.58ms p(90)=90.12µs p(95)=108.23µs
     http_req_sending...............: avg=102.74µs min=7.79µs  med=15.08µs max=37.58ms p(90)=40.69µs p(95)=144.52µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s      p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=1.62s    min=4.95ms  med=1.04s   max=14.89s  p(90)=4.24s   p(95)=5.46s   
     http_reqs......................: 5666   180.399334/s
     iteration_duration.............: avg=1.62s    min=6.36ms  med=1.06s   max=14.89s  p(90)=4.26s   p(95)=5.47s   
     iterations.....................: 5646   179.762555/s
     vus............................: 123    min=123      max=300
     vus_max........................: 300    min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16728      ✗ 0    
     data_received..................: 491 MB  16 MB/s
     data_sent......................: 6.6 MB  213 kB/s
     http_req_blocked...............: avg=2.19ms   min=1.55µs  med=3.08µs   max=2.79s  p(90)=5.24µs   p(95)=473.83µs
     http_req_connecting............: avg=2.12ms   min=0s      med=0s       max=2.79s  p(90)=0s       p(95)=309.93µs
     http_req_duration..............: avg=870.84ms min=5.96ms  med=671.84ms max=4.81s  p(90)=1.9s     p(95)=2.28s   
       { expected_response:true }...: avg=870.84ms min=5.96ms  med=671.84ms max=4.81s  p(90)=1.9s     p(95)=2.28s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5596 
     http_req_receiving.............: avg=324.23ms min=31.14µs med=80.25µs  max=4.3s   p(90)=1.18s    p(95)=1.74s   
     http_req_sending...............: avg=21.28ms  min=7.61µs  med=14.43µs  max=4.13s  p(90)=199.8µs  p(95)=10.85ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=525.32ms min=5.88ms  med=472.99ms max=2.1s   p(90)=972.51ms p(95)=1.07s   
     http_reqs......................: 5596    179.57503/s
     iteration_duration.............: avg=1.62s    min=36.02ms med=1.28s    max=11.84s p(90)=3.4s     p(95)=4.27s   
     iterations.....................: 5576    178.933232/s
     vus............................: 63      min=63       max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16092      ✗ 0    
     data_received..................: 473 MB  15 MB/s
     data_sent......................: 6.4 MB  207 kB/s
     http_req_blocked...............: avg=1.91ms   min=1.35µs  med=3.03µs   max=2.36s  p(90)=5.06µs   p(95)=382.73µs
     http_req_connecting............: avg=1.66ms   min=0s      med=0s       max=2.36s  p(90)=0s       p(95)=242.69µs
     http_req_duration..............: avg=870.01ms min=3ms     med=768.4ms  max=5.52s  p(90)=1.66s    p(95)=2.14s   
       { expected_response:true }...: avg=870.01ms min=3ms     med=768.4ms  max=5.52s  p(90)=1.66s    p(95)=2.14s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5384 
     http_req_receiving.............: avg=185.09ms min=32.36µs med=73.88µs  max=5.34s  p(90)=749.4ms  p(95)=1.31s   
     http_req_sending...............: avg=21.66ms  min=7.78µs  med=14.2µs   max=4.48s  p(90)=133.35µs p(95)=2.97ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=663.25ms min=2.91ms  med=650.09ms max=3.05s  p(90)=1.14s    p(95)=1.32s   
     http_reqs......................: 5384    174.268473/s
     iteration_duration.............: avg=1.68s    min=15.63ms med=1.45s    max=12.29s p(90)=3.34s    p(95)=4.04s   
     iterations.....................: 5364    173.621117/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7569      ✗ 0    
     data_received..................: 224 MB  6.7 MB/s
     data_sent......................: 3.0 MB  90 kB/s
     http_req_blocked...............: avg=573.05µs min=1.54µs   med=3.64µs   max=29.14ms  p(90)=768.2µs  p(95)=4.87ms  
     http_req_connecting............: avg=561.32µs min=0s       med=0s       max=29.03ms  p(90)=726.11µs p(95)=4.76ms  
     http_req_duration..............: avg=3.69s    min=12.73ms  med=1.46s    max=33.03s   p(90)=3.41s    p(95)=31.56s  
       { expected_response:true }...: avg=3.69s    min=12.73ms  med=1.46s    max=33.03s   p(90)=3.41s    p(95)=31.56s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2543 
     http_req_receiving.............: avg=343.76µs min=48.14µs  med=117.74µs max=226.28ms p(90)=176.41µs p(95)=203.95µs
     http_req_sending...............: avg=460.61µs min=8.85µs   med=19.56µs  max=19.78ms  p(90)=417.03µs p(95)=2.27ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.69s    min=12.65ms  med=1.46s    max=33.03s   p(90)=3.41s    p(95)=31.56s  
     http_reqs......................: 2543    75.85574/s
     iteration_duration.............: avg=3.73s    min=215.89ms med=1.48s    max=33.04s   p(90)=3.75s    p(95)=31.58s  
     iterations.....................: 2523    75.259155/s
     vus............................: 49      min=49      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7347      ✗ 0    
     data_received..................: 217 MB  6.6 MB/s
     data_sent......................: 2.9 MB  89 kB/s
     http_req_blocked...............: avg=1.2ms    min=1.67µs   med=4.26µs   max=30.98ms  p(90)=2.16ms  p(95)=12.8ms  
     http_req_connecting............: avg=1.16ms   min=0s       med=0s       max=20.56ms  p(90)=1.91ms  p(95)=12.72ms 
     http_req_duration..............: avg=3.79s    min=13.56ms  med=2.58s    max=32.44s   p(90)=4.79s   p(95)=14.28s  
       { expected_response:true }...: avg=3.79s    min=13.56ms  med=2.58s    max=32.44s   p(90)=4.79s   p(95)=14.28s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2469 
     http_req_receiving.............: avg=1.67ms   min=42.32µs  med=119.33µs max=127.19ms p(90)=1.43ms  p(95)=7.71ms  
     http_req_sending...............: avg=200.76µs min=8.96µs   med=24.42µs  max=46.35ms  p(90)=208.8µs p(95)=564.17µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=3.79s    min=13.39ms  med=2.58s    max=32.44s   p(90)=4.79s   p(95)=14.27s  
     http_reqs......................: 2469    74.743962/s
     iteration_duration.............: avg=3.85s    min=283.83ms med=2.61s    max=32.45s   p(90)=4.82s   p(95)=14.46s  
     iterations.....................: 2449    74.138502/s
     vus............................: 33      min=33      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 6168      ✗ 0    
     data_received..................: 182 MB  5.7 MB/s
     data_sent......................: 2.5 MB  77 kB/s
     http_req_blocked...............: avg=754.46µs min=1.82µs   med=4.61µs   max=17.14ms  p(90)=2.98ms   p(95)=5.73ms  
     http_req_connecting............: avg=737.3µs  min=0s       med=0s       max=17.1ms   p(90)=2.9ms    p(95)=5.6ms   
     http_req_duration..............: avg=4.43s    min=14.85ms  med=4.4s     max=10.08s   p(90)=5.54s    p(95)=7.9s    
       { expected_response:true }...: avg=4.43s    min=14.85ms  med=4.4s     max=10.08s   p(90)=5.54s    p(95)=7.9s    
     http_req_failed................: 0.00%   ✓ 0         ✗ 2076 
     http_req_receiving.............: avg=6.23ms   min=39.78µs  med=117.99µs max=530.87ms p(90)=226.47µs p(95)=510.81µs
     http_req_sending...............: avg=115.15µs min=10.38µs  med=27.42µs  max=15.75ms  p(90)=339.41µs p(95)=728.04µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=4.42s    min=14.69ms  med=4.4s     max=10.08s   p(90)=5.54s    p(95)=7.89s   
     http_reqs......................: 2076    64.660644/s
     iteration_duration.............: avg=4.49s    min=276.78ms med=4.48s    max=10.09s   p(90)=5.56s    p(95)=7.96s   
     iterations.....................: 2056    64.037709/s
     vus............................: 38      min=38      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Nov 6, 2024

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 190 5893 total, 0 failed avg: 878ms, p95: 2425ms
inigo 183 5792 total, 0 failed avg: 1593ms, p95: 5143ms ❌ non-compatible response structure (5772)
apollo-router 176 5571 total, 0 failed avg: 806ms, p95: 2320ms
grafbase 170 5240 total, 0 failed avg: 842ms, p95: 2808ms
apollo-server 75 2576 total, 0 failed avg: 3700ms, p95: 32007ms
hive-gateway 73 2429 total, 0 failed avg: 3866ms, p95: 15308ms
mercurius 65 2114 total, 0 failed avg: 4356ms, p95: 7238ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 17619      ✗ 0    
     data_received..................: 517 MB  17 MB/s
     data_sent......................: 7.0 MB  226 kB/s
     http_req_blocked...............: avg=1.16ms   min=1.51µs  med=3µs      max=921.83ms p(90)=4.92µs   p(95)=1.5ms   
     http_req_connecting............: avg=1.11ms   min=0s      med=0s       max=921.77ms p(90)=0s       p(95)=309.68µs
     http_req_duration..............: avg=878.43ms min=3.69ms  med=690.02ms max=6s       p(90)=1.92s    p(95)=2.42s   
       { expected_response:true }...: avg=878.43ms min=3.69ms  med=690.02ms max=6s       p(90)=1.92s    p(95)=2.42s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5893 
     http_req_receiving.............: avg=299.93ms min=34.05µs med=78.21µs  max=5.79s    p(90)=1.1s     p(95)=1.89s   
     http_req_sending...............: avg=18.75ms  min=7.83µs  med=14.03µs  max=3.85s    p(90)=141.06µs p(95)=13.48ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=559.75ms min=3.59ms  med=514.95ms max=2.88s    p(90)=1.04s    p(95)=1.24s   
     http_reqs......................: 5893    190.642213/s
     iteration_duration.............: avg=1.55s    min=18.35ms med=1.17s    max=9.27s    p(90)=3.3s     p(95)=4.05s   
     iterations.....................: 5873    189.995201/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `inigo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✗ valid response structure
      ↳  0% — ✓ 0 / ✗ 5772

     █ setup

     checks.........................: 66.66% ✓ 11544      ✗ 5772 
     data_received..................: 875 kB 28 kB/s
     data_sent......................: 6.9 MB 218 kB/s
     http_req_blocked...............: avg=227.82µs min=1.21µs  med=2.21µs  max=23.58ms p(90)=3.38µs  p(95)=121.27µs
     http_req_connecting............: avg=216.97µs min=0s      med=0s      max=23.54ms p(90)=0s      p(95)=92.82µs 
     http_req_duration..............: avg=1.59s    min=4.89ms  med=1.1s    max=16.47s  p(90)=3.98s   p(95)=5.14s   
       { expected_response:true }...: avg=1.59s    min=4.89ms  med=1.1s    max=16.47s  p(90)=3.98s   p(95)=5.14s   
     http_req_failed................: 0.00%  ✓ 0          ✗ 5792 
     http_req_receiving.............: avg=45.14µs  min=16.52µs med=34.15µs max=7.44ms  p(90)=58.99µs p(95)=68.66µs 
     http_req_sending...............: avg=121.73µs min=7.18µs  med=12.56µs max=27.04ms p(90)=30.1µs  p(95)=266.94µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s      p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=1.59s    min=4.86ms  med=1.1s    max=16.47s  p(90)=3.98s   p(95)=5.14s   
     http_reqs......................: 5792   183.825075/s
     iteration_duration.............: avg=1.59s    min=5.33ms  med=1.1s    max=16.47s  p(90)=3.99s   p(95)=5.15s   
     iterations.....................: 5772   183.19032/s
     vus............................: 143    min=143      max=300
     vus_max........................: 300    min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16653      ✗ 0    
     data_received..................: 489 MB  16 MB/s
     data_sent......................: 6.6 MB  210 kB/s
     http_req_blocked...............: avg=1.76ms   min=1.44µs  med=3.36µs   max=1.02s p(90)=6.03µs   p(95)=1.03ms  
     http_req_connecting............: avg=1.55ms   min=0s      med=0s       max=1.02s p(90)=0s       p(95)=731.92µs
     http_req_duration..............: avg=806.32ms min=6.08ms  med=570.07ms max=6.05s p(90)=1.79s    p(95)=2.32s   
       { expected_response:true }...: avg=806.32ms min=6.08ms  med=570.07ms max=6.05s p(90)=1.79s    p(95)=2.32s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5571 
     http_req_receiving.............: avg=320.17ms min=29.79µs med=83.79µs  max=3.83s p(90)=1.25s    p(95)=1.76s   
     http_req_sending...............: avg=26.21ms  min=8.2µs   med=14.8µs   max=3.79s p(90)=279.58µs p(95)=48.96ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=459.92ms min=6.01ms  med=423.56ms max=2.28s p(90)=836.53ms p(95)=1.02s   
     http_reqs......................: 5571    176.91887/s
     iteration_duration.............: avg=1.64s    min=30.24ms med=1.31s    max=9.35s p(90)=3.38s    p(95)=4.1s    
     iterations.....................: 5551    176.283728/s
     vus............................: 201     min=201      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15660      ✗ 0    
     data_received..................: 460 MB  15 MB/s
     data_sent......................: 6.2 MB  202 kB/s
     http_req_blocked...............: avg=1ms      min=1.39µs  med=3.4µs    max=2.23s   p(90)=5.75µs   p(95)=194.61µs
     http_req_connecting............: avg=275.71µs min=0s      med=0s       max=577.8ms p(90)=0s       p(95)=130.93µs
     http_req_duration..............: avg=842.38ms min=3.99ms  med=408.93ms max=7.18s   p(90)=2.3s     p(95)=2.8s    
       { expected_response:true }...: avg=842.38ms min=3.99ms  med=408.93ms max=7.18s   p(90)=2.3s     p(95)=2.8s    
     http_req_failed................: 0.00%   ✓ 0          ✗ 5240 
     http_req_receiving.............: avg=486.62ms min=32.69µs med=107.21µs max=5.81s   p(90)=1.73s    p(95)=2.26s   
     http_req_sending...............: avg=18.77ms  min=8.14µs  med=15.21µs  max=2.68s   p(90)=172.49µs p(95)=11.17ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=336.98ms min=3.9ms   med=256.38ms max=3.03s   p(90)=639.25ms p(95)=1.05s   
     http_reqs......................: 5240    170.028343/s
     iteration_duration.............: avg=1.72s    min=19.01ms med=1.04s    max=10.72s  p(90)=4.32s    p(95)=5.25s   
     iterations.....................: 5220    169.37938/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7668      ✗ 0    
     data_received..................: 226 MB  6.6 MB/s
     data_sent......................: 3.1 MB  90 kB/s
     http_req_blocked...............: avg=549.92µs min=1.41µs   med=3.45µs   max=26.91ms p(90)=529.42µs p(95)=2.94ms  
     http_req_connecting............: avg=511.82µs min=0s       med=0s       max=26.85ms p(90)=447.85µs p(95)=2.63ms  
     http_req_duration..............: avg=3.69s    min=12.56ms  med=1.44s    max=33.53s  p(90)=3.08s    p(95)=32s     
       { expected_response:true }...: avg=3.69s    min=12.56ms  med=1.44s    max=33.53s  p(90)=3.08s    p(95)=32s     
     http_req_failed................: 0.00%   ✓ 0         ✗ 2576 
     http_req_receiving.............: avg=160.99µs min=43.83µs  med=111.49µs max=26.42ms p(90)=172.68µs p(95)=208.03µs
     http_req_sending...............: avg=168.93µs min=8.56µs   med=18.38µs  max=19.39ms p(90)=133.66µs p(95)=520.86µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.69s    min=12.47ms  med=1.44s    max=33.53s  p(90)=3.08s    p(95)=32s     
     http_reqs......................: 2576    75.639317/s
     iteration_duration.............: avg=3.74s    min=232.02ms med=1.46s    max=33.56s  p(90)=3.28s    p(95)=32.06s  
     iterations.....................: 2556    75.052055/s
     vus............................: 10      min=10      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7227      ✗ 0    
     data_received..................: 213 MB  6.4 MB/s
     data_sent......................: 2.9 MB  87 kB/s
     http_req_blocked...............: avg=2.74ms   min=1.72µs   med=4.64µs   max=34.95ms  p(90)=19.13ms  p(95)=25.5ms 
     http_req_connecting............: avg=2.71ms   min=0s       med=0s       max=34.88ms  p(90)=19.07ms  p(95)=25.43ms
     http_req_duration..............: avg=3.86s    min=12.72ms  med=2.56s    max=32.52s   p(90)=4.67s    p(95)=15.3s  
       { expected_response:true }...: avg=3.86s    min=12.72ms  med=2.56s    max=32.52s   p(90)=4.67s    p(95)=15.3s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2429 
     http_req_receiving.............: avg=6.17ms   min=41.12µs  med=120.67µs max=517.05ms p(90)=2.51ms   p(95)=14.28ms
     http_req_sending...............: avg=251.26µs min=9.2µs    med=25.46µs  max=48.43ms  p(90)=466.66µs p(95)=1.1ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=3.85s    min=12.61ms  med=2.55s    max=32.48s   p(90)=4.67s    p(95)=15.3s  
     http_reqs......................: 2429    73.386962/s
     iteration_duration.............: avg=3.92s    min=485.97ms med=2.61s    max=32.58s   p(90)=4.71s    p(95)=15.59s 
     iterations.....................: 2409    72.782705/s
     vus............................: 33      min=33      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 6282      ✗ 0    
     data_received..................: 186 MB  5.8 MB/s
     data_sent......................: 2.5 MB  78 kB/s
     http_req_blocked...............: avg=1.32ms   min=1.46µs   med=3.43µs   max=31.34ms  p(90)=3.34ms   p(95)=12.29ms 
     http_req_connecting............: avg=741.08µs min=0s       med=0s       max=18.06ms  p(90)=336.61µs p(95)=7.54ms  
     http_req_duration..............: avg=4.35s    min=14.11ms  med=4.4s     max=9.68s    p(90)=5.23s    p(95)=7.23s   
       { expected_response:true }...: avg=4.35s    min=14.11ms  med=4.4s     max=9.68s    p(90)=5.23s    p(95)=7.23s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2114 
     http_req_receiving.............: avg=1.28ms   min=42.42µs  med=105.24µs max=224.49ms p(90)=219.48µs p(95)=356.69µs
     http_req_sending...............: avg=1.15ms   min=9.14µs   med=20.22µs  max=37.91ms  p(90)=180.54µs p(95)=16.19ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=4.35s    min=14.01ms  med=4.4s     max=9.68s    p(90)=5.23s    p(95)=7.23s   
     http_reqs......................: 2114    65.811084/s
     iteration_duration.............: avg=4.41s    min=161.73ms med=4.42s    max=9.69s    p(90)=5.24s    p(95)=7.27s   
     iterations.....................: 2094    65.188463/s
     vus............................: 56      min=56      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Nov 6, 2024

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
inigo 279 8811 total, 0 failed avg: 1741ms, p95: 5765ms ❌ non-compatible response structure (8791)
cosmo 185 5873 total, 0 failed avg: 1348ms, p95: 3939ms
apollo-router 170 5403 total, 0 failed avg: 1326ms, p95: 3398ms
grafbase 170 5372 total, 0 failed avg: 1641ms, p95: 5404ms
hive-gateway 86 3009 total, 0 failed avg: 5303ms, p95: 32750ms
apollo-server 78 2813 total, 0 failed avg: 5793ms, p95: 33850ms
mercurius 65 2147 total, 0 failed avg: 7265ms, p95: 12405ms
Summary for: `inigo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✗ valid response structure
      ↳  0% — ✓ 0 / ✗ 8791

     █ setup

     checks.........................: 66.66% ✓ 17582      ✗ 8791 
     data_received..................: 1.3 MB 42 kB/s
     data_sent......................: 11 MB  332 kB/s
     http_req_blocked...............: avg=1.57ms   min=1.02µs med=2.05µs  max=59.26ms p(90)=3.44µs  p(95)=10.06ms 
     http_req_connecting............: avg=1.54ms   min=0s     med=0s      max=52.06ms p(90)=0s      p(95)=9.85ms  
     http_req_duration..............: avg=1.74s    min=4.89ms med=1.13s   max=15.05s  p(90)=4.43s   p(95)=5.76s   
       { expected_response:true }...: avg=1.74s    min=4.89ms med=1.13s   max=15.05s  p(90)=4.43s   p(95)=5.76s   
     http_req_failed................: 0.00%  ✓ 0          ✗ 8811 
     http_req_receiving.............: avg=49.45µs  min=16.3µs med=33.68µs max=15.21ms p(90)=58.14µs p(95)=68.39µs 
     http_req_sending...............: avg=150.98µs min=7.73µs med=12.5µs  max=37.77ms p(90)=28.97µs p(95)=399.11µs
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s      max=0s      p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=1.74s    min=4.85ms med=1.13s   max=15.05s  p(90)=4.43s   p(95)=5.76s   
     http_reqs......................: 8811   279.461285/s
     iteration_duration.............: avg=1.74s    min=9.03ms med=1.13s   max=15.05s  p(90)=4.44s   p(95)=5.77s   
     iterations.....................: 8791   278.826938/s
     vus............................: 229    min=229      max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 17559      ✗ 0    
     data_received..................: 515 MB  16 MB/s
     data_sent......................: 7.0 MB  221 kB/s
     http_req_blocked...............: avg=2.66ms   min=1.46µs med=3.15µs   max=2.06s  p(90)=10.74µs p(95)=9.16ms
     http_req_connecting............: avg=1.85ms   min=0s     med=0s       max=1.53s  p(90)=0s      p(95)=8.66ms
     http_req_duration..............: avg=1.34s    min=3.63ms med=996.67ms max=8.41s  p(90)=3.36s   p(95)=3.93s 
       { expected_response:true }...: avg=1.34s    min=3.63ms med=996.67ms max=8.41s  p(90)=3.36s   p(95)=3.93s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 5873 
     http_req_receiving.............: avg=456.49ms min=35µs   med=83.27µs  max=6.85s  p(90)=1.67s   p(95)=3.03s 
     http_req_sending...............: avg=52.03ms  min=7.43µs med=14.08µs  max=6.04s  p(90)=1.13ms  p(95)=30.5ms
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s     p(90)=0s      p(95)=0s    
     http_req_waiting...............: avg=839.67ms min=3.55ms med=756.26ms max=3.78s  p(90)=1.65s   p(95)=1.95s 
     http_reqs......................: 5873    185.796652/s
     iteration_duration.............: avg=2.58s    min=23.1ms med=2.01s    max=12.72s p(90)=5.61s   p(95)=6.78s 
     iterations.....................: 5853    185.163937/s
     vus............................: 263     min=263      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16149      ✗ 0    
     data_received..................: 474 MB  15 MB/s
     data_sent......................: 6.4 MB  203 kB/s
     http_req_blocked...............: avg=3.46ms   min=1.4µs   med=3.26µs   max=2.4s   p(90)=13.54µs  p(95)=18.69ms
     http_req_connecting............: avg=3.15ms   min=0s      med=0s       max=2.4s   p(90)=0s       p(95)=17.99ms
     http_req_duration..............: avg=1.32s    min=6.28ms  med=1.06s    max=8.68s  p(90)=2.47s    p(95)=3.39s  
       { expected_response:true }...: avg=1.32s    min=6.28ms  med=1.06s    max=8.68s  p(90)=2.47s    p(95)=3.39s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5403 
     http_req_receiving.............: avg=360.83ms min=31.89µs med=85.9µs   max=7.53s  p(90)=1.37s    p(95)=2.06s  
     http_req_sending...............: avg=35.8ms   min=8.07µs  med=15.24µs  max=5.62s  p(90)=955.58µs p(95)=24.1ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=929.86ms min=6.22ms  med=844.41ms max=4.46s  p(90)=1.71s    p(95)=2.16s  
     http_reqs......................: 5403    170.992145/s
     iteration_duration.............: avg=2.83s    min=36.78ms med=2.31s    max=13.34s p(90)=5.88s    p(95)=7.08s  
     iterations.....................: 5383    170.359192/s
     vus............................: 299     min=299      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16056      ✗ 0    
     data_received..................: 472 MB  15 MB/s
     data_sent......................: 6.4 MB  202 kB/s
     http_req_blocked...............: avg=4.7ms    min=1.61µs  med=3.17µs   max=5.16s  p(90)=13.08µs  p(95)=13.17ms
     http_req_connecting............: avg=3.69ms   min=0s      med=0s       max=1.78s  p(90)=0s       p(95)=12.82ms
     http_req_duration..............: avg=1.64s    min=3.81ms  med=1.14s    max=11.41s p(90)=4.16s    p(95)=5.4s   
       { expected_response:true }...: avg=1.64s    min=3.81ms  med=1.14s    max=11.41s p(90)=4.16s    p(95)=5.4s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5372 
     http_req_receiving.............: avg=833.3ms  min=33.59µs med=106.68µs max=10.24s p(90)=2.96s    p(95)=4.22s  
     http_req_sending...............: avg=25.02ms  min=7.04µs  med=14.96µs  max=7.29s  p(90)=456.28µs p(95)=2.67ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=783.11ms min=3.72ms  med=690.95ms max=2.98s  p(90)=1.65s    p(95)=2.03s  
     http_reqs......................: 5372    170.034593/s
     iteration_duration.............: avg=2.86s    min=18.9ms  med=2.24s    max=16.7s  p(90)=6.72s    p(95)=8.26s  
     iterations.....................: 5352    169.401552/s
     vus............................: 285     min=285      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8967      ✗ 0    
     data_received..................: 264 MB  7.6 MB/s
     data_sent......................: 3.6 MB  103 kB/s
     http_req_blocked...............: avg=6.49ms min=1.72µs   med=4.06µs  max=146.75ms p(90)=19.78ms p(95)=53.76ms
     http_req_connecting............: avg=6.39ms min=0s       med=0s      max=146.7ms  p(90)=19.16ms p(95)=53.23ms
     http_req_duration..............: avg=5.3s   min=12.26ms  med=2.57s   max=34.27s   p(90)=13.45s  p(95)=32.75s 
       { expected_response:true }...: avg=5.3s   min=12.26ms  med=2.57s   max=34.27s   p(90)=13.45s  p(95)=32.75s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 3009 
     http_req_receiving.............: avg=6.15ms min=42.19µs  med=97.95µs max=678.25ms p(90)=1.66ms  p(95)=10.06ms
     http_req_sending...............: avg=4.18ms min=9.74µs   med=22.04µs max=352.18ms p(90)=12.91ms p(95)=25.25ms
     http_req_tls_handshaking.......: avg=0s     min=0s       med=0s      max=0s       p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=5.29s  min=12.17ms  med=2.57s   max=34.27s   p(90)=13.44s  p(95)=32.74s 
     http_reqs......................: 3009    86.361894/s
     iteration_duration.............: avg=5.38s  min=323.13ms med=2.62s   max=34.38s   p(90)=13.6s   p(95)=32.97s 
     iterations.....................: 2989    85.78787/s
     vus............................: 82      min=82      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8379      ✗ 0    
     data_received..................: 247 MB  6.9 MB/s
     data_sent......................: 3.3 MB  93 kB/s
     http_req_blocked...............: avg=3.26ms   min=1.49µs   med=3.5µs    max=44.34ms p(90)=8.54ms   p(95)=31.39ms 
     http_req_connecting............: avg=3.21ms   min=0s       med=0s       max=44.29ms p(90)=8.19ms   p(95)=31.25ms 
     http_req_duration..............: avg=5.79s    min=12.78ms  med=1.55s    max=35.41s  p(90)=32.11s   p(95)=33.84s  
       { expected_response:true }...: avg=5.79s    min=12.78ms  med=1.55s    max=35.41s  p(90)=32.11s   p(95)=33.84s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2813 
     http_req_receiving.............: avg=270.75µs min=47.75µs  med=114.75µs max=44.22ms p(90)=179.67µs p(95)=232.59µs
     http_req_sending...............: avg=205.33µs min=9.06µs   med=18.84µs  max=32.39ms p(90)=754.45µs p(95)=1.15ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=5.79s    min=12.66ms  med=1.55s    max=35.41s  p(90)=32.11s   p(95)=33.84s  
     http_reqs......................: 2813    78.306855/s
     iteration_duration.............: avg=5.84s    min=370.62ms med=1.56s    max=35.41s  p(90)=32.18s   p(95)=33.87s  
     iterations.....................: 2793    77.750105/s
     vus............................: 90      min=90      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 6381      ✗ 0    
     data_received..................: 188 MB  5.7 MB/s
     data_sent......................: 2.5 MB  77 kB/s
     http_req_blocked...............: avg=6.56ms  min=1.5µs    med=3.85µs   max=71.92ms  p(90)=29.53ms  p(95)=42.82ms
     http_req_connecting............: avg=6.39ms  min=0s       med=0s       max=71.88ms  p(90)=29.21ms  p(95)=40.31ms
     http_req_duration..............: avg=7.26s   min=14.47ms  med=7.71s    max=14.47s   p(90)=9.9s     p(95)=12.4s  
       { expected_response:true }...: avg=7.26s   min=14.47ms  med=7.71s    max=14.47s   p(90)=9.9s     p(95)=12.4s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2147 
     http_req_receiving.............: avg=13.57ms min=37.14µs  med=109.26µs max=503.13ms p(90)=332.12µs p(95)=14.7ms 
     http_req_sending...............: avg=2.82ms  min=8.35µs   med=21.17µs  max=70.13ms  p(90)=6.9ms    p(95)=12.24ms
     http_req_tls_handshaking.......: avg=0s      min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=7.24s   min=14.39ms  med=7.71s    max=14.47s   p(90)=9.89s    p(95)=12.4s  
     http_reqs......................: 2147    65.035078/s
     iteration_duration.............: avg=7.37s   min=147.25ms med=7.75s    max=14.53s   p(90)=10.02s   p(95)=12.42s 
     iterations.....................: 2127    64.429255/s
     vus............................: 12      min=12      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Nov 6, 2024

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 2000 concurrent VUs over 60s

Comparison

Comparison

Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 5752ms 173 12187 total, 0 failed avg: 2580ms, p95: 5752ms, max: 12955ms, med: 2212ms
apollo-router 5977ms 165 11601 total, 0 failed avg: 2442ms, p95: 5977ms, max: 12556ms, med: 1956ms
grafbase 7043ms 169 12020 total, 0 failed avg: 2721ms, p95: 7044ms, max: 19135ms, med: 1904ms
inigo 14461ms 279 19726 total, 0 failed avg: 3805ms, p95: 14462ms, max: 42886ms, med: 1707ms ❌ non-compatible response structure (19706)
mercurius 39186ms 53 4861 total, 0 failed avg: 21652ms, p95: 39187ms, max: 40350ms, med: 23132ms
hive-gateway 49566ms 88 7676 total, 0 failed avg: 11898ms, p95: 49566ms, max: 56652ms, med: 3734ms
apollo-server 60000ms 75 7023 total, 583 failed avg: 13259ms, p95: 60000ms, max: 60188ms, med: 2349ms ❌ 583 failed requests, 583 non-200 responses, 583 unexpected GraphQL errors
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 36501      ✗ 0     
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   206 kB/s
     http_req_blocked...............: avg=288.22ms min=1.74µs  med=4.59µs  max=10.79s p(90)=815.63ms p(95)=2.19s   
     http_req_connecting............: avg=284.72ms min=0s      med=0s      max=10.79s p(90)=784.66ms p(95)=2.1s    
     http_req_duration..............: avg=2.57s    min=3.58ms  med=2.21s   max=12.95s p(90)=5.18s    p(95)=5.75s   
       { expected_response:true }...: avg=2.57s    min=3.58ms  med=2.21s   max=12.95s p(90)=5.18s    p(95)=5.75s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 12187 
     http_req_receiving.............: avg=369.7ms  min=34.66µs med=106.4µs max=12.33s p(90)=1.1s     p(95)=3.08s   
     http_req_sending...............: avg=146.82ms min=8.65µs  med=26.22µs max=9.02s  p(90)=367.95ms p(95)=902.26ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.06s    min=3.5ms   med=1.61s   max=9.23s  p(90)=4.54s    p(95)=5.15s   
     http_reqs......................: 12187   173.733366/s
     iteration_duration.............: avg=5.93s    min=9.87ms  med=5.24s   max=28.85s p(90)=11.68s   p(95)=14.11s  
     iterations.....................: 12167   173.448254/s
     vus............................: 155     min=60       max=1960
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 34743      ✗ 0     
     data_received..................: 1.0 GB  15 MB/s
     data_sent......................: 14 MB   196 kB/s
     http_req_blocked...............: avg=247.4ms  min=1.89µs  med=4.21µs  max=10.68s p(90)=311.94ms p(95)=1.95s 
     http_req_connecting............: avg=242.79ms min=0s      med=0s      max=9.27s  p(90)=278.06ms p(95)=1.95s 
     http_req_duration..............: avg=2.44s    min=6.79ms  med=1.95s   max=12.55s p(90)=5.27s    p(95)=5.97s 
       { expected_response:true }...: avg=2.44s    min=6.79ms  med=1.95s   max=12.55s p(90)=5.27s    p(95)=5.97s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 11601 
     http_req_receiving.............: avg=577.37ms min=27.36µs med=97.82µs max=6.32s  p(90)=2.45s    p(95)=3.69s 
     http_req_sending...............: avg=155.04ms min=8.16µs  med=22.04µs max=5.5s   p(90)=238.18ms p(95)=1.04s 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=1.71s    min=6.59ms  med=1.38s   max=9.63s  p(90)=4.23s    p(95)=5.1s  
     http_reqs......................: 11601   165.147143/s
     iteration_duration.............: avg=6.1s     min=13.7ms  med=5.27s   max=26.14s p(90)=12.69s   p(95)=14.62s
     iterations.....................: 11581   164.862431/s
     vus............................: 20      min=20       max=1901
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 36000      ✗ 0     
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 14 MB   201 kB/s
     http_req_blocked...............: avg=292.46ms min=1.7µs   med=3.77µs  max=13.56s p(90)=703.73ms p(95)=1.82s   
     http_req_connecting............: avg=287.05ms min=0s      med=0s      max=7.78s  p(90)=666.98ms p(95)=1.81s   
     http_req_duration..............: avg=2.72s    min=3.71ms  med=1.9s    max=19.13s p(90)=5.91s    p(95)=7.04s   
       { expected_response:true }...: avg=2.72s    min=3.71ms  med=1.9s    max=19.13s p(90)=5.91s    p(95)=7.04s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 12020 
     http_req_receiving.............: avg=704.6ms  min=31.86µs med=87.06µs max=12.46s p(90)=2.4s     p(95)=4.27s   
     http_req_sending...............: avg=184.47ms min=8.42µs  med=18.2µs  max=12.29s p(90)=334.63ms p(95)=991.29ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.83s    min=3.64ms  med=1.46s   max=9.17s  p(90)=3.81s    p(95)=4.74s   
     http_reqs......................: 12020   169.19586/s
     iteration_duration.............: avg=5.87s    min=18.76ms med=4.53s   max=33.02s p(90)=12.58s   p(95)=16.28s  
     iterations.....................: 12000   168.914336/s
     vus............................: 214     min=65       max=1936
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `inigo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✗ valid response structure
      ↳  0% — ✓ 0 / ✗ 19706

     █ setup

     checks.........................: 66.66% ✓ 39412      ✗ 19706 
     data_received..................: 3.0 MB 42 kB/s
     data_sent......................: 23 MB  332 kB/s
     http_req_blocked...............: avg=51.03µs min=1.03µs  med=2.28µs  max=32.24ms p(90)=143.72µs p(95)=228.86µs
     http_req_connecting............: avg=41.96µs min=0s      med=0s      max=32.18ms p(90)=97.49µs  p(95)=157.54µs
     http_req_duration..............: avg=3.8s    min=5ms     med=1.7s    max=42.88s  p(90)=10.85s   p(95)=14.46s  
       { expected_response:true }...: avg=3.8s    min=5ms     med=1.7s    max=42.88s  p(90)=10.85s   p(95)=14.46s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 19726 
     http_req_receiving.............: avg=48.38µs min=16.48µs med=35.05µs max=24.11ms p(90)=56.84µs  p(95)=66.54µs 
     http_req_sending...............: avg=31.67µs min=6.72µs  med=12.62µs max=24.44ms p(90)=34.54µs  p(95)=46.72µs 
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.8s    min=4.95ms  med=1.7s    max=42.88s  p(90)=10.85s   p(95)=14.46s  
     http_reqs......................: 19726  279.407307/s
     iteration_duration.............: avg=3.8s    min=7.83ms  med=1.71s   max=42.88s  p(90)=10.86s   p(95)=14.46s  
     iterations.....................: 19706  279.124018/s
     vus............................: 339    min=63       max=1993
     vus_max........................: 2000   min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14523     ✗ 0     
     data_received..................: 427 MB  4.7 MB/s
     data_sent......................: 5.8 MB  64 kB/s
     http_req_blocked...............: avg=191.2µs  min=1.58µs   med=4.72µs   max=23.21ms  p(90)=477.51µs p(95)=525.67µs
     http_req_connecting............: avg=159.01µs min=0s       med=0s       max=23.15ms  p(90)=401.48µs p(95)=450.45µs
     http_req_duration..............: avg=21.65s   min=14.43ms  med=23.13s   max=40.34s   p(90)=37.49s   p(95)=39.18s  
       { expected_response:true }...: avg=21.65s   min=14.43ms  med=23.13s   max=40.34s   p(90)=37.49s   p(95)=39.18s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 4861  
     http_req_receiving.............: avg=6.57ms   min=42.49µs  med=119.63µs max=642.57ms p(90)=281.4µs  p(95)=581.69µs
     http_req_sending...............: avg=51.53µs  min=8.77µs   med=29.7µs   max=11.19ms  p(90)=70.75µs  p(95)=82.81µs 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=21.64s   min=14.33ms  med=23.13s   max=40.34s   p(90)=37.49s   p(95)=39.18s  
     http_reqs......................: 4861    53.790784/s
     iteration_duration.............: avg=21.79s   min=108.74ms med=23.19s   max=40.39s   p(90)=37.62s   p(95)=39.21s  
     iterations.....................: 4841    53.569468/s
     vus............................: 17      min=0       max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 22968     ✗ 0     
     data_received..................: 674 MB  7.8 MB/s
     data_sent......................: 9.1 MB  105 kB/s
     http_req_blocked...............: avg=3.75ms min=2.2µs    med=5.06µs   max=492.56ms p(90)=1.26ms   p(95)=16.59ms
     http_req_connecting............: avg=3.63ms min=0s       med=0s       max=272.47ms p(90)=909.2µs  p(95)=16.24ms
     http_req_duration..............: avg=11.89s min=13.27ms  med=3.73s    max=56.65s   p(90)=42.67s   p(95)=49.56s 
       { expected_response:true }...: avg=11.89s min=13.27ms  med=3.73s    max=56.65s   p(90)=42.67s   p(95)=49.56s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 7676  
     http_req_receiving.............: avg=2.38ms min=44.05µs  med=115.56µs max=341.96ms p(90)=988.59µs p(95)=6.57ms 
     http_req_sending...............: avg=2.26ms min=9.36µs   med=27.52µs  max=241.41ms p(90)=187.35µs p(95)=7.22ms 
     http_req_tls_handshaking.......: avg=0s     min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=11.89s min=13.14ms  med=3.72s    max=56.65s   p(90)=42.64s   p(95)=49.55s 
     http_reqs......................: 7676    88.793347/s
     iteration_duration.............: avg=11.97s min=115.38ms med=3.79s    max=56.67s   p(90)=42.73s   p(95)=49.6s  
     iterations.....................: 7656    88.561994/s
     vus............................: 104     min=52      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✗ response code was 200
      ↳  91% — ✓ 6420 / ✗ 583
     ✗ no graphql errors
      ↳  91% — ✓ 6420 / ✗ 583
     ✓ valid response structure

     █ setup

     checks.........................: 94.29% ✓ 19260     ✗ 1166  
     data_received..................: 566 MB 6.1 MB/s
     data_sent......................: 8.4 MB 91 kB/s
     http_req_blocked...............: avg=585.78µs min=1.47µs  med=4.15µs   max=157.18ms p(90)=376.97µs p(95)=492.1µs 
     http_req_connecting............: avg=557.75µs min=0s      med=0s       max=156.87ms p(90)=302.79µs p(95)=413.3µs 
     http_req_duration..............: avg=13.25s   min=12.89ms med=2.34s    max=1m0s     p(90)=57.94s   p(95)=1m0s    
       { expected_response:true }...: avg=9.02s    min=12.89ms med=2.27s    max=59.96s   p(90)=38.52s   p(95)=44.88s  
     http_req_failed................: 8.30%  ✓ 583       ✗ 6440  
     http_req_receiving.............: avg=280.97µs min=0s      med=116.66µs max=293.32ms p(90)=187.21µs p(95)=260.27µs
     http_req_sending...............: avg=273.55µs min=8.6µs   med=22.67µs  max=99.23ms  p(90)=67.94µs  p(95)=101.52µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=13.25s   min=12.79ms med=2.34s    max=1m0s     p(90)=57.94s   p(95)=1m0s    
     http_reqs......................: 7023   75.677799/s
     iteration_duration.............: avg=13.3s    min=61.56ms med=2.36s    max=1m0s     p(90)=58s      p(95)=1m0s    
     iterations.....................: 7003   75.462285/s
     vus............................: 9      min=9       max=2000
     vus_max........................: 2000   min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants