2021 05 10 bench results

Benchmarked on: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz, 32G RAM

Benchmark duration per suite: 300s Commit: e52aca9

Config:

GRPC_BENCHMARK_DURATION=300s
GRPC_SERVER_CPUS=<1-3>
GRPC_SERVER_RAM=512m
GRPC_CLIENT_CONNECTIONS=50
GRPC_CLIENT_CONCURRENCY=1000
GRPC_CLIENT_QPS=0
GRPC_CLIENT_CPUS=9
GRPC_REQUEST_PAYLOAD=100B

1 CPU Server

WIP

2 CPU Server

--------------------------------------------------------------------------------------------------------------------------------
| name               |   req/s |   avg. latency |        90 % in |        95 % in |        99 % in | avg. cpu |   avg. memory |
--------------------------------------------------------------------------------------------------------------------------------
| dotnet_grpc        |   65677 |       15.11 ms |       21.67 ms |       25.89 ms |       42.95 ms |  200.05% |    132.36 MiB |
| cpp_grpc_mt        |   64724 |       15.37 ms |       27.99 ms |       32.52 ms |       38.64 ms |  204.79% |     22.25 MiB |
| java_grpc_pgc      |   63075 |       15.75 ms |       62.48 ms |       77.01 ms |      106.26 ms |  203.31% |    196.53 MiB |
| rust_tonic_mt      |   59731 |       16.67 ms |       42.54 ms |       75.00 ms |      119.87 ms |   200.9% |     16.25 MiB |
| rust_grpcio        |   58300 |       17.06 ms |       22.96 ms |       24.96 ms |       31.05 ms |  202.68% |     41.52 MiB |
| java_grpc_g1gc     |   57033 |       17.41 ms |       69.22 ms |       84.24 ms |      119.44 ms |  203.82% |    180.86 MiB |
| java_grpc_she      |   52780 |       18.80 ms |       78.27 ms |       93.63 ms |      180.37 ms |   203.7% |    393.13 MiB |
| rust_thruster_mt   |   51649 |       19.29 ms |       49.43 ms |       87.63 ms |      143.30 ms |   201.4% |     14.16 MiB |
| java_grpc_zgc      |   51474 |       19.27 ms |       60.72 ms |       79.17 ms |      110.06 ms |   202.8% |    116.39 MiB |
| rust_tonic_st      |   49574 |       20.11 ms |       23.92 ms |       25.40 ms |       28.06 ms |  101.18% |     13.18 MiB |
| java_grpc_sgc      |   49324 |       20.17 ms |       57.72 ms |       78.48 ms |      131.01 ms |  200.47% |     93.66 MiB |
| rust_thruster_st   |   41674 |       23.93 ms |       28.16 ms |       29.68 ms |       32.11 ms |  101.56% |     12.12 MiB |
| go_grpc            |   38695 |       25.66 ms |       68.03 ms |       74.96 ms |       87.05 ms |  204.04% |     33.38 MiB |
| cpp_grpc_st        |   30219 |       33.03 ms |       36.36 ms |       37.55 ms |       39.64 ms |  102.39% |      8.19 MiB |
| crystal_grpc       |   22481 |       44.38 ms |       52.35 ms |       54.27 ms |       58.07 ms |   114.7% |     24.57 MiB |
| swift_grpc         |   21660 |       46.08 ms |       48.32 ms |       49.06 ms |       50.96 ms |  201.84% |      6.46 MiB |
| kotlin_grpc        |   19368 |       51.52 ms |      102.26 ms |      113.38 ms |      214.15 ms |  204.09% |    273.08 MiB |
| csharp_grpc        |   18904 |       52.79 ms |       85.25 ms |       90.65 ms |      100.93 ms |  204.73% |    109.46 MiB |
| haskell_mu         |   18269 |       54.66 ms |       71.75 ms |       75.82 ms |       84.42 ms |  203.44% |    171.33 MiB |
| java_micronaut     |   18057 |       54.75 ms |       88.67 ms |       98.57 ms |      182.88 ms |  177.53% |    481.44 MiB |
| node_grpc_st       |   12066 |       82.75 ms |       92.36 ms |       95.99 ms |      101.94 ms |  103.61% |     48.32 MiB |
| dart_grpc          |   10351 |       96.51 ms |       16.13 ms |         1.07 s |         1.19 s |  106.98% |     26.68 MiB |
| elixir_grpc        |    8298 |      120.39 ms |      140.64 ms |      147.27 ms |      160.95 ms |  203.76% |     82.73 MiB |
| node_grpcjs_st     |    7177 |      139.18 ms |      150.26 ms |      153.91 ms |      161.80 ms |  115.98% |     41.33 MiB |
| scala_akka         |    4776 |      209.10 ms |      381.94 ms |      495.42 ms |      798.40 ms |  200.29% |    174.23 MiB |
| java_aot           |    4688 |      213.02 ms |      438.45 ms |      509.42 ms |      713.40 ms |  174.08% |    264.58 MiB |
| python_grpc        |    4058 |      246.11 ms |      275.74 ms |      280.78 ms |      288.40 ms |  150.15% |      33.7 MiB |
| php_grpc           |    3922 |      254.66 ms |      289.79 ms |      290.94 ms |      293.23 ms |  205.12% |      65.4 MiB |
| ruby_grpc          |    2629 |      379.64 ms |      404.55 ms |      411.17 ms |      429.52 ms |   131.9% |     30.81 MiB |
--------------------------------------------------------------------------------------------------------------------------------

3 CPU Server

WIP