Skip to content

Commit 1fc0f94

Browse files
committed
chore: updated benchmarks
1 parent 2603c83 commit 1fc0f94

File tree

1 file changed

+67
-12
lines changed

1 file changed

+67
-12
lines changed

README.md

Lines changed: 67 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -397,25 +397,79 @@ We have written extensive benchmarks to show that :tangerine: Tangerine is as fa
397397
398398
The latest benchmark results are viewable on GitHub under this repository's [GitHub CI actions logs](https://github.com/forwardemail/tangerine/actions?query=event%3Apush):
399399
400-
> [Node 16 on ubuntu-latest](#TODO)
400+
> [Node 16 on ubuntu-latest](https://github.com/forwardemail/tangerine/actions/runs/4297805550/jobs/7491228635#step:6:1)
401401
402-
```sh
402+
```diff
403403
> node benchmarks/lookup && node benchmarks/resolve && node benchmarks/reverse
404404

405-
TODO
406-
```
405+
Started: lookup
406+
tangerine.lookup POST with caching using Cloudflare x 735 ops/sec ±195.35% (88 runs sampled)
407+
tangerine.lookup POST without caching using Cloudflare x 142 ops/sec ±0.58% (84 runs sampled)
408+
tangerine.lookup GET with caching using Cloudflare x 222,397 ops/sec ±0.52% (88 runs sampled)
409+
+tangerine.lookup GET without caching using Cloudflare x 142 ops/sec ±0.46% (83 runs sampled)
410+
dns.promises.lookup with caching using Cloudflare x 6,169,417 ops/sec ±1.67% (84 runs sampled)
411+
-dns.promises.lookup without caching using Cloudflare x 4,186 ops/sec ±0.58% (89 runs sampled)
412+
Fastest without caching is: dns.promises.lookup without caching using Cloudflare
407413

408-
> **NOTE**: HTTP library benchmark tests above are not based on real-world usage; instead they are using mock libraries such as `nock` and undici's `MockAgent`. An actual HTTP server could be implemented in these benchmarks (pull request is welcome). See [HTTP Library Benchmarks](#http-library-benchmarks) below for more insight into results with real-world servers.
414+
Started: resolve
415+
tangerine.resolve POST with caching using Cloudflare x 951 ops/sec ±195.84% (87 runs sampled)
416+
tangerine.resolve POST without caching using Cloudflare x 135 ops/sec ±1.27% (79 runs sampled)
417+
tangerine.resolve GET with caching using Cloudflare x 1,134,724 ops/sec ±0.27% (87 runs sampled)
418+
+tangerine.resolve GET without caching using Cloudflare x 135 ops/sec ±1.34% (81 runs sampled)
419+
tangerine.resolve POST with caching using Google x 1,103,189 ops/sec ±0.44% (86 runs sampled)
420+
tangerine.resolve POST without caching using Google x 55.76 ops/sec ±3.57% (80 runs sampled)
421+
tangerine.resolve GET with caching using Google x 1,140,499 ops/sec ±0.32% (87 runs sampled)
422+
tangerine.resolve GET without caching using Google x 70.51 ops/sec ±0.93% (84 runs sampled)
423+
resolver.resolve with caching using Cloudflare x 4,790,171 ops/sec ±0.43% (87 runs sampled)
424+
-resolver.resolve without caching using Cloudflare x 158 ops/sec ±1.26% (83 runs sampled)
425+
Fastest without caching is: resolver.resolve without caching using Cloudflare
409426

410-
> [Node 18 on ubuntu latest](#TODO)
427+
Started: reverse
428+
tangerine.reverse GET with caching x 771 ops/sec ±195.37% (85 runs sampled)
429+
+tangerine.reverse GET without caching x 135 ops/sec ±0.74% (81 runs sampled)
430+
resolver.reverse with caching x 5,353,130 ops/sec ±0.36% (89 runs sampled)
431+
-resolver.reverse without caching x 1.90 ops/sec ±210.52% (16 runs sampled)
432+
dns.promises.reverse with caching x 5,123,900 ops/sec ±0.96% (85 runs sampled)
433+
-dns.promises.reverse without caching x 0.29 ops/sec ±171.85% (18 runs sampled)
434+
+Fastest without caching is: tangerine.reverse GET without caching
435+
```
411436
412-
```sh
437+
> [Node 18 on ubuntu latest](https://github.com/forwardemail/tangerine/actions/runs/4297805550/jobs/7491228742#step:6:1)
438+
439+
```diff
413440
> node benchmarks/lookup && node benchmarks/resolve && node benchmarks/reverse && node benchmarks/http
414441

415-
TODO
416-
```
442+
Started: lookup
443+
tangerine.lookup POST with caching using Cloudflare x 666 ops/sec ±195.48% (87 runs sampled)
444+
tangerine.lookup POST without caching using Cloudflare x 90.81 ops/sec ±8.06% (89 runs sampled)
445+
tangerine.lookup GET with caching using Cloudflare x 256,141 ops/sec ±1.72% (87 runs sampled)
446+
+tangerine.lookup GET without caching using Cloudflare x 96.39 ops/sec ±0.31% (89 runs sampled)
447+
dns.promises.lookup with caching using Cloudflare x 1,473 ops/sec ±195.95% (87 runs sampled)
448+
-dns.promises.lookup without caching using Cloudflare x 4,191 ops/sec ±0.54% (85 runs sampled)
449+
Fastest without caching is: dns.promises.lookup without caching using Cloudflare
417450

418-
> **NOTE**: HTTP library benchmark tests above are not based on real-world usage; instead they are using mock libraries such as `nock` and undici's `MockAgent`. An actual HTTP server could be implemented in these benchmarks (pull request is welcome). See [HTTP Library Benchmarks](#http-library-benchmarks) below for more insight into results with real-world servers.
451+
Started: resolve
452+
tangerine.resolve POST with caching using Cloudflare x 683 ops/sec ±195.88% (87 runs sampled)
453+
tangerine.resolve POST without caching using Cloudflare x 93.37 ops/sec ±0.48% (87 runs sampled)
454+
tangerine.resolve GET with caching using Cloudflare x 1,146,727 ops/sec ±0.58% (88 runs sampled)
455+
+tangerine.resolve GET without caching using Cloudflare x 93.33 ops/sec ±0.51% (87 runs sampled)
456+
tangerine.resolve POST with caching using Google x 1,133,683 ops/sec ±2.74% (89 runs sampled)
457+
tangerine.resolve POST without caching using Google x 83.91 ops/sec ±6.32% (76 runs sampled)
458+
tangerine.resolve GET with caching using Google x 1,147,212 ops/sec ±0.32% (90 runs sampled)
459+
tangerine.resolve GET without caching using Google x 79.73 ops/sec ±4.02% (77 runs sampled)
460+
resolver.resolve with caching using Cloudflare x 5,318,406 ops/sec ±0.67% (86 runs sampled)
461+
-resolver.resolve without caching using Cloudflare x 100 ops/sec ±1.55% (79 runs sampled)
462+
Fastest without caching is: resolver.resolve without caching using Cloudflare
463+
464+
Started: reverse
465+
tangerine.reverse GET with caching x 722 ops/sec ±195.42% (88 runs sampled)
466+
+tangerine.reverse GET without caching x 93.19 ops/sec ±0.74% (87 runs sampled)
467+
resolver.reverse with caching x 5,520,569 ops/sec ±0.59% (85 runs sampled)
468+
-resolver.reverse without caching x 17.42 ops/sec ±162.63% (70 runs sampled)
469+
dns.promises.reverse with caching x 5,164,258 ops/sec ±0.96% (86 runs sampled)
470+
-dns.promises.reverse without caching x 0.20 ops/sec ±184.87% (25 runs sampled)
471+
+Fastest without caching is: tangerine.reverse GET without caching
472+
```
419473
420474
---
421475
@@ -453,7 +507,7 @@ tangerine.resolve GET with caching using Google x 2,885,428 ops/sec ±0.22% (88
453507
tangerine.resolve GET without caching using Google x 70.38 ops/sec ±3.72% (68 runs sampled)
454508
resolver.resolve with caching using Cloudflare x 10,645,813 ops/sec ±0.23% (91 runs sampled)
455509
-resolver.resolve without caching using Cloudflare x 71.80 ops/sec ±2.84% (67 runs sampled)
456-
Fastest without caching is: resolver.resolve without caching using Cloudflare, tangerine.resolve GET without caching using Cloudflare, tangerine.resolve GET without caching using Google, tangerine.resolve POST without caching using Cloudflare
510+
+Fastest without caching is: resolver.resolve without caching using Cloudflare, tangerine.resolve GET without caching using Cloudflare, tangerine.resolve GET without caching using Google, tangerine.resolve POST without caching using Cloudflare
457511

458512
Started: reverse
459513
tangerine.reverse GET with caching x 917 ops/sec ±195.78% (88 runs sampled)
@@ -493,7 +547,7 @@ tangerine.resolve GET with caching using Google x 2,784,199 ops/sec ±0.15% (92
493547
tangerine.resolve GET without caching using Google x 47.55 ops/sec ±5.66% (76 runs sampled)
494548
resolver.resolve with caching using Cloudflare x 0.09 ops/sec ±6.41% (5 runs sampled)
495549
-resolver.resolve without caching using Cloudflare x 0.10 ops/sec ±6.52% (5 runs sampled)
496-
Fastest without caching is: tangerine.resolve GET without caching using Google
550+
+Fastest without caching is: tangerine.resolve GET without caching using Google
497551

498552
Started: reverse
499553
tangerine.reverse GET with caching x 1,345 ops/sec ±195.66% (92 runs sampled)
@@ -502,6 +556,7 @@ resolver.reverse with caching x 0.10 ops/sec ±6.54% (5 runs sampled)
502556
-resolver.reverse without caching x 0.10 ops/sec ±0.01% (5 runs sampled)
503557
dns.promises.reverse with caching x 0.10 ops/sec ±6.54% (5 runs sampled)
504558
-dns.promises.reverse without caching x 0.10 ops/sec ±0.01% (5 runs sampled)
559+
+Fastest without caching is: tangerine.reverse GET without caching
505560
```
506561
507562
Also see this [write-up](https://samknows.com/blog/dns-over-https-performance) on UDP-based DNS versus DNS over HTTPS ("DoH") benchmarks.

0 commit comments

Comments
 (0)