Support route to multiple nodes by speeddragon · Pull Request #1106 · permaweb/HyperBEAM

speeddragon · 2026-08-27T13:52:01Z

Based on #988, rebased on current edge.

This includes #1097, since it needs it for the gateway-shim@1.0 redirect to work.
Uses permaweb/gateway-shim-1.0#1

Config

Config example:

  "store": [
    {
      "ao-types": "store-module=atom",
      "store-module": "hb_store_remote_node",
      "access": ["read"],
      "nodes": [
          {
              "prefix": "NODE1",
              "opts": {
                  "http-reference": "REDACTED"
              }
          },
          {
              "prefix": "NODE",
              "opts": {
                  "http-reference": "REDACTED"
              }
          }
      ],
      "admissible": {
        "device": "cache-admissibility@1.0",
        "path": "expected-response",
        "decorator": { "device": "stamp-decorator@1.0" },
        "commit-hook-response": true,
        "on": {
          "admissible-response": [
            {
              "device": "relay@1.0",
              "path": "call",
              "method": "POST",
              "peer": "NODE_COLLECTOR",
              "relay-path": "/PROCCESS_ID/push"
            }
          ]
        }
      }
    }
  ]

TODO:

Run full test suite.
Extract new devices into their own repository (cache-admissibility, stamp-decorator)
Fix ARNS domains.

When deployed

Verify is-admissible is received properly by lua process.

speeddragon · 2026-08-28T13:00:21Z

        Device -> WithPrivIP#{<<"device">> => Device}
    end,
-    Host = cowboy_req:host(Req),
+    Host = cowboy_req:header(<<"host">>, Req, cowboy_req:host(Req)),


speeddragon · 2026-08-28T14:06:51Z

+        {ok, #{<<"ao-result">> := Key} = Res} ->
+            ?event(debug_multi, {admissible_result, {result, Res}}),
+            hb_util:atom(maps:get(Key, Res, false)) == true;


For HyperBEAM-to-HyperBEAM node communication, we need to know where the message is.

speeddragon · 2026-08-28T16:03:32Z

+                    [ID | Rest] when length(Rest) >= 2 ->
+                        {KeyParts, [Value]} =
+                            lists:split(length(Rest) - 1, Rest),
+                        Key =
+                            iolist_to_binary(
+                                lists:join(<<":">>, KeyParts)
+                            ),


This supports keys that contain :. Eg: qScPIDiicX8dyvkeXlyLcfNknLiNnJLqbjhdcg--a5w.

@Lucifer0x17, this isn't mandatory for this PR, right? I'm not sure why it was originally added.

it's a correctness fix from the router port for colon-containing committed field names, independent of the multi-node feature but load-bearing for the NASA flow that produced those names, and safe to keep.

some manifest were failing to load like sam.weave.space and stuff

speeddragon · 2026-08-31T17:02:55Z

+        hb_private:set(
+            Response#{ <<"path">> => Path },
+            <<"admissibility/node">>,
+            Node,
+            Opts
+        ),


Previously, we set http-reference in the Base. I don't see a clear advantage/disadvantage (maybe readability), but this avoids modifying the body.

speeddragon · 2026-08-31T17:05:28Z

+apply_decorator(Base, Req, Decorator, Opts) ->
+    DecoratorBase =
+        hb_message:without_unless_signed([<<"path">>], Decorator, Opts),
+    {ok, Decorated} =
+        hb_ao:resolve(
+            DecoratorBase,
+            Req#{ <<"path">> => <<"decorator">>, <<"body">> => Base },
+            Opts
+        ),
+    Decorated.


The goal here is to modify add to Base the http-reference configuration via dev_stamp_decorator.

Ports the feat/chance_and_router_conf router work onto post-#915 edge. Edge already carries the shared neo/edge Arweave and bundler layer, so the net delta is the router-specific work: dev_chance@1.0, the multi-node verifying read in hb_store_remote_node (parallel fan-out + cache@1.0 expected-response gate, no local store), the dev_cache trust gate, the dev_manifest b32 redirect, and host/port plumbing in hb_http. Source: feat/chance_and_router_conf. Carries four non-router fixes that auto-merged from that branch: 333a94b uncommit test_process/1 base before merging the execution stack f973947 bail from ensure_started/1 cleanly when sidecar dir is absent bb7521e symmetrical handling of `status` encoding (dev_httpsig) f70c3b8 relay-path dropped when matched at root path (dev_relay) Co-Authored-By: Sam Williams <sam@arweave.org>

…ncode)

…ification dev_meta: log the raw request singleton instead of wrapping it in hb_cache:ensure_all_loaded, which forced store reads on every request even when the http topic is off

Fire + sign on admitted reads; thread the hook config via the admissibility spec, not the runtime opts.

Thread the responding store node through the multi-read fan-out so the admissible-response push carries that node's http-reference, not empty. - hb_store_remote_node: wrap nodes as {prefix, opts} - hb_http_multi: pass the responding node into the admissibility check, stamp its http-reference onto the base - hb_http: route a {prefix} node by prefix, preserving the path

The edge port flattened the hook lookup (deep_get -> maps:get), so device-scoped hooks like on.~cache@1.0.admissible-response stopped resolving. Restore nested resolution for path-form hook names while keeping flat names on the fast direct lookup. - hb_hook: list HookName -> deep_get (walk nested); binary -> maps:get - dev_cache: fire the device-scoped path [~cache@1.0, admissible-response]; drop a redundant debug event in the async hook

https://github.com/permaweb/chance-device

The hook fires inside the multi_read fan-out, so it inherits the remote-node store. Once chance@1.0 loads as a remote device, the hook's archive read re-enters the fan-out and the relay never fires. Drop the store from the hook opts so device reads hit the node default store (local + gateway); the admissibility verify keeps the store, only the hook drops it.

speeddragon commented Aug 27, 2026

View reviewed changes

Comment thread src/preloaded/util/dev_relay.erl

speeddragon commented Aug 28, 2026

View reviewed changes

Comment thread src/preloaded/name/dev_name.erl

speeddragon commented Aug 28, 2026

View reviewed changes

Comment thread src/core/store/hb_store_remote_node.erl Outdated

speeddragon commented Aug 28, 2026

View reviewed changes

Comment thread src/core/http/hb_http_multi.erl Outdated

speeddragon commented Aug 31, 2026

View reviewed changes

speeddragon force-pushed the feat/router-node-rebased branch from 3703273 to 2b2714c Compare September 2, 2026 13:56

Lucifer0x17 and others added 20 commits September 7, 2026 17:06

fix: manifest rendering on #915 (lowercase peer headers, inline b32 e…

66a9e08

…ncode)

perf: drop eager request-event load and parallelize peer-response ver…

9462da6

…ification dev_meta: log the raw request singleton instead of wrapping it in hb_cache:ensure_all_loaded, which forced store reads on every request even when the http topic is off

fix: restore signed admissible-response push dropped in edge port

767b85e

Fire + sign on admitted reads; thread the hook config via the admissibility spec, not the runtime opts.

impr: remove chance device and use it as a remote device

5dd9d15

https://github.com/permaweb/chance-device

impr: Handle errors in logs better

396af73

impr: Handle expired certificate error

48f7e87

fix: verify remote response before commitment filtering

01eba92

fix: dev_manifest test, adding subdomain

bb4c85c

feat: Allow to set the store remote node scope

7776619

fix: Loading manifest asset via hb_store_remote_node

8e79fc4

impr: Revert genesis wasm change, not needed

cc71d2f

impr: Remove subdomain redirect from dev_manifest

9a51012

impr: Make request host to have both hostname and port

0f199d8

impr: Move comment

44274e7

impr: Reuse lower_case_keys

2089041

impr: Make variable name more readable

8884841

speeddragon added 9 commits September 7, 2026 17:06

impr: Refactor multi_read functionality in hb_store_remote_node

a920e78

impr: Make code more modular, extract some functionality to devices

d73c958

impr: decorator code

46a6ac4

impr: Update code based on CONTRIBUTING file

d64a34f

fix: Revert http header lowercase

d2225bc

impr: Remove external devices

3560e35

fix: New line

3880e40

impr: Add logs

93c1cad

fix: Make store_remote_node to use local-store cache

771aefb

speeddragon force-pushed the feat/router-node-rebased branch from 75865e8 to 771aefb Compare September 7, 2026 16:07

speeddragon marked this pull request as ready for review September 9, 2026 03:39

Navigation Menu

Uh oh!

Support route to multiple nodes - #1106

Support route to multiple nodes #1106
speeddragon wants to merge 29 commits into
edgefrom
feat/router-node-rebased

speeddragon commented Aug 27, 2026 •

edited

Loading

Uh oh!

Uh oh!

speeddragon Aug 28, 2026

Uh oh!

speeddragon Aug 28, 2026

Uh oh!

Uh oh!

speeddragon Aug 28, 2026

Uh oh!

Lucifer0x17 Sep 1, 2026

Uh oh!

Uh oh!

Uh oh!

speeddragon Aug 31, 2026

Uh oh!

speeddragon Aug 31, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

speeddragon commented Aug 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Config

TODO:

When deployed

Uh oh!

Uh oh!

speeddragon Aug 28, 2026

Choose a reason for hiding this comment

Uh oh!

speeddragon Aug 28, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

speeddragon Aug 28, 2026

Choose a reason for hiding this comment

Uh oh!

Lucifer0x17 Sep 1, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

speeddragon Aug 31, 2026

Choose a reason for hiding this comment

Uh oh!

speeddragon Aug 31, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

speeddragon commented Aug 27, 2026 •

edited

Loading