Skip to content

feat(talis): add dedicated encoder instances for fibre-txsim#7059

Merged
walldiss merged 7 commits intomainfrom
feat/talis-encoder-separation
Apr 15, 2026
Merged

feat(talis): add dedicated encoder instances for fibre-txsim#7059
walldiss merged 7 commits intomainfrom
feat/talis-encoder-separation

Conversation

@walldiss
Copy link
Copy Markdown
Member

@walldiss walldiss commented Apr 13, 2026

Summary

  • Adds encoder node type to talis for running fibre-txsim on dedicated instances separate from validators
  • Each encoder gets its own keyring with unique key prefixes (enc0-*, enc1-*, ...) and independent escrow accounts
  • Encoders are round-robin mapped to validators for gRPC and upload shards to all validators
  • Frees ~2.5 GB RAM per validator by moving encoding off-box

Changes

  • config.go: Encoder NodeType, Encoders []Instance, builder methods
  • add.go: --type encoder support
  • client.go, google_cloud.go: encoders in Up/Down
  • deployment.go: deployEncodersIfConfigured via S3
  • genesis.go: encoder payload creation with init script
  • network.go: AddEncoder with unique key prefixes
  • fibre_setup.go: encoder escrow deposits
  • fibre_txsim.go: --on-encoders flag, round-robin validator mapping
  • reset.go, txsim.go: encoder cleanup

Test plan

  • go build ./tools/talis/ compiles
  • talis add -t encoder -c 3 adds encoder instances to config
  • talis up + talis deploy creates and deploys to encoder instances
  • talis fibre-txsim --on-encoders runs fibre-txsim on encoders
  • talis kill-session -s fibre-txsim kills sessions on both validators and encoders
  • talis reset cleans up encoder instances

Closes https://linear.app/celestia/issue/PROTOCO-1492/talis-add-dedicated-encoder-instances-for-fibre-txsim

🤖 Generated with Claude Code


Open with Devin

@walldiss walldiss requested a review from a team as a code owner April 13, 2026 17:42
@walldiss walldiss requested review from ninabarbakadze and removed request for a team April 13, 2026 17:42
Copy link
Copy Markdown

@claude claude Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This repository is configured for manual code reviews. Comment @claude review to trigger a review and subscribe this PR to future pushes, or @claude review once for a one-time review.

Tip: disable this comment in your organization's Code Review settings.

devin-ai-integration[bot]

This comment was marked as resolved.

devin-ai-integration[bot]

This comment was marked as resolved.

Copy link
Copy Markdown
Member

@ninabarbakadze ninabarbakadze left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lint is failing

devin-ai-integration[bot]

This comment was marked as resolved.

devin-ai-integration[bot]

This comment was marked as resolved.

ninabarbakadze
ninabarbakadze previously approved these changes Apr 15, 2026
Copy link
Copy Markdown
Member

@ninabarbakadze ninabarbakadze left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

utAck

@walldiss walldiss added this pull request to the merge queue Apr 15, 2026
Merged via the queue into main with commit 4d4f7a8 Apr 15, 2026
31 checks passed
@walldiss walldiss deleted the feat/talis-encoder-separation branch April 15, 2026 14:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants