Skip to content

Compress and linearise beacon blocks on disk #3208

Open
@michaelsproul

Description

@michaelsproul

Description

Beacon blocks alone now consume around 80GB of disk space on mainnet.

I think we could be more efficient with storage by using compression. Recently I'm particularly fond of zstd compression, which is fast and could probably offer a 2-4x reduction.

The complicating factor is that compressing blocks requires a database schema upgrade, as well as a moderately sophisticated migration to copy and compress all the existing blocks.

Metadata

Metadata

Assignees

Labels

backwards-incompatBackwards-incompatible API changedatabasemajor-taskA significant amount of work or conceptual task.optimizationSomething to make Lighthouse run more efficiently.tree-statesOngoing state and database overhaul

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions