Skip to content

[M2] RocksDB persistent index storage #6

@Fosurero

Description

@Fosurero

Description

Add on-disk persistence so the optimizer index survives restarts and can handle datasets larger than RAM.

Tasks

  • Add rocksdb dependency
  • Serialize/deserialize inverted index to RocksDB
  • Incremental index updates (append-only)
  • Startup: load existing index from disk
  • Configurable data directory
  • Benchmark: disk-backed vs in-memory query performance

Acceptance Criteria

  • Index 1M blocks, restart process, query without re-indexing
  • Query latency < 2× in-memory baseline

Metadata

Metadata

Assignees

No one assigned

    Labels

    M2Milestone 2: Live NEAR Lake IntegrationenhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions