Skip to content

tech debt: benchmark storing records in memory #4464

@fraidev

Description

@fraidev

The Fluvio benchmark tool currently stores all generated records in memory during benchmarking. When running benchmarks with a high num-records value, this approach can quickly exhaust available memory, causing system instability or crashes.

Suggested Improvements:

  • Write records to a temporary file instead of keeping them entirely in memory.
  • Alternatively, generate records on-the-fly during benchmarking, avoiding large memory allocations.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions