Skip to content

Reduce memory usage during map creation #185

Open
@JoshKarpel

Description

@JoshKarpel

Right now, we pre-process all of the map data in memory while writing the map out to disk. The primary offender is

def process_args_and_kwargs(args_and_kwargs: Iterator[Tuple[tuple, dict]]):
, but the ease of using the pre-processed data has downstream effects elsewhere.

Hopefully, we can completely remove the need for pre-processing. This would dramatically reduce memory usage during map creation.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestinternalsNon-user-facing functionality

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions