Skip to content

Add b+ tree secondary indexing for fast search and retrieval #20

@gorarakelyan

Description

@gorarakelyan
  • B+ tree data structure to hold indexes and pointers
  • Provide an appropriate API for indexing

Where it will be used
In main panel:

  • when selecting runs which have accuracy greater than 0.9
  • when selecting specific epochs and iterations of runs
  • selecting by any other field

Notes
aimrecords is not aware of the data model scheme and actual data that it receives and stores(it gets encoded binary records), so for secondary indexing the field key: value should be passed. An appropriate API should be provided e.g

writer.append_record(data, secondary_index={
  value: v, # it will hold secondary index by value
  epoch: e, # it will hold secondary index by epoch
  …
})

Metadata

Metadata

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions