Skip to content

Native serialization for DynamicFlat index#281

Merged
razdoburdin merged 4 commits intointel:dev/razdoburdin_streamingfrom
razdoburdin:streaming/dynamicflat
Mar 6, 2026
Merged

Native serialization for DynamicFlat index#281
razdoburdin merged 4 commits intointel:dev/razdoburdin_streamingfrom
razdoburdin:streaming/dynamicflat

Conversation

@razdoburdin
Copy link
Contributor

This PR introduce native serialization for DynamicFlat index.

Main changes are:

  1. auto_dynamic_assemble now accepts lazy loader. That is mandatory for buffer-free deserialization.
  2. new class `Deserializer' is introduced. It is responsible for conditional reading of overhead data (like names of temporary files) in case of legacy models.
  3. IDTranslator is refactored to cover save and load to/from stream.

Copy link
Member

@rfsaliev rfsaliev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGFM

@razdoburdin
Copy link
Contributor Author

The failure of Integration tests isn't related to PR content. The same failure presents in other PRs.
image

@razdoburdin razdoburdin merged commit 4c0f19b into intel:dev/razdoburdin_streaming Mar 6, 2026
16 of 19 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants