Skip to content

🐛 [bq import script] - Data consistency #2265

Closed
@cabljac

Description

@cabljac

In the BQ import script, I have witnessed a bit of data inconsistency for large collections (of 5 million docs +)

This was running it with multiple threads, and with collection group query enabled.

For a collection of about 6.5 million documents I saw a discrepancy of plus or minus about 1000 documents.

I can't say how consistent this discrepancy was, as I only had a chance to run the script a couple of times on this large collection.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions