Skip to content

Conversation

holyMolyTolli
Copy link
Contributor

No description provided.

Copy link

netlify bot commented Oct 6, 2025

Deploy Preview for condescending-goldwasser-91acf0 ready!

Name Link
🔨 Latest commit 3689404
🔍 Latest deploy log https://app.netlify.com/projects/condescending-goldwasser-91acf0/deploys/68f7182a11dd3b0008e4f747
😎 Deploy Preview https://deploy-preview-1931--condescending-goldwasser-91acf0.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@holyMolyTolli holyMolyTolli requested review from mrscoopers and removed request for thierrypdamiba October 6, 2025 18:07
@holyMolyTolli holyMolyTolli mentioned this pull request Oct 7, 2025
- Memory management for large datasets
- Monitoring and troubleshooting ingestion

*Content to be added* No newline at end of file
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@thierrypdamiba @holyMolyTolli welp, what are we doing here?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Side note about upload_collection/upload_points - they exist only for the Python client, afaik

So for the Python client, they're good for large-scale upserts cause they support lazy batching, retries & parallelism, but for other clients, upsert is the only (and good for scalable uploads) option, and it allows batching, not only individual points

So I'd add here a warning that this video is focused on the python client

Copy link
Contributor

@mrscoopers mrscoopers Oct 10, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wait, I am also lost why we're zeroing ef_construct instead of m for the initial bulk upload?
It won't work, minimum ef_construct allowed is 4 @thierrypdamiba


## Analysis Framework

### Performance Comparison
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Latencies
Bcs performance kinda builds in quality for me, and here it's not measured


You'll know you've succeeded when:

<input type="checkbox"> You've achieved measurable speed improvements (5x+ for scalar, 20x+ for binary)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Where did we take 5X from?

@kanungle
Copy link
Contributor

Can we point discord link to this instead? https://discord.com/channels/907569970500743200/1429673887590776832

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants