feat: add shared memory for DDP data deduplication

[ori-kron-wis]

No description provided.

[codecov]

Codecov Report

❌ Patch coverage is 47.20497% with 85 lines in your changes missing coverage. Please review.
✅ Project coverage is 88.13%. Comparing base (4acf2f7) to head (1b58047).
⚠️ Report is 1 commits behind head on main.

Files with missing lines	Patch %	Lines
src/scvi/dataloaders/_shared_memory.py	45.65%	75 Missing ⚠️
src/scvi/dataloaders/_data_splitting.py	56.52%	10 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #3754      +/-   ##
==========================================
- Coverage   88.21%   88.13%   -0.09%     
==========================================
  Files         229      230       +1     
  Lines       22622    23219     +597     
==========================================
+ Hits        19957    20465     +508     
- Misses       2665     2754      +89     

Flag	Coverage Δ
integration	71.28% <47.20%> (+0.20%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines	Coverage Δ
src/scvi/dataloaders/_data_splitting.py	92.56% <56.52%> (-3.37%)	⬇️
src/scvi/dataloaders/_shared_memory.py	45.65% <45.65%> (ø)

... and 3 files with indirect coverage changes

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.