Skip to content

fix(dask): Preserve remote URIs (e.g. s3://) in DaskOfflineStore path #5208

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

predictorsSH
Copy link

… resolution

What this PR does / why we need it:

Which issue(s) this PR fixes:

Misc

@predictorsSH predictorsSH requested a review from a team as a code owner April 2, 2025 07:41
@ntkathole
Copy link
Contributor

Please sign the commit so that DCO commit pass

@predictorsSH predictorsSH force-pushed the fix/dask-offline-store-s3-path branch from e66f15e to 9356173 Compare April 3, 2025 05:12
predictorsSH and others added 3 commits April 3, 2025 14:23
… resolution

Signed-off-by: sanghyun <[email protected]>
Signed-off-by: Sanghyun Kim <[email protected]>
refactor: use FileSource.get_uri_for_file_path for remote URI resolution
Signed-off-by: Sanghyun Kim <[email protected]>
@predictorsSH predictorsSH force-pushed the fix/dask-offline-store-s3-path branch from 9356173 to 806d0c4 Compare April 3, 2025 05:24
Copy link
Contributor

@ntkathole ntkathole left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me!

@ntkathole
Copy link
Contributor

@predictorsSH There is 1 more instance in the same file where absolute path is not correctly set up https://github.com/feast-dev/feast/blob/master/sdk/python/feast/infra/offline_stores/dask.py#L472
Can you please apply the same fix for offline_write_batch method ?

@predictorsSH
Copy link
Author

Thanks! I've applied the same fix to offline_write_batch with the same logic.

@franciscojavierarceo franciscojavierarceo changed the title fix(dask): preserve remote URIs (e.g. s3://) in DaskOfflineStore path… fix(dask): Preserve remote URIs (e.g. s3://) in DaskOfflineStore path Apr 4, 2025
@franciscojavierarceo
Copy link
Member

@predictorsSH can you run the linter? make format-python?

@predictorsSH
Copy link
Author

I've applied the formatting using make format-python

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants