Skip to content

feat: cache python packages for speedup(DOCKER_BUILDKIT=1) #41

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Mar 26, 2025

Conversation

oleksandr-nc
Copy link
Contributor

@oleksandr-nc oleksandr-nc commented Mar 26, 2025

Instead of downloading packages for ExApp in python every time, we can ask docker to keep them in a separate volume and use from there. (not much speed for skeleton, but for any program that uses PyTorch it is a huge plus)

What do you think about it?

Edited: Also changed Docker file to use stage build - to allow use this in GitHub Actions without modification.

@oleksandr-nc oleksandr-nc requested a review from kyteinsky March 26, 2025 10:43
Signed-off-by: Oleksander Piskun <[email protected]>
@oleksandr-nc oleksandr-nc force-pushed the feat/use-DOCKER_BUILDKIT branch from 65407ef to 23d2ce1 Compare March 26, 2025 13:06
Copy link

@kyteinsky kyteinsky left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sounds great!
It was a pain for dev setups when small dependencies changed and the pip install layer invalidated.

Signed-off-by: Oleksander Piskun <[email protected]>
Copy link

@kyteinsky kyteinsky left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚀

@oleksandr-nc oleksandr-nc merged commit 4d5513f into main Mar 26, 2025
3 checks passed
@oleksandr-nc oleksandr-nc deleted the feat/use-DOCKER_BUILDKIT branch March 26, 2025 17:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants